2023-12-24T19:46:39.519 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-24T19:46:39.519 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi --owner scheduled_yuriw@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --archive /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456 --verbose -- /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456/orig.config.yaml 2023-12-24T19:46:39.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-24T19:46:39.654 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456 branch: wip-yuri4-testing-2023-12-21-0917-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: null first_in_suite: false job_id: '7500456' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-yuri4-testing-2023-12-21-0917-quincy ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-12-21-0917-quincy sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9956 sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f sleep_before_teardown: 0 subset: 908/1024 suite: fs suite_branch: wip-yuri4-testing-2023-12-21-0917-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f targets: smithi061.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMKTiZ5La285rjy8lxT50C4HZdGqhb70oICSSBxPGanEXRMwsUk6v4+rc+RciNaqN451D18zfIee11G2zsOiSAk= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNThfGfMMmLySKD43rbOrpUGeIIpUwnVsBwmooAy/5Y68xtPz/UoaPRWfSn2BcWTQNG/SoB5/2WPj7qKElA51ZY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9680d2aba1e76f64ade295c81599c97907457848 timestamp: 2023-12-24_15:41:15 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-24T19:46:39.655 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/qa; will attempt to use it 2023-12-24T19:46:39.655 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/qa/tasks 2023-12-24T19:46:39.655 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-24T19:46:39.657 INFO:teuthology.task.internal:Checking packages... 2023-12-24T19:46:39.681 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f' 2023-12-24T19:46:39.681 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-24T19:46:39.681 INFO:teuthology.packaging:ref: None 2023-12-24T19:46:39.681 INFO:teuthology.packaging:tag: None 2023-12-24T19:46:39.681 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-12-21-0917-quincy 2023-12-24T19:46:39.681 INFO:teuthology.packaging:sha1: 5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f 2023-12-24T19:46:39.681 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri4-testing-2023-12-21-0917-quincy 2023-12-24T19:46:39.819 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-168.g5e7ce129 2023-12-24T19:46:39.820 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-24T19:46:39.829 INFO:teuthology.task.internal:no buildpackages task found 2023-12-24T19:46:39.829 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-24T19:46:39.864 INFO:teuthology.task.internal:Saving configuration 2023-12-24T19:46:39.882 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-24T19:46:39.894 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-24T19:46:39.919 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-24 19:41:28.259133', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMKTiZ5La285rjy8lxT50C4HZdGqhb70oICSSBxPGanEXRMwsUk6v4+rc+RciNaqN451D18zfIee11G2zsOiSAk='} 2023-12-24T19:46:39.940 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-24 19:41:28.261071', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNThfGfMMmLySKD43rbOrpUGeIIpUwnVsBwmooAy/5Y68xtPz/UoaPRWfSn2BcWTQNG/SoB5/2WPj7qKElA51ZY='} 2023-12-24T19:46:39.940 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-24T19:46:39.949 INFO:teuthology.task.internal:roles: ubuntu@smithi061.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-24T19:46:39.949 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-24T19:46:39.950 INFO:teuthology.run_tasks:Running task console_log... 2023-12-24T19:46:40.050 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f08e2f3ae50>, signals=[15]) 2023-12-24T19:46:40.050 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-24T19:46:40.058 INFO:teuthology.task.internal:Opening connections... 2023-12-24T19:46:40.059 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:46:40.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T19:46:40.131 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:46:40.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T19:46:40.198 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-24T19:46:40.206 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-12-24T19:46:40.228 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-12-24T19:46:40.228 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-12-24T19:46:40.288 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.6 (Ootpa)" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.6" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-24T19:46:40.289 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-24T19:46:40.290 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-24T19:46:40.290 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-24T19:46:40.290 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-12-24T19:46:40.311 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-12-24T19:46:40.331 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-12-24T19:46:40.331 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-24T19:46:40.391 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:46:40.392 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-24T19:46:40.392 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-24T19:46:40.392 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-24T19:46:40.392 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-24T19:46:40.392 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-12-24T19:46:40.411 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-24T19:46:40.422 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-24T19:46:40.450 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-24T19:46:40.450 DEBUG:teuthology.orchestra.run.smithi061:> test '!' -e /home/ubuntu/cephtest 2023-12-24T19:46:40.453 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2023-12-24T19:46:40.472 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-24T19:46:40.486 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-24T19:46:40.486 DEBUG:teuthology.orchestra.run.smithi061:> test -z $(ls -A /var/lib/ceph) 2023-12-24T19:46:40.513 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2023-12-24T19:46:40.551 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-24T19:46:40.607 INFO:teuthology.run_tasks:Running task kernel... 2023-12-24T19:46:40.623 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-24T19:46:40.623 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-24T19:46:40.623 DEBUG:teuthology.orchestra.run.smithi061:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-24T19:46:40.624 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-24T19:46:40.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:46:40.642 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-12-24T19:46:40.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:46:40.644 DEBUG:teuthology.orchestra.run.smithi061:> uname -r 2023-12-24T19:46:40.701 INFO:teuthology.orchestra.run.smithi133.stdout:4.18.0-513.9.1.el8_9.x86_64 2023-12-24T19:46:40.701 INFO:teuthology.task.kernel:Running kernel on smithi133: 4.18.0-513.9.1.el8_9.x86_64 2023-12-24T19:46:40.701 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum install -y kernel 2023-12-24T19:46:40.705 INFO:teuthology.orchestra.run.smithi061.stdout:4.18.0-513.9.1.el8_9.x86_64 2023-12-24T19:46:40.705 INFO:teuthology.task.kernel:Running kernel on smithi061: 4.18.0-513.9.1.el8_9.x86_64 2023-12-24T19:46:40.705 DEBUG:teuthology.orchestra.run.smithi061:> sudo yum install -y kernel 2023-12-24T19:46:42.279 INFO:teuthology.orchestra.run.smithi061.stdout:Updating Subscription Management repositories. 2023-12-24T19:46:42.279 INFO:teuthology.orchestra.run.smithi061.stdout:Unable to read consumer identity 2023-12-24T19:46:42.325 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-12-24T19:46:42.325 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2023-12-24T19:46:42.589 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:46:42.590 INFO:teuthology.orchestra.run.smithi061.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-24T19:46:42.590 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:46:42.640 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:46:42.640 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-24T19:46:42.641 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:46:44.325 INFO:teuthology.orchestra.run.smithi061.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-12-24T19:46:44.417 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-12-24T19:46:44.959 INFO:teuthology.orchestra.run.smithi061.stdout:Extra Packages for Enterprise Linux 26 MB/s | 16 MB 00:00 2023-12-24T19:46:48.742 INFO:teuthology.orchestra.run.smithi061.stdout:lab-extras 453 kB/s | 24 kB 00:00 2023-12-24T19:46:49.512 INFO:teuthology.orchestra.run.smithi061.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2023-12-24T19:46:49.512 INFO:teuthology.orchestra.run.smithi061.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-12-24T19:46:49.580 INFO:teuthology.orchestra.run.smithi061.stdout:Dependencies resolved. 2023-12-24T19:46:49.581 INFO:teuthology.orchestra.run.smithi061.stdout:Nothing to do. 2023-12-24T19:46:49.581 INFO:teuthology.orchestra.run.smithi061.stdout:Complete! 2023-12-24T19:46:49.705 DEBUG:teuthology.orchestra.run.smithi061:> echo no | sudo yum reinstall kernel || true 2023-12-24T19:46:50.060 INFO:teuthology.orchestra.run.smithi061.stdout:Updating Subscription Management repositories. 2023-12-24T19:46:50.060 INFO:teuthology.orchestra.run.smithi061.stdout:Unable to read consumer identity 2023-12-24T19:46:50.305 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:46:50.305 INFO:teuthology.orchestra.run.smithi061.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-24T19:46:50.305 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:46:50.635 INFO:teuthology.orchestra.run.smithi061.stdout:Last metadata expiration check: 0:00:02 ago on Sun 24 Dec 2023 07:46:48 PM UTC. 2023-12-24T19:46:50.711 INFO:teuthology.orchestra.run.smithi061.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-24T19:46:50.711 INFO:teuthology.orchestra.run.smithi061.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-24T19:46:50.759 INFO:teuthology.orchestra.run.smithi061.stderr:Error: No packages marked for reinstall. 2023-12-24T19:46:50.808 DEBUG:teuthology.orchestra.run.smithi061:> sudo yum reinstall -y kernel || true 2023-12-24T19:46:51.162 INFO:teuthology.orchestra.run.smithi061.stdout:Updating Subscription Management repositories. 2023-12-24T19:46:51.162 INFO:teuthology.orchestra.run.smithi061.stdout:Unable to read consumer identity 2023-12-24T19:46:51.388 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:46:51.388 INFO:teuthology.orchestra.run.smithi061.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-24T19:46:51.388 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:46:51.706 INFO:teuthology.orchestra.run.smithi061.stdout:Last metadata expiration check: 0:00:03 ago on Sun 24 Dec 2023 07:46:48 PM UTC. 2023-12-24T19:46:51.778 INFO:teuthology.orchestra.run.smithi061.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-24T19:46:51.778 INFO:teuthology.orchestra.run.smithi061.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-24T19:46:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:Error: No packages marked for reinstall. 2023-12-24T19:46:51.861 DEBUG:teuthology.orchestra.run.smithi061:> rpm -q kernel | sort -rV | head -n 1 2023-12-24T19:46:52.034 INFO:teuthology.orchestra.run.smithi061.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2023-12-24T19:46:52.035 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2023-12-24T19:46:52.035 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-12-24T19:46:52.035 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-24T19:46:52.035 DEBUG:teuthology.orchestra.run.smithi061:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-24T19:46:52.074 INFO:teuthology.orchestra.run.smithi061.stdout:ttyS1 2023-12-24T19:46:52.091 DEBUG:teuthology.parallel:result is None 2023-12-24T19:47:00.367 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 16 MB 00:15 2023-12-24T19:47:04.016 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 638 kB/s | 24 kB 00:00 2023-12-24T19:47:04.744 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2023-12-24T19:47:04.744 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-12-24T19:47:04.822 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-24T19:47:04.823 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2023-12-24T19:47:04.823 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-24T19:47:04.966 DEBUG:teuthology.orchestra.run.smithi133:> echo no | sudo yum reinstall kernel || true 2023-12-24T19:47:05.305 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-12-24T19:47:05.305 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2023-12-24T19:47:05.579 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:47:05.579 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-24T19:47:05.579 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:47:05.890 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:02 ago on Sun 24 Dec 2023 07:47:03 PM UTC. 2023-12-24T19:47:05.981 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-24T19:47:05.985 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-24T19:47:06.026 INFO:teuthology.orchestra.run.smithi133.stderr:Error: No packages marked for reinstall. 2023-12-24T19:47:06.073 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum reinstall -y kernel || true 2023-12-24T19:47:06.407 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-12-24T19:47:06.408 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2023-12-24T19:47:06.621 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:47:06.621 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-24T19:47:06.621 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:47:06.929 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:03 ago on Sun 24 Dec 2023 07:47:03 PM UTC. 2023-12-24T19:47:06.991 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-12-24T19:47:06.992 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-24T19:47:07.033 INFO:teuthology.orchestra.run.smithi133.stderr:Error: No packages marked for reinstall. 2023-12-24T19:47:07.085 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2023-12-24T19:47:07.244 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2023-12-24T19:47:07.244 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2023-12-24T19:47:07.244 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-12-24T19:47:07.245 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-24T19:47:07.245 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-24T19:47:07.280 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2023-12-24T19:47:07.297 DEBUG:teuthology.parallel:result is None 2023-12-24T19:47:07.297 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-24T19:47:07.304 INFO:teuthology.task.internal:Creating test directory... 2023-12-24T19:47:07.304 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-24T19:47:07.307 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-24T19:47:07.354 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-24T19:47:07.361 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-24T19:47:07.384 INFO:teuthology.task.internal:Creating archive directory... 2023-12-24T19:47:07.385 DEBUG:teuthology.orchestra.run.smithi061:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-24T19:47:07.387 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-24T19:47:07.429 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-24T19:47:07.436 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-24T19:47:07.436 DEBUG:teuthology.orchestra.run.smithi061:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-24T19:47:07.466 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-24T19:47:07.495 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-24T19:47:07.498 INFO:teuthology.orchestra.run.smithi061.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-24T19:47:07.505 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-24T19:47:07.510 INFO:teuthology.orchestra.run.smithi061.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-24T19:47:07.512 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-24T19:47:07.519 INFO:teuthology.task.internal:Configuring sudo... 2023-12-24T19:47:07.519 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-24T19:47:07.554 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-24T19:47:07.582 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-24T19:47:07.591 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-24T19:47:07.592 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-24T19:47:07.626 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-24T19:47:07.642 DEBUG:teuthology.orchestra.run.smithi061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-24T19:47:07.729 DEBUG:teuthology.orchestra.run.smithi061:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-24T19:47:07.781 DEBUG:teuthology.orchestra.run.smithi061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-24T19:47:07.865 DEBUG:teuthology.orchestra.run.smithi061:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-24T19:47:07.909 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:47:07.909 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-24T19:47:07.976 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-24T19:47:08.018 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-24T19:47:08.073 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-24T19:47:08.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-24T19:47:08.200 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:47:08.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-24T19:47:08.268 DEBUG:teuthology.orchestra.run.smithi061:> sudo service rsyslog restart 2023-12-24T19:47:08.270 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2023-12-24T19:47:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-24T19:47:08.389 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-24T19:47:08.632 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-24T19:47:08.641 INFO:teuthology.task.internal:Starting timer... 2023-12-24T19:47:08.641 INFO:teuthology.run_tasks:Running task pcp... 2023-12-24T19:47:08.671 INFO:teuthology.run_tasks:Running task selinux... 2023-12-24T19:47:08.696 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-24T19:47:08.696 DEBUG:teuthology.orchestra.run.smithi061:> sudo service auditd rotate 2023-12-24T19:47:08.775 INFO:teuthology.orchestra.run.smithi061.stdout:Rotating logs: 2023-12-24T19:47:08.777 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2023-12-24T19:47:08.847 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2023-12-24T19:47:08.849 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-24T19:47:08.849 DEBUG:teuthology.orchestra.run.smithi061:> /usr/sbin/getenforce 2023-12-24T19:47:08.869 INFO:teuthology.orchestra.run.smithi061.stdout:Permissive 2023-12-24T19:47:08.870 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2023-12-24T19:47:08.906 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2023-12-24T19:47:08.907 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi061.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi133.front.sepia.ceph.com': 'permissive'} 2023-12-24T19:47:08.907 DEBUG:teuthology.orchestra.run.smithi061:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-24T19:47:08.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:47:08.938 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-24T19:47:08.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:47:08.977 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-24T19:47:08.977 DEBUG:teuthology.orchestra.run.smithi061:> sudo /usr/sbin/setenforce permissive 2023-12-24T19:47:09.009 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2023-12-24T19:47:09.046 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-24T19:47:09.056 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-24T19:47:09.062 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2023-12-24T19:47:09.183 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-24T19:47:09.199 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-24T19:47:09.200 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi061.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-24T19:53:36.610 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi061.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2023-12-24T19:53:36.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-12-24T19:53:36.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T19:53:36.684 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-12-24T19:53:36.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-12-24T19:53:36.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-24T19:53:36.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-24T19:53:36.822 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-12-24T19:53:36.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-24T19:53:36.892 INFO:teuthology.run_tasks:Running task clock... 2023-12-24T19:53:36.903 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-24T19:53:36.904 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-24T19:53:36.904 DEBUG:teuthology.orchestra.run.smithi061:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-24T19:53:36.907 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-24T19:53:36.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-24T19:53:36.939 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-24T19:53:36.955 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-24T19:53:36.965 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-24T19:53:36.980 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-24T19:53:37.017 INFO:teuthology.orchestra.run.smithi061.stderr:sudo: ntpd: command not found 2023-12-24T19:53:37.029 INFO:teuthology.orchestra.run.smithi061.stdout:506 Cannot talk to daemon 2023-12-24T19:53:37.046 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-24T19:53:37.051 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2023-12-24T19:53:37.059 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-24T19:53:37.063 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2023-12-24T19:53:37.079 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-24T19:53:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-24T19:53:37.140 INFO:teuthology.orchestra.run.smithi061.stderr:bash: ntpq: command not found 2023-12-24T19:53:37.143 INFO:teuthology.orchestra.run.smithi061.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-24T19:53:37.143 INFO:teuthology.orchestra.run.smithi061.stdout:=============================================================================== 2023-12-24T19:53:37.144 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-24T19:53:37.144 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-24T19:53:37.144 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-24T19:53:37.144 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-24T19:53:37.160 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2023-12-24T19:53:37.163 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-24T19:53:37.163 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2023-12-24T19:53:37.164 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-24T19:53:37.164 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-24T19:53:37.164 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-24T19:53:37.164 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-24T19:53:37.166 INFO:teuthology.run_tasks:Running task install... 2023-12-24T19:53:37.179 DEBUG:teuthology.task.install:project ceph 2023-12-24T19:53:37.179 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'}} 2023-12-24T19:53:37.179 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'} 2023-12-24T19:53:37.179 INFO:teuthology.task.install:Using flavor: default 2023-12-24T19:53:37.192 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-24T19:53:37.192 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-24T19:53:37.192 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f', 'tag': None, 'wait_for_package': False} 2023-12-24T19:53:37.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f 2023-12-24T19:53:37.197 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f', 'tag': None, 'wait_for_package': False} 2023-12-24T19:53:37.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f 2023-12-24T19:53:37.420 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/centos/8/flavors/default/ 2023-12-24T19:53:37.421 INFO:teuthology.task.install.rpm:Package version is 17.2.7-168.g5e7ce129 2023-12-24T19:53:37.424 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/centos/8/flavors/default/ 2023-12-24T19:53:37.424 INFO:teuthology.task.install.rpm:Package version is 17.2.7-168.g5e7ce129 2023-12-24T19:53:37.720 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-24T19:53:37.721 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:53:37.721 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-24T19:53:37.751 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-12-24T19:53:37.751 DEBUG:teuthology.orchestra.run.smithi061:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-24T19:53:37.790 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-12-21-0917-quincy/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-24T19:53:37.790 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:53:37.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-24T19:53:37.819 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-12-24T19:53:37.819 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-24T19:53:37.821 DEBUG:teuthology.orchestra.run.smithi061:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-24T19:53:37.889 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-24T19:53:37.900 DEBUG:teuthology.orchestra.run.smithi061:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-24T19:53:37.967 INFO:teuthology.orchestra.run.smithi061.stdout:check_obsoletes = 1 2023-12-24T19:53:37.968 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-24T19:53:37.969 DEBUG:teuthology.orchestra.run.smithi061:> sudo yum clean all 2023-12-24T19:53:38.035 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2023-12-24T19:53:38.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2023-12-24T19:53:38.364 INFO:teuthology.orchestra.run.smithi061.stdout:Updating Subscription Management repositories. 2023-12-24T19:53:38.412 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-12-24T19:53:39.540 INFO:teuthology.orchestra.run.smithi133.stdout:52 files removed 2023-12-24T19:53:39.594 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-12-24T19:53:39.663 INFO:teuthology.orchestra.run.smithi061.stdout:52 files removed 2023-12-24T19:53:39.717 DEBUG:teuthology.orchestra.run.smithi061:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-12-24T19:53:39.930 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2023-12-24T19:53:40.073 INFO:teuthology.orchestra.run.smithi061.stdout:Updating Subscription Management repositories. 2023-12-24T19:53:42.052 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 117 kB/s | 78 kB 00:00 2023-12-24T19:53:42.179 INFO:teuthology.orchestra.run.smithi061.stdout:ceph packages for x86_64 102 kB/s | 78 kB 00:00 2023-12-24T19:53:42.869 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 12 kB/s | 9.1 kB 00:00 2023-12-24T19:53:42.888 INFO:teuthology.orchestra.run.smithi061.stdout:ceph noarch packages 14 kB/s | 9.1 kB 00:00 2023-12-24T19:53:43.630 INFO:teuthology.orchestra.run.smithi061.stdout:ceph source packages 2.0 kB/s | 1.5 kB 00:00 2023-12-24T19:53:43.695 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 1.8 kB/s | 1.5 kB 00:00 2023-12-24T19:53:43.789 INFO:teuthology.orchestra.run.smithi061.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-12-24T19:53:43.837 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 30 kB/s | 3.5 kB 00:00 2023-12-24T19:53:45.092 INFO:teuthology.orchestra.run.smithi061.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-12-24T19:53:48.573 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 3.4 MB/s | 16 MB 00:04 2023-12-24T19:53:48.890 INFO:teuthology.orchestra.run.smithi061.stdout:lab-extras 441 kB/s | 24 kB 00:00 2023-12-24T19:53:50.317 INFO:teuthology.orchestra.run.smithi061.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 58 MB 00:01 2023-12-24T19:53:52.129 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 380 kB/s | 24 kB 00:00 2023-12-24T19:53:52.722 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 17 MB/s | 8.8 MB 00:00 2023-12-24T19:53:55.632 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 64 MB 00:01 2023-12-24T19:54:01.375 INFO:teuthology.orchestra.run.smithi061.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2023-12-24T19:54:04.468 INFO:teuthology.orchestra.run.smithi061.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 64 MB 00:01 2023-12-24T19:54:06.316 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 44 MB/s | 58 MB 00:01 2023-12-24T19:54:20.092 INFO:teuthology.orchestra.run.smithi061.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-24T19:54:20.093 INFO:teuthology.orchestra.run.smithi061.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-24T19:54:20.112 INFO:teuthology.orchestra.run.smithi061.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-24T19:54:20.114 INFO:teuthology.orchestra.run.smithi061.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-24T19:54:20.115 INFO:teuthology.orchestra.run.smithi061.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-24T19:54:20.117 INFO:teuthology.orchestra.run.smithi061.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-24T19:54:20.120 INFO:teuthology.orchestra.run.smithi061.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-24T19:54:20.124 INFO:teuthology.orchestra.run.smithi061.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-24T19:54:20.125 INFO:teuthology.orchestra.run.smithi061.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-24T19:54:20.334 INFO:teuthology.orchestra.run.smithi061.stdout:Dependencies resolved. 2023-12-24T19:54:20.349 INFO:teuthology.orchestra.run.smithi061.stdout:=========================================================================================================================== 2023-12-24T19:54:20.349 INFO:teuthology.orchestra.run.smithi061.stdout: Package Arch Version Repository Size 2023-12-24T19:54:20.349 INFO:teuthology.orchestra.run.smithi061.stdout:=========================================================================================================================== 2023-12-24T19:54:20.349 INFO:teuthology.orchestra.run.smithi061.stdout:Installing: 2023-12-24T19:54:20.349 INFO:teuthology.orchestra.run.smithi061.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-24T19:54:20.349 INFO:teuthology.orchestra.run.smithi061.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-24T19:54:20.349 INFO:teuthology.orchestra.run.smithi061.stdout: ceph x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 6.4 k 2023-12-24T19:54:20.349 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-base x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 5.2 M 2023-12-24T19:54:20.349 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-fuse x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 875 k 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 162 k 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 1.6 M 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-cephadm noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 121 k 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-dashboard noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 1.7 M 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 7.4 M 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-rook noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 47 k 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-radosgw x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 17 M 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-test x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 52 M 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-volume noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 267 k 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: cephadm noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 80 k 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: cephfs-mirror x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 255 k 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: cephfs-top noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 18 k 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-24T19:54:20.350 INFO:teuthology.orchestra.run.smithi061.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: libcephfs-devel x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 25 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: libcephfs2 x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 796 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: librados-devel x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 130 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cephfs x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 190 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rados x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 371 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rbd x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 358 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rgw x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 107 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-fuse x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 90 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-mirror x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 3.5 M 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-nbd x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 175 k 2023-12-24T19:54:20.351 INFO:teuthology.orchestra.run.smithi061.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout:Upgrading: 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: librados2 x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 3.5 M 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: librbd1 x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 3.6 M 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-24T19:54:20.352 INFO:teuthology.orchestra.run.smithi061.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout:Installing dependencies: 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-common x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 23 M 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-grafana-dashboards noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 23 k 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mds x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 2.3 M 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-modules-core noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 238 k 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mon x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 3.9 M 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-osd x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 17 M 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-prometheus-alerts noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 14 k 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-selinux x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 24 k 2023-12-24T19:54:20.353 INFO:teuthology.orchestra.run.smithi061.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: libcephsqlite x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 174 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: libradosstriper1 x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 506 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: librgw2 x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 5.6 M 2023-12-24T19:54:20.354 INFO:teuthology.orchestra.run.smithi061.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-24T19:54:20.355 INFO:teuthology.orchestra.run.smithi061.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-ceph-argparse x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 45 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-ceph-common x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 115 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-24T19:54:20.356 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-24T19:54:20.357 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-24T19:54:20.358 INFO:teuthology.orchestra.run.smithi061.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction Summary 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout:=========================================================================================================================== 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout:Install 124 Packages 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout:Upgrade 16 Packages 2023-12-24T19:54:20.359 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:54:20.360 INFO:teuthology.orchestra.run.smithi061.stdout:Total download size: 211 M 2023-12-24T19:54:20.360 INFO:teuthology.orchestra.run.smithi061.stdout:Downloading Packages: 2023-12-24T19:54:20.843 INFO:teuthology.orchestra.run.smithi061.stdout:(1/140): ceph-17.2.7-168.g5e7ce129.el8.x86_64.r 25 kB/s | 6.4 kB 00:00 2023-12-24T19:54:21.290 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-24T19:54:21.292 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-24T19:54:21.309 INFO:teuthology.orchestra.run.smithi133.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-24T19:54:21.310 INFO:teuthology.orchestra.run.smithi133.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-24T19:54:21.312 INFO:teuthology.orchestra.run.smithi133.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-24T19:54:21.313 INFO:teuthology.orchestra.run.smithi133.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-24T19:54:21.316 INFO:teuthology.orchestra.run.smithi133.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-24T19:54:21.320 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-24T19:54:21.321 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-24T19:54:21.515 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2023-12-24T19:54:21.528 INFO:teuthology.orchestra.run.smithi133.stdout:=========================================================================================================================== 2023-12-24T19:54:21.528 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2023-12-24T19:54:21.528 INFO:teuthology.orchestra.run.smithi133.stdout:=========================================================================================================================== 2023-12-24T19:54:21.528 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2023-12-24T19:54:21.528 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-24T19:54:21.528 INFO:teuthology.orchestra.run.smithi133.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-24T19:54:21.528 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 6.4 k 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 5.2 M 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 875 k 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 162 k 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 1.6 M 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 121 k 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 1.7 M 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 7.4 M 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 47 k 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 17 M 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 52 M 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 267 k 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 80 k 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 255 k 2023-12-24T19:54:21.529 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 18 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 25 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 796 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 130 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 190 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 371 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 358 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 107 k 2023-12-24T19:54:21.530 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 90 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 3.5 M 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 175 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 3.5 M 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 3.6 M 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-24T19:54:21.531 INFO:teuthology.orchestra.run.smithi133.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 23 M 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 23 k 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 2.3 M 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 238 k 2023-12-24T19:54:21.532 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 3.9 M 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 17 M 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:17.2.7-168.g5e7ce129.el8 ceph-noarch 14 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 24 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 174 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-24T19:54:21.533 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 506 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 5.6 M 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-24T19:54:21.534 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 45 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:17.2.7-168.g5e7ce129.el8 ceph 115 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-24T19:54:21.535 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-24T19:54:21.536 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-24T19:54:21.537 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2023-12-24T19:54:21.538 INFO:teuthology.orchestra.run.smithi133.stdout:=========================================================================================================================== 2023-12-24T19:54:21.539 INFO:teuthology.orchestra.run.smithi133.stdout:Install 124 Packages 2023-12-24T19:54:21.539 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 16 Packages 2023-12-24T19:54:21.539 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:54:21.539 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 211 M 2023-12-24T19:54:21.539 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2023-12-24T19:54:21.660 INFO:teuthology.orchestra.run.smithi061.stdout:(2/140): ceph-fuse-17.2.7-168.g5e7ce129.el8.x86 1.0 MB/s | 875 kB 00:00 2023-12-24T19:54:21.885 INFO:teuthology.orchestra.run.smithi061.stdout:(3/140): ceph-immutable-object-cache-17.2.7-168 719 kB/s | 162 kB 00:00 2023-12-24T19:54:22.057 INFO:teuthology.orchestra.run.smithi133.stdout:(1/140): ceph-17.2.7-168.g5e7ce129.el8.x86_64.r 30 kB/s | 6.4 kB 00:00 2023-12-24T19:54:22.311 INFO:teuthology.orchestra.run.smithi061.stdout:(4/140): ceph-common-17.2.7-168.g5e7ce129.el8.x 14 MB/s | 23 MB 00:01 2023-12-24T19:54:22.332 INFO:teuthology.orchestra.run.smithi133.stdout:(2/140): ceph-fuse-17.2.7-168.g5e7ce129.el8.x86 3.1 MB/s | 875 kB 00:00 2023-12-24T19:54:22.432 INFO:teuthology.orchestra.run.smithi133.stdout:(3/140): ceph-immutable-object-cache-17.2.7-168 1.6 MB/s | 162 kB 00:00 2023-12-24T19:54:22.436 INFO:teuthology.orchestra.run.smithi061.stdout:(5/140): ceph-mgr-17.2.7-168.g5e7ce129.el8.x86_ 13 MB/s | 1.6 MB 00:00 2023-12-24T19:54:22.719 INFO:teuthology.orchestra.run.smithi061.stdout:(6/140): ceph-mon-17.2.7-168.g5e7ce129.el8.x86_ 14 MB/s | 3.9 MB 00:00 2023-12-24T19:54:23.374 INFO:teuthology.orchestra.run.smithi133.stdout:(4/140): ceph-mds-17.2.7-168.g5e7ce129.el8.x86_ 2.4 MB/s | 2.3 MB 00:00 2023-12-24T19:54:23.466 INFO:teuthology.orchestra.run.smithi133.stdout:(5/140): ceph-base-17.2.7-168.g5e7ce129.el8.x86 3.2 MB/s | 5.2 MB 00:01 2023-12-24T19:54:23.828 INFO:teuthology.orchestra.run.smithi061.stdout:(7/140): ceph-osd-17.2.7-168.g5e7ce129.el8.x86_ 15 MB/s | 17 MB 00:01 2023-12-24T19:54:24.137 INFO:teuthology.orchestra.run.smithi061.stdout:(8/140): ceph-mds-17.2.7-168.g5e7ce129.el8.x86_ 1.0 MB/s | 2.3 MB 00:02 2023-12-24T19:54:24.200 INFO:teuthology.orchestra.run.smithi133.stdout:(6/140): ceph-mgr-17.2.7-168.g5e7ce129.el8.x86_ 1.9 MB/s | 1.6 MB 00:00 2023-12-24T19:54:24.237 INFO:teuthology.orchestra.run.smithi061.stdout:(9/140): ceph-selinux-17.2.7-168.g5e7ce129.el8. 243 kB/s | 24 kB 00:00 2023-12-24T19:54:24.383 INFO:teuthology.orchestra.run.smithi133.stdout:(7/140): ceph-mon-17.2.7-168.g5e7ce129.el8.x86_ 4.3 MB/s | 3.9 MB 00:00 2023-12-24T19:54:24.546 INFO:teuthology.orchestra.run.smithi061.stdout:(10/140): ceph-base-17.2.7-168.g5e7ce129.el8.x8 1.3 MB/s | 5.2 MB 00:03 2023-12-24T19:54:24.821 INFO:teuthology.orchestra.run.smithi061.stdout:(11/140): cephfs-mirror-17.2.7-168.g5e7ce129.el 929 kB/s | 255 kB 00:00 2023-12-24T19:54:25.005 INFO:teuthology.orchestra.run.smithi061.stdout:(12/140): ceph-radosgw-17.2.7-168.g5e7ce129.el8 14 MB/s | 17 MB 00:01 2023-12-24T19:54:25.030 INFO:teuthology.orchestra.run.smithi061.stdout:(13/140): libcephfs-devel-17.2.7-168.g5e7ce129. 119 kB/s | 25 kB 00:00 2023-12-24T19:54:25.122 INFO:teuthology.orchestra.run.smithi061.stdout:(14/140): libcephfs2-17.2.7-168.g5e7ce129.el8.x 6.7 MB/s | 796 kB 00:00 2023-12-24T19:54:25.180 INFO:teuthology.orchestra.run.smithi061.stdout:(15/140): librados-devel-17.2.7-168.g5e7ce129.e 2.2 MB/s | 130 kB 00:00 2023-12-24T19:54:25.205 INFO:teuthology.orchestra.run.smithi061.stdout:(16/140): libcephsqlite-17.2.7-168.g5e7ce129.el 993 kB/s | 174 kB 00:00 2023-12-24T19:54:25.358 INFO:teuthology.orchestra.run.smithi061.stdout:(17/140): libradosstriper1-17.2.7-168.g5e7ce129 2.8 MB/s | 506 kB 00:00 2023-12-24T19:54:25.414 INFO:teuthology.orchestra.run.smithi061.stdout:(18/140): python3-ceph-argparse-17.2.7-168.g5e7 796 kB/s | 45 kB 00:00 2023-12-24T19:54:25.464 INFO:teuthology.orchestra.run.smithi061.stdout:(19/140): python3-ceph-common-17.2.7-168.g5e7ce 2.3 MB/s | 115 kB 00:00 2023-12-24T19:54:25.523 INFO:teuthology.orchestra.run.smithi061.stdout:(20/140): python3-cephfs-17.2.7-168.g5e7ce129.e 3.2 MB/s | 190 kB 00:00 2023-12-24T19:54:25.590 INFO:teuthology.orchestra.run.smithi061.stdout:(21/140): python3-rados-17.2.7-168.g5e7ce129.el 5.4 MB/s | 371 kB 00:00 2023-12-24T19:54:25.657 INFO:teuthology.orchestra.run.smithi061.stdout:(22/140): python3-rbd-17.2.7-168.g5e7ce129.el8. 5.3 MB/s | 358 kB 00:00 2023-12-24T19:54:25.707 INFO:teuthology.orchestra.run.smithi061.stdout:(23/140): python3-rgw-17.2.7-168.g5e7ce129.el8. 2.1 MB/s | 107 kB 00:00 2023-12-24T19:54:25.786 INFO:teuthology.orchestra.run.smithi061.stdout:(24/140): rbd-fuse-17.2.7-168.g5e7ce129.el8.x86 1.1 MB/s | 90 kB 00:00 2023-12-24T19:54:26.075 INFO:teuthology.orchestra.run.smithi061.stdout:(25/140): rbd-mirror-17.2.7-168.g5e7ce129.el8.x 12 MB/s | 3.5 MB 00:00 2023-12-24T19:54:26.142 INFO:teuthology.orchestra.run.smithi061.stdout:(26/140): rbd-nbd-17.2.7-168.g5e7ce129.el8.x86_ 2.6 MB/s | 175 kB 00:00 2023-12-24T19:54:26.208 INFO:teuthology.orchestra.run.smithi061.stdout:(27/140): ceph-grafana-dashboards-17.2.7-168.g5 347 kB/s | 23 kB 00:00 2023-12-24T19:54:26.258 INFO:teuthology.orchestra.run.smithi061.stdout:(28/140): ceph-mgr-cephadm-17.2.7-168.g5e7ce129 2.4 MB/s | 121 kB 00:00 2023-12-24T19:54:26.383 INFO:teuthology.orchestra.run.smithi133.stdout:(8/140): ceph-common-17.2.7-168.g5e7ce129.el8.x 5.2 MB/s | 23 MB 00:04 2023-12-24T19:54:26.383 INFO:teuthology.orchestra.run.smithi061.stdout:(29/140): ceph-mgr-dashboard-17.2.7-168.g5e7ce1 14 MB/s | 1.7 MB 00:00 2023-12-24T19:54:26.442 INFO:teuthology.orchestra.run.smithi133.stdout:(9/140): ceph-selinux-17.2.7-168.g5e7ce129.el8. 419 kB/s | 24 kB 00:00 2023-12-24T19:54:26.926 INFO:teuthology.orchestra.run.smithi061.stdout:(30/140): ceph-mgr-diskprediction-local-17.2.7- 14 MB/s | 7.4 MB 00:00 2023-12-24T19:54:26.994 INFO:teuthology.orchestra.run.smithi061.stdout:(31/140): ceph-mgr-modules-core-17.2.7-168.g5e7 3.5 MB/s | 238 kB 00:00 2023-12-24T19:54:27.028 INFO:teuthology.orchestra.run.smithi133.stdout:(10/140): ceph-radosgw-17.2.7-168.g5e7ce129.el8 6.4 MB/s | 17 MB 00:02 2023-12-24T19:54:27.043 INFO:teuthology.orchestra.run.smithi061.stdout:(32/140): ceph-mgr-rook-17.2.7-168.g5e7ce129.el 970 kB/s | 47 kB 00:00 2023-12-24T19:54:27.085 INFO:teuthology.orchestra.run.smithi061.stdout:(33/140): ceph-prometheus-alerts-17.2.7-168.g5e 348 kB/s | 14 kB 00:00 2023-12-24T19:54:27.102 INFO:teuthology.orchestra.run.smithi133.stdout:(11/140): cephfs-mirror-17.2.7-168.g5e7ce129.el 3.3 MB/s | 255 kB 00:00 2023-12-24T19:54:27.135 INFO:teuthology.orchestra.run.smithi061.stdout:(34/140): ceph-volume-17.2.7-168.g5e7ce129.el8. 5.2 MB/s | 267 kB 00:00 2023-12-24T19:54:27.153 INFO:teuthology.orchestra.run.smithi133.stdout:(12/140): libcephfs-devel-17.2.7-168.g5e7ce129. 498 kB/s | 25 kB 00:00 2023-12-24T19:54:27.177 INFO:teuthology.orchestra.run.smithi061.stdout:(35/140): cephadm-17.2.7-168.g5e7ce129.el8.noar 1.9 MB/s | 80 kB 00:00 2023-12-24T19:54:27.227 INFO:teuthology.orchestra.run.smithi061.stdout:(36/140): cephfs-top-17.2.7-168.g5e7ce129.el8.n 362 kB/s | 18 kB 00:00 2023-12-24T19:54:27.287 INFO:teuthology.orchestra.run.smithi133.stdout:(13/140): libcephfs2-17.2.7-168.g5e7ce129.el8.x 5.8 MB/s | 796 kB 00:00 2023-12-24T19:54:27.354 INFO:teuthology.orchestra.run.smithi133.stdout:(14/140): libcephsqlite-17.2.7-168.g5e7ce129.el 2.6 MB/s | 174 kB 00:00 2023-12-24T19:54:27.412 INFO:teuthology.orchestra.run.smithi133.stdout:(15/140): librados-devel-17.2.7-168.g5e7ce129.e 2.2 MB/s | 130 kB 00:00 2023-12-24T19:54:27.512 INFO:teuthology.orchestra.run.smithi133.stdout:(16/140): libradosstriper1-17.2.7-168.g5e7ce129 5.0 MB/s | 506 kB 00:00 2023-12-24T19:54:27.969 INFO:teuthology.orchestra.run.smithi061.stdout:(37/140): gperftools-libs-2.7-9.el8.x86_64.rpm 413 kB/s | 306 kB 00:00 2023-12-24T19:54:28.086 INFO:teuthology.orchestra.run.smithi061.stdout:(38/140): liboath-2.6.2-3.el8.x86_64.rpm 504 kB/s | 59 kB 00:00 2023-12-24T19:54:28.170 INFO:teuthology.orchestra.run.smithi061.stdout:(39/140): librgw2-17.2.7-168.g5e7ce129.el8.x86_ 1.9 MB/s | 5.6 MB 00:02 2023-12-24T19:54:28.220 INFO:teuthology.orchestra.run.smithi061.stdout:(40/140): libunwind-1.3.1-3.el8.x86_64.rpm 562 kB/s | 75 kB 00:00 2023-12-24T19:54:28.304 INFO:teuthology.orchestra.run.smithi133.stdout:(17/140): librgw2-17.2.7-168.g5e7ce129.el8.x86_ 7.0 MB/s | 5.6 MB 00:00 2023-12-24T19:54:28.329 INFO:teuthology.orchestra.run.smithi061.stdout:(41/140): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-12-24T19:54:28.354 INFO:teuthology.orchestra.run.smithi133.stdout:(18/140): python3-ceph-argparse-17.2.7-168.g5e7 900 kB/s | 45 kB 00:00 2023-12-24T19:54:28.413 INFO:teuthology.orchestra.run.smithi133.stdout:(19/140): python3-ceph-common-17.2.7-168.g5e7ce 1.9 MB/s | 115 kB 00:00 2023-12-24T19:54:28.472 INFO:teuthology.orchestra.run.smithi133.stdout:(20/140): python3-cephfs-17.2.7-168.g5e7ce129.e 3.2 MB/s | 190 kB 00:00 2023-12-24T19:54:28.572 INFO:teuthology.orchestra.run.smithi133.stdout:(21/140): python3-rados-17.2.7-168.g5e7ce129.el 3.6 MB/s | 371 kB 00:00 2023-12-24T19:54:28.664 INFO:teuthology.orchestra.run.smithi133.stdout:(22/140): python3-rbd-17.2.7-168.g5e7ce129.el8. 3.8 MB/s | 358 kB 00:00 2023-12-24T19:54:28.719 INFO:teuthology.orchestra.run.smithi061.stdout:(42/140): python3-beautifulsoup4-4.6.3-2.el8.1. 474 kB/s | 185 kB 00:00 2023-12-24T19:54:28.783 INFO:teuthology.orchestra.run.smithi133.stdout:(23/140): python3-rgw-17.2.7-168.g5e7ce129.el8. 901 kB/s | 107 kB 00:00 2023-12-24T19:54:28.821 INFO:teuthology.orchestra.run.smithi061.stdout:(43/140): python3-cachetools-3.1.1-4.el8.noarch 325 kB/s | 33 kB 00:00 2023-12-24T19:54:28.930 INFO:teuthology.orchestra.run.smithi061.stdout:(44/140): python3-asyncssh-2.7.0-2.el8.noarch.r 627 kB/s | 476 kB 00:00 2023-12-24T19:54:28.948 INFO:teuthology.orchestra.run.smithi133.stdout:(24/140): ceph-osd-17.2.7-168.g5e7ce129.el8.x86 3.5 MB/s | 17 MB 00:04 2023-12-24T19:54:28.955 INFO:teuthology.orchestra.run.smithi061.stdout:(45/140): python3-certifi-2018.10.15-7.el8.noar 122 kB/s | 16 kB 00:00 2023-12-24T19:54:28.973 INFO:teuthology.orchestra.run.smithi133.stdout:(25/140): rbd-fuse-17.2.7-168.g5e7ce129.el8.x86 475 kB/s | 90 kB 00:00 2023-12-24T19:54:29.057 INFO:teuthology.orchestra.run.smithi133.stdout:(26/140): rbd-nbd-17.2.7-168.g5e7ce129.el8.x86_ 2.1 MB/s | 175 kB 00:00 2023-12-24T19:54:29.107 INFO:teuthology.orchestra.run.smithi133.stdout:(27/140): ceph-grafana-dashboards-17.2.7-168.g5 463 kB/s | 23 kB 00:00 2023-12-24T19:54:29.138 INFO:teuthology.orchestra.run.smithi061.stdout:(46/140): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2023-12-24T19:54:29.165 INFO:teuthology.orchestra.run.smithi133.stdout:(28/140): ceph-mgr-cephadm-17.2.7-168.g5e7ce129 2.0 MB/s | 121 kB 00:00 2023-12-24T19:54:29.214 INFO:teuthology.orchestra.run.smithi061.stdout:(47/140): python3-cheroot-8.5.2-1.el8.noarch.rp 668 kB/s | 173 kB 00:00 2023-12-24T19:54:29.239 INFO:teuthology.orchestra.run.smithi061.stdout:(48/140): python3-google-auth-1.1.1-10.el8.noar 810 kB/s | 81 kB 00:00 2023-12-24T19:54:29.323 INFO:teuthology.orchestra.run.smithi061.stdout:(49/140): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-12-24T19:54:29.348 INFO:teuthology.orchestra.run.smithi061.stdout:(50/140): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-12-24T19:54:29.416 INFO:teuthology.orchestra.run.smithi133.stdout:(29/140): ceph-mgr-dashboard-17.2.7-168.g5e7ce1 6.8 MB/s | 1.7 MB 00:00 2023-12-24T19:54:29.456 INFO:teuthology.orchestra.run.smithi061.stdout:(51/140): python3-logutils-0.3.5-11.el8.noarch. 450 kB/s | 49 kB 00:00 2023-12-24T19:54:29.565 INFO:teuthology.orchestra.run.smithi061.stdout:(52/140): python3-more-itertools-7.2.0-3.el8.no 542 kB/s | 59 kB 00:00 2023-12-24T19:54:29.666 INFO:teuthology.orchestra.run.smithi133.stdout:(30/140): rbd-mirror-17.2.7-168.g5e7ce129.el8.x 4.8 MB/s | 3.5 MB 00:00 2023-12-24T19:54:29.682 INFO:teuthology.orchestra.run.smithi061.stdout:(53/140): python3-natsort-7.1.1-2.el8.noarch.rp 517 kB/s | 60 kB 00:00 2023-12-24T19:54:29.775 INFO:teuthology.orchestra.run.smithi133.stdout:(31/140): ceph-mgr-modules-core-17.2.7-168.g5e7 2.2 MB/s | 238 kB 00:00 2023-12-24T19:54:29.825 INFO:teuthology.orchestra.run.smithi133.stdout:(32/140): ceph-mgr-rook-17.2.7-168.g5e7ce129.el 950 kB/s | 47 kB 00:00 2023-12-24T19:54:29.845 INFO:teuthology.orchestra.run.smithi061.stdout:(54/140): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-12-24T19:54:29.884 INFO:teuthology.orchestra.run.smithi133.stdout:(33/140): ceph-prometheus-alerts-17.2.7-168.g5e 249 kB/s | 14 kB 00:00 2023-12-24T19:54:29.958 INFO:teuthology.orchestra.run.smithi061.stdout:(55/140): python3-portend-2.6-1.el8.noarch.rpm 139 kB/s | 16 kB 00:00 2023-12-24T19:54:30.017 INFO:teuthology.orchestra.run.smithi133.stdout:(34/140): ceph-volume-17.2.7-168.g5e7ce129.el8. 2.0 MB/s | 267 kB 00:00 2023-12-24T19:54:30.067 INFO:teuthology.orchestra.run.smithi133.stdout:(35/140): cephadm-17.2.7-168.g5e7ce129.el8.noar 1.6 MB/s | 80 kB 00:00 2023-12-24T19:54:30.074 INFO:teuthology.orchestra.run.smithi061.stdout:(56/140): python3-repoze-lru-0.7-6.el8.noarch.r 288 kB/s | 34 kB 00:00 2023-12-24T19:54:30.118 INFO:teuthology.orchestra.run.smithi133.stdout:(36/140): cephfs-top-17.2.7-168.g5e7ce129.el8.n 361 kB/s | 18 kB 00:00 2023-12-24T19:54:30.200 INFO:teuthology.orchestra.run.smithi061.stdout:(57/140): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-12-24T19:54:30.300 INFO:teuthology.orchestra.run.smithi061.stdout:(58/140): python3-kubernetes-11.0.0-6.el8.noarc 1.2 MB/s | 1.2 MB 00:00 2023-12-24T19:54:30.317 INFO:teuthology.orchestra.run.smithi061.stdout:(59/140): python3-rsa-4.9-2.el8.noarch.rpm 550 kB/s | 64 kB 00:00 2023-12-24T19:54:30.410 INFO:teuthology.orchestra.run.smithi133.stdout:(37/140): ceph-mgr-diskprediction-local-17.2.7- 7.4 MB/s | 7.4 MB 00:00 2023-12-24T19:54:30.417 INFO:teuthology.orchestra.run.smithi061.stdout:(60/140): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2023-12-24T19:54:30.434 INFO:teuthology.orchestra.run.smithi061.stdout:(61/140): python3-singledispatch-3.4.0.3-18.el8 204 kB/s | 24 kB 00:00 2023-12-24T19:54:30.543 INFO:teuthology.orchestra.run.smithi061.stdout:(62/140): python3-tempora-1.14.1-5.el8.noarch.r 233 kB/s | 29 kB 00:00 2023-12-24T19:54:30.568 INFO:teuthology.orchestra.run.smithi061.stdout:(63/140): python3-trustme-0.6.0-4.el8.noarch.rp 206 kB/s | 27 kB 00:00 2023-12-24T19:54:30.702 INFO:teuthology.orchestra.run.smithi061.stdout:(64/140): python3-webob-1.8.5-1.el8.1.noarch.rp 1.8 MB/s | 251 kB 00:00 2023-12-24T19:54:30.752 INFO:teuthology.orchestra.run.smithi133.stdout:(38/140): gperftools-libs-2.7-9.el8.x86_64.rpm 483 kB/s | 306 kB 00:00 2023-12-24T19:54:30.769 INFO:teuthology.orchestra.run.smithi061.stdout:(65/140): python3-waitress-1.4.3-1.el8.noarch.r 1.1 MB/s | 255 kB 00:00 2023-12-24T19:54:30.785 INFO:teuthology.orchestra.run.smithi133.stdout:(39/140): liboath-2.6.2-3.el8.x86_64.rpm 157 kB/s | 59 kB 00:00 2023-12-24T19:54:30.830 INFO:teuthology.orchestra.run.smithi061.stdout:(66/140): python3-websocket-client-0.56.0-5.el8 489 kB/s | 61 kB 00:00 2023-12-24T19:54:30.894 INFO:teuthology.orchestra.run.smithi133.stdout:(40/140): libunwind-1.3.1-3.el8.x86_64.rpm 529 kB/s | 75 kB 00:00 2023-12-24T19:54:30.895 INFO:teuthology.orchestra.run.smithi061.stdout:(67/140): python3-webtest-2.0.33-1.el8.noarch.r 681 kB/s | 85 kB 00:00 2023-12-24T19:54:30.945 INFO:teuthology.orchestra.run.smithi061.stdout:(68/140): python3-zc-lockfile-2.0-2.el8.noarch. 196 kB/s | 23 kB 00:00 2023-12-24T19:54:30.970 INFO:teuthology.orchestra.run.smithi061.stdout:(69/140): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-12-24T19:54:31.011 INFO:teuthology.orchestra.run.smithi133.stdout:(41/140): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-12-24T19:54:31.137 INFO:teuthology.orchestra.run.smithi061.stdout:(70/140): python3-jsonpointer-1.10-11.el8.noarc 120 kB/s | 20 kB 00:00 2023-12-24T19:54:31.161 INFO:teuthology.orchestra.run.smithi133.stdout:(42/140): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-12-24T19:54:31.203 INFO:teuthology.orchestra.run.smithi133.stdout:(43/140): python3-asyncssh-2.7.0-2.el8.noarch.r 1.1 MB/s | 476 kB 00:00 2023-12-24T19:54:31.279 INFO:teuthology.orchestra.run.smithi133.stdout:(44/140): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2023-12-24T19:54:31.312 INFO:teuthology.orchestra.run.smithi061.stdout:(71/140): python3-prettytable-0.7.2-14.el8.noar 251 kB/s | 44 kB 00:00 2023-12-24T19:54:31.329 INFO:teuthology.orchestra.run.smithi133.stdout:(45/140): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-12-24T19:54:31.396 INFO:teuthology.orchestra.run.smithi133.stdout:(46/140): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-12-24T19:54:31.471 INFO:teuthology.orchestra.run.smithi061.stdout:(72/140): python3-pyasn1-modules-0.3.7-6.el8.no 696 kB/s | 110 kB 00:00 2023-12-24T19:54:31.471 INFO:teuthology.orchestra.run.smithi133.stdout:(47/140): python3-cherrypy-18.4.0-1.el8.noarch. 2.6 MB/s | 384 kB 00:00 2023-12-24T19:54:31.505 INFO:teuthology.orchestra.run.smithi133.stdout:(48/140): python3-google-auth-1.1.1-10.el8.noar 749 kB/s | 81 kB 00:00 2023-12-24T19:54:31.605 INFO:teuthology.orchestra.run.smithi133.stdout:(49/140): python3-jaraco-6.2-6.el8.noarch.rpm 83 kB/s | 11 kB 00:00 2023-12-24T19:54:31.630 INFO:teuthology.orchestra.run.smithi133.stdout:(50/140): python3-jaraco-functools-2.0-4.el8.no 140 kB/s | 18 kB 00:00 2023-12-24T19:54:31.655 INFO:teuthology.orchestra.run.smithi061.stdout:(73/140): python3-jsonpatch-1.21-2.el8.noarch.r 145 kB/s | 27 kB 00:00 2023-12-24T19:54:31.781 INFO:teuthology.orchestra.run.smithi133.stdout:(51/140): python3-logutils-0.3.5-11.el8.noarch. 325 kB/s | 49 kB 00:00 2023-12-24T19:54:31.805 INFO:teuthology.orchestra.run.smithi061.stdout:(74/140): python3-pyasn1-0.3.7-6.el8.noarch.rpm 844 kB/s | 126 kB 00:00 2023-12-24T19:54:31.831 INFO:teuthology.orchestra.run.smithi133.stdout:(52/140): python3-kubernetes-11.0.0-6.el8.noarc 5.2 MB/s | 1.2 MB 00:00 2023-12-24T19:54:31.888 INFO:teuthology.orchestra.run.smithi061.stdout:(75/140): thrift-0.13.0-2.el8.x86_64.rpm 1.7 MB/s | 1.7 MB 00:00 2023-12-24T19:54:31.928 INFO:teuthology.orchestra.run.smithi133.stdout:(53/140): python3-more-itertools-7.2.0-3.el8.no 400 kB/s | 59 kB 00:00 2023-12-24T19:54:31.956 INFO:teuthology.orchestra.run.smithi133.stdout:(54/140): python3-natsort-7.1.1-2.el8.noarch.rp 481 kB/s | 60 kB 00:00 2023-12-24T19:54:31.989 INFO:teuthology.orchestra.run.smithi061.stdout:(76/140): python3-werkzeug-0.12.2-4.el8.noarch. 2.4 MB/s | 457 kB 00:00 2023-12-24T19:54:32.065 INFO:teuthology.orchestra.run.smithi133.stdout:(55/140): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-12-24T19:54:32.081 INFO:teuthology.orchestra.run.smithi061.stdout:(77/140): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2023-12-24T19:54:32.090 INFO:teuthology.orchestra.run.smithi133.stdout:(56/140): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-12-24T19:54:32.114 INFO:teuthology.orchestra.run.smithi061.stdout:(78/140): bison-3.0.4-10.el8.x86_64.rpm 3.0 MB/s | 688 kB 00:00 2023-12-24T19:54:32.182 INFO:teuthology.orchestra.run.smithi133.stdout:(57/140): python3-repoze-lru-0.7-6.el8.noarch.r 288 kB/s | 34 kB 00:00 2023-12-24T19:54:32.224 INFO:teuthology.orchestra.run.smithi133.stdout:(58/140): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-12-24T19:54:32.273 INFO:teuthology.orchestra.run.smithi061.stdout:(79/140): libtool-2.4.6-25.el8.x86_64.rpm 3.6 MB/s | 709 kB 00:00 2023-12-24T19:54:32.291 INFO:teuthology.orchestra.run.smithi133.stdout:(59/140): python3-rsa-4.9-2.el8.noarch.rpm 592 kB/s | 64 kB 00:00 2023-12-24T19:54:32.298 INFO:teuthology.orchestra.run.smithi061.stdout:(80/140): python3-markupsafe-0.23-19.el8.x86_64 212 kB/s | 39 kB 00:00 2023-12-24T19:54:32.325 INFO:teuthology.orchestra.run.smithi133.stdout:(60/140): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-12-24T19:54:32.425 INFO:teuthology.orchestra.run.smithi133.stdout:(61/140): python3-singledispatch-3.4.0.3-18.el8 179 kB/s | 24 kB 00:00 2023-12-24T19:54:32.450 INFO:teuthology.orchestra.run.smithi133.stdout:(62/140): python3-tempora-1.14.1-5.el8.noarch.r 233 kB/s | 29 kB 00:00 2023-12-24T19:54:32.456 INFO:teuthology.orchestra.run.smithi061.stdout:(81/140): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-12-24T19:54:32.482 INFO:teuthology.orchestra.run.smithi061.stdout:(82/140): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.2 MB/s | 259 kB 00:00 2023-12-24T19:54:32.534 INFO:teuthology.orchestra.run.smithi133.stdout:(63/140): python3-trustme-0.6.0-4.el8.noarch.rp 254 kB/s | 27 kB 00:00 2023-12-24T19:54:32.540 INFO:teuthology.orchestra.run.smithi061.stdout:(83/140): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.2 MB/s | 103 kB 00:00 2023-12-24T19:54:32.601 INFO:teuthology.orchestra.run.smithi133.stdout:(64/140): python3-waitress-1.4.3-1.el8.noarch.r 1.7 MB/s | 255 kB 00:00 2023-12-24T19:54:32.684 INFO:teuthology.orchestra.run.smithi133.stdout:(65/140): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2023-12-24T19:54:32.708 INFO:teuthology.orchestra.run.smithi061.stdout:(84/140): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-12-24T19:54:32.710 INFO:teuthology.orchestra.run.smithi133.stdout:(66/140): python3-websocket-client-0.56.0-5.el8 563 kB/s | 61 kB 00:00 2023-12-24T19:54:32.741 INFO:teuthology.orchestra.run.smithi061.stdout:(85/140): python3-jinja2-2.10.1-3.el8.noarch.rp 2.6 MB/s | 538 kB 00:00 2023-12-24T19:54:32.802 INFO:teuthology.orchestra.run.smithi133.stdout:(67/140): python3-webtest-2.0.33-1.el8.noarch.r 730 kB/s | 85 kB 00:00 2023-12-24T19:54:32.827 INFO:teuthology.orchestra.run.smithi133.stdout:(68/140): python3-zc-lockfile-2.0-2.el8.noarch. 196 kB/s | 23 kB 00:00 2023-12-24T19:54:32.850 INFO:teuthology.orchestra.run.smithi061.stdout:(86/140): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-12-24T19:54:32.852 INFO:teuthology.orchestra.run.smithi133.stdout:(69/140): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-12-24T19:54:32.916 INFO:teuthology.orchestra.run.smithi061.stdout:(87/140): python3-numpy-1.14.3-10.el8.x86_64.rp 18 MB/s | 3.7 MB 00:00 2023-12-24T19:54:32.958 INFO:teuthology.orchestra.run.smithi061.stdout:(88/140): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2023-12-24T19:54:33.017 INFO:teuthology.orchestra.run.smithi061.stdout:(89/140): librdkafka-0.11.4-3.el8.x86_64.rpm 3.4 MB/s | 354 kB 00:00 2023-12-24T19:54:33.053 INFO:teuthology.orchestra.run.smithi133.stdout:(70/140): thrift-0.13.0-2.el8.x86_64.rpm 6.9 MB/s | 1.7 MB 00:00 2023-12-24T19:54:33.103 INFO:teuthology.orchestra.run.smithi133.stdout:(71/140): libverto-devel-0.3.0-5.el8.x86_64.rpm 71 kB/s | 18 kB 00:00 2023-12-24T19:54:33.168 INFO:teuthology.orchestra.run.smithi061.stdout:(90/140): openblas-threads-0.3.15-6.el8.x86_64. 25 MB/s | 5.2 MB 00:00 2023-12-24T19:54:33.193 INFO:teuthology.orchestra.run.smithi061.stdout:(91/140): python3-mako-1.0.6-14.el8.noarch.rpm 895 kB/s | 157 kB 00:00 2023-12-24T19:54:33.278 INFO:teuthology.orchestra.run.smithi133.stdout:(72/140): python3-oauthlib-2.1.0-1.el8.noarch.r 914 kB/s | 155 kB 00:00 2023-12-24T19:54:33.368 INFO:teuthology.orchestra.run.smithi061.stdout:(92/140): automake-1.16.1-8.el8.noarch.rpm 4.0 MB/s | 714 kB 00:00 2023-12-24T19:54:33.502 INFO:teuthology.orchestra.run.smithi061.stdout:(93/140): openblas-0.3.15-6.el8.x86_64.rpm 15 MB/s | 5.0 MB 00:00 2023-12-24T19:54:33.527 INFO:teuthology.orchestra.run.smithi061.stdout:(94/140): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2023-12-24T19:54:33.602 INFO:teuthology.orchestra.run.smithi061.stdout:(95/140): python3-pytz-2017.2-11.el8.noarch.rpm 541 kB/s | 54 kB 00:00 2023-12-24T19:54:33.736 INFO:teuthology.orchestra.run.smithi061.stdout:(96/140): libverto-devel-0.3.0-5.el8.x86_64.rpm 134 kB/s | 18 kB 00:00 2023-12-24T19:54:33.762 INFO:teuthology.orchestra.run.smithi133.stdout:(73/140): ceph-test-17.2.7-168.g5e7ce129.el8.x8 7.1 MB/s | 52 MB 00:07 2023-12-24T19:54:33.787 INFO:teuthology.orchestra.run.smithi133.stdout:(74/140): python3-jwt-1.6.1-2.el8.noarch.rpm 58 kB/s | 43 kB 00:00 2023-12-24T19:54:33.944 INFO:teuthology.orchestra.run.smithi061.stdout:(97/140): python3-scipy-1.0.0-21.module+el8.9.0 33 MB/s | 14 MB 00:00 2023-12-24T19:54:34.086 INFO:teuthology.orchestra.run.smithi061.stdout:(98/140): python3-jwt-1.6.1-2.el8.noarch.rpm 121 kB/s | 43 kB 00:00 2023-12-24T19:54:34.110 INFO:teuthology.orchestra.run.smithi133.stdout:(75/140): python3-pycparser-2.14-14.el8.noarch. 131 kB/s | 109 kB 00:00 2023-12-24T19:54:34.138 INFO:teuthology.orchestra.run.smithi133.stdout:(76/140): libaio-devel-0.3.112-1.el8.x86_64.rpm 53 kB/s | 19 kB 00:00 2023-12-24T19:54:34.204 INFO:teuthology.orchestra.run.smithi061.stdout:(99/140): python3-oauthlib-2.1.0-1.el8.noarch.r 599 kB/s | 155 kB 00:00 2023-12-24T19:54:34.346 INFO:teuthology.orchestra.run.smithi133.stdout:(77/140): libzstd-devel-1.4.4-1.el8.x86_64.rpm 190 kB/s | 44 kB 00:00 2023-12-24T19:54:34.366 INFO:teuthology.orchestra.run.smithi061.stdout:(100/140): python3-pycparser-2.14-14.el8.noarch 391 kB/s | 109 kB 00:00 2023-12-24T19:54:34.412 INFO:teuthology.orchestra.run.smithi061.stdout:(101/140): python3-requests-oauthlib-1.0.0-1.el 204 kB/s | 43 kB 00:00 2023-12-24T19:54:34.421 INFO:teuthology.orchestra.run.smithi133.stdout:(78/140): python3-requests-oauthlib-1.0.0-1.el8 65 kB/s | 43 kB 00:00 2023-12-24T19:54:34.455 INFO:teuthology.orchestra.run.smithi133.stdout:(79/140): pcre2-devel-10.32-2.el8.x86_64.rpm 1.9 MB/s | 605 kB 00:00 2023-12-24T19:54:34.513 INFO:teuthology.orchestra.run.smithi061.stdout:(102/140): libaio-devel-0.3.112-1.el8.x86_64.rp 127 kB/s | 19 kB 00:00 2023-12-24T19:54:34.538 INFO:teuthology.orchestra.run.smithi061.stdout:(103/140): libzstd-devel-1.4.4-1.el8.x86_64.rpm 350 kB/s | 44 kB 00:00 2023-12-24T19:54:34.589 INFO:teuthology.orchestra.run.smithi133.stdout:(80/140): pcre2-utf16-10.32-2.el8.x86_64.rpm 945 kB/s | 229 kB 00:00 2023-12-24T19:54:34.655 INFO:teuthology.orchestra.run.smithi061.stdout:(104/140): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-12-24T19:54:34.664 INFO:teuthology.orchestra.run.smithi133.stdout:(81/140): libselinux-devel-2.9-5.el8.x86_64.rpm 958 kB/s | 200 kB 00:00 2023-12-24T19:54:34.698 INFO:teuthology.orchestra.run.smithi133.stdout:(82/140): pcre2-utf32-10.32-2.el8.x86_64.rpm 800 kB/s | 220 kB 00:00 2023-12-24T19:54:34.705 INFO:teuthology.orchestra.run.smithi061.stdout:(105/140): pcre2-devel-10.32-2.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2023-12-24T19:54:34.821 INFO:teuthology.orchestra.run.smithi133.stdout:(83/140): keyutils-libs-devel-1.5.10-9.el8.x86_ 207 kB/s | 48 kB 00:00 2023-12-24T19:54:34.872 INFO:teuthology.orchestra.run.smithi061.stdout:(106/140): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2023-12-24T19:54:34.906 INFO:teuthology.orchestra.run.smithi133.stdout:(84/140): libsepol-devel-2.9-3.el8.x86_64.rpm 359 kB/s | 87 kB 00:00 2023-12-24T19:54:34.939 INFO:teuthology.orchestra.run.smithi061.stdout:(107/140): libselinux-devel-2.9-5.el8.x86_64.rp 856 kB/s | 200 kB 00:00 2023-12-24T19:54:35.015 INFO:teuthology.orchestra.run.smithi133.stdout:(85/140): libcom_err-devel-1.45.6-4.el8.x86_64. 199 kB/s | 39 kB 00:00 2023-12-24T19:54:35.031 INFO:teuthology.orchestra.run.smithi061.stdout:(108/140): keyutils-libs-devel-1.5.10-9.el8.x86 303 kB/s | 48 kB 00:00 2023-12-24T19:54:35.071 INFO:teuthology.orchestra.run.smithi133.stdout:(86/140): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 154 kB/s | 58 kB 00:00 2023-12-24T19:54:35.081 INFO:teuthology.orchestra.run.smithi061.stdout:(109/140): libsepol-devel-2.9-3.el8.x86_64.rpm 613 kB/s | 87 kB 00:00 2023-12-24T19:54:35.107 INFO:teuthology.orchestra.run.smithi061.stdout:(110/140): zlib-devel-1.2.11-18.el8_5.x86_64.rp 767 kB/s | 58 kB 00:00 2023-12-24T19:54:35.182 INFO:teuthology.orchestra.run.smithi061.stdout:(111/140): fuse-2.9.7-17.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-12-24T19:54:35.182 INFO:teuthology.orchestra.run.smithi133.stdout:(87/140): fuse-2.9.7-17.el8.x86_64.rpm 301 kB/s | 83 kB 00:00 2023-12-24T19:54:35.207 INFO:teuthology.orchestra.run.smithi061.stdout:(112/140): libcom_err-devel-1.45.6-4.el8.x86_64 307 kB/s | 39 kB 00:00 2023-12-24T19:54:35.208 INFO:teuthology.orchestra.run.smithi133.stdout:(88/140): libquadmath-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2023-12-24T19:54:35.241 INFO:teuthology.orchestra.run.smithi133.stdout:(89/140): libgfortran-8.5.0-20.el8.x86_64.rpm 2.8 MB/s | 645 kB 00:00 2023-12-24T19:54:35.249 INFO:teuthology.orchestra.run.smithi061.stdout:(113/140): libquadmath-8.5.0-20.el8.x86_64.rpm 4.1 MB/s | 172 kB 00:00 2023-12-24T19:54:35.308 INFO:teuthology.orchestra.run.smithi061.stdout:(114/140): libgfortran-8.5.0-20.el8.x86_64.rpm 5.0 MB/s | 645 kB 00:00 2023-12-24T19:54:35.458 INFO:teuthology.orchestra.run.smithi133.stdout:(90/140): libuuid-devel-2.32.1-43.el8.x86_64.rp 362 kB/s | 100 kB 00:00 2023-12-24T19:54:35.500 INFO:teuthology.orchestra.run.smithi061.stdout:(115/140): libuuid-devel-2.32.1-43.el8.x86_64.r 399 kB/s | 100 kB 00:00 2023-12-24T19:54:35.517 INFO:teuthology.orchestra.run.smithi133.stdout:(91/140): python3-cryptography-3.2.1-6.el8.x86_ 2.0 MB/s | 559 kB 00:00 2023-12-24T19:54:35.583 INFO:teuthology.orchestra.run.smithi061.stdout:(116/140): python3-cffi-1.11.5-6.el8.x86_64.rpm 864 kB/s | 238 kB 00:00 2023-12-24T19:54:35.584 INFO:teuthology.orchestra.run.smithi133.stdout:(92/140): python3-cffi-1.11.5-6.el8.x86_64.rpm 633 kB/s | 238 kB 00:00 2023-12-24T19:54:35.617 INFO:teuthology.orchestra.run.smithi061.stdout:(117/140): python3-cryptography-3.2.1-6.el8.x86 4.7 MB/s | 559 kB 00:00 2023-12-24T19:54:35.650 INFO:teuthology.orchestra.run.smithi133.stdout:(93/140): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 378 kB/s | 73 kB 00:00 2023-12-24T19:54:35.709 INFO:teuthology.orchestra.run.smithi061.stdout:(118/140): xfsprogs-devel-5.0.0-12.el8.x86_64.r 580 kB/s | 73 kB 00:00 2023-12-24T19:54:35.709 INFO:teuthology.orchestra.run.smithi133.stdout:(94/140): NetworkManager-initscripts-updown-1.4 748 kB/s | 143 kB 00:00 2023-12-24T19:54:35.759 INFO:teuthology.orchestra.run.smithi061.stdout:(119/140): NetworkManager-initscripts-updown-1. 1.0 MB/s | 143 kB 00:00 2023-12-24T19:54:35.834 INFO:teuthology.orchestra.run.smithi133.stdout:(95/140): librabbitmq-0.9.0-4.el8.x86_64.rpm 256 kB/s | 47 kB 00:00 2023-12-24T19:54:35.868 INFO:teuthology.orchestra.run.smithi133.stdout:(96/140): elfutils-libelf-devel-0.189-3.el8.x86 217 kB/s | 62 kB 00:00 2023-12-24T19:54:35.876 INFO:teuthology.orchestra.run.smithi061.stdout:(120/140): librabbitmq-0.9.0-4.el8.x86_64.rpm 403 kB/s | 47 kB 00:00 2023-12-24T19:54:35.926 INFO:teuthology.orchestra.run.smithi061.stdout:(121/140): elfutils-libelf-devel-0.189-3.el8.x8 284 kB/s | 62 kB 00:00 2023-12-24T19:54:36.077 INFO:teuthology.orchestra.run.smithi061.stdout:(122/140): krb5-devel-1.18.2-26.el8_9.x86_64.rp 2.7 MB/s | 562 kB 00:00 2023-12-24T19:54:36.085 INFO:teuthology.orchestra.run.smithi133.stdout:(97/140): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 1.5 MB/s | 562 kB 00:00 2023-12-24T19:54:36.110 INFO:teuthology.orchestra.run.smithi133.stdout:(98/140): python3-jsonpointer-1.10-11.el8.noarc 83 kB/s | 20 kB 00:00 2023-12-24T19:54:36.210 INFO:teuthology.orchestra.run.smithi133.stdout:(99/140): openssl-devel-1.1.1k-12.el8_9.x86_64. 6.2 MB/s | 2.3 MB 00:00 2023-12-24T19:54:36.236 INFO:teuthology.orchestra.run.smithi133.stdout:(100/140): python3-prettytable-0.7.2-14.el8.noa 292 kB/s | 44 kB 00:00 2023-12-24T19:54:36.295 INFO:teuthology.orchestra.run.smithi133.stdout:(101/140): python3-pyasn1-modules-0.3.7-6.el8.n 599 kB/s | 110 kB 00:00 2023-12-24T19:54:36.328 INFO:teuthology.orchestra.run.smithi133.stdout:(102/140): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.3 MB/s | 126 kB 00:00 2023-12-24T19:54:36.346 INFO:teuthology.orchestra.run.smithi133.stdout:(103/140): python3-jsonpatch-1.21-2.el8.noarch. 197 kB/s | 27 kB 00:00 2023-12-24T19:54:36.388 INFO:teuthology.orchestra.run.smithi061.stdout:(123/140): openssl-devel-1.1.1k-12.el8_9.x86_64 5.0 MB/s | 2.3 MB 00:00 2023-12-24T19:54:36.420 INFO:teuthology.orchestra.run.smithi133.stdout:(104/140): python3-werkzeug-0.12.2-4.el8.noarch 3.6 MB/s | 457 kB 00:00 2023-12-24T19:54:36.454 INFO:teuthology.orchestra.run.smithi133.stdout:(105/140): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2023-12-24T19:54:36.516 INFO:teuthology.orchestra.run.smithi133.stdout:(106/140): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-12-24T19:54:36.563 INFO:teuthology.orchestra.run.smithi133.stdout:(107/140): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2023-12-24T19:54:36.588 INFO:teuthology.orchestra.run.smithi133.stdout:(108/140): python3-markupsafe-0.23-19.el8.x86_6 290 kB/s | 39 kB 00:00 2023-12-24T19:54:36.630 INFO:teuthology.orchestra.run.smithi133.stdout:(109/140): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2023-12-24T19:54:36.688 INFO:teuthology.orchestra.run.smithi133.stdout:(110/140): oniguruma-6.8.2-2.el8.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2023-12-24T19:54:36.781 INFO:teuthology.orchestra.run.smithi133.stdout:(111/140): python3-pyOpenSSL-19.0.0-1.el8.noarc 538 kB/s | 103 kB 00:00 2023-12-24T19:54:36.889 INFO:teuthology.orchestra.run.smithi133.stdout:(112/140): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-12-24T19:54:36.923 INFO:teuthology.orchestra.run.smithi133.stdout:(113/140): python3-jinja2-2.10.1-3.el8.noarch.r 2.2 MB/s | 538 kB 00:00 2023-12-24T19:54:37.040 INFO:teuthology.orchestra.run.smithi133.stdout:(114/140): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-12-24T19:54:37.065 INFO:teuthology.orchestra.run.smithi133.stdout:(115/140): python3-numpy-f2py-1.14.3-10.el8.x86 1.6 MB/s | 225 kB 00:00 2023-12-24T19:54:37.090 INFO:teuthology.orchestra.run.smithi133.stdout:(116/140): socat-1.7.4.1-1.el8.x86_64.rpm 1.6 MB/s | 323 kB 00:00 2023-12-24T19:54:37.191 INFO:teuthology.orchestra.run.smithi133.stdout:(117/140): librdkafka-0.11.4-3.el8.x86_64.rpm 2.3 MB/s | 354 kB 00:00 2023-12-24T19:54:37.274 INFO:teuthology.orchestra.run.smithi133.stdout:(118/140): python3-mako-1.0.6-14.el8.noarch.rpm 855 kB/s | 157 kB 00:00 2023-12-24T19:54:37.391 INFO:teuthology.orchestra.run.smithi133.stdout:(119/140): openblas-0.3.15-6.el8.x86_64.rpm 25 MB/s | 5.0 MB 00:00 2023-12-24T19:54:37.499 INFO:teuthology.orchestra.run.smithi133.stdout:(120/140): openblas-threads-0.3.15-6.el8.x86_64 12 MB/s | 5.2 MB 00:00 2023-12-24T19:54:37.533 INFO:teuthology.orchestra.run.smithi133.stdout:(121/140): automake-1.16.1-8.el8.noarch.rpm 2.7 MB/s | 714 kB 00:00 2023-12-24T19:54:37.558 INFO:teuthology.orchestra.run.smithi133.stdout:(122/140): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2023-12-24T19:54:37.617 INFO:teuthology.orchestra.run.smithi133.stdout:(123/140): python3-pytz-2017.2-11.el8.noarch.rp 463 kB/s | 54 kB 00:00 2023-12-24T19:54:37.892 INFO:teuthology.orchestra.run.smithi133.stdout:(124/140): python3-scipy-1.0.0-21.module+el8.9. 38 MB/s | 14 MB 00:00 2023-12-24T19:54:38.143 INFO:teuthology.orchestra.run.smithi133.stdout:(125/140): elfutils-libelf-0.189-3.el8.x86_64.r 929 kB/s | 232 kB 00:00 2023-12-24T19:54:38.197 INFO:teuthology.orchestra.run.smithi061.stdout:(124/140): librbd1-17.2.7-168.g5e7ce129.el8.x86 2.0 MB/s | 3.6 MB 00:01 2023-12-24T19:54:38.319 INFO:teuthology.orchestra.run.smithi061.stdout:(125/140): elfutils-libelf-0.189-3.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2023-12-24T19:54:38.384 INFO:teuthology.orchestra.run.smithi133.stdout:(126/140): elfutils-libs-0.189-3.el8.x86_64.rpm 1.2 MB/s | 303 kB 00:00 2023-12-24T19:54:38.394 INFO:teuthology.orchestra.run.smithi061.stdout:(126/140): librados2-17.2.7-168.g5e7ce129.el8.x 1.5 MB/s | 3.5 MB 00:02 2023-12-24T19:54:38.445 INFO:teuthology.orchestra.run.smithi061.stdout:(127/140): elfutils-libs-0.189-3.el8.x86_64.rpm 2.4 MB/s | 303 kB 00:00 2023-12-24T19:54:38.587 INFO:teuthology.orchestra.run.smithi061.stdout:(128/140): libmount-2.32.1-43.el8.x86_64.rpm 1.2 MB/s | 237 kB 00:00 2023-12-24T19:54:38.605 INFO:teuthology.orchestra.run.smithi133.stdout:(127/140): libmount-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 237 kB 00:00 2023-12-24T19:54:38.612 INFO:teuthology.orchestra.run.smithi061.stdout:(129/140): libsmartcols-2.32.1-43.el8.x86_64.rp 1.1 MB/s | 179 kB 00:00 2023-12-24T19:54:38.718 INFO:teuthology.orchestra.run.smithi133.stdout:(128/140): libsmartcols-2.32.1-43.el8.x86_64.rp 1.5 MB/s | 179 kB 00:00 2023-12-24T19:54:38.745 INFO:teuthology.orchestra.run.smithi061.stdout:(130/140): libuuid-2.32.1-43.el8.x86_64.rpm 625 kB/s | 99 kB 00:00 2023-12-24T19:54:38.785 INFO:teuthology.orchestra.run.smithi133.stdout:(129/140): librbd1-17.2.7-168.g5e7ce129.el8.x86 3.1 MB/s | 3.6 MB 00:01 2023-12-24T19:54:38.838 INFO:teuthology.orchestra.run.smithi061.stdout:(131/140): util-linux-2.32.1-43.el8.x86_64.rpm 11 MB/s | 2.5 MB 00:00 2023-12-24T19:54:38.844 INFO:teuthology.orchestra.run.smithi133.stdout:(130/140): libuuid-2.32.1-43.el8.x86_64.rpm 791 kB/s | 99 kB 00:00 2023-12-24T19:54:38.952 INFO:teuthology.orchestra.run.smithi133.stdout:(131/140): util-linux-2.32.1-43.el8.x86_64.rpm 15 MB/s | 2.5 MB 00:00 2023-12-24T19:54:38.963 INFO:teuthology.orchestra.run.smithi061.stdout:(132/140): util-linux-user-2.32.1-43.el8.x86_64 474 kB/s | 103 kB 00:00 2023-12-24T19:54:38.978 INFO:teuthology.orchestra.run.smithi133.stdout:(132/140): util-linux-user-2.32.1-43.el8.x86_64 769 kB/s | 103 kB 00:00 2023-12-24T19:54:39.105 INFO:teuthology.orchestra.run.smithi061.stdout:(133/140): xfsdump-3.1.8-6.el8.x86_64.rpm 1.2 MB/s | 333 kB 00:00 2023-12-24T19:54:39.175 INFO:teuthology.orchestra.run.smithi133.stdout:(133/140): librados2-17.2.7-168.g5e7ce129.el8.x 2.1 MB/s | 3.5 MB 00:01 2023-12-24T19:54:39.205 INFO:teuthology.orchestra.run.smithi061.stdout:(134/140): iproute-6.2.0-5.el8_9.x86_64.rpm 3.4 MB/s | 854 kB 00:00 2023-12-24T19:54:39.212 INFO:teuthology.orchestra.run.smithi133.stdout:(134/140): xfsdump-3.1.8-6.el8.x86_64.rpm 1.3 MB/s | 333 kB 00:00 2023-12-24T19:54:39.230 INFO:teuthology.orchestra.run.smithi061.stdout:(135/140): libblkid-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-12-24T19:54:39.245 INFO:teuthology.orchestra.run.smithi133.stdout:(135/140): iproute-6.2.0-5.el8_9.x86_64.rpm 3.1 MB/s | 854 kB 00:00 2023-12-24T19:54:39.295 INFO:teuthology.orchestra.run.smithi133.stdout:(136/140): libblkid-2.32.1-43.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-12-24T19:54:39.430 INFO:teuthology.orchestra.run.smithi061.stdout:(136/140): libfdisk-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 254 kB 00:00 2023-12-24T19:54:39.472 INFO:teuthology.orchestra.run.smithi061.stdout:(137/140): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.4 MB/s | 1.1 MB 00:00 2023-12-24T19:54:39.563 INFO:teuthology.orchestra.run.smithi133.stdout:(137/140): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.4 MB/s | 1.1 MB 00:00 2023-12-24T19:54:39.588 INFO:teuthology.orchestra.run.smithi133.stdout:(138/140): libfdisk-2.32.1-43.el8.x86_64.rpm 676 kB/s | 254 kB 00:00 2023-12-24T19:54:39.621 INFO:teuthology.orchestra.run.smithi133.stdout:(139/140): openssl-1.1.1k-12.el8_9.x86_64.rpm 2.1 MB/s | 711 kB 00:00 2023-12-24T19:54:39.631 INFO:teuthology.orchestra.run.smithi061.stdout:(138/140): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.5 MB/s | 711 kB 00:00 2023-12-24T19:54:39.848 INFO:teuthology.orchestra.run.smithi061.stdout:(139/140): openssl-libs-1.1.1k-12.el8_9.x86_64. 3.9 MB/s | 1.5 MB 00:00 2023-12-24T19:54:39.946 INFO:teuthology.orchestra.run.smithi133.stdout:(140/140): openssl-libs-1.1.1k-12.el8_9.x86_64. 3.8 MB/s | 1.5 MB 00:00 2023-12-24T19:54:39.949 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2023-12-24T19:54:39.950 INFO:teuthology.orchestra.run.smithi133.stdout:Total 11 MB/s | 211 MB 00:18 2023-12-24T19:54:40.871 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2023-12-24T19:54:41.261 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2023-12-24T19:54:41.261 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2023-12-24T19:54:42.424 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2023-12-24T19:54:42.434 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2023-12-24T19:54:48.321 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2023-12-24T19:54:48.381 INFO:teuthology.orchestra.run.smithi061.stdout:(140/140): ceph-test-17.2.7-168.g5e7ce129.el8.x 2.1 MB/s | 52 MB 00:24 2023-12-24T19:54:48.384 INFO:teuthology.orchestra.run.smithi061.stdout:-------------------------------------------------------------------------------- 2023-12-24T19:54:48.384 INFO:teuthology.orchestra.run.smithi061.stdout:Total 7.5 MB/s | 211 MB 00:28 2023-12-24T19:54:48.480 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2023-12-24T19:54:48.782 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/156 2023-12-24T19:54:48.866 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/156 2023-12-24T19:54:49.062 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 2/156 2023-12-24T19:54:49.122 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 2/156 2023-12-24T19:54:49.337 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 3/156 2023-12-24T19:54:49.348 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction check 2023-12-24T19:54:49.400 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 3/156 2023-12-24T19:54:49.749 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/156 2023-12-24T19:54:49.772 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction check succeeded. 2023-12-24T19:54:49.772 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction test 2023-12-24T19:54:49.933 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/156 2023-12-24T19:54:50.168 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/156 2023-12-24T19:54:50.404 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/156 2023-12-24T19:54:50.498 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/156 2023-12-24T19:54:50.703 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/156 2023-12-24T19:54:51.007 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction test succeeded. 2023-12-24T19:54:51.018 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction 2023-12-24T19:54:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/156 2023-12-24T19:54:51.362 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:17.2.7-168.g5e7ce129.el8.x86_64 9/156 2023-12-24T19:54:51.758 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:17.2.7-168.g5e7ce129.el8.x86_64 9/156 2023-12-24T19:54:51.995 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:17.2.7-168.g5e7ce129.el8.x86_64 10/156 2023-12-24T19:54:52.110 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:17.2.7-168.g5e7ce129.el8.x86_64 10/156 2023-12-24T19:54:52.295 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:17.2.7-168.g5e7ce129.el8.x86_64 11/156 2023-12-24T19:54:52.380 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:17.2.7-168.g5e7ce129.el8.x86_64 11/156 2023-12-24T19:54:53.052 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:17.2.7-168.g5e7ce129.el8.x86_64 12/156 2023-12-24T19:54:53.236 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:17.2.7-168.g5e7ce129.el8.x86_64 13/156 2023-12-24T19:54:53.432 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:17.2.7-168.g5e7ce129.el8.x86_64 13/156 2023-12-24T19:54:53.736 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/156 2023-12-24T19:54:53.821 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/156 2023-12-24T19:54:54.074 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/156 2023-12-24T19:54:54.281 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/156 2023-12-24T19:54:54.468 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/156 2023-12-24T19:54:54.611 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:17.2.7-168.g5e7ce129.el8.x86_64 18/156 2023-12-24T19:54:54.764 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:17.2.7-168.g5e7ce129.el8.x86_64 18/156 2023-12-24T19:54:54.936 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:17.2.7-168.g5e7ce129.el8.x86_ 19/156 2023-12-24T19:54:55.000 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:17.2.7-168.g5e7ce129.el8.x86_ 19/156 2023-12-24T19:54:55.173 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/156 2023-12-24T19:54:55.742 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/156 2023-12-24T19:54:55.933 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/156 2023-12-24T19:54:56.119 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 23/156 2023-12-24T19:54:56.292 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 23/156 2023-12-24T19:54:56.432 INFO:teuthology.orchestra.run.smithi061.stdout: Preparing : 1/1 2023-12-24T19:54:56.502 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 24/156 2023-12-24T19:54:56.588 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2023-12-24T19:54:56.867 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/156 2023-12-24T19:54:56.931 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/156 2023-12-24T19:54:57.127 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 24/156 2023-12-24T19:54:57.127 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 2/156 2023-12-24T19:54:57.190 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 2/156 2023-12-24T19:54:57.360 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 3/156 2023-12-24T19:54:57.361 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 25/156 2023-12-24T19:54:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 3/156 2023-12-24T19:54:57.781 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/156 2023-12-24T19:54:57.993 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 25/156 2023-12-24T19:54:58.010 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/156 2023-12-24T19:54:58.185 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/156 2023-12-24T19:54:58.211 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.15-6.el8.x86_64 26/156 2023-12-24T19:54:58.252 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/156 2023-12-24T19:54:58.455 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/156 2023-12-24T19:54:58.693 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/156 2023-12-24T19:54:58.897 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 26/156 2023-12-24T19:54:59.082 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/156 2023-12-24T19:54:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 27/156 2023-12-24T19:54:59.374 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 28/156 2023-12-24T19:54:59.418 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : librados2-2:17.2.7-168.g5e7ce129.el8.x86_64 9/156 2023-12-24T19:54:59.652 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 29/156 2023-12-24T19:54:59.861 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:17.2.7-168.g5e7ce129.el8.x 30/156 2023-12-24T19:54:59.861 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librados2-2:17.2.7-168.g5e7ce129.el8.x86_64 9/156 2023-12-24T19:55:00.021 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:17.2.7-168.g5e7ce129.el8 31/156 2023-12-24T19:55:00.102 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : librbd1-2:17.2.7-168.g5e7ce129.el8.x86_64 10/156 2023-12-24T19:55:00.232 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librbd1-2:17.2.7-168.g5e7ce129.el8.x86_64 10/156 2023-12-24T19:55:00.306 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:17.2.7-168.g5e7ce129.el8.x86_64 32/156 2023-12-24T19:55:00.427 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libcephfs2-2:17.2.7-168.g5e7ce129.el8.x86_64 11/156 2023-12-24T19:55:00.524 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libcephfs2-2:17.2.7-168.g5e7ce129.el8.x86_64 11/156 2023-12-24T19:55:00.543 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/156 2023-12-24T19:55:01.243 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-rados-2:17.2.7-168.g5e7ce129.el8.x86_64 12/156 2023-12-24T19:55:01.460 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : librgw2-2:17.2.7-168.g5e7ce129.el8.x86_64 13/156 2023-12-24T19:55:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librgw2-2:17.2.7-168.g5e7ce129.el8.x86_64 13/156 2023-12-24T19:55:01.976 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/156 2023-12-24T19:55:02.073 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/156 2023-12-24T19:55:02.288 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/156 2023-12-24T19:55:02.291 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/156 2023-12-24T19:55:02.497 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/156 2023-12-24T19:55:02.659 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/156 2023-12-24T19:55:02.678 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 34/156 2023-12-24T19:55:02.826 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libcephsqlite-2:17.2.7-168.g5e7ce129.el8.x86_64 18/156 2023-12-24T19:55:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libcephsqlite-2:17.2.7-168.g5e7ce129.el8.x86_64 18/156 2023-12-24T19:55:03.051 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libradosstriper1-2:17.2.7-168.g5e7ce129.el8.x86_ 19/156 2023-12-24T19:55:03.126 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libradosstriper1-2:17.2.7-168.g5e7ce129.el8.x86_ 19/156 2023-12-24T19:55:03.284 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/156 2023-12-24T19:55:03.403 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/156 2023-12-24T19:55:03.568 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/156 2023-12-24T19:55:03.677 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 35/156 2023-12-24T19:55:04.192 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 36/156 2023-12-24T19:55:04.229 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/156 2023-12-24T19:55:04.418 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 22/156 2023-12-24T19:55:04.435 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 37/156 2023-12-24T19:55:04.688 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/156 2023-12-24T19:55:04.896 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 39/156 2023-12-24T19:55:05.061 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 22/156 2023-12-24T19:55:05.169 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:17.2.7-168.g5e7ce129.el8.x86_64 40/156 2023-12-24T19:55:05.276 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : openblas-0.3.15-6.el8.x86_64 23/156 2023-12-24T19:55:05.431 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:17.2.7-168.g5e7ce129.el8.x86_64 41/156 2023-12-24T19:55:05.649 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:17.2.7-168.g5e7ce129.el8.x86_64 42/156 2023-12-24T19:55:05.876 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/156 2023-12-24T19:55:05.943 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/156 2023-12-24T19:55:06.007 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 23/156 2023-12-24T19:55:06.159 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/156 2023-12-24T19:55:06.210 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/156 2023-12-24T19:55:06.324 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/156 2023-12-24T19:55:06.440 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/156 2023-12-24T19:55:06.508 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 25/156 2023-12-24T19:55:06.664 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 26/156 2023-12-24T19:55:06.712 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/156 2023-12-24T19:55:06.934 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/156 2023-12-24T19:55:06.954 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 27/156 2023-12-24T19:55:07.196 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 28/156 2023-12-24T19:55:07.370 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/156 2023-12-24T19:55:07.455 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 29/156 2023-12-24T19:55:07.695 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-ceph-common-2:17.2.7-168.g5e7ce129.el8.x 30/156 2023-12-24T19:55:07.734 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/156 2023-12-24T19:55:07.830 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/156 2023-12-24T19:55:07.838 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-ceph-argparse-2:17.2.7-168.g5e7ce129.el8 31/156 2023-12-24T19:55:08.106 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : automake-1.16.1-8.el8.noarch 49/156 2023-12-24T19:55:08.124 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cephfs-2:17.2.7-168.g5e7ce129.el8.x86_64 32/156 2023-12-24T19:55:08.317 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 50/156 2023-12-24T19:55:08.398 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 50/156 2023-12-24T19:55:08.609 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jq-1.6-7.el8.x86_64 51/156 2023-12-24T19:55:08.757 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 52/156 2023-12-24T19:55:08.974 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/156 2023-12-24T19:55:09.143 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/156 2023-12-24T19:55:09.159 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/156 2023-12-24T19:55:09.380 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.7-17.el8.x86_64 55/156 2023-12-24T19:55:09.506 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/156 2023-12-24T19:55:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 56/156 2023-12-24T19:55:09.738 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/156 2023-12-24T19:55:09.793 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/156 2023-12-24T19:55:09.953 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/156 2023-12-24T19:55:09.976 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/156 2023-12-24T19:55:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 59/156 2023-12-24T19:55:10.529 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 60/156 2023-12-24T19:55:10.855 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/156 2023-12-24T19:55:11.072 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/156 2023-12-24T19:55:11.263 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 63/156 2023-12-24T19:55:11.460 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/156 2023-12-24T19:55:11.826 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/156 2023-12-24T19:55:11.865 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 65/156 2023-12-24T19:55:12.153 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 37/156 2023-12-24T19:55:12.185 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 66/156 2023-12-24T19:55:12.372 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/156 2023-12-24T19:55:12.423 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 67/156 2023-12-24T19:55:12.587 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 39/156 2023-12-24T19:55:12.679 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/156 2023-12-24T19:55:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-rgw-2:17.2.7-168.g5e7ce129.el8.x86_64 40/156 2023-12-24T19:55:12.962 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/156 2023-12-24T19:55:13.039 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-rbd-2:17.2.7-168.g5e7ce129.el8.x86_64 41/156 2023-12-24T19:55:13.224 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : librados-devel-2:17.2.7-168.g5e7ce129.el8.x86_64 42/156 2023-12-24T19:55:13.275 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/156 2023-12-24T19:55:13.467 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/156 2023-12-24T19:55:13.499 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 71/156 2023-12-24T19:55:13.528 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/156 2023-12-24T19:55:13.675 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 72/156 2023-12-24T19:55:13.733 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/156 2023-12-24T19:55:13.786 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/156 2023-12-24T19:55:13.894 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 73/156 2023-12-24T19:55:13.990 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/156 2023-12-24T19:55:14.073 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 74/156 2023-12-24T19:55:14.228 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/156 2023-12-24T19:55:14.376 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 75/156 2023-12-24T19:55:14.416 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/156 2023-12-24T19:55:14.603 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 76/156 2023-12-24T19:55:14.795 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 77/156 2023-12-24T19:55:14.872 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/156 2023-12-24T19:55:15.060 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 78/156 2023-12-24T19:55:15.200 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/156 2023-12-24T19:55:15.218 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/156 2023-12-24T19:55:15.323 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 79/156 2023-12-24T19:55:15.462 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/156 2023-12-24T19:55:15.512 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 80/156 2023-12-24T19:55:15.647 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/156 2023-12-24T19:55:15.744 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 81/156 2023-12-24T19:55:15.846 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/156 2023-12-24T19:55:15.976 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 82/156 2023-12-24T19:55:16.020 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/156 2023-12-24T19:55:16.213 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 83/156 2023-12-24T19:55:16.271 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/156 2023-12-24T19:55:16.444 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 84/156 2023-12-24T19:55:16.568 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/156 2023-12-24T19:55:16.644 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 85/156 2023-12-24T19:55:16.830 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 86/156 2023-12-24T19:55:16.836 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/156 2023-12-24T19:55:17.044 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 87/156 2023-12-24T19:55:17.072 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/156 2023-12-24T19:55:17.247 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/156 2023-12-24T19:55:17.294 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 88/156 2023-12-24T19:55:17.480 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 89/156 2023-12-24T19:55:17.489 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/156 2023-12-24T19:55:17.745 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-2.6-1.el8.noarch 90/156 2023-12-24T19:55:17.835 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/156 2023-12-24T19:55:18.015 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 91/156 2023-12-24T19:55:18.112 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 60/156 2023-12-24T19:55:18.248 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/156 2023-12-24T19:55:18.336 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/156 2023-12-24T19:55:18.503 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/156 2023-12-24T19:55:18.618 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 62/156 2023-12-24T19:55:18.864 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 63/156 2023-12-24T19:55:19.191 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 64/156 2023-12-24T19:55:19.383 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 65/156 2023-12-24T19:55:19.567 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 66/156 2023-12-24T19:55:19.582 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/156 2023-12-24T19:55:19.743 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/156 2023-12-24T19:55:19.902 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 95/156 2023-12-24T19:55:19.975 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/156 2023-12-24T19:55:20.147 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/156 2023-12-24T19:55:20.257 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/156 2023-12-24T19:55:20.485 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : automake-1.16.1-8.el8.noarch 70/156 2023-12-24T19:55:20.500 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 97/156 2023-12-24T19:55:20.666 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 71/156 2023-12-24T19:55:20.736 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 71/156 2023-12-24T19:55:20.791 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 98/156 2023-12-24T19:55:20.916 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : jq-1.6-7.el8.x86_64 72/156 2023-12-24T19:55:21.006 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/156 2023-12-24T19:55:21.098 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 73/156 2023-12-24T19:55:21.232 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 100/156 2023-12-24T19:55:21.290 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 74/156 2023-12-24T19:55:21.442 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 75/156 2023-12-24T19:55:21.616 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 76/156 2023-12-24T19:55:21.871 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 77/156 2023-12-24T19:55:22.099 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 78/156 2023-12-24T19:55:22.323 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 79/156 2023-12-24T19:55:22.478 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 80/156 2023-12-24T19:55:22.695 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 81/156 2023-12-24T19:55:22.903 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 82/156 2023-12-24T19:55:23.139 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 83/156 2023-12-24T19:55:23.321 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 84/156 2023-12-24T19:55:23.519 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 85/156 2023-12-24T19:55:23.697 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 86/156 2023-12-24T19:55:23.957 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 87/156 2023-12-24T19:55:24.154 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 88/156 2023-12-24T19:55:24.347 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 89/156 2023-12-24T19:55:24.594 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-portend-2.6-1.el8.noarch 90/156 2023-12-24T19:55:24.831 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 91/156 2023-12-24T19:55:25.023 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/156 2023-12-24T19:55:25.177 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 101/156 2023-12-24T19:55:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/156 2023-12-24T19:55:25.431 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 101/156 2023-12-24T19:55:25.987 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 101/156 2023-12-24T19:55:26.276 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:17.2.7-168.g5e7ce129.el8.x86_64 102/156 2023-12-24T19:55:26.343 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/156 2023-12-24T19:55:26.387 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:17.2.7-168.g5e7ce129.el8.x86_64 102/156 2023-12-24T19:55:26.522 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:17.2.7-168.g5e7ce129.el8.x86_64 103/156 2023-12-24T19:55:26.622 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 95/156 2023-12-24T19:55:26.858 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/156 2023-12-24T19:55:27.191 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 97/156 2023-12-24T19:55:27.458 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 98/156 2023-12-24T19:55:27.676 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/156 2023-12-24T19:55:27.932 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 100/156 2023-12-24T19:55:32.084 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 101/156 2023-12-24T19:55:32.314 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 101/156 2023-12-24T19:55:32.907 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 101/156 2023-12-24T19:55:33.196 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-base-2:17.2.7-168.g5e7ce129.el8.x86_64 102/156 2023-12-24T19:55:33.281 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-base-2:17.2.7-168.g5e7ce129.el8.x86_64 102/156 2023-12-24T19:55:33.447 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-selinux-2:17.2.7-168.g5e7ce129.el8.x86_64 103/156 2023-12-24T19:55:45.736 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:17.2.7-168.g5e7ce129.el8.x86_64 103/156 2023-12-24T19:55:45.736 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2023-12-24T19:55:45.736 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2023-12-24T19:55:45.736 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2023-12-24T19:55:45.736 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /run 2023-12-24T19:55:45.736 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2023-12-24T19:55:45.736 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2023-12-24T19:55:45.736 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2023-12-24T19:55:45.736 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2023-12-24T19:55:45.737 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2023-12-24T19:55:45.737 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:55:46.134 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-volume-2:17.2.7-168.g5e7ce129.el8.noarch 104/156 2023-12-24T19:55:47.605 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-volume-2:17.2.7-168.g5e7ce129.el8.noarch 104/156 2023-12-24T19:55:47.822 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:17.2.7-168.g5e7ce129.el8.x86_64 105/156 2023-12-24T19:55:48.043 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:17.2.7-168.g5e7ce129.el8.x86_64 105/156 2023-12-24T19:55:48.235 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:17.2.7-168.g5e7ce129.el8.x86_64 106/156 2023-12-24T19:55:48.624 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:17.2.7-168.g5e7ce129.el8.x86_64 106/156 2023-12-24T19:55:48.777 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:17.2.7-168.g5e7ce129.el8.x86_64 107/156 2023-12-24T19:55:48.794 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:17.2.7-168.g5e7ce129.el8.x86_64 107/156 2023-12-24T19:55:50.544 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:17.2.7-168.g5e7ce129.el8.noarch 108/156 2023-12-24T19:55:50.724 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:17.2.7-168.g5e7ce129.el8.noarch 108/156 2023-12-24T19:55:50.866 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-168.g5e7ce129.el 109/156 2023-12-24T19:55:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-168.g5e7ce129.e 110/156 2023-12-24T19:55:51.326 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-168.g5e7ce129.el8.noar 111/156 2023-12-24T19:55:51.542 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-168.g5e7ce129.el8.noar 111/156 2023-12-24T19:55:51.854 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-168.g5e7ce129.el8.no 112/156 2023-12-24T19:55:52.821 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-168.g5e7ce129.el8.no 112/156 2023-12-24T19:55:53.020 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-168.g5e7c 113/156 2023-12-24T19:55:53.112 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-168.g5e7c 113/156 2023-12-24T19:55:53.412 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-selinux-2:17.2.7-168.g5e7ce129.el8.x86_64 103/156 2023-12-24T19:55:53.413 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /sys 2023-12-24T19:55:53.413 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /proc 2023-12-24T19:55:53.413 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /dev 2023-12-24T19:55:53.413 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /run 2023-12-24T19:55:53.413 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /mnt 2023-12-24T19:55:53.413 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /var/tmp 2023-12-24T19:55:53.413 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /home 2023-12-24T19:55:53.413 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /tmp 2023-12-24T19:55:53.413 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /dev 2023-12-24T19:55:53.413 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:55:53.492 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-168.g5e7ce129.el8 114/156 2023-12-24T19:55:53.654 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:17.2.7-168.g5e7ce129.el8.x86_64 115/156 2023-12-24T19:55:53.690 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:17.2.7-168.g5e7ce129.el8.x86_64 115/156 2023-12-24T19:55:53.826 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-volume-2:17.2.7-168.g5e7ce129.el8.noarch 104/156 2023-12-24T19:55:53.851 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:17.2.7-168.g5e7ce129.el8.noarch 116/156 2023-12-24T19:55:53.862 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-168.g5e7ce129.el8.noarch 116/156 2023-12-24T19:55:55.394 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-volume-2:17.2.7-168.g5e7ce129.el8.noarch 104/156 2023-12-24T19:55:55.434 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:17.2.7-168.g5e7ce129.el8.x86_64 117/156 2023-12-24T19:55:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-osd-2:17.2.7-168.g5e7ce129.el8.x86_64 105/156 2023-12-24T19:55:55.612 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:17.2.7-168.g5e7ce129.el8.x86_64 118/156 2023-12-24T19:55:55.724 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-168.g5e7ce129.el8.x86_64 118/156 2023-12-24T19:55:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-osd-2:17.2.7-168.g5e7ce129.el8.x86_64 105/156 2023-12-24T19:55:55.884 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-168.g5e7ce1 119/156 2023-12-24T19:55:55.926 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-168.g5e7ce1 119/156 2023-12-24T19:55:56.011 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mds-2:17.2.7-168.g5e7ce129.el8.x86_64 106/156 2023-12-24T19:55:56.101 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 120/156 2023-12-24T19:55:56.424 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mds-2:17.2.7-168.g5e7ce129.el8.x86_64 106/156 2023-12-24T19:55:56.448 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 120/156 2023-12-24T19:55:56.626 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 121/156 2023-12-24T19:55:56.628 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mon-2:17.2.7-168.g5e7ce129.el8.x86_64 107/156 2023-12-24T19:55:56.646 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mon-2:17.2.7-168.g5e7ce129.el8.x86_64 107/156 2023-12-24T19:55:58.584 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: cephadm-2:17.2.7-168.g5e7ce129.el8.noarch 108/156 2023-12-24T19:55:58.737 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : cephadm-2:17.2.7-168.g5e7ce129.el8.noarch 108/156 2023-12-24T19:55:58.901 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-168.g5e7ce129.el 109/156 2023-12-24T19:55:59.090 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-168.g5e7ce129.e 110/156 2023-12-24T19:55:59.344 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-168.g5e7ce129.el8.noar 111/156 2023-12-24T19:55:59.568 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-168.g5e7ce129.el8.noar 111/156 2023-12-24T19:55:59.825 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-168.g5e7ce129.el8.no 112/156 2023-12-24T19:56:00.856 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-168.g5e7ce129.el8.no 112/156 2023-12-24T19:56:01.052 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-168.g5e7c 113/156 2023-12-24T19:56:01.151 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-168.g5e7c 113/156 2023-12-24T19:56:01.509 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 121/156 2023-12-24T19:56:01.532 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-168.g5e7ce129.el8 114/156 2023-12-24T19:56:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-2:17.2.7-168.g5e7ce129.el8.x86_64 115/156 2023-12-24T19:56:01.738 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mgr-2:17.2.7-168.g5e7ce129.el8.x86_64 115/156 2023-12-24T19:56:01.894 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-rook-2:17.2.7-168.g5e7ce129.el8.noarch 116/156 2023-12-24T19:56:01.906 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-168.g5e7ce129.el8.noarch 116/156 2023-12-24T19:56:02.461 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:17.2.7-168.g5e7ce129.el8.x86_64 122/156 2023-12-24T19:56:02.796 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 123/156 2023-12-24T19:56:03.075 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 124/156 2023-12-24T19:56:03.355 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 125/156 2023-12-24T19:56:03.583 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtool-2.4.6-25.el8.x86_64 126/156 2023-12-24T19:56:03.587 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-2:17.2.7-168.g5e7ce129.el8.x86_64 117/156 2023-12-24T19:56:03.596 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 126/156 2023-12-24T19:56:03.783 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-radosgw-2:17.2.7-168.g5e7ce129.el8.x86_64 118/156 2023-12-24T19:56:03.819 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 127/156 2023-12-24T19:56:03.877 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-168.g5e7ce129.el8.x86_64 118/156 2023-12-24T19:56:04.028 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/156 2023-12-24T19:56:04.052 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-168.g5e7ce1 119/156 2023-12-24T19:56:04.096 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-168.g5e7ce1 119/156 2023-12-24T19:56:04.264 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:17.2.7-168.g5e7ce129.el8.x86_6 129/156 2023-12-24T19:56:04.285 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : cephfs-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 120/156 2023-12-24T19:56:04.628 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/156 2023-12-24T19:56:04.654 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 120/156 2023-12-24T19:56:04.835 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : rbd-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 121/156 2023-12-24T19:56:05.049 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 131/156 2023-12-24T19:56:05.329 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 132/156 2023-12-24T19:56:05.533 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-top-2:17.2.7-168.g5e7ce129.el8.noarch 133/156 2023-12-24T19:56:05.766 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 134/156 2023-12-24T19:56:06.087 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:17.2.7-168.g5e7ce129.el8.x86_64 135/156 2023-12-24T19:56:06.385 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 136/156 2023-12-24T19:56:06.590 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flex-2.6.1-9.el8.x86_64 137/156 2023-12-24T19:56:06.669 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 137/156 2023-12-24T19:56:06.949 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bison-3.0.4-10.el8.x86_64 138/156 2023-12-24T19:56:06.963 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 138/156 2023-12-24T19:56:07.157 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 139/156 2023-12-24T19:56:07.166 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 139/156 2023-12-24T19:56:07.292 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 140/156 2023-12-24T19:56:07.506 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 141/156 2023-12-24T19:56:07.734 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 142/156 2023-12-24T19:56:07.927 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 143/156 2023-12-24T19:56:07.928 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 144/156 2023-12-24T19:56:08.243 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 144/156 2023-12-24T19:56:08.243 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 145/156 2023-12-24T19:56:08.494 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 145/156 2023-12-24T19:56:08.495 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/156 2023-12-24T19:56:08.763 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/156 2023-12-24T19:56:09.008 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 147/156 2023-12-24T19:56:09.200 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 148/156 2023-12-24T19:56:09.475 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 149/156 2023-12-24T19:56:09.475 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 150/156 2023-12-24T19:56:09.734 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 150/156 2023-12-24T19:56:09.735 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 151/156 2023-12-24T19:56:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 151/156 2023-12-24T19:56:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 152/156 2023-12-24T19:56:10.037 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: rbd-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 121/156 2023-12-24T19:56:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 152/156 2023-12-24T19:56:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 153/156 2023-12-24T19:56:10.366 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-test-2:17.2.7-168.g5e7ce129.el8.x86_64 122/156 2023-12-24T19:56:10.509 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 153/156 2023-12-24T19:56:10.509 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 154/156 2023-12-24T19:56:10.510 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/156 2023-12-24T19:56:10.742 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 154/156 2023-12-24T19:56:10.926 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 155/156 2023-12-24T19:56:10.926 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 156/156 2023-12-24T19:56:11.249 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/156 2023-12-24T19:56:11.582 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 124/156 2023-12-24T19:56:11.777 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 156/156 2023-12-24T19:56:11.777 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:17.2.7-168.g5e7ce129.el8.x86_64 1/156 2023-12-24T19:56:11.777 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:17.2.7-168.g5e7ce129.el8.x86_64 2/156 2023-12-24T19:56:11.777 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 3/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 4/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-168.g5e7ce1 5/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:17.2.7-168.g5e7ce129.el8.x86_64 6/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:17.2.7-168.g5e7ce129.el8.x86_64 7/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:17.2.7-168.g5e7ce129.el8.x86_64 8/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:17.2.7-168.g5e7ce129.el8.x86_64 9/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:17.2.7-168.g5e7ce129.el8.x86_64 10/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:17.2.7-168.g5e7ce129.el8.x86_64 11/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:17.2.7-168.g5e7ce129.el8.x86_64 12/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 13/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:17.2.7-168.g5e7ce129.el8.x86_6 14/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:17.2.7-168.g5e7ce129.el8.x86_64 15/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:17.2.7-168.g5e7ce129.el8.x86_64 16/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:17.2.7-168.g5e7ce129.el8.x86_64 17/156 2023-12-24T19:56:11.778 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:17.2.7-168.g5e7ce129.el8.x86_ 18/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:17.2.7-168.g5e7ce129.el8.x86_64 19/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:17.2.7-168.g5e7ce129.el8 20/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:17.2.7-168.g5e7ce129.el8.x 21/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:17.2.7-168.g5e7ce129.el8.x86_64 22/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:17.2.7-168.g5e7ce129.el8.x86_64 23/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:17.2.7-168.g5e7ce129.el8.x86_64 24/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:17.2.7-168.g5e7ce129.el8.x86_64 25/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 26/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 27/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:17.2.7-168.g5e7ce129.el8.x86_64 28/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-168.g5e7ce129.e 29/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-168.g5e7ce129.el8.noar 30/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-168.g5e7ce129.el8.no 31/156 2023-12-24T19:56:11.779 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-168.g5e7c 32/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-168.g5e7ce129.el8 33/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:17.2.7-168.g5e7ce129.el8.noarch 34/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-168.g5e7ce129.el 35/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-volume-2:17.2.7-168.g5e7ce129.el8.noarch 36/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:17.2.7-168.g5e7ce129.el8.noarch 37/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-top-2:17.2.7-168.g5e7ce129.el8.noarch 38/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/156 2023-12-24T19:56:11.780 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/156 2023-12-24T19:56:11.781 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/156 2023-12-24T19:56:11.782 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 90/156 2023-12-24T19:56:11.783 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 92/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 93/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 94/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 95/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 96/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 97/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 98/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/156 2023-12-24T19:56:11.784 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 110/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 111/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 113/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 114/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 115/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 116/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 117/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 118/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 119/156 2023-12-24T19:56:11.785 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 120/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : automake-1.16.1-8.el8.noarch 121/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jq-1.6-7.el8.x86_64 122/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 123/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 124/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:17.2.7-168.g5e7ce129.el8.x86_64 125/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 126/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:17.2.7-168.g5e7ce129.el8.x86_64 127/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 128/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 129/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 130/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 131/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 132/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 133/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 134/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 135/156 2023-12-24T19:56:11.786 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 136/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 137/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 138/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 139/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 140/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 141/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 142/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 143/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 144/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 145/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 146/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 147/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 148/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 149/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 150/156 2023-12-24T19:56:11.787 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/156 2023-12-24T19:56:11.788 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/156 2023-12-24T19:56:11.788 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 153/156 2023-12-24T19:56:11.788 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 154/156 2023-12-24T19:56:11.788 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 155/156 2023-12-24T19:56:11.832 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 125/156 2023-12-24T19:56:12.049 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 126/156 2023-12-24T19:56:12.263 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 127/156 2023-12-24T19:56:12.463 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/156 2023-12-24T19:56:12.675 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libcephfs-devel-2:17.2.7-168.g5e7ce129.el8.x86_6 129/156 2023-12-24T19:56:13.046 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/156 2023-12-24T19:56:13.412 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 131/156 2023-12-24T19:56:13.681 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 132/156 2023-12-24T19:56:13.852 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : cephfs-top-2:17.2.7-168.g5e7ce129.el8.noarch 133/156 2023-12-24T19:56:14.085 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : rbd-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 134/156 2023-12-24T19:56:14.369 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : rbd-nbd-2:17.2.7-168.g5e7ce129.el8.x86_64 135/156 2023-12-24T19:56:14.603 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 136/156 2023-12-24T19:56:14.808 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 137/156 2023-12-24T19:56:14.820 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 137/156 2023-12-24T19:56:15.000 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 138/156 2023-12-24T19:56:15.208 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : flex-2.6.1-9.el8.x86_64 139/156 2023-12-24T19:56:15.295 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 139/156 2023-12-24T19:56:15.492 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : bison-3.0.4-10.el8.x86_64 140/156 2023-12-24T19:56:15.506 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 140/156 2023-12-24T19:56:15.695 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 141/156 2023-12-24T19:56:15.877 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 142/156 2023-12-24T19:56:16.062 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 143/156 2023-12-24T19:56:16.063 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 144/156 2023-12-24T19:56:16.320 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 144/156 2023-12-24T19:56:16.320 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 145/156 2023-12-24T19:56:16.571 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 145/156 2023-12-24T19:56:16.571 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/156 2023-12-24T19:56:16.857 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/156 2023-12-24T19:56:17.052 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 147/156 2023-12-24T19:56:17.246 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 148/156 2023-12-24T19:56:17.494 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 149/156 2023-12-24T19:56:17.495 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 150/156 2023-12-24T19:56:17.761 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 150/156 2023-12-24T19:56:17.762 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 151/156 2023-12-24T19:56:17.978 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 151/156 2023-12-24T19:56:17.978 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 152/156 2023-12-24T19:56:18.228 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 152/156 2023-12-24T19:56:18.228 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 153/156 2023-12-24T19:56:18.453 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 153/156 2023-12-24T19:56:18.453 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 154/156 2023-12-24T19:56:18.661 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 154/156 2023-12-24T19:56:18.836 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 155/156 2023-12-24T19:56:18.836 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 156/156 2023-12-24T19:56:19.754 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 156/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-2:17.2.7-168.g5e7ce129.el8.x86_64 1/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-base-2:17.2.7-168.g5e7ce129.el8.x86_64 2/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 3/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 4/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-168.g5e7ce1 5/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mds-2:17.2.7-168.g5e7ce129.el8.x86_64 6/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-2:17.2.7-168.g5e7ce129.el8.x86_64 7/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mon-2:17.2.7-168.g5e7ce129.el8.x86_64 8/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-osd-2:17.2.7-168.g5e7ce129.el8.x86_64 9/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-radosgw-2:17.2.7-168.g5e7ce129.el8.x86_64 10/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-selinux-2:17.2.7-168.g5e7ce129.el8.x86_64 11/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-test-2:17.2.7-168.g5e7ce129.el8.x86_64 12/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : cephfs-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 13/156 2023-12-24T19:56:19.755 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libcephfs-devel-2:17.2.7-168.g5e7ce129.el8.x86_6 14/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libcephfs2-2:17.2.7-168.g5e7ce129.el8.x86_64 15/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libcephsqlite-2:17.2.7-168.g5e7ce129.el8.x86_64 16/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librados-devel-2:17.2.7-168.g5e7ce129.el8.x86_64 17/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libradosstriper1-2:17.2.7-168.g5e7ce129.el8.x86_ 18/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librgw2-2:17.2.7-168.g5e7ce129.el8.x86_64 19/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-ceph-argparse-2:17.2.7-168.g5e7ce129.el8 20/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-ceph-common-2:17.2.7-168.g5e7ce129.el8.x 21/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cephfs-2:17.2.7-168.g5e7ce129.el8.x86_64 22/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-rados-2:17.2.7-168.g5e7ce129.el8.x86_64 23/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-rbd-2:17.2.7-168.g5e7ce129.el8.x86_64 24/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-rgw-2:17.2.7-168.g5e7ce129.el8.x86_64 25/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : rbd-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 26/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : rbd-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 27/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : rbd-nbd-2:17.2.7-168.g5e7ce129.el8.x86_64 28/156 2023-12-24T19:56:19.756 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-168.g5e7ce129.e 29/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-168.g5e7ce129.el8.noar 30/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-168.g5e7ce129.el8.no 31/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-168.g5e7c 32/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-168.g5e7ce129.el8 33/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-rook-2:17.2.7-168.g5e7ce129.el8.noarch 34/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-168.g5e7ce129.el 35/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-volume-2:17.2.7-168.g5e7ce129.el8.noarch 36/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : cephadm-2:17.2.7-168.g5e7ce129.el8.noarch 37/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : cephfs-top-2:17.2.7-168.g5e7ce129.el8.noarch 38/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/156 2023-12-24T19:56:19.757 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/156 2023-12-24T19:56:19.758 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/156 2023-12-24T19:56:19.759 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 72/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 74/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 75/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 76/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/156 2023-12-24T19:56:19.760 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : flex-2.6.1-9.el8.x86_64 79/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 80/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 81/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 82/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 83/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 84/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 85/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 86/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 88/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 90/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 91/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 92/156 2023-12-24T19:56:19.761 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 93/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : automake-1.16.1-8.el8.noarch 94/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : jq-1.6-7.el8.x86_64 95/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 96/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 97/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 98/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 99/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 100/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 101/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 103/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 104/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 105/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 106/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 107/156 2023-12-24T19:56:19.762 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 108/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 109/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 110/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 111/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 112/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 113/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 114/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 115/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 116/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 117/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 118/156 2023-12-24T19:56:19.763 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 119/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 121/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 122/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 123/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 124/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librados2-2:17.2.7-168.g5e7ce129.el8.x86_64 125/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 126/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librbd1-2:17.2.7-168.g5e7ce129.el8.x86_64 127/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 128/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 129/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 130/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 131/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 132/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 133/156 2023-12-24T19:56:19.764 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 134/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 135/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 136/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 137/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 138/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 139/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 140/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 141/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 142/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 143/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 144/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 145/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 146/156 2023-12-24T19:56:19.765 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 147/156 2023-12-24T19:56:19.766 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 148/156 2023-12-24T19:56:19.766 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 149/156 2023-12-24T19:56:19.766 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 150/156 2023-12-24T19:56:19.766 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/156 2023-12-24T19:56:19.766 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/156 2023-12-24T19:56:19.766 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 153/156 2023-12-24T19:56:19.766 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 154/156 2023-12-24T19:56:19.766 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 155/156 2023-12-24T19:56:25.937 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 156/156 2023-12-24T19:56:25.937 INFO:teuthology.orchestra.run.smithi133.stdout:Installed products updated. 2023-12-24T19:56:27.266 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:27.266 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2023-12-24T19:56:27.266 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-24T19:56:27.266 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-24T19:56:27.266 INFO:teuthology.orchestra.run.smithi133.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-24T19:56:27.266 INFO:teuthology.orchestra.run.smithi133.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-24T19:56:27.266 INFO:teuthology.orchestra.run.smithi133.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-24T19:56:27.266 INFO:teuthology.orchestra.run.smithi133.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-24T19:56:27.266 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: automake-1.16.1-8.el8.noarch 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: bison-3.0.4-10.el8.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.267 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.268 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: flex-2.6.1-9.el8.x86_64 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-24T19:56:27.269 INFO:teuthology.orchestra.run.smithi133.stdout: jq-1.6-7.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.270 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-24T19:56:27.271 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.272 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-24T19:56:27.273 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-2.6-1.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-24T19:56:27.274 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-24T19:56:27.275 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:27.276 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2023-12-24T19:56:28.094 DEBUG:teuthology.parallel:result is None 2023-12-24T19:56:32.584 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 156/156 2023-12-24T19:56:32.585 INFO:teuthology.orchestra.run.smithi061.stdout:Installed products updated. 2023-12-24T19:56:33.322 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout:Upgraded: 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: librados2-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: librbd1-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-24T19:56:33.323 INFO:teuthology.orchestra.run.smithi061.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout:Installed: 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: automake-1.16.1-8.el8.noarch 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: bison-3.0.4-10.el8.x86_64 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-base-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.324 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-grafana-dashboards-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-immutable-object-cache-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mds-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-cephadm-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-dashboard-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-diskprediction-local-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-modules-core-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-rook-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mon-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-osd-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-prometheus-alerts-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-radosgw-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.325 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-selinux-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-test-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-volume-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: cephadm-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: cephfs-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: cephfs-top-2:17.2.7-168.g5e7ce129.el8.noarch 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: flex-2.6.1-9.el8.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: jq-1.6-7.el8.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-24T19:56:33.326 INFO:teuthology.orchestra.run.smithi061.stdout: libcephfs-devel-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: libcephfs2-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: libcephsqlite-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: librados-devel-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: libradosstriper1-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: librgw2-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-24T19:56:33.327 INFO:teuthology.orchestra.run.smithi061.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-24T19:56:33.328 INFO:teuthology.orchestra.run.smithi061.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-ceph-argparse-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-ceph-common-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cephfs-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-24T19:56:33.329 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-portend-2.6-1.el8.noarch 2023-12-24T19:56:33.330 INFO:teuthology.orchestra.run.smithi061.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rados-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rbd-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rgw-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-24T19:56:33.331 INFO:teuthology.orchestra.run.smithi061.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-fuse-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-mirror-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-nbd-2:17.2.7-168.g5e7ce129.el8.x86_64 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-24T19:56:33.332 INFO:teuthology.orchestra.run.smithi061.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-24T19:56:33.333 INFO:teuthology.orchestra.run.smithi061.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-24T19:56:33.333 INFO:teuthology.orchestra.run.smithi061.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-24T19:56:33.333 INFO:teuthology.orchestra.run.smithi061.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-24T19:56:33.333 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:33.333 INFO:teuthology.orchestra.run.smithi061.stdout:Complete! 2023-12-24T19:56:33.546 DEBUG:teuthology.parallel:result is None 2023-12-24T19:56:33.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f 2023-12-24T19:56:33.692 DEBUG:teuthology.orchestra.run.smithi061:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-24T19:56:33.716 INFO:teuthology.orchestra.run.smithi061.stdout:17.2.7-168.g5e7ce129.el8 2023-12-24T19:56:33.717 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-168.g5e7ce129.el8 2023-12-24T19:56:33.717 INFO:teuthology.task.install:The correct ceph version 17.2.7-168.g5e7ce129 is installed. 2023-12-24T19:56:33.719 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f 2023-12-24T19:56:33.859 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-24T19:56:33.888 INFO:teuthology.orchestra.run.smithi133.stdout:17.2.7-168.g5e7ce129.el8 2023-12-24T19:56:33.888 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-168.g5e7ce129.el8 2023-12-24T19:56:33.888 INFO:teuthology.task.install:The correct ceph version 17.2.7-168.g5e7ce129 is installed. 2023-12-24T19:56:33.890 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-24T19:56:33.890 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:33.890 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-24T19:56:33.997 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:33.997 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-24T19:56:34.045 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-24T19:56:34.045 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:34.045 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/usr/bin/daemon-helper 2023-12-24T19:56:34.077 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-24T19:56:34.146 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:34.146 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2023-12-24T19:56:34.178 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-24T19:56:34.248 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-24T19:56:34.248 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:34.248 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-24T19:56:34.276 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-24T19:56:34.344 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:34.345 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-24T19:56:34.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-24T19:56:34.442 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-24T19:56:34.442 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:34.442 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/usr/bin/stdin-killer 2023-12-24T19:56:34.470 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-24T19:56:34.538 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:34.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2023-12-24T19:56:34.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-24T19:56:34.660 INFO:teuthology.run_tasks:Running task ceph... 2023-12-24T19:56:34.731 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-24T19:56:34.732 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 777 /var/log/ceph 2023-12-24T19:56:34.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2023-12-24T19:56:34.761 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-24T19:56:34.761 DEBUG:teuthology.orchestra.run.smithi061:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-24T19:56:34.802 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-24T19:56:34.829 INFO:tasks.ceph:Creating extra log directories... 2023-12-24T19:56:34.829 DEBUG:teuthology.orchestra.run.smithi061:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-24T19:56:34.870 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-24T19:56:34.903 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-24T19:56:34.904 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-24T19:56:34.904 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-24T19:56:34.904 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:34.904 DEBUG:teuthology.orchestra.run.smithi061:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-24T19:56:34.955 DEBUG:teuthology.orchestra.run.smithi061:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-24T19:56:35.074 DEBUG:teuthology.orchestra.run.smithi061:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-24T19:56:35.116 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:35.116 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-24T19:56:35.133 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-24T19:56:35.247 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-24T19:56:35.280 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-24T19:56:35.280 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-24T19:56:35.280 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456', 'branch': 'wip-yuri4-testing-2023-12-21-0917-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7500456', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-12-21-0917-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-12-21-0917-quincy', 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9956, 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f', 'sleep_before_teardown': 0, 'subset': '908/1024', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2023-12-21-0917-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f', 'targets': {'smithi061.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMKTiZ5La285rjy8lxT50C4HZdGqhb70oICSSBxPGanEXRMwsUk6v4+rc+RciNaqN451D18zfIee11G2zsOiSAk=', 'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNThfGfMMmLySKD43rbOrpUGeIIpUwnVsBwmooAy/5Y68xtPz/UoaPRWfSn2BcWTQNG/SoB5/2WPj7qKElA51ZY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9680d2aba1e76f64ade295c81599c97907457848', 'timestamp': '2023-12-24_15:41:15', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-24T19:56:35.281 DEBUG:teuthology.orchestra.run.smithi061:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-24T19:56:35.284 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-24T19:56:35.331 DEBUG:teuthology.orchestra.run.smithi061:> sudo install -d -m0777 -- /var/run/ceph 2023-12-24T19:56:35.342 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2023-12-24T19:56:35.398 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:35.398 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/scratch_devs of=/dev/stdout 2023-12-24T19:56:35.425 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-24T19:56:35.425 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_1 2023-12-24T19:56:35.482 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-24T19:56:35.483 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T19:56:35.483 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 124683 Links: 1 2023-12-24T19:56:35.483 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T19:56:35.483 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2023-12-24T19:56:35.483 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2023-12-24 19:56:19.381236979 +0000 2023-12-24T19:56:35.483 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2023-12-24 19:53:03.126316471 +0000 2023-12-24T19:56:35.483 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2023-12-24 19:53:03.126316471 +0000 2023-12-24T19:56:35.483 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2023-12-24T19:56:35.483 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-24T19:56:35.549 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2023-12-24T19:56:35.549 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2023-12-24T19:56:35.549 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000247614 s, 2.1 MB/s 2023-12-24T19:56:35.550 DEBUG:teuthology.orchestra.run.smithi061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-24T19:56:35.609 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_2 2023-12-24T19:56:35.667 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-24T19:56:35.667 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T19:56:35.667 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 121842 Links: 1 2023-12-24T19:56:35.667 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T19:56:35.667 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2023-12-24T19:56:35.667 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2023-12-24 19:56:19.381236979 +0000 2023-12-24T19:56:35.667 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2023-12-24 19:53:03.640307792 +0000 2023-12-24T19:56:35.667 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2023-12-24 19:53:03.640307792 +0000 2023-12-24T19:56:35.667 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2023-12-24T19:56:35.668 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-24T19:56:35.734 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2023-12-24T19:56:35.734 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2023-12-24T19:56:35.734 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000218854 s, 2.3 MB/s 2023-12-24T19:56:35.735 DEBUG:teuthology.orchestra.run.smithi061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-24T19:56:35.793 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_3 2023-12-24T19:56:35.851 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-24T19:56:35.851 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T19:56:35.851 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 122830 Links: 1 2023-12-24T19:56:35.851 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T19:56:35.851 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2023-12-24T19:56:35.851 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2023-12-24 19:56:19.381236979 +0000 2023-12-24T19:56:35.851 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2023-12-24 19:53:04.146299248 +0000 2023-12-24T19:56:35.851 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2023-12-24 19:53:04.146299248 +0000 2023-12-24T19:56:35.851 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2023-12-24T19:56:35.852 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-24T19:56:35.917 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2023-12-24T19:56:35.917 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2023-12-24T19:56:35.917 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000205188 s, 2.5 MB/s 2023-12-24T19:56:35.918 DEBUG:teuthology.orchestra.run.smithi061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-24T19:56:35.977 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_4 2023-12-24T19:56:36.034 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-24T19:56:36.034 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T19:56:36.035 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 123727 Links: 1 2023-12-24T19:56:36.035 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T19:56:36.035 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2023-12-24T19:56:36.035 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2023-12-24 19:56:19.381236979 +0000 2023-12-24T19:56:36.035 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2023-12-24 19:53:04.664290501 +0000 2023-12-24T19:56:36.035 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2023-12-24 19:53:04.664290501 +0000 2023-12-24T19:56:36.035 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2023-12-24T19:56:36.035 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-24T19:56:36.101 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2023-12-24T19:56:36.101 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2023-12-24T19:56:36.101 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000220246 s, 2.3 MB/s 2023-12-24T19:56:36.102 DEBUG:teuthology.orchestra.run.smithi061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-24T19:56:36.160 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-24T19:56:36.160 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:36.160 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2023-12-24T19:56:36.180 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-24T19:56:36.180 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2023-12-24T19:56:36.240 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-24T19:56:36.240 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T19:56:36.240 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 131089 Links: 1 2023-12-24T19:56:36.240 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T19:56:36.240 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-12-24T19:56:36.240 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-24 19:56:11.425119362 +0000 2023-12-24T19:56:36.240 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-24 19:52:52.739010974 +0000 2023-12-24T19:56:36.241 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-24 19:52:52.739010974 +0000 2023-12-24T19:56:36.241 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-12-24T19:56:36.241 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-24T19:56:36.308 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-24T19:56:36.308 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-24T19:56:36.308 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000245302 s, 2.1 MB/s 2023-12-24T19:56:36.309 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-24T19:56:36.368 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2023-12-24T19:56:36.426 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-24T19:56:36.427 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T19:56:36.427 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 122587 Links: 1 2023-12-24T19:56:36.427 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T19:56:36.427 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-12-24T19:56:36.427 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-24 19:56:11.425119362 +0000 2023-12-24T19:56:36.427 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-24 19:52:53.245001549 +0000 2023-12-24T19:56:36.427 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-24 19:52:53.245001549 +0000 2023-12-24T19:56:36.427 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-12-24T19:56:36.427 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-24T19:56:36.493 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-24T19:56:36.493 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-24T19:56:36.493 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000242119 s, 2.1 MB/s 2023-12-24T19:56:36.494 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-24T19:56:36.552 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2023-12-24T19:56:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-24T19:56:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T19:56:36.610 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 126756 Links: 1 2023-12-24T19:56:36.610 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T19:56:36.610 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-12-24T19:56:36.610 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-24 19:56:11.425119362 +0000 2023-12-24T19:56:36.610 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-24 19:52:53.749992142 +0000 2023-12-24T19:56:36.610 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-24 19:52:53.749992142 +0000 2023-12-24T19:56:36.610 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-12-24T19:56:36.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-24T19:56:36.676 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-24T19:56:36.676 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-24T19:56:36.676 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000286674 s, 1.8 MB/s 2023-12-24T19:56:36.677 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-24T19:56:36.735 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2023-12-24T19:56:36.793 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-24T19:56:36.793 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-24T19:56:36.793 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 131404 Links: 1 2023-12-24T19:56:36.793 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-24T19:56:36.793 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2023-12-24T19:56:36.793 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-24 19:56:11.425119362 +0000 2023-12-24T19:56:36.793 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-24 19:52:54.267982494 +0000 2023-12-24T19:56:36.793 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-24 19:52:54.267982494 +0000 2023-12-24T19:56:36.793 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-12-24T19:56:36.793 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-24T19:56:36.859 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-24T19:56:36.859 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-24T19:56:36.859 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000301212 s, 1.7 MB/s 2023-12-24T19:56:36.860 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-24T19:56:36.918 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-24T19:56:36.918 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi061.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-24T19:56:36.918 INFO:tasks.ceph:Generating config... 2023-12-24T19:56:36.919 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-24T19:56:36.919 INFO:tasks.ceph:[client] debug client = 20 2023-12-24T19:56:36.920 INFO:tasks.ceph:[client] debug ms = 1 2023-12-24T19:56:36.920 INFO:tasks.ceph:[client] pid file = 2023-12-24T19:56:36.920 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-24T19:56:36.920 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-24T19:56:36.920 INFO:tasks.ceph:[client.0] debug client = 20 2023-12-24T19:56:36.920 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-12-24T19:56:36.920 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-12-24T19:56:36.920 INFO:tasks.ceph:[client.1] debug client = 20 2023-12-24T19:56:36.920 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-12-24T19:56:36.920 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-12-24T19:56:36.920 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-24T19:56:36.920 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-24T19:56:36.920 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-24T19:56:36.920 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-12-24T19:56:36.921 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-12-24T19:56:36.921 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-12-24T19:56:36.922 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-24T19:56:36.923 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-24T19:56:36.923 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-24T19:56:36.923 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-12-24T19:56:36.923 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-12-24T19:56:36.923 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-12-24T19:56:36.923 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-24T19:56:36.923 INFO:tasks.ceph:Setting up mon.a... 2023-12-24T19:56:36.923 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-24T19:56:36.984 INFO:teuthology.orchestra.run.smithi061.stdout:creating /etc/ceph/ceph.keyring 2023-12-24T19:56:36.987 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-24T19:56:37.034 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-24T19:56:37.063 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.61'), ('mon.b', '172.21.15.133'), ('mon.c', '[v2:172.21.15.133:3301,v1:172.21.15.133:6790]')] 2023-12-24T19:56:37.063 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.61,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-24T19:56:37.064 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:37.064 DEBUG:teuthology.orchestra.run.smithi061:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-24T19:56:37.121 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.61 --add b 172.21.15.133 --addv c '[v2:172.21.15.133:3301,v1:172.21.15.133:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:37.207 INFO:teuthology.orchestra.run.smithi061.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:37.207 INFO:teuthology.orchestra.run.smithi061.stdout:monmaptool: generated fsid dfb999b6-2fb1-4e3b-80b2-d432556cbbe5 2023-12-24T19:56:37.207 INFO:teuthology.orchestra.run.smithi061.stdout:setting min_mon_release = octopus 2023-12-24T19:56:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:epoch 0 2023-12-24T19:56:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:fsid dfb999b6-2fb1-4e3b-80b2-d432556cbbe5 2023-12-24T19:56:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:last_changed 2023-12-24T19:56:37.208209+0000 2023-12-24T19:56:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:created 2023-12-24T19:56:37.208209+0000 2023-12-24T19:56:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:min_mon_release 15 (octopus) 2023-12-24T19:56:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:election_strategy: 1 2023-12-24T19:56:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:0: [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] mon.a 2023-12-24T19:56:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.b 2023-12-24T19:56:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2023-12-24T19:56:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-24T19:56:37.209 DEBUG:teuthology.orchestra.run.smithi061:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-24T19:56:37.226 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dfb999b6-2fb1-4e3b-80b2-d432556cbbe5... 2023-12-24T19:56:37.227 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-24T19:56:37.269 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-24T19:56:37.313 INFO:teuthology.orchestra.run.smithi061.stdout:[global] 2023-12-24T19:56:37.313 INFO:teuthology.orchestra.run.smithi061.stdout: chdir = "" 2023-12-24T19:56:37.313 INFO:teuthology.orchestra.run.smithi061.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: auth supported = cephx 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: filestore xattr use omap = true 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: mon clock drift allowed = 1.000 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: osd crush chooseleaf type = 0 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: auth debug = true 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: ms die on old message = true 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: ms die on bug = true 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: mon pg warn max object skew = 0 2023-12-24T19:56:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: # disable pg_autoscaler by default for new pools 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: osd pool default size = 2 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd allow primary affinity = true 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd allow pg remap = true 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: mon warn on legacy crush tunables = false 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: mon warn on crush straw calc version zero = false 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: mon warn on no sortbitwise = false 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: mon warn on osd down out interval zero = false 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: mon warn on too few osds = false 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-24T19:56:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: mon_allow_pool_size_one = true 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: osd default data pool replay window = 5 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: mon allow pool delete = true 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: mon cluster log file level = debug 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: debug asserts on shutdown = true 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: mon health detail to clog = false 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: mon host = "172.21.15.61,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]" 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: fsid = dfb999b6-2fb1-4e3b-80b2-d432556cbbe5 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout:[osd] 2023-12-24T19:56:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: osd journal size = 100 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd scrub load threshold = 5.0 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd scrub max interval = 600 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd mclock profile = high_recovery_ops 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd recover clone overlap = true 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd recovery max chunk = 1048576 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd debug shutdown = true 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd debug op order = true 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd debug verify stray on activate = true 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd open classes on start = true 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd debug pg log writeout = true 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.317 INFO:teuthology.orchestra.run.smithi061.stdout: osd deep scrub update digest min age = 30 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: osd map max advance = 10 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: journal zero on create = true 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: filestore ondisk finisher threads = 3 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: filestore apply finisher threads = 3 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: bdev debug aio = true 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: osd debug misdirected ops = true 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: bdev async discard = True 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: bdev enable discard = True 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: bluestore allocator = bitmap 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: bluestore block size = 96636764160 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: bluestore fsck on mount = True 2023-12-24T19:56:37.318 INFO:teuthology.orchestra.run.smithi061.stdout: debug bluefs = 1/20 2023-12-24T19:56:37.319 INFO:teuthology.orchestra.run.smithi061.stdout: debug bluestore = 1/20 2023-12-24T19:56:37.319 INFO:teuthology.orchestra.run.smithi061.stdout: debug ms = 1 2023-12-24T19:56:37.319 INFO:teuthology.orchestra.run.smithi061.stdout: debug osd = 20 2023-12-24T19:56:37.319 INFO:teuthology.orchestra.run.smithi061.stdout: debug rocksdb = 4/10 2023-12-24T19:56:37.320 INFO:teuthology.orchestra.run.smithi061.stdout: memstore device bytes = 200000000 2023-12-24T19:56:37.320 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd backfillfull_ratio = 0.85 2023-12-24T19:56:37.320 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd full ratio = 0.9 2023-12-24T19:56:37.320 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd nearfull ratio = 0.8 2023-12-24T19:56:37.321 INFO:teuthology.orchestra.run.smithi061.stdout: osd failsafe full ratio = 1.0 2023-12-24T19:56:37.321 INFO:teuthology.orchestra.run.smithi061.stdout: osd mon report interval = 5 2023-12-24T19:56:37.321 INFO:teuthology.orchestra.run.smithi061.stdout: osd objectstore = memstore 2023-12-24T19:56:37.321 INFO:teuthology.orchestra.run.smithi061.stdout: osd op complaint time = 180 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout:[mgr] 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: debug ms = 1 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: debug mgr = 20 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: debug mon = 20 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: debug auth = 20 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: mon reweight min pgs per osd = 4 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: mon reweight min bytes per osd = 10 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: mgr/telemetry/nag = false 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout:[mon] 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: debug ms = 1 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: debug mon = 20 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: debug paxos = 20 2023-12-24T19:56:37.322 INFO:teuthology.orchestra.run.smithi061.stdout: debug auth = 20 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: mon data avail warn = 5 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: mon mgr mkfs grace = 240 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: mon reweight min pgs per osd = 4 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd reporter subtree level = osd 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd prime pg temp = true 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: mon reweight min bytes per osd = 10 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: auth mon ticket ttl = 660 # 11m 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: auth service ticket ttl = 240 # 4m 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: # don't complain about insecure global_id in the test suite 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.323 INFO:teuthology.orchestra.run.smithi061.stdout: # 1m isn't quite enough 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: mon_down_mkfs_grace = 2m 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: mon_warn_on_filestore_osds = false 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: mon op complaint time = 120 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd backfillfull ratio = 0.6 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd full ratio = 0.7 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd nearfull ratio = 0.6 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout:[client] 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: rgw cache enabled = true 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: rgw enable ops log = true 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: rgw enable usage log = true 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: client mount timeout = 600 2023-12-24T19:56:37.324 INFO:teuthology.orchestra.run.smithi061.stdout: debug client = 20 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout: debug ms = 1 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout: pid file = "" 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout: rados mon op timeout = 900 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout: rados osd op timeout = 900 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout:[mon.a] 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout:[mon.b] 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout:[mon.c] 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.a] 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.c] 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.b] 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.d] 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout:[client.0] 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout: debug client = 20 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout: debug objectcacher = 20 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout: debug objecter = 20 2023-12-24T19:56:37.325 INFO:teuthology.orchestra.run.smithi061.stdout:[client.1] 2023-12-24T19:56:37.326 INFO:teuthology.orchestra.run.smithi061.stdout: debug client = 20 2023-12-24T19:56:37.326 INFO:teuthology.orchestra.run.smithi061.stdout: debug objectcacher = 20 2023-12-24T19:56:37.326 INFO:teuthology.orchestra.run.smithi061.stdout: debug objecter = 20 2023-12-24T19:56:37.326 INFO:teuthology.orchestra.run.smithi061.stdout:[mds] 2023-12-24T19:56:37.326 INFO:teuthology.orchestra.run.smithi061.stdout: debug mds = 20 2023-12-24T19:56:37.326 INFO:teuthology.orchestra.run.smithi061.stdout: debug ms = 1 2023-12-24T19:56:37.326 INFO:teuthology.orchestra.run.smithi061.stdout: mds debug frag = True 2023-12-24T19:56:37.327 INFO:teuthology.orchestra.run.smithi061.stdout: mds debug scatterstat = True 2023-12-24T19:56:37.327 INFO:teuthology.orchestra.run.smithi061.stdout: mds op complaint time = 180 2023-12-24T19:56:37.327 INFO:teuthology.orchestra.run.smithi061.stdout: mds verify scatter = True 2023-12-24T19:56:37.327 INFO:teuthology.orchestra.run.smithi061.stdout: osd op complaint time = 180 2023-12-24T19:56:37.327 INFO:teuthology.orchestra.run.smithi061.stdout: rados mon op timeout = 900 2023-12-24T19:56:37.327 INFO:teuthology.orchestra.run.smithi061.stdout: rados osd op timeout = 900 2023-12-24T19:56:37.327 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2023-12-24T19:56:37.328 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2023-12-24T19:56:37.329 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2023-12-24T19:56:37.330 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.61,172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790]" 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = dfb999b6-2fb1-4e3b-80b2-d432556cbbe5 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.331 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2023-12-24T19:56:37.332 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2023-12-24T19:56:37.333 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2023-12-24T19:56:37.334 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = bitmap 2023-12-24T19:56:37.334 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2023-12-24T19:56:37.334 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2023-12-24T19:56:37.334 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2023-12-24T19:56:37.334 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2023-12-24T19:56:37.334 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-24T19:56:37.334 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2023-12-24T19:56:37.334 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: memstore device bytes = 200000000 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 1.0 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: osd mon report interval = 5 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = memstore 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-12-24T19:56:37.335 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.336 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull ratio = 0.6 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.7 2023-12-24T19:56:37.337 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.6 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = "" 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-12-24T19:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout: debug objectcacher = 20 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout: debug objecter = 20 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout: debug objectcacher = 20 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout: debug objecter = 20 2023-12-24T19:56:37.339 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2023-12-24T19:56:37.340 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2023-12-24T19:56:37.340 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-24T19:56:37.340 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2023-12-24T19:56:37.340 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2023-12-24T19:56:37.340 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2023-12-24T19:56:37.340 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2023-12-24T19:56:37.340 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-12-24T19:56:37.340 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-12-24T19:56:37.340 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-12-24T19:56:37.341 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-24T19:56:37.342 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-24T19:56:37.436 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-24T19:56:37.436 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:37.436 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-24T19:56:37.453 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:37.454 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-24T19:56:37.511 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:56:37.511 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:37.511 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-24T19:56:37.511 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-24T19:56:37.589 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:37.590 DEBUG:teuthology.orchestra.run.smithi061:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:37.647 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:56:37.647 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:37.647 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-24T19:56:37.648 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-24T19:56:37.686 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:37.686 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:37.745 INFO:tasks.ceph:Setting up mon nodes... 2023-12-24T19:56:37.746 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-24T19:56:37.746 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-24T19:56:37.798 INFO:teuthology.orchestra.run.smithi061.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-24T19:56:37.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-24T19:56:37.867 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-24T19:56:37.869 INFO:tasks.ceph:Setting up mds nodes... 2023-12-24T19:56:37.869 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-24T19:56:37.921 INFO:teuthology.orchestra.run.smithi061.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-24T19:56:37.924 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-24T19:56:37.950 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-24T19:56:38.044 INFO:teuthology.orchestra.run.smithi061.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-24T19:56:38.046 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-24T19:56:38.073 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-24T19:56:38.124 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-24T19:56:38.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-24T19:56:38.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-24T19:56:38.243 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-24T19:56:38.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-24T19:56:38.272 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-24T19:56:38.272 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-24T19:56:38.314 INFO:teuthology.orchestra.run.smithi061.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-24T19:56:38.327 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-24T19:56:38.408 INFO:teuthology.orchestra.run.smithi061.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-24T19:56:38.421 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-24T19:56:38.461 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-24T19:56:38.474 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-24T19:56:38.554 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-24T19:56:38.567 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-24T19:56:38.567 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi061.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-24T19:56:38.567 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-24T19:56:38.595 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-24T19:56:38.595 INFO:tasks.ceph:role: osd.0 2023-12-24T19:56:38.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:56:38.595 DEBUG:teuthology.orchestra.run.smithi061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-24T19:56:38.670 INFO:teuthology.orchestra.run.smithi061.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T19:56:38.670 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T19:56:38.670 INFO:teuthology.orchestra.run.smithi061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T19:56:38.670 INFO:teuthology.orchestra.run.smithi061.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-24T19:56:38.670 INFO:teuthology.orchestra.run.smithi061.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T19:56:38.670 INFO:teuthology.orchestra.run.smithi061.stdout: = sunit=0 swidth=0 blks 2023-12-24T19:56:38.670 INFO:teuthology.orchestra.run.smithi061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T19:56:38.670 INFO:teuthology.orchestra.run.smithi061.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T19:56:38.670 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T19:56:38.670 INFO:teuthology.orchestra.run.smithi061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T19:56:39.105 INFO:teuthology.orchestra.run.smithi061.stdout:Discarding blocks...Done. 2023-12-24T19:56:39.107 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi061.front.sepia.ceph.com -o noatime 2023-12-24T19:56:39.107 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-24T19:56:39.281 DEBUG:teuthology.orchestra.run.smithi061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-24T19:56:39.317 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-24T19:56:39.386 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-24T19:56:39.386 INFO:tasks.ceph:role: osd.1 2023-12-24T19:56:39.386 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:56:39.386 DEBUG:teuthology.orchestra.run.smithi061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-24T19:56:39.461 INFO:teuthology.orchestra.run.smithi061.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T19:56:39.461 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T19:56:39.461 INFO:teuthology.orchestra.run.smithi061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T19:56:39.461 INFO:teuthology.orchestra.run.smithi061.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-24T19:56:39.461 INFO:teuthology.orchestra.run.smithi061.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T19:56:39.461 INFO:teuthology.orchestra.run.smithi061.stdout: = sunit=0 swidth=0 blks 2023-12-24T19:56:39.461 INFO:teuthology.orchestra.run.smithi061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T19:56:39.462 INFO:teuthology.orchestra.run.smithi061.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T19:56:39.462 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T19:56:39.462 INFO:teuthology.orchestra.run.smithi061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T19:56:39.886 INFO:teuthology.orchestra.run.smithi061.stdout:Discarding blocks...Done. 2023-12-24T19:56:39.888 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi061.front.sepia.ceph.com -o noatime 2023-12-24T19:56:39.888 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-24T19:56:39.997 DEBUG:teuthology.orchestra.run.smithi061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-24T19:56:40.030 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-24T19:56:40.098 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-24T19:56:40.099 INFO:tasks.ceph:role: osd.2 2023-12-24T19:56:40.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:56:40.099 DEBUG:teuthology.orchestra.run.smithi061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-24T19:56:40.175 INFO:teuthology.orchestra.run.smithi061.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T19:56:40.175 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T19:56:40.175 INFO:teuthology.orchestra.run.smithi061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T19:56:40.175 INFO:teuthology.orchestra.run.smithi061.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-24T19:56:40.175 INFO:teuthology.orchestra.run.smithi061.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T19:56:40.175 INFO:teuthology.orchestra.run.smithi061.stdout: = sunit=0 swidth=0 blks 2023-12-24T19:56:40.175 INFO:teuthology.orchestra.run.smithi061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T19:56:40.175 INFO:teuthology.orchestra.run.smithi061.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T19:56:40.175 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T19:56:40.175 INFO:teuthology.orchestra.run.smithi061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T19:56:40.624 INFO:teuthology.orchestra.run.smithi061.stdout:Discarding blocks...Done. 2023-12-24T19:56:40.626 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi061.front.sepia.ceph.com -o noatime 2023-12-24T19:56:40.626 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-24T19:56:40.806 DEBUG:teuthology.orchestra.run.smithi061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-24T19:56:40.842 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-24T19:56:40.913 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-24T19:56:40.913 INFO:tasks.ceph:role: osd.3 2023-12-24T19:56:40.914 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:56:40.914 DEBUG:teuthology.orchestra.run.smithi061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-24T19:56:40.990 INFO:teuthology.orchestra.run.smithi061.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T19:56:40.990 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T19:56:40.991 INFO:teuthology.orchestra.run.smithi061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T19:56:40.991 INFO:teuthology.orchestra.run.smithi061.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-24T19:56:40.991 INFO:teuthology.orchestra.run.smithi061.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T19:56:40.991 INFO:teuthology.orchestra.run.smithi061.stdout: = sunit=0 swidth=0 blks 2023-12-24T19:56:40.991 INFO:teuthology.orchestra.run.smithi061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T19:56:40.991 INFO:teuthology.orchestra.run.smithi061.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T19:56:40.991 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T19:56:40.991 INFO:teuthology.orchestra.run.smithi061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T19:56:41.425 INFO:teuthology.orchestra.run.smithi061.stdout:Discarding blocks...Done. 2023-12-24T19:56:41.427 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi061.front.sepia.ceph.com -o noatime 2023-12-24T19:56:41.428 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-24T19:56:41.602 DEBUG:teuthology.orchestra.run.smithi061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-24T19:56:41.641 DEBUG:teuthology.orchestra.run.smithi061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:41.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:41.731+0000 7fd0223af540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-24T19:56:41.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:41.732+0000 7fd0223af540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-24T19:56:41.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:41.733+0000 7fd0223af540 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-12-24T19:56:41.744 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-24T19:56:41.773 DEBUG:teuthology.orchestra.run.smithi061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:41.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:41.862+0000 7fe9c6c20540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-24T19:56:41.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:41.863+0000 7fe9c6c20540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-24T19:56:41.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:41.863+0000 7fe9c6c20540 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-12-24T19:56:41.870 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-24T19:56:41.897 DEBUG:teuthology.orchestra.run.smithi061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:41.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:41.982+0000 7feeec9ab540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-24T19:56:41.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:41.982+0000 7feeec9ab540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-24T19:56:41.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:41.982+0000 7feeec9ab540 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-12-24T19:56:41.991 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-24T19:56:42.018 DEBUG:teuthology.orchestra.run.smithi061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:42.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:42.102+0000 7f529fa8a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-24T19:56:42.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:42.102+0000 7f529fa8a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-24T19:56:42.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:42.102+0000 7f529fa8a540 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-12-24T19:56:42.108 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-24T19:56:42.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-24T19:56:42.168 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-24T19:56:42.168 INFO:tasks.ceph:role: osd.4 2023-12-24T19:56:42.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:56:42.168 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-24T19:56:42.246 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T19:56:42.247 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T19:56:42.247 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T19:56:42.247 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-24T19:56:42.247 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T19:56:42.247 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-24T19:56:42.247 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T19:56:42.247 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T19:56:42.247 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T19:56:42.247 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T19:56:42.676 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-24T19:56:42.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-24T19:56:42.678 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-24T19:56:42.858 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-24T19:56:42.894 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-24T19:56:42.964 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-24T19:56:42.964 INFO:tasks.ceph:role: osd.5 2023-12-24T19:56:42.964 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:56:42.964 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-24T19:56:43.041 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T19:56:43.041 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T19:56:43.041 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T19:56:43.041 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-24T19:56:43.041 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T19:56:43.041 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-24T19:56:43.041 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T19:56:43.041 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T19:56:43.041 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T19:56:43.041 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T19:56:43.465 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-24T19:56:43.466 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-24T19:56:43.466 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-24T19:56:43.582 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-24T19:56:43.616 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-24T19:56:43.685 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-24T19:56:43.685 INFO:tasks.ceph:role: osd.6 2023-12-24T19:56:43.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:56:43.685 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-24T19:56:43.761 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T19:56:43.761 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T19:56:43.761 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T19:56:43.761 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-24T19:56:43.762 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T19:56:43.762 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-24T19:56:43.762 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T19:56:43.762 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T19:56:43.762 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T19:56:43.762 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T19:56:44.201 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-24T19:56:44.202 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-24T19:56:44.203 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-24T19:56:44.345 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-24T19:56:44.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-24T19:56:44.450 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-24T19:56:44.450 INFO:tasks.ceph:role: osd.7 2023-12-24T19:56:44.450 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:56:44.450 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-24T19:56:44.527 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-24T19:56:44.527 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-24T19:56:44.527 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-24T19:56:44.527 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-24T19:56:44.527 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-24T19:56:44.527 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-24T19:56:44.527 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-24T19:56:44.527 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-24T19:56:44.527 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-24T19:56:44.528 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-24T19:56:44.968 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-24T19:56:44.970 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-24T19:56:44.970 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-24T19:56:45.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-24T19:56:45.191 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.281+0000 7fd69df3e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-24T19:56:45.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.282+0000 7fd69df3e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-24T19:56:45.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.283+0000 7fd69df3e540 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-12-24T19:56:45.294 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-24T19:56:45.323 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:45.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.408+0000 7ff4222c6540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-24T19:56:45.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.408+0000 7ff4222c6540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-24T19:56:45.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.409+0000 7ff4222c6540 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-12-24T19:56:45.415 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-24T19:56:45.443 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:45.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.524+0000 7f00770d0540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-24T19:56:45.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.524+0000 7f00770d0540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-24T19:56:45.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.525+0000 7f00770d0540 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-12-24T19:56:45.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-24T19:56:45.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:45.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.682+0000 7f22af1f4540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-24T19:56:45.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.683+0000 7f22af1f4540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-24T19:56:45.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:45.683+0000 7f22af1f4540 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-12-24T19:56:45.689 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-24T19:56:45.756 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-24T19:56:45.757 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:45.757 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-24T19:56:45.790 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:45.790 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-24T19:56:45.861 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:45.861 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-24T19:56:45.931 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:45.931 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-24T19:56:46.000 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:46.000 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-24T19:56:46.069 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:46.069 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-24T19:56:46.137 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:46.137 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-24T19:56:46.205 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:46.205 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-24T19:56:46.232 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:46.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-24T19:56:46.299 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:46.300 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-24T19:56:46.366 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:46.366 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-24T19:56:46.433 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:46.433 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-24T19:56:46.500 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:46.500 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-24T19:56:46.567 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:46.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-24T19:56:46.633 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:46.634 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-24T19:56:46.653 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:46.653 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-24T19:56:46.712 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:46.712 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-24T19:56:46.729 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:46.729 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-24T19:56:46.785 INFO:tasks.ceph:Adding keys to all mons... 2023-12-24T19:56:46.786 DEBUG:teuthology.orchestra.run.smithi061:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-24T19:56:46.788 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-24T19:56:46.828 INFO:teuthology.orchestra.run.smithi061.stdout:[mgr.y] 2023-12-24T19:56:46.828 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A== 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.a] 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew== 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.c] 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g== 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.0] 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag== 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.1] 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw== 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.2] 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ== 2023-12-24T19:56:46.829 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.3] 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA== 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout:[mgr.x] 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg== 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.b] 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw== 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.d] 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg== 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.4] 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ== 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.5] 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w== 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.6] 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw== 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.7] 2023-12-24T19:56:46.830 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw== 2023-12-24T19:56:46.831 INFO:teuthology.orchestra.run.smithi061.stdout:[client.0] 2023-12-24T19:56:46.831 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA== 2023-12-24T19:56:46.831 INFO:teuthology.orchestra.run.smithi061.stdout:[client.2] 2023-12-24T19:56:46.831 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg== 2023-12-24T19:56:46.831 INFO:teuthology.orchestra.run.smithi061.stdout:[client.1] 2023-12-24T19:56:46.831 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w== 2023-12-24T19:56:46.831 INFO:teuthology.orchestra.run.smithi061.stdout:[client.3] 2023-12-24T19:56:46.831 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g== 2023-12-24T19:56:46.850 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2023-12-24T19:56:46.850 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A== 2023-12-24T19:56:46.850 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-12-24T19:56:46.850 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew== 2023-12-24T19:56:46.850 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-12-24T19:56:46.850 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g== 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag== 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw== 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ== 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA== 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg== 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw== 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg== 2023-12-24T19:56:46.851 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ== 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w== 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw== 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw== 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA== 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout:[client.2] 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg== 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w== 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout:[client.3] 2023-12-24T19:56:46.852 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g== 2023-12-24T19:56:46.853 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-24T19:56:46.874 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-24T19:56:46.943 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T19:56:46.946 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T19:56:46.999 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T19:56:47.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T19:56:47.054 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.056 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.105 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.107 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.157 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.159 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.208 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.260 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-24T19:56:47.262 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-24T19:56:47.312 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T19:56:47.314 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T19:56:47.367 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T19:56:47.369 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-24T19:56:47.422 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.424 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.474 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.476 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.525 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.577 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.579 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-24T19:56:47.629 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T19:56:47.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T19:56:47.684 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T19:56:47.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T19:56:47.739 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T19:56:47.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T19:56:47.794 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T19:56:47.797 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-24T19:56:47.850 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-24T19:56:47.850 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-24T19:56:47.878 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-24T19:56:47.972 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-24T19:56:48.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-24T19:56:48.027 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-24T19:56:48.121 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-24T19:56:48.147 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-24T19:56:48.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-24T19:56:48.308 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-24T19:56:48.335 DEBUG:teuthology.orchestra.run.smithi061:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:48.337 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-24T19:56:48.392 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-24T19:56:48.392 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-24T19:56:48.392 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-24T19:56:48.395 INFO:tasks.ceph.mon.a:Started 2023-12-24T19:56:48.396 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-24T19:56:48.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-24T19:56:48.435 INFO:tasks.ceph.mon.b:Started 2023-12-24T19:56:48.435 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-24T19:56:48.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-24T19:56:48.438 INFO:tasks.ceph.mon.c:Started 2023-12-24T19:56:48.438 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-24T19:56:48.438 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-24T19:56:48.438 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-24T19:56:48.440 INFO:tasks.ceph.mgr.y:Started 2023-12-24T19:56:48.440 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-24T19:56:48.440 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-24T19:56:48.442 INFO:tasks.ceph.mgr.x:Started 2023-12-24T19:56:48.442 INFO:tasks.ceph:Setting crush tunables to default 2023-12-24T19:56:48.442 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --cluster ceph osd crush tunables default 2023-12-24T19:56:48.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.566+0000 7fcb13395700 1 Processor -- start 2023-12-24T19:56:48.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.566+0000 7fcb13395700 1 -- start start 2023-12-24T19:56:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.567+0000 7fcb13395700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcb0c157880 0x7fcb0c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.567+0000 7fcb13395700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.567+0000 7fcb13395700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb0c069480 0x7fcb0c0ae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.567+0000 7fcb13395700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0c0b1f70 con 0x7fcb0c157880 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.567+0000 7fcb13395700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0c06d010 con 0x7fcb0c069480 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.567+0000 7fcb13395700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0af5c0 con 0x7fcb0c157c50 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.567+0000 7fcb11131700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcb0c157880 0x7fcb0c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.567+0000 7fcb11131700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcb0c157880 0x7fcb0c0b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51688/0 (socket says 172.21.15.61:51688) 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.567+0000 7fcb11131700 1 -- 172.21.15.61:0/419244273 learned_addr learned my addr 172.21.15.61:0/419244273 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb11131700 1 -- 172.21.15.61:0/419244273 >> v2:172.21.15.61:3300/0 conn(0x7fcb0c157880 msgr2=0x7fcb0c0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb11131700 1 -- 172.21.15.61:0/419244273 >> v2:172.21.15.61:3300/0 conn(0x7fcb0c157880 msgr2=0x7fcb0c0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb11131700 1 --2- 172.21.15.61:0/419244273 >> v2:172.21.15.61:3300/0 conn(0x7fcb0c157880 0x7fcb0c0b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb11131700 1 --2- 172.21.15.61:0/419244273 >> v2:172.21.15.61:3300/0 conn(0x7fcb0c157880 0x7fcb0c0b15d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb11932700 1 --2- 172.21.15.61:0/419244273 >> v2:172.21.15.133:3300/0 conn(0x7fcb0c069480 0x7fcb0c0ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb10930700 1 --2- 172.21.15.61:0/419244273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb11932700 1 -- 172.21.15.61:0/419244273 >> v2:172.21.15.133:3300/0 conn(0x7fcb0c069480 msgr2=0x7fcb0c0ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-24T19:56:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb11932700 1 -- 172.21.15.61:0/419244273 >> v2:172.21.15.133:3300/0 conn(0x7fcb0c069480 msgr2=0x7fcb0c0ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-24T19:56:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb11932700 1 --2- 172.21.15.61:0/419244273 >> v2:172.21.15.133:3300/0 conn(0x7fcb0c069480 0x7fcb0c0ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-24T19:56:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb10930700 1 -- 172.21.15.61:0/419244273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 msgr2=0x7fcb0c0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-24T19:56:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb11932700 1 --2- 172.21.15.61:0/419244273 >> v2:172.21.15.133:3300/0 conn(0x7fcb0c069480 0x7fcb0c0ae710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:56:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb10930700 1 -- 172.21.15.61:0/419244273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 msgr2=0x7fcb0c0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-24T19:56:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb10930700 1 --2- 172.21.15.61:0/419244273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-24T19:56:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.568+0000 7fcb10930700 1 --2- 172.21.15.61:0/419244273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c0ae1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-24T19:56:48.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb11131700 1 --2- 172.21.15.61:0/419244273 >> v2:172.21.15.61:3300/0 conn(0x7fcb0c157880 0x7fcb0c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:48.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb10930700 1 --2- 172.21.15.61:0/419244273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:48.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb11932700 1 --2- 172.21.15.61:0/419244273 >> v2:172.21.15.133:3300/0 conn(0x7fcb0c069480 0x7fcb0c0ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:48.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb11131700 1 -- 172.21.15.61:0/419244273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 msgr2=0x7fcb0c0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:48.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb11131700 1 --2- 172.21.15.61:0/419244273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:48.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb11131700 1 -- 172.21.15.61:0/419244273 >> v2:172.21.15.133:3300/0 conn(0x7fcb0c069480 msgr2=0x7fcb0c0ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:48.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb11131700 1 --2- 172.21.15.61:0/419244273 >> v2:172.21.15.133:3300/0 conn(0x7fcb0c069480 0x7fcb0c0ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:48.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb11131700 1 -- 172.21.15.61:0/419244273 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0b1c90 con 0x7fcb0c157880 2023-12-24T19:56:48.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb11131700 1 --2- 172.21.15.61:0/419244273 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c157880 0x7fcb0c0b15d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c069a80 tx=0x7fcafc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5224d6dd989acf62 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:48.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb03fff700 1 -- 172.21.15.61:0/419244273 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc013410 con 0x7fcb0c157880 2023-12-24T19:56:48.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb03fff700 1 -- 172.21.15.61:0/419244273 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc013570 con 0x7fcb0c157880 2023-12-24T19:56:48.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.769+0000 7fcb03fff700 1 -- 172.21.15.61:0/419244273 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc013970 con 0x7fcb0c157880 2023-12-24T19:56:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.770+0000 7fcb13395700 1 -- 172.21.15.61:0/419244273 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c157880 msgr2=0x7fcb0c0b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.770+0000 7fcb13395700 1 --2- 172.21.15.61:0/419244273 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c157880 0x7fcb0c0b15d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c069a80 tx=0x7fcafc008040 comp rx=0 tx=0).stop 2023-12-24T19:56:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.770+0000 7fcb13395700 1 -- 172.21.15.61:0/419244273 shutdown_connections 2023-12-24T19:56:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.770+0000 7fcb13395700 1 --2- 172.21.15.61:0/419244273 >> v2:172.21.15.133:3300/0 conn(0x7fcb0c069480 0x7fcb0c0ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.770+0000 7fcb13395700 1 --2- 172.21.15.61:0/419244273 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c157880 0x7fcb0c0b15d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.770+0000 7fcb13395700 1 --2- 172.21.15.61:0/419244273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.770+0000 7fcb13395700 1 -- 172.21.15.61:0/419244273 >> 172.21.15.61:0/419244273 conn(0x7fcb0c067550 msgr2=0x7fcb0c067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.770+0000 7fcb13395700 1 -- 172.21.15.61:0/419244273 shutdown_connections 2023-12-24T19:56:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.770+0000 7fcb13395700 1 -- 172.21.15.61:0/419244273 wait complete. 2023-12-24T19:56:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.771+0000 7fcb13395700 1 Processor -- start 2023-12-24T19:56:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.771+0000 7fcb13395700 1 -- start start 2023-12-24T19:56:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.772+0000 7fcb13395700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c069480 0x7fcb0c1489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.772+0000 7fcb13395700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb0c157880 0x7fcb0c0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.772+0000 7fcb13395700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.772+0000 7fcb13395700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c15b5c0 con 0x7fcb0c069480 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.772+0000 7fcb13395700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0c96b0 con 0x7fcb0c157880 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.772+0000 7fcb13395700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0c9990 con 0x7fcb0c157c50 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.772+0000 7fcb11131700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c069480 0x7fcb0c1489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.772+0000 7fcb11131700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c069480 0x7fcb0c1489f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51702/0 (socket says 172.21.15.61:51702) 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.772+0000 7fcb11131700 1 -- 172.21.15.61:0/3627851965 learned_addr learned my addr 172.21.15.61:0/3627851965 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb10930700 1 --2- 172.21.15.61:0/3627851965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb0c157880 0x7fcb0c0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb11932700 1 --2- 172.21.15.61:0/3627851965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb11131700 1 -- 172.21.15.61:0/3627851965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 msgr2=0x7fcb0c158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb11131700 1 --2- 172.21.15.61:0/3627851965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb11131700 1 -- 172.21.15.61:0/3627851965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb0c157880 msgr2=0x7fcb0c0c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb11131700 1 --2- 172.21.15.61:0/3627851965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb0c157880 0x7fcb0c0c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb11131700 1 -- 172.21.15.61:0/3627851965 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc009570 con 0x7fcb0c069480 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb11131700 1 --2- 172.21.15.61:0/3627851965 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c069480 0x7fcb0c1489f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00a010 tx=0x7fcafc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb017fa700 1 -- 172.21.15.61:0/3627851965 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00e9e0 con 0x7fcb0c069480 2023-12-24T19:56:48.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb017fa700 1 -- 172.21.15.61:0/3627851965 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc00eba0 con 0x7fcb0c069480 2023-12-24T19:56:48.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb13395700 1 -- 172.21.15.61:0/3627851965 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0c0c9c70 con 0x7fcb0c069480 2023-12-24T19:56:48.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb017fa700 1 -- 172.21.15.61:0/3627851965 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc024410 con 0x7fcb0c069480 2023-12-24T19:56:48.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb13395700 1 -- 172.21.15.61:0/3627851965 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0c15b230 con 0x7fcb0c069480 2023-12-24T19:56:48.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb017fa700 1 -- 172.21.15.61:0/3627851965 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcafc024840 con 0x7fcb0c069480 2023-12-24T19:56:48.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.773+0000 7fcb017fa700 1 -- 172.21.15.61:0/3627851965 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcafc02e740 con 0x7fcb0c069480 2023-12-24T19:56:48.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.774+0000 7fcb13395700 1 -- 172.21.15.61:0/3627851965 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0c04c3c0 con 0x7fcb0c069480 2023-12-24T19:56:48.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.776+0000 7fcb017fa700 1 -- 172.21.15.61:0/3627851965 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcafc029020 con 0x7fcb0c069480 2023-12-24T19:56:48.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.853+0000 7fcb13395700 1 -- 172.21.15.61:0/3627851965 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcb0c06c9c0 con 0x7fcb0c069480 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.856+0000 7fcb017fa700 1 -- 172.21.15.61:0/3627851965 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcafc00c070 con 0x7fcb0c069480 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.857+0000 7fcb13395700 1 -- 172.21.15.61:0/3627851965 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c069480 msgr2=0x7fcb0c1489f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.857+0000 7fcb13395700 1 --2- 172.21.15.61:0/3627851965 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c069480 0x7fcb0c1489f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00a010 tx=0x7fcafc01a000 comp rx=0 tx=0).stop 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.857+0000 7fcb13395700 1 -- 172.21.15.61:0/3627851965 shutdown_connections 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.857+0000 7fcb13395700 1 --2- 172.21.15.61:0/3627851965 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb0c157c50 0x7fcb0c158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.857+0000 7fcb13395700 1 --2- 172.21.15.61:0/3627851965 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb0c069480 0x7fcb0c1489f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.857+0000 7fcb13395700 1 --2- 172.21.15.61:0/3627851965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb0c157880 0x7fcb0c0c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.857+0000 7fcb13395700 1 -- 172.21.15.61:0/3627851965 >> 172.21.15.61:0/3627851965 conn(0x7fcb0c067550 msgr2=0x7fcb0c06d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.857+0000 7fcb13395700 1 -- 172.21.15.61:0/3627851965 shutdown_connections 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:48.857+0000 7fcb13395700 1 -- 172.21.15.61:0/3627851965 wait complete. 2023-12-24T19:56:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:adjusted tunables profile to default 2023-12-24T19:56:48.870 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-24T19:56:48.870 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:48.870 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-24T19:56:48.898 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:48.898 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-24T19:56:48.966 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:48.966 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-24T19:56:49.034 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-12-24T19:56:49.034 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-24T19:56:49.101 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:49.101 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-24T19:56:49.125 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:49.125+0000 7f514aa1a1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T19:56:49.129 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:49.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-24T19:56:49.144 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:49.144+0000 7fc83e5401c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-24T19:56:49.196 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:49.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-24T19:56:49.207 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:49.206+0000 7f514aa1a1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T19:56:49.226 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:49.226+0000 7fc83e5401c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-24T19:56:49.232 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-24T19:56:49.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-24T19:56:49.282 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:49.281+0000 7f514aa1a1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T19:56:49.298 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-12-24T19:56:49.301 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:49.301+0000 7fc83e5401c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-24T19:56:49.353 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:49.352+0000 7f514aa1a1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T19:56:49.374 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:49.373+0000 7fc83e5401c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-24T19:56:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.458+0000 7f07e539d700 1 Processor -- start 2023-12-24T19:56:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.458+0000 7f07e539d700 1 -- start start 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.458+0000 7f07e539d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f07e0159cb0 0x7f07e006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.458+0000 7f07e539d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f07e00c8930 0x7f07e0063c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.458+0000 7f07e539d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e00641c0 con 0x7f07e00c8560 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.458+0000 7f07e539d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e0069740 con 0x7f07e00c8930 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.458+0000 7f07e539d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e006d930 con 0x7f07e0159cb0 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07df7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f07e0159cb0 0x7f07e006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07df7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f07e0159cb0 0x7f07e006d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43566/0 (socket says 172.21.15.133:43566) 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07df7fe700 1 -- 172.21.15.133:0/673845267 learned_addr learned my addr 172.21.15.133:0/673845267 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07dffff700 1 --1- 172.21.15.133:0/673845267 >> v1:172.21.15.133:6789/0 conn(0x7f07e00c8560 0x7f07e01595a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42908/0 (socket says 172.21.15.133:42908) 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07e4b9c700 1 --2- 172.21.15.133:0/673845267 >> v2:172.21.15.61:3300/0 conn(0x7f07e00c8930 0x7f07e0063c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07df7fe700 1 -- 172.21.15.133:0/673845267 >> v2:172.21.15.61:3300/0 conn(0x7f07e00c8930 msgr2=0x7f07e0063c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07df7fe700 1 --2- 172.21.15.133:0/673845267 >> v2:172.21.15.61:3300/0 conn(0x7f07e00c8930 0x7f07e0063c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07df7fe700 1 -- 172.21.15.133:0/673845267 >> v1:172.21.15.133:6789/0 conn(0x7f07e00c8560 legacy=0x7f07e01595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07df7fe700 1 -- 172.21.15.133:0/673845267 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e006dc10 con 0x7f07e0159cb0 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07df7fe700 1 --2- 172.21.15.133:0/673845267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e0159cb0 0x7f07e006d230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f07e00c7280 tx=0x7f07d4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=177591caf1975f65 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07deffd700 1 -- 172.21.15.133:0/673845267 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4009e70 con 0x7f07e0159cb0 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07deffd700 1 -- 172.21.15.133:0/673845267 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d400b8f0 con 0x7f07e0159cb0 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.459+0000 7f07deffd700 1 -- 172.21.15.133:0/673845267 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400bc90 con 0x7f07e0159cb0 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.460+0000 7f07e539d700 1 -- 172.21.15.133:0/673845267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e0159cb0 msgr2=0x7f07e006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.460+0000 7f07e539d700 1 --2- 172.21.15.133:0/673845267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e0159cb0 0x7f07e006d230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f07e00c7280 tx=0x7f07d4009250 comp rx=0 tx=0).stop 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.460+0000 7f07e539d700 1 -- 172.21.15.133:0/673845267 shutdown_connections 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.460+0000 7f07e539d700 1 --2- 172.21.15.133:0/673845267 >> v2:172.21.15.61:3300/0 conn(0x7f07e00c8930 0x7f07e0063c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.460+0000 7f07e539d700 1 --2- 172.21.15.133:0/673845267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e0159cb0 0x7f07e006d230 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.460+0000 7f07e539d700 1 -- 172.21.15.133:0/673845267 >> 172.21.15.133:0/673845267 conn(0x7f07e00cd780 msgr2=0x7f07e00c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.460+0000 7f07e539d700 1 -- 172.21.15.133:0/673845267 shutdown_connections 2023-12-24T19:56:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.460+0000 7f07e539d700 1 -- 172.21.15.133:0/673845267 wait complete. 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.461+0000 7f07e539d700 1 Processor -- start 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.461+0000 7f07e539d700 1 -- start start 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.462+0000 7f07e539d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07e00c8560 0x7f07e00c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.462+0000 7f07e539d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e00c8930 0x7f07e016e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.462+0000 7f07e539d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07e0159cb0 0x7f07e015df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.462+0000 7f07e539d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00c4740 con 0x7f07e00c8560 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.462+0000 7f07e539d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e016e5f0 con 0x7f07e00c8930 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.462+0000 7f07e539d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00c6a90 con 0x7f07e0159cb0 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.462+0000 7f07df7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e00c8930 0x7f07e016e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07df7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e00c8930 0x7f07e016e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43580/0 (socket says 172.21.15.133:43580) 2023-12-24T19:56:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07e4b9c700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07e0159cb0 0x7f07e015df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07df7fe700 1 -- 172.21.15.133:0/1598917217 learned_addr learned my addr 172.21.15.133:0/1598917217 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07dffff700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07e00c8560 0x7f07e00c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07df7fe700 1 -- 172.21.15.133:0/1598917217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07e0159cb0 msgr2=0x7f07e015df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07df7fe700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07e0159cb0 0x7f07e015df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07df7fe700 1 -- 172.21.15.133:0/1598917217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07e00c8560 msgr2=0x7f07e00c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07df7fe700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07e00c8560 0x7f07e00c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07df7fe700 1 -- 172.21.15.133:0/1598917217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40094f0 con 0x7f07e00c8930 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07e4b9c700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07e0159cb0 0x7f07e015df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07dffff700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07e00c8560 0x7f07e00c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07df7fe700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e00c8930 0x7f07e016e0b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f07e006da70 tx=0x7f07d4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07c7fff700 1 -- 172.21.15.133:0/1598917217 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400bc70 con 0x7f07e00c8930 2023-12-24T19:56:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07c7fff700 1 -- 172.21.15.133:0/1598917217 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4024440 con 0x7f07e00c8930 2023-12-24T19:56:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07c7fff700 1 -- 172.21.15.133:0/1598917217 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4024800 con 0x7f07e00c8930 2023-12-24T19:56:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07e539d700 1 -- 172.21.15.133:0/1598917217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e00c3e10 con 0x7f07e00c8930 2023-12-24T19:56:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07e539d700 1 -- 172.21.15.133:0/1598917217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e00c43d0 con 0x7f07e00c8930 2023-12-24T19:56:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07c7fff700 1 -- 172.21.15.133:0/1598917217 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f07d4024bb0 con 0x7f07e00c8930 2023-12-24T19:56:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.463+0000 7f07c7fff700 1 -- 172.21.15.133:0/1598917217 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f07d401aa10 con 0x7f07e00c8930 2023-12-24T19:56:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.465+0000 7f07e539d700 1 -- 172.21.15.133:0/1598917217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e00c6fb0 con 0x7f07e00c8930 2023-12-24T19:56:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.469+0000 7f07c7fff700 1 -- 172.21.15.133:0/1598917217 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f07d402a060 con 0x7f07e00c8930 2023-12-24T19:56:49.533 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:49.532+0000 7f514aa1a1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:56:49.550 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:49.550+0000 7fc83e5401c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:56:49.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.553+0000 7f07e539d700 1 -- 172.21.15.133:0/1598917217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f07e00c48b0 con 0x7f07e00c8930 2023-12-24T19:56:49.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.557+0000 7f07c7fff700 1 -- 172.21.15.133:0/1598917217 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f07d4015020 con 0x7f07e00c8930 2023-12-24T19:56:49.558 INFO:teuthology.orchestra.run.smithi133.stdout:0 2023-12-24T19:56:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.558+0000 7f07e539d700 1 -- 172.21.15.133:0/1598917217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e00c8930 msgr2=0x7f07e016e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.558+0000 7f07e539d700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e00c8930 0x7f07e016e0b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f07e006da70 tx=0x7f07d4017000 comp rx=0 tx=0).stop 2023-12-24T19:56:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.558+0000 7f07e539d700 1 -- 172.21.15.133:0/1598917217 shutdown_connections 2023-12-24T19:56:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.558+0000 7f07e539d700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07e0159cb0 0x7f07e015df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.558+0000 7f07e539d700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07e00c8560 0x7f07e00c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.558+0000 7f07e539d700 1 --2- 172.21.15.133:0/1598917217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07e00c8930 0x7f07e016e0b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.558+0000 7f07e539d700 1 -- 172.21.15.133:0/1598917217 >> 172.21.15.133:0/1598917217 conn(0x7f07e00cd780 msgr2=0x7f07e00c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.558+0000 7f07e539d700 1 -- 172.21.15.133:0/1598917217 shutdown_connections 2023-12-24T19:56:49.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.558+0000 7f07e539d700 1 -- 172.21.15.133:0/1598917217 wait complete. 2023-12-24T19:56:49.570 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-12-24T19:56:49.689 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:49.689+0000 7f514aa1a1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T19:56:49.704 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:49.703+0000 7fc83e5401c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-24T19:56:49.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.731+0000 7f031e6ce700 1 Processor -- start 2023-12-24T19:56:49.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.731+0000 7f031e6ce700 1 -- start start 2023-12-24T19:56:49.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f031e6ce700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03180c3630 0x7f03180c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f031e6ce700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031806aaf0 con 0x7f0318156b60 2023-12-24T19:56:49.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f031e6ce700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0318069c00 con 0x7f031806af80 2023-12-24T19:56:49.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f031e6ce700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0318069ee0 con 0x7f03180c3630 2023-12-24T19:56:49.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f031cc6b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03180c3630 0x7f03180c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f031cc6b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03180c3630 0x7f03180c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43590/0 (socket says 172.21.15.133:43590) 2023-12-24T19:56:49.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f03177fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f031806af80 0x7f03180c2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42914/0 (socket says 172.21.15.133:42914) 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f031cc6b700 1 -- 172.21.15.133:0/1885577892 learned_addr learned my addr 172.21.15.133:0/1885577892 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f0317fff700 1 --1- 172.21.15.133:0/1885577892 >> v1:172.21.15.61:6789/0 conn(0x7f0318156b60 0x7f0318067f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.133:47574/0 (socket says 172.21.15.133:47574) 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f031cc6b700 1 -- 172.21.15.133:0/1885577892 >> v1:172.21.15.133:6789/0 conn(0x7f031806af80 legacy=0x7f03180c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f031cc6b700 1 -- 172.21.15.133:0/1885577892 >> v1:172.21.15.61:6789/0 conn(0x7f0318156b60 legacy=0x7f0318067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f0316ffd700 1 -- 172.21.15.133:0/1885577892 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965410307 0 0) 0x7f031806aaf0 con 0x7f0318156b60 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.732+0000 7f031cc6b700 1 -- 172.21.15.133:0/1885577892 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031806a1c0 con 0x7f03180c3630 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f031cc6b700 1 --2- 172.21.15.133:0/1885577892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03180c3630 0x7f03180c8690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0310009f20 tx=0x7f0310009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7485cd3826dd8d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f0316ffd700 1 -- 172.21.15.133:0/1885577892 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03100092e0 con 0x7f03180c3630 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f0316ffd700 1 -- 172.21.15.133:0/1885577892 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031000ba80 con 0x7f03180c3630 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f0316ffd700 1 -- 172.21.15.133:0/1885577892 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000be40 con 0x7f03180c3630 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f031e6ce700 1 -- 172.21.15.133:0/1885577892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03180c3630 msgr2=0x7f03180c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f031e6ce700 1 --2- 172.21.15.133:0/1885577892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03180c3630 0x7f03180c8690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0310009f20 tx=0x7f0310009840 comp rx=0 tx=0).stop 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f031e6ce700 1 -- 172.21.15.133:0/1885577892 shutdown_connections 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f031e6ce700 1 --2- 172.21.15.133:0/1885577892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03180c3630 0x7f03180c8690 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f031e6ce700 1 -- 172.21.15.133:0/1885577892 >> 172.21.15.133:0/1885577892 conn(0x7f03180ce420 msgr2=0x7f03180ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f031e6ce700 1 -- 172.21.15.133:0/1885577892 shutdown_connections 2023-12-24T19:56:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.733+0000 7f031e6ce700 1 -- 172.21.15.133:0/1885577892 wait complete. 2023-12-24T19:56:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.734+0000 7f031e6ce700 1 Processor -- start 2023-12-24T19:56:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.735+0000 7f031e6ce700 1 -- start start 2023-12-24T19:56:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.735+0000 7f031e6ce700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f031806af80 0x7f0318153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.735+0000 7f031e6ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03180c3630 0x7f0318166ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.735+0000 7f031e6ce700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0318156b60 0x7f031814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.735+0000 7f031e6ce700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180b0790 con 0x7f0318156b60 2023-12-24T19:56:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.735+0000 7f031e6ce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180b09e0 con 0x7f03180c3630 2023-12-24T19:56:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.735+0000 7f031e6ce700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03180b0cc0 con 0x7f031806af80 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f0317fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f031806af80 0x7f0318153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f03177fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03180c3630 0x7f0318166ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f0317fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f031806af80 0x7f0318153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42486/0 (socket says 172.21.15.133:42486) 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f0317fff700 1 -- 172.21.15.133:0/2211944784 learned_addr learned my addr 172.21.15.133:0/2211944784 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f031cc6b700 1 --2- 172.21.15.133:0/2211944784 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0318156b60 0x7f031814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f0317fff700 1 -- 172.21.15.133:0/2211944784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03180c3630 msgr2=0x7f0318166ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f0317fff700 1 --2- 172.21.15.133:0/2211944784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03180c3630 0x7f0318166ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f0317fff700 1 -- 172.21.15.133:0/2211944784 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0318156b60 msgr2=0x7f031814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f0317fff700 1 --2- 172.21.15.133:0/2211944784 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0318156b60 0x7f031814d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f0317fff700 1 -- 172.21.15.133:0/2211944784 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0310009ae0 con 0x7f031806af80 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f03177fe700 1 --2- 172.21.15.133:0/2211944784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03180c3630 0x7f0318166ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f0317fff700 1 --2- 172.21.15.133:0/2211944784 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f031806af80 0x7f0318153840 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f030800c5b0 tx=0x7f0308001040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f02fffff700 1 -- 172.21.15.133:0/2211944784 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308005a70 con 0x7f031806af80 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f02fffff700 1 -- 172.21.15.133:0/2211944784 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0308005bd0 con 0x7f031806af80 2023-12-24T19:56:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f031e6ce700 1 -- 172.21.15.133:0/2211944784 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03180b0fa0 con 0x7f031806af80 2023-12-24T19:56:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f02fffff700 1 -- 172.21.15.133:0/2211944784 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03080070d0 con 0x7f031806af80 2023-12-24T19:56:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f031e6ce700 1 -- 172.21.15.133:0/2211944784 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03180b3080 con 0x7f031806af80 2023-12-24T19:56:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f02fffff700 1 -- 172.21.15.133:0/2211944784 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f030801c440 con 0x7f031806af80 2023-12-24T19:56:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.736+0000 7f02fffff700 1 -- 172.21.15.133:0/2211944784 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f03080127c0 con 0x7f031806af80 2023-12-24T19:56:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.738+0000 7f031e6ce700 1 -- 172.21.15.133:0/2211944784 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03180b32a0 con 0x7f031806af80 2023-12-24T19:56:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.740+0000 7f02fffff700 1 -- 172.21.15.133:0/2211944784 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0308017070 con 0x7f031806af80 2023-12-24T19:56:49.764 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:49.763+0000 7f514aa1a1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T19:56:49.777 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:49.777+0000 7fc83e5401c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-24T19:56:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.824+0000 7f031e6ce700 1 -- 172.21.15.133:0/2211944784 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f03180b14c0 con 0x7f031806af80 2023-12-24T19:56:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.828+0000 7f02fffff700 1 -- 172.21.15.133:0/2211944784 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0308007700 con 0x7f031806af80 2023-12-24T19:56:49.829 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T19:56:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.829+0000 7f031e6ce700 1 -- 172.21.15.133:0/2211944784 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f031806af80 msgr2=0x7f0318153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.829+0000 7f031e6ce700 1 --2- 172.21.15.133:0/2211944784 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f031806af80 0x7f0318153840 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f030800c5b0 tx=0x7f0308001040 comp rx=0 tx=0).stop 2023-12-24T19:56:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.829+0000 7f031e6ce700 1 -- 172.21.15.133:0/2211944784 shutdown_connections 2023-12-24T19:56:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.829+0000 7f031e6ce700 1 --2- 172.21.15.133:0/2211944784 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f031806af80 0x7f0318153840 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.829+0000 7f031e6ce700 1 --2- 172.21.15.133:0/2211944784 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0318156b60 0x7f031814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.829+0000 7f031e6ce700 1 --2- 172.21.15.133:0/2211944784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03180c3630 0x7f0318166ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.829+0000 7f031e6ce700 1 -- 172.21.15.133:0/2211944784 >> 172.21.15.133:0/2211944784 conn(0x7f03180ce420 msgr2=0x7f03180cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.829+0000 7f031e6ce700 1 -- 172.21.15.133:0/2211944784 shutdown_connections 2023-12-24T19:56:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.829+0000 7f031e6ce700 1 -- 172.21.15.133:0/2211944784 wait complete. 2023-12-24T19:56:49.842 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-12-24T19:56:49.907 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:49.906+0000 7f514aa1a1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T19:56:49.917 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:49.917+0000 7fc83e5401c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-24T19:56:49.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.959+0000 7fb3f2a41700 1 Processor -- start 2023-12-24T19:56:49.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.960+0000 7fb3f2a41700 1 -- start start 2023-12-24T19:56:49.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3f2a41700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3ec0c9050 0x7fb3ec0af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3f2a41700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec06b080 con 0x7fb3ec1580a0 2023-12-24T19:56:49.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3f2a41700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec0b00f0 con 0x7fb3ec15b050 2023-12-24T19:56:49.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3f2a41700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec15b4d0 con 0x7fb3ec0c9050 2023-12-24T19:56:49.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3eb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3ec0c9050 0x7fb3ec0af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3eb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3ec0c9050 0x7fb3ec0af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43606/0 (socket says 172.21.15.133:43606) 2023-12-24T19:56:49.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3eb7fe700 1 -- 172.21.15.133:0/859694388 learned_addr learned my addr 172.21.15.133:0/859694388 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:49.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3eb7fe700 1 -- 172.21.15.133:0/859694388 >> v1:172.21.15.133:6789/0 conn(0x7fb3ec15b050 legacy=0x7fb3ec067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3eb7fe700 1 -- 172.21.15.133:0/859694388 >> v1:172.21.15.61:6789/0 conn(0x7fb3ec1580a0 legacy=0x7fb3ec15a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3eb7fe700 1 -- 172.21.15.133:0/859694388 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec15b720 con 0x7fb3ec0c9050 2023-12-24T19:56:49.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3eb7fe700 1 --2- 172.21.15.133:0/859694388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 0x7fb3ec0af8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00099b0 tx=0x7fb3e0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=230c55a6f1659ce0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:49.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3eaffd700 1 -- 172.21.15.133:0/859694388 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000b860 con 0x7fb3ec0c9050 2023-12-24T19:56:49.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3eaffd700 1 -- 172.21.15.133:0/859694388 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e000b9c0 con 0x7fb3ec0c9050 2023-12-24T19:56:49.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.961+0000 7fb3eaffd700 1 -- 172.21.15.133:0/859694388 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000bd60 con 0x7fb3ec0c9050 2023-12-24T19:56:49.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.962+0000 7fb3f2a41700 1 -- 172.21.15.133:0/859694388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 msgr2=0x7fb3ec0af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.962+0000 7fb3f2a41700 1 --2- 172.21.15.133:0/859694388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 0x7fb3ec0af8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb3e00099b0 tx=0x7fb3e0009250 comp rx=0 tx=0).stop 2023-12-24T19:56:49.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.962+0000 7fb3f2a41700 1 -- 172.21.15.133:0/859694388 shutdown_connections 2023-12-24T19:56:49.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.962+0000 7fb3f2a41700 1 --2- 172.21.15.133:0/859694388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 0x7fb3ec0af8e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.962+0000 7fb3f2a41700 1 -- 172.21.15.133:0/859694388 >> 172.21.15.133:0/859694388 conn(0x7fb3ec0ce400 msgr2=0x7fb3ec0ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:49.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.962+0000 7fb3f2a41700 1 -- 172.21.15.133:0/859694388 shutdown_connections 2023-12-24T19:56:49.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.962+0000 7fb3f2a41700 1 -- 172.21.15.133:0/859694388 wait complete. 2023-12-24T19:56:49.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.963+0000 7fb3f2a41700 1 Processor -- start 2023-12-24T19:56:49.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3f2a41700 1 -- start start 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3f2a41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 0x7fb3ec0ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3f2a41700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3ec1580a0 0x7fb3ec154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3f2a41700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3ec15b050 0x7fb3ec0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3f2a41700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0c6d60 con 0x7fb3ec1580a0 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3f2a41700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0c5eb0 con 0x7fb3ec0c9050 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3f2a41700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0ad880 con 0x7fb3ec15b050 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 0x7fb3ec0ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3f0fde700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3ec15b050 0x7fb3ec0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 0x7fb3ec0ad340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43616/0 (socket says 172.21.15.133:43616) 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3ebfff700 1 -- 172.21.15.133:0/3253875410 learned_addr learned my addr 172.21.15.133:0/3253875410 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.964+0000 7fb3eb7fe700 1 --2- 172.21.15.133:0/3253875410 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3ec1580a0 0x7fb3ec154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3ebfff700 1 -- 172.21.15.133:0/3253875410 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3ec15b050 msgr2=0x7fb3ec0c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3ebfff700 1 --2- 172.21.15.133:0/3253875410 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3ec15b050 0x7fb3ec0c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3ebfff700 1 -- 172.21.15.133:0/3253875410 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3ec1580a0 msgr2=0x7fb3ec154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3ebfff700 1 --2- 172.21.15.133:0/3253875410 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3ec1580a0 0x7fb3ec154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3ebfff700 1 -- 172.21.15.133:0/3253875410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e00094f0 con 0x7fb3ec0c9050 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3f0fde700 1 --2- 172.21.15.133:0/3253875410 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3ec15b050 0x7fb3ec0c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3eb7fe700 1 --2- 172.21.15.133:0/3253875410 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3ec1580a0 0x7fb3ec154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3ebfff700 1 --2- 172.21.15.133:0/3253875410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 0x7fb3ec0ad340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00c590 tx=0x7fb3dc00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3d3fff700 1 -- 172.21.15.133:0/3253875410 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc011590 con 0x7fb3ec0c9050 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3d3fff700 1 -- 172.21.15.133:0/3253875410 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc011710 con 0x7fb3ec0c9050 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3f2a41700 1 -- 172.21.15.133:0/3253875410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec0adb20 con 0x7fb3ec0c9050 2023-12-24T19:56:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3d3fff700 1 -- 172.21.15.133:0/3253875410 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc011ad0 con 0x7fb3ec0c9050 2023-12-24T19:56:49.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3f2a41700 1 -- 172.21.15.133:0/3253875410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec0c6150 con 0x7fb3ec0c9050 2023-12-24T19:56:49.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3d3fff700 1 -- 172.21.15.133:0/3253875410 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb3dc01c6c0 con 0x7fb3ec0c9050 2023-12-24T19:56:49.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.965+0000 7fb3d3fff700 1 -- 172.21.15.133:0/3253875410 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fb3dc012850 con 0x7fb3ec0c9050 2023-12-24T19:56:49.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.966+0000 7fb3f2a41700 1 -- 172.21.15.133:0/3253875410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec04c3c0 con 0x7fb3ec0c9050 2023-12-24T19:56:49.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:49.968+0000 7fb3d3fff700 1 -- 172.21.15.133:0/3253875410 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb3dc017070 con 0x7fb3ec0c9050 2023-12-24T19:56:49.985 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:49.984+0000 7f514aa1a1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T19:56:49.995 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:49.994+0000 7fc83e5401c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-24T19:56:50.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.051+0000 7fb3f2a41700 1 -- 172.21.15.133:0/3253875410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7fb3ec0b37a0 con 0x7fb3ec0c9050 2023-12-24T19:56:50.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.056+0000 7fb3d3fff700 1 -- 172.21.15.133:0/3253875410 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb3dc012420 con 0x7fb3ec0c9050 2023-12-24T19:56:50.056 INFO:teuthology.orchestra.run.smithi133.stdout:2 2023-12-24T19:56:50.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.056+0000 7fb3f2a41700 1 -- 172.21.15.133:0/3253875410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 msgr2=0x7fb3ec0ad340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.056+0000 7fb3f2a41700 1 --2- 172.21.15.133:0/3253875410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 0x7fb3ec0ad340 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00c590 tx=0x7fb3dc00c8a0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.057+0000 7fb3f2a41700 1 -- 172.21.15.133:0/3253875410 shutdown_connections 2023-12-24T19:56:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.057+0000 7fb3f2a41700 1 --2- 172.21.15.133:0/3253875410 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3ec15b050 0x7fb3ec0c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.057+0000 7fb3f2a41700 1 --2- 172.21.15.133:0/3253875410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3ec0c9050 0x7fb3ec0ad340 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.057+0000 7fb3f2a41700 1 --2- 172.21.15.133:0/3253875410 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3ec1580a0 0x7fb3ec154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.057+0000 7fb3f2a41700 1 -- 172.21.15.133:0/3253875410 >> 172.21.15.133:0/3253875410 conn(0x7fb3ec0ce400 msgr2=0x7fb3ec067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.057+0000 7fb3f2a41700 1 -- 172.21.15.133:0/3253875410 shutdown_connections 2023-12-24T19:56:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.057+0000 7fb3f2a41700 1 -- 172.21.15.133:0/3253875410 wait complete. 2023-12-24T19:56:50.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-12-24T19:56:50.158 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:50.158+0000 7f514aa1a1c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-24T19:56:50.175 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:50.174+0000 7fc83e5401c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-24T19:56:50.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.211+0000 7f74333df700 1 Processor -- start 2023-12-24T19:56:50.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.212+0000 7f74333df700 1 -- start start 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.213+0000 7f74333df700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 0x7f742c164c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.213+0000 7f74333df700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c0c8c30 con 0x7f742c15afd0 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.213+0000 7f74333df700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742c0c7e00 con 0x7f742c15ac00 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.213+0000 7f74333df700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c0c80b0 con 0x7f742c0cb5a0 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.213+0000 7f743117b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f742c15ac00 0x7f742c0c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42940/0 (socket says 172.21.15.133:42940) 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.213+0000 7f743117b700 1 -- 172.21.15.133:0/685283999 learned_addr learned my addr 172.21.15.133:0/685283999 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.213+0000 7f743197c700 1 --2- 172.21.15.133:0/685283999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 0x7f742c164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.214+0000 7f7423fff700 1 -- 172.21.15.133:0/685283999 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318581593 0 0) 0x7f742c0c7e00 con 0x7f742c15ac00 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.214+0000 7f743197c700 1 -- 172.21.15.133:0/685283999 >> v1:172.21.15.133:6789/0 conn(0x7f742c15ac00 legacy=0x7f742c0c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.214+0000 7f743197c700 1 -- 172.21.15.133:0/685283999 >> v1:172.21.15.61:6789/0 conn(0x7f742c15afd0 legacy=0x7f742c0cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.214+0000 7f743197c700 1 -- 172.21.15.133:0/685283999 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c0c8390 con 0x7f742c0cb5a0 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.214+0000 7f743197c700 1 --2- 172.21.15.133:0/685283999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 0x7f742c164c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7424009e90 tx=0x7f7424009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff1d183321cf3135 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.214+0000 7f7423fff700 1 -- 172.21.15.133:0/685283999 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400e070 con 0x7f742c0cb5a0 2023-12-24T19:56:50.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.214+0000 7f7423fff700 1 -- 172.21.15.133:0/685283999 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742400bc30 con 0x7f742c0cb5a0 2023-12-24T19:56:50.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.214+0000 7f7423fff700 1 -- 172.21.15.133:0/685283999 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424012430 con 0x7f742c0cb5a0 2023-12-24T19:56:50.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.215+0000 7f74333df700 1 -- 172.21.15.133:0/685283999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 msgr2=0x7f742c164c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.215+0000 7f74333df700 1 --2- 172.21.15.133:0/685283999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 0x7f742c164c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7424009e90 tx=0x7f7424009780 comp rx=0 tx=0).stop 2023-12-24T19:56:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.215+0000 7f74333df700 1 -- 172.21.15.133:0/685283999 shutdown_connections 2023-12-24T19:56:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.215+0000 7f74333df700 1 --2- 172.21.15.133:0/685283999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 0x7f742c164c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.215+0000 7f74333df700 1 -- 172.21.15.133:0/685283999 >> 172.21.15.133:0/685283999 conn(0x7f742c0cd0b0 msgr2=0x7f742c0cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.215+0000 7f74333df700 1 -- 172.21.15.133:0/685283999 shutdown_connections 2023-12-24T19:56:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.215+0000 7f74333df700 1 -- 172.21.15.133:0/685283999 wait complete. 2023-12-24T19:56:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.217+0000 7f74333df700 1 Processor -- start 2023-12-24T19:56:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.217+0000 7f74333df700 1 -- start start 2023-12-24T19:56:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f74333df700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 0x7f742c15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f74333df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742c15ac00 0x7f742c06db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f74333df700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f742c15afd0 0x7f742c152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f74333df700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c16a1d0 con 0x7f742c15afd0 2023-12-24T19:56:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f74333df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c16a490 con 0x7f742c15ac00 2023-12-24T19:56:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f74333df700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742c16a770 con 0x7f742c0cb5a0 2023-12-24T19:56:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743097a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742c15ac00 0x7f742c06db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743117b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 0x7f742c15ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743097a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742c15ac00 0x7f742c06db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43626/0 (socket says 172.21.15.133:43626) 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743097a700 1 -- 172.21.15.133:0/603488685 learned_addr learned my addr 172.21.15.133:0/603488685 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743197c700 1 --2- 172.21.15.133:0/603488685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f742c15afd0 0x7f742c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743117b700 1 -- 172.21.15.133:0/603488685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742c15ac00 msgr2=0x7f742c06db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743117b700 1 --2- 172.21.15.133:0/603488685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742c15ac00 0x7f742c06db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743117b700 1 -- 172.21.15.133:0/603488685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f742c15afd0 msgr2=0x7f742c152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743117b700 1 --2- 172.21.15.133:0/603488685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f742c15afd0 0x7f742c152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743117b700 1 -- 172.21.15.133:0/603488685 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424009a20 con 0x7f742c0cb5a0 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743197c700 1 --2- 172.21.15.133:0/603488685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f742c15afd0 0x7f742c152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743097a700 1 --2- 172.21.15.133:0/603488685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742c15ac00 0x7f742c06db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f743117b700 1 --2- 172.21.15.133:0/603488685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 0x7f742c15ecb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f742800c7c0 tx=0x7f7428007b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f74217fa700 1 -- 172.21.15.133:0/603488685 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280072e0 con 0x7f742c0cb5a0 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f74217fa700 1 -- 172.21.15.133:0/603488685 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428007460 con 0x7f742c0cb5a0 2023-12-24T19:56:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.218+0000 7f74333df700 1 -- 172.21.15.133:0/603488685 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c16aa50 con 0x7f742c0cb5a0 2023-12-24T19:56:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.219+0000 7f74217fa700 1 -- 172.21.15.133:0/603488685 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280057f0 con 0x7f742c0cb5a0 2023-12-24T19:56:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.219+0000 7f74333df700 1 -- 172.21.15.133:0/603488685 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c0b11e0 con 0x7f742c0cb5a0 2023-12-24T19:56:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.219+0000 7f74217fa700 1 -- 172.21.15.133:0/603488685 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f742801c440 con 0x7f742c0cb5a0 2023-12-24T19:56:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.219+0000 7f74217fa700 1 -- 172.21.15.133:0/603488685 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f74280128a0 con 0x7f742c0cb5a0 2023-12-24T19:56:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.219+0000 7f74333df700 1 -- 172.21.15.133:0/603488685 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742c16aef0 con 0x7f742c0cb5a0 2023-12-24T19:56:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.221+0000 7f74217fa700 1 -- 172.21.15.133:0/603488685 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7428021060 con 0x7f742c0cb5a0 2023-12-24T19:56:50.289 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:50.288+0000 7f514aa1a1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T19:56:50.304 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:50.303+0000 7fc83e5401c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-24T19:56:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.305+0000 7f74333df700 1 -- 172.21.15.133:0/603488685 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f742c0c98f0 con 0x7f742c0cb5a0 2023-12-24T19:56:50.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.308+0000 7f74217fa700 1 -- 172.21.15.133:0/603488685 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7428017070 con 0x7f742c0cb5a0 2023-12-24T19:56:50.309 INFO:teuthology.orchestra.run.smithi133.stdout:3 2023-12-24T19:56:50.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.309+0000 7f74333df700 1 -- 172.21.15.133:0/603488685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 msgr2=0x7f742c15ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.309+0000 7f74333df700 1 --2- 172.21.15.133:0/603488685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 0x7f742c15ecb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f742800c7c0 tx=0x7f7428007b60 comp rx=0 tx=0).stop 2023-12-24T19:56:50.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.309+0000 7f74333df700 1 -- 172.21.15.133:0/603488685 shutdown_connections 2023-12-24T19:56:50.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.309+0000 7f74333df700 1 --2- 172.21.15.133:0/603488685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f742c0cb5a0 0x7f742c15ecb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.309+0000 7f74333df700 1 --2- 172.21.15.133:0/603488685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f742c15afd0 0x7f742c152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.309+0000 7f74333df700 1 --2- 172.21.15.133:0/603488685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742c15ac00 0x7f742c06db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.309+0000 7f74333df700 1 -- 172.21.15.133:0/603488685 >> 172.21.15.133:0/603488685 conn(0x7f742c0cd0b0 msgr2=0x7f742c153620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:50.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.309+0000 7f74333df700 1 -- 172.21.15.133:0/603488685 shutdown_connections 2023-12-24T19:56:50.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.309+0000 7f74333df700 1 -- 172.21.15.133:0/603488685 wait complete. 2023-12-24T19:56:50.321 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-12-24T19:56:50.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.438+0000 7fc9c092b700 1 Processor -- start 2023-12-24T19:56:50.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.438+0000 7fc9c092b700 1 -- start start 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.439+0000 7fc9c092b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9bc156830 0x7fc9bc0c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.439+0000 7fc9c092b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc9bc156c00 0x7fc9bc0c3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.439+0000 7fc9c092b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc0cac50 0x7fc9bc067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.439+0000 7fc9c092b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc0c3870 con 0x7fc9bc156c00 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.439+0000 7fc9c092b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc0c8690 con 0x7fc9bc156830 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.439+0000 7fc9c092b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc069f00 con 0x7fc9bc0cac50 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.439+0000 7fc9bad9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc0cac50 0x7fc9bc067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.439+0000 7fc9ba59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9bc156830 0x7fc9bc0c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9ba59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9bc156830 0x7fc9bc0c2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43636/0 (socket says 172.21.15.133:43636) 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9bad9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc0cac50 0x7fc9bc067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42516/0 (socket says 172.21.15.133:42516) 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9ba59c700 1 -- 172.21.15.133:0/1687367706 learned_addr learned my addr 172.21.15.133:0/1687367706 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9b9d9b700 1 --2- 172.21.15.133:0/1687367706 >> v2:172.21.15.61:3300/0 conn(0x7fc9bc156c00 0x7fc9bc0c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9bad9d700 1 -- 172.21.15.133:0/1687367706 >> v2:172.21.15.133:3300/0 conn(0x7fc9bc156830 msgr2=0x7fc9bc0c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:50.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9bad9d700 1 --2- 172.21.15.133:0/1687367706 >> v2:172.21.15.133:3300/0 conn(0x7fc9bc156830 0x7fc9bc0c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9bad9d700 1 -- 172.21.15.133:0/1687367706 >> v2:172.21.15.61:3300/0 conn(0x7fc9bc156c00 msgr2=0x7fc9bc0c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9bad9d700 1 --2- 172.21.15.133:0/1687367706 >> v2:172.21.15.61:3300/0 conn(0x7fc9bc156c00 0x7fc9bc0c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9bad9d700 1 -- 172.21.15.133:0/1687367706 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc06a1e0 con 0x7fc9bc0cac50 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9ba59c700 1 --2- 172.21.15.133:0/1687367706 >> v2:172.21.15.133:3300/0 conn(0x7fc9bc156830 0x7fc9bc0c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9bad9d700 1 --2- 172.21.15.133:0/1687367706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc0cac50 0x7fc9bc067550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc064820 tx=0x7fc9ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f77f1b8795d81bac server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9b959a700 1 -- 172.21.15.133:0/1687367706 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00e070 con 0x7fc9bc0cac50 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9b959a700 1 -- 172.21.15.133:0/1687367706 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac00bb60 con 0x7fc9bc0cac50 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.440+0000 7fc9b959a700 1 -- 172.21.15.133:0/1687367706 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac012430 con 0x7fc9bc0cac50 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.441+0000 7fc9c092b700 1 -- 172.21.15.133:0/1687367706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc0cac50 msgr2=0x7fc9bc067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.441+0000 7fc9c092b700 1 --2- 172.21.15.133:0/1687367706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc0cac50 0x7fc9bc067550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc064820 tx=0x7fc9ac009780 comp rx=0 tx=0).stop 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.441+0000 7fc9c092b700 1 -- 172.21.15.133:0/1687367706 shutdown_connections 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.441+0000 7fc9c092b700 1 --2- 172.21.15.133:0/1687367706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc0cac50 0x7fc9bc067550 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.441+0000 7fc9c092b700 1 --2- 172.21.15.133:0/1687367706 >> v2:172.21.15.133:3300/0 conn(0x7fc9bc156830 0x7fc9bc0c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.441+0000 7fc9c092b700 1 --2- 172.21.15.133:0/1687367706 >> v2:172.21.15.61:3300/0 conn(0x7fc9bc156c00 0x7fc9bc0c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.441+0000 7fc9c092b700 1 -- 172.21.15.133:0/1687367706 >> 172.21.15.133:0/1687367706 conn(0x7fc9bc0ce1f0 msgr2=0x7fc9bc0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:50.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.441+0000 7fc9c092b700 1 -- 172.21.15.133:0/1687367706 shutdown_connections 2023-12-24T19:56:50.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.441+0000 7fc9c092b700 1 -- 172.21.15.133:0/1687367706 wait complete. 2023-12-24T19:56:50.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.442+0000 7fc9c092b700 1 Processor -- start 2023-12-24T19:56:50.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.442+0000 7fc9c092b700 1 -- start start 2023-12-24T19:56:50.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9c092b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9bc0cac50 0x7fc9bc1699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9c092b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9bc156830 0x7fc9bc070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9c092b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc156c00 0x7fc9bc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9c092b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc16abb0 con 0x7fc9bc0cac50 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9c092b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b08a0 con 0x7fc9bc156830 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9c092b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc169fa0 con 0x7fc9bc156c00 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9b9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9bc156830 0x7fc9bc070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9bad9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc156c00 0x7fc9bc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9b9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9bc156830 0x7fc9bc070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43652/0 (socket says 172.21.15.133:43652) 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9b9d9b700 1 -- 172.21.15.133:0/1856256618 learned_addr learned my addr 172.21.15.133:0/1856256618 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9ba59c700 1 --2- 172.21.15.133:0/1856256618 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9bc0cac50 0x7fc9bc1699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9bad9d700 1 -- 172.21.15.133:0/1856256618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9bc156830 msgr2=0x7fc9bc070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9bad9d700 1 --2- 172.21.15.133:0/1856256618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9bc156830 0x7fc9bc070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9bad9d700 1 -- 172.21.15.133:0/1856256618 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9bc0cac50 msgr2=0x7fc9bc1699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9bad9d700 1 --2- 172.21.15.133:0/1856256618 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9bc0cac50 0x7fc9bc1699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9bad9d700 1 -- 172.21.15.133:0/1856256618 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b40094f0 con 0x7fc9bc156c00 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9b9d9b700 1 --2- 172.21.15.133:0/1856256618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9bc156830 0x7fc9bc070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9bad9d700 1 --2- 172.21.15.133:0/1856256618 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc156c00 0x7fc9bc070b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac016000 tx=0x7fc9ac019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9aa7fc700 1 -- 172.21.15.133:0/1856256618 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0032b0 con 0x7fc9bc156c00 2023-12-24T19:56:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9aa7fc700 1 -- 172.21.15.133:0/1856256618 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac007000 con 0x7fc9bc156c00 2023-12-24T19:56:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9c092b700 1 -- 172.21.15.133:0/1856256618 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac009a20 con 0x7fc9bc156c00 2023-12-24T19:56:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9aa7fc700 1 -- 172.21.15.133:0/1856256618 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac026620 con 0x7fc9bc156c00 2023-12-24T19:56:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.443+0000 7fc9c092b700 1 -- 172.21.15.133:0/1856256618 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc16a560 con 0x7fc9bc156c00 2023-12-24T19:56:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.444+0000 7fc9aa7fc700 1 -- 172.21.15.133:0/1856256618 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc9ac026a50 con 0x7fc9bc156c00 2023-12-24T19:56:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.444+0000 7fc9aa7fc700 1 -- 172.21.15.133:0/1856256618 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fc9ac02ea40 con 0x7fc9bc156c00 2023-12-24T19:56:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.444+0000 7fc9c092b700 1 -- 172.21.15.133:0/1856256618 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc04c3c0 con 0x7fc9bc156c00 2023-12-24T19:56:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.446+0000 7fc9aa7fc700 1 -- 172.21.15.133:0/1856256618 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc9ac02e530 con 0x7fc9bc156c00 2023-12-24T19:56:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.528+0000 7fc9c092b700 1 -- 172.21.15.133:0/1856256618 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7fc9bc14fb00 con 0x7fc9bc156c00 2023-12-24T19:56:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.532+0000 7fc9aa7fc700 1 -- 172.21.15.133:0/1856256618 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9ac02e6d0 con 0x7fc9bc156c00 2023-12-24T19:56:50.533 INFO:teuthology.orchestra.run.smithi133.stdout:4 2023-12-24T19:56:50.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.533+0000 7fc9c092b700 1 -- 172.21.15.133:0/1856256618 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc156c00 msgr2=0x7fc9bc070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.533+0000 7fc9c092b700 1 --2- 172.21.15.133:0/1856256618 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc156c00 0x7fc9bc070b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac016000 tx=0x7fc9ac019000 comp rx=0 tx=0).stop 2023-12-24T19:56:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.533+0000 7fc9c092b700 1 -- 172.21.15.133:0/1856256618 shutdown_connections 2023-12-24T19:56:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.533+0000 7fc9c092b700 1 --2- 172.21.15.133:0/1856256618 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9bc156c00 0x7fc9bc070b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.533+0000 7fc9c092b700 1 --2- 172.21.15.133:0/1856256618 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9bc0cac50 0x7fc9bc1699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.533+0000 7fc9c092b700 1 --2- 172.21.15.133:0/1856256618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9bc156830 0x7fc9bc070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.533+0000 7fc9c092b700 1 -- 172.21.15.133:0/1856256618 >> 172.21.15.133:0/1856256618 conn(0x7fc9bc0ce1f0 msgr2=0x7fc9bc0cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.533+0000 7fc9c092b700 1 -- 172.21.15.133:0/1856256618 shutdown_connections 2023-12-24T19:56:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.533+0000 7fc9c092b700 1 -- 172.21.15.133:0/1856256618 wait complete. 2023-12-24T19:56:50.546 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-12-24T19:56:50.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.666+0000 7fd49dae4700 1 Processor -- start 2023-12-24T19:56:50.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.666+0000 7fd49dae4700 1 -- start start 2023-12-24T19:56:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.667+0000 7fd49dae4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd49806ae60 0x7fd49815e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.667+0000 7fd49dae4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49806b230 0x7fd4980ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.667+0000 7fd49dae4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49815de70 con 0x7fd4980ca700 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.667+0000 7fd49dae4700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4980cac80 con 0x7fd49806ae60 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.667+0000 7fd49dae4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980caf60 con 0x7fd49806b230 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.667+0000 7fd496ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49806b230 0x7fd4980ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.667+0000 7fd497fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd4980ca700 0x7fd4981596a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42952/0 (socket says 172.21.15.133:42952) 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.667+0000 7fd497fff700 1 -- 172.21.15.133:0/4283154906 learned_addr learned my addr 172.21.15.133:0/4283154906 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.667+0000 7fd4977fe700 1 --2- 172.21.15.133:0/4283154906 >> v2:172.21.15.61:3300/0 conn(0x7fd49806ae60 0x7fd49815e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.667+0000 7fd4967fc700 1 -- 172.21.15.133:0/4283154906 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763791052 0 0) 0x7fd49815de70 con 0x7fd4980ca700 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd4967fc700 1 -- 172.21.15.133:0/4283154906 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd480003570 con 0x7fd4980ca700 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd496ffd700 1 -- 172.21.15.133:0/4283154906 >> v2:172.21.15.61:3300/0 conn(0x7fd49806ae60 msgr2=0x7fd49815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd496ffd700 1 --2- 172.21.15.133:0/4283154906 >> v2:172.21.15.61:3300/0 conn(0x7fd49806ae60 0x7fd49815e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd496ffd700 1 -- 172.21.15.133:0/4283154906 >> v1:172.21.15.133:6789/0 conn(0x7fd4980ca700 legacy=0x7fd4981596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd496ffd700 1 -- 172.21.15.133:0/4283154906 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49815d820 con 0x7fd49806b230 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd496ffd700 1 --2- 172.21.15.133:0/4283154906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49806b230 0x7fd4980ca1c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098e0 tx=0x7fd4880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb50176ac125a552 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd4967fc700 1 -- 172.21.15.133:0/4283154906 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488011630 con 0x7fd49806b230 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd4967fc700 1 -- 172.21.15.133:0/4283154906 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd488011790 con 0x7fd49806b230 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd4967fc700 1 -- 172.21.15.133:0/4283154906 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488011b30 con 0x7fd49806b230 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd49dae4700 1 -- 172.21.15.133:0/4283154906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49806b230 msgr2=0x7fd4980ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd49dae4700 1 --2- 172.21.15.133:0/4283154906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49806b230 0x7fd4980ca1c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098e0 tx=0x7fd4880091a0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd49dae4700 1 -- 172.21.15.133:0/4283154906 shutdown_connections 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd49dae4700 1 --2- 172.21.15.133:0/4283154906 >> v2:172.21.15.61:3300/0 conn(0x7fd49806ae60 0x7fd49815e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd49dae4700 1 --2- 172.21.15.133:0/4283154906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd49806b230 0x7fd4980ca1c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.668+0000 7fd49dae4700 1 -- 172.21.15.133:0/4283154906 >> 172.21.15.133:0/4283154906 conn(0x7fd4980ce800 msgr2=0x7fd4980cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:50.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.669+0000 7fd49dae4700 1 -- 172.21.15.133:0/4283154906 shutdown_connections 2023-12-24T19:56:50.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.669+0000 7fd49dae4700 1 -- 172.21.15.133:0/4283154906 wait complete. 2023-12-24T19:56:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.670+0000 7fd49dae4700 1 Processor -- start 2023-12-24T19:56:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.670+0000 7fd49dae4700 1 -- start start 2023-12-24T19:56:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd49dae4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd49806ae60 0x7fd4980c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd49dae4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49806b230 0x7fd4980b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd49dae4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4980ca700 0x7fd4980ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd49dae4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980b0220 con 0x7fd49806ae60 2023-12-24T19:56:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd49dae4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980af5a0 con 0x7fd49806b230 2023-12-24T19:56:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd49dae4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980af880 con 0x7fd4980ca700 2023-12-24T19:56:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd497fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4980ca700 0x7fd4980ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd497fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4980ca700 0x7fd4980ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42550/0 (socket says 172.21.15.133:42550) 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd497fff700 1 -- 172.21.15.133:0/3060781439 learned_addr learned my addr 172.21.15.133:0/3060781439 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd4977fe700 1 --2- 172.21.15.133:0/3060781439 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd49806ae60 0x7fd4980c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.671+0000 7fd496ffd700 1 --2- 172.21.15.133:0/3060781439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49806b230 0x7fd4980b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd497fff700 1 -- 172.21.15.133:0/3060781439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49806b230 msgr2=0x7fd4980b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd497fff700 1 --2- 172.21.15.133:0/3060781439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49806b230 0x7fd4980b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd497fff700 1 -- 172.21.15.133:0/3060781439 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd49806ae60 msgr2=0x7fd4980c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd497fff700 1 --2- 172.21.15.133:0/3060781439 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd49806ae60 0x7fd4980c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd497fff700 1 -- 172.21.15.133:0/3060781439 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd488009420 con 0x7fd4980ca700 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd4977fe700 1 --2- 172.21.15.133:0/3060781439 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd49806ae60 0x7fd4980c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd497fff700 1 --2- 172.21.15.133:0/3060781439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4980ca700 0x7fd4980ad540 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd490001460 tx=0x7fd490001a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd47f7fe700 1 -- 172.21.15.133:0/3060781439 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000a870 con 0x7fd4980ca700 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd47f7fe700 1 -- 172.21.15.133:0/3060781439 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000a9d0 con 0x7fd4980ca700 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd49dae4700 1 -- 172.21.15.133:0/3060781439 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4980afb60 con 0x7fd4980ca700 2023-12-24T19:56:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd47f7fe700 1 -- 172.21.15.133:0/3060781439 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000ad50 con 0x7fd4980ca700 2023-12-24T19:56:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd49dae4700 1 -- 172.21.15.133:0/3060781439 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4980b0b80 con 0x7fd4980ca700 2023-12-24T19:56:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd47f7fe700 1 -- 172.21.15.133:0/3060781439 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd490007300 con 0x7fd4980ca700 2023-12-24T19:56:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.672+0000 7fd47f7fe700 1 -- 172.21.15.133:0/3060781439 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fd49001b980 con 0x7fd4980ca700 2023-12-24T19:56:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.673+0000 7fd49dae4700 1 -- 172.21.15.133:0/3060781439 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49804c3c0 con 0x7fd4980ca700 2023-12-24T19:56:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.676+0000 7fd47f7fe700 1 -- 172.21.15.133:0/3060781439 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd490007790 con 0x7fd4980ca700 2023-12-24T19:56:50.683 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:50.682+0000 7f514aa1a1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T19:56:50.688 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:50.688+0000 7fc83e5401c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-24T19:56:50.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.761+0000 7fd49dae4700 1 -- 172.21.15.133:0/3060781439 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7fd49815db00 con 0x7fd4980ca700 2023-12-24T19:56:50.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.769+0000 7fd47f7fe700 1 -- 172.21.15.133:0/3060781439 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd49002a0b0 con 0x7fd4980ca700 2023-12-24T19:56:50.770 INFO:teuthology.orchestra.run.smithi133.stdout:5 2023-12-24T19:56:50.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.770+0000 7fd49dae4700 1 -- 172.21.15.133:0/3060781439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4980ca700 msgr2=0x7fd4980ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.770+0000 7fd49dae4700 1 --2- 172.21.15.133:0/3060781439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4980ca700 0x7fd4980ad540 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd490001460 tx=0x7fd490001a40 comp rx=0 tx=0).stop 2023-12-24T19:56:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.770+0000 7fd49dae4700 1 -- 172.21.15.133:0/3060781439 shutdown_connections 2023-12-24T19:56:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.770+0000 7fd49dae4700 1 --2- 172.21.15.133:0/3060781439 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4980ca700 0x7fd4980ad540 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.770+0000 7fd49dae4700 1 --2- 172.21.15.133:0/3060781439 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd49806ae60 0x7fd4980c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.770+0000 7fd49dae4700 1 --2- 172.21.15.133:0/3060781439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd49806b230 0x7fd4980b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.770+0000 7fd49dae4700 1 -- 172.21.15.133:0/3060781439 >> 172.21.15.133:0/3060781439 conn(0x7fd4980ce800 msgr2=0x7fd4980b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.771+0000 7fd49dae4700 1 -- 172.21.15.133:0/3060781439 shutdown_connections 2023-12-24T19:56:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.771+0000 7fd49dae4700 1 -- 172.21.15.133:0/3060781439 wait complete. 2023-12-24T19:56:50.783 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-12-24T19:56:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.900+0000 7f8e1ea5c700 1 Processor -- start 2023-12-24T19:56:50.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.900+0000 7f8e1ea5c700 1 -- start start 2023-12-24T19:56:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e1ea5c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e18159df0 0x7f8e180cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e1ea5c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e180cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e1ea5c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180cf150 con 0x7f8e1815a1c0 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e1ea5c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e180cc5f0 con 0x7f8e18159df0 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e1ea5c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180ce820 con 0x7f8e180cc0e0 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e17fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e18159df0 0x7f8e180cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e1cff9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e180cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e17fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e18159df0 0x7f8e180cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43660/0 (socket says 172.21.15.133:43660) 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e1cff9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e180cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42560/0 (socket says 172.21.15.133:42560) 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e17fff700 1 -- 172.21.15.133:0/2541136990 learned_addr learned my addr 172.21.15.133:0/2541136990 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.901+0000 7f8e177fe700 1 --1- 172.21.15.133:0/2541136990 >> v1:172.21.15.133:6789/0 conn(0x7f8e1815a1c0 0x7f8e180cd470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42956/0 (socket says 172.21.15.133:42956) 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e17fff700 1 -- 172.21.15.133:0/2541136990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 msgr2=0x7f8e180cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e17fff700 1 --2- 172.21.15.133:0/2541136990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e180cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e17fff700 1 -- 172.21.15.133:0/2541136990 >> v1:172.21.15.133:6789/0 conn(0x7f8e1815a1c0 legacy=0x7f8e180cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e17fff700 1 -- 172.21.15.133:0/2541136990 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180ceb00 con 0x7f8e18159df0 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e1cff9700 1 --2- 172.21.15.133:0/2541136990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e180cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:50.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e17fff700 1 --2- 172.21.15.133:0/2541136990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18159df0 0x7f8e180cbba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8e080099b0 tx=0x7f8e08009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45a9cd5f872e8a29 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e16ffd700 1 -- 172.21.15.133:0/2541136990 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08009ea0 con 0x7f8e18159df0 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e16ffd700 1 -- 172.21.15.133:0/2541136990 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0800b860 con 0x7f8e18159df0 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e16ffd700 1 -- 172.21.15.133:0/2541136990 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800bc00 con 0x7f8e18159df0 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/2541136990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18159df0 msgr2=0x7f8e180cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.902+0000 7f8e1ea5c700 1 --2- 172.21.15.133:0/2541136990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18159df0 0x7f8e180cbba0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8e080099b0 tx=0x7f8e08009250 comp rx=0 tx=0).stop 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.903+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/2541136990 shutdown_connections 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.903+0000 7f8e1ea5c700 1 --2- 172.21.15.133:0/2541136990 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e180cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.903+0000 7f8e1ea5c700 1 --2- 172.21.15.133:0/2541136990 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e18159df0 0x7f8e180cbba0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.903+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/2541136990 >> 172.21.15.133:0/2541136990 conn(0x7f8e1806e600 msgr2=0x7f8e18067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.903+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/2541136990 shutdown_connections 2023-12-24T19:56:50.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.903+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/2541136990 wait complete. 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.904+0000 7f8e1ea5c700 1 Processor -- start 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.904+0000 7f8e1ea5c700 1 -- start start 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1ea5c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e18154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1ea5c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e18159df0 0x7f8e180b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1ea5c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1815a1c0 0x7f8e180b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1ea5c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180b39f0 con 0x7f8e18159df0 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1ea5c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180b4570 con 0x7f8e1815a1c0 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1ea5c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18154d60 con 0x7f8e180cc0e0 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e17fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e18154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1cff9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1815a1c0 0x7f8e180b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1cff9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1815a1c0 0x7f8e180b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43668/0 (socket says 172.21.15.133:43668) 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1cff9700 1 -- 172.21.15.133:0/1678107450 learned_addr learned my addr 172.21.15.133:0/1678107450 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e17fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e18154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42572/0 (socket says 172.21.15.133:42572) 2023-12-24T19:56:50.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e177fe700 1 --2- 172.21.15.133:0/1678107450 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e18159df0 0x7f8e180b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1cff9700 1 -- 172.21.15.133:0/1678107450 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 msgr2=0x7f8e18154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1cff9700 1 --2- 172.21.15.133:0/1678107450 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e18154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1cff9700 1 -- 172.21.15.133:0/1678107450 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e18159df0 msgr2=0x7f8e180b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1cff9700 1 --2- 172.21.15.133:0/1678107450 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e18159df0 0x7f8e180b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1cff9700 1 -- 172.21.15.133:0/1678107450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10009a20 con 0x7f8e1815a1c0 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e177fe700 1 --2- 172.21.15.133:0/1678107450 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e18159df0 0x7f8e180b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1cff9700 1 --2- 172.21.15.133:0/1678107450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1815a1c0 0x7f8e180b20e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009f60 tx=0x7f8e1000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8dfffff700 1 -- 172.21.15.133:0/1678107450 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000cc20 con 0x7f8e1815a1c0 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8dfffff700 1 -- 172.21.15.133:0/1678107450 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1000f040 con 0x7f8e1815a1c0 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8dfffff700 1 -- 172.21.15.133:0/1678107450 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10014480 con 0x7f8e1815a1c0 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/1678107450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e080094f0 con 0x7f8e1815a1c0 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.905+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/1678107450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e180b3f20 con 0x7f8e1815a1c0 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.906+0000 7f8dfffff700 1 -- 172.21.15.133:0/1678107450 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8e10014810 con 0x7f8e1815a1c0 2023-12-24T19:56:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.906+0000 7f8dfffff700 1 -- 172.21.15.133:0/1678107450 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f8e10014d90 con 0x7f8e1815a1c0 2023-12-24T19:56:50.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.906+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/1678107450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e18067ca0 con 0x7f8e1815a1c0 2023-12-24T19:56:50.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.910+0000 7f8dfffff700 1 -- 172.21.15.133:0/1678107450 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8e10018020 con 0x7f8e1815a1c0 2023-12-24T19:56:50.911 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:50.911+0000 7fc83e5401c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T19:56:50.912 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:50.911+0000 7f514aa1a1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-24T19:56:50.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:50.994+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/1678107450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7f8e18089040 con 0x7f8e1815a1c0 2023-12-24T19:56:51.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.000+0000 7f8dfffff700 1 -- 172.21.15.133:0/1678107450 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e1001d6d0 con 0x7f8e1815a1c0 2023-12-24T19:56:51.001 INFO:teuthology.orchestra.run.smithi133.stdout:6 2023-12-24T19:56:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.001+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/1678107450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1815a1c0 msgr2=0x7f8e180b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:51.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.001+0000 7f8e1ea5c700 1 --2- 172.21.15.133:0/1678107450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1815a1c0 0x7f8e180b20e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009f60 tx=0x7f8e1000b040 comp rx=0 tx=0).stop 2023-12-24T19:56:51.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.001+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/1678107450 shutdown_connections 2023-12-24T19:56:51.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.001+0000 7f8e1ea5c700 1 --2- 172.21.15.133:0/1678107450 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e180cc0e0 0x7f8e18154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.001+0000 7f8e1ea5c700 1 --2- 172.21.15.133:0/1678107450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1815a1c0 0x7f8e180b20e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.001+0000 7f8e1ea5c700 1 --2- 172.21.15.133:0/1678107450 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e18159df0 0x7f8e180b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.001+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/1678107450 >> 172.21.15.133:0/1678107450 conn(0x7f8e1806e600 msgr2=0x7f8e180cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:51.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.001+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/1678107450 shutdown_connections 2023-12-24T19:56:51.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.001+0000 7f8e1ea5c700 1 -- 172.21.15.133:0/1678107450 wait complete. 2023-12-24T19:56:51.017 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-12-24T19:56:51.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.135+0000 7fc5f45f4700 1 Processor -- start 2023-12-24T19:56:51.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.135+0000 7fc5f45f4700 1 -- start start 2023-12-24T19:56:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f45f4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec1580a0 0x7fc5ec0af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f45f4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc5ec15a940 0x7fc5ec15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f45f4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5ec0c8040 0x7fc5ec0c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f45f4700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ec06b080 con 0x7fc5ec15a940 2023-12-24T19:56:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f45f4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ec0b00f0 con 0x7fc5ec0c8040 2023-12-24T19:56:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f45f4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec15b720 con 0x7fc5ec1580a0 2023-12-24T19:56:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f2b91700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5ec0c8040 0x7fc5ec0c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f2390700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec1580a0 0x7fc5ec0af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f2b91700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5ec0c8040 0x7fc5ec0c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43680/0 (socket says 172.21.15.133:43680) 2023-12-24T19:56:51.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f2390700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec1580a0 0x7fc5ec0af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.133:42576/0 (socket says 172.21.15.133:42576) 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f2b91700 1 -- 172.21.15.133:0/2755188345 learned_addr learned my addr 172.21.15.133:0/2755188345 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.136+0000 7fc5f1b8f700 1 --2- 172.21.15.133:0/2755188345 >> v2:172.21.15.61:3300/0 conn(0x7fc5ec15a940 0x7fc5ec15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.137+0000 7fc5f2390700 1 -- 172.21.15.133:0/2755188345 >> v2:172.21.15.133:3300/0 conn(0x7fc5ec0c8040 msgr2=0x7fc5ec0c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.137+0000 7fc5f2390700 1 --2- 172.21.15.133:0/2755188345 >> v2:172.21.15.133:3300/0 conn(0x7fc5ec0c8040 0x7fc5ec0c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.137+0000 7fc5f2390700 1 -- 172.21.15.133:0/2755188345 >> v2:172.21.15.61:3300/0 conn(0x7fc5ec15a940 msgr2=0x7fc5ec15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.137+0000 7fc5f2390700 1 --2- 172.21.15.133:0/2755188345 >> v2:172.21.15.61:3300/0 conn(0x7fc5ec15a940 0x7fc5ec15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.137+0000 7fc5f2390700 1 -- 172.21.15.133:0/2755188345 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec06aa30 con 0x7fc5ec1580a0 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.137+0000 7fc5f2b91700 1 --2- 172.21.15.133:0/2755188345 >> v2:172.21.15.133:3300/0 conn(0x7fc5ec0c8040 0x7fc5ec0c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.137+0000 7fc5f2390700 1 --2- 172.21.15.133:0/2755188345 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec1580a0 0x7fc5ec0af8e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec06aff0 tx=0x7fc5e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e399752d515e9b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.137+0000 7fc5f138e700 1 -- 172.21.15.133:0/2755188345 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8011630 con 0x7fc5ec1580a0 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.137+0000 7fc5f138e700 1 -- 172.21.15.133:0/2755188345 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e80117b0 con 0x7fc5ec1580a0 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.137+0000 7fc5f138e700 1 -- 172.21.15.133:0/2755188345 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8011b70 con 0x7fc5ec1580a0 2023-12-24T19:56:51.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.138+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2755188345 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec1580a0 msgr2=0x7fc5ec0af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:51.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.138+0000 7fc5f45f4700 1 --2- 172.21.15.133:0/2755188345 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec1580a0 0x7fc5ec0af8e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec06aff0 tx=0x7fc5e80091a0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.138+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2755188345 shutdown_connections 2023-12-24T19:56:51.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.138+0000 7fc5f45f4700 1 --2- 172.21.15.133:0/2755188345 >> v2:172.21.15.133:3300/0 conn(0x7fc5ec0c8040 0x7fc5ec0c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.138+0000 7fc5f45f4700 1 --2- 172.21.15.133:0/2755188345 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec1580a0 0x7fc5ec0af8e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.138+0000 7fc5f45f4700 1 --2- 172.21.15.133:0/2755188345 >> v2:172.21.15.61:3300/0 conn(0x7fc5ec15a940 0x7fc5ec15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.138+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2755188345 >> 172.21.15.133:0/2755188345 conn(0x7fc5ec0ce400 msgr2=0x7fc5ec0ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:51.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.138+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2755188345 shutdown_connections 2023-12-24T19:56:51.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.138+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2755188345 wait complete. 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.139+0000 7fc5f45f4700 1 Processor -- start 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.139+0000 7fc5f45f4700 1 -- start start 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f45f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ec0c8040 0x7fc5ec0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f45f4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5ec1580a0 0x7fc5ec0b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f45f4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec15a940 0x7fc5ec0b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f45f4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0aadd0 con 0x7fc5ec1580a0 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f45f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec1545f0 con 0x7fc5ec0c8040 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f45f4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0c4f60 con 0x7fc5ec15a940 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f2b91700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec15a940 0x7fc5ec0b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f2390700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ec0c8040 0x7fc5ec0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f2390700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ec0c8040 0x7fc5ec0aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43682/0 (socket says 172.21.15.133:43682) 2023-12-24T19:56:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f2390700 1 -- 172.21.15.133:0/2977455881 learned_addr learned my addr 172.21.15.133:0/2977455881 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f1b8f700 1 --2- 172.21.15.133:0/2977455881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5ec1580a0 0x7fc5ec0b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f1b8f700 1 -- 172.21.15.133:0/2977455881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec15a940 msgr2=0x7fc5ec0b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f1b8f700 1 --2- 172.21.15.133:0/2977455881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec15a940 0x7fc5ec0b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f1b8f700 1 -- 172.21.15.133:0/2977455881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ec0c8040 msgr2=0x7fc5ec0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f1b8f700 1 --2- 172.21.15.133:0/2977455881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ec0c8040 0x7fc5ec0aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f1b8f700 1 -- 172.21.15.133:0/2977455881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e400bcf0 con 0x7fc5ec1580a0 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f2390700 1 --2- 172.21.15.133:0/2977455881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ec0c8040 0x7fc5ec0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.140+0000 7fc5f2b91700 1 --2- 172.21.15.133:0/2977455881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec15a940 0x7fc5ec0b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.141+0000 7fc5f1b8f700 1 --2- 172.21.15.133:0/2977455881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5ec1580a0 0x7fc5ec0b0e70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00e900 tx=0x7fc5dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.141+0000 7fc5e27fc700 1 -- 172.21.15.133:0/2977455881 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc013680 con 0x7fc5ec1580a0 2023-12-24T19:56:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.141+0000 7fc5e27fc700 1 -- 172.21.15.133:0/2977455881 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc0137e0 con 0x7fc5ec1580a0 2023-12-24T19:56:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.141+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2977455881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e8009420 con 0x7fc5ec1580a0 2023-12-24T19:56:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.141+0000 7fc5e27fc700 1 -- 172.21.15.133:0/2977455881 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc013ba0 con 0x7fc5ec1580a0 2023-12-24T19:56:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.141+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2977455881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ec0c5520 con 0x7fc5ec1580a0 2023-12-24T19:56:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.141+0000 7fc5e27fc700 1 -- 172.21.15.133:0/2977455881 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc5dc005c80 con 0x7fc5ec1580a0 2023-12-24T19:56:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.141+0000 7fc5e27fc700 1 -- 172.21.15.133:0/2977455881 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fc5dc006020 con 0x7fc5ec1580a0 2023-12-24T19:56:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.142+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2977455881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ec04c3c0 con 0x7fc5ec1580a0 2023-12-24T19:56:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.144+0000 7fc5e27fc700 1 -- 172.21.15.133:0/2977455881 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc5dc021060 con 0x7fc5ec1580a0 2023-12-24T19:56:51.149 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:51.149+0000 7fc83e5401c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-24T19:56:51.151 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:51.151+0000 7f514aa1a1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-24T19:56:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.227+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2977455881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7fc5ec0b37a0 con 0x7fc5ec1580a0 2023-12-24T19:56:51.229 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:51.229+0000 7fc83e5401c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T19:56:51.231 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:51.231+0000 7f514aa1a1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-24T19:56:51.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.235+0000 7fc5e27fc700 1 -- 172.21.15.133:0/2977455881 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc5dc029020 con 0x7fc5ec1580a0 2023-12-24T19:56:51.235 INFO:teuthology.orchestra.run.smithi133.stdout:7 2023-12-24T19:56:51.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.235+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2977455881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5ec1580a0 msgr2=0x7fc5ec0b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.235+0000 7fc5f45f4700 1 --2- 172.21.15.133:0/2977455881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5ec1580a0 0x7fc5ec0b0e70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00e900 tx=0x7fc5dc0091a0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.236+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2977455881 shutdown_connections 2023-12-24T19:56:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.236+0000 7fc5f45f4700 1 --2- 172.21.15.133:0/2977455881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5ec15a940 0x7fc5ec0b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.236+0000 7fc5f45f4700 1 --2- 172.21.15.133:0/2977455881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5ec0c8040 0x7fc5ec0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.236+0000 7fc5f45f4700 1 --2- 172.21.15.133:0/2977455881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5ec1580a0 0x7fc5ec0b0e70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.236+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2977455881 >> 172.21.15.133:0/2977455881 conn(0x7fc5ec0ce400 msgr2=0x7fc5ec070640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.236+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2977455881 shutdown_connections 2023-12-24T19:56:51.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-24T19:56:51.236+0000 7fc5f45f4700 1 -- 172.21.15.133:0/2977455881 wait complete. 2023-12-24T19:56:51.248 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-24T19:56:51.248 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-24T19:56:51.251 INFO:tasks.ceph.osd.0:Started 2023-12-24T19:56:51.251 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-24T19:56:51.251 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-24T19:56:51.253 INFO:tasks.ceph.osd.1:Started 2023-12-24T19:56:51.253 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-24T19:56:51.253 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-24T19:56:51.257 INFO:tasks.ceph.osd.2:Started 2023-12-24T19:56:51.257 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-24T19:56:51.257 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-24T19:56:51.259 INFO:tasks.ceph.osd.3:Started 2023-12-24T19:56:51.259 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-24T19:56:51.260 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-24T19:56:51.262 INFO:tasks.ceph.osd.4:Started 2023-12-24T19:56:51.262 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-24T19:56:51.262 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-24T19:56:51.265 INFO:tasks.ceph.osd.5:Started 2023-12-24T19:56:51.265 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-24T19:56:51.265 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-24T19:56:51.267 INFO:tasks.ceph.osd.6:Started 2023-12-24T19:56:51.268 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-24T19:56:51.268 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-24T19:56:51.271 INFO:tasks.ceph.osd.7:Started 2023-12-24T19:56:51.272 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:56:51.343 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-12-24T19:56:51.342+0000 7fad3a64a540 -1 Falling back to public interface 2023-12-24T19:56:51.345 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-12-24T19:56:51.345+0000 7f6854087540 -1 Falling back to public interface 2023-12-24T19:56:51.351 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-12-24T19:56:51.350+0000 7f039eb2b540 -1 Falling back to public interface 2023-12-24T19:56:51.353 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-12-24T19:56:51.353+0000 7fa5a1654540 -1 Falling back to public interface 2023-12-24T19:56:51.355 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-12-24T19:56:51.355+0000 7fad3a64a540 -1 osd.4 0 log_to_monitors true 2023-12-24T19:56:51.358 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-12-24T19:56:51.358+0000 7fd21c64e540 -1 Falling back to public interface 2023-12-24T19:56:51.361 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-12-24T19:56:51.361+0000 7f6854087540 -1 osd.2 0 log_to_monitors true 2023-12-24T19:56:51.368 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-12-24T19:56:51.367+0000 7f039eb2b540 -1 osd.7 0 log_to_monitors true 2023-12-24T19:56:51.369 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-12-24T19:56:51.369+0000 7f5e717da540 -1 Falling back to public interface 2023-12-24T19:56:51.371 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-12-24T19:56:51.371+0000 7fa5a1654540 -1 osd.6 0 log_to_monitors true 2023-12-24T19:56:51.375 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-12-24T19:56:51.374+0000 7fa38ecfc540 -1 Falling back to public interface 2023-12-24T19:56:51.375 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-12-24T19:56:51.375+0000 7f6310643540 -1 Falling back to public interface 2023-12-24T19:56:51.377 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-12-24T19:56:51.377+0000 7fd21c64e540 -1 osd.0 0 log_to_monitors true 2023-12-24T19:56:51.384 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-12-24T19:56:51.384+0000 7f5e717da540 -1 osd.1 0 log_to_monitors true 2023-12-24T19:56:51.393 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-12-24T19:56:51.393+0000 7fa38ecfc540 -1 osd.5 0 log_to_monitors true 2023-12-24T19:56:51.397 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-12-24T19:56:51.397+0000 7f6310643540 -1 osd.3 0 log_to_monitors true 2023-12-24T19:56:51.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.441+0000 7fea9a00a700 1 Processor -- start 2023-12-24T19:56:51.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.441+0000 7fea9a00a700 1 -- start start 2023-12-24T19:56:51.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.442+0000 7fea9a00a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fea94068140 0x7fea940cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.442+0000 7fea9a00a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea94159a60 0x7fea94159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.442+0000 7fea9a00a700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea940b2890 con 0x7fea94068510 2023-12-24T19:56:51.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.442+0000 7fea9a00a700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea940cf630 con 0x7fea94068140 2023-12-24T19:56:51.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.442+0000 7fea9a00a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea940b2240 con 0x7fea94159a60 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.442+0000 7fea937fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fea94068140 0x7fea940cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.442+0000 7fea937fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fea94068140 0x7fea940cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51794/0 (socket says 172.21.15.61:51794) 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.442+0000 7fea92ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fea94068510 0x7fea940b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:36538/0 (socket says 172.21.15.61:36538) 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.442+0000 7fea937fe700 1 -- 172.21.15.61:0/1294297184 learned_addr learned my addr 172.21.15.61:0/1294297184 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.443+0000 7fea93fff700 1 --2- 172.21.15.61:0/1294297184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea94159a60 0x7fea94159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.443+0000 7fea937fe700 1 -- 172.21.15.61:0/1294297184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea94159a60 msgr2=0x7fea94159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.443+0000 7fea937fe700 1 --2- 172.21.15.61:0/1294297184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea94159a60 0x7fea94159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.443+0000 7fea937fe700 1 -- 172.21.15.61:0/1294297184 >> v1:172.21.15.61:6789/0 conn(0x7fea94068510 legacy=0x7fea940b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.443+0000 7fea927fc700 1 -- 172.21.15.61:0/1294297184 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985645867 0 0) 0x7fea940b2890 con 0x7fea94068510 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.443+0000 7fea937fe700 1 -- 172.21.15.61:0/1294297184 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea940b2520 con 0x7fea94068140 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.443+0000 7fea937fe700 1 --2- 172.21.15.61:0/1294297184 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 0x7fea940cefa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea84009990 tx=0x7fea84009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33b6b26970567d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.443+0000 7fea927fc700 1 -- 172.21.15.61:0/1294297184 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea84009e80 con 0x7fea94068140 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.443+0000 7fea927fc700 1 -- 172.21.15.61:0/1294297184 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea84005c10 con 0x7fea94068140 2023-12-24T19:56:51.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.443+0000 7fea927fc700 1 -- 172.21.15.61:0/1294297184 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8400b650 con 0x7fea94068140 2023-12-24T19:56:51.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.444+0000 7fea9a00a700 1 -- 172.21.15.61:0/1294297184 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 msgr2=0x7fea940cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:51.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.444+0000 7fea9a00a700 1 --2- 172.21.15.61:0/1294297184 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 0x7fea940cefa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea84009990 tx=0x7fea84009220 comp rx=0 tx=0).stop 2023-12-24T19:56:51.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.444+0000 7fea9a00a700 1 -- 172.21.15.61:0/1294297184 shutdown_connections 2023-12-24T19:56:51.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.444+0000 7fea9a00a700 1 --2- 172.21.15.61:0/1294297184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea94159a60 0x7fea94159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.444+0000 7fea9a00a700 1 --2- 172.21.15.61:0/1294297184 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 0x7fea940cefa0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.444+0000 7fea9a00a700 1 -- 172.21.15.61:0/1294297184 >> 172.21.15.61:0/1294297184 conn(0x7fea94097a10 msgr2=0x7fea940ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:51.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.444+0000 7fea9a00a700 1 -- 172.21.15.61:0/1294297184 shutdown_connections 2023-12-24T19:56:51.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.444+0000 7fea9a00a700 1 -- 172.21.15.61:0/1294297184 wait complete. 2023-12-24T19:56:51.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.445+0000 7fea9a00a700 1 Processor -- start 2023-12-24T19:56:51.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.445+0000 7fea9a00a700 1 -- start start 2023-12-24T19:56:51.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea9a00a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 0x7fea9415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea9a00a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea94068510 0x7fea94153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea9a00a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea94159a60 0x7fea94098e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:51.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea9a00a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9409ac90 con 0x7fea94068140 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea9a00a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea941543d0 con 0x7fea94159a60 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea9a00a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9409a080 con 0x7fea94068510 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea937fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 0x7fea9415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea937fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 0x7fea9415ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51804/0 (socket says 172.21.15.61:51804) 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea937fe700 1 -- 172.21.15.61:0/2049596185 learned_addr learned my addr 172.21.15.61:0/2049596185 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea92ffd700 1 --2- 172.21.15.61:0/2049596185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea94068510 0x7fea94153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.446+0000 7fea93fff700 1 --2- 172.21.15.61:0/2049596185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea94159a60 0x7fea94098e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea937fe700 1 -- 172.21.15.61:0/2049596185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea94068510 msgr2=0x7fea94153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea937fe700 1 --2- 172.21.15.61:0/2049596185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea94068510 0x7fea94153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea937fe700 1 -- 172.21.15.61:0/2049596185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea94159a60 msgr2=0x7fea94098e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea937fe700 1 --2- 172.21.15.61:0/2049596185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea94159a60 0x7fea94098e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea937fe700 1 -- 172.21.15.61:0/2049596185 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea84009480 con 0x7fea94068140 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea937fe700 1 --2- 172.21.15.61:0/2049596185 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 0x7fea9415ad30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fea8400b3c0 tx=0x7fea84016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:51.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea7b7fe700 1 -- 172.21.15.61:0/2049596185 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8401db50 con 0x7fea94068140 2023-12-24T19:56:51.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea7b7fe700 1 -- 172.21.15.61:0/2049596185 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8401dcb0 con 0x7fea94068140 2023-12-24T19:56:51.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea9a00a700 1 -- 172.21.15.61:0/2049596185 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9409a360 con 0x7fea94068140 2023-12-24T19:56:51.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea7b7fe700 1 -- 172.21.15.61:0/2049596185 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8401a670 con 0x7fea94068140 2023-12-24T19:56:51.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea9a00a700 1 -- 172.21.15.61:0/2049596185 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9409a920 con 0x7fea94068140 2023-12-24T19:56:51.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea7b7fe700 1 -- 172.21.15.61:0/2049596185 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fea8401a9e0 con 0x7fea94068140 2023-12-24T19:56:51.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.447+0000 7fea7b7fe700 1 -- 172.21.15.61:0/2049596185 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fea84011b00 con 0x7fea94068140 2023-12-24T19:56:51.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.448+0000 7fea9a00a700 1 -- 172.21.15.61:0/2049596185 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9406d440 con 0x7fea94068140 2023-12-24T19:56:51.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.450+0000 7fea7b7fe700 1 -- 172.21.15.61:0/2049596185 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fea84011cc0 con 0x7fea94068140 2023-12-24T19:56:51.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.521+0000 7fea9a00a700 1 -- 172.21.15.61:0/2049596185 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea9404c3c0 con 0x7fea94068140 2023-12-24T19:56:51.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.521+0000 7fea7b7fe700 1 -- 172.21.15.61:0/2049596185 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fea84011e60 con 0x7fea94068140 2023-12-24T19:56:51.523 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:56:51.523 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":10,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:56:51.229309+0000","last_up_change":"0.000000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:56:51.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.522+0000 7fea9a00a700 1 -- 172.21.15.61:0/2049596185 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 msgr2=0x7fea9415ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:51.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.522+0000 7fea9a00a700 1 --2- 172.21.15.61:0/2049596185 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 0x7fea9415ad30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fea8400b3c0 tx=0x7fea84016000 comp rx=0 tx=0).stop 2023-12-24T19:56:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.522+0000 7fea9a00a700 1 -- 172.21.15.61:0/2049596185 shutdown_connections 2023-12-24T19:56:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.522+0000 7fea9a00a700 1 --2- 172.21.15.61:0/2049596185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea94159a60 0x7fea94098e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.522+0000 7fea9a00a700 1 --2- 172.21.15.61:0/2049596185 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fea94068140 0x7fea9415ad30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.522+0000 7fea9a00a700 1 --2- 172.21.15.61:0/2049596185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fea94068510 0x7fea94153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.522+0000 7fea9a00a700 1 -- 172.21.15.61:0/2049596185 >> 172.21.15.61:0/2049596185 conn(0x7fea94097a10 msgr2=0x7fea9415f820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.522+0000 7fea9a00a700 1 -- 172.21.15.61:0/2049596185 shutdown_connections 2023-12-24T19:56:51.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:51.522+0000 7fea9a00a700 1 -- 172.21.15.61:0/2049596185 wait complete. 2023-12-24T19:56:51.535 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-24T19:56:51.536 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-24T19:56:51.960 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:51.959+0000 7f514aa1a1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T19:56:51.988 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:51.988+0000 7fc83e5401c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-24T19:56:52.039 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:52.038+0000 7f514aa1a1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T19:56:52.070 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:52.070+0000 7fc83e5401c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-24T19:56:52.169 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:52.168+0000 7f514aa1a1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T19:56:52.208 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:52.207+0000 7fc83e5401c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-24T19:56:52.341 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-24T19:56:52.454 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.454+0000 7fc70a121700 1 Processor -- start 2023-12-24T19:56:52.455 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.454+0000 7fc70a121700 1 -- start start 2023-12-24T19:56:52.457 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.455+0000 7fc70a121700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc704069ca0 0x7fc704156530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:52.457 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.455+0000 7fc70a121700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc7040cb2b0 0x7fc704156a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.455+0000 7fc70a121700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7040cbbd0 con 0x7fc70406ab70 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.455+0000 7fc70a121700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7040cb0c0 con 0x7fc7040cb2b0 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.455+0000 7fc70a121700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7040c8170 con 0x7fc704069ca0 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.455+0000 7fc702ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc7040cb2b0 0x7fc704156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.455+0000 7fc703fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fc70406ab70 0x7fc70415a6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:36554/0 (socket says 172.21.15.61:36554) 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.455+0000 7fc702ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc7040cb2b0 0x7fc704156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51810/0 (socket says 172.21.15.61:51810) 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.455+0000 7fc703fff700 1 -- 172.21.15.61:0/994893567 learned_addr learned my addr 172.21.15.61:0/994893567 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.455+0000 7fc7037fe700 1 --2- 172.21.15.61:0/994893567 >> v2:172.21.15.133:3300/0 conn(0x7fc704069ca0 0x7fc704156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.456+0000 7fc702ffd700 1 -- 172.21.15.61:0/994893567 >> v2:172.21.15.133:3300/0 conn(0x7fc704069ca0 msgr2=0x7fc704156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.456+0000 7fc702ffd700 1 --2- 172.21.15.61:0/994893567 >> v2:172.21.15.133:3300/0 conn(0x7fc704069ca0 0x7fc704156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:52.458 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.456+0000 7fc702ffd700 1 -- 172.21.15.61:0/994893567 >> v1:172.21.15.61:6789/0 conn(0x7fc70406ab70 legacy=0x7fc70415a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.456+0000 7fc702ffd700 1 -- 172.21.15.61:0/994893567 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc704067550 con 0x7fc7040cb2b0 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.456+0000 7fc7027fc700 1 -- 172.21.15.61:0/994893567 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840741647 0 0) 0x7fc7040cbbd0 con 0x7fc70406ab70 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.456+0000 7fc702ffd700 1 --2- 172.21.15.61:0/994893567 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7040cb2b0 0x7fc704156a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc7040643f0 tx=0x7fc6f8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eedb8af9639d441 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.456+0000 7fc7027fc700 1 -- 172.21.15.61:0/994893567 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8005c10 con 0x7fc7040cb2b0 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.456+0000 7fc7027fc700 1 -- 172.21.15.61:0/994893567 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f8005d70 con 0x7fc7040cb2b0 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.456+0000 7fc7027fc700 1 -- 172.21.15.61:0/994893567 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8006280 con 0x7fc7040cb2b0 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.457+0000 7fc70a121700 1 -- 172.21.15.61:0/994893567 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7040cb2b0 msgr2=0x7fc704156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.457+0000 7fc70a121700 1 --2- 172.21.15.61:0/994893567 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7040cb2b0 0x7fc704156a70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc7040643f0 tx=0x7fc6f8009120 comp rx=0 tx=0).stop 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.457+0000 7fc70a121700 1 -- 172.21.15.61:0/994893567 shutdown_connections 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.457+0000 7fc70a121700 1 --2- 172.21.15.61:0/994893567 >> v2:172.21.15.133:3300/0 conn(0x7fc704069ca0 0x7fc704156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.457+0000 7fc70a121700 1 --2- 172.21.15.61:0/994893567 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7040cb2b0 0x7fc704156a70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.457+0000 7fc70a121700 1 -- 172.21.15.61:0/994893567 >> 172.21.15.61:0/994893567 conn(0x7fc7040ce1b0 msgr2=0x7fc7040ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.457+0000 7fc70a121700 1 -- 172.21.15.61:0/994893567 shutdown_connections 2023-12-24T19:56:52.459 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.457+0000 7fc70a121700 1 -- 172.21.15.61:0/994893567 wait complete. 2023-12-24T19:56:52.462 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.458+0000 7fc70a121700 1 Processor -- start 2023-12-24T19:56:52.462 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.458+0000 7fc70a121700 1 -- start start 2023-12-24T19:56:52.462 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc70a121700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc704069ca0 0x7fc7040b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:52.462 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc70a121700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc70406ab70 0x7fc7041621a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:52.462 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc70a121700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc7040cb2b0 0x7fc7040c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:52.463 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc70a121700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7041626e0 con 0x7fc70406ab70 2023-12-24T19:56:52.463 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc70a121700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040b0af0 con 0x7fc704069ca0 2023-12-24T19:56:52.463 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc70a121700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040b0dd0 con 0x7fc7040cb2b0 2023-12-24T19:56:52.463 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc702ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc70406ab70 0x7fc7041621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:52.463 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc702ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc70406ab70 0x7fc7041621a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51820/0 (socket says 172.21.15.61:51820) 2023-12-24T19:56:52.463 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc702ffd700 1 -- 172.21.15.61:0/4195245942 learned_addr learned my addr 172.21.15.61:0/4195245942 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:56:52.463 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc7037fe700 1 --2- 172.21.15.61:0/4195245942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc704069ca0 0x7fc7040b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:52.464 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc703fff700 1 --2- 172.21.15.61:0/4195245942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc7040cb2b0 0x7fc7040c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:52.464 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc702ffd700 1 -- 172.21.15.61:0/4195245942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc7040cb2b0 msgr2=0x7fc7040c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:52.464 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc702ffd700 1 --2- 172.21.15.61:0/4195245942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc7040cb2b0 0x7fc7040c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:52.464 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc702ffd700 1 -- 172.21.15.61:0/4195245942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc704069ca0 msgr2=0x7fc7040b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:52.464 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc702ffd700 1 --2- 172.21.15.61:0/4195245942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc704069ca0 0x7fc7040b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:52.464 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.459+0000 7fc702ffd700 1 -- 172.21.15.61:0/4195245942 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80093c0 con 0x7fc70406ab70 2023-12-24T19:56:52.465 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.460+0000 7fc702ffd700 1 --2- 172.21.15.61:0/4195245942 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc70406ab70 0x7fc7041621a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc7040641d0 tx=0x7fc6f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:52.465 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.460+0000 7fc6eb7fe700 1 -- 172.21.15.61:0/4195245942 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f801b690 con 0x7fc70406ab70 2023-12-24T19:56:52.465 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.460+0000 7fc6eb7fe700 1 -- 172.21.15.61:0/4195245942 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f801b7f0 con 0x7fc70406ab70 2023-12-24T19:56:52.465 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.460+0000 7fc70a121700 1 -- 172.21.15.61:0/4195245942 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7040b10b0 con 0x7fc70406ab70 2023-12-24T19:56:52.465 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.460+0000 7fc6eb7fe700 1 -- 172.21.15.61:0/4195245942 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f801bbb0 con 0x7fc70406ab70 2023-12-24T19:56:52.465 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.460+0000 7fc70a121700 1 -- 172.21.15.61:0/4195245942 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7040b1670 con 0x7fc70406ab70 2023-12-24T19:56:52.465 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.460+0000 7fc6eb7fe700 1 -- 172.21.15.61:0/4195245942 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc6f802f6c0 con 0x7fc70406ab70 2023-12-24T19:56:52.466 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.460+0000 7fc6eb7fe700 1 -- 172.21.15.61:0/4195245942 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1879+0+0 (secure 0 0 0) 0x7fc6f8026c10 con 0x7fc70406ab70 2023-12-24T19:56:52.466 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.461+0000 7fc70a121700 1 -- 172.21.15.61:0/4195245942 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7040b1890 con 0x7fc70406ab70 2023-12-24T19:56:52.466 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.463+0000 7fc6eb7fe700 1 -- 172.21.15.61:0/4195245942 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc6f8026e60 con 0x7fc70406ab70 2023-12-24T19:56:52.534 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.534+0000 7fc70a121700 1 -- 172.21.15.61:0/4195245942 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc70404c3c0 con 0x7fc70406ab70 2023-12-24T19:56:52.535 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.535+0000 7fc6eb7fe700 1 -- 172.21.15.61:0/4195245942 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fc6f802fb50 con 0x7fc70406ab70 2023-12-24T19:56:52.535 INFO:teuthology.misc.health.smithi061.stdout: 2023-12-24T19:56:52.535 INFO:teuthology.misc.health.smithi061.stdout:{"epoch":11,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:56:52.232435+0000","last_up_change":"0.000000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:56:52.536 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.536+0000 7fc70a121700 1 -- 172.21.15.61:0/4195245942 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc70406ab70 msgr2=0x7fc7041621a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:52.536 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.536+0000 7fc70a121700 1 --2- 172.21.15.61:0/4195245942 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc70406ab70 0x7fc7041621a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc7040641d0 tx=0x7fc6f8016000 comp rx=0 tx=0).stop 2023-12-24T19:56:52.536 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.536+0000 7fc70a121700 1 -- 172.21.15.61:0/4195245942 shutdown_connections 2023-12-24T19:56:52.536 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.536+0000 7fc70a121700 1 --2- 172.21.15.61:0/4195245942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc7040cb2b0 0x7fc7040c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:52.536 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.536+0000 7fc70a121700 1 --2- 172.21.15.61:0/4195245942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc704069ca0 0x7fc7040b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:52.537 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.536+0000 7fc70a121700 1 --2- 172.21.15.61:0/4195245942 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc70406ab70 0x7fc7041621a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:52.537 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.536+0000 7fc70a121700 1 -- 172.21.15.61:0/4195245942 >> 172.21.15.61:0/4195245942 conn(0x7fc7040ce1b0 msgr2=0x7fc7040c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:52.537 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.536+0000 7fc70a121700 1 -- 172.21.15.61:0/4195245942 shutdown_connections 2023-12-24T19:56:52.537 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:52.536+0000 7fc70a121700 1 -- 172.21.15.61:0/4195245942 wait complete. 2023-12-24T19:56:52.547 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-24T19:56:52.718 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:52.717+0000 7f514aa1a1c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-24T19:56:52.797 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:52.797+0000 7fc83e5401c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-24T19:56:52.883 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:52.882+0000 7f514aa1a1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T19:56:52.970 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:52.970+0000 7fc83e5401c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-24T19:56:53.044 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:53.043+0000 7f514aa1a1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T19:56:53.139 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:53.139+0000 7fc83e5401c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-24T19:56:53.254 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-12-24T19:56:53.253+0000 7f5e68bf4700 -1 osd.1 0 waiting for initial osdmap 2023-12-24T19:56:53.254 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-12-24T19:56:53.253+0000 7f0395f45700 -1 osd.7 0 waiting for initial osdmap 2023-12-24T19:56:53.254 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-12-24T19:56:53.254+0000 7f6307a5d700 -1 osd.3 0 waiting for initial osdmap 2023-12-24T19:56:53.255 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-12-24T19:56:53.254+0000 7fad31a64700 -1 osd.4 0 waiting for initial osdmap 2023-12-24T19:56:53.255 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-12-24T19:56:53.255+0000 7f5e629ed700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T19:56:53.255 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-12-24T19:56:53.255+0000 7f684bca2700 -1 osd.2 0 waiting for initial osdmap 2023-12-24T19:56:53.256 INFO:tasks.ceph.osd.4.smithi133.stderr:2023-12-24T19:56:53.255+0000 7fad2b85d700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T19:56:53.256 INFO:tasks.ceph.osd.7.smithi133.stderr:2023-12-24T19:56:53.255+0000 7f038fd3e700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T19:56:53.256 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-12-24T19:56:53.255+0000 7fa598a6e700 -1 osd.6 0 waiting for initial osdmap 2023-12-24T19:56:53.257 INFO:tasks.ceph.osd.6.smithi133.stderr:2023-12-24T19:56:53.256+0000 7fa592867700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T19:56:53.257 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-12-24T19:56:53.256+0000 7f684529a700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T19:56:53.257 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-12-24T19:56:53.257+0000 7f6301856700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T19:56:53.258 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-12-24T19:56:53.257+0000 7fa386917700 -1 osd.5 0 waiting for initial osdmap 2023-12-24T19:56:53.261 INFO:tasks.ceph.osd.5.smithi133.stderr:2023-12-24T19:56:53.258+0000 7fa37ff0f700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T19:56:53.262 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-12-24T19:56:53.262+0000 7fd214269700 -1 osd.0 0 waiting for initial osdmap 2023-12-24T19:56:53.263 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-12-24T19:56:53.263+0000 7fd20d861700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-24T19:56:53.837 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:53.837+0000 7f514aa1a1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T19:56:53.978 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:53.978+0000 7fc83e5401c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-24T19:56:54.053 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:54.052+0000 7f514aa1a1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:56:54.123 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:54.123+0000 7f514aa1a1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T19:56:54.207 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:54.206+0000 7fc83e5401c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-24T19:56:54.285 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:54.285+0000 7f514aa1a1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T19:56:54.286 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:54.286+0000 7fc83e5401c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-24T19:56:54.456 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-12-24T19:56:54.455+0000 7fc83e5401c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-24T19:56:55.321 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:55.320+0000 7f5109475700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-24T19:56:55.321 INFO:tasks.ceph.mgr.x.smithi133.stderr:2023-12-24T19:56:55.320+0000 7f5109475700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-24T19:56:59.353 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-24T19:56:59.473 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.473+0000 7f83d8520700 1 Processor -- start 2023-12-24T19:56:59.473 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.473+0000 7f83d8520700 1 -- start start 2023-12-24T19:56:59.477 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d8520700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83d00ca350 0x7f83d00cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.477 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d8520700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d0157920 0x7f83d0158f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.477 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d8520700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d0157e30 con 0x7f83d0156ab0 2023-12-24T19:56:59.477 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d8520700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d0158160 con 0x7f83d00ca350 2023-12-24T19:56:59.477 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d8520700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0158440 con 0x7f83d0157920 2023-12-24T19:56:59.477 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d62bc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f83d0156ab0 0x7f83d00c9c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:48366/0 (socket says 172.21.15.61:48366) 2023-12-24T19:56:59.477 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d62bc700 1 -- 172.21.15.61:0/3968130405 learned_addr learned my addr 172.21.15.61:0/3968130405 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:56:59.477 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d6abd700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d0157920 0x7f83d0158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.477 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d5abb700 1 --2- 172.21.15.61:0/3968130405 >> v2:172.21.15.133:3300/0 conn(0x7f83d00ca350 0x7f83d00cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.477 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698311673 0 0) 0x7f83d0157e30 con 0x7f83d0156ab0 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83bc003570 con 0x7f83d0156ab0 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3710621573 0 0) 0x7f83bc003570 con 0x7f83d0156ab0 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d0157920 msgr2=0x7f83d0158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d0157920 0x7f83d0158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 >> v2:172.21.15.133:3300/0 conn(0x7f83d00ca350 msgr2=0x7f83d00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 --2- 172.21.15.61:0/3968130405 >> v2:172.21.15.133:3300/0 conn(0x7f83d00ca350 0x7f83d00cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d0158720 con 0x7f83d0156ab0 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f83cc001470 con 0x7f83d0156ab0 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d6abd700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d0157920 0x7f83d0158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d5abb700 1 --2- 172.21.15.61:0/3968130405 >> v2:172.21.15.133:3300/0 conn(0x7f83d00ca350 0x7f83d00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 >> v1:172.21.15.61:6789/0 conn(0x7f83d0156ab0 legacy=0x7f83d00c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83bc003a60 0x7f83bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.478 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d0157920 0x7f83bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83bc004d50 0x7f83bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0158160 con 0x7f83bc003a60 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0158440 con 0x7f83bc004d50 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.474+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc00dca0 con 0x7f83d0157920 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d62bc700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83bc003a60 0x7f83bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d5abb700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d0157920 0x7f83bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d6abd700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83bc004d50 0x7f83bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d62bc700 1 -- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d0157920 msgr2=0x7f83bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d62bc700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83d0157920 0x7f83bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d62bc700 1 -- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83bc004d50 msgr2=0x7f83bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d62bc700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83bc004d50 0x7f83bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.479 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d62bc700 1 -- 172.21.15.61:0/3968130405 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009a20 con 0x7f83bc003a60 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d62bc700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83bc003a60 0x7f83bc003e70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c3c0 tx=0x7f83cc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97963cb7b2b6ae3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00cc90 con 0x7f83bc003a60 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc00ce30 con 0x7f83bc003a60 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.475+0000 7f83d52ba700 1 -- 172.21.15.61:0/3968130405 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc005b70 con 0x7f83bc003a60 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.476+0000 7f83d8520700 1 -- 172.21.15.61:0/3968130405 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83bc003a60 msgr2=0x7f83bc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.476+0000 7f83d8520700 1 --2- 172.21.15.61:0/3968130405 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83bc003a60 0x7f83bc003e70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c3c0 tx=0x7f83cc001e90 comp rx=0 tx=0).stop 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.476+0000 7f83d6abd700 1 -- 172.21.15.61:0/3968130405 reap_dead start 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.476+0000 7f83d8520700 1 -- 172.21.15.61:0/3968130405 shutdown_connections 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.476+0000 7f83d8520700 1 -- 172.21.15.61:0/3968130405 >> 172.21.15.61:0/3968130405 conn(0x7f83d0067fe0 msgr2=0x7f83d00cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.476+0000 7f83d8520700 1 -- 172.21.15.61:0/3968130405 shutdown_connections 2023-12-24T19:56:59.480 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.476+0000 7f83d8520700 1 -- 172.21.15.61:0/3968130405 wait complete. 2023-12-24T19:56:59.483 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.477+0000 7f83d8520700 1 Processor -- start 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.477+0000 7f83d8520700 1 -- start start 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d8520700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc003a60 0x7f83d016a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d8520700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83d00c13a0 0x7f83d014c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d8520700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d00aa880 0x7f83d00aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d8520700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00ab260 con 0x7f83d00c13a0 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d8520700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d016af10 con 0x7f83d00aa880 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d8520700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00c18a0 con 0x7f83bc003a60 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d5abb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83d00c13a0 0x7f83d014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d5abb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83d00c13a0 0x7f83d014c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35966/0 (socket says 172.21.15.61:35966) 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d5abb700 1 -- 172.21.15.61:0/1820750148 learned_addr learned my addr 172.21.15.61:0/1820750148 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d62bc700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc003a60 0x7f83d016a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.484 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d6abd700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d00aa880 0x7f83d00aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d5abb700 1 -- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc003a60 msgr2=0x7f83d016a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d5abb700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc003a60 0x7f83d016a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d5abb700 1 -- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d00aa880 msgr2=0x7f83d00aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d5abb700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d00aa880 0x7f83d00aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d5abb700 1 -- 172.21.15.61:0/1820750148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d00c1b80 con 0x7f83d00c13a0 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.478+0000 7f83d5abb700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83d00c13a0 0x7f83d014c000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f83c0011d70 tx=0x7f83c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.479+0000 7f83c67fc700 1 -- 172.21.15.61:0/1820750148 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c000fb40 con 0x7f83d00c13a0 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.479+0000 7f83c67fc700 1 -- 172.21.15.61:0/1820750148 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c000fca0 con 0x7f83d00c13a0 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.479+0000 7f83c67fc700 1 -- 172.21.15.61:0/1820750148 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c001d480 con 0x7f83d00c13a0 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.479+0000 7f83d8520700 1 -- 172.21.15.61:0/1820750148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d00c1e60 con 0x7f83d00c13a0 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.479+0000 7f83d8520700 1 -- 172.21.15.61:0/1820750148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d00c6ee0 con 0x7f83d00c13a0 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.480+0000 7f83d8520700 1 -- 172.21.15.61:0/1820750148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d004c3c0 con 0x7f83d00c13a0 2023-12-24T19:56:59.485 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.480+0000 7f83c67fc700 1 -- 172.21.15.61:0/1820750148 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f83c001d8b0 con 0x7f83d00c13a0 2023-12-24T19:56:59.486 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.480+0000 7f83c67fc700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f83b4066f30 0x7f83b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.486 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.480+0000 7f83c67fc700 1 -- 172.21.15.61:0/1820750148 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f83c0018070 con 0x7f83d00c13a0 2023-12-24T19:56:59.486 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.480+0000 7f83d62bc700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f83b4066f30 0x7f83b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.486 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.481+0000 7f83d62bc700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f83b4066f30 0x7f83b40693e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c3c0 tx=0x7f83cc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:59.486 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.485+0000 7f83c67fc700 1 -- 172.21.15.61:0/1820750148 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83c0052430 con 0x7f83d00c13a0 2023-12-24T19:56:59.681 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.681+0000 7f83d8520700 1 -- 172.21.15.61:0/1820750148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83d0158a00 con 0x7f83d00c13a0 2023-12-24T19:56:59.682 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.682+0000 7f83c67fc700 1 -- 172.21.15.61:0/1820750148 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f83c0055a50 con 0x7f83d00c13a0 2023-12-24T19:56:59.682 INFO:teuthology.misc.health.smithi061.stdout: 2023-12-24T19:56:59.682 INFO:teuthology.misc.health.smithi061.stdout:{"epoch":16,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:56:57.314480+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:56:59.684 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 -- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f83b4066f30 msgr2=0x7f83b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f83b4066f30 0x7f83b40693e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00c3c0 tx=0x7f83cc015000 comp rx=0 tx=0).stop 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 -- 172.21.15.61:0/1820750148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83d00c13a0 msgr2=0x7f83d014c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83d00c13a0 0x7f83d014c000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f83c0011d70 tx=0x7f83c00091a0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 -- 172.21.15.61:0/1820750148 shutdown_connections 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83bc003a60 0x7f83d016a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f83b4066f30 0x7f83b40693e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d00aa880 0x7f83d00aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 --2- 172.21.15.61:0/1820750148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83d00c13a0 0x7f83d014c000 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 -- 172.21.15.61:0/1820750148 >> 172.21.15.61:0/1820750148 conn(0x7f83d0067fe0 msgr2=0x7f83d00ac4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 -- 172.21.15.61:0/1820750148 shutdown_connections 2023-12-24T19:56:59.685 INFO:teuthology.misc.health.smithi061.stderr:2023-12-24T19:56:59.684+0000 7f83d8520700 1 -- 172.21.15.61:0/1820750148 wait complete. 2023-12-24T19:56:59.695 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-24T19:56:59.695 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-24T19:56:59.696 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T19:56:59.696 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T19:56:59.703 INFO:tasks.ceph.mds.a:Started 2023-12-24T19:56:59.703 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T19:56:59.703 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T19:56:59.709 INFO:tasks.ceph.mds.c:Started 2023-12-24T19:56:59.709 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T19:56:59.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T19:56:59.712 INFO:tasks.ceph.mds.b:Started 2023-12-24T19:56:59.712 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T19:56:59.712 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T19:56:59.717 INFO:tasks.ceph.mds.d:Started 2023-12-24T19:56:59.717 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-24T19:56:59.717 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:56:59.784 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T19:56:59.785 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T19:56:59.785 INFO:tasks.ceph.mds.a.smithi061.stderr:2023-12-24T19:56:59.785+0000 7f6812ea2700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6833/0: (98) Address already in use 2023-12-24T19:56:59.800 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T19:56:59.800 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T19:56:59.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.847+0000 7f4d648cf700 1 Processor -- start 2023-12-24T19:56:59.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.847+0000 7f4d648cf700 1 -- start start 2023-12-24T19:56:59.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d648cf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d60159c10 0x7f4d600c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d648cf700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d60159fe0 0x7f4d600c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d648cf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d600cba80 0x7f4d600cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d648cf700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d600cc440 con 0x7f4d60159fe0 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d648cf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d600af880 con 0x7f4d60159c10 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d648cf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600c6fc0 con 0x7f4d600cba80 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5dd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d60159fe0 0x7f4d600c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5dd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d60159fe0 0x7f4d600c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35990/0 (socket says 172.21.15.61:35990) 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5dd9b700 1 -- 172.21.15.61:0/1322958820 learned_addr learned my addr 172.21.15.61:0/1322958820 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5ed9d700 1 --2- 172.21.15.61:0/1322958820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d600cba80 0x7f4d600cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5e59c700 1 --2- 172.21.15.61:0/1322958820 >> v2:172.21.15.133:3300/0 conn(0x7f4d60159c10 0x7f4d600c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5dd9b700 1 -- 172.21.15.61:0/1322958820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d600cba80 msgr2=0x7f4d600cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5dd9b700 1 --2- 172.21.15.61:0/1322958820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d600cba80 0x7f4d600cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5dd9b700 1 -- 172.21.15.61:0/1322958820 >> v2:172.21.15.133:3300/0 conn(0x7f4d60159c10 msgr2=0x7f4d600c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:56:59.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5dd9b700 1 --2- 172.21.15.61:0/1322958820 >> v2:172.21.15.133:3300/0 conn(0x7f4d60159c10 0x7f4d600c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5dd9b700 1 -- 172.21.15.61:0/1322958820 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600c63b0 con 0x7f4d60159fe0 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5dd9b700 1 --2- 172.21.15.61:0/1322958820 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 0x7f4d600c5d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4d600d0990 tx=0x7f4d48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d504ccb08824e783 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5d59a700 1 -- 172.21.15.61:0/1322958820 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800b820 con 0x7f4d60159fe0 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5d59a700 1 -- 172.21.15.61:0/1322958820 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4800b980 con 0x7f4d60159fe0 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.849+0000 7f4d5d59a700 1 -- 172.21.15.61:0/1322958820 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800bd20 con 0x7f4d60159fe0 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.850+0000 7f4d648cf700 1 -- 172.21.15.61:0/1322958820 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 msgr2=0x7f4d600c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.850+0000 7f4d648cf700 1 --2- 172.21.15.61:0/1322958820 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 0x7f4d600c5d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4d600d0990 tx=0x7f4d48009250 comp rx=0 tx=0).stop 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.850+0000 7f4d648cf700 1 -- 172.21.15.61:0/1322958820 shutdown_connections 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.850+0000 7f4d648cf700 1 --2- 172.21.15.61:0/1322958820 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d600cba80 0x7f4d600cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.850+0000 7f4d648cf700 1 --2- 172.21.15.61:0/1322958820 >> v2:172.21.15.133:3300/0 conn(0x7f4d60159c10 0x7f4d600c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.850+0000 7f4d648cf700 1 --2- 172.21.15.61:0/1322958820 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 0x7f4d600c5d10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.850+0000 7f4d648cf700 1 -- 172.21.15.61:0/1322958820 >> 172.21.15.61:0/1322958820 conn(0x7f4d6006e640 msgr2=0x7f4d60067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.850+0000 7f4d648cf700 1 -- 172.21.15.61:0/1322958820 shutdown_connections 2023-12-24T19:56:59.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.850+0000 7f4d648cf700 1 -- 172.21.15.61:0/1322958820 wait complete. 2023-12-24T19:56:59.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.851+0000 7f4d648cf700 1 Processor -- start 2023-12-24T19:56:59.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.851+0000 7f4d648cf700 1 -- start start 2023-12-24T19:56:59.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d648cf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d600cba80 0x7f4d60153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d648cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d60159c10 0x7f4d60141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d648cf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 0x7f4d600c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d648cf700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600b0f00 con 0x7f4d60159fe0 2023-12-24T19:56:59.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d648cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600c7d80 con 0x7f4d60159c10 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d648cf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600b6150 con 0x7f4d600cba80 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 0x7f4d600c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d60159c10 0x7f4d60141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5e59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d600cba80 0x7f4d60153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 0x7f4d600c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36002/0 (socket says 172.21.15.61:36002) 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5ed9d700 1 -- 172.21.15.61:0/3562319671 learned_addr learned my addr 172.21.15.61:0/3562319671 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5dd9b700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d60159c10 0x7f4d60141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:48532/0 (socket says 172.21.15.61:48532) 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5ed9d700 1 -- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d600cba80 msgr2=0x7f4d60153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5ed9d700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d600cba80 0x7f4d60153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5ed9d700 1 -- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d60159c10 msgr2=0x7f4d60141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5ed9d700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d60159c10 0x7f4d60141800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5ed9d700 1 -- 172.21.15.61:0/3562319671 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d480094f0 con 0x7f4d60159fe0 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.852+0000 7f4d5ed9d700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 0x7f4d600c9330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4d50007f20 tx=0x7f4d50009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.853+0000 7f4d567fc700 1 -- 172.21.15.61:0/3562319671 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000eb90 con 0x7f4d60159fe0 2023-12-24T19:56:59.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.853+0000 7f4d567fc700 1 -- 172.21.15.61:0/3562319671 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5000ed10 con 0x7f4d60159fe0 2023-12-24T19:56:59.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.853+0000 7f4d567fc700 1 -- 172.21.15.61:0/3562319671 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50014670 con 0x7f4d60159fe0 2023-12-24T19:56:59.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.853+0000 7f4d648cf700 1 -- 172.21.15.61:0/3562319671 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d600b6430 con 0x7f4d60159fe0 2023-12-24T19:56:59.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.853+0000 7f4d648cf700 1 -- 172.21.15.61:0/3562319671 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d600b37d0 con 0x7f4d60159fe0 2023-12-24T19:56:59.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.854+0000 7f4d648cf700 1 -- 172.21.15.61:0/3562319671 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d600b0d50 con 0x7f4d60159fe0 2023-12-24T19:56:59.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.854+0000 7f4d567fc700 1 -- 172.21.15.61:0/3562319671 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4d500149e0 con 0x7f4d60159fe0 2023-12-24T19:56:59.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.854+0000 7f4d567fc700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d40066f30 0x7f4d400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:56:59.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.854+0000 7f4d567fc700 1 -- 172.21.15.61:0/3562319671 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4d500847e0 con 0x7f4d60159fe0 2023-12-24T19:56:59.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.854+0000 7f4d5e59c700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d40066f30 0x7f4d400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:56:59.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.855+0000 7f4d5e59c700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d40066f30 0x7f4d400693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800acb0 tx=0x7f4d58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:56:59.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:56:59.859+0000 7f4d567fc700 1 -- 172.21.15.61:0/3562319671 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d50051da0 con 0x7f4d60159fe0 2023-12-24T19:57:00.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.052+0000 7f4d648cf700 1 -- 172.21.15.61:0/3562319671 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d600b09f0 con 0x7f4d60159fe0 2023-12-24T19:57:00.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.053+0000 7f4d567fc700 1 -- 172.21.15.61:0/3562319671 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f4d600b09f0 con 0x7f4d60159fe0 2023-12-24T19:57:00.053 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:00.053 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:56:57.314480+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:00.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 -- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d40066f30 msgr2=0x7f4d400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d40066f30 0x7f4d400693e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800acb0 tx=0x7f4d58008040 comp rx=0 tx=0).stop 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 -- 172.21.15.61:0/3562319671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 msgr2=0x7f4d600c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 0x7f4d600c9330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4d50007f20 tx=0x7f4d50009860 comp rx=0 tx=0).stop 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 -- 172.21.15.61:0/3562319671 shutdown_connections 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d600cba80 0x7f4d60153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d40066f30 0x7f4d400693e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d60159fe0 0x7f4d600c9330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 --2- 172.21.15.61:0/3562319671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d60159c10 0x7f4d60141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 -- 172.21.15.61:0/3562319671 >> 172.21.15.61:0/3562319671 conn(0x7f4d6006e640 msgr2=0x7f4d600cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 -- 172.21.15.61:0/3562319671 shutdown_connections 2023-12-24T19:57:00.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.055+0000 7f4d648cf700 1 -- 172.21.15.61:0/3562319671 wait complete. 2023-12-24T19:57:00.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T19:57:00.067 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:57:00.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.193+0000 7f3704903700 1 Processor -- start 2023-12-24T19:57:00.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.193+0000 7f3704903700 1 -- start start 2023-12-24T19:57:00.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.194+0000 7f3704903700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3700159930 0x7f3700069b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.194+0000 7f3704903700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3700070d50 0x7f37001636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.194+0000 7f3704903700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37000c7d30 con 0x7f3700159d00 2023-12-24T19:57:00.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.194+0000 7f3704903700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3700067960 con 0x7f3700070d50 2023-12-24T19:57:00.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.194+0000 7f3704903700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370006a480 con 0x7f3700159930 2023-12-24T19:57:00.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.194+0000 7f36fe59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3700159930 0x7f3700069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.194+0000 7f36fed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3700070d50 0x7f37001636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.194+0000 7f36fed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3700070d50 0x7f37001636e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:48542/0 (socket says 172.21.15.61:48542) 2023-12-24T19:57:00.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.194+0000 7f36fed9d700 1 -- 172.21.15.61:0/3739981666 learned_addr learned my addr 172.21.15.61:0/3739981666 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:00.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.194+0000 7f36fdd9b700 1 --1- 172.21.15.61:0/3739981666 >> v1:172.21.15.133:6789/0 conn(0x7f3700159d00 0x7f3700070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:49808/0 (socket says 172.21.15.61:49808) 2023-12-24T19:57:00.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.195+0000 7f36fd59a700 1 -- 172.21.15.61:0/3739981666 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498177394 0 0) 0x7f37000c7d30 con 0x7f3700159d00 2023-12-24T19:57:00.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.195+0000 7f36fd59a700 1 -- 172.21.15.61:0/3739981666 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36e8003570 con 0x7f3700159d00 2023-12-24T19:57:00.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.195+0000 7f36fed9d700 1 -- 172.21.15.61:0/3739981666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3700159930 msgr2=0x7f3700069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:00.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.195+0000 7f36fed9d700 1 --2- 172.21.15.61:0/3739981666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3700159930 0x7f3700069b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.195+0000 7f36fed9d700 1 -- 172.21.15.61:0/3739981666 >> v1:172.21.15.133:6789/0 conn(0x7f3700159d00 legacy=0x7f3700070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.195+0000 7f36fed9d700 1 -- 172.21.15.61:0/3739981666 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370006a760 con 0x7f3700070d50 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.195+0000 7f36fed9d700 1 --2- 172.21.15.61:0/3739981666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3700070d50 0x7f37001636e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009f20 tx=0x7f36f8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbb22275e9242c6c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f36fd59a700 1 -- 172.21.15.61:0/3739981666 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f800e070 con 0x7f3700070d50 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f36fd59a700 1 -- 172.21.15.61:0/3739981666 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f800b970 con 0x7f3700070d50 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f36fd59a700 1 -- 172.21.15.61:0/3739981666 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80092e0 con 0x7f3700070d50 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f3704903700 1 -- 172.21.15.61:0/3739981666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3700070d50 msgr2=0x7f37001636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f3704903700 1 --2- 172.21.15.61:0/3739981666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3700070d50 0x7f37001636e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009f20 tx=0x7f36f8009840 comp rx=0 tx=0).stop 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f3704903700 1 -- 172.21.15.61:0/3739981666 shutdown_connections 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f3704903700 1 --2- 172.21.15.61:0/3739981666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3700070d50 0x7f37001636e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f3704903700 1 --2- 172.21.15.61:0/3739981666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3700159930 0x7f3700069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f3704903700 1 -- 172.21.15.61:0/3739981666 >> 172.21.15.61:0/3739981666 conn(0x7f37000ce170 msgr2=0x7f37000ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f3704903700 1 -- 172.21.15.61:0/3739981666 shutdown_connections 2023-12-24T19:57:00.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.196+0000 7f3704903700 1 -- 172.21.15.61:0/3739981666 wait complete. 2023-12-24T19:57:00.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.197+0000 7f3704903700 1 Processor -- start 2023-12-24T19:57:00.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.197+0000 7f3704903700 1 -- start start 2023-12-24T19:57:00.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f3704903700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3700070d50 0x7f3700155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f3704903700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3700159930 0x7f37000add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f3704903700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3700159d00 0x7f37000ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f3704903700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700169a80 con 0x7f3700159930 2023-12-24T19:57:00.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f3704903700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700157ff0 con 0x7f3700159d00 2023-12-24T19:57:00.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f3704903700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37001582d0 con 0x7f3700070d50 2023-12-24T19:57:00.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f36fdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3700159930 0x7f37000add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f36fdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3700159930 0x7f37000add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36008/0 (socket says 172.21.15.61:36008) 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f36fdd9b700 1 -- 172.21.15.61:0/1019262707 learned_addr learned my addr 172.21.15.61:0/1019262707 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f36fed9d700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3700159d00 0x7f37000ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.198+0000 7f36fe59c700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3700070d50 0x7f3700155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f36fdd9b700 1 -- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3700070d50 msgr2=0x7f3700155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f36fdd9b700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3700070d50 0x7f3700155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f36fdd9b700 1 -- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3700159d00 msgr2=0x7f37000ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f36fdd9b700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3700159d00 0x7f37000ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f36fdd9b700 1 -- 172.21.15.61:0/1019262707 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f8009ae0 con 0x7f3700159930 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f36fdd9b700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3700159930 0x7f37000add70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c560 tx=0x7f36f0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f36ee7fc700 1 -- 172.21.15.61:0/1019262707 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0005a70 con 0x7f3700159930 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f36ee7fc700 1 -- 172.21.15.61:0/1019262707 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f0005bd0 con 0x7f3700159930 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f3704903700 1 -- 172.21.15.61:0/1019262707 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37001585b0 con 0x7f3700159930 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f36ee7fc700 1 -- 172.21.15.61:0/1019262707 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f00070d0 con 0x7f3700159930 2023-12-24T19:57:00.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.199+0000 7f3704903700 1 -- 172.21.15.61:0/1019262707 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3700155760 con 0x7f3700159930 2023-12-24T19:57:00.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.200+0000 7f3704903700 1 -- 172.21.15.61:0/1019262707 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3700169bd0 con 0x7f3700159930 2023-12-24T19:57:00.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.200+0000 7f36ee7fc700 1 -- 172.21.15.61:0/1019262707 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f36f00074c0 con 0x7f3700159930 2023-12-24T19:57:00.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.201+0000 7f36ee7fc700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36e0066f30 0x7f36e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.201+0000 7f36ee7fc700 1 -- 172.21.15.61:0/1019262707 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f36f00835f0 con 0x7f3700159930 2023-12-24T19:57:00.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.201+0000 7f36fe59c700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36e0066f30 0x7f36e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.201+0000 7f36fe59c700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36e0066f30 0x7f36e00693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009db0 tx=0x7f36f40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:00.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.205+0000 7f36ee7fc700 1 -- 172.21.15.61:0/1019262707 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3700169bd0 con 0x7f3700159930 2023-12-24T19:57:00.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.399+0000 7f3704903700 1 -- 172.21.15.61:0/1019262707 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3700169bd0 con 0x7f3700159930 2023-12-24T19:57:00.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.399+0000 7f36ee7fc700 1 -- 172.21.15.61:0/1019262707 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3700169bd0 con 0x7f3700159930 2023-12-24T19:57:00.400 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:57:00.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 -- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36e0066f30 msgr2=0x7f36e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36e0066f30 0x7f36e00693e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009db0 tx=0x7f36f40091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 -- 172.21.15.61:0/1019262707 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3700159930 msgr2=0x7f37000add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3700159930 0x7f37000add70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c560 tx=0x7f36f0007dd0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 -- 172.21.15.61:0/1019262707 shutdown_connections 2023-12-24T19:57:00.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3700070d50 0x7f3700155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36e0066f30 0x7f36e00693e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3700159d00 0x7f37000ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 --2- 172.21.15.61:0/1019262707 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3700159930 0x7f37000add70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 -- 172.21.15.61:0/1019262707 >> 172.21.15.61:0/1019262707 conn(0x7f37000ce170 msgr2=0x7f37000b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:00.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 -- 172.21.15.61:0/1019262707 shutdown_connections 2023-12-24T19:57:00.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.401+0000 7f3704903700 1 -- 172.21.15.61:0/1019262707 wait complete. 2023-12-24T19:57:00.413 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:57:00.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.535+0000 7f9226324700 1 Processor -- start 2023-12-24T19:57:00.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.535+0000 7f9226324700 1 -- start start 2023-12-24T19:57:00.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.536+0000 7f9226324700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92200ca270 0x7f92200cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.536+0000 7f9226324700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92200ca6f0 con 0x7f9220157780 2023-12-24T19:57:00.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.536+0000 7f9226324700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92200ca9d0 con 0x7f9220158b60 2023-12-24T19:57:00.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.536+0000 7f9226324700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92200cacb0 con 0x7f92200ca270 2023-12-24T19:57:00.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.536+0000 7f921ffff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9220157780 0x7f922006c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:48372/0 (socket says 172.21.15.61:48372) 2023-12-24T19:57:00.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.536+0000 7f921ffff700 1 -- 172.21.15.61:0/2234970130 learned_addr learned my addr 172.21.15.61:0/2234970130 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:00.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.536+0000 7f921f7fe700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92200ca270 0x7f92200cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489148566 0 0) 0x7f92200ca6f0 con 0x7f9220157780 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9208003570 con 0x7f9220157780 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036822113 0 0) 0x7f92200ca9d0 con 0x7f9220158b60 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92200ca6f0 con 0x7f9220158b60 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3348558852 0 0) 0x7f9208003570 con 0x7f9220157780 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92200ca270 msgr2=0x7f92200cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f92200ca270 0x7f92200cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 >> v1:172.21.15.133:6789/0 conn(0x7f9220158b60 legacy=0x7f922015ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92200caf90 con 0x7f9220157780 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f9210001470 con 0x7f9220157780 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 >> v1:172.21.15.61:6789/0 conn(0x7f9220157780 legacy=0x7f922006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9208003c20 0x7f9208004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9208004810 0x7f9208004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 0x7f920800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92200cacb0 con 0x7f9208005180 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920800bfa0 con 0x7f9208003c20 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920800c130 con 0x7f9208004810 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921ffff700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9208003c20 0x7f9208004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f92248c1700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 0x7f920800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921f7fe700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9208004810 0x7f9208004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f92248c1700 1 -- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9208004810 msgr2=0x7f9208004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f92248c1700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9208004810 0x7f9208004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f92248c1700 1 -- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9208003c20 msgr2=0x7f9208004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f92248c1700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9208003c20 0x7f9208004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f92248c1700 1 -- 172.21.15.61:0/2234970130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208003570 con 0x7f9208005180 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.537+0000 7f921ffff700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9208003c20 0x7f9208004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f92248c1700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 0x7f920800ba60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9218002150 tx=0x7f92180017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc02f1047a37bd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218001ab0 con 0x7f9208005180 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921800c940 con 0x7f9208005180 2023-12-24T19:57:00.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f921effd700 1 -- 172.21.15.61:0/2234970130 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921800cce0 con 0x7f9208005180 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f9226324700 1 -- 172.21.15.61:0/2234970130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 msgr2=0x7f920800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f9226324700 1 --2- 172.21.15.61:0/2234970130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 0x7f920800ba60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9218002150 tx=0x7f92180017a0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f92248c1700 1 -- 172.21.15.61:0/2234970130 reap_dead start 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f9226324700 1 -- 172.21.15.61:0/2234970130 shutdown_connections 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f9226324700 1 -- 172.21.15.61:0/2234970130 >> 172.21.15.61:0/2234970130 conn(0x7f922006b650 msgr2=0x7f92200ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f9226324700 1 -- 172.21.15.61:0/2234970130 shutdown_connections 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.538+0000 7f9226324700 1 -- 172.21.15.61:0/2234970130 wait complete. 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.539+0000 7f9226324700 1 Processor -- start 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.540+0000 7f9226324700 1 -- start start 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.540+0000 7f9226324700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 0x7f9220152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.540+0000 7f9226324700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9220142320 0x7f92201513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.540+0000 7f9226324700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92200c45a0 0x7f92200c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.540+0000 7f9226324700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92200c4f50 con 0x7f9208005180 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.540+0000 7f9226324700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922015a300 con 0x7f92200c45a0 2023-12-24T19:57:00.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.540+0000 7f9226324700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9220159a50 con 0x7f9220142320 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.540+0000 7f921ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 0x7f9220152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.540+0000 7f921ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 0x7f9220152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36030/0 (socket says 172.21.15.61:36030) 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.540+0000 7f921ffff700 1 -- 172.21.15.61:0/4097633596 learned_addr learned my addr 172.21.15.61:0/4097633596 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f92248c1700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92200c45a0 0x7f92200c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f921ffff700 1 -- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9220142320 msgr2=0x7f92201513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f921f7fe700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9220142320 0x7f92201513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f921ffff700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9220142320 0x7f92201513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f921ffff700 1 -- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92200c45a0 msgr2=0x7f92200c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f921ffff700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92200c45a0 0x7f92200c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f921ffff700 1 -- 172.21.15.61:0/4097633596 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92201518f0 con 0x7f9208005180 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f92248c1700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92200c45a0 0x7f92200c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f921ffff700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 0x7f9220152e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9210007310 tx=0x7f9210001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f9207fff700 1 -- 172.21.15.61:0/4097633596 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921000f8d0 con 0x7f9208005180 2023-12-24T19:57:00.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f9207fff700 1 -- 172.21.15.61:0/4097633596 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921000fa30 con 0x7f9208005180 2023-12-24T19:57:00.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f9207fff700 1 -- 172.21.15.61:0/4097633596 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921000fdb0 con 0x7f9208005180 2023-12-24T19:57:00.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f9226324700 1 -- 172.21.15.61:0/4097633596 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9220142790 con 0x7f9208005180 2023-12-24T19:57:00.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.541+0000 7f9226324700 1 -- 172.21.15.61:0/4097633596 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9220159cb0 con 0x7f9208005180 2023-12-24T19:57:00.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.542+0000 7f9226324700 1 -- 172.21.15.61:0/4097633596 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922004c3c0 con 0x7f9208005180 2023-12-24T19:57:00.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.542+0000 7f9207fff700 1 -- 172.21.15.61:0/4097633596 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9210013600 con 0x7f9208005180 2023-12-24T19:57:00.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.543+0000 7f9207fff700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f920c066f30 0x7f920c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:00.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.543+0000 7f9207fff700 1 -- 172.21.15.61:0/4097633596 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f92100844b0 con 0x7f9208005180 2023-12-24T19:57:00.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.543+0000 7f921f7fe700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f920c066f30 0x7f920c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:00.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.544+0000 7f921f7fe700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f920c066f30 0x7f920c0693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92200cc1d0 tx=0x7f9214008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:00.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.547+0000 7f9207fff700 1 -- 172.21.15.61:0/4097633596 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9210051a70 con 0x7f9208005180 2023-12-24T19:57:00.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.786+0000 7f9226324700 1 -- 172.21.15.61:0/4097633596 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f922015b560 con 0x7f9208005180 2023-12-24T19:57:00.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.786+0000 7f9207fff700 1 -- 172.21.15.61:0/4097633596 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1253 (secure 0 0 0) 0x7f9210055090 con 0x7f9208005180 2023-12-24T19:57:00.787 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:00.787 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/180373533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":180373533},{"type":"v1","addr":"172.21.15.61:6835","nonce":180373533}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-24T19:57:00.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 -- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f920c066f30 msgr2=0x7f920c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f920c066f30 0x7f920c0693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92200cc1d0 tx=0x7f9214008040 comp rx=0 tx=0).stop 2023-12-24T19:57:00.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 -- 172.21.15.61:0/4097633596 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 msgr2=0x7f9220152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:00.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 0x7f9220152e10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9210007310 tx=0x7f9210001d40 comp rx=0 tx=0).stop 2023-12-24T19:57:00.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 -- 172.21.15.61:0/4097633596 shutdown_connections 2023-12-24T19:57:00.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f920c066f30 0x7f920c0693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92200c45a0 0x7f92200c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9208005180 0x7f9220152e10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 --2- 172.21.15.61:0/4097633596 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9220142320 0x7f92201513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:00.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 -- 172.21.15.61:0/4097633596 >> 172.21.15.61:0/4097633596 conn(0x7f922006b650 msgr2=0x7f9220153a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:00.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 -- 172.21.15.61:0/4097633596 shutdown_connections 2023-12-24T19:57:00.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:00.788+0000 7f9226324700 1 -- 172.21.15.61:0/4097633596 wait complete. 2023-12-24T19:57:00.790 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 2 2023-12-24T19:57:02.802 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:57:02.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.937+0000 7f9b9a847700 1 Processor -- start 2023-12-24T19:57:02.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.937+0000 7f9b9a847700 1 -- start start 2023-12-24T19:57:02.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.938+0000 7f9b9a847700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b9406aac0 0x7f9b94159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:02.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.938+0000 7f9b9a847700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9406a630 con 0x7f9b94159850 2023-12-24T19:57:02.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.938+0000 7f9b9a847700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b94069d00 con 0x7f9b940caa80 2023-12-24T19:57:02.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.938+0000 7f9b9a847700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b940cccf0 con 0x7f9b9406aac0 2023-12-24T19:57:02.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.938+0000 7f9b93fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9b94159850 0x7f9b940cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:48376/0 (socket says 172.21.15.61:48376) 2023-12-24T19:57:02.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.938+0000 7f9b93fff700 1 -- 172.21.15.61:0/1386357153 learned_addr learned my addr 172.21.15.61:0/1386357153 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b937fe700 1 --2- 172.21.15.61:0/1386357153 >> v2:172.21.15.133:3300/0 conn(0x7f9b9406aac0 0x7f9b94159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259422025 0 0) 0x7f9b9406a630 con 0x7f9b94159850 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b7c003570 con 0x7f9b94159850 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729630930 0 0) 0x7f9b7c003570 con 0x7f9b94159850 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 >> v2:172.21.15.133:3300/0 conn(0x7f9b9406aac0 msgr2=0x7f9b94159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 --2- 172.21.15.61:0/1386357153 >> v2:172.21.15.133:3300/0 conn(0x7f9b9406aac0 0x7f9b94159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 >> v1:172.21.15.133:6789/0 conn(0x7f9b940caa80 legacy=0x7f9b940aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94069fe0 con 0x7f9b94159850 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f9b84001470 con 0x7f9b94159850 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 >> v1:172.21.15.61:6789/0 conn(0x7f9b94159850 legacy=0x7f9b940cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c003a60 0x7f9b7c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b7c004810 0x7f9b7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c0051c0 0x7f9b7c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940cccf0 con 0x7f9b7c0051c0 2023-12-24T19:57:02.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c00c1e0 con 0x7f9b7c003a60 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c00c3a0 con 0x7f9b7c004810 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b93fff700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c003a60 0x7f9b7c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b98de4700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c0051c0 0x7f9b7c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b937fe700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b7c004810 0x7f9b7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b98de4700 1 -- 172.21.15.61:0/1386357153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b7c004810 msgr2=0x7f9b7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b98de4700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b7c004810 0x7f9b7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b98de4700 1 -- 172.21.15.61:0/1386357153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c003a60 msgr2=0x7f9b7c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b98de4700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c003a60 0x7f9b7c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b98de4700 1 -- 172.21.15.61:0/1386357153 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c003570 con 0x7f9b7c0051c0 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.939+0000 7f9b98de4700 1 -- 172.21.15.61:0/1386357153 reap_dead start 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b98de4700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c0051c0 0x7f9b7c00ba60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c002070 tx=0x7f9b8c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f53c5eeacb7e78 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0019e0 con 0x7f9b7c0051c0 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00c8b0 con 0x7f9b7c0051c0 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b92ffd700 1 -- 172.21.15.61:0/1386357153 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00cc70 con 0x7f9b7c0051c0 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b9a847700 1 -- 172.21.15.61:0/1386357153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c0051c0 msgr2=0x7f9b7c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:02.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b9a847700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c0051c0 0x7f9b7c00ba60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c002070 tx=0x7f9b8c0016d0 comp rx=0 tx=0).stop 2023-12-24T19:57:02.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b9a847700 1 -- 172.21.15.61:0/1386357153 shutdown_connections 2023-12-24T19:57:02.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b9a847700 1 --2- 172.21.15.61:0/1386357153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c0051c0 0x7f9b7c00ba60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:02.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b9a847700 1 -- 172.21.15.61:0/1386357153 >> 172.21.15.61:0/1386357153 conn(0x7f9b940cceb0 msgr2=0x7f9b940cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:02.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b9a847700 1 -- 172.21.15.61:0/1386357153 shutdown_connections 2023-12-24T19:57:02.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.940+0000 7f9b9a847700 1 -- 172.21.15.61:0/1386357153 wait complete. 2023-12-24T19:57:02.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.941+0000 7f9b9a847700 1 Processor -- start 2023-12-24T19:57:02.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.942+0000 7f9b9a847700 1 -- start start 2023-12-24T19:57:02.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.942+0000 7f9b9a847700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c0051c0 0x7f9b94152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:02.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.942+0000 7f9b9a847700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b94152b10 0x7f9b940aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:02.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.942+0000 7f9b9a847700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b940b1cc0 0x7f9b940af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:02.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.942+0000 7f9b9a847700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b941529b0 con 0x7f9b940b1cc0 2023-12-24T19:57:02.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.942+0000 7f9b9a847700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940b10b0 con 0x7f9b7c0051c0 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.942+0000 7f9b9a847700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b940b2280 con 0x7f9b94152b10 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b98de4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b940b1cc0 0x7f9b940af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b98de4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b940b1cc0 0x7f9b940af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36046/0 (socket says 172.21.15.61:36046) 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b98de4700 1 -- 172.21.15.61:0/2009774420 learned_addr learned my addr 172.21.15.61:0/2009774420 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b93fff700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c0051c0 0x7f9b94152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b937fe700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b94152b10 0x7f9b940aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b98de4700 1 -- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b94152b10 msgr2=0x7f9b940aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b98de4700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b94152b10 0x7f9b940aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b98de4700 1 -- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c0051c0 msgr2=0x7f9b94152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b98de4700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c0051c0 0x7f9b94152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b98de4700 1 -- 172.21.15.61:0/2009774420 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b940b0780 con 0x7f9b940b1cc0 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b98de4700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b940b1cc0 0x7f9b940af2e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00c6a0 tx=0x7f9b8c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b7bfff700 1 -- 172.21.15.61:0/2009774420 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0019e0 con 0x7f9b940b1cc0 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b7bfff700 1 -- 172.21.15.61:0/2009774420 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00cea0 con 0x7f9b940b1cc0 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b9a847700 1 -- 172.21.15.61:0/2009774420 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b940b0a60 con 0x7f9b940b1cc0 2023-12-24T19:57:02.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b7bfff700 1 -- 172.21.15.61:0/2009774420 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c012e00 con 0x7f9b940b1cc0 2023-12-24T19:57:02.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.943+0000 7f9b9a847700 1 -- 172.21.15.61:0/2009774420 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b94153330 con 0x7f9b940b1cc0 2023-12-24T19:57:02.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.944+0000 7f9b9a847700 1 -- 172.21.15.61:0/2009774420 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b940b0f00 con 0x7f9b940b1cc0 2023-12-24T19:57:02.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.945+0000 7f9b7bfff700 1 -- 172.21.15.61:0/2009774420 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9b8c01e640 con 0x7f9b940b1cc0 2023-12-24T19:57:02.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.945+0000 7f9b7bfff700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b80066f30 0x7f9b800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:02.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.945+0000 7f9b7bfff700 1 -- 172.21.15.61:0/2009774420 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9b8c085d70 con 0x7f9b940b1cc0 2023-12-24T19:57:02.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.945+0000 7f9b93fff700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b80066f30 0x7f9b800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:02.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.946+0000 7f9b93fff700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b80066f30 0x7f9b800693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b84001ed0 tx=0x7f9b9406a5a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:02.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:02.949+0000 7f9b7bfff700 1 -- 172.21.15.61:0/2009774420 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b8c053330 con 0x7f9b940b1cc0 2023-12-24T19:57:03.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.188+0000 7f9b9a847700 1 -- 172.21.15.61:0/2009774420 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b9404c3c0 con 0x7f9b940b1cc0 2023-12-24T19:57:03.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.188+0000 7f9b7bfff700 1 -- 172.21.15.61:0/2009774420 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7f9b8c017020 con 0x7f9b940b1cc0 2023-12-24T19:57:03.189 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:03.189 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3729732902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3729732902},{"type":"v1","addr":"172.21.15.61:6834","nonce":3729732902}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/402997858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":402997858},{"type":"v1","addr":"172.21.15.133:6837","nonce":402997858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/180373533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":180373533},{"type":"v1","addr":"172.21.15.61:6835","nonce":180373533}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/74793696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":74793696},{"type":"v1","addr":"172.21.15.133:6836","nonce":74793696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-24T19:57:03.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.190+0000 7f9b9a847700 1 -- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b80066f30 msgr2=0x7f9b800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.190+0000 7f9b9a847700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b80066f30 0x7f9b800693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9b84001ed0 tx=0x7f9b9406a5a0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.190+0000 7f9b9a847700 1 -- 172.21.15.61:0/2009774420 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b940b1cc0 msgr2=0x7f9b940af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.190+0000 7f9b9a847700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b940b1cc0 0x7f9b940af2e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00c6a0 tx=0x7f9b8c015000 comp rx=0 tx=0).stop 2023-12-24T19:57:03.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.190+0000 7f9b9a847700 1 -- 172.21.15.61:0/2009774420 shutdown_connections 2023-12-24T19:57:03.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.190+0000 7f9b9a847700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b80066f30 0x7f9b800693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.190+0000 7f9b9a847700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b940b1cc0 0x7f9b940af2e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.190+0000 7f9b9a847700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c0051c0 0x7f9b94152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.190+0000 7f9b9a847700 1 --2- 172.21.15.61:0/2009774420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b94152b10 0x7f9b940aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.190+0000 7f9b9a847700 1 -- 172.21.15.61:0/2009774420 >> 172.21.15.61:0/2009774420 conn(0x7f9b940cceb0 msgr2=0x7f9b94155c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:03.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.191+0000 7f9b9a847700 1 -- 172.21.15.61:0/2009774420 shutdown_connections 2023-12-24T19:57:03.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.191+0000 7f9b9a847700 1 -- 172.21.15.61:0/2009774420 wait complete. 2023-12-24T19:57:03.192 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 3 2023-12-24T19:57:03.203 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:03.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.323+0000 7f6f60ee8700 1 Processor -- start 2023-12-24T19:57:03.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.323+0000 7f6f60ee8700 1 -- start start 2023-12-24T19:57:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.324+0000 7f6f60ee8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f5c159850 0x7f6f5c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.324+0000 7f6f60ee8700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c06a630 con 0x7f6f5c0caa80 2023-12-24T19:57:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.324+0000 7f6f60ee8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c069d00 con 0x7f6f5c06aac0 2023-12-24T19:57:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.324+0000 7f6f60ee8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0cccf0 con 0x7f6f5c159850 2023-12-24T19:57:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5ad9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f6f5c0caa80 0x7f6f5c0aa880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:48386/0 (socket says 172.21.15.61:48386) 2023-12-24T19:57:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5ad9d700 1 -- 172.21.15.61:0/862786794 learned_addr learned my addr 172.21.15.61:0/862786794 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943888765 0 0) 0x7f6f5c06a630 con 0x7f6f5c0caa80 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5a59c700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f5c159850 0x7f6f5c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f44003570 con 0x7f6f5c0caa80 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3110254367 0 0) 0x7f6f44003570 con 0x7f6f5c0caa80 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f5c159850 msgr2=0x7f6f5c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f5c159850 0x7f6f5c159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 >> v1:172.21.15.133:6789/0 conn(0x7f6f5c06aac0 legacy=0x7f6f5c0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c069fe0 con 0x7f6f5c0caa80 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f6f540017f0 con 0x7f6f5c0caa80 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 >> v1:172.21.15.61:6789/0 conn(0x7f6f5c0caa80 legacy=0x7f6f5c0aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f5c159850 0x7f6f44003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44003fd0 0x7f6f44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f44004d50 0x7f6f440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0cccf0 con 0x7f6f44004d50 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4400bb40 con 0x7f6f44003fd0 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4400bd00 con 0x7f6f5c159850 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5ad9d700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f44004d50 0x7f6f440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f5a59c700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f5c159850 0x7f6f44003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.325+0000 7f6f59d9b700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44003fd0 0x7f6f44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.326+0000 7f6f5ad9d700 1 -- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f5c159850 msgr2=0x7f6f44003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.326+0000 7f6f5ad9d700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f5c159850 0x7f6f44003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.326+0000 7f6f5ad9d700 1 -- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44003fd0 msgr2=0x7f6f44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.326+0000 7f6f5ad9d700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f44003fd0 0x7f6f44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.326+0000 7f6f5ad9d700 1 -- 172.21.15.61:0/862786794 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44003570 con 0x7f6f44004d50 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.326+0000 7f6f5ad9d700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f44004d50 0x7f6f440051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400a920 tx=0x7f6f540021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b4458933b3e6a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.326+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f540070d0 con 0x7f6f44004d50 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.326+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f54007230 con 0x7f6f44004d50 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.326+0000 7f6f5959a700 1 -- 172.21.15.61:0/862786794 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f540075f0 con 0x7f6f44004d50 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.327+0000 7f6f60ee8700 1 -- 172.21.15.61:0/862786794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f44004d50 msgr2=0x7f6f440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.327+0000 7f6f60ee8700 1 --2- 172.21.15.61:0/862786794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f44004d50 0x7f6f440051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400a920 tx=0x7f6f540021f0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.327+0000 7f6f5ad9d700 1 -- 172.21.15.61:0/862786794 reap_dead start 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.327+0000 7f6f60ee8700 1 -- 172.21.15.61:0/862786794 shutdown_connections 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.327+0000 7f6f60ee8700 1 -- 172.21.15.61:0/862786794 >> 172.21.15.61:0/862786794 conn(0x7f6f5c0cceb0 msgr2=0x7f6f5c0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.327+0000 7f6f60ee8700 1 -- 172.21.15.61:0/862786794 shutdown_connections 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.327+0000 7f6f60ee8700 1 -- 172.21.15.61:0/862786794 wait complete. 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.328+0000 7f6f60ee8700 1 Processor -- start 2023-12-24T19:57:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.328+0000 7f6f60ee8700 1 -- start start 2023-12-24T19:57:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.328+0000 7f6f60ee8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f44004d50 0x7f6f5c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f60ee8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5c0b2220 0x7f6f5c0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f60ee8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f5c1543f0 0x7f6f5c0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f60ee8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c14fbe0 con 0x7f6f5c0b2220 2023-12-24T19:57:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f60ee8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0b2cb0 con 0x7f6f5c1543f0 2023-12-24T19:57:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f60ee8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c150130 con 0x7f6f44004d50 2023-12-24T19:57:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f59d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5c0b2220 0x7f6f5c0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f59d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5c0b2220 0x7f6f5c0afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36068/0 (socket says 172.21.15.61:36068) 2023-12-24T19:57:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f59d9b700 1 -- 172.21.15.61:0/1477389625 learned_addr learned my addr 172.21.15.61:0/1477389625 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f5ad9d700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f5c1543f0 0x7f6f5c0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f5a59c700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f44004d50 0x7f6f5c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f59d9b700 1 -- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f44004d50 msgr2=0x7f6f5c14c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f59d9b700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f44004d50 0x7f6f5c14c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f59d9b700 1 -- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f5c1543f0 msgr2=0x7f6f5c0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f59d9b700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f5c1543f0 0x7f6f5c0b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f59d9b700 1 -- 172.21.15.61:0/1477389625 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c14c820 con 0x7f6f5c0b2220 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f59d9b700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5c0b2220 0x7f6f5c0afcd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f50002b00 tx=0x7f6f50007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f4a7fc700 1 -- 172.21.15.61:0/1477389625 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000f9a0 con 0x7f6f5c0b2220 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f4a7fc700 1 -- 172.21.15.61:0/1477389625 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5000fb40 con 0x7f6f5c0b2220 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f60ee8700 1 -- 172.21.15.61:0/1477389625 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c0b26f0 con 0x7f6f5c0b2220 2023-12-24T19:57:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f4a7fc700 1 -- 172.21.15.61:0/1477389625 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500133f0 con 0x7f6f5c0b2220 2023-12-24T19:57:03.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.329+0000 7f6f60ee8700 1 -- 172.21.15.61:0/1477389625 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c14fdc0 con 0x7f6f5c0b2220 2023-12-24T19:57:03.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.330+0000 7f6f60ee8700 1 -- 172.21.15.61:0/1477389625 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c04c3c0 con 0x7f6f5c0b2220 2023-12-24T19:57:03.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.331+0000 7f6f4a7fc700 1 -- 172.21.15.61:0/1477389625 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6f50013760 con 0x7f6f5c0b2220 2023-12-24T19:57:03.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.331+0000 7f6f4a7fc700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f3c066f30 0x7f6f3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.331+0000 7f6f4a7fc700 1 -- 172.21.15.61:0/1477389625 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6f500842a0 con 0x7f6f5c0b2220 2023-12-24T19:57:03.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.331+0000 7f6f5a59c700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f3c066f30 0x7f6f3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.332+0000 7f6f5a59c700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f3c066f30 0x7f6f3c0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c006f00 tx=0x7f6f4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:03.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.335+0000 7f6f4a7fc700 1 -- 172.21.15.61:0/1477389625 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f50051860 con 0x7f6f5c0b2220 2023-12-24T19:57:03.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.532+0000 7f6f60ee8700 1 -- 172.21.15.61:0/1477389625 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f5c14c9b0 con 0x7f6f5c0b2220 2023-12-24T19:57:03.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.533+0000 7f6f4a7fc700 1 -- 172.21.15.61:0/1477389625 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f6f50054e80 con 0x7f6f5c0b2220 2023-12-24T19:57:03.534 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:03.534 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:56:57.314480+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:03.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 -- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f3c066f30 msgr2=0x7f6f3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f3c066f30 0x7f6f3c0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c006f00 tx=0x7f6f4c008040 comp rx=0 tx=0).stop 2023-12-24T19:57:03.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 -- 172.21.15.61:0/1477389625 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5c0b2220 msgr2=0x7f6f5c0afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5c0b2220 0x7f6f5c0afcd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f50002b00 tx=0x7f6f50007d10 comp rx=0 tx=0).stop 2023-12-24T19:57:03.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 -- 172.21.15.61:0/1477389625 shutdown_connections 2023-12-24T19:57:03.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f44004d50 0x7f6f5c14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f3c066f30 0x7f6f3c0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f5c1543f0 0x7f6f5c0b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 --2- 172.21.15.61:0/1477389625 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5c0b2220 0x7f6f5c0afcd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 -- 172.21.15.61:0/1477389625 >> 172.21.15.61:0/1477389625 conn(0x7f6f5c0cceb0 msgr2=0x7f6f5c14f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:03.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 -- 172.21.15.61:0/1477389625 shutdown_connections 2023-12-24T19:57:03.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.535+0000 7f6f60ee8700 1 -- 172.21.15.61:0/1477389625 wait complete. 2023-12-24T19:57:03.548 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T19:57:03.548 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:57:03.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.672+0000 7fd56ece4700 1 Processor -- start 2023-12-24T19:57:03.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.672+0000 7fd56ece4700 1 -- start start 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ece4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd56815ac00 0x7fd5680c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ece4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5680c7c30 0x7fd5680cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ece4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd56815afd0 0x7fd5680cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ece4700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680c8c30 con 0x7fd56815ac00 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ece4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680c80b0 con 0x7fd56815afd0 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ece4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680c8390 con 0x7fd5680c7c30 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ca80700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd56815ac00 0x7fd5680c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ca80700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd56815ac00 0x7fd5680c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36070/0 (socket says 172.21.15.61:36070) 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ca80700 1 -- 172.21.15.61:0/3146276989 learned_addr learned my addr 172.21.15.61:0/3146276989 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56d281700 1 --2- 172.21.15.61:0/3146276989 >> v2:172.21.15.133:3300/0 conn(0x7fd56815afd0 0x7fd5680cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd567fff700 1 --2- 172.21.15.61:0/3146276989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5680c7c30 0x7fd5680cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ca80700 1 -- 172.21.15.61:0/3146276989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5680c7c30 msgr2=0x7fd5680cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ca80700 1 --2- 172.21.15.61:0/3146276989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5680c7c30 0x7fd5680cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ca80700 1 -- 172.21.15.61:0/3146276989 >> v2:172.21.15.133:3300/0 conn(0x7fd56815afd0 msgr2=0x7fd5680cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ca80700 1 --2- 172.21.15.61:0/3146276989 >> v2:172.21.15.133:3300/0 conn(0x7fd56815afd0 0x7fd5680cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ca80700 1 -- 172.21.15.61:0/3146276989 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680c8670 con 0x7fd56815ac00 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.673+0000 7fd56ca80700 1 --2- 172.21.15.61:0/3146276989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 0x7fd5680c76f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd56806d200 tx=0x7fd55c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54968450f9390fc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd5677fe700 1 -- 172.21.15.61:0/3146276989 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c005c10 con 0x7fd56815ac00 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd5677fe700 1 -- 172.21.15.61:0/3146276989 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55c005d70 con 0x7fd56815ac00 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd5677fe700 1 -- 172.21.15.61:0/3146276989 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c006260 con 0x7fd56815ac00 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd56ece4700 1 -- 172.21.15.61:0/3146276989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 msgr2=0x7fd5680c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd56ece4700 1 --2- 172.21.15.61:0/3146276989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 0x7fd5680c76f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd56806d200 tx=0x7fd55c009220 comp rx=0 tx=0).stop 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd56ece4700 1 -- 172.21.15.61:0/3146276989 shutdown_connections 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd56ece4700 1 --2- 172.21.15.61:0/3146276989 >> v2:172.21.15.133:3300/0 conn(0x7fd56815afd0 0x7fd5680cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd56ece4700 1 --2- 172.21.15.61:0/3146276989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 0x7fd5680c76f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd56ece4700 1 --2- 172.21.15.61:0/3146276989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5680c7c30 0x7fd5680cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd56ece4700 1 -- 172.21.15.61:0/3146276989 >> 172.21.15.61:0/3146276989 conn(0x7fd5680cd0b0 msgr2=0x7fd5680cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:03.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd56ece4700 1 -- 172.21.15.61:0/3146276989 shutdown_connections 2023-12-24T19:57:03.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.674+0000 7fd56ece4700 1 -- 172.21.15.61:0/3146276989 wait complete. 2023-12-24T19:57:03.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.675+0000 7fd56ece4700 1 Processor -- start 2023-12-24T19:57:03.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.676+0000 7fd56ece4700 1 -- start start 2023-12-24T19:57:03.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.676+0000 7fd56ece4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 0x7fd56815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.676+0000 7fd56ece4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd56815afd0 0x7fd5680aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.676+0000 7fd56ece4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b1e00 0x7fd56806d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.676+0000 7fd56ece4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b0a40 con 0x7fd56815ac00 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.676+0000 7fd56ece4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680c4160 con 0x7fd5680b1e00 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.676+0000 7fd56ece4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680b22a0 con 0x7fd56815afd0 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.676+0000 7fd56ca80700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 0x7fd56815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.676+0000 7fd56ca80700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 0x7fd56815eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36078/0 (socket says 172.21.15.61:36078) 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.676+0000 7fd56ca80700 1 -- 172.21.15.61:0/3696566792 learned_addr learned my addr 172.21.15.61:0/3696566792 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd56d281700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b1e00 0x7fd56806d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd567fff700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd56815afd0 0x7fd5680aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd56ca80700 1 -- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd56815afd0 msgr2=0x7fd5680aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd56ca80700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd56815afd0 0x7fd5680aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd56ca80700 1 -- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b1e00 msgr2=0x7fd56806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd56ca80700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b1e00 0x7fd56806d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd56ca80700 1 -- 172.21.15.61:0/3696566792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c009480 con 0x7fd56815ac00 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd56d281700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b1e00 0x7fd56806d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd56ca80700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 0x7fd56815eba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5680c4040 tx=0x7fd55c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd564ff9700 1 -- 172.21.15.61:0/3696566792 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c011ab0 con 0x7fd56815ac00 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd564ff9700 1 -- 172.21.15.61:0/3696566792 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55c011c10 con 0x7fd56815ac00 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd56ece4700 1 -- 172.21.15.61:0/3696566792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5680b2580 con 0x7fd56815ac00 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd564ff9700 1 -- 172.21.15.61:0/3696566792 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c01b430 con 0x7fd56815ac00 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.677+0000 7fd56ece4700 1 -- 172.21.15.61:0/3696566792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5680b2b40 con 0x7fd56815ac00 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.678+0000 7fd56ece4700 1 -- 172.21.15.61:0/3696566792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56804c3c0 con 0x7fd56815ac00 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.678+0000 7fd564ff9700 1 -- 172.21.15.61:0/3696566792 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd55c01b820 con 0x7fd56815ac00 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.679+0000 7fd564ff9700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd54c066f30 0x7fd54c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.679+0000 7fd564ff9700 1 -- 172.21.15.61:0/3696566792 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd55c085ac0 con 0x7fd56815ac00 2023-12-24T19:57:03.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.679+0000 7fd567fff700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd54c066f30 0x7fd54c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:03.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.680+0000 7fd567fff700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd54c066f30 0x7fd54c0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd554006f00 tx=0x7fd554008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:03.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.684+0000 7fd564ff9700 1 -- 172.21.15.61:0/3696566792 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd55c053080 con 0x7fd56815ac00 2023-12-24T19:57:03.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.876+0000 7fd56ece4700 1 -- 172.21.15.61:0/3696566792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5680c42f0 con 0x7fd56815ac00 2023-12-24T19:57:03.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.877+0000 7fd564ff9700 1 -- 172.21.15.61:0/3696566792 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd55c02a0a0 con 0x7fd56815ac00 2023-12-24T19:57:03.877 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 -- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd54c066f30 msgr2=0x7fd54c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd54c066f30 0x7fd54c0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd554006f00 tx=0x7fd554008040 comp rx=0 tx=0).stop 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 -- 172.21.15.61:0/3696566792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 msgr2=0x7fd56815eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 0x7fd56815eba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5680c4040 tx=0x7fd55c016000 comp rx=0 tx=0).stop 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 -- 172.21.15.61:0/3696566792 shutdown_connections 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd54c066f30 0x7fd54c0693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b1e00 0x7fd56806d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd56815ac00 0x7fd56815eba0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 --2- 172.21.15.61:0/3696566792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd56815afd0 0x7fd5680aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 -- 172.21.15.61:0/3696566792 >> 172.21.15.61:0/3696566792 conn(0x7fd5680cd0b0 msgr2=0x7fd5680c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 -- 172.21.15.61:0/3696566792 shutdown_connections 2023-12-24T19:57:03.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:03.879+0000 7fd56ece4700 1 -- 172.21.15.61:0/3696566792 wait complete. 2023-12-24T19:57:03.891 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T19:57:04.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.011+0000 7f959bae5700 1 Processor -- start 2023-12-24T19:57:04.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.012+0000 7f959bae5700 1 -- start start 2023-12-24T19:57:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.012+0000 7f959bae5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9594159e60 0x7f95940c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.012+0000 7f959bae5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9594070d50 0x7f95940c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.012+0000 7f959bae5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959406a090 con 0x7f9594159a90 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.012+0000 7f959bae5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959406ac10 con 0x7f9594159e60 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.012+0000 7f959bae5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940c9e40 con 0x7f9594070d50 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f9599080700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9594159e60 0x7f95940c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f9599080700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9594159e60 0x7f95940c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36080/0 (socket says 172.21.15.61:36080) 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f9599881700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9594159a90 0x7f9594070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:48396/0 (socket says 172.21.15.61:48396) 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f9599080700 1 -- 172.21.15.61:0/1790658634 learned_addr learned my addr 172.21.15.61:0/1790658634 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f959a082700 1 --2- 172.21.15.61:0/1790658634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9594070d50 0x7f95940c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f9599080700 1 -- 172.21.15.61:0/1790658634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9594070d50 msgr2=0x7f95940c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f9599080700 1 --2- 172.21.15.61:0/1790658634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9594070d50 0x7f95940c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f9599080700 1 -- 172.21.15.61:0/1790658634 >> v1:172.21.15.61:6789/0 conn(0x7f9594159a90 legacy=0x7f9594070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f959887f700 1 -- 172.21.15.61:0/1790658634 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049230005 0 0) 0x7f959406a090 con 0x7f9594159a90 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f9599080700 1 -- 172.21.15.61:0/1790658634 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959406a2e0 con 0x7f9594159e60 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f959a082700 1 --2- 172.21.15.61:0/1790658634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9594070d50 0x7f95940c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f9599080700 1 --2- 172.21.15.61:0/1790658634 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594159e60 0x7f95940c93c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f95880099b0 tx=0x7f9588009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a33db6c7c484c2b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f959887f700 1 -- 172.21.15.61:0/1790658634 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958800b860 con 0x7f9594159e60 2023-12-24T19:57:04.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f959887f700 1 -- 172.21.15.61:0/1790658634 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958800b9c0 con 0x7f9594159e60 2023-12-24T19:57:04.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.013+0000 7f959887f700 1 -- 172.21.15.61:0/1790658634 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958800bd60 con 0x7f9594159e60 2023-12-24T19:57:04.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.014+0000 7f959bae5700 1 -- 172.21.15.61:0/1790658634 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594159e60 msgr2=0x7f95940c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.014+0000 7f959bae5700 1 --2- 172.21.15.61:0/1790658634 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594159e60 0x7f95940c93c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f95880099b0 tx=0x7f9588009250 comp rx=0 tx=0).stop 2023-12-24T19:57:04.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.014+0000 7f959bae5700 1 -- 172.21.15.61:0/1790658634 shutdown_connections 2023-12-24T19:57:04.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.014+0000 7f959bae5700 1 --2- 172.21.15.61:0/1790658634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9594070d50 0x7f95940c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.014+0000 7f959bae5700 1 --2- 172.21.15.61:0/1790658634 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594159e60 0x7f95940c93c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.014+0000 7f959bae5700 1 -- 172.21.15.61:0/1790658634 >> 172.21.15.61:0/1790658634 conn(0x7f95940cd6f0 msgr2=0x7f95940cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:04.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.014+0000 7f959bae5700 1 -- 172.21.15.61:0/1790658634 shutdown_connections 2023-12-24T19:57:04.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.014+0000 7f959bae5700 1 -- 172.21.15.61:0/1790658634 wait complete. 2023-12-24T19:57:04.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.015+0000 7f959bae5700 1 Processor -- start 2023-12-24T19:57:04.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.016+0000 7f959bae5700 1 -- start start 2023-12-24T19:57:04.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.016+0000 7f959bae5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594070d50 0x7f95941575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.016+0000 7f959bae5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9594159a90 0x7f959415d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.016+0000 7f959bae5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9594159e60 0x7f959415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.016+0000 7f959bae5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95940c1120 con 0x7f9594070d50 2023-12-24T19:57:04.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.016+0000 7f959bae5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959415d0a0 con 0x7f9594159a90 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.016+0000 7f959bae5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940c5650 con 0x7f9594159e60 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.016+0000 7f9599881700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594070d50 0x7f95941575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9599881700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594070d50 0x7f95941575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36094/0 (socket says 172.21.15.61:36094) 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9599881700 1 -- 172.21.15.61:0/658979989 learned_addr learned my addr 172.21.15.61:0/658979989 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9599881700 1 -- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9594159e60 msgr2=0x7f959415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9599881700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9594159e60 0x7f959415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9599080700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9594159a90 0x7f959415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9599881700 1 -- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9594159a90 msgr2=0x7f959415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9599881700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9594159a90 0x7f959415d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9599881700 1 -- 172.21.15.61:0/658979989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95880094f0 con 0x7f9594070d50 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9599881700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594070d50 0x7f95941575a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95900011e0 tx=0x7f9590007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9585ffb700 1 -- 172.21.15.61:0/658979989 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590007300 con 0x7f9594070d50 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9585ffb700 1 -- 172.21.15.61:0/658979989 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590007460 con 0x7f9594070d50 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f959bae5700 1 -- 172.21.15.61:0/658979989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95940c5930 con 0x7f9594070d50 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f9585ffb700 1 -- 172.21.15.61:0/658979989 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590004830 con 0x7f9594070d50 2023-12-24T19:57:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.017+0000 7f959bae5700 1 -- 172.21.15.61:0/658979989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95940c5ef0 con 0x7f9594070d50 2023-12-24T19:57:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.018+0000 7f959bae5700 1 -- 172.21.15.61:0/658979989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959404c3c0 con 0x7f9594070d50 2023-12-24T19:57:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.019+0000 7f9585ffb700 1 -- 172.21.15.61:0/658979989 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9590004be0 con 0x7f9594070d50 2023-12-24T19:57:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.019+0000 7f9585ffb700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9578066f30 0x7f95780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.019+0000 7f9585ffb700 1 -- 172.21.15.61:0/658979989 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9590083720 con 0x7f9594070d50 2023-12-24T19:57:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.019+0000 7f9599080700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9578066f30 0x7f95780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:04.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.020+0000 7f9599080700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9578066f30 0x7f95780693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f95940c46b0 tx=0x7f9588017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:04.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.023+0000 7f9585ffb700 1 -- 172.21.15.61:0/658979989 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9590050d60 con 0x7f9594070d50 2023-12-24T19:57:04.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.218+0000 7f959bae5700 1 -- 172.21.15.61:0/658979989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f95940c60e0 con 0x7f9594070d50 2023-12-24T19:57:04.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.218+0000 7f9585ffb700 1 -- 172.21.15.61:0/658979989 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9590018090 con 0x7f9594070d50 2023-12-24T19:57:04.219 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:04.219 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T19:57:04.219 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:04.219 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T19:57:04.219 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T19:57:04.219 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:04.219 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T19:57:04.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.220+0000 7f959bae5700 1 -- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9578066f30 msgr2=0x7f95780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.220+0000 7f959bae5700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9578066f30 0x7f95780693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f95940c46b0 tx=0x7f9588017000 comp rx=0 tx=0).stop 2023-12-24T19:57:04.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.220+0000 7f959bae5700 1 -- 172.21.15.61:0/658979989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594070d50 msgr2=0x7f95941575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.220+0000 7f959bae5700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594070d50 0x7f95941575a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95900011e0 tx=0x7f9590007e10 comp rx=0 tx=0).stop 2023-12-24T19:57:04.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.221+0000 7f959bae5700 1 -- 172.21.15.61:0/658979989 shutdown_connections 2023-12-24T19:57:04.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.221+0000 7f959bae5700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9594159e60 0x7f959415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.221+0000 7f959bae5700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9578066f30 0x7f95780693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.221+0000 7f959bae5700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9594070d50 0x7f95941575a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.221+0000 7f959bae5700 1 --2- 172.21.15.61:0/658979989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9594159a90 0x7f959415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.221+0000 7f959bae5700 1 -- 172.21.15.61:0/658979989 >> 172.21.15.61:0/658979989 conn(0x7f95940cd6f0 msgr2=0x7f95940b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:04.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.221+0000 7f959bae5700 1 -- 172.21.15.61:0/658979989 shutdown_connections 2023-12-24T19:57:04.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.221+0000 7f959bae5700 1 -- 172.21.15.61:0/658979989 wait complete. 2023-12-24T19:57:04.233 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T19:57:04.233 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T19:57:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.359+0000 7fb3e6f2c700 1 Processor -- start 2023-12-24T19:57:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.359+0000 7fb3e6f2c700 1 -- start start 2023-12-24T19:57:04.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.359+0000 7fb3e6f2c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3e01567b0 0x7fb3e0069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3e6f2c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e00c81a0 con 0x7fb3e006a9b0 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3e6f2c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e0069fe0 con 0x7fb3e00cc350 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3e6f2c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e006a4f0 con 0x7fb3e01567b0 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3dffff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb3e006a9b0 0x7fb3e00cbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:48404/0 (socket says 172.21.15.61:48404) 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3dffff700 1 -- 172.21.15.61:0/2528727477 learned_addr learned my addr 172.21.15.61:0/2528727477 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3e4cc8700 1 --2- 172.21.15.61:0/2528727477 >> v2:172.21.15.133:3300/0 conn(0x7fb3e01567b0 0x7fb3e0069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3df7fe700 1 -- 172.21.15.61:0/2528727477 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965105573 0 0) 0x7fb3e00c81a0 con 0x7fb3e006a9b0 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3df7fe700 1 -- 172.21.15.61:0/2528727477 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d0003570 con 0x7fb3e006a9b0 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3df7fe700 1 -- 172.21.15.61:0/2528727477 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348275206 0 0) 0x7fb3e0069fe0 con 0x7fb3e00cc350 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3df7fe700 1 -- 172.21.15.61:0/2528727477 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3e00c81a0 con 0x7fb3e00cc350 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3e4cc8700 1 -- 172.21.15.61:0/2528727477 >> v1:172.21.15.133:6789/0 conn(0x7fb3e00cc350 legacy=0x7fb3e00c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3df7fe700 1 -- 172.21.15.61:0/2528727477 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3386040520 0 0) 0x7fb3d0003570 con 0x7fb3e006a9b0 2023-12-24T19:57:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3e4cc8700 1 -- 172.21.15.61:0/2528727477 >> v1:172.21.15.61:6789/0 conn(0x7fb3e006a9b0 legacy=0x7fb3e00cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3e4cc8700 1 -- 172.21.15.61:0/2528727477 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e00c8a20 con 0x7fb3e01567b0 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.360+0000 7fb3e4cc8700 1 --2- 172.21.15.61:0/2528727477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e01567b0 0x7fb3e0069aa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40098e0 tx=0x7fb3d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cad22d28ade027bd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.361+0000 7fb3df7fe700 1 -- 172.21.15.61:0/2528727477 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc001470 con 0x7fb3e01567b0 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.361+0000 7fb3df7fe700 1 -- 172.21.15.61:0/2528727477 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d4011420 con 0x7fb3e01567b0 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.361+0000 7fb3df7fe700 1 -- 172.21.15.61:0/2528727477 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40117c0 con 0x7fb3e01567b0 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.361+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/2528727477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e01567b0 msgr2=0x7fb3e0069aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.361+0000 7fb3e6f2c700 1 --2- 172.21.15.61:0/2528727477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e01567b0 0x7fb3e0069aa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40098e0 tx=0x7fb3d40091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.361+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/2528727477 shutdown_connections 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.361+0000 7fb3e6f2c700 1 --2- 172.21.15.61:0/2528727477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e01567b0 0x7fb3e0069aa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.361+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/2528727477 >> 172.21.15.61:0/2528727477 conn(0x7fb3e00ce1a0 msgr2=0x7fb3e00ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.361+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/2528727477 shutdown_connections 2023-12-24T19:57:04.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.361+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/2528727477 wait complete. 2023-12-24T19:57:04.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.362+0000 7fb3e6f2c700 1 Processor -- start 2023-12-24T19:57:04.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.362+0000 7fb3e6f2c700 1 -- start start 2023-12-24T19:57:04.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.363+0000 7fb3e6f2c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e006a9b0 0x7fb3e01549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.363+0000 7fb3e6f2c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3e00cc350 0x7fb3e0144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.363+0000 7fb3e6f2c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3e01567b0 0x7fb3e015d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.363+0000 7fb3e6f2c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e0154ef0 con 0x7fb3e00cc350 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.363+0000 7fb3e6f2c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e015cfe0 con 0x7fb3e006a9b0 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.363+0000 7fb3e6f2c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e015cd00 con 0x7fb3e01567b0 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.363+0000 7fb3dffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3e00cc350 0x7fb3e0144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.363+0000 7fb3dffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3e00cc350 0x7fb3e0144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36110/0 (socket says 172.21.15.61:36110) 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.363+0000 7fb3dffff700 1 -- 172.21.15.61:0/1054914773 learned_addr learned my addr 172.21.15.61:0/1054914773 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3dffff700 1 -- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3e01567b0 msgr2=0x7fb3e015d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3e4cc8700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e006a9b0 0x7fb3e01549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3e54c9700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3e01567b0 0x7fb3e015d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3dffff700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3e01567b0 0x7fb3e015d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3dffff700 1 -- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e006a9b0 msgr2=0x7fb3e01549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3dffff700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e006a9b0 0x7fb3e01549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3dffff700 1 -- 172.21.15.61:0/1054914773 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009420 con 0x7fb3e00cc350 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3e4cc8700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e006a9b0 0x7fb3e01549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:04.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3dffff700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3e00cc350 0x7fb3e0144fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00cb90 tx=0x7fb3cc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:04.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3dcff9700 1 -- 172.21.15.61:0/1054914773 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc001d00 con 0x7fb3e00cc350 2023-12-24T19:57:04.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/1054914773 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e00c6260 con 0x7fb3e00cc350 2023-12-24T19:57:04.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3dcff9700 1 -- 172.21.15.61:0/1054914773 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc007360 con 0x7fb3e00cc350 2023-12-24T19:57:04.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3dcff9700 1 -- 172.21.15.61:0/1054914773 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc004830 con 0x7fb3e00cc350 2023-12-24T19:57:04.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.364+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/1054914773 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e00c6820 con 0x7fb3e00cc350 2023-12-24T19:57:04.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.365+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/1054914773 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e004c3c0 con 0x7fb3e00cc350 2023-12-24T19:57:04.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.365+0000 7fb3dcff9700 1 -- 172.21.15.61:0/1054914773 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb3cc004be0 con 0x7fb3e00cc350 2023-12-24T19:57:04.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.366+0000 7fb3dcff9700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb3c4066f30 0x7fb3c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:04.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.366+0000 7fb3dcff9700 1 -- 172.21.15.61:0/1054914773 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb3cc083b10 con 0x7fb3e00cc350 2023-12-24T19:57:04.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.366+0000 7fb3e4cc8700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb3c4066f30 0x7fb3c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:04.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.366+0000 7fb3e4cc8700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb3c4066f30 0x7fb3c40693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb3e016d0b0 tx=0x7fb3d4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:04.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.370+0000 7fb3dcff9700 1 -- 172.21.15.61:0/1054914773 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3cc0510d0 con 0x7fb3e00cc350 2023-12-24T19:57:04.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:04.564+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/1054914773 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb3e00afc80 con 0x7fb3e00cc350 2023-12-24T19:57:05.282 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:57:05.285 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:57:05.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.505+0000 7fb3dcff9700 1 -- 172.21.15.61:0/1054914773 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb3cc018020 con 0x7fb3e00cc350 2023-12-24T19:57:05.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb3c4066f30 msgr2=0x7fb3c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:05.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb3c4066f30 0x7fb3c40693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb3e016d0b0 tx=0x7fb3d4016000 comp rx=0 tx=0).stop 2023-12-24T19:57:05.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/1054914773 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3e00cc350 msgr2=0x7fb3e0144fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:05.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3e00cc350 0x7fb3e0144fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00cb90 tx=0x7fb3cc001ab0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/1054914773 shutdown_connections 2023-12-24T19:57:05.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3e01567b0 0x7fb3e015d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb3c4066f30 0x7fb3c40693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e006a9b0 0x7fb3e01549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 --2- 172.21.15.61:0/1054914773 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3e00cc350 0x7fb3e0144fd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/1054914773 >> 172.21.15.61:0/1054914773 conn(0x7fb3e00ce1a0 msgr2=0x7fb3e00c25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:05.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.510+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/1054914773 shutdown_connections 2023-12-24T19:57:05.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.511+0000 7fb3e6f2c700 1 -- 172.21.15.61:0/1054914773 wait complete. 2023-12-24T19:57:05.512 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T19:57:05.526 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T19:57:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.660+0000 7f521e097700 1 Processor -- start 2023-12-24T19:57:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.660+0000 7f521e097700 1 -- start start 2023-12-24T19:57:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.661+0000 7f521e097700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f521815afd0 0x7f52180cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.661+0000 7f521e097700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52180cb3d0 0x7f52180aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.661+0000 7f521e097700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52180cb7e0 con 0x7f521815ac00 2023-12-24T19:57:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.661+0000 7f521e097700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52180c8c30 con 0x7f52180cb3d0 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.661+0000 7f521e097700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52180c7e00 con 0x7f521815afd0 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.661+0000 7f52177fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f521815ac00 0x7f52180c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:48406/0 (socket says 172.21.15.61:48406) 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.661+0000 7f52177fe700 1 -- 172.21.15.61:0/3428399195 learned_addr learned my addr 172.21.15.61:0/3428399195 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f5217fff700 1 --2- 172.21.15.61:0/3428399195 >> v2:172.21.15.133:3300/0 conn(0x7f52180cb3d0 0x7f52180aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f5216ffd700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f521815afd0 0x7f52180cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086299382 0 0) 0x7f52180cb7e0 con 0x7f521815ac00 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5200003570 con 0x7f521815ac00 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871705373 0 0) 0x7f5200003570 con 0x7f521815ac00 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f521815afd0 msgr2=0x7f52180cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f521815afd0 0x7f52180cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 >> v2:172.21.15.133:3300/0 conn(0x7f52180cb3d0 msgr2=0x7f52180aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 --2- 172.21.15.61:0/3428399195 >> v2:172.21.15.133:3300/0 conn(0x7f52180cb3d0 0x7f52180aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52180c80b0 con 0x7f521815ac00 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f52080015f0 con 0x7f521815ac00 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f5216ffd700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f521815afd0 0x7f52180cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 >> v1:172.21.15.61:6789/0 conn(0x7f521815ac00 legacy=0x7f52180c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f521815afd0 0x7f5200003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003fa0 0x7f5200004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5200004d50 0x7f52000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52180c8c30 con 0x7f5200003fa0 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52180c7e00 con 0x7f5200004d50 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520000bb10 con 0x7f521815afd0 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f5216ffd700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003fa0 0x7f5200004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f52177fe700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f521815afd0 0x7f5200003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f5217fff700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5200004d50 0x7f52000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f5216ffd700 1 -- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f521815afd0 msgr2=0x7f5200003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f5216ffd700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f521815afd0 0x7f5200003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f5216ffd700 1 -- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5200004d50 msgr2=0x7f52000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f5216ffd700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5200004d50 0x7f52000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.662+0000 7f5216ffd700 1 -- 172.21.15.61:0/3428399195 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200003570 con 0x7f5200003fa0 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f5216ffd700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003fa0 0x7f5200004810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f520c006fd0 tx=0x7f520c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b299c696d115710a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c00c070 con 0x7f5200003fa0 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c00e5e0 con 0x7f5200003fa0 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f52167fc700 1 -- 172.21.15.61:0/3428399195 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c009510 con 0x7f5200003fa0 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f521e097700 1 -- 172.21.15.61:0/3428399195 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003fa0 msgr2=0x7f5200004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f521e097700 1 --2- 172.21.15.61:0/3428399195 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003fa0 0x7f5200004810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f520c006fd0 tx=0x7f520c008040 comp rx=0 tx=0).stop 2023-12-24T19:57:05.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f5217fff700 1 -- 172.21.15.61:0/3428399195 reap_dead start 2023-12-24T19:57:05.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f521e097700 1 -- 172.21.15.61:0/3428399195 shutdown_connections 2023-12-24T19:57:05.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f521e097700 1 -- 172.21.15.61:0/3428399195 >> 172.21.15.61:0/3428399195 conn(0x7f52180cd0b0 msgr2=0x7f52180cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:05.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f521e097700 1 -- 172.21.15.61:0/3428399195 shutdown_connections 2023-12-24T19:57:05.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.663+0000 7f521e097700 1 -- 172.21.15.61:0/3428399195 wait complete. 2023-12-24T19:57:05.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f521e097700 1 Processor -- start 2023-12-24T19:57:05.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f521e097700 1 -- start start 2023-12-24T19:57:05.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f521e097700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5200003fa0 0x7f521813f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:05.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f521e097700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f521816df80 0x7f521816e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:05.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f521e097700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52180ad380 0x7f52180ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:05.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f521e097700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5218168450 con 0x7f52180ad380 2023-12-24T19:57:05.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f521e097700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521816e930 con 0x7f521816df80 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f521e097700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52180ae300 con 0x7f5200003fa0 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f5217fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52180ad380 0x7f52180ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f5217fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52180ad380 0x7f52180ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36132/0 (socket says 172.21.15.61:36132) 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.665+0000 7f5217fff700 1 -- 172.21.15.61:0/1301620610 learned_addr learned my addr 172.21.15.61:0/1301620610 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f5216ffd700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f521816df80 0x7f521816e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f52177fe700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5200003fa0 0x7f521813f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f5217fff700 1 -- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5200003fa0 msgr2=0x7f521813f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f5217fff700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5200003fa0 0x7f521813f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f5217fff700 1 -- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f521816df80 msgr2=0x7f521816e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f5217fff700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f521816df80 0x7f521816e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f5217fff700 1 -- 172.21.15.61:0/1301620610 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521816c2d0 con 0x7f52180ad380 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f5217fff700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52180ad380 0x7f52180ad800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52180ac910 tx=0x7f521000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:05.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f51ff7fe700 1 -- 172.21.15.61:0/1301620610 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000e040 con 0x7f52180ad380 2023-12-24T19:57:05.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f51ff7fe700 1 -- 172.21.15.61:0/1301620610 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521000f040 con 0x7f52180ad380 2023-12-24T19:57:05.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f521e097700 1 -- 172.21.15.61:0/1301620610 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52180ae020 con 0x7f52180ad380 2023-12-24T19:57:05.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f51ff7fe700 1 -- 172.21.15.61:0/1301620610 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000fd10 con 0x7f52180ad380 2023-12-24T19:57:05.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.666+0000 7f521e097700 1 -- 172.21.15.61:0/1301620610 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521816bf60 con 0x7f52180ad380 2023-12-24T19:57:05.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.667+0000 7f521e097700 1 -- 172.21.15.61:0/1301620610 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521816c460 con 0x7f52180ad380 2023-12-24T19:57:05.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.668+0000 7f51ff7fe700 1 -- 172.21.15.61:0/1301620610 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5210015640 con 0x7f52180ad380 2023-12-24T19:57:05.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.668+0000 7f51ff7fe700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066f30 0x7f52040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:05.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.668+0000 7f51ff7fe700 1 -- 172.21.15.61:0/1301620610 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f5210084ba0 con 0x7f52180ad380 2023-12-24T19:57:05.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.668+0000 7f52177fe700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066f30 0x7f52040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:05.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.669+0000 7f52177fe700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066f30 0x7f52040693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5208000ef0 tx=0x7f5208009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:05.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.673+0000 7f51ff7fe700 1 -- 172.21.15.61:0/1301620610 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5210051ff0 con 0x7f52180ad380 2023-12-24T19:57:05.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:05.867+0000 7f521e097700 1 -- 172.21.15.61:0/1301620610 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f521804c3c0 con 0x7f52180ad380 2023-12-24T19:57:06.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.513+0000 7f51ff7fe700 1 -- 172.21.15.61:0/1301620610 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5210055610 con 0x7f52180ad380 2023-12-24T19:57:06.523 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.522+0000 7f521e097700 1 -- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066f30 msgr2=0x7f52040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:06.523 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.522+0000 7f521e097700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066f30 0x7f52040693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5208000ef0 tx=0x7f5208009040 comp rx=0 tx=0).stop 2023-12-24T19:57:06.523 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.522+0000 7f521e097700 1 -- 172.21.15.61:0/1301620610 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52180ad380 msgr2=0x7f52180ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:06.523 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.522+0000 7f521e097700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52180ad380 0x7f52180ad800 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52180ac910 tx=0x7f521000b040 comp rx=0 tx=0).stop 2023-12-24T19:57:06.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.524+0000 7f521e097700 1 -- 172.21.15.61:0/1301620610 shutdown_connections 2023-12-24T19:57:06.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.524+0000 7f521e097700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5200003fa0 0x7f521813f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:06.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.524+0000 7f521e097700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066f30 0x7f52040693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:06.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.524+0000 7f521e097700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52180ad380 0x7f52180ad800 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:06.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.524+0000 7f521e097700 1 --2- 172.21.15.61:0/1301620610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f521816df80 0x7f521816e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:06.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.524+0000 7f521e097700 1 -- 172.21.15.61:0/1301620610 >> 172.21.15.61:0/1301620610 conn(0x7f52180cd0b0 msgr2=0x7f5218063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:06.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.524+0000 7f521e097700 1 -- 172.21.15.61:0/1301620610 shutdown_connections 2023-12-24T19:57:06.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.525+0000 7f521e097700 1 -- 172.21.15.61:0/1301620610 wait complete. 2023-12-24T19:57:06.527 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T19:57:06.540 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T19:57:06.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.669+0000 7efd99406700 1 Processor -- start 2023-12-24T19:57:06.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.669+0000 7efd99406700 1 -- start start 2023-12-24T19:57:06.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd99406700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd94159bb0 0x7efd9415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:06.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd99406700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd9406ac10 0x7efd9406b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd99406700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9415aa10 con 0x7efd9406ed20 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd99406700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd9415b3e0 con 0x7efd9406ac10 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd99406700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9406b5a0 con 0x7efd94159bb0 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd92ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd94159bb0 0x7efd9415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd927fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd9406ac10 0x7efd9406b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd92ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd94159bb0 0x7efd9415aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:52106/0 (socket says 172.21.15.61:52106) 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd927fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd9406ac10 0x7efd9406b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:39896/0 (socket says 172.21.15.61:39896) 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd92ffd700 1 -- 172.21.15.61:0/1114343362 learned_addr learned my addr 172.21.15.61:0/1114343362 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.670+0000 7efd937fe700 1 --1- 172.21.15.61:0/1114343362 >> v1:172.21.15.133:6789/0 conn(0x7efd9406ed20 0x7efd9406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:38756/0 (socket says 172.21.15.61:38756) 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.671+0000 7efd92ffd700 1 -- 172.21.15.61:0/1114343362 >> v2:172.21.15.133:3300/0 conn(0x7efd9406ac10 msgr2=0x7efd9406b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.671+0000 7efd92ffd700 1 --2- 172.21.15.61:0/1114343362 >> v2:172.21.15.133:3300/0 conn(0x7efd9406ac10 0x7efd9406b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.671+0000 7efd92ffd700 1 -- 172.21.15.61:0/1114343362 >> v1:172.21.15.133:6789/0 conn(0x7efd9406ed20 legacy=0x7efd9406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:06.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.671+0000 7efd92ffd700 1 -- 172.21.15.61:0/1114343362 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9406fa30 con 0x7efd94159bb0 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.671+0000 7efd927fc700 1 --2- 172.21.15.61:0/1114343362 >> v2:172.21.15.133:3300/0 conn(0x7efd9406ac10 0x7efd9406b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.671+0000 7efd92ffd700 1 --2- 172.21.15.61:0/1114343362 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd94159bb0 0x7efd9415aea0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd880099b0 tx=0x7efd88009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=650050a5db5db02f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.671+0000 7efd91ffb700 1 -- 172.21.15.61:0/1114343362 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88009ea0 con 0x7efd94159bb0 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.671+0000 7efd91ffb700 1 -- 172.21.15.61:0/1114343362 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd8800b860 con 0x7efd94159bb0 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.671+0000 7efd91ffb700 1 -- 172.21.15.61:0/1114343362 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8800bc00 con 0x7efd94159bb0 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.672+0000 7efd99406700 1 -- 172.21.15.61:0/1114343362 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd94159bb0 msgr2=0x7efd9415aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.672+0000 7efd99406700 1 --2- 172.21.15.61:0/1114343362 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd94159bb0 0x7efd9415aea0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd880099b0 tx=0x7efd88009250 comp rx=0 tx=0).stop 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.672+0000 7efd99406700 1 -- 172.21.15.61:0/1114343362 shutdown_connections 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.672+0000 7efd99406700 1 --2- 172.21.15.61:0/1114343362 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd94159bb0 0x7efd9415aea0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.672+0000 7efd99406700 1 --2- 172.21.15.61:0/1114343362 >> v2:172.21.15.133:3300/0 conn(0x7efd9406ac10 0x7efd9406b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.672+0000 7efd99406700 1 -- 172.21.15.61:0/1114343362 >> 172.21.15.61:0/1114343362 conn(0x7efd940ce800 msgr2=0x7efd940cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.672+0000 7efd99406700 1 -- 172.21.15.61:0/1114343362 shutdown_connections 2023-12-24T19:57:06.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.672+0000 7efd99406700 1 -- 172.21.15.61:0/1114343362 wait complete. 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.673+0000 7efd99406700 1 Processor -- start 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.674+0000 7efd99406700 1 -- start start 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.674+0000 7efd99406700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd9406ac10 0x7efd941580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd99406700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd9406ed20 0x7efd940c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd99406700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd94159bb0 0x7efd940c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd99406700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd940c2c40 con 0x7efd9406ac10 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd99406700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd940c6a90 con 0x7efd94159bb0 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd99406700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd940c2f00 con 0x7efd9406ed20 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd92ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd9406ac10 0x7efd941580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd92ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd9406ac10 0x7efd941580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53502/0 (socket says 172.21.15.61:53502) 2023-12-24T19:57:06.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd92ffd700 1 -- 172.21.15.61:0/2699467184 learned_addr learned my addr 172.21.15.61:0/2699467184 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd927fc700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd9406ed20 0x7efd940c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd937fe700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd94159bb0 0x7efd940c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd92ffd700 1 -- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd9406ed20 msgr2=0x7efd940c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd92ffd700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd9406ed20 0x7efd940c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd92ffd700 1 -- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd94159bb0 msgr2=0x7efd940c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd92ffd700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd94159bb0 0x7efd940c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd92ffd700 1 -- 172.21.15.61:0/2699467184 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84009420 con 0x7efd9406ac10 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd92ffd700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd9406ac10 0x7efd941580d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd88006fd0 tx=0x7efd88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd7affd700 1 -- 172.21.15.61:0/2699467184 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8800bbe0 con 0x7efd9406ac10 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd7affd700 1 -- 172.21.15.61:0/2699467184 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd88000c90 con 0x7efd9406ac10 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd7affd700 1 -- 172.21.15.61:0/2699467184 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd88011650 con 0x7efd9406ac10 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.675+0000 7efd99406700 1 -- 172.21.15.61:0/2699467184 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd880094f0 con 0x7efd9406ac10 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.676+0000 7efd99406700 1 -- 172.21.15.61:0/2699467184 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd940c61f0 con 0x7efd9406ac10 2023-12-24T19:57:06.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.676+0000 7efd99406700 1 -- 172.21.15.61:0/2699467184 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9404c3c0 con 0x7efd9406ac10 2023-12-24T19:57:06.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.677+0000 7efd7affd700 1 -- 172.21.15.61:0/2699467184 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7efd88011a00 con 0x7efd9406ac10 2023-12-24T19:57:06.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.677+0000 7efd7affd700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd80066f30 0x7efd800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:06.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.677+0000 7efd7affd700 1 -- 172.21.15.61:0/2699467184 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7efd88085bb0 con 0x7efd9406ac10 2023-12-24T19:57:06.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.677+0000 7efd927fc700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd80066f30 0x7efd800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:06.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.678+0000 7efd927fc700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd80066f30 0x7efd800693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd94070a20 tx=0x7efd840091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:06.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.682+0000 7efd7affd700 1 -- 172.21.15.61:0/2699467184 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd88052e80 con 0x7efd9406ac10 2023-12-24T19:57:06.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:06.922+0000 7efd99406700 1 -- 172.21.15.61:0/2699467184 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efd9406f500 con 0x7efd9406ac10 2023-12-24T19:57:07.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.513+0000 7efd7affd700 1 -- 172.21.15.61:0/2699467184 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7efd88015020 con 0x7efd9406ac10 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 -- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd80066f30 msgr2=0x7efd800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd80066f30 0x7efd800693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efd94070a20 tx=0x7efd840091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 -- 172.21.15.61:0/2699467184 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd9406ac10 msgr2=0x7efd941580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd9406ac10 0x7efd941580d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd88006fd0 tx=0x7efd88017000 comp rx=0 tx=0).stop 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 -- 172.21.15.61:0/2699467184 shutdown_connections 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd80066f30 0x7efd800693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd94159bb0 0x7efd940c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd9406ac10 0x7efd941580d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 --2- 172.21.15.61:0/2699467184 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd9406ed20 0x7efd940c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 -- 172.21.15.61:0/2699467184 >> 172.21.15.61:0/2699467184 conn(0x7efd940ce800 msgr2=0x7efd940689e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 -- 172.21.15.61:0/2699467184 shutdown_connections 2023-12-24T19:57:07.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.519+0000 7efd99406700 1 -- 172.21.15.61:0/2699467184 wait complete. 2023-12-24T19:57:07.532 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 2 and data pool 3 2023-12-24T19:57:07.544 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:07.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.667+0000 7f0c3258f700 1 Processor -- start 2023-12-24T19:57:07.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.667+0000 7f0c3258f700 1 -- start start 2023-12-24T19:57:07.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c3258f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c2c06b260 0x7f0c2c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:07.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c3258f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0c2c06b630 0x7f0c2c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c3258f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2c067a90 0x7f0c2c070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c3258f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2c067ed0 con 0x7f0c2c06b630 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c3258f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2c15bcd0 con 0x7f0c2c06b260 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c3258f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c0cafb0 con 0x7f0c2c067a90 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c2b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0c2c06b630 0x7f0c2c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c2b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0c2c06b630 0x7f0c2c067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53504/0 (socket says 172.21.15.61:53504) 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c2b7fe700 1 -- 172.21.15.61:0/2487609766 learned_addr learned my addr 172.21.15.61:0/2487609766 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c2bfff700 1 --2- 172.21.15.61:0/2487609766 >> v2:172.21.15.133:3300/0 conn(0x7f0c2c06b260 0x7f0c2c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.668+0000 7f0c30b2c700 1 --2- 172.21.15.61:0/2487609766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2c067a90 0x7f0c2c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c2b7fe700 1 -- 172.21.15.61:0/2487609766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2c067a90 msgr2=0x7f0c2c070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c2b7fe700 1 --2- 172.21.15.61:0/2487609766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2c067a90 0x7f0c2c070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c2b7fe700 1 -- 172.21.15.61:0/2487609766 >> v2:172.21.15.133:3300/0 conn(0x7f0c2c06b260 msgr2=0x7f0c2c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c2b7fe700 1 --2- 172.21.15.61:0/2487609766 >> v2:172.21.15.133:3300/0 conn(0x7f0c2c06b260 0x7f0c2c15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c2b7fe700 1 -- 172.21.15.61:0/2487609766 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c0683a0 con 0x7f0c2c06b630 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c2b7fe700 1 --2- 172.21.15.61:0/2487609766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c06b630 0x7f0c2c067550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c06d0e0 tx=0x7f0c20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b1bed26e0892f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c2affd700 1 -- 172.21.15.61:0/2487609766 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2000b640 con 0x7f0c2c06b630 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c2affd700 1 -- 172.21.15.61:0/2487609766 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2000b7a0 con 0x7f0c2c06b630 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c2affd700 1 -- 172.21.15.61:0/2487609766 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2000bb60 con 0x7f0c2c06b630 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c3258f700 1 -- 172.21.15.61:0/2487609766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c06b630 msgr2=0x7f0c2c067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.669+0000 7f0c3258f700 1 --2- 172.21.15.61:0/2487609766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c06b630 0x7f0c2c067550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c06d0e0 tx=0x7f0c20009250 comp rx=0 tx=0).stop 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.670+0000 7f0c3258f700 1 -- 172.21.15.61:0/2487609766 shutdown_connections 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.670+0000 7f0c3258f700 1 --2- 172.21.15.61:0/2487609766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2c067a90 0x7f0c2c070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.670+0000 7f0c3258f700 1 --2- 172.21.15.61:0/2487609766 >> v2:172.21.15.133:3300/0 conn(0x7f0c2c06b260 0x7f0c2c15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.670+0000 7f0c3258f700 1 --2- 172.21.15.61:0/2487609766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c06b630 0x7f0c2c067550 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.670+0000 7f0c3258f700 1 -- 172.21.15.61:0/2487609766 >> 172.21.15.61:0/2487609766 conn(0x7f0c2c0ca200 msgr2=0x7f0c2c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.670+0000 7f0c3258f700 1 -- 172.21.15.61:0/2487609766 shutdown_connections 2023-12-24T19:57:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.670+0000 7f0c3258f700 1 -- 172.21.15.61:0/2487609766 wait complete. 2023-12-24T19:57:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.671+0000 7f0c3258f700 1 Processor -- start 2023-12-24T19:57:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.671+0000 7f0c3258f700 1 -- start start 2023-12-24T19:57:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c3258f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c067a90 0x7f0c2c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c3258f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c2c06b260 0x7f0c2c0a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c3258f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2c06b630 0x7f0c2c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c3258f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c0a7fc0 con 0x7f0c2c067a90 2023-12-24T19:57:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c3258f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c0a8450 con 0x7f0c2c06b260 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c3258f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c0a73b0 con 0x7f0c2c06b630 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c2bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c067a90 0x7f0c2c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c2bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c067a90 0x7f0c2c0c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53512/0 (socket says 172.21.15.61:53512) 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c2bfff700 1 -- 172.21.15.61:0/133105470 learned_addr learned my addr 172.21.15.61:0/133105470 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c2b7fe700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c2c06b260 0x7f0c2c0a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c30b2c700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2c06b630 0x7f0c2c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c2bfff700 1 -- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2c06b630 msgr2=0x7f0c2c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c2bfff700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2c06b630 0x7f0c2c158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c2bfff700 1 -- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c2c06b260 msgr2=0x7f0c2c0a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c2bfff700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c2c06b260 0x7f0c2c0a6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c2bfff700 1 -- 172.21.15.61:0/133105470 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c200094f0 con 0x7f0c2c067a90 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c2bfff700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c067a90 0x7f0c2c0c8c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00ec80 tx=0x7f0c1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c13fff700 1 -- 172.21.15.61:0/133105470 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00c850 con 0x7f0c2c067a90 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c13fff700 1 -- 172.21.15.61:0/133105470 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c00c9b0 con 0x7f0c2c067a90 2023-12-24T19:57:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c3258f700 1 -- 172.21.15.61:0/133105470 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2c0a7690 con 0x7f0c2c067a90 2023-12-24T19:57:07.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.672+0000 7f0c13fff700 1 -- 172.21.15.61:0/133105470 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00cd50 con 0x7f0c2c067a90 2023-12-24T19:57:07.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.673+0000 7f0c3258f700 1 -- 172.21.15.61:0/133105470 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2c0a7c50 con 0x7f0c2c067a90 2023-12-24T19:57:07.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.673+0000 7f0c3258f700 1 -- 172.21.15.61:0/133105470 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2c04c3c0 con 0x7f0c2c067a90 2023-12-24T19:57:07.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.674+0000 7f0c13fff700 1 -- 172.21.15.61:0/133105470 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0c1c013680 con 0x7f0c2c067a90 2023-12-24T19:57:07.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.674+0000 7f0c13fff700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c18066f30 0x7f0c180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:07.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.674+0000 7f0c13fff700 1 -- 172.21.15.61:0/133105470 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c1c084760 con 0x7f0c2c067a90 2023-12-24T19:57:07.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.674+0000 7f0c2b7fe700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c18066f30 0x7f0c180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:07.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.675+0000 7f0c2b7fe700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c18066f30 0x7f0c180693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c06d0e0 tx=0x7f0c20017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.679+0000 7f0c13fff700 1 -- 172.21.15.61:0/133105470 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c1c0519d0 con 0x7f0c2c067a90 2023-12-24T19:57:07.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.877+0000 7f0c3258f700 1 -- 172.21.15.61:0/133105470 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c2c06f110 con 0x7f0c2c067a90 2023-12-24T19:57:07.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.877+0000 7f0c13fff700 1 -- 172.21.15.61:0/133105470 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f0c1c054ff0 con 0x7f0c2c067a90 2023-12-24T19:57:07.878 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:07.878 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":19,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:06.923814+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:07.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.879+0000 7f0c3258f700 1 -- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c18066f30 msgr2=0x7f0c180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:07.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.879+0000 7f0c3258f700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c18066f30 0x7f0c180693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c06d0e0 tx=0x7f0c20017000 comp rx=0 tx=0).stop 2023-12-24T19:57:07.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.879+0000 7f0c3258f700 1 -- 172.21.15.61:0/133105470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c067a90 msgr2=0x7f0c2c0c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:07.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.879+0000 7f0c3258f700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c067a90 0x7f0c2c0c8c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00ec80 tx=0x7f0c1c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.879+0000 7f0c3258f700 1 -- 172.21.15.61:0/133105470 shutdown_connections 2023-12-24T19:57:07.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.879+0000 7f0c3258f700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2c06b630 0x7f0c2c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.880+0000 7f0c3258f700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c18066f30 0x7f0c180693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.880+0000 7f0c3258f700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2c067a90 0x7f0c2c0c8c40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.880+0000 7f0c3258f700 1 --2- 172.21.15.61:0/133105470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c2c06b260 0x7f0c2c0a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:07.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.880+0000 7f0c3258f700 1 -- 172.21.15.61:0/133105470 >> 172.21.15.61:0/133105470 conn(0x7f0c2c0ca200 msgr2=0x7f0c2c0cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:07.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.880+0000 7f0c3258f700 1 -- 172.21.15.61:0/133105470 shutdown_connections 2023-12-24T19:57:07.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:07.880+0000 7f0c3258f700 1 -- 172.21.15.61:0/133105470 wait complete. 2023-12-24T19:57:07.892 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:08.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.013+0000 7f864b7ce700 1 Processor -- start 2023-12-24T19:57:08.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.013+0000 7f864b7ce700 1 -- start start 2023-12-24T19:57:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f864b7ce700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8644151080 0x7f864406ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f864b7ce700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864406f440 con 0x7f864406aa70 2023-12-24T19:57:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f864b7ce700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86441573b0 con 0x7f8644150cb0 2023-12-24T19:57:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f864b7ce700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8644064000 con 0x7f8644151080 2023-12-24T19:57:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f8648d69700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f864406aa70 0x7f864406db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40828/0 (socket says 172.21.15.61:40828) 2023-12-24T19:57:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f8648d69700 1 -- 172.21.15.61:0/884777285 learned_addr learned my addr 172.21.15.61:0/884777285 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f8649d6b700 1 --2- 172.21.15.61:0/884777285 >> v2:172.21.15.133:3300/0 conn(0x7f8644151080 0x7f864406ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917653546 0 0) 0x7f8634001110 con 0x7f864406aa70 2023-12-24T19:57:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8630003570 con 0x7f864406aa70 2023-12-24T19:57:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3960822496 0 0) 0x7f8630003570 con 0x7f864406aa70 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 >> v2:172.21.15.133:3300/0 conn(0x7f8644151080 msgr2=0x7f864406ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f863bfff700 1 --2- 172.21.15.61:0/884777285 >> v2:172.21.15.133:3300/0 conn(0x7f8644151080 0x7f864406ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 >> v1:172.21.15.133:6789/0 conn(0x7f8644150cb0 legacy=0x7f864406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8644157690 con 0x7f864406aa70 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f8634001600 con 0x7f864406aa70 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.014+0000 7f8649d6b700 1 --2- 172.21.15.61:0/884777285 >> v2:172.21.15.133:3300/0 conn(0x7f8644151080 0x7f864406ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 >> v1:172.21.15.61:6789/0 conn(0x7f864406aa70 legacy=0x7f864406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f863bfff700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8630003a60 0x7f8630003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f863bfff700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8630004810 0x7f8630004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f863bfff700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86300051c0 0x7f863000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644064000 con 0x7f8630004810 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863000c0d0 con 0x7f8630003a60 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863000e4a0 con 0x7f86300051c0 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f8648d69700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8630004810 0x7f8630004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f864956a700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8630003a60 0x7f8630003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f8649d6b700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86300051c0 0x7f863000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f8648d69700 1 -- 172.21.15.61:0/884777285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86300051c0 msgr2=0x7f863000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f8648d69700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86300051c0 0x7f863000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f8648d69700 1 -- 172.21.15.61:0/884777285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8630003a60 msgr2=0x7f8630003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f8648d69700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8630003a60 0x7f8630003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f8649d6b700 1 -- 172.21.15.61:0/884777285 reap_dead start 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f8648d69700 1 -- 172.21.15.61:0/884777285 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8630003570 con 0x7f8630004810 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f8648d69700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8630004810 0x7f8630004c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f863400c5c0 tx=0x7f8644157f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a415918c7a7a1e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863400cd40 con 0x7f8630004810 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8634005920 con 0x7f8630004810 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.015+0000 7f863bfff700 1 -- 172.21.15.61:0/884777285 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863400cea0 con 0x7f8630004810 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.016+0000 7f864b7ce700 1 -- 172.21.15.61:0/884777285 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8630004810 msgr2=0x7f8630004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.016+0000 7f864b7ce700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8630004810 0x7f8630004c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f863400c5c0 tx=0x7f8644157f30 comp rx=0 tx=0).stop 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.016+0000 7f864b7ce700 1 -- 172.21.15.61:0/884777285 shutdown_connections 2023-12-24T19:57:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.016+0000 7f864b7ce700 1 --2- 172.21.15.61:0/884777285 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8630004810 0x7f8630004c80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.016+0000 7f864b7ce700 1 -- 172.21.15.61:0/884777285 >> 172.21.15.61:0/884777285 conn(0x7f86440cceb0 msgr2=0x7f86440cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.016+0000 7f864b7ce700 1 -- 172.21.15.61:0/884777285 shutdown_connections 2023-12-24T19:57:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.016+0000 7f864b7ce700 1 -- 172.21.15.61:0/884777285 wait complete. 2023-12-24T19:57:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.017+0000 7f864b7ce700 1 Processor -- start 2023-12-24T19:57:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.018+0000 7f864b7ce700 1 -- start start 2023-12-24T19:57:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f864b7ce700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8630004810 0x7f864414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f864b7ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440aff50 0x7f864414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f864b7ce700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86441698e0 0x7f8644169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f864b7ce700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864414f9d0 con 0x7f86441698e0 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f864b7ce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864416a2a0 con 0x7f86440aff50 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f864b7ce700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8644152c90 con 0x7f8630004810 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8649d6b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86441698e0 0x7f8644169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8649d6b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86441698e0 0x7f8644169d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53534/0 (socket says 172.21.15.61:53534) 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8649d6b700 1 -- 172.21.15.61:0/3704935711 learned_addr learned my addr 172.21.15.61:0/3704935711 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8648d69700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440aff50 0x7f864414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f864956a700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8630004810 0x7f864414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8649d6b700 1 -- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8630004810 msgr2=0x7f864414cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8649d6b700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8630004810 0x7f864414cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8649d6b700 1 -- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440aff50 msgr2=0x7f864414ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8649d6b700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440aff50 0x7f864414ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8649d6b700 1 -- 172.21.15.61:0/3704935711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864414f490 con 0x7f86441698e0 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8648d69700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440aff50 0x7f864414ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f864956a700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8630004810 0x7f864414cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f8649d6b700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86441698e0 0x7f8644169d60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f863c009f00 tx=0x7f863c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f86397fa700 1 -- 172.21.15.61:0/3704935711 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c00e040 con 0x7f86441698e0 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f86397fa700 1 -- 172.21.15.61:0/3704935711 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c00f040 con 0x7f86441698e0 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f864b7ce700 1 -- 172.21.15.61:0/3704935711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86440b03c0 con 0x7f86441698e0 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f86397fa700 1 -- 172.21.15.61:0/3704935711 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c015430 con 0x7f86441698e0 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.019+0000 7f864b7ce700 1 -- 172.21.15.61:0/3704935711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8644152640 con 0x7f86441698e0 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.020+0000 7f864b7ce700 1 -- 172.21.15.61:0/3704935711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86441524a0 con 0x7f86441698e0 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.021+0000 7f86397fa700 1 -- 172.21.15.61:0/3704935711 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f863c015800 con 0x7f86441698e0 2023-12-24T19:57:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.021+0000 7f86397fa700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8628066f30 0x7f86280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.021+0000 7f86397fa700 1 -- 172.21.15.61:0/3704935711 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f863c084fe0 con 0x7f86441698e0 2023-12-24T19:57:08.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.021+0000 7f864956a700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8628066f30 0x7f86280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.022+0000 7f864956a700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8628066f30 0x7f86280693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f86440c9e00 tx=0x7f8640009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:08.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.026+0000 7f86397fa700 1 -- 172.21.15.61:0/3704935711 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86441524a0 con 0x7f86441698e0 2023-12-24T19:57:08.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.226+0000 7f864b7ce700 1 -- 172.21.15.61:0/3704935711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86441524a0 con 0x7f86441698e0 2023-12-24T19:57:08.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.227+0000 7f86397fa700 1 -- 172.21.15.61:0/3704935711 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f86441524a0 con 0x7f86441698e0 2023-12-24T19:57:08.228 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:08.228 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":19,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:06.923814+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:08.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.229+0000 7f864b7ce700 1 -- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8628066f30 msgr2=0x7f86280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.229+0000 7f864b7ce700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8628066f30 0x7f86280693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f86440c9e00 tx=0x7f8640009040 comp rx=0 tx=0).stop 2023-12-24T19:57:08.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.229+0000 7f864b7ce700 1 -- 172.21.15.61:0/3704935711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86441698e0 msgr2=0x7f8644169d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.229+0000 7f864b7ce700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86441698e0 0x7f8644169d60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f863c009f00 tx=0x7f863c00b040 comp rx=0 tx=0).stop 2023-12-24T19:57:08.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.230+0000 7f864b7ce700 1 -- 172.21.15.61:0/3704935711 shutdown_connections 2023-12-24T19:57:08.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.230+0000 7f864b7ce700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8630004810 0x7f864414cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.230+0000 7f864b7ce700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8628066f30 0x7f86280693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.230+0000 7f864b7ce700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86441698e0 0x7f8644169d60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.230+0000 7f864b7ce700 1 --2- 172.21.15.61:0/3704935711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86440aff50 0x7f864414ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.230+0000 7f864b7ce700 1 -- 172.21.15.61:0/3704935711 >> 172.21.15.61:0/3704935711 conn(0x7f86440cceb0 msgr2=0x7f8644156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:08.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.230+0000 7f864b7ce700 1 -- 172.21.15.61:0/3704935711 shutdown_connections 2023-12-24T19:57:08.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.230+0000 7f864b7ce700 1 -- 172.21.15.61:0/3704935711 wait complete. 2023-12-24T19:57:08.242 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T19:57:08.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.366+0000 7fbe8ec02700 1 Processor -- start 2023-12-24T19:57:08.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.366+0000 7fbe8ec02700 1 -- start start 2023-12-24T19:57:08.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.367+0000 7fbe8ec02700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbe881578d0 0x7fbe880af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.367+0000 7fbe8ec02700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe880caf30 con 0x7fbe8806b320 2023-12-24T19:57:08.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.367+0000 7fbe8ec02700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe880af9f0 con 0x7fbe8806f6e0 2023-12-24T19:57:08.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.367+0000 7fbe8ec02700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe880afcd0 con 0x7fbe881578d0 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.367+0000 7fbe8d19f700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fbe8806b320 0x7fbe880c8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40840/0 (socket says 172.21.15.61:40840) 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.367+0000 7fbe8d19f700 1 -- 172.21.15.61:0/372969792 learned_addr learned my addr 172.21.15.61:0/372969792 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.368+0000 7fbe8c99e700 1 --2- 172.21.15.61:0/372969792 >> v2:172.21.15.133:3300/0 conn(0x7fbe881578d0 0x7fbe880af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.368+0000 7fbe877fe700 1 -- 172.21.15.61:0/372969792 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490068707 0 0) 0x7fbe880caf30 con 0x7fbe8806b320 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.368+0000 7fbe877fe700 1 -- 172.21.15.61:0/372969792 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe78003570 con 0x7fbe8806b320 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.368+0000 7fbe8c99e700 1 -- 172.21.15.61:0/372969792 >> v1:172.21.15.133:6789/0 conn(0x7fbe8806f6e0 legacy=0x7fbe8806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.368+0000 7fbe8c99e700 1 -- 172.21.15.61:0/372969792 >> v1:172.21.15.61:6789/0 conn(0x7fbe8806b320 legacy=0x7fbe880c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.368+0000 7fbe8c99e700 1 -- 172.21.15.61:0/372969792 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe880affb0 con 0x7fbe881578d0 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.368+0000 7fbe8c99e700 1 --2- 172.21.15.61:0/372969792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe881578d0 0x7fbe880af330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0098e0 tx=0x7fbe7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aff9bec1aad7536 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.368+0000 7fbe877fe700 1 -- 172.21.15.61:0/372969792 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c00b640 con 0x7fbe881578d0 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.368+0000 7fbe877fe700 1 -- 172.21.15.61:0/372969792 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c00b7a0 con 0x7fbe881578d0 2023-12-24T19:57:08.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.368+0000 7fbe877fe700 1 -- 172.21.15.61:0/372969792 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c00bb40 con 0x7fbe881578d0 2023-12-24T19:57:08.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.369+0000 7fbe8ec02700 1 -- 172.21.15.61:0/372969792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe881578d0 msgr2=0x7fbe880af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.369+0000 7fbe8ec02700 1 --2- 172.21.15.61:0/372969792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe881578d0 0x7fbe880af330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0098e0 tx=0x7fbe7c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.369+0000 7fbe8ec02700 1 -- 172.21.15.61:0/372969792 shutdown_connections 2023-12-24T19:57:08.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.369+0000 7fbe8ec02700 1 --2- 172.21.15.61:0/372969792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe881578d0 0x7fbe880af330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.369+0000 7fbe8ec02700 1 -- 172.21.15.61:0/372969792 >> 172.21.15.61:0/372969792 conn(0x7fbe880ce800 msgr2=0x7fbe880cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:08.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.369+0000 7fbe8ec02700 1 -- 172.21.15.61:0/372969792 shutdown_connections 2023-12-24T19:57:08.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.369+0000 7fbe8ec02700 1 -- 172.21.15.61:0/372969792 wait complete. 2023-12-24T19:57:08.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.370+0000 7fbe8ec02700 1 Processor -- start 2023-12-24T19:57:08.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.370+0000 7fbe8ec02700 1 -- start start 2023-12-24T19:57:08.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8ec02700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe8806b320 0x7fbe88067f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8ec02700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8806f6e0 0x7fbe8815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8ec02700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe881578d0 0x7fbe881550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8ec02700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880695e0 con 0x7fbe881578d0 2023-12-24T19:57:08.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8ec02700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8815d1c0 con 0x7fbe8806f6e0 2023-12-24T19:57:08.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8ec02700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88068540 con 0x7fbe8806b320 2023-12-24T19:57:08.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8d19f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe881578d0 0x7fbe881550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8d19f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe881578d0 0x7fbe881550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53550/0 (socket says 172.21.15.61:53550) 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8d19f700 1 -- 172.21.15.61:0/406441645 learned_addr learned my addr 172.21.15.61:0/406441645 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe87fff700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8806f6e0 0x7fbe8815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8c99e700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe8806b320 0x7fbe88067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8d19f700 1 -- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe8806b320 msgr2=0x7fbe88067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8d19f700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe8806b320 0x7fbe88067f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8d19f700 1 -- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8806f6e0 msgr2=0x7fbe8815cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8d19f700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8806f6e0 0x7fbe8815cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8d19f700 1 -- 172.21.15.61:0/406441645 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c009420 con 0x7fbe881578d0 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.371+0000 7fbe8d19f700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe881578d0 0x7fbe881550a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000cc40 tx=0x7fbe80001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.372+0000 7fbe84ff9700 1 -- 172.21.15.61:0/406441645 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000a8b0 con 0x7fbe881578d0 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.372+0000 7fbe84ff9700 1 -- 172.21.15.61:0/406441645 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8000aa10 con 0x7fbe881578d0 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.372+0000 7fbe8ec02700 1 -- 172.21.15.61:0/406441645 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe88068820 con 0x7fbe881578d0 2023-12-24T19:57:08.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.372+0000 7fbe84ff9700 1 -- 172.21.15.61:0/406441645 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000ad90 con 0x7fbe881578d0 2023-12-24T19:57:08.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.372+0000 7fbe8ec02700 1 -- 172.21.15.61:0/406441645 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe88068de0 con 0x7fbe881578d0 2023-12-24T19:57:08.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.373+0000 7fbe8ec02700 1 -- 172.21.15.61:0/406441645 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8804c3c0 con 0x7fbe881578d0 2023-12-24T19:57:08.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.373+0000 7fbe84ff9700 1 -- 172.21.15.61:0/406441645 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbe80007300 con 0x7fbe881578d0 2023-12-24T19:57:08.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.374+0000 7fbe84ff9700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe6c066f30 0x7fbe6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:08.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.374+0000 7fbe84ff9700 1 -- 172.21.15.61:0/406441645 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe80084820 con 0x7fbe881578d0 2023-12-24T19:57:08.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.374+0000 7fbe8c99e700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe6c066f30 0x7fbe6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:08.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.374+0000 7fbe8c99e700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe6c066f30 0x7fbe6c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0093f0 tx=0x7fbe7c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:08.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.378+0000 7fbe84ff9700 1 -- 172.21.15.61:0/406441645 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe80051b10 con 0x7fbe881578d0 2023-12-24T19:57:08.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:08.628+0000 7fbe8ec02700 1 -- 172.21.15.61:0/406441645 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbe880b0290 con 0x7fbe881578d0 2023-12-24T19:57:09.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.535+0000 7fbe84ff9700 1 -- 172.21.15.61:0/406441645 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbe80055130 con 0x7fbe881578d0 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 -- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe6c066f30 msgr2=0x7fbe6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe6c066f30 0x7fbe6c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0093f0 tx=0x7fbe7c017000 comp rx=0 tx=0).stop 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 -- 172.21.15.61:0/406441645 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe881578d0 msgr2=0x7fbe881550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe881578d0 0x7fbe881550a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000cc40 tx=0x7fbe80001aa0 comp rx=0 tx=0).stop 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 -- 172.21.15.61:0/406441645 shutdown_connections 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe8806b320 0x7fbe88067f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe6c066f30 0x7fbe6c0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe881578d0 0x7fbe881550a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 --2- 172.21.15.61:0/406441645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8806f6e0 0x7fbe8815cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 -- 172.21.15.61:0/406441645 >> 172.21.15.61:0/406441645 conn(0x7fbe880ce800 msgr2=0x7fbe880cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 -- 172.21.15.61:0/406441645 shutdown_connections 2023-12-24T19:57:09.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.538+0000 7fbe8ec02700 1 -- 172.21.15.61:0/406441645 wait complete. 2023-12-24T19:57:09.554 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T19:57:09.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.686+0000 7f867cb2e700 1 Processor -- start 2023-12-24T19:57:09.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.686+0000 7f867cb2e700 1 -- start start 2023-12-24T19:57:09.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f867cb2e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8678159bb0 0x7f867815aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:09.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f867cb2e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 0x7f867806b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:09.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f867cb2e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867815aa10 con 0x7f867806ac10 2023-12-24T19:57:09.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f867cb2e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867815b3e0 con 0x7f8678159bb0 2023-12-24T19:57:09.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f867cb2e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867806b5a0 con 0x7f867806f430 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f8676d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 0x7f867806b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f867659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8678159bb0 0x7f867815aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f8676d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 0x7f867806b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:52176/0 (socket says 172.21.15.61:52176) 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f8675d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f867806ac10 0x7f867806ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:38786/0 (socket says 172.21.15.61:38786) 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f8676d9d700 1 -- 172.21.15.61:0/1058731112 learned_addr learned my addr 172.21.15.61:0/1058731112 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f8676d9d700 1 -- 172.21.15.61:0/1058731112 >> v2:172.21.15.133:3300/0 conn(0x7f8678159bb0 msgr2=0x7f867815aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f8676d9d700 1 --2- 172.21.15.61:0/1058731112 >> v2:172.21.15.133:3300/0 conn(0x7f8678159bb0 0x7f867815aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f8676d9d700 1 -- 172.21.15.61:0/1058731112 >> v1:172.21.15.133:6789/0 conn(0x7f867806ac10 legacy=0x7f867806ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f8676d9d700 1 -- 172.21.15.61:0/1058731112 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867806fa30 con 0x7f867806f430 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f867559a700 1 -- 172.21.15.61:0/1058731112 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506751221 0 0) 0x7f867815aa10 con 0x7f867806ac10 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.687+0000 7f867659c700 1 --2- 172.21.15.61:0/1058731112 >> v2:172.21.15.133:3300/0 conn(0x7f8678159bb0 0x7f867815aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.688+0000 7f8676d9d700 1 --2- 172.21.15.61:0/1058731112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 0x7f867806b060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8670009f20 tx=0x7f8670009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f59825afd94f32c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.688+0000 7f867559a700 1 -- 172.21.15.61:0/1058731112 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867000e070 con 0x7f867806f430 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.688+0000 7f867559a700 1 -- 172.21.15.61:0/1058731112 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867000b9d0 con 0x7f867806f430 2023-12-24T19:57:09.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.688+0000 7f867559a700 1 -- 172.21.15.61:0/1058731112 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86700092e0 con 0x7f867806f430 2023-12-24T19:57:09.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.688+0000 7f867cb2e700 1 -- 172.21.15.61:0/1058731112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 msgr2=0x7f867806b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:09.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.688+0000 7f867cb2e700 1 --2- 172.21.15.61:0/1058731112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 0x7f867806b060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8670009f20 tx=0x7f8670009840 comp rx=0 tx=0).stop 2023-12-24T19:57:09.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.689+0000 7f867cb2e700 1 -- 172.21.15.61:0/1058731112 shutdown_connections 2023-12-24T19:57:09.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.689+0000 7f867cb2e700 1 --2- 172.21.15.61:0/1058731112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 0x7f867806b060 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:09.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.689+0000 7f867cb2e700 1 --2- 172.21.15.61:0/1058731112 >> v2:172.21.15.133:3300/0 conn(0x7f8678159bb0 0x7f867815aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.689+0000 7f867cb2e700 1 -- 172.21.15.61:0/1058731112 >> 172.21.15.61:0/1058731112 conn(0x7f86780ce800 msgr2=0x7f86780cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.689+0000 7f867cb2e700 1 -- 172.21.15.61:0/1058731112 shutdown_connections 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.689+0000 7f867cb2e700 1 -- 172.21.15.61:0/1058731112 wait complete. 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.690+0000 7f867cb2e700 1 Processor -- start 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.690+0000 7f867cb2e700 1 -- start start 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.690+0000 7f867cb2e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f867806ac10 0x7f8678158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.690+0000 7f867cb2e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 0x7f86780aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867cb2e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8678159bb0 0x7f867815e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867cb2e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780b37a0 con 0x7f867806ac10 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867cb2e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780b2b90 con 0x7f8678159bb0 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867cb2e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86780b2e70 con 0x7f867806f430 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f867806ac10 0x7f8678158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f867806ac10 0x7f8678158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53558/0 (socket says 172.21.15.61:53558) 2023-12-24T19:57:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867659c700 1 -- 172.21.15.61:0/3054132571 learned_addr learned my addr 172.21.15.61:0/3054132571 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f8676d9d700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8678159bb0 0x7f867815e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f8675d9b700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 0x7f86780aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867659c700 1 -- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 msgr2=0x7f86780aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867659c700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 0x7f86780aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867659c700 1 -- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8678159bb0 msgr2=0x7f867815e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867659c700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8678159bb0 0x7f867815e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867659c700 1 -- 172.21.15.61:0/3054132571 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668009420 con 0x7f867806ac10 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867659c700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f867806ac10 0x7f8678158ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f866800ec80 tx=0x7f86680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f86667fc700 1 -- 172.21.15.61:0/3054132571 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866800c850 con 0x7f867806ac10 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f86667fc700 1 -- 172.21.15.61:0/3054132571 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866800c9b0 con 0x7f867806ac10 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f86667fc700 1 -- 172.21.15.61:0/3054132571 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866800cd30 con 0x7f867806ac10 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867cb2e700 1 -- 172.21.15.61:0/3054132571 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8670009ae0 con 0x7f867806ac10 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.691+0000 7f867cb2e700 1 -- 172.21.15.61:0/3054132571 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86780b3430 con 0x7f867806ac10 2023-12-24T19:57:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.692+0000 7f867cb2e700 1 -- 172.21.15.61:0/3054132571 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867804c3c0 con 0x7f867806ac10 2023-12-24T19:57:09.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.693+0000 7f86667fc700 1 -- 172.21.15.61:0/3054132571 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8668013680 con 0x7f867806ac10 2023-12-24T19:57:09.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.693+0000 7f86667fc700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8658066f30 0x7f86580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:09.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.693+0000 7f86667fc700 1 -- 172.21.15.61:0/3054132571 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86680847e0 con 0x7f867806ac10 2023-12-24T19:57:09.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.693+0000 7f8675d9b700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8658066f30 0x7f86580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:09.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.694+0000 7f8675d9b700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8658066f30 0x7f86580693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f867816d140 tx=0x7f866c007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:09.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.697+0000 7f86667fc700 1 -- 172.21.15.61:0/3054132571 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86680554e0 con 0x7f867806ac10 2023-12-24T19:57:09.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:09.936+0000 7f867cb2e700 1 -- 172.21.15.61:0/3054132571 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f86780aefc0 con 0x7f867806ac10 2023-12-24T19:57:10.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.550+0000 7f86667fc700 1 -- 172.21.15.61:0/3054132571 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8668055070 con 0x7f867806ac10 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 -- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8658066f30 msgr2=0x7f86580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8658066f30 0x7f86580693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f867816d140 tx=0x7f866c007ef0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 -- 172.21.15.61:0/3054132571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f867806ac10 msgr2=0x7f8678158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f867806ac10 0x7f8678158ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f866800ec80 tx=0x7f86680091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 -- 172.21.15.61:0/3054132571 shutdown_connections 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8658066f30 0x7f86580693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8678159bb0 0x7f867815e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f867806ac10 0x7f8678158ef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 --2- 172.21.15.61:0/3054132571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f867806f430 0x7f86780aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 -- 172.21.15.61:0/3054132571 >> 172.21.15.61:0/3054132571 conn(0x7f86780ce800 msgr2=0x7f8678068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:10.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 -- 172.21.15.61:0/3054132571 shutdown_connections 2023-12-24T19:57:10.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.553+0000 7f867cb2e700 1 -- 172.21.15.61:0/3054132571 wait complete. 2023-12-24T19:57:10.568 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:57:10.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.695+0000 7f78e0c37700 1 Processor -- start 2023-12-24T19:57:10.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.695+0000 7f78e0c37700 1 -- start start 2023-12-24T19:57:10.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78e0c37700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 0x7f78dc0686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:10.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78e0c37700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78dc070d50 0x7f78dc163640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:10.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78e0c37700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78dc15ac00 con 0x7f78dc159d40 2023-12-24T19:57:10.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78e0c37700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78dc15a2d0 con 0x7f78dc070d50 2023-12-24T19:57:10.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78e0c37700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc15a5b0 con 0x7f78dc159970 2023-12-24T19:57:10.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78da59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 0x7f78dc0686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:10.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78dad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78dc070d50 0x7f78dc163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78da59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 0x7f78dc0686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:52184/0 (socket says 172.21.15.61:52184) 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78da59c700 1 -- 172.21.15.61:0/3327216376 learned_addr learned my addr 172.21.15.61:0/3327216376 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78d9d9b700 1 --1- 172.21.15.61:0/3327216376 >> v1:172.21.15.133:6789/0 conn(0x7f78dc159d40 0x7f78dc070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:38802/0 (socket says 172.21.15.61:38802) 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78dad9d700 1 -- 172.21.15.61:0/3327216376 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 msgr2=0x7f78dc0686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78dad9d700 1 --2- 172.21.15.61:0/3327216376 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 0x7f78dc0686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.696+0000 7f78dad9d700 1 -- 172.21.15.61:0/3327216376 >> v1:172.21.15.133:6789/0 conn(0x7f78dc159d40 legacy=0x7f78dc070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.697+0000 7f78dad9d700 1 -- 172.21.15.61:0/3327216376 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc15a890 con 0x7f78dc070d50 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.697+0000 7f78d959a700 1 -- 172.21.15.61:0/3327216376 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517462764 0 0) 0x7f78dc15ac00 con 0x7f78dc159d40 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.697+0000 7f78dad9d700 1 --2- 172.21.15.61:0/3327216376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78dc070d50 0x7f78dc163640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009e60 tx=0x7f78d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2165afd8b064992 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.697+0000 7f78d959a700 1 -- 172.21.15.61:0/3327216376 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d400e070 con 0x7f78dc070d50 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.697+0000 7f78d959a700 1 -- 172.21.15.61:0/3327216376 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d400bb60 con 0x7f78dc070d50 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.697+0000 7f78d959a700 1 -- 172.21.15.61:0/3327216376 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4012430 con 0x7f78dc070d50 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.697+0000 7f78e0c37700 1 -- 172.21.15.61:0/3327216376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78dc070d50 msgr2=0x7f78dc163640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.697+0000 7f78e0c37700 1 --2- 172.21.15.61:0/3327216376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78dc070d50 0x7f78dc163640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009e60 tx=0x7f78d4009780 comp rx=0 tx=0).stop 2023-12-24T19:57:10.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.698+0000 7f78e0c37700 1 -- 172.21.15.61:0/3327216376 shutdown_connections 2023-12-24T19:57:10.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.698+0000 7f78e0c37700 1 --2- 172.21.15.61:0/3327216376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78dc070d50 0x7f78dc163640 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.698+0000 7f78e0c37700 1 --2- 172.21.15.61:0/3327216376 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 0x7f78dc0686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.698+0000 7f78e0c37700 1 -- 172.21.15.61:0/3327216376 >> 172.21.15.61:0/3327216376 conn(0x7f78dc0ce130 msgr2=0x7f78dc0ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:10.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.698+0000 7f78e0c37700 1 -- 172.21.15.61:0/3327216376 shutdown_connections 2023-12-24T19:57:10.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.698+0000 7f78e0c37700 1 -- 172.21.15.61:0/3327216376 wait complete. 2023-12-24T19:57:10.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.699+0000 7f78e0c37700 1 Processor -- start 2023-12-24T19:57:10.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.699+0000 7f78e0c37700 1 -- start start 2023-12-24T19:57:10.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.699+0000 7f78e0c37700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78dc070d50 0x7f78dc15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:10.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.699+0000 7f78e0c37700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 0x7f78dc0aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:10.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.699+0000 7f78e0c37700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78dc159d40 0x7f78dc146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:10.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.699+0000 7f78e0c37700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc0aadc0 con 0x7f78dc070d50 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.699+0000 7f78e0c37700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc0ab020 con 0x7f78dc159d40 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78e0c37700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc0ab300 con 0x7f78dc159970 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78da59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78dc070d50 0x7f78dc15ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78da59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78dc070d50 0x7f78dc15ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53570/0 (socket says 172.21.15.61:53570) 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78da59c700 1 -- 172.21.15.61:0/1097006726 learned_addr learned my addr 172.21.15.61:0/1097006726 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78dad9d700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78dc159d40 0x7f78dc146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78d9d9b700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 0x7f78dc0aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78da59c700 1 -- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 msgr2=0x7f78dc0aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78da59c700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 0x7f78dc0aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78da59c700 1 -- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78dc159d40 msgr2=0x7f78dc146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78da59c700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78dc159d40 0x7f78dc146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78da59c700 1 -- 172.21.15.61:0/1097006726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d4009a20 con 0x7f78dc070d50 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78d9d9b700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 0x7f78dc0aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:10.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78da59c700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78dc070d50 0x7f78dc15ecb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00ea50 tx=0x7f78cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78ca7fc700 1 -- 172.21.15.61:0/1097006726 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00eee0 con 0x7f78dc070d50 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78ca7fc700 1 -- 172.21.15.61:0/1097006726 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc00c850 con 0x7f78dc070d50 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78e0c37700 1 -- 172.21.15.61:0/1097006726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78dc0ab5e0 con 0x7f78dc070d50 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78ca7fc700 1 -- 172.21.15.61:0/1097006726 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00cbd0 con 0x7f78dc070d50 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.700+0000 7f78e0c37700 1 -- 172.21.15.61:0/1097006726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78dc0abba0 con 0x7f78dc070d50 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.701+0000 7f78e0c37700 1 -- 172.21.15.61:0/1097006726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78dc04c3c0 con 0x7f78dc070d50 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.702+0000 7f78ca7fc700 1 -- 172.21.15.61:0/1097006726 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f78cc013470 con 0x7f78dc070d50 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.702+0000 7f78ca7fc700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f78bc066f30 0x7f78bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.702+0000 7f78ca7fc700 1 -- 172.21.15.61:0/1097006726 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78cc0847b0 con 0x7f78dc070d50 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.702+0000 7f78d9d9b700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f78bc066f30 0x7f78bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:10.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.703+0000 7f78d9d9b700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f78bc066f30 0x7f78bc0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f78dc157120 tx=0x7f78d0007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:10.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.706+0000 7f78ca7fc700 1 -- 172.21.15.61:0/1097006726 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78cc0554b0 con 0x7f78dc070d50 2023-12-24T19:57:10.804 INFO:tasks.ceph.mds.b.smithi133.stderr:2023-12-24T19:57:10.802+0000 7fa43507a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T19:57:10.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.946+0000 7f78e0c37700 1 -- 172.21.15.61:0/1097006726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78dc0ae3b0 con 0x7f78dc070d50 2023-12-24T19:57:10.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.947+0000 7f78ca7fc700 1 -- 172.21.15.61:0/1097006726 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f78cc055040 con 0x7f78dc070d50 2023-12-24T19:57:10.947 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:10.947 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3729732902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3729732902},{"type":"v1","addr":"172.21.15.61:6834","nonce":3729732902}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/402997858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":402997858},{"type":"v1","addr":"172.21.15.133:6837","nonce":402997858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/180373533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":180373533},{"type":"v1","addr":"172.21.15.61:6835","nonce":180373533}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:06.924129+0000","modified":"2023-12-24T19:57:10.540414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/74793696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":74793696},{"type":"v1","addr":"172.21.15.133:6836","nonce":74793696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T19:57:10.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 -- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f78bc066f30 msgr2=0x7f78bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:10.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f78bc066f30 0x7f78bc0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f78dc157120 tx=0x7f78d0007c90 comp rx=0 tx=0).stop 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 -- 172.21.15.61:0/1097006726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78dc070d50 msgr2=0x7f78dc15ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78dc070d50 0x7f78dc15ecb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00ea50 tx=0x7f78cc009250 comp rx=0 tx=0).stop 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 -- 172.21.15.61:0/1097006726 shutdown_connections 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f78bc066f30 0x7f78bc0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78dc159d40 0x7f78dc146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78dc070d50 0x7f78dc15ecb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 --2- 172.21.15.61:0/1097006726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78dc159970 0x7f78dc0aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 -- 172.21.15.61:0/1097006726 >> 172.21.15.61:0/1097006726 conn(0x7f78dc0ce130 msgr2=0x7f78dc0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 -- 172.21.15.61:0/1097006726 shutdown_connections 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:10.949+0000 7f78e0c37700 1 -- 172.21.15.61:0/1097006726 wait complete. 2023-12-24T19:57:10.950 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 7 2023-12-24T19:57:10.962 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:11.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.083+0000 7ff8a9317700 1 Processor -- start 2023-12-24T19:57:11.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.083+0000 7ff8a9317700 1 -- start start 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a9317700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff8a4159c10 0x7ff8a40c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a9317700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8a4159fe0 0x7ff8a40c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a9317700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a40af880 con 0x7ff8a40cba80 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a9317700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a40c6fc0 con 0x7ff8a4159c10 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a9317700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a40c63b0 con 0x7ff8a4159fe0 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a2ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff8a4159c10 0x7ff8a40c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a2ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff8a4159c10 0x7ff8a40c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53582/0 (socket says 172.21.15.61:53582) 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a2ffd700 1 -- 172.21.15.61:0/2321241272 learned_addr learned my addr 172.21.15.61:0/2321241272 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a27fc700 1 --2- 172.21.15.61:0/2321241272 >> v2:172.21.15.133:3300/0 conn(0x7ff8a4159fe0 0x7ff8a40c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a2ffd700 1 -- 172.21.15.61:0/2321241272 >> v2:172.21.15.133:3300/0 conn(0x7ff8a4159fe0 msgr2=0x7ff8a40c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a2ffd700 1 --2- 172.21.15.61:0/2321241272 >> v2:172.21.15.133:3300/0 conn(0x7ff8a4159fe0 0x7ff8a40c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a2ffd700 1 -- 172.21.15.61:0/2321241272 >> v1:172.21.15.133:6789/0 conn(0x7ff8a40cba80 legacy=0x7ff8a40cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:11.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.084+0000 7ff8a2ffd700 1 -- 172.21.15.61:0/2321241272 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40c6690 con 0x7ff8a4159c10 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a2ffd700 1 --2- 172.21.15.61:0/2321241272 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a4159c10 0x7ff8a40c57d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40d1b20 tx=0x7ff894009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13173dc4e953ff2e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a1ffb700 1 -- 172.21.15.61:0/2321241272 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400b820 con 0x7ff8a4159c10 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a1ffb700 1 -- 172.21.15.61:0/2321241272 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89400b980 con 0x7ff8a4159c10 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a1ffb700 1 -- 172.21.15.61:0/2321241272 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400bd20 con 0x7ff8a4159c10 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a9317700 1 -- 172.21.15.61:0/2321241272 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a4159c10 msgr2=0x7ff8a40c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a9317700 1 --2- 172.21.15.61:0/2321241272 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a4159c10 0x7ff8a40c57d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40d1b20 tx=0x7ff894009250 comp rx=0 tx=0).stop 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a9317700 1 -- 172.21.15.61:0/2321241272 shutdown_connections 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a9317700 1 --2- 172.21.15.61:0/2321241272 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a4159c10 0x7ff8a40c57d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a9317700 1 --2- 172.21.15.61:0/2321241272 >> v2:172.21.15.133:3300/0 conn(0x7ff8a4159fe0 0x7ff8a40c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a9317700 1 -- 172.21.15.61:0/2321241272 >> 172.21.15.61:0/2321241272 conn(0x7ff8a406e640 msgr2=0x7ff8a4067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a9317700 1 -- 172.21.15.61:0/2321241272 shutdown_connections 2023-12-24T19:57:11.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.085+0000 7ff8a9317700 1 -- 172.21.15.61:0/2321241272 wait complete. 2023-12-24T19:57:11.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a9317700 1 Processor -- start 2023-12-24T19:57:11.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a9317700 1 -- start start 2023-12-24T19:57:11.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a9317700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a40cba80 0x7ff8a40d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a9317700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8a4159c10 0x7ff8a40c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a9317700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8a4159fe0 0x7ff8a40c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a9317700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40b37d0 con 0x7ff8a40cba80 2023-12-24T19:57:11.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a9317700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40ca320 con 0x7ff8a4159fe0 2023-12-24T19:57:11.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a9317700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a40ca600 con 0x7ff8a4159c10 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a40cba80 0x7ff8a40d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a40cba80 0x7ff8a40d03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53592/0 (socket says 172.21.15.61:53592) 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.087+0000 7ff8a2ffd700 1 -- 172.21.15.61:0/1844776734 learned_addr learned my addr 172.21.15.61:0/1844776734 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a37fe700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8a4159fe0 0x7ff8a40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a27fc700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8a4159c10 0x7ff8a40c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a2ffd700 1 -- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8a4159c10 msgr2=0x7ff8a40c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a2ffd700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8a4159c10 0x7ff8a40c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a2ffd700 1 -- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8a4159fe0 msgr2=0x7ff8a40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a2ffd700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8a4159fe0 0x7ff8a40c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a2ffd700 1 -- 172.21.15.61:0/1844776734 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940094f0 con 0x7ff8a40cba80 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a37fe700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8a4159fe0 0x7ff8a40c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a2ffd700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a40cba80 0x7ff8a40d03b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff8940030c0 tx=0x7ff894016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff88affd700 1 -- 172.21.15.61:0/1844776734 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894011e60 con 0x7ff8a40cba80 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff88affd700 1 -- 172.21.15.61:0/1844776734 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff894020070 con 0x7ff8a40cba80 2023-12-24T19:57:11.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff88affd700 1 -- 172.21.15.61:0/1844776734 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89401b6a0 con 0x7ff8a40cba80 2023-12-24T19:57:11.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a9317700 1 -- 172.21.15.61:0/1844776734 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a40ca8e0 con 0x7ff8a40cba80 2023-12-24T19:57:11.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.088+0000 7ff8a9317700 1 -- 172.21.15.61:0/1844776734 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a40c7cb0 con 0x7ff8a40cba80 2023-12-24T19:57:11.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.089+0000 7ff8a9317700 1 -- 172.21.15.61:0/1844776734 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a40b3be0 con 0x7ff8a40cba80 2023-12-24T19:57:11.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.089+0000 7ff88affd700 1 -- 172.21.15.61:0/1844776734 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff894022030 con 0x7ff8a40cba80 2023-12-24T19:57:11.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.090+0000 7ff88affd700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.090+0000 7ff88affd700 1 -- 172.21.15.61:0/1844776734 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff894086500 con 0x7ff8a40cba80 2023-12-24T19:57:11.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.090+0000 7ff8a27fc700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.090+0000 7ff8a27fc700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff890066f30 0x7ff8900693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40cfbf0 tx=0x7ff898008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:11.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.094+0000 7ff88affd700 1 -- 172.21.15.61:0/1844776734 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff894053770 con 0x7ff8a40cba80 2023-12-24T19:57:11.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.290+0000 7ff8a9317700 1 -- 172.21.15.61:0/1844776734 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8a40890b0 con 0x7ff8a40cba80 2023-12-24T19:57:11.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.291+0000 7ff88affd700 1 -- 172.21.15.61:0/1844776734 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff894056d90 con 0x7ff8a40cba80 2023-12-24T19:57:11.292 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:11.292 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:11.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.293+0000 7ff8a9317700 1 -- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff890066f30 msgr2=0x7ff8900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.293+0000 7ff8a9317700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff890066f30 0x7ff8900693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40cfbf0 tx=0x7ff898008040 comp rx=0 tx=0).stop 2023-12-24T19:57:11.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.293+0000 7ff8a9317700 1 -- 172.21.15.61:0/1844776734 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a40cba80 msgr2=0x7ff8a40d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.293+0000 7ff8a9317700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a40cba80 0x7ff8a40d03b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff8940030c0 tx=0x7ff894016000 comp rx=0 tx=0).stop 2023-12-24T19:57:11.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.294+0000 7ff8a9317700 1 -- 172.21.15.61:0/1844776734 shutdown_connections 2023-12-24T19:57:11.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.294+0000 7ff8a9317700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff890066f30 0x7ff8900693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.294+0000 7ff8a9317700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8a4159fe0 0x7ff8a40c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.294+0000 7ff8a9317700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff8a40cba80 0x7ff8a40d03b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.294+0000 7ff8a9317700 1 --2- 172.21.15.61:0/1844776734 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8a4159c10 0x7ff8a40c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.294+0000 7ff8a9317700 1 -- 172.21.15.61:0/1844776734 >> 172.21.15.61:0/1844776734 conn(0x7ff8a406e640 msgr2=0x7ff8a415faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:11.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.294+0000 7ff8a9317700 1 -- 172.21.15.61:0/1844776734 shutdown_connections 2023-12-24T19:57:11.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.294+0000 7ff8a9317700 1 -- 172.21.15.61:0/1844776734 wait complete. 2023-12-24T19:57:11.306 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T19:57:11.306 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:57:11.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.427+0000 7fbb199e5700 1 Processor -- start 2023-12-24T19:57:11.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.427+0000 7fbb199e5700 1 -- start start 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.427+0000 7fbb199e5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbb14159c10 0x7fbb140c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.427+0000 7fbb199e5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb140cc190 0x7fbb140c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.427+0000 7fbb199e5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb140af880 con 0x7fbb14159fe0 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.427+0000 7fbb199e5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb140c6fc0 con 0x7fbb14159c10 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.427+0000 7fbb199e5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140c63b0 con 0x7fbb140cc190 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb12ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbb14159c10 0x7fbb140c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb12ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbb14159c10 0x7fbb140c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53598/0 (socket says 172.21.15.61:53598) 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb12ffd700 1 -- 172.21.15.61:0/2644934703 learned_addr learned my addr 172.21.15.61:0/2644934703 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb137fe700 1 --2- 172.21.15.61:0/2644934703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb140cc190 0x7fbb140c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb12ffd700 1 -- 172.21.15.61:0/2644934703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb140cc190 msgr2=0x7fbb140c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb12ffd700 1 --2- 172.21.15.61:0/2644934703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb140cc190 0x7fbb140c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb12ffd700 1 -- 172.21.15.61:0/2644934703 >> v1:172.21.15.133:6789/0 conn(0x7fbb14159fe0 legacy=0x7fbb140cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb12ffd700 1 -- 172.21.15.61:0/2644934703 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb140c6690 con 0x7fbb14159c10 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb137fe700 1 --2- 172.21.15.61:0/2644934703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb140cc190 0x7fbb140c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb12ffd700 1 --2- 172.21.15.61:0/2644934703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 0x7fbb140c57d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb040099b0 tx=0x7fbb04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629e4381fe4cb6fb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb11ffb700 1 -- 172.21.15.61:0/2644934703 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400b820 con 0x7fbb14159c10 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb11ffb700 1 -- 172.21.15.61:0/2644934703 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0400b980 con 0x7fbb14159c10 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.428+0000 7fbb11ffb700 1 -- 172.21.15.61:0/2644934703 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400bd20 con 0x7fbb14159c10 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.429+0000 7fbb199e5700 1 -- 172.21.15.61:0/2644934703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 msgr2=0x7fbb140c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.429+0000 7fbb199e5700 1 --2- 172.21.15.61:0/2644934703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 0x7fbb140c57d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb040099b0 tx=0x7fbb04009250 comp rx=0 tx=0).stop 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.429+0000 7fbb199e5700 1 -- 172.21.15.61:0/2644934703 shutdown_connections 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.429+0000 7fbb199e5700 1 --2- 172.21.15.61:0/2644934703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb140cc190 0x7fbb140c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.429+0000 7fbb199e5700 1 --2- 172.21.15.61:0/2644934703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 0x7fbb140c57d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.429+0000 7fbb199e5700 1 -- 172.21.15.61:0/2644934703 >> 172.21.15.61:0/2644934703 conn(0x7fbb1406e640 msgr2=0x7fbb14067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.429+0000 7fbb199e5700 1 -- 172.21.15.61:0/2644934703 shutdown_connections 2023-12-24T19:57:11.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.429+0000 7fbb199e5700 1 -- 172.21.15.61:0/2644934703 wait complete. 2023-12-24T19:57:11.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.430+0000 7fbb199e5700 1 Processor -- start 2023-12-24T19:57:11.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.430+0000 7fbb199e5700 1 -- start start 2023-12-24T19:57:11.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb199e5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb140cc190 0x7fbb140b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb199e5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 0x7fbb141549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb199e5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb14159fe0 0x7fbb140b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb199e5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1415a3b0 con 0x7fbb14159c10 2023-12-24T19:57:11.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb199e5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1415ac50 con 0x7fbb140cc190 2023-12-24T19:57:11.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb199e5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140b1830 con 0x7fbb14159fe0 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb127fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 0x7fbb141549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb127fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 0x7fbb141549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53606/0 (socket says 172.21.15.61:53606) 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb127fc700 1 -- 172.21.15.61:0/1957447641 learned_addr learned my addr 172.21.15.61:0/1957447641 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb12ffd700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb140cc190 0x7fbb140b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb137fe700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb14159fe0 0x7fbb140b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb127fc700 1 -- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb14159fe0 msgr2=0x7fbb140b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb127fc700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb14159fe0 0x7fbb140b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb127fc700 1 -- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb140cc190 msgr2=0x7fbb140b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb127fc700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb140cc190 0x7fbb140b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.431+0000 7fbb127fc700 1 -- 172.21.15.61:0/1957447641 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb040094f0 con 0x7fbb14159c10 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.432+0000 7fbb127fc700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 0x7fbb141549c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800b610 tx=0x7fbb080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.432+0000 7fbafaffd700 1 -- 172.21.15.61:0/1957447641 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0800f510 con 0x7fbb14159c10 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.432+0000 7fbafaffd700 1 -- 172.21.15.61:0/1957447641 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0800f6b0 con 0x7fbb14159c10 2023-12-24T19:57:11.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.432+0000 7fbb199e5700 1 -- 172.21.15.61:0/1957447641 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1416ad70 con 0x7fbb14159c10 2023-12-24T19:57:11.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.432+0000 7fbafaffd700 1 -- 172.21.15.61:0/1957447641 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0800fa70 con 0x7fbb14159c10 2023-12-24T19:57:11.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.432+0000 7fbb199e5700 1 -- 172.21.15.61:0/1957447641 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1415a8e0 con 0x7fbb14159c10 2023-12-24T19:57:11.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.433+0000 7fbb199e5700 1 -- 172.21.15.61:0/1957447641 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1415ae00 con 0x7fbb14159c10 2023-12-24T19:57:11.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.433+0000 7fbafaffd700 1 -- 172.21.15.61:0/1957447641 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbb0801a400 con 0x7fbb14159c10 2023-12-24T19:57:11.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.434+0000 7fbafaffd700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb00066f60 0x7fbb00069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.434+0000 7fbafaffd700 1 -- 172.21.15.61:0/1957447641 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb08083f50 con 0x7fbb14159c10 2023-12-24T19:57:11.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.434+0000 7fbb12ffd700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb00066f60 0x7fbb00069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.434+0000 7fbb12ffd700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb00066f60 0x7fbb00069410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbb040099b0 tx=0x7fbb04016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:11.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.438+0000 7fbafaffd700 1 -- 172.21.15.61:0/1957447641 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb1415ae00 con 0x7fbb14159c10 2023-12-24T19:57:11.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.626+0000 7fbb199e5700 1 -- 172.21.15.61:0/1957447641 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb14068030 con 0x7fbb00066f60 2023-12-24T19:57:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.634+0000 7fbafaffd700 1 -- 172.21.15.61:0/1957447641 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248991 (secure 0 0 0) 0x7fbb14068030 con 0x7fbb00066f60 2023-12-24T19:57:11.637 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 -- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb00066f60 msgr2=0x7fbb00069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb00066f60 0x7fbb00069410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbb040099b0 tx=0x7fbb04016000 comp rx=0 tx=0).stop 2023-12-24T19:57:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 -- 172.21.15.61:0/1957447641 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 msgr2=0x7fbb141549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 0x7fbb141549c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800b610 tx=0x7fbb080090f0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 -- 172.21.15.61:0/1957447641 shutdown_connections 2023-12-24T19:57:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb14159fe0 0x7fbb140b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb00066f60 0x7fbb00069410 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb140cc190 0x7fbb140b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 --2- 172.21.15.61:0/1957447641 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb14159c10 0x7fbb141549c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 -- 172.21.15.61:0/1957447641 >> 172.21.15.61:0/1957447641 conn(0x7fbb1406e640 msgr2=0x7fbb14157470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:11.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 -- 172.21.15.61:0/1957447641 shutdown_connections 2023-12-24T19:57:11.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.637+0000 7fbb199e5700 1 -- 172.21.15.61:0/1957447641 wait complete. 2023-12-24T19:57:11.641 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:57:11.649 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-12-24T19:57:10.308415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1507,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560992,"statfs":{"total":1600000000,"available":1598456264,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.803304"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":159,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-24T19:56:56.730474+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:56:56.730474+0000","last_peered":"2023-12-24T19:56:56.730474+0000","last_clean":"2023-12-24T19:56:56.730474+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:56:56.730474+0000","last_undegraded":"2023-12-24T19:56:56.730474+0000","last_fullsized":"2023-12-24T19:56:56.730474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364257,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364257,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]}],"pool_statfs":[]}} 2023-12-24T19:57:11.654 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:57:11.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.810+0000 7f9b97842700 1 Processor -- start 2023-12-24T19:57:11.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.810+0000 7f9b97842700 1 -- start start 2023-12-24T19:57:11.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.811+0000 7f9b97842700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b90068140 0x7f9b900cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.811+0000 7f9b97842700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b900b2890 con 0x7f9b90068510 2023-12-24T19:57:11.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.811+0000 7f9b97842700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b900cf630 con 0x7f9b90159a60 2023-12-24T19:57:11.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.811+0000 7f9b97842700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900b2240 con 0x7f9b90068140 2023-12-24T19:57:11.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.811+0000 7f9b94ddd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9b90068510 0x7f9b900b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40844/0 (socket says 172.21.15.61:40844) 2023-12-24T19:57:11.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.811+0000 7f9b94ddd700 1 -- 172.21.15.61:0/2853220490 learned_addr learned my addr 172.21.15.61:0/2853220490 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:11.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816673556 0 0) 0x7f9b900b2890 con 0x7f9b90068510 2023-12-24T19:57:11.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b7c003570 con 0x7f9b90068510 2023-12-24T19:57:11.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b955de700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b90068140 0x7f9b900cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2082570517 0 0) 0x7f9b7c003570 con 0x7f9b90068510 2023-12-24T19:57:11.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b90068140 msgr2=0x7f9b900cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:11.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b90068140 0x7f9b900cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 >> v1:172.21.15.133:6789/0 conn(0x7f9b90159a60 legacy=0x7f9b90159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900b2520 con 0x7f9b90068510 2023-12-24T19:57:11.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f9b8c001470 con 0x7f9b90068510 2023-12-24T19:57:11.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 >> v1:172.21.15.61:6789/0 conn(0x7f9b90068510 legacy=0x7f9b900b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c003a90 0x7f9b7c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c004810 0x7f9b7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b90068140 0x7f9b7c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900b2240 con 0x7f9b7c003a90 2023-12-24T19:57:11.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c00bb60 con 0x7f9b7c004810 2023-12-24T19:57:11.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c014530 con 0x7f9b90068140 2023-12-24T19:57:11.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b955de700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c003a90 0x7f9b7c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b94ddd700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c004810 0x7f9b7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b95ddf700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b90068140 0x7f9b7c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b955de700 1 -- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b90068140 msgr2=0x7f9b7c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:11.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b955de700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b90068140 0x7f9b7c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b955de700 1 -- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c004810 msgr2=0x7f9b7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:11.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b955de700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c004810 0x7f9b7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b955de700 1 -- 172.21.15.61:0/2853220490 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c003570 con 0x7f9b7c003a90 2023-12-24T19:57:11.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.812+0000 7f9b94ddd700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c004810 0x7f9b7c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:11.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b955de700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c003a90 0x7f9b7c003ea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009bf0 tx=0x7f9b80009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38869e9d3a152f4f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:11.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80005a00 con 0x7f9b7c003a90 2023-12-24T19:57:11.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b80005b60 con 0x7f9b7c003a90 2023-12-24T19:57:11.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b87fff700 1 -- 172.21.15.61:0/2853220490 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000e710 con 0x7f9b7c003a90 2023-12-24T19:57:11.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b97842700 1 -- 172.21.15.61:0/2853220490 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c003a90 msgr2=0x7f9b7c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b97842700 1 --2- 172.21.15.61:0/2853220490 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b7c003a90 0x7f9b7c003ea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009bf0 tx=0x7f9b80009120 comp rx=0 tx=0).stop 2023-12-24T19:57:11.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b95ddf700 1 -- 172.21.15.61:0/2853220490 reap_dead start 2023-12-24T19:57:11.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b97842700 1 -- 172.21.15.61:0/2853220490 shutdown_connections 2023-12-24T19:57:11.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b97842700 1 -- 172.21.15.61:0/2853220490 >> 172.21.15.61:0/2853220490 conn(0x7f9b90097a10 msgr2=0x7f9b900ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:11.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b97842700 1 -- 172.21.15.61:0/2853220490 shutdown_connections 2023-12-24T19:57:11.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.813+0000 7f9b97842700 1 -- 172.21.15.61:0/2853220490 wait complete. 2023-12-24T19:57:11.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.815+0000 7f9b97842700 1 Processor -- start 2023-12-24T19:57:11.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.815+0000 7f9b97842700 1 -- start start 2023-12-24T19:57:11.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.815+0000 7f9b97842700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c003a90 0x7f9b90155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.815+0000 7f9b97842700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b9009b440 0x7f9b9009b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.815+0000 7f9b97842700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900ab6a0 0x7f9b900abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.815+0000 7f9b97842700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900ada50 con 0x7f9b9009b440 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.815+0000 7f9b97842700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9009bdf0 con 0x7f9b7c003a90 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.815+0000 7f9b97842700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900acee0 con 0x7f9b900ab6a0 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b94ddd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b9009b440 0x7f9b9009b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b94ddd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b9009b440 0x7f9b9009b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53632/0 (socket says 172.21.15.61:53632) 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b94ddd700 1 -- 172.21.15.61:0/2900570363 learned_addr learned my addr 172.21.15.61:0/2900570363 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b95ddf700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900ab6a0 0x7f9b900abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b955de700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c003a90 0x7f9b90155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b94ddd700 1 -- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900ab6a0 msgr2=0x7f9b900abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b94ddd700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900ab6a0 0x7f9b900abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b94ddd700 1 -- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c003a90 msgr2=0x7f9b90155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b94ddd700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c003a90 0x7f9b90155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b94ddd700 1 -- 172.21.15.61:0/2900570363 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900ac050 con 0x7f9b9009b440 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b95ddf700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900ab6a0 0x7f9b900abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b955de700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c003a90 0x7f9b90155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b94ddd700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b9009b440 0x7f9b9009b8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c000ff0 tx=0x7f9b8c000c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b857fa700 1 -- 172.21.15.61:0/2900570363 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00c880 con 0x7f9b9009b440 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b857fa700 1 -- 172.21.15.61:0/2900570363 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00c9e0 con 0x7f9b9009b440 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b857fa700 1 -- 172.21.15.61:0/2900570363 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00cda0 con 0x7f9b9009b440 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b97842700 1 -- 172.21.15.61:0/2900570363 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b900ac2d0 con 0x7f9b9009b440 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.816+0000 7f9b97842700 1 -- 172.21.15.61:0/2900570363 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b900ac890 con 0x7f9b9009b440 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.817+0000 7f9b97842700 1 -- 172.21.15.61:0/2900570363 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b900ad090 con 0x7f9b9009b440 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.818+0000 7f9b857fa700 1 -- 172.21.15.61:0/2900570363 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9b8c013630 con 0x7f9b9009b440 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.818+0000 7f9b857fa700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b74066f30 0x7f9b740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:11.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.818+0000 7f9b857fa700 1 -- 172.21.15.61:0/2900570363 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9b8c0845c0 con 0x7f9b9009b440 2023-12-24T19:57:11.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.818+0000 7f9b955de700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b74066f30 0x7f9b740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:11.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.819+0000 7f9b955de700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b74066f30 0x7f9b740693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009160 tx=0x7f9b80019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:11.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:11.822+0000 7f9b857fa700 1 -- 172.21.15.61:0/2900570363 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b900ad090 con 0x7f9b9009b440 2023-12-24T19:57:12.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.013+0000 7f9b97842700 1 -- 172.21.15.61:0/2900570363 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b9006d210 con 0x7f9b74066f30 2023-12-24T19:57:12.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.020+0000 7f9b857fa700 1 -- 172.21.15.61:0/2900570363 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248991 (secure 0 0 0) 0x7f9b9006d210 con 0x7f9b74066f30 2023-12-24T19:57:12.024 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:12.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.023+0000 7f9b97842700 1 -- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b74066f30 msgr2=0x7f9b740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.023+0000 7f9b97842700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b74066f30 0x7f9b740693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009160 tx=0x7f9b80019000 comp rx=0 tx=0).stop 2023-12-24T19:57:12.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.023+0000 7f9b97842700 1 -- 172.21.15.61:0/2900570363 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b9009b440 msgr2=0x7f9b9009b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.023+0000 7f9b97842700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b9009b440 0x7f9b9009b8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c000ff0 tx=0x7f9b8c000c30 comp rx=0 tx=0).stop 2023-12-24T19:57:12.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.024+0000 7f9b97842700 1 -- 172.21.15.61:0/2900570363 shutdown_connections 2023-12-24T19:57:12.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.024+0000 7f9b97842700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9b900ab6a0 0x7f9b900abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.024+0000 7f9b97842700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9b74066f30 0x7f9b740693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.024+0000 7f9b97842700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b7c003a90 0x7f9b90155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.024+0000 7f9b97842700 1 --2- 172.21.15.61:0/2900570363 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9b9009b440 0x7f9b9009b8b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.024+0000 7f9b97842700 1 -- 172.21.15.61:0/2900570363 >> 172.21.15.61:0/2900570363 conn(0x7f9b90097a10 msgr2=0x7f9b900ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:12.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.024+0000 7f9b97842700 1 -- 172.21.15.61:0/2900570363 shutdown_connections 2023-12-24T19:57:12.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.024+0000 7f9b97842700 1 -- 172.21.15.61:0/2900570363 wait complete. 2023-12-24T19:57:12.027 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:57:12.036 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-12-24T19:57:10.308415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1507,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560992,"statfs":{"total":1600000000,"available":1598456264,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.803304"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":159,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-24T19:56:56.730474+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:56:56.730474+0000","last_peered":"2023-12-24T19:56:56.730474+0000","last_clean":"2023-12-24T19:56:56.730474+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:56:56.730474+0000","last_undegraded":"2023-12-24T19:56:56.730474+0000","last_fullsized":"2023-12-24T19:56:56.730474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:05.498822+0000","last_change":"2023-12-24T19:57:05.498822+0000","last_active":"2023-12-24T19:57:05.498822+0000","last_peered":"2023-12-24T19:57:05.498822+0000","last_clean":"2023-12-24T19:57:05.498822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:05.498822+0000","last_undegraded":"2023-12-24T19:57:05.498822+0000","last_fullsized":"2023-12-24T19:57:05.498822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T19:57:06.504895+0000","last_change":"2023-12-24T19:57:06.504895+0000","last_active":"2023-12-24T19:57:06.504895+0000","last_peered":"2023-12-24T19:57:06.504895+0000","last_clean":"2023-12-24T19:57:06.504895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T19:57:06.504895+0000","last_undegraded":"2023-12-24T19:57:06.504895+0000","last_fullsized":"2023-12-24T19:57:06.504895+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364257,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":620,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364257,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195268,"statfs":{"total":200000000,"available":199954625,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]}],"pool_statfs":[]}} 2023-12-24T19:57:12.040 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:57:12.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.197+0000 7fe0bb527700 1 Processor -- start 2023-12-24T19:57:12.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.197+0000 7fe0bb527700 1 -- start start 2023-12-24T19:57:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0bb527700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe0b4159e60 0x7fe0b40c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0bb527700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0b4070d50 0x7fe0b40c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0bb527700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b406a090 con 0x7fe0b4159a90 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0bb527700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b406ac10 con 0x7fe0b4159e60 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0bb527700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b40c9e40 con 0x7fe0b4070d50 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0b8ac2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe0b4159e60 0x7fe0b40c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0b8ac2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe0b4159e60 0x7fe0b40c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53638/0 (socket says 172.21.15.61:53638) 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0b8ac2700 1 -- 172.21.15.61:0/3107999382 learned_addr learned my addr 172.21.15.61:0/3107999382 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0b9ac4700 1 --2- 172.21.15.61:0/3107999382 >> v2:172.21.15.133:3300/0 conn(0x7fe0b4070d50 0x7fe0b40c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0b8ac2700 1 -- 172.21.15.61:0/3107999382 >> v2:172.21.15.133:3300/0 conn(0x7fe0b4070d50 msgr2=0x7fe0b40c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0b8ac2700 1 --2- 172.21.15.61:0/3107999382 >> v2:172.21.15.133:3300/0 conn(0x7fe0b4070d50 0x7fe0b40c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0b8ac2700 1 -- 172.21.15.61:0/3107999382 >> v1:172.21.15.133:6789/0 conn(0x7fe0b4159a90 legacy=0x7fe0b4070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0b8ac2700 1 -- 172.21.15.61:0/3107999382 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b406a2e0 con 0x7fe0b4159e60 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0b8ac2700 1 --2- 172.21.15.61:0/3107999382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 0x7fe0b40c93c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40b37a0 tx=0x7fe0b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d510d19d32266d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0a7fff700 1 -- 172.21.15.61:0/3107999382 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000b820 con 0x7fe0b4159e60 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0a7fff700 1 -- 172.21.15.61:0/3107999382 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000b980 con 0x7fe0b4159e60 2023-12-24T19:57:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.198+0000 7fe0a7fff700 1 -- 172.21.15.61:0/3107999382 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000bd20 con 0x7fe0b4159e60 2023-12-24T19:57:12.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.199+0000 7fe0bb527700 1 -- 172.21.15.61:0/3107999382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 msgr2=0x7fe0b40c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.199+0000 7fe0bb527700 1 --2- 172.21.15.61:0/3107999382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 0x7fe0b40c93c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40b37a0 tx=0x7fe0b0009250 comp rx=0 tx=0).stop 2023-12-24T19:57:12.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.199+0000 7fe0bb527700 1 -- 172.21.15.61:0/3107999382 shutdown_connections 2023-12-24T19:57:12.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.199+0000 7fe0bb527700 1 --2- 172.21.15.61:0/3107999382 >> v2:172.21.15.133:3300/0 conn(0x7fe0b4070d50 0x7fe0b40c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.199+0000 7fe0bb527700 1 --2- 172.21.15.61:0/3107999382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 0x7fe0b40c93c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.199+0000 7fe0bb527700 1 -- 172.21.15.61:0/3107999382 >> 172.21.15.61:0/3107999382 conn(0x7fe0b40cd6f0 msgr2=0x7fe0b40cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:12.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.199+0000 7fe0bb527700 1 -- 172.21.15.61:0/3107999382 shutdown_connections 2023-12-24T19:57:12.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.199+0000 7fe0bb527700 1 -- 172.21.15.61:0/3107999382 wait complete. 2023-12-24T19:57:12.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.200+0000 7fe0bb527700 1 Processor -- start 2023-12-24T19:57:12.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.200+0000 7fe0bb527700 1 -- start start 2023-12-24T19:57:12.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0bb527700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4070d50 0x7fe0b416a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0bb527700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159a90 0x7fe0b4158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0bb527700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 0x7fe0b40c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0bb527700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b416a9b0 con 0x7fe0b4159e60 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0bb527700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b415b630 con 0x7fe0b4070d50 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0bb527700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b415b910 con 0x7fe0b4159a90 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0b9ac4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 0x7fe0b40c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0b9ac4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 0x7fe0b40c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53654/0 (socket says 172.21.15.61:53654) 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0b9ac4700 1 -- 172.21.15.61:0/3998659508 learned_addr learned my addr 172.21.15.61:0/3998659508 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0b92c3700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4070d50 0x7fe0b416a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0b8ac2700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159a90 0x7fe0b4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0b9ac4700 1 -- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159a90 msgr2=0x7fe0b4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0b9ac4700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159a90 0x7fe0b4158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0b9ac4700 1 -- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4070d50 msgr2=0x7fe0b416a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0b9ac4700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4070d50 0x7fe0b416a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.201+0000 7fe0b9ac4700 1 -- 172.21.15.61:0/3998659508 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b00094f0 con 0x7fe0b4159e60 2023-12-24T19:57:12.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.202+0000 7fe0b9ac4700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 0x7fe0b40c5eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00ceb0 tx=0x7fe0ac007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:12.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.202+0000 7fe0a57fa700 1 -- 172.21.15.61:0/3998659508 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac00ad90 con 0x7fe0b4159e60 2023-12-24T19:57:12.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.202+0000 7fe0a57fa700 1 -- 172.21.15.61:0/3998659508 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac016430 con 0x7fe0b4159e60 2023-12-24T19:57:12.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.202+0000 7fe0bb527700 1 -- 172.21.15.61:0/3998659508 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b415bbf0 con 0x7fe0b4159e60 2023-12-24T19:57:12.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.202+0000 7fe0a57fa700 1 -- 172.21.15.61:0/3998659508 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0167d0 con 0x7fe0b4159e60 2023-12-24T19:57:12.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.202+0000 7fe0bb527700 1 -- 172.21.15.61:0/3998659508 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b415c1b0 con 0x7fe0b4159e60 2023-12-24T19:57:12.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.203+0000 7fe0bb527700 1 -- 172.21.15.61:0/3998659508 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b404c3c0 con 0x7fe0b4159e60 2023-12-24T19:57:12.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.203+0000 7fe0a57fa700 1 -- 172.21.15.61:0/3998659508 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe0ac003020 con 0x7fe0b4159e60 2023-12-24T19:57:12.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.204+0000 7fe0a57fa700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 0x7fe0980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.204+0000 7fe0a57fa700 1 -- 172.21.15.61:0/3998659508 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0ac012070 con 0x7fe0b4159e60 2023-12-24T19:57:12.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.204+0000 7fe0b92c3700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 0x7fe0980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.204+0000 7fe0b92c3700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 0x7fe0980693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8003a30 tx=0x7fe0a8007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:12.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.208+0000 7fe0a57fa700 1 -- 172.21.15.61:0/3998659508 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0ac0525a0 con 0x7fe0b4159e60 2023-12-24T19:57:12.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.398+0000 7fe0bb527700 1 -- 172.21.15.61:0/3998659508 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0b415c3a0 con 0x7fe098066f30 2023-12-24T19:57:12.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.406+0000 7fe0a57fa700 1 -- 172.21.15.61:0/3998659508 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260189 (secure 0 0 0) 0x7fe0b415c3a0 con 0x7fe098066f30 2023-12-24T19:57:12.410 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 -- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 msgr2=0x7fe0980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 0x7fe0980693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8003a30 tx=0x7fe0a8007ea0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 -- 172.21.15.61:0/3998659508 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 msgr2=0x7fe0b40c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 0x7fe0b40c5eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00ceb0 tx=0x7fe0ac007870 comp rx=0 tx=0).stop 2023-12-24T19:57:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 -- 172.21.15.61:0/3998659508 shutdown_connections 2023-12-24T19:57:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 0x7fe0980693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0b4159e60 0x7fe0b40c5eb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b4070d50 0x7fe0b416a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 --2- 172.21.15.61:0/3998659508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159a90 0x7fe0b4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 -- 172.21.15.61:0/3998659508 >> 172.21.15.61:0/3998659508 conn(0x7fe0b40cd6f0 msgr2=0x7fe0b40b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 -- 172.21.15.61:0/3998659508 shutdown_connections 2023-12-24T19:57:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.409+0000 7fe0bb527700 1 -- 172.21.15.61:0/3998659508 wait complete. 2023-12-24T19:57:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:57:12.421 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-24T19:57:12.308866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1696,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560803,"statfs":{"total":1600000000,"available":1598263276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536218+0000","last_change":"2023-12-24T19:57:07.536146+0000","last_active":"2023-12-24T19:57:07.536218+0000","last_peered":"2023-12-24T19:57:07.536218+0000","last_clean":"2023-12-24T19:57:07.536218+0000","last_became_active":"2023-12-24T19:57:07.535549+0000","last_became_peered":"2023-12-24T19:57:07.535549+0000","last_unstale":"2023-12-24T19:57:07.536218+0000","last_undegraded":"2023-12-24T19:57:07.536218+0000","last_fullsized":"2023-12-24T19:57:07.536218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:52.100502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519135+0000","last_change":"2023-12-24T19:57:07.519070+0000","last_active":"2023-12-24T19:57:07.519135+0000","last_peered":"2023-12-24T19:57:07.519135+0000","last_clean":"2023-12-24T19:57:07.519135+0000","last_became_active":"2023-12-24T19:57:07.518830+0000","last_became_peered":"2023-12-24T19:57:07.518830+0000","last_unstale":"2023-12-24T19:57:07.519135+0000","last_undegraded":"2023-12-24T19:57:07.519135+0000","last_fullsized":"2023-12-24T19:57:07.519135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515907+0000","last_change":"2023-12-24T19:57:07.515829+0000","last_active":"2023-12-24T19:57:07.515907+0000","last_peered":"2023-12-24T19:57:07.515907+0000","last_clean":"2023-12-24T19:57:07.515907+0000","last_became_active":"2023-12-24T19:57:07.515554+0000","last_became_peered":"2023-12-24T19:57:07.515554+0000","last_unstale":"2023-12-24T19:57:07.515907+0000","last_undegraded":"2023-12-24T19:57:07.515907+0000","last_fullsized":"2023-12-24T19:57:07.515907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531866+0000","last_change":"2023-12-24T19:57:07.531458+0000","last_active":"2023-12-24T19:57:07.531866+0000","last_peered":"2023-12-24T19:57:07.531866+0000","last_clean":"2023-12-24T19:57:07.531866+0000","last_became_active":"2023-12-24T19:57:07.530225+0000","last_became_peered":"2023-12-24T19:57:07.530225+0000","last_unstale":"2023-12-24T19:57:07.531866+0000","last_undegraded":"2023-12-24T19:57:07.531866+0000","last_fullsized":"2023-12-24T19:57:07.531866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:21.152234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535982+0000","last_change":"2023-12-24T19:57:07.534875+0000","last_active":"2023-12-24T19:57:07.535982+0000","last_peered":"2023-12-24T19:57:07.535982+0000","last_clean":"2023-12-24T19:57:07.535982+0000","last_became_active":"2023-12-24T19:57:07.534444+0000","last_became_peered":"2023-12-24T19:57:07.534444+0000","last_unstale":"2023-12-24T19:57:07.535982+0000","last_undegraded":"2023-12-24T19:57:07.535982+0000","last_fullsized":"2023-12-24T19:57:07.535982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520980+0000","last_change":"2023-12-24T19:57:07.520108+0000","last_active":"2023-12-24T19:57:07.520980+0000","last_peered":"2023-12-24T19:57:07.520980+0000","last_clean":"2023-12-24T19:57:07.520980+0000","last_became_active":"2023-12-24T19:57:07.519639+0000","last_became_peered":"2023-12-24T19:57:07.519639+0000","last_unstale":"2023-12-24T19:57:07.520980+0000","last_undegraded":"2023-12-24T19:57:07.520980+0000","last_fullsized":"2023-12-24T19:57:07.520980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.537256+0000","last_change":"2023-12-24T19:57:07.537204+0000","last_active":"2023-12-24T19:57:07.537256+0000","last_peered":"2023-12-24T19:57:07.537256+0000","last_clean":"2023-12-24T19:57:07.537256+0000","last_became_active":"2023-12-24T19:57:07.535804+0000","last_became_peered":"2023-12-24T19:57:07.535804+0000","last_unstale":"2023-12-24T19:57:07.537256+0000","last_undegraded":"2023-12-24T19:57:07.537256+0000","last_fullsized":"2023-12-24T19:57:07.537256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:08:43.312235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525929+0000","last_change":"2023-12-24T19:57:07.525839+0000","last_active":"2023-12-24T19:57:07.525929+0000","last_peered":"2023-12-24T19:57:07.525929+0000","last_clean":"2023-12-24T19:57:07.525929+0000","last_became_active":"2023-12-24T19:57:07.525535+0000","last_became_peered":"2023-12-24T19:57:07.525535+0000","last_unstale":"2023-12-24T19:57:07.525929+0000","last_undegraded":"2023-12-24T19:57:07.525929+0000","last_fullsized":"2023-12-24T19:57:07.525929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532601+0000","last_change":"2023-12-24T19:57:07.532497+0000","last_active":"2023-12-24T19:57:07.532601+0000","last_peered":"2023-12-24T19:57:07.532601+0000","last_clean":"2023-12-24T19:57:07.532601+0000","last_became_active":"2023-12-24T19:57:07.532280+0000","last_became_peered":"2023-12-24T19:57:07.532280+0000","last_unstale":"2023-12-24T19:57:07.532601+0000","last_undegraded":"2023-12-24T19:57:07.532601+0000","last_fullsized":"2023-12-24T19:57:07.532601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:01.279518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520933+0000","last_change":"2023-12-24T19:57:07.520487+0000","last_active":"2023-12-24T19:57:07.520933+0000","last_peered":"2023-12-24T19:57:07.520933+0000","last_clean":"2023-12-24T19:57:07.520933+0000","last_became_active":"2023-12-24T19:57:07.520238+0000","last_became_peered":"2023-12-24T19:57:07.520238+0000","last_unstale":"2023-12-24T19:57:07.520933+0000","last_undegraded":"2023-12-24T19:57:07.520933+0000","last_fullsized":"2023-12-24T19:57:07.520933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:16:20.311262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.521578+0000","last_change":"2023-12-24T19:57:07.521484+0000","last_active":"2023-12-24T19:57:07.521578+0000","last_peered":"2023-12-24T19:57:07.521578+0000","last_clean":"2023-12-24T19:57:07.521578+0000","last_became_active":"2023-12-24T19:57:07.521255+0000","last_became_peered":"2023-12-24T19:57:07.521255+0000","last_unstale":"2023-12-24T19:57:07.521578+0000","last_undegraded":"2023-12-24T19:57:07.521578+0000","last_fullsized":"2023-12-24T19:57:07.521578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527053+0000","last_change":"2023-12-24T19:57:07.526737+0000","last_active":"2023-12-24T19:57:07.527053+0000","last_peered":"2023-12-24T19:57:07.527053+0000","last_clean":"2023-12-24T19:57:07.527053+0000","last_became_active":"2023-12-24T19:57:07.526481+0000","last_became_peered":"2023-12-24T19:57:07.526481+0000","last_unstale":"2023-12-24T19:57:07.527053+0000","last_undegraded":"2023-12-24T19:57:07.527053+0000","last_fullsized":"2023-12-24T19:57:07.527053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:15.825581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530680+0000","last_change":"2023-12-24T19:57:07.530165+0000","last_active":"2023-12-24T19:57:07.530680+0000","last_peered":"2023-12-24T19:57:07.530680+0000","last_clean":"2023-12-24T19:57:07.530680+0000","last_became_active":"2023-12-24T19:57:07.529444+0000","last_became_peered":"2023-12-24T19:57:07.529444+0000","last_unstale":"2023-12-24T19:57:07.530680+0000","last_undegraded":"2023-12-24T19:57:07.530680+0000","last_fullsized":"2023-12-24T19:57:07.530680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518630+0000","last_change":"2023-12-24T19:57:07.518298+0000","last_active":"2023-12-24T19:57:07.518630+0000","last_peered":"2023-12-24T19:57:07.518630+0000","last_clean":"2023-12-24T19:57:07.518630+0000","last_became_active":"2023-12-24T19:57:07.517984+0000","last_became_peered":"2023-12-24T19:57:07.517984+0000","last_unstale":"2023-12-24T19:57:07.518630+0000","last_undegraded":"2023-12-24T19:57:07.518630+0000","last_fullsized":"2023-12-24T19:57:07.518630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524033+0000","last_change":"2023-12-24T19:57:07.523925+0000","last_active":"2023-12-24T19:57:07.524033+0000","last_peered":"2023-12-24T19:57:07.524033+0000","last_clean":"2023-12-24T19:57:07.524033+0000","last_became_active":"2023-12-24T19:57:07.523700+0000","last_became_peered":"2023-12-24T19:57:07.523700+0000","last_unstale":"2023-12-24T19:57:07.524033+0000","last_undegraded":"2023-12-24T19:57:07.524033+0000","last_fullsized":"2023-12-24T19:57:07.524033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520963+0000","last_change":"2023-12-24T19:57:07.519865+0000","last_active":"2023-12-24T19:57:07.520963+0000","last_peered":"2023-12-24T19:57:07.520963+0000","last_clean":"2023-12-24T19:57:07.520963+0000","last_became_active":"2023-12-24T19:57:07.519280+0000","last_became_peered":"2023-12-24T19:57:07.519280+0000","last_unstale":"2023-12-24T19:57:07.520963+0000","last_undegraded":"2023-12-24T19:57:07.520963+0000","last_fullsized":"2023-12-24T19:57:07.520963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535309+0000","last_change":"2023-12-24T19:57:07.535246+0000","last_active":"2023-12-24T19:57:07.535309+0000","last_peered":"2023-12-24T19:57:07.535309+0000","last_clean":"2023-12-24T19:57:07.535309+0000","last_became_active":"2023-12-24T19:57:07.534766+0000","last_became_peered":"2023-12-24T19:57:07.534766+0000","last_unstale":"2023-12-24T19:57:07.535309+0000","last_undegraded":"2023-12-24T19:57:07.535309+0000","last_fullsized":"2023-12-24T19:57:07.535309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:01.279518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518582+0000","last_change":"2023-12-24T19:57:07.518511+0000","last_active":"2023-12-24T19:57:07.518582+0000","last_peered":"2023-12-24T19:57:07.518582+0000","last_clean":"2023-12-24T19:57:07.518582+0000","last_became_active":"2023-12-24T19:57:07.518256+0000","last_became_peered":"2023-12-24T19:57:07.518256+0000","last_unstale":"2023-12-24T19:57:07.518582+0000","last_undegraded":"2023-12-24T19:57:07.518582+0000","last_fullsized":"2023-12-24T19:57:07.518582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535963+0000","last_change":"2023-12-24T19:57:07.534422+0000","last_active":"2023-12-24T19:57:07.535963+0000","last_peered":"2023-12-24T19:57:07.535963+0000","last_clean":"2023-12-24T19:57:07.535963+0000","last_became_active":"2023-12-24T19:57:07.533941+0000","last_became_peered":"2023-12-24T19:57:07.533941+0000","last_unstale":"2023-12-24T19:57:07.535963+0000","last_undegraded":"2023-12-24T19:57:07.535963+0000","last_fullsized":"2023-12-24T19:57:07.535963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529337+0000","last_change":"2023-12-24T19:57:06.524904+0000","last_active":"2023-12-24T19:57:07.529337+0000","last_peered":"2023-12-24T19:57:07.529337+0000","last_clean":"2023-12-24T19:57:07.529337+0000","last_became_active":"2023-12-24T19:57:06.524655+0000","last_became_peered":"2023-12-24T19:57:06.524655+0000","last_unstale":"2023-12-24T19:57:07.529337+0000","last_undegraded":"2023-12-24T19:57:07.529337+0000","last_fullsized":"2023-12-24T19:57:07.529337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530981+0000","last_change":"2023-12-24T19:57:07.530215+0000","last_active":"2023-12-24T19:57:07.530981+0000","last_peered":"2023-12-24T19:57:07.530981+0000","last_clean":"2023-12-24T19:57:07.530981+0000","last_became_active":"2023-12-24T19:57:07.529530+0000","last_became_peered":"2023-12-24T19:57:07.529530+0000","last_unstale":"2023-12-24T19:57:07.530981+0000","last_undegraded":"2023-12-24T19:57:07.530981+0000","last_fullsized":"2023-12-24T19:57:07.530981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:52.100502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530889+0000","last_change":"2023-12-24T19:57:06.513334+0000","last_active":"2023-12-24T19:57:07.530889+0000","last_peered":"2023-12-24T19:57:07.530889+0000","last_clean":"2023-12-24T19:57:07.530889+0000","last_became_active":"2023-12-24T19:57:06.513019+0000","last_became_peered":"2023-12-24T19:57:06.513019+0000","last_unstale":"2023-12-24T19:57:07.530889+0000","last_undegraded":"2023-12-24T19:57:07.530889+0000","last_fullsized":"2023-12-24T19:57:07.530889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517778+0000","last_change":"2023-12-24T19:57:07.517103+0000","last_active":"2023-12-24T19:57:07.517778+0000","last_peered":"2023-12-24T19:57:07.517778+0000","last_clean":"2023-12-24T19:57:07.517778+0000","last_became_active":"2023-12-24T19:57:07.516861+0000","last_became_peered":"2023-12-24T19:57:07.516861+0000","last_unstale":"2023-12-24T19:57:07.517778+0000","last_undegraded":"2023-12-24T19:57:07.517778+0000","last_fullsized":"2023-12-24T19:57:07.517778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536144+0000","last_change":"2023-12-24T19:57:06.525249+0000","last_active":"2023-12-24T19:57:07.536144+0000","last_peered":"2023-12-24T19:57:07.536144+0000","last_clean":"2023-12-24T19:57:07.536144+0000","last_became_active":"2023-12-24T19:57:06.525009+0000","last_became_peered":"2023-12-24T19:57:06.525009+0000","last_unstale":"2023-12-24T19:57:07.536144+0000","last_undegraded":"2023-12-24T19:57:07.536144+0000","last_fullsized":"2023-12-24T19:57:07.536144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:07.722680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523253+0000","last_change":"2023-12-24T19:57:07.523010+0000","last_active":"2023-12-24T19:57:07.523253+0000","last_peered":"2023-12-24T19:57:07.523253+0000","last_clean":"2023-12-24T19:57:07.523253+0000","last_became_active":"2023-12-24T19:57:07.522733+0000","last_became_peered":"2023-12-24T19:57:07.522733+0000","last_unstale":"2023-12-24T19:57:07.523253+0000","last_undegraded":"2023-12-24T19:57:07.523253+0000","last_fullsized":"2023-12-24T19:57:07.523253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532233+0000","last_change":"2023-12-24T19:57:06.527966+0000","last_active":"2023-12-24T19:57:07.532233+0000","last_peered":"2023-12-24T19:57:07.532233+0000","last_clean":"2023-12-24T19:57:07.532233+0000","last_became_active":"2023-12-24T19:57:06.527733+0000","last_became_peered":"2023-12-24T19:57:06.527733+0000","last_unstale":"2023-12-24T19:57:07.532233+0000","last_undegraded":"2023-12-24T19:57:07.532233+0000","last_fullsized":"2023-12-24T19:57:07.532233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:51.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523731+0000","last_change":"2023-12-24T19:57:07.523651+0000","last_active":"2023-12-24T19:57:07.523731+0000","last_peered":"2023-12-24T19:57:07.523731+0000","last_clean":"2023-12-24T19:57:07.523731+0000","last_became_active":"2023-12-24T19:57:07.523421+0000","last_became_peered":"2023-12-24T19:57:07.523421+0000","last_unstale":"2023-12-24T19:57:07.523731+0000","last_undegraded":"2023-12-24T19:57:07.523731+0000","last_fullsized":"2023-12-24T19:57:07.523731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528856+0000","last_change":"2023-12-24T19:57:06.525065+0000","last_active":"2023-12-24T19:57:07.528856+0000","last_peered":"2023-12-24T19:57:07.528856+0000","last_clean":"2023-12-24T19:57:07.528856+0000","last_became_active":"2023-12-24T19:57:06.524824+0000","last_became_peered":"2023-12-24T19:57:06.524824+0000","last_unstale":"2023-12-24T19:57:07.528856+0000","last_undegraded":"2023-12-24T19:57:07.528856+0000","last_fullsized":"2023-12-24T19:57:07.528856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:17.717686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523500+0000","last_change":"2023-12-24T19:57:07.523416+0000","last_active":"2023-12-24T19:57:07.523500+0000","last_peered":"2023-12-24T19:57:07.523500+0000","last_clean":"2023-12-24T19:57:07.523500+0000","last_became_active":"2023-12-24T19:57:07.523188+0000","last_became_peered":"2023-12-24T19:57:07.523188+0000","last_unstale":"2023-12-24T19:57:07.523500+0000","last_undegraded":"2023-12-24T19:57:07.523500+0000","last_fullsized":"2023-12-24T19:57:07.523500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:47.622467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528383+0000","last_change":"2023-12-24T19:57:06.523002+0000","last_active":"2023-12-24T19:57:07.528383+0000","last_peered":"2023-12-24T19:57:07.528383+0000","last_clean":"2023-12-24T19:57:07.528383+0000","last_became_active":"2023-12-24T19:57:06.522751+0000","last_became_peered":"2023-12-24T19:57:06.522751+0000","last_unstale":"2023-12-24T19:57:07.528383+0000","last_undegraded":"2023-12-24T19:57:07.528383+0000","last_fullsized":"2023-12-24T19:57:07.528383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524533+0000","last_change":"2023-12-24T19:57:07.524449+0000","last_active":"2023-12-24T19:57:07.524533+0000","last_peered":"2023-12-24T19:57:07.524533+0000","last_clean":"2023-12-24T19:57:07.524533+0000","last_became_active":"2023-12-24T19:57:07.524202+0000","last_became_peered":"2023-12-24T19:57:07.524202+0000","last_unstale":"2023-12-24T19:57:07.524533+0000","last_undegraded":"2023-12-24T19:57:07.524533+0000","last_fullsized":"2023-12-24T19:57:07.524533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526502+0000","last_change":"2023-12-24T19:57:06.524481+0000","last_active":"2023-12-24T19:57:07.526502+0000","last_peered":"2023-12-24T19:57:07.526502+0000","last_clean":"2023-12-24T19:57:07.526502+0000","last_became_active":"2023-12-24T19:57:06.523848+0000","last_became_peered":"2023-12-24T19:57:06.523848+0000","last_unstale":"2023-12-24T19:57:07.526502+0000","last_undegraded":"2023-12-24T19:57:07.526502+0000","last_fullsized":"2023-12-24T19:57:07.526502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525501+0000","last_change":"2023-12-24T19:57:07.525363+0000","last_active":"2023-12-24T19:57:07.525501+0000","last_peered":"2023-12-24T19:57:07.525501+0000","last_clean":"2023-12-24T19:57:07.525501+0000","last_became_active":"2023-12-24T19:57:07.524804+0000","last_became_peered":"2023-12-24T19:57:07.524804+0000","last_unstale":"2023-12-24T19:57:07.525501+0000","last_undegraded":"2023-12-24T19:57:07.525501+0000","last_fullsized":"2023-12-24T19:57:07.525501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:38.268155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516808+0000","last_change":"2023-12-24T19:57:06.522784+0000","last_active":"2023-12-24T19:57:07.516808+0000","last_peered":"2023-12-24T19:57:07.516808+0000","last_clean":"2023-12-24T19:57:07.516808+0000","last_became_active":"2023-12-24T19:57:06.522559+0000","last_became_peered":"2023-12-24T19:57:06.522559+0000","last_unstale":"2023-12-24T19:57:07.516808+0000","last_undegraded":"2023-12-24T19:57:07.516808+0000","last_fullsized":"2023-12-24T19:57:07.516808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529007+0000","last_change":"2023-12-24T19:57:07.528916+0000","last_active":"2023-12-24T19:57:07.529007+0000","last_peered":"2023-12-24T19:57:07.529007+0000","last_clean":"2023-12-24T19:57:07.529007+0000","last_became_active":"2023-12-24T19:57:07.528614+0000","last_became_peered":"2023-12-24T19:57:07.528614+0000","last_unstale":"2023-12-24T19:57:07.529007+0000","last_undegraded":"2023-12-24T19:57:07.529007+0000","last_fullsized":"2023-12-24T19:57:07.529007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518133+0000","last_change":"2023-12-24T19:57:06.521620+0000","last_active":"2023-12-24T19:57:07.518133+0000","last_peered":"2023-12-24T19:57:07.518133+0000","last_clean":"2023-12-24T19:57:07.518133+0000","last_became_active":"2023-12-24T19:57:06.521329+0000","last_became_peered":"2023-12-24T19:57:06.521329+0000","last_unstale":"2023-12-24T19:57:07.518133+0000","last_undegraded":"2023-12-24T19:57:07.518133+0000","last_fullsized":"2023-12-24T19:57:07.518133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535124+0000","last_change":"2023-12-24T19:57:07.534974+0000","last_active":"2023-12-24T19:57:07.535124+0000","last_peered":"2023-12-24T19:57:07.535124+0000","last_clean":"2023-12-24T19:57:07.535124+0000","last_became_active":"2023-12-24T19:57:07.534336+0000","last_became_peered":"2023-12-24T19:57:07.534336+0000","last_unstale":"2023-12-24T19:57:07.535124+0000","last_undegraded":"2023-12-24T19:57:07.535124+0000","last_fullsized":"2023-12-24T19:57:07.535124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:21.111646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515712+0000","last_change":"2023-12-24T19:57:06.525016+0000","last_active":"2023-12-24T19:57:07.515712+0000","last_peered":"2023-12-24T19:57:07.515712+0000","last_clean":"2023-12-24T19:57:07.515712+0000","last_became_active":"2023-12-24T19:57:06.524783+0000","last_became_peered":"2023-12-24T19:57:06.524783+0000","last_unstale":"2023-12-24T19:57:07.515712+0000","last_undegraded":"2023-12-24T19:57:07.515712+0000","last_fullsized":"2023-12-24T19:57:07.515712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519757+0000","last_change":"2023-12-24T19:57:07.519678+0000","last_active":"2023-12-24T19:57:07.519757+0000","last_peered":"2023-12-24T19:57:07.519757+0000","last_clean":"2023-12-24T19:57:07.519757+0000","last_became_active":"2023-12-24T19:57:07.519439+0000","last_became_peered":"2023-12-24T19:57:07.519439+0000","last_unstale":"2023-12-24T19:57:07.519757+0000","last_undegraded":"2023-12-24T19:57:07.519757+0000","last_fullsized":"2023-12-24T19:57:07.519757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525729+0000","last_change":"2023-12-24T19:57:06.520438+0000","last_active":"2023-12-24T19:57:07.525729+0000","last_peered":"2023-12-24T19:57:07.525729+0000","last_clean":"2023-12-24T19:57:07.525729+0000","last_became_active":"2023-12-24T19:57:06.520107+0000","last_became_peered":"2023-12-24T19:57:06.520107+0000","last_unstale":"2023-12-24T19:57:07.525729+0000","last_undegraded":"2023-12-24T19:57:07.525729+0000","last_fullsized":"2023-12-24T19:57:07.525729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:18.362103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529743+0000","last_change":"2023-12-24T19:57:07.528796+0000","last_active":"2023-12-24T19:57:07.529743+0000","last_peered":"2023-12-24T19:57:07.529743+0000","last_clean":"2023-12-24T19:57:07.529743+0000","last_became_active":"2023-12-24T19:57:07.528655+0000","last_became_peered":"2023-12-24T19:57:07.528655+0000","last_unstale":"2023-12-24T19:57:07.529743+0000","last_undegraded":"2023-12-24T19:57:07.529743+0000","last_fullsized":"2023-12-24T19:57:07.529743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534720+0000","last_change":"2023-12-24T19:57:06.521232+0000","last_active":"2023-12-24T19:57:07.534720+0000","last_peered":"2023-12-24T19:57:07.534720+0000","last_clean":"2023-12-24T19:57:07.534720+0000","last_became_active":"2023-12-24T19:57:06.520781+0000","last_became_peered":"2023-12-24T19:57:06.520781+0000","last_unstale":"2023-12-24T19:57:07.534720+0000","last_undegraded":"2023-12-24T19:57:07.534720+0000","last_fullsized":"2023-12-24T19:57:07.534720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530590+0000","last_change":"2023-12-24T19:57:07.530411+0000","last_active":"2023-12-24T19:57:07.530590+0000","last_peered":"2023-12-24T19:57:07.530590+0000","last_clean":"2023-12-24T19:57:07.530590+0000","last_became_active":"2023-12-24T19:57:07.530142+0000","last_became_peered":"2023-12-24T19:57:07.530142+0000","last_unstale":"2023-12-24T19:57:07.530590+0000","last_undegraded":"2023-12-24T19:57:07.530590+0000","last_fullsized":"2023-12-24T19:57:07.530590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:49.060653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527723+0000","last_change":"2023-12-24T19:57:06.518450+0000","last_active":"2023-12-24T19:57:07.527723+0000","last_peered":"2023-12-24T19:57:07.527723+0000","last_clean":"2023-12-24T19:57:07.527723+0000","last_became_active":"2023-12-24T19:57:06.518168+0000","last_became_peered":"2023-12-24T19:57:06.518168+0000","last_unstale":"2023-12-24T19:57:07.527723+0000","last_undegraded":"2023-12-24T19:57:07.527723+0000","last_fullsized":"2023-12-24T19:57:07.527723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:34.036458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534331+0000","last_change":"2023-12-24T19:57:07.534267+0000","last_active":"2023-12-24T19:57:07.534331+0000","last_peered":"2023-12-24T19:57:07.534331+0000","last_clean":"2023-12-24T19:57:07.534331+0000","last_became_active":"2023-12-24T19:57:07.533743+0000","last_became_peered":"2023-12-24T19:57:07.533743+0000","last_unstale":"2023-12-24T19:57:07.534331+0000","last_undegraded":"2023-12-24T19:57:07.534331+0000","last_fullsized":"2023-12-24T19:57:07.534331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516585+0000","last_change":"2023-12-24T19:57:06.519259+0000","last_active":"2023-12-24T19:57:07.516585+0000","last_peered":"2023-12-24T19:57:07.516585+0000","last_clean":"2023-12-24T19:57:07.516585+0000","last_became_active":"2023-12-24T19:57:06.518732+0000","last_became_peered":"2023-12-24T19:57:06.518732+0000","last_unstale":"2023-12-24T19:57:07.516585+0000","last_undegraded":"2023-12-24T19:57:07.516585+0000","last_fullsized":"2023-12-24T19:57:07.516585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535999+0000","last_change":"2023-12-24T19:57:07.535031+0000","last_active":"2023-12-24T19:57:07.535999+0000","last_peered":"2023-12-24T19:57:07.535999+0000","last_clean":"2023-12-24T19:57:07.535999+0000","last_became_active":"2023-12-24T19:57:07.534715+0000","last_became_peered":"2023-12-24T19:57:07.534715+0000","last_unstale":"2023-12-24T19:57:07.535999+0000","last_undegraded":"2023-12-24T19:57:07.535999+0000","last_fullsized":"2023-12-24T19:57:07.535999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:21.111646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517413+0000","last_change":"2023-12-24T19:57:06.524250+0000","last_active":"2023-12-24T19:57:07.517413+0000","last_peered":"2023-12-24T19:57:07.517413+0000","last_clean":"2023-12-24T19:57:07.517413+0000","last_became_active":"2023-12-24T19:57:06.523702+0000","last_became_peered":"2023-12-24T19:57:06.523702+0000","last_unstale":"2023-12-24T19:57:07.517413+0000","last_undegraded":"2023-12-24T19:57:07.517413+0000","last_fullsized":"2023-12-24T19:57:07.517413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520473+0000","last_change":"2023-12-24T19:57:07.520401+0000","last_active":"2023-12-24T19:57:07.520473+0000","last_peered":"2023-12-24T19:57:07.520473+0000","last_clean":"2023-12-24T19:57:07.520473+0000","last_became_active":"2023-12-24T19:57:07.520170+0000","last_became_peered":"2023-12-24T19:57:07.520170+0000","last_unstale":"2023-12-24T19:57:07.520473+0000","last_undegraded":"2023-12-24T19:57:07.520473+0000","last_fullsized":"2023-12-24T19:57:07.520473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530362+0000","last_change":"2023-12-24T19:57:06.526329+0000","last_active":"2023-12-24T19:57:07.530362+0000","last_peered":"2023-12-24T19:57:07.530362+0000","last_clean":"2023-12-24T19:57:07.530362+0000","last_became_active":"2023-12-24T19:57:06.525718+0000","last_became_peered":"2023-12-24T19:57:06.525718+0000","last_unstale":"2023-12-24T19:57:07.530362+0000","last_undegraded":"2023-12-24T19:57:07.530362+0000","last_fullsized":"2023-12-24T19:57:07.530362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.537377+0000","last_change":"2023-12-24T19:57:07.537325+0000","last_active":"2023-12-24T19:57:07.537377+0000","last_peered":"2023-12-24T19:57:07.537377+0000","last_clean":"2023-12-24T19:57:07.537377+0000","last_became_active":"2023-12-24T19:57:07.536102+0000","last_became_peered":"2023-12-24T19:57:07.536102+0000","last_unstale":"2023-12-24T19:57:07.537377+0000","last_undegraded":"2023-12-24T19:57:07.537377+0000","last_fullsized":"2023-12-24T19:57:07.537377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:52:11.849851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528207+0000","last_change":"2023-12-24T19:57:06.518295+0000","last_active":"2023-12-24T19:57:07.528207+0000","last_peered":"2023-12-24T19:57:07.528207+0000","last_clean":"2023-12-24T19:57:07.528207+0000","last_became_active":"2023-12-24T19:57:06.516591+0000","last_became_peered":"2023-12-24T19:57:06.516591+0000","last_unstale":"2023-12-24T19:57:07.528207+0000","last_undegraded":"2023-12-24T19:57:07.528207+0000","last_fullsized":"2023-12-24T19:57:07.528207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:34.036458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536964+0000","last_change":"2023-12-24T19:57:07.536755+0000","last_active":"2023-12-24T19:57:07.536964+0000","last_peered":"2023-12-24T19:57:07.536964+0000","last_clean":"2023-12-24T19:57:07.536964+0000","last_became_active":"2023-12-24T19:57:07.536502+0000","last_became_peered":"2023-12-24T19:57:07.536502+0000","last_unstale":"2023-12-24T19:57:07.536964+0000","last_undegraded":"2023-12-24T19:57:07.536964+0000","last_fullsized":"2023-12-24T19:57:07.536964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:21.152234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517131+0000","last_change":"2023-12-24T19:57:06.519180+0000","last_active":"2023-12-24T19:57:07.517131+0000","last_peered":"2023-12-24T19:57:07.517131+0000","last_clean":"2023-12-24T19:57:07.517131+0000","last_became_active":"2023-12-24T19:57:06.518906+0000","last_became_peered":"2023-12-24T19:57:06.518906+0000","last_unstale":"2023-12-24T19:57:07.517131+0000","last_undegraded":"2023-12-24T19:57:07.517131+0000","last_fullsized":"2023-12-24T19:57:07.517131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531876+0000","last_change":"2023-12-24T19:57:07.531626+0000","last_active":"2023-12-24T19:57:07.531876+0000","last_peered":"2023-12-24T19:57:07.531876+0000","last_clean":"2023-12-24T19:57:07.531876+0000","last_became_active":"2023-12-24T19:57:07.530556+0000","last_became_peered":"2023-12-24T19:57:07.530556+0000","last_unstale":"2023-12-24T19:57:07.531876+0000","last_undegraded":"2023-12-24T19:57:07.531876+0000","last_fullsized":"2023-12-24T19:57:07.531876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:43:42.570184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515831+0000","last_change":"2023-12-24T19:57:06.522317+0000","last_active":"2023-12-24T19:57:07.515831+0000","last_peered":"2023-12-24T19:57:07.515831+0000","last_clean":"2023-12-24T19:57:07.515831+0000","last_became_active":"2023-12-24T19:57:06.521804+0000","last_became_peered":"2023-12-24T19:57:06.521804+0000","last_unstale":"2023-12-24T19:57:07.515831+0000","last_undegraded":"2023-12-24T19:57:07.515831+0000","last_fullsized":"2023-12-24T19:57:07.515831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525176+0000","last_change":"2023-12-24T19:57:07.525106+0000","last_active":"2023-12-24T19:57:07.525176+0000","last_peered":"2023-12-24T19:57:07.525176+0000","last_clean":"2023-12-24T19:57:07.525176+0000","last_became_active":"2023-12-24T19:57:07.524852+0000","last_became_peered":"2023-12-24T19:57:07.524852+0000","last_unstale":"2023-12-24T19:57:07.525176+0000","last_undegraded":"2023-12-24T19:57:07.525176+0000","last_fullsized":"2023-12-24T19:57:07.525176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:19.368177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517665+0000","last_change":"2023-12-24T19:57:07.517596+0000","last_active":"2023-12-24T19:57:07.517665+0000","last_peered":"2023-12-24T19:57:07.517665+0000","last_clean":"2023-12-24T19:57:07.517665+0000","last_became_active":"2023-12-24T19:57:07.517352+0000","last_became_peered":"2023-12-24T19:57:07.517352+0000","last_unstale":"2023-12-24T19:57:07.517665+0000","last_undegraded":"2023-12-24T19:57:07.517665+0000","last_fullsized":"2023-12-24T19:57:07.517665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.513830+0000","last_change":"2023-12-24T19:57:06.526469+0000","last_active":"2023-12-24T19:57:07.513830+0000","last_peered":"2023-12-24T19:57:07.513830+0000","last_clean":"2023-12-24T19:57:07.513830+0000","last_became_active":"2023-12-24T19:57:06.526071+0000","last_became_peered":"2023-12-24T19:57:06.526071+0000","last_unstale":"2023-12-24T19:57:07.513830+0000","last_undegraded":"2023-12-24T19:57:07.513830+0000","last_fullsized":"2023-12-24T19:57:07.513830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527346+0000","last_change":"2023-12-24T19:57:07.527208+0000","last_active":"2023-12-24T19:57:07.527346+0000","last_peered":"2023-12-24T19:57:07.527346+0000","last_clean":"2023-12-24T19:57:07.527346+0000","last_became_active":"2023-12-24T19:57:07.526792+0000","last_became_peered":"2023-12-24T19:57:07.526792+0000","last_unstale":"2023-12-24T19:57:07.527346+0000","last_undegraded":"2023-12-24T19:57:07.527346+0000","last_fullsized":"2023-12-24T19:57:07.527346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:43:42.570184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516700+0000","last_change":"2023-12-24T19:57:06.521786+0000","last_active":"2023-12-24T19:57:07.516700+0000","last_peered":"2023-12-24T19:57:07.516700+0000","last_clean":"2023-12-24T19:57:07.516700+0000","last_became_active":"2023-12-24T19:57:06.521491+0000","last_became_peered":"2023-12-24T19:57:06.521491+0000","last_unstale":"2023-12-24T19:57:07.516700+0000","last_undegraded":"2023-12-24T19:57:07.516700+0000","last_fullsized":"2023-12-24T19:57:07.516700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527038+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:57:07.527038+0000","last_peered":"2023-12-24T19:57:07.527038+0000","last_clean":"2023-12-24T19:57:07.527038+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:57:07.527038+0000","last_undegraded":"2023-12-24T19:57:07.527038+0000","last_fullsized":"2023-12-24T19:57:07.527038+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526944+0000","last_change":"2023-12-24T19:57:07.526851+0000","last_active":"2023-12-24T19:57:07.526944+0000","last_peered":"2023-12-24T19:57:07.526944+0000","last_clean":"2023-12-24T19:57:07.526944+0000","last_became_active":"2023-12-24T19:57:07.526572+0000","last_became_peered":"2023-12-24T19:57:07.526572+0000","last_unstale":"2023-12-24T19:57:07.526944+0000","last_undegraded":"2023-12-24T19:57:07.526944+0000","last_fullsized":"2023-12-24T19:57:07.526944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526230+0000","last_change":"2023-12-24T19:57:06.527232+0000","last_active":"2023-12-24T19:57:07.526230+0000","last_peered":"2023-12-24T19:57:07.526230+0000","last_clean":"2023-12-24T19:57:07.526230+0000","last_became_active":"2023-12-24T19:57:06.526965+0000","last_became_peered":"2023-12-24T19:57:06.526965+0000","last_unstale":"2023-12-24T19:57:07.526230+0000","last_undegraded":"2023-12-24T19:57:07.526230+0000","last_fullsized":"2023-12-24T19:57:07.526230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526332+0000","last_change":"2023-12-24T19:57:06.527833+0000","last_active":"2023-12-24T19:57:07.526332+0000","last_peered":"2023-12-24T19:57:07.526332+0000","last_clean":"2023-12-24T19:57:07.526332+0000","last_became_active":"2023-12-24T19:57:06.527507+0000","last_became_peered":"2023-12-24T19:57:06.527507+0000","last_unstale":"2023-12-24T19:57:07.526332+0000","last_undegraded":"2023-12-24T19:57:07.526332+0000","last_fullsized":"2023-12-24T19:57:07.526332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517724+0000","last_change":"2023-12-24T19:57:07.517660+0000","last_active":"2023-12-24T19:57:07.517724+0000","last_peered":"2023-12-24T19:57:07.517724+0000","last_clean":"2023-12-24T19:57:07.517724+0000","last_became_active":"2023-12-24T19:57:07.517397+0000","last_became_peered":"2023-12-24T19:57:07.517397+0000","last_unstale":"2023-12-24T19:57:07.517724+0000","last_undegraded":"2023-12-24T19:57:07.517724+0000","last_fullsized":"2023-12-24T19:57:07.517724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-24T19:57:08.515389+0000","last_change":"2023-12-24T19:57:06.525879+0000","last_active":"2023-12-24T19:57:08.515389+0000","last_peered":"2023-12-24T19:57:08.515389+0000","last_clean":"2023-12-24T19:57:08.515389+0000","last_became_active":"2023-12-24T19:57:06.525637+0000","last_became_peered":"2023-12-24T19:57:06.525637+0000","last_unstale":"2023-12-24T19:57:08.515389+0000","last_undegraded":"2023-12-24T19:57:08.515389+0000","last_fullsized":"2023-12-24T19:57:08.515389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:46.616394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534151+0000","last_change":"2023-12-24T19:57:07.534062+0000","last_active":"2023-12-24T19:57:07.534151+0000","last_peered":"2023-12-24T19:57:07.534151+0000","last_clean":"2023-12-24T19:57:07.534151+0000","last_became_active":"2023-12-24T19:57:07.533898+0000","last_became_peered":"2023-12-24T19:57:07.533898+0000","last_unstale":"2023-12-24T19:57:07.534151+0000","last_undegraded":"2023-12-24T19:57:07.534151+0000","last_fullsized":"2023-12-24T19:57:07.534151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536398+0000","last_change":"2023-12-24T19:57:06.525416+0000","last_active":"2023-12-24T19:57:07.536398+0000","last_peered":"2023-12-24T19:57:07.536398+0000","last_clean":"2023-12-24T19:57:07.536398+0000","last_became_active":"2023-12-24T19:57:06.525105+0000","last_became_peered":"2023-12-24T19:57:06.525105+0000","last_unstale":"2023-12-24T19:57:07.536398+0000","last_undegraded":"2023-12-24T19:57:07.536398+0000","last_fullsized":"2023-12-24T19:57:07.536398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518611+0000","last_change":"2023-12-24T19:57:07.518192+0000","last_active":"2023-12-24T19:57:07.518611+0000","last_peered":"2023-12-24T19:57:07.518611+0000","last_clean":"2023-12-24T19:57:07.518611+0000","last_became_active":"2023-12-24T19:57:07.517957+0000","last_became_peered":"2023-12-24T19:57:07.517957+0000","last_unstale":"2023-12-24T19:57:07.518611+0000","last_undegraded":"2023-12-24T19:57:07.518611+0000","last_fullsized":"2023-12-24T19:57:07.518611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526634+0000","last_change":"2023-12-24T19:57:06.526486+0000","last_active":"2023-12-24T19:57:07.526634+0000","last_peered":"2023-12-24T19:57:07.526634+0000","last_clean":"2023-12-24T19:57:07.526634+0000","last_became_active":"2023-12-24T19:57:06.526260+0000","last_became_peered":"2023-12-24T19:57:06.526260+0000","last_unstale":"2023-12-24T19:57:07.526634+0000","last_undegraded":"2023-12-24T19:57:07.526634+0000","last_fullsized":"2023-12-24T19:57:07.526634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:46.616394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525256+0000","last_change":"2023-12-24T19:57:07.525195+0000","last_active":"2023-12-24T19:57:07.525256+0000","last_peered":"2023-12-24T19:57:07.525256+0000","last_clean":"2023-12-24T19:57:07.525256+0000","last_became_active":"2023-12-24T19:57:07.524903+0000","last_became_peered":"2023-12-24T19:57:07.524903+0000","last_unstale":"2023-12-24T19:57:07.525256+0000","last_undegraded":"2023-12-24T19:57:07.525256+0000","last_fullsized":"2023-12-24T19:57:07.525256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517242+0000","last_change":"2023-12-24T19:57:06.524497+0000","last_active":"2023-12-24T19:57:07.517242+0000","last_peered":"2023-12-24T19:57:07.517242+0000","last_clean":"2023-12-24T19:57:07.517242+0000","last_became_active":"2023-12-24T19:57:06.524278+0000","last_became_peered":"2023-12-24T19:57:06.524278+0000","last_unstale":"2023-12-24T19:57:07.517242+0000","last_undegraded":"2023-12-24T19:57:07.517242+0000","last_fullsized":"2023-12-24T19:57:07.517242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526976+0000","last_change":"2023-12-24T19:57:07.526151+0000","last_active":"2023-12-24T19:57:07.526976+0000","last_peered":"2023-12-24T19:57:07.526976+0000","last_clean":"2023-12-24T19:57:07.526976+0000","last_became_active":"2023-12-24T19:57:07.525918+0000","last_became_peered":"2023-12-24T19:57:07.525918+0000","last_unstale":"2023-12-24T19:57:07.526976+0000","last_undegraded":"2023-12-24T19:57:07.526976+0000","last_fullsized":"2023-12-24T19:57:07.526976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516440+0000","last_change":"2023-12-24T19:57:06.518972+0000","last_active":"2023-12-24T19:57:07.516440+0000","last_peered":"2023-12-24T19:57:07.516440+0000","last_clean":"2023-12-24T19:57:07.516440+0000","last_became_active":"2023-12-24T19:57:06.518437+0000","last_became_peered":"2023-12-24T19:57:06.518437+0000","last_unstale":"2023-12-24T19:57:07.516440+0000","last_undegraded":"2023-12-24T19:57:07.516440+0000","last_fullsized":"2023-12-24T19:57:07.516440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:51.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531001+0000","last_change":"2023-12-24T19:57:07.530312+0000","last_active":"2023-12-24T19:57:07.531001+0000","last_peered":"2023-12-24T19:57:07.531001+0000","last_clean":"2023-12-24T19:57:07.531001+0000","last_became_active":"2023-12-24T19:57:07.529911+0000","last_became_peered":"2023-12-24T19:57:07.529911+0000","last_unstale":"2023-12-24T19:57:07.531001+0000","last_undegraded":"2023-12-24T19:57:07.531001+0000","last_fullsized":"2023-12-24T19:57:07.531001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.533595+0000","last_change":"2023-12-24T19:57:06.527759+0000","last_active":"2023-12-24T19:57:07.533595+0000","last_peered":"2023-12-24T19:57:07.533595+0000","last_clean":"2023-12-24T19:57:07.533595+0000","last_became_active":"2023-12-24T19:57:06.527500+0000","last_became_peered":"2023-12-24T19:57:06.527500+0000","last_unstale":"2023-12-24T19:57:07.533595+0000","last_undegraded":"2023-12-24T19:57:07.533595+0000","last_fullsized":"2023-12-24T19:57:07.533595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525889+0000","last_change":"2023-12-24T19:57:07.525825+0000","last_active":"2023-12-24T19:57:07.525889+0000","last_peered":"2023-12-24T19:57:07.525889+0000","last_clean":"2023-12-24T19:57:07.525889+0000","last_became_active":"2023-12-24T19:57:07.525212+0000","last_became_peered":"2023-12-24T19:57:07.525212+0000","last_unstale":"2023-12-24T19:57:07.525889+0000","last_undegraded":"2023-12-24T19:57:07.525889+0000","last_fullsized":"2023-12-24T19:57:07.525889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.514129+0000","last_change":"2023-12-24T19:57:06.523392+0000","last_active":"2023-12-24T19:57:07.514129+0000","last_peered":"2023-12-24T19:57:07.514129+0000","last_clean":"2023-12-24T19:57:07.514129+0000","last_became_active":"2023-12-24T19:57:06.523144+0000","last_became_peered":"2023-12-24T19:57:06.523144+0000","last_unstale":"2023-12-24T19:57:07.514129+0000","last_undegraded":"2023-12-24T19:57:07.514129+0000","last_fullsized":"2023-12-24T19:57:07.514129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532749+0000","last_change":"2023-12-24T19:57:07.532683+0000","last_active":"2023-12-24T19:57:07.532749+0000","last_peered":"2023-12-24T19:57:07.532749+0000","last_clean":"2023-12-24T19:57:07.532749+0000","last_became_active":"2023-12-24T19:57:07.532453+0000","last_became_peered":"2023-12-24T19:57:07.532453+0000","last_unstale":"2023-12-24T19:57:07.532749+0000","last_undegraded":"2023-12-24T19:57:07.532749+0000","last_fullsized":"2023-12-24T19:57:07.532749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:39.083422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524143+0000","last_change":"2023-12-24T19:57:06.524540+0000","last_active":"2023-12-24T19:57:07.524143+0000","last_peered":"2023-12-24T19:57:07.524143+0000","last_clean":"2023-12-24T19:57:07.524143+0000","last_became_active":"2023-12-24T19:57:06.524289+0000","last_became_peered":"2023-12-24T19:57:06.524289+0000","last_unstale":"2023-12-24T19:57:07.524143+0000","last_undegraded":"2023-12-24T19:57:07.524143+0000","last_fullsized":"2023-12-24T19:57:07.524143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530781+0000","last_change":"2023-12-24T19:57:07.527389+0000","last_active":"2023-12-24T19:57:07.530781+0000","last_peered":"2023-12-24T19:57:07.530781+0000","last_clean":"2023-12-24T19:57:07.530781+0000","last_became_active":"2023-12-24T19:57:07.527176+0000","last_became_peered":"2023-12-24T19:57:07.527176+0000","last_unstale":"2023-12-24T19:57:07.530781+0000","last_undegraded":"2023-12-24T19:57:07.530781+0000","last_fullsized":"2023-12-24T19:57:07.530781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:49.060653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530624+0000","last_change":"2023-12-24T19:57:06.521236+0000","last_active":"2023-12-24T19:57:07.530624+0000","last_peered":"2023-12-24T19:57:07.530624+0000","last_clean":"2023-12-24T19:57:07.530624+0000","last_became_active":"2023-12-24T19:57:06.520985+0000","last_became_peered":"2023-12-24T19:57:06.520985+0000","last_unstale":"2023-12-24T19:57:07.530624+0000","last_undegraded":"2023-12-24T19:57:07.530624+0000","last_fullsized":"2023-12-24T19:57:07.530624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531745+0000","last_change":"2023-12-24T19:57:07.530650+0000","last_active":"2023-12-24T19:57:07.531745+0000","last_peered":"2023-12-24T19:57:07.531745+0000","last_clean":"2023-12-24T19:57:07.531745+0000","last_became_active":"2023-12-24T19:57:07.528576+0000","last_became_peered":"2023-12-24T19:57:07.528576+0000","last_unstale":"2023-12-24T19:57:07.531745+0000","last_undegraded":"2023-12-24T19:57:07.531745+0000","last_fullsized":"2023-12-24T19:57:07.531745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:54:49.589999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.521561+0000","last_change":"2023-12-24T19:57:07.520973+0000","last_active":"2023-12-24T19:57:07.521561+0000","last_peered":"2023-12-24T19:57:07.521561+0000","last_clean":"2023-12-24T19:57:07.521561+0000","last_became_active":"2023-12-24T19:57:07.520830+0000","last_became_peered":"2023-12-24T19:57:07.520830+0000","last_unstale":"2023-12-24T19:57:07.521561+0000","last_undegraded":"2023-12-24T19:57:07.521561+0000","last_fullsized":"2023-12-24T19:57:07.521561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519817+0000","last_change":"2023-12-24T19:57:07.519770+0000","last_active":"2023-12-24T19:57:07.519817+0000","last_peered":"2023-12-24T19:57:07.519817+0000","last_clean":"2023-12-24T19:57:07.519817+0000","last_became_active":"2023-12-24T19:57:07.519599+0000","last_became_peered":"2023-12-24T19:57:07.519599+0000","last_unstale":"2023-12-24T19:57:07.519817+0000","last_undegraded":"2023-12-24T19:57:07.519817+0000","last_fullsized":"2023-12-24T19:57:07.519817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526841+0000","last_change":"2023-12-24T19:57:07.526619+0000","last_active":"2023-12-24T19:57:07.526841+0000","last_peered":"2023-12-24T19:57:07.526841+0000","last_clean":"2023-12-24T19:57:07.526841+0000","last_became_active":"2023-12-24T19:57:07.526393+0000","last_became_peered":"2023-12-24T19:57:07.526393+0000","last_unstale":"2023-12-24T19:57:07.526841+0000","last_undegraded":"2023-12-24T19:57:07.526841+0000","last_fullsized":"2023-12-24T19:57:07.526841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530703+0000","last_change":"2023-12-24T19:57:07.530632+0000","last_active":"2023-12-24T19:57:07.530703+0000","last_peered":"2023-12-24T19:57:07.530703+0000","last_clean":"2023-12-24T19:57:07.530703+0000","last_became_active":"2023-12-24T19:57:07.530304+0000","last_became_peered":"2023-12-24T19:57:07.530304+0000","last_unstale":"2023-12-24T19:57:07.530703+0000","last_undegraded":"2023-12-24T19:57:07.530703+0000","last_fullsized":"2023-12-24T19:57:07.530703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528770+0000","last_change":"2023-12-24T19:57:07.528719+0000","last_active":"2023-12-24T19:57:07.528770+0000","last_peered":"2023-12-24T19:57:07.528770+0000","last_clean":"2023-12-24T19:57:07.528770+0000","last_became_active":"2023-12-24T19:57:07.528307+0000","last_became_peered":"2023-12-24T19:57:07.528307+0000","last_unstale":"2023-12-24T19:57:07.528770+0000","last_undegraded":"2023-12-24T19:57:07.528770+0000","last_fullsized":"2023-12-24T19:57:07.528770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526251+0000","last_change":"2023-12-24T19:57:07.526152+0000","last_active":"2023-12-24T19:57:07.526251+0000","last_peered":"2023-12-24T19:57:07.526251+0000","last_clean":"2023-12-24T19:57:07.526251+0000","last_became_active":"2023-12-24T19:57:07.525938+0000","last_became_peered":"2023-12-24T19:57:07.525938+0000","last_unstale":"2023-12-24T19:57:07.526251+0000","last_undegraded":"2023-12-24T19:57:07.526251+0000","last_fullsized":"2023-12-24T19:57:07.526251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534227+0000","last_change":"2023-12-24T19:57:07.534143+0000","last_active":"2023-12-24T19:57:07.534227+0000","last_peered":"2023-12-24T19:57:07.534227+0000","last_clean":"2023-12-24T19:57:07.534227+0000","last_became_active":"2023-12-24T19:57:07.533934+0000","last_became_peered":"2023-12-24T19:57:07.533934+0000","last_unstale":"2023-12-24T19:57:07.534227+0000","last_undegraded":"2023-12-24T19:57:07.534227+0000","last_fullsized":"2023-12-24T19:57:07.534227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526994+0000","last_change":"2023-12-24T19:57:07.526319+0000","last_active":"2023-12-24T19:57:07.526994+0000","last_peered":"2023-12-24T19:57:07.526994+0000","last_clean":"2023-12-24T19:57:07.526994+0000","last_became_active":"2023-12-24T19:57:07.526080+0000","last_became_peered":"2023-12-24T19:57:07.526080+0000","last_unstale":"2023-12-24T19:57:07.526994+0000","last_undegraded":"2023-12-24T19:57:07.526994+0000","last_fullsized":"2023-12-24T19:57:07.526994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531848+0000","last_change":"2023-12-24T19:57:07.530837+0000","last_active":"2023-12-24T19:57:07.531848+0000","last_peered":"2023-12-24T19:57:07.531848+0000","last_clean":"2023-12-24T19:57:07.531848+0000","last_became_active":"2023-12-24T19:57:07.527904+0000","last_became_peered":"2023-12-24T19:57:07.527904+0000","last_unstale":"2023-12-24T19:57:07.531848+0000","last_undegraded":"2023-12-24T19:57:07.531848+0000","last_fullsized":"2023-12-24T19:57:07.531848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528649+0000","last_change":"2023-12-24T19:57:07.528578+0000","last_active":"2023-12-24T19:57:07.528649+0000","last_peered":"2023-12-24T19:57:07.528649+0000","last_clean":"2023-12-24T19:57:07.528649+0000","last_became_active":"2023-12-24T19:57:07.528029+0000","last_became_peered":"2023-12-24T19:57:07.528029+0000","last_unstale":"2023-12-24T19:57:07.528649+0000","last_undegraded":"2023-12-24T19:57:07.528649+0000","last_fullsized":"2023-12-24T19:57:07.528649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535175+0000","last_change":"2023-12-24T19:57:07.535104+0000","last_active":"2023-12-24T19:57:07.535175+0000","last_peered":"2023-12-24T19:57:07.535175+0000","last_clean":"2023-12-24T19:57:07.535175+0000","last_became_active":"2023-12-24T19:57:07.534556+0000","last_became_peered":"2023-12-24T19:57:07.534556+0000","last_unstale":"2023-12-24T19:57:07.535175+0000","last_undegraded":"2023-12-24T19:57:07.535175+0000","last_fullsized":"2023-12-24T19:57:07.535175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:52:11.849851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534469+0000","last_change":"2023-12-24T19:57:07.534398+0000","last_active":"2023-12-24T19:57:07.534469+0000","last_peered":"2023-12-24T19:57:07.534469+0000","last_clean":"2023-12-24T19:57:07.534469+0000","last_became_active":"2023-12-24T19:57:07.534052+0000","last_became_peered":"2023-12-24T19:57:07.534052+0000","last_unstale":"2023-12-24T19:57:07.534469+0000","last_undegraded":"2023-12-24T19:57:07.534469+0000","last_fullsized":"2023-12-24T19:57:07.534469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526814+0000","last_change":"2023-12-24T19:57:07.526507+0000","last_active":"2023-12-24T19:57:07.526814+0000","last_peered":"2023-12-24T19:57:07.526814+0000","last_clean":"2023-12-24T19:57:07.526814+0000","last_became_active":"2023-12-24T19:57:07.526282+0000","last_became_peered":"2023-12-24T19:57:07.526282+0000","last_unstale":"2023-12-24T19:57:07.526814+0000","last_undegraded":"2023-12-24T19:57:07.526814+0000","last_fullsized":"2023-12-24T19:57:07.526814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199344816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":62,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195249,"statfs":{"total":200000000,"available":199935704,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]}],"pool_statfs":[]}} 2023-12-24T19:57:12.427 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T19:57:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.581+0000 7fd66053d700 1 Processor -- start 2023-12-24T19:57:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.581+0000 7fd66053d700 1 -- start start 2023-12-24T19:57:12.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.582+0000 7fd66053d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6580b2660 0x7fd65815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.582+0000 7fd66053d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd65815c470 0x7fd6580b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.582+0000 7fd66053d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6580b2eb0 con 0x7fd65815bb60 2023-12-24T19:57:12.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.582+0000 7fd66053d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6580afc20 con 0x7fd65815c470 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.582+0000 7fd66053d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580b2bd0 con 0x7fd6580b2660 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.582+0000 7fd65eada700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd65815c470 0x7fd6580b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65eada700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd65815c470 0x7fd6580b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53670/0 (socket says 172.21.15.61:53670) 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65eada700 1 -- 172.21.15.61:0/2944718051 learned_addr learned my addr 172.21.15.61:0/2944718051 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65dad8700 1 --2- 172.21.15.61:0/2944718051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6580b2660 0x7fd65815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65eada700 1 -- 172.21.15.61:0/2944718051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6580b2660 msgr2=0x7fd65815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65eada700 1 --2- 172.21.15.61:0/2944718051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6580b2660 0x7fd65815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65eada700 1 -- 172.21.15.61:0/2944718051 >> v1:172.21.15.133:6789/0 conn(0x7fd65815bb60 legacy=0x7fd658098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65eada700 1 -- 172.21.15.61:0/2944718051 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580afe10 con 0x7fd65815c470 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65dad8700 1 --2- 172.21.15.61:0/2944718051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6580b2660 0x7fd65815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65eada700 1 --2- 172.21.15.61:0/2944718051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815c470 0x7fd6580b08f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd650009f20 tx=0x7fd650009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae05cfacc6f60d0e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65d2d7700 1 -- 172.21.15.61:0/2944718051 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65000e070 con 0x7fd65815c470 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65d2d7700 1 -- 172.21.15.61:0/2944718051 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65000ba80 con 0x7fd65815c470 2023-12-24T19:57:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.583+0000 7fd65d2d7700 1 -- 172.21.15.61:0/2944718051 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6500092e0 con 0x7fd65815c470 2023-12-24T19:57:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.584+0000 7fd66053d700 1 -- 172.21.15.61:0/2944718051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815c470 msgr2=0x7fd6580b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.584+0000 7fd66053d700 1 --2- 172.21.15.61:0/2944718051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815c470 0x7fd6580b08f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd650009f20 tx=0x7fd650009840 comp rx=0 tx=0).stop 2023-12-24T19:57:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.584+0000 7fd66053d700 1 -- 172.21.15.61:0/2944718051 shutdown_connections 2023-12-24T19:57:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.584+0000 7fd66053d700 1 --2- 172.21.15.61:0/2944718051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815c470 0x7fd6580b08f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.584+0000 7fd66053d700 1 --2- 172.21.15.61:0/2944718051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6580b2660 0x7fd65815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.584+0000 7fd66053d700 1 -- 172.21.15.61:0/2944718051 >> 172.21.15.61:0/2944718051 conn(0x7fd658097a10 msgr2=0x7fd6580ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.584+0000 7fd66053d700 1 -- 172.21.15.61:0/2944718051 shutdown_connections 2023-12-24T19:57:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.584+0000 7fd66053d700 1 -- 172.21.15.61:0/2944718051 wait complete. 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.585+0000 7fd66053d700 1 Processor -- start 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.585+0000 7fd66053d700 1 -- start start 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd66053d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6580b2660 0x7fd658156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd66053d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815bb60 0x7fd6580ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd66053d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd65815c470 0x7fd65809a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd66053d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580abcd0 con 0x7fd65815bb60 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd66053d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580ac570 con 0x7fd6580b2660 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd66053d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580aa3b0 con 0x7fd65815c470 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65dad8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815bb60 0x7fd6580ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65dad8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815bb60 0x7fd6580ab1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53678/0 (socket says 172.21.15.61:53678) 2023-12-24T19:57:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65dad8700 1 -- 172.21.15.61:0/404101980 learned_addr learned my addr 172.21.15.61:0/404101980 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65e2d9700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6580b2660 0x7fd658156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65eada700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd65815c470 0x7fd65809a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65dad8700 1 -- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd65815c470 msgr2=0x7fd65809a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65dad8700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd65815c470 0x7fd65809a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65dad8700 1 -- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6580b2660 msgr2=0x7fd658156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65dad8700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6580b2660 0x7fd658156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65dad8700 1 -- 172.21.15.61:0/404101980 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd650009ae0 con 0x7fd65815bb60 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd65dad8700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815bb60 0x7fd6580ab1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd64800e900 tx=0x7fd648008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd64e7fc700 1 -- 172.21.15.61:0/404101980 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648013410 con 0x7fd65815bb60 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd64e7fc700 1 -- 172.21.15.61:0/404101980 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd648013570 con 0x7fd65815bb60 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd66053d700 1 -- 172.21.15.61:0/404101980 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6580abf20 con 0x7fd65815bb60 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd64e7fc700 1 -- 172.21.15.61:0/404101980 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648013910 con 0x7fd65815bb60 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.586+0000 7fd66053d700 1 -- 172.21.15.61:0/404101980 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6580ab730 con 0x7fd65815bb60 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.587+0000 7fd66053d700 1 -- 172.21.15.61:0/404101980 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65806d440 con 0x7fd65815bb60 2023-12-24T19:57:12.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.588+0000 7fd64e7fc700 1 -- 172.21.15.61:0/404101980 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd648013cc0 con 0x7fd65815bb60 2023-12-24T19:57:12.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.588+0000 7fd64e7fc700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd63c066f30 0x7fd63c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:12.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.588+0000 7fd64e7fc700 1 -- 172.21.15.61:0/404101980 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd648084250 con 0x7fd65815bb60 2023-12-24T19:57:12.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.588+0000 7fd65e2d9700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd63c066f30 0x7fd63c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:12.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.589+0000 7fd65e2d9700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd63c066f30 0x7fd63c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd654000c00 tx=0x7fd654009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:12.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.592+0000 7fd64e7fc700 1 -- 172.21.15.61:0/404101980 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd648054f50 con 0x7fd65815bb60 2023-12-24T19:57:12.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.867+0000 7fd66053d700 1 -- 172.21.15.61:0/404101980 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd65804c3c0 con 0x7fd65815bb60 2023-12-24T19:57:12.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.868+0000 7fd64e7fc700 1 -- 172.21.15.61:0/404101980 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1006 (secure 0 0 0) 0x7fd648054ae0 con 0x7fd65815bb60 2023-12-24T19:57:12.868 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:12.869 INFO:teuthology.orchestra.run.smithi061.stdout:{"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":24,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1703447814,"num_in_osds":8,"osd_in_since":1703447811,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592674,"bytes_used":1736724,"bytes_avail":1598263276,"bytes_total":1600000000,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4255}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-12-24T19:56:48.742597+0000","services":{}},"progress_events":{}} 2023-12-24T19:57:12.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 -- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd63c066f30 msgr2=0x7fd63c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd63c066f30 0x7fd63c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd654000c00 tx=0x7fd654009040 comp rx=0 tx=0).stop 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 -- 172.21.15.61:0/404101980 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815bb60 msgr2=0x7fd6580ab1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815bb60 0x7fd6580ab1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd64800e900 tx=0x7fd648008040 comp rx=0 tx=0).stop 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 -- 172.21.15.61:0/404101980 shutdown_connections 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd65815c470 0x7fd65809a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd63c066f30 0x7fd63c0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6580b2660 0x7fd658156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 --2- 172.21.15.61:0/404101980 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd65815bb60 0x7fd6580ab1f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 -- 172.21.15.61:0/404101980 >> 172.21.15.61:0/404101980 conn(0x7fd658097a10 msgr2=0x7fd658157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 -- 172.21.15.61:0/404101980 shutdown_connections 2023-12-24T19:57:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:12.870+0000 7fd66053d700 1 -- 172.21.15.61:0/404101980 wait complete. 2023-12-24T19:57:12.882 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T19:57:12.882 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:57:13.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.003+0000 7fe8dbcbb700 1 Processor -- start 2023-12-24T19:57:13.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.003+0000 7fe8dbcbb700 1 -- start start 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8dbcbb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 0x7fe8d40afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8dbcbb700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40687f0 con 0x7fe8d4068c80 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8dbcbb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d4067be0 con 0x7fe8d40af710 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8dbcbb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4067ec0 con 0x7fe8d415acf0 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8d9256700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe8d4068c80 0x7fe8d40ad290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40850/0 (socket says 172.21.15.61:40850) 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8d9256700 1 -- 172.21.15.61:0/455359757 learned_addr learned my addr 172.21.15.61:0/455359757 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8da258700 1 --2- 172.21.15.61:0/455359757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 0x7fe8d40afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8d8a55700 1 -- 172.21.15.61:0/455359757 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238413611 0 0) 0x7fe8d40687f0 con 0x7fe8d4068c80 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8d8a55700 1 -- 172.21.15.61:0/455359757 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c0003570 con 0x7fe8d4068c80 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8d8a55700 1 -- 172.21.15.61:0/455359757 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315361358 0 0) 0x7fe8d4067be0 con 0x7fe8d40af710 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8d8a55700 1 -- 172.21.15.61:0/455359757 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d40687f0 con 0x7fe8d40af710 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8da258700 1 -- 172.21.15.61:0/455359757 >> v1:172.21.15.133:6789/0 conn(0x7fe8d40af710 legacy=0x7fe8d415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8d8a55700 1 -- 172.21.15.61:0/455359757 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 672642448 0 0) 0x7fe8c0003570 con 0x7fe8d4068c80 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8da258700 1 -- 172.21.15.61:0/455359757 >> v1:172.21.15.61:6789/0 conn(0x7fe8d4068c80 legacy=0x7fe8d40ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.004+0000 7fe8da258700 1 -- 172.21.15.61:0/455359757 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40681a0 con 0x7fe8d415acf0 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8da258700 1 --2- 172.21.15.61:0/455359757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 0x7fe8d40afae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009e90 tx=0x7fe8cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac2228473c8147d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8d8a55700 1 -- 172.21.15.61:0/455359757 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00e070 con 0x7fe8d415acf0 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8d8a55700 1 -- 172.21.15.61:0/455359757 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00b870 con 0x7fe8d415acf0 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8d8a55700 1 -- 172.21.15.61:0/455359757 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4001470 con 0x7fe8d415acf0 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/455359757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 msgr2=0x7fe8d40afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8dbcbb700 1 --2- 172.21.15.61:0/455359757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 0x7fe8d40afae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009e90 tx=0x7fe8cc009780 comp rx=0 tx=0).stop 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/455359757 shutdown_connections 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8dbcbb700 1 --2- 172.21.15.61:0/455359757 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 0x7fe8d40afae0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/455359757 >> 172.21.15.61:0/455359757 conn(0x7fe8d40ca200 msgr2=0x7fe8d40ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/455359757 shutdown_connections 2023-12-24T19:57:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.005+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/455359757 wait complete. 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.007+0000 7fe8dbcbb700 1 Processor -- start 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.007+0000 7fe8dbcbb700 1 -- start start 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8dbcbb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4068c80 0x7fe8d41556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8dbcbb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d40af710 0x7fe8d40ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8dbcbb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 0x7fe8d40abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8dbcbb700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40ac120 con 0x7fe8d4068c80 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8dbcbb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4159f10 con 0x7fe8d40af710 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8dbcbb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d415a1f0 con 0x7fe8d415acf0 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8d9a57700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4068c80 0x7fe8d41556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8d9a57700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4068c80 0x7fe8d41556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53686/0 (socket says 172.21.15.61:53686) 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8d9a57700 1 -- 172.21.15.61:0/744283086 learned_addr learned my addr 172.21.15.61:0/744283086 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8d9256700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d40af710 0x7fe8d40ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:13.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8da258700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 0x7fe8d40abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8d9a57700 1 -- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 msgr2=0x7fe8d40abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8d9a57700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 0x7fe8d40abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8d9a57700 1 -- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d40af710 msgr2=0x7fe8d40ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8d9a57700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d40af710 0x7fe8d40ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8d9a57700 1 -- 172.21.15.61:0/744283086 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc009a20 con 0x7fe8d4068c80 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.008+0000 7fe8d9a57700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4068c80 0x7fe8d41556d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c590 tx=0x7fe8d0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.009+0000 7fe8c9ffb700 1 -- 172.21.15.61:0/744283086 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0011680 con 0x7fe8d4068c80 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.009+0000 7fe8c9ffb700 1 -- 172.21.15.61:0/744283086 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0011800 con 0x7fe8d4068c80 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.009+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/744283086 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d415a4d0 con 0x7fe8d4068c80 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.009+0000 7fe8c9ffb700 1 -- 172.21.15.61:0/744283086 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0011bc0 con 0x7fe8d4068c80 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.009+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/744283086 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d415aa90 con 0x7fe8d4068c80 2023-12-24T19:57:13.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.010+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/744283086 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d404c3c0 con 0x7fe8d4068c80 2023-12-24T19:57:13.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.010+0000 7fe8c9ffb700 1 -- 172.21.15.61:0/744283086 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe8d00103d0 con 0x7fe8d4068c80 2023-12-24T19:57:13.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.011+0000 7fe8c9ffb700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8b8066f30 0x7fe8b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:13.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.011+0000 7fe8c9ffb700 1 -- 172.21.15.61:0/744283086 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe8d0086370 con 0x7fe8d4068c80 2023-12-24T19:57:13.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.011+0000 7fe8d9256700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8b8066f30 0x7fe8b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:13.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.011+0000 7fe8d9256700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8b8066f30 0x7fe8b80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40af5f0 tx=0x7fe8c4000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:13.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.015+0000 7fe8c9ffb700 1 -- 172.21.15.61:0/744283086 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8d0053540 con 0x7fe8d4068c80 2023-12-24T19:57:13.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.201+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/744283086 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8d415a360 con 0x7fe8b8066f30 2023-12-24T19:57:13.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.209+0000 7fe8c9ffb700 1 -- 172.21.15.61:0/744283086 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260189 (secure 0 0 0) 0x7fe8d415a360 con 0x7fe8b8066f30 2023-12-24T19:57:13.212 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:13.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8b8066f30 msgr2=0x7fe8b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:13.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8b8066f30 0x7fe8b80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40af5f0 tx=0x7fe8c4000bc0 comp rx=0 tx=0).stop 2023-12-24T19:57:13.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/744283086 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4068c80 msgr2=0x7fe8d41556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:13.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4068c80 0x7fe8d41556d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000c590 tx=0x7fe8d0007dd0 comp rx=0 tx=0).stop 2023-12-24T19:57:13.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/744283086 shutdown_connections 2023-12-24T19:57:13.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8d415acf0 0x7fe8d40abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:13.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8b8066f30 0x7fe8b80693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:13.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4068c80 0x7fe8d41556d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:13.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 --2- 172.21.15.61:0/744283086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d40af710 0x7fe8d40ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:13.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/744283086 >> 172.21.15.61:0/744283086 conn(0x7fe8d40ca200 msgr2=0x7fe8d40ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:13.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/744283086 shutdown_connections 2023-12-24T19:57:13.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:13.212+0000 7fe8dbcbb700 1 -- 172.21.15.61:0/744283086 wait complete. 2023-12-24T19:57:13.215 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:57:13.224 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-24T19:57:12.308866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1696,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560803,"statfs":{"total":1600000000,"available":1598263276,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536218+0000","last_change":"2023-12-24T19:57:07.536146+0000","last_active":"2023-12-24T19:57:07.536218+0000","last_peered":"2023-12-24T19:57:07.536218+0000","last_clean":"2023-12-24T19:57:07.536218+0000","last_became_active":"2023-12-24T19:57:07.535549+0000","last_became_peered":"2023-12-24T19:57:07.535549+0000","last_unstale":"2023-12-24T19:57:07.536218+0000","last_undegraded":"2023-12-24T19:57:07.536218+0000","last_fullsized":"2023-12-24T19:57:07.536218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:52.100502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519135+0000","last_change":"2023-12-24T19:57:07.519070+0000","last_active":"2023-12-24T19:57:07.519135+0000","last_peered":"2023-12-24T19:57:07.519135+0000","last_clean":"2023-12-24T19:57:07.519135+0000","last_became_active":"2023-12-24T19:57:07.518830+0000","last_became_peered":"2023-12-24T19:57:07.518830+0000","last_unstale":"2023-12-24T19:57:07.519135+0000","last_undegraded":"2023-12-24T19:57:07.519135+0000","last_fullsized":"2023-12-24T19:57:07.519135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515907+0000","last_change":"2023-12-24T19:57:07.515829+0000","last_active":"2023-12-24T19:57:07.515907+0000","last_peered":"2023-12-24T19:57:07.515907+0000","last_clean":"2023-12-24T19:57:07.515907+0000","last_became_active":"2023-12-24T19:57:07.515554+0000","last_became_peered":"2023-12-24T19:57:07.515554+0000","last_unstale":"2023-12-24T19:57:07.515907+0000","last_undegraded":"2023-12-24T19:57:07.515907+0000","last_fullsized":"2023-12-24T19:57:07.515907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531866+0000","last_change":"2023-12-24T19:57:07.531458+0000","last_active":"2023-12-24T19:57:07.531866+0000","last_peered":"2023-12-24T19:57:07.531866+0000","last_clean":"2023-12-24T19:57:07.531866+0000","last_became_active":"2023-12-24T19:57:07.530225+0000","last_became_peered":"2023-12-24T19:57:07.530225+0000","last_unstale":"2023-12-24T19:57:07.531866+0000","last_undegraded":"2023-12-24T19:57:07.531866+0000","last_fullsized":"2023-12-24T19:57:07.531866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:21.152234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535982+0000","last_change":"2023-12-24T19:57:07.534875+0000","last_active":"2023-12-24T19:57:07.535982+0000","last_peered":"2023-12-24T19:57:07.535982+0000","last_clean":"2023-12-24T19:57:07.535982+0000","last_became_active":"2023-12-24T19:57:07.534444+0000","last_became_peered":"2023-12-24T19:57:07.534444+0000","last_unstale":"2023-12-24T19:57:07.535982+0000","last_undegraded":"2023-12-24T19:57:07.535982+0000","last_fullsized":"2023-12-24T19:57:07.535982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520980+0000","last_change":"2023-12-24T19:57:07.520108+0000","last_active":"2023-12-24T19:57:07.520980+0000","last_peered":"2023-12-24T19:57:07.520980+0000","last_clean":"2023-12-24T19:57:07.520980+0000","last_became_active":"2023-12-24T19:57:07.519639+0000","last_became_peered":"2023-12-24T19:57:07.519639+0000","last_unstale":"2023-12-24T19:57:07.520980+0000","last_undegraded":"2023-12-24T19:57:07.520980+0000","last_fullsized":"2023-12-24T19:57:07.520980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.537256+0000","last_change":"2023-12-24T19:57:07.537204+0000","last_active":"2023-12-24T19:57:07.537256+0000","last_peered":"2023-12-24T19:57:07.537256+0000","last_clean":"2023-12-24T19:57:07.537256+0000","last_became_active":"2023-12-24T19:57:07.535804+0000","last_became_peered":"2023-12-24T19:57:07.535804+0000","last_unstale":"2023-12-24T19:57:07.537256+0000","last_undegraded":"2023-12-24T19:57:07.537256+0000","last_fullsized":"2023-12-24T19:57:07.537256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:08:43.312235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525929+0000","last_change":"2023-12-24T19:57:07.525839+0000","last_active":"2023-12-24T19:57:07.525929+0000","last_peered":"2023-12-24T19:57:07.525929+0000","last_clean":"2023-12-24T19:57:07.525929+0000","last_became_active":"2023-12-24T19:57:07.525535+0000","last_became_peered":"2023-12-24T19:57:07.525535+0000","last_unstale":"2023-12-24T19:57:07.525929+0000","last_undegraded":"2023-12-24T19:57:07.525929+0000","last_fullsized":"2023-12-24T19:57:07.525929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532601+0000","last_change":"2023-12-24T19:57:07.532497+0000","last_active":"2023-12-24T19:57:07.532601+0000","last_peered":"2023-12-24T19:57:07.532601+0000","last_clean":"2023-12-24T19:57:07.532601+0000","last_became_active":"2023-12-24T19:57:07.532280+0000","last_became_peered":"2023-12-24T19:57:07.532280+0000","last_unstale":"2023-12-24T19:57:07.532601+0000","last_undegraded":"2023-12-24T19:57:07.532601+0000","last_fullsized":"2023-12-24T19:57:07.532601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:01.279518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520933+0000","last_change":"2023-12-24T19:57:07.520487+0000","last_active":"2023-12-24T19:57:07.520933+0000","last_peered":"2023-12-24T19:57:07.520933+0000","last_clean":"2023-12-24T19:57:07.520933+0000","last_became_active":"2023-12-24T19:57:07.520238+0000","last_became_peered":"2023-12-24T19:57:07.520238+0000","last_unstale":"2023-12-24T19:57:07.520933+0000","last_undegraded":"2023-12-24T19:57:07.520933+0000","last_fullsized":"2023-12-24T19:57:07.520933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:16:20.311262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.521578+0000","last_change":"2023-12-24T19:57:07.521484+0000","last_active":"2023-12-24T19:57:07.521578+0000","last_peered":"2023-12-24T19:57:07.521578+0000","last_clean":"2023-12-24T19:57:07.521578+0000","last_became_active":"2023-12-24T19:57:07.521255+0000","last_became_peered":"2023-12-24T19:57:07.521255+0000","last_unstale":"2023-12-24T19:57:07.521578+0000","last_undegraded":"2023-12-24T19:57:07.521578+0000","last_fullsized":"2023-12-24T19:57:07.521578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527053+0000","last_change":"2023-12-24T19:57:07.526737+0000","last_active":"2023-12-24T19:57:07.527053+0000","last_peered":"2023-12-24T19:57:07.527053+0000","last_clean":"2023-12-24T19:57:07.527053+0000","last_became_active":"2023-12-24T19:57:07.526481+0000","last_became_peered":"2023-12-24T19:57:07.526481+0000","last_unstale":"2023-12-24T19:57:07.527053+0000","last_undegraded":"2023-12-24T19:57:07.527053+0000","last_fullsized":"2023-12-24T19:57:07.527053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:15.825581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530680+0000","last_change":"2023-12-24T19:57:07.530165+0000","last_active":"2023-12-24T19:57:07.530680+0000","last_peered":"2023-12-24T19:57:07.530680+0000","last_clean":"2023-12-24T19:57:07.530680+0000","last_became_active":"2023-12-24T19:57:07.529444+0000","last_became_peered":"2023-12-24T19:57:07.529444+0000","last_unstale":"2023-12-24T19:57:07.530680+0000","last_undegraded":"2023-12-24T19:57:07.530680+0000","last_fullsized":"2023-12-24T19:57:07.530680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518630+0000","last_change":"2023-12-24T19:57:07.518298+0000","last_active":"2023-12-24T19:57:07.518630+0000","last_peered":"2023-12-24T19:57:07.518630+0000","last_clean":"2023-12-24T19:57:07.518630+0000","last_became_active":"2023-12-24T19:57:07.517984+0000","last_became_peered":"2023-12-24T19:57:07.517984+0000","last_unstale":"2023-12-24T19:57:07.518630+0000","last_undegraded":"2023-12-24T19:57:07.518630+0000","last_fullsized":"2023-12-24T19:57:07.518630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524033+0000","last_change":"2023-12-24T19:57:07.523925+0000","last_active":"2023-12-24T19:57:07.524033+0000","last_peered":"2023-12-24T19:57:07.524033+0000","last_clean":"2023-12-24T19:57:07.524033+0000","last_became_active":"2023-12-24T19:57:07.523700+0000","last_became_peered":"2023-12-24T19:57:07.523700+0000","last_unstale":"2023-12-24T19:57:07.524033+0000","last_undegraded":"2023-12-24T19:57:07.524033+0000","last_fullsized":"2023-12-24T19:57:07.524033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520963+0000","last_change":"2023-12-24T19:57:07.519865+0000","last_active":"2023-12-24T19:57:07.520963+0000","last_peered":"2023-12-24T19:57:07.520963+0000","last_clean":"2023-12-24T19:57:07.520963+0000","last_became_active":"2023-12-24T19:57:07.519280+0000","last_became_peered":"2023-12-24T19:57:07.519280+0000","last_unstale":"2023-12-24T19:57:07.520963+0000","last_undegraded":"2023-12-24T19:57:07.520963+0000","last_fullsized":"2023-12-24T19:57:07.520963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535309+0000","last_change":"2023-12-24T19:57:07.535246+0000","last_active":"2023-12-24T19:57:07.535309+0000","last_peered":"2023-12-24T19:57:07.535309+0000","last_clean":"2023-12-24T19:57:07.535309+0000","last_became_active":"2023-12-24T19:57:07.534766+0000","last_became_peered":"2023-12-24T19:57:07.534766+0000","last_unstale":"2023-12-24T19:57:07.535309+0000","last_undegraded":"2023-12-24T19:57:07.535309+0000","last_fullsized":"2023-12-24T19:57:07.535309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:01.279518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518582+0000","last_change":"2023-12-24T19:57:07.518511+0000","last_active":"2023-12-24T19:57:07.518582+0000","last_peered":"2023-12-24T19:57:07.518582+0000","last_clean":"2023-12-24T19:57:07.518582+0000","last_became_active":"2023-12-24T19:57:07.518256+0000","last_became_peered":"2023-12-24T19:57:07.518256+0000","last_unstale":"2023-12-24T19:57:07.518582+0000","last_undegraded":"2023-12-24T19:57:07.518582+0000","last_fullsized":"2023-12-24T19:57:07.518582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535963+0000","last_change":"2023-12-24T19:57:07.534422+0000","last_active":"2023-12-24T19:57:07.535963+0000","last_peered":"2023-12-24T19:57:07.535963+0000","last_clean":"2023-12-24T19:57:07.535963+0000","last_became_active":"2023-12-24T19:57:07.533941+0000","last_became_peered":"2023-12-24T19:57:07.533941+0000","last_unstale":"2023-12-24T19:57:07.535963+0000","last_undegraded":"2023-12-24T19:57:07.535963+0000","last_fullsized":"2023-12-24T19:57:07.535963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529337+0000","last_change":"2023-12-24T19:57:06.524904+0000","last_active":"2023-12-24T19:57:07.529337+0000","last_peered":"2023-12-24T19:57:07.529337+0000","last_clean":"2023-12-24T19:57:07.529337+0000","last_became_active":"2023-12-24T19:57:06.524655+0000","last_became_peered":"2023-12-24T19:57:06.524655+0000","last_unstale":"2023-12-24T19:57:07.529337+0000","last_undegraded":"2023-12-24T19:57:07.529337+0000","last_fullsized":"2023-12-24T19:57:07.529337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530981+0000","last_change":"2023-12-24T19:57:07.530215+0000","last_active":"2023-12-24T19:57:07.530981+0000","last_peered":"2023-12-24T19:57:07.530981+0000","last_clean":"2023-12-24T19:57:07.530981+0000","last_became_active":"2023-12-24T19:57:07.529530+0000","last_became_peered":"2023-12-24T19:57:07.529530+0000","last_unstale":"2023-12-24T19:57:07.530981+0000","last_undegraded":"2023-12-24T19:57:07.530981+0000","last_fullsized":"2023-12-24T19:57:07.530981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:52.100502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530889+0000","last_change":"2023-12-24T19:57:06.513334+0000","last_active":"2023-12-24T19:57:07.530889+0000","last_peered":"2023-12-24T19:57:07.530889+0000","last_clean":"2023-12-24T19:57:07.530889+0000","last_became_active":"2023-12-24T19:57:06.513019+0000","last_became_peered":"2023-12-24T19:57:06.513019+0000","last_unstale":"2023-12-24T19:57:07.530889+0000","last_undegraded":"2023-12-24T19:57:07.530889+0000","last_fullsized":"2023-12-24T19:57:07.530889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517778+0000","last_change":"2023-12-24T19:57:07.517103+0000","last_active":"2023-12-24T19:57:07.517778+0000","last_peered":"2023-12-24T19:57:07.517778+0000","last_clean":"2023-12-24T19:57:07.517778+0000","last_became_active":"2023-12-24T19:57:07.516861+0000","last_became_peered":"2023-12-24T19:57:07.516861+0000","last_unstale":"2023-12-24T19:57:07.517778+0000","last_undegraded":"2023-12-24T19:57:07.517778+0000","last_fullsized":"2023-12-24T19:57:07.517778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536144+0000","last_change":"2023-12-24T19:57:06.525249+0000","last_active":"2023-12-24T19:57:07.536144+0000","last_peered":"2023-12-24T19:57:07.536144+0000","last_clean":"2023-12-24T19:57:07.536144+0000","last_became_active":"2023-12-24T19:57:06.525009+0000","last_became_peered":"2023-12-24T19:57:06.525009+0000","last_unstale":"2023-12-24T19:57:07.536144+0000","last_undegraded":"2023-12-24T19:57:07.536144+0000","last_fullsized":"2023-12-24T19:57:07.536144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:07.722680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523253+0000","last_change":"2023-12-24T19:57:07.523010+0000","last_active":"2023-12-24T19:57:07.523253+0000","last_peered":"2023-12-24T19:57:07.523253+0000","last_clean":"2023-12-24T19:57:07.523253+0000","last_became_active":"2023-12-24T19:57:07.522733+0000","last_became_peered":"2023-12-24T19:57:07.522733+0000","last_unstale":"2023-12-24T19:57:07.523253+0000","last_undegraded":"2023-12-24T19:57:07.523253+0000","last_fullsized":"2023-12-24T19:57:07.523253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532233+0000","last_change":"2023-12-24T19:57:06.527966+0000","last_active":"2023-12-24T19:57:07.532233+0000","last_peered":"2023-12-24T19:57:07.532233+0000","last_clean":"2023-12-24T19:57:07.532233+0000","last_became_active":"2023-12-24T19:57:06.527733+0000","last_became_peered":"2023-12-24T19:57:06.527733+0000","last_unstale":"2023-12-24T19:57:07.532233+0000","last_undegraded":"2023-12-24T19:57:07.532233+0000","last_fullsized":"2023-12-24T19:57:07.532233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:51.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523731+0000","last_change":"2023-12-24T19:57:07.523651+0000","last_active":"2023-12-24T19:57:07.523731+0000","last_peered":"2023-12-24T19:57:07.523731+0000","last_clean":"2023-12-24T19:57:07.523731+0000","last_became_active":"2023-12-24T19:57:07.523421+0000","last_became_peered":"2023-12-24T19:57:07.523421+0000","last_unstale":"2023-12-24T19:57:07.523731+0000","last_undegraded":"2023-12-24T19:57:07.523731+0000","last_fullsized":"2023-12-24T19:57:07.523731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528856+0000","last_change":"2023-12-24T19:57:06.525065+0000","last_active":"2023-12-24T19:57:07.528856+0000","last_peered":"2023-12-24T19:57:07.528856+0000","last_clean":"2023-12-24T19:57:07.528856+0000","last_became_active":"2023-12-24T19:57:06.524824+0000","last_became_peered":"2023-12-24T19:57:06.524824+0000","last_unstale":"2023-12-24T19:57:07.528856+0000","last_undegraded":"2023-12-24T19:57:07.528856+0000","last_fullsized":"2023-12-24T19:57:07.528856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:17.717686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523500+0000","last_change":"2023-12-24T19:57:07.523416+0000","last_active":"2023-12-24T19:57:07.523500+0000","last_peered":"2023-12-24T19:57:07.523500+0000","last_clean":"2023-12-24T19:57:07.523500+0000","last_became_active":"2023-12-24T19:57:07.523188+0000","last_became_peered":"2023-12-24T19:57:07.523188+0000","last_unstale":"2023-12-24T19:57:07.523500+0000","last_undegraded":"2023-12-24T19:57:07.523500+0000","last_fullsized":"2023-12-24T19:57:07.523500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:47.622467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528383+0000","last_change":"2023-12-24T19:57:06.523002+0000","last_active":"2023-12-24T19:57:07.528383+0000","last_peered":"2023-12-24T19:57:07.528383+0000","last_clean":"2023-12-24T19:57:07.528383+0000","last_became_active":"2023-12-24T19:57:06.522751+0000","last_became_peered":"2023-12-24T19:57:06.522751+0000","last_unstale":"2023-12-24T19:57:07.528383+0000","last_undegraded":"2023-12-24T19:57:07.528383+0000","last_fullsized":"2023-12-24T19:57:07.528383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524533+0000","last_change":"2023-12-24T19:57:07.524449+0000","last_active":"2023-12-24T19:57:07.524533+0000","last_peered":"2023-12-24T19:57:07.524533+0000","last_clean":"2023-12-24T19:57:07.524533+0000","last_became_active":"2023-12-24T19:57:07.524202+0000","last_became_peered":"2023-12-24T19:57:07.524202+0000","last_unstale":"2023-12-24T19:57:07.524533+0000","last_undegraded":"2023-12-24T19:57:07.524533+0000","last_fullsized":"2023-12-24T19:57:07.524533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526502+0000","last_change":"2023-12-24T19:57:06.524481+0000","last_active":"2023-12-24T19:57:07.526502+0000","last_peered":"2023-12-24T19:57:07.526502+0000","last_clean":"2023-12-24T19:57:07.526502+0000","last_became_active":"2023-12-24T19:57:06.523848+0000","last_became_peered":"2023-12-24T19:57:06.523848+0000","last_unstale":"2023-12-24T19:57:07.526502+0000","last_undegraded":"2023-12-24T19:57:07.526502+0000","last_fullsized":"2023-12-24T19:57:07.526502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525501+0000","last_change":"2023-12-24T19:57:07.525363+0000","last_active":"2023-12-24T19:57:07.525501+0000","last_peered":"2023-12-24T19:57:07.525501+0000","last_clean":"2023-12-24T19:57:07.525501+0000","last_became_active":"2023-12-24T19:57:07.524804+0000","last_became_peered":"2023-12-24T19:57:07.524804+0000","last_unstale":"2023-12-24T19:57:07.525501+0000","last_undegraded":"2023-12-24T19:57:07.525501+0000","last_fullsized":"2023-12-24T19:57:07.525501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:38.268155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516808+0000","last_change":"2023-12-24T19:57:06.522784+0000","last_active":"2023-12-24T19:57:07.516808+0000","last_peered":"2023-12-24T19:57:07.516808+0000","last_clean":"2023-12-24T19:57:07.516808+0000","last_became_active":"2023-12-24T19:57:06.522559+0000","last_became_peered":"2023-12-24T19:57:06.522559+0000","last_unstale":"2023-12-24T19:57:07.516808+0000","last_undegraded":"2023-12-24T19:57:07.516808+0000","last_fullsized":"2023-12-24T19:57:07.516808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529007+0000","last_change":"2023-12-24T19:57:07.528916+0000","last_active":"2023-12-24T19:57:07.529007+0000","last_peered":"2023-12-24T19:57:07.529007+0000","last_clean":"2023-12-24T19:57:07.529007+0000","last_became_active":"2023-12-24T19:57:07.528614+0000","last_became_peered":"2023-12-24T19:57:07.528614+0000","last_unstale":"2023-12-24T19:57:07.529007+0000","last_undegraded":"2023-12-24T19:57:07.529007+0000","last_fullsized":"2023-12-24T19:57:07.529007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518133+0000","last_change":"2023-12-24T19:57:06.521620+0000","last_active":"2023-12-24T19:57:07.518133+0000","last_peered":"2023-12-24T19:57:07.518133+0000","last_clean":"2023-12-24T19:57:07.518133+0000","last_became_active":"2023-12-24T19:57:06.521329+0000","last_became_peered":"2023-12-24T19:57:06.521329+0000","last_unstale":"2023-12-24T19:57:07.518133+0000","last_undegraded":"2023-12-24T19:57:07.518133+0000","last_fullsized":"2023-12-24T19:57:07.518133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535124+0000","last_change":"2023-12-24T19:57:07.534974+0000","last_active":"2023-12-24T19:57:07.535124+0000","last_peered":"2023-12-24T19:57:07.535124+0000","last_clean":"2023-12-24T19:57:07.535124+0000","last_became_active":"2023-12-24T19:57:07.534336+0000","last_became_peered":"2023-12-24T19:57:07.534336+0000","last_unstale":"2023-12-24T19:57:07.535124+0000","last_undegraded":"2023-12-24T19:57:07.535124+0000","last_fullsized":"2023-12-24T19:57:07.535124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:21.111646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515712+0000","last_change":"2023-12-24T19:57:06.525016+0000","last_active":"2023-12-24T19:57:07.515712+0000","last_peered":"2023-12-24T19:57:07.515712+0000","last_clean":"2023-12-24T19:57:07.515712+0000","last_became_active":"2023-12-24T19:57:06.524783+0000","last_became_peered":"2023-12-24T19:57:06.524783+0000","last_unstale":"2023-12-24T19:57:07.515712+0000","last_undegraded":"2023-12-24T19:57:07.515712+0000","last_fullsized":"2023-12-24T19:57:07.515712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519757+0000","last_change":"2023-12-24T19:57:07.519678+0000","last_active":"2023-12-24T19:57:07.519757+0000","last_peered":"2023-12-24T19:57:07.519757+0000","last_clean":"2023-12-24T19:57:07.519757+0000","last_became_active":"2023-12-24T19:57:07.519439+0000","last_became_peered":"2023-12-24T19:57:07.519439+0000","last_unstale":"2023-12-24T19:57:07.519757+0000","last_undegraded":"2023-12-24T19:57:07.519757+0000","last_fullsized":"2023-12-24T19:57:07.519757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525729+0000","last_change":"2023-12-24T19:57:06.520438+0000","last_active":"2023-12-24T19:57:07.525729+0000","last_peered":"2023-12-24T19:57:07.525729+0000","last_clean":"2023-12-24T19:57:07.525729+0000","last_became_active":"2023-12-24T19:57:06.520107+0000","last_became_peered":"2023-12-24T19:57:06.520107+0000","last_unstale":"2023-12-24T19:57:07.525729+0000","last_undegraded":"2023-12-24T19:57:07.525729+0000","last_fullsized":"2023-12-24T19:57:07.525729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:18.362103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529743+0000","last_change":"2023-12-24T19:57:07.528796+0000","last_active":"2023-12-24T19:57:07.529743+0000","last_peered":"2023-12-24T19:57:07.529743+0000","last_clean":"2023-12-24T19:57:07.529743+0000","last_became_active":"2023-12-24T19:57:07.528655+0000","last_became_peered":"2023-12-24T19:57:07.528655+0000","last_unstale":"2023-12-24T19:57:07.529743+0000","last_undegraded":"2023-12-24T19:57:07.529743+0000","last_fullsized":"2023-12-24T19:57:07.529743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534720+0000","last_change":"2023-12-24T19:57:06.521232+0000","last_active":"2023-12-24T19:57:07.534720+0000","last_peered":"2023-12-24T19:57:07.534720+0000","last_clean":"2023-12-24T19:57:07.534720+0000","last_became_active":"2023-12-24T19:57:06.520781+0000","last_became_peered":"2023-12-24T19:57:06.520781+0000","last_unstale":"2023-12-24T19:57:07.534720+0000","last_undegraded":"2023-12-24T19:57:07.534720+0000","last_fullsized":"2023-12-24T19:57:07.534720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530590+0000","last_change":"2023-12-24T19:57:07.530411+0000","last_active":"2023-12-24T19:57:07.530590+0000","last_peered":"2023-12-24T19:57:07.530590+0000","last_clean":"2023-12-24T19:57:07.530590+0000","last_became_active":"2023-12-24T19:57:07.530142+0000","last_became_peered":"2023-12-24T19:57:07.530142+0000","last_unstale":"2023-12-24T19:57:07.530590+0000","last_undegraded":"2023-12-24T19:57:07.530590+0000","last_fullsized":"2023-12-24T19:57:07.530590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:49.060653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527723+0000","last_change":"2023-12-24T19:57:06.518450+0000","last_active":"2023-12-24T19:57:07.527723+0000","last_peered":"2023-12-24T19:57:07.527723+0000","last_clean":"2023-12-24T19:57:07.527723+0000","last_became_active":"2023-12-24T19:57:06.518168+0000","last_became_peered":"2023-12-24T19:57:06.518168+0000","last_unstale":"2023-12-24T19:57:07.527723+0000","last_undegraded":"2023-12-24T19:57:07.527723+0000","last_fullsized":"2023-12-24T19:57:07.527723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:34.036458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534331+0000","last_change":"2023-12-24T19:57:07.534267+0000","last_active":"2023-12-24T19:57:07.534331+0000","last_peered":"2023-12-24T19:57:07.534331+0000","last_clean":"2023-12-24T19:57:07.534331+0000","last_became_active":"2023-12-24T19:57:07.533743+0000","last_became_peered":"2023-12-24T19:57:07.533743+0000","last_unstale":"2023-12-24T19:57:07.534331+0000","last_undegraded":"2023-12-24T19:57:07.534331+0000","last_fullsized":"2023-12-24T19:57:07.534331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516585+0000","last_change":"2023-12-24T19:57:06.519259+0000","last_active":"2023-12-24T19:57:07.516585+0000","last_peered":"2023-12-24T19:57:07.516585+0000","last_clean":"2023-12-24T19:57:07.516585+0000","last_became_active":"2023-12-24T19:57:06.518732+0000","last_became_peered":"2023-12-24T19:57:06.518732+0000","last_unstale":"2023-12-24T19:57:07.516585+0000","last_undegraded":"2023-12-24T19:57:07.516585+0000","last_fullsized":"2023-12-24T19:57:07.516585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535999+0000","last_change":"2023-12-24T19:57:07.535031+0000","last_active":"2023-12-24T19:57:07.535999+0000","last_peered":"2023-12-24T19:57:07.535999+0000","last_clean":"2023-12-24T19:57:07.535999+0000","last_became_active":"2023-12-24T19:57:07.534715+0000","last_became_peered":"2023-12-24T19:57:07.534715+0000","last_unstale":"2023-12-24T19:57:07.535999+0000","last_undegraded":"2023-12-24T19:57:07.535999+0000","last_fullsized":"2023-12-24T19:57:07.535999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:21.111646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517413+0000","last_change":"2023-12-24T19:57:06.524250+0000","last_active":"2023-12-24T19:57:07.517413+0000","last_peered":"2023-12-24T19:57:07.517413+0000","last_clean":"2023-12-24T19:57:07.517413+0000","last_became_active":"2023-12-24T19:57:06.523702+0000","last_became_peered":"2023-12-24T19:57:06.523702+0000","last_unstale":"2023-12-24T19:57:07.517413+0000","last_undegraded":"2023-12-24T19:57:07.517413+0000","last_fullsized":"2023-12-24T19:57:07.517413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520473+0000","last_change":"2023-12-24T19:57:07.520401+0000","last_active":"2023-12-24T19:57:07.520473+0000","last_peered":"2023-12-24T19:57:07.520473+0000","last_clean":"2023-12-24T19:57:07.520473+0000","last_became_active":"2023-12-24T19:57:07.520170+0000","last_became_peered":"2023-12-24T19:57:07.520170+0000","last_unstale":"2023-12-24T19:57:07.520473+0000","last_undegraded":"2023-12-24T19:57:07.520473+0000","last_fullsized":"2023-12-24T19:57:07.520473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530362+0000","last_change":"2023-12-24T19:57:06.526329+0000","last_active":"2023-12-24T19:57:07.530362+0000","last_peered":"2023-12-24T19:57:07.530362+0000","last_clean":"2023-12-24T19:57:07.530362+0000","last_became_active":"2023-12-24T19:57:06.525718+0000","last_became_peered":"2023-12-24T19:57:06.525718+0000","last_unstale":"2023-12-24T19:57:07.530362+0000","last_undegraded":"2023-12-24T19:57:07.530362+0000","last_fullsized":"2023-12-24T19:57:07.530362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.537377+0000","last_change":"2023-12-24T19:57:07.537325+0000","last_active":"2023-12-24T19:57:07.537377+0000","last_peered":"2023-12-24T19:57:07.537377+0000","last_clean":"2023-12-24T19:57:07.537377+0000","last_became_active":"2023-12-24T19:57:07.536102+0000","last_became_peered":"2023-12-24T19:57:07.536102+0000","last_unstale":"2023-12-24T19:57:07.537377+0000","last_undegraded":"2023-12-24T19:57:07.537377+0000","last_fullsized":"2023-12-24T19:57:07.537377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:52:11.849851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528207+0000","last_change":"2023-12-24T19:57:06.518295+0000","last_active":"2023-12-24T19:57:07.528207+0000","last_peered":"2023-12-24T19:57:07.528207+0000","last_clean":"2023-12-24T19:57:07.528207+0000","last_became_active":"2023-12-24T19:57:06.516591+0000","last_became_peered":"2023-12-24T19:57:06.516591+0000","last_unstale":"2023-12-24T19:57:07.528207+0000","last_undegraded":"2023-12-24T19:57:07.528207+0000","last_fullsized":"2023-12-24T19:57:07.528207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:34.036458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536964+0000","last_change":"2023-12-24T19:57:07.536755+0000","last_active":"2023-12-24T19:57:07.536964+0000","last_peered":"2023-12-24T19:57:07.536964+0000","last_clean":"2023-12-24T19:57:07.536964+0000","last_became_active":"2023-12-24T19:57:07.536502+0000","last_became_peered":"2023-12-24T19:57:07.536502+0000","last_unstale":"2023-12-24T19:57:07.536964+0000","last_undegraded":"2023-12-24T19:57:07.536964+0000","last_fullsized":"2023-12-24T19:57:07.536964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:21.152234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517131+0000","last_change":"2023-12-24T19:57:06.519180+0000","last_active":"2023-12-24T19:57:07.517131+0000","last_peered":"2023-12-24T19:57:07.517131+0000","last_clean":"2023-12-24T19:57:07.517131+0000","last_became_active":"2023-12-24T19:57:06.518906+0000","last_became_peered":"2023-12-24T19:57:06.518906+0000","last_unstale":"2023-12-24T19:57:07.517131+0000","last_undegraded":"2023-12-24T19:57:07.517131+0000","last_fullsized":"2023-12-24T19:57:07.517131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531876+0000","last_change":"2023-12-24T19:57:07.531626+0000","last_active":"2023-12-24T19:57:07.531876+0000","last_peered":"2023-12-24T19:57:07.531876+0000","last_clean":"2023-12-24T19:57:07.531876+0000","last_became_active":"2023-12-24T19:57:07.530556+0000","last_became_peered":"2023-12-24T19:57:07.530556+0000","last_unstale":"2023-12-24T19:57:07.531876+0000","last_undegraded":"2023-12-24T19:57:07.531876+0000","last_fullsized":"2023-12-24T19:57:07.531876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:43:42.570184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515831+0000","last_change":"2023-12-24T19:57:06.522317+0000","last_active":"2023-12-24T19:57:07.515831+0000","last_peered":"2023-12-24T19:57:07.515831+0000","last_clean":"2023-12-24T19:57:07.515831+0000","last_became_active":"2023-12-24T19:57:06.521804+0000","last_became_peered":"2023-12-24T19:57:06.521804+0000","last_unstale":"2023-12-24T19:57:07.515831+0000","last_undegraded":"2023-12-24T19:57:07.515831+0000","last_fullsized":"2023-12-24T19:57:07.515831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525176+0000","last_change":"2023-12-24T19:57:07.525106+0000","last_active":"2023-12-24T19:57:07.525176+0000","last_peered":"2023-12-24T19:57:07.525176+0000","last_clean":"2023-12-24T19:57:07.525176+0000","last_became_active":"2023-12-24T19:57:07.524852+0000","last_became_peered":"2023-12-24T19:57:07.524852+0000","last_unstale":"2023-12-24T19:57:07.525176+0000","last_undegraded":"2023-12-24T19:57:07.525176+0000","last_fullsized":"2023-12-24T19:57:07.525176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:19.368177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517665+0000","last_change":"2023-12-24T19:57:07.517596+0000","last_active":"2023-12-24T19:57:07.517665+0000","last_peered":"2023-12-24T19:57:07.517665+0000","last_clean":"2023-12-24T19:57:07.517665+0000","last_became_active":"2023-12-24T19:57:07.517352+0000","last_became_peered":"2023-12-24T19:57:07.517352+0000","last_unstale":"2023-12-24T19:57:07.517665+0000","last_undegraded":"2023-12-24T19:57:07.517665+0000","last_fullsized":"2023-12-24T19:57:07.517665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.513830+0000","last_change":"2023-12-24T19:57:06.526469+0000","last_active":"2023-12-24T19:57:07.513830+0000","last_peered":"2023-12-24T19:57:07.513830+0000","last_clean":"2023-12-24T19:57:07.513830+0000","last_became_active":"2023-12-24T19:57:06.526071+0000","last_became_peered":"2023-12-24T19:57:06.526071+0000","last_unstale":"2023-12-24T19:57:07.513830+0000","last_undegraded":"2023-12-24T19:57:07.513830+0000","last_fullsized":"2023-12-24T19:57:07.513830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527346+0000","last_change":"2023-12-24T19:57:07.527208+0000","last_active":"2023-12-24T19:57:07.527346+0000","last_peered":"2023-12-24T19:57:07.527346+0000","last_clean":"2023-12-24T19:57:07.527346+0000","last_became_active":"2023-12-24T19:57:07.526792+0000","last_became_peered":"2023-12-24T19:57:07.526792+0000","last_unstale":"2023-12-24T19:57:07.527346+0000","last_undegraded":"2023-12-24T19:57:07.527346+0000","last_fullsized":"2023-12-24T19:57:07.527346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:43:42.570184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516700+0000","last_change":"2023-12-24T19:57:06.521786+0000","last_active":"2023-12-24T19:57:07.516700+0000","last_peered":"2023-12-24T19:57:07.516700+0000","last_clean":"2023-12-24T19:57:07.516700+0000","last_became_active":"2023-12-24T19:57:06.521491+0000","last_became_peered":"2023-12-24T19:57:06.521491+0000","last_unstale":"2023-12-24T19:57:07.516700+0000","last_undegraded":"2023-12-24T19:57:07.516700+0000","last_fullsized":"2023-12-24T19:57:07.516700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527038+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:57:07.527038+0000","last_peered":"2023-12-24T19:57:07.527038+0000","last_clean":"2023-12-24T19:57:07.527038+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:57:07.527038+0000","last_undegraded":"2023-12-24T19:57:07.527038+0000","last_fullsized":"2023-12-24T19:57:07.527038+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526944+0000","last_change":"2023-12-24T19:57:07.526851+0000","last_active":"2023-12-24T19:57:07.526944+0000","last_peered":"2023-12-24T19:57:07.526944+0000","last_clean":"2023-12-24T19:57:07.526944+0000","last_became_active":"2023-12-24T19:57:07.526572+0000","last_became_peered":"2023-12-24T19:57:07.526572+0000","last_unstale":"2023-12-24T19:57:07.526944+0000","last_undegraded":"2023-12-24T19:57:07.526944+0000","last_fullsized":"2023-12-24T19:57:07.526944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526230+0000","last_change":"2023-12-24T19:57:06.527232+0000","last_active":"2023-12-24T19:57:07.526230+0000","last_peered":"2023-12-24T19:57:07.526230+0000","last_clean":"2023-12-24T19:57:07.526230+0000","last_became_active":"2023-12-24T19:57:06.526965+0000","last_became_peered":"2023-12-24T19:57:06.526965+0000","last_unstale":"2023-12-24T19:57:07.526230+0000","last_undegraded":"2023-12-24T19:57:07.526230+0000","last_fullsized":"2023-12-24T19:57:07.526230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526332+0000","last_change":"2023-12-24T19:57:06.527833+0000","last_active":"2023-12-24T19:57:07.526332+0000","last_peered":"2023-12-24T19:57:07.526332+0000","last_clean":"2023-12-24T19:57:07.526332+0000","last_became_active":"2023-12-24T19:57:06.527507+0000","last_became_peered":"2023-12-24T19:57:06.527507+0000","last_unstale":"2023-12-24T19:57:07.526332+0000","last_undegraded":"2023-12-24T19:57:07.526332+0000","last_fullsized":"2023-12-24T19:57:07.526332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517724+0000","last_change":"2023-12-24T19:57:07.517660+0000","last_active":"2023-12-24T19:57:07.517724+0000","last_peered":"2023-12-24T19:57:07.517724+0000","last_clean":"2023-12-24T19:57:07.517724+0000","last_became_active":"2023-12-24T19:57:07.517397+0000","last_became_peered":"2023-12-24T19:57:07.517397+0000","last_unstale":"2023-12-24T19:57:07.517724+0000","last_undegraded":"2023-12-24T19:57:07.517724+0000","last_fullsized":"2023-12-24T19:57:07.517724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-24T19:57:08.515389+0000","last_change":"2023-12-24T19:57:06.525879+0000","last_active":"2023-12-24T19:57:08.515389+0000","last_peered":"2023-12-24T19:57:08.515389+0000","last_clean":"2023-12-24T19:57:08.515389+0000","last_became_active":"2023-12-24T19:57:06.525637+0000","last_became_peered":"2023-12-24T19:57:06.525637+0000","last_unstale":"2023-12-24T19:57:08.515389+0000","last_undegraded":"2023-12-24T19:57:08.515389+0000","last_fullsized":"2023-12-24T19:57:08.515389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:46.616394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534151+0000","last_change":"2023-12-24T19:57:07.534062+0000","last_active":"2023-12-24T19:57:07.534151+0000","last_peered":"2023-12-24T19:57:07.534151+0000","last_clean":"2023-12-24T19:57:07.534151+0000","last_became_active":"2023-12-24T19:57:07.533898+0000","last_became_peered":"2023-12-24T19:57:07.533898+0000","last_unstale":"2023-12-24T19:57:07.534151+0000","last_undegraded":"2023-12-24T19:57:07.534151+0000","last_fullsized":"2023-12-24T19:57:07.534151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536398+0000","last_change":"2023-12-24T19:57:06.525416+0000","last_active":"2023-12-24T19:57:07.536398+0000","last_peered":"2023-12-24T19:57:07.536398+0000","last_clean":"2023-12-24T19:57:07.536398+0000","last_became_active":"2023-12-24T19:57:06.525105+0000","last_became_peered":"2023-12-24T19:57:06.525105+0000","last_unstale":"2023-12-24T19:57:07.536398+0000","last_undegraded":"2023-12-24T19:57:07.536398+0000","last_fullsized":"2023-12-24T19:57:07.536398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518611+0000","last_change":"2023-12-24T19:57:07.518192+0000","last_active":"2023-12-24T19:57:07.518611+0000","last_peered":"2023-12-24T19:57:07.518611+0000","last_clean":"2023-12-24T19:57:07.518611+0000","last_became_active":"2023-12-24T19:57:07.517957+0000","last_became_peered":"2023-12-24T19:57:07.517957+0000","last_unstale":"2023-12-24T19:57:07.518611+0000","last_undegraded":"2023-12-24T19:57:07.518611+0000","last_fullsized":"2023-12-24T19:57:07.518611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526634+0000","last_change":"2023-12-24T19:57:06.526486+0000","last_active":"2023-12-24T19:57:07.526634+0000","last_peered":"2023-12-24T19:57:07.526634+0000","last_clean":"2023-12-24T19:57:07.526634+0000","last_became_active":"2023-12-24T19:57:06.526260+0000","last_became_peered":"2023-12-24T19:57:06.526260+0000","last_unstale":"2023-12-24T19:57:07.526634+0000","last_undegraded":"2023-12-24T19:57:07.526634+0000","last_fullsized":"2023-12-24T19:57:07.526634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:46.616394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525256+0000","last_change":"2023-12-24T19:57:07.525195+0000","last_active":"2023-12-24T19:57:07.525256+0000","last_peered":"2023-12-24T19:57:07.525256+0000","last_clean":"2023-12-24T19:57:07.525256+0000","last_became_active":"2023-12-24T19:57:07.524903+0000","last_became_peered":"2023-12-24T19:57:07.524903+0000","last_unstale":"2023-12-24T19:57:07.525256+0000","last_undegraded":"2023-12-24T19:57:07.525256+0000","last_fullsized":"2023-12-24T19:57:07.525256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517242+0000","last_change":"2023-12-24T19:57:06.524497+0000","last_active":"2023-12-24T19:57:07.517242+0000","last_peered":"2023-12-24T19:57:07.517242+0000","last_clean":"2023-12-24T19:57:07.517242+0000","last_became_active":"2023-12-24T19:57:06.524278+0000","last_became_peered":"2023-12-24T19:57:06.524278+0000","last_unstale":"2023-12-24T19:57:07.517242+0000","last_undegraded":"2023-12-24T19:57:07.517242+0000","last_fullsized":"2023-12-24T19:57:07.517242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526976+0000","last_change":"2023-12-24T19:57:07.526151+0000","last_active":"2023-12-24T19:57:07.526976+0000","last_peered":"2023-12-24T19:57:07.526976+0000","last_clean":"2023-12-24T19:57:07.526976+0000","last_became_active":"2023-12-24T19:57:07.525918+0000","last_became_peered":"2023-12-24T19:57:07.525918+0000","last_unstale":"2023-12-24T19:57:07.526976+0000","last_undegraded":"2023-12-24T19:57:07.526976+0000","last_fullsized":"2023-12-24T19:57:07.526976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516440+0000","last_change":"2023-12-24T19:57:06.518972+0000","last_active":"2023-12-24T19:57:07.516440+0000","last_peered":"2023-12-24T19:57:07.516440+0000","last_clean":"2023-12-24T19:57:07.516440+0000","last_became_active":"2023-12-24T19:57:06.518437+0000","last_became_peered":"2023-12-24T19:57:06.518437+0000","last_unstale":"2023-12-24T19:57:07.516440+0000","last_undegraded":"2023-12-24T19:57:07.516440+0000","last_fullsized":"2023-12-24T19:57:07.516440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:51.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531001+0000","last_change":"2023-12-24T19:57:07.530312+0000","last_active":"2023-12-24T19:57:07.531001+0000","last_peered":"2023-12-24T19:57:07.531001+0000","last_clean":"2023-12-24T19:57:07.531001+0000","last_became_active":"2023-12-24T19:57:07.529911+0000","last_became_peered":"2023-12-24T19:57:07.529911+0000","last_unstale":"2023-12-24T19:57:07.531001+0000","last_undegraded":"2023-12-24T19:57:07.531001+0000","last_fullsized":"2023-12-24T19:57:07.531001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.533595+0000","last_change":"2023-12-24T19:57:06.527759+0000","last_active":"2023-12-24T19:57:07.533595+0000","last_peered":"2023-12-24T19:57:07.533595+0000","last_clean":"2023-12-24T19:57:07.533595+0000","last_became_active":"2023-12-24T19:57:06.527500+0000","last_became_peered":"2023-12-24T19:57:06.527500+0000","last_unstale":"2023-12-24T19:57:07.533595+0000","last_undegraded":"2023-12-24T19:57:07.533595+0000","last_fullsized":"2023-12-24T19:57:07.533595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525889+0000","last_change":"2023-12-24T19:57:07.525825+0000","last_active":"2023-12-24T19:57:07.525889+0000","last_peered":"2023-12-24T19:57:07.525889+0000","last_clean":"2023-12-24T19:57:07.525889+0000","last_became_active":"2023-12-24T19:57:07.525212+0000","last_became_peered":"2023-12-24T19:57:07.525212+0000","last_unstale":"2023-12-24T19:57:07.525889+0000","last_undegraded":"2023-12-24T19:57:07.525889+0000","last_fullsized":"2023-12-24T19:57:07.525889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.514129+0000","last_change":"2023-12-24T19:57:06.523392+0000","last_active":"2023-12-24T19:57:07.514129+0000","last_peered":"2023-12-24T19:57:07.514129+0000","last_clean":"2023-12-24T19:57:07.514129+0000","last_became_active":"2023-12-24T19:57:06.523144+0000","last_became_peered":"2023-12-24T19:57:06.523144+0000","last_unstale":"2023-12-24T19:57:07.514129+0000","last_undegraded":"2023-12-24T19:57:07.514129+0000","last_fullsized":"2023-12-24T19:57:07.514129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532749+0000","last_change":"2023-12-24T19:57:07.532683+0000","last_active":"2023-12-24T19:57:07.532749+0000","last_peered":"2023-12-24T19:57:07.532749+0000","last_clean":"2023-12-24T19:57:07.532749+0000","last_became_active":"2023-12-24T19:57:07.532453+0000","last_became_peered":"2023-12-24T19:57:07.532453+0000","last_unstale":"2023-12-24T19:57:07.532749+0000","last_undegraded":"2023-12-24T19:57:07.532749+0000","last_fullsized":"2023-12-24T19:57:07.532749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:39.083422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524143+0000","last_change":"2023-12-24T19:57:06.524540+0000","last_active":"2023-12-24T19:57:07.524143+0000","last_peered":"2023-12-24T19:57:07.524143+0000","last_clean":"2023-12-24T19:57:07.524143+0000","last_became_active":"2023-12-24T19:57:06.524289+0000","last_became_peered":"2023-12-24T19:57:06.524289+0000","last_unstale":"2023-12-24T19:57:07.524143+0000","last_undegraded":"2023-12-24T19:57:07.524143+0000","last_fullsized":"2023-12-24T19:57:07.524143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530781+0000","last_change":"2023-12-24T19:57:07.527389+0000","last_active":"2023-12-24T19:57:07.530781+0000","last_peered":"2023-12-24T19:57:07.530781+0000","last_clean":"2023-12-24T19:57:07.530781+0000","last_became_active":"2023-12-24T19:57:07.527176+0000","last_became_peered":"2023-12-24T19:57:07.527176+0000","last_unstale":"2023-12-24T19:57:07.530781+0000","last_undegraded":"2023-12-24T19:57:07.530781+0000","last_fullsized":"2023-12-24T19:57:07.530781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:49.060653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530624+0000","last_change":"2023-12-24T19:57:06.521236+0000","last_active":"2023-12-24T19:57:07.530624+0000","last_peered":"2023-12-24T19:57:07.530624+0000","last_clean":"2023-12-24T19:57:07.530624+0000","last_became_active":"2023-12-24T19:57:06.520985+0000","last_became_peered":"2023-12-24T19:57:06.520985+0000","last_unstale":"2023-12-24T19:57:07.530624+0000","last_undegraded":"2023-12-24T19:57:07.530624+0000","last_fullsized":"2023-12-24T19:57:07.530624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531745+0000","last_change":"2023-12-24T19:57:07.530650+0000","last_active":"2023-12-24T19:57:07.531745+0000","last_peered":"2023-12-24T19:57:07.531745+0000","last_clean":"2023-12-24T19:57:07.531745+0000","last_became_active":"2023-12-24T19:57:07.528576+0000","last_became_peered":"2023-12-24T19:57:07.528576+0000","last_unstale":"2023-12-24T19:57:07.531745+0000","last_undegraded":"2023-12-24T19:57:07.531745+0000","last_fullsized":"2023-12-24T19:57:07.531745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:54:49.589999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.521561+0000","last_change":"2023-12-24T19:57:07.520973+0000","last_active":"2023-12-24T19:57:07.521561+0000","last_peered":"2023-12-24T19:57:07.521561+0000","last_clean":"2023-12-24T19:57:07.521561+0000","last_became_active":"2023-12-24T19:57:07.520830+0000","last_became_peered":"2023-12-24T19:57:07.520830+0000","last_unstale":"2023-12-24T19:57:07.521561+0000","last_undegraded":"2023-12-24T19:57:07.521561+0000","last_fullsized":"2023-12-24T19:57:07.521561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519817+0000","last_change":"2023-12-24T19:57:07.519770+0000","last_active":"2023-12-24T19:57:07.519817+0000","last_peered":"2023-12-24T19:57:07.519817+0000","last_clean":"2023-12-24T19:57:07.519817+0000","last_became_active":"2023-12-24T19:57:07.519599+0000","last_became_peered":"2023-12-24T19:57:07.519599+0000","last_unstale":"2023-12-24T19:57:07.519817+0000","last_undegraded":"2023-12-24T19:57:07.519817+0000","last_fullsized":"2023-12-24T19:57:07.519817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526841+0000","last_change":"2023-12-24T19:57:07.526619+0000","last_active":"2023-12-24T19:57:07.526841+0000","last_peered":"2023-12-24T19:57:07.526841+0000","last_clean":"2023-12-24T19:57:07.526841+0000","last_became_active":"2023-12-24T19:57:07.526393+0000","last_became_peered":"2023-12-24T19:57:07.526393+0000","last_unstale":"2023-12-24T19:57:07.526841+0000","last_undegraded":"2023-12-24T19:57:07.526841+0000","last_fullsized":"2023-12-24T19:57:07.526841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530703+0000","last_change":"2023-12-24T19:57:07.530632+0000","last_active":"2023-12-24T19:57:07.530703+0000","last_peered":"2023-12-24T19:57:07.530703+0000","last_clean":"2023-12-24T19:57:07.530703+0000","last_became_active":"2023-12-24T19:57:07.530304+0000","last_became_peered":"2023-12-24T19:57:07.530304+0000","last_unstale":"2023-12-24T19:57:07.530703+0000","last_undegraded":"2023-12-24T19:57:07.530703+0000","last_fullsized":"2023-12-24T19:57:07.530703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528770+0000","last_change":"2023-12-24T19:57:07.528719+0000","last_active":"2023-12-24T19:57:07.528770+0000","last_peered":"2023-12-24T19:57:07.528770+0000","last_clean":"2023-12-24T19:57:07.528770+0000","last_became_active":"2023-12-24T19:57:07.528307+0000","last_became_peered":"2023-12-24T19:57:07.528307+0000","last_unstale":"2023-12-24T19:57:07.528770+0000","last_undegraded":"2023-12-24T19:57:07.528770+0000","last_fullsized":"2023-12-24T19:57:07.528770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526251+0000","last_change":"2023-12-24T19:57:07.526152+0000","last_active":"2023-12-24T19:57:07.526251+0000","last_peered":"2023-12-24T19:57:07.526251+0000","last_clean":"2023-12-24T19:57:07.526251+0000","last_became_active":"2023-12-24T19:57:07.525938+0000","last_became_peered":"2023-12-24T19:57:07.525938+0000","last_unstale":"2023-12-24T19:57:07.526251+0000","last_undegraded":"2023-12-24T19:57:07.526251+0000","last_fullsized":"2023-12-24T19:57:07.526251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534227+0000","last_change":"2023-12-24T19:57:07.534143+0000","last_active":"2023-12-24T19:57:07.534227+0000","last_peered":"2023-12-24T19:57:07.534227+0000","last_clean":"2023-12-24T19:57:07.534227+0000","last_became_active":"2023-12-24T19:57:07.533934+0000","last_became_peered":"2023-12-24T19:57:07.533934+0000","last_unstale":"2023-12-24T19:57:07.534227+0000","last_undegraded":"2023-12-24T19:57:07.534227+0000","last_fullsized":"2023-12-24T19:57:07.534227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526994+0000","last_change":"2023-12-24T19:57:07.526319+0000","last_active":"2023-12-24T19:57:07.526994+0000","last_peered":"2023-12-24T19:57:07.526994+0000","last_clean":"2023-12-24T19:57:07.526994+0000","last_became_active":"2023-12-24T19:57:07.526080+0000","last_became_peered":"2023-12-24T19:57:07.526080+0000","last_unstale":"2023-12-24T19:57:07.526994+0000","last_undegraded":"2023-12-24T19:57:07.526994+0000","last_fullsized":"2023-12-24T19:57:07.526994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531848+0000","last_change":"2023-12-24T19:57:07.530837+0000","last_active":"2023-12-24T19:57:07.531848+0000","last_peered":"2023-12-24T19:57:07.531848+0000","last_clean":"2023-12-24T19:57:07.531848+0000","last_became_active":"2023-12-24T19:57:07.527904+0000","last_became_peered":"2023-12-24T19:57:07.527904+0000","last_unstale":"2023-12-24T19:57:07.531848+0000","last_undegraded":"2023-12-24T19:57:07.531848+0000","last_fullsized":"2023-12-24T19:57:07.531848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528649+0000","last_change":"2023-12-24T19:57:07.528578+0000","last_active":"2023-12-24T19:57:07.528649+0000","last_peered":"2023-12-24T19:57:07.528649+0000","last_clean":"2023-12-24T19:57:07.528649+0000","last_became_active":"2023-12-24T19:57:07.528029+0000","last_became_peered":"2023-12-24T19:57:07.528029+0000","last_unstale":"2023-12-24T19:57:07.528649+0000","last_undegraded":"2023-12-24T19:57:07.528649+0000","last_fullsized":"2023-12-24T19:57:07.528649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535175+0000","last_change":"2023-12-24T19:57:07.535104+0000","last_active":"2023-12-24T19:57:07.535175+0000","last_peered":"2023-12-24T19:57:07.535175+0000","last_clean":"2023-12-24T19:57:07.535175+0000","last_became_active":"2023-12-24T19:57:07.534556+0000","last_became_peered":"2023-12-24T19:57:07.534556+0000","last_unstale":"2023-12-24T19:57:07.535175+0000","last_undegraded":"2023-12-24T19:57:07.535175+0000","last_fullsized":"2023-12-24T19:57:07.535175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:52:11.849851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534469+0000","last_change":"2023-12-24T19:57:07.534398+0000","last_active":"2023-12-24T19:57:07.534469+0000","last_peered":"2023-12-24T19:57:07.534469+0000","last_clean":"2023-12-24T19:57:07.534469+0000","last_became_active":"2023-12-24T19:57:07.534052+0000","last_became_peered":"2023-12-24T19:57:07.534052+0000","last_unstale":"2023-12-24T19:57:07.534469+0000","last_undegraded":"2023-12-24T19:57:07.534469+0000","last_fullsized":"2023-12-24T19:57:07.534469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526814+0000","last_change":"2023-12-24T19:57:07.526507+0000","last_active":"2023-12-24T19:57:07.526814+0000","last_peered":"2023-12-24T19:57:07.526814+0000","last_clean":"2023-12-24T19:57:07.526814+0000","last_became_active":"2023-12-24T19:57:07.526282+0000","last_became_peered":"2023-12-24T19:57:07.526282+0000","last_unstale":"2023-12-24T19:57:07.526814+0000","last_undegraded":"2023-12-24T19:57:07.526814+0000","last_fullsized":"2023-12-24T19:57:07.526814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199344816,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":62,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195249,"statfs":{"total":200000000,"available":199935704,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]}],"pool_statfs":[]}} 2023-12-24T19:57:16.228 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:57:16.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.364+0000 7f60fd40a700 1 Processor -- start 2023-12-24T19:57:16.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.364+0000 7f60fd40a700 1 -- start start 2023-12-24T19:57:16.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60fd40a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60f8159850 0x7f60f8159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60fd40a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f60f806aac0 0x7f60f80cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60fd40a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 0x7f60f80aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60fd40a700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f806a630 con 0x7f60f806aac0 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60fd40a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f8069d00 con 0x7f60f8159850 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60fd40a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8069fe0 con 0x7f60f80caa80 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f67fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f60f806aac0 0x7f60f80cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f67fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f60f806aac0 0x7f60f80cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53690/0 (socket says 172.21.15.61:53690) 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f67fc700 1 -- 172.21.15.61:0/2452277623 learned_addr learned my addr 172.21.15.61:0/2452277623 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f77fe700 1 --2- 172.21.15.61:0/2452277623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 0x7f60f80aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f6ffd700 1 --2- 172.21.15.61:0/2452277623 >> v2:172.21.15.133:3300/0 conn(0x7f60f8159850 0x7f60f8159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f67fc700 1 -- 172.21.15.61:0/2452277623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 msgr2=0x7f60f80aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f67fc700 1 --2- 172.21.15.61:0/2452277623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 0x7f60f80aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f67fc700 1 -- 172.21.15.61:0/2452277623 >> v2:172.21.15.133:3300/0 conn(0x7f60f8159850 msgr2=0x7f60f8159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f67fc700 1 --2- 172.21.15.61:0/2452277623 >> v2:172.21.15.133:3300/0 conn(0x7f60f8159850 0x7f60f8159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f67fc700 1 -- 172.21.15.61:0/2452277623 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f806a2c0 con 0x7f60f806aac0 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f77fe700 1 --2- 172.21.15.61:0/2452277623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 0x7f60f80aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f6ffd700 1 --2- 172.21.15.61:0/2452277623 >> v2:172.21.15.133:3300/0 conn(0x7f60f8159850 0x7f60f8159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f67fc700 1 --2- 172.21.15.61:0/2452277623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f806aac0 0x7f60f80cc5e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f60f80ca970 tx=0x7f60ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c1706d66760450 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f5ffb700 1 -- 172.21.15.61:0/2452277623 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00b860 con 0x7f60f806aac0 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.365+0000 7f60f5ffb700 1 -- 172.21.15.61:0/2452277623 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00b9c0 con 0x7f60f806aac0 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.366+0000 7f60f5ffb700 1 -- 172.21.15.61:0/2452277623 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00bd60 con 0x7f60f806aac0 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.366+0000 7f60fd40a700 1 -- 172.21.15.61:0/2452277623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f806aac0 msgr2=0x7f60f80cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.366+0000 7f60fd40a700 1 --2- 172.21.15.61:0/2452277623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f806aac0 0x7f60f80cc5e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f60f80ca970 tx=0x7f60ec009250 comp rx=0 tx=0).stop 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.366+0000 7f60fd40a700 1 -- 172.21.15.61:0/2452277623 shutdown_connections 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.366+0000 7f60fd40a700 1 --2- 172.21.15.61:0/2452277623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 0x7f60f80aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.366+0000 7f60fd40a700 1 --2- 172.21.15.61:0/2452277623 >> v2:172.21.15.133:3300/0 conn(0x7f60f8159850 0x7f60f8159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.366+0000 7f60fd40a700 1 --2- 172.21.15.61:0/2452277623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f806aac0 0x7f60f80cc5e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.366+0000 7f60fd40a700 1 -- 172.21.15.61:0/2452277623 >> 172.21.15.61:0/2452277623 conn(0x7f60f80cceb0 msgr2=0x7f60f80cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.366+0000 7f60fd40a700 1 -- 172.21.15.61:0/2452277623 shutdown_connections 2023-12-24T19:57:16.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.366+0000 7f60fd40a700 1 -- 172.21.15.61:0/2452277623 wait complete. 2023-12-24T19:57:16.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.367+0000 7f60fd40a700 1 Processor -- start 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.367+0000 7f60fd40a700 1 -- start start 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60fd40a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60f806aac0 0x7f60f815db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60fd40a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 0x7f60f80b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60fd40a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f8159850 0x7f60f80b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60fd40a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f815bab0 con 0x7f60f8159850 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60fd40a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f80b2170 con 0x7f60f806aac0 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60fd40a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f80b2450 con 0x7f60f80caa80 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60f77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f8159850 0x7f60f80b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60f77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f8159850 0x7f60f80b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53706/0 (socket says 172.21.15.61:53706) 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60f77fe700 1 -- 172.21.15.61:0/2468205975 learned_addr learned my addr 172.21.15.61:0/2468205975 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60f6ffd700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60f806aac0 0x7f60f815db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.368+0000 7f60f67fc700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 0x7f60f80b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60f77fe700 1 -- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 msgr2=0x7f60f80b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:16.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60f77fe700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 0x7f60f80b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60f77fe700 1 -- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60f806aac0 msgr2=0x7f60f815db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:16.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60f77fe700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60f806aac0 0x7f60f815db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60f77fe700 1 -- 172.21.15.61:0/2468205975 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec0094f0 con 0x7f60f8159850 2023-12-24T19:57:16.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60f77fe700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f8159850 0x7f60f80b1b90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f60f000d180 tx=0x7f60f0009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:16.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60deffd700 1 -- 172.21.15.61:0/2468205975 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000dcc0 con 0x7f60f8159850 2023-12-24T19:57:16.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60deffd700 1 -- 172.21.15.61:0/2468205975 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f000f040 con 0x7f60f8159850 2023-12-24T19:57:16.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60deffd700 1 -- 172.21.15.61:0/2468205975 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0015690 con 0x7f60f8159850 2023-12-24T19:57:16.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60fd40a700 1 -- 172.21.15.61:0/2468205975 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f815b740 con 0x7f60f8159850 2023-12-24T19:57:16.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.369+0000 7f60fd40a700 1 -- 172.21.15.61:0/2468205975 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f815e660 con 0x7f60f8159850 2023-12-24T19:57:16.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.370+0000 7f60fd40a700 1 -- 172.21.15.61:0/2468205975 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f80b2670 con 0x7f60f8159850 2023-12-24T19:57:16.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.371+0000 7f60deffd700 1 -- 172.21.15.61:0/2468205975 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f60f001f440 con 0x7f60f8159850 2023-12-24T19:57:16.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.371+0000 7f60deffd700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60e4066f30 0x7f60e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.371+0000 7f60deffd700 1 -- 172.21.15.61:0/2468205975 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f60f0084ed0 con 0x7f60f8159850 2023-12-24T19:57:16.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.372+0000 7f60f6ffd700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60e4066f30 0x7f60e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.372+0000 7f60f6ffd700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60e4066f30 0x7f60e40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60e8006fd0 tx=0x7f60e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:16.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.375+0000 7f60deffd700 1 -- 172.21.15.61:0/2468205975 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60f0052120 con 0x7f60f8159850 2023-12-24T19:57:16.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.566+0000 7f60fd40a700 1 -- 172.21.15.61:0/2468205975 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60f80cdc70 con 0x7f60e4066f30 2023-12-24T19:57:16.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.574+0000 7f60deffd700 1 -- 172.21.15.61:0/2468205975 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260191 (secure 0 0 0) 0x7f60f80cdc70 con 0x7f60e4066f30 2023-12-24T19:57:16.577 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:16.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.576+0000 7f60fd40a700 1 -- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60e4066f30 msgr2=0x7f60e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:16.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.576+0000 7f60fd40a700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60e4066f30 0x7f60e40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f60e8006fd0 tx=0x7f60e8008040 comp rx=0 tx=0).stop 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.576+0000 7f60fd40a700 1 -- 172.21.15.61:0/2468205975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f8159850 msgr2=0x7f60f80b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.576+0000 7f60fd40a700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f8159850 0x7f60f80b1b90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f60f000d180 tx=0x7f60f0009a50 comp rx=0 tx=0).stop 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.577+0000 7f60fd40a700 1 -- 172.21.15.61:0/2468205975 shutdown_connections 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.577+0000 7f60fd40a700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60e4066f30 0x7f60e40693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.577+0000 7f60fd40a700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60f8159850 0x7f60f80b1b90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.577+0000 7f60fd40a700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60f806aac0 0x7f60f815db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.577+0000 7f60fd40a700 1 --2- 172.21.15.61:0/2468205975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60f80caa80 0x7f60f80b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.577+0000 7f60fd40a700 1 -- 172.21.15.61:0/2468205975 >> 172.21.15.61:0/2468205975 conn(0x7f60f80cceb0 msgr2=0x7f60f806d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.577+0000 7f60fd40a700 1 -- 172.21.15.61:0/2468205975 shutdown_connections 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.577+0000 7f60fd40a700 1 -- 172.21.15.61:0/2468205975 wait complete. 2023-12-24T19:57:16.580 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:57:16.589 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-24T19:57:16.309757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.796683"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536218+0000","last_change":"2023-12-24T19:57:07.536146+0000","last_active":"2023-12-24T19:57:07.536218+0000","last_peered":"2023-12-24T19:57:07.536218+0000","last_clean":"2023-12-24T19:57:07.536218+0000","last_became_active":"2023-12-24T19:57:07.535549+0000","last_became_peered":"2023-12-24T19:57:07.535549+0000","last_unstale":"2023-12-24T19:57:07.536218+0000","last_undegraded":"2023-12-24T19:57:07.536218+0000","last_fullsized":"2023-12-24T19:57:07.536218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:52.100502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519135+0000","last_change":"2023-12-24T19:57:07.519070+0000","last_active":"2023-12-24T19:57:07.519135+0000","last_peered":"2023-12-24T19:57:07.519135+0000","last_clean":"2023-12-24T19:57:07.519135+0000","last_became_active":"2023-12-24T19:57:07.518830+0000","last_became_peered":"2023-12-24T19:57:07.518830+0000","last_unstale":"2023-12-24T19:57:07.519135+0000","last_undegraded":"2023-12-24T19:57:07.519135+0000","last_fullsized":"2023-12-24T19:57:07.519135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515907+0000","last_change":"2023-12-24T19:57:07.515829+0000","last_active":"2023-12-24T19:57:07.515907+0000","last_peered":"2023-12-24T19:57:07.515907+0000","last_clean":"2023-12-24T19:57:07.515907+0000","last_became_active":"2023-12-24T19:57:07.515554+0000","last_became_peered":"2023-12-24T19:57:07.515554+0000","last_unstale":"2023-12-24T19:57:07.515907+0000","last_undegraded":"2023-12-24T19:57:07.515907+0000","last_fullsized":"2023-12-24T19:57:07.515907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531866+0000","last_change":"2023-12-24T19:57:07.531458+0000","last_active":"2023-12-24T19:57:07.531866+0000","last_peered":"2023-12-24T19:57:07.531866+0000","last_clean":"2023-12-24T19:57:07.531866+0000","last_became_active":"2023-12-24T19:57:07.530225+0000","last_became_peered":"2023-12-24T19:57:07.530225+0000","last_unstale":"2023-12-24T19:57:07.531866+0000","last_undegraded":"2023-12-24T19:57:07.531866+0000","last_fullsized":"2023-12-24T19:57:07.531866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:21.152234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535982+0000","last_change":"2023-12-24T19:57:07.534875+0000","last_active":"2023-12-24T19:57:07.535982+0000","last_peered":"2023-12-24T19:57:07.535982+0000","last_clean":"2023-12-24T19:57:07.535982+0000","last_became_active":"2023-12-24T19:57:07.534444+0000","last_became_peered":"2023-12-24T19:57:07.534444+0000","last_unstale":"2023-12-24T19:57:07.535982+0000","last_undegraded":"2023-12-24T19:57:07.535982+0000","last_fullsized":"2023-12-24T19:57:07.535982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520980+0000","last_change":"2023-12-24T19:57:07.520108+0000","last_active":"2023-12-24T19:57:07.520980+0000","last_peered":"2023-12-24T19:57:07.520980+0000","last_clean":"2023-12-24T19:57:07.520980+0000","last_became_active":"2023-12-24T19:57:07.519639+0000","last_became_peered":"2023-12-24T19:57:07.519639+0000","last_unstale":"2023-12-24T19:57:07.520980+0000","last_undegraded":"2023-12-24T19:57:07.520980+0000","last_fullsized":"2023-12-24T19:57:07.520980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.537256+0000","last_change":"2023-12-24T19:57:07.537204+0000","last_active":"2023-12-24T19:57:07.537256+0000","last_peered":"2023-12-24T19:57:07.537256+0000","last_clean":"2023-12-24T19:57:07.537256+0000","last_became_active":"2023-12-24T19:57:07.535804+0000","last_became_peered":"2023-12-24T19:57:07.535804+0000","last_unstale":"2023-12-24T19:57:07.537256+0000","last_undegraded":"2023-12-24T19:57:07.537256+0000","last_fullsized":"2023-12-24T19:57:07.537256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:08:43.312235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525929+0000","last_change":"2023-12-24T19:57:07.525839+0000","last_active":"2023-12-24T19:57:07.525929+0000","last_peered":"2023-12-24T19:57:07.525929+0000","last_clean":"2023-12-24T19:57:07.525929+0000","last_became_active":"2023-12-24T19:57:07.525535+0000","last_became_peered":"2023-12-24T19:57:07.525535+0000","last_unstale":"2023-12-24T19:57:07.525929+0000","last_undegraded":"2023-12-24T19:57:07.525929+0000","last_fullsized":"2023-12-24T19:57:07.525929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532601+0000","last_change":"2023-12-24T19:57:07.532497+0000","last_active":"2023-12-24T19:57:07.532601+0000","last_peered":"2023-12-24T19:57:07.532601+0000","last_clean":"2023-12-24T19:57:07.532601+0000","last_became_active":"2023-12-24T19:57:07.532280+0000","last_became_peered":"2023-12-24T19:57:07.532280+0000","last_unstale":"2023-12-24T19:57:07.532601+0000","last_undegraded":"2023-12-24T19:57:07.532601+0000","last_fullsized":"2023-12-24T19:57:07.532601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:01.279518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520933+0000","last_change":"2023-12-24T19:57:07.520487+0000","last_active":"2023-12-24T19:57:07.520933+0000","last_peered":"2023-12-24T19:57:07.520933+0000","last_clean":"2023-12-24T19:57:07.520933+0000","last_became_active":"2023-12-24T19:57:07.520238+0000","last_became_peered":"2023-12-24T19:57:07.520238+0000","last_unstale":"2023-12-24T19:57:07.520933+0000","last_undegraded":"2023-12-24T19:57:07.520933+0000","last_fullsized":"2023-12-24T19:57:07.520933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:16:20.311262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.521578+0000","last_change":"2023-12-24T19:57:07.521484+0000","last_active":"2023-12-24T19:57:07.521578+0000","last_peered":"2023-12-24T19:57:07.521578+0000","last_clean":"2023-12-24T19:57:07.521578+0000","last_became_active":"2023-12-24T19:57:07.521255+0000","last_became_peered":"2023-12-24T19:57:07.521255+0000","last_unstale":"2023-12-24T19:57:07.521578+0000","last_undegraded":"2023-12-24T19:57:07.521578+0000","last_fullsized":"2023-12-24T19:57:07.521578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527053+0000","last_change":"2023-12-24T19:57:07.526737+0000","last_active":"2023-12-24T19:57:07.527053+0000","last_peered":"2023-12-24T19:57:07.527053+0000","last_clean":"2023-12-24T19:57:07.527053+0000","last_became_active":"2023-12-24T19:57:07.526481+0000","last_became_peered":"2023-12-24T19:57:07.526481+0000","last_unstale":"2023-12-24T19:57:07.527053+0000","last_undegraded":"2023-12-24T19:57:07.527053+0000","last_fullsized":"2023-12-24T19:57:07.527053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:15.825581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530680+0000","last_change":"2023-12-24T19:57:07.530165+0000","last_active":"2023-12-24T19:57:07.530680+0000","last_peered":"2023-12-24T19:57:07.530680+0000","last_clean":"2023-12-24T19:57:07.530680+0000","last_became_active":"2023-12-24T19:57:07.529444+0000","last_became_peered":"2023-12-24T19:57:07.529444+0000","last_unstale":"2023-12-24T19:57:07.530680+0000","last_undegraded":"2023-12-24T19:57:07.530680+0000","last_fullsized":"2023-12-24T19:57:07.530680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518630+0000","last_change":"2023-12-24T19:57:07.518298+0000","last_active":"2023-12-24T19:57:07.518630+0000","last_peered":"2023-12-24T19:57:07.518630+0000","last_clean":"2023-12-24T19:57:07.518630+0000","last_became_active":"2023-12-24T19:57:07.517984+0000","last_became_peered":"2023-12-24T19:57:07.517984+0000","last_unstale":"2023-12-24T19:57:07.518630+0000","last_undegraded":"2023-12-24T19:57:07.518630+0000","last_fullsized":"2023-12-24T19:57:07.518630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524033+0000","last_change":"2023-12-24T19:57:07.523925+0000","last_active":"2023-12-24T19:57:07.524033+0000","last_peered":"2023-12-24T19:57:07.524033+0000","last_clean":"2023-12-24T19:57:07.524033+0000","last_became_active":"2023-12-24T19:57:07.523700+0000","last_became_peered":"2023-12-24T19:57:07.523700+0000","last_unstale":"2023-12-24T19:57:07.524033+0000","last_undegraded":"2023-12-24T19:57:07.524033+0000","last_fullsized":"2023-12-24T19:57:07.524033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520963+0000","last_change":"2023-12-24T19:57:07.519865+0000","last_active":"2023-12-24T19:57:07.520963+0000","last_peered":"2023-12-24T19:57:07.520963+0000","last_clean":"2023-12-24T19:57:07.520963+0000","last_became_active":"2023-12-24T19:57:07.519280+0000","last_became_peered":"2023-12-24T19:57:07.519280+0000","last_unstale":"2023-12-24T19:57:07.520963+0000","last_undegraded":"2023-12-24T19:57:07.520963+0000","last_fullsized":"2023-12-24T19:57:07.520963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535309+0000","last_change":"2023-12-24T19:57:07.535246+0000","last_active":"2023-12-24T19:57:07.535309+0000","last_peered":"2023-12-24T19:57:07.535309+0000","last_clean":"2023-12-24T19:57:07.535309+0000","last_became_active":"2023-12-24T19:57:07.534766+0000","last_became_peered":"2023-12-24T19:57:07.534766+0000","last_unstale":"2023-12-24T19:57:07.535309+0000","last_undegraded":"2023-12-24T19:57:07.535309+0000","last_fullsized":"2023-12-24T19:57:07.535309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:01.279518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518582+0000","last_change":"2023-12-24T19:57:07.518511+0000","last_active":"2023-12-24T19:57:07.518582+0000","last_peered":"2023-12-24T19:57:07.518582+0000","last_clean":"2023-12-24T19:57:07.518582+0000","last_became_active":"2023-12-24T19:57:07.518256+0000","last_became_peered":"2023-12-24T19:57:07.518256+0000","last_unstale":"2023-12-24T19:57:07.518582+0000","last_undegraded":"2023-12-24T19:57:07.518582+0000","last_fullsized":"2023-12-24T19:57:07.518582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535963+0000","last_change":"2023-12-24T19:57:07.534422+0000","last_active":"2023-12-24T19:57:07.535963+0000","last_peered":"2023-12-24T19:57:07.535963+0000","last_clean":"2023-12-24T19:57:07.535963+0000","last_became_active":"2023-12-24T19:57:07.533941+0000","last_became_peered":"2023-12-24T19:57:07.533941+0000","last_unstale":"2023-12-24T19:57:07.535963+0000","last_undegraded":"2023-12-24T19:57:07.535963+0000","last_fullsized":"2023-12-24T19:57:07.535963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529337+0000","last_change":"2023-12-24T19:57:06.524904+0000","last_active":"2023-12-24T19:57:07.529337+0000","last_peered":"2023-12-24T19:57:07.529337+0000","last_clean":"2023-12-24T19:57:07.529337+0000","last_became_active":"2023-12-24T19:57:06.524655+0000","last_became_peered":"2023-12-24T19:57:06.524655+0000","last_unstale":"2023-12-24T19:57:07.529337+0000","last_undegraded":"2023-12-24T19:57:07.529337+0000","last_fullsized":"2023-12-24T19:57:07.529337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530981+0000","last_change":"2023-12-24T19:57:07.530215+0000","last_active":"2023-12-24T19:57:07.530981+0000","last_peered":"2023-12-24T19:57:07.530981+0000","last_clean":"2023-12-24T19:57:07.530981+0000","last_became_active":"2023-12-24T19:57:07.529530+0000","last_became_peered":"2023-12-24T19:57:07.529530+0000","last_unstale":"2023-12-24T19:57:07.530981+0000","last_undegraded":"2023-12-24T19:57:07.530981+0000","last_fullsized":"2023-12-24T19:57:07.530981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:52.100502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530889+0000","last_change":"2023-12-24T19:57:06.513334+0000","last_active":"2023-12-24T19:57:07.530889+0000","last_peered":"2023-12-24T19:57:07.530889+0000","last_clean":"2023-12-24T19:57:07.530889+0000","last_became_active":"2023-12-24T19:57:06.513019+0000","last_became_peered":"2023-12-24T19:57:06.513019+0000","last_unstale":"2023-12-24T19:57:07.530889+0000","last_undegraded":"2023-12-24T19:57:07.530889+0000","last_fullsized":"2023-12-24T19:57:07.530889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517778+0000","last_change":"2023-12-24T19:57:07.517103+0000","last_active":"2023-12-24T19:57:07.517778+0000","last_peered":"2023-12-24T19:57:07.517778+0000","last_clean":"2023-12-24T19:57:07.517778+0000","last_became_active":"2023-12-24T19:57:07.516861+0000","last_became_peered":"2023-12-24T19:57:07.516861+0000","last_unstale":"2023-12-24T19:57:07.517778+0000","last_undegraded":"2023-12-24T19:57:07.517778+0000","last_fullsized":"2023-12-24T19:57:07.517778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536144+0000","last_change":"2023-12-24T19:57:06.525249+0000","last_active":"2023-12-24T19:57:07.536144+0000","last_peered":"2023-12-24T19:57:07.536144+0000","last_clean":"2023-12-24T19:57:07.536144+0000","last_became_active":"2023-12-24T19:57:06.525009+0000","last_became_peered":"2023-12-24T19:57:06.525009+0000","last_unstale":"2023-12-24T19:57:07.536144+0000","last_undegraded":"2023-12-24T19:57:07.536144+0000","last_fullsized":"2023-12-24T19:57:07.536144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:07.722680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523253+0000","last_change":"2023-12-24T19:57:07.523010+0000","last_active":"2023-12-24T19:57:07.523253+0000","last_peered":"2023-12-24T19:57:07.523253+0000","last_clean":"2023-12-24T19:57:07.523253+0000","last_became_active":"2023-12-24T19:57:07.522733+0000","last_became_peered":"2023-12-24T19:57:07.522733+0000","last_unstale":"2023-12-24T19:57:07.523253+0000","last_undegraded":"2023-12-24T19:57:07.523253+0000","last_fullsized":"2023-12-24T19:57:07.523253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532233+0000","last_change":"2023-12-24T19:57:06.527966+0000","last_active":"2023-12-24T19:57:07.532233+0000","last_peered":"2023-12-24T19:57:07.532233+0000","last_clean":"2023-12-24T19:57:07.532233+0000","last_became_active":"2023-12-24T19:57:06.527733+0000","last_became_peered":"2023-12-24T19:57:06.527733+0000","last_unstale":"2023-12-24T19:57:07.532233+0000","last_undegraded":"2023-12-24T19:57:07.532233+0000","last_fullsized":"2023-12-24T19:57:07.532233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:51.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523731+0000","last_change":"2023-12-24T19:57:07.523651+0000","last_active":"2023-12-24T19:57:07.523731+0000","last_peered":"2023-12-24T19:57:07.523731+0000","last_clean":"2023-12-24T19:57:07.523731+0000","last_became_active":"2023-12-24T19:57:07.523421+0000","last_became_peered":"2023-12-24T19:57:07.523421+0000","last_unstale":"2023-12-24T19:57:07.523731+0000","last_undegraded":"2023-12-24T19:57:07.523731+0000","last_fullsized":"2023-12-24T19:57:07.523731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528856+0000","last_change":"2023-12-24T19:57:06.525065+0000","last_active":"2023-12-24T19:57:07.528856+0000","last_peered":"2023-12-24T19:57:07.528856+0000","last_clean":"2023-12-24T19:57:07.528856+0000","last_became_active":"2023-12-24T19:57:06.524824+0000","last_became_peered":"2023-12-24T19:57:06.524824+0000","last_unstale":"2023-12-24T19:57:07.528856+0000","last_undegraded":"2023-12-24T19:57:07.528856+0000","last_fullsized":"2023-12-24T19:57:07.528856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:17.717686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523500+0000","last_change":"2023-12-24T19:57:07.523416+0000","last_active":"2023-12-24T19:57:07.523500+0000","last_peered":"2023-12-24T19:57:07.523500+0000","last_clean":"2023-12-24T19:57:07.523500+0000","last_became_active":"2023-12-24T19:57:07.523188+0000","last_became_peered":"2023-12-24T19:57:07.523188+0000","last_unstale":"2023-12-24T19:57:07.523500+0000","last_undegraded":"2023-12-24T19:57:07.523500+0000","last_fullsized":"2023-12-24T19:57:07.523500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:47.622467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528383+0000","last_change":"2023-12-24T19:57:06.523002+0000","last_active":"2023-12-24T19:57:07.528383+0000","last_peered":"2023-12-24T19:57:07.528383+0000","last_clean":"2023-12-24T19:57:07.528383+0000","last_became_active":"2023-12-24T19:57:06.522751+0000","last_became_peered":"2023-12-24T19:57:06.522751+0000","last_unstale":"2023-12-24T19:57:07.528383+0000","last_undegraded":"2023-12-24T19:57:07.528383+0000","last_fullsized":"2023-12-24T19:57:07.528383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524533+0000","last_change":"2023-12-24T19:57:07.524449+0000","last_active":"2023-12-24T19:57:07.524533+0000","last_peered":"2023-12-24T19:57:07.524533+0000","last_clean":"2023-12-24T19:57:07.524533+0000","last_became_active":"2023-12-24T19:57:07.524202+0000","last_became_peered":"2023-12-24T19:57:07.524202+0000","last_unstale":"2023-12-24T19:57:07.524533+0000","last_undegraded":"2023-12-24T19:57:07.524533+0000","last_fullsized":"2023-12-24T19:57:07.524533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526502+0000","last_change":"2023-12-24T19:57:06.524481+0000","last_active":"2023-12-24T19:57:07.526502+0000","last_peered":"2023-12-24T19:57:07.526502+0000","last_clean":"2023-12-24T19:57:07.526502+0000","last_became_active":"2023-12-24T19:57:06.523848+0000","last_became_peered":"2023-12-24T19:57:06.523848+0000","last_unstale":"2023-12-24T19:57:07.526502+0000","last_undegraded":"2023-12-24T19:57:07.526502+0000","last_fullsized":"2023-12-24T19:57:07.526502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525501+0000","last_change":"2023-12-24T19:57:07.525363+0000","last_active":"2023-12-24T19:57:07.525501+0000","last_peered":"2023-12-24T19:57:07.525501+0000","last_clean":"2023-12-24T19:57:07.525501+0000","last_became_active":"2023-12-24T19:57:07.524804+0000","last_became_peered":"2023-12-24T19:57:07.524804+0000","last_unstale":"2023-12-24T19:57:07.525501+0000","last_undegraded":"2023-12-24T19:57:07.525501+0000","last_fullsized":"2023-12-24T19:57:07.525501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:38.268155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516808+0000","last_change":"2023-12-24T19:57:06.522784+0000","last_active":"2023-12-24T19:57:07.516808+0000","last_peered":"2023-12-24T19:57:07.516808+0000","last_clean":"2023-12-24T19:57:07.516808+0000","last_became_active":"2023-12-24T19:57:06.522559+0000","last_became_peered":"2023-12-24T19:57:06.522559+0000","last_unstale":"2023-12-24T19:57:07.516808+0000","last_undegraded":"2023-12-24T19:57:07.516808+0000","last_fullsized":"2023-12-24T19:57:07.516808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529007+0000","last_change":"2023-12-24T19:57:07.528916+0000","last_active":"2023-12-24T19:57:07.529007+0000","last_peered":"2023-12-24T19:57:07.529007+0000","last_clean":"2023-12-24T19:57:07.529007+0000","last_became_active":"2023-12-24T19:57:07.528614+0000","last_became_peered":"2023-12-24T19:57:07.528614+0000","last_unstale":"2023-12-24T19:57:07.529007+0000","last_undegraded":"2023-12-24T19:57:07.529007+0000","last_fullsized":"2023-12-24T19:57:07.529007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518133+0000","last_change":"2023-12-24T19:57:06.521620+0000","last_active":"2023-12-24T19:57:07.518133+0000","last_peered":"2023-12-24T19:57:07.518133+0000","last_clean":"2023-12-24T19:57:07.518133+0000","last_became_active":"2023-12-24T19:57:06.521329+0000","last_became_peered":"2023-12-24T19:57:06.521329+0000","last_unstale":"2023-12-24T19:57:07.518133+0000","last_undegraded":"2023-12-24T19:57:07.518133+0000","last_fullsized":"2023-12-24T19:57:07.518133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535124+0000","last_change":"2023-12-24T19:57:07.534974+0000","last_active":"2023-12-24T19:57:07.535124+0000","last_peered":"2023-12-24T19:57:07.535124+0000","last_clean":"2023-12-24T19:57:07.535124+0000","last_became_active":"2023-12-24T19:57:07.534336+0000","last_became_peered":"2023-12-24T19:57:07.534336+0000","last_unstale":"2023-12-24T19:57:07.535124+0000","last_undegraded":"2023-12-24T19:57:07.535124+0000","last_fullsized":"2023-12-24T19:57:07.535124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:21.111646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515712+0000","last_change":"2023-12-24T19:57:06.525016+0000","last_active":"2023-12-24T19:57:07.515712+0000","last_peered":"2023-12-24T19:57:07.515712+0000","last_clean":"2023-12-24T19:57:07.515712+0000","last_became_active":"2023-12-24T19:57:06.524783+0000","last_became_peered":"2023-12-24T19:57:06.524783+0000","last_unstale":"2023-12-24T19:57:07.515712+0000","last_undegraded":"2023-12-24T19:57:07.515712+0000","last_fullsized":"2023-12-24T19:57:07.515712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519757+0000","last_change":"2023-12-24T19:57:07.519678+0000","last_active":"2023-12-24T19:57:07.519757+0000","last_peered":"2023-12-24T19:57:07.519757+0000","last_clean":"2023-12-24T19:57:07.519757+0000","last_became_active":"2023-12-24T19:57:07.519439+0000","last_became_peered":"2023-12-24T19:57:07.519439+0000","last_unstale":"2023-12-24T19:57:07.519757+0000","last_undegraded":"2023-12-24T19:57:07.519757+0000","last_fullsized":"2023-12-24T19:57:07.519757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525729+0000","last_change":"2023-12-24T19:57:06.520438+0000","last_active":"2023-12-24T19:57:07.525729+0000","last_peered":"2023-12-24T19:57:07.525729+0000","last_clean":"2023-12-24T19:57:07.525729+0000","last_became_active":"2023-12-24T19:57:06.520107+0000","last_became_peered":"2023-12-24T19:57:06.520107+0000","last_unstale":"2023-12-24T19:57:07.525729+0000","last_undegraded":"2023-12-24T19:57:07.525729+0000","last_fullsized":"2023-12-24T19:57:07.525729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:18.362103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529743+0000","last_change":"2023-12-24T19:57:07.528796+0000","last_active":"2023-12-24T19:57:07.529743+0000","last_peered":"2023-12-24T19:57:07.529743+0000","last_clean":"2023-12-24T19:57:07.529743+0000","last_became_active":"2023-12-24T19:57:07.528655+0000","last_became_peered":"2023-12-24T19:57:07.528655+0000","last_unstale":"2023-12-24T19:57:07.529743+0000","last_undegraded":"2023-12-24T19:57:07.529743+0000","last_fullsized":"2023-12-24T19:57:07.529743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534720+0000","last_change":"2023-12-24T19:57:06.521232+0000","last_active":"2023-12-24T19:57:07.534720+0000","last_peered":"2023-12-24T19:57:07.534720+0000","last_clean":"2023-12-24T19:57:07.534720+0000","last_became_active":"2023-12-24T19:57:06.520781+0000","last_became_peered":"2023-12-24T19:57:06.520781+0000","last_unstale":"2023-12-24T19:57:07.534720+0000","last_undegraded":"2023-12-24T19:57:07.534720+0000","last_fullsized":"2023-12-24T19:57:07.534720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530590+0000","last_change":"2023-12-24T19:57:07.530411+0000","last_active":"2023-12-24T19:57:07.530590+0000","last_peered":"2023-12-24T19:57:07.530590+0000","last_clean":"2023-12-24T19:57:07.530590+0000","last_became_active":"2023-12-24T19:57:07.530142+0000","last_became_peered":"2023-12-24T19:57:07.530142+0000","last_unstale":"2023-12-24T19:57:07.530590+0000","last_undegraded":"2023-12-24T19:57:07.530590+0000","last_fullsized":"2023-12-24T19:57:07.530590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:49.060653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527723+0000","last_change":"2023-12-24T19:57:06.518450+0000","last_active":"2023-12-24T19:57:07.527723+0000","last_peered":"2023-12-24T19:57:07.527723+0000","last_clean":"2023-12-24T19:57:07.527723+0000","last_became_active":"2023-12-24T19:57:06.518168+0000","last_became_peered":"2023-12-24T19:57:06.518168+0000","last_unstale":"2023-12-24T19:57:07.527723+0000","last_undegraded":"2023-12-24T19:57:07.527723+0000","last_fullsized":"2023-12-24T19:57:07.527723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:34.036458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534331+0000","last_change":"2023-12-24T19:57:07.534267+0000","last_active":"2023-12-24T19:57:07.534331+0000","last_peered":"2023-12-24T19:57:07.534331+0000","last_clean":"2023-12-24T19:57:07.534331+0000","last_became_active":"2023-12-24T19:57:07.533743+0000","last_became_peered":"2023-12-24T19:57:07.533743+0000","last_unstale":"2023-12-24T19:57:07.534331+0000","last_undegraded":"2023-12-24T19:57:07.534331+0000","last_fullsized":"2023-12-24T19:57:07.534331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516585+0000","last_change":"2023-12-24T19:57:06.519259+0000","last_active":"2023-12-24T19:57:07.516585+0000","last_peered":"2023-12-24T19:57:07.516585+0000","last_clean":"2023-12-24T19:57:07.516585+0000","last_became_active":"2023-12-24T19:57:06.518732+0000","last_became_peered":"2023-12-24T19:57:06.518732+0000","last_unstale":"2023-12-24T19:57:07.516585+0000","last_undegraded":"2023-12-24T19:57:07.516585+0000","last_fullsized":"2023-12-24T19:57:07.516585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535999+0000","last_change":"2023-12-24T19:57:07.535031+0000","last_active":"2023-12-24T19:57:07.535999+0000","last_peered":"2023-12-24T19:57:07.535999+0000","last_clean":"2023-12-24T19:57:07.535999+0000","last_became_active":"2023-12-24T19:57:07.534715+0000","last_became_peered":"2023-12-24T19:57:07.534715+0000","last_unstale":"2023-12-24T19:57:07.535999+0000","last_undegraded":"2023-12-24T19:57:07.535999+0000","last_fullsized":"2023-12-24T19:57:07.535999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:21.111646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517413+0000","last_change":"2023-12-24T19:57:06.524250+0000","last_active":"2023-12-24T19:57:07.517413+0000","last_peered":"2023-12-24T19:57:07.517413+0000","last_clean":"2023-12-24T19:57:07.517413+0000","last_became_active":"2023-12-24T19:57:06.523702+0000","last_became_peered":"2023-12-24T19:57:06.523702+0000","last_unstale":"2023-12-24T19:57:07.517413+0000","last_undegraded":"2023-12-24T19:57:07.517413+0000","last_fullsized":"2023-12-24T19:57:07.517413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520473+0000","last_change":"2023-12-24T19:57:07.520401+0000","last_active":"2023-12-24T19:57:07.520473+0000","last_peered":"2023-12-24T19:57:07.520473+0000","last_clean":"2023-12-24T19:57:07.520473+0000","last_became_active":"2023-12-24T19:57:07.520170+0000","last_became_peered":"2023-12-24T19:57:07.520170+0000","last_unstale":"2023-12-24T19:57:07.520473+0000","last_undegraded":"2023-12-24T19:57:07.520473+0000","last_fullsized":"2023-12-24T19:57:07.520473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530362+0000","last_change":"2023-12-24T19:57:06.526329+0000","last_active":"2023-12-24T19:57:07.530362+0000","last_peered":"2023-12-24T19:57:07.530362+0000","last_clean":"2023-12-24T19:57:07.530362+0000","last_became_active":"2023-12-24T19:57:06.525718+0000","last_became_peered":"2023-12-24T19:57:06.525718+0000","last_unstale":"2023-12-24T19:57:07.530362+0000","last_undegraded":"2023-12-24T19:57:07.530362+0000","last_fullsized":"2023-12-24T19:57:07.530362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.537377+0000","last_change":"2023-12-24T19:57:07.537325+0000","last_active":"2023-12-24T19:57:07.537377+0000","last_peered":"2023-12-24T19:57:07.537377+0000","last_clean":"2023-12-24T19:57:07.537377+0000","last_became_active":"2023-12-24T19:57:07.536102+0000","last_became_peered":"2023-12-24T19:57:07.536102+0000","last_unstale":"2023-12-24T19:57:07.537377+0000","last_undegraded":"2023-12-24T19:57:07.537377+0000","last_fullsized":"2023-12-24T19:57:07.537377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:52:11.849851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528207+0000","last_change":"2023-12-24T19:57:06.518295+0000","last_active":"2023-12-24T19:57:07.528207+0000","last_peered":"2023-12-24T19:57:07.528207+0000","last_clean":"2023-12-24T19:57:07.528207+0000","last_became_active":"2023-12-24T19:57:06.516591+0000","last_became_peered":"2023-12-24T19:57:06.516591+0000","last_unstale":"2023-12-24T19:57:07.528207+0000","last_undegraded":"2023-12-24T19:57:07.528207+0000","last_fullsized":"2023-12-24T19:57:07.528207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:34.036458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536964+0000","last_change":"2023-12-24T19:57:07.536755+0000","last_active":"2023-12-24T19:57:07.536964+0000","last_peered":"2023-12-24T19:57:07.536964+0000","last_clean":"2023-12-24T19:57:07.536964+0000","last_became_active":"2023-12-24T19:57:07.536502+0000","last_became_peered":"2023-12-24T19:57:07.536502+0000","last_unstale":"2023-12-24T19:57:07.536964+0000","last_undegraded":"2023-12-24T19:57:07.536964+0000","last_fullsized":"2023-12-24T19:57:07.536964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:21.152234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517131+0000","last_change":"2023-12-24T19:57:06.519180+0000","last_active":"2023-12-24T19:57:07.517131+0000","last_peered":"2023-12-24T19:57:07.517131+0000","last_clean":"2023-12-24T19:57:07.517131+0000","last_became_active":"2023-12-24T19:57:06.518906+0000","last_became_peered":"2023-12-24T19:57:06.518906+0000","last_unstale":"2023-12-24T19:57:07.517131+0000","last_undegraded":"2023-12-24T19:57:07.517131+0000","last_fullsized":"2023-12-24T19:57:07.517131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531876+0000","last_change":"2023-12-24T19:57:07.531626+0000","last_active":"2023-12-24T19:57:07.531876+0000","last_peered":"2023-12-24T19:57:07.531876+0000","last_clean":"2023-12-24T19:57:07.531876+0000","last_became_active":"2023-12-24T19:57:07.530556+0000","last_became_peered":"2023-12-24T19:57:07.530556+0000","last_unstale":"2023-12-24T19:57:07.531876+0000","last_undegraded":"2023-12-24T19:57:07.531876+0000","last_fullsized":"2023-12-24T19:57:07.531876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:43:42.570184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515831+0000","last_change":"2023-12-24T19:57:06.522317+0000","last_active":"2023-12-24T19:57:07.515831+0000","last_peered":"2023-12-24T19:57:07.515831+0000","last_clean":"2023-12-24T19:57:07.515831+0000","last_became_active":"2023-12-24T19:57:06.521804+0000","last_became_peered":"2023-12-24T19:57:06.521804+0000","last_unstale":"2023-12-24T19:57:07.515831+0000","last_undegraded":"2023-12-24T19:57:07.515831+0000","last_fullsized":"2023-12-24T19:57:07.515831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525176+0000","last_change":"2023-12-24T19:57:07.525106+0000","last_active":"2023-12-24T19:57:07.525176+0000","last_peered":"2023-12-24T19:57:07.525176+0000","last_clean":"2023-12-24T19:57:07.525176+0000","last_became_active":"2023-12-24T19:57:07.524852+0000","last_became_peered":"2023-12-24T19:57:07.524852+0000","last_unstale":"2023-12-24T19:57:07.525176+0000","last_undegraded":"2023-12-24T19:57:07.525176+0000","last_fullsized":"2023-12-24T19:57:07.525176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:19.368177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517665+0000","last_change":"2023-12-24T19:57:07.517596+0000","last_active":"2023-12-24T19:57:07.517665+0000","last_peered":"2023-12-24T19:57:07.517665+0000","last_clean":"2023-12-24T19:57:07.517665+0000","last_became_active":"2023-12-24T19:57:07.517352+0000","last_became_peered":"2023-12-24T19:57:07.517352+0000","last_unstale":"2023-12-24T19:57:07.517665+0000","last_undegraded":"2023-12-24T19:57:07.517665+0000","last_fullsized":"2023-12-24T19:57:07.517665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.513830+0000","last_change":"2023-12-24T19:57:06.526469+0000","last_active":"2023-12-24T19:57:07.513830+0000","last_peered":"2023-12-24T19:57:07.513830+0000","last_clean":"2023-12-24T19:57:07.513830+0000","last_became_active":"2023-12-24T19:57:06.526071+0000","last_became_peered":"2023-12-24T19:57:06.526071+0000","last_unstale":"2023-12-24T19:57:07.513830+0000","last_undegraded":"2023-12-24T19:57:07.513830+0000","last_fullsized":"2023-12-24T19:57:07.513830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527346+0000","last_change":"2023-12-24T19:57:07.527208+0000","last_active":"2023-12-24T19:57:07.527346+0000","last_peered":"2023-12-24T19:57:07.527346+0000","last_clean":"2023-12-24T19:57:07.527346+0000","last_became_active":"2023-12-24T19:57:07.526792+0000","last_became_peered":"2023-12-24T19:57:07.526792+0000","last_unstale":"2023-12-24T19:57:07.527346+0000","last_undegraded":"2023-12-24T19:57:07.527346+0000","last_fullsized":"2023-12-24T19:57:07.527346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:43:42.570184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516700+0000","last_change":"2023-12-24T19:57:06.521786+0000","last_active":"2023-12-24T19:57:07.516700+0000","last_peered":"2023-12-24T19:57:07.516700+0000","last_clean":"2023-12-24T19:57:07.516700+0000","last_became_active":"2023-12-24T19:57:06.521491+0000","last_became_peered":"2023-12-24T19:57:06.521491+0000","last_unstale":"2023-12-24T19:57:07.516700+0000","last_undegraded":"2023-12-24T19:57:07.516700+0000","last_fullsized":"2023-12-24T19:57:07.516700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527038+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:57:07.527038+0000","last_peered":"2023-12-24T19:57:07.527038+0000","last_clean":"2023-12-24T19:57:07.527038+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:57:07.527038+0000","last_undegraded":"2023-12-24T19:57:07.527038+0000","last_fullsized":"2023-12-24T19:57:07.527038+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526944+0000","last_change":"2023-12-24T19:57:07.526851+0000","last_active":"2023-12-24T19:57:07.526944+0000","last_peered":"2023-12-24T19:57:07.526944+0000","last_clean":"2023-12-24T19:57:07.526944+0000","last_became_active":"2023-12-24T19:57:07.526572+0000","last_became_peered":"2023-12-24T19:57:07.526572+0000","last_unstale":"2023-12-24T19:57:07.526944+0000","last_undegraded":"2023-12-24T19:57:07.526944+0000","last_fullsized":"2023-12-24T19:57:07.526944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526230+0000","last_change":"2023-12-24T19:57:06.527232+0000","last_active":"2023-12-24T19:57:07.526230+0000","last_peered":"2023-12-24T19:57:07.526230+0000","last_clean":"2023-12-24T19:57:07.526230+0000","last_became_active":"2023-12-24T19:57:06.526965+0000","last_became_peered":"2023-12-24T19:57:06.526965+0000","last_unstale":"2023-12-24T19:57:07.526230+0000","last_undegraded":"2023-12-24T19:57:07.526230+0000","last_fullsized":"2023-12-24T19:57:07.526230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526332+0000","last_change":"2023-12-24T19:57:06.527833+0000","last_active":"2023-12-24T19:57:07.526332+0000","last_peered":"2023-12-24T19:57:07.526332+0000","last_clean":"2023-12-24T19:57:07.526332+0000","last_became_active":"2023-12-24T19:57:06.527507+0000","last_became_peered":"2023-12-24T19:57:06.527507+0000","last_unstale":"2023-12-24T19:57:07.526332+0000","last_undegraded":"2023-12-24T19:57:07.526332+0000","last_fullsized":"2023-12-24T19:57:07.526332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517724+0000","last_change":"2023-12-24T19:57:07.517660+0000","last_active":"2023-12-24T19:57:07.517724+0000","last_peered":"2023-12-24T19:57:07.517724+0000","last_clean":"2023-12-24T19:57:07.517724+0000","last_became_active":"2023-12-24T19:57:07.517397+0000","last_became_peered":"2023-12-24T19:57:07.517397+0000","last_unstale":"2023-12-24T19:57:07.517724+0000","last_undegraded":"2023-12-24T19:57:07.517724+0000","last_fullsized":"2023-12-24T19:57:07.517724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-24T19:57:08.515389+0000","last_change":"2023-12-24T19:57:06.525879+0000","last_active":"2023-12-24T19:57:08.515389+0000","last_peered":"2023-12-24T19:57:08.515389+0000","last_clean":"2023-12-24T19:57:08.515389+0000","last_became_active":"2023-12-24T19:57:06.525637+0000","last_became_peered":"2023-12-24T19:57:06.525637+0000","last_unstale":"2023-12-24T19:57:08.515389+0000","last_undegraded":"2023-12-24T19:57:08.515389+0000","last_fullsized":"2023-12-24T19:57:08.515389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:46.616394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534151+0000","last_change":"2023-12-24T19:57:07.534062+0000","last_active":"2023-12-24T19:57:07.534151+0000","last_peered":"2023-12-24T19:57:07.534151+0000","last_clean":"2023-12-24T19:57:07.534151+0000","last_became_active":"2023-12-24T19:57:07.533898+0000","last_became_peered":"2023-12-24T19:57:07.533898+0000","last_unstale":"2023-12-24T19:57:07.534151+0000","last_undegraded":"2023-12-24T19:57:07.534151+0000","last_fullsized":"2023-12-24T19:57:07.534151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536398+0000","last_change":"2023-12-24T19:57:06.525416+0000","last_active":"2023-12-24T19:57:07.536398+0000","last_peered":"2023-12-24T19:57:07.536398+0000","last_clean":"2023-12-24T19:57:07.536398+0000","last_became_active":"2023-12-24T19:57:06.525105+0000","last_became_peered":"2023-12-24T19:57:06.525105+0000","last_unstale":"2023-12-24T19:57:07.536398+0000","last_undegraded":"2023-12-24T19:57:07.536398+0000","last_fullsized":"2023-12-24T19:57:07.536398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518611+0000","last_change":"2023-12-24T19:57:07.518192+0000","last_active":"2023-12-24T19:57:07.518611+0000","last_peered":"2023-12-24T19:57:07.518611+0000","last_clean":"2023-12-24T19:57:07.518611+0000","last_became_active":"2023-12-24T19:57:07.517957+0000","last_became_peered":"2023-12-24T19:57:07.517957+0000","last_unstale":"2023-12-24T19:57:07.518611+0000","last_undegraded":"2023-12-24T19:57:07.518611+0000","last_fullsized":"2023-12-24T19:57:07.518611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526634+0000","last_change":"2023-12-24T19:57:06.526486+0000","last_active":"2023-12-24T19:57:07.526634+0000","last_peered":"2023-12-24T19:57:07.526634+0000","last_clean":"2023-12-24T19:57:07.526634+0000","last_became_active":"2023-12-24T19:57:06.526260+0000","last_became_peered":"2023-12-24T19:57:06.526260+0000","last_unstale":"2023-12-24T19:57:07.526634+0000","last_undegraded":"2023-12-24T19:57:07.526634+0000","last_fullsized":"2023-12-24T19:57:07.526634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:46.616394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525256+0000","last_change":"2023-12-24T19:57:07.525195+0000","last_active":"2023-12-24T19:57:07.525256+0000","last_peered":"2023-12-24T19:57:07.525256+0000","last_clean":"2023-12-24T19:57:07.525256+0000","last_became_active":"2023-12-24T19:57:07.524903+0000","last_became_peered":"2023-12-24T19:57:07.524903+0000","last_unstale":"2023-12-24T19:57:07.525256+0000","last_undegraded":"2023-12-24T19:57:07.525256+0000","last_fullsized":"2023-12-24T19:57:07.525256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517242+0000","last_change":"2023-12-24T19:57:06.524497+0000","last_active":"2023-12-24T19:57:07.517242+0000","last_peered":"2023-12-24T19:57:07.517242+0000","last_clean":"2023-12-24T19:57:07.517242+0000","last_became_active":"2023-12-24T19:57:06.524278+0000","last_became_peered":"2023-12-24T19:57:06.524278+0000","last_unstale":"2023-12-24T19:57:07.517242+0000","last_undegraded":"2023-12-24T19:57:07.517242+0000","last_fullsized":"2023-12-24T19:57:07.517242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526976+0000","last_change":"2023-12-24T19:57:07.526151+0000","last_active":"2023-12-24T19:57:07.526976+0000","last_peered":"2023-12-24T19:57:07.526976+0000","last_clean":"2023-12-24T19:57:07.526976+0000","last_became_active":"2023-12-24T19:57:07.525918+0000","last_became_peered":"2023-12-24T19:57:07.525918+0000","last_unstale":"2023-12-24T19:57:07.526976+0000","last_undegraded":"2023-12-24T19:57:07.526976+0000","last_fullsized":"2023-12-24T19:57:07.526976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516440+0000","last_change":"2023-12-24T19:57:06.518972+0000","last_active":"2023-12-24T19:57:07.516440+0000","last_peered":"2023-12-24T19:57:07.516440+0000","last_clean":"2023-12-24T19:57:07.516440+0000","last_became_active":"2023-12-24T19:57:06.518437+0000","last_became_peered":"2023-12-24T19:57:06.518437+0000","last_unstale":"2023-12-24T19:57:07.516440+0000","last_undegraded":"2023-12-24T19:57:07.516440+0000","last_fullsized":"2023-12-24T19:57:07.516440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:51.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531001+0000","last_change":"2023-12-24T19:57:07.530312+0000","last_active":"2023-12-24T19:57:07.531001+0000","last_peered":"2023-12-24T19:57:07.531001+0000","last_clean":"2023-12-24T19:57:07.531001+0000","last_became_active":"2023-12-24T19:57:07.529911+0000","last_became_peered":"2023-12-24T19:57:07.529911+0000","last_unstale":"2023-12-24T19:57:07.531001+0000","last_undegraded":"2023-12-24T19:57:07.531001+0000","last_fullsized":"2023-12-24T19:57:07.531001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.533595+0000","last_change":"2023-12-24T19:57:06.527759+0000","last_active":"2023-12-24T19:57:07.533595+0000","last_peered":"2023-12-24T19:57:07.533595+0000","last_clean":"2023-12-24T19:57:07.533595+0000","last_became_active":"2023-12-24T19:57:06.527500+0000","last_became_peered":"2023-12-24T19:57:06.527500+0000","last_unstale":"2023-12-24T19:57:07.533595+0000","last_undegraded":"2023-12-24T19:57:07.533595+0000","last_fullsized":"2023-12-24T19:57:07.533595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525889+0000","last_change":"2023-12-24T19:57:07.525825+0000","last_active":"2023-12-24T19:57:07.525889+0000","last_peered":"2023-12-24T19:57:07.525889+0000","last_clean":"2023-12-24T19:57:07.525889+0000","last_became_active":"2023-12-24T19:57:07.525212+0000","last_became_peered":"2023-12-24T19:57:07.525212+0000","last_unstale":"2023-12-24T19:57:07.525889+0000","last_undegraded":"2023-12-24T19:57:07.525889+0000","last_fullsized":"2023-12-24T19:57:07.525889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.514129+0000","last_change":"2023-12-24T19:57:06.523392+0000","last_active":"2023-12-24T19:57:07.514129+0000","last_peered":"2023-12-24T19:57:07.514129+0000","last_clean":"2023-12-24T19:57:07.514129+0000","last_became_active":"2023-12-24T19:57:06.523144+0000","last_became_peered":"2023-12-24T19:57:06.523144+0000","last_unstale":"2023-12-24T19:57:07.514129+0000","last_undegraded":"2023-12-24T19:57:07.514129+0000","last_fullsized":"2023-12-24T19:57:07.514129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532749+0000","last_change":"2023-12-24T19:57:07.532683+0000","last_active":"2023-12-24T19:57:07.532749+0000","last_peered":"2023-12-24T19:57:07.532749+0000","last_clean":"2023-12-24T19:57:07.532749+0000","last_became_active":"2023-12-24T19:57:07.532453+0000","last_became_peered":"2023-12-24T19:57:07.532453+0000","last_unstale":"2023-12-24T19:57:07.532749+0000","last_undegraded":"2023-12-24T19:57:07.532749+0000","last_fullsized":"2023-12-24T19:57:07.532749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:39.083422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524143+0000","last_change":"2023-12-24T19:57:06.524540+0000","last_active":"2023-12-24T19:57:07.524143+0000","last_peered":"2023-12-24T19:57:07.524143+0000","last_clean":"2023-12-24T19:57:07.524143+0000","last_became_active":"2023-12-24T19:57:06.524289+0000","last_became_peered":"2023-12-24T19:57:06.524289+0000","last_unstale":"2023-12-24T19:57:07.524143+0000","last_undegraded":"2023-12-24T19:57:07.524143+0000","last_fullsized":"2023-12-24T19:57:07.524143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530781+0000","last_change":"2023-12-24T19:57:07.527389+0000","last_active":"2023-12-24T19:57:07.530781+0000","last_peered":"2023-12-24T19:57:07.530781+0000","last_clean":"2023-12-24T19:57:07.530781+0000","last_became_active":"2023-12-24T19:57:07.527176+0000","last_became_peered":"2023-12-24T19:57:07.527176+0000","last_unstale":"2023-12-24T19:57:07.530781+0000","last_undegraded":"2023-12-24T19:57:07.530781+0000","last_fullsized":"2023-12-24T19:57:07.530781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:49.060653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530624+0000","last_change":"2023-12-24T19:57:06.521236+0000","last_active":"2023-12-24T19:57:07.530624+0000","last_peered":"2023-12-24T19:57:07.530624+0000","last_clean":"2023-12-24T19:57:07.530624+0000","last_became_active":"2023-12-24T19:57:06.520985+0000","last_became_peered":"2023-12-24T19:57:06.520985+0000","last_unstale":"2023-12-24T19:57:07.530624+0000","last_undegraded":"2023-12-24T19:57:07.530624+0000","last_fullsized":"2023-12-24T19:57:07.530624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531745+0000","last_change":"2023-12-24T19:57:07.530650+0000","last_active":"2023-12-24T19:57:07.531745+0000","last_peered":"2023-12-24T19:57:07.531745+0000","last_clean":"2023-12-24T19:57:07.531745+0000","last_became_active":"2023-12-24T19:57:07.528576+0000","last_became_peered":"2023-12-24T19:57:07.528576+0000","last_unstale":"2023-12-24T19:57:07.531745+0000","last_undegraded":"2023-12-24T19:57:07.531745+0000","last_fullsized":"2023-12-24T19:57:07.531745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:54:49.589999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.521561+0000","last_change":"2023-12-24T19:57:07.520973+0000","last_active":"2023-12-24T19:57:07.521561+0000","last_peered":"2023-12-24T19:57:07.521561+0000","last_clean":"2023-12-24T19:57:07.521561+0000","last_became_active":"2023-12-24T19:57:07.520830+0000","last_became_peered":"2023-12-24T19:57:07.520830+0000","last_unstale":"2023-12-24T19:57:07.521561+0000","last_undegraded":"2023-12-24T19:57:07.521561+0000","last_fullsized":"2023-12-24T19:57:07.521561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519817+0000","last_change":"2023-12-24T19:57:07.519770+0000","last_active":"2023-12-24T19:57:07.519817+0000","last_peered":"2023-12-24T19:57:07.519817+0000","last_clean":"2023-12-24T19:57:07.519817+0000","last_became_active":"2023-12-24T19:57:07.519599+0000","last_became_peered":"2023-12-24T19:57:07.519599+0000","last_unstale":"2023-12-24T19:57:07.519817+0000","last_undegraded":"2023-12-24T19:57:07.519817+0000","last_fullsized":"2023-12-24T19:57:07.519817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526841+0000","last_change":"2023-12-24T19:57:07.526619+0000","last_active":"2023-12-24T19:57:07.526841+0000","last_peered":"2023-12-24T19:57:07.526841+0000","last_clean":"2023-12-24T19:57:07.526841+0000","last_became_active":"2023-12-24T19:57:07.526393+0000","last_became_peered":"2023-12-24T19:57:07.526393+0000","last_unstale":"2023-12-24T19:57:07.526841+0000","last_undegraded":"2023-12-24T19:57:07.526841+0000","last_fullsized":"2023-12-24T19:57:07.526841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530703+0000","last_change":"2023-12-24T19:57:07.530632+0000","last_active":"2023-12-24T19:57:07.530703+0000","last_peered":"2023-12-24T19:57:07.530703+0000","last_clean":"2023-12-24T19:57:07.530703+0000","last_became_active":"2023-12-24T19:57:07.530304+0000","last_became_peered":"2023-12-24T19:57:07.530304+0000","last_unstale":"2023-12-24T19:57:07.530703+0000","last_undegraded":"2023-12-24T19:57:07.530703+0000","last_fullsized":"2023-12-24T19:57:07.530703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528770+0000","last_change":"2023-12-24T19:57:07.528719+0000","last_active":"2023-12-24T19:57:07.528770+0000","last_peered":"2023-12-24T19:57:07.528770+0000","last_clean":"2023-12-24T19:57:07.528770+0000","last_became_active":"2023-12-24T19:57:07.528307+0000","last_became_peered":"2023-12-24T19:57:07.528307+0000","last_unstale":"2023-12-24T19:57:07.528770+0000","last_undegraded":"2023-12-24T19:57:07.528770+0000","last_fullsized":"2023-12-24T19:57:07.528770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526251+0000","last_change":"2023-12-24T19:57:07.526152+0000","last_active":"2023-12-24T19:57:07.526251+0000","last_peered":"2023-12-24T19:57:07.526251+0000","last_clean":"2023-12-24T19:57:07.526251+0000","last_became_active":"2023-12-24T19:57:07.525938+0000","last_became_peered":"2023-12-24T19:57:07.525938+0000","last_unstale":"2023-12-24T19:57:07.526251+0000","last_undegraded":"2023-12-24T19:57:07.526251+0000","last_fullsized":"2023-12-24T19:57:07.526251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534227+0000","last_change":"2023-12-24T19:57:07.534143+0000","last_active":"2023-12-24T19:57:07.534227+0000","last_peered":"2023-12-24T19:57:07.534227+0000","last_clean":"2023-12-24T19:57:07.534227+0000","last_became_active":"2023-12-24T19:57:07.533934+0000","last_became_peered":"2023-12-24T19:57:07.533934+0000","last_unstale":"2023-12-24T19:57:07.534227+0000","last_undegraded":"2023-12-24T19:57:07.534227+0000","last_fullsized":"2023-12-24T19:57:07.534227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526994+0000","last_change":"2023-12-24T19:57:07.526319+0000","last_active":"2023-12-24T19:57:07.526994+0000","last_peered":"2023-12-24T19:57:07.526994+0000","last_clean":"2023-12-24T19:57:07.526994+0000","last_became_active":"2023-12-24T19:57:07.526080+0000","last_became_peered":"2023-12-24T19:57:07.526080+0000","last_unstale":"2023-12-24T19:57:07.526994+0000","last_undegraded":"2023-12-24T19:57:07.526994+0000","last_fullsized":"2023-12-24T19:57:07.526994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531848+0000","last_change":"2023-12-24T19:57:07.530837+0000","last_active":"2023-12-24T19:57:07.531848+0000","last_peered":"2023-12-24T19:57:07.531848+0000","last_clean":"2023-12-24T19:57:07.531848+0000","last_became_active":"2023-12-24T19:57:07.527904+0000","last_became_peered":"2023-12-24T19:57:07.527904+0000","last_unstale":"2023-12-24T19:57:07.531848+0000","last_undegraded":"2023-12-24T19:57:07.531848+0000","last_fullsized":"2023-12-24T19:57:07.531848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528649+0000","last_change":"2023-12-24T19:57:07.528578+0000","last_active":"2023-12-24T19:57:07.528649+0000","last_peered":"2023-12-24T19:57:07.528649+0000","last_clean":"2023-12-24T19:57:07.528649+0000","last_became_active":"2023-12-24T19:57:07.528029+0000","last_became_peered":"2023-12-24T19:57:07.528029+0000","last_unstale":"2023-12-24T19:57:07.528649+0000","last_undegraded":"2023-12-24T19:57:07.528649+0000","last_fullsized":"2023-12-24T19:57:07.528649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535175+0000","last_change":"2023-12-24T19:57:07.535104+0000","last_active":"2023-12-24T19:57:07.535175+0000","last_peered":"2023-12-24T19:57:07.535175+0000","last_clean":"2023-12-24T19:57:07.535175+0000","last_became_active":"2023-12-24T19:57:07.534556+0000","last_became_peered":"2023-12-24T19:57:07.534556+0000","last_unstale":"2023-12-24T19:57:07.535175+0000","last_undegraded":"2023-12-24T19:57:07.535175+0000","last_fullsized":"2023-12-24T19:57:07.535175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:52:11.849851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534469+0000","last_change":"2023-12-24T19:57:07.534398+0000","last_active":"2023-12-24T19:57:07.534469+0000","last_peered":"2023-12-24T19:57:07.534469+0000","last_clean":"2023-12-24T19:57:07.534469+0000","last_became_active":"2023-12-24T19:57:07.534052+0000","last_became_peered":"2023-12-24T19:57:07.534052+0000","last_unstale":"2023-12-24T19:57:07.534469+0000","last_undegraded":"2023-12-24T19:57:07.534469+0000","last_fullsized":"2023-12-24T19:57:07.534469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526814+0000","last_change":"2023-12-24T19:57:07.526507+0000","last_active":"2023-12-24T19:57:07.526814+0000","last_peered":"2023-12-24T19:57:07.526814+0000","last_clean":"2023-12-24T19:57:07.526814+0000","last_became_active":"2023-12-24T19:57:07.526282+0000","last_became_peered":"2023-12-24T19:57:07.526282+0000","last_unstale":"2023-12-24T19:57:07.526814+0000","last_undegraded":"2023-12-24T19:57:07.526814+0000","last_fullsized":"2023-12-24T19:57:07.526814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[]}} 2023-12-24T19:57:16.593 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T19:57:16.594 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-24T19:57:16.594 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-24T19:57:16.594 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-24T19:57:16.594 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-24T19:57:16.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.750+0000 7f82ced5a700 1 Processor -- start 2023-12-24T19:57:16.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.750+0000 7f82ced5a700 1 -- start start 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.750+0000 7f82ced5a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f82c815bb60 0x7f82c8098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.750+0000 7f82ced5a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c80b2660 0x7f82c80b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.750+0000 7f82ced5a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c80b2eb0 con 0x7f82c8098aa0 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.750+0000 7f82ced5a700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c80afc20 con 0x7f82c815bb60 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.750+0000 7f82ced5a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80b2bd0 con 0x7f82c80b2660 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82ccaf6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f82c815bb60 0x7f82c8098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82ccaf6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f82c815bb60 0x7f82c8098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53084/0 (socket says 172.21.15.61:53084) 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82ccaf6700 1 -- 172.21.15.61:0/523941787 learned_addr learned my addr 172.21.15.61:0/523941787 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82cd2f7700 1 --2- 172.21.15.61:0/523941787 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c80b2660 0x7f82c80b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82ccaf6700 1 -- 172.21.15.61:0/523941787 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c80b2660 msgr2=0x7f82c80b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82ccaf6700 1 --2- 172.21.15.61:0/523941787 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c80b2660 0x7f82c80b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82ccaf6700 1 -- 172.21.15.61:0/523941787 >> v1:172.21.15.133:6789/0 conn(0x7f82c8098aa0 legacy=0x7f82c815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:16.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82ccaf6700 1 -- 172.21.15.61:0/523941787 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80afe10 con 0x7f82c815bb60 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82ccaf6700 1 --2- 172.21.15.61:0/523941787 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 0x7f82c8098560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009990 tx=0x7f82bc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a2b02d192fb0d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82c77fe700 1 -- 172.21.15.61:0/523941787 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc005c10 con 0x7f82c815bb60 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82c77fe700 1 -- 172.21.15.61:0/523941787 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc005d70 con 0x7f82c815bb60 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.751+0000 7f82c77fe700 1 -- 172.21.15.61:0/523941787 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00b840 con 0x7f82c815bb60 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.752+0000 7f82ced5a700 1 -- 172.21.15.61:0/523941787 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 msgr2=0x7f82c8098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.752+0000 7f82ced5a700 1 --2- 172.21.15.61:0/523941787 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 0x7f82c8098560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009990 tx=0x7f82bc009220 comp rx=0 tx=0).stop 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.752+0000 7f82ced5a700 1 -- 172.21.15.61:0/523941787 shutdown_connections 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.752+0000 7f82ced5a700 1 --2- 172.21.15.61:0/523941787 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c80b2660 0x7f82c80b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.752+0000 7f82ced5a700 1 --2- 172.21.15.61:0/523941787 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 0x7f82c8098560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.752+0000 7f82ced5a700 1 -- 172.21.15.61:0/523941787 >> 172.21.15.61:0/523941787 conn(0x7f82c8097a10 msgr2=0x7f82c80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.752+0000 7f82ced5a700 1 -- 172.21.15.61:0/523941787 shutdown_connections 2023-12-24T19:57:16.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.752+0000 7f82ced5a700 1 -- 172.21.15.61:0/523941787 wait complete. 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.753+0000 7f82ced5a700 1 Processor -- start 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.753+0000 7f82ced5a700 1 -- start start 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82ced5a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c8098aa0 0x7f82c815e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82ced5a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c80b2660 0x7f82c81689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82ced5a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 0x7f82c80ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82ced5a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80aa360 con 0x7f82c815bb60 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82ced5a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c815e060 con 0x7f82c80b2660 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82ced5a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c815d450 con 0x7f82c8098aa0 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82cd2f7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 0x7f82c80ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82cd2f7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 0x7f82c80ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53092/0 (socket says 172.21.15.61:53092) 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82ccaf6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c8098aa0 0x7f82c815e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82cd2f7700 1 -- 172.21.15.61:0/2671350566 learned_addr learned my addr 172.21.15.61:0/2671350566 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82c7fff700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c80b2660 0x7f82c81689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82cd2f7700 1 -- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c8098aa0 msgr2=0x7f82c815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82cd2f7700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c8098aa0 0x7f82c815e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82cd2f7700 1 -- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c80b2660 msgr2=0x7f82c81689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82cd2f7700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c80b2660 0x7f82c81689b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.754+0000 7f82cd2f7700 1 -- 172.21.15.61:0/2671350566 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc009480 con 0x7f82c815bb60 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.755+0000 7f82cd2f7700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 0x7f82c80ac990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82c000ceb0 tx=0x7f82c0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.755+0000 7f82c4ff9700 1 -- 172.21.15.61:0/2671350566 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c000ad90 con 0x7f82c815bb60 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.755+0000 7f82c4ff9700 1 -- 172.21.15.61:0/2671350566 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0016430 con 0x7f82c815bb60 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.755+0000 7f82ced5a700 1 -- 172.21.15.61:0/2671350566 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c815d730 con 0x7f82c815bb60 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.755+0000 7f82c4ff9700 1 -- 172.21.15.61:0/2671350566 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c00167d0 con 0x7f82c815bb60 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.755+0000 7f82ced5a700 1 -- 172.21.15.61:0/2671350566 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c815dcf0 con 0x7f82c815bb60 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.756+0000 7f82ced5a700 1 -- 172.21.15.61:0/2671350566 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c806d440 con 0x7f82c815bb60 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.756+0000 7f82c4ff9700 1 -- 172.21.15.61:0/2671350566 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f82c0003020 con 0x7f82c815bb60 2023-12-24T19:57:16.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.756+0000 7f82c4ff9700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f82ac066f30 0x7f82ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:16.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.756+0000 7f82c4ff9700 1 -- 172.21.15.61:0/2671350566 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82c0012070 con 0x7f82c815bb60 2023-12-24T19:57:16.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.757+0000 7f82ccaf6700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f82ac066f30 0x7f82ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:16.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.757+0000 7f82ccaf6700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f82ac066f30 0x7f82ac0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0030c0 tx=0x7f82bc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:16.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:16.761+0000 7f82c4ff9700 1 -- 172.21.15.61:0/2671350566 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82c0052580 con 0x7f82c815bb60 2023-12-24T19:57:17.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.010+0000 7f82ced5a700 1 -- 172.21.15.61:0/2671350566 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f82c804c3c0 con 0x7f82c815bb60 2023-12-24T19:57:17.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.013+0000 7f82c4ff9700 1 -- 172.21.15.61:0/2671350566 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163708 (secure 0 0 0) 0x7f82c0055ba0 con 0x7f82c815bb60 2023-12-24T19:57:17.015 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:17.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 -- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f82ac066f30 msgr2=0x7f82ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f82ac066f30 0x7f82ac0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0030c0 tx=0x7f82bc015000 comp rx=0 tx=0).stop 2023-12-24T19:57:17.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 -- 172.21.15.61:0/2671350566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 msgr2=0x7f82c80ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 0x7f82c80ac990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f82c000ceb0 tx=0x7f82c0007870 comp rx=0 tx=0).stop 2023-12-24T19:57:17.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 -- 172.21.15.61:0/2671350566 shutdown_connections 2023-12-24T19:57:17.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82c8098aa0 0x7f82c815e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f82ac066f30 0x7f82ac0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82c815bb60 0x7f82c80ac990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 --2- 172.21.15.61:0/2671350566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82c80b2660 0x7f82c81689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 -- 172.21.15.61:0/2671350566 >> 172.21.15.61:0/2671350566 conn(0x7f82c8097a10 msgr2=0x7f82c806c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 -- 172.21.15.61:0/2671350566 shutdown_connections 2023-12-24T19:57:17.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.015+0000 7f82ced5a700 1 -- 172.21.15.61:0/2671350566 wait complete. 2023-12-24T19:57:17.028 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":39914},{"type":"v1","addr":"172.21.15.133:6833","nonce":39914}]},"active_addr":"172.21.15.133:6833/39914","active_change":"2023-12-24T19:56:54.299681+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":1631061776}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":2549554501}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":1351904010}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":1257059939}]}]} 2023-12-24T19:57:17.032 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-24T19:57:17.032 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-24T19:57:17.032 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:17.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.152+0000 7f0012ce6700 1 Processor -- start 2023-12-24T19:57:17.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.153+0000 7f0012ce6700 1 -- start start 2023-12-24T19:57:17.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.153+0000 7f0012ce6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000c159850 0x7f000c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.153+0000 7f0012ce6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f000c06aac0 0x7f000c0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.153+0000 7f0012ce6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f000c0caa80 0x7f000c0aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.153+0000 7f0012ce6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000c06a630 con 0x7f000c0caa80 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.153+0000 7f0012ce6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000c069d00 con 0x7f000c06aac0 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.153+0000 7f0012ce6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c069fe0 con 0x7f000c159850 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.153+0000 7f0011283700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f000c0caa80 0x7f000c0aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f0011283700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f000c0caa80 0x7f000c0aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53096/0 (socket says 172.21.15.61:53096) 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f0011283700 1 -- 172.21.15.61:0/3622841972 learned_addr learned my addr 172.21.15.61:0/3622841972 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f0010a82700 1 --2- 172.21.15.61:0/3622841972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000c159850 0x7f000c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f000bfff700 1 --2- 172.21.15.61:0/3622841972 >> v2:172.21.15.133:3300/0 conn(0x7f000c06aac0 0x7f000c0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f0011283700 1 -- 172.21.15.61:0/3622841972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000c159850 msgr2=0x7f000c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f0011283700 1 --2- 172.21.15.61:0/3622841972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000c159850 0x7f000c159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f0011283700 1 -- 172.21.15.61:0/3622841972 >> v2:172.21.15.133:3300/0 conn(0x7f000c06aac0 msgr2=0x7f000c0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f0011283700 1 --2- 172.21.15.61:0/3622841972 >> v2:172.21.15.133:3300/0 conn(0x7f000c06aac0 0x7f000c0cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f0011283700 1 -- 172.21.15.61:0/3622841972 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c06a2c0 con 0x7f000c0caa80 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f0011283700 1 --2- 172.21.15.61:0/3622841972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c0caa80 0x7f000c0aa880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f000c06c860 tx=0x7f0004009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7a7abb94362bfb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f000b7fe700 1 -- 172.21.15.61:0/3622841972 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000400e070 con 0x7f000c0caa80 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f000b7fe700 1 -- 172.21.15.61:0/3622841972 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000400b970 con 0x7f000c0caa80 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.154+0000 7f000b7fe700 1 -- 172.21.15.61:0/3622841972 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00040092e0 con 0x7f000c0caa80 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.155+0000 7f0012ce6700 1 -- 172.21.15.61:0/3622841972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c0caa80 msgr2=0x7f000c0aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.155+0000 7f0012ce6700 1 --2- 172.21.15.61:0/3622841972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c0caa80 0x7f000c0aa880 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f000c06c860 tx=0x7f0004009840 comp rx=0 tx=0).stop 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.155+0000 7f0012ce6700 1 -- 172.21.15.61:0/3622841972 shutdown_connections 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.155+0000 7f0012ce6700 1 --2- 172.21.15.61:0/3622841972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c0caa80 0x7f000c0aa880 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.155+0000 7f0012ce6700 1 --2- 172.21.15.61:0/3622841972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000c159850 0x7f000c159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.155+0000 7f0012ce6700 1 --2- 172.21.15.61:0/3622841972 >> v2:172.21.15.133:3300/0 conn(0x7f000c06aac0 0x7f000c0cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.155+0000 7f0012ce6700 1 -- 172.21.15.61:0/3622841972 >> 172.21.15.61:0/3622841972 conn(0x7f000c0cceb0 msgr2=0x7f000c0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.155+0000 7f0012ce6700 1 -- 172.21.15.61:0/3622841972 shutdown_connections 2023-12-24T19:57:17.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.155+0000 7f0012ce6700 1 -- 172.21.15.61:0/3622841972 wait complete. 2023-12-24T19:57:17.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.156+0000 7f0012ce6700 1 Processor -- start 2023-12-24T19:57:17.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.156+0000 7f0012ce6700 1 -- start start 2023-12-24T19:57:17.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0012ce6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c06aac0 0x7f000c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0012ce6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000c0caa80 0x7f000c1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0012ce6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000c159850 0x7f000c1539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0012ce6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c152a60 con 0x7f000c06aac0 2023-12-24T19:57:17.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0012ce6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c169a60 con 0x7f000c159850 2023-12-24T19:57:17.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0012ce6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c154080 con 0x7f000c0caa80 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0010a82700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c06aac0 0x7f000c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0010a82700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c06aac0 0x7f000c14eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53112/0 (socket says 172.21.15.61:53112) 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0010a82700 1 -- 172.21.15.61:0/387985254 learned_addr learned my addr 172.21.15.61:0/387985254 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0011283700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000c159850 0x7f000c1539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f000bfff700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000c0caa80 0x7f000c1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0010a82700 1 -- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000c0caa80 msgr2=0x7f000c1534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0010a82700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000c0caa80 0x7f000c1534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0010a82700 1 -- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000c159850 msgr2=0x7f000c1539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0010a82700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000c159850 0x7f000c1539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0010a82700 1 -- 172.21.15.61:0/387985254 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004009ae0 con 0x7f000c06aac0 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0010a82700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c06aac0 0x7f000c14eb90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f000000ec80 tx=0x7f00000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0008ff9700 1 -- 172.21.15.61:0/387985254 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000c850 con 0x7f000c06aac0 2023-12-24T19:57:17.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.157+0000 7f0008ff9700 1 -- 172.21.15.61:0/387985254 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000000c9b0 con 0x7f000c06aac0 2023-12-24T19:57:17.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.158+0000 7f0012ce6700 1 -- 172.21.15.61:0/387985254 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c154360 con 0x7f000c06aac0 2023-12-24T19:57:17.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.158+0000 7f0008ff9700 1 -- 172.21.15.61:0/387985254 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000cd50 con 0x7f000c06aac0 2023-12-24T19:57:17.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.158+0000 7f0012ce6700 1 -- 172.21.15.61:0/387985254 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c154920 con 0x7f000c06aac0 2023-12-24T19:57:17.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.158+0000 7f0012ce6700 1 -- 172.21.15.61:0/387985254 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000c04c3c0 con 0x7f000c06aac0 2023-12-24T19:57:17.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.159+0000 7f0008ff9700 1 -- 172.21.15.61:0/387985254 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0000013680 con 0x7f000c06aac0 2023-12-24T19:57:17.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.160+0000 7f0008ff9700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efff0066f30 0x7efff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.160+0000 7f0008ff9700 1 -- 172.21.15.61:0/387985254 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0000084ef0 con 0x7f000c06aac0 2023-12-24T19:57:17.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.160+0000 7f000bfff700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efff0066f30 0x7efff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.160+0000 7f000bfff700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efff0066f30 0x7efff00693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f000c06f5c0 tx=0x7efff80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.163+0000 7f0008ff9700 1 -- 172.21.15.61:0/387985254 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00000521e0 con 0x7f000c06aac0 2023-12-24T19:57:17.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.358+0000 7f0012ce6700 1 -- 172.21.15.61:0/387985254 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f000c0ccb20 con 0x7f000c06aac0 2023-12-24T19:57:17.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.359+0000 7f0008ff9700 1 -- 172.21.15.61:0/387985254 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f0000055800 con 0x7f000c06aac0 2023-12-24T19:57:17.359 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:17.359 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:17.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.360+0000 7f0012ce6700 1 -- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efff0066f30 msgr2=0x7efff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.360+0000 7f0012ce6700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efff0066f30 0x7efff00693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f000c06f5c0 tx=0x7efff80091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.360+0000 7f0012ce6700 1 -- 172.21.15.61:0/387985254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c06aac0 msgr2=0x7f000c14eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.360+0000 7f0012ce6700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c06aac0 0x7f000c14eb90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f000000ec80 tx=0x7f00000091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.361+0000 7f0012ce6700 1 -- 172.21.15.61:0/387985254 shutdown_connections 2023-12-24T19:57:17.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.361+0000 7f0012ce6700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efff0066f30 0x7efff00693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.361+0000 7f0012ce6700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f000c159850 0x7f000c1539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.361+0000 7f0012ce6700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000c06aac0 0x7f000c14eb90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.361+0000 7f0012ce6700 1 --2- 172.21.15.61:0/387985254 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000c0caa80 0x7f000c1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.361+0000 7f0012ce6700 1 -- 172.21.15.61:0/387985254 >> 172.21.15.61:0/387985254 conn(0x7f000c0cceb0 msgr2=0x7f000c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.361+0000 7f0012ce6700 1 -- 172.21.15.61:0/387985254 shutdown_connections 2023-12-24T19:57:17.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.361+0000 7f0012ce6700 1 -- 172.21.15.61:0/387985254 wait complete. 2023-12-24T19:57:17.373 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-24T19:57:17.373 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:17.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.494+0000 7f4171c0b700 1 Processor -- start 2023-12-24T19:57:17.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.494+0000 7f4171c0b700 1 -- start start 2023-12-24T19:57:17.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.495+0000 7f4171c0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c159cf0 0x7f416c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.495+0000 7f4171c0b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416c06c300 con 0x7f416c06ec70 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.495+0000 7f4171c0b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416c06ce80 con 0x7f416c0cd9c0 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.495+0000 7f4171c0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416c0ce530 con 0x7f416c159cf0 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.495+0000 7f416b7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f416c06ec70 0x7f416c1595e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41596/0 (socket says 172.21.15.61:41596) 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.495+0000 7f416b7fe700 1 -- 172.21.15.61:0/4210029900 learned_addr learned my addr 172.21.15.61:0/4210029900 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416affd700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c159cf0 0x7f416c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951503767 0 0) 0x7f416c06c300 con 0x7f416c06ec70 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4158003570 con 0x7f416c06ec70 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4067922632 0 0) 0x7f4158003570 con 0x7f416c06ec70 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c159cf0 msgr2=0x7f416c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c159cf0 0x7f416c06f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 >> v1:172.21.15.133:6789/0 conn(0x7f416c0cd9c0 legacy=0x7f416c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c068560 con 0x7f416c06ec70 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f415c001470 con 0x7f416c06ec70 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416affd700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c159cf0 0x7f416c06f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 >> v1:172.21.15.61:6789/0 conn(0x7f416c06ec70 legacy=0x7f416c1595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4158003a90 0x7f4158003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c159cf0 0x7f4158004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158004d50 0x7f41580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c0ce530 con 0x7f4158003a90 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415800bb10 con 0x7f4158004d50 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415800bca0 con 0x7f416c159cf0 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416b7fe700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4158003a90 0x7f4158003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416affd700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c159cf0 0x7f4158004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416bfff700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158004d50 0x7f41580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416b7fe700 1 -- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c159cf0 msgr2=0x7f4158004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416b7fe700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c159cf0 0x7f4158004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416b7fe700 1 -- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158004d50 msgr2=0x7f41580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416b7fe700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158004d50 0x7f41580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416b7fe700 1 -- 172.21.15.61:0/4210029900 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4154009420 con 0x7f4158003a90 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.496+0000 7f416bfff700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158004d50 0x7f41580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f416b7fe700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4158003a90 0x7f4158003e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f415c00c3f0 tx=0x7f416c06cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dff8b2f1017fb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c00cc80 con 0x7f4158003a90 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415c00cde0 con 0x7f4158003a90 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f416a7fc700 1 -- 172.21.15.61:0/4210029900 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c005b70 con 0x7f4158003a90 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f4171c0b700 1 -- 172.21.15.61:0/4210029900 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4158003a90 msgr2=0x7f4158003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f4171c0b700 1 --2- 172.21.15.61:0/4210029900 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4158003a90 0x7f4158003e60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f415c00c3f0 tx=0x7f416c06cdf0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f416bfff700 1 -- 172.21.15.61:0/4210029900 reap_dead start 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f4171c0b700 1 -- 172.21.15.61:0/4210029900 shutdown_connections 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f4171c0b700 1 -- 172.21.15.61:0/4210029900 >> 172.21.15.61:0/4210029900 conn(0x7f416c06b650 msgr2=0x7f416c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f4171c0b700 1 -- 172.21.15.61:0/4210029900 shutdown_connections 2023-12-24T19:57:17.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.497+0000 7f4171c0b700 1 -- 172.21.15.61:0/4210029900 wait complete. 2023-12-24T19:57:17.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.498+0000 7f4171c0b700 1 Processor -- start 2023-12-24T19:57:17.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.499+0000 7f4171c0b700 1 -- start start 2023-12-24T19:57:17.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.499+0000 7f4171c0b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158003a90 0x7f416c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.499+0000 7f4171c0b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f416c0afa50 0x7f416c0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.499+0000 7f4171c0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c0ca7e0 0x7f416c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.499+0000 7f4171c0b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c158bd0 con 0x7f416c0afa50 2023-12-24T19:57:17.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.499+0000 7f4171c0b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c16a6f0 con 0x7f4158003a90 2023-12-24T19:57:17.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.499+0000 7f4171c0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416c0afee0 con 0x7f416c0ca7e0 2023-12-24T19:57:17.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.499+0000 7f416affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f416c0afa50 0x7f416c0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.499+0000 7f416affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f416c0afa50 0x7f416c0b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53130/0 (socket says 172.21.15.61:53130) 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.499+0000 7f416affd700 1 -- 172.21.15.61:0/2041265601 learned_addr learned my addr 172.21.15.61:0/2041265601 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f416b7fe700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158003a90 0x7f416c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f416bfff700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c0ca7e0 0x7f416c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f416affd700 1 -- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c0ca7e0 msgr2=0x7f416c0689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f416affd700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c0ca7e0 0x7f416c0689f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f416affd700 1 -- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158003a90 msgr2=0x7f416c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f416affd700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158003a90 0x7f416c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f416affd700 1 -- 172.21.15.61:0/2041265601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c16a0a0 con 0x7f416c0afa50 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f416b7fe700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158003a90 0x7f416c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f416affd700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f416c0afa50 0x7f416c0b01c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4154011d70 tx=0x7f41540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f41637fe700 1 -- 172.21.15.61:0/2041265601 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400fcd0 con 0x7f416c0afa50 2023-12-24T19:57:17.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f41637fe700 1 -- 172.21.15.61:0/2041265601 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415400fe30 con 0x7f416c0afa50 2023-12-24T19:57:17.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f4171c0b700 1 -- 172.21.15.61:0/2041265601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416c16a380 con 0x7f416c0afa50 2023-12-24T19:57:17.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f41637fe700 1 -- 172.21.15.61:0/2041265601 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154014670 con 0x7f416c0afa50 2023-12-24T19:57:17.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.500+0000 7f4171c0b700 1 -- 172.21.15.61:0/2041265601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416c16ad40 con 0x7f416c0afa50 2023-12-24T19:57:17.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.501+0000 7f4171c0b700 1 -- 172.21.15.61:0/2041265601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416c16a9d0 con 0x7f416c0afa50 2023-12-24T19:57:17.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.502+0000 7f41637fe700 1 -- 172.21.15.61:0/2041265601 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4154014aa0 con 0x7f416c0afa50 2023-12-24T19:57:17.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.502+0000 7f41637fe700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f414c066f30 0x7f414c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.502+0000 7f41637fe700 1 -- 172.21.15.61:0/2041265601 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4154018030 con 0x7f416c0afa50 2023-12-24T19:57:17.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.502+0000 7f416b7fe700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f414c066f30 0x7f414c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.503+0000 7f416b7fe700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f414c066f30 0x7f414c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f415c00c390 tx=0x7f415c012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.506+0000 7f41637fe700 1 -- 172.21.15.61:0/2041265601 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41540527b0 con 0x7f416c0afa50 2023-12-24T19:57:17.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.703+0000 7f4171c0b700 1 -- 172.21.15.61:0/2041265601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f416c16aed0 con 0x7f416c0afa50 2023-12-24T19:57:17.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.704+0000 7f41637fe700 1 -- 172.21.15.61:0/2041265601 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4154006cb0 con 0x7f416c0afa50 2023-12-24T19:57:17.704 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:17.704 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:17.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 -- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f414c066f30 msgr2=0x7f414c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f414c066f30 0x7f414c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f415c00c390 tx=0x7f415c012000 comp rx=0 tx=0).stop 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 -- 172.21.15.61:0/2041265601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f416c0afa50 msgr2=0x7f416c0b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f416c0afa50 0x7f416c0b01c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4154011d70 tx=0x7f41540091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 -- 172.21.15.61:0/2041265601 shutdown_connections 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f416c0ca7e0 0x7f416c0689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f414c066f30 0x7f414c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4158003a90 0x7f416c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 --2- 172.21.15.61:0/2041265601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f416c0afa50 0x7f416c0b01c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 -- 172.21.15.61:0/2041265601 >> 172.21.15.61:0/2041265601 conn(0x7f416c06b650 msgr2=0x7f416c1552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 -- 172.21.15.61:0/2041265601 shutdown_connections 2023-12-24T19:57:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.706+0000 7f4171c0b700 1 -- 172.21.15.61:0/2041265601 wait complete. 2023-12-24T19:57:17.719 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-24T19:57:17.720 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-24T19:57:17.720 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-24T19:57:17.721 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-24T19:57:17.721 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-24T19:57:17.721 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-24T19:57:17.722 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-24T19:57:17.722 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-24T19:57:17.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.937+0000 7fcc84fb2700 1 Processor -- start 2023-12-24T19:57:17.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.937+0000 7ff1be981700 1 Processor -- start 2023-12-24T19:57:17.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.937+0000 7ff1be981700 1 -- start start 2023-12-24T19:57:17.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.937+0000 7fcc84fb2700 1 -- start start 2023-12-24T19:57:17.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7fcc84fb2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcc8015e210 0x7fcc8006da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7fcc84fb2700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800b1fd0 con 0x7fcc8006df70 2023-12-24T19:57:17.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7fcc84fb2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800cd560 con 0x7fcc8015de40 2023-12-24T19:57:17.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7fcc84fb2700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8006e3f0 con 0x7fcc8015e210 2023-12-24T19:57:17.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7fcc7dd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcc8015e210 0x7fcc8006da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7fcc7dd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcc8015e210 0x7fcc8006da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53142/0 (socket says 172.21.15.61:53142) 2023-12-24T19:57:17.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7fcc7dd9b700 1 -- 172.21.15.61:0/3995970498 learned_addr learned my addr 172.21.15.61:0/3995970498 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7ff1be981700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8068c70 0x7ff1b8070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7ff1be981700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b815e360 con 0x7ff1b8070e90 2023-12-24T19:57:17.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7ff1be981700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b815d750 con 0x7ff1b8159a60 2023-12-24T19:57:17.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7ff1be981700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b815da30 con 0x7ff1b8068c70 2023-12-24T19:57:17.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7fcc7dd9b700 1 -- 172.21.15.61:0/3995970498 >> v1:172.21.15.133:6789/0 conn(0x7fcc8015de40 legacy=0x7fcc800ae970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-24T19:57:17.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7fcc7dd9b700 1 -- 172.21.15.61:0/3995970498 >> v1:172.21.15.61:6789/0 conn(0x7fcc8006df70 legacy=0x7fcc800abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7fcc7dd9b700 1 -- 172.21.15.61:0/3995970498 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800cd280 con 0x7fcc8015e210 2023-12-24T19:57:17.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.939+0000 7ff1b77fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8068c70 0x7ff1b8070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7ff1b77fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8068c70 0x7ff1b8070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:57710/0 (socket says 172.21.15.61:57710) 2023-12-24T19:57:17.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7ff1b77fe700 1 -- 172.21.15.61:0/3154322056 learned_addr learned my addr 172.21.15.61:0/3154322056 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7fcc7dd9b700 1 --2- 172.21.15.61:0/3995970498 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc8015e210 0x7fcc8006da30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc700099b0 tx=0x7fcc70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6aeca12dff13d22 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7ff1b6ffd700 1 -- 172.21.15.61:0/3154322056 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462350959 0 0) 0x7ff1b815d750 con 0x7ff1b8159a60 2023-12-24T19:57:17.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7ff1b6ffd700 1 -- 172.21.15.61:0/3154322056 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a0003570 con 0x7ff1b8159a60 2023-12-24T19:57:17.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7ff1b77fe700 1 -- 172.21.15.61:0/3154322056 >> v1:172.21.15.133:6789/0 conn(0x7ff1b8159a60 legacy=0x7ff1b8068560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7ff1b77fe700 1 -- 172.21.15.61:0/3154322056 >> v1:172.21.15.61:6789/0 conn(0x7ff1b8070e90 legacy=0x7ff1b806a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-24T19:57:17.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7ff1b77fe700 1 -- 172.21.15.61:0/3154322056 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b815dd10 con 0x7ff1b8068c70 2023-12-24T19:57:17.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7f5b058e7700 1 Processor -- start 2023-12-24T19:57:17.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7fcc7d59a700 1 -- 172.21.15.61:0/3995970498 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000b820 con 0x7fcc8015e210 2023-12-24T19:57:17.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7f5b058e7700 1 -- start start 2023-12-24T19:57:17.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7fcc7d59a700 1 -- 172.21.15.61:0/3995970498 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7000b980 con 0x7fcc8015e210 2023-12-24T19:57:17.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7fcc7d59a700 1 -- 172.21.15.61:0/3995970498 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000bd00 con 0x7fcc8015e210 2023-12-24T19:57:17.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7ff1b77fe700 1 --2- 172.21.15.61:0/3154322056 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8068c70 0x7ff1b8070950 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0099e0 tx=0x7ff1ac009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8020a8333f8506b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.940+0000 7ff1b6ffd700 1 -- 172.21.15.61:0/3154322056 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00b820 con 0x7ff1b8068c70 2023-12-24T19:57:17.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.941+0000 7ff1b6ffd700 1 -- 172.21.15.61:0/3154322056 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac00b980 con 0x7ff1b8068c70 2023-12-24T19:57:17.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.941+0000 7ff1b6ffd700 1 -- 172.21.15.61:0/3154322056 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00bd20 con 0x7ff1b8068c70 2023-12-24T19:57:17.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.941+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3995970498 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc8015e210 msgr2=0x7fcc8006da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.941+0000 7fcc84fb2700 1 --2- 172.21.15.61:0/3995970498 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc8015e210 0x7fcc8006da30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc700099b0 tx=0x7fcc70009250 comp rx=0 tx=0).stop 2023-12-24T19:57:17.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.941+0000 7ff1be981700 1 -- 172.21.15.61:0/3154322056 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8068c70 msgr2=0x7ff1b8070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.941+0000 7ff1be981700 1 --2- 172.21.15.61:0/3154322056 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8068c70 0x7ff1b8070950 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0099e0 tx=0x7ff1ac009250 comp rx=0 tx=0).stop 2023-12-24T19:57:17.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3995970498 shutdown_connections 2023-12-24T19:57:17.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7fcc84fb2700 1 --2- 172.21.15.61:0/3995970498 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc8015e210 0x7fcc8006da30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3995970498 >> 172.21.15.61:0/3995970498 conn(0x7fcc80068020 msgr2=0x7fcc800cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3995970498 shutdown_connections 2023-12-24T19:57:17.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3995970498 wait complete. 2023-12-24T19:57:17.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5b058e7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5b0015ced0 0x7f5b000abf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5b058e7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b000afe90 0x7f5b0015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5b058e7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b000ace40 con 0x7f5b0006e3f0 2023-12-24T19:57:17.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5b058e7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0015d880 con 0x7f5b0015ced0 2023-12-24T19:57:17.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5b058e7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0006ec30 con 0x7f5b000afe90 2023-12-24T19:57:17.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5afe7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5b0006e3f0 0x7f5b000af780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:51574/0 (socket says 172.21.15.61:51574) 2023-12-24T19:57:17.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5afe7fc700 1 -- 172.21.15.61:0/551026934 learned_addr learned my addr 172.21.15.61:0/551026934 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:17.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5afeffd700 1 --2- 172.21.15.61:0/551026934 >> v2:172.21.15.61:3300/0 conn(0x7f5b0015ced0 0x7f5b000abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7fcc84fb2700 1 Processor -- start 2023-12-24T19:57:17.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5aff7fe700 1 --2- 172.21.15.61:0/551026934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b000afe90 0x7f5b0015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5afeffd700 1 -- 172.21.15.61:0/551026934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b000afe90 msgr2=0x7f5b0015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5afeffd700 1 --2- 172.21.15.61:0/551026934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b000afe90 0x7f5b0015dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5afeffd700 1 -- 172.21.15.61:0/551026934 >> v1:172.21.15.133:6789/0 conn(0x7f5b0006e3f0 legacy=0x7f5b000af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5afeffd700 1 -- 172.21.15.61:0/551026934 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000ac5a0 con 0x7f5b0015ced0 2023-12-24T19:57:17.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7f5afeffd700 1 --2- 172.21.15.61:0/551026934 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5b0015ced0 0x7f5b000abf10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5af00098e0 tx=0x7f5af00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f56c692f6b50e7a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7fcc84fb2700 1 -- start start 2023-12-24T19:57:17.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7f5afdffb700 1 -- 172.21.15.61:0/551026934 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0009e80 con 0x7f5b0015ced0 2023-12-24T19:57:17.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7f5afdffb700 1 -- 172.21.15.61:0/551026934 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000b820 con 0x7f5b0015ced0 2023-12-24T19:57:17.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7f5afdffb700 1 -- 172.21.15.61:0/551026934 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000bbe0 con 0x7f5b0015ced0 2023-12-24T19:57:17.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7fcc84fb2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc8006df70 0x7fcc8016f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7fcc84fb2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc8015de40 0x7fcc8014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7fcc84fb2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015e210 0x7fcc800a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7fcc84fb2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8014ce40 con 0x7fcc8006df70 2023-12-24T19:57:17.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7fcc84fb2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8015fba0 con 0x7fcc8015de40 2023-12-24T19:57:17.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7fcc84fb2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8015fe80 con 0x7fcc8015e210 2023-12-24T19:57:17.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7fcc7e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc8006df70 0x7fcc8016f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc7e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc8006df70 0x7fcc8016f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53174/0 (socket says 172.21.15.61:53174) 2023-12-24T19:57:17.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc7e59c700 1 -- 172.21.15.61:0/3293063583 learned_addr learned my addr 172.21.15.61:0/3293063583 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc7ed9d700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015e210 0x7fcc800a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc7dd9b700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc8015de40 0x7fcc8014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc7e59c700 1 -- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015e210 msgr2=0x7fcc800a6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc7e59c700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015e210 0x7fcc800a6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc7e59c700 1 -- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc8015de40 msgr2=0x7fcc8014c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc7e59c700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc8015de40 0x7fcc8014c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc7e59c700 1 -- 172.21.15.61:0/3293063583 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc700094f0 con 0x7fcc8006df70 2023-12-24T19:57:17.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.941+0000 7f5f01011700 1 Processor -- start 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.941+0000 7f5f01011700 1 -- start start 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5f01011700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5efc1613c0 0x7f5efc0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5f01011700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5efc15e470 0x7f5efc06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5f01011700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc06df70 0x7f5efc161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5f01011700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc15f510 con 0x7f5efc15e470 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5f01011700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc06e3d0 con 0x7f5efc1613c0 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5f01011700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc15e900 con 0x7f5efc06df70 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5efa59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5efc15e470 0x7f5efc06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5efb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc06df70 0x7f5efc161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5efa59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5efc15e470 0x7f5efc06da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53148/0 (socket says 172.21.15.61:53148) 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.942+0000 7f5efa59c700 1 -- 172.21.15.61:0/2935341671 learned_addr learned my addr 172.21.15.61:0/2935341671 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5efad9d700 1 --2- 172.21.15.61:0/2935341671 >> v2:172.21.15.133:3300/0 conn(0x7f5efc1613c0 0x7f5efc0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5efa59c700 1 -- 172.21.15.61:0/2935341671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc06df70 msgr2=0x7f5efc161ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5efa59c700 1 --2- 172.21.15.61:0/2935341671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc06df70 0x7f5efc161ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5efa59c700 1 -- 172.21.15.61:0/2935341671 >> v2:172.21.15.133:3300/0 conn(0x7f5efc1613c0 msgr2=0x7f5efc0ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5efa59c700 1 --2- 172.21.15.61:0/2935341671 >> v2:172.21.15.133:3300/0 conn(0x7f5efc1613c0 0x7f5efc0ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5efa59c700 1 -- 172.21.15.61:0/2935341671 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc15ebe0 con 0x7f5efc15e470 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5efad9d700 1 --2- 172.21.15.61:0/2935341671 >> v2:172.21.15.133:3300/0 conn(0x7f5efc1613c0 0x7f5efc0ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.943+0000 7f5efa59c700 1 --2- 172.21.15.61:0/2935341671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5efc15e470 0x7f5efc06da30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5efc065960 tx=0x7f5ef4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b979dd89f99a7355 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7f5ef9d9b700 1 -- 172.21.15.61:0/2935341671 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400e070 con 0x7f5efc15e470 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7f5ef9d9b700 1 -- 172.21.15.61:0/2935341671 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400ba50 con 0x7f5efc15e470 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.944+0000 7f5ef9d9b700 1 -- 172.21.15.61:0/2935341671 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40092e0 con 0x7f5efc15e470 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7f5f01011700 1 -- 172.21.15.61:0/2935341671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5efc15e470 msgr2=0x7f5efc06da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7f5f01011700 1 --2- 172.21.15.61:0/2935341671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5efc15e470 0x7f5efc06da30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5efc065960 tx=0x7f5ef4009840 comp rx=0 tx=0).stop 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7f5f01011700 1 -- 172.21.15.61:0/2935341671 shutdown_connections 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7f5f01011700 1 --2- 172.21.15.61:0/2935341671 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc06df70 0x7f5efc161ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7f5f01011700 1 --2- 172.21.15.61:0/2935341671 >> v2:172.21.15.133:3300/0 conn(0x7f5efc1613c0 0x7f5efc0ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7ff1be981700 1 -- 172.21.15.61:0/3154322056 shutdown_connections 2023-12-24T19:57:17.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7ff1be981700 1 --2- 172.21.15.61:0/3154322056 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8068c70 0x7ff1b8070950 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7ff1be981700 1 -- 172.21.15.61:0/3154322056 >> 172.21.15.61:0/3154322056 conn(0x7ff1b80cac10 msgr2=0x7ff1b806da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc7e59c700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc8006df70 0x7fcc8016f740 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400b600 tx=0x7fcc740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7f5f01011700 1 --2- 172.21.15.61:0/2935341671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5efc15e470 0x7f5efc06da30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7f5f01011700 1 -- 172.21.15.61:0/2935341671 >> 172.21.15.61:0/2935341671 conn(0x7f5efc067fe0 msgr2=0x7f5efc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc6e7fc700 1 -- 172.21.15.61:0/3293063583 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400f510 con 0x7fcc8006df70 2023-12-24T19:57:17.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc80160160 con 0x7fcc8006df70 2023-12-24T19:57:17.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.946+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc80160720 con 0x7fcc8006df70 2023-12-24T19:57:17.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.946+0000 7fcc6e7fc700 1 -- 172.21.15.61:0/3293063583 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7400f690 con 0x7fcc8006df70 2023-12-24T19:57:17.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.946+0000 7fcc6e7fc700 1 -- 172.21.15.61:0/3293063583 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400fa50 con 0x7fcc8006df70 2023-12-24T19:57:17.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.946+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc8004c3c0 con 0x7fcc8006df70 2023-12-24T19:57:17.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7f5f01011700 1 -- 172.21.15.61:0/2935341671 shutdown_connections 2023-12-24T19:57:17.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7f5f01011700 1 -- 172.21.15.61:0/2935341671 wait complete. 2023-12-24T19:57:17.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7ff1be981700 1 -- 172.21.15.61:0/3154322056 shutdown_connections 2023-12-24T19:57:17.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.946+0000 7f5b058e7700 1 -- 172.21.15.61:0/551026934 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5b0015ced0 msgr2=0x7f5b000abf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.946+0000 7f5b058e7700 1 --2- 172.21.15.61:0/551026934 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5b0015ced0 0x7f5b000abf10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5af00098e0 tx=0x7f5af00091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.946+0000 7f5b058e7700 1 -- 172.21.15.61:0/551026934 shutdown_connections 2023-12-24T19:57:17.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.946+0000 7f5b058e7700 1 --2- 172.21.15.61:0/551026934 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b000afe90 0x7f5b0015dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.946+0000 7f5b058e7700 1 --2- 172.21.15.61:0/551026934 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5b0015ced0 0x7f5b000abf10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.946+0000 7f5b058e7700 1 -- 172.21.15.61:0/551026934 >> 172.21.15.61:0/551026934 conn(0x7f5b00067fe0 msgr2=0x7f5b000cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.945+0000 7ff1be981700 1 -- 172.21.15.61:0/3154322056 wait complete. 2023-12-24T19:57:17.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.947+0000 7feb47c50700 1 Processor -- start 2023-12-24T19:57:17.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.947+0000 7feb47c50700 1 -- start start 2023-12-24T19:57:17.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.947+0000 7ff1be981700 1 Processor -- start 2023-12-24T19:57:17.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.947+0000 7f5f01011700 1 Processor -- start 2023-12-24T19:57:17.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.947+0000 7ff1be981700 1 -- start start 2023-12-24T19:57:17.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7feb47c50700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb4015ced0 0x7feb400abf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7feb47c50700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4006e3f0 0x7feb400af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7feb47c50700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7feb400afcc0 0x7feb4015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7feb47c50700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb400ace40 con 0x7feb400afcc0 2023-12-24T19:57:17.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7feb47c50700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4015d880 con 0x7feb4015ced0 2023-12-24T19:57:17.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7feb47c50700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4006ec30 con 0x7feb4006e3f0 2023-12-24T19:57:17.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.947+0000 7f5b058e7700 1 -- 172.21.15.61:0/551026934 shutdown_connections 2023-12-24T19:57:17.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7f5b058e7700 1 -- 172.21.15.61:0/551026934 wait complete. 2023-12-24T19:57:17.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7fcc6e7fc700 1 -- 172.21.15.61:0/3293063583 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcc74024430 con 0x7fcc8006df70 2023-12-24T19:57:17.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7feb451eb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4006e3f0 0x7feb400af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7feb451eb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4006e3f0 0x7feb400af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:57752/0 (socket says 172.21.15.61:57752) 2023-12-24T19:57:17.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7feb451eb700 1 -- 172.21.15.61:0/2142825582 learned_addr learned my addr 172.21.15.61:0/2142825582 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7fcc6e7fc700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc68067050 0x7fcc68069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7fcc6e7fc700 1 -- 172.21.15.61:0/3293063583 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc740848c0 con 0x7fcc8006df70 2023-12-24T19:57:17.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7fcc6e7fc700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] conn(0x7fcc6806f260 0x7fcc68071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7fcc6e7fc700 1 -- 172.21.15.61:0/3293063583 --> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc68071d20 con 0x7fcc6806f260 2023-12-24T19:57:17.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7fcc6e7fc700 1 -- 172.21.15.61:0/3293063583 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc74084c60 con 0x7fcc8006df70 2023-12-24T19:57:17.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7feb461ed700 1 --2- 172.21.15.61:0/2142825582 >> v2:172.21.15.61:3300/0 conn(0x7feb400afcc0 0x7feb4015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7feb451eb700 1 -- 172.21.15.61:0/2142825582 >> v2:172.21.15.133:3300/0 conn(0x7feb4015ced0 msgr2=0x7feb400abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7feb451eb700 1 --2- 172.21.15.61:0/2142825582 >> v2:172.21.15.133:3300/0 conn(0x7feb4015ced0 0x7feb400abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7feb451eb700 1 -- 172.21.15.61:0/2142825582 >> v2:172.21.15.61:3300/0 conn(0x7feb400afcc0 msgr2=0x7feb4015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7feb451eb700 1 --2- 172.21.15.61:0/2142825582 >> v2:172.21.15.61:3300/0 conn(0x7feb400afcc0 0x7feb4015dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7feb451eb700 1 -- 172.21.15.61:0/2142825582 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb400ac5a0 con 0x7feb4006e3f0 2023-12-24T19:57:17.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7feb461ed700 1 --2- 172.21.15.61:0/2142825582 >> v2:172.21.15.61:3300/0 conn(0x7feb400afcc0 0x7feb4015dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:17.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.948+0000 7f5f01011700 1 -- start start 2023-12-24T19:57:17.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5f01011700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5efc06df70 0x7f5efc149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5f01011700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5efc15e470 0x7f5efc14cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5f01011700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc1613c0 0x7f5efc169c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5f01011700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc14f6e0 con 0x7f5efc06df70 2023-12-24T19:57:17.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5f01011700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc14eb10 con 0x7f5efc15e470 2023-12-24T19:57:17.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5f01011700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc14edb0 con 0x7f5efc1613c0 2023-12-24T19:57:17.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5efb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc1613c0 0x7f5efc169c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7fece3013700 1 Processor -- start 2023-12-24T19:57:17.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1be981700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1b8068c70 0x7ff1b817ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1be981700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8070e90 0x7ff1b8158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1be981700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b8159a60 0x7ff1b8176500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1be981700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8159270 con 0x7ff1b8068c70 2023-12-24T19:57:17.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1be981700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8157320 con 0x7ff1b8159a60 2023-12-24T19:57:17.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1be981700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8156710 con 0x7ff1b8070e90 2023-12-24T19:57:17.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1bcf1e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b8159a60 0x7ff1b8176500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1bcf1e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b8159a60 0x7ff1b8176500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56046/0 (socket says 172.21.15.61:56046) 2023-12-24T19:57:17.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1bcf1e700 1 -- 172.21.15.61:0/2355144916 learned_addr learned my addr 172.21.15.61:0/2355144916 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7fcc7dd9b700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc68067050 0x7fcc68069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7feb451eb700 1 --2- 172.21.15.61:0/2142825582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4006e3f0 0x7feb400af780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb400af190 tx=0x7feb30009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa659eef61b852b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5efb59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc1613c0 0x7f5efc169c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:57764/0 (socket says 172.21.15.61:57764) 2023-12-24T19:57:17.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5efb59e700 1 -- 172.21.15.61:0/3772707183 learned_addr learned my addr 172.21.15.61:0/3772707183 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5efad9d700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5efc06df70 0x7f5efc149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7f5efa59c700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5efc15e470 0x7f5efc14cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1b77fe700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8070e90 0x7ff1b8158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1b7fff700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1b8068c70 0x7ff1b817ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1bcf1e700 1 -- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8070e90 msgr2=0x7ff1b8158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1bcf1e700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1b8070e90 0x7ff1b8158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1bcf1e700 1 -- 172.21.15.61:0/2355144916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1b8068c70 msgr2=0x7ff1b817ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.949+0000 7ff1bcf1e700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1b8068c70 0x7ff1b817ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7ff1bcf1e700 1 -- 172.21.15.61:0/2355144916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0094f0 con 0x7ff1b8159a60 2023-12-24T19:57:17.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7fcc7ed9d700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] conn(0x7fcc6806f260 0x7fcc68071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5efad9d700 1 -- 172.21.15.61:0/3772707183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc1613c0 msgr2=0x7f5efc169c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5efad9d700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5efc1613c0 0x7f5efc169c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5efad9d700 1 -- 172.21.15.61:0/3772707183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5efc15e470 msgr2=0x7f5efc14cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5efad9d700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5efc15e470 0x7f5efc14cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5efad9d700 1 -- 172.21.15.61:0/3772707183 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4009ae0 con 0x7f5efc06df70 2023-12-24T19:57:17.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7fcc7dd9b700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc68067050 0x7fcc68069500 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcc700099b0 tx=0x7fcc70016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7ff1b7fff700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1b8068c70 0x7ff1b817ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:17.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7ff1bcf1e700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b8159a60 0x7ff1b8176500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800b5e0 tx=0x7ff1a8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5b058e7700 1 Processor -- start 2023-12-24T19:57:17.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7fcc7ed9d700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] conn(0x7fcc6806f260 0x7fcc68071670 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7fece3013700 1 -- start start 2023-12-24T19:57:17.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7feb449ea700 1 -- 172.21.15.61:0/2142825582 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3000b860 con 0x7feb4006e3f0 2023-12-24T19:57:17.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7feb449ea700 1 -- 172.21.15.61:0/2142825582 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3000b9c0 con 0x7feb4006e3f0 2023-12-24T19:57:17.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7feb449ea700 1 -- 172.21.15.61:0/2142825582 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3000bd60 con 0x7feb4006e3f0 2023-12-24T19:57:17.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7feb47c50700 1 -- 172.21.15.61:0/2142825582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4006e3f0 msgr2=0x7feb400af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7feb47c50700 1 --2- 172.21.15.61:0/2142825582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4006e3f0 0x7feb400af780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb400af190 tx=0x7feb30009250 comp rx=0 tx=0).stop 2023-12-24T19:57:17.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5b058e7700 1 -- start start 2023-12-24T19:57:17.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5efad9d700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5efc06df70 0x7f5efc149920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c880 tx=0x7f5eec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5ee2ffd700 1 -- 172.21.15.61:0/3772707183 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec011600 con 0x7f5efc06df70 2023-12-24T19:57:17.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5ee2ffd700 1 -- 172.21.15.61:0/3772707183 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec011760 con 0x7f5efc06df70 2023-12-24T19:57:17.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.950+0000 7f5ee2ffd700 1 -- 172.21.15.61:0/3772707183 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec011b40 con 0x7f5efc06df70 2023-12-24T19:57:17.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7ff19ffff700 1 -- 172.21.15.61:0/2355144916 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800f510 con 0x7ff1b8159a60 2023-12-24T19:57:17.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7feb47c50700 1 -- 172.21.15.61:0/2142825582 shutdown_connections 2023-12-24T19:57:17.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7feb47c50700 1 --2- 172.21.15.61:0/2142825582 >> v2:172.21.15.61:3300/0 conn(0x7feb400afcc0 0x7feb4015dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7feb47c50700 1 --2- 172.21.15.61:0/2142825582 >> v2:172.21.15.133:3300/0 conn(0x7feb4015ced0 0x7feb400abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7feb47c50700 1 --2- 172.21.15.61:0/2142825582 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4006e3f0 0x7feb400af780 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7feb47c50700 1 -- 172.21.15.61:0/2142825582 >> 172.21.15.61:0/2142825582 conn(0x7feb40067fe0 msgr2=0x7feb400cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7ff19ffff700 1 -- 172.21.15.61:0/2355144916 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a800f690 con 0x7ff1b8159a60 2023-12-24T19:57:17.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7ff19ffff700 1 -- 172.21.15.61:0/2355144916 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800fa50 con 0x7ff1b8159a60 2023-12-24T19:57:17.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7fcc6e7fc700 1 -- 172.21.15.61:0/3293063583 <== osd.0 v2:172.21.15.61:6808/40393 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fcc68071d20 con 0x7fcc6806f260 2023-12-24T19:57:17.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc14f090 con 0x7f5efc06df70 2023-12-24T19:57:17.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.951+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc150ea0 con 0x7f5efc06df70 2023-12-24T19:57:17.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7f9dbeedd700 1 Processor -- start 2023-12-24T19:57:17.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7fece3013700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fecdc15de40 0x7fecdc0ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7fece3013700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fecdc15e210 0x7fecdc06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7fece3013700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc0b1fd0 con 0x7fecdc06df70 2023-12-24T19:57:17.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7fece3013700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecdc06e3f0 con 0x7fecdc15e210 2023-12-24T19:57:17.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7fece3013700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecdc0cd560 con 0x7fecdc15de40 2023-12-24T19:57:17.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7fecdbfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fecdc15e210 0x7fecdc06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7fecdbfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fecdc15e210 0x7fecdc06da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53224/0 (socket says 172.21.15.61:53224) 2023-12-24T19:57:17.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7fecdbfff700 1 -- 172.21.15.61:0/230901852 learned_addr learned my addr 172.21.15.61:0/230901852 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f5b058e7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5b0006e3f0 0x7f5b000a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f5b058e7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b000afe90 0x7f5b0015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f5b058e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b001432f0 0x7f5b000a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f5b058e7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000a6c40 con 0x7f5b0006e3f0 2023-12-24T19:57:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f5b058e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b001574a0 con 0x7f5b001432f0 2023-12-24T19:57:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f5b058e7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015b960 con 0x7f5b000afe90 2023-12-24T19:57:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5efc04c3c0 con 0x7f5efc06df70 2023-12-24T19:57:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.952+0000 7f9dbeedd700 1 -- start start 2023-12-24T19:57:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f9dbeedd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9db80afd40 0x7f9db80b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f9dbeedd700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db80c8200 con 0x7f9db80c2cc0 2023-12-24T19:57:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f9dbeedd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db80c8d60 con 0x7f9db806a250 2023-12-24T19:57:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f9dbeedd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db80b0110 con 0x7f9db80afd40 2023-12-24T19:57:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f5aff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b001432f0 0x7f5b000a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f5aff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b001432f0 0x7f5b000a8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56066/0 (socket says 172.21.15.61:56066) 2023-12-24T19:57:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f5aff7fe700 1 -- 172.21.15.61:0/387281762 learned_addr learned my addr 172.21.15.61:0/387281762 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f9dbcc79700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9db80afd40 0x7f9db80b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f9dbcc79700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9db80afd40 0x7f9db80b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56078/0 (socket says 172.21.15.61:56078) 2023-12-24T19:57:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.953+0000 7f9dbcc79700 1 -- 172.21.15.61:0/3394724581 learned_addr learned my addr 172.21.15.61:0/3394724581 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5afe7fc700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b000afe90 0x7f5b0015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5aff7fe700 1 -- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b000afe90 msgr2=0x7f5b0015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5aff7fe700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b000afe90 0x7f5b0015aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5aff7fe700 1 -- 172.21.15.61:0/387281762 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5b0006e3f0 msgr2=0x7f5b000a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5aff7fe700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5b0006e3f0 0x7f5b000a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5aff7fe700 1 -- 172.21.15.61:0/387281762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009420 con 0x7f5b001432f0 2023-12-24T19:57:17.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5afe7fc700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5b000afe90 0x7f5b0015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:17.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f9dbcc79700 1 -- 172.21.15.61:0/3394724581 >> v1:172.21.15.133:6789/0 conn(0x7f9db806a250 legacy=0x7f9db80c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f9dbcc79700 1 -- 172.21.15.61:0/3394724581 >> v1:172.21.15.61:6789/0 conn(0x7f9db80c2cc0 legacy=0x7f9db8069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f9dbcc79700 1 -- 172.21.15.61:0/3394724581 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8156e40 con 0x7f9db80afd40 2023-12-24T19:57:17.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5aff7fe700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b001432f0 0x7f5b000a8b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5af800cdb0 tx=0x7f5af80077a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7feb47c50700 1 -- 172.21.15.61:0/2142825582 shutdown_connections 2023-12-24T19:57:17.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5ae6ffd700 1 -- 172.21.15.61:0/387281762 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800aac0 con 0x7f5b001432f0 2023-12-24T19:57:17.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5ae6ffd700 1 -- 172.21.15.61:0/387281762 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af800ac20 con 0x7f5b001432f0 2023-12-24T19:57:17.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5ae6ffd700 1 -- 172.21.15.61:0/387281762 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8017430 con 0x7f5b001432f0 2023-12-24T19:57:17.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0015b0c0 con 0x7f5b001432f0 2023-12-24T19:57:17.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0015b680 con 0x7f5b001432f0 2023-12-24T19:57:17.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f5ee2ffd700 1 -- 172.21.15.61:0/3772707183 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5eec0233e0 con 0x7f5efc06df70 2023-12-24T19:57:17.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7f5ee2ffd700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ee8066f30 0x7f5ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7f5ee2ffd700 1 -- 172.21.15.61:0/3772707183 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5eec084980 con 0x7f5efc06df70 2023-12-24T19:57:17.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7f5ee2ffd700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] conn(0x7f5ee806f0c0 0x7f5ee80714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7f5ee2ffd700 1 -- 172.21.15.61:0/3772707183 --> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ee8071b80 con 0x7f5ee806f0c0 2023-12-24T19:57:17.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7f5ee2ffd700 1 -- 172.21.15.61:0/3772707183 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eec00a3d0 con 0x7f5efc06df70 2023-12-24T19:57:17.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7f5efb59e700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] conn(0x7f5ee806f0c0 0x7f5ee80714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7f5efa59c700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ee8066f30 0x7f5ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7fece0daf700 1 --2- 172.21.15.61:0/230901852 >> v2:172.21.15.133:3300/0 conn(0x7fecdc15de40 0x7fecdc0ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7fecdbfff700 1 -- 172.21.15.61:0/230901852 >> v2:172.21.15.133:3300/0 conn(0x7fecdc15de40 msgr2=0x7fecdc0ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7fecdbfff700 1 --2- 172.21.15.61:0/230901852 >> v2:172.21.15.133:3300/0 conn(0x7fecdc15de40 0x7fecdc0ae970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7fecdbfff700 1 -- 172.21.15.61:0/230901852 >> v1:172.21.15.61:6789/0 conn(0x7fecdc06df70 legacy=0x7fecdc161ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:17.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7fecdbfff700 1 -- 172.21.15.61:0/230901852 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc0aeeb0 con 0x7fecdc15e210 2023-12-24T19:57:17.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f9dbcc79700 1 --2- 172.21.15.61:0/3394724581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db80afd40 0x7f9db80b04c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0099b0 tx=0x7f9dac009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a0215c795c1cbaf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.954+0000 7f9db77fe700 1 -- 172.21.15.61:0/3394724581 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00b820 con 0x7f9db80afd40 2023-12-24T19:57:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7f9db77fe700 1 -- 172.21.15.61:0/3394724581 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac00b980 con 0x7f9db80afd40 2023-12-24T19:57:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7f9db77fe700 1 -- 172.21.15.61:0/3394724581 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00bd20 con 0x7f9db80afd40 2023-12-24T19:57:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7f9dbeedd700 1 -- 172.21.15.61:0/3394724581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db80afd40 msgr2=0x7f9db80b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7f9dbeedd700 1 --2- 172.21.15.61:0/3394724581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db80afd40 0x7f9db80b04c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0099b0 tx=0x7f9dac009250 comp rx=0 tx=0).stop 2023-12-24T19:57:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b81569f0 con 0x7ff1b8159a60 2023-12-24T19:57:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b8156fb0 con 0x7ff1b8159a60 2023-12-24T19:57:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7fecdbfff700 1 --2- 172.21.15.61:0/230901852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecdc15e210 0x7fecdc06da30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fecdc06c4d0 tx=0x7fecd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7728c0bacc692987 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7fecdb7fe700 1 -- 172.21.15.61:0/230901852 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000b820 con 0x7fecdc15e210 2023-12-24T19:57:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7fecdb7fe700 1 -- 172.21.15.61:0/230901852 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd000b980 con 0x7fecdc15e210 2023-12-24T19:57:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7fecdb7fe700 1 -- 172.21.15.61:0/230901852 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000bd20 con 0x7fecdc15e210 2023-12-24T19:57:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7f9dbeedd700 1 -- 172.21.15.61:0/3394724581 shutdown_connections 2023-12-24T19:57:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7f9dbeedd700 1 --2- 172.21.15.61:0/3394724581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db80afd40 0x7f9db80b04c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.956+0000 7f9dbeedd700 1 -- 172.21.15.61:0/3394724581 >> 172.21.15.61:0/3394724581 conn(0x7f9db80ce190 msgr2=0x7f9db80ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.957+0000 7f5efb59e700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] conn(0x7f5ee806f0c0 0x7f5ee80714d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.955+0000 7feb47c50700 1 -- 172.21.15.61:0/2142825582 wait complete. 2023-12-24T19:57:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.957+0000 7feb47c50700 1 Processor -- start 2023-12-24T19:57:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.957+0000 7f5ae6ffd700 1 -- 172.21.15.61:0/387281762 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5af800d040 con 0x7f5b001432f0 2023-12-24T19:57:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.957+0000 7f5ae6ffd700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ae80670a0 0x7f5ae8069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.957+0000 7f5efa59c700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ee8066f30 0x7f5ee80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009ab0 tx=0x7f5ef403a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7f5ee2ffd700 1 -- 172.21.15.61:0/3772707183 <== osd.3 v2:172.21.15.61:6824/40415 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f5ee8071b80 con 0x7f5ee806f0c0 2023-12-24T19:57:17.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7f5ae6ffd700 1 -- 172.21.15.61:0/387281762 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5af8013070 con 0x7f5b001432f0 2023-12-24T19:57:17.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7f9dbeedd700 1 -- 172.21.15.61:0/3394724581 shutdown_connections 2023-12-24T19:57:17.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7f5afeffd700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ae80670a0 0x7f5ae8069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.957+0000 7feb47c50700 1 -- start start 2023-12-24T19:57:17.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7feb47c50700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb4006e3f0 0x7feb4016c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7feb47c50700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7feb400afcc0 0x7feb40179730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7feb47c50700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4015ced0 0x7feb40069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7feb47c50700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb40156a00 con 0x7feb400afcc0 2023-12-24T19:57:17.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7feb47c50700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb401574b0 con 0x7feb4006e3f0 2023-12-24T19:57:17.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7feb47c50700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4016c710 con 0x7feb4015ced0 2023-12-24T19:57:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.957+0000 7ff19ffff700 1 -- 172.21.15.61:0/2355144916 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff1a801a400 con 0x7ff1b8159a60 2023-12-24T19:57:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7ff19ffff700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1a4067080 0x7ff1a4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7ff19ffff700 1 -- 172.21.15.61:0/2355144916 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1a8084010 con 0x7ff1b8159a60 2023-12-24T19:57:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7feb459ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb4006e3f0 0x7feb4016c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7feb459ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb4006e3f0 0x7feb4016c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56082/0 (socket says 172.21.15.61:56082) 2023-12-24T19:57:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7feb459ec700 1 -- 172.21.15.61:0/2207728365 learned_addr learned my addr 172.21.15.61:0/2207728365 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7feb461ed700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4015ced0 0x7feb40069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb451eb700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7feb400afcc0 0x7feb40179730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7f5afeffd700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ae80670a0 0x7f5ae8069550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5af00098e0 tx=0x7f5af0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb459ec700 1 -- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4015ced0 msgr2=0x7feb40069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb459ec700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feb4015ced0 0x7feb40069aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb459ec700 1 -- 172.21.15.61:0/2207728365 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7feb400afcc0 msgr2=0x7feb40179730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb459ec700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7feb400afcc0 0x7feb40179730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb459ec700 1 -- 172.21.15.61:0/2207728365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb300094f0 con 0x7feb4006e3f0 2023-12-24T19:57:17.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7f5b058e7700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] conn(0x7f5ae00015e0 0x7f5ae0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 --> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ae0006b80 con 0x7f5ae00015e0 2023-12-24T19:57:17.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb459ec700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb4006e3f0 0x7feb4016c1d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00b840 tx=0x7feb3c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb35ffb700 1 -- 172.21.15.61:0/2207728365 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c00f510 con 0x7feb4006e3f0 2023-12-24T19:57:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.958+0000 7f9dbeedd700 1 -- 172.21.15.61:0/3394724581 wait complete. 2023-12-24T19:57:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7f9dbeedd700 1 Processor -- start 2023-12-24T19:57:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.957+0000 7fece3013700 1 -- 172.21.15.61:0/230901852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecdc15e210 msgr2=0x7fecdc06da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.957+0000 7fece3013700 1 --2- 172.21.15.61:0/230901852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecdc15e210 0x7fecdc06da30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fecdc06c4d0 tx=0x7fecd0009250 comp rx=0 tx=0).stop 2023-12-24T19:57:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.960+0000 7fece3013700 1 -- 172.21.15.61:0/230901852 shutdown_connections 2023-12-24T19:57:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.960+0000 7fece3013700 1 --2- 172.21.15.61:0/230901852 >> v2:172.21.15.133:3300/0 conn(0x7fecdc15de40 0x7fecdc0ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.960+0000 7fece3013700 1 --2- 172.21.15.61:0/230901852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecdc15e210 0x7fecdc06da30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.960+0000 7fece3013700 1 -- 172.21.15.61:0/230901852 >> 172.21.15.61:0/230901852 conn(0x7fecdc068020 msgr2=0x7fecdc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb35ffb700 1 -- 172.21.15.61:0/2207728365 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c00f670 con 0x7feb4006e3f0 2023-12-24T19:57:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb400a9fe0 con 0x7feb4006e3f0 2023-12-24T19:57:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7feb35ffb700 1 -- 172.21.15.61:0/2207728365 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c00fa30 con 0x7feb4006e3f0 2023-12-24T19:57:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.960+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb400a9990 con 0x7feb4006e3f0 2023-12-24T19:57:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.960+0000 7f9dbeedd700 1 -- start start 2023-12-24T19:57:17.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7fece3013700 1 -- 172.21.15.61:0/230901852 shutdown_connections 2023-12-24T19:57:17.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7fece3013700 1 -- 172.21.15.61:0/230901852 wait complete. 2023-12-24T19:57:17.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7f9dbeedd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9db806a250 0x7f9db816b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7f9dbeedd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db80afd40 0x7f9db8157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7f9dbeedd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db80c2cc0 0x7f9db8157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7f9dbeedd700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db816cd40 con 0x7f9db806a250 2023-12-24T19:57:17.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7f9dbeedd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db816c130 con 0x7f9db80c2cc0 2023-12-24T19:57:17.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7f9dbeedd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db816c410 con 0x7f9db80afd40 2023-12-24T19:57:17.989 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7f9db7fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db80afd40 0x7f9db8157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.989 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7f9db7fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db80afd40 0x7f9db8157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:57792/0 (socket says 172.21.15.61:57792) 2023-12-24T19:57:17.989 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7f9db7fff700 1 -- 172.21.15.61:0/978875316 learned_addr learned my addr 172.21.15.61:0/978875316 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.989 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f9dbd47a700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db80c2cc0 0x7f9db8157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.989 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f9dbcc79700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9db806a250 0x7f9db816b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.989 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.961+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feb4004c3c0 con 0x7feb4006e3f0 2023-12-24T19:57:17.989 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7ff1be981700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] conn(0x7ff1b80c4010 0x7ff1b80c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 --> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1b80639b0 con 0x7ff1b80c4010 2023-12-24T19:57:17.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.959+0000 7ff1b77fe700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] conn(0x7ff1b80c4010 0x7ff1b80c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.960+0000 7ff1b77fe700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] conn(0x7ff1b80c4010 0x7ff1b80c43e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7fece3013700 1 Processor -- start 2023-12-24T19:57:17.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f9dbd47a700 1 -- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db80afd40 msgr2=0x7f9db8157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f9dbd47a700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9db80afd40 0x7f9db8157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f9dbd47a700 1 -- 172.21.15.61:0/978875316 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9db806a250 msgr2=0x7f9db816b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f9dbd47a700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9db806a250 0x7f9db816b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f9dbd47a700 1 -- 172.21.15.61:0/978875316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0094f0 con 0x7f9db80c2cc0 2023-12-24T19:57:17.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7ff19ffff700 1 -- 172.21.15.61:0/2355144916 <== osd.7 v2:172.21.15.133:6808/40577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7ff1b80639b0 con 0x7ff1b80c4010 2023-12-24T19:57:17.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f9dbd47a700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db80c2cc0 0x7f9db8157570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9db806a650 tx=0x7f9db00015f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7feb35ffb700 1 -- 172.21.15.61:0/2207728365 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7feb3c01a400 con 0x7feb4006e3f0 2023-12-24T19:57:17.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7feb35ffb700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7feb24066fb0 0x7feb24069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7feb35ffb700 1 -- 172.21.15.61:0/2207728365 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb3c083ff0 con 0x7feb4006e3f0 2023-12-24T19:57:17.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7feb35ffb700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] conn(0x7feb2406f1c0 0x7feb240715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7feb35ffb700 1 -- 172.21.15.61:0/2207728365 --> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb24071c80 con 0x7feb2406f1c0 2023-12-24T19:57:17.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7feb35ffb700 1 -- 172.21.15.61:0/2207728365 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb3c086590 con 0x7feb4006e3f0 2023-12-24T19:57:17.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7feb451eb700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7feb24066fb0 0x7feb24069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f5afe7fc700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] conn(0x7f5ae00015e0 0x7f5ae0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7f5afe7fc700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] conn(0x7f5ae00015e0 0x7f5ae0003a90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7fece3013700 1 -- start start 2023-12-24T19:57:17.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f9db4ff9700 1 -- 172.21.15.61:0/978875316 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0011590 con 0x7f9db80c2cc0 2023-12-24T19:57:17.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.962+0000 7f9db4ff9700 1 -- 172.21.15.61:0/978875316 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db0011710 con 0x7f9db80c2cc0 2023-12-24T19:57:17.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7ff1b7fff700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1a4067080 0x7ff1a4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7f9db4ff9700 1 -- 172.21.15.61:0/978875316 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0011ad0 con 0x7f9db80c2cc0 2023-12-24T19:57:17.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.963+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db816c6f0 con 0x7f9db80c2cc0 2023-12-24T19:57:17.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.964+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db816d1d0 con 0x7f9db80c2cc0 2023-12-24T19:57:17.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.964+0000 7f5ae6ffd700 1 -- 172.21.15.61:0/387281762 <== osd.2 v2:172.21.15.61:6800/40392 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f5ae0006b80 con 0x7f5ae00015e0 2023-12-24T19:57:17.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.964+0000 7fece3013700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc06df70 0x7fecdc159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.964+0000 7fece3013700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecdc15de40 0x7fecdc1608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.964+0000 7fece3013700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecdc15e210 0x7fecdc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.964+0000 7fece3013700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc161e60 con 0x7fecdc15e210 2023-12-24T19:57:17.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.964+0000 7fece3013700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc161250 con 0x7fecdc06df70 2023-12-24T19:57:17.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.964+0000 7fece3013700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc161530 con 0x7fecdc15de40 2023-12-24T19:57:17.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.966+0000 7f9db4ff9700 1 -- 172.21.15.61:0/978875316 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9db0003030 con 0x7f9db80c2cc0 2023-12-24T19:57:17.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.964+0000 7fecdbfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecdc15de40 0x7fecdc1608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.965+0000 7fece0daf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc06df70 0x7fecdc159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.965+0000 7fecdbfff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecdc15de40 0x7fecdc1608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:57804/0 (socket says 172.21.15.61:57804) 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.965+0000 7fecdbfff700 1 -- 172.21.15.61:0/3168487523 learned_addr learned my addr 172.21.15.61:0/3168487523 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.965+0000 7fece15b0700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecdc15e210 0x7fecdc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.965+0000 7fece15b0700 1 -- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecdc15de40 msgr2=0x7fecdc1608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.965+0000 7fece15b0700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecdc15de40 0x7fecdc1608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.965+0000 7fece15b0700 1 -- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc06df70 msgr2=0x7fecdc159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.965+0000 7fece15b0700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc06df70 0x7fecdc159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.965+0000 7fece15b0700 1 -- 172.21.15.61:0/3168487523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00094f0 con 0x7fecdc15e210 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.965+0000 7fece0daf700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc06df70 0x7fecdc159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.966+0000 7fece15b0700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecdc15e210 0x7fecdc069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c810 tx=0x7fecd4002620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.966+0000 7fecd8ff9700 1 -- 172.21.15.61:0/3168487523 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4012630 con 0x7fecdc15e210 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.966+0000 7fecd8ff9700 1 -- 172.21.15.61:0/3168487523 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40127b0 con 0x7fecdc15e210 2023-12-24T19:57:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.966+0000 7fecd8ff9700 1 -- 172.21.15.61:0/3168487523 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4012b70 con 0x7fecdc15e210 2023-12-24T19:57:17.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.967+0000 7f9db4ff9700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d9c067000 0x7f9d9c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.967+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9db804c3c0 con 0x7f9db80c2cc0 2023-12-24T19:57:17.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.967+0000 7f9db4ff9700 1 -- 172.21.15.61:0/978875316 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9db0084020 con 0x7f9db80c2cc0 2023-12-24T19:57:17.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.967+0000 7feb461ed700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] conn(0x7feb2406f1c0 0x7feb240715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.967+0000 7feb451eb700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7feb24066fb0 0x7feb24069460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb400af190 tx=0x7feb30017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.967+0000 7f9db4ff9700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] conn(0x7f9d9c06f190 0x7f9d9c0715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.967+0000 7f9db4ff9700 1 -- 172.21.15.61:0/978875316 --> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d9c071c50 con 0x7f9d9c06f190 2023-12-24T19:57:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.967+0000 7f9db4ff9700 1 -- 172.21.15.61:0/978875316 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9db0001280 con 0x7f9db80c2cc0 2023-12-24T19:57:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.967+0000 7f9dbcc79700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d9c067000 0x7f9d9c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.967+0000 7f9db7fff700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] conn(0x7f9d9c06f190 0x7f9d9c0715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.968+0000 7f9dbcc79700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d9c067000 0x7f9d9c0694b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0099b0 tx=0x7f9dac016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.968+0000 7f9db7fff700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] conn(0x7f9d9c06f190 0x7f9d9c0715a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.968+0000 7f9db4ff9700 1 -- 172.21.15.61:0/978875316 <== osd.5 v2:172.21.15.133:6824/40616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f9d9c071c50 con 0x7f9d9c06f190 2023-12-24T19:57:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.972+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc161810 con 0x7fecdc15e210 2023-12-24T19:57:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.972+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc1622f0 con 0x7fecdc15e210 2023-12-24T19:57:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.972+0000 7ff5878ba700 1 Processor -- start 2023-12-24T19:57:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.972+0000 7ff5878ba700 1 -- start start 2023-12-24T19:57:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.974+0000 7fecd8ff9700 1 -- 172.21.15.61:0/3168487523 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fecd401b400 con 0x7fecdc15e210 2023-12-24T19:57:18.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.975+0000 7fecd8ff9700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fecc8067080 0x7fecc8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.975+0000 7fecd8ff9700 1 -- 172.21.15.61:0/3168487523 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fecd4084770 con 0x7fecdc15e210 2023-12-24T19:57:18.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.975+0000 7fece0daf700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fecc8067080 0x7fecc8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.973+0000 7ff5878ba700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff580153aa0 0x7ff580156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.973+0000 7ff5878ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5800b26d0 0x7ff580157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.973+0000 7ff5878ba700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff580157740 con 0x7ff580159b70 2023-12-24T19:57:18.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.973+0000 7ff5878ba700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58015a0c0 con 0x7ff580153aa0 2023-12-24T19:57:18.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.973+0000 7ff5878ba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58015a3a0 con 0x7ff5800b26d0 2023-12-24T19:57:18.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.974+0000 7ff585656700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff580153aa0 0x7ff580156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.974+0000 7ff585656700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff580153aa0 0x7ff580156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53262/0 (socket says 172.21.15.61:53262) 2023-12-24T19:57:18.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.974+0000 7ff585656700 1 -- 172.21.15.61:0/122377889 learned_addr learned my addr 172.21.15.61:0/122377889 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.974+0000 7ff585e57700 1 --2- 172.21.15.61:0/122377889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5800b26d0 0x7ff580157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.975+0000 7ff585656700 1 -- 172.21.15.61:0/122377889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5800b26d0 msgr2=0x7ff580157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.975+0000 7ff585656700 1 --2- 172.21.15.61:0/122377889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5800b26d0 0x7ff580157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.975+0000 7ff585656700 1 -- 172.21.15.61:0/122377889 >> v1:172.21.15.61:6789/0 conn(0x7ff580159b70 legacy=0x7ff5800b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.975+0000 7ff585656700 1 -- 172.21.15.61:0/122377889 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58015a680 con 0x7ff580153aa0 2023-12-24T19:57:18.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.975+0000 7ff585656700 1 --2- 172.21.15.61:0/122377889 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff580153aa0 0x7ff580156fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00ba50 tx=0x7ff57c00a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8e2410b38d8b05 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.975+0000 7ff577fff700 1 -- 172.21.15.61:0/122377889 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c009070 con 0x7ff580153aa0 2023-12-24T19:57:18.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.976+0000 7fece0daf700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fecc8067080 0x7fecc8069530 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fecdc06a550 tx=0x7feccc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.975+0000 7ff577fff700 1 -- 172.21.15.61:0/122377889 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c00cb60 con 0x7ff580153aa0 2023-12-24T19:57:18.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.976+0000 7ff577fff700 1 -- 172.21.15.61:0/122377889 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00d450 con 0x7ff580153aa0 2023-12-24T19:57:18.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.976+0000 7fece3013700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] conn(0x7fecdc0a78a0 0x7fecdc0abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.976+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 --> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecdc0cd280 con 0x7fecdc0a78a0 2023-12-24T19:57:18.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.976+0000 7fecdbfff700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] conn(0x7fecdc0a78a0 0x7fecdc0abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.976+0000 7ff5878ba700 1 -- 172.21.15.61:0/122377889 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff580153aa0 msgr2=0x7ff580156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.976+0000 7ff5878ba700 1 --2- 172.21.15.61:0/122377889 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff580153aa0 0x7ff580156fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00ba50 tx=0x7ff57c00a200 comp rx=0 tx=0).stop 2023-12-24T19:57:18.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.977+0000 7ff5878ba700 1 -- 172.21.15.61:0/122377889 shutdown_connections 2023-12-24T19:57:18.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.977+0000 7ff5878ba700 1 --2- 172.21.15.61:0/122377889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5800b26d0 0x7ff580157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.977+0000 7ff5878ba700 1 --2- 172.21.15.61:0/122377889 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff580153aa0 0x7ff580156fa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.977+0000 7ff5878ba700 1 -- 172.21.15.61:0/122377889 >> 172.21.15.61:0/122377889 conn(0x7ff580068020 msgr2=0x7ff5800cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.977+0000 7ff5878ba700 1 -- 172.21.15.61:0/122377889 shutdown_connections 2023-12-24T19:57:18.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.977+0000 7ff5878ba700 1 -- 172.21.15.61:0/122377889 wait complete. 2023-12-24T19:57:18.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.978+0000 7feb461ed700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] conn(0x7feb2406f1c0 0x7feb240715d0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.979+0000 7ff5878ba700 1 Processor -- start 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.979+0000 7ff5878ba700 1 -- start start 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.980+0000 7ff5878ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5800b26d0 0x7ff58016e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.980+0000 7ff5878ba700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff580153aa0 0x7ff58014dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.980+0000 7ff5878ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff580159b70 0x7ff58014bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.980+0000 7ff5878ba700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014fc50 con 0x7ff580153aa0 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.980+0000 7ff5878ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014ede0 con 0x7ff5800b26d0 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.980+0000 7ff5878ba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014efd0 con 0x7ff580159b70 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff585656700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5800b26d0 0x7ff58016e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff584e55700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff580153aa0 0x7ff58014dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff585656700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5800b26d0 0x7ff58016e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56112/0 (socket says 172.21.15.61:56112) 2023-12-24T19:57:18.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff585656700 1 -- 172.21.15.61:0/1056106034 learned_addr learned my addr 172.21.15.61:0/1056106034 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff585e57700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff580159b70 0x7ff58014bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff585656700 1 -- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff580159b70 msgr2=0x7ff58014bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff585656700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff580159b70 0x7ff58014bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff585656700 1 -- 172.21.15.61:0/1056106034 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff580153aa0 msgr2=0x7ff58014dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff585656700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff580153aa0 0x7ff58014dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff585656700 1 -- 172.21.15.61:0/1056106034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c00b590 con 0x7ff5800b26d0 2023-12-24T19:57:18.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 --> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcc800b1980 con 0x7fcc6806f260 2023-12-24T19:57:18.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.981+0000 7ff585656700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5800b26d0 0x7ff58016e4b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c6c0 tx=0x7ff57c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7fcc6e7fc700 1 -- 172.21.15.61:0/3293063583 <== osd.0 v2:172.21.15.61:6808/40393 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcc800b1980 con 0x7fcc6806f260 2023-12-24T19:57:18.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 >> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] conn(0x7fcc6806f260 msgr2=0x7fcc68071670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7fcc84fb2700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] conn(0x7fcc6806f260 0x7fcc68071670 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc68067050 msgr2=0x7fcc68069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7fcc84fb2700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc68067050 0x7fcc68069500 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcc700099b0 tx=0x7fcc70016000 comp rx=0 tx=0).stop 2023-12-24T19:57:18.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc8006df70 msgr2=0x7fcc8016f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7fcc84fb2700 1 --2- 172.21.15.61:0/3293063583 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc8006df70 0x7fcc8016f740 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400b600 tx=0x7fcc740091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7fcc7ed9d700 1 -- 172.21.15.61:0/3293063583 reap_dead start 2023-12-24T19:57:18.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7ff1b7fff700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1a4067080 0x7ff1a4069530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0003fa0 tx=0x7ff1b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7ff5757fa700 1 -- 172.21.15.61:0/1056106034 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00de40 con 0x7ff5800b26d0 2023-12-24T19:57:18.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7ff5757fa700 1 -- 172.21.15.61:0/1056106034 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c01e600 con 0x7ff5800b26d0 2023-12-24T19:57:18.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.982+0000 7ff5757fa700 1 -- 172.21.15.61:0/1056106034 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c01e9c0 con 0x7ff5800b26d0 2023-12-24T19:57:18.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.983+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58014f2b0 con 0x7ff5800b26d0 2023-12-24T19:57:18.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.983+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58014f870 con 0x7ff5800b26d0 2023-12-24T19:57:18.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.985+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 shutdown_connections 2023-12-24T19:57:18.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.985+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 >> 172.21.15.61:0/3293063583 conn(0x7fcc80068020 msgr2=0x7fcc800cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.985+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 shutdown_connections 2023-12-24T19:57:18.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.985+0000 7fcc84fb2700 1 -- 172.21.15.61:0/3293063583 wait complete. 2023-12-24T19:57:18.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.984+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5801574d0 con 0x7ff5800b26d0 2023-12-24T19:57:18.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.986+0000 7feb35ffb700 1 -- 172.21.15.61:0/2207728365 <== osd.1 v2:172.21.15.61:6816/40391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7feb24071c80 con 0x7feb2406f1c0 2023-12-24T19:57:18.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.986+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 --> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5efc14f530 con 0x7f5ee806f0c0 2023-12-24T19:57:18.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.985+0000 7fecdbfff700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] conn(0x7fecdc0a78a0 0x7fecdc0abd30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.986+0000 7ff5757fa700 1 -- 172.21.15.61:0/1056106034 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff57c0153f0 con 0x7ff5800b26d0 2023-12-24T19:57:18.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.986+0000 7ff5757fa700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff564067080 0x7ff564069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.987+0000 7ff5757fa700 1 -- 172.21.15.61:0/1056106034 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff57c085c10 con 0x7ff5800b26d0 2023-12-24T19:57:18.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.987+0000 7ff5757fa700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] conn(0x7ff56406f210 0x7ff564071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.987+0000 7ff5757fa700 1 -- 172.21.15.61:0/1056106034 --> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff564071cd0 con 0x7ff56406f210 2023-12-24T19:57:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.989+0000 7ff5757fa700 1 -- 172.21.15.61:0/1056106034 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff57c052e90 con 0x7ff5800b26d0 2023-12-24T19:57:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.990+0000 7f5ee2ffd700 1 -- 172.21.15.61:0/3772707183 <== osd.3 v2:172.21.15.61:6824/40415 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5efc14f530 con 0x7f5ee806f0c0 2023-12-24T19:57:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.990+0000 7ff584e55700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff564067080 0x7ff564069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.990+0000 7ff585e57700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] conn(0x7ff56406f210 0x7ff564071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.989+0000 7fecd8ff9700 1 -- 172.21.15.61:0/3168487523 <== osd.4 v2:172.21.15.133:6800/40575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fecdc0cd280 con 0x7fecdc0a78a0 2023-12-24T19:57:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.991+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 >> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] conn(0x7f5ee806f0c0 msgr2=0x7f5ee80714d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.991+0000 7f5f01011700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] conn(0x7f5ee806f0c0 0x7f5ee80714d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.991+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ee8066f30 msgr2=0x7f5ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.991+0000 7f5f01011700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ee8066f30 0x7f5ee80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009ab0 tx=0x7f5ef403a000 comp rx=0 tx=0).stop 2023-12-24T19:57:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.991+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5efc06df70 msgr2=0x7f5efc149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.991+0000 7f5f01011700 1 --2- 172.21.15.61:0/3772707183 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5efc06df70 0x7f5efc149920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c880 tx=0x7f5eec008040 comp rx=0 tx=0).stop 2023-12-24T19:57:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.991+0000 7f5efb59e700 1 -- 172.21.15.61:0/3772707183 reap_dead start 2023-12-24T19:57:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.991+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 shutdown_connections 2023-12-24T19:57:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.991+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 >> 172.21.15.61:0/3772707183 conn(0x7f5efc067fe0 msgr2=0x7f5efc068ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.992+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 shutdown_connections 2023-12-24T19:57:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.992+0000 7f5f01011700 1 -- 172.21.15.61:0/3772707183 wait complete. 2023-12-24T19:57:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.992+0000 7ff585e57700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] conn(0x7ff56406f210 0x7ff564071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.994+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 --> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ae0005c70 con 0x7f5ae00015e0 2023-12-24T19:57:18.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.997+0000 7f5ae6ffd700 1 -- 172.21.15.61:0/387281762 <== osd.2 v2:172.21.15.61:6800/40392 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ae0005c70 con 0x7f5ae00015e0 2023-12-24T19:57:18.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.997+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 >> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] conn(0x7f5ae00015e0 msgr2=0x7f5ae0003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.997+0000 7f5b058e7700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] conn(0x7f5ae00015e0 0x7f5ae0003a90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:17.997+0000 7ff5757fa700 1 -- 172.21.15.61:0/1056106034 <== osd.6 v2:172.21.15.133:6816/40576 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7ff564071cd0 con 0x7ff56406f210 2023-12-24T19:57:18.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7ff584e55700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff564067080 0x7ff564069530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5800686f0 tx=0x7ff570009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ae80670a0 msgr2=0x7f5ae8069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7f5b058e7700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ae80670a0 0x7f5ae8069550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5af00098e0 tx=0x7f5af0016000 comp rx=0 tx=0).stop 2023-12-24T19:57:18.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b001432f0 msgr2=0x7f5b000a8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7f5b058e7700 1 --2- 172.21.15.61:0/387281762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b001432f0 0x7f5b000a8b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5af800cdb0 tx=0x7f5af80077a0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7f5aff7fe700 1 -- 172.21.15.61:0/387281762 reap_dead start 2023-12-24T19:57:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 shutdown_connections 2023-12-24T19:57:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 >> 172.21.15.61:0/387281762 conn(0x7f5b00067fe0 msgr2=0x7f5b0006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 shutdown_connections 2023-12-24T19:57:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7f5b058e7700 1 -- 172.21.15.61:0/387281762 wait complete. 2023-12-24T19:57:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.000+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 --> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff1b815dff0 con 0x7ff1b80c4010 2023-12-24T19:57:18.017 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.017 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-24T19:57:18.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.002+0000 7ff19ffff700 1 -- 172.21.15.61:0/2355144916 <== osd.7 v2:172.21.15.133:6808/40577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff1b815dff0 con 0x7ff1b80c4010 2023-12-24T19:57:18.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.003+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 --> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9db816bd70 con 0x7f9d9c06f190 2023-12-24T19:57:18.019 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.019 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-24T19:57:18.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.006+0000 7f9db4ff9700 1 -- 172.21.15.61:0/978875316 <== osd.5 v2:172.21.15.133:6824/40616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9db816bd70 con 0x7f9d9c06f190 2023-12-24T19:57:18.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.007+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] conn(0x7ff1b80c4010 msgr2=0x7ff1b80c43e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.007+0000 7ff1be981700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] conn(0x7ff1b80c4010 0x7ff1b80c43e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.007+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1a4067080 msgr2=0x7ff1a4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.007+0000 7ff1be981700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1a4067080 0x7ff1a4069530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0003fa0 tx=0x7ff1b0009040 comp rx=0 tx=0).stop 2023-12-24T19:57:18.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.007+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b8159a60 msgr2=0x7ff1b8176500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.007+0000 7ff1be981700 1 --2- 172.21.15.61:0/2355144916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b8159a60 0x7ff1b8176500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800b5e0 tx=0x7ff1a8009120 comp rx=0 tx=0).stop 2023-12-24T19:57:18.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.009+0000 7ff1bcf1e700 1 -- 172.21.15.61:0/2355144916 reap_dead start 2023-12-24T19:57:18.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.009+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 shutdown_connections 2023-12-24T19:57:18.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.009+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 >> 172.21.15.61:0/2355144916 conn(0x7ff1b80cac10 msgr2=0x7ff1b80c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.009+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 shutdown_connections 2023-12-24T19:57:18.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.009+0000 7ff1be981700 1 -- 172.21.15.61:0/2355144916 wait complete. 2023-12-24T19:57:18.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.011+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 --> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fecdc06eb30 con 0x7fecdc0a78a0 2023-12-24T19:57:18.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.011+0000 7fecd8ff9700 1 -- 172.21.15.61:0/3168487523 <== osd.4 v2:172.21.15.133:6800/40575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fecdc06eb30 con 0x7fecdc0a78a0 2023-12-24T19:57:18.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] conn(0x7fecdc0a78a0 msgr2=0x7fecdc0abd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece3013700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] conn(0x7fecdc0a78a0 0x7fecdc0abd30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fecc8067080 msgr2=0x7fecc8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece3013700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fecc8067080 0x7fecc8069530 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fecdc06a550 tx=0x7feccc008040 comp rx=0 tx=0).stop 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecdc15e210 msgr2=0x7fecdc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece3013700 1 --2- 172.21.15.61:0/3168487523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecdc15e210 0x7fecdc069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fecd400c810 tx=0x7fecd4002620 comp rx=0 tx=0).stop 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece15b0700 1 -- 172.21.15.61:0/3168487523 reap_dead start 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 shutdown_connections 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 >> 172.21.15.61:0/3168487523 conn(0x7fecdc068020 msgr2=0x7fecdc0ace70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 shutdown_connections 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.012+0000 7fece3013700 1 -- 172.21.15.61:0/3168487523 wait complete. 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.015+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] conn(0x7f9d9c06f190 msgr2=0x7f9d9c0715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.015+0000 7f9dbeedd700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] conn(0x7f9d9c06f190 0x7f9d9c0715a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.024 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.024 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-24T19:57:18.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.015+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d9c067000 msgr2=0x7f9d9c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.015+0000 7f9dbeedd700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d9c067000 0x7f9d9c0694b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0099b0 tx=0x7f9dac016000 comp rx=0 tx=0).stop 2023-12-24T19:57:18.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.015+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db80c2cc0 msgr2=0x7f9db8157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.015+0000 7f9dbeedd700 1 --2- 172.21.15.61:0/978875316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9db80c2cc0 0x7f9db8157570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9db806a650 tx=0x7f9db00015f0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.015+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 --> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feb40068730 con 0x7feb2406f1c0 2023-12-24T19:57:18.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.015+0000 7f9dbd47a700 1 -- 172.21.15.61:0/978875316 reap_dead start 2023-12-24T19:57:18.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.015+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 shutdown_connections 2023-12-24T19:57:18.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.015+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 >> 172.21.15.61:0/978875316 conn(0x7f9db80ce190 msgr2=0x7f9db80ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.016+0000 7feb35ffb700 1 -- 172.21.15.61:0/2207728365 <== osd.1 v2:172.21.15.61:6816/40391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feb40068730 con 0x7feb2406f1c0 2023-12-24T19:57:18.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.016+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 >> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] conn(0x7feb2406f1c0 msgr2=0x7feb240715d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.016+0000 7feb47c50700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] conn(0x7feb2406f1c0 0x7feb240715d0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.016+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7feb24066fb0 msgr2=0x7feb24069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.016+0000 7feb47c50700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7feb24066fb0 0x7feb24069460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feb400af190 tx=0x7feb30017000 comp rx=0 tx=0).stop 2023-12-24T19:57:18.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.016+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb4006e3f0 msgr2=0x7feb4016c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.016+0000 7feb47c50700 1 --2- 172.21.15.61:0/2207728365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb4006e3f0 0x7feb4016c1d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00b840 tx=0x7feb3c0091d0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.016+0000 7feb461ed700 1 -- 172.21.15.61:0/2207728365 reap_dead start 2023-12-24T19:57:18.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.016+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 shutdown_connections 2023-12-24T19:57:18.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.016+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 >> 172.21.15.61:0/2207728365 conn(0x7feb40067fe0 msgr2=0x7feb400b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.017+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 shutdown_connections 2023-12-24T19:57:18.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.017+0000 7feb47c50700 1 -- 172.21.15.61:0/2207728365 wait complete. 2023-12-24T19:57:18.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.018+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 shutdown_connections 2023-12-24T19:57:18.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.018+0000 7f9dbeedd700 1 -- 172.21.15.61:0/978875316 wait complete. 2023-12-24T19:57:18.029 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.030 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-24T19:57:18.031 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.031 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-24T19:57:18.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.031+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 --> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff58004c3c0 con 0x7ff56406f210 2023-12-24T19:57:18.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.031+0000 7ff5757fa700 1 -- 172.21.15.61:0/1056106034 <== osd.6 v2:172.21.15.133:6816/40576 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff58004c3c0 con 0x7ff56406f210 2023-12-24T19:57:18.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.032+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] conn(0x7ff56406f210 msgr2=0x7ff564071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.032+0000 7ff5878ba700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] conn(0x7ff56406f210 0x7ff564071620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.032+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff564067080 msgr2=0x7ff564069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.032+0000 7ff5878ba700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff564067080 0x7ff564069530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5800686f0 tx=0x7ff570009040 comp rx=0 tx=0).stop 2023-12-24T19:57:18.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.032+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5800b26d0 msgr2=0x7ff58016e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.032+0000 7ff5878ba700 1 --2- 172.21.15.61:0/1056106034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5800b26d0 0x7ff58016e4b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c6c0 tx=0x7ff57c017000 comp rx=0 tx=0).stop 2023-12-24T19:57:18.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.032+0000 7ff585e57700 1 -- 172.21.15.61:0/1056106034 reap_dead start 2023-12-24T19:57:18.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.032+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 shutdown_connections 2023-12-24T19:57:18.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.032+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 >> 172.21.15.61:0/1056106034 conn(0x7ff580068020 msgr2=0x7ff580159140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.033+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 shutdown_connections 2023-12-24T19:57:18.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.033+0000 7ff5878ba700 1 -- 172.21.15.61:0/1056106034 wait complete. 2023-12-24T19:57:18.036 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.036 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-24T19:57:18.039 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.039 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-24T19:57:18.052 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.052 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-24T19:57:18.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.226+0000 7fa95ac0b700 1 Processor -- start 2023-12-24T19:57:18.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.226+0000 7fa95ac0b700 1 -- start start 2023-12-24T19:57:18.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.228+0000 7fa95ac0b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa95413f3e0 0x7fa9541596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.228+0000 7fa95ac0b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95415a080 con 0x7fa95413f010 2023-12-24T19:57:18.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.228+0000 7fa95ac0b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9540b2570 con 0x7fa954159c20 2023-12-24T19:57:18.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.228+0000 7fa95ac0b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9540c9160 con 0x7fa95413f3e0 2023-12-24T19:57:18.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.228+0000 7fa953fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa95413f3e0 0x7fa9541596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.228+0000 7fa953fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa95413f3e0 0x7fa9541596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56120/0 (socket says 172.21.15.61:56120) 2023-12-24T19:57:18.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.228+0000 7fa953fff700 1 -- 172.21.15.61:0/3861428719 learned_addr learned my addr 172.21.15.61:0/3861428719 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.229+0000 7fa953fff700 1 -- 172.21.15.61:0/3861428719 >> v1:172.21.15.133:6789/0 conn(0x7fa954159c20 legacy=0x7fa9540c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.229+0000 7fa953fff700 1 -- 172.21.15.61:0/3861428719 >> v1:172.21.15.61:6789/0 conn(0x7fa95413f010 legacy=0x7fa9540b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.229+0000 7fa953fff700 1 -- 172.21.15.61:0/3861428719 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540b1cd0 con 0x7fa95413f3e0 2023-12-24T19:57:18.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.230+0000 7fa953fff700 1 --2- 172.21.15.61:0/3861428719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95413f3e0 0x7fa9541596e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa94400d050 tx=0x7fa9440082d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14ba24393e583c09 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.230+0000 7fa9537fe700 1 -- 172.21.15.61:0/3861428719 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944010070 con 0x7fa95413f3e0 2023-12-24T19:57:18.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.230+0000 7fa9537fe700 1 -- 172.21.15.61:0/3861428719 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94400dae0 con 0x7fa95413f3e0 2023-12-24T19:57:18.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.230+0000 7fa9537fe700 1 -- 172.21.15.61:0/3861428719 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94400de80 con 0x7fa95413f3e0 2023-12-24T19:57:18.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.232+0000 7fa95ac0b700 1 -- 172.21.15.61:0/3861428719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95413f3e0 msgr2=0x7fa9541596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.232+0000 7fa95ac0b700 1 --2- 172.21.15.61:0/3861428719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95413f3e0 0x7fa9541596e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa94400d050 tx=0x7fa9440082d0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.234+0000 7fa95ac0b700 1 -- 172.21.15.61:0/3861428719 shutdown_connections 2023-12-24T19:57:18.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.234+0000 7fa95ac0b700 1 --2- 172.21.15.61:0/3861428719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95413f3e0 0x7fa9541596e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.234+0000 7fa95ac0b700 1 -- 172.21.15.61:0/3861428719 >> 172.21.15.61:0/3861428719 conn(0x7fa954067fe0 msgr2=0x7fa9540cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.234+0000 7fa95ac0b700 1 -- 172.21.15.61:0/3861428719 shutdown_connections 2023-12-24T19:57:18.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.234+0000 7fa95ac0b700 1 -- 172.21.15.61:0/3861428719 wait complete. 2023-12-24T19:57:18.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.235+0000 7fa95ac0b700 1 Processor -- start 2023-12-24T19:57:18.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.236+0000 7fa95ac0b700 1 -- start start 2023-12-24T19:57:18.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.236+0000 7f027b690700 1 Processor -- start 2023-12-24T19:57:18.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.237+0000 7f027b690700 1 -- start start 2023-12-24T19:57:18.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.237+0000 7efefbb76700 1 Processor -- start 2023-12-24T19:57:18.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.237+0000 7fa95ac0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa95413f010 0x7fa9540c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.237+0000 7fa95ac0b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa95413f3e0 0x7fa9540c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.237+0000 7fa95ac0b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa954159c20 0x7fa95416ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.237+0000 7fa95ac0b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9540c2c20 con 0x7fa95413f3e0 2023-12-24T19:57:18.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.237+0000 7fa95ac0b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9540c2f00 con 0x7fa954159c20 2023-12-24T19:57:18.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.237+0000 7fa95ac0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9540c82b0 con 0x7fa95413f010 2023-12-24T19:57:18.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.238+0000 7f027b690700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f02741613c0 0x7f02740ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.238+0000 7f027b690700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f027406e140 0x7f02740b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.238+0000 7f027b690700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027415f510 con 0x7f027415e470 2023-12-24T19:57:18.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.238+0000 7f027b690700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027415e900 con 0x7f02741613c0 2023-12-24T19:57:18.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.238+0000 7f027b690700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027415ebe0 con 0x7f027406e140 2023-12-24T19:57:18.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.238+0000 7f0278c2b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f027415e470 0x7f027406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41652/0 (socket says 172.21.15.61:41652) 2023-12-24T19:57:18.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.238+0000 7f0278c2b700 1 -- 172.21.15.61:0/1737072982 learned_addr learned my addr 172.21.15.61:0/1737072982 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:18.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.238+0000 7f0279c2d700 1 --2- 172.21.15.61:0/1737072982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f027406e140 0x7f02740b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7f0267fff700 1 -- 172.21.15.61:0/1737072982 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344360120 0 0) 0x7f027415f510 con 0x7f027415e470 2023-12-24T19:57:18.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7f0279c2d700 1 -- 172.21.15.61:0/1737072982 >> v2:172.21.15.61:3300/0 conn(0x7f02741613c0 msgr2=0x7f02740ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7f0279c2d700 1 --2- 172.21.15.61:0/1737072982 >> v2:172.21.15.61:3300/0 conn(0x7f02741613c0 0x7f02740ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7f0279c2d700 1 -- 172.21.15.61:0/1737072982 >> v1:172.21.15.61:6789/0 conn(0x7f027415e470 legacy=0x7f027406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7f0279c2d700 1 -- 172.21.15.61:0/1737072982 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027415eec0 con 0x7f027406e140 2023-12-24T19:57:18.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.238+0000 7efefbb76700 1 -- start start 2023-12-24T19:57:18.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7efefbb76700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7efef413f3e0 0x7efef41596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7efefbb76700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef415a080 con 0x7efef413f010 2023-12-24T19:57:18.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7efefbb76700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef40b2570 con 0x7efef4159c20 2023-12-24T19:57:18.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7efefbb76700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef40c9160 con 0x7efef413f3e0 2023-12-24T19:57:18.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7efef9111700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7efef413f3e0 0x7efef41596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7efef9912700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7efef413f010 0x7efef40b1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41668/0 (socket says 172.21.15.61:41668) 2023-12-24T19:57:18.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7efef9912700 1 -- 172.21.15.61:0/1487238920 learned_addr learned my addr 172.21.15.61:0/1487238920 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:18.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7fa953fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa95413f3e0 0x7fa9540c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7fa953fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa95413f3e0 0x7fa9540c7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53284/0 (socket says 172.21.15.61:53284) 2023-12-24T19:57:18.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7fa953fff700 1 -- 172.21.15.61:0/2236584633 learned_addr learned my addr 172.21.15.61:0/2236584633 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7fa9591a8700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa954159c20 0x7fa95416ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7fa9589a7700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa95413f010 0x7fa9540c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7fa9591a8700 1 -- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa95413f010 msgr2=0x7fa9540c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7fa9591a8700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa95413f010 0x7fa9540c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7fa9591a8700 1 -- 172.21.15.61:0/2236584633 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa95413f3e0 msgr2=0x7fa9540c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7fa9591a8700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa95413f3e0 0x7fa9540c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.239+0000 7fa9591a8700 1 -- 172.21.15.61:0/2236584633 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944008570 con 0x7fa954159c20 2023-12-24T19:57:18.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7f0279c2d700 1 --2- 172.21.15.61:0/1737072982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f027406e140 0x7f02740b11e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0268006fd0 tx=0x7f02680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11c2cde051a9b844 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7fa9591a8700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa954159c20 0x7fa95416ea50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa94800c410 tx=0x7fa948007e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716036681 0 0) 0x7efef40b2570 con 0x7efef4159c20 2023-12-24T19:57:18.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efee0003570 con 0x7efef4159c20 2023-12-24T19:57:18.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7f0267fff700 1 -- 172.21.15.61:0/1737072982 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0268005c60 con 0x7f027406e140 2023-12-24T19:57:18.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7f0267fff700 1 -- 172.21.15.61:0/1737072982 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0268005dc0 con 0x7f027406e140 2023-12-24T19:57:18.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7f0267fff700 1 -- 172.21.15.61:0/1737072982 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0268006280 con 0x7f027406e140 2023-12-24T19:57:18.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032168044 0 0) 0x7efef0004aa0 con 0x7efef413f010 2023-12-24T19:57:18.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef40b2570 con 0x7efef413f010 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 726861553 0 0) 0x7efee0003570 con 0x7efef4159c20 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 >> v2:172.21.15.61:3300/0 conn(0x7efef413f3e0 msgr2=0x7efef41596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 --2- 172.21.15.61:0/1487238920 >> v2:172.21.15.61:3300/0 conn(0x7efef413f3e0 0x7efef41596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 >> v1:172.21.15.61:6789/0 conn(0x7efef413f010 legacy=0x7efef40b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef40b1cd0 con 0x7efef4159c20 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7efeec001840 con 0x7efef4159c20 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 >> v1:172.21.15.133:6789/0 conn(0x7efef4159c20 legacy=0x7efef40c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 --2- 172.21.15.61:0/1487238920 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efee0003bf0 0x7efee0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 --2- 172.21.15.61:0/1487238920 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 0x7efee0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 --2- 172.21.15.61:0/1487238920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee0005230 0x7efee000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef40c9160 con 0x7efee0003bf0 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee000c200 con 0x7efee0005230 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee000c3c0 con 0x7efee0004810 2023-12-24T19:57:18.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7efef9111700 1 --2- 172.21.15.61:0/1487238920 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 0x7efee0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7fa950ff9700 1 -- 172.21.15.61:0/2236584633 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948012420 con 0x7fa954159c20 2023-12-24T19:57:18.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7fa950ff9700 1 -- 172.21.15.61:0/2236584633 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa948012580 con 0x7fa954159c20 2023-12-24T19:57:18.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7fa95ac0b700 1 -- 172.21.15.61:0/2236584633 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95416f2d0 con 0x7fa954159c20 2023-12-24T19:57:18.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7fa95ac0b700 1 -- 172.21.15.61:0/2236584633 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95416f890 con 0x7fa954159c20 2023-12-24T19:57:18.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.240+0000 7fa950ff9700 1 -- 172.21.15.61:0/2236584633 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948012920 con 0x7fa954159c20 2023-12-24T19:57:18.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7f027b690700 1 -- 172.21.15.61:0/1737072982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f027406e140 msgr2=0x7f02740b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7f027b690700 1 --2- 172.21.15.61:0/1737072982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f027406e140 0x7f02740b11e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0268006fd0 tx=0x7f02680091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7f027b690700 1 -- 172.21.15.61:0/1737072982 shutdown_connections 2023-12-24T19:57:18.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7f027b690700 1 --2- 172.21.15.61:0/1737072982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f027406e140 0x7f02740b11e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7f027b690700 1 --2- 172.21.15.61:0/1737072982 >> v2:172.21.15.61:3300/0 conn(0x7f02741613c0 0x7f02740ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7f027b690700 1 -- 172.21.15.61:0/1737072982 >> 172.21.15.61:0/1737072982 conn(0x7f0274067fe0 msgr2=0x7f02740cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7efefa113700 1 --2- 172.21.15.61:0/1487238920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee0005230 0x7efee000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7f027b690700 1 -- 172.21.15.61:0/1737072982 shutdown_connections 2023-12-24T19:57:18.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7efef9111700 1 -- 172.21.15.61:0/1487238920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee0005230 msgr2=0x7efee000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7efef9111700 1 --2- 172.21.15.61:0/1487238920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efee0005230 0x7efee000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7efef9111700 1 -- 172.21.15.61:0/1487238920 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efee0003bf0 msgr2=0x7efee0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7efef9111700 1 --2- 172.21.15.61:0/1487238920 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efee0003bf0 0x7efee0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.242+0000 7efef9111700 1 -- 172.21.15.61:0/1487238920 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef40b1cd0 con 0x7efee0004810 2023-12-24T19:57:18.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.242+0000 7fa95ac0b700 1 -- 172.21.15.61:0/2236584633 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9300052a0 con 0x7fa954159c20 2023-12-24T19:57:18.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.242+0000 7efefa113700 1 -- 172.21.15.61:0/1487238920 reap_dead start 2023-12-24T19:57:18.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.241+0000 7f027b690700 1 -- 172.21.15.61:0/1737072982 wait complete. 2023-12-24T19:57:18.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.242+0000 7f8ae3d29700 1 Processor -- start 2023-12-24T19:57:18.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.242+0000 7efef9111700 1 --2- 172.21.15.61:0/1487238920 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 0x7efee0004c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efee400bde0 tx=0x7efee400b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc63b1e8b8df1ae8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.242+0000 7fa950ff9700 1 -- 172.21.15.61:0/2236584633 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa94801b3b0 con 0x7fa954159c20 2023-12-24T19:57:18.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.242+0000 7fd3145df700 1 Processor -- start 2023-12-24T19:57:18.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.243+0000 7f8ae3d29700 1 -- start start 2023-12-24T19:57:18.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.243+0000 7fa950ff9700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa938067050 0x7fa938069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.243+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4010ad0 con 0x7efee0004810 2023-12-24T19:57:18.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.243+0000 7f027b690700 1 Processor -- start 2023-12-24T19:57:18.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.243+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee4010c30 con 0x7efee0004810 2023-12-24T19:57:18.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.243+0000 7efef8910700 1 -- 172.21.15.61:0/1487238920 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4019400 con 0x7efee0004810 2023-12-24T19:57:18.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.243+0000 7fa950ff9700 1 -- 172.21.15.61:0/2236584633 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9480835c0 con 0x7fa954159c20 2023-12-24T19:57:18.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.243+0000 7fd3145df700 1 -- start start 2023-12-24T19:57:18.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.244+0000 7fa9589a7700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa938067050 0x7fa938069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.244+0000 7f8ae3d29700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8adc153a10 0x7f8adc063ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.244+0000 7f8ae3d29700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 0x7f8adc0b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.244+0000 7f8ae3d29700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8adc157740 con 0x7f8adc159b70 2023-12-24T19:57:18.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.244+0000 7f8ae3d29700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8adc15a0c0 con 0x7f8adc153a10 2023-12-24T19:57:18.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.244+0000 7f8ae3d29700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc15a3a0 con 0x7f8adc0b1fc0 2023-12-24T19:57:18.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f8ae12c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8adc153a10 0x7f8adc063ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f8ae22c6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 0x7f8adc0b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f8ae22c6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 0x7f8adc0b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:57850/0 (socket says 172.21.15.61:57850) 2023-12-24T19:57:18.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f8ae12c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8adc153a10 0x7f8adc063ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56134/0 (socket says 172.21.15.61:56134) 2023-12-24T19:57:18.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f8ae22c6700 1 -- 172.21.15.61:0/1902876170 learned_addr learned my addr 172.21.15.61:0/1902876170 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.243+0000 7f027b690700 1 -- start start 2023-12-24T19:57:18.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f027b690700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f027406e140 0x7f0274152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f027b690700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f027415e470 0x7f0274151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f027b690700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02741613c0 0x7f0274155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f027b690700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274152860 con 0x7f027406e140 2023-12-24T19:57:18.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f027b690700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274157cb0 con 0x7f027415e470 2023-12-24T19:57:18.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f027b690700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0274157f90 con 0x7f02741613c0 2023-12-24T19:57:18.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7fa9589a7700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa938067050 0x7fa938069500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9540aef10 tx=0x7fa94c009780 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f0279c2d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02741613c0 0x7f0274155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f0278c2b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f027415e470 0x7f0274151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f0278c2b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f027415e470 0x7f0274151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56136/0 (socket says 172.21.15.61:56136) 2023-12-24T19:57:18.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f0278c2b700 1 -- 172.21.15.61:0/3568951700 learned_addr learned my addr 172.21.15.61:0/3568951700 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7fd3145df700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c15de40 0x7fd30c0ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7fd3145df700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30c0b1fd0 con 0x7fd30c06e140 2023-12-24T19:57:18.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7fd3145df700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30c0cd560 con 0x7fd30c15e210 2023-12-24T19:57:18.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f8ae12c4700 1 -- 172.21.15.61:0/1902876170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 msgr2=0x7f8adc0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f8ae12c4700 1 --2- 172.21.15.61:0/1902876170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 0x7f8adc0b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f8ae12c4700 1 -- 172.21.15.61:0/1902876170 >> v1:172.21.15.61:6789/0 conn(0x7f8adc159b70 legacy=0x7f8adc156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f8ae12c4700 1 -- 172.21.15.61:0/1902876170 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc15a680 con 0x7f8adc153a10 2023-12-24T19:57:18.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7fd3145df700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0aeeb0 con 0x7fd30c15de40 2023-12-24T19:57:18.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7efefbb76700 1 -- 172.21.15.61:0/1487238920 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 msgr2=0x7efee0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7efefbb76700 1 --2- 172.21.15.61:0/1487238920 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 0x7efee0004c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efee400bde0 tx=0x7efee400b460 comp rx=0 tx=0).stop 2023-12-24T19:57:18.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f027942c700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f027406e140 0x7f0274152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7f0278c2b700 1 -- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02741613c0 msgr2=0x7f0274155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7f0278c2b700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02741613c0 0x7f0274155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7f0278c2b700 1 -- 172.21.15.61:0/3568951700 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f027406e140 msgr2=0x7f0274152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7f0278c2b700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f027406e140 0x7f0274152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7f0278c2b700 1 -- 172.21.15.61:0/3568951700 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268009420 con 0x7f027415e470 2023-12-24T19:57:18.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.245+0000 7f8ae12c4700 1 --2- 172.21.15.61:0/1902876170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8adc153a10 0x7f8adc063ac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009e60 tx=0x7f8ad4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f026f35659cb62fa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7efefbb76700 1 -- 172.21.15.61:0/1487238920 shutdown_connections 2023-12-24T19:57:18.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7efefbb76700 1 --2- 172.21.15.61:0/1487238920 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 0x7efee0004c80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7efefbb76700 1 -- 172.21.15.61:0/1487238920 >> 172.21.15.61:0/1487238920 conn(0x7efef4067fe0 msgr2=0x7efef40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7fd31237b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c15de40 0x7fd30c0ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7fd31237b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c15de40 0x7fd30c0ae970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:57870/0 (socket says 172.21.15.61:57870) 2023-12-24T19:57:18.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7fd31237b700 1 -- 172.21.15.61:0/812335756 learned_addr learned my addr 172.21.15.61:0/812335756 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7efefbb76700 1 -- 172.21.15.61:0/1487238920 shutdown_connections 2023-12-24T19:57:18.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7efefbb76700 1 -- 172.21.15.61:0/1487238920 wait complete. 2023-12-24T19:57:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7fd31237b700 1 -- 172.21.15.61:0/812335756 >> v1:172.21.15.133:6789/0 conn(0x7fd30c15e210 legacy=0x7fd30c06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7fd31237b700 1 -- 172.21.15.61:0/812335756 >> v1:172.21.15.61:6789/0 conn(0x7fd30c06e140 legacy=0x7fd30c0abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7fd31237b700 1 -- 172.21.15.61:0/812335756 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c0cd280 con 0x7fd30c15de40 2023-12-24T19:57:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7fd31237b700 1 --2- 172.21.15.61:0/812335756 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c15de40 0x7fd30c0ae970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd304009f50 tx=0x7fd304009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f386725731635e14 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.246+0000 7fd311379700 1 -- 172.21.15.61:0/812335756 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30400e070 con 0x7fd30c15de40 2023-12-24T19:57:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.247+0000 7fd311379700 1 -- 172.21.15.61:0/812335756 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30400ba70 con 0x7fd30c15de40 2023-12-24T19:57:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.247+0000 7fd311379700 1 -- 172.21.15.61:0/812335756 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3040092e0 con 0x7fd30c15de40 2023-12-24T19:57:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.247+0000 7efefbb76700 1 Processor -- start 2023-12-24T19:57:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.247+0000 7efefbb76700 1 -- start start 2023-12-24T19:57:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.248+0000 7fd3145df700 1 -- 172.21.15.61:0/812335756 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c15de40 msgr2=0x7fd30c0ae970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.248+0000 7fd3145df700 1 --2- 172.21.15.61:0/812335756 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c15de40 0x7fd30c0ae970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd304009f50 tx=0x7fd304009840 comp rx=0 tx=0).stop 2023-12-24T19:57:18.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.248+0000 7f8ae0ac3700 1 -- 172.21.15.61:0/1902876170 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad400e070 con 0x7f8adc153a10 2023-12-24T19:57:18.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.248+0000 7f8ae0ac3700 1 -- 172.21.15.61:0/1902876170 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad400bbb0 con 0x7f8adc153a10 2023-12-24T19:57:18.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.248+0000 7f8ae0ac3700 1 -- 172.21.15.61:0/1902876170 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4012430 con 0x7f8adc153a10 2023-12-24T19:57:18.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.248+0000 7fd3145df700 1 -- 172.21.15.61:0/812335756 shutdown_connections 2023-12-24T19:57:18.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.248+0000 7fd3145df700 1 --2- 172.21.15.61:0/812335756 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c15de40 0x7fd30c0ae970 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.248+0000 7fd3145df700 1 -- 172.21.15.61:0/812335756 >> 172.21.15.61:0/812335756 conn(0x7fd30c068020 msgr2=0x7fd30c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efefbb76700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 0x7efef416ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efefbb76700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efef40ad680 0x7efef40adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efefbb76700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efef4171cb0 0x7efef4172130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7fa950ff9700 1 -- 172.21.15.61:0/2236584633 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa94804b5a0 con 0x7fa954159c20 2023-12-24T19:57:18.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7f8ae3d29700 1 -- 172.21.15.61:0/1902876170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8adc153a10 msgr2=0x7f8adc063ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7f8ae3d29700 1 --2- 172.21.15.61:0/1902876170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8adc153a10 0x7f8adc063ac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009e60 tx=0x7f8ad4009780 comp rx=0 tx=0).stop 2023-12-24T19:57:18.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efefbb76700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef4172670 con 0x7efef4171cb0 2023-12-24T19:57:18.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efefbb76700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef40ae150 con 0x7efef40ad680 2023-12-24T19:57:18.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efefbb76700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef40ae430 con 0x7efee0004810 2023-12-24T19:57:18.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7f8ae3d29700 1 -- 172.21.15.61:0/1902876170 shutdown_connections 2023-12-24T19:57:18.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7f8ae3d29700 1 --2- 172.21.15.61:0/1902876170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 0x7f8adc0b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7f8ae3d29700 1 --2- 172.21.15.61:0/1902876170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8adc153a10 0x7f8adc063ac0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7f8ae3d29700 1 -- 172.21.15.61:0/1902876170 >> 172.21.15.61:0/1902876170 conn(0x7f8adc068020 msgr2=0x7f8adc0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efef9912700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 0x7efef416ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efefa113700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efef4171cb0 0x7efef4172130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efefa113700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efef4171cb0 0x7efef4172130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53310/0 (socket says 172.21.15.61:53310) 2023-12-24T19:57:18.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efefa113700 1 -- 172.21.15.61:0/1705018946 learned_addr learned my addr 172.21.15.61:0/1705018946 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.249+0000 7efef9111700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efef40ad680 0x7efef40adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7f0278c2b700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f027415e470 0x7f0274151a60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f026c00cdb0 tx=0x7f026c001ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7fd3145df700 1 -- 172.21.15.61:0/812335756 shutdown_connections 2023-12-24T19:57:18.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7efefa113700 1 -- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 msgr2=0x7efef416ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7efefa113700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 0x7efef416ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7efefa113700 1 -- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efef40ad680 msgr2=0x7efef40adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7efefa113700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efef40ad680 0x7efef40adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7efefa113700 1 -- 172.21.15.61:0/1705018946 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef416f960 con 0x7efef4171cb0 2023-12-24T19:57:18.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7efefa113700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efef4171cb0 0x7efef4172130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efef4159ff0 tx=0x7efeec003250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7efee9ffb700 1 -- 172.21.15.61:0/1705018946 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec00fbf0 con 0x7efef4171cb0 2023-12-24T19:57:18.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7efee9ffb700 1 -- 172.21.15.61:0/1705018946 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec00fd70 con 0x7efef4171cb0 2023-12-24T19:57:18.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7efefbb76700 1 -- 172.21.15.61:0/1705018946 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef416fc40 con 0x7efef4171cb0 2023-12-24T19:57:18.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.251+0000 7efee9ffb700 1 -- 172.21.15.61:0/1705018946 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec00fee0 con 0x7efef4171cb0 2023-12-24T19:57:18.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.251+0000 7efefbb76700 1 -- 172.21.15.61:0/1705018946 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef416e6b0 con 0x7efef4171cb0 2023-12-24T19:57:18.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.250+0000 7fd3145df700 1 -- 172.21.15.61:0/812335756 wait complete. 2023-12-24T19:57:18.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.252+0000 7fd3145df700 1 Processor -- start 2023-12-24T19:57:18.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.253+0000 7f8ae3d29700 1 -- 172.21.15.61:0/1902876170 shutdown_connections 2023-12-24T19:57:18.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.253+0000 7f8ae3d29700 1 -- 172.21.15.61:0/1902876170 wait complete. 2023-12-24T19:57:18.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.254+0000 7f8ae3d29700 1 Processor -- start 2023-12-24T19:57:18.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.253+0000 7efee9ffb700 1 -- 172.21.15.61:0/1705018946 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7efeec014910 con 0x7efef4171cb0 2023-12-24T19:57:18.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.254+0000 7efee9ffb700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efed8066f30 0x7efed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.254+0000 7efee9ffb700 1 -- 172.21.15.61:0/1705018946 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efeec084e80 con 0x7efef4171cb0 2023-12-24T19:57:18.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.255+0000 7f8ae3d29700 1 -- start start 2023-12-24T19:57:18.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.255+0000 7f8ae3d29700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 0x7f8adc133490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.255+0000 7f8ae3d29700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8adc153a10 0x7f8adc0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.255+0000 7f8ae3d29700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8adc159b70 0x7f8adc0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.255+0000 7f8ae3d29700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc0ccee0 con 0x7f8adc153a10 2023-12-24T19:57:18.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.255+0000 7f8ae3d29700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc0ccc00 con 0x7f8adc159b70 2023-12-24T19:57:18.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.255+0000 7f8ae3d29700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc145220 con 0x7f8adc0b1fc0 2023-12-24T19:57:18.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.255+0000 7efef9912700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efed8066f30 0x7efed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.256+0000 7f02657fa700 1 -- 172.21.15.61:0/3568951700 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c00aad0 con 0x7f027415e470 2023-12-24T19:57:18.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.256+0000 7f02657fa700 1 -- 172.21.15.61:0/3568951700 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c00ac30 con 0x7f027415e470 2023-12-24T19:57:18.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.256+0000 7f8ae22c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8adc159b70 0x7f8adc0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.256+0000 7f8ae22c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8adc159b70 0x7f8adc0c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56158/0 (socket says 172.21.15.61:56158) 2023-12-24T19:57:18.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.256+0000 7f8ae22c6700 1 -- 172.21.15.61:0/3219032068 learned_addr learned my addr 172.21.15.61:0/3219032068 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.256+0000 7f027b690700 1 -- 172.21.15.61:0/3568951700 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0274158270 con 0x7f027415e470 2023-12-24T19:57:18.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.256+0000 7f027b690700 1 -- 172.21.15.61:0/3568951700 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0274158830 con 0x7f027415e470 2023-12-24T19:57:18.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.256+0000 7f02657fa700 1 -- 172.21.15.61:0/3568951700 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c0070f0 con 0x7f027415e470 2023-12-24T19:57:18.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.256+0000 7f8ae12c4700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8adc153a10 0x7f8adc0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.256+0000 7f8ae1ac5700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 0x7f8adc133490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7f8ae12c4700 1 -- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 msgr2=0x7f8adc133490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7f8ae12c4700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 0x7f8adc133490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7f8ae12c4700 1 -- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8adc159b70 msgr2=0x7f8adc0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7f8ae12c4700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8adc159b70 0x7f8adc0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7f8ae12c4700 1 -- 172.21.15.61:0/3219032068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad4009a20 con 0x7f8adc153a10 2023-12-24T19:57:18.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.253+0000 7fd3145df700 1 -- start start 2023-12-24T19:57:18.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.254+0000 7fd3145df700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c06e140 0x7fd30c15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.254+0000 7fd3145df700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd30c15de40 0x7fd30c069400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.254+0000 7fd3145df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd30c15e210 0x7fd30c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.254+0000 7fd3145df700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c15ab90 con 0x7fd30c15de40 2023-12-24T19:57:18.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.254+0000 7fd3145df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c15d420 con 0x7fd30c15e210 2023-12-24T19:57:18.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.254+0000 7fd3145df700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c15ad70 con 0x7fd30c06e140 2023-12-24T19:57:18.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7fd311b7a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd30c15de40 0x7fd30c069400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7fd311b7a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd30c15de40 0x7fd30c069400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53336/0 (socket says 172.21.15.61:53336) 2023-12-24T19:57:18.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7fd311b7a700 1 -- 172.21.15.61:0/1857357082 learned_addr learned my addr 172.21.15.61:0/1857357082 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7fd312b7c700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd30c15e210 0x7fd30c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7efef9912700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efed8066f30 0x7efed80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efef0005040 tx=0x7efef000a3f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7fd312b7c700 1 -- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c06e140 msgr2=0x7fd30c15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7fd312b7c700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c06e140 0x7fd30c15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7fd312b7c700 1 -- 172.21.15.61:0/1857357082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd30c15de40 msgr2=0x7fd30c069400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7fd312b7c700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd30c15de40 0x7fd30c069400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7fd312b7c700 1 -- 172.21.15.61:0/1857357082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd304009ae0 con 0x7fd30c15e210 2023-12-24T19:57:18.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.258+0000 7f8ae12c4700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8adc153a10 0x7f8adc0cc5d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4015000 tx=0x7f8ad4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.258+0000 7fd312b7c700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd30c15e210 0x7fd30c15b850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd30800c460 tx=0x7fd308007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.258+0000 7f8ad1ffb700 1 -- 172.21.15.61:0/3219032068 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4009420 con 0x7f8adc153a10 2023-12-24T19:57:18.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.258+0000 7f8ad1ffb700 1 -- 172.21.15.61:0/3219032068 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad400be70 con 0x7f8adc153a10 2023-12-24T19:57:18.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.258+0000 7f8ad1ffb700 1 -- 172.21.15.61:0/3219032068 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40276a0 con 0x7f8adc153a10 2023-12-24T19:57:18.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.257+0000 7f027b690700 1 -- 172.21.15.61:0/3568951700 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02540052a0 con 0x7f027415e470 2023-12-24T19:57:18.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.258+0000 7f8ae3d29700 1 -- 172.21.15.61:0/3219032068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8adc145500 con 0x7f8adc153a10 2023-12-24T19:57:18.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.258+0000 7f8ae3d29700 1 -- 172.21.15.61:0/3219032068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8adc0ca580 con 0x7f8adc153a10 2023-12-24T19:57:18.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.259+0000 7fd3027fc700 1 -- 172.21.15.61:0/1857357082 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308011590 con 0x7fd30c15e210 2023-12-24T19:57:18.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.259+0000 7fd3145df700 1 -- 172.21.15.61:0/1857357082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30c15b050 con 0x7fd30c15e210 2023-12-24T19:57:18.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.259+0000 7fd3145df700 1 -- 172.21.15.61:0/1857357082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30c15a700 con 0x7fd30c15e210 2023-12-24T19:57:18.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.258+0000 7f02657fa700 1 -- 172.21.15.61:0/3568951700 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f026c0074a0 con 0x7f027415e470 2023-12-24T19:57:18.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.259+0000 7f02657fa700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0258067080 0x7f0258069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.259+0000 7f02657fa700 1 -- 172.21.15.61:0/3568951700 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f026c084a30 con 0x7f027415e470 2023-12-24T19:57:18.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.259+0000 7f8ae3d29700 1 -- 172.21.15.61:0/3219032068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8adc145a20 con 0x7f8adc153a10 2023-12-24T19:57:18.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.260+0000 7efefbb76700 1 -- 172.21.15.61:0/1705018946 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef416f7c0 con 0x7efef4171cb0 2023-12-24T19:57:18.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.259+0000 7fd3027fc700 1 -- 172.21.15.61:0/1857357082 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3080116f0 con 0x7fd30c15e210 2023-12-24T19:57:18.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.259+0000 7fd3027fc700 1 -- 172.21.15.61:0/1857357082 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308011ab0 con 0x7fd30c15e210 2023-12-24T19:57:18.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.261+0000 7fd3145df700 1 -- 172.21.15.61:0/1857357082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f40052a0 con 0x7fd30c15e210 2023-12-24T19:57:18.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.261+0000 7f027942c700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0258067080 0x7f0258069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.261+0000 7f027942c700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0258067080 0x7f0258069530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f02700099d0 tx=0x7f0270008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.262+0000 7f8ad1ffb700 1 -- 172.21.15.61:0/3219032068 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8ad4024070 con 0x7f8adc153a10 2023-12-24T19:57:18.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.262+0000 7f8ad1ffb700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ac0066f30 0x7f8ac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.262+0000 7f8ad1ffb700 1 -- 172.21.15.61:0/3219032068 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ad4086f90 con 0x7f8adc153a10 2023-12-24T19:57:18.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.262+0000 7f8ae1ac5700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ac0066f30 0x7f8ac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.263+0000 7f8ae1ac5700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ac0066f30 0x7f8ac00693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8006fd0 tx=0x7f8ad8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.264+0000 7f02657fa700 1 -- 172.21.15.61:0/3568951700 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f026c051d00 con 0x7f027415e470 2023-12-24T19:57:18.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.265+0000 7fd3027fc700 1 -- 172.21.15.61:0/1857357082 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd308006820 con 0x7fd30c15e210 2023-12-24T19:57:18.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.265+0000 7fd3027fc700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2f0066f30 0x7fd2f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.266+0000 7fd3027fc700 1 -- 172.21.15.61:0/1857357082 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd308084c40 con 0x7fd30c15e210 2023-12-24T19:57:18.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.266+0000 7fd31237b700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2f0066f30 0x7fd2f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.266+0000 7fd31237b700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2f0066f30 0x7fd2f00693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd304009880 tx=0x7fd304017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.267+0000 7f8ad1ffb700 1 -- 172.21.15.61:0/3219032068 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ad40541e0 con 0x7f8adc153a10 2023-12-24T19:57:18.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.271+0000 7fd3027fc700 1 -- 172.21.15.61:0/1857357082 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd308051eb0 con 0x7fd30c15e210 2023-12-24T19:57:18.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.275+0000 7efee9ffb700 1 -- 172.21.15.61:0/1705018946 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efef416f7c0 con 0x7efef4171cb0 2023-12-24T19:57:18.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.291+0000 7ff84ad47700 1 Processor -- start 2023-12-24T19:57:18.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.299+0000 7ff84ad47700 1 -- start start 2023-12-24T19:57:18.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.300+0000 7ff84ad47700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff84413f3e0 0x7ff8441596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.300+0000 7ff84ad47700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff844159c20 0x7ff8440c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.300+0000 7ff84ad47700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440b2570 con 0x7ff84413f010 2023-12-24T19:57:18.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.300+0000 7ff84ad47700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84415a0a0 con 0x7ff844159c20 2023-12-24T19:57:18.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.300+0000 7ff84ad47700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440c9160 con 0x7ff84413f3e0 2023-12-24T19:57:18.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.301+0000 7ff848ae3700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff84413f010 0x7ff8440b1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41682/0 (socket says 172.21.15.61:41682) 2023-12-24T19:57:18.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.301+0000 7ff848ae3700 1 -- 172.21.15.61:0/1462231868 learned_addr learned my addr 172.21.15.61:0/1462231868 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:18.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.301+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668517530 0 0) 0x7ff8440b2570 con 0x7ff84413f010 2023-12-24T19:57:18.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.301+0000 7ff8492e4700 1 --2- 172.21.15.61:0/1462231868 >> v2:172.21.15.133:3300/0 conn(0x7ff844159c20 0x7ff8440c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.301+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff82c003570 con 0x7ff84413f010 2023-12-24T19:57:18.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1140005500 0 0) 0x7ff82c003570 con 0x7ff84413f010 2023-12-24T19:57:18.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff84413f3e0 msgr2=0x7ff8441596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 --2- 172.21.15.61:0/1462231868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff84413f3e0 0x7ff8441596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 >> v2:172.21.15.133:3300/0 conn(0x7ff844159c20 msgr2=0x7ff8440c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 --2- 172.21.15.61:0/1462231868 >> v2:172.21.15.133:3300/0 conn(0x7ff844159c20 0x7ff8440c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440b1cd0 con 0x7ff84413f010 2023-12-24T19:57:18.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7ff834001470 con 0x7ff84413f010 2023-12-24T19:57:18.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 >> v1:172.21.15.61:6789/0 conn(0x7ff84413f010 legacy=0x7ff8440b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 --2- 172.21.15.61:0/1462231868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff82c003ae0 0x7ff82c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 --2- 172.21.15.61:0/1462231868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff82c004810 0x7ff82c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 --2- 172.21.15.61:0/1462231868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c005310 0x7ff82c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84415a0a0 con 0x7ff82c005310 2023-12-24T19:57:18.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440c9160 con 0x7ff82c003ae0 2023-12-24T19:57:18.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c00c320 con 0x7ff82c004810 2023-12-24T19:57:18.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.302+0000 7ff848ae3700 1 --2- 172.21.15.61:0/1462231868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff82c003ae0 0x7ff82c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.303+0000 7ff8492e4700 1 --2- 172.21.15.61:0/1462231868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c005310 0x7ff82c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.303+0000 7ff848ae3700 1 -- 172.21.15.61:0/1462231868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff82c004810 msgr2=0x7ff82c004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-24T19:57:18.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.303+0000 7ff848ae3700 1 --2- 172.21.15.61:0/1462231868 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff82c004810 0x7ff82c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.303+0000 7ff848ae3700 1 -- 172.21.15.61:0/1462231868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c005310 msgr2=0x7ff82c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.303+0000 7ff848ae3700 1 --2- 172.21.15.61:0/1462231868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c005310 0x7ff82c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.303+0000 7ff848ae3700 1 -- 172.21.15.61:0/1462231868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440b1cd0 con 0x7ff82c003ae0 2023-12-24T19:57:18.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.304+0000 7ff848ae3700 1 --2- 172.21.15.61:0/1462231868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff82c003ae0 0x7ff82c003ef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff83400d520 tx=0x7ff834004950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6789844d4c9c93f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.304+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83400dd70 con 0x7ff82c003ae0 2023-12-24T19:57:18.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.304+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834010460 con 0x7ff82c003ae0 2023-12-24T19:57:18.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.304+0000 7ff8437fe700 1 -- 172.21.15.61:0/1462231868 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834010820 con 0x7ff82c003ae0 2023-12-24T19:57:18.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.305+0000 7ff84ad47700 1 -- 172.21.15.61:0/1462231868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff82c003ae0 msgr2=0x7ff82c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.305+0000 7ff84ad47700 1 --2- 172.21.15.61:0/1462231868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff82c003ae0 0x7ff82c003ef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff83400d520 tx=0x7ff834004950 comp rx=0 tx=0).stop 2023-12-24T19:57:18.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.305+0000 7ff8492e4700 1 -- 172.21.15.61:0/1462231868 reap_dead start 2023-12-24T19:57:18.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.305+0000 7ff84ad47700 1 -- 172.21.15.61:0/1462231868 shutdown_connections 2023-12-24T19:57:18.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.305+0000 7ff84ad47700 1 -- 172.21.15.61:0/1462231868 >> 172.21.15.61:0/1462231868 conn(0x7ff844067fe0 msgr2=0x7ff8440cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.306+0000 7ff84ad47700 1 -- 172.21.15.61:0/1462231868 shutdown_connections 2023-12-24T19:57:18.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.306+0000 7ff84ad47700 1 -- 172.21.15.61:0/1462231868 wait complete. 2023-12-24T19:57:18.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.308+0000 7ff84ad47700 1 Processor -- start 2023-12-24T19:57:18.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.308+0000 7ff84ad47700 1 -- start start 2023-12-24T19:57:18.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.309+0000 7ff84ad47700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c003ae0 0x7ff844156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.309+0000 7ff84ad47700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff844154980 0x7ff844154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.309+0000 7ff84ad47700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff844176930 0x7ff844176da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.309+0000 7ff84ad47700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84413e5e0 con 0x7ff82c003ae0 2023-12-24T19:57:18.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.309+0000 7ff84ad47700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff844155c10 con 0x7ff844154980 2023-12-24T19:57:18.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.309+0000 7ff84ad47700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff844155ef0 con 0x7ff844176930 2023-12-24T19:57:18.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.310+0000 7ff8492e4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff844176930 0x7ff844176da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.311+0000 7ff848ae3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c003ae0 0x7ff844156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.311+0000 7ff848ae3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c003ae0 0x7ff844156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53368/0 (socket says 172.21.15.61:53368) 2023-12-24T19:57:18.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.311+0000 7ff848ae3700 1 -- 172.21.15.61:0/403581061 learned_addr learned my addr 172.21.15.61:0/403581061 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.311+0000 7ff843fff700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff844154980 0x7ff844154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.311+0000 7ff848ae3700 1 -- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff844176930 msgr2=0x7ff844176da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.311+0000 7ff848ae3700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff844176930 0x7ff844176da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.311+0000 7ff848ae3700 1 -- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff844154980 msgr2=0x7ff844154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.311+0000 7ff848ae3700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff844154980 0x7ff844154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.311+0000 7ff848ae3700 1 -- 172.21.15.61:0/403581061 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8441561d0 con 0x7ff82c003ae0 2023-12-24T19:57:18.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.312+0000 7ff8492e4700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff844176930 0x7ff844176da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:18.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.312+0000 7ff848ae3700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c003ae0 0x7ff844156f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00c2f0 tx=0x7ff834016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.313+0000 7f7a95ab3700 1 Processor -- start 2023-12-24T19:57:18.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.312+0000 7ff840ff9700 1 -- 172.21.15.61:0/403581061 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834021070 con 0x7ff82c003ae0 2023-12-24T19:57:18.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.312+0000 7ff840ff9700 1 -- 172.21.15.61:0/403581061 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340016d0 con 0x7ff82c003ae0 2023-12-24T19:57:18.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.312+0000 7ff840ff9700 1 -- 172.21.15.61:0/403581061 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83401a660 con 0x7ff82c003ae0 2023-12-24T19:57:18.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.313+0000 7f7a95ab3700 1 -- start start 2023-12-24T19:57:18.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.314+0000 7f7a95ab3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a9013f3e0 0x7f7a901596e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.314+0000 7f7a95ab3700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a9015a080 con 0x7f7a90159c20 2023-12-24T19:57:18.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.314+0000 7f7a95ab3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a900b2570 con 0x7f7a9013f010 2023-12-24T19:57:18.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.314+0000 7f7a95ab3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a900c9160 con 0x7f7a9013f3e0 2023-12-24T19:57:18.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.313+0000 7ff84ad47700 1 -- 172.21.15.61:0/403581061 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8441564b0 con 0x7ff82c003ae0 2023-12-24T19:57:18.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.314+0000 7ff84ad47700 1 -- 172.21.15.61:0/403581061 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff844156a70 con 0x7ff82c003ae0 2023-12-24T19:57:18.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.315+0000 7f7a8ffff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7a90159c20 0x7f7a900c95f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41688/0 (socket says 172.21.15.61:41688) 2023-12-24T19:57:18.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.315+0000 7f7a8ffff700 1 -- 172.21.15.61:0/649235011 learned_addr learned my addr 172.21.15.61:0/649235011 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:18.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.315+0000 7f7a8effd700 1 --2- 172.21.15.61:0/649235011 >> v2:172.21.15.133:3300/0 conn(0x7f7a9013f3e0 0x7f7a901596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.316+0000 7f7a8e7fc700 1 -- 172.21.15.61:0/649235011 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408843996 0 0) 0x7f7a800049a0 con 0x7f7a90159c20 2023-12-24T19:57:18.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.316+0000 7f7a8e7fc700 1 -- 172.21.15.61:0/649235011 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a78003570 con 0x7f7a90159c20 2023-12-24T19:57:18.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.315+0000 7ff84ad47700 1 -- 172.21.15.61:0/403581061 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff844156c60 con 0x7ff82c003ae0 2023-12-24T19:57:18.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.317+0000 7f7a8e7fc700 1 -- 172.21.15.61:0/649235011 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305602632 0 0) 0x7f7a900b2570 con 0x7f7a9013f010 2023-12-24T19:57:18.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.317+0000 7f7a8e7fc700 1 -- 172.21.15.61:0/649235011 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a800049a0 con 0x7f7a9013f010 2023-12-24T19:57:18.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.318+0000 7f7a8effd700 1 -- 172.21.15.61:0/649235011 >> v1:172.21.15.133:6789/0 conn(0x7f7a9013f010 legacy=0x7f7a900b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.318+0000 7f7a8effd700 1 -- 172.21.15.61:0/649235011 >> v1:172.21.15.61:6789/0 conn(0x7f7a90159c20 legacy=0x7f7a900c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.318+0000 7f7a8effd700 1 -- 172.21.15.61:0/649235011 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a900b1cd0 con 0x7f7a9013f3e0 2023-12-24T19:57:18.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.318+0000 7ff840ff9700 1 -- 172.21.15.61:0/403581061 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff83401a9d0 con 0x7ff82c003ae0 2023-12-24T19:57:18.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.318+0000 7ff840ff9700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff8300670b0 0x7ff830069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.318+0000 7ff840ff9700 1 -- 172.21.15.61:0/403581061 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff834086720 con 0x7ff82c003ae0 2023-12-24T19:57:18.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.319+0000 7ff843fff700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff8300670b0 0x7ff830069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.320+0000 7ff843fff700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff8300670b0 0x7ff830069560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8440caac0 tx=0x7ff8380090f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.320+0000 7f7a8effd700 1 --2- 172.21.15.61:0/649235011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f3e0 0x7f7a901596e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800aea0 tx=0x7f7a8800c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f6f8bcc4ac9c92a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.320+0000 7f7a8e7fc700 1 -- 172.21.15.61:0/649235011 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84001470 con 0x7f7a9013f3e0 2023-12-24T19:57:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.320+0000 7f7a8e7fc700 1 -- 172.21.15.61:0/649235011 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8800a0d0 con 0x7f7a9013f3e0 2023-12-24T19:57:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.320+0000 7f7a8e7fc700 1 -- 172.21.15.61:0/649235011 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800b810 con 0x7f7a9013f3e0 2023-12-24T19:57:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.321+0000 7f7a95ab3700 1 -- 172.21.15.61:0/649235011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f3e0 msgr2=0x7f7a901596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.321+0000 7f7a95ab3700 1 --2- 172.21.15.61:0/649235011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f3e0 0x7f7a901596e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800aea0 tx=0x7f7a8800c040 comp rx=0 tx=0).stop 2023-12-24T19:57:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.321+0000 7f7a95ab3700 1 -- 172.21.15.61:0/649235011 shutdown_connections 2023-12-24T19:57:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.321+0000 7f7a95ab3700 1 --2- 172.21.15.61:0/649235011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f3e0 0x7f7a901596e0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800aea0 tx=0x7f7a8800c040 comp rx=0 tx=0).stop 2023-12-24T19:57:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.321+0000 7f7a95ab3700 1 -- 172.21.15.61:0/649235011 >> 172.21.15.61:0/649235011 conn(0x7f7a90067fe0 msgr2=0x7f7a900cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.321+0000 7f7a95ab3700 1 -- 172.21.15.61:0/649235011 shutdown_connections 2023-12-24T19:57:18.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.322+0000 7f7a95ab3700 1 -- 172.21.15.61:0/649235011 wait complete. 2023-12-24T19:57:18.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.324+0000 7f7a95ab3700 1 Processor -- start 2023-12-24T19:57:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.324+0000 7f7a95ab3700 1 -- start start 2023-12-24T19:57:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.325+0000 7f7a95ab3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f010 0x7f7a900a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.325+0000 7f7a95ab3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a90159c20 0x7f7a90158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.325+0000 7f7a95ab3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a900a7300 0x7f7a901593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.325+0000 7f7a95ab3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90157de0 con 0x7f7a900a7300 2023-12-24T19:57:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.325+0000 7f7a95ab3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a901580c0 con 0x7f7a9013f010 2023-12-24T19:57:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.325+0000 7f7a95ab3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a901583a0 con 0x7f7a90159c20 2023-12-24T19:57:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.325+0000 7f7a8f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f010 0x7f7a900a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.325+0000 7f7a8f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f010 0x7f7a900a6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56212/0 (socket says 172.21.15.61:56212) 2023-12-24T19:57:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.325+0000 7f7a8f7fe700 1 -- 172.21.15.61:0/2481933390 learned_addr learned my addr 172.21.15.61:0/2481933390 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.326+0000 7f7a8f7fe700 1 -- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a90159c20 msgr2=0x7f7a90158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.326+0000 7f7a8f7fe700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a90159c20 0x7f7a90158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.326+0000 7f7a8f7fe700 1 -- 172.21.15.61:0/2481933390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a900a7300 msgr2=0x7f7a901593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.326+0000 7f7a8f7fe700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a900a7300 0x7f7a901593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.326+0000 7f7a8f7fe700 1 -- 172.21.15.61:0/2481933390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8800aa30 con 0x7f7a9013f010 2023-12-24T19:57:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.326+0000 7f7a8f7fe700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f010 0x7f7a900a6dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a840011e0 tx=0x7f7a84007650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.326+0000 7f7a777fe700 1 -- 172.21.15.61:0/2481933390 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8400adf0 con 0x7f7a9013f010 2023-12-24T19:57:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.327+0000 7f7a777fe700 1 -- 172.21.15.61:0/2481933390 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a84001940 con 0x7f7a9013f010 2023-12-24T19:57:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.327+0000 7f7a777fe700 1 -- 172.21.15.61:0/2481933390 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84001d00 con 0x7f7a9013f010 2023-12-24T19:57:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.327+0000 7f7a95ab3700 1 -- 172.21.15.61:0/2481933390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a90158680 con 0x7f7a9013f010 2023-12-24T19:57:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.327+0000 7f7a95ab3700 1 -- 172.21.15.61:0/2481933390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a90154fd0 con 0x7f7a9013f010 2023-12-24T19:57:18.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.327+0000 7ff840ff9700 1 -- 172.21.15.61:0/403581061 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff834053970 con 0x7ff82c003ae0 2023-12-24T19:57:18.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.328+0000 7f7a95ab3700 1 -- 172.21.15.61:0/2481933390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9004c3c0 con 0x7f7a9013f010 2023-12-24T19:57:18.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.334+0000 7f7a777fe700 1 -- 172.21.15.61:0/2481933390 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7a84003300 con 0x7f7a9013f010 2023-12-24T19:57:18.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.334+0000 7f7a777fe700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a780675a0 0x7f7a78069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.335+0000 7f7a777fe700 1 -- 172.21.15.61:0/2481933390 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a84084ea0 con 0x7f7a9013f010 2023-12-24T19:57:18.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.335+0000 7f7a8effd700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a780675a0 0x7f7a78069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.335+0000 7f7a8effd700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a780675a0 0x7f7a78069a50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7a9013f880 tx=0x7f7a88014000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.339+0000 7f7a777fe700 1 -- 172.21.15.61:0/2481933390 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a84055b80 con 0x7f7a9013f010 2023-12-24T19:57:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.340+0000 7fc7c401b700 1 Processor -- start 2023-12-24T19:57:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.340+0000 7fc7c401b700 1 -- start start 2023-12-24T19:57:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.341+0000 7fc7c401b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc7bc15e470 0x7fc7bc06da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.341+0000 7fc7c401b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7bc06df70 0x7fc7bc0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.341+0000 7fc7c401b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7bc15f510 con 0x7fc7bc1613c0 2023-12-24T19:57:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.341+0000 7fc7c401b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7bc06e3d0 con 0x7fc7bc15e470 2023-12-24T19:57:18.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.341+0000 7fc7c401b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7bc0af010 con 0x7fc7bc06df70 2023-12-24T19:57:18.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.342+0000 7fc7c25b8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7bc06df70 0x7fc7bc0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.342+0000 7fc7c25b8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7bc06df70 0x7fc7bc0b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56214/0 (socket says 172.21.15.61:56214) 2023-12-24T19:57:18.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.342+0000 7fc7c25b8700 1 -- 172.21.15.61:0/459938846 learned_addr learned my addr 172.21.15.61:0/459938846 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.342+0000 7fc7c25b8700 1 -- 172.21.15.61:0/459938846 >> v2:172.21.15.61:3300/0 conn(0x7fc7bc15e470 msgr2=0x7fc7bc06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.342+0000 7fc7c25b8700 1 --2- 172.21.15.61:0/459938846 >> v2:172.21.15.61:3300/0 conn(0x7fc7bc15e470 0x7fc7bc06da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.342+0000 7fc7c25b8700 1 -- 172.21.15.61:0/459938846 >> v1:172.21.15.133:6789/0 conn(0x7fc7bc1613c0 legacy=0x7fc7bc0ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:18.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.342+0000 7fc7c25b8700 1 -- 172.21.15.61:0/459938846 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc15e900 con 0x7fc7bc06df70 2023-12-24T19:57:18.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.343+0000 7fc7c25b8700 1 --2- 172.21.15.61:0/459938846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7bc06df70 0x7fc7bc0b11e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0b0660 tx=0x7fc7b4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46dc10cc18368e40 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.348+0000 7fc7c0db5700 1 -- 172.21.15.61:0/459938846 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b400e070 con 0x7fc7bc06df70 2023-12-24T19:57:18.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.348+0000 7fc7c0db5700 1 -- 172.21.15.61:0/459938846 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b400ba10 con 0x7fc7bc06df70 2023-12-24T19:57:18.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.348+0000 7fc7c0db5700 1 -- 172.21.15.61:0/459938846 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40092e0 con 0x7fc7bc06df70 2023-12-24T19:57:18.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.349+0000 7fc7c401b700 1 -- 172.21.15.61:0/459938846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7bc06df70 msgr2=0x7fc7bc0b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.349+0000 7fc7c401b700 1 --2- 172.21.15.61:0/459938846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7bc06df70 0x7fc7bc0b11e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc0b0660 tx=0x7fc7b4009840 comp rx=0 tx=0).stop 2023-12-24T19:57:18.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.350+0000 7fc7c401b700 1 -- 172.21.15.61:0/459938846 shutdown_connections 2023-12-24T19:57:18.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.350+0000 7fc7c401b700 1 --2- 172.21.15.61:0/459938846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7bc06df70 0x7fc7bc0b11e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.350+0000 7fc7c401b700 1 --2- 172.21.15.61:0/459938846 >> v2:172.21.15.61:3300/0 conn(0x7fc7bc15e470 0x7fc7bc06da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.350+0000 7fc7c401b700 1 -- 172.21.15.61:0/459938846 >> 172.21.15.61:0/459938846 conn(0x7fc7bc067fe0 msgr2=0x7fc7bc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.350+0000 7fc7c401b700 1 -- 172.21.15.61:0/459938846 shutdown_connections 2023-12-24T19:57:18.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.350+0000 7fc7c401b700 1 -- 172.21.15.61:0/459938846 wait complete. 2023-12-24T19:57:18.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.352+0000 7fc7c401b700 1 Processor -- start 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.353+0000 7fc7c401b700 1 -- start start 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.354+0000 7fc7c401b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7bc06df70 0x7fc7bc165eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.354+0000 7fc7c401b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7bc15e470 0x7fc7bc14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.354+0000 7fc7c401b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc7bc1613c0 0x7fc7bc13dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.354+0000 7fc7c401b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc13bad0 con 0x7fc7bc15e470 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.354+0000 7fc7c401b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc13e760 con 0x7fc7bc06df70 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.354+0000 7fc7c401b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc13ea40 con 0x7fc7bc1613c0 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.354+0000 7fc7c25b8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc7bc1613c0 0x7fc7bc13dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.354+0000 7fc7c15b6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7bc15e470 0x7fc7bc14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.354+0000 7fc7c15b6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7bc15e470 0x7fc7bc14eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53390/0 (socket says 172.21.15.61:53390) 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.354+0000 7fc7c15b6700 1 -- 172.21.15.61:0/785524938 learned_addr learned my addr 172.21.15.61:0/785524938 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.355+0000 7fc7c15b6700 1 -- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc7bc1613c0 msgr2=0x7fc7bc13dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.355+0000 7fc7c15b6700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc7bc1613c0 0x7fc7bc13dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.355+0000 7fc7c15b6700 1 -- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7bc06df70 msgr2=0x7fc7bc165eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-24T19:57:18.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.355+0000 7fc7c15b6700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7bc06df70 0x7fc7bc165eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.355+0000 7fc7c15b6700 1 -- 172.21.15.61:0/785524938 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4009ae0 con 0x7fc7bc15e470 2023-12-24T19:57:18.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.355+0000 7fc7c15b6700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7bc15e470 0x7fc7bc14eb60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009ea0 tx=0x7fc7b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.357+0000 7fc7b1ffb700 1 -- 172.21.15.61:0/785524938 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8031580 con 0x7fc7bc15e470 2023-12-24T19:57:18.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.357+0000 7fc7b1ffb700 1 -- 172.21.15.61:0/785524938 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b80316e0 con 0x7fc7bc15e470 2023-12-24T19:57:18.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.357+0000 7fc7b1ffb700 1 -- 172.21.15.61:0/785524938 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8031a80 con 0x7fc7bc15e470 2023-12-24T19:57:18.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.357+0000 7fc7c401b700 1 -- 172.21.15.61:0/785524938 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc13b760 con 0x7fc7bc15e470 2023-12-24T19:57:18.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.358+0000 7fc7c401b700 1 -- 172.21.15.61:0/785524938 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc14f0a0 con 0x7fc7bc15e470 2023-12-24T19:57:18.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.363+0000 7fc7b1ffb700 1 -- 172.21.15.61:0/785524938 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc7b803c460 con 0x7fc7bc15e470 2023-12-24T19:57:18.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.364+0000 7fc7b1ffb700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc7a0067050 0x7fc7a0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:18.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.364+0000 7fc7b1ffb700 1 -- 172.21.15.61:0/785524938 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7b80a6230 con 0x7fc7bc15e470 2023-12-24T19:57:18.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.364+0000 7fc7c1db7700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc7a0067050 0x7fc7a0069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:18.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.365+0000 7fc7c1db7700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc7a0067050 0x7fc7a0069500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0096c0 tx=0x7fc7ac006be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:18.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.367+0000 7fc7c401b700 1 -- 172.21.15.61:0/785524938 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c0052a0 con 0x7fc7bc15e470 2023-12-24T19:57:18.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.376+0000 7fc7b1ffb700 1 -- 172.21.15.61:0/785524938 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7b8076f90 con 0x7fc7bc15e470 2023-12-24T19:57:18.654 INFO:teuthology.orchestra.run.smithi061.stdout:55834574853 2023-12-24T19:57:18.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.642+0000 7fa95ac0b700 1 -- 172.21.15.61:0/2236584633 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa930005550 con 0x7fa954159c20 2023-12-24T19:57:18.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.650+0000 7fa950ff9700 1 -- 172.21.15.61:0/2236584633 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa948081e60 con 0x7fa954159c20 2023-12-24T19:57:18.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.655+0000 7f027b690700 1 -- 172.21.15.61:0/3568951700 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0254005550 con 0x7f027415e470 2023-12-24T19:57:18.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.655+0000 7fa95ac0b700 1 -- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa938067050 msgr2=0x7fa938069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.655+0000 7fa95ac0b700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa938067050 0x7fa938069500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9540aef10 tx=0x7fa94c009780 comp rx=0 tx=0).stop 2023-12-24T19:57:18.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.655+0000 7fa95ac0b700 1 -- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa954159c20 msgr2=0x7fa95416ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.655+0000 7fa95ac0b700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa954159c20 0x7fa95416ea50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa94800c410 tx=0x7fa948007e30 comp rx=0 tx=0).stop 2023-12-24T19:57:18.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.655+0000 7f02657fa700 1 -- 172.21.15.61:0/3568951700 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f026c055320 con 0x7f027415e470 2023-12-24T19:57:18.656 INFO:teuthology.orchestra.run.smithi061.stdout:55834574853 2023-12-24T19:57:18.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.659+0000 7fa95ac0b700 1 -- 172.21.15.61:0/2236584633 shutdown_connections 2023-12-24T19:57:18.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.659+0000 7fa95ac0b700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa95413f010 0x7fa9540c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.659+0000 7fa95ac0b700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa938067050 0x7fa938069500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.659+0000 7fa95ac0b700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa954159c20 0x7fa95416ea50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.659+0000 7fa95ac0b700 1 --2- 172.21.15.61:0/2236584633 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa95413f3e0 0x7fa9540c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.659+0000 7fa95ac0b700 1 -- 172.21.15.61:0/2236584633 >> 172.21.15.61:0/2236584633 conn(0x7fa954067fe0 msgr2=0x7fa9540af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.659+0000 7fa95ac0b700 1 -- 172.21.15.61:0/2236584633 shutdown_connections 2023-12-24T19:57:18.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.659+0000 7fa95ac0b700 1 -- 172.21.15.61:0/2236584633 wait complete. 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 -- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0258067080 msgr2=0x7f0258069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0258067080 0x7f0258069530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f02700099d0 tx=0x7f0270008040 comp rx=0 tx=0).stop 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 -- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f027415e470 msgr2=0x7f0274151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f027415e470 0x7f0274151a60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f026c00cdb0 tx=0x7f026c001ae0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 -- 172.21.15.61:0/3568951700 shutdown_connections 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f02741613c0 0x7f0274155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0258067080 0x7f0258069530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f027406e140 0x7f0274152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 --2- 172.21.15.61:0/3568951700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f027415e470 0x7f0274151a60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 -- 172.21.15.61:0/3568951700 >> 172.21.15.61:0/3568951700 conn(0x7f0274067fe0 msgr2=0x7f027406ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 -- 172.21.15.61:0/3568951700 shutdown_connections 2023-12-24T19:57:18.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.660+0000 7f027b690700 1 -- 172.21.15.61:0/3568951700 wait complete. 2023-12-24T19:57:18.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.669+0000 7efefbb76700 1 -- 172.21.15.61:0/1705018946 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efef416fe80 con 0x7efef4171cb0 2023-12-24T19:57:18.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.669+0000 7efee9ffb700 1 -- 172.21.15.61:0/1705018946 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efef416fe80 con 0x7efef4171cb0 2023-12-24T19:57:18.670 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.673+0000 7efefbb76700 1 -- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efed8066f30 msgr2=0x7efed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.673+0000 7efefbb76700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efed8066f30 0x7efed80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efef0005040 tx=0x7efef000a3f0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.673+0000 7efefbb76700 1 -- 172.21.15.61:0/1705018946 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efef4171cb0 msgr2=0x7efef4172130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.673+0000 7efefbb76700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efef4171cb0 0x7efef4172130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efef4159ff0 tx=0x7efeec003250 comp rx=0 tx=0).stop 2023-12-24T19:57:18.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.674+0000 7efefbb76700 1 -- 172.21.15.61:0/1705018946 shutdown_connections 2023-12-24T19:57:18.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.674+0000 7efefbb76700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efee0004810 0x7efef416ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.674+0000 7efefbb76700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efed8066f30 0x7efed80693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.674+0000 7efefbb76700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efef4171cb0 0x7efef4172130 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.674+0000 7efefbb76700 1 --2- 172.21.15.61:0/1705018946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efef40ad680 0x7efef40adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.674+0000 7efefbb76700 1 -- 172.21.15.61:0/1705018946 >> 172.21.15.61:0/1705018946 conn(0x7efef4067fe0 msgr2=0x7efef413bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.673+0000 7fd3145df700 1 -- 172.21.15.61:0/1857357082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd2f4005820 con 0x7fd30c15e210 2023-12-24T19:57:18.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-24T19:57:18.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.674+0000 7fd3027fc700 1 -- 172.21.15.61:0/1857357082 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3080554d0 con 0x7fd30c15e210 2023-12-24T19:57:18.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.674+0000 7efefbb76700 1 -- 172.21.15.61:0/1705018946 shutdown_connections 2023-12-24T19:57:18.677 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.674+0000 7efefbb76700 1 -- 172.21.15.61:0/1705018946 wait complete. 2023-12-24T19:57:18.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.679+0000 7fd3145df700 1 -- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2f0066f30 msgr2=0x7fd2f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.679+0000 7fd3145df700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2f0066f30 0x7fd2f00693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd304009880 tx=0x7fd304017000 comp rx=0 tx=0).stop 2023-12-24T19:57:18.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.679+0000 7fd3145df700 1 -- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd30c15e210 msgr2=0x7fd30c15b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.679+0000 7fd3145df700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd30c15e210 0x7fd30c15b850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd30800c460 tx=0x7fd308007ea0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.679+0000 7fd3145df700 1 -- 172.21.15.61:0/1857357082 shutdown_connections 2023-12-24T19:57:18.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.679+0000 7fd3145df700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd30c06e140 0x7fd30c15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.679+0000 7fd3145df700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2f0066f30 0x7fd2f00693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.679+0000 7fd3145df700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd30c15e210 0x7fd30c15b850 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.679+0000 7fd3145df700 1 --2- 172.21.15.61:0/1857357082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd30c15de40 0x7fd30c069400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.679+0000 7fd3145df700 1 -- 172.21.15.61:0/1857357082 >> 172.21.15.61:0/1857357082 conn(0x7fd30c068020 msgr2=0x7fd30c157100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.680+0000 7fd3145df700 1 -- 172.21.15.61:0/1857357082 shutdown_connections 2023-12-24T19:57:18.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.680+0000 7fd3145df700 1 -- 172.21.15.61:0/1857357082 wait complete. 2023-12-24T19:57:18.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.684+0000 7f8ae3d29700 1 -- 172.21.15.61:0/3219032068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8adc145a20 con 0x7f8adc153a10 2023-12-24T19:57:18.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.685+0000 7f8ad1ffb700 1 -- 172.21.15.61:0/3219032068 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8adc145a20 con 0x7f8adc153a10 2023-12-24T19:57:18.686 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-24T19:57:18.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.690+0000 7f8ae3d29700 1 -- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ac0066f30 msgr2=0x7f8ac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.690+0000 7f8ae3d29700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ac0066f30 0x7f8ac00693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8006fd0 tx=0x7f8ad8008040 comp rx=0 tx=0).stop 2023-12-24T19:57:18.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.690+0000 7f8ae3d29700 1 -- 172.21.15.61:0/3219032068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8adc153a10 msgr2=0x7f8adc0cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.690+0000 7f8ae3d29700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8adc153a10 0x7f8adc0cc5d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4015000 tx=0x7f8ad4018000 comp rx=0 tx=0).stop 2023-12-24T19:57:18.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.690+0000 7f8ae3d29700 1 -- 172.21.15.61:0/3219032068 shutdown_connections 2023-12-24T19:57:18.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.690+0000 7f8ae3d29700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8adc0b1fc0 0x7f8adc133490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.690+0000 7f8ae3d29700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ac0066f30 0x7f8ac00693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.690+0000 7f8ae3d29700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8adc159b70 0x7f8adc0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.690+0000 7f8ae3d29700 1 --2- 172.21.15.61:0/3219032068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8adc153a10 0x7f8adc0cc5d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.690+0000 7f8ae3d29700 1 -- 172.21.15.61:0/3219032068 >> 172.21.15.61:0/3219032068 conn(0x7f8adc068020 msgr2=0x7f8adc158890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.691+0000 7f8ae3d29700 1 -- 172.21.15.61:0/3219032068 shutdown_connections 2023-12-24T19:57:18.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.691+0000 7f8ae3d29700 1 -- 172.21.15.61:0/3219032068 wait complete. 2023-12-24T19:57:18.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-12-24T19:57:18.695 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:18.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-12-24T19:57:18.707 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:18.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-12-24T19:57:18.707 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:18.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.736+0000 7ff84ad47700 1 -- 172.21.15.61:0/403581061 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff84404c3c0 con 0x7ff82c003ae0 2023-12-24T19:57:18.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.736+0000 7ff840ff9700 1 -- 172.21.15.61:0/403581061 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff834056f90 con 0x7ff82c003ae0 2023-12-24T19:57:18.737 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 -- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff8300670b0 msgr2=0x7ff830069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff8300670b0 0x7ff830069560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff8440caac0 tx=0x7ff8380090f0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 -- 172.21.15.61:0/403581061 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c003ae0 msgr2=0x7ff844156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c003ae0 0x7ff844156f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00c2f0 tx=0x7ff834016000 comp rx=0 tx=0).stop 2023-12-24T19:57:18.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 -- 172.21.15.61:0/403581061 shutdown_connections 2023-12-24T19:57:18.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff844176930 0x7ff844176da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff8300670b0 0x7ff830069560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff82c003ae0 0x7ff844156f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 --2- 172.21.15.61:0/403581061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff844154980 0x7ff844154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 -- 172.21.15.61:0/403581061 >> 172.21.15.61:0/403581061 conn(0x7ff844067fe0 msgr2=0x7ff8440c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 -- 172.21.15.61:0/403581061 shutdown_connections 2023-12-24T19:57:18.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.740+0000 7ff84ad47700 1 -- 172.21.15.61:0/403581061 wait complete. 2023-12-24T19:57:18.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.742+0000 7fc7c401b700 1 -- 172.21.15.61:0/785524938 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc79c005550 con 0x7fc7bc15e470 2023-12-24T19:57:18.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.742+0000 7fc7b1ffb700 1 -- 172.21.15.61:0/785524938 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7b8076b20 con 0x7fc7bc15e470 2023-12-24T19:57:18.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.742+0000 7f7a95ab3700 1 -- 172.21.15.61:0/2481933390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7a901552b0 con 0x7f7a9013f010 2023-12-24T19:57:18.746 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.743+0000 7f7a777fe700 1 -- 172.21.15.61:0/2481933390 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a84001e60 con 0x7f7a9013f010 2023-12-24T19:57:18.746 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:18.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 -- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc7a0067050 msgr2=0x7fc7a0069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc7a0067050 0x7fc7a0069500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0096c0 tx=0x7fc7ac006be0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 -- 172.21.15.61:0/785524938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7bc15e470 msgr2=0x7fc7bc14eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7bc15e470 0x7fc7bc14eb60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009ea0 tx=0x7fc7b8009250 comp rx=0 tx=0).stop 2023-12-24T19:57:18.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 -- 172.21.15.61:0/785524938 shutdown_connections 2023-12-24T19:57:18.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc7bc1613c0 0x7fc7bc13dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc7a0067050 0x7fc7a0069500 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7bc06df70 0x7fc7bc165eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 --2- 172.21.15.61:0/785524938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7bc15e470 0x7fc7bc14eb60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 -- 172.21.15.61:0/785524938 >> 172.21.15.61:0/785524938 conn(0x7fc7bc067fe0 msgr2=0x7fc7bc068d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 -- 172.21.15.61:0/785524938 shutdown_connections 2023-12-24T19:57:18.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7fc7c401b700 1 -- 172.21.15.61:0/785524938 wait complete. 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 -- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a780675a0 msgr2=0x7f7a78069a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a780675a0 0x7f7a78069a50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7a9013f880 tx=0x7f7a88014000 comp rx=0 tx=0).stop 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 -- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f010 msgr2=0x7f7a900a6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f010 0x7f7a900a6dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7a840011e0 tx=0x7f7a84007650 comp rx=0 tx=0).stop 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 -- 172.21.15.61:0/2481933390 shutdown_connections 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a780675a0 0x7f7a78069a50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a900a7300 0x7f7a901593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a9013f010 0x7f7a900a6dc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 --2- 172.21.15.61:0/2481933390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a90159c20 0x7f7a90158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 -- 172.21.15.61:0/2481933390 >> 172.21.15.61:0/2481933390 conn(0x7f7a90067fe0 msgr2=0x7f7a9006a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 -- 172.21.15.61:0/2481933390 shutdown_connections 2023-12-24T19:57:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:18.745+0000 7f7a95ab3700 1 -- 172.21.15.61:0/2481933390 wait complete. 2023-12-24T19:57:18.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-12-24T19:57:18.756 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:18.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-12-24T19:57:18.760 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:18.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-12-24T19:57:18.761 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:19.678 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-24T19:57:19.688 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-24T19:57:19.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.816+0000 7fdf7bc9d700 1 Processor -- start 2023-12-24T19:57:19.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.817+0000 7fdf7bc9d700 1 -- start start 2023-12-24T19:57:19.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.818+0000 7fdf7bc9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdf74159920 0x7fdf7406f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.818+0000 7fdf7bc9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 0x7fdf740cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.818+0000 7fdf7bc9d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7415aba0 con 0x7fdf74159cf0 2023-12-24T19:57:19.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.818+0000 7fdf7bc9d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7406fbe0 con 0x7fdf74159920 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.818+0000 7fdf7bc9d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7415ae80 con 0x7fdf740cd920 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.818+0000 7fdf79a39700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdf74159920 0x7fdf7406f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.818+0000 7fdf7a23a700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fdf74159cf0 0x7fdf7415a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41704/0 (socket says 172.21.15.61:41704) 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.818+0000 7fdf79a39700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdf74159920 0x7fdf7406f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53398/0 (socket says 172.21.15.61:53398) 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.818+0000 7fdf7a23a700 1 -- 172.21.15.61:0/1778956318 learned_addr learned my addr 172.21.15.61:0/1778956318 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.818+0000 7fdf79238700 1 --2- 172.21.15.61:0/1778956318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 0x7fdf740cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.819+0000 7fdf79a39700 1 -- 172.21.15.61:0/1778956318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 msgr2=0x7fdf740cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.819+0000 7fdf79a39700 1 --2- 172.21.15.61:0/1778956318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 0x7fdf740cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.819+0000 7fdf79a39700 1 -- 172.21.15.61:0/1778956318 >> v1:172.21.15.61:6789/0 conn(0x7fdf74159cf0 legacy=0x7fdf7415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.819+0000 7fdf79a39700 1 -- 172.21.15.61:0/1778956318 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7406ebc0 con 0x7fdf74159920 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.819+0000 7fdf78a37700 1 -- 172.21.15.61:0/1778956318 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276960169 0 0) 0x7fdf7415aba0 con 0x7fdf74159cf0 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.819+0000 7fdf79238700 1 --2- 172.21.15.61:0/1778956318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 0x7fdf740cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:19.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.819+0000 7fdf79a39700 1 --2- 172.21.15.61:0/1778956318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 0x7fdf7406f6a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf700098e0 tx=0x7fdf700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a512dd7c5ecd305b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.819+0000 7fdf78a37700 1 -- 172.21.15.61:0/1778956318 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70009e80 con 0x7fdf74159920 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.819+0000 7fdf78a37700 1 -- 172.21.15.61:0/1778956318 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7000b860 con 0x7fdf74159920 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.819+0000 7fdf78a37700 1 -- 172.21.15.61:0/1778956318 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7000bbe0 con 0x7fdf74159920 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.820+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/1778956318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 msgr2=0x7fdf7406f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.820+0000 7fdf7bc9d700 1 --2- 172.21.15.61:0/1778956318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 0x7fdf7406f6a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf700098e0 tx=0x7fdf700091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.820+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/1778956318 shutdown_connections 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.820+0000 7fdf7bc9d700 1 --2- 172.21.15.61:0/1778956318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 0x7fdf7406f6a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.820+0000 7fdf7bc9d700 1 --2- 172.21.15.61:0/1778956318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 0x7fdf740cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.820+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/1778956318 >> 172.21.15.61:0/1778956318 conn(0x7fdf7406b790 msgr2=0x7fdf74069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.820+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/1778956318 shutdown_connections 2023-12-24T19:57:19.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.820+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/1778956318 wait complete. 2023-12-24T19:57:19.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.821+0000 7fdf7bc9d700 1 Processor -- start 2023-12-24T19:57:19.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.821+0000 7fdf7bc9d700 1 -- start start 2023-12-24T19:57:19.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf7bc9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 0x7fdf74153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf7bc9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 0x7fdf740ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf7bc9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf74159cf0 0x7fdf740ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf7bc9d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf740cad20 con 0x7fdf74159920 2023-12-24T19:57:19.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf7bc9d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf740cb000 con 0x7fdf74159cf0 2023-12-24T19:57:19.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf7bc9d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf740cb2e0 con 0x7fdf740cd920 2023-12-24T19:57:19.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79238700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 0x7fdf740ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79238700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 0x7fdf740ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53406/0 (socket says 172.21.15.61:53406) 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79238700 1 -- 172.21.15.61:0/595339956 learned_addr learned my addr 172.21.15.61:0/595339956 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79a39700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 0x7fdf74153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf7a23a700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf74159cf0 0x7fdf740ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79238700 1 -- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 msgr2=0x7fdf74153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79238700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 0x7fdf74153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79238700 1 -- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf74159cf0 msgr2=0x7fdf740ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79238700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf74159cf0 0x7fdf740ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79238700 1 -- 172.21.15.61:0/595339956 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf70009420 con 0x7fdf74159920 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79a39700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 0x7fdf74153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf7a23a700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf74159cf0 0x7fdf740ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf79238700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 0x7fdf740ac3a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400e8d0 tx=0x7fdf64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.822+0000 7fdf69ffb700 1 -- 172.21.15.61:0/595339956 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6400ee70 con 0x7fdf74159920 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.823+0000 7fdf69ffb700 1 -- 172.21.15.61:0/595339956 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6400c5e0 con 0x7fdf74159920 2023-12-24T19:57:19.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.823+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/595339956 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf740cb5c0 con 0x7fdf74159920 2023-12-24T19:57:19.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.823+0000 7fdf69ffb700 1 -- 172.21.15.61:0/595339956 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6400c980 con 0x7fdf74159920 2023-12-24T19:57:19.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.823+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/595339956 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf740b4180 con 0x7fdf74159920 2023-12-24T19:57:19.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.824+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/595339956 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf740b16f0 con 0x7fdf74159920 2023-12-24T19:57:19.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.824+0000 7fdf69ffb700 1 -- 172.21.15.61:0/595339956 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdf64013410 con 0x7fdf74159920 2023-12-24T19:57:19.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.824+0000 7fdf69ffb700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.825+0000 7fdf69ffb700 1 -- 172.21.15.61:0/595339956 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf64084320 con 0x7fdf74159920 2023-12-24T19:57:19.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.825+0000 7fdf79a39700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.825+0000 7fdf79a39700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf58066f30 0x7fdf580693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf70003080 tx=0x7fdf70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:19.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.829+0000 7fdf69ffb700 1 -- 172.21.15.61:0/595339956 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf740b16f0 con 0x7fdf74159920 2023-12-24T19:57:19.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.854+0000 7f8d8b709700 1 Processor -- start 2023-12-24T19:57:19.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.855+0000 7f8d8b709700 1 -- start start 2023-12-24T19:57:19.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.855+0000 7f8d8b709700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d840ce010 0x7f8d840ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.855+0000 7f8d8b709700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8d840ce3e0 0x7f8d841587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.855+0000 7f8d8b709700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d84158350 con 0x7f8d84069f00 2023-12-24T19:57:19.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.855+0000 7f8d8b709700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d840ca740 con 0x7f8d840ce3e0 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.855+0000 7f8d8b709700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d840b1120 con 0x7f8d840ce010 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.855+0000 7f8d88ca4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8d840ce3e0 0x7f8d841587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d89ca6700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8d84069f00 0x7f8d840cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41716/0 (socket says 172.21.15.61:41716) 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d89ca6700 1 -- 172.21.15.61:0/2516052800 learned_addr learned my addr 172.21.15.61:0/2516052800 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d894a5700 1 --2- 172.21.15.61:0/2516052800 >> v2:172.21.15.133:3300/0 conn(0x7f8d840ce010 0x7f8d840ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d88ca4700 1 -- 172.21.15.61:0/2516052800 >> v2:172.21.15.133:3300/0 conn(0x7f8d840ce010 msgr2=0x7f8d840ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d88ca4700 1 --2- 172.21.15.61:0/2516052800 >> v2:172.21.15.133:3300/0 conn(0x7f8d840ce010 0x7f8d840ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d88ca4700 1 -- 172.21.15.61:0/2516052800 >> v1:172.21.15.61:6789/0 conn(0x7f8d84069f00 legacy=0x7f8d840cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d88ca4700 1 -- 172.21.15.61:0/2516052800 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d840ca990 con 0x7f8d840ce3e0 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d7bfff700 1 -- 172.21.15.61:0/2516052800 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98061572 0 0) 0x7f8d84158350 con 0x7f8d84069f00 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d88ca4700 1 --2- 172.21.15.61:0/2516052800 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce3e0 0x7f8d841587e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d840cb1e0 tx=0x7f8d740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5d0711ab85b6cf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d7bfff700 1 -- 172.21.15.61:0/2516052800 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74011630 con 0x7f8d840ce3e0 2023-12-24T19:57:19.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d7bfff700 1 -- 172.21.15.61:0/2516052800 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d74011790 con 0x7f8d840ce3e0 2023-12-24T19:57:19.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.856+0000 7f8d7bfff700 1 -- 172.21.15.61:0/2516052800 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74011b30 con 0x7f8d840ce3e0 2023-12-24T19:57:19.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.857+0000 7f8d8b709700 1 -- 172.21.15.61:0/2516052800 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce3e0 msgr2=0x7f8d841587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:19.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.857+0000 7f8d8b709700 1 --2- 172.21.15.61:0/2516052800 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce3e0 0x7f8d841587e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d840cb1e0 tx=0x7f8d740091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.857+0000 7f8d8b709700 1 -- 172.21.15.61:0/2516052800 shutdown_connections 2023-12-24T19:57:19.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.857+0000 7f8d8b709700 1 --2- 172.21.15.61:0/2516052800 >> v2:172.21.15.133:3300/0 conn(0x7f8d840ce010 0x7f8d840ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.857+0000 7f8d8b709700 1 --2- 172.21.15.61:0/2516052800 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce3e0 0x7f8d841587e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.857+0000 7f8d8b709700 1 -- 172.21.15.61:0/2516052800 >> 172.21.15.61:0/2516052800 conn(0x7f8d8406b790 msgr2=0x7f8d84069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:19.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.857+0000 7f8d8b709700 1 -- 172.21.15.61:0/2516052800 shutdown_connections 2023-12-24T19:57:19.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.857+0000 7f8d8b709700 1 -- 172.21.15.61:0/2516052800 wait complete. 2023-12-24T19:57:19.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.858+0000 7f8d8b709700 1 Processor -- start 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.858+0000 7f8d8b709700 1 -- start start 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d8b709700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d84069f00 0x7f8d8416ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d8b709700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce010 0x7f8d840aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d8b709700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d840ce3e0 0x7f8d841699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d8b709700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840affc0 con 0x7f8d840ce010 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d8b709700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840b0450 con 0x7f8d840ce3e0 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d8b709700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840af130 con 0x7f8d84069f00 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d88ca4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce010 0x7f8d840aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d88ca4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce010 0x7f8d840aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53424/0 (socket says 172.21.15.61:53424) 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d88ca4700 1 -- 172.21.15.61:0/102353958 learned_addr learned my addr 172.21.15.61:0/102353958 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d894a5700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d84069f00 0x7f8d8416ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d89ca6700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d840ce3e0 0x7f8d841699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d88ca4700 1 -- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d84069f00 msgr2=0x7f8d8416ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d88ca4700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d84069f00 0x7f8d8416ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d88ca4700 1 -- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d840ce3e0 msgr2=0x7f8d841699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:19.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d88ca4700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d840ce3e0 0x7f8d841699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:19.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.859+0000 7f8d88ca4700 1 -- 172.21.15.61:0/102353958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74009420 con 0x7f8d840ce010 2023-12-24T19:57:19.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.860+0000 7f8d88ca4700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce010 0x7f8d840aebf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8d84064b60 tx=0x7f8d74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:19.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.860+0000 7f8d797fa700 1 -- 172.21.15.61:0/102353958 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74000d10 con 0x7f8d840ce010 2023-12-24T19:57:19.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.860+0000 7f8d797fa700 1 -- 172.21.15.61:0/102353958 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d74011b10 con 0x7f8d840ce010 2023-12-24T19:57:19.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.860+0000 7f8d797fa700 1 -- 172.21.15.61:0/102353958 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74025640 con 0x7f8d840ce010 2023-12-24T19:57:19.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.860+0000 7f8d8b709700 1 -- 172.21.15.61:0/102353958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d840af3b0 con 0x7f8d840ce010 2023-12-24T19:57:19.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.860+0000 7f8d8b709700 1 -- 172.21.15.61:0/102353958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d840af970 con 0x7f8d840ce010 2023-12-24T19:57:19.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.861+0000 7f8d8b709700 1 -- 172.21.15.61:0/102353958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d840b0170 con 0x7f8d840ce010 2023-12-24T19:57:19.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.862+0000 7f8d797fa700 1 -- 172.21.15.61:0/102353958 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8d74025a30 con 0x7f8d840ce010 2023-12-24T19:57:19.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.862+0000 7f8d797fa700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8d68066f30 0x7f8d680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:19.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.862+0000 7f8d797fa700 1 -- 172.21.15.61:0/102353958 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d74085e50 con 0x7f8d840ce010 2023-12-24T19:57:19.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.862+0000 7f8d894a5700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8d68066f30 0x7f8d680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:19.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.863+0000 7f8d894a5700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8d68066f30 0x7f8d680693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d8416d7c0 tx=0x7f8d800091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:19.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:19.866+0000 7f8d797fa700 1 -- 172.21.15.61:0/102353958 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d74053140 con 0x7f8d840ce010 2023-12-24T19:57:20.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.030+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/595339956 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdf740b16f0 con 0x7fdf74159920 2023-12-24T19:57:20.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.030+0000 7fdf69ffb700 1 -- 172.21.15.61:0/595339956 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf740b16f0 con 0x7fdf74159920 2023-12-24T19:57:20.031 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf58066f30 msgr2=0x7fdf580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf58066f30 0x7fdf580693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf70003080 tx=0x7fdf70017000 comp rx=0 tx=0).stop 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/595339956 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 msgr2=0x7fdf740ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 0x7fdf740ac3a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400e8d0 tx=0x7fdf64008040 comp rx=0 tx=0).stop 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/595339956 shutdown_connections 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf740cd920 0x7fdf74153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf58066f30 0x7fdf580693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf74159cf0 0x7fdf740ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 --2- 172.21.15.61:0/595339956 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf74159920 0x7fdf740ac3a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/595339956 >> 172.21.15.61:0/595339956 conn(0x7fdf7406b790 msgr2=0x7fdf74155250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/595339956 shutdown_connections 2023-12-24T19:57:20.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.032+0000 7fdf7bc9d700 1 -- 172.21.15.61:0/595339956 wait complete. 2023-12-24T19:57:20.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-12-24T19:57:20.045 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:20.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.064+0000 7f8d8b709700 1 -- 172.21.15.61:0/102353958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8d8404c3c0 con 0x7f8d840ce010 2023-12-24T19:57:20.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.064+0000 7f8d797fa700 1 -- 172.21.15.61:0/102353958 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d74056760 con 0x7f8d840ce010 2023-12-24T19:57:20.064 INFO:teuthology.orchestra.run.smithi061.stdout:55834574854 2023-12-24T19:57:20.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 -- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8d68066f30 msgr2=0x7f8d680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8d68066f30 0x7f8d680693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d8416d7c0 tx=0x7f8d800091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 -- 172.21.15.61:0/102353958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce010 msgr2=0x7f8d840aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce010 0x7f8d840aebf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8d84064b60 tx=0x7f8d74017000 comp rx=0 tx=0).stop 2023-12-24T19:57:20.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 -- 172.21.15.61:0/102353958 shutdown_connections 2023-12-24T19:57:20.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8d84069f00 0x7f8d8416ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8d68066f30 0x7f8d680693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d840ce3e0 0x7f8d841699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 --2- 172.21.15.61:0/102353958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8d840ce010 0x7f8d840aebf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 -- 172.21.15.61:0/102353958 >> 172.21.15.61:0/102353958 conn(0x7f8d8406b790 msgr2=0x7f8d84157000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:20.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 -- 172.21.15.61:0/102353958 shutdown_connections 2023-12-24T19:57:20.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.066+0000 7f8d8b709700 1 -- 172.21.15.61:0/102353958 wait complete. 2023-12-24T19:57:20.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-12-24T19:57:20.079 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:20.079 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-24T19:57:20.079 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:57:20.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.240+0000 7fd212b71700 1 Processor -- start 2023-12-24T19:57:20.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.240+0000 7fd212b71700 1 -- start start 2023-12-24T19:57:20.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.241+0000 7fd212b71700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd20c0afee0 0x7fd20c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.241+0000 7fd212b71700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd20c070640 0x7fd20c070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.241+0000 7fd212b71700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c0a84d0 con 0x7fd20c159b00 2023-12-24T19:57:20.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.241+0000 7fd212b71700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c070fd0 con 0x7fd20c0afee0 2023-12-24T19:57:20.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.241+0000 7fd212b71700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c0a7620 con 0x7fd20c070640 2023-12-24T19:57:20.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.241+0000 7fd20bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd20c0afee0 0x7fd20c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.241+0000 7fd20bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd20c0afee0 0x7fd20c067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53434/0 (socket says 172.21.15.61:53434) 2023-12-24T19:57:20.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.241+0000 7fd20bfff700 1 -- 172.21.15.61:0/1600056541 learned_addr learned my addr 172.21.15.61:0/1600056541 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:20.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.241+0000 7fd21110e700 1 --2- 172.21.15.61:0/1600056541 >> v2:172.21.15.133:3300/0 conn(0x7fd20c070640 0x7fd20c070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd20bfff700 1 -- 172.21.15.61:0/1600056541 >> v2:172.21.15.133:3300/0 conn(0x7fd20c070640 msgr2=0x7fd20c070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd20bfff700 1 --2- 172.21.15.61:0/1600056541 >> v2:172.21.15.133:3300/0 conn(0x7fd20c070640 0x7fd20c070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd20bfff700 1 -- 172.21.15.61:0/1600056541 >> v1:172.21.15.133:6789/0 conn(0x7fd20c159b00 legacy=0x7fd20c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd20bfff700 1 -- 172.21.15.61:0/1600056541 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0a78c0 con 0x7fd20c0afee0 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd20bfff700 1 --2- 172.21.15.61:0/1600056541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c0afee0 0x7fd20c067550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd20c069040 tx=0x7fd1f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfdb187cb2e02f2f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd20b7fe700 1 -- 172.21.15.61:0/1600056541 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800b820 con 0x7fd20c0afee0 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd20b7fe700 1 -- 172.21.15.61:0/1600056541 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f800b980 con 0x7fd20c0afee0 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd20b7fe700 1 -- 172.21.15.61:0/1600056541 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800bd20 con 0x7fd20c0afee0 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd212b71700 1 -- 172.21.15.61:0/1600056541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c0afee0 msgr2=0x7fd20c067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd212b71700 1 --2- 172.21.15.61:0/1600056541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c0afee0 0x7fd20c067550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd20c069040 tx=0x7fd1f8009250 comp rx=0 tx=0).stop 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd212b71700 1 -- 172.21.15.61:0/1600056541 shutdown_connections 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd212b71700 1 --2- 172.21.15.61:0/1600056541 >> v2:172.21.15.133:3300/0 conn(0x7fd20c070640 0x7fd20c070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd212b71700 1 --2- 172.21.15.61:0/1600056541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c0afee0 0x7fd20c067550 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd212b71700 1 -- 172.21.15.61:0/1600056541 >> 172.21.15.61:0/1600056541 conn(0x7fd20c0ca200 msgr2=0x7fd20c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:20.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd212b71700 1 -- 172.21.15.61:0/1600056541 shutdown_connections 2023-12-24T19:57:20.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.242+0000 7fd212b71700 1 -- 172.21.15.61:0/1600056541 wait complete. 2023-12-24T19:57:20.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.244+0000 7fd212b71700 1 Processor -- start 2023-12-24T19:57:20.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.244+0000 7fd212b71700 1 -- start start 2023-12-24T19:57:20.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.244+0000 7fd212b71700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c070640 0x7fd20c15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.244+0000 7fd212b71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0afee0 0x7fd20c06ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.244+0000 7fd212b71700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c159b00 0x7fd20c06b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.244+0000 7fd212b71700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c158f30 con 0x7fd20c159b00 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.244+0000 7fd212b71700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c15c730 con 0x7fd20c0afee0 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.244+0000 7fd212b71700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1588e0 con 0x7fd20c070640 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd21110e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c159b00 0x7fd20c06b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd21110e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c159b00 0x7fd20c06b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53438/0 (socket says 172.21.15.61:53438) 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd21110e700 1 -- 172.21.15.61:0/4087387541 learned_addr learned my addr 172.21.15.61:0/4087387541 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd20bfff700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0afee0 0x7fd20c06ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd21090d700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c070640 0x7fd20c15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd21110e700 1 -- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c070640 msgr2=0x7fd20c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd21110e700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c070640 0x7fd20c15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd21110e700 1 -- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0afee0 msgr2=0x7fd20c06ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd21110e700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0afee0 0x7fd20c06ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd21110e700 1 -- 172.21.15.61:0/4087387541 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f80094f0 con 0x7fd20c159b00 2023-12-24T19:57:20.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd20bfff700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0afee0 0x7fd20c06ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd21110e700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c159b00 0x7fd20c06b240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd204009fa0 tx=0x7fd204009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd208ff9700 1 -- 172.21.15.61:0/4087387541 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400ed20 con 0x7fd20c159b00 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd208ff9700 1 -- 172.21.15.61:0/4087387541 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400ee80 con 0x7fd20c159b00 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd208ff9700 1 -- 172.21.15.61:0/4087387541 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204014670 con 0x7fd20c159b00 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd212b71700 1 -- 172.21.15.61:0/4087387541 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c158bc0 con 0x7fd20c159b00 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.245+0000 7fd212b71700 1 -- 172.21.15.61:0/4087387541 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c15d120 con 0x7fd20c159b00 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.246+0000 7fd212b71700 1 -- 172.21.15.61:0/4087387541 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c158750 con 0x7fd20c159b00 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.247+0000 7fd208ff9700 1 -- 172.21.15.61:0/4087387541 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd2040149e0 con 0x7fd20c159b00 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.247+0000 7fd208ff9700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1f0066f30 0x7fd1f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.247+0000 7fd208ff9700 1 -- 172.21.15.61:0/4087387541 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd204084dc0 con 0x7fd20c159b00 2023-12-24T19:57:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.247+0000 7fd21090d700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1f0066f30 0x7fd1f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.248+0000 7fd21090d700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1f0066f30 0x7fd1f00693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd200006fd0 tx=0x7fd200008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.251+0000 7fd208ff9700 1 -- 172.21.15.61:0/4087387541 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd204052030 con 0x7fd20c159b00 2023-12-24T19:57:20.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.442+0000 7fd212b71700 1 -- 172.21.15.61:0/4087387541 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd20c04c3c0 con 0x7fd1f0066f30 2023-12-24T19:57:20.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.449+0000 7fd208ff9700 1 -- 172.21.15.61:0/4087387541 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260178 (secure 0 0 0) 0x7fd20c04c3c0 con 0x7fd1f0066f30 2023-12-24T19:57:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:20.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.452+0000 7fd212b71700 1 -- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1f0066f30 msgr2=0x7fd1f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.452+0000 7fd212b71700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1f0066f30 0x7fd1f00693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd200006fd0 tx=0x7fd200008040 comp rx=0 tx=0).stop 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.452+0000 7fd212b71700 1 -- 172.21.15.61:0/4087387541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c159b00 msgr2=0x7fd20c06b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.452+0000 7fd212b71700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c159b00 0x7fd20c06b240 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd204009fa0 tx=0x7fd204009900 comp rx=0 tx=0).stop 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.453+0000 7fd212b71700 1 -- 172.21.15.61:0/4087387541 shutdown_connections 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.453+0000 7fd212b71700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd20c070640 0x7fd20c15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.453+0000 7fd212b71700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1f0066f30 0x7fd1f00693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.453+0000 7fd212b71700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd20c159b00 0x7fd20c06b240 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.453+0000 7fd212b71700 1 --2- 172.21.15.61:0/4087387541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c0afee0 0x7fd20c06ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.453+0000 7fd212b71700 1 -- 172.21.15.61:0/4087387541 >> 172.21.15.61:0/4087387541 conn(0x7fd20c0ca200 msgr2=0x7fd20c068290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.453+0000 7fd212b71700 1 -- 172.21.15.61:0/4087387541 shutdown_connections 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.453+0000 7fd212b71700 1 -- 172.21.15.61:0/4087387541 wait complete. 2023-12-24T19:57:20.456 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:57:20.465 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-24T19:57:20.310838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.797168"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536218+0000","last_change":"2023-12-24T19:57:07.536146+0000","last_active":"2023-12-24T19:57:07.536218+0000","last_peered":"2023-12-24T19:57:07.536218+0000","last_clean":"2023-12-24T19:57:07.536218+0000","last_became_active":"2023-12-24T19:57:07.535549+0000","last_became_peered":"2023-12-24T19:57:07.535549+0000","last_unstale":"2023-12-24T19:57:07.536218+0000","last_undegraded":"2023-12-24T19:57:07.536218+0000","last_fullsized":"2023-12-24T19:57:07.536218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:52.100502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519135+0000","last_change":"2023-12-24T19:57:07.519070+0000","last_active":"2023-12-24T19:57:07.519135+0000","last_peered":"2023-12-24T19:57:07.519135+0000","last_clean":"2023-12-24T19:57:07.519135+0000","last_became_active":"2023-12-24T19:57:07.518830+0000","last_became_peered":"2023-12-24T19:57:07.518830+0000","last_unstale":"2023-12-24T19:57:07.519135+0000","last_undegraded":"2023-12-24T19:57:07.519135+0000","last_fullsized":"2023-12-24T19:57:07.519135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515907+0000","last_change":"2023-12-24T19:57:07.515829+0000","last_active":"2023-12-24T19:57:07.515907+0000","last_peered":"2023-12-24T19:57:07.515907+0000","last_clean":"2023-12-24T19:57:07.515907+0000","last_became_active":"2023-12-24T19:57:07.515554+0000","last_became_peered":"2023-12-24T19:57:07.515554+0000","last_unstale":"2023-12-24T19:57:07.515907+0000","last_undegraded":"2023-12-24T19:57:07.515907+0000","last_fullsized":"2023-12-24T19:57:07.515907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531866+0000","last_change":"2023-12-24T19:57:07.531458+0000","last_active":"2023-12-24T19:57:07.531866+0000","last_peered":"2023-12-24T19:57:07.531866+0000","last_clean":"2023-12-24T19:57:07.531866+0000","last_became_active":"2023-12-24T19:57:07.530225+0000","last_became_peered":"2023-12-24T19:57:07.530225+0000","last_unstale":"2023-12-24T19:57:07.531866+0000","last_undegraded":"2023-12-24T19:57:07.531866+0000","last_fullsized":"2023-12-24T19:57:07.531866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:21.152234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535982+0000","last_change":"2023-12-24T19:57:07.534875+0000","last_active":"2023-12-24T19:57:07.535982+0000","last_peered":"2023-12-24T19:57:07.535982+0000","last_clean":"2023-12-24T19:57:07.535982+0000","last_became_active":"2023-12-24T19:57:07.534444+0000","last_became_peered":"2023-12-24T19:57:07.534444+0000","last_unstale":"2023-12-24T19:57:07.535982+0000","last_undegraded":"2023-12-24T19:57:07.535982+0000","last_fullsized":"2023-12-24T19:57:07.535982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520980+0000","last_change":"2023-12-24T19:57:07.520108+0000","last_active":"2023-12-24T19:57:07.520980+0000","last_peered":"2023-12-24T19:57:07.520980+0000","last_clean":"2023-12-24T19:57:07.520980+0000","last_became_active":"2023-12-24T19:57:07.519639+0000","last_became_peered":"2023-12-24T19:57:07.519639+0000","last_unstale":"2023-12-24T19:57:07.520980+0000","last_undegraded":"2023-12-24T19:57:07.520980+0000","last_fullsized":"2023-12-24T19:57:07.520980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.537256+0000","last_change":"2023-12-24T19:57:07.537204+0000","last_active":"2023-12-24T19:57:07.537256+0000","last_peered":"2023-12-24T19:57:07.537256+0000","last_clean":"2023-12-24T19:57:07.537256+0000","last_became_active":"2023-12-24T19:57:07.535804+0000","last_became_peered":"2023-12-24T19:57:07.535804+0000","last_unstale":"2023-12-24T19:57:07.537256+0000","last_undegraded":"2023-12-24T19:57:07.537256+0000","last_fullsized":"2023-12-24T19:57:07.537256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:08:43.312235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525929+0000","last_change":"2023-12-24T19:57:07.525839+0000","last_active":"2023-12-24T19:57:07.525929+0000","last_peered":"2023-12-24T19:57:07.525929+0000","last_clean":"2023-12-24T19:57:07.525929+0000","last_became_active":"2023-12-24T19:57:07.525535+0000","last_became_peered":"2023-12-24T19:57:07.525535+0000","last_unstale":"2023-12-24T19:57:07.525929+0000","last_undegraded":"2023-12-24T19:57:07.525929+0000","last_fullsized":"2023-12-24T19:57:07.525929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532601+0000","last_change":"2023-12-24T19:57:07.532497+0000","last_active":"2023-12-24T19:57:07.532601+0000","last_peered":"2023-12-24T19:57:07.532601+0000","last_clean":"2023-12-24T19:57:07.532601+0000","last_became_active":"2023-12-24T19:57:07.532280+0000","last_became_peered":"2023-12-24T19:57:07.532280+0000","last_unstale":"2023-12-24T19:57:07.532601+0000","last_undegraded":"2023-12-24T19:57:07.532601+0000","last_fullsized":"2023-12-24T19:57:07.532601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:01.279518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520933+0000","last_change":"2023-12-24T19:57:07.520487+0000","last_active":"2023-12-24T19:57:07.520933+0000","last_peered":"2023-12-24T19:57:07.520933+0000","last_clean":"2023-12-24T19:57:07.520933+0000","last_became_active":"2023-12-24T19:57:07.520238+0000","last_became_peered":"2023-12-24T19:57:07.520238+0000","last_unstale":"2023-12-24T19:57:07.520933+0000","last_undegraded":"2023-12-24T19:57:07.520933+0000","last_fullsized":"2023-12-24T19:57:07.520933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:16:20.311262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.521578+0000","last_change":"2023-12-24T19:57:07.521484+0000","last_active":"2023-12-24T19:57:07.521578+0000","last_peered":"2023-12-24T19:57:07.521578+0000","last_clean":"2023-12-24T19:57:07.521578+0000","last_became_active":"2023-12-24T19:57:07.521255+0000","last_became_peered":"2023-12-24T19:57:07.521255+0000","last_unstale":"2023-12-24T19:57:07.521578+0000","last_undegraded":"2023-12-24T19:57:07.521578+0000","last_fullsized":"2023-12-24T19:57:07.521578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527053+0000","last_change":"2023-12-24T19:57:07.526737+0000","last_active":"2023-12-24T19:57:07.527053+0000","last_peered":"2023-12-24T19:57:07.527053+0000","last_clean":"2023-12-24T19:57:07.527053+0000","last_became_active":"2023-12-24T19:57:07.526481+0000","last_became_peered":"2023-12-24T19:57:07.526481+0000","last_unstale":"2023-12-24T19:57:07.527053+0000","last_undegraded":"2023-12-24T19:57:07.527053+0000","last_fullsized":"2023-12-24T19:57:07.527053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:15.825581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530680+0000","last_change":"2023-12-24T19:57:07.530165+0000","last_active":"2023-12-24T19:57:07.530680+0000","last_peered":"2023-12-24T19:57:07.530680+0000","last_clean":"2023-12-24T19:57:07.530680+0000","last_became_active":"2023-12-24T19:57:07.529444+0000","last_became_peered":"2023-12-24T19:57:07.529444+0000","last_unstale":"2023-12-24T19:57:07.530680+0000","last_undegraded":"2023-12-24T19:57:07.530680+0000","last_fullsized":"2023-12-24T19:57:07.530680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518630+0000","last_change":"2023-12-24T19:57:07.518298+0000","last_active":"2023-12-24T19:57:07.518630+0000","last_peered":"2023-12-24T19:57:07.518630+0000","last_clean":"2023-12-24T19:57:07.518630+0000","last_became_active":"2023-12-24T19:57:07.517984+0000","last_became_peered":"2023-12-24T19:57:07.517984+0000","last_unstale":"2023-12-24T19:57:07.518630+0000","last_undegraded":"2023-12-24T19:57:07.518630+0000","last_fullsized":"2023-12-24T19:57:07.518630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524033+0000","last_change":"2023-12-24T19:57:07.523925+0000","last_active":"2023-12-24T19:57:07.524033+0000","last_peered":"2023-12-24T19:57:07.524033+0000","last_clean":"2023-12-24T19:57:07.524033+0000","last_became_active":"2023-12-24T19:57:07.523700+0000","last_became_peered":"2023-12-24T19:57:07.523700+0000","last_unstale":"2023-12-24T19:57:07.524033+0000","last_undegraded":"2023-12-24T19:57:07.524033+0000","last_fullsized":"2023-12-24T19:57:07.524033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520963+0000","last_change":"2023-12-24T19:57:07.519865+0000","last_active":"2023-12-24T19:57:07.520963+0000","last_peered":"2023-12-24T19:57:07.520963+0000","last_clean":"2023-12-24T19:57:07.520963+0000","last_became_active":"2023-12-24T19:57:07.519280+0000","last_became_peered":"2023-12-24T19:57:07.519280+0000","last_unstale":"2023-12-24T19:57:07.520963+0000","last_undegraded":"2023-12-24T19:57:07.520963+0000","last_fullsized":"2023-12-24T19:57:07.520963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535309+0000","last_change":"2023-12-24T19:57:07.535246+0000","last_active":"2023-12-24T19:57:07.535309+0000","last_peered":"2023-12-24T19:57:07.535309+0000","last_clean":"2023-12-24T19:57:07.535309+0000","last_became_active":"2023-12-24T19:57:07.534766+0000","last_became_peered":"2023-12-24T19:57:07.534766+0000","last_unstale":"2023-12-24T19:57:07.535309+0000","last_undegraded":"2023-12-24T19:57:07.535309+0000","last_fullsized":"2023-12-24T19:57:07.535309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:01.279518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518582+0000","last_change":"2023-12-24T19:57:07.518511+0000","last_active":"2023-12-24T19:57:07.518582+0000","last_peered":"2023-12-24T19:57:07.518582+0000","last_clean":"2023-12-24T19:57:07.518582+0000","last_became_active":"2023-12-24T19:57:07.518256+0000","last_became_peered":"2023-12-24T19:57:07.518256+0000","last_unstale":"2023-12-24T19:57:07.518582+0000","last_undegraded":"2023-12-24T19:57:07.518582+0000","last_fullsized":"2023-12-24T19:57:07.518582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535963+0000","last_change":"2023-12-24T19:57:07.534422+0000","last_active":"2023-12-24T19:57:07.535963+0000","last_peered":"2023-12-24T19:57:07.535963+0000","last_clean":"2023-12-24T19:57:07.535963+0000","last_became_active":"2023-12-24T19:57:07.533941+0000","last_became_peered":"2023-12-24T19:57:07.533941+0000","last_unstale":"2023-12-24T19:57:07.535963+0000","last_undegraded":"2023-12-24T19:57:07.535963+0000","last_fullsized":"2023-12-24T19:57:07.535963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529337+0000","last_change":"2023-12-24T19:57:06.524904+0000","last_active":"2023-12-24T19:57:07.529337+0000","last_peered":"2023-12-24T19:57:07.529337+0000","last_clean":"2023-12-24T19:57:07.529337+0000","last_became_active":"2023-12-24T19:57:06.524655+0000","last_became_peered":"2023-12-24T19:57:06.524655+0000","last_unstale":"2023-12-24T19:57:07.529337+0000","last_undegraded":"2023-12-24T19:57:07.529337+0000","last_fullsized":"2023-12-24T19:57:07.529337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530981+0000","last_change":"2023-12-24T19:57:07.530215+0000","last_active":"2023-12-24T19:57:07.530981+0000","last_peered":"2023-12-24T19:57:07.530981+0000","last_clean":"2023-12-24T19:57:07.530981+0000","last_became_active":"2023-12-24T19:57:07.529530+0000","last_became_peered":"2023-12-24T19:57:07.529530+0000","last_unstale":"2023-12-24T19:57:07.530981+0000","last_undegraded":"2023-12-24T19:57:07.530981+0000","last_fullsized":"2023-12-24T19:57:07.530981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:52.100502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530889+0000","last_change":"2023-12-24T19:57:06.513334+0000","last_active":"2023-12-24T19:57:07.530889+0000","last_peered":"2023-12-24T19:57:07.530889+0000","last_clean":"2023-12-24T19:57:07.530889+0000","last_became_active":"2023-12-24T19:57:06.513019+0000","last_became_peered":"2023-12-24T19:57:06.513019+0000","last_unstale":"2023-12-24T19:57:07.530889+0000","last_undegraded":"2023-12-24T19:57:07.530889+0000","last_fullsized":"2023-12-24T19:57:07.530889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517778+0000","last_change":"2023-12-24T19:57:07.517103+0000","last_active":"2023-12-24T19:57:07.517778+0000","last_peered":"2023-12-24T19:57:07.517778+0000","last_clean":"2023-12-24T19:57:07.517778+0000","last_became_active":"2023-12-24T19:57:07.516861+0000","last_became_peered":"2023-12-24T19:57:07.516861+0000","last_unstale":"2023-12-24T19:57:07.517778+0000","last_undegraded":"2023-12-24T19:57:07.517778+0000","last_fullsized":"2023-12-24T19:57:07.517778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536144+0000","last_change":"2023-12-24T19:57:06.525249+0000","last_active":"2023-12-24T19:57:07.536144+0000","last_peered":"2023-12-24T19:57:07.536144+0000","last_clean":"2023-12-24T19:57:07.536144+0000","last_became_active":"2023-12-24T19:57:06.525009+0000","last_became_peered":"2023-12-24T19:57:06.525009+0000","last_unstale":"2023-12-24T19:57:07.536144+0000","last_undegraded":"2023-12-24T19:57:07.536144+0000","last_fullsized":"2023-12-24T19:57:07.536144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:07.722680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523253+0000","last_change":"2023-12-24T19:57:07.523010+0000","last_active":"2023-12-24T19:57:07.523253+0000","last_peered":"2023-12-24T19:57:07.523253+0000","last_clean":"2023-12-24T19:57:07.523253+0000","last_became_active":"2023-12-24T19:57:07.522733+0000","last_became_peered":"2023-12-24T19:57:07.522733+0000","last_unstale":"2023-12-24T19:57:07.523253+0000","last_undegraded":"2023-12-24T19:57:07.523253+0000","last_fullsized":"2023-12-24T19:57:07.523253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532233+0000","last_change":"2023-12-24T19:57:06.527966+0000","last_active":"2023-12-24T19:57:07.532233+0000","last_peered":"2023-12-24T19:57:07.532233+0000","last_clean":"2023-12-24T19:57:07.532233+0000","last_became_active":"2023-12-24T19:57:06.527733+0000","last_became_peered":"2023-12-24T19:57:06.527733+0000","last_unstale":"2023-12-24T19:57:07.532233+0000","last_undegraded":"2023-12-24T19:57:07.532233+0000","last_fullsized":"2023-12-24T19:57:07.532233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:51.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523731+0000","last_change":"2023-12-24T19:57:07.523651+0000","last_active":"2023-12-24T19:57:07.523731+0000","last_peered":"2023-12-24T19:57:07.523731+0000","last_clean":"2023-12-24T19:57:07.523731+0000","last_became_active":"2023-12-24T19:57:07.523421+0000","last_became_peered":"2023-12-24T19:57:07.523421+0000","last_unstale":"2023-12-24T19:57:07.523731+0000","last_undegraded":"2023-12-24T19:57:07.523731+0000","last_fullsized":"2023-12-24T19:57:07.523731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528856+0000","last_change":"2023-12-24T19:57:06.525065+0000","last_active":"2023-12-24T19:57:07.528856+0000","last_peered":"2023-12-24T19:57:07.528856+0000","last_clean":"2023-12-24T19:57:07.528856+0000","last_became_active":"2023-12-24T19:57:06.524824+0000","last_became_peered":"2023-12-24T19:57:06.524824+0000","last_unstale":"2023-12-24T19:57:07.528856+0000","last_undegraded":"2023-12-24T19:57:07.528856+0000","last_fullsized":"2023-12-24T19:57:07.528856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:17.717686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523500+0000","last_change":"2023-12-24T19:57:07.523416+0000","last_active":"2023-12-24T19:57:07.523500+0000","last_peered":"2023-12-24T19:57:07.523500+0000","last_clean":"2023-12-24T19:57:07.523500+0000","last_became_active":"2023-12-24T19:57:07.523188+0000","last_became_peered":"2023-12-24T19:57:07.523188+0000","last_unstale":"2023-12-24T19:57:07.523500+0000","last_undegraded":"2023-12-24T19:57:07.523500+0000","last_fullsized":"2023-12-24T19:57:07.523500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:47.622467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528383+0000","last_change":"2023-12-24T19:57:06.523002+0000","last_active":"2023-12-24T19:57:07.528383+0000","last_peered":"2023-12-24T19:57:07.528383+0000","last_clean":"2023-12-24T19:57:07.528383+0000","last_became_active":"2023-12-24T19:57:06.522751+0000","last_became_peered":"2023-12-24T19:57:06.522751+0000","last_unstale":"2023-12-24T19:57:07.528383+0000","last_undegraded":"2023-12-24T19:57:07.528383+0000","last_fullsized":"2023-12-24T19:57:07.528383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524533+0000","last_change":"2023-12-24T19:57:07.524449+0000","last_active":"2023-12-24T19:57:07.524533+0000","last_peered":"2023-12-24T19:57:07.524533+0000","last_clean":"2023-12-24T19:57:07.524533+0000","last_became_active":"2023-12-24T19:57:07.524202+0000","last_became_peered":"2023-12-24T19:57:07.524202+0000","last_unstale":"2023-12-24T19:57:07.524533+0000","last_undegraded":"2023-12-24T19:57:07.524533+0000","last_fullsized":"2023-12-24T19:57:07.524533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526502+0000","last_change":"2023-12-24T19:57:06.524481+0000","last_active":"2023-12-24T19:57:07.526502+0000","last_peered":"2023-12-24T19:57:07.526502+0000","last_clean":"2023-12-24T19:57:07.526502+0000","last_became_active":"2023-12-24T19:57:06.523848+0000","last_became_peered":"2023-12-24T19:57:06.523848+0000","last_unstale":"2023-12-24T19:57:07.526502+0000","last_undegraded":"2023-12-24T19:57:07.526502+0000","last_fullsized":"2023-12-24T19:57:07.526502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525501+0000","last_change":"2023-12-24T19:57:07.525363+0000","last_active":"2023-12-24T19:57:07.525501+0000","last_peered":"2023-12-24T19:57:07.525501+0000","last_clean":"2023-12-24T19:57:07.525501+0000","last_became_active":"2023-12-24T19:57:07.524804+0000","last_became_peered":"2023-12-24T19:57:07.524804+0000","last_unstale":"2023-12-24T19:57:07.525501+0000","last_undegraded":"2023-12-24T19:57:07.525501+0000","last_fullsized":"2023-12-24T19:57:07.525501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:38.268155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516808+0000","last_change":"2023-12-24T19:57:06.522784+0000","last_active":"2023-12-24T19:57:07.516808+0000","last_peered":"2023-12-24T19:57:07.516808+0000","last_clean":"2023-12-24T19:57:07.516808+0000","last_became_active":"2023-12-24T19:57:06.522559+0000","last_became_peered":"2023-12-24T19:57:06.522559+0000","last_unstale":"2023-12-24T19:57:07.516808+0000","last_undegraded":"2023-12-24T19:57:07.516808+0000","last_fullsized":"2023-12-24T19:57:07.516808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529007+0000","last_change":"2023-12-24T19:57:07.528916+0000","last_active":"2023-12-24T19:57:07.529007+0000","last_peered":"2023-12-24T19:57:07.529007+0000","last_clean":"2023-12-24T19:57:07.529007+0000","last_became_active":"2023-12-24T19:57:07.528614+0000","last_became_peered":"2023-12-24T19:57:07.528614+0000","last_unstale":"2023-12-24T19:57:07.529007+0000","last_undegraded":"2023-12-24T19:57:07.529007+0000","last_fullsized":"2023-12-24T19:57:07.529007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518133+0000","last_change":"2023-12-24T19:57:06.521620+0000","last_active":"2023-12-24T19:57:07.518133+0000","last_peered":"2023-12-24T19:57:07.518133+0000","last_clean":"2023-12-24T19:57:07.518133+0000","last_became_active":"2023-12-24T19:57:06.521329+0000","last_became_peered":"2023-12-24T19:57:06.521329+0000","last_unstale":"2023-12-24T19:57:07.518133+0000","last_undegraded":"2023-12-24T19:57:07.518133+0000","last_fullsized":"2023-12-24T19:57:07.518133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535124+0000","last_change":"2023-12-24T19:57:07.534974+0000","last_active":"2023-12-24T19:57:07.535124+0000","last_peered":"2023-12-24T19:57:07.535124+0000","last_clean":"2023-12-24T19:57:07.535124+0000","last_became_active":"2023-12-24T19:57:07.534336+0000","last_became_peered":"2023-12-24T19:57:07.534336+0000","last_unstale":"2023-12-24T19:57:07.535124+0000","last_undegraded":"2023-12-24T19:57:07.535124+0000","last_fullsized":"2023-12-24T19:57:07.535124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:21.111646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515712+0000","last_change":"2023-12-24T19:57:06.525016+0000","last_active":"2023-12-24T19:57:07.515712+0000","last_peered":"2023-12-24T19:57:07.515712+0000","last_clean":"2023-12-24T19:57:07.515712+0000","last_became_active":"2023-12-24T19:57:06.524783+0000","last_became_peered":"2023-12-24T19:57:06.524783+0000","last_unstale":"2023-12-24T19:57:07.515712+0000","last_undegraded":"2023-12-24T19:57:07.515712+0000","last_fullsized":"2023-12-24T19:57:07.515712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519757+0000","last_change":"2023-12-24T19:57:07.519678+0000","last_active":"2023-12-24T19:57:07.519757+0000","last_peered":"2023-12-24T19:57:07.519757+0000","last_clean":"2023-12-24T19:57:07.519757+0000","last_became_active":"2023-12-24T19:57:07.519439+0000","last_became_peered":"2023-12-24T19:57:07.519439+0000","last_unstale":"2023-12-24T19:57:07.519757+0000","last_undegraded":"2023-12-24T19:57:07.519757+0000","last_fullsized":"2023-12-24T19:57:07.519757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525729+0000","last_change":"2023-12-24T19:57:06.520438+0000","last_active":"2023-12-24T19:57:07.525729+0000","last_peered":"2023-12-24T19:57:07.525729+0000","last_clean":"2023-12-24T19:57:07.525729+0000","last_became_active":"2023-12-24T19:57:06.520107+0000","last_became_peered":"2023-12-24T19:57:06.520107+0000","last_unstale":"2023-12-24T19:57:07.525729+0000","last_undegraded":"2023-12-24T19:57:07.525729+0000","last_fullsized":"2023-12-24T19:57:07.525729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:18.362103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529743+0000","last_change":"2023-12-24T19:57:07.528796+0000","last_active":"2023-12-24T19:57:07.529743+0000","last_peered":"2023-12-24T19:57:07.529743+0000","last_clean":"2023-12-24T19:57:07.529743+0000","last_became_active":"2023-12-24T19:57:07.528655+0000","last_became_peered":"2023-12-24T19:57:07.528655+0000","last_unstale":"2023-12-24T19:57:07.529743+0000","last_undegraded":"2023-12-24T19:57:07.529743+0000","last_fullsized":"2023-12-24T19:57:07.529743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534720+0000","last_change":"2023-12-24T19:57:06.521232+0000","last_active":"2023-12-24T19:57:07.534720+0000","last_peered":"2023-12-24T19:57:07.534720+0000","last_clean":"2023-12-24T19:57:07.534720+0000","last_became_active":"2023-12-24T19:57:06.520781+0000","last_became_peered":"2023-12-24T19:57:06.520781+0000","last_unstale":"2023-12-24T19:57:07.534720+0000","last_undegraded":"2023-12-24T19:57:07.534720+0000","last_fullsized":"2023-12-24T19:57:07.534720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530590+0000","last_change":"2023-12-24T19:57:07.530411+0000","last_active":"2023-12-24T19:57:07.530590+0000","last_peered":"2023-12-24T19:57:07.530590+0000","last_clean":"2023-12-24T19:57:07.530590+0000","last_became_active":"2023-12-24T19:57:07.530142+0000","last_became_peered":"2023-12-24T19:57:07.530142+0000","last_unstale":"2023-12-24T19:57:07.530590+0000","last_undegraded":"2023-12-24T19:57:07.530590+0000","last_fullsized":"2023-12-24T19:57:07.530590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:49.060653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527723+0000","last_change":"2023-12-24T19:57:06.518450+0000","last_active":"2023-12-24T19:57:07.527723+0000","last_peered":"2023-12-24T19:57:07.527723+0000","last_clean":"2023-12-24T19:57:07.527723+0000","last_became_active":"2023-12-24T19:57:06.518168+0000","last_became_peered":"2023-12-24T19:57:06.518168+0000","last_unstale":"2023-12-24T19:57:07.527723+0000","last_undegraded":"2023-12-24T19:57:07.527723+0000","last_fullsized":"2023-12-24T19:57:07.527723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:34.036458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534331+0000","last_change":"2023-12-24T19:57:07.534267+0000","last_active":"2023-12-24T19:57:07.534331+0000","last_peered":"2023-12-24T19:57:07.534331+0000","last_clean":"2023-12-24T19:57:07.534331+0000","last_became_active":"2023-12-24T19:57:07.533743+0000","last_became_peered":"2023-12-24T19:57:07.533743+0000","last_unstale":"2023-12-24T19:57:07.534331+0000","last_undegraded":"2023-12-24T19:57:07.534331+0000","last_fullsized":"2023-12-24T19:57:07.534331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516585+0000","last_change":"2023-12-24T19:57:06.519259+0000","last_active":"2023-12-24T19:57:07.516585+0000","last_peered":"2023-12-24T19:57:07.516585+0000","last_clean":"2023-12-24T19:57:07.516585+0000","last_became_active":"2023-12-24T19:57:06.518732+0000","last_became_peered":"2023-12-24T19:57:06.518732+0000","last_unstale":"2023-12-24T19:57:07.516585+0000","last_undegraded":"2023-12-24T19:57:07.516585+0000","last_fullsized":"2023-12-24T19:57:07.516585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535999+0000","last_change":"2023-12-24T19:57:07.535031+0000","last_active":"2023-12-24T19:57:07.535999+0000","last_peered":"2023-12-24T19:57:07.535999+0000","last_clean":"2023-12-24T19:57:07.535999+0000","last_became_active":"2023-12-24T19:57:07.534715+0000","last_became_peered":"2023-12-24T19:57:07.534715+0000","last_unstale":"2023-12-24T19:57:07.535999+0000","last_undegraded":"2023-12-24T19:57:07.535999+0000","last_fullsized":"2023-12-24T19:57:07.535999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:21.111646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517413+0000","last_change":"2023-12-24T19:57:06.524250+0000","last_active":"2023-12-24T19:57:07.517413+0000","last_peered":"2023-12-24T19:57:07.517413+0000","last_clean":"2023-12-24T19:57:07.517413+0000","last_became_active":"2023-12-24T19:57:06.523702+0000","last_became_peered":"2023-12-24T19:57:06.523702+0000","last_unstale":"2023-12-24T19:57:07.517413+0000","last_undegraded":"2023-12-24T19:57:07.517413+0000","last_fullsized":"2023-12-24T19:57:07.517413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520473+0000","last_change":"2023-12-24T19:57:07.520401+0000","last_active":"2023-12-24T19:57:07.520473+0000","last_peered":"2023-12-24T19:57:07.520473+0000","last_clean":"2023-12-24T19:57:07.520473+0000","last_became_active":"2023-12-24T19:57:07.520170+0000","last_became_peered":"2023-12-24T19:57:07.520170+0000","last_unstale":"2023-12-24T19:57:07.520473+0000","last_undegraded":"2023-12-24T19:57:07.520473+0000","last_fullsized":"2023-12-24T19:57:07.520473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530362+0000","last_change":"2023-12-24T19:57:06.526329+0000","last_active":"2023-12-24T19:57:07.530362+0000","last_peered":"2023-12-24T19:57:07.530362+0000","last_clean":"2023-12-24T19:57:07.530362+0000","last_became_active":"2023-12-24T19:57:06.525718+0000","last_became_peered":"2023-12-24T19:57:06.525718+0000","last_unstale":"2023-12-24T19:57:07.530362+0000","last_undegraded":"2023-12-24T19:57:07.530362+0000","last_fullsized":"2023-12-24T19:57:07.530362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.537377+0000","last_change":"2023-12-24T19:57:07.537325+0000","last_active":"2023-12-24T19:57:07.537377+0000","last_peered":"2023-12-24T19:57:07.537377+0000","last_clean":"2023-12-24T19:57:07.537377+0000","last_became_active":"2023-12-24T19:57:07.536102+0000","last_became_peered":"2023-12-24T19:57:07.536102+0000","last_unstale":"2023-12-24T19:57:07.537377+0000","last_undegraded":"2023-12-24T19:57:07.537377+0000","last_fullsized":"2023-12-24T19:57:07.537377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:52:11.849851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528207+0000","last_change":"2023-12-24T19:57:06.518295+0000","last_active":"2023-12-24T19:57:07.528207+0000","last_peered":"2023-12-24T19:57:07.528207+0000","last_clean":"2023-12-24T19:57:07.528207+0000","last_became_active":"2023-12-24T19:57:06.516591+0000","last_became_peered":"2023-12-24T19:57:06.516591+0000","last_unstale":"2023-12-24T19:57:07.528207+0000","last_undegraded":"2023-12-24T19:57:07.528207+0000","last_fullsized":"2023-12-24T19:57:07.528207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:34.036458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536964+0000","last_change":"2023-12-24T19:57:07.536755+0000","last_active":"2023-12-24T19:57:07.536964+0000","last_peered":"2023-12-24T19:57:07.536964+0000","last_clean":"2023-12-24T19:57:07.536964+0000","last_became_active":"2023-12-24T19:57:07.536502+0000","last_became_peered":"2023-12-24T19:57:07.536502+0000","last_unstale":"2023-12-24T19:57:07.536964+0000","last_undegraded":"2023-12-24T19:57:07.536964+0000","last_fullsized":"2023-12-24T19:57:07.536964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:21.152234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517131+0000","last_change":"2023-12-24T19:57:06.519180+0000","last_active":"2023-12-24T19:57:07.517131+0000","last_peered":"2023-12-24T19:57:07.517131+0000","last_clean":"2023-12-24T19:57:07.517131+0000","last_became_active":"2023-12-24T19:57:06.518906+0000","last_became_peered":"2023-12-24T19:57:06.518906+0000","last_unstale":"2023-12-24T19:57:07.517131+0000","last_undegraded":"2023-12-24T19:57:07.517131+0000","last_fullsized":"2023-12-24T19:57:07.517131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531876+0000","last_change":"2023-12-24T19:57:07.531626+0000","last_active":"2023-12-24T19:57:07.531876+0000","last_peered":"2023-12-24T19:57:07.531876+0000","last_clean":"2023-12-24T19:57:07.531876+0000","last_became_active":"2023-12-24T19:57:07.530556+0000","last_became_peered":"2023-12-24T19:57:07.530556+0000","last_unstale":"2023-12-24T19:57:07.531876+0000","last_undegraded":"2023-12-24T19:57:07.531876+0000","last_fullsized":"2023-12-24T19:57:07.531876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:43:42.570184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515831+0000","last_change":"2023-12-24T19:57:06.522317+0000","last_active":"2023-12-24T19:57:07.515831+0000","last_peered":"2023-12-24T19:57:07.515831+0000","last_clean":"2023-12-24T19:57:07.515831+0000","last_became_active":"2023-12-24T19:57:06.521804+0000","last_became_peered":"2023-12-24T19:57:06.521804+0000","last_unstale":"2023-12-24T19:57:07.515831+0000","last_undegraded":"2023-12-24T19:57:07.515831+0000","last_fullsized":"2023-12-24T19:57:07.515831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525176+0000","last_change":"2023-12-24T19:57:07.525106+0000","last_active":"2023-12-24T19:57:07.525176+0000","last_peered":"2023-12-24T19:57:07.525176+0000","last_clean":"2023-12-24T19:57:07.525176+0000","last_became_active":"2023-12-24T19:57:07.524852+0000","last_became_peered":"2023-12-24T19:57:07.524852+0000","last_unstale":"2023-12-24T19:57:07.525176+0000","last_undegraded":"2023-12-24T19:57:07.525176+0000","last_fullsized":"2023-12-24T19:57:07.525176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:19.368177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517665+0000","last_change":"2023-12-24T19:57:07.517596+0000","last_active":"2023-12-24T19:57:07.517665+0000","last_peered":"2023-12-24T19:57:07.517665+0000","last_clean":"2023-12-24T19:57:07.517665+0000","last_became_active":"2023-12-24T19:57:07.517352+0000","last_became_peered":"2023-12-24T19:57:07.517352+0000","last_unstale":"2023-12-24T19:57:07.517665+0000","last_undegraded":"2023-12-24T19:57:07.517665+0000","last_fullsized":"2023-12-24T19:57:07.517665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.513830+0000","last_change":"2023-12-24T19:57:06.526469+0000","last_active":"2023-12-24T19:57:07.513830+0000","last_peered":"2023-12-24T19:57:07.513830+0000","last_clean":"2023-12-24T19:57:07.513830+0000","last_became_active":"2023-12-24T19:57:06.526071+0000","last_became_peered":"2023-12-24T19:57:06.526071+0000","last_unstale":"2023-12-24T19:57:07.513830+0000","last_undegraded":"2023-12-24T19:57:07.513830+0000","last_fullsized":"2023-12-24T19:57:07.513830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527346+0000","last_change":"2023-12-24T19:57:07.527208+0000","last_active":"2023-12-24T19:57:07.527346+0000","last_peered":"2023-12-24T19:57:07.527346+0000","last_clean":"2023-12-24T19:57:07.527346+0000","last_became_active":"2023-12-24T19:57:07.526792+0000","last_became_peered":"2023-12-24T19:57:07.526792+0000","last_unstale":"2023-12-24T19:57:07.527346+0000","last_undegraded":"2023-12-24T19:57:07.527346+0000","last_fullsized":"2023-12-24T19:57:07.527346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:43:42.570184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516700+0000","last_change":"2023-12-24T19:57:06.521786+0000","last_active":"2023-12-24T19:57:07.516700+0000","last_peered":"2023-12-24T19:57:07.516700+0000","last_clean":"2023-12-24T19:57:07.516700+0000","last_became_active":"2023-12-24T19:57:06.521491+0000","last_became_peered":"2023-12-24T19:57:06.521491+0000","last_unstale":"2023-12-24T19:57:07.516700+0000","last_undegraded":"2023-12-24T19:57:07.516700+0000","last_fullsized":"2023-12-24T19:57:07.516700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527038+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:57:07.527038+0000","last_peered":"2023-12-24T19:57:07.527038+0000","last_clean":"2023-12-24T19:57:07.527038+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:57:07.527038+0000","last_undegraded":"2023-12-24T19:57:07.527038+0000","last_fullsized":"2023-12-24T19:57:07.527038+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526944+0000","last_change":"2023-12-24T19:57:07.526851+0000","last_active":"2023-12-24T19:57:07.526944+0000","last_peered":"2023-12-24T19:57:07.526944+0000","last_clean":"2023-12-24T19:57:07.526944+0000","last_became_active":"2023-12-24T19:57:07.526572+0000","last_became_peered":"2023-12-24T19:57:07.526572+0000","last_unstale":"2023-12-24T19:57:07.526944+0000","last_undegraded":"2023-12-24T19:57:07.526944+0000","last_fullsized":"2023-12-24T19:57:07.526944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526230+0000","last_change":"2023-12-24T19:57:06.527232+0000","last_active":"2023-12-24T19:57:07.526230+0000","last_peered":"2023-12-24T19:57:07.526230+0000","last_clean":"2023-12-24T19:57:07.526230+0000","last_became_active":"2023-12-24T19:57:06.526965+0000","last_became_peered":"2023-12-24T19:57:06.526965+0000","last_unstale":"2023-12-24T19:57:07.526230+0000","last_undegraded":"2023-12-24T19:57:07.526230+0000","last_fullsized":"2023-12-24T19:57:07.526230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526332+0000","last_change":"2023-12-24T19:57:06.527833+0000","last_active":"2023-12-24T19:57:07.526332+0000","last_peered":"2023-12-24T19:57:07.526332+0000","last_clean":"2023-12-24T19:57:07.526332+0000","last_became_active":"2023-12-24T19:57:06.527507+0000","last_became_peered":"2023-12-24T19:57:06.527507+0000","last_unstale":"2023-12-24T19:57:07.526332+0000","last_undegraded":"2023-12-24T19:57:07.526332+0000","last_fullsized":"2023-12-24T19:57:07.526332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517724+0000","last_change":"2023-12-24T19:57:07.517660+0000","last_active":"2023-12-24T19:57:07.517724+0000","last_peered":"2023-12-24T19:57:07.517724+0000","last_clean":"2023-12-24T19:57:07.517724+0000","last_became_active":"2023-12-24T19:57:07.517397+0000","last_became_peered":"2023-12-24T19:57:07.517397+0000","last_unstale":"2023-12-24T19:57:07.517724+0000","last_undegraded":"2023-12-24T19:57:07.517724+0000","last_fullsized":"2023-12-24T19:57:07.517724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-24T19:57:08.515389+0000","last_change":"2023-12-24T19:57:06.525879+0000","last_active":"2023-12-24T19:57:08.515389+0000","last_peered":"2023-12-24T19:57:08.515389+0000","last_clean":"2023-12-24T19:57:08.515389+0000","last_became_active":"2023-12-24T19:57:06.525637+0000","last_became_peered":"2023-12-24T19:57:06.525637+0000","last_unstale":"2023-12-24T19:57:08.515389+0000","last_undegraded":"2023-12-24T19:57:08.515389+0000","last_fullsized":"2023-12-24T19:57:08.515389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:46.616394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534151+0000","last_change":"2023-12-24T19:57:07.534062+0000","last_active":"2023-12-24T19:57:07.534151+0000","last_peered":"2023-12-24T19:57:07.534151+0000","last_clean":"2023-12-24T19:57:07.534151+0000","last_became_active":"2023-12-24T19:57:07.533898+0000","last_became_peered":"2023-12-24T19:57:07.533898+0000","last_unstale":"2023-12-24T19:57:07.534151+0000","last_undegraded":"2023-12-24T19:57:07.534151+0000","last_fullsized":"2023-12-24T19:57:07.534151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536398+0000","last_change":"2023-12-24T19:57:06.525416+0000","last_active":"2023-12-24T19:57:07.536398+0000","last_peered":"2023-12-24T19:57:07.536398+0000","last_clean":"2023-12-24T19:57:07.536398+0000","last_became_active":"2023-12-24T19:57:06.525105+0000","last_became_peered":"2023-12-24T19:57:06.525105+0000","last_unstale":"2023-12-24T19:57:07.536398+0000","last_undegraded":"2023-12-24T19:57:07.536398+0000","last_fullsized":"2023-12-24T19:57:07.536398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518611+0000","last_change":"2023-12-24T19:57:07.518192+0000","last_active":"2023-12-24T19:57:07.518611+0000","last_peered":"2023-12-24T19:57:07.518611+0000","last_clean":"2023-12-24T19:57:07.518611+0000","last_became_active":"2023-12-24T19:57:07.517957+0000","last_became_peered":"2023-12-24T19:57:07.517957+0000","last_unstale":"2023-12-24T19:57:07.518611+0000","last_undegraded":"2023-12-24T19:57:07.518611+0000","last_fullsized":"2023-12-24T19:57:07.518611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526634+0000","last_change":"2023-12-24T19:57:06.526486+0000","last_active":"2023-12-24T19:57:07.526634+0000","last_peered":"2023-12-24T19:57:07.526634+0000","last_clean":"2023-12-24T19:57:07.526634+0000","last_became_active":"2023-12-24T19:57:06.526260+0000","last_became_peered":"2023-12-24T19:57:06.526260+0000","last_unstale":"2023-12-24T19:57:07.526634+0000","last_undegraded":"2023-12-24T19:57:07.526634+0000","last_fullsized":"2023-12-24T19:57:07.526634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:46.616394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525256+0000","last_change":"2023-12-24T19:57:07.525195+0000","last_active":"2023-12-24T19:57:07.525256+0000","last_peered":"2023-12-24T19:57:07.525256+0000","last_clean":"2023-12-24T19:57:07.525256+0000","last_became_active":"2023-12-24T19:57:07.524903+0000","last_became_peered":"2023-12-24T19:57:07.524903+0000","last_unstale":"2023-12-24T19:57:07.525256+0000","last_undegraded":"2023-12-24T19:57:07.525256+0000","last_fullsized":"2023-12-24T19:57:07.525256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517242+0000","last_change":"2023-12-24T19:57:06.524497+0000","last_active":"2023-12-24T19:57:07.517242+0000","last_peered":"2023-12-24T19:57:07.517242+0000","last_clean":"2023-12-24T19:57:07.517242+0000","last_became_active":"2023-12-24T19:57:06.524278+0000","last_became_peered":"2023-12-24T19:57:06.524278+0000","last_unstale":"2023-12-24T19:57:07.517242+0000","last_undegraded":"2023-12-24T19:57:07.517242+0000","last_fullsized":"2023-12-24T19:57:07.517242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526976+0000","last_change":"2023-12-24T19:57:07.526151+0000","last_active":"2023-12-24T19:57:07.526976+0000","last_peered":"2023-12-24T19:57:07.526976+0000","last_clean":"2023-12-24T19:57:07.526976+0000","last_became_active":"2023-12-24T19:57:07.525918+0000","last_became_peered":"2023-12-24T19:57:07.525918+0000","last_unstale":"2023-12-24T19:57:07.526976+0000","last_undegraded":"2023-12-24T19:57:07.526976+0000","last_fullsized":"2023-12-24T19:57:07.526976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516440+0000","last_change":"2023-12-24T19:57:06.518972+0000","last_active":"2023-12-24T19:57:07.516440+0000","last_peered":"2023-12-24T19:57:07.516440+0000","last_clean":"2023-12-24T19:57:07.516440+0000","last_became_active":"2023-12-24T19:57:06.518437+0000","last_became_peered":"2023-12-24T19:57:06.518437+0000","last_unstale":"2023-12-24T19:57:07.516440+0000","last_undegraded":"2023-12-24T19:57:07.516440+0000","last_fullsized":"2023-12-24T19:57:07.516440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:51.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531001+0000","last_change":"2023-12-24T19:57:07.530312+0000","last_active":"2023-12-24T19:57:07.531001+0000","last_peered":"2023-12-24T19:57:07.531001+0000","last_clean":"2023-12-24T19:57:07.531001+0000","last_became_active":"2023-12-24T19:57:07.529911+0000","last_became_peered":"2023-12-24T19:57:07.529911+0000","last_unstale":"2023-12-24T19:57:07.531001+0000","last_undegraded":"2023-12-24T19:57:07.531001+0000","last_fullsized":"2023-12-24T19:57:07.531001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.533595+0000","last_change":"2023-12-24T19:57:06.527759+0000","last_active":"2023-12-24T19:57:07.533595+0000","last_peered":"2023-12-24T19:57:07.533595+0000","last_clean":"2023-12-24T19:57:07.533595+0000","last_became_active":"2023-12-24T19:57:06.527500+0000","last_became_peered":"2023-12-24T19:57:06.527500+0000","last_unstale":"2023-12-24T19:57:07.533595+0000","last_undegraded":"2023-12-24T19:57:07.533595+0000","last_fullsized":"2023-12-24T19:57:07.533595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525889+0000","last_change":"2023-12-24T19:57:07.525825+0000","last_active":"2023-12-24T19:57:07.525889+0000","last_peered":"2023-12-24T19:57:07.525889+0000","last_clean":"2023-12-24T19:57:07.525889+0000","last_became_active":"2023-12-24T19:57:07.525212+0000","last_became_peered":"2023-12-24T19:57:07.525212+0000","last_unstale":"2023-12-24T19:57:07.525889+0000","last_undegraded":"2023-12-24T19:57:07.525889+0000","last_fullsized":"2023-12-24T19:57:07.525889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.514129+0000","last_change":"2023-12-24T19:57:06.523392+0000","last_active":"2023-12-24T19:57:07.514129+0000","last_peered":"2023-12-24T19:57:07.514129+0000","last_clean":"2023-12-24T19:57:07.514129+0000","last_became_active":"2023-12-24T19:57:06.523144+0000","last_became_peered":"2023-12-24T19:57:06.523144+0000","last_unstale":"2023-12-24T19:57:07.514129+0000","last_undegraded":"2023-12-24T19:57:07.514129+0000","last_fullsized":"2023-12-24T19:57:07.514129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532749+0000","last_change":"2023-12-24T19:57:07.532683+0000","last_active":"2023-12-24T19:57:07.532749+0000","last_peered":"2023-12-24T19:57:07.532749+0000","last_clean":"2023-12-24T19:57:07.532749+0000","last_became_active":"2023-12-24T19:57:07.532453+0000","last_became_peered":"2023-12-24T19:57:07.532453+0000","last_unstale":"2023-12-24T19:57:07.532749+0000","last_undegraded":"2023-12-24T19:57:07.532749+0000","last_fullsized":"2023-12-24T19:57:07.532749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:39.083422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524143+0000","last_change":"2023-12-24T19:57:06.524540+0000","last_active":"2023-12-24T19:57:07.524143+0000","last_peered":"2023-12-24T19:57:07.524143+0000","last_clean":"2023-12-24T19:57:07.524143+0000","last_became_active":"2023-12-24T19:57:06.524289+0000","last_became_peered":"2023-12-24T19:57:06.524289+0000","last_unstale":"2023-12-24T19:57:07.524143+0000","last_undegraded":"2023-12-24T19:57:07.524143+0000","last_fullsized":"2023-12-24T19:57:07.524143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530781+0000","last_change":"2023-12-24T19:57:07.527389+0000","last_active":"2023-12-24T19:57:07.530781+0000","last_peered":"2023-12-24T19:57:07.530781+0000","last_clean":"2023-12-24T19:57:07.530781+0000","last_became_active":"2023-12-24T19:57:07.527176+0000","last_became_peered":"2023-12-24T19:57:07.527176+0000","last_unstale":"2023-12-24T19:57:07.530781+0000","last_undegraded":"2023-12-24T19:57:07.530781+0000","last_fullsized":"2023-12-24T19:57:07.530781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:49.060653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530624+0000","last_change":"2023-12-24T19:57:06.521236+0000","last_active":"2023-12-24T19:57:07.530624+0000","last_peered":"2023-12-24T19:57:07.530624+0000","last_clean":"2023-12-24T19:57:07.530624+0000","last_became_active":"2023-12-24T19:57:06.520985+0000","last_became_peered":"2023-12-24T19:57:06.520985+0000","last_unstale":"2023-12-24T19:57:07.530624+0000","last_undegraded":"2023-12-24T19:57:07.530624+0000","last_fullsized":"2023-12-24T19:57:07.530624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531745+0000","last_change":"2023-12-24T19:57:07.530650+0000","last_active":"2023-12-24T19:57:07.531745+0000","last_peered":"2023-12-24T19:57:07.531745+0000","last_clean":"2023-12-24T19:57:07.531745+0000","last_became_active":"2023-12-24T19:57:07.528576+0000","last_became_peered":"2023-12-24T19:57:07.528576+0000","last_unstale":"2023-12-24T19:57:07.531745+0000","last_undegraded":"2023-12-24T19:57:07.531745+0000","last_fullsized":"2023-12-24T19:57:07.531745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:54:49.589999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.521561+0000","last_change":"2023-12-24T19:57:07.520973+0000","last_active":"2023-12-24T19:57:07.521561+0000","last_peered":"2023-12-24T19:57:07.521561+0000","last_clean":"2023-12-24T19:57:07.521561+0000","last_became_active":"2023-12-24T19:57:07.520830+0000","last_became_peered":"2023-12-24T19:57:07.520830+0000","last_unstale":"2023-12-24T19:57:07.521561+0000","last_undegraded":"2023-12-24T19:57:07.521561+0000","last_fullsized":"2023-12-24T19:57:07.521561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519817+0000","last_change":"2023-12-24T19:57:07.519770+0000","last_active":"2023-12-24T19:57:07.519817+0000","last_peered":"2023-12-24T19:57:07.519817+0000","last_clean":"2023-12-24T19:57:07.519817+0000","last_became_active":"2023-12-24T19:57:07.519599+0000","last_became_peered":"2023-12-24T19:57:07.519599+0000","last_unstale":"2023-12-24T19:57:07.519817+0000","last_undegraded":"2023-12-24T19:57:07.519817+0000","last_fullsized":"2023-12-24T19:57:07.519817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526841+0000","last_change":"2023-12-24T19:57:07.526619+0000","last_active":"2023-12-24T19:57:07.526841+0000","last_peered":"2023-12-24T19:57:07.526841+0000","last_clean":"2023-12-24T19:57:07.526841+0000","last_became_active":"2023-12-24T19:57:07.526393+0000","last_became_peered":"2023-12-24T19:57:07.526393+0000","last_unstale":"2023-12-24T19:57:07.526841+0000","last_undegraded":"2023-12-24T19:57:07.526841+0000","last_fullsized":"2023-12-24T19:57:07.526841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530703+0000","last_change":"2023-12-24T19:57:07.530632+0000","last_active":"2023-12-24T19:57:07.530703+0000","last_peered":"2023-12-24T19:57:07.530703+0000","last_clean":"2023-12-24T19:57:07.530703+0000","last_became_active":"2023-12-24T19:57:07.530304+0000","last_became_peered":"2023-12-24T19:57:07.530304+0000","last_unstale":"2023-12-24T19:57:07.530703+0000","last_undegraded":"2023-12-24T19:57:07.530703+0000","last_fullsized":"2023-12-24T19:57:07.530703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528770+0000","last_change":"2023-12-24T19:57:07.528719+0000","last_active":"2023-12-24T19:57:07.528770+0000","last_peered":"2023-12-24T19:57:07.528770+0000","last_clean":"2023-12-24T19:57:07.528770+0000","last_became_active":"2023-12-24T19:57:07.528307+0000","last_became_peered":"2023-12-24T19:57:07.528307+0000","last_unstale":"2023-12-24T19:57:07.528770+0000","last_undegraded":"2023-12-24T19:57:07.528770+0000","last_fullsized":"2023-12-24T19:57:07.528770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526251+0000","last_change":"2023-12-24T19:57:07.526152+0000","last_active":"2023-12-24T19:57:07.526251+0000","last_peered":"2023-12-24T19:57:07.526251+0000","last_clean":"2023-12-24T19:57:07.526251+0000","last_became_active":"2023-12-24T19:57:07.525938+0000","last_became_peered":"2023-12-24T19:57:07.525938+0000","last_unstale":"2023-12-24T19:57:07.526251+0000","last_undegraded":"2023-12-24T19:57:07.526251+0000","last_fullsized":"2023-12-24T19:57:07.526251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534227+0000","last_change":"2023-12-24T19:57:07.534143+0000","last_active":"2023-12-24T19:57:07.534227+0000","last_peered":"2023-12-24T19:57:07.534227+0000","last_clean":"2023-12-24T19:57:07.534227+0000","last_became_active":"2023-12-24T19:57:07.533934+0000","last_became_peered":"2023-12-24T19:57:07.533934+0000","last_unstale":"2023-12-24T19:57:07.534227+0000","last_undegraded":"2023-12-24T19:57:07.534227+0000","last_fullsized":"2023-12-24T19:57:07.534227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526994+0000","last_change":"2023-12-24T19:57:07.526319+0000","last_active":"2023-12-24T19:57:07.526994+0000","last_peered":"2023-12-24T19:57:07.526994+0000","last_clean":"2023-12-24T19:57:07.526994+0000","last_became_active":"2023-12-24T19:57:07.526080+0000","last_became_peered":"2023-12-24T19:57:07.526080+0000","last_unstale":"2023-12-24T19:57:07.526994+0000","last_undegraded":"2023-12-24T19:57:07.526994+0000","last_fullsized":"2023-12-24T19:57:07.526994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531848+0000","last_change":"2023-12-24T19:57:07.530837+0000","last_active":"2023-12-24T19:57:07.531848+0000","last_peered":"2023-12-24T19:57:07.531848+0000","last_clean":"2023-12-24T19:57:07.531848+0000","last_became_active":"2023-12-24T19:57:07.527904+0000","last_became_peered":"2023-12-24T19:57:07.527904+0000","last_unstale":"2023-12-24T19:57:07.531848+0000","last_undegraded":"2023-12-24T19:57:07.531848+0000","last_fullsized":"2023-12-24T19:57:07.531848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528649+0000","last_change":"2023-12-24T19:57:07.528578+0000","last_active":"2023-12-24T19:57:07.528649+0000","last_peered":"2023-12-24T19:57:07.528649+0000","last_clean":"2023-12-24T19:57:07.528649+0000","last_became_active":"2023-12-24T19:57:07.528029+0000","last_became_peered":"2023-12-24T19:57:07.528029+0000","last_unstale":"2023-12-24T19:57:07.528649+0000","last_undegraded":"2023-12-24T19:57:07.528649+0000","last_fullsized":"2023-12-24T19:57:07.528649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535175+0000","last_change":"2023-12-24T19:57:07.535104+0000","last_active":"2023-12-24T19:57:07.535175+0000","last_peered":"2023-12-24T19:57:07.535175+0000","last_clean":"2023-12-24T19:57:07.535175+0000","last_became_active":"2023-12-24T19:57:07.534556+0000","last_became_peered":"2023-12-24T19:57:07.534556+0000","last_unstale":"2023-12-24T19:57:07.535175+0000","last_undegraded":"2023-12-24T19:57:07.535175+0000","last_fullsized":"2023-12-24T19:57:07.535175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:52:11.849851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534469+0000","last_change":"2023-12-24T19:57:07.534398+0000","last_active":"2023-12-24T19:57:07.534469+0000","last_peered":"2023-12-24T19:57:07.534469+0000","last_clean":"2023-12-24T19:57:07.534469+0000","last_became_active":"2023-12-24T19:57:07.534052+0000","last_became_peered":"2023-12-24T19:57:07.534052+0000","last_unstale":"2023-12-24T19:57:07.534469+0000","last_undegraded":"2023-12-24T19:57:07.534469+0000","last_fullsized":"2023-12-24T19:57:07.534469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526814+0000","last_change":"2023-12-24T19:57:07.526507+0000","last_active":"2023-12-24T19:57:07.526814+0000","last_peered":"2023-12-24T19:57:07.526814+0000","last_clean":"2023-12-24T19:57:07.526814+0000","last_became_active":"2023-12-24T19:57:07.526282+0000","last_became_peered":"2023-12-24T19:57:07.526282+0000","last_unstale":"2023-12-24T19:57:07.526814+0000","last_undegraded":"2023-12-24T19:57:07.526814+0000","last_fullsized":"2023-12-24T19:57:07.526814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]}],"pool_statfs":[]}} 2023-12-24T19:57:20.469 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:57:20.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.626+0000 7fccb2ff7700 1 Processor -- start 2023-12-24T19:57:20.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.626+0000 7fccb2ff7700 1 -- start start 2023-12-24T19:57:20.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb2ff7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 0x7fccac070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb2ff7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fccac0b04c0 0x7fccac0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb2ff7700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac06a090 con 0x7fccac159e60 2023-12-24T19:57:20.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb2ff7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccac06ac10 con 0x7fccac0b04c0 2023-12-24T19:57:20.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb2ff7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac06a2e0 con 0x7fccac159a90 2023-12-24T19:57:20.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb1594700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fccac0b04c0 0x7fccac0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccabfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fccac159e60 0x7fccac0c93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41722/0 (socket says 172.21.15.61:41722) 2023-12-24T19:57:20.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb1594700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fccac0b04c0 0x7fccac0c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53446/0 (socket says 172.21.15.61:53446) 2023-12-24T19:57:20.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccabfff700 1 -- 172.21.15.61:0/759338024 learned_addr learned my addr 172.21.15.61:0/759338024 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:20.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb0d93700 1 --2- 172.21.15.61:0/759338024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 0x7fccac070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb1594700 1 -- 172.21.15.61:0/759338024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 msgr2=0x7fccac070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb1594700 1 --2- 172.21.15.61:0/759338024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 0x7fccac070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb1594700 1 -- 172.21.15.61:0/759338024 >> v1:172.21.15.61:6789/0 conn(0x7fccac159e60 legacy=0x7fccac0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb1594700 1 -- 172.21.15.61:0/759338024 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac06a5c0 con 0x7fccac0b04c0 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccab7fe700 1 -- 172.21.15.61:0/759338024 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819176696 0 0) 0x7fccac06a090 con 0x7fccac159e60 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.627+0000 7fccb0d93700 1 --2- 172.21.15.61:0/759338024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 0x7fccac070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccb1594700 1 --2- 172.21.15.61:0/759338024 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 0x7fccac0c9ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009e60 tx=0x7fcca4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75adb53d67f69d3b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccab7fe700 1 -- 172.21.15.61:0/759338024 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca400e070 con 0x7fccac0b04c0 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccab7fe700 1 -- 172.21.15.61:0/759338024 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca400bc30 con 0x7fccac0b04c0 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccab7fe700 1 -- 172.21.15.61:0/759338024 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4012430 con 0x7fccac0b04c0 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccb2ff7700 1 -- 172.21.15.61:0/759338024 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 msgr2=0x7fccac0c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccb2ff7700 1 --2- 172.21.15.61:0/759338024 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 0x7fccac0c9ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009e60 tx=0x7fcca4009780 comp rx=0 tx=0).stop 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccb2ff7700 1 -- 172.21.15.61:0/759338024 shutdown_connections 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccb2ff7700 1 --2- 172.21.15.61:0/759338024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 0x7fccac070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccb2ff7700 1 --2- 172.21.15.61:0/759338024 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 0x7fccac0c9ad0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccb2ff7700 1 -- 172.21.15.61:0/759338024 >> 172.21.15.61:0/759338024 conn(0x7fccac0cd6f0 msgr2=0x7fccac0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:20.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccb2ff7700 1 -- 172.21.15.61:0/759338024 shutdown_connections 2023-12-24T19:57:20.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.628+0000 7fccb2ff7700 1 -- 172.21.15.61:0/759338024 wait complete. 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.629+0000 7fccb2ff7700 1 Processor -- start 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.630+0000 7fccb2ff7700 1 -- start start 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.630+0000 7fccb2ff7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 0x7fccac0c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.630+0000 7fccb2ff7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 0x7fccac0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.630+0000 7fccb2ff7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccac159e60 0x7fccac168b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.630+0000 7fccb2ff7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0c6740 con 0x7fccac0b04c0 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.630+0000 7fccb2ff7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac16a740 con 0x7fccac159e60 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.630+0000 7fccb2ff7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0c7920 con 0x7fccac159a90 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.630+0000 7fccb0d93700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 0x7fccac0c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.630+0000 7fccb0d93700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 0x7fccac0c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53460/0 (socket says 172.21.15.61:53460) 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.630+0000 7fccb0d93700 1 -- 172.21.15.61:0/2030188187 learned_addr learned my addr 172.21.15.61:0/2030188187 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccb1594700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccac159e60 0x7fccac168b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccabfff700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 0x7fccac0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccb0d93700 1 -- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 msgr2=0x7fccac0b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccb0d93700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 0x7fccac0b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccb0d93700 1 -- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccac159e60 msgr2=0x7fccac168b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccb0d93700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccac159e60 0x7fccac168b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccb0d93700 1 -- 172.21.15.61:0/2030188187 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca4009a20 con 0x7fccac0b04c0 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccb1594700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccac159e60 0x7fccac168b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccb0d93700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 0x7fccac0c73e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcca000e8d0 tx=0x7fcca0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fcca8ff9700 1 -- 172.21.15.61:0/2030188187 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000ee70 con 0x7fccac0b04c0 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fcca8ff9700 1 -- 172.21.15.61:0/2030188187 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca000c580 con 0x7fccac0b04c0 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccb2ff7700 1 -- 172.21.15.61:0/2030188187 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac16da20 con 0x7fccac0b04c0 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fcca8ff9700 1 -- 172.21.15.61:0/2030188187 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000c920 con 0x7fccac0b04c0 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.631+0000 7fccb2ff7700 1 -- 172.21.15.61:0/2030188187 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac0c6ee0 con 0x7fccac0b04c0 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.632+0000 7fccb2ff7700 1 -- 172.21.15.61:0/2030188187 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac04c3c0 con 0x7fccac0b04c0 2023-12-24T19:57:20.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.633+0000 7fcca8ff9700 1 -- 172.21.15.61:0/2030188187 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcca000cd10 con 0x7fccac0b04c0 2023-12-24T19:57:20.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.633+0000 7fcca8ff9700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc90066f30 0x7fcc900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:20.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.633+0000 7fcca8ff9700 1 -- 172.21.15.61:0/2030188187 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcca0084290 con 0x7fccac0b04c0 2023-12-24T19:57:20.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.633+0000 7fccabfff700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc90066f30 0x7fcc900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:20.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.634+0000 7fccabfff700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc90066f30 0x7fcc900693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fccac15a250 tx=0x7fcc98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:20.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.637+0000 7fcca8ff9700 1 -- 172.21.15.61:0/2030188187 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcca0051500 con 0x7fccac0b04c0 2023-12-24T19:57:20.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.827+0000 7fccb2ff7700 1 -- 172.21.15.61:0/2030188187 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fccac0cad40 con 0x7fcc90066f30 2023-12-24T19:57:20.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.834+0000 7fcca8ff9700 1 -- 172.21.15.61:0/2030188187 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260178 (secure 0 0 0) 0x7fccac0cad40 con 0x7fcc90066f30 2023-12-24T19:57:20.838 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.837+0000 7fccb2ff7700 1 -- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc90066f30 msgr2=0x7fcc900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.837+0000 7fccb2ff7700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc90066f30 0x7fcc900693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fccac15a250 tx=0x7fcc98009040 comp rx=0 tx=0).stop 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.837+0000 7fccb2ff7700 1 -- 172.21.15.61:0/2030188187 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 msgr2=0x7fccac0c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.837+0000 7fccb2ff7700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 0x7fccac0c73e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcca000e8d0 tx=0x7fcca0008040 comp rx=0 tx=0).stop 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.837+0000 7fccb2ff7700 1 -- 172.21.15.61:0/2030188187 shutdown_connections 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.837+0000 7fccb2ff7700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc90066f30 0x7fcc900693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.837+0000 7fccb2ff7700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccac159e60 0x7fccac168b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.837+0000 7fccb2ff7700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccac0b04c0 0x7fccac0c73e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.837+0000 7fccb2ff7700 1 --2- 172.21.15.61:0/2030188187 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccac159a90 0x7fccac0b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.837+0000 7fccb2ff7700 1 -- 172.21.15.61:0/2030188187 >> 172.21.15.61:0/2030188187 conn(0x7fccac0cd6f0 msgr2=0x7fccac0ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.838+0000 7fccb2ff7700 1 -- 172.21.15.61:0/2030188187 shutdown_connections 2023-12-24T19:57:20.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:20.838+0000 7fccb2ff7700 1 -- 172.21.15.61:0/2030188187 wait complete. 2023-12-24T19:57:20.841 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:57:20.850 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-24T19:57:20.310838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1708,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560791,"statfs":{"total":1600000000,"available":1598250700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.797168"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536218+0000","last_change":"2023-12-24T19:57:07.536146+0000","last_active":"2023-12-24T19:57:07.536218+0000","last_peered":"2023-12-24T19:57:07.536218+0000","last_clean":"2023-12-24T19:57:07.536218+0000","last_became_active":"2023-12-24T19:57:07.535549+0000","last_became_peered":"2023-12-24T19:57:07.535549+0000","last_unstale":"2023-12-24T19:57:07.536218+0000","last_undegraded":"2023-12-24T19:57:07.536218+0000","last_fullsized":"2023-12-24T19:57:07.536218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:52.100502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519135+0000","last_change":"2023-12-24T19:57:07.519070+0000","last_active":"2023-12-24T19:57:07.519135+0000","last_peered":"2023-12-24T19:57:07.519135+0000","last_clean":"2023-12-24T19:57:07.519135+0000","last_became_active":"2023-12-24T19:57:07.518830+0000","last_became_peered":"2023-12-24T19:57:07.518830+0000","last_unstale":"2023-12-24T19:57:07.519135+0000","last_undegraded":"2023-12-24T19:57:07.519135+0000","last_fullsized":"2023-12-24T19:57:07.519135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515907+0000","last_change":"2023-12-24T19:57:07.515829+0000","last_active":"2023-12-24T19:57:07.515907+0000","last_peered":"2023-12-24T19:57:07.515907+0000","last_clean":"2023-12-24T19:57:07.515907+0000","last_became_active":"2023-12-24T19:57:07.515554+0000","last_became_peered":"2023-12-24T19:57:07.515554+0000","last_unstale":"2023-12-24T19:57:07.515907+0000","last_undegraded":"2023-12-24T19:57:07.515907+0000","last_fullsized":"2023-12-24T19:57:07.515907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531866+0000","last_change":"2023-12-24T19:57:07.531458+0000","last_active":"2023-12-24T19:57:07.531866+0000","last_peered":"2023-12-24T19:57:07.531866+0000","last_clean":"2023-12-24T19:57:07.531866+0000","last_became_active":"2023-12-24T19:57:07.530225+0000","last_became_peered":"2023-12-24T19:57:07.530225+0000","last_unstale":"2023-12-24T19:57:07.531866+0000","last_undegraded":"2023-12-24T19:57:07.531866+0000","last_fullsized":"2023-12-24T19:57:07.531866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:21.152234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535982+0000","last_change":"2023-12-24T19:57:07.534875+0000","last_active":"2023-12-24T19:57:07.535982+0000","last_peered":"2023-12-24T19:57:07.535982+0000","last_clean":"2023-12-24T19:57:07.535982+0000","last_became_active":"2023-12-24T19:57:07.534444+0000","last_became_peered":"2023-12-24T19:57:07.534444+0000","last_unstale":"2023-12-24T19:57:07.535982+0000","last_undegraded":"2023-12-24T19:57:07.535982+0000","last_fullsized":"2023-12-24T19:57:07.535982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520980+0000","last_change":"2023-12-24T19:57:07.520108+0000","last_active":"2023-12-24T19:57:07.520980+0000","last_peered":"2023-12-24T19:57:07.520980+0000","last_clean":"2023-12-24T19:57:07.520980+0000","last_became_active":"2023-12-24T19:57:07.519639+0000","last_became_peered":"2023-12-24T19:57:07.519639+0000","last_unstale":"2023-12-24T19:57:07.520980+0000","last_undegraded":"2023-12-24T19:57:07.520980+0000","last_fullsized":"2023-12-24T19:57:07.520980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.537256+0000","last_change":"2023-12-24T19:57:07.537204+0000","last_active":"2023-12-24T19:57:07.537256+0000","last_peered":"2023-12-24T19:57:07.537256+0000","last_clean":"2023-12-24T19:57:07.537256+0000","last_became_active":"2023-12-24T19:57:07.535804+0000","last_became_peered":"2023-12-24T19:57:07.535804+0000","last_unstale":"2023-12-24T19:57:07.537256+0000","last_undegraded":"2023-12-24T19:57:07.537256+0000","last_fullsized":"2023-12-24T19:57:07.537256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:08:43.312235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525929+0000","last_change":"2023-12-24T19:57:07.525839+0000","last_active":"2023-12-24T19:57:07.525929+0000","last_peered":"2023-12-24T19:57:07.525929+0000","last_clean":"2023-12-24T19:57:07.525929+0000","last_became_active":"2023-12-24T19:57:07.525535+0000","last_became_peered":"2023-12-24T19:57:07.525535+0000","last_unstale":"2023-12-24T19:57:07.525929+0000","last_undegraded":"2023-12-24T19:57:07.525929+0000","last_fullsized":"2023-12-24T19:57:07.525929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532601+0000","last_change":"2023-12-24T19:57:07.532497+0000","last_active":"2023-12-24T19:57:07.532601+0000","last_peered":"2023-12-24T19:57:07.532601+0000","last_clean":"2023-12-24T19:57:07.532601+0000","last_became_active":"2023-12-24T19:57:07.532280+0000","last_became_peered":"2023-12-24T19:57:07.532280+0000","last_unstale":"2023-12-24T19:57:07.532601+0000","last_undegraded":"2023-12-24T19:57:07.532601+0000","last_fullsized":"2023-12-24T19:57:07.532601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:01.279518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520933+0000","last_change":"2023-12-24T19:57:07.520487+0000","last_active":"2023-12-24T19:57:07.520933+0000","last_peered":"2023-12-24T19:57:07.520933+0000","last_clean":"2023-12-24T19:57:07.520933+0000","last_became_active":"2023-12-24T19:57:07.520238+0000","last_became_peered":"2023-12-24T19:57:07.520238+0000","last_unstale":"2023-12-24T19:57:07.520933+0000","last_undegraded":"2023-12-24T19:57:07.520933+0000","last_fullsized":"2023-12-24T19:57:07.520933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:16:20.311262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.521578+0000","last_change":"2023-12-24T19:57:07.521484+0000","last_active":"2023-12-24T19:57:07.521578+0000","last_peered":"2023-12-24T19:57:07.521578+0000","last_clean":"2023-12-24T19:57:07.521578+0000","last_became_active":"2023-12-24T19:57:07.521255+0000","last_became_peered":"2023-12-24T19:57:07.521255+0000","last_unstale":"2023-12-24T19:57:07.521578+0000","last_undegraded":"2023-12-24T19:57:07.521578+0000","last_fullsized":"2023-12-24T19:57:07.521578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527053+0000","last_change":"2023-12-24T19:57:07.526737+0000","last_active":"2023-12-24T19:57:07.527053+0000","last_peered":"2023-12-24T19:57:07.527053+0000","last_clean":"2023-12-24T19:57:07.527053+0000","last_became_active":"2023-12-24T19:57:07.526481+0000","last_became_peered":"2023-12-24T19:57:07.526481+0000","last_unstale":"2023-12-24T19:57:07.527053+0000","last_undegraded":"2023-12-24T19:57:07.527053+0000","last_fullsized":"2023-12-24T19:57:07.527053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:15.825581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530680+0000","last_change":"2023-12-24T19:57:07.530165+0000","last_active":"2023-12-24T19:57:07.530680+0000","last_peered":"2023-12-24T19:57:07.530680+0000","last_clean":"2023-12-24T19:57:07.530680+0000","last_became_active":"2023-12-24T19:57:07.529444+0000","last_became_peered":"2023-12-24T19:57:07.529444+0000","last_unstale":"2023-12-24T19:57:07.530680+0000","last_undegraded":"2023-12-24T19:57:07.530680+0000","last_fullsized":"2023-12-24T19:57:07.530680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518630+0000","last_change":"2023-12-24T19:57:07.518298+0000","last_active":"2023-12-24T19:57:07.518630+0000","last_peered":"2023-12-24T19:57:07.518630+0000","last_clean":"2023-12-24T19:57:07.518630+0000","last_became_active":"2023-12-24T19:57:07.517984+0000","last_became_peered":"2023-12-24T19:57:07.517984+0000","last_unstale":"2023-12-24T19:57:07.518630+0000","last_undegraded":"2023-12-24T19:57:07.518630+0000","last_fullsized":"2023-12-24T19:57:07.518630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524033+0000","last_change":"2023-12-24T19:57:07.523925+0000","last_active":"2023-12-24T19:57:07.524033+0000","last_peered":"2023-12-24T19:57:07.524033+0000","last_clean":"2023-12-24T19:57:07.524033+0000","last_became_active":"2023-12-24T19:57:07.523700+0000","last_became_peered":"2023-12-24T19:57:07.523700+0000","last_unstale":"2023-12-24T19:57:07.524033+0000","last_undegraded":"2023-12-24T19:57:07.524033+0000","last_fullsized":"2023-12-24T19:57:07.524033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520963+0000","last_change":"2023-12-24T19:57:07.519865+0000","last_active":"2023-12-24T19:57:07.520963+0000","last_peered":"2023-12-24T19:57:07.520963+0000","last_clean":"2023-12-24T19:57:07.520963+0000","last_became_active":"2023-12-24T19:57:07.519280+0000","last_became_peered":"2023-12-24T19:57:07.519280+0000","last_unstale":"2023-12-24T19:57:07.520963+0000","last_undegraded":"2023-12-24T19:57:07.520963+0000","last_fullsized":"2023-12-24T19:57:07.520963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535309+0000","last_change":"2023-12-24T19:57:07.535246+0000","last_active":"2023-12-24T19:57:07.535309+0000","last_peered":"2023-12-24T19:57:07.535309+0000","last_clean":"2023-12-24T19:57:07.535309+0000","last_became_active":"2023-12-24T19:57:07.534766+0000","last_became_peered":"2023-12-24T19:57:07.534766+0000","last_unstale":"2023-12-24T19:57:07.535309+0000","last_undegraded":"2023-12-24T19:57:07.535309+0000","last_fullsized":"2023-12-24T19:57:07.535309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:41:01.279518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518582+0000","last_change":"2023-12-24T19:57:07.518511+0000","last_active":"2023-12-24T19:57:07.518582+0000","last_peered":"2023-12-24T19:57:07.518582+0000","last_clean":"2023-12-24T19:57:07.518582+0000","last_became_active":"2023-12-24T19:57:07.518256+0000","last_became_peered":"2023-12-24T19:57:07.518256+0000","last_unstale":"2023-12-24T19:57:07.518582+0000","last_undegraded":"2023-12-24T19:57:07.518582+0000","last_fullsized":"2023-12-24T19:57:07.518582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535963+0000","last_change":"2023-12-24T19:57:07.534422+0000","last_active":"2023-12-24T19:57:07.535963+0000","last_peered":"2023-12-24T19:57:07.535963+0000","last_clean":"2023-12-24T19:57:07.535963+0000","last_became_active":"2023-12-24T19:57:07.533941+0000","last_became_peered":"2023-12-24T19:57:07.533941+0000","last_unstale":"2023-12-24T19:57:07.535963+0000","last_undegraded":"2023-12-24T19:57:07.535963+0000","last_fullsized":"2023-12-24T19:57:07.535963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529337+0000","last_change":"2023-12-24T19:57:06.524904+0000","last_active":"2023-12-24T19:57:07.529337+0000","last_peered":"2023-12-24T19:57:07.529337+0000","last_clean":"2023-12-24T19:57:07.529337+0000","last_became_active":"2023-12-24T19:57:06.524655+0000","last_became_peered":"2023-12-24T19:57:06.524655+0000","last_unstale":"2023-12-24T19:57:07.529337+0000","last_undegraded":"2023-12-24T19:57:07.529337+0000","last_fullsized":"2023-12-24T19:57:07.529337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530981+0000","last_change":"2023-12-24T19:57:07.530215+0000","last_active":"2023-12-24T19:57:07.530981+0000","last_peered":"2023-12-24T19:57:07.530981+0000","last_clean":"2023-12-24T19:57:07.530981+0000","last_became_active":"2023-12-24T19:57:07.529530+0000","last_became_peered":"2023-12-24T19:57:07.529530+0000","last_unstale":"2023-12-24T19:57:07.530981+0000","last_undegraded":"2023-12-24T19:57:07.530981+0000","last_fullsized":"2023-12-24T19:57:07.530981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:52.100502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530889+0000","last_change":"2023-12-24T19:57:06.513334+0000","last_active":"2023-12-24T19:57:07.530889+0000","last_peered":"2023-12-24T19:57:07.530889+0000","last_clean":"2023-12-24T19:57:07.530889+0000","last_became_active":"2023-12-24T19:57:06.513019+0000","last_became_peered":"2023-12-24T19:57:06.513019+0000","last_unstale":"2023-12-24T19:57:07.530889+0000","last_undegraded":"2023-12-24T19:57:07.530889+0000","last_fullsized":"2023-12-24T19:57:07.530889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517778+0000","last_change":"2023-12-24T19:57:07.517103+0000","last_active":"2023-12-24T19:57:07.517778+0000","last_peered":"2023-12-24T19:57:07.517778+0000","last_clean":"2023-12-24T19:57:07.517778+0000","last_became_active":"2023-12-24T19:57:07.516861+0000","last_became_peered":"2023-12-24T19:57:07.516861+0000","last_unstale":"2023-12-24T19:57:07.517778+0000","last_undegraded":"2023-12-24T19:57:07.517778+0000","last_fullsized":"2023-12-24T19:57:07.517778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536144+0000","last_change":"2023-12-24T19:57:06.525249+0000","last_active":"2023-12-24T19:57:07.536144+0000","last_peered":"2023-12-24T19:57:07.536144+0000","last_clean":"2023-12-24T19:57:07.536144+0000","last_became_active":"2023-12-24T19:57:06.525009+0000","last_became_peered":"2023-12-24T19:57:06.525009+0000","last_unstale":"2023-12-24T19:57:07.536144+0000","last_undegraded":"2023-12-24T19:57:07.536144+0000","last_fullsized":"2023-12-24T19:57:07.536144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:07.722680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523253+0000","last_change":"2023-12-24T19:57:07.523010+0000","last_active":"2023-12-24T19:57:07.523253+0000","last_peered":"2023-12-24T19:57:07.523253+0000","last_clean":"2023-12-24T19:57:07.523253+0000","last_became_active":"2023-12-24T19:57:07.522733+0000","last_became_peered":"2023-12-24T19:57:07.522733+0000","last_unstale":"2023-12-24T19:57:07.523253+0000","last_undegraded":"2023-12-24T19:57:07.523253+0000","last_fullsized":"2023-12-24T19:57:07.523253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532233+0000","last_change":"2023-12-24T19:57:06.527966+0000","last_active":"2023-12-24T19:57:07.532233+0000","last_peered":"2023-12-24T19:57:07.532233+0000","last_clean":"2023-12-24T19:57:07.532233+0000","last_became_active":"2023-12-24T19:57:06.527733+0000","last_became_peered":"2023-12-24T19:57:06.527733+0000","last_unstale":"2023-12-24T19:57:07.532233+0000","last_undegraded":"2023-12-24T19:57:07.532233+0000","last_fullsized":"2023-12-24T19:57:07.532233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:51.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523731+0000","last_change":"2023-12-24T19:57:07.523651+0000","last_active":"2023-12-24T19:57:07.523731+0000","last_peered":"2023-12-24T19:57:07.523731+0000","last_clean":"2023-12-24T19:57:07.523731+0000","last_became_active":"2023-12-24T19:57:07.523421+0000","last_became_peered":"2023-12-24T19:57:07.523421+0000","last_unstale":"2023-12-24T19:57:07.523731+0000","last_undegraded":"2023-12-24T19:57:07.523731+0000","last_fullsized":"2023-12-24T19:57:07.523731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528856+0000","last_change":"2023-12-24T19:57:06.525065+0000","last_active":"2023-12-24T19:57:07.528856+0000","last_peered":"2023-12-24T19:57:07.528856+0000","last_clean":"2023-12-24T19:57:07.528856+0000","last_became_active":"2023-12-24T19:57:06.524824+0000","last_became_peered":"2023-12-24T19:57:06.524824+0000","last_unstale":"2023-12-24T19:57:07.528856+0000","last_undegraded":"2023-12-24T19:57:07.528856+0000","last_fullsized":"2023-12-24T19:57:07.528856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:17.717686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.523500+0000","last_change":"2023-12-24T19:57:07.523416+0000","last_active":"2023-12-24T19:57:07.523500+0000","last_peered":"2023-12-24T19:57:07.523500+0000","last_clean":"2023-12-24T19:57:07.523500+0000","last_became_active":"2023-12-24T19:57:07.523188+0000","last_became_peered":"2023-12-24T19:57:07.523188+0000","last_unstale":"2023-12-24T19:57:07.523500+0000","last_undegraded":"2023-12-24T19:57:07.523500+0000","last_fullsized":"2023-12-24T19:57:07.523500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:47.622467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528383+0000","last_change":"2023-12-24T19:57:06.523002+0000","last_active":"2023-12-24T19:57:07.528383+0000","last_peered":"2023-12-24T19:57:07.528383+0000","last_clean":"2023-12-24T19:57:07.528383+0000","last_became_active":"2023-12-24T19:57:06.522751+0000","last_became_peered":"2023-12-24T19:57:06.522751+0000","last_unstale":"2023-12-24T19:57:07.528383+0000","last_undegraded":"2023-12-24T19:57:07.528383+0000","last_fullsized":"2023-12-24T19:57:07.528383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524533+0000","last_change":"2023-12-24T19:57:07.524449+0000","last_active":"2023-12-24T19:57:07.524533+0000","last_peered":"2023-12-24T19:57:07.524533+0000","last_clean":"2023-12-24T19:57:07.524533+0000","last_became_active":"2023-12-24T19:57:07.524202+0000","last_became_peered":"2023-12-24T19:57:07.524202+0000","last_unstale":"2023-12-24T19:57:07.524533+0000","last_undegraded":"2023-12-24T19:57:07.524533+0000","last_fullsized":"2023-12-24T19:57:07.524533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526502+0000","last_change":"2023-12-24T19:57:06.524481+0000","last_active":"2023-12-24T19:57:07.526502+0000","last_peered":"2023-12-24T19:57:07.526502+0000","last_clean":"2023-12-24T19:57:07.526502+0000","last_became_active":"2023-12-24T19:57:06.523848+0000","last_became_peered":"2023-12-24T19:57:06.523848+0000","last_unstale":"2023-12-24T19:57:07.526502+0000","last_undegraded":"2023-12-24T19:57:07.526502+0000","last_fullsized":"2023-12-24T19:57:07.526502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525501+0000","last_change":"2023-12-24T19:57:07.525363+0000","last_active":"2023-12-24T19:57:07.525501+0000","last_peered":"2023-12-24T19:57:07.525501+0000","last_clean":"2023-12-24T19:57:07.525501+0000","last_became_active":"2023-12-24T19:57:07.524804+0000","last_became_peered":"2023-12-24T19:57:07.524804+0000","last_unstale":"2023-12-24T19:57:07.525501+0000","last_undegraded":"2023-12-24T19:57:07.525501+0000","last_fullsized":"2023-12-24T19:57:07.525501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:38.268155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516808+0000","last_change":"2023-12-24T19:57:06.522784+0000","last_active":"2023-12-24T19:57:07.516808+0000","last_peered":"2023-12-24T19:57:07.516808+0000","last_clean":"2023-12-24T19:57:07.516808+0000","last_became_active":"2023-12-24T19:57:06.522559+0000","last_became_peered":"2023-12-24T19:57:06.522559+0000","last_unstale":"2023-12-24T19:57:07.516808+0000","last_undegraded":"2023-12-24T19:57:07.516808+0000","last_fullsized":"2023-12-24T19:57:07.516808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529007+0000","last_change":"2023-12-24T19:57:07.528916+0000","last_active":"2023-12-24T19:57:07.529007+0000","last_peered":"2023-12-24T19:57:07.529007+0000","last_clean":"2023-12-24T19:57:07.529007+0000","last_became_active":"2023-12-24T19:57:07.528614+0000","last_became_peered":"2023-12-24T19:57:07.528614+0000","last_unstale":"2023-12-24T19:57:07.529007+0000","last_undegraded":"2023-12-24T19:57:07.529007+0000","last_fullsized":"2023-12-24T19:57:07.529007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518133+0000","last_change":"2023-12-24T19:57:06.521620+0000","last_active":"2023-12-24T19:57:07.518133+0000","last_peered":"2023-12-24T19:57:07.518133+0000","last_clean":"2023-12-24T19:57:07.518133+0000","last_became_active":"2023-12-24T19:57:06.521329+0000","last_became_peered":"2023-12-24T19:57:06.521329+0000","last_unstale":"2023-12-24T19:57:07.518133+0000","last_undegraded":"2023-12-24T19:57:07.518133+0000","last_fullsized":"2023-12-24T19:57:07.518133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535124+0000","last_change":"2023-12-24T19:57:07.534974+0000","last_active":"2023-12-24T19:57:07.535124+0000","last_peered":"2023-12-24T19:57:07.535124+0000","last_clean":"2023-12-24T19:57:07.535124+0000","last_became_active":"2023-12-24T19:57:07.534336+0000","last_became_peered":"2023-12-24T19:57:07.534336+0000","last_unstale":"2023-12-24T19:57:07.535124+0000","last_undegraded":"2023-12-24T19:57:07.535124+0000","last_fullsized":"2023-12-24T19:57:07.535124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:21.111646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515712+0000","last_change":"2023-12-24T19:57:06.525016+0000","last_active":"2023-12-24T19:57:07.515712+0000","last_peered":"2023-12-24T19:57:07.515712+0000","last_clean":"2023-12-24T19:57:07.515712+0000","last_became_active":"2023-12-24T19:57:06.524783+0000","last_became_peered":"2023-12-24T19:57:06.524783+0000","last_unstale":"2023-12-24T19:57:07.515712+0000","last_undegraded":"2023-12-24T19:57:07.515712+0000","last_fullsized":"2023-12-24T19:57:07.515712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519757+0000","last_change":"2023-12-24T19:57:07.519678+0000","last_active":"2023-12-24T19:57:07.519757+0000","last_peered":"2023-12-24T19:57:07.519757+0000","last_clean":"2023-12-24T19:57:07.519757+0000","last_became_active":"2023-12-24T19:57:07.519439+0000","last_became_peered":"2023-12-24T19:57:07.519439+0000","last_unstale":"2023-12-24T19:57:07.519757+0000","last_undegraded":"2023-12-24T19:57:07.519757+0000","last_fullsized":"2023-12-24T19:57:07.519757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525729+0000","last_change":"2023-12-24T19:57:06.520438+0000","last_active":"2023-12-24T19:57:07.525729+0000","last_peered":"2023-12-24T19:57:07.525729+0000","last_clean":"2023-12-24T19:57:07.525729+0000","last_became_active":"2023-12-24T19:57:06.520107+0000","last_became_peered":"2023-12-24T19:57:06.520107+0000","last_unstale":"2023-12-24T19:57:07.525729+0000","last_undegraded":"2023-12-24T19:57:07.525729+0000","last_fullsized":"2023-12-24T19:57:07.525729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:18.362103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.529743+0000","last_change":"2023-12-24T19:57:07.528796+0000","last_active":"2023-12-24T19:57:07.529743+0000","last_peered":"2023-12-24T19:57:07.529743+0000","last_clean":"2023-12-24T19:57:07.529743+0000","last_became_active":"2023-12-24T19:57:07.528655+0000","last_became_peered":"2023-12-24T19:57:07.528655+0000","last_unstale":"2023-12-24T19:57:07.529743+0000","last_undegraded":"2023-12-24T19:57:07.529743+0000","last_fullsized":"2023-12-24T19:57:07.529743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:08.728753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534720+0000","last_change":"2023-12-24T19:57:06.521232+0000","last_active":"2023-12-24T19:57:07.534720+0000","last_peered":"2023-12-24T19:57:07.534720+0000","last_clean":"2023-12-24T19:57:07.534720+0000","last_became_active":"2023-12-24T19:57:06.520781+0000","last_became_peered":"2023-12-24T19:57:06.520781+0000","last_unstale":"2023-12-24T19:57:07.534720+0000","last_undegraded":"2023-12-24T19:57:07.534720+0000","last_fullsized":"2023-12-24T19:57:07.534720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530590+0000","last_change":"2023-12-24T19:57:07.530411+0000","last_active":"2023-12-24T19:57:07.530590+0000","last_peered":"2023-12-24T19:57:07.530590+0000","last_clean":"2023-12-24T19:57:07.530590+0000","last_became_active":"2023-12-24T19:57:07.530142+0000","last_became_peered":"2023-12-24T19:57:07.530142+0000","last_unstale":"2023-12-24T19:57:07.530590+0000","last_undegraded":"2023-12-24T19:57:07.530590+0000","last_fullsized":"2023-12-24T19:57:07.530590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:49.060653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527723+0000","last_change":"2023-12-24T19:57:06.518450+0000","last_active":"2023-12-24T19:57:07.527723+0000","last_peered":"2023-12-24T19:57:07.527723+0000","last_clean":"2023-12-24T19:57:07.527723+0000","last_became_active":"2023-12-24T19:57:06.518168+0000","last_became_peered":"2023-12-24T19:57:06.518168+0000","last_unstale":"2023-12-24T19:57:07.527723+0000","last_undegraded":"2023-12-24T19:57:07.527723+0000","last_fullsized":"2023-12-24T19:57:07.527723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:34.036458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534331+0000","last_change":"2023-12-24T19:57:07.534267+0000","last_active":"2023-12-24T19:57:07.534331+0000","last_peered":"2023-12-24T19:57:07.534331+0000","last_clean":"2023-12-24T19:57:07.534331+0000","last_became_active":"2023-12-24T19:57:07.533743+0000","last_became_peered":"2023-12-24T19:57:07.533743+0000","last_unstale":"2023-12-24T19:57:07.534331+0000","last_undegraded":"2023-12-24T19:57:07.534331+0000","last_fullsized":"2023-12-24T19:57:07.534331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516585+0000","last_change":"2023-12-24T19:57:06.519259+0000","last_active":"2023-12-24T19:57:07.516585+0000","last_peered":"2023-12-24T19:57:07.516585+0000","last_clean":"2023-12-24T19:57:07.516585+0000","last_became_active":"2023-12-24T19:57:06.518732+0000","last_became_peered":"2023-12-24T19:57:06.518732+0000","last_unstale":"2023-12-24T19:57:07.516585+0000","last_undegraded":"2023-12-24T19:57:07.516585+0000","last_fullsized":"2023-12-24T19:57:07.516585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535999+0000","last_change":"2023-12-24T19:57:07.535031+0000","last_active":"2023-12-24T19:57:07.535999+0000","last_peered":"2023-12-24T19:57:07.535999+0000","last_clean":"2023-12-24T19:57:07.535999+0000","last_became_active":"2023-12-24T19:57:07.534715+0000","last_became_peered":"2023-12-24T19:57:07.534715+0000","last_unstale":"2023-12-24T19:57:07.535999+0000","last_undegraded":"2023-12-24T19:57:07.535999+0000","last_fullsized":"2023-12-24T19:57:07.535999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:21.111646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517413+0000","last_change":"2023-12-24T19:57:06.524250+0000","last_active":"2023-12-24T19:57:07.517413+0000","last_peered":"2023-12-24T19:57:07.517413+0000","last_clean":"2023-12-24T19:57:07.517413+0000","last_became_active":"2023-12-24T19:57:06.523702+0000","last_became_peered":"2023-12-24T19:57:06.523702+0000","last_unstale":"2023-12-24T19:57:07.517413+0000","last_undegraded":"2023-12-24T19:57:07.517413+0000","last_fullsized":"2023-12-24T19:57:07.517413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.520473+0000","last_change":"2023-12-24T19:57:07.520401+0000","last_active":"2023-12-24T19:57:07.520473+0000","last_peered":"2023-12-24T19:57:07.520473+0000","last_clean":"2023-12-24T19:57:07.520473+0000","last_became_active":"2023-12-24T19:57:07.520170+0000","last_became_peered":"2023-12-24T19:57:07.520170+0000","last_unstale":"2023-12-24T19:57:07.520473+0000","last_undegraded":"2023-12-24T19:57:07.520473+0000","last_fullsized":"2023-12-24T19:57:07.520473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530362+0000","last_change":"2023-12-24T19:57:06.526329+0000","last_active":"2023-12-24T19:57:07.530362+0000","last_peered":"2023-12-24T19:57:07.530362+0000","last_clean":"2023-12-24T19:57:07.530362+0000","last_became_active":"2023-12-24T19:57:06.525718+0000","last_became_peered":"2023-12-24T19:57:06.525718+0000","last_unstale":"2023-12-24T19:57:07.530362+0000","last_undegraded":"2023-12-24T19:57:07.530362+0000","last_fullsized":"2023-12-24T19:57:07.530362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.537377+0000","last_change":"2023-12-24T19:57:07.537325+0000","last_active":"2023-12-24T19:57:07.537377+0000","last_peered":"2023-12-24T19:57:07.537377+0000","last_clean":"2023-12-24T19:57:07.537377+0000","last_became_active":"2023-12-24T19:57:07.536102+0000","last_became_peered":"2023-12-24T19:57:07.536102+0000","last_unstale":"2023-12-24T19:57:07.537377+0000","last_undegraded":"2023-12-24T19:57:07.537377+0000","last_fullsized":"2023-12-24T19:57:07.537377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:52:11.849851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528207+0000","last_change":"2023-12-24T19:57:06.518295+0000","last_active":"2023-12-24T19:57:07.528207+0000","last_peered":"2023-12-24T19:57:07.528207+0000","last_clean":"2023-12-24T19:57:07.528207+0000","last_became_active":"2023-12-24T19:57:06.516591+0000","last_became_peered":"2023-12-24T19:57:06.516591+0000","last_unstale":"2023-12-24T19:57:07.528207+0000","last_undegraded":"2023-12-24T19:57:07.528207+0000","last_fullsized":"2023-12-24T19:57:07.528207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:34.036458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536964+0000","last_change":"2023-12-24T19:57:07.536755+0000","last_active":"2023-12-24T19:57:07.536964+0000","last_peered":"2023-12-24T19:57:07.536964+0000","last_clean":"2023-12-24T19:57:07.536964+0000","last_became_active":"2023-12-24T19:57:07.536502+0000","last_became_peered":"2023-12-24T19:57:07.536502+0000","last_unstale":"2023-12-24T19:57:07.536964+0000","last_undegraded":"2023-12-24T19:57:07.536964+0000","last_fullsized":"2023-12-24T19:57:07.536964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:42:21.152234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517131+0000","last_change":"2023-12-24T19:57:06.519180+0000","last_active":"2023-12-24T19:57:07.517131+0000","last_peered":"2023-12-24T19:57:07.517131+0000","last_clean":"2023-12-24T19:57:07.517131+0000","last_became_active":"2023-12-24T19:57:06.518906+0000","last_became_peered":"2023-12-24T19:57:06.518906+0000","last_unstale":"2023-12-24T19:57:07.517131+0000","last_undegraded":"2023-12-24T19:57:07.517131+0000","last_fullsized":"2023-12-24T19:57:07.517131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:45.922217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531876+0000","last_change":"2023-12-24T19:57:07.531626+0000","last_active":"2023-12-24T19:57:07.531876+0000","last_peered":"2023-12-24T19:57:07.531876+0000","last_clean":"2023-12-24T19:57:07.531876+0000","last_became_active":"2023-12-24T19:57:07.530556+0000","last_became_peered":"2023-12-24T19:57:07.530556+0000","last_unstale":"2023-12-24T19:57:07.531876+0000","last_undegraded":"2023-12-24T19:57:07.531876+0000","last_fullsized":"2023-12-24T19:57:07.531876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:43:42.570184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.515831+0000","last_change":"2023-12-24T19:57:06.522317+0000","last_active":"2023-12-24T19:57:07.515831+0000","last_peered":"2023-12-24T19:57:07.515831+0000","last_clean":"2023-12-24T19:57:07.515831+0000","last_became_active":"2023-12-24T19:57:06.521804+0000","last_became_peered":"2023-12-24T19:57:06.521804+0000","last_unstale":"2023-12-24T19:57:07.515831+0000","last_undegraded":"2023-12-24T19:57:07.515831+0000","last_fullsized":"2023-12-24T19:57:07.515831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525176+0000","last_change":"2023-12-24T19:57:07.525106+0000","last_active":"2023-12-24T19:57:07.525176+0000","last_peered":"2023-12-24T19:57:07.525176+0000","last_clean":"2023-12-24T19:57:07.525176+0000","last_became_active":"2023-12-24T19:57:07.524852+0000","last_became_peered":"2023-12-24T19:57:07.524852+0000","last_unstale":"2023-12-24T19:57:07.525176+0000","last_undegraded":"2023-12-24T19:57:07.525176+0000","last_fullsized":"2023-12-24T19:57:07.525176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:11:19.368177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517665+0000","last_change":"2023-12-24T19:57:07.517596+0000","last_active":"2023-12-24T19:57:07.517665+0000","last_peered":"2023-12-24T19:57:07.517665+0000","last_clean":"2023-12-24T19:57:07.517665+0000","last_became_active":"2023-12-24T19:57:07.517352+0000","last_became_peered":"2023-12-24T19:57:07.517352+0000","last_unstale":"2023-12-24T19:57:07.517665+0000","last_undegraded":"2023-12-24T19:57:07.517665+0000","last_fullsized":"2023-12-24T19:57:07.517665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:50.965895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.513830+0000","last_change":"2023-12-24T19:57:06.526469+0000","last_active":"2023-12-24T19:57:07.513830+0000","last_peered":"2023-12-24T19:57:07.513830+0000","last_clean":"2023-12-24T19:57:07.513830+0000","last_became_active":"2023-12-24T19:57:06.526071+0000","last_became_peered":"2023-12-24T19:57:06.526071+0000","last_unstale":"2023-12-24T19:57:07.513830+0000","last_undegraded":"2023-12-24T19:57:07.513830+0000","last_fullsized":"2023-12-24T19:57:07.513830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527346+0000","last_change":"2023-12-24T19:57:07.527208+0000","last_active":"2023-12-24T19:57:07.527346+0000","last_peered":"2023-12-24T19:57:07.527346+0000","last_clean":"2023-12-24T19:57:07.527346+0000","last_became_active":"2023-12-24T19:57:07.526792+0000","last_became_peered":"2023-12-24T19:57:07.526792+0000","last_unstale":"2023-12-24T19:57:07.527346+0000","last_undegraded":"2023-12-24T19:57:07.527346+0000","last_fullsized":"2023-12-24T19:57:07.527346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:43:42.570184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516700+0000","last_change":"2023-12-24T19:57:06.521786+0000","last_active":"2023-12-24T19:57:07.516700+0000","last_peered":"2023-12-24T19:57:07.516700+0000","last_clean":"2023-12-24T19:57:07.516700+0000","last_became_active":"2023-12-24T19:57:06.521491+0000","last_became_peered":"2023-12-24T19:57:06.521491+0000","last_unstale":"2023-12-24T19:57:07.516700+0000","last_undegraded":"2023-12-24T19:57:07.516700+0000","last_fullsized":"2023-12-24T19:57:07.516700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.527038+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:57:07.527038+0000","last_peered":"2023-12-24T19:57:07.527038+0000","last_clean":"2023-12-24T19:57:07.527038+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:57:07.527038+0000","last_undegraded":"2023-12-24T19:57:07.527038+0000","last_fullsized":"2023-12-24T19:57:07.527038+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526944+0000","last_change":"2023-12-24T19:57:07.526851+0000","last_active":"2023-12-24T19:57:07.526944+0000","last_peered":"2023-12-24T19:57:07.526944+0000","last_clean":"2023-12-24T19:57:07.526944+0000","last_became_active":"2023-12-24T19:57:07.526572+0000","last_became_peered":"2023-12-24T19:57:07.526572+0000","last_unstale":"2023-12-24T19:57:07.526944+0000","last_undegraded":"2023-12-24T19:57:07.526944+0000","last_fullsized":"2023-12-24T19:57:07.526944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526230+0000","last_change":"2023-12-24T19:57:06.527232+0000","last_active":"2023-12-24T19:57:07.526230+0000","last_peered":"2023-12-24T19:57:07.526230+0000","last_clean":"2023-12-24T19:57:07.526230+0000","last_became_active":"2023-12-24T19:57:06.526965+0000","last_became_peered":"2023-12-24T19:57:06.526965+0000","last_unstale":"2023-12-24T19:57:07.526230+0000","last_undegraded":"2023-12-24T19:57:07.526230+0000","last_fullsized":"2023-12-24T19:57:07.526230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:32.732412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526332+0000","last_change":"2023-12-24T19:57:06.527833+0000","last_active":"2023-12-24T19:57:07.526332+0000","last_peered":"2023-12-24T19:57:07.526332+0000","last_clean":"2023-12-24T19:57:07.526332+0000","last_became_active":"2023-12-24T19:57:06.527507+0000","last_became_peered":"2023-12-24T19:57:06.527507+0000","last_unstale":"2023-12-24T19:57:07.526332+0000","last_undegraded":"2023-12-24T19:57:07.526332+0000","last_fullsized":"2023-12-24T19:57:07.526332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517724+0000","last_change":"2023-12-24T19:57:07.517660+0000","last_active":"2023-12-24T19:57:07.517724+0000","last_peered":"2023-12-24T19:57:07.517724+0000","last_clean":"2023-12-24T19:57:07.517724+0000","last_became_active":"2023-12-24T19:57:07.517397+0000","last_became_peered":"2023-12-24T19:57:07.517397+0000","last_unstale":"2023-12-24T19:57:07.517724+0000","last_undegraded":"2023-12-24T19:57:07.517724+0000","last_fullsized":"2023-12-24T19:57:07.517724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-24T19:57:08.515389+0000","last_change":"2023-12-24T19:57:06.525879+0000","last_active":"2023-12-24T19:57:08.515389+0000","last_peered":"2023-12-24T19:57:08.515389+0000","last_clean":"2023-12-24T19:57:08.515389+0000","last_became_active":"2023-12-24T19:57:06.525637+0000","last_became_peered":"2023-12-24T19:57:06.525637+0000","last_unstale":"2023-12-24T19:57:08.515389+0000","last_undegraded":"2023-12-24T19:57:08.515389+0000","last_fullsized":"2023-12-24T19:57:08.515389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:46.616394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534151+0000","last_change":"2023-12-24T19:57:07.534062+0000","last_active":"2023-12-24T19:57:07.534151+0000","last_peered":"2023-12-24T19:57:07.534151+0000","last_clean":"2023-12-24T19:57:07.534151+0000","last_became_active":"2023-12-24T19:57:07.533898+0000","last_became_peered":"2023-12-24T19:57:07.533898+0000","last_unstale":"2023-12-24T19:57:07.534151+0000","last_undegraded":"2023-12-24T19:57:07.534151+0000","last_fullsized":"2023-12-24T19:57:07.534151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.536398+0000","last_change":"2023-12-24T19:57:06.525416+0000","last_active":"2023-12-24T19:57:07.536398+0000","last_peered":"2023-12-24T19:57:07.536398+0000","last_clean":"2023-12-24T19:57:07.536398+0000","last_became_active":"2023-12-24T19:57:06.525105+0000","last_became_peered":"2023-12-24T19:57:06.525105+0000","last_unstale":"2023-12-24T19:57:07.536398+0000","last_undegraded":"2023-12-24T19:57:07.536398+0000","last_fullsized":"2023-12-24T19:57:07.536398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.518611+0000","last_change":"2023-12-24T19:57:07.518192+0000","last_active":"2023-12-24T19:57:07.518611+0000","last_peered":"2023-12-24T19:57:07.518611+0000","last_clean":"2023-12-24T19:57:07.518611+0000","last_became_active":"2023-12-24T19:57:07.517957+0000","last_became_peered":"2023-12-24T19:57:07.517957+0000","last_unstale":"2023-12-24T19:57:07.518611+0000","last_undegraded":"2023-12-24T19:57:07.518611+0000","last_fullsized":"2023-12-24T19:57:07.518611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526634+0000","last_change":"2023-12-24T19:57:06.526486+0000","last_active":"2023-12-24T19:57:07.526634+0000","last_peered":"2023-12-24T19:57:07.526634+0000","last_clean":"2023-12-24T19:57:07.526634+0000","last_became_active":"2023-12-24T19:57:06.526260+0000","last_became_peered":"2023-12-24T19:57:06.526260+0000","last_unstale":"2023-12-24T19:57:07.526634+0000","last_undegraded":"2023-12-24T19:57:07.526634+0000","last_fullsized":"2023-12-24T19:57:07.526634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:38:46.616394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525256+0000","last_change":"2023-12-24T19:57:07.525195+0000","last_active":"2023-12-24T19:57:07.525256+0000","last_peered":"2023-12-24T19:57:07.525256+0000","last_clean":"2023-12-24T19:57:07.525256+0000","last_became_active":"2023-12-24T19:57:07.524903+0000","last_became_peered":"2023-12-24T19:57:07.524903+0000","last_unstale":"2023-12-24T19:57:07.525256+0000","last_undegraded":"2023-12-24T19:57:07.525256+0000","last_fullsized":"2023-12-24T19:57:07.525256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.517242+0000","last_change":"2023-12-24T19:57:06.524497+0000","last_active":"2023-12-24T19:57:07.517242+0000","last_peered":"2023-12-24T19:57:07.517242+0000","last_clean":"2023-12-24T19:57:07.517242+0000","last_became_active":"2023-12-24T19:57:06.524278+0000","last_became_peered":"2023-12-24T19:57:06.524278+0000","last_unstale":"2023-12-24T19:57:07.517242+0000","last_undegraded":"2023-12-24T19:57:07.517242+0000","last_fullsized":"2023-12-24T19:57:07.517242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:28:28.297141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526976+0000","last_change":"2023-12-24T19:57:07.526151+0000","last_active":"2023-12-24T19:57:07.526976+0000","last_peered":"2023-12-24T19:57:07.526976+0000","last_clean":"2023-12-24T19:57:07.526976+0000","last_became_active":"2023-12-24T19:57:07.525918+0000","last_became_peered":"2023-12-24T19:57:07.525918+0000","last_unstale":"2023-12-24T19:57:07.526976+0000","last_undegraded":"2023-12-24T19:57:07.526976+0000","last_fullsized":"2023-12-24T19:57:07.526976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.516440+0000","last_change":"2023-12-24T19:57:06.518972+0000","last_active":"2023-12-24T19:57:07.516440+0000","last_peered":"2023-12-24T19:57:07.516440+0000","last_clean":"2023-12-24T19:57:07.516440+0000","last_became_active":"2023-12-24T19:57:06.518437+0000","last_became_peered":"2023-12-24T19:57:06.518437+0000","last_unstale":"2023-12-24T19:57:07.516440+0000","last_undegraded":"2023-12-24T19:57:07.516440+0000","last_fullsized":"2023-12-24T19:57:07.516440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:51.447168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531001+0000","last_change":"2023-12-24T19:57:07.530312+0000","last_active":"2023-12-24T19:57:07.531001+0000","last_peered":"2023-12-24T19:57:07.531001+0000","last_clean":"2023-12-24T19:57:07.531001+0000","last_became_active":"2023-12-24T19:57:07.529911+0000","last_became_peered":"2023-12-24T19:57:07.529911+0000","last_unstale":"2023-12-24T19:57:07.531001+0000","last_undegraded":"2023-12-24T19:57:07.531001+0000","last_fullsized":"2023-12-24T19:57:07.531001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.533595+0000","last_change":"2023-12-24T19:57:06.527759+0000","last_active":"2023-12-24T19:57:07.533595+0000","last_peered":"2023-12-24T19:57:07.533595+0000","last_clean":"2023-12-24T19:57:07.533595+0000","last_became_active":"2023-12-24T19:57:06.527500+0000","last_became_peered":"2023-12-24T19:57:06.527500+0000","last_unstale":"2023-12-24T19:57:07.533595+0000","last_undegraded":"2023-12-24T19:57:07.533595+0000","last_fullsized":"2023-12-24T19:57:07.533595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.525889+0000","last_change":"2023-12-24T19:57:07.525825+0000","last_active":"2023-12-24T19:57:07.525889+0000","last_peered":"2023-12-24T19:57:07.525889+0000","last_clean":"2023-12-24T19:57:07.525889+0000","last_became_active":"2023-12-24T19:57:07.525212+0000","last_became_peered":"2023-12-24T19:57:07.525212+0000","last_unstale":"2023-12-24T19:57:07.525889+0000","last_undegraded":"2023-12-24T19:57:07.525889+0000","last_fullsized":"2023-12-24T19:57:07.525889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.514129+0000","last_change":"2023-12-24T19:57:06.523392+0000","last_active":"2023-12-24T19:57:07.514129+0000","last_peered":"2023-12-24T19:57:07.514129+0000","last_clean":"2023-12-24T19:57:07.514129+0000","last_became_active":"2023-12-24T19:57:06.523144+0000","last_became_peered":"2023-12-24T19:57:06.523144+0000","last_unstale":"2023-12-24T19:57:07.514129+0000","last_undegraded":"2023-12-24T19:57:07.514129+0000","last_fullsized":"2023-12-24T19:57:07.514129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:33.977175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.532749+0000","last_change":"2023-12-24T19:57:07.532683+0000","last_active":"2023-12-24T19:57:07.532749+0000","last_peered":"2023-12-24T19:57:07.532749+0000","last_clean":"2023-12-24T19:57:07.532749+0000","last_became_active":"2023-12-24T19:57:07.532453+0000","last_became_peered":"2023-12-24T19:57:07.532453+0000","last_unstale":"2023-12-24T19:57:07.532749+0000","last_undegraded":"2023-12-24T19:57:07.532749+0000","last_fullsized":"2023-12-24T19:57:07.532749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:39.083422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.524143+0000","last_change":"2023-12-24T19:57:06.524540+0000","last_active":"2023-12-24T19:57:07.524143+0000","last_peered":"2023-12-24T19:57:07.524143+0000","last_clean":"2023-12-24T19:57:07.524143+0000","last_became_active":"2023-12-24T19:57:06.524289+0000","last_became_peered":"2023-12-24T19:57:06.524289+0000","last_unstale":"2023-12-24T19:57:07.524143+0000","last_undegraded":"2023-12-24T19:57:07.524143+0000","last_fullsized":"2023-12-24T19:57:07.524143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:14.819508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530781+0000","last_change":"2023-12-24T19:57:07.527389+0000","last_active":"2023-12-24T19:57:07.530781+0000","last_peered":"2023-12-24T19:57:07.530781+0000","last_clean":"2023-12-24T19:57:07.530781+0000","last_became_active":"2023-12-24T19:57:07.527176+0000","last_became_peered":"2023-12-24T19:57:07.527176+0000","last_unstale":"2023-12-24T19:57:07.530781+0000","last_undegraded":"2023-12-24T19:57:07.530781+0000","last_fullsized":"2023-12-24T19:57:07.530781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:35:49.060653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530624+0000","last_change":"2023-12-24T19:57:06.521236+0000","last_active":"2023-12-24T19:57:07.530624+0000","last_peered":"2023-12-24T19:57:07.530624+0000","last_clean":"2023-12-24T19:57:07.530624+0000","last_became_active":"2023-12-24T19:57:06.520985+0000","last_became_peered":"2023-12-24T19:57:06.520985+0000","last_unstale":"2023-12-24T19:57:07.530624+0000","last_undegraded":"2023-12-24T19:57:07.530624+0000","last_fullsized":"2023-12-24T19:57:07.530624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:05.498822+0000","last_clean_scrub_stamp":"2023-12-24T19:57:05.498822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:39:27.700998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531745+0000","last_change":"2023-12-24T19:57:07.530650+0000","last_active":"2023-12-24T19:57:07.531745+0000","last_peered":"2023-12-24T19:57:07.531745+0000","last_clean":"2023-12-24T19:57:07.531745+0000","last_became_active":"2023-12-24T19:57:07.528576+0000","last_became_peered":"2023-12-24T19:57:07.528576+0000","last_unstale":"2023-12-24T19:57:07.531745+0000","last_undegraded":"2023-12-24T19:57:07.531745+0000","last_fullsized":"2023-12-24T19:57:07.531745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:54:49.589999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.521561+0000","last_change":"2023-12-24T19:57:07.520973+0000","last_active":"2023-12-24T19:57:07.521561+0000","last_peered":"2023-12-24T19:57:07.521561+0000","last_clean":"2023-12-24T19:57:07.521561+0000","last_became_active":"2023-12-24T19:57:07.520830+0000","last_became_peered":"2023-12-24T19:57:07.520830+0000","last_unstale":"2023-12-24T19:57:07.521561+0000","last_undegraded":"2023-12-24T19:57:07.521561+0000","last_fullsized":"2023-12-24T19:57:07.521561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.519817+0000","last_change":"2023-12-24T19:57:07.519770+0000","last_active":"2023-12-24T19:57:07.519817+0000","last_peered":"2023-12-24T19:57:07.519817+0000","last_clean":"2023-12-24T19:57:07.519817+0000","last_became_active":"2023-12-24T19:57:07.519599+0000","last_became_peered":"2023-12-24T19:57:07.519599+0000","last_unstale":"2023-12-24T19:57:07.519817+0000","last_undegraded":"2023-12-24T19:57:07.519817+0000","last_fullsized":"2023-12-24T19:57:07.519817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:15:52.453241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526841+0000","last_change":"2023-12-24T19:57:07.526619+0000","last_active":"2023-12-24T19:57:07.526841+0000","last_peered":"2023-12-24T19:57:07.526841+0000","last_clean":"2023-12-24T19:57:07.526841+0000","last_became_active":"2023-12-24T19:57:07.526393+0000","last_became_peered":"2023-12-24T19:57:07.526393+0000","last_unstale":"2023-12-24T19:57:07.526841+0000","last_undegraded":"2023-12-24T19:57:07.526841+0000","last_fullsized":"2023-12-24T19:57:07.526841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:49:16.868612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.530703+0000","last_change":"2023-12-24T19:57:07.530632+0000","last_active":"2023-12-24T19:57:07.530703+0000","last_peered":"2023-12-24T19:57:07.530703+0000","last_clean":"2023-12-24T19:57:07.530703+0000","last_became_active":"2023-12-24T19:57:07.530304+0000","last_became_peered":"2023-12-24T19:57:07.530304+0000","last_unstale":"2023-12-24T19:57:07.530703+0000","last_undegraded":"2023-12-24T19:57:07.530703+0000","last_fullsized":"2023-12-24T19:57:07.530703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528770+0000","last_change":"2023-12-24T19:57:07.528719+0000","last_active":"2023-12-24T19:57:07.528770+0000","last_peered":"2023-12-24T19:57:07.528770+0000","last_clean":"2023-12-24T19:57:07.528770+0000","last_became_active":"2023-12-24T19:57:07.528307+0000","last_became_peered":"2023-12-24T19:57:07.528307+0000","last_unstale":"2023-12-24T19:57:07.528770+0000","last_undegraded":"2023-12-24T19:57:07.528770+0000","last_fullsized":"2023-12-24T19:57:07.528770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526251+0000","last_change":"2023-12-24T19:57:07.526152+0000","last_active":"2023-12-24T19:57:07.526251+0000","last_peered":"2023-12-24T19:57:07.526251+0000","last_clean":"2023-12-24T19:57:07.526251+0000","last_became_active":"2023-12-24T19:57:07.525938+0000","last_became_peered":"2023-12-24T19:57:07.525938+0000","last_unstale":"2023-12-24T19:57:07.526251+0000","last_undegraded":"2023-12-24T19:57:07.526251+0000","last_fullsized":"2023-12-24T19:57:07.526251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534227+0000","last_change":"2023-12-24T19:57:07.534143+0000","last_active":"2023-12-24T19:57:07.534227+0000","last_peered":"2023-12-24T19:57:07.534227+0000","last_clean":"2023-12-24T19:57:07.534227+0000","last_became_active":"2023-12-24T19:57:07.533934+0000","last_became_peered":"2023-12-24T19:57:07.533934+0000","last_unstale":"2023-12-24T19:57:07.534227+0000","last_undegraded":"2023-12-24T19:57:07.534227+0000","last_fullsized":"2023-12-24T19:57:07.534227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:46.406082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526994+0000","last_change":"2023-12-24T19:57:07.526319+0000","last_active":"2023-12-24T19:57:07.526994+0000","last_peered":"2023-12-24T19:57:07.526994+0000","last_clean":"2023-12-24T19:57:07.526994+0000","last_became_active":"2023-12-24T19:57:07.526080+0000","last_became_peered":"2023-12-24T19:57:07.526080+0000","last_unstale":"2023-12-24T19:57:07.526994+0000","last_undegraded":"2023-12-24T19:57:07.526994+0000","last_fullsized":"2023-12-24T19:57:07.526994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:18:39.054336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.531848+0000","last_change":"2023-12-24T19:57:07.530837+0000","last_active":"2023-12-24T19:57:07.531848+0000","last_peered":"2023-12-24T19:57:07.531848+0000","last_clean":"2023-12-24T19:57:07.531848+0000","last_became_active":"2023-12-24T19:57:07.527904+0000","last_became_peered":"2023-12-24T19:57:07.527904+0000","last_unstale":"2023-12-24T19:57:07.531848+0000","last_undegraded":"2023-12-24T19:57:07.531848+0000","last_fullsized":"2023-12-24T19:57:07.531848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:09.728335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.528649+0000","last_change":"2023-12-24T19:57:07.528578+0000","last_active":"2023-12-24T19:57:07.528649+0000","last_peered":"2023-12-24T19:57:07.528649+0000","last_clean":"2023-12-24T19:57:07.528649+0000","last_became_active":"2023-12-24T19:57:07.528029+0000","last_became_peered":"2023-12-24T19:57:07.528029+0000","last_unstale":"2023-12-24T19:57:07.528649+0000","last_undegraded":"2023-12-24T19:57:07.528649+0000","last_fullsized":"2023-12-24T19:57:07.528649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:38.314000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.535175+0000","last_change":"2023-12-24T19:57:07.535104+0000","last_active":"2023-12-24T19:57:07.535175+0000","last_peered":"2023-12-24T19:57:07.535175+0000","last_clean":"2023-12-24T19:57:07.535175+0000","last_became_active":"2023-12-24T19:57:07.534556+0000","last_became_peered":"2023-12-24T19:57:07.534556+0000","last_unstale":"2023-12-24T19:57:07.535175+0000","last_undegraded":"2023-12-24T19:57:07.535175+0000","last_fullsized":"2023-12-24T19:57:07.535175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:52:11.849851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.534469+0000","last_change":"2023-12-24T19:57:07.534398+0000","last_active":"2023-12-24T19:57:07.534469+0000","last_peered":"2023-12-24T19:57:07.534469+0000","last_clean":"2023-12-24T19:57:07.534469+0000","last_became_active":"2023-12-24T19:57:07.534052+0000","last_became_peered":"2023-12-24T19:57:07.534052+0000","last_unstale":"2023-12-24T19:57:07.534469+0000","last_undegraded":"2023-12-24T19:57:07.534469+0000","last_fullsized":"2023-12-24T19:57:07.534469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:21.541220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-24T19:57:07.526814+0000","last_change":"2023-12-24T19:57:07.526507+0000","last_active":"2023-12-24T19:57:07.526814+0000","last_peered":"2023-12-24T19:57:07.526814+0000","last_clean":"2023-12-24T19:57:07.526814+0000","last_became_active":"2023-12-24T19:57:07.526282+0000","last_became_peered":"2023-12-24T19:57:07.526282+0000","last_unstale":"2023-12-24T19:57:07.526814+0000","last_undegraded":"2023-12-24T19:57:07.526814+0000","last_fullsized":"2023-12-24T19:57:07.526814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:06.504895+0000","last_clean_scrub_stamp":"2023-12-24T19:57:06.504895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:43:56.120092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338584,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929346,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195242,"statfs":{"total":200000000,"available":199927970,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":68,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929416,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]}],"pool_statfs":[]}} 2023-12-24T19:57:20.854 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-24T19:57:20.854 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-24T19:57:20.855 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-24T19:57:20.855 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-24T19:57:21.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.010+0000 7fc5abd91700 1 Processor -- start 2023-12-24T19:57:21.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.011+0000 7fc5abd91700 1 -- start start 2023-12-24T19:57:21.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.011+0000 7fc5abd91700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a4159b00 0x7fc5a4067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.011+0000 7fc5abd91700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc5a4070d50 0x7fc5a40afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.011+0000 7fc5abd91700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a40a84d0 con 0x7fc5a40af7d0 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.011+0000 7fc5abd91700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a40b0180 con 0x7fc5a4070d50 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.011+0000 7fc5abd91700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a40a7620 con 0x7fc5a4159b00 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.011+0000 7fc5aa32e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc5a4070d50 0x7fc5a40afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5a932c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fc5a40af7d0 0x7fc5a4070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41730/0 (socket says 172.21.15.61:41730) 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5aa32e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc5a4070d50 0x7fc5a40afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53468/0 (socket says 172.21.15.61:53468) 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5a932c700 1 -- 172.21.15.61:0/3510509497 learned_addr learned my addr 172.21.15.61:0/3510509497 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5a9b2d700 1 --2- 172.21.15.61:0/3510509497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a4159b00 0x7fc5a4067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5aa32e700 1 -- 172.21.15.61:0/3510509497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a4159b00 msgr2=0x7fc5a4067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5aa32e700 1 --2- 172.21.15.61:0/3510509497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a4159b00 0x7fc5a4067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5aa32e700 1 -- 172.21.15.61:0/3510509497 >> v1:172.21.15.61:6789/0 conn(0x7fc5a40af7d0 legacy=0x7fc5a4070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5aa32e700 1 -- 172.21.15.61:0/3510509497 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a40a78c0 con 0x7fc5a4070d50 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5a8b2b700 1 -- 172.21.15.61:0/3510509497 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223019998 0 0) 0x7fc5a40a84d0 con 0x7fc5a40af7d0 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5aa32e700 1 --2- 172.21.15.61:0/3510509497 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 0x7fc5a40afc40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc59c009e60 tx=0x7fc59c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9112a68c7adcef8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5a8b2b700 1 -- 172.21.15.61:0/3510509497 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c00e070 con 0x7fc5a4070d50 2023-12-24T19:57:21.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5a8b2b700 1 -- 172.21.15.61:0/3510509497 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c00bc30 con 0x7fc5a4070d50 2023-12-24T19:57:21.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.012+0000 7fc5a8b2b700 1 -- 172.21.15.61:0/3510509497 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c012430 con 0x7fc5a4070d50 2023-12-24T19:57:21.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.013+0000 7fc5abd91700 1 -- 172.21.15.61:0/3510509497 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 msgr2=0x7fc5a40afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.013+0000 7fc5abd91700 1 --2- 172.21.15.61:0/3510509497 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 0x7fc5a40afc40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc59c009e60 tx=0x7fc59c009780 comp rx=0 tx=0).stop 2023-12-24T19:57:21.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.013+0000 7fc5abd91700 1 -- 172.21.15.61:0/3510509497 shutdown_connections 2023-12-24T19:57:21.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.013+0000 7fc5abd91700 1 --2- 172.21.15.61:0/3510509497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a4159b00 0x7fc5a4067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.013+0000 7fc5abd91700 1 --2- 172.21.15.61:0/3510509497 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 0x7fc5a40afc40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.013+0000 7fc5abd91700 1 -- 172.21.15.61:0/3510509497 >> 172.21.15.61:0/3510509497 conn(0x7fc5a40ca200 msgr2=0x7fc5a40ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:21.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.013+0000 7fc5abd91700 1 -- 172.21.15.61:0/3510509497 shutdown_connections 2023-12-24T19:57:21.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.013+0000 7fc5abd91700 1 -- 172.21.15.61:0/3510509497 wait complete. 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.014+0000 7fc5abd91700 1 Processor -- start 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.014+0000 7fc5abd91700 1 -- start start 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5abd91700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 0x7fc5a40cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5abd91700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a40af7d0 0x7fc5a415ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5abd91700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5a4159b00 0x7fc5a4148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5abd91700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a40cd300 con 0x7fc5a4070d50 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5abd91700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a415cf80 con 0x7fc5a4159b00 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5abd91700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a40cc6f0 con 0x7fc5a40af7d0 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5a9b2d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 0x7fc5a40cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5a9b2d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 0x7fc5a40cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53484/0 (socket says 172.21.15.61:53484) 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5a9b2d700 1 -- 172.21.15.61:0/606863989 learned_addr learned my addr 172.21.15.61:0/606863989 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5a932c700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a40af7d0 0x7fc5a415ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5aa32e700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5a4159b00 0x7fc5a4148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5a9b2d700 1 -- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a40af7d0 msgr2=0x7fc5a415ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5a9b2d700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a40af7d0 0x7fc5a415ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5a9b2d700 1 -- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5a4159b00 msgr2=0x7fc5a4148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5a9b2d700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5a4159b00 0x7fc5a4148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5a9b2d700 1 -- 172.21.15.61:0/606863989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c009a20 con 0x7fc5a4070d50 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5a9b2d700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 0x7fc5a40cc040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000d890 tx=0x7fc5a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc599ffb700 1 -- 172.21.15.61:0/606863989 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0009610 con 0x7fc5a4070d50 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc599ffb700 1 -- 172.21.15.61:0/606863989 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0009770 con 0x7fc5a4070d50 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc599ffb700 1 -- 172.21.15.61:0/606863989 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0009b30 con 0x7fc5a4070d50 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.015+0000 7fc5abd91700 1 -- 172.21.15.61:0/606863989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a40cc9d0 con 0x7fc5a4070d50 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.016+0000 7fc5abd91700 1 -- 172.21.15.61:0/606863989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a40ccf90 con 0x7fc5a4070d50 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.016+0000 7fc5abd91700 1 -- 172.21.15.61:0/606863989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a404c3c0 con 0x7fc5a4070d50 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.017+0000 7fc599ffb700 1 -- 172.21.15.61:0/606863989 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc5a001e460 con 0x7fc5a4070d50 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.017+0000 7fc599ffb700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.017+0000 7fc599ffb700 1 -- 172.21.15.61:0/606863989 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5a0084ba0 con 0x7fc5a4070d50 2023-12-24T19:57:21.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.017+0000 7fc5a932c700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.018+0000 7fc5a932c700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc588066f30 0x7fc5880693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40708f0 tx=0x7fc594009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:21.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.021+0000 7fc599ffb700 1 -- 172.21.15.61:0/606863989 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5a0051e10 con 0x7fc5a4070d50 2023-12-24T19:57:21.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.258+0000 7fc5abd91700 1 -- 172.21.15.61:0/606863989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc5a40af3a0 con 0x7fc5a4070d50 2023-12-24T19:57:21.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.259+0000 7fc599ffb700 1 -- 172.21.15.61:0/606863989 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc5a0055430 con 0x7fc5a4070d50 2023-12-24T19:57:21.260 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:21.260 INFO:teuthology.orchestra.run.smithi061.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-24T19:57:21.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.260+0000 7fc5abd91700 1 -- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc588066f30 msgr2=0x7fc5880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.260+0000 7fc5abd91700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc588066f30 0x7fc5880693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40708f0 tx=0x7fc594009040 comp rx=0 tx=0).stop 2023-12-24T19:57:21.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.261+0000 7fc5abd91700 1 -- 172.21.15.61:0/606863989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 msgr2=0x7fc5a40cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.261+0000 7fc5abd91700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 0x7fc5a40cc040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000d890 tx=0x7fc5a0008040 comp rx=0 tx=0).stop 2023-12-24T19:57:21.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.261+0000 7fc5abd91700 1 -- 172.21.15.61:0/606863989 shutdown_connections 2023-12-24T19:57:21.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.261+0000 7fc5abd91700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.261+0000 7fc5abd91700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5a4159b00 0x7fc5a4148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.261+0000 7fc5abd91700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5a4070d50 0x7fc5a40cc040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.261+0000 7fc5abd91700 1 --2- 172.21.15.61:0/606863989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a40af7d0 0x7fc5a415ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.261+0000 7fc5abd91700 1 -- 172.21.15.61:0/606863989 >> 172.21.15.61:0/606863989 conn(0x7fc5a40ca200 msgr2=0x7fc5a4156270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:21.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.261+0000 7fc5abd91700 1 -- 172.21.15.61:0/606863989 shutdown_connections 2023-12-24T19:57:21.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.261+0000 7fc5abd91700 1 -- 172.21.15.61:0/606863989 wait complete. 2023-12-24T19:57:21.273 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-24T19:57:21.273 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:21.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.395+0000 7fb091d21700 1 Processor -- start 2023-12-24T19:57:21.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.395+0000 7fb091d21700 1 -- start start 2023-12-24T19:57:21.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb091d21700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 0x7fb08c0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb091d21700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb08c15acf0 0x7fb08c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb091d21700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c0687f0 con 0x7fb08c0af710 2023-12-24T19:57:21.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb091d21700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c067be0 con 0x7fb08c15acf0 2023-12-24T19:57:21.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb091d21700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c067ec0 con 0x7fb08c068c80 2023-12-24T19:57:21.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08affd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 0x7fb08c0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb08c15acf0 0x7fb08c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb08c0af710 0x7fb08c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:51622/0 (socket says 172.21.15.61:51622) 2023-12-24T19:57:21.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08b7fe700 1 -- 172.21.15.61:0/3413441232 learned_addr learned my addr 172.21.15.61:0/3413441232 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:21.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb08c15acf0 0x7fb08c067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:56274/0 (socket says 172.21.15.61:56274) 2023-12-24T19:57:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08bfff700 1 -- 172.21.15.61:0/3413441232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 msgr2=0x7fb08c0afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08bfff700 1 --2- 172.21.15.61:0/3413441232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 0x7fb08c0afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08bfff700 1 -- 172.21.15.61:0/3413441232 >> v1:172.21.15.133:6789/0 conn(0x7fb08c0af710 legacy=0x7fb08c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08bfff700 1 -- 172.21.15.61:0/3413441232 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0681a0 con 0x7fb08c15acf0 2023-12-24T19:57:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08a7fc700 1 -- 172.21.15.61:0/3413441232 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141967401 0 0) 0x7fb08c0687f0 con 0x7fb08c0af710 2023-12-24T19:57:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.396+0000 7fb08affd700 1 --2- 172.21.15.61:0/3413441232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 0x7fb08c0afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:57:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb08bfff700 1 --2- 172.21.15.61:0/3413441232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c15acf0 0x7fb08c067550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb084009e60 tx=0x7fb084009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5297fd75a6a3bfc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb08a7fc700 1 -- 172.21.15.61:0/3413441232 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08400e070 con 0x7fb08c15acf0 2023-12-24T19:57:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb08a7fc700 1 -- 172.21.15.61:0/3413441232 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08400bb60 con 0x7fb08c15acf0 2023-12-24T19:57:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb08a7fc700 1 -- 172.21.15.61:0/3413441232 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084012430 con 0x7fb08c15acf0 2023-12-24T19:57:21.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb091d21700 1 -- 172.21.15.61:0/3413441232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c15acf0 msgr2=0x7fb08c067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb091d21700 1 --2- 172.21.15.61:0/3413441232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c15acf0 0x7fb08c067550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb084009e60 tx=0x7fb084009780 comp rx=0 tx=0).stop 2023-12-24T19:57:21.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb091d21700 1 -- 172.21.15.61:0/3413441232 shutdown_connections 2023-12-24T19:57:21.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb091d21700 1 --2- 172.21.15.61:0/3413441232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c15acf0 0x7fb08c067550 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb091d21700 1 --2- 172.21.15.61:0/3413441232 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 0x7fb08c0afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb091d21700 1 -- 172.21.15.61:0/3413441232 >> 172.21.15.61:0/3413441232 conn(0x7fb08c0ca200 msgr2=0x7fb08c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:21.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb091d21700 1 -- 172.21.15.61:0/3413441232 shutdown_connections 2023-12-24T19:57:21.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.397+0000 7fb091d21700 1 -- 172.21.15.61:0/3413441232 wait complete. 2023-12-24T19:57:21.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.399+0000 7fb091d21700 1 Processor -- start 2023-12-24T19:57:21.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.399+0000 7fb091d21700 1 -- start start 2023-12-24T19:57:21.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.399+0000 7fb091d21700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 0x7fb08c1583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.399+0000 7fb091d21700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb08c0af710 0x7fb08c16e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.399+0000 7fb091d21700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c15acf0 0x7fb08c06dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.399+0000 7fb091d21700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0b3350 con 0x7fb08c0af710 2023-12-24T19:57:21.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.399+0000 7fb091d21700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c16e760 con 0x7fb08c15acf0 2023-12-24T19:57:21.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.399+0000 7fb091d21700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0b27d0 con 0x7fb08c068c80 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb08c0af710 0x7fb08c16e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb08c0af710 0x7fb08c16e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53486/0 (socket says 172.21.15.61:53486) 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08affd700 1 -- 172.21.15.61:0/2980622523 learned_addr learned my addr 172.21.15.61:0/2980622523 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08bfff700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c15acf0 0x7fb08c06dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08b7fe700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 0x7fb08c1583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08affd700 1 -- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 msgr2=0x7fb08c1583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08affd700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 0x7fb08c1583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08affd700 1 -- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c15acf0 msgr2=0x7fb08c06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08affd700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c15acf0 0x7fb08c06dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08affd700 1 -- 172.21.15.61:0/2980622523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080009420 con 0x7fb08c0af710 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08bfff700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c15acf0 0x7fb08c06dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb08affd700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb08c0af710 0x7fb08c16e220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb08000ec80 tx=0x7fb0800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb0737fe700 1 -- 172.21.15.61:0/2980622523 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000c9d0 con 0x7fb08c0af710 2023-12-24T19:57:21.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb0737fe700 1 -- 172.21.15.61:0/2980622523 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08000cb30 con 0x7fb08c0af710 2023-12-24T19:57:21.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb091d21700 1 -- 172.21.15.61:0/2980622523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb084009a20 con 0x7fb08c0af710 2023-12-24T19:57:21.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb0737fe700 1 -- 172.21.15.61:0/2980622523 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080013470 con 0x7fb08c0af710 2023-12-24T19:57:21.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.400+0000 7fb091d21700 1 -- 172.21.15.61:0/2980622523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c0b2d90 con 0x7fb08c0af710 2023-12-24T19:57:21.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.401+0000 7fb091d21700 1 -- 172.21.15.61:0/2980622523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c04c3c0 con 0x7fb08c0af710 2023-12-24T19:57:21.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.402+0000 7fb0737fe700 1 -- 172.21.15.61:0/2980622523 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb080013820 con 0x7fb08c0af710 2023-12-24T19:57:21.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.402+0000 7fb0737fe700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb078066f30 0x7fb0780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.402+0000 7fb0737fe700 1 -- 172.21.15.61:0/2980622523 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb0800845f0 con 0x7fb08c0af710 2023-12-24T19:57:21.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.402+0000 7fb08b7fe700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb078066f30 0x7fb0780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.403+0000 7fb08b7fe700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb078066f30 0x7fb0780693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb07c001750 tx=0x7fb07c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:21.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.406+0000 7fb0737fe700 1 -- 172.21.15.61:0/2980622523 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb080051860 con 0x7fb08c0af710 2023-12-24T19:57:21.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.601+0000 7fb091d21700 1 -- 172.21.15.61:0/2980622523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb08c0a7640 con 0x7fb08c0af710 2023-12-24T19:57:21.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.602+0000 7fb0737fe700 1 -- 172.21.15.61:0/2980622523 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb080054e80 con 0x7fb08c0af710 2023-12-24T19:57:21.602 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:21.603 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 -- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb078066f30 msgr2=0x7fb0780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb078066f30 0x7fb0780693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb07c001750 tx=0x7fb07c009040 comp rx=0 tx=0).stop 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 -- 172.21.15.61:0/2980622523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb08c0af710 msgr2=0x7fb08c16e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb08c0af710 0x7fb08c16e220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb08000ec80 tx=0x7fb0800091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 -- 172.21.15.61:0/2980622523 shutdown_connections 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb08c068c80 0x7fb08c1583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb078066f30 0x7fb0780693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c15acf0 0x7fb08c06dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 --2- 172.21.15.61:0/2980622523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb08c0af710 0x7fb08c16e220 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 -- 172.21.15.61:0/2980622523 >> 172.21.15.61:0/2980622523 conn(0x7fb08c0ca200 msgr2=0x7fb08c06b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 -- 172.21.15.61:0/2980622523 shutdown_connections 2023-12-24T19:57:21.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.604+0000 7fb091d21700 1 -- 172.21.15.61:0/2980622523 wait complete. 2023-12-24T19:57:21.617 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:57:04.595282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:57:05.898273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:57:21.617 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:57:21.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.741+0000 7ff46b056700 1 Processor -- start 2023-12-24T19:57:21.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.742+0000 7ff46b056700 1 -- start start 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.742+0000 7ff46b056700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff464159df0 0x7ff4640cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.742+0000 7ff46b056700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4640cc0e0 0x7ff4640cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.742+0000 7ff46b056700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4640cf150 con 0x7ff46415a1c0 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.742+0000 7ff46b056700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640cc5f0 con 0x7ff4640cc0e0 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.742+0000 7ff46b056700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640ce820 con 0x7ff464159df0 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff463fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff46415a1c0 0x7ff4640cd470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41734/0 (socket says 172.21.15.61:41734) 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff463fff700 1 -- 172.21.15.61:0/2813703091 learned_addr learned my addr 172.21.15.61:0/2813703091 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4695f3700 1 --2- 172.21.15.61:0/2813703091 >> v2:172.21.15.133:3300/0 conn(0x7ff4640cc0e0 0x7ff4640cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702408598 0 0) 0x7ff4640cf150 con 0x7ff46415a1c0 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff468df2700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff464159df0 0x7ff4640cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff454003570 con 0x7ff46415a1c0 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3739199251 0 0) 0x7ff454003570 con 0x7ff46415a1c0 2023-12-24T19:57:21.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff464159df0 msgr2=0x7ff4640cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff464159df0 0x7ff4640cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 >> v2:172.21.15.133:3300/0 conn(0x7ff4640cc0e0 msgr2=0x7ff4640cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 --2- 172.21.15.61:0/2813703091 >> v2:172.21.15.133:3300/0 conn(0x7ff4640cc0e0 0x7ff4640cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640ceb00 con 0x7ff46415a1c0 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7ff450001470 con 0x7ff46415a1c0 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 >> v1:172.21.15.61:6789/0 conn(0x7ff46415a1c0 legacy=0x7ff4640cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 0x7ff454003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff464159df0 0x7ff454004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff454004d50 0x7ff4540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640cc5f0 con 0x7ff454003a60 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640ce820 con 0x7ff454004d50 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45400ba60 con 0x7ff464159df0 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff468df2700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 0x7ff454003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff463fff700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff464159df0 0x7ff454004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.743+0000 7ff4695f3700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff454004d50 0x7ff4540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff468df2700 1 -- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff464159df0 msgr2=0x7ff454004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff468df2700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff464159df0 0x7ff454004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff468df2700 1 -- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff454004d50 msgr2=0x7ff4540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff468df2700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff454004d50 0x7ff4540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff468df2700 1 -- 172.21.15.61:0/2813703091 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff454003570 con 0x7ff454003a60 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff468df2700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 0x7ff454003e70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff458009c00 tx=0x7ff4580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f98ffc1ad1bff35 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45800e6b0 con 0x7ff454003a60 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45800e810 con 0x7ff454003a60 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff4637fe700 1 -- 172.21.15.61:0/2813703091 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45800ebd0 con 0x7ff454003a60 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff46b056700 1 -- 172.21.15.61:0/2813703091 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 msgr2=0x7ff454003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff46b056700 1 --2- 172.21.15.61:0/2813703091 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 0x7ff454003e70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff458009c00 tx=0x7ff4580091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff4695f3700 1 -- 172.21.15.61:0/2813703091 reap_dead start 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff46b056700 1 -- 172.21.15.61:0/2813703091 shutdown_connections 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.744+0000 7ff46b056700 1 -- 172.21.15.61:0/2813703091 >> 172.21.15.61:0/2813703091 conn(0x7ff46406e600 msgr2=0x7ff464067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:21.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.745+0000 7ff46b056700 1 -- 172.21.15.61:0/2813703091 shutdown_connections 2023-12-24T19:57:21.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.745+0000 7ff46b056700 1 -- 172.21.15.61:0/2813703091 wait complete. 2023-12-24T19:57:21.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.746+0000 7ff46b056700 1 Processor -- start 2023-12-24T19:57:21.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.746+0000 7ff46b056700 1 -- start start 2023-12-24T19:57:21.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.746+0000 7ff46b056700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 0x7ff46415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.746+0000 7ff46b056700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4640b4400 0x7ff464155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff46b056700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4640b1b60 0x7ff4640b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff46b056700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640b2520 con 0x7ff454003a60 2023-12-24T19:57:21.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff46b056700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46415ca70 con 0x7ff4640b1b60 2023-12-24T19:57:21.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff46b056700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46415be60 con 0x7ff4640b4400 2023-12-24T19:57:21.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff468df2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 0x7ff46415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff468df2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 0x7ff46415cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53514/0 (socket says 172.21.15.61:53514) 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff468df2700 1 -- 172.21.15.61:0/745130966 learned_addr learned my addr 172.21.15.61:0/745130966 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff4695f3700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4640b1b60 0x7ff4640b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff463fff700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4640b4400 0x7ff464155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff468df2700 1 -- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4640b4400 msgr2=0x7ff464155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff468df2700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4640b4400 0x7ff464155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff468df2700 1 -- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4640b1b60 msgr2=0x7ff4640b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff468df2700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4640b1b60 0x7ff4640b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff468df2700 1 -- 172.21.15.61:0/745130966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46415c140 con 0x7ff454003a60 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff468df2700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 0x7ff46415cf00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff454004730 tx=0x7ff45801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff460ff9700 1 -- 172.21.15.61:0/745130966 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458022070 con 0x7ff454003a60 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff460ff9700 1 -- 172.21.15.61:0/745130966 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45800e980 con 0x7ff454003a60 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff46b056700 1 -- 172.21.15.61:0/745130966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46415c420 con 0x7ff454003a60 2023-12-24T19:57:21.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff460ff9700 1 -- 172.21.15.61:0/745130966 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458027470 con 0x7ff454003a60 2023-12-24T19:57:21.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.747+0000 7ff46b056700 1 -- 172.21.15.61:0/745130966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46415d440 con 0x7ff454003a60 2023-12-24T19:57:21.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.748+0000 7ff46b056700 1 -- 172.21.15.61:0/745130966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff464089040 con 0x7ff454003a60 2023-12-24T19:57:21.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.749+0000 7ff460ff9700 1 -- 172.21.15.61:0/745130966 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff45801c450 con 0x7ff454003a60 2023-12-24T19:57:21.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.749+0000 7ff460ff9700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff448066f60 0x7ff448069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:21.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.749+0000 7ff460ff9700 1 -- 172.21.15.61:0/745130966 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff458086040 con 0x7ff454003a60 2023-12-24T19:57:21.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.749+0000 7ff463fff700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff448066f60 0x7ff448069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:21.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.750+0000 7ff463fff700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff448066f60 0x7ff448069410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4500010e0 tx=0x7ff450009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:21.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.753+0000 7ff460ff9700 1 -- 172.21.15.61:0/745130966 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4580532b0 con 0x7ff454003a60 2023-12-24T19:57:21.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.945+0000 7ff46b056700 1 -- 172.21.15.61:0/745130966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff46404c3c0 con 0x7ff454003a60 2023-12-24T19:57:21.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.946+0000 7ff460ff9700 1 -- 172.21.15.61:0/745130966 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff45802c020 con 0x7ff454003a60 2023-12-24T19:57:21.946 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:57:21.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 -- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff448066f60 msgr2=0x7ff448069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff448066f60 0x7ff448069410 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4500010e0 tx=0x7ff450009040 comp rx=0 tx=0).stop 2023-12-24T19:57:21.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 -- 172.21.15.61:0/745130966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 msgr2=0x7ff46415cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:21.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 0x7ff46415cf00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff454004730 tx=0x7ff45801a000 comp rx=0 tx=0).stop 2023-12-24T19:57:21.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 -- 172.21.15.61:0/745130966 shutdown_connections 2023-12-24T19:57:21.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff448066f60 0x7ff448069410 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4640b1b60 0x7ff4640b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff454003a60 0x7ff46415cf00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 --2- 172.21.15.61:0/745130966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff4640b4400 0x7ff464155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:21.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 -- 172.21.15.61:0/745130966 >> 172.21.15.61:0/745130966 conn(0x7ff46406e600 msgr2=0x7ff4640d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:21.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 -- 172.21.15.61:0/745130966 shutdown_connections 2023-12-24T19:57:21.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:21.948+0000 7ff46b056700 1 -- 172.21.15.61:0/745130966 wait complete. 2023-12-24T19:57:21.960 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:57:22.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.084+0000 7fb22f771700 1 Processor -- start 2023-12-24T19:57:22.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.084+0000 7fb22f771700 1 -- start start 2023-12-24T19:57:22.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22f771700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb228156830 0x7fb2280c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22f771700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb228156c00 0x7fb2280c3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22f771700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb2280cac50 0x7fb228067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22f771700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2280c3870 con 0x7fb2280cac50 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22f771700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2280c8690 con 0x7fb228156830 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22f771700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb228069f00 con 0x7fb228156c00 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22dd0e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb2280cac50 0x7fb228067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22dd0e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb2280cac50 0x7fb228067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53516/0 (socket says 172.21.15.61:53516) 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22dd0e700 1 -- 172.21.15.61:0/1599842321 learned_addr learned my addr 172.21.15.61:0/1599842321 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22d50d700 1 --2- 172.21.15.61:0/1599842321 >> v2:172.21.15.133:3300/0 conn(0x7fb228156830 0x7fb2280c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.085+0000 7fb22cd0c700 1 --2- 172.21.15.61:0/1599842321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb228156c00 0x7fb2280c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22dd0e700 1 -- 172.21.15.61:0/1599842321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb228156c00 msgr2=0x7fb2280c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22dd0e700 1 --2- 172.21.15.61:0/1599842321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb228156c00 0x7fb2280c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22dd0e700 1 -- 172.21.15.61:0/1599842321 >> v2:172.21.15.133:3300/0 conn(0x7fb228156830 msgr2=0x7fb2280c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22dd0e700 1 --2- 172.21.15.61:0/1599842321 >> v2:172.21.15.133:3300/0 conn(0x7fb228156830 0x7fb2280c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22dd0e700 1 -- 172.21.15.61:0/1599842321 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22806a1e0 con 0x7fb2280cac50 2023-12-24T19:57:22.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22dd0e700 1 --2- 172.21.15.61:0/1599842321 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 0x7fb228067550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb228064820 tx=0x7fb22000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d308827adb3e1183 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb21ffff700 1 -- 172.21.15.61:0/1599842321 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220010070 con 0x7fb2280cac50 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb21ffff700 1 -- 172.21.15.61:0/1599842321 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22000de90 con 0x7fb2280cac50 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb21ffff700 1 -- 172.21.15.61:0/1599842321 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22000b320 con 0x7fb2280cac50 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22f771700 1 -- 172.21.15.61:0/1599842321 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 msgr2=0x7fb228067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22f771700 1 --2- 172.21.15.61:0/1599842321 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 0x7fb228067550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb228064820 tx=0x7fb22000ba50 comp rx=0 tx=0).stop 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22f771700 1 -- 172.21.15.61:0/1599842321 shutdown_connections 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22f771700 1 --2- 172.21.15.61:0/1599842321 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 0x7fb228067550 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22f771700 1 --2- 172.21.15.61:0/1599842321 >> v2:172.21.15.133:3300/0 conn(0x7fb228156830 0x7fb2280c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22f771700 1 --2- 172.21.15.61:0/1599842321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb228156c00 0x7fb2280c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.086+0000 7fb22f771700 1 -- 172.21.15.61:0/1599842321 >> 172.21.15.61:0/1599842321 conn(0x7fb2280ce1f0 msgr2=0x7fb2280ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.087+0000 7fb22f771700 1 -- 172.21.15.61:0/1599842321 shutdown_connections 2023-12-24T19:57:22.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.087+0000 7fb22f771700 1 -- 172.21.15.61:0/1599842321 wait complete. 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.088+0000 7fb22f771700 1 Processor -- start 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.088+0000 7fb22f771700 1 -- start start 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22f771700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 0x7fb2281540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22f771700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb228156830 0x7fb228153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22f771700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb228156c00 0x7fb2280b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22f771700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280b1a50 con 0x7fb2280cac50 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22f771700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb228154610 con 0x7fb228156c00 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22f771700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280b14d0 con 0x7fb228156830 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22d50d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 0x7fb2281540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22d50d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 0x7fb2281540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53528/0 (socket says 172.21.15.61:53528) 2023-12-24T19:57:22.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22d50d700 1 -- 172.21.15.61:0/2429271123 learned_addr learned my addr 172.21.15.61:0/2429271123 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22cd0c700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb228156830 0x7fb228153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22dd0e700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb228156c00 0x7fb2280b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22d50d700 1 -- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb228156830 msgr2=0x7fb228153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22d50d700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb228156830 0x7fb228153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22d50d700 1 -- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb228156c00 msgr2=0x7fb2280b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22d50d700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb228156c00 0x7fb2280b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22d50d700 1 -- 172.21.15.61:0/2429271123 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22000bcf0 con 0x7fb2280cac50 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22d50d700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 0x7fb2281540d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb21800d890 tx=0x7fb218008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb21d7fa700 1 -- 172.21.15.61:0/2429271123 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218009610 con 0x7fb2280cac50 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb21d7fa700 1 -- 172.21.15.61:0/2429271123 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218009770 con 0x7fb2280cac50 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22f771700 1 -- 172.21.15.61:0/2429271123 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2280b1770 con 0x7fb2280cac50 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb21d7fa700 1 -- 172.21.15.61:0/2429271123 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218009b30 con 0x7fb2280cac50 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.089+0000 7fb22f771700 1 -- 172.21.15.61:0/2429271123 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb228153d80 con 0x7fb2280cac50 2023-12-24T19:57:22.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.090+0000 7fb22f771700 1 -- 172.21.15.61:0/2429271123 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2280c4c70 con 0x7fb2280cac50 2023-12-24T19:57:22.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.091+0000 7fb21d7fa700 1 -- 172.21.15.61:0/2429271123 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb21801e460 con 0x7fb2280cac50 2023-12-24T19:57:22.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.091+0000 7fb21d7fa700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb20c066f30 0x7fb20c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.091+0000 7fb21d7fa700 1 -- 172.21.15.61:0/2429271123 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb218084aa0 con 0x7fb2280cac50 2023-12-24T19:57:22.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.091+0000 7fb22cd0c700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb20c066f30 0x7fb20c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.092+0000 7fb22cd0c700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb20c066f30 0x7fb20c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb224006aa0 tx=0x7fb224008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:22.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.095+0000 7fb21d7fa700 1 -- 172.21.15.61:0/2429271123 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb218051d10 con 0x7fb2280cac50 2023-12-24T19:57:22.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.290+0000 7fb22f771700 1 -- 172.21.15.61:0/2429271123 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb22804c3c0 con 0x7fb2280cac50 2023-12-24T19:57:22.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.291+0000 7fb21d7fa700 1 -- 172.21.15.61:0/2429271123 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb218055330 con 0x7fb2280cac50 2023-12-24T19:57:22.291 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T19:57:22.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.292+0000 7fb22f771700 1 -- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb20c066f30 msgr2=0x7fb20c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.292+0000 7fb22f771700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb20c066f30 0x7fb20c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb224006aa0 tx=0x7fb224008040 comp rx=0 tx=0).stop 2023-12-24T19:57:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.292+0000 7fb22f771700 1 -- 172.21.15.61:0/2429271123 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 msgr2=0x7fb2281540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.292+0000 7fb22f771700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 0x7fb2281540d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb21800d890 tx=0x7fb218008040 comp rx=0 tx=0).stop 2023-12-24T19:57:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.293+0000 7fb22f771700 1 -- 172.21.15.61:0/2429271123 shutdown_connections 2023-12-24T19:57:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.293+0000 7fb22f771700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb20c066f30 0x7fb20c0693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.293+0000 7fb22f771700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb228156c00 0x7fb2280b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.293+0000 7fb22f771700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2280cac50 0x7fb2281540d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.293+0000 7fb22f771700 1 --2- 172.21.15.61:0/2429271123 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb228156830 0x7fb228153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.293+0000 7fb22f771700 1 -- 172.21.15.61:0/2429271123 >> 172.21.15.61:0/2429271123 conn(0x7fb2280ce1f0 msgr2=0x7fb2280c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.293+0000 7fb22f771700 1 -- 172.21.15.61:0/2429271123 shutdown_connections 2023-12-24T19:57:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.293+0000 7fb22f771700 1 -- 172.21.15.61:0/2429271123 wait complete. 2023-12-24T19:57:22.305 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:57:22.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.429+0000 7f5ee07c2700 1 Processor -- start 2023-12-24T19:57:22.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.429+0000 7f5ee07c2700 1 -- start start 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.430+0000 7f5ee07c2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8159bb0 0x7f5ed815aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.430+0000 7f5ee07c2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ed806f430 0x7f5ed806b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.430+0000 7f5ee07c2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed815aa10 con 0x7f5ed806ac10 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.430+0000 7f5ee07c2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed815b3e0 con 0x7f5ed806f430 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.430+0000 7f5ee07c2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed806b5a0 con 0x7f5ed8159bb0 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5ede55e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8159bb0 0x7f5ed815aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5eded5f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ed806f430 0x7f5ed806b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5ede55e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8159bb0 0x7f5ed815aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:58090/0 (socket says 172.21.15.61:58090) 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5ede55e700 1 -- 172.21.15.61:0/1629172963 learned_addr learned my addr 172.21.15.61:0/1629172963 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5eddd5d700 1 --1- 172.21.15.61:0/1629172963 >> v1:172.21.15.133:6789/0 conn(0x7f5ed806ac10 0x7f5ed806ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:51632/0 (socket says 172.21.15.61:51632) 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5ede55e700 1 -- 172.21.15.61:0/1629172963 >> v2:172.21.15.133:3300/0 conn(0x7f5ed806f430 msgr2=0x7f5ed806b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5ede55e700 1 --2- 172.21.15.61:0/1629172963 >> v2:172.21.15.133:3300/0 conn(0x7f5ed806f430 0x7f5ed806b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5ede55e700 1 -- 172.21.15.61:0/1629172963 >> v1:172.21.15.133:6789/0 conn(0x7f5ed806ac10 legacy=0x7f5ed806ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5ede55e700 1 -- 172.21.15.61:0/1629172963 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed806fa30 con 0x7f5ed8159bb0 2023-12-24T19:57:22.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5eded5f700 1 --2- 172.21.15.61:0/1629172963 >> v2:172.21.15.133:3300/0 conn(0x7f5ed806f430 0x7f5ed806b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:57:22.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5ede55e700 1 --2- 172.21.15.61:0/1629172963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8159bb0 0x7f5ed815aea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80099b0 tx=0x7f5ec8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc395254bdb619d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:22.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5edd55c700 1 -- 172.21.15.61:0/1629172963 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8009ea0 con 0x7f5ed8159bb0 2023-12-24T19:57:22.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5edd55c700 1 -- 172.21.15.61:0/1629172963 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec800b860 con 0x7f5ed8159bb0 2023-12-24T19:57:22.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.431+0000 7f5edd55c700 1 -- 172.21.15.61:0/1629172963 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800bc00 con 0x7f5ed8159bb0 2023-12-24T19:57:22.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.432+0000 7f5ee07c2700 1 -- 172.21.15.61:0/1629172963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8159bb0 msgr2=0x7f5ed815aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.432+0000 7f5ee07c2700 1 --2- 172.21.15.61:0/1629172963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8159bb0 0x7f5ed815aea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80099b0 tx=0x7f5ec8009250 comp rx=0 tx=0).stop 2023-12-24T19:57:22.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.432+0000 7f5ee07c2700 1 -- 172.21.15.61:0/1629172963 shutdown_connections 2023-12-24T19:57:22.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.432+0000 7f5ee07c2700 1 --2- 172.21.15.61:0/1629172963 >> v2:172.21.15.133:3300/0 conn(0x7f5ed806f430 0x7f5ed806b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.432+0000 7f5ee07c2700 1 --2- 172.21.15.61:0/1629172963 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8159bb0 0x7f5ed815aea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.432+0000 7f5ee07c2700 1 -- 172.21.15.61:0/1629172963 >> 172.21.15.61:0/1629172963 conn(0x7f5ed80ce800 msgr2=0x7f5ed80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:22.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.432+0000 7f5ee07c2700 1 -- 172.21.15.61:0/1629172963 shutdown_connections 2023-12-24T19:57:22.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.432+0000 7f5ee07c2700 1 -- 172.21.15.61:0/1629172963 wait complete. 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.433+0000 7f5ee07c2700 1 Processor -- start 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.433+0000 7f5ee07c2700 1 -- start start 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ee07c2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806ac10 0x7f5ed80c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ee07c2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed806f430 0x7f5ed8156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ee07c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ed8159bb0 0x7f5ed816ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ee07c2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8156810 con 0x7f5ed806ac10 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ee07c2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80b3ab0 con 0x7f5ed8159bb0 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ee07c2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80b3620 con 0x7f5ed806f430 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ede55e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806ac10 0x7f5ed80c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ede55e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806ac10 0x7f5ed80c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53530/0 (socket says 172.21.15.61:53530) 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ede55e700 1 -- 172.21.15.61:0/3905422454 learned_addr learned my addr 172.21.15.61:0/3905422454 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5eded5f700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ed8159bb0 0x7f5ed816ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5eddd5d700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed806f430 0x7f5ed8156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ede55e700 1 -- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed806f430 msgr2=0x7f5ed8156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ede55e700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed806f430 0x7f5ed8156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ede55e700 1 -- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ed8159bb0 msgr2=0x7f5ed816ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ede55e700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ed8159bb0 0x7f5ed816ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.434+0000 7f5ede55e700 1 -- 172.21.15.61:0/3905422454 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0009a20 con 0x7f5ed806ac10 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.435+0000 7f5ede55e700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806ac10 0x7f5ed80c80e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8006fd0 tx=0x7f5ec8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.435+0000 7f5ece7fc700 1 -- 172.21.15.61:0/3905422454 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8000d10 con 0x7f5ed806ac10 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.435+0000 7f5ece7fc700 1 -- 172.21.15.61:0/3905422454 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec800bbe0 con 0x7f5ed806ac10 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.435+0000 7f5ee07c2700 1 -- 172.21.15.61:0/3905422454 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec80094f0 con 0x7f5ed806ac10 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.435+0000 7f5ece7fc700 1 -- 172.21.15.61:0/3905422454 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8011650 con 0x7f5ed806ac10 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.435+0000 7f5ee07c2700 1 -- 172.21.15.61:0/3905422454 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed80afec0 con 0x7f5ed806ac10 2023-12-24T19:57:22.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.436+0000 7f5ee07c2700 1 -- 172.21.15.61:0/3905422454 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed815d2c0 con 0x7f5ed806ac10 2023-12-24T19:57:22.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.436+0000 7f5ece7fc700 1 -- 172.21.15.61:0/3905422454 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5ec8011a80 con 0x7f5ed806ac10 2023-12-24T19:57:22.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.437+0000 7f5ece7fc700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ebc066f30 0x7f5ebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.437+0000 7f5ece7fc700 1 -- 172.21.15.61:0/3905422454 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ec8085870 con 0x7f5ed806ac10 2023-12-24T19:57:22.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.437+0000 7f5eddd5d700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ebc066f30 0x7f5ebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.437+0000 7f5eddd5d700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ebc066f30 0x7f5ebc0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ed806d5d0 tx=0x7f5ed4007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:22.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.441+0000 7f5ece7fc700 1 -- 172.21.15.61:0/3905422454 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ec8052c20 con 0x7f5ed806ac10 2023-12-24T19:57:22.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.639+0000 7f5ee07c2700 1 -- 172.21.15.61:0/3905422454 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ed806b260 con 0x7f5ed806ac10 2023-12-24T19:57:22.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.639+0000 7f5ece7fc700 1 -- 172.21.15.61:0/3905422454 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ec8015020 con 0x7f5ed806ac10 2023-12-24T19:57:22.640 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T19:57:22.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 -- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ebc066f30 msgr2=0x7f5ebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ebc066f30 0x7f5ebc0693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ed806d5d0 tx=0x7f5ed4007eb0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 -- 172.21.15.61:0/3905422454 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806ac10 msgr2=0x7f5ed80c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806ac10 0x7f5ed80c80e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8006fd0 tx=0x7f5ec8017000 comp rx=0 tx=0).stop 2023-12-24T19:57:22.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 -- 172.21.15.61:0/3905422454 shutdown_connections 2023-12-24T19:57:22.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ebc066f30 0x7f5ebc0693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ed8159bb0 0x7f5ed816ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806ac10 0x7f5ed80c80e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 --2- 172.21.15.61:0/3905422454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed806f430 0x7f5ed8156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 -- 172.21.15.61:0/3905422454 >> 172.21.15.61:0/3905422454 conn(0x7f5ed80ce800 msgr2=0x7f5ed8158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:22.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 -- 172.21.15.61:0/3905422454 shutdown_connections 2023-12-24T19:57:22.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.642+0000 7f5ee07c2700 1 -- 172.21.15.61:0/3905422454 wait complete. 2023-12-24T19:57:22.654 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:57:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.775+0000 7efc07d61700 1 Processor -- start 2023-12-24T19:57:22.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.775+0000 7efc07d61700 1 -- start start 2023-12-24T19:57:22.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.776+0000 7efc07d61700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc000b3d30 0x7efc000cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.776+0000 7efc07d61700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000b2890 con 0x7efc00068510 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.776+0000 7efc07d61700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000cf630 con 0x7efc00068140 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.776+0000 7efc07d61700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000b2240 con 0x7efc000b3d30 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.776+0000 7efc052fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7efc00068510 0x7efc00159a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41738/0 (socket says 172.21.15.61:41738) 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.776+0000 7efc052fc700 1 -- 172.21.15.61:0/3907078215 learned_addr learned my addr 172.21.15.61:0/3907078215 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.776+0000 7efc062fe700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc000b3d30 0x7efc000cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.776+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680506678 0 0) 0x7efc000b2890 con 0x7efc00068510 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.776+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbec003570 con 0x7efc00068510 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869023853 0 0) 0x7efc000cf630 con 0x7efc00068140 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc000b2890 con 0x7efc00068140 2023-12-24T19:57:22.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 933677235 0 0) 0x7efbec003570 con 0x7efc00068510 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc000b3d30 msgr2=0x7efc000cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc000b3d30 0x7efc000cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 >> v1:172.21.15.133:6789/0 conn(0x7efc00068140 legacy=0x7efc000b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000b2520 con 0x7efc00068510 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7efbf0001470 con 0x7efc00068510 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 >> v1:172.21.15.61:6789/0 conn(0x7efc00068510 legacy=0x7efc00159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbec003c20 0x7efbec004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc000b3d30 0x7efbec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 0x7efbec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000b2240 con 0x7efbec004d50 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbec00bb40 con 0x7efbec003c20 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbec00bd00 con 0x7efc000b3d30 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc062fe700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 0x7efbec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc052fc700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc000b3d30 0x7efbec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc05afd700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbec003c20 0x7efbec004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc062fe700 1 -- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc000b3d30 msgr2=0x7efbec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc062fe700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc000b3d30 0x7efbec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc062fe700 1 -- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbec003c20 msgr2=0x7efbec004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc062fe700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbec003c20 0x7efbec004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc062fe700 1 -- 172.21.15.61:0/3907078215 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec003570 con 0x7efbec004d50 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc062fe700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 0x7efbec0051c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efbf800e210 tx=0x7efbf800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6cce6f511924ad server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800eac0 con 0x7efbec004d50 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf800f040 con 0x7efbec004d50 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.777+0000 7efc04afb700 1 -- 172.21.15.61:0/3907078215 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800ee70 con 0x7efbec004d50 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.778+0000 7efc07d61700 1 -- 172.21.15.61:0/3907078215 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 msgr2=0x7efbec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.778+0000 7efc07d61700 1 --2- 172.21.15.61:0/3907078215 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 0x7efbec0051c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efbf800e210 tx=0x7efbf800b040 comp rx=0 tx=0).stop 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.778+0000 7efc062fe700 1 -- 172.21.15.61:0/3907078215 reap_dead start 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.778+0000 7efc07d61700 1 -- 172.21.15.61:0/3907078215 shutdown_connections 2023-12-24T19:57:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.778+0000 7efc07d61700 1 -- 172.21.15.61:0/3907078215 >> 172.21.15.61:0/3907078215 conn(0x7efc00097a10 msgr2=0x7efc000ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.778+0000 7efc07d61700 1 -- 172.21.15.61:0/3907078215 shutdown_connections 2023-12-24T19:57:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.778+0000 7efc07d61700 1 -- 172.21.15.61:0/3907078215 wait complete. 2023-12-24T19:57:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.779+0000 7efc07d61700 1 Processor -- start 2023-12-24T19:57:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.779+0000 7efc07d61700 1 -- start start 2023-12-24T19:57:22.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc07d61700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 0x7efc00155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc07d61700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc0016d660 0x7efc0009b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc07d61700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc0016dad0 0x7efc0009be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc07d61700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0016e090 con 0x7efbec004d50 2023-12-24T19:57:22.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc07d61700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0016e370 con 0x7efc0016d660 2023-12-24T19:57:22.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc07d61700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0015ba30 con 0x7efc0016dad0 2023-12-24T19:57:22.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc05afd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 0x7efc00155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc05afd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 0x7efc00155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53538/0 (socket says 172.21.15.61:53538) 2023-12-24T19:57:22.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc05afd700 1 -- 172.21.15.61:0/3095442480 learned_addr learned my addr 172.21.15.61:0/3095442480 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:22.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc062fe700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc0016dad0 0x7efc0009be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc052fc700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc0016d660 0x7efc0009b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc05afd700 1 -- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc0016dad0 msgr2=0x7efc0009be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc05afd700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc0016dad0 0x7efc0009be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc05afd700 1 -- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc0016d660 msgr2=0x7efc0009b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:22.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc05afd700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc0016d660 0x7efc0009b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:22.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.780+0000 7efc05afd700 1 -- 172.21.15.61:0/3095442480 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0015bd10 con 0x7efbec004d50 2023-12-24T19:57:22.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.781+0000 7efc05afd700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 0x7efc00155b60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efbfc00f830 tx=0x7efbfc007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:22.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.781+0000 7efbf5ffb700 1 -- 172.21.15.61:0/3095442480 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc00d700 con 0x7efbec004d50 2023-12-24T19:57:22.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.781+0000 7efbf5ffb700 1 -- 172.21.15.61:0/3095442480 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc00d860 con 0x7efbec004d50 2023-12-24T19:57:22.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.781+0000 7efbf5ffb700 1 -- 172.21.15.61:0/3095442480 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc00dbe0 con 0x7efbec004d50 2023-12-24T19:57:22.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.781+0000 7efc07d61700 1 -- 172.21.15.61:0/3095442480 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc001560a0 con 0x7efbec004d50 2023-12-24T19:57:22.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.781+0000 7efc07d61700 1 -- 172.21.15.61:0/3095442480 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0015b690 con 0x7efbec004d50 2023-12-24T19:57:22.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.782+0000 7efc07d61700 1 -- 172.21.15.61:0/3095442480 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0015b890 con 0x7efbec004d50 2023-12-24T19:57:22.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.782+0000 7efbf5ffb700 1 -- 172.21.15.61:0/3095442480 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7efbfc00dd40 con 0x7efbec004d50 2023-12-24T19:57:22.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.782+0000 7efbf5ffb700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efbe4066f30 0x7efbe40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:22.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.782+0000 7efbf5ffb700 1 -- 172.21.15.61:0/3095442480 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efbfc084310 con 0x7efbec004d50 2023-12-24T19:57:22.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.783+0000 7efc052fc700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efbe4066f30 0x7efbe40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:22.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.783+0000 7efc052fc700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efbe4066f30 0x7efbe40693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efbf0001ca0 tx=0x7efbf0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:22.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:22.787+0000 7efbf5ffb700 1 -- 172.21.15.61:0/3095442480 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc0015b890 con 0x7efbec004d50 2023-12-24T19:57:23.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.027+0000 7efc07d61700 1 -- 172.21.15.61:0/3095442480 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc0015b890 con 0x7efbec004d50 2023-12-24T19:57:23.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.028+0000 7efbf5ffb700 1 -- 172.21.15.61:0/3095442480 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7efc0015b890 con 0x7efbec004d50 2023-12-24T19:57:23.029 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:23.029 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3729732902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3729732902},{"type":"v1","addr":"172.21.15.61:6834","nonce":3729732902}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/402997858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":402997858},{"type":"v1","addr":"172.21.15.133:6837","nonce":402997858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/180373533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":180373533},{"type":"v1","addr":"172.21.15.61:6835","nonce":180373533}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:06.924129+0000","modified":"2023-12-24T19:57:10.540414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/74793696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":74793696},{"type":"v1","addr":"172.21.15.133:6836","nonce":74793696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T19:57:23.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 -- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efbe4066f30 msgr2=0x7efbe40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efbe4066f30 0x7efbe40693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efbf0001ca0 tx=0x7efbf0009040 comp rx=0 tx=0).stop 2023-12-24T19:57:23.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 -- 172.21.15.61:0/3095442480 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 msgr2=0x7efc00155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 0x7efc00155b60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efbfc00f830 tx=0x7efbfc007d80 comp rx=0 tx=0).stop 2023-12-24T19:57:23.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 -- 172.21.15.61:0/3095442480 shutdown_connections 2023-12-24T19:57:23.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efc0016dad0 0x7efc0009be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efbe4066f30 0x7efbe40693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efbec004d50 0x7efc00155b60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 --2- 172.21.15.61:0/3095442480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc0016d660 0x7efc0009b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 -- 172.21.15.61:0/3095442480 >> 172.21.15.61:0/3095442480 conn(0x7efc00097a10 msgr2=0x7efc000ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:23.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 -- 172.21.15.61:0/3095442480 shutdown_connections 2023-12-24T19:57:23.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.030+0000 7efc07d61700 1 -- 172.21.15.61:0/3095442480 wait complete. 2023-12-24T19:57:23.033 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 7 2023-12-24T19:57:23.043 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:23.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.164+0000 7f7f84d00700 1 Processor -- start 2023-12-24T19:57:23.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.164+0000 7f7f84d00700 1 -- start start 2023-12-24T19:57:23.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.165+0000 7f7f84d00700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f80159a90 0x7f7f80070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.165+0000 7f7f84d00700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7f80159e60 0x7f7f80070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.165+0000 7f7f84d00700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f800b04c0 0x7f7f800c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.165+0000 7f7f84d00700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8006a090 con 0x7f7f80159e60 2023-12-24T19:57:23.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.165+0000 7f7f84d00700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8006ac10 con 0x7f7f800b04c0 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.165+0000 7f7f84d00700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8006a2e0 con 0x7f7f80159a90 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.165+0000 7f7f7dd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7f80159e60 0x7f7f80070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.165+0000 7f7f7dd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7f80159e60 0x7f7f80070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53552/0 (socket says 172.21.15.61:53552) 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.165+0000 7f7f7dd9b700 1 -- 172.21.15.61:0/407244975 learned_addr learned my addr 172.21.15.61:0/407244975 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7e59c700 1 --2- 172.21.15.61:0/407244975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f80159a90 0x7f7f80070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7ed9d700 1 --2- 172.21.15.61:0/407244975 >> v2:172.21.15.133:3300/0 conn(0x7f7f800b04c0 0x7f7f800c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7dd9b700 1 -- 172.21.15.61:0/407244975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f80159a90 msgr2=0x7f7f80070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7dd9b700 1 --2- 172.21.15.61:0/407244975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f80159a90 0x7f7f80070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7dd9b700 1 -- 172.21.15.61:0/407244975 >> v2:172.21.15.133:3300/0 conn(0x7f7f800b04c0 msgr2=0x7f7f800c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7dd9b700 1 --2- 172.21.15.61:0/407244975 >> v2:172.21.15.133:3300/0 conn(0x7f7f800b04c0 0x7f7f800c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7dd9b700 1 -- 172.21.15.61:0/407244975 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8006a5c0 con 0x7f7f80159e60 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7e59c700 1 --2- 172.21.15.61:0/407244975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f80159a90 0x7f7f80070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7ed9d700 1 --2- 172.21.15.61:0/407244975 >> v2:172.21.15.133:3300/0 conn(0x7f7f800b04c0 0x7f7f800c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:23.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7dd9b700 1 --2- 172.21.15.61:0/407244975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f80159e60 0x7f7f80070b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7f80071700 tx=0x7f7f70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a941f43a2d0d0192 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7d59a700 1 -- 172.21.15.61:0/407244975 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000b860 con 0x7f7f80159e60 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7d59a700 1 -- 172.21.15.61:0/407244975 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000b9c0 con 0x7f7f80159e60 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f7d59a700 1 -- 172.21.15.61:0/407244975 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000bd60 con 0x7f7f80159e60 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f84d00700 1 -- 172.21.15.61:0/407244975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f80159e60 msgr2=0x7f7f80070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.166+0000 7f7f84d00700 1 --2- 172.21.15.61:0/407244975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f80159e60 0x7f7f80070b80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7f80071700 tx=0x7f7f70009250 comp rx=0 tx=0).stop 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.167+0000 7f7f84d00700 1 -- 172.21.15.61:0/407244975 shutdown_connections 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.167+0000 7f7f84d00700 1 --2- 172.21.15.61:0/407244975 >> v2:172.21.15.133:3300/0 conn(0x7f7f800b04c0 0x7f7f800c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.167+0000 7f7f84d00700 1 --2- 172.21.15.61:0/407244975 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f80159a90 0x7f7f80070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.167+0000 7f7f84d00700 1 --2- 172.21.15.61:0/407244975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f80159e60 0x7f7f80070b80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.167+0000 7f7f84d00700 1 -- 172.21.15.61:0/407244975 >> 172.21.15.61:0/407244975 conn(0x7f7f800cd6f0 msgr2=0x7f7f800cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.167+0000 7f7f84d00700 1 -- 172.21.15.61:0/407244975 shutdown_connections 2023-12-24T19:57:23.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.167+0000 7f7f84d00700 1 -- 172.21.15.61:0/407244975 wait complete. 2023-12-24T19:57:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.168+0000 7f7f84d00700 1 Processor -- start 2023-12-24T19:57:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.168+0000 7f7f84d00700 1 -- start start 2023-12-24T19:57:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.168+0000 7f7f84d00700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f800b04c0 0x7f7f80154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.168+0000 7f7f84d00700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f80159a90 0x7f7f801566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.168+0000 7f7f84d00700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f80159e60 0x7f7f80156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f84d00700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8015bf60 con 0x7f7f800b04c0 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f84d00700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f801554e0 con 0x7f7f80159e60 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f84d00700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8015c170 con 0x7f7f80159a90 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f7e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f800b04c0 0x7f7f80154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f7e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f800b04c0 0x7f7f80154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53562/0 (socket says 172.21.15.61:53562) 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f7e59c700 1 -- 172.21.15.61:0/3847384309 learned_addr learned my addr 172.21.15.61:0/3847384309 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f7e59c700 1 -- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f80159a90 msgr2=0x7f7f801566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f7e59c700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f80159a90 0x7f7f801566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f7e59c700 1 -- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f80159e60 msgr2=0x7f7f80156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f7ed9d700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f80159e60 0x7f7f80156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f7e59c700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f80159e60 0x7f7f80156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f7e59c700 1 -- 172.21.15.61:0/3847384309 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700094f0 con 0x7f7f800b04c0 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f7e59c700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f800b04c0 0x7f7f80154fa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c830 tx=0x7f7f74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f6e7fc700 1 -- 172.21.15.61:0/3847384309 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400a680 con 0x7f7f800b04c0 2023-12-24T19:57:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f6e7fc700 1 -- 172.21.15.61:0/3847384309 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400a7e0 con 0x7f7f800b04c0 2023-12-24T19:57:23.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f84d00700 1 -- 172.21.15.61:0/3847384309 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f8015c450 con 0x7f7f800b04c0 2023-12-24T19:57:23.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f6e7fc700 1 -- 172.21.15.61:0/3847384309 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400aba0 con 0x7f7f800b04c0 2023-12-24T19:57:23.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.169+0000 7f7f84d00700 1 -- 172.21.15.61:0/3847384309 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8015ca10 con 0x7f7f800b04c0 2023-12-24T19:57:23.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.170+0000 7f7f84d00700 1 -- 172.21.15.61:0/3847384309 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8004c3c0 con 0x7f7f800b04c0 2023-12-24T19:57:23.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.171+0000 7f7f6e7fc700 1 -- 172.21.15.61:0/3847384309 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7f740113f0 con 0x7f7f800b04c0 2023-12-24T19:57:23.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.171+0000 7f7f6e7fc700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7f60066f30 0x7f7f600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.171+0000 7f7f6e7fc700 1 -- 172.21.15.61:0/3847384309 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f74084a40 con 0x7f7f800b04c0 2023-12-24T19:57:23.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.171+0000 7f7f7dd9b700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7f60066f30 0x7f7f600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.172+0000 7f7f7dd9b700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7f60066f30 0x7f7f600693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f8015d710 tx=0x7f7f70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:23.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.175+0000 7f7f6e7fc700 1 -- 172.21.15.61:0/3847384309 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f74086e60 con 0x7f7f800b04c0 2023-12-24T19:57:23.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.371+0000 7f7f84d00700 1 -- 172.21.15.61:0/3847384309 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f8015cc00 con 0x7f7f800b04c0 2023-12-24T19:57:23.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.372+0000 7f7f6e7fc700 1 -- 172.21.15.61:0/3847384309 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f7f74015090 con 0x7f7f800b04c0 2023-12-24T19:57:23.372 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:23.373 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 -- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7f60066f30 msgr2=0x7f7f600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7f60066f30 0x7f7f600693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f8015d710 tx=0x7f7f70017000 comp rx=0 tx=0).stop 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 -- 172.21.15.61:0/3847384309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f800b04c0 msgr2=0x7f7f80154fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f800b04c0 0x7f7f80154fa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c830 tx=0x7f7f74008040 comp rx=0 tx=0).stop 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 -- 172.21.15.61:0/3847384309 shutdown_connections 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7f60066f30 0x7f7f600693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f80159e60 0x7f7f80156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7f800b04c0 0x7f7f80154fa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 --2- 172.21.15.61:0/3847384309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7f80159a90 0x7f7f801566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 -- 172.21.15.61:0/3847384309 >> 172.21.15.61:0/3847384309 conn(0x7f7f800cd6f0 msgr2=0x7f7f800cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 -- 172.21.15.61:0/3847384309 shutdown_connections 2023-12-24T19:57:23.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.374+0000 7f7f84d00700 1 -- 172.21.15.61:0/3847384309 wait complete. 2023-12-24T19:57:23.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:57:04.595282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:57:05.898273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:57:23.387 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:57:23.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.511+0000 7f92933a1700 1 Processor -- start 2023-12-24T19:57:23.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.511+0000 7f92933a1700 1 -- start start 2023-12-24T19:57:23.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f92933a1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f928c06f4f0 0x7f928c0c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f92933a1700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928c0c9310 con 0x7f928c159be0 2023-12-24T19:57:23.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f92933a1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928c0c8d30 con 0x7f928c159810 2023-12-24T19:57:23.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f92933a1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928c06f910 con 0x7f928c06f4f0 2023-12-24T19:57:23.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f9292ba0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f928c06f4f0 0x7f928c0c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f9291b9e700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f928c159be0 0x7f928c067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41744/0 (socket says 172.21.15.61:41744) 2023-12-24T19:57:23.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f9291b9e700 1 -- 172.21.15.61:0/1924112899 learned_addr learned my addr 172.21.15.61:0/1924112899 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:23.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f9292ba0700 1 -- 172.21.15.61:0/1924112899 >> v1:172.21.15.133:6789/0 conn(0x7f928c159810 legacy=0x7f928c06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f9292ba0700 1 -- 172.21.15.61:0/1924112899 >> v1:172.21.15.61:6789/0 conn(0x7f928c159be0 legacy=0x7f928c067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f9292ba0700 1 -- 172.21.15.61:0/1924112899 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c06c9b0 con 0x7f928c06f4f0 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.512+0000 7f929139d700 1 -- 172.21.15.61:0/1924112899 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017678255 0 0) 0x7f928c0c9310 con 0x7f928c159be0 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f9292ba0700 1 --2- 172.21.15.61:0/1924112899 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c06f4f0 0x7f928c0c97a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9284009e60 tx=0x7f9284009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fef288e5ce36992 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f929139d700 1 -- 172.21.15.61:0/1924112899 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400e070 con 0x7f928c06f4f0 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f929139d700 1 -- 172.21.15.61:0/1924112899 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928400bc30 con 0x7f928c06f4f0 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f929139d700 1 -- 172.21.15.61:0/1924112899 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284012430 con 0x7f928c06f4f0 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f92933a1700 1 -- 172.21.15.61:0/1924112899 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c06f4f0 msgr2=0x7f928c0c97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f92933a1700 1 --2- 172.21.15.61:0/1924112899 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c06f4f0 0x7f928c0c97a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9284009e60 tx=0x7f9284009780 comp rx=0 tx=0).stop 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f92933a1700 1 -- 172.21.15.61:0/1924112899 shutdown_connections 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f92933a1700 1 --2- 172.21.15.61:0/1924112899 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c06f4f0 0x7f928c0c97a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f92933a1700 1 -- 172.21.15.61:0/1924112899 >> 172.21.15.61:0/1924112899 conn(0x7f928c0cf110 msgr2=0x7f928c0cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f92933a1700 1 -- 172.21.15.61:0/1924112899 shutdown_connections 2023-12-24T19:57:23.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.513+0000 7f92933a1700 1 -- 172.21.15.61:0/1924112899 wait complete. 2023-12-24T19:57:23.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.515+0000 7f92933a1700 1 Processor -- start 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.515+0000 7f92933a1700 1 -- start start 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f92933a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f928c06f4f0 0x7f928c14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f92933a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f928c159810 0x7f928c0c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f92933a1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c159be0 0x7f928c0c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f92933a1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c14f300 con 0x7f928c159be0 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f92933a1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c0c6120 con 0x7f928c159810 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f92933a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928c156bf0 con 0x7f928c06f4f0 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f9292ba0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c159be0 0x7f928c0c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f9292ba0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c159be0 0x7f928c0c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53568/0 (socket says 172.21.15.61:53568) 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f9292ba0700 1 -- 172.21.15.61:0/3603137434 learned_addr learned my addr 172.21.15.61:0/3603137434 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f929239f700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f928c06f4f0 0x7f928c14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f9291b9e700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f928c159810 0x7f928c0c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f9292ba0700 1 -- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f928c06f4f0 msgr2=0x7f928c14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f9292ba0700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f928c06f4f0 0x7f928c14edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f9292ba0700 1 -- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f928c159810 msgr2=0x7f928c0c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f9292ba0700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f928c159810 0x7f928c0c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f9292ba0700 1 -- 172.21.15.61:0/3603137434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284009a20 con 0x7f928c159be0 2023-12-24T19:57:23.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.516+0000 7f929239f700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f928c06f4f0 0x7f928c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:23.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.517+0000 7f9292ba0700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c159be0 0x7f928c0c7a40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9284013000 tx=0x7f9284019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:23.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.517+0000 7f927e7fc700 1 -- 172.21.15.61:0/3603137434 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928401b630 con 0x7f928c159be0 2023-12-24T19:57:23.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.517+0000 7f927e7fc700 1 -- 172.21.15.61:0/3603137434 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928401b7b0 con 0x7f928c159be0 2023-12-24T19:57:23.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.517+0000 7f927e7fc700 1 -- 172.21.15.61:0/3603137434 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928401bb70 con 0x7f928c159be0 2023-12-24T19:57:23.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.517+0000 7f92933a1700 1 -- 172.21.15.61:0/3603137434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c157170 con 0x7f928c159be0 2023-12-24T19:57:23.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.517+0000 7f92933a1700 1 -- 172.21.15.61:0/3603137434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c0c8380 con 0x7f928c159be0 2023-12-24T19:57:23.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.518+0000 7f92933a1700 1 -- 172.21.15.61:0/3603137434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c0c8590 con 0x7f928c159be0 2023-12-24T19:57:23.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.518+0000 7f927e7fc700 1 -- 172.21.15.61:0/3603137434 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f928401c400 con 0x7f928c159be0 2023-12-24T19:57:23.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.519+0000 7f927e7fc700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9270066f30 0x7f92700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.519+0000 7f927e7fc700 1 -- 172.21.15.61:0/3603137434 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92840865d0 con 0x7f928c159be0 2023-12-24T19:57:23.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.519+0000 7f929239f700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9270066f30 0x7f92700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.520+0000 7f929239f700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9270066f30 0x7f92700693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9280007fd0 tx=0x7f9280009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:23.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.523+0000 7f927e7fc700 1 -- 172.21.15.61:0/3603137434 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f928c0c8590 con 0x7f928c159be0 2023-12-24T19:57:23.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.717+0000 7f92933a1700 1 -- 172.21.15.61:0/3603137434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f928c0c8560 con 0x7f928c159be0 2023-12-24T19:57:23.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.718+0000 7f927e7fc700 1 -- 172.21.15.61:0/3603137434 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9284053840 con 0x7f928c159be0 2023-12-24T19:57:23.718 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:57:23.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.719+0000 7f92933a1700 1 -- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9270066f30 msgr2=0x7f92700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.719+0000 7f92933a1700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9270066f30 0x7f92700693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9280007fd0 tx=0x7f9280009040 comp rx=0 tx=0).stop 2023-12-24T19:57:23.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.719+0000 7f92933a1700 1 -- 172.21.15.61:0/3603137434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c159be0 msgr2=0x7f928c0c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.719+0000 7f92933a1700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c159be0 0x7f928c0c7a40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9284013000 tx=0x7f9284019000 comp rx=0 tx=0).stop 2023-12-24T19:57:23.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.719+0000 7f92933a1700 1 -- 172.21.15.61:0/3603137434 shutdown_connections 2023-12-24T19:57:23.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.719+0000 7f92933a1700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f928c06f4f0 0x7f928c14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.719+0000 7f92933a1700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9270066f30 0x7f92700693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.719+0000 7f92933a1700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f928c159be0 0x7f928c0c7a40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.719+0000 7f92933a1700 1 --2- 172.21.15.61:0/3603137434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f928c159810 0x7f928c0c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.719+0000 7f92933a1700 1 -- 172.21.15.61:0/3603137434 >> 172.21.15.61:0/3603137434 conn(0x7f928c0cf110 msgr2=0x7f928c068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:23.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.720+0000 7f92933a1700 1 -- 172.21.15.61:0/3603137434 shutdown_connections 2023-12-24T19:57:23.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.720+0000 7f92933a1700 1 -- 172.21.15.61:0/3603137434 wait complete. 2023-12-24T19:57:23.732 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:57:23.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.856+0000 7f7ba2fcc700 1 Processor -- start 2023-12-24T19:57:23.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.856+0000 7f7ba2fcc700 1 -- start start 2023-12-24T19:57:23.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba2fcc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7b9c1578b0 0x7f7b9c15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba2fcc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b9c069500 0x7f7b9c069940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba2fcc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c0ab770 con 0x7f7b9c0caa70 2023-12-24T19:57:23.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba2fcc700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c15b250 con 0x7f7b9c1578b0 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba2fcc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c0aa880 con 0x7f7b9c069500 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba0d68700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7b9c1578b0 0x7f7b9c15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba0d68700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7b9c1578b0 0x7f7b9c15ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53576/0 (socket says 172.21.15.61:53576) 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba0d68700 1 -- 172.21.15.61:0/2046342276 learned_addr learned my addr 172.21.15.61:0/2046342276 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba1569700 1 --2- 172.21.15.61:0/2046342276 >> v2:172.21.15.133:3300/0 conn(0x7f7b9c069500 0x7f7b9c069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba0d68700 1 -- 172.21.15.61:0/2046342276 >> v2:172.21.15.133:3300/0 conn(0x7f7b9c069500 msgr2=0x7f7b9c069940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba0d68700 1 --2- 172.21.15.61:0/2046342276 >> v2:172.21.15.133:3300/0 conn(0x7f7b9c069500 0x7f7b9c069940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba0d68700 1 -- 172.21.15.61:0/2046342276 >> v1:172.21.15.133:6789/0 conn(0x7f7b9c0caa70 legacy=0x7f7b9c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.857+0000 7f7ba0d68700 1 -- 172.21.15.61:0/2046342276 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0aab60 con 0x7f7b9c1578b0 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7ba0d68700 1 --2- 172.21.15.61:0/2046342276 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c1578b0 0x7f7b9c15ad10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ab6e0 tx=0x7f7b90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bffa472e945f04 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7b9b7fe700 1 -- 172.21.15.61:0/2046342276 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9000b860 con 0x7f7b9c1578b0 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7b9b7fe700 1 -- 172.21.15.61:0/2046342276 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9000b9c0 con 0x7f7b9c1578b0 2023-12-24T19:57:23.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7b9b7fe700 1 -- 172.21.15.61:0/2046342276 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9000bd60 con 0x7f7b9c1578b0 2023-12-24T19:57:23.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/2046342276 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c1578b0 msgr2=0x7f7b9c15ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7ba2fcc700 1 --2- 172.21.15.61:0/2046342276 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c1578b0 0x7f7b9c15ad10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ab6e0 tx=0x7f7b90009250 comp rx=0 tx=0).stop 2023-12-24T19:57:23.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/2046342276 shutdown_connections 2023-12-24T19:57:23.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7ba2fcc700 1 --2- 172.21.15.61:0/2046342276 >> v2:172.21.15.133:3300/0 conn(0x7f7b9c069500 0x7f7b9c069940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7ba2fcc700 1 --2- 172.21.15.61:0/2046342276 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c1578b0 0x7f7b9c15ad10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/2046342276 >> 172.21.15.61:0/2046342276 conn(0x7f7b9c067fd0 msgr2=0x7f7b9c0ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:23.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/2046342276 shutdown_connections 2023-12-24T19:57:23.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.858+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/2046342276 wait complete. 2023-12-24T19:57:23.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.859+0000 7f7ba2fcc700 1 Processor -- start 2023-12-24T19:57:23.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.860+0000 7f7ba2fcc700 1 -- start start 2023-12-24T19:57:23.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.860+0000 7f7ba2fcc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b9c069500 0x7f7b9c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.860+0000 7f7ba2fcc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c0caa70 0x7f7b9c0c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.860+0000 7f7ba2fcc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1578b0 0x7f7b9c0c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.860+0000 7f7ba2fcc700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0c4f20 con 0x7f7b9c0caa70 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.860+0000 7f7ba2fcc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0c54a0 con 0x7f7b9c1578b0 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.860+0000 7f7ba2fcc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c154310 con 0x7f7b9c069500 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b9bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c0caa70 0x7f7b9c0c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b9bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c0caa70 0x7f7b9c0c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53580/0 (socket says 172.21.15.61:53580) 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b9bfff700 1 -- 172.21.15.61:0/413910622 learned_addr learned my addr 172.21.15.61:0/413910622 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7ba1569700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1578b0 0x7f7b9c0c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7ba0d68700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b9c069500 0x7f7b9c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b9bfff700 1 -- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b9c069500 msgr2=0x7f7b9c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b9bfff700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b9c069500 0x7f7b9c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b9bfff700 1 -- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1578b0 msgr2=0x7f7b9c0c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b9bfff700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1578b0 0x7f7b9c0c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:23.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b9bfff700 1 -- 172.21.15.61:0/413910622 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b900094f0 con 0x7f7b9c0caa70 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b9bfff700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c0caa70 0x7f7b9c0c5930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800c790 tx=0x7f7b88007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b98ff9700 1 -- 172.21.15.61:0/413910622 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88011590 con 0x7f7b9c0caa70 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b98ff9700 1 -- 172.21.15.61:0/413910622 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88011710 con 0x7f7b9c0caa70 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/413910622 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c0c5e70 con 0x7f7b9c0caa70 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7b98ff9700 1 -- 172.21.15.61:0/413910622 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88011ad0 con 0x7f7b9c0caa70 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.861+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/413910622 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c0c6bd0 con 0x7f7b9c0caa70 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.862+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/413910622 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c15a760 con 0x7f7b9c0caa70 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.863+0000 7f7b98ff9700 1 -- 172.21.15.61:0/413910622 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7b8801b3b0 con 0x7f7b9c0caa70 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.863+0000 7f7b98ff9700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b80066f30 0x7f7b800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.863+0000 7f7b98ff9700 1 -- 172.21.15.61:0/413910622 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b88083a60 con 0x7f7b9c0caa70 2023-12-24T19:57:23.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.863+0000 7f7ba0d68700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b80066f30 0x7f7b800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:23.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.864+0000 7f7ba0d68700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b80066f30 0x7f7b800693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ab6e0 tx=0x7f7b90017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:23.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:23.867+0000 7f7b98ff9700 1 -- 172.21.15.61:0/413910622 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b88050cd0 con 0x7f7b9c0caa70 2023-12-24T19:57:24.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.058+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/413910622 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b9c04c3c0 con 0x7f7b9c0caa70 2023-12-24T19:57:24.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.058+0000 7f7b98ff9700 1 -- 172.21.15.61:0/413910622 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b88017020 con 0x7f7b9c0caa70 2023-12-24T19:57:24.059 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T19:57:24.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.060+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b80066f30 msgr2=0x7f7b800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.060+0000 7f7ba2fcc700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b80066f30 0x7f7b800693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0ab6e0 tx=0x7f7b90017000 comp rx=0 tx=0).stop 2023-12-24T19:57:24.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.060+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/413910622 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c0caa70 msgr2=0x7f7b9c0c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.060+0000 7f7ba2fcc700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c0caa70 0x7f7b9c0c5930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800c790 tx=0x7f7b88007f40 comp rx=0 tx=0).stop 2023-12-24T19:57:24.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.060+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/413910622 shutdown_connections 2023-12-24T19:57:24.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.060+0000 7f7ba2fcc700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b9c069500 0x7f7b9c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.060+0000 7f7ba2fcc700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b80066f30 0x7f7b800693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.060+0000 7f7ba2fcc700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1578b0 0x7f7b9c0c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.060+0000 7f7ba2fcc700 1 --2- 172.21.15.61:0/413910622 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b9c0caa70 0x7f7b9c0c5930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.060+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/413910622 >> 172.21.15.61:0/413910622 conn(0x7f7b9c067fd0 msgr2=0x7f7b9c0cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:24.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.061+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/413910622 shutdown_connections 2023-12-24T19:57:24.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.061+0000 7f7ba2fcc700 1 -- 172.21.15.61:0/413910622 wait complete. 2023-12-24T19:57:24.073 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:57:24.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.197+0000 7f3fa8a86700 1 Processor -- start 2023-12-24T19:57:24.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.197+0000 7f3fa8a86700 1 -- start start 2023-12-24T19:57:24.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa8a86700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3fa40caa70 0x7f3fa40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa8a86700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa4069500 0x7f3fa4069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa8a86700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa40ab770 con 0x7f3fa41578b0 2023-12-24T19:57:24.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa8a86700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa40cb450 con 0x7f3fa40caa70 2023-12-24T19:57:24.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa8a86700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40aa880 con 0x7f3fa4069500 2023-12-24T19:57:24.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa1d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3fa40caa70 0x7f3fa40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa1d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3fa40caa70 0x7f3fa40caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53584/0 (socket says 172.21.15.61:53584) 2023-12-24T19:57:24.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa1d9b700 1 -- 172.21.15.61:0/2646626046 learned_addr learned my addr 172.21.15.61:0/2646626046 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:24.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa2d9d700 1 --2- 172.21.15.61:0/2646626046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa4069500 0x7f3fa4069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa1d9b700 1 -- 172.21.15.61:0/2646626046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa4069500 msgr2=0x7f3fa4069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:24.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.198+0000 7f3fa1d9b700 1 --2- 172.21.15.61:0/2646626046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa4069500 0x7f3fa4069910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa1d9b700 1 -- 172.21.15.61:0/2646626046 >> v1:172.21.15.133:6789/0 conn(0x7f3fa41578b0 legacy=0x7f3fa415ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa1d9b700 1 -- 172.21.15.61:0/2646626046 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40aab60 con 0x7f3fa40caa70 2023-12-24T19:57:24.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa1d9b700 1 --2- 172.21.15.61:0/2646626046 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa40caa70 0x7f3fa40caf10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f940099b0 tx=0x7f3f94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1807aca2df8faa6b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:24.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa159a700 1 -- 172.21.15.61:0/2646626046 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94009ea0 con 0x7f3fa40caa70 2023-12-24T19:57:24.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa159a700 1 -- 172.21.15.61:0/2646626046 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9400b860 con 0x7f3fa40caa70 2023-12-24T19:57:24.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa159a700 1 -- 172.21.15.61:0/2646626046 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400bc00 con 0x7f3fa40caa70 2023-12-24T19:57:24.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa8a86700 1 -- 172.21.15.61:0/2646626046 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa40caa70 msgr2=0x7f3fa40caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa8a86700 1 --2- 172.21.15.61:0/2646626046 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa40caa70 0x7f3fa40caf10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f940099b0 tx=0x7f3f94009250 comp rx=0 tx=0).stop 2023-12-24T19:57:24.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa8a86700 1 -- 172.21.15.61:0/2646626046 shutdown_connections 2023-12-24T19:57:24.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa8a86700 1 --2- 172.21.15.61:0/2646626046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa4069500 0x7f3fa4069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa8a86700 1 --2- 172.21.15.61:0/2646626046 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa40caa70 0x7f3fa40caf10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa8a86700 1 -- 172.21.15.61:0/2646626046 >> 172.21.15.61:0/2646626046 conn(0x7f3fa4067fd0 msgr2=0x7f3fa40ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:24.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.199+0000 7f3fa8a86700 1 -- 172.21.15.61:0/2646626046 shutdown_connections 2023-12-24T19:57:24.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.200+0000 7f3fa8a86700 1 -- 172.21.15.61:0/2646626046 wait complete. 2023-12-24T19:57:24.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa8a86700 1 Processor -- start 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa8a86700 1 -- start start 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa8a86700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa4069500 0x7f3fa4153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa8a86700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fa40caa70 0x7f3fa40afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa8a86700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa41578b0 0x7f3fa4156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa8a86700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40b0600 con 0x7f3fa41578b0 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa8a86700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40b08e0 con 0x7f3fa40caa70 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa8a86700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40b0bc0 con 0x7f3fa4069500 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa2d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa41578b0 0x7f3fa4156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa2d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa41578b0 0x7f3fa4156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53594/0 (socket says 172.21.15.61:53594) 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.201+0000 7f3fa2d9d700 1 -- 172.21.15.61:0/4044821968 learned_addr learned my addr 172.21.15.61:0/4044821968 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3fa1d9b700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fa40caa70 0x7f3fa40afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3fa259c700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa4069500 0x7f3fa4153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3fa2d9d700 1 -- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa4069500 msgr2=0x7f3fa4153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3fa2d9d700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa4069500 0x7f3fa4153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3fa2d9d700 1 -- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fa40caa70 msgr2=0x7f3fa40afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3fa2d9d700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fa40caa70 0x7f3fa40afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3fa2d9d700 1 -- 172.21.15.61:0/4044821968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940094f0 con 0x7f3fa41578b0 2023-12-24T19:57:24.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3fa2d9d700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa41578b0 0x7f3fa4156240 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009e90 tx=0x7f3f9c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:24.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3f927fc700 1 -- 172.21.15.61:0/4044821968 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00cc20 con 0x7f3fa41578b0 2023-12-24T19:57:24.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3f927fc700 1 -- 172.21.15.61:0/4044821968 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00f040 con 0x7f3fa41578b0 2023-12-24T19:57:24.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3fa8a86700 1 -- 172.21.15.61:0/4044821968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa40b0ea0 con 0x7f3fa41578b0 2023-12-24T19:57:24.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3f927fc700 1 -- 172.21.15.61:0/4044821968 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c014480 con 0x7f3fa41578b0 2023-12-24T19:57:24.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.202+0000 7f3fa8a86700 1 -- 172.21.15.61:0/4044821968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa41542a0 con 0x7f3fa41578b0 2023-12-24T19:57:24.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.203+0000 7f3fa8a86700 1 -- 172.21.15.61:0/4044821968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa404c3c0 con 0x7f3fa41578b0 2023-12-24T19:57:24.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.203+0000 7f3f927fc700 1 -- 172.21.15.61:0/4044821968 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3f9c014830 con 0x7f3fa41578b0 2023-12-24T19:57:24.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.204+0000 7f3f927fc700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.204+0000 7f3f927fc700 1 -- 172.21.15.61:0/4044821968 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f9c084fc0 con 0x7f3fa41578b0 2023-12-24T19:57:24.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.204+0000 7f3fa259c700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.204+0000 7f3fa259c700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f84066f30 0x7f3f840693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3f98003720 tx=0x7f3f98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:24.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.208+0000 7f3f927fc700 1 -- 172.21.15.61:0/4044821968 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f9c0b65a0 con 0x7f3fa41578b0 2023-12-24T19:57:24.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.404+0000 7f3fa8a86700 1 -- 172.21.15.61:0/4044821968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fa40c8c60 con 0x7f3fa41578b0 2023-12-24T19:57:24.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.404+0000 7f3f927fc700 1 -- 172.21.15.61:0/4044821968 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f9c018020 con 0x7f3fa41578b0 2023-12-24T19:57:24.405 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T19:57:24.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 -- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f84066f30 msgr2=0x7f3f840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f84066f30 0x7f3f840693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3f98003720 tx=0x7f3f98009040 comp rx=0 tx=0).stop 2023-12-24T19:57:24.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 -- 172.21.15.61:0/4044821968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa41578b0 msgr2=0x7f3fa4156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa41578b0 0x7f3fa4156240 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009e90 tx=0x7f3f9c00b040 comp rx=0 tx=0).stop 2023-12-24T19:57:24.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 -- 172.21.15.61:0/4044821968 shutdown_connections 2023-12-24T19:57:24.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3fa4069500 0x7f3fa4153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f84066f30 0x7f3f840693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3fa41578b0 0x7f3fa4156240 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 --2- 172.21.15.61:0/4044821968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fa40caa70 0x7f3fa40afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 -- 172.21.15.61:0/4044821968 >> 172.21.15.61:0/4044821968 conn(0x7f3fa4067fd0 msgr2=0x7f3fa4157c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:24.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 -- 172.21.15.61:0/4044821968 shutdown_connections 2023-12-24T19:57:24.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.407+0000 7f3fa8a86700 1 -- 172.21.15.61:0/4044821968 wait complete. 2023-12-24T19:57:24.420 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:57:24.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.541+0000 7f0c28ff1700 1 Processor -- start 2023-12-24T19:57:24.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.541+0000 7f0c28ff1700 1 -- start start 2023-12-24T19:57:24.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c28ff1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c2415bb60 0x7f0c24098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c28ff1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0c24098aa0 0x7f0c2415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c28ff1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2415c470 0x7f0c240b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c28ff1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c240afc20 con 0x7f0c24098aa0 2023-12-24T19:57:24.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c28ff1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c240b2eb0 con 0x7f0c2415bb60 2023-12-24T19:57:24.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c28ff1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240b2bd0 con 0x7f0c2415c470 2023-12-24T19:57:24.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c21d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0c24098aa0 0x7f0c2415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c21d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0c24098aa0 0x7f0c2415bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53608/0 (socket says 172.21.15.61:53608) 2023-12-24T19:57:24.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c21d9b700 1 -- 172.21.15.61:0/2524471708 learned_addr learned my addr 172.21.15.61:0/2524471708 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c22d9d700 1 --2- 172.21.15.61:0/2524471708 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2415c470 0x7f0c240b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c2259c700 1 --2- 172.21.15.61:0/2524471708 >> v2:172.21.15.133:3300/0 conn(0x7f0c2415bb60 0x7f0c24098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c21d9b700 1 -- 172.21.15.61:0/2524471708 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2415c470 msgr2=0x7f0c240b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c21d9b700 1 --2- 172.21.15.61:0/2524471708 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2415c470 0x7f0c240b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c21d9b700 1 -- 172.21.15.61:0/2524471708 >> v2:172.21.15.133:3300/0 conn(0x7f0c2415bb60 msgr2=0x7f0c24098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c21d9b700 1 --2- 172.21.15.61:0/2524471708 >> v2:172.21.15.133:3300/0 conn(0x7f0c2415bb60 0x7f0c24098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.542+0000 7f0c21d9b700 1 -- 172.21.15.61:0/2524471708 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240afe10 con 0x7f0c24098aa0 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c21d9b700 1 --2- 172.21.15.61:0/2524471708 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c24098aa0 0x7f0c2415bf30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0c2406d9b0 tx=0x7f0c14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4a9546cdf548d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c2159a700 1 -- 172.21.15.61:0/2524471708 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400b860 con 0x7f0c24098aa0 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c2159a700 1 -- 172.21.15.61:0/2524471708 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1400b9c0 con 0x7f0c24098aa0 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c2159a700 1 -- 172.21.15.61:0/2524471708 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400bd60 con 0x7f0c24098aa0 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c28ff1700 1 -- 172.21.15.61:0/2524471708 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c24098aa0 msgr2=0x7f0c2415bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c28ff1700 1 --2- 172.21.15.61:0/2524471708 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c24098aa0 0x7f0c2415bf30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0c2406d9b0 tx=0x7f0c14009250 comp rx=0 tx=0).stop 2023-12-24T19:57:24.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c28ff1700 1 -- 172.21.15.61:0/2524471708 shutdown_connections 2023-12-24T19:57:24.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c28ff1700 1 --2- 172.21.15.61:0/2524471708 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c2415c470 0x7f0c240b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c28ff1700 1 --2- 172.21.15.61:0/2524471708 >> v2:172.21.15.133:3300/0 conn(0x7f0c2415bb60 0x7f0c24098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c28ff1700 1 --2- 172.21.15.61:0/2524471708 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c24098aa0 0x7f0c2415bf30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c28ff1700 1 -- 172.21.15.61:0/2524471708 >> 172.21.15.61:0/2524471708 conn(0x7f0c24097a10 msgr2=0x7f0c240ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:24.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c28ff1700 1 -- 172.21.15.61:0/2524471708 shutdown_connections 2023-12-24T19:57:24.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.543+0000 7f0c28ff1700 1 -- 172.21.15.61:0/2524471708 wait complete. 2023-12-24T19:57:24.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.544+0000 7f0c28ff1700 1 Processor -- start 2023-12-24T19:57:24.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.545+0000 7f0c28ff1700 1 -- start start 2023-12-24T19:57:24.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.545+0000 7f0c28ff1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c24098aa0 0x7f0c240acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.545+0000 7f0c28ff1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c2415bb60 0x7f0c240c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.545+0000 7f0c28ff1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2415c470 0x7f0c240c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.545+0000 7f0c28ff1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240abc60 con 0x7f0c2415c470 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.545+0000 7f0c28ff1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240abf40 con 0x7f0c2415bb60 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.545+0000 7f0c28ff1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240ac220 con 0x7f0c24098aa0 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.545+0000 7f0c22d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2415c470 0x7f0c240c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.545+0000 7f0c22d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2415c470 0x7f0c240c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53612/0 (socket says 172.21.15.61:53612) 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.545+0000 7f0c22d9d700 1 -- 172.21.15.61:0/3687468503 learned_addr learned my addr 172.21.15.61:0/3687468503 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c2259c700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c24098aa0 0x7f0c240acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c21d9b700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c2415bb60 0x7f0c240c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c22d9d700 1 -- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c24098aa0 msgr2=0x7f0c240acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c22d9d700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c24098aa0 0x7f0c240acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c22d9d700 1 -- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c2415bb60 msgr2=0x7f0c240c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c22d9d700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c2415bb60 0x7f0c240c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c22d9d700 1 -- 172.21.15.61:0/3687468503 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c140094f0 con 0x7f0c2415c470 2023-12-24T19:57:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c22d9d700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2415c470 0x7f0c240c4560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c007f20 tx=0x7f0c1c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c1a7fc700 1 -- 172.21.15.61:0/3687468503 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00eca0 con 0x7f0c2415c470 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c1a7fc700 1 -- 172.21.15.61:0/3687468503 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c00ee20 con 0x7f0c2415c470 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c28ff1700 1 -- 172.21.15.61:0/3687468503 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c240ac500 con 0x7f0c2415c470 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c1a7fc700 1 -- 172.21.15.61:0/3687468503 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c014670 con 0x7f0c2415c470 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.546+0000 7f0c28ff1700 1 -- 172.21.15.61:0/3687468503 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c240acac0 con 0x7f0c2415c470 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.547+0000 7f0c28ff1700 1 -- 172.21.15.61:0/3687468503 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2406d440 con 0x7f0c2415c470 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.547+0000 7f0c1a7fc700 1 -- 172.21.15.61:0/3687468503 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0c1c0149e0 con 0x7f0c2415c470 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.548+0000 7f0c1a7fc700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c04066f30 0x7f0c040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.548+0000 7f0c1a7fc700 1 -- 172.21.15.61:0/3687468503 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c1c084c60 con 0x7f0c2415c470 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.548+0000 7f0c2259c700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c04066f30 0x7f0c040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.549+0000 7f0c2259c700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c04066f30 0x7f0c040693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c006aa0 tx=0x7f0c0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:24.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.552+0000 7f0c1a7fc700 1 -- 172.21.15.61:0/3687468503 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c1c051ed0 con 0x7f0c2415c470 2023-12-24T19:57:24.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.791+0000 7f0c28ff1700 1 -- 172.21.15.61:0/3687468503 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c2404c3c0 con 0x7f0c2415c470 2023-12-24T19:57:24.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.792+0000 7f0c1a7fc700 1 -- 172.21.15.61:0/3687468503 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f0c1c0554f0 con 0x7f0c2415c470 2023-12-24T19:57:24.792 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:24.792 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3729732902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3729732902},{"type":"v1","addr":"172.21.15.61:6834","nonce":3729732902}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/402997858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":402997858},{"type":"v1","addr":"172.21.15.133:6837","nonce":402997858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/180373533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":180373533},{"type":"v1","addr":"172.21.15.61:6835","nonce":180373533}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:06.924129+0000","modified":"2023-12-24T19:57:10.540414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/74793696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":74793696},{"type":"v1","addr":"172.21.15.133:6836","nonce":74793696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T19:57:24.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 -- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c04066f30 msgr2=0x7f0c040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c04066f30 0x7f0c040693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c006aa0 tx=0x7f0c0c008040 comp rx=0 tx=0).stop 2023-12-24T19:57:24.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 -- 172.21.15.61:0/3687468503 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2415c470 msgr2=0x7f0c240c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2415c470 0x7f0c240c4560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c007f20 tx=0x7f0c1c009860 comp rx=0 tx=0).stop 2023-12-24T19:57:24.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 -- 172.21.15.61:0/3687468503 shutdown_connections 2023-12-24T19:57:24.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0c24098aa0 0x7f0c240acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c04066f30 0x7f0c040693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0c2415c470 0x7f0c240c4560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 --2- 172.21.15.61:0/3687468503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c2415bb60 0x7f0c240c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 -- 172.21.15.61:0/3687468503 >> 172.21.15.61:0/3687468503 conn(0x7f0c24097a10 msgr2=0x7f0c24157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:24.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 -- 172.21.15.61:0/3687468503 shutdown_connections 2023-12-24T19:57:24.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.794+0000 7f0c28ff1700 1 -- 172.21.15.61:0/3687468503 wait complete. 2023-12-24T19:57:24.796 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 7 2023-12-24T19:57:24.807 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:24.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.928+0000 7f28fceb2700 1 Processor -- start 2023-12-24T19:57:24.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.928+0000 7f28fceb2700 1 -- start start 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28fceb2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28f80ca270 0x7f28f80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28fceb2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28f8158b60 0x7f28f80ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28fceb2700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f80ca6f0 con 0x7f28f8157780 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28fceb2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f80ca9d0 con 0x7f28f8158b60 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28fceb2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80cacb0 con 0x7f28f80ca270 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f659c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f28f8157780 0x7f28f806c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41758/0 (socket says 172.21.15.61:41758) 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f659c700 1 -- 172.21.15.61:0/932528524 learned_addr learned my addr 172.21.15.61:0/932528524 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f5d9b700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28f80ca270 0x7f28f80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f6d9d700 1 --2- 172.21.15.61:0/932528524 >> v2:172.21.15.133:3300/0 conn(0x7f28f8158b60 0x7f28f80ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683100138 0 0) 0x7f28f80ca6f0 con 0x7f28f8157780 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e4003570 con 0x7f28f8157780 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1876484829 0 0) 0x7f28e4003570 con 0x7f28f8157780 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28f80ca270 msgr2=0x7f28f80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:24.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28f80ca270 0x7f28f80cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 >> v2:172.21.15.133:3300/0 conn(0x7f28f8158b60 msgr2=0x7f28f80ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:24.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 --2- 172.21.15.61:0/932528524 >> v2:172.21.15.133:3300/0 conn(0x7f28f8158b60 0x7f28f80ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80caf90 con 0x7f28f8157780 2023-12-24T19:57:24.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f28e8001470 con 0x7f28f8157780 2023-12-24T19:57:24.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 >> v1:172.21.15.61:6789/0 conn(0x7f28f8157780 legacy=0x7f28f806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28e4003a60 0x7f28e4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e40043b0 0x7f28e4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28e4004ee0 0x7f28e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80ca9d0 con 0x7f28e4004ee0 2023-12-24T19:57:24.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80cacb0 con 0x7f28e40043b0 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40056d0 con 0x7f28e4003a60 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.929+0000 7f28f6d9d700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28e4004ee0 0x7f28e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f659c700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28e4003a60 0x7f28e4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f5d9b700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e40043b0 0x7f28e4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f6d9d700 1 -- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28e4003a60 msgr2=0x7f28e4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f6d9d700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28e4003a60 0x7f28e4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f6d9d700 1 -- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e40043b0 msgr2=0x7f28e4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f6d9d700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28e40043b0 0x7f28e4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f6d9d700 1 -- 172.21.15.61:0/932528524 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4003570 con 0x7f28e4004ee0 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f6d9d700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28e4004ee0 0x7f28e400ba60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f28f000e210 tx=0x7f28f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733ac1c56025d208 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000eac0 con 0x7f28e4004ee0 2023-12-24T19:57:24.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f000f040 con 0x7f28e4004ee0 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.930+0000 7f28f559a700 1 -- 172.21.15.61:0/932528524 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000ee70 con 0x7f28e4004ee0 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.931+0000 7f28fceb2700 1 -- 172.21.15.61:0/932528524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28e4004ee0 msgr2=0x7f28e400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.931+0000 7f28fceb2700 1 --2- 172.21.15.61:0/932528524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28e4004ee0 0x7f28e400ba60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f28f000e210 tx=0x7f28f000b040 comp rx=0 tx=0).stop 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.931+0000 7f28f6d9d700 1 -- 172.21.15.61:0/932528524 reap_dead start 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.931+0000 7f28fceb2700 1 -- 172.21.15.61:0/932528524 shutdown_connections 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.931+0000 7f28fceb2700 1 -- 172.21.15.61:0/932528524 >> 172.21.15.61:0/932528524 conn(0x7f28f806b650 msgr2=0x7f28f80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.931+0000 7f28fceb2700 1 -- 172.21.15.61:0/932528524 shutdown_connections 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.931+0000 7f28fceb2700 1 -- 172.21.15.61:0/932528524 wait complete. 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.932+0000 7f28fceb2700 1 Processor -- start 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.932+0000 7f28fceb2700 1 -- start start 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.932+0000 7f28fceb2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28e4004ee0 0x7f28f8152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.932+0000 7f28fceb2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28f814ecb0 0x7f28f8068530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28fceb2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28f814e080 0x7f28f814e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28fceb2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f81532e0 con 0x7f28f814ecb0 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28fceb2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f81551e0 con 0x7f28f814e080 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28fceb2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80afe10 con 0x7f28e4004ee0 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f5d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28f814ecb0 0x7f28f8068530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f5d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28f814ecb0 0x7f28f8068530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53622/0 (socket says 172.21.15.61:53622) 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f5d9b700 1 -- 172.21.15.61:0/2265707276 learned_addr learned my addr 172.21.15.61:0/2265707276 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f659c700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28e4004ee0 0x7f28f8152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f6d9d700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28f814e080 0x7f28f814e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f5d9b700 1 -- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28e4004ee0 msgr2=0x7f28f8152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f5d9b700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28e4004ee0 0x7f28f8152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f5d9b700 1 -- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28f814e080 msgr2=0x7f28f814e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f5d9b700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28f814e080 0x7f28f814e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f5d9b700 1 -- 172.21.15.61:0/2265707276 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80b00d0 con 0x7f28f814ecb0 2023-12-24T19:57:24.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28f5d9b700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28f814ecb0 0x7f28f8068530 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f28e0006ac0 tx=0x7f28e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:24.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28ee7fc700 1 -- 172.21.15.61:0/2265707276 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000fa10 con 0x7f28f814ecb0 2023-12-24T19:57:24.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28ee7fc700 1 -- 172.21.15.61:0/2265707276 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e000fb70 con 0x7f28f814ecb0 2023-12-24T19:57:24.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28fceb2700 1 -- 172.21.15.61:0/2265707276 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f8155480 con 0x7f28f814ecb0 2023-12-24T19:57:24.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28ee7fc700 1 -- 172.21.15.61:0/2265707276 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0014440 con 0x7f28f814ecb0 2023-12-24T19:57:24.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.933+0000 7f28fceb2700 1 -- 172.21.15.61:0/2265707276 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f814ea30 con 0x7f28f814ecb0 2023-12-24T19:57:24.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.934+0000 7f28fceb2700 1 -- 172.21.15.61:0/2265707276 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f804c3c0 con 0x7f28f814ecb0 2023-12-24T19:57:24.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.935+0000 7f28ee7fc700 1 -- 172.21.15.61:0/2265707276 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f28e0027480 con 0x7f28f814ecb0 2023-12-24T19:57:24.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.935+0000 7f28ee7fc700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28d8066f60 0x7f28d8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:24.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.935+0000 7f28ee7fc700 1 -- 172.21.15.61:0/2265707276 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28e0018030 con 0x7f28f814ecb0 2023-12-24T19:57:24.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.936+0000 7f28f659c700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28d8066f60 0x7f28d8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:24.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.936+0000 7f28f659c700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28d8066f60 0x7f28d8069410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28e80015a0 tx=0x7f28e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:24.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:24.939+0000 7f28ee7fc700 1 -- 172.21.15.61:0/2265707276 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28e0052740 con 0x7f28f814ecb0 2023-12-24T19:57:25.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.135+0000 7f28fceb2700 1 -- 172.21.15.61:0/2265707276 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28f8155670 con 0x7f28f814ecb0 2023-12-24T19:57:25.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.136+0000 7f28ee7fc700 1 -- 172.21.15.61:0/2265707276 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f28e0055d60 con 0x7f28f814ecb0 2023-12-24T19:57:25.136 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:25.136 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:25.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 -- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28d8066f60 msgr2=0x7f28d8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:25.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28d8066f60 0x7f28d8069410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f28e80015a0 tx=0x7f28e8009040 comp rx=0 tx=0).stop 2023-12-24T19:57:25.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 -- 172.21.15.61:0/2265707276 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28f814ecb0 msgr2=0x7f28f8068530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:25.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28f814ecb0 0x7f28f8068530 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f28e0006ac0 tx=0x7f28e00091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 -- 172.21.15.61:0/2265707276 shutdown_connections 2023-12-24T19:57:25.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28e4004ee0 0x7f28f8152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28d8066f60 0x7f28d8069410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28f814e080 0x7f28f814e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 --2- 172.21.15.61:0/2265707276 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28f814ecb0 0x7f28f8068530 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 -- 172.21.15.61:0/2265707276 >> 172.21.15.61:0/2265707276 conn(0x7f28f806b650 msgr2=0x7f28f8154530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:25.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 -- 172.21.15.61:0/2265707276 shutdown_connections 2023-12-24T19:57:25.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.138+0000 7f28fceb2700 1 -- 172.21.15.61:0/2265707276 wait complete. 2023-12-24T19:57:25.150 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:57:25.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.272+0000 7f0ca7041700 1 Processor -- start 2023-12-24T19:57:25.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.272+0000 7f0ca7041700 1 -- start start 2023-12-24T19:57:25.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca7041700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ca00b2660 0x7f0ca015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca7041700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0ca015c470 0x7f0ca00b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca7041700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00b2eb0 con 0x7f0ca015bb60 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca7041700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00afc20 con 0x7f0ca015c470 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca7041700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00b2bd0 con 0x7f0ca00b2660 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca55de700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0ca015c470 0x7f0ca00b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca55de700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0ca015c470 0x7f0ca00b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53636/0 (socket says 172.21.15.61:53636) 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca55de700 1 -- 172.21.15.61:0/3262648279 learned_addr learned my addr 172.21.15.61:0/3262648279 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0c9ffff700 1 --2- 172.21.15.61:0/3262648279 >> v2:172.21.15.133:3300/0 conn(0x7f0ca00b2660 0x7f0ca015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca55de700 1 -- 172.21.15.61:0/3262648279 >> v2:172.21.15.133:3300/0 conn(0x7f0ca00b2660 msgr2=0x7f0ca015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca55de700 1 --2- 172.21.15.61:0/3262648279 >> v2:172.21.15.133:3300/0 conn(0x7f0ca00b2660 0x7f0ca015bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca55de700 1 -- 172.21.15.61:0/3262648279 >> v1:172.21.15.133:6789/0 conn(0x7f0ca015bb60 legacy=0x7f0ca0098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:25.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca55de700 1 -- 172.21.15.61:0/3262648279 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca00afe10 con 0x7f0ca015c470 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.273+0000 7f0ca55de700 1 --2- 172.21.15.61:0/3262648279 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca015c470 0x7f0ca00b08f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0ca006e250 tx=0x7f0c98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22ba214d4905d05 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0c9f7fe700 1 -- 172.21.15.61:0/3262648279 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800e070 con 0x7f0ca015c470 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0c9f7fe700 1 -- 172.21.15.61:0/3262648279 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800ba10 con 0x7f0ca015c470 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0c9f7fe700 1 -- 172.21.15.61:0/3262648279 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980092e0 con 0x7f0ca015c470 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0ca7041700 1 -- 172.21.15.61:0/3262648279 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca015c470 msgr2=0x7f0ca00b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0ca7041700 1 --2- 172.21.15.61:0/3262648279 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca015c470 0x7f0ca00b08f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0ca006e250 tx=0x7f0c98009840 comp rx=0 tx=0).stop 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0ca7041700 1 -- 172.21.15.61:0/3262648279 shutdown_connections 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0ca7041700 1 --2- 172.21.15.61:0/3262648279 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca015c470 0x7f0ca00b08f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0ca7041700 1 --2- 172.21.15.61:0/3262648279 >> v2:172.21.15.133:3300/0 conn(0x7f0ca00b2660 0x7f0ca015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0ca7041700 1 -- 172.21.15.61:0/3262648279 >> 172.21.15.61:0/3262648279 conn(0x7f0ca0097a10 msgr2=0x7f0ca00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0ca7041700 1 -- 172.21.15.61:0/3262648279 shutdown_connections 2023-12-24T19:57:25.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.274+0000 7f0ca7041700 1 -- 172.21.15.61:0/3262648279 wait complete. 2023-12-24T19:57:25.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.275+0000 7f0ca7041700 1 Processor -- start 2023-12-24T19:57:25.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.276+0000 7f0ca7041700 1 -- start start 2023-12-24T19:57:25.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.276+0000 7f0ca7041700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca00b2660 0x7f0ca0168050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:25.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.276+0000 7f0ca7041700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ca015bb60 0x7f0ca0099c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:25.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.276+0000 7f0ca7041700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca015c470 0x7f0ca0151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:25.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.276+0000 7f0ca7041700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0168ff0 con 0x7f0ca00b2660 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.276+0000 7f0ca7041700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0152900 con 0x7f0ca015c470 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.276+0000 7f0ca7041700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca009a180 con 0x7f0ca015bb60 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.276+0000 7f0ca4ddd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca00b2660 0x7f0ca0168050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca4ddd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca00b2660 0x7f0ca0168050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53644/0 (socket says 172.21.15.61:53644) 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca4ddd700 1 -- 172.21.15.61:0/3332153785 learned_addr learned my addr 172.21.15.61:0/3332153785 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca55de700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca015c470 0x7f0ca0151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0c9ffff700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ca015bb60 0x7f0ca0099c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca4ddd700 1 -- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ca015bb60 msgr2=0x7f0ca0099c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca4ddd700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ca015bb60 0x7f0ca0099c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca4ddd700 1 -- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca015c470 msgr2=0x7f0ca0151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca4ddd700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca015c470 0x7f0ca0151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca4ddd700 1 -- 172.21.15.61:0/3332153785 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c98009ae0 con 0x7f0ca00b2660 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca55de700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca015c470 0x7f0ca0151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:25.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0c9ffff700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ca015bb60 0x7f0ca0099c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca4ddd700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca00b2660 0x7f0ca0168050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400c5b0 tx=0x7f0c940020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0c9cff9700 1 -- 172.21.15.61:0/3332153785 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94011590 con 0x7f0ca00b2660 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0c9cff9700 1 -- 172.21.15.61:0/3332153785 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c940116f0 con 0x7f0ca00b2660 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca7041700 1 -- 172.21.15.61:0/3332153785 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca01520e0 con 0x7f0ca00b2660 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0c9cff9700 1 -- 172.21.15.61:0/3332153785 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94011a90 con 0x7f0ca00b2660 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.277+0000 7f0ca7041700 1 -- 172.21.15.61:0/3332153785 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca0168a30 con 0x7f0ca00b2660 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.278+0000 7f0ca7041700 1 -- 172.21.15.61:0/3332153785 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca006d440 con 0x7f0ca00b2660 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.279+0000 7f0c9cff9700 1 -- 172.21.15.61:0/3332153785 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0c94012420 con 0x7f0ca00b2660 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.279+0000 7f0c9cff9700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c84066f30 0x7f0c840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.279+0000 7f0c9cff9700 1 -- 172.21.15.61:0/3332153785 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c94083f90 con 0x7f0ca00b2660 2023-12-24T19:57:25.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.279+0000 7f0c9ffff700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c84066f30 0x7f0c840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:25.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.280+0000 7f0c9ffff700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c84066f30 0x7f0c840693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0165c40 tx=0x7f0c8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:25.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.283+0000 7f0c9cff9700 1 -- 172.21.15.61:0/3332153785 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c94051200 con 0x7f0ca00b2660 2023-12-24T19:57:25.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.522+0000 7f0ca7041700 1 -- 172.21.15.61:0/3332153785 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ca004c3c0 con 0x7f0ca00b2660 2023-12-24T19:57:25.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.522+0000 7f0c9cff9700 1 -- 172.21.15.61:0/3332153785 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f0c94054820 con 0x7f0ca00b2660 2023-12-24T19:57:25.523 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:25.523 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3729732902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3729732902},{"type":"v1","addr":"172.21.15.61:6834","nonce":3729732902}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/402997858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":402997858},{"type":"v1","addr":"172.21.15.133:6837","nonce":402997858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/180373533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":180373533},{"type":"v1","addr":"172.21.15.61:6835","nonce":180373533}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:06.924129+0000","modified":"2023-12-24T19:57:10.540414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/74793696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":74793696},{"type":"v1","addr":"172.21.15.133:6836","nonce":74793696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T19:57:25.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 -- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c84066f30 msgr2=0x7f0c840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:25.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c84066f30 0x7f0c840693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0165c40 tx=0x7f0c8c008040 comp rx=0 tx=0).stop 2023-12-24T19:57:25.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 -- 172.21.15.61:0/3332153785 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca00b2660 msgr2=0x7f0ca0168050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:25.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca00b2660 0x7f0ca0168050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400c5b0 tx=0x7f0c940020e0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 -- 172.21.15.61:0/3332153785 shutdown_connections 2023-12-24T19:57:25.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0c84066f30 0x7f0c840693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca015c470 0x7f0ca0151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ca00b2660 0x7f0ca0168050 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 --2- 172.21.15.61:0/3332153785 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ca015bb60 0x7f0ca0099c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:25.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 -- 172.21.15.61:0/3332153785 >> 172.21.15.61:0/3332153785 conn(0x7f0ca0097a10 msgr2=0x7f0ca006c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:25.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 -- 172.21.15.61:0/3332153785 shutdown_connections 2023-12-24T19:57:25.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:25.524+0000 7f0ca7041700 1 -- 172.21.15.61:0/3332153785 wait complete. 2023-12-24T19:57:25.526 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 7 2023-12-24T19:57:25.939 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T19:57:06.924129+0000', 'modified': '2023-12-24T19:57:10.540414+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4255': {'gid': 4255, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6836/74793696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 74793696}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 74793696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T19:57:25.939 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T19:57:25.939 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-24T19:57:26.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.063+0000 7fa07dd9f700 1 Processor -- start 2023-12-24T19:57:26.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.063+0000 7fa07dd9f700 1 -- start start 2023-12-24T19:57:26.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.064+0000 7fa07dd9f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa078159c40 0x7fa078070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.064+0000 7fa07dd9f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0780c41e0 0x7fa0780c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.064+0000 7fa07dd9f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa078068d10 con 0x7fa078070db0 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.064+0000 7fa07dd9f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa078067f10 con 0x7fa078159c40 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.064+0000 7fa07dd9f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa078068100 con 0x7fa0780c41e0 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.064+0000 7fa0777fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa078159c40 0x7fa078070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.064+0000 7fa0777fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa078159c40 0x7fa078070870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53656/0 (socket says 172.21.15.61:53656) 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.064+0000 7fa0777fe700 1 -- 172.21.15.61:0/4288195725 learned_addr learned my addr 172.21.15.61:0/4288195725 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.064+0000 7fa076ffd700 1 --1- 172.21.15.61:0/4288195725 >> v1:172.21.15.61:6789/0 conn(0x7fa078070db0 0x7fa0780c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:41766/0 (socket says 172.21.15.61:41766) 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa077fff700 1 --2- 172.21.15.61:0/4288195725 >> v2:172.21.15.133:3300/0 conn(0x7fa0780c41e0 0x7fa0780c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa0777fe700 1 -- 172.21.15.61:0/4288195725 >> v2:172.21.15.133:3300/0 conn(0x7fa0780c41e0 msgr2=0x7fa0780c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa0777fe700 1 --2- 172.21.15.61:0/4288195725 >> v2:172.21.15.133:3300/0 conn(0x7fa0780c41e0 0x7fa0780c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa0777fe700 1 -- 172.21.15.61:0/4288195725 >> v1:172.21.15.61:6789/0 conn(0x7fa078070db0 legacy=0x7fa0780c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa0777fe700 1 -- 172.21.15.61:0/4288195725 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780683e0 con 0x7fa078159c40 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa077fff700 1 --2- 172.21.15.61:0/4288195725 >> v2:172.21.15.133:3300/0 conn(0x7fa0780c41e0 0x7fa0780c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:26.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa0767fc700 1 -- 172.21.15.61:0/4288195725 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062856108 0 0) 0x7fa078068d10 con 0x7fa078070db0 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa0777fe700 1 --2- 172.21.15.61:0/4288195725 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078159c40 0x7fa078070870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa07806d9a0 tx=0x7fa068009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f114d9fb5ba664e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa0767fc700 1 -- 172.21.15.61:0/4288195725 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800b860 con 0x7fa078159c40 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa0767fc700 1 -- 172.21.15.61:0/4288195725 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06800b9c0 con 0x7fa078159c40 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa0767fc700 1 -- 172.21.15.61:0/4288195725 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800bd60 con 0x7fa078159c40 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa07dd9f700 1 -- 172.21.15.61:0/4288195725 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078159c40 msgr2=0x7fa078070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.065+0000 7fa07dd9f700 1 --2- 172.21.15.61:0/4288195725 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078159c40 0x7fa078070870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa07806d9a0 tx=0x7fa068009250 comp rx=0 tx=0).stop 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.066+0000 7fa07dd9f700 1 -- 172.21.15.61:0/4288195725 shutdown_connections 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.066+0000 7fa07dd9f700 1 --2- 172.21.15.61:0/4288195725 >> v2:172.21.15.133:3300/0 conn(0x7fa0780c41e0 0x7fa0780c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.066+0000 7fa07dd9f700 1 --2- 172.21.15.61:0/4288195725 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078159c40 0x7fa078070870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.066+0000 7fa07dd9f700 1 -- 172.21.15.61:0/4288195725 >> 172.21.15.61:0/4288195725 conn(0x7fa0780ce190 msgr2=0x7fa0780ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.066+0000 7fa07dd9f700 1 -- 172.21.15.61:0/4288195725 shutdown_connections 2023-12-24T19:57:26.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.066+0000 7fa07dd9f700 1 -- 172.21.15.61:0/4288195725 wait complete. 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.067+0000 7fa07dd9f700 1 Processor -- start 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.067+0000 7fa07dd9f700 1 -- start start 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa07dd9f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078070db0 0x7fa07814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa07dd9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0780c41e0 0x7fa07815d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa07dd9f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa078159c40 0x7fa07815de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa07dd9f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c47b0 con 0x7fa078070db0 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa07dd9f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07815e470 con 0x7fa0780c41e0 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa07dd9f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07815e750 con 0x7fa078159c40 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa0777fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078070db0 0x7fa07814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa0777fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078070db0 0x7fa07814b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53660/0 (socket says 172.21.15.61:53660) 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa0777fe700 1 -- 172.21.15.61:0/2913545263 learned_addr learned my addr 172.21.15.61:0/2913545263 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa077fff700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa078159c40 0x7fa07815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa076ffd700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0780c41e0 0x7fa07815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa0777fe700 1 -- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa078159c40 msgr2=0x7fa07815de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa0777fe700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa078159c40 0x7fa07815de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa0777fe700 1 -- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0780c41e0 msgr2=0x7fa07815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa0777fe700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0780c41e0 0x7fa07815d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa0777fe700 1 -- 172.21.15.61:0/2913545263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0680094f0 con 0x7fa078070db0 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa0777fe700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078070db0 0x7fa07814b190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa0680090b0 tx=0x7fa068017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa05f7fe700 1 -- 172.21.15.61:0/2913545263 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068011e60 con 0x7fa078070db0 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa05f7fe700 1 -- 172.21.15.61:0/2913545263 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06801f070 con 0x7fa078070db0 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa07dd9f700 1 -- 172.21.15.61:0/2913545263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07815ea30 con 0x7fa078070db0 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa05f7fe700 1 -- 172.21.15.61:0/2913545263 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06801a890 con 0x7fa078070db0 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.068+0000 7fa07dd9f700 1 -- 172.21.15.61:0/2913545263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07814b6d0 con 0x7fa078070db0 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.070+0000 7fa05f7fe700 1 -- 172.21.15.61:0/2913545263 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa06801ac00 con 0x7fa078070db0 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.070+0000 7fa05f7fe700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa064066f30 0x7fa0640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.070+0000 7fa05f7fe700 1 -- 172.21.15.61:0/2913545263 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa068021070 con 0x7fa078070db0 2023-12-24T19:57:26.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.070+0000 7fa076ffd700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa064066f30 0x7fa0640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.071+0000 7fa076ffd700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa064066f30 0x7fa0640693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa06c007fd0 tx=0x7fa06c007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:26.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.072+0000 7fa08709fb80 1 Processor -- start 2023-12-24T19:57:26.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.072+0000 7fa08709fb80 1 -- start start 2023-12-24T19:57:26.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113ffa0 0x55c791140370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c7911408b0 0x55c79113bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113c170 0x55c79115c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa08709fb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79106e3e0 con 0x55c7911408b0 2023-12-24T19:57:26.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa08709fb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79106bbe0 con 0x55c79113ffa0 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa08709fb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7910679d0 con 0x55c79113c170 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa076ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c7911408b0 0x55c79113bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa076ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c7911408b0 0x55c79113bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53662/0 (socket says 172.21.15.61:53662) 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa076ffd700 1 -- 172.21.15.61:0/898910485 learned_addr learned my addr 172.21.15.61:0/898910485 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa0777fe700 1 --2- 172.21.15.61:0/898910485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113ffa0 0x55c791140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.073+0000 7fa077fff700 1 --2- 172.21.15.61:0/898910485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113c170 0x55c79115c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa076ffd700 1 -- 172.21.15.61:0/898910485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113c170 msgr2=0x55c79115c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa076ffd700 1 --2- 172.21.15.61:0/898910485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113c170 0x55c79115c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa076ffd700 1 -- 172.21.15.61:0/898910485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113ffa0 msgr2=0x55c791140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa076ffd700 1 --2- 172.21.15.61:0/898910485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113ffa0 0x55c791140370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa076ffd700 1 -- 172.21.15.61:0/898910485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c790efb360 con 0x55c7911408b0 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa076ffd700 1 --2- 172.21.15.61:0/898910485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c7911408b0 0x55c79113bc30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa06c015810 tx=0x7fa06c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f4353bddd87e2b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa05cff9700 1 -- 172.21.15.61:0/898910485 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0152e0 con 0x55c7911408b0 2023-12-24T19:57:26.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa05cff9700 1 -- 172.21.15.61:0/898910485 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c021450 con 0x55c7911408b0 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa05cff9700 1 -- 172.21.15.61:0/898910485 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0217d0 con 0x55c7911408b0 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa08709fb80 1 -- 172.21.15.61:0/898910485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c7911408b0 msgr2=0x55c79113bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.074+0000 7fa08709fb80 1 --2- 172.21.15.61:0/898910485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c7911408b0 0x55c79113bc30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa06c015810 tx=0x7fa06c013000 comp rx=0 tx=0).stop 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.075+0000 7fa08709fb80 1 -- 172.21.15.61:0/898910485 shutdown_connections 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.075+0000 7fa08709fb80 1 --2- 172.21.15.61:0/898910485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113c170 0x55c79115c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.075+0000 7fa08709fb80 1 --2- 172.21.15.61:0/898910485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113ffa0 0x55c791140370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.075+0000 7fa08709fb80 1 --2- 172.21.15.61:0/898910485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c7911408b0 0x55c79113bc30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.075+0000 7fa08709fb80 1 -- 172.21.15.61:0/898910485 >> 172.21.15.61:0/898910485 conn(0x55c791116440 msgr2=0x55c791161dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.075+0000 7fa08709fb80 1 -- 172.21.15.61:0/898910485 shutdown_connections 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.075+0000 7fa08709fb80 1 -- 172.21.15.61:0/898910485 wait complete. 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.075+0000 7fa08709fb80 1 -- start start 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.075+0000 7fa08709fb80 1 Processor -- start 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113c170 0x55c7911586e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c79113b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 0x55c791144640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa08709fb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7910141b0 con 0x55c79113ffa0 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa08709fb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c791013e50 con 0x55c79113c170 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa08709fb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c790f60e40 con 0x55c7911408b0 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa08709fb80 10 client.0 _ll_register_callbacks cb 0x55c790f637b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa076ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c79113b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa076ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c79113b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53666/0 (socket says 172.21.15.61:53666) 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa076ffd700 1 -- 172.21.15.61:0/3956675677 learned_addr learned my addr 172.21.15.61:0/3956675677 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa0777fe700 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113c170 0x55c7911586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa077fff700 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 0x55c791144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa076ffd700 1 -- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 msgr2=0x55c791144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa076ffd700 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 0x55c791144640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa076ffd700 1 -- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113c170 msgr2=0x55c7911586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa076ffd700 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113c170 0x55c7911586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.076+0000 7fa076ffd700 1 -- 172.21.15.61:0/3956675677 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06c00f040 con 0x55c79113ffa0 2023-12-24T19:57:26.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa076ffd700 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c79113b1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa06c01a000 tx=0x7fa06c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9795a51764bf2653 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa055ffb700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa055ffb700 1 -- 172.21.15.61:0/3956675677 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c021880 con 0x55c79113ffa0 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa055ffb700 1 -- 172.21.15.61:0/3956675677 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa06c013630 con 0x55c79113ffa0 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa08709fb80 1 -- 172.21.15.61:0/3956675677 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7910e8eb0 con 0x55c79113ffa0 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa055ffb700 1 -- 172.21.15.61:0/3956675677 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa06c013a00 con 0x55c79113ffa0 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa08709fb80 10 client.4611 fetch_fsmap learned FSMap version 7 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa08709fb80 1 -- 172.21.15.61:0/3956675677 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c790ea7b10 con 0x55c79113ffa0 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa055ffb700 1 -- 172.21.15.61:0/3956675677 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7910e8eb0 con 0x55c79113ffa0 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa055ffb700 1 -- 172.21.15.61:0/3956675677 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa06c013b60 con 0x55c79113ffa0 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa08709fb80 10 client.4611 fetch_fsmap finished waiting for FSMap version 7 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa08709fb80 10 client.4611 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa08709fb80 20 client.4611 populate_metadata read hostname 'smithi061' 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa08709fb80 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:6834/74793696,v1:172.21.15.133:6836/74793696] conn(0x55c791157230 0x55c791157600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa08709fb80 4 client.4611 mds_command: new command op to 4255 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.077+0000 7fa08709fb80 1 -- 172.21.15.61:0/3956675677 --> [v2:172.21.15.133:6834/74793696,v1:172.21.15.133:6836/74793696] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c79103e880 con 0x55c791157230 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.078+0000 7fa0777fe700 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:6834/74793696,v1:172.21.15.133:6836/74793696] conn(0x55c791157230 0x55c791157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.078+0000 7fa055ffb700 10 client.4611 ms_handle_connect on v2:172.21.15.133:6834/74793696 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.078+0000 7fa0777fe700 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:6834/74793696,v1:172.21.15.133:6836/74793696] conn(0x55c791157230 0x55c791157600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac1190d2ba325209 server_cookie=82bd30b51a9f04f8 in_seq=0 out_seq=0 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa055ffb700 1 -- 172.21.15.61:0/3956675677 <== mds.0 v2:172.21.15.133:6834/74793696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c79103e880 con 0x55c791157230 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa055ffb700 10 client.4611 handle_command_reply: tid=0 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 client.4611 shutdown 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 -- 172.21.15.61:0/3956675677 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 msgr2=0x55c79113b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c79113b1d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa06c01a000 tx=0x7fa06c018000 comp rx=0 tx=0).stop 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 -- 172.21.15.61:0/3956675677 shutdown_connections 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:6834/74793696,v1:172.21.15.133:6836/74793696] conn(0x55c791157230 0x55c791157600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 0x55c791144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa055ffb700 0 client.4611 ms_handle_reset on v2:172.21.15.133:6834/74793696 2023-12-24T19:57:26.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113c170 0x55c7911586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 --2- 172.21.15.61:0/3956675677 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c79113b1d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 -- 172.21.15.61:0/3956675677 >> 172.21.15.61:0/3956675677 conn(0x55c791116440 msgr2=0x55c791116810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:26.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 -- 172.21.15.61:0/3956675677 shutdown_connections 2023-12-24T19:57:26.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 1 -- 172.21.15.61:0/3956675677 wait complete. 2023-12-24T19:57:26.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.079+0000 7fa08709fb80 20 client.4611 trim_cache size 0 max 16384 2023-12-24T19:57:26.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.096+0000 7fa08709fb80 1 Processor -- start 2023-12-24T19:57:26.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.096+0000 7fa08709fb80 1 -- start start 2023-12-24T19:57:26.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113c170 0x55c791116810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113ffa0 0x55c79110dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7911408b0 0x55c79110e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa08709fb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79111aef0 con 0x55c79113c170 2023-12-24T19:57:26.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa08709fb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c791147d80 con 0x55c7911408b0 2023-12-24T19:57:26.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa08709fb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c791162740 con 0x55c79113ffa0 2023-12-24T19:57:26.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa0777fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113c170 0x55c791116810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa0777fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113c170 0x55c791116810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53672/0 (socket says 172.21.15.61:53672) 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa0777fe700 1 -- 172.21.15.61:0/873502701 learned_addr learned my addr 172.21.15.61:0/873502701 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa076ffd700 1 --2- 172.21.15.61:0/873502701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113ffa0 0x55c79110dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa077fff700 1 --2- 172.21.15.61:0/873502701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7911408b0 0x55c79110e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa0777fe700 1 -- 172.21.15.61:0/873502701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113ffa0 msgr2=0x55c79110dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa0777fe700 1 --2- 172.21.15.61:0/873502701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113ffa0 0x55c79110dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa0777fe700 1 -- 172.21.15.61:0/873502701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7911408b0 msgr2=0x55c79110e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa0777fe700 1 --2- 172.21.15.61:0/873502701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7911408b0 0x55c79110e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa0777fe700 1 -- 172.21.15.61:0/873502701 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c791036290 con 0x55c79113c170 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa076ffd700 1 --2- 172.21.15.61:0/873502701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113ffa0 0x55c79110dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.097+0000 7fa0777fe700 1 --2- 172.21.15.61:0/873502701 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113c170 0x55c791116810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa068057180 tx=0x7fa068028040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b35717c568739b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa05d7fa700 1 -- 172.21.15.61:0/873502701 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa068057bd0 con 0x55c79113c170 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa05d7fa700 1 -- 172.21.15.61:0/873502701 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680574d0 con 0x55c79113c170 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa05d7fa700 1 -- 172.21.15.61:0/873502701 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06805a720 con 0x55c79113c170 2023-12-24T19:57:26.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa08709fb80 1 -- 172.21.15.61:0/873502701 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113c170 msgr2=0x55c791116810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa08709fb80 1 --2- 172.21.15.61:0/873502701 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113c170 0x55c791116810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa068057180 tx=0x7fa068028040 comp rx=0 tx=0).stop 2023-12-24T19:57:26.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa08709fb80 1 -- 172.21.15.61:0/873502701 shutdown_connections 2023-12-24T19:57:26.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa08709fb80 1 --2- 172.21.15.61:0/873502701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c7911408b0 0x55c79110e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa08709fb80 1 --2- 172.21.15.61:0/873502701 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113c170 0x55c791116810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa08709fb80 1 --2- 172.21.15.61:0/873502701 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c79113ffa0 0x55c79110dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa08709fb80 1 -- 172.21.15.61:0/873502701 >> 172.21.15.61:0/873502701 conn(0x55c791116440 msgr2=0x55c79113b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:26.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa08709fb80 1 -- 172.21.15.61:0/873502701 shutdown_connections 2023-12-24T19:57:26.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.098+0000 7fa08709fb80 1 -- 172.21.15.61:0/873502701 wait complete. 2023-12-24T19:57:26.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.099+0000 7fa08709fb80 1 -- start start 2023-12-24T19:57:26.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.099+0000 7fa08709fb80 1 Processor -- start 2023-12-24T19:57:26.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.099+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113c170 0x55c7911c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.099+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c791143140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.099+0000 7fa08709fb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 0x55c791143680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.099+0000 7fa08709fb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c791154940 con 0x55c79113ffa0 2023-12-24T19:57:26.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.099+0000 7fa08709fb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79115e7d0 con 0x55c79113c170 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.099+0000 7fa08709fb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c79115ea20 con 0x55c7911408b0 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa08709fb80 10 client.0 _ll_register_callbacks cb 0x7fa068006d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa076ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c791143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa076ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c791143140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53688/0 (socket says 172.21.15.61:53688) 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa076ffd700 1 -- 172.21.15.61:0/2197731444 learned_addr learned my addr 172.21.15.61:0/2197731444 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa0777fe700 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113c170 0x55c7911c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa076ffd700 1 -- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 msgr2=0x55c791143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa077fff700 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 0x55c791143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa076ffd700 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 0x55c791143680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa076ffd700 1 -- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113c170 msgr2=0x55c7911c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa076ffd700 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113c170 0x55c7911c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa076ffd700 1 -- 172.21.15.61:0/2197731444 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07814b6d0 con 0x55c79113ffa0 2023-12-24T19:57:26.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa077fff700 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 0x55c791143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa076ffd700 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c791143140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa06c015680 tx=0x7fa06c026050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54d550d7ae6dcb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa055ffb700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa055ffb700 1 -- 172.21.15.61:0/2197731444 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c013630 con 0x55c79113ffa0 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa055ffb700 1 -- 172.21.15.61:0/2197731444 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa06c013c10 con 0x55c79113ffa0 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa08709fb80 1 -- 172.21.15.61:0/2197731444 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c79110c490 con 0x55c79113ffa0 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa055ffb700 1 -- 172.21.15.61:0/2197731444 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa06c02cd10 con 0x55c79113ffa0 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa08709fb80 10 client.4617 fetch_fsmap learned FSMap version 7 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa08709fb80 1 -- 172.21.15.61:0/2197731444 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c790effc80 con 0x55c79113ffa0 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.100+0000 7fa055ffb700 1 -- 172.21.15.61:0/2197731444 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c79110c490 con 0x55c79113ffa0 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa055ffb700 1 -- 172.21.15.61:0/2197731444 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa06c02c440 con 0x55c79113ffa0 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa08709fb80 10 client.4617 fetch_fsmap finished waiting for FSMap version 7 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa08709fb80 10 client.4617 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa08709fb80 20 client.4617 populate_metadata read hostname 'smithi061' 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa08709fb80 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:6834/74793696,v1:172.21.15.133:6836/74793696] conn(0x55c79115ec10 0x55c79115efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa08709fb80 4 client.4617 mds_command: new command op to 4255 tid=0[{"prefix": "status"}] 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa08709fb80 1 -- 172.21.15.61:0/2197731444 --> [v2:172.21.15.133:6834/74793696,v1:172.21.15.133:6836/74793696] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c79100a910 con 0x55c79115ec10 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa0777fe700 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:6834/74793696,v1:172.21.15.133:6836/74793696] conn(0x55c79115ec10 0x55c79115efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa055ffb700 10 client.4617 ms_handle_connect on v2:172.21.15.133:6834/74793696 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa0777fe700 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:6834/74793696,v1:172.21.15.133:6836/74793696] conn(0x55c79115ec10 0x55c79115efe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db5974edaeb50849 server_cookie=15c741f6425a8cbf in_seq=0 out_seq=0 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa055ffb700 1 -- 172.21.15.61:0/2197731444 <== mds.0 v2:172.21.15.133:6834/74793696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c79100a910 con 0x55c79115ec10 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa055ffb700 10 client.4617 handle_command_reply: tid=0 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa08709fb80 1 client.4617 shutdown 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa08709fb80 1 -- 172.21.15.61:0/2197731444 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 msgr2=0x55c791143140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.101+0000 7fa08709fb80 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c791143140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa06c015680 tx=0x7fa06c026050 comp rx=0 tx=0).stop 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa08709fb80 1 -- 172.21.15.61:0/2197731444 shutdown_connections 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa08709fb80 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:6834/74793696,v1:172.21.15.133:6836/74793696] conn(0x55c79115ec10 0x55c79115efe0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa08709fb80 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55c7911408b0 0x55c791143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa08709fb80 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c79113c170 0x55c7911c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa055ffb700 0 client.4617 ms_handle_reset on v2:172.21.15.133:6834/74793696 2023-12-24T19:57:26.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa08709fb80 1 --2- 172.21.15.61:0/2197731444 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55c79113ffa0 0x55c791143140 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa08709fb80 1 -- 172.21.15.61:0/2197731444 >> 172.21.15.61:0/2197731444 conn(0x55c791116440 msgr2=0x55c791157600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:26.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa08709fb80 1 -- 172.21.15.61:0/2197731444 shutdown_connections 2023-12-24T19:57:26.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa08709fb80 1 -- 172.21.15.61:0/2197731444 wait complete. 2023-12-24T19:57:26.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa08709fb80 20 client.4617 trim_cache size 0 max 16384 2023-12-24T19:57:26.109 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:57:26.109 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:57:26.109 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T19:57:26.109 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 4255, 2023-12-24T19:57:26.109 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T19:57:26.109 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T19:57:26.110 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T19:57:26.110 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 18.589750937000002, 2023-12-24T19:57:26.110 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 7, 2023-12-24T19:57:26.110 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 20, 2023-12-24T19:57:26.110 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 20, 2023-12-24T19:57:26.110 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 26.300529202 2023-12-24T19:57:26.110 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 -- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa064066f30 msgr2=0x7fa0640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa064066f30 0x7fa0640693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa06c007fd0 tx=0x7fa06c007e10 comp rx=0 tx=0).stop 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 -- 172.21.15.61:0/2913545263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078070db0 msgr2=0x7fa07814b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078070db0 0x7fa07814b190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa0680090b0 tx=0x7fa068017000 comp rx=0 tx=0).stop 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 -- 172.21.15.61:0/2913545263 shutdown_connections 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa078159c40 0x7fa07815de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa064066f30 0x7fa0640693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa078070db0 0x7fa07814b190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 --2- 172.21.15.61:0/2913545263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0780c41e0 0x7fa07815d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 -- 172.21.15.61:0/2913545263 >> 172.21.15.61:0/2913545263 conn(0x7fa0780ce190 msgr2=0x7fa078159450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 -- 172.21.15.61:0/2913545263 shutdown_connections 2023-12-24T19:57:26.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.102+0000 7fa07dd9f700 1 -- 172.21.15.61:0/2913545263 wait complete. 2023-12-24T19:57:26.115 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-24T19:57:26.137 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-24T19:57:26.137 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-24T19:57:26.138 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-24T19:57:26.138 INFO:tasks.ceph_fuse:client.2 config is {} 2023-12-24T19:57:26.138 INFO:tasks.ceph_fuse:client.1 config is {} 2023-12-24T19:57:26.138 INFO:tasks.ceph_fuse:client.3 config is {} 2023-12-24T19:57:26.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:26.138 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T19:57:26.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:26.156 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link delete ceph-brx 2023-12-24T19:57:26.225 INFO:teuthology.orchestra.run.smithi061.stderr:Cannot find device "ceph-brx" 2023-12-24T19:57:26.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:57:26.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:26.227 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T19:57:26.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:26.249 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-12-24T19:57:26.325 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2023-12-24T19:57:26.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:57:26.327 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-24T19:57:26.327 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:57:26.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.449+0000 7fce168d1700 1 Processor -- start 2023-12-24T19:57:26.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.449+0000 7fce168d1700 1 -- start start 2023-12-24T19:57:26.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.450+0000 7fce168d1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce10068510 0x7fce100cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.450+0000 7fce168d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce10159a60 0x7fce10159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.450+0000 7fce168d1700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce100b2890 con 0x7fce10068140 2023-12-24T19:57:26.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.450+0000 7fce168d1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce100cf630 con 0x7fce10068510 2023-12-24T19:57:26.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.450+0000 7fce168d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce100b2240 con 0x7fce10159a60 2023-12-24T19:57:26.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.450+0000 7fce0ffff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fce10068140 0x7fce100b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57592/0 (socket says 172.21.15.61:57592) 2023-12-24T19:57:26.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.450+0000 7fce0ffff700 1 -- 172.21.15.61:0/516036983 learned_addr learned my addr 172.21.15.61:0/516036983 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028238972 0 0) 0x7fce100b2890 con 0x7fce10068140 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0f7fe700 1 --2- 172.21.15.61:0/516036983 >> v2:172.21.15.133:3300/0 conn(0x7fce10068510 0x7fce100cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf8003570 con 0x7fce10068140 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce14e6e700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce10159a60 0x7fce10159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2263363456 0 0) 0x7fcdf8003570 con 0x7fce10068140 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce10159a60 msgr2=0x7fce10159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce10159a60 0x7fce10159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 >> v2:172.21.15.133:3300/0 conn(0x7fce10068510 msgr2=0x7fce100cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 --2- 172.21.15.61:0/516036983 >> v2:172.21.15.133:3300/0 conn(0x7fce10068510 0x7fce100cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce100b2520 con 0x7fce10068140 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fce000015f0 con 0x7fce10068140 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 >> v1:172.21.15.61:6789/0 conn(0x7fce10068140 legacy=0x7fce100b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce10159a60 0x7fcdf8003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf80040b0 0x7fcdf8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdf8004d50 0x7fcdf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce100cf630 con 0x7fcdf8004d50 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce100b2240 con 0x7fcdf80040b0 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf800bb60 con 0x7fce10159a60 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0ffff700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce10159a60 0x7fcdf8003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce0f7fe700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf80040b0 0x7fcdf8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce14e6e700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdf8004d50 0x7fcdf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce14e6e700 1 -- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce10159a60 msgr2=0x7fcdf8003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce14e6e700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce10159a60 0x7fcdf8003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce14e6e700 1 -- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf80040b0 msgr2=0x7fcdf8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce14e6e700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdf80040b0 0x7fcdf8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.451+0000 7fce14e6e700 1 -- 172.21.15.61:0/516036983 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8003570 con 0x7fcdf8004d50 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce14e6e700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdf8004d50 0x7fcdf80051c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce080094d0 tx=0x7fce0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c272ba68eb56ee server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:26.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0800ea90 con 0x7fcdf8004d50 2023-12-24T19:57:26.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0800f040 con 0x7fcdf8004d50 2023-12-24T19:57:26.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce0effd700 1 -- 172.21.15.61:0/516036983 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0800ee20 con 0x7fcdf8004d50 2023-12-24T19:57:26.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce168d1700 1 -- 172.21.15.61:0/516036983 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdf8004d50 msgr2=0x7fcdf80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce168d1700 1 --2- 172.21.15.61:0/516036983 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdf8004d50 0x7fcdf80051c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce080094d0 tx=0x7fce0800b040 comp rx=0 tx=0).stop 2023-12-24T19:57:26.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce14e6e700 1 -- 172.21.15.61:0/516036983 reap_dead start 2023-12-24T19:57:26.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce168d1700 1 -- 172.21.15.61:0/516036983 shutdown_connections 2023-12-24T19:57:26.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce168d1700 1 -- 172.21.15.61:0/516036983 >> 172.21.15.61:0/516036983 conn(0x7fce10097a10 msgr2=0x7fce100ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:26.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce168d1700 1 -- 172.21.15.61:0/516036983 shutdown_connections 2023-12-24T19:57:26.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.452+0000 7fce168d1700 1 -- 172.21.15.61:0/516036983 wait complete. 2023-12-24T19:57:26.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.453+0000 7fce168d1700 1 Processor -- start 2023-12-24T19:57:26.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.454+0000 7fce168d1700 1 -- start start 2023-12-24T19:57:26.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.454+0000 7fce168d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcdf8004d50 0x7fce1016d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.454+0000 7fce168d1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce10146cb0 0x7fce1016b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.454+0000 7fce168d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce1016bb00 0x7fce100b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.454+0000 7fce168d1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1016bff0 con 0x7fce10146cb0 2023-12-24T19:57:26.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.454+0000 7fce168d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1016c2d0 con 0x7fce1016bb00 2023-12-24T19:57:26.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.454+0000 7fce168d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1016c5b0 con 0x7fcdf8004d50 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.454+0000 7fce0f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce10146cb0 0x7fce1016b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.454+0000 7fce0f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce10146cb0 0x7fce1016b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33116/0 (socket says 172.21.15.61:33116) 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce0f7fe700 1 -- 172.21.15.61:0/2776819292 learned_addr learned my addr 172.21.15.61:0/2776819292 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce14e6e700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce1016bb00 0x7fce100b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce0ffff700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcdf8004d50 0x7fce1016d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce0f7fe700 1 -- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcdf8004d50 msgr2=0x7fce1016d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce0f7fe700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcdf8004d50 0x7fce1016d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce0f7fe700 1 -- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce1016bb00 msgr2=0x7fce100b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce0f7fe700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce1016bb00 0x7fce100b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce0f7fe700 1 -- 172.21.15.61:0/2776819292 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1016c890 con 0x7fce10146cb0 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce0ffff700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcdf8004d50 0x7fce1016d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce14e6e700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce1016bb00 0x7fce100b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce0f7fe700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce10146cb0 0x7fce1016b5c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce04006ac0 tx=0x7fce040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:26.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fcdf7fff700 1 -- 172.21.15.61:0/2776819292 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400fa10 con 0x7fce10146cb0 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fcdf7fff700 1 -- 172.21.15.61:0/2776819292 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0400fb70 con 0x7fce10146cb0 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce168d1700 1 -- 172.21.15.61:0/2776819292 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1016cb70 con 0x7fce10146cb0 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fcdf7fff700 1 -- 172.21.15.61:0/2776819292 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04014440 con 0x7fce10146cb0 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.455+0000 7fce168d1700 1 -- 172.21.15.61:0/2776819292 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce10157970 con 0x7fce10146cb0 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.456+0000 7fce168d1700 1 -- 172.21.15.61:0/2776819292 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1006d440 con 0x7fce10146cb0 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.456+0000 7fcdf7fff700 1 -- 172.21.15.61:0/2776819292 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fce04014830 con 0x7fce10146cb0 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.457+0000 7fcdf7fff700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcdfc066f60 0x7fcdfc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.457+0000 7fcdf7fff700 1 -- 172.21.15.61:0/2776819292 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce04018030 con 0x7fce10146cb0 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.457+0000 7fce0ffff700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcdfc066f60 0x7fcdfc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.457+0000 7fce0ffff700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcdfc066f60 0x7fcdfc069410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce00001260 tx=0x7fce00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:26.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.461+0000 7fcdf7fff700 1 -- 172.21.15.61:0/2776819292 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce040521e0 con 0x7fce10146cb0 2023-12-24T19:57:26.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.703+0000 7fce168d1700 1 -- 172.21.15.61:0/2776819292 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce1004c3c0 con 0x7fce10146cb0 2023-12-24T19:57:26.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.703+0000 7fcdf7fff700 1 -- 172.21.15.61:0/2776819292 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fce04022070 con 0x7fce10146cb0 2023-12-24T19:57:26.704 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:57:26.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 -- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcdfc066f60 msgr2=0x7fcdfc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcdfc066f60 0x7fcdfc069410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fce00001260 tx=0x7fce00009040 comp rx=0 tx=0).stop 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 -- 172.21.15.61:0/2776819292 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce10146cb0 msgr2=0x7fce1016b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce10146cb0 0x7fce1016b5c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce04006ac0 tx=0x7fce040091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 -- 172.21.15.61:0/2776819292 shutdown_connections 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcdf8004d50 0x7fce1016d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcdfc066f60 0x7fcdfc069410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce1016bb00 0x7fce100b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 --2- 172.21.15.61:0/2776819292 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce10146cb0 0x7fce1016b5c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 -- 172.21.15.61:0/2776819292 >> 172.21.15.61:0/2776819292 conn(0x7fce10097a10 msgr2=0x7fce100af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 -- 172.21.15.61:0/2776819292 shutdown_connections 2023-12-24T19:57:26.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:26.705+0000 7fce168d1700 1 -- 172.21.15.61:0/2776819292 wait complete. 2023-12-24T19:57:26.717 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T19:57:26.717 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:57:26.717 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T19:57:26.717 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T19:57:26.718 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T19:57:26.718 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T19:57:26.718 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T19:57:26.718 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:57:26.718 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:57:26.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:26.718 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T19:57:26.735 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:26.736 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:26.737 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:57:26.737 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:26.737 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T19:57:26.737 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42519sec preferred_lft 42519sec 2023-12-24T19:57:26.737 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T19:57:26.737 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:26.737 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-24T19:57:26.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:26.738 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:57:26.738 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:57:26.738 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link add name ceph-brx type bridge 2023-12-24T19:57:26.738 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip addr flush dev ceph-brx 2023-12-24T19:57:26.738 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set ceph-brx up 2023-12-24T19:57:26.738 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-24T19:57:26.738 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:57:26.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:26.912 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:57:26.942 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T19:57:26.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:26.944 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T19:57:27.012 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T19:57:27.012 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:57:27.012 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T19:57:27.012 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T19:57:27.012 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:57:27.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:27.013 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:57:27.013 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:57:27.013 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T19:57:27.013 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T19:57:27.013 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T19:57:27.013 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:57:27.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:27.258 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T19:57:27.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:27.276 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list-id 2023-12-24T19:57:27.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:27.334 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:57:27.334 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:57:27.334 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T19:57:27.334 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-24T19:57:27.334 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:57:27.431 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-24T19:57:27.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:27.432 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:57:27.432 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:57:27.432 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-24T19:57:27.432 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-24T19:57:27.432 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-24T19:57:27.432 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-24T19:57:27.432 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-24T19:57:27.432 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:57:27.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:27.635 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:57:27.635 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:57:27.635 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T19:57:27.635 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set dev brx.0 master ceph-brx 2023-12-24T19:57:27.635 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:57:27.735 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T19:57:27.735 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:57:27.735 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T19:57:27.752 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:57:27.752 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:57:27.752 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:57:27.809 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T19:57:27.877 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:57:27.877 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:57:27.944 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:57:27.945 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:57:27.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:27.946 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T19:57:28.003 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T19:57:28.003 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T19:57:28.045 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T19:57:28.073 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:57:28.073 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:57:28.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T19:57:28.131+0000 7f8d6e83a540 -1 init, newargv = 0x55a489891550 newargc=15 2023-12-24T19:57:28.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[44244]: starting ceph client 2023-12-24T19:57:28.136 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[44244]: starting fuse 2023-12-24T19:57:28.141 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:57:28.143 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:57:28.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:28.143 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T19:57:28.200 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T19:57:28.200 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T19:57:28.201 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T19:57:28.202 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:57:28.325 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.44244.asok 2023-12-24T19:57:28.507 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44244.asok 2023-12-24T19:57:28.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:28.507 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44244.asok status 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "44244", 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T19:57:28.666 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 4629, 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 4629 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 348137465 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:57:28.667 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 348137465 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.4629 192.168.0.1:0/348137465", 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/348137465", 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 7, 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 20, 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T19:57:28.668 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:57:28.676 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:57:28.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.797+0000 7f12aea43700 1 Processor -- start 2023-12-24T19:57:28.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.797+0000 7f12aea43700 1 -- start start 2023-12-24T19:57:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12aea43700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f12a8159b00 0x7f12a8067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12aea43700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12a80af7d0 0x7f12a80afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12aea43700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a80a84d0 con 0x7f12a8070640 2023-12-24T19:57:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12aea43700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a80b01b0 con 0x7f12a8159b00 2023-12-24T19:57:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12aea43700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a80a7620 con 0x7f12a80af7d0 2023-12-24T19:57:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12a7fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f12a8159b00 0x7f12a8067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12a7fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f12a8159b00 0x7f12a8067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33122/0 (socket says 172.21.15.61:33122) 2023-12-24T19:57:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12acfe0700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f12a8070640 0x7f12a8070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57596/0 (socket says 172.21.15.61:57596) 2023-12-24T19:57:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12a7fff700 1 -- 172.21.15.61:0/744223702 learned_addr learned my addr 172.21.15.61:0/744223702 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12a77fe700 1 --2- 172.21.15.61:0/744223702 >> v2:172.21.15.133:3300/0 conn(0x7f12a80af7d0 0x7f12a80afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12a7fff700 1 -- 172.21.15.61:0/744223702 >> v2:172.21.15.133:3300/0 conn(0x7f12a80af7d0 msgr2=0x7f12a80afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12a7fff700 1 --2- 172.21.15.61:0/744223702 >> v2:172.21.15.133:3300/0 conn(0x7f12a80af7d0 0x7f12a80afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.798+0000 7f12a7fff700 1 -- 172.21.15.61:0/744223702 >> v1:172.21.15.61:6789/0 conn(0x7f12a8070640 legacy=0x7f12a8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12a7fff700 1 -- 172.21.15.61:0/744223702 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a80a78c0 con 0x7f12a8159b00 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12a6ffd700 1 -- 172.21.15.61:0/744223702 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818381213 0 0) 0x7f12a80a84d0 con 0x7f12a8070640 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12a7fff700 1 --2- 172.21.15.61:0/744223702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a8159b00 0x7f12a8067550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f12a80cd6c0 tx=0x7f1298009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6adce655edeb47a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12a6ffd700 1 -- 172.21.15.61:0/744223702 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129800b860 con 0x7f12a8159b00 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12a6ffd700 1 -- 172.21.15.61:0/744223702 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129800b9c0 con 0x7f12a8159b00 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12a6ffd700 1 -- 172.21.15.61:0/744223702 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129800bd60 con 0x7f12a8159b00 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12aea43700 1 -- 172.21.15.61:0/744223702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a8159b00 msgr2=0x7f12a8067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12aea43700 1 --2- 172.21.15.61:0/744223702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a8159b00 0x7f12a8067550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f12a80cd6c0 tx=0x7f1298009250 comp rx=0 tx=0).stop 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12aea43700 1 -- 172.21.15.61:0/744223702 shutdown_connections 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12aea43700 1 --2- 172.21.15.61:0/744223702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a8159b00 0x7f12a8067550 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12aea43700 1 --2- 172.21.15.61:0/744223702 >> v2:172.21.15.133:3300/0 conn(0x7f12a80af7d0 0x7f12a80afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.799+0000 7f12aea43700 1 -- 172.21.15.61:0/744223702 >> 172.21.15.61:0/744223702 conn(0x7f12a80ca200 msgr2=0x7f12a80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.800+0000 7f12aea43700 1 -- 172.21.15.61:0/744223702 shutdown_connections 2023-12-24T19:57:28.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.800+0000 7f12aea43700 1 -- 172.21.15.61:0/744223702 wait complete. 2023-12-24T19:57:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.801+0000 7f12aea43700 1 Processor -- start 2023-12-24T19:57:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.801+0000 7f12aea43700 1 -- start start 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12aea43700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12a8070640 0x7f12a81420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12aea43700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a80af7d0 0x7f12a8152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12aea43700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a8159b00 0x7f12a8067f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12aea43700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a815b340 con 0x7f12a80af7d0 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12aea43700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a815b890 con 0x7f12a8159b00 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12aea43700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8153570 con 0x7f12a8070640 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a80af7d0 0x7f12a8152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a80af7d0 0x7f12a8152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33124/0 (socket says 172.21.15.61:33124) 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a77fe700 1 -- 172.21.15.61:0/766359148 learned_addr learned my addr 172.21.15.61:0/766359148 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12acfe0700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a8159b00 0x7f12a8067f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a7fff700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12a8070640 0x7f12a81420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a77fe700 1 -- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12a8070640 msgr2=0x7f12a81420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a77fe700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12a8070640 0x7f12a81420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a77fe700 1 -- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a8159b00 msgr2=0x7f12a8067f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a77fe700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a8159b00 0x7f12a8067f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a77fe700 1 -- 172.21.15.61:0/766359148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12980094f0 con 0x7f12a80af7d0 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a7fff700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12a8070640 0x7f12a81420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12a77fe700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a80af7d0 0x7f12a8152b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f129000d890 tx=0x7f1290008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f129ffff700 1 -- 172.21.15.61:0/766359148 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12900125f0 con 0x7f12a80af7d0 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f129ffff700 1 -- 172.21.15.61:0/766359148 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290012750 con 0x7f12a80af7d0 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f12aea43700 1 -- 172.21.15.61:0/766359148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a8153850 con 0x7f12a80af7d0 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.802+0000 7f129ffff700 1 -- 172.21.15.61:0/766359148 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290012ad0 con 0x7f12a80af7d0 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.803+0000 7f12aea43700 1 -- 172.21.15.61:0/766359148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a8154ca0 con 0x7f12a80af7d0 2023-12-24T19:57:28.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.804+0000 7f12aea43700 1 -- 172.21.15.61:0/766359148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a804c3c0 con 0x7f12a80af7d0 2023-12-24T19:57:28.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.804+0000 7f129ffff700 1 -- 172.21.15.61:0/766359148 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f129001e460 con 0x7f12a80af7d0 2023-12-24T19:57:28.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.804+0000 7f129ffff700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1288066f30 0x7f12880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:28.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.804+0000 7f129ffff700 1 -- 172.21.15.61:0/766359148 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1290084b50 con 0x7f12a80af7d0 2023-12-24T19:57:28.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.805+0000 7f12a7fff700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1288066f30 0x7f12880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:28.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.805+0000 7f12a7fff700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1288066f30 0x7f12880693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f12a80cd6c0 tx=0x7f1298017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:28.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:28.809+0000 7f129ffff700 1 -- 172.21.15.61:0/766359148 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1290051dc0 con 0x7f12a80af7d0 2023-12-24T19:57:29.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.045+0000 7f12aea43700 1 -- 172.21.15.61:0/766359148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f12a815b9d0 con 0x7f12a80af7d0 2023-12-24T19:57:29.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.045+0000 7f129ffff700 1 -- 172.21.15.61:0/766359148 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f12900553e0 con 0x7f12a80af7d0 2023-12-24T19:57:29.046 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:57:29.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 -- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1288066f30 msgr2=0x7f12880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:29.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1288066f30 0x7f12880693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f12a80cd6c0 tx=0x7f1298017000 comp rx=0 tx=0).stop 2023-12-24T19:57:29.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 -- 172.21.15.61:0/766359148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a80af7d0 msgr2=0x7f12a8152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:29.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a80af7d0 0x7f12a8152b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f129000d890 tx=0x7f1290008040 comp rx=0 tx=0).stop 2023-12-24T19:57:29.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 -- 172.21.15.61:0/766359148 shutdown_connections 2023-12-24T19:57:29.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12a8070640 0x7f12a81420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:29.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1288066f30 0x7f12880693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:29.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a8159b00 0x7f12a8067f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:29.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 --2- 172.21.15.61:0/766359148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12a80af7d0 0x7f12a8152b00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:29.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 -- 172.21.15.61:0/766359148 >> 172.21.15.61:0/766359148 conn(0x7f12a80ca200 msgr2=0x7f12a81552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:29.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 -- 172.21.15.61:0/766359148 shutdown_connections 2023-12-24T19:57:29.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:29.048+0000 7f12aea43700 1 -- 172.21.15.61:0/766359148 wait complete. 2023-12-24T19:57:29.060 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T19:57:29.060 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:57:29.060 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T19:57:29.060 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-24T19:57:29.060 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-24T19:57:29.060 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T19:57:29.060 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T19:57:29.060 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:57:29.061 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-24T19:57:29.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.061 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T19:57:29.079 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:57:29.079 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:57:29.079 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:57:29.079 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.079 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T19:57:29.079 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.079 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:29.079 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:29.079 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T19:57:29.079 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42517sec preferred_lft 42517sec 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.080 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:57:29.081 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T19:57:29.081 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link tentative 2023-12-24T19:57:29.081 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.081 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:57:29.145 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T19:57:29.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.147 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T19:57:29.206 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T19:57:29.206 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:57:29.207 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T19:57:29.207 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T19:57:29.207 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:57:29.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.207 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:57:29.207 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:57:29.207 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T19:57:29.207 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T19:57:29.207 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T19:57:29.207 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:57:29.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.315 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T19:57:29.332 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T19:57:29.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.332 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list-id 2023-12-24T19:57:29.389 INFO:teuthology.orchestra.run.smithi061.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-24T19:57:29.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.390 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:57:29.390 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:57:29.390 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T19:57:29.390 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-24T19:57:29.390 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:57:29.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.485 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-24T19:57:29.522 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:57:29.522 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:57:29.522 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:57:29.522 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.522 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T19:57:29.522 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.522 INFO:teuthology.orchestra.run.smithi061.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:57:29.523 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 8a:a8:14:a2:7f:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-24T19:57:29.523 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-24T19:57:29.523 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.523 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::88a8:14ff:fea2:7f07/64 scope link 2023-12-24T19:57:29.523 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.540 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-24T19:57:29.624 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:57:29.624 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:57:29.624 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:57:29.624 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.624 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T19:57:29.625 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.625 INFO:teuthology.orchestra.run.smithi061.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:57:29.625 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 8a:a8:14:a2:7f:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-24T19:57:29.625 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-24T19:57:29.625 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.625 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::88a8:14ff:fea2:7f07/64 scope link 2023-12-24T19:57:29.625 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:29.636 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-24T19:57:29.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.637 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:57:29.637 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:57:29.637 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-24T19:57:29.637 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-24T19:57:29.637 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-24T19:57:29.637 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-24T19:57:29.637 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-24T19:57:29.637 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:57:29.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:29.838 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:57:29.838 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:57:29.838 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.1 up 2023-12-24T19:57:29.838 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set dev brx.1 master ceph-brx 2023-12-24T19:57:29.838 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:57:29.937 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-12-24T19:57:29.937 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:57:29.937 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-24T19:57:29.955 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-24T19:57:29.955 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:57:29.955 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-24T19:57:30.012 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T19:57:30.080 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:57:30.080 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:57:30.147 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:57:30.148 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:57:30.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:30.148 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T19:57:30.205 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T19:57:30.206 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-12-24T19:57:30.206 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-12-24T19:57:30.248 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T19:57:30.275 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:57:30.276 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:57:30.335 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi061.stderr:2023-12-24T19:57:30.334+0000 7f5bb5a63540 -1 init, newargv = 0x5616e565d210 newargc=15 2023-12-24T19:57:30.335 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi061.stderr:ceph-fuse[44899]: starting ceph client 2023-12-24T19:57:30.339 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi061.stderr:ceph-fuse[44899]: starting fuse 2023-12-24T19:57:30.345 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:57:30.346 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:57:30.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:30.347 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T19:57:30.406 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T19:57:30.406 INFO:teuthology.orchestra.run.smithi061.stdout:48 2023-12-24T19:57:30.408 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-12-24T19:57:30.408 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:57:30.408 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T19:57:30.408 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T19:57:30.408 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:57:30.408 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T19:57:30.409 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:57:30.409 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T19:57:30.409 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-12-24T19:57:30.409 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T19:57:30.409 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-12-24T19:57:30.409 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:57:30.410 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T19:57:30.410 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T19:57:30.410 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T19:57:30.410 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T19:57:30.410 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:57:30.410 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T19:57:30.411 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:57:30.411 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:57:30.411 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:57:30.411 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T19:57:30.411 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T19:57:30.411 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T19:57:30.411 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:57:30.412 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:57:30.412 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.2")) 2023-12-24T19:57:30.412 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:57:30.533 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.2.44899.asok 2023-12-24T19:57:30.715 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.44899.asok 2023-12-24T19:57:30.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:30.715 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.44899.asok status 2023-12-24T19:57:30.871 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:57:30.871 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "2", 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "44899", 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 4641, 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T19:57:30.872 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 4641 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:0", 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 4243596125 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:0", 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 4243596125 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:30.873 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.4641 172.21.15.61:0/4243596125", 2023-12-24T19:57:30.874 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "172.21.15.61:0/4243596125", 2023-12-24T19:57:30.874 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T19:57:30.874 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 7, 2023-12-24T19:57:30.874 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 20, 2023-12-24T19:57:30.874 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T19:57:30.874 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T19:57:30.874 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T19:57:30.874 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:57:30.881 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:57:31.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.001+0000 7fe22c9e5700 1 Processor -- start 2023-12-24T19:57:31.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.001+0000 7fe22c9e5700 1 -- start start 2023-12-24T19:57:31.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.002+0000 7fe22c9e5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe228159850 0x7fe228159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:31.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.002+0000 7fe22c9e5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe22806aac0 0x7fe2280cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:31.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.002+0000 7fe22c9e5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe2280caa80 0x7fe2280aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.002+0000 7fe22c9e5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22806a630 con 0x7fe22806aac0 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.002+0000 7fe22c9e5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe228069d00 con 0x7fe2280caa80 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.002+0000 7fe22c9e5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe228069fe0 con 0x7fe228159850 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe225d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe22806aac0 0x7fe2280cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe225d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe22806aac0 0x7fe2280cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33126/0 (socket says 172.21.15.61:33126) 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe225d9b700 1 -- 172.21.15.61:0/3309901069 learned_addr learned my addr 172.21.15.61:0/3309901069 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe226d9d700 1 --2- 172.21.15.61:0/3309901069 >> v2:172.21.15.133:3300/0 conn(0x7fe2280caa80 0x7fe2280aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe22659c700 1 --2- 172.21.15.61:0/3309901069 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe228159850 0x7fe228159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe225d9b700 1 -- 172.21.15.61:0/3309901069 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe228159850 msgr2=0x7fe228159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe225d9b700 1 --2- 172.21.15.61:0/3309901069 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe228159850 0x7fe228159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe225d9b700 1 -- 172.21.15.61:0/3309901069 >> v2:172.21.15.133:3300/0 conn(0x7fe2280caa80 msgr2=0x7fe2280aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe225d9b700 1 --2- 172.21.15.61:0/3309901069 >> v2:172.21.15.133:3300/0 conn(0x7fe2280caa80 0x7fe2280aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe225d9b700 1 -- 172.21.15.61:0/3309901069 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22806a2c0 con 0x7fe22806aac0 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe225d9b700 1 --2- 172.21.15.61:0/3309901069 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe22806aac0 0x7fe2280cc5e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe22806cf00 tx=0x7fe21c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80be25708421b39f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe22559a700 1 -- 172.21.15.61:0/3309901069 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00b860 con 0x7fe22806aac0 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe22559a700 1 -- 172.21.15.61:0/3309901069 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c00b9c0 con 0x7fe22806aac0 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.003+0000 7fe22559a700 1 -- 172.21.15.61:0/3309901069 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00bd60 con 0x7fe22806aac0 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.004+0000 7fe22c9e5700 1 -- 172.21.15.61:0/3309901069 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe22806aac0 msgr2=0x7fe2280cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.004+0000 7fe22c9e5700 1 --2- 172.21.15.61:0/3309901069 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe22806aac0 0x7fe2280cc5e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe22806cf00 tx=0x7fe21c009250 comp rx=0 tx=0).stop 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.004+0000 7fe22c9e5700 1 -- 172.21.15.61:0/3309901069 shutdown_connections 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.004+0000 7fe22c9e5700 1 --2- 172.21.15.61:0/3309901069 >> v2:172.21.15.133:3300/0 conn(0x7fe2280caa80 0x7fe2280aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.004+0000 7fe22c9e5700 1 --2- 172.21.15.61:0/3309901069 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe228159850 0x7fe228159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.004+0000 7fe22c9e5700 1 --2- 172.21.15.61:0/3309901069 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe22806aac0 0x7fe2280cc5e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.004+0000 7fe22c9e5700 1 -- 172.21.15.61:0/3309901069 >> 172.21.15.61:0/3309901069 conn(0x7fe2280cceb0 msgr2=0x7fe2280cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.004+0000 7fe22c9e5700 1 -- 172.21.15.61:0/3309901069 shutdown_connections 2023-12-24T19:57:31.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.004+0000 7fe22c9e5700 1 -- 172.21.15.61:0/3309901069 wait complete. 2023-12-24T19:57:31.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.005+0000 7fe22c9e5700 1 Processor -- start 2023-12-24T19:57:31.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.005+0000 7fe22c9e5700 1 -- start start 2023-12-24T19:57:31.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe22c9e5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe22806aac0 0x7fe22815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:31.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe22c9e5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2280caa80 0x7fe228148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:31.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe22c9e5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe228159850 0x7fe2280aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:31.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe22c9e5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe228148f40 con 0x7fe228159850 2023-12-24T19:57:31.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe22c9e5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22815e420 con 0x7fe2280caa80 2023-12-24T19:57:31.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe22c9e5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22815df90 con 0x7fe22806aac0 2023-12-24T19:57:31.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe226d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe228159850 0x7fe2280aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe226d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe228159850 0x7fe2280aa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33138/0 (socket says 172.21.15.61:33138) 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe226d9d700 1 -- 172.21.15.61:0/2956178320 learned_addr learned my addr 172.21.15.61:0/2956178320 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe225d9b700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2280caa80 0x7fe228148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe22659c700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe22806aac0 0x7fe22815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe226d9d700 1 -- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe22806aac0 msgr2=0x7fe22815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe226d9d700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe22806aac0 0x7fe22815cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe226d9d700 1 -- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2280caa80 msgr2=0x7fe228148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe226d9d700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2280caa80 0x7fe228148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe226d9d700 1 -- 172.21.15.61:0/2956178320 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0094f0 con 0x7fe228159850 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe226d9d700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe228159850 0x7fe2280aa8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe220007f60 tx=0x7fe2200098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe2167fc700 1 -- 172.21.15.61:0/2956178320 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22000eb90 con 0x7fe228159850 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe2167fc700 1 -- 172.21.15.61:0/2956178320 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22000ecf0 con 0x7fe228159850 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe2167fc700 1 -- 172.21.15.61:0/2956178320 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220014670 con 0x7fe228159850 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.006+0000 7fe22c9e5700 1 -- 172.21.15.61:0/2956178320 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22815d380 con 0x7fe228159850 2023-12-24T19:57:31.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.007+0000 7fe22c9e5700 1 -- 172.21.15.61:0/2956178320 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22815d940 con 0x7fe228159850 2023-12-24T19:57:31.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.007+0000 7fe22c9e5700 1 -- 172.21.15.61:0/2956178320 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22806f210 con 0x7fe228159850 2023-12-24T19:57:31.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.008+0000 7fe2167fc700 1 -- 172.21.15.61:0/2956178320 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe220014a60 con 0x7fe228159850 2023-12-24T19:57:31.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.008+0000 7fe2167fc700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe208066f30 0x7fe2080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:31.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.009+0000 7fe2167fc700 1 -- 172.21.15.61:0/2956178320 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe220084b00 con 0x7fe228159850 2023-12-24T19:57:31.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.009+0000 7fe22659c700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe208066f30 0x7fe2080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:31.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.009+0000 7fe22659c700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe208066f30 0x7fe2080693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe21800acb0 tx=0x7fe218008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:31.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.013+0000 7fe2167fc700 1 -- 172.21.15.61:0/2956178320 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe220051d70 con 0x7fe228159850 2023-12-24T19:57:31.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.250+0000 7fe22c9e5700 1 -- 172.21.15.61:0/2956178320 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe22815e100 con 0x7fe228159850 2023-12-24T19:57:31.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.251+0000 7fe2167fc700 1 -- 172.21.15.61:0/2956178320 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe220055390 con 0x7fe228159850 2023-12-24T19:57:31.251 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:57:31.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 -- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe208066f30 msgr2=0x7fe2080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:31.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe208066f30 0x7fe2080693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe21800acb0 tx=0x7fe218008040 comp rx=0 tx=0).stop 2023-12-24T19:57:31.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 -- 172.21.15.61:0/2956178320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe228159850 msgr2=0x7fe2280aa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:31.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe228159850 0x7fe2280aa8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe220007f60 tx=0x7fe2200098e0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 -- 172.21.15.61:0/2956178320 shutdown_connections 2023-12-24T19:57:31.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe22806aac0 0x7fe22815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe208066f30 0x7fe2080693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe228159850 0x7fe2280aa8f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 --2- 172.21.15.61:0/2956178320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2280caa80 0x7fe228148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:31.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 -- 172.21.15.61:0/2956178320 >> 172.21.15.61:0/2956178320 conn(0x7fe2280cceb0 msgr2=0x7fe22806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:31.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 -- 172.21.15.61:0/2956178320 shutdown_connections 2023-12-24T19:57:31.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:31.253+0000 7fe22c9e5700 1 -- 172.21.15.61:0/2956178320 wait complete. 2023-12-24T19:57:31.265 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T19:57:31.265 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:57:31.265 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T19:57:31.265 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T19:57:31.265 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T19:57:31.265 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T19:57:31.265 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T19:57:31.265 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:57:31.265 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:57:31.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:31.266 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T19:57:31.287 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:57:31.287 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:57:31.287 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:57:31.287 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:31.288 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T19:57:31.288 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:31.288 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:31.288 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:31.288 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T19:57:31.288 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:31.288 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:31.288 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T19:57:31.288 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:31.288 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:31.289 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:57:31.289 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:31.289 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T19:57:31.289 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42522sec preferred_lft 42522sec 2023-12-24T19:57:31.289 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T19:57:31.289 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:31.289 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-24T19:57:31.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:31.290 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:57:31.290 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:57:31.290 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2023-12-24T19:57:31.290 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2023-12-24T19:57:31.290 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2023-12-24T19:57:31.290 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-24T19:57:31.291 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:57:31.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:31.476 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:57:31.506 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T19:57:31.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:31.507 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T19:57:31.575 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T19:57:31.575 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:57:31.575 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T19:57:31.575 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T19:57:31.575 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:57:31.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:31.576 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:57:31.576 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:57:31.576 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T19:57:31.576 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T19:57:31.576 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T19:57:31.576 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:57:31.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:31.791 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T19:57:31.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:31.808 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-12-24T19:57:31.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:31.864 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:57:31.864 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:57:31.864 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T19:57:31.864 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-24T19:57:31.864 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:57:31.960 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-24T19:57:31.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:31.960 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:57:31.960 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:57:31.960 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-24T19:57:31.960 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-24T19:57:31.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-24T19:57:31.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-24T19:57:31.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-24T19:57:31.961 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:57:32.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:32.172 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:57:32.172 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:57:32.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T19:57:32.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2023-12-24T19:57:32.172 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:57:32.269 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T19:57:32.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:57:32.269 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T19:57:32.286 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:57:32.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:57:32.286 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T19:57:32.343 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T19:57:32.411 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:57:32.411 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:57:32.477 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:57:32.478 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:57:32.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:32.479 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T19:57:32.536 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T19:57:32.536 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T19:57:32.579 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T19:57:32.604 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:57:32.605 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:57:32.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T19:57:32.662+0000 7f86097f1540 -1 init, newargv = 0x55bda69de690 newargc=15 2023-12-24T19:57:32.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[41637]: starting ceph client 2023-12-24T19:57:32.667 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[41637]: starting fuse 2023-12-24T19:57:32.672 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:57:32.673 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:57:32.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:32.674 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T19:57:32.731 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T19:57:32.731 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T19:57:32.731 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:57:32.731 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:57:32.732 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:57:32.733 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:57:32.733 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T19:57:32.733 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T19:57:32.733 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T19:57:32.733 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:57:32.733 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:57:32.733 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T19:57:32.733 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T19:57:32.854 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.41637.asok 2023-12-24T19:57:33.037 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41637.asok 2023-12-24T19:57:33.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:33.037 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41637.asok status 2023-12-24T19:57:33.188 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "41637", 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T19:57:33.189 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4523, 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 4523 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 980946259 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:57:33.190 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 980946259 2023-12-24T19:57:33.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:57:33.191 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.4523 192.168.0.1:0/980946259", 2023-12-24T19:57:33.191 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/980946259", 2023-12-24T19:57:33.191 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T19:57:33.191 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 7, 2023-12-24T19:57:33.191 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 20, 2023-12-24T19:57:33.191 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T19:57:33.191 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T19:57:33.191 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T19:57:33.192 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T19:57:33.198 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:57:33.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.331+0000 7fd7731eb700 1 Processor -- start 2023-12-24T19:57:33.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.331+0000 7fd7731eb700 1 -- start start 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd7731eb700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd76c0af710 0x7fd76c0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd7731eb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd76c15acf0 0x7fd76c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd7731eb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c0687f0 con 0x7fd76c068c80 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd7731eb700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c067be0 con 0x7fd76c0af710 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd7731eb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c067ec0 con 0x7fd76c15acf0 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd770f87700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd76c0af710 0x7fd76c0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd770f87700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd76c0af710 0x7fd76c0afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33144/0 (socket says 172.21.15.61:33144) 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd770f87700 1 -- 172.21.15.61:0/2920158950 learned_addr learned my addr 172.21.15.61:0/2920158950 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd771788700 1 --2- 172.21.15.61:0/2920158950 >> v2:172.21.15.133:3300/0 conn(0x7fd76c15acf0 0x7fd76c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd770f87700 1 -- 172.21.15.61:0/2920158950 >> v2:172.21.15.133:3300/0 conn(0x7fd76c15acf0 msgr2=0x7fd76c067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd770f87700 1 --2- 172.21.15.61:0/2920158950 >> v2:172.21.15.133:3300/0 conn(0x7fd76c15acf0 0x7fd76c067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd770f87700 1 -- 172.21.15.61:0/2920158950 >> v1:172.21.15.133:6789/0 conn(0x7fd76c068c80 legacy=0x7fd76c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd770f87700 1 -- 172.21.15.61:0/2920158950 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c0681a0 con 0x7fd76c0af710 2023-12-24T19:57:33.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.332+0000 7fd771788700 1 --2- 172.21.15.61:0/2920158950 >> v2:172.21.15.133:3300/0 conn(0x7fd76c15acf0 0x7fd76c067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd770f87700 1 --2- 172.21.15.61:0/2920158950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 0x7fd76c0afae0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd76c15a540 tx=0x7fd76000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7823e50b9896db4d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd76b7fe700 1 -- 172.21.15.61:0/2920158950 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76000dc50 con 0x7fd76c0af710 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd76b7fe700 1 -- 172.21.15.61:0/2920158950 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76000ddb0 con 0x7fd76c0af710 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd76b7fe700 1 -- 172.21.15.61:0/2920158950 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7600196d0 con 0x7fd76c0af710 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd7731eb700 1 -- 172.21.15.61:0/2920158950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 msgr2=0x7fd76c0afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd7731eb700 1 --2- 172.21.15.61:0/2920158950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 0x7fd76c0afae0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd76c15a540 tx=0x7fd76000b4f0 comp rx=0 tx=0).stop 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd7731eb700 1 -- 172.21.15.61:0/2920158950 shutdown_connections 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd7731eb700 1 --2- 172.21.15.61:0/2920158950 >> v2:172.21.15.133:3300/0 conn(0x7fd76c15acf0 0x7fd76c067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd7731eb700 1 --2- 172.21.15.61:0/2920158950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 0x7fd76c0afae0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd7731eb700 1 -- 172.21.15.61:0/2920158950 >> 172.21.15.61:0/2920158950 conn(0x7fd76c0ca200 msgr2=0x7fd76c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd7731eb700 1 -- 172.21.15.61:0/2920158950 shutdown_connections 2023-12-24T19:57:33.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.333+0000 7fd7731eb700 1 -- 172.21.15.61:0/2920158950 wait complete. 2023-12-24T19:57:33.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.334+0000 7fd7731eb700 1 Processor -- start 2023-12-24T19:57:33.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.335+0000 7fd7731eb700 1 -- start start 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.335+0000 7fd7731eb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd76c068c80 0x7fd76c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.335+0000 7fd7731eb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 0x7fd76c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.335+0000 7fd7731eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd76c15acf0 0x7fd76c0b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.335+0000 7fd7731eb700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c1599b0 con 0x7fd76c0af710 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd7731eb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c15a380 con 0x7fd76c15acf0 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd7731eb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0b31e0 con 0x7fd76c068c80 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd76bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 0x7fd76c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd76bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 0x7fd76c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33158/0 (socket says 172.21.15.61:33158) 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd76bfff700 1 -- 172.21.15.61:0/1544914137 learned_addr learned my addr 172.21.15.61:0/1544914137 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd771788700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd76c15acf0 0x7fd76c0b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd770f87700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd76c068c80 0x7fd76c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd76bfff700 1 -- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd76c068c80 msgr2=0x7fd76c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd76bfff700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd76c068c80 0x7fd76c159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd76bfff700 1 -- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd76c15acf0 msgr2=0x7fd76c0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd76bfff700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd76c15acf0 0x7fd76c0b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:33.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd76bfff700 1 -- 172.21.15.61:0/1544914137 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76000b790 con 0x7fd76c0af710 2023-12-24T19:57:33.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd770f87700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd76c068c80 0x7fd76c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:33.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd76bfff700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 0x7fd76c152300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c590 tx=0x7fd758007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:33.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd768ff9700 1 -- 172.21.15.61:0/1544914137 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758011590 con 0x7fd76c0af710 2023-12-24T19:57:33.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd768ff9700 1 -- 172.21.15.61:0/1544914137 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758011710 con 0x7fd76c0af710 2023-12-24T19:57:33.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd7731eb700 1 -- 172.21.15.61:0/1544914137 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c159360 con 0x7fd76c0af710 2023-12-24T19:57:33.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd768ff9700 1 -- 172.21.15.61:0/1544914137 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd758011ad0 con 0x7fd76c0af710 2023-12-24T19:57:33.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.336+0000 7fd7731eb700 1 -- 172.21.15.61:0/1544914137 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c159030 con 0x7fd76c0af710 2023-12-24T19:57:33.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.337+0000 7fd7731eb700 1 -- 172.21.15.61:0/1544914137 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c04c3c0 con 0x7fd76c0af710 2023-12-24T19:57:33.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.338+0000 7fd768ff9700 1 -- 172.21.15.61:0/1544914137 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd75801b3b0 con 0x7fd76c0af710 2023-12-24T19:57:33.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.338+0000 7fd768ff9700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:33.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.338+0000 7fd768ff9700 1 -- 172.21.15.61:0/1544914137 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd758083940 con 0x7fd76c0af710 2023-12-24T19:57:33.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.339+0000 7fd770f87700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:33.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.339+0000 7fd770f87700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd750066f30 0x7fd7500693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd76c15a540 tx=0x7fd76001b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:33.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.343+0000 7fd768ff9700 1 -- 172.21.15.61:0/1544914137 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd758050bb0 con 0x7fd76c0af710 2023-12-24T19:57:33.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.583+0000 7fd7731eb700 1 -- 172.21.15.61:0/1544914137 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd76c0cb930 con 0x7fd76c0af710 2023-12-24T19:57:33.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.583+0000 7fd768ff9700 1 -- 172.21.15.61:0/1544914137 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd758017070 con 0x7fd76c0af710 2023-12-24T19:57:33.585 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 -- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd750066f30 msgr2=0x7fd7500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd750066f30 0x7fd7500693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd76c15a540 tx=0x7fd76001b000 comp rx=0 tx=0).stop 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 -- 172.21.15.61:0/1544914137 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 msgr2=0x7fd76c152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 0x7fd76c152300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c590 tx=0x7fd758007f50 comp rx=0 tx=0).stop 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 -- 172.21.15.61:0/1544914137 shutdown_connections 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd76c068c80 0x7fd76c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd750066f30 0x7fd7500693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd76c15acf0 0x7fd76c0b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 --2- 172.21.15.61:0/1544914137 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd76c0af710 0x7fd76c152300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 -- 172.21.15.61:0/1544914137 >> 172.21.15.61:0/1544914137 conn(0x7fd76c0ca200 msgr2=0x7fd76c15c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 -- 172.21.15.61:0/1544914137 shutdown_connections 2023-12-24T19:57:33.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:33.585+0000 7fd7731eb700 1 -- 172.21.15.61:0/1544914137 wait complete. 2023-12-24T19:57:33.598 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T19:57:33.598 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:57:33.598 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T19:57:33.598 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-24T19:57:33.598 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-24T19:57:33.598 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T19:57:33.598 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T19:57:33.599 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:57:33.599 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-24T19:57:33.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:33.599 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T19:57:33.618 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:57:33.618 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:57:33.618 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:57:33.618 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:33.618 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T19:57:33.618 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:33.618 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42519sec preferred_lft 42519sec 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:33.619 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:57:33.620 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff 2023-12-24T19:57:33.620 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T19:57:33.620 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:33.620 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T19:57:33.620 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:33.621 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:57:33.621 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T19:57:33.621 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link tentative 2023-12-24T19:57:33.621 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:33.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:33.622 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:57:33.685 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T19:57:33.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:33.687 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T19:57:33.747 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T19:57:33.747 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:57:33.747 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T19:57:33.747 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T19:57:33.747 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:57:33.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:33.748 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:57:33.748 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:57:33.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T19:57:33.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T19:57:33.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T19:57:33.748 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:57:33.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:33.855 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T19:57:33.872 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T19:57:33.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:33.873 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-12-24T19:57:33.930 INFO:teuthology.orchestra.run.smithi133.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-24T19:57:33.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:33.931 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:57:33.931 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:57:33.931 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T19:57:33.931 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-24T19:57:33.931 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:57:34.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:34.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-24T19:57:34.059 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:57:34.059 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:57:34.060 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:57:34.060 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:34.060 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T19:57:34.060 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:34.060 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:57:34.060 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ce:cb:22:ab:8c:b2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-24T19:57:34.060 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-24T19:57:34.060 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:34.060 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cccb:22ff:feab:8cb2/64 scope link 2023-12-24T19:57:34.060 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:34.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:34.072 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-24T19:57:34.148 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:57:34.148 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:57:34.149 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:57:34.149 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:34.149 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T19:57:34.149 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:34.149 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:57:34.149 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ce:cb:22:ab:8c:b2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-24T19:57:34.149 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-24T19:57:34.149 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:34.149 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cccb:22ff:feab:8cb2/64 scope link 2023-12-24T19:57:34.149 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:57:34.163 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-24T19:57:34.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:34.163 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:57:34.163 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:57:34.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-24T19:57:34.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-24T19:57:34.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-24T19:57:34.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-24T19:57:34.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-24T19:57:34.163 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:57:34.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:34.380 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:57:34.380 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:57:34.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.1 up 2023-12-24T19:57:34.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.1 master ceph-brx 2023-12-24T19:57:34.381 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:57:34.478 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-12-24T19:57:34.478 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:57:34.478 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-24T19:57:34.495 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-24T19:57:34.495 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:57:34.495 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-24T19:57:34.552 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T19:57:34.619 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:57:34.619 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:57:34.685 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:57:34.686 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:57:34.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:34.687 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T19:57:34.744 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T19:57:34.744 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [47] 2023-12-24T19:57:34.745 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-12-24T19:57:34.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T19:57:34.813 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:57:34.813 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:57:34.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi133.stderr:2023-12-24T19:57:34.869+0000 7f710668e540 -1 init, newargv = 0x562facb7a040 newargc=15 2023-12-24T19:57:34.870 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi133.stderr:ceph-fuse[42247]: starting ceph client 2023-12-24T19:57:34.874 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi133.stderr:ceph-fuse[42247]: starting fuse 2023-12-24T19:57:34.882 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:57:34.883 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:57:34.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:34.884 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T19:57:34.941 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T19:57:34.941 INFO:teuthology.orchestra.run.smithi133.stdout:48 2023-12-24T19:57:34.942 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47, 48] 2023-12-24T19:57:34.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:57:34.942 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T19:57:34.942 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T19:57:34.942 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T19:57:34.942 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T19:57:34.942 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:57:34.942 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T19:57:34.942 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-12-24T19:57:34.942 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T19:57:34.942 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.3")) 2023-12-24T19:57:34.943 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T19:57:35.064 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.3.42247.asok 2023-12-24T19:57:35.247 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42247.asok 2023-12-24T19:57:35.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:35.247 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42247.asok status 2023-12-24T19:57:35.360 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:57:35.362 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:57:35.403 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T19:57:35.403 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T19:57:35.403 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:57:35.403 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "3", 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "42247", 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4624, 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 4624 2023-12-24T19:57:35.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.2:0", 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 4083083962 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.2:0", 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 4083083962 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.4624 192.168.0.2:0/4083083962", 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.2:0/4083083962", 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T19:57:35.405 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 7, 2023-12-24T19:57:35.406 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 20, 2023-12-24T19:57:35.406 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T19:57:35.406 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T19:57:35.406 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T19:57:35.406 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T19:57:35.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:35.413 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T19:57:35.413 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T19:57:35.434 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T19:57:35.435 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T19:57:35.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:35.435 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:57:35.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:35.508 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T19:57:35.508 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.2 2023-12-24T19:57:35.567 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T19:57:35.568 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-12-24T19:57:35.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:35.568 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-24T19:57:35.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:35.641 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T19:57:35.641 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T19:57:35.661 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T19:57:35.661 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T19:57:35.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:35.662 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T19:57:35.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:35.730 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T19:57:35.730 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.3 2023-12-24T19:57:35.788 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T19:57:35.788 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-12-24T19:57:35.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:57:35.788 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-24T19:57:35.855 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-24T19:57:35.873 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:36.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.004+0000 7fd4c94bb700 1 Processor -- start 2023-12-24T19:57:36.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.004+0000 7fd4c94bb700 1 -- start start 2023-12-24T19:57:36.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c94bb700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd4c41599e0 0x7fd4c415ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c94bb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4c40cdb80 0x7fd4c40cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c94bb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c40cc2a0 con 0x7fd4c40cbac0 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c94bb700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c40cedc0 con 0x7fd4c41599e0 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c94bb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4067f60 con 0x7fd4c40cdb80 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c2ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd4c41599e0 0x7fd4c415ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c2ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd4c41599e0 0x7fd4c415ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33168/0 (socket says 172.21.15.61:33168) 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c2ffd700 1 -- 172.21.15.61:0/801154810 learned_addr learned my addr 172.21.15.61:0/801154810 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c37fe700 1 --2- 172.21.15.61:0/801154810 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4c40cdb80 0x7fd4c40cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c2ffd700 1 -- 172.21.15.61:0/801154810 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4c40cdb80 msgr2=0x7fd4c40cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c2ffd700 1 --2- 172.21.15.61:0/801154810 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4c40cdb80 0x7fd4c40cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c2ffd700 1 -- 172.21.15.61:0/801154810 >> v1:172.21.15.133:6789/0 conn(0x7fd4c40cbac0 legacy=0x7fd4c40cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c2ffd700 1 -- 172.21.15.61:0/801154810 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c415b040 con 0x7fd4c41599e0 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c2ffd700 1 --2- 172.21.15.61:0/801154810 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c41599e0 0x7fd4c415ab00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40099b0 tx=0x7fd4b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e45fb3fcff5a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.005+0000 7fd4c1ffb700 1 -- 172.21.15.61:0/801154810 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4009ea0 con 0x7fd4c41599e0 2023-12-24T19:57:36.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.006+0000 7fd4c1ffb700 1 -- 172.21.15.61:0/801154810 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b400b860 con 0x7fd4c41599e0 2023-12-24T19:57:36.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.006+0000 7fd4c1ffb700 1 -- 172.21.15.61:0/801154810 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400bc00 con 0x7fd4c41599e0 2023-12-24T19:57:36.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.006+0000 7fd4c94bb700 1 -- 172.21.15.61:0/801154810 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c41599e0 msgr2=0x7fd4c415ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.006+0000 7fd4c94bb700 1 --2- 172.21.15.61:0/801154810 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c41599e0 0x7fd4c415ab00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40099b0 tx=0x7fd4b4009250 comp rx=0 tx=0).stop 2023-12-24T19:57:36.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.006+0000 7fd4c94bb700 1 -- 172.21.15.61:0/801154810 shutdown_connections 2023-12-24T19:57:36.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.006+0000 7fd4c94bb700 1 --2- 172.21.15.61:0/801154810 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4c40cdb80 0x7fd4c40cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.006+0000 7fd4c94bb700 1 --2- 172.21.15.61:0/801154810 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c41599e0 0x7fd4c415ab00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.006+0000 7fd4c94bb700 1 -- 172.21.15.61:0/801154810 >> 172.21.15.61:0/801154810 conn(0x7fd4c406e640 msgr2=0x7fd4c4067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:36.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.006+0000 7fd4c94bb700 1 -- 172.21.15.61:0/801154810 shutdown_connections 2023-12-24T19:57:36.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.006+0000 7fd4c94bb700 1 -- 172.21.15.61:0/801154810 wait complete. 2023-12-24T19:57:36.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.007+0000 7fd4c94bb700 1 Processor -- start 2023-12-24T19:57:36.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.007+0000 7fd4c94bb700 1 -- start start 2023-12-24T19:57:36.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c94bb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4c40cbac0 0x7fd4c4158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c94bb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c40cdb80 0x7fd4c40c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c94bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c41599e0 0x7fd4c40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c94bb700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c41473d0 con 0x7fd4c40cdb80 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c94bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c41590d0 con 0x7fd4c41599e0 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c94bb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4156320 con 0x7fd4c40cbac0 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c27fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c40cdb80 0x7fd4c40c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c27fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c40cdb80 0x7fd4c40c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33172/0 (socket says 172.21.15.61:33172) 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c27fc700 1 -- 172.21.15.61:0/105040681 learned_addr learned my addr 172.21.15.61:0/105040681 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c2ffd700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4c40cbac0 0x7fd4c4158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.008+0000 7fd4c37fe700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c41599e0 0x7fd4c40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4c27fc700 1 -- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4c40cbac0 msgr2=0x7fd4c4158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4c27fc700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4c40cbac0 0x7fd4c4158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4c27fc700 1 -- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c41599e0 msgr2=0x7fd4c40c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4c27fc700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c41599e0 0x7fd4c40c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4c27fc700 1 -- 172.21.15.61:0/105040681 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40094f0 con 0x7fd4c40cdb80 2023-12-24T19:57:36.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4c27fc700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c40cdb80 0x7fd4c40c8db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c590 tx=0x7fd4b8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:36.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4aaffd700 1 -- 172.21.15.61:0/105040681 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011590 con 0x7fd4c40cdb80 2023-12-24T19:57:36.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4aaffd700 1 -- 172.21.15.61:0/105040681 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b8011730 con 0x7fd4c40cdb80 2023-12-24T19:57:36.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4c94bb700 1 -- 172.21.15.61:0/105040681 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c4156600 con 0x7fd4c40cdb80 2023-12-24T19:57:36.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4aaffd700 1 -- 172.21.15.61:0/105040681 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011af0 con 0x7fd4c40cdb80 2023-12-24T19:57:36.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.009+0000 7fd4c94bb700 1 -- 172.21.15.61:0/105040681 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c4156bc0 con 0x7fd4c40cdb80 2023-12-24T19:57:36.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.010+0000 7fd4c94bb700 1 -- 172.21.15.61:0/105040681 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c404c3c0 con 0x7fd4c40cdb80 2023-12-24T19:57:36.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.010+0000 7fd4aaffd700 1 -- 172.21.15.61:0/105040681 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd4b8012420 con 0x7fd4c40cdb80 2023-12-24T19:57:36.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.011+0000 7fd4aaffd700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd4b0066f30 0x7fd4b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.011+0000 7fd4aaffd700 1 -- 172.21.15.61:0/105040681 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4b8083700 con 0x7fd4c40cdb80 2023-12-24T19:57:36.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.011+0000 7fd4c2ffd700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd4b0066f30 0x7fd4b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.011+0000 7fd4c2ffd700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd4b0066f30 0x7fd4b00693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40099b0 tx=0x7fd4b4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:36.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.015+0000 7fd4aaffd700 1 -- 172.21.15.61:0/105040681 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4b804b5a0 con 0x7fd4c40cdb80 2023-12-24T19:57:36.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.211+0000 7fd4c94bb700 1 -- 172.21.15.61:0/105040681 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4c40cbfc0 con 0x7fd4c40cdb80 2023-12-24T19:57:36.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.212+0000 7fd4aaffd700 1 -- 172.21.15.61:0/105040681 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd4b8017020 con 0x7fd4c40cdb80 2023-12-24T19:57:36.213 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:36.213 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:36.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 -- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd4b0066f30 msgr2=0x7fd4b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd4b0066f30 0x7fd4b00693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40099b0 tx=0x7fd4b4017000 comp rx=0 tx=0).stop 2023-12-24T19:57:36.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 -- 172.21.15.61:0/105040681 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c40cdb80 msgr2=0x7fd4c40c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c40cdb80 0x7fd4c40c8db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c590 tx=0x7fd4b8007f30 comp rx=0 tx=0).stop 2023-12-24T19:57:36.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 -- 172.21.15.61:0/105040681 shutdown_connections 2023-12-24T19:57:36.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd4c40cbac0 0x7fd4c4158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd4b0066f30 0x7fd4b00693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c41599e0 0x7fd4c40c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 --2- 172.21.15.61:0/105040681 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4c40cdb80 0x7fd4c40c8db0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 -- 172.21.15.61:0/105040681 >> 172.21.15.61:0/105040681 conn(0x7fd4c406e640 msgr2=0x7fd4c40b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:36.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 -- 172.21.15.61:0/105040681 shutdown_connections 2023-12-24T19:57:36.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.214+0000 7fd4c94bb700 1 -- 172.21.15.61:0/105040681 wait complete. 2023-12-24T19:57:36.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:57:04.595282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:57:05.898273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:57:36.228 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:57:36.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.351+0000 7fb14ea45700 1 Processor -- start 2023-12-24T19:57:36.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.351+0000 7fb14ea45700 1 -- start start 2023-12-24T19:57:36.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.352+0000 7fb14ea45700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb148156830 0x7fb1480c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.352+0000 7fb14ea45700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb1480c9b30 0x7fb1480c3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.352+0000 7fb14ea45700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1480c8690 con 0x7fb148156c00 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.352+0000 7fb14ea45700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1480c3870 con 0x7fb148156830 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.352+0000 7fb14ea45700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb148069f00 con 0x7fb1480c9b30 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.352+0000 7fb147fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb148156830 0x7fb1480c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.352+0000 7fb1477fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb148156c00 0x7fb148067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57602/0 (socket says 172.21.15.61:57602) 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.352+0000 7fb1477fe700 1 -- 172.21.15.61:0/3643178015 learned_addr learned my addr 172.21.15.61:0/3643178015 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.353+0000 7fb14cfe2700 1 --2- 172.21.15.61:0/3643178015 >> v2:172.21.15.133:3300/0 conn(0x7fb1480c9b30 0x7fb1480c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.353+0000 7fb147fff700 1 -- 172.21.15.61:0/3643178015 >> v2:172.21.15.133:3300/0 conn(0x7fb1480c9b30 msgr2=0x7fb1480c3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.353+0000 7fb147fff700 1 --2- 172.21.15.61:0/3643178015 >> v2:172.21.15.133:3300/0 conn(0x7fb1480c9b30 0x7fb1480c3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.353+0000 7fb147fff700 1 -- 172.21.15.61:0/3643178015 >> v1:172.21.15.61:6789/0 conn(0x7fb148156c00 legacy=0x7fb148067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.353+0000 7fb147fff700 1 -- 172.21.15.61:0/3643178015 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14806a1e0 con 0x7fb148156830 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.353+0000 7fb146ffd700 1 -- 172.21.15.61:0/3643178015 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670058784 0 0) 0x7fb1480c8690 con 0x7fb148156c00 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.353+0000 7fb147fff700 1 --2- 172.21.15.61:0/3643178015 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb148156830 0x7fb1480c2df0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb14806d350 tx=0x7fb1380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b2e14ead00e8d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:36.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.353+0000 7fb146ffd700 1 -- 172.21.15.61:0/3643178015 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800b6b0 con 0x7fb148156830 2023-12-24T19:57:36.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.353+0000 7fb146ffd700 1 -- 172.21.15.61:0/3643178015 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13800b810 con 0x7fb148156830 2023-12-24T19:57:36.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.353+0000 7fb146ffd700 1 -- 172.21.15.61:0/3643178015 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800bbb0 con 0x7fb148156830 2023-12-24T19:57:36.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.354+0000 7fb14ea45700 1 -- 172.21.15.61:0/3643178015 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb148156830 msgr2=0x7fb1480c2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.354+0000 7fb14ea45700 1 --2- 172.21.15.61:0/3643178015 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb148156830 0x7fb1480c2df0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb14806d350 tx=0x7fb1380091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.354+0000 7fb14ea45700 1 -- 172.21.15.61:0/3643178015 shutdown_connections 2023-12-24T19:57:36.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.354+0000 7fb14ea45700 1 --2- 172.21.15.61:0/3643178015 >> v2:172.21.15.133:3300/0 conn(0x7fb1480c9b30 0x7fb1480c3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.354+0000 7fb14ea45700 1 --2- 172.21.15.61:0/3643178015 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb148156830 0x7fb1480c2df0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.354+0000 7fb14ea45700 1 -- 172.21.15.61:0/3643178015 >> 172.21.15.61:0/3643178015 conn(0x7fb1480ce1f0 msgr2=0x7fb1480ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:36.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.354+0000 7fb14ea45700 1 -- 172.21.15.61:0/3643178015 shutdown_connections 2023-12-24T19:57:36.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.354+0000 7fb14ea45700 1 -- 172.21.15.61:0/3643178015 wait complete. 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.355+0000 7fb14ea45700 1 Processor -- start 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.355+0000 7fb14ea45700 1 -- start start 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb14ea45700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1480c9b30 0x7fb14815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb14ea45700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb148156830 0x7fb1481596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb14ea45700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb148156c00 0x7fb1480cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb14ea45700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148157820 con 0x7fb1480c9b30 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb14ea45700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1480c4b90 con 0x7fb148156c00 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb14ea45700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1480c4e70 con 0x7fb148156830 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb147fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1480c9b30 0x7fb14815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb147fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1480c9b30 0x7fb14815c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33190/0 (socket says 172.21.15.61:33190) 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb147fff700 1 -- 172.21.15.61:0/1082024164 learned_addr learned my addr 172.21.15.61:0/1082024164 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb1477fe700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb148156830 0x7fb1481596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb14cfe2700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb148156c00 0x7fb1480cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb147fff700 1 -- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb148156830 msgr2=0x7fb1481596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb147fff700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb148156830 0x7fb1481596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb147fff700 1 -- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb148156c00 msgr2=0x7fb1480cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb147fff700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb148156c00 0x7fb1480cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb147fff700 1 -- 172.21.15.61:0/1082024164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138009420 con 0x7fb1480c9b30 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb14cfe2700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb148156c00 0x7fb1480cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb147fff700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1480c9b30 0x7fb14815c3a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb14806ca80 tx=0x7fb138017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.356+0000 7fb12ffff700 1 -- 172.21.15.61:0/1082024164 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800bb90 con 0x7fb1480c9b30 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.357+0000 7fb12ffff700 1 -- 172.21.15.61:0/1082024164 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138000cc0 con 0x7fb1480c9b30 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.357+0000 7fb14ea45700 1 -- 172.21.15.61:0/1082024164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1480c5150 con 0x7fb1480c9b30 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.357+0000 7fb12ffff700 1 -- 172.21.15.61:0/1082024164 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138011670 con 0x7fb1480c9b30 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.357+0000 7fb14ea45700 1 -- 172.21.15.61:0/1082024164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1480c47d0 con 0x7fb1480c9b30 2023-12-24T19:57:36.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.358+0000 7fb14ea45700 1 -- 172.21.15.61:0/1082024164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb148157b50 con 0x7fb1480c9b30 2023-12-24T19:57:36.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.359+0000 7fb12ffff700 1 -- 172.21.15.61:0/1082024164 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb138011aa0 con 0x7fb1480c9b30 2023-12-24T19:57:36.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.359+0000 7fb12ffff700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.359+0000 7fb12ffff700 1 -- 172.21.15.61:0/1082024164 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1380866b0 con 0x7fb1480c9b30 2023-12-24T19:57:36.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.360+0000 7fb1477fe700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.360+0000 7fb1477fe700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb134066f30 0x7fb1340693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb1480c77d0 tx=0x7fb13c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:36.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.363+0000 7fb12ffff700 1 -- 172.21.15.61:0/1082024164 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb138053900 con 0x7fb1480c9b30 2023-12-24T19:57:36.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.554+0000 7fb14ea45700 1 -- 172.21.15.61:0/1082024164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb148157960 con 0x7fb1480c9b30 2023-12-24T19:57:36.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.555+0000 7fb12ffff700 1 -- 172.21.15.61:0/1082024164 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb138056f20 con 0x7fb1480c9b30 2023-12-24T19:57:36.556 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:57:36.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 -- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb134066f30 msgr2=0x7fb1340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb134066f30 0x7fb1340693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb1480c77d0 tx=0x7fb13c009040 comp rx=0 tx=0).stop 2023-12-24T19:57:36.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 -- 172.21.15.61:0/1082024164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1480c9b30 msgr2=0x7fb14815c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1480c9b30 0x7fb14815c3a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb14806ca80 tx=0x7fb138017000 comp rx=0 tx=0).stop 2023-12-24T19:57:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 -- 172.21.15.61:0/1082024164 shutdown_connections 2023-12-24T19:57:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb148156c00 0x7fb1480cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1480c9b30 0x7fb14815c3a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 --2- 172.21.15.61:0/1082024164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb148156830 0x7fb1481596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 -- 172.21.15.61:0/1082024164 >> 172.21.15.61:0/1082024164 conn(0x7fb1480ce1f0 msgr2=0x7fb14814d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 -- 172.21.15.61:0/1082024164 shutdown_connections 2023-12-24T19:57:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.557+0000 7fb14ea45700 1 -- 172.21.15.61:0/1082024164 wait complete. 2023-12-24T19:57:36.570 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:57:36.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.696+0000 7f46c4db1700 1 Processor -- start 2023-12-24T19:57:36.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.696+0000 7f46c4db1700 1 -- start start 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46c4db1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f46c00b0130 0x7f46c0070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46c4db1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f46c00688b0 0x7f46c0070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46c4db1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c015e470 con 0x7f46c00afd60 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46c4db1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c006ad90 con 0x7f46c00b0130 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46c4db1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c0068db0 con 0x7f46c00688b0 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46bdd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f46c00b0130 0x7f46c0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46bdd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f46c00b0130 0x7f46c0070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36314/0 (socket says 172.21.15.61:36314) 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46bdd9b700 1 -- 172.21.15.61:0/3168409372 learned_addr learned my addr 172.21.15.61:0/3168409372 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46bed9d700 1 --2- 172.21.15.61:0/3168409372 >> v2:172.21.15.133:3300/0 conn(0x7f46c00688b0 0x7f46c0070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46bdd9b700 1 -- 172.21.15.61:0/3168409372 >> v2:172.21.15.133:3300/0 conn(0x7f46c00688b0 msgr2=0x7f46c0070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46bdd9b700 1 --2- 172.21.15.61:0/3168409372 >> v2:172.21.15.133:3300/0 conn(0x7f46c00688b0 0x7f46c0070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46bdd9b700 1 -- 172.21.15.61:0/3168409372 >> v1:172.21.15.133:6789/0 conn(0x7f46c00afd60 legacy=0x7f46c00cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.697+0000 7f46bdd9b700 1 -- 172.21.15.61:0/3168409372 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c015db40 con 0x7f46c00b0130 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46bdd9b700 1 --2- 172.21.15.61:0/3168409372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00b0130 0x7f46c0070640 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f46b00099b0 tx=0x7f46b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26fec6bda585f71 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46bd59a700 1 -- 172.21.15.61:0/3168409372 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b000b820 con 0x7f46c00b0130 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46bd59a700 1 -- 172.21.15.61:0/3168409372 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b000b980 con 0x7f46c00b0130 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46bd59a700 1 -- 172.21.15.61:0/3168409372 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b000bd20 con 0x7f46c00b0130 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46c4db1700 1 -- 172.21.15.61:0/3168409372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00b0130 msgr2=0x7f46c0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46c4db1700 1 --2- 172.21.15.61:0/3168409372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00b0130 0x7f46c0070640 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f46b00099b0 tx=0x7f46b0009250 comp rx=0 tx=0).stop 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46c4db1700 1 -- 172.21.15.61:0/3168409372 shutdown_connections 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46c4db1700 1 --2- 172.21.15.61:0/3168409372 >> v2:172.21.15.133:3300/0 conn(0x7f46c00688b0 0x7f46c0070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46c4db1700 1 --2- 172.21.15.61:0/3168409372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00b0130 0x7f46c0070640 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46c4db1700 1 -- 172.21.15.61:0/3168409372 >> 172.21.15.61:0/3168409372 conn(0x7f46c00ce400 msgr2=0x7f46c00ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46c4db1700 1 -- 172.21.15.61:0/3168409372 shutdown_connections 2023-12-24T19:57:36.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.698+0000 7f46c4db1700 1 -- 172.21.15.61:0/3168409372 wait complete. 2023-12-24T19:57:36.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46c4db1700 1 Processor -- start 2023-12-24T19:57:36.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46c4db1700 1 -- start start 2023-12-24T19:57:36.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46c4db1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46c00688b0 0x7f46c0148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46c4db1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46c00afd60 0x7f46c00c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46c4db1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00c75e0 0x7f46c014a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46c4db1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00c8150 con 0x7f46c00c75e0 2023-12-24T19:57:36.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46c4db1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c014a100 con 0x7f46c00688b0 2023-12-24T19:57:36.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46c4db1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00c7e70 con 0x7f46c00afd60 2023-12-24T19:57:36.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46bed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00c75e0 0x7f46c014a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46bed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00c75e0 0x7f46c014a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36322/0 (socket says 172.21.15.61:36322) 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.700+0000 7f46bed9d700 1 -- 172.21.15.61:0/2381574233 learned_addr learned my addr 172.21.15.61:0/2381574233 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46bdd9b700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46c00afd60 0x7f46c00c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46be59c700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46c00688b0 0x7f46c0148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46bed9d700 1 -- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46c00afd60 msgr2=0x7f46c00c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46bed9d700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46c00afd60 0x7f46c00c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46bed9d700 1 -- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46c00688b0 msgr2=0x7f46c0148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46bed9d700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46c00688b0 0x7f46c0148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46bed9d700 1 -- 172.21.15.61:0/2381574233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00094f0 con 0x7f46c00c75e0 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46be59c700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46c00688b0 0x7f46c0148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46bed9d700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00c75e0 0x7f46c014a590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009fa0 tx=0x7f46b8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46ae7fc700 1 -- 172.21.15.61:0/2381574233 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b800ed20 con 0x7f46c00c75e0 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46ae7fc700 1 -- 172.21.15.61:0/2381574233 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b800ee80 con 0x7f46c00c75e0 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46ae7fc700 1 -- 172.21.15.61:0/2381574233 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8014670 con 0x7f46c00c75e0 2023-12-24T19:57:36.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46c4db1700 1 -- 172.21.15.61:0/2381574233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c0149ab0 con 0x7f46c00c75e0 2023-12-24T19:57:36.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.701+0000 7f46c4db1700 1 -- 172.21.15.61:0/2381574233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c0149230 con 0x7f46c00c75e0 2023-12-24T19:57:36.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.702+0000 7f46c4db1700 1 -- 172.21.15.61:0/2381574233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c0149910 con 0x7f46c00c75e0 2023-12-24T19:57:36.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.702+0000 7f46ae7fc700 1 -- 172.21.15.61:0/2381574233 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f46b80149e0 con 0x7f46c00c75e0 2023-12-24T19:57:36.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.703+0000 7f46ae7fc700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f46a0066f30 0x7f46a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:36.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.703+0000 7f46ae7fc700 1 -- 172.21.15.61:0/2381574233 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46b8084cb0 con 0x7f46c00c75e0 2023-12-24T19:57:36.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.703+0000 7f46be59c700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f46a0066f30 0x7f46a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:36.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.704+0000 7f46be59c700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f46a0066f30 0x7f46a00693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f46b4001840 tx=0x7f46b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:36.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.707+0000 7f46ae7fc700 1 -- 172.21.15.61:0/2381574233 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46c0149910 con 0x7f46c00c75e0 2023-12-24T19:57:36.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.901+0000 7f46c4db1700 1 -- 172.21.15.61:0/2381574233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46c0149910 con 0x7f46c00c75e0 2023-12-24T19:57:36.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.901+0000 7f46ae7fc700 1 -- 172.21.15.61:0/2381574233 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46c0149910 con 0x7f46c00c75e0 2023-12-24T19:57:36.903 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T19:57:36.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.903+0000 7f46c4db1700 1 -- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f46a0066f30 msgr2=0x7f46a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.903+0000 7f46c4db1700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f46a0066f30 0x7f46a00693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f46b4001840 tx=0x7f46b4009040 comp rx=0 tx=0).stop 2023-12-24T19:57:36.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.903+0000 7f46c4db1700 1 -- 172.21.15.61:0/2381574233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00c75e0 msgr2=0x7f46c014a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:36.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.903+0000 7f46c4db1700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00c75e0 0x7f46c014a590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009fa0 tx=0x7f46b8009900 comp rx=0 tx=0).stop 2023-12-24T19:57:36.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.904+0000 7f46c4db1700 1 -- 172.21.15.61:0/2381574233 shutdown_connections 2023-12-24T19:57:36.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.904+0000 7f46c4db1700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f46a0066f30 0x7f46a00693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.904+0000 7f46c4db1700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46c00c75e0 0x7f46c014a590 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.904+0000 7f46c4db1700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46c00688b0 0x7f46c0148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.904+0000 7f46c4db1700 1 --2- 172.21.15.61:0/2381574233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46c00afd60 0x7f46c00c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:36.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.904+0000 7f46c4db1700 1 -- 172.21.15.61:0/2381574233 >> 172.21.15.61:0/2381574233 conn(0x7f46c00ce400 msgr2=0x7f46c00cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:36.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.904+0000 7f46c4db1700 1 -- 172.21.15.61:0/2381574233 shutdown_connections 2023-12-24T19:57:36.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:36.904+0000 7f46c4db1700 1 -- 172.21.15.61:0/2381574233 wait complete. 2023-12-24T19:57:36.917 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:57:37.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.040+0000 7f00c384b700 1 Processor -- start 2023-12-24T19:57:37.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.040+0000 7f00c384b700 1 -- start start 2023-12-24T19:57:37.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.041+0000 7f00c384b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f00bc0cd420 0x7f00bc159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.041+0000 7f00c384b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00bc0cbf80 con 0x7f00bc1598d0 2023-12-24T19:57:37.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.041+0000 7f00c15e7700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f00bc1598d0 0x7f00bc06db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46344/0 (socket says 172.21.15.61:46344) 2023-12-24T19:57:37.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.041+0000 7f00c15e7700 1 -- 172.21.15.61:0/1666736182 learned_addr learned my addr 172.21.15.61:0/1666736182 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:37.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.041+0000 7f00c384b700 1 -- 172.21.15.61:0/1666736182 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00bc06e990 con 0x7f00bc0b2aa0 2023-12-24T19:57:37.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.041+0000 7f00c384b700 1 -- 172.21.15.61:0/1666736182 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc0b2f10 con 0x7f00bc0cd420 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.041+0000 7f00c1de8700 1 --2- 172.21.15.61:0/1666736182 >> v2:172.21.15.61:3300/0 conn(0x7f00bc0cd420 0x7f00bc159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00bbfff700 1 -- 172.21.15.61:0/1666736182 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770124352 0 0) 0x7f00bc0cbf80 con 0x7f00bc1598d0 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00bbfff700 1 -- 172.21.15.61:0/1666736182 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00a4003570 con 0x7f00bc1598d0 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00bbfff700 1 -- 172.21.15.61:0/1666736182 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069422444 0 0) 0x7f00bc06e990 con 0x7f00bc0b2aa0 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00bbfff700 1 -- 172.21.15.61:0/1666736182 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00bc0cbf80 con 0x7f00bc0b2aa0 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00c1de8700 1 -- 172.21.15.61:0/1666736182 >> v1:172.21.15.133:6789/0 conn(0x7f00bc0b2aa0 legacy=0x7f00bc06e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00c1de8700 1 -- 172.21.15.61:0/1666736182 >> v1:172.21.15.61:6789/0 conn(0x7f00bc1598d0 legacy=0x7f00bc06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00c1de8700 1 -- 172.21.15.61:0/1666736182 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc0b11c0 con 0x7f00bc0cd420 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00c1de8700 1 --2- 172.21.15.61:0/1666736182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 0x7f00bc159ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009e60 tx=0x7f00ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4355a9a04f2cf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00bbfff700 1 -- 172.21.15.61:0/1666736182 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00e070 con 0x7f00bc0cd420 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00bbfff700 1 -- 172.21.15.61:0/1666736182 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ac00bab0 con 0x7f00bc0cd420 2023-12-24T19:57:37.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.042+0000 7f00bbfff700 1 -- 172.21.15.61:0/1666736182 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00be70 con 0x7f00bc0cd420 2023-12-24T19:57:37.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.043+0000 7f00c384b700 1 -- 172.21.15.61:0/1666736182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 msgr2=0x7f00bc159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.043+0000 7f00c384b700 1 --2- 172.21.15.61:0/1666736182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 0x7f00bc159ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009e60 tx=0x7f00ac009780 comp rx=0 tx=0).stop 2023-12-24T19:57:37.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.043+0000 7f00c384b700 1 -- 172.21.15.61:0/1666736182 shutdown_connections 2023-12-24T19:57:37.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.043+0000 7f00c384b700 1 --2- 172.21.15.61:0/1666736182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 0x7f00bc159ca0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.043+0000 7f00c384b700 1 -- 172.21.15.61:0/1666736182 >> 172.21.15.61:0/1666736182 conn(0x7f00bc067550 msgr2=0x7f00bc067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:37.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.043+0000 7f00c384b700 1 -- 172.21.15.61:0/1666736182 shutdown_connections 2023-12-24T19:57:37.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.043+0000 7f00c384b700 1 -- 172.21.15.61:0/1666736182 wait complete. 2023-12-24T19:57:37.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.044+0000 7f00c384b700 1 Processor -- start 2023-12-24T19:57:37.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.044+0000 7f00c384b700 1 -- start start 2023-12-24T19:57:37.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c384b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00bc0b2aa0 0x7f00bc0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c384b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 0x7f00bc155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c384b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00bc1598d0 0x7f00bc0c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c384b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc15c580 con 0x7f00bc0cd420 2023-12-24T19:57:37.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c384b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc15d0e0 con 0x7f00bc1598d0 2023-12-24T19:57:37.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c384b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0c8f60 con 0x7f00bc0b2aa0 2023-12-24T19:57:37.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c0de6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 0x7f00bc155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c0de6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 0x7f00bc155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36330/0 (socket says 172.21.15.61:36330) 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c0de6700 1 -- 172.21.15.61:0/3113155139 learned_addr learned my addr 172.21.15.61:0/3113155139 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c15e7700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00bc0b2aa0 0x7f00bc0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c1de8700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00bc1598d0 0x7f00bc0c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c0de6700 1 -- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00bc0b2aa0 msgr2=0x7f00bc0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c0de6700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00bc0b2aa0 0x7f00bc0c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c0de6700 1 -- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00bc1598d0 msgr2=0x7f00bc0c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c0de6700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00bc1598d0 0x7f00bc0c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c0de6700 1 -- 172.21.15.61:0/3113155139 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac009a20 con 0x7f00bc0cd420 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c15e7700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00bc0b2aa0 0x7f00bc0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.045+0000 7f00c0de6700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 0x7f00bc155e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c5b0 tx=0x7f00b0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.046+0000 7f00b97fa700 1 -- 172.21.15.61:0/3113155139 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0010510 con 0x7f00bc0cd420 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.046+0000 7f00b97fa700 1 -- 172.21.15.61:0/3113155139 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b0010670 con 0x7f00bc0cd420 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.046+0000 7f00c384b700 1 -- 172.21.15.61:0/3113155139 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc0c7050 con 0x7f00bc0cd420 2023-12-24T19:57:37.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.046+0000 7f00b97fa700 1 -- 172.21.15.61:0/3113155139 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0010a30 con 0x7f00bc0cd420 2023-12-24T19:57:37.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.046+0000 7f00c384b700 1 -- 172.21.15.61:0/3113155139 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00bc15ca90 con 0x7f00bc0cd420 2023-12-24T19:57:37.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.047+0000 7f00c384b700 1 -- 172.21.15.61:0/3113155139 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00bc15d290 con 0x7f00bc0cd420 2023-12-24T19:57:37.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.047+0000 7f00b97fa700 1 -- 172.21.15.61:0/3113155139 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f00b001b400 con 0x7f00bc0cd420 2023-12-24T19:57:37.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.047+0000 7f00b97fa700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 0x7f00a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.048+0000 7f00b97fa700 1 -- 172.21.15.61:0/3113155139 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00b0084120 con 0x7f00bc0cd420 2023-12-24T19:57:37.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.048+0000 7f00c15e7700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 0x7f00a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.048+0000 7f00c15e7700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 0x7f00a80693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f00b40058d0 tx=0x7f00b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:37.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.052+0000 7f00b97fa700 1 -- 172.21.15.61:0/3113155139 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00bc15d290 con 0x7f00bc0cd420 2023-12-24T19:57:37.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.246+0000 7f00c384b700 1 -- 172.21.15.61:0/3113155139 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00bc089150 con 0x7f00bc0cd420 2023-12-24T19:57:37.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.246+0000 7f00b97fa700 1 -- 172.21.15.61:0/3113155139 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00b0051390 con 0x7f00bc0cd420 2023-12-24T19:57:37.248 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T19:57:37.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 -- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 msgr2=0x7f00a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 0x7f00a80693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f00b40058d0 tx=0x7f00b4009040 comp rx=0 tx=0).stop 2023-12-24T19:57:37.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 -- 172.21.15.61:0/3113155139 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 msgr2=0x7f00bc155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 0x7f00bc155e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c5b0 tx=0x7f00b0007e10 comp rx=0 tx=0).stop 2023-12-24T19:57:37.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 -- 172.21.15.61:0/3113155139 shutdown_connections 2023-12-24T19:57:37.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00bc0b2aa0 0x7f00bc0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 0x7f00a80693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00bc1598d0 0x7f00bc0c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 --2- 172.21.15.61:0/3113155139 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00bc0cd420 0x7f00bc155e10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 -- 172.21.15.61:0/3113155139 >> 172.21.15.61:0/3113155139 conn(0x7f00bc067550 msgr2=0x7f00bc0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:37.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 -- 172.21.15.61:0/3113155139 shutdown_connections 2023-12-24T19:57:37.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.248+0000 7f00c384b700 1 -- 172.21.15.61:0/3113155139 wait complete. 2023-12-24T19:57:37.261 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:37.383 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.381+0000 7f18948ad700 1 Processor -- start 2023-12-24T19:57:37.383 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.382+0000 7f18948ad700 1 -- start start 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.382+0000 7f18948ad700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1890159850 0x7f1890159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.382+0000 7f18948ad700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18900caa80 0x7f18900aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.382+0000 7f18948ad700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189006a630 con 0x7f189006aac0 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f18948ad700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900cccf0 con 0x7f1890159850 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f18948ad700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1890069d00 con 0x7f18900caa80 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188e59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1890159850 0x7f1890159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188dd9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f189006aac0 0x7f18900cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46358/0 (socket says 172.21.15.61:46358) 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188dd9b700 1 -- 172.21.15.61:0/2247966459 learned_addr learned my addr 172.21.15.61:0/2247966459 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188ed9d700 1 --2- 172.21.15.61:0/2247966459 >> v2:172.21.15.133:3300/0 conn(0x7f18900caa80 0x7f18900aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188e59c700 1 -- 172.21.15.61:0/2247966459 >> v2:172.21.15.133:3300/0 conn(0x7f18900caa80 msgr2=0x7f18900aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188e59c700 1 --2- 172.21.15.61:0/2247966459 >> v2:172.21.15.133:3300/0 conn(0x7f18900caa80 0x7f18900aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188e59c700 1 -- 172.21.15.61:0/2247966459 >> v1:172.21.15.61:6789/0 conn(0x7f189006aac0 legacy=0x7f18900cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188e59c700 1 -- 172.21.15.61:0/2247966459 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890069fe0 con 0x7f1890159850 2023-12-24T19:57:37.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188d59a700 1 -- 172.21.15.61:0/2247966459 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749954774 0 0) 0x7f189006a630 con 0x7f189006aac0 2023-12-24T19:57:37.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188e59c700 1 --2- 172.21.15.61:0/2247966459 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1890159850 0x7f1890159c20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18900caa10 tx=0x7f18800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba61b739e1047123 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:37.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188d59a700 1 -- 172.21.15.61:0/2247966459 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188000b6b0 con 0x7f1890159850 2023-12-24T19:57:37.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188d59a700 1 -- 172.21.15.61:0/2247966459 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188000b810 con 0x7f1890159850 2023-12-24T19:57:37.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.383+0000 7f188d59a700 1 -- 172.21.15.61:0/2247966459 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188000bbb0 con 0x7f1890159850 2023-12-24T19:57:37.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.384+0000 7f18948ad700 1 -- 172.21.15.61:0/2247966459 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1890159850 msgr2=0x7f1890159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.384+0000 7f18948ad700 1 --2- 172.21.15.61:0/2247966459 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1890159850 0x7f1890159c20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18900caa10 tx=0x7f18800091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.384+0000 7f18948ad700 1 -- 172.21.15.61:0/2247966459 shutdown_connections 2023-12-24T19:57:37.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.384+0000 7f18948ad700 1 --2- 172.21.15.61:0/2247966459 >> v2:172.21.15.133:3300/0 conn(0x7f18900caa80 0x7f18900aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.384+0000 7f18948ad700 1 --2- 172.21.15.61:0/2247966459 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1890159850 0x7f1890159c20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.384+0000 7f18948ad700 1 -- 172.21.15.61:0/2247966459 >> 172.21.15.61:0/2247966459 conn(0x7f18900cceb0 msgr2=0x7f18900cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:37.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.384+0000 7f18948ad700 1 -- 172.21.15.61:0/2247966459 shutdown_connections 2023-12-24T19:57:37.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.384+0000 7f18948ad700 1 -- 172.21.15.61:0/2247966459 wait complete. 2023-12-24T19:57:37.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.385+0000 7f18948ad700 1 Processor -- start 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.385+0000 7f18948ad700 1 -- start start 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f18948ad700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f189006aac0 0x7f1890144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f18948ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18900caa80 0x7f18901587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f18948ad700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1890159850 0x7f1890158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f18948ad700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189016a120 con 0x7f189006aac0 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f18948ad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189016a400 con 0x7f18900caa80 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f18948ad700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189016a6e0 con 0x7f1890159850 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f188e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f189006aac0 0x7f1890144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f188e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f189006aac0 0x7f1890144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36352/0 (socket says 172.21.15.61:36352) 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f188e59c700 1 -- 172.21.15.61:0/3481120653 learned_addr learned my addr 172.21.15.61:0/3481120653 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f188ed9d700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1890159850 0x7f1890158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f188dd9b700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18900caa80 0x7f18901587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f188e59c700 1 -- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1890159850 msgr2=0x7f1890158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f188e59c700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1890159850 0x7f1890158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f188e59c700 1 -- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18900caa80 msgr2=0x7f18901587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f188e59c700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18900caa80 0x7f18901587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.386+0000 7f188e59c700 1 -- 172.21.15.61:0/3481120653 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880009420 con 0x7f189006aac0 2023-12-24T19:57:37.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.387+0000 7f188e59c700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f189006aac0 0x7f1890144820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f189006c4b0 tx=0x7f1880017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:37.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.387+0000 7f187e7fc700 1 -- 172.21.15.61:0/3481120653 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880006af0 con 0x7f189006aac0 2023-12-24T19:57:37.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.387+0000 7f187e7fc700 1 -- 172.21.15.61:0/3481120653 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188000bb90 con 0x7f189006aac0 2023-12-24T19:57:37.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.387+0000 7f18948ad700 1 -- 172.21.15.61:0/3481120653 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189016a9c0 con 0x7f189006aac0 2023-12-24T19:57:37.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.387+0000 7f187e7fc700 1 -- 172.21.15.61:0/3481120653 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880011650 con 0x7f189006aac0 2023-12-24T19:57:37.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.387+0000 7f18948ad700 1 -- 172.21.15.61:0/3481120653 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18900afcd0 con 0x7f189006aac0 2023-12-24T19:57:37.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.388+0000 7f18948ad700 1 -- 172.21.15.61:0/3481120653 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189004c3c0 con 0x7f189006aac0 2023-12-24T19:57:37.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.388+0000 7f187e7fc700 1 -- 172.21.15.61:0/3481120653 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1880011a40 con 0x7f189006aac0 2023-12-24T19:57:37.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.389+0000 7f187e7fc700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1870066f30 0x7f18700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.389+0000 7f187e7fc700 1 -- 172.21.15.61:0/3481120653 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1880085eb0 con 0x7f189006aac0 2023-12-24T19:57:37.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.389+0000 7f188dd9b700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1870066f30 0x7f18700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.389+0000 7f188dd9b700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1870066f30 0x7f18700693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f18900b12a0 tx=0x7f1884009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:37.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.393+0000 7f187e7fc700 1 -- 172.21.15.61:0/3481120653 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1880053120 con 0x7f189006aac0 2023-12-24T19:57:37.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.588+0000 7f18948ad700 1 -- 172.21.15.61:0/3481120653 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f189016a260 con 0x7f189006aac0 2023-12-24T19:57:37.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.589+0000 7f187e7fc700 1 -- 172.21.15.61:0/3481120653 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f189016a260 con 0x7f189006aac0 2023-12-24T19:57:37.590 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:37.591 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:37.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 -- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1870066f30 msgr2=0x7f18700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1870066f30 0x7f18700693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f18900b12a0 tx=0x7f1884009040 comp rx=0 tx=0).stop 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 -- 172.21.15.61:0/3481120653 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f189006aac0 msgr2=0x7f1890144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f189006aac0 0x7f1890144820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f189006c4b0 tx=0x7f1880017000 comp rx=0 tx=0).stop 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 -- 172.21.15.61:0/3481120653 shutdown_connections 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1890159850 0x7f1890158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1870066f30 0x7f18700693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f189006aac0 0x7f1890144820 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 --2- 172.21.15.61:0/3481120653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18900caa80 0x7f18901587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 -- 172.21.15.61:0/3481120653 >> 172.21.15.61:0/3481120653 conn(0x7f18900cceb0 msgr2=0x7f18900c1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 -- 172.21.15.61:0/3481120653 shutdown_connections 2023-12-24T19:57:37.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.591+0000 7f18948ad700 1 -- 172.21.15.61:0/3481120653 wait complete. 2023-12-24T19:57:37.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:57:04.595282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:57:05.898273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:57:37.605 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:57:37.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.728+0000 7f69e0c90700 1 Processor -- start 2023-12-24T19:57:37.730 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.728+0000 7f69e0c90700 1 -- start start 2023-12-24T19:57:37.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69e0c90700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f69dc070d50 0x7f69dc164e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69e0c90700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc15e470 con 0x7f69dc0b0130 2023-12-24T19:57:37.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69e0c90700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69dc06ad90 con 0x7f69dc0afd60 2023-12-24T19:57:37.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69e0c90700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69dc068db0 con 0x7f69dc070d50 2023-12-24T19:57:37.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69dad9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f69dc070d50 0x7f69dc164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69d9d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f69dc0b0130 0x7f69dc070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46366/0 (socket says 172.21.15.61:46366) 2023-12-24T19:57:37.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69d9d9b700 1 -- 172.21.15.61:0/3908729341 learned_addr learned my addr 172.21.15.61:0/3908729341 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:37.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69dad9d700 1 -- 172.21.15.61:0/3908729341 >> v1:172.21.15.133:6789/0 conn(0x7f69dc0afd60 legacy=0x7f69dc0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:37.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69dad9d700 1 -- 172.21.15.61:0/3908729341 >> v1:172.21.15.61:6789/0 conn(0x7f69dc0b0130 legacy=0x7f69dc070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69dad9d700 1 -- 172.21.15.61:0/3908729341 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc15db40 con 0x7f69dc070d50 2023-12-24T19:57:37.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.729+0000 7f69d959a700 1 -- 172.21.15.61:0/3908729341 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559409143 0 0) 0x7f69dc15e470 con 0x7f69dc0b0130 2023-12-24T19:57:37.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69dad9d700 1 --2- 172.21.15.61:0/3908729341 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc070d50 0x7f69dc164e80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009e60 tx=0x7f69d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13b6c6823a9510c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:37.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69d959a700 1 -- 172.21.15.61:0/3908729341 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d400e070 con 0x7f69dc070d50 2023-12-24T19:57:37.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69d959a700 1 -- 172.21.15.61:0/3908729341 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d400bbf0 con 0x7f69dc070d50 2023-12-24T19:57:37.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69d959a700 1 -- 172.21.15.61:0/3908729341 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4012430 con 0x7f69dc070d50 2023-12-24T19:57:37.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69e0c90700 1 -- 172.21.15.61:0/3908729341 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc070d50 msgr2=0x7f69dc164e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69e0c90700 1 --2- 172.21.15.61:0/3908729341 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc070d50 0x7f69dc164e80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009e60 tx=0x7f69d4009780 comp rx=0 tx=0).stop 2023-12-24T19:57:37.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69e0c90700 1 -- 172.21.15.61:0/3908729341 shutdown_connections 2023-12-24T19:57:37.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69e0c90700 1 --2- 172.21.15.61:0/3908729341 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc070d50 0x7f69dc164e80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69e0c90700 1 -- 172.21.15.61:0/3908729341 >> 172.21.15.61:0/3908729341 conn(0x7f69dc0ce400 msgr2=0x7f69dc0ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:37.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69e0c90700 1 -- 172.21.15.61:0/3908729341 shutdown_connections 2023-12-24T19:57:37.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.730+0000 7f69e0c90700 1 -- 172.21.15.61:0/3908729341 wait complete. 2023-12-24T19:57:37.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.732+0000 7f69e0c90700 1 Processor -- start 2023-12-24T19:57:37.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.732+0000 7f69e0c90700 1 -- start start 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.732+0000 7f69e0c90700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69dc070d50 0x7f69dc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.732+0000 7f69e0c90700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69dc0afd60 0x7f69dc0c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.732+0000 7f69e0c90700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc0c3f30 0x7f69dc0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.732+0000 7f69e0c90700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0c3560 con 0x7f69dc0c3f30 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.732+0000 7f69e0c90700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0c2950 con 0x7f69dc070d50 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.732+0000 7f69e0c90700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc0c2c30 con 0x7f69dc0afd60 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69dad9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc0c3f30 0x7f69dc0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69dad9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc0c3f30 0x7f69dc0c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36368/0 (socket says 172.21.15.61:36368) 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69dad9d700 1 -- 172.21.15.61:0/1697043907 learned_addr learned my addr 172.21.15.61:0/1697043907 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69d9d9b700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69dc0afd60 0x7f69dc0c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69da59c700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69dc070d50 0x7f69dc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69dad9d700 1 -- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69dc0afd60 msgr2=0x7f69dc0c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69dad9d700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69dc0afd60 0x7f69dc0c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69dad9d700 1 -- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69dc070d50 msgr2=0x7f69dc159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69dad9d700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69dc070d50 0x7f69dc159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69dad9d700 1 -- 172.21.15.61:0/1697043907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d4009a20 con 0x7f69dc0c3f30 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69dad9d700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc0c3f30 0x7f69dc0c5f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f69dc06cbb0 tx=0x7f69d4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69d27fc700 1 -- 172.21.15.61:0/1697043907 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4007000 con 0x7f69dc0c3f30 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69d27fc700 1 -- 172.21.15.61:0/1697043907 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d4021070 con 0x7f69dc0c3f30 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69d27fc700 1 -- 172.21.15.61:0/1697043907 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4026680 con 0x7f69dc0c3f30 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69e0c90700 1 -- 172.21.15.61:0/1697043907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69dc0c2f10 con 0x7f69dc0c3f30 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.733+0000 7f69e0c90700 1 -- 172.21.15.61:0/1697043907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc0c6460 con 0x7f69dc0c3f30 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.734+0000 7f69e0c90700 1 -- 172.21.15.61:0/1697043907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69dc04c3c0 con 0x7f69dc0c3f30 2023-12-24T19:57:37.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.735+0000 7f69d27fc700 1 -- 172.21.15.61:0/1697043907 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f69d4023030 con 0x7f69dc0c3f30 2023-12-24T19:57:37.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.735+0000 7f69d27fc700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f69bc066f30 0x7f69bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:37.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.735+0000 7f69d27fc700 1 -- 172.21.15.61:0/1697043907 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69d4086a00 con 0x7f69dc0c3f30 2023-12-24T19:57:37.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.735+0000 7f69da59c700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f69bc066f30 0x7f69bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:37.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.736+0000 7f69da59c700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f69bc066f30 0x7f69bc0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69c4003870 tx=0x7f69c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:37.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.740+0000 7f69d27fc700 1 -- 172.21.15.61:0/1697043907 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69d4053c70 con 0x7f69dc0c3f30 2023-12-24T19:57:37.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.931+0000 7f69e0c90700 1 -- 172.21.15.61:0/1697043907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69dc0c36a0 con 0x7f69dc0c3f30 2023-12-24T19:57:37.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.931+0000 7f69d27fc700 1 -- 172.21.15.61:0/1697043907 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69d4057290 con 0x7f69dc0c3f30 2023-12-24T19:57:37.933 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:57:37.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 -- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f69bc066f30 msgr2=0x7f69bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f69bc066f30 0x7f69bc0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f69c4003870 tx=0x7f69c4009040 comp rx=0 tx=0).stop 2023-12-24T19:57:37.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 -- 172.21.15.61:0/1697043907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc0c3f30 msgr2=0x7f69dc0c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:37.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc0c3f30 0x7f69dc0c5f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f69dc06cbb0 tx=0x7f69d4018000 comp rx=0 tx=0).stop 2023-12-24T19:57:37.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 -- 172.21.15.61:0/1697043907 shutdown_connections 2023-12-24T19:57:37.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f69bc066f30 0x7f69bc0693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f69dc0c3f30 0x7f69dc0c5f20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69dc070d50 0x7f69dc159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 --2- 172.21.15.61:0/1697043907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f69dc0afd60 0x7f69dc0c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:37.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 -- 172.21.15.61:0/1697043907 >> 172.21.15.61:0/1697043907 conn(0x7f69dc0ce400 msgr2=0x7f69dc06e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:37.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 -- 172.21.15.61:0/1697043907 shutdown_connections 2023-12-24T19:57:37.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:37.933+0000 7f69e0c90700 1 -- 172.21.15.61:0/1697043907 wait complete. 2023-12-24T19:57:37.946 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:57:38.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.069+0000 7f51e452e700 1 Processor -- start 2023-12-24T19:57:38.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.069+0000 7f51e452e700 1 -- start start 2023-12-24T19:57:38.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.070+0000 7f51e452e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51dc159f10 0x7f51dc164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.070+0000 7f51e452e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc15d900 con 0x7f51dc0ce030 2023-12-24T19:57:38.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.070+0000 7f51e452e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc15e480 con 0x7f51dc06b560 2023-12-24T19:57:38.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.070+0000 7f51e452e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc15e910 con 0x7f51dc159f10 2023-12-24T19:57:38.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.070+0000 7f51e22ca700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f51dc0ce030 0x7f51dc068df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46376/0 (socket says 172.21.15.61:46376) 2023-12-24T19:57:38.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.070+0000 7f51e22ca700 1 -- 172.21.15.61:0/3222006302 learned_addr learned my addr 172.21.15.61:0/3222006302 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:38.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.070+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107957447 0 0) 0x7f51dc15d900 con 0x7f51dc0ce030 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.070+0000 7f51e2acb700 1 --2- 172.21.15.61:0/3222006302 >> v2:172.21.15.133:3300/0 conn(0x7f51dc159f10 0x7f51dc164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.070+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c8003570 con 0x7f51dc0ce030 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3415127033 0 0) 0x7f51c8003570 con 0x7f51dc0ce030 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 >> v2:172.21.15.133:3300/0 conn(0x7f51dc159f10 msgr2=0x7f51dc164ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 --2- 172.21.15.61:0/3222006302 >> v2:172.21.15.133:3300/0 conn(0x7f51dc159f10 0x7f51dc164ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 >> v1:172.21.15.133:6789/0 conn(0x7f51dc06b560 legacy=0x7f51dc159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc15db50 con 0x7f51dc0ce030 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f51cc001470 con 0x7f51dc0ce030 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 >> v1:172.21.15.61:6789/0 conn(0x7f51dc0ce030 legacy=0x7f51dc068df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c8003a60 0x7f51c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51c80051c0 0x7f51c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c800c130 con 0x7f51c8004810 2023-12-24T19:57:38.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c800c2a0 con 0x7f51c8003a60 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c800c460 con 0x7f51c80051c0 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e1ac9700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e22ca700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c8003a60 0x7f51c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e2acb700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51c80051c0 0x7f51c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e1ac9700 1 -- 172.21.15.61:0/3222006302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51c80051c0 msgr2=0x7f51c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e1ac9700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51c80051c0 0x7f51c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e1ac9700 1 -- 172.21.15.61:0/3222006302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c8003a60 msgr2=0x7f51c8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e1ac9700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c8003a60 0x7f51c8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e2acb700 1 -- 172.21.15.61:0/3222006302 reap_dead start 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e1ac9700 1 -- 172.21.15.61:0/3222006302 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c8003570 con 0x7f51c8004810 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.071+0000 7f51e1ac9700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51c8004c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f51d80018b0 tx=0x7f51d8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7d9e210e3e6ec server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.072+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8012420 con 0x7f51c8004810 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.072+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d80125a0 con 0x7f51c8004810 2023-12-24T19:57:38.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.072+0000 7f51e12c8700 1 -- 172.21.15.61:0/3222006302 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8012960 con 0x7f51c8004810 2023-12-24T19:57:38.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.072+0000 7f51e452e700 1 -- 172.21.15.61:0/3222006302 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 msgr2=0x7f51c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.072+0000 7f51e452e700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51c8004c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f51d80018b0 tx=0x7f51d8007d30 comp rx=0 tx=0).stop 2023-12-24T19:57:38.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.072+0000 7f51e452e700 1 -- 172.21.15.61:0/3222006302 shutdown_connections 2023-12-24T19:57:38.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.072+0000 7f51e452e700 1 --2- 172.21.15.61:0/3222006302 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51c8004c80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.072+0000 7f51e452e700 1 -- 172.21.15.61:0/3222006302 >> 172.21.15.61:0/3222006302 conn(0x7f51dc06f810 msgr2=0x7f51dc06ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:38.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.072+0000 7f51e452e700 1 -- 172.21.15.61:0/3222006302 shutdown_connections 2023-12-24T19:57:38.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.072+0000 7f51e452e700 1 -- 172.21.15.61:0/3222006302 wait complete. 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.073+0000 7f51e452e700 1 Processor -- start 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.073+0000 7f51e452e700 1 -- start start 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e452e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51dc0677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e452e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51dc0ca950 0x7f51dc0cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e452e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51dc153cf0 0x7f51dc154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e452e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0b4450 con 0x7f51c8004810 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e452e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc16db10 con 0x7f51dc153cf0 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e452e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc16ddf0 con 0x7f51dc0ca950 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e22ca700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51dc0677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e22ca700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51dc0677a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36392/0 (socket says 172.21.15.61:36392) 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e22ca700 1 -- 172.21.15.61:0/4063672471 learned_addr learned my addr 172.21.15.61:0/4063672471 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:38.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e1ac9700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51dc0ca950 0x7f51dc0cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.074+0000 7f51e2acb700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51dc153cf0 0x7f51dc154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51e22ca700 1 -- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51dc0ca950 msgr2=0x7f51dc0cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51e22ca700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51dc0ca950 0x7f51dc0cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51e22ca700 1 -- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51dc153cf0 msgr2=0x7f51dc154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51e22ca700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51dc153cf0 0x7f51dc154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51e22ca700 1 -- 172.21.15.61:0/4063672471 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc16e0d0 con 0x7f51c8004810 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51e2acb700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51dc153cf0 0x7f51dc154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51e22ca700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51dc0677a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f51cc001050 tx=0x7f51cc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51d27fc700 1 -- 172.21.15.61:0/4063672471 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc018030 con 0x7f51c8004810 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51d27fc700 1 -- 172.21.15.61:0/4063672471 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc00f940 con 0x7f51c8004810 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51e452e700 1 -- 172.21.15.61:0/4063672471 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc16e3b0 con 0x7f51c8004810 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51d27fc700 1 -- 172.21.15.61:0/4063672471 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc00fd00 con 0x7f51c8004810 2023-12-24T19:57:38.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.075+0000 7f51e452e700 1 -- 172.21.15.61:0/4063672471 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc1546d0 con 0x7f51c8004810 2023-12-24T19:57:38.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.076+0000 7f51e452e700 1 -- 172.21.15.61:0/4063672471 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc16e850 con 0x7f51c8004810 2023-12-24T19:57:38.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.076+0000 7f51d27fc700 1 -- 172.21.15.61:0/4063672471 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f51cc01b070 con 0x7f51c8004810 2023-12-24T19:57:38.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.077+0000 7f51d27fc700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f51c0066f30 0x7f51c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.077+0000 7f51d27fc700 1 -- 172.21.15.61:0/4063672471 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51cc019070 con 0x7f51c8004810 2023-12-24T19:57:38.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.077+0000 7f51e1ac9700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f51c0066f30 0x7f51c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.077+0000 7f51e1ac9700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f51c0066f30 0x7f51c00693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f51dc068120 tx=0x7f51d8015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:38.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.081+0000 7f51d27fc700 1 -- 172.21.15.61:0/4063672471 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51cc051820 con 0x7f51c8004810 2023-12-24T19:57:38.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.276+0000 7f51e452e700 1 -- 172.21.15.61:0/4063672471 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51dc04c3c0 con 0x7f51c8004810 2023-12-24T19:57:38.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.276+0000 7f51d27fc700 1 -- 172.21.15.61:0/4063672471 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51cc054e40 con 0x7f51c8004810 2023-12-24T19:57:38.278 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T19:57:38.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 -- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f51c0066f30 msgr2=0x7f51c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f51c0066f30 0x7f51c00693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f51dc068120 tx=0x7f51d8015000 comp rx=0 tx=0).stop 2023-12-24T19:57:38.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 -- 172.21.15.61:0/4063672471 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 msgr2=0x7f51dc0677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51dc0677a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f51cc001050 tx=0x7f51cc001e50 comp rx=0 tx=0).stop 2023-12-24T19:57:38.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 -- 172.21.15.61:0/4063672471 shutdown_connections 2023-12-24T19:57:38.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f51c0066f30 0x7f51c00693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51dc153cf0 0x7f51dc154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51c8004810 0x7f51dc0677a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 --2- 172.21.15.61:0/4063672471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51dc0ca950 0x7f51dc0cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 -- 172.21.15.61:0/4063672471 >> 172.21.15.61:0/4063672471 conn(0x7f51dc06f810 msgr2=0x7f51dc0cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:38.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 -- 172.21.15.61:0/4063672471 shutdown_connections 2023-12-24T19:57:38.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.278+0000 7f51e452e700 1 -- 172.21.15.61:0/4063672471 wait complete. 2023-12-24T19:57:38.291 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:57:38.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.415+0000 7f814fc73700 1 Processor -- start 2023-12-24T19:57:38.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.415+0000 7f814fc73700 1 -- start start 2023-12-24T19:57:38.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814fc73700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f81480c3500 0x7f81480c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814fc73700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480c8690 con 0x7f8148156830 2023-12-24T19:57:38.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814fc73700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8148069f00 con 0x7f8148156c00 2023-12-24T19:57:38.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814fc73700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814806a1e0 con 0x7f81480c3500 2023-12-24T19:57:38.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814e210700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f81480c3500 0x7f81480c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814da0f700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8148156830 0x7f81480c2df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46384/0 (socket says 172.21.15.61:46384) 2023-12-24T19:57:38.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814da0f700 1 -- 172.21.15.61:0/889024146 learned_addr learned my addr 172.21.15.61:0/889024146 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:38.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814e210700 1 -- 172.21.15.61:0/889024146 >> v1:172.21.15.133:6789/0 conn(0x7f8148156c00 legacy=0x7f81480c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:38.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814e210700 1 -- 172.21.15.61:0/889024146 >> v1:172.21.15.61:6789/0 conn(0x7f8148156830 legacy=0x7f81480c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814e210700 1 -- 172.21.15.61:0/889024146 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814806a4c0 con 0x7f81480c3500 2023-12-24T19:57:38.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.416+0000 7f814e210700 1 --2- 172.21.15.61:0/889024146 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81480c3500 0x7f81480c9230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8140009e60 tx=0x7f8140009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67c4aa23a223762 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:38.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.417+0000 7f814ca0d700 1 -- 172.21.15.61:0/889024146 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000e070 con 0x7f81480c3500 2023-12-24T19:57:38.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.417+0000 7f814ca0d700 1 -- 172.21.15.61:0/889024146 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814000bc30 con 0x7f81480c3500 2023-12-24T19:57:38.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.417+0000 7f814ca0d700 1 -- 172.21.15.61:0/889024146 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140012430 con 0x7f81480c3500 2023-12-24T19:57:38.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.417+0000 7f814fc73700 1 -- 172.21.15.61:0/889024146 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81480c3500 msgr2=0x7f81480c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.417+0000 7f814fc73700 1 --2- 172.21.15.61:0/889024146 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81480c3500 0x7f81480c9230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8140009e60 tx=0x7f8140009780 comp rx=0 tx=0).stop 2023-12-24T19:57:38.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.417+0000 7f814fc73700 1 -- 172.21.15.61:0/889024146 shutdown_connections 2023-12-24T19:57:38.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.417+0000 7f814fc73700 1 --2- 172.21.15.61:0/889024146 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81480c3500 0x7f81480c9230 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.417+0000 7f814fc73700 1 -- 172.21.15.61:0/889024146 >> 172.21.15.61:0/889024146 conn(0x7f81480ce1f0 msgr2=0x7f81480ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:38.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.417+0000 7f814fc73700 1 -- 172.21.15.61:0/889024146 shutdown_connections 2023-12-24T19:57:38.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.417+0000 7f814fc73700 1 -- 172.21.15.61:0/889024146 wait complete. 2023-12-24T19:57:38.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.418+0000 7f814fc73700 1 Processor -- start 2023-12-24T19:57:38.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.418+0000 7f814fc73700 1 -- start start 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814fc73700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81480c3500 0x7f8148158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814fc73700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8148156830 0x7f8148146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814fc73700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8148156c00 0x7f8148157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814fc73700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148158710 con 0x7f8148156830 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814fc73700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148157b00 con 0x7f8148156c00 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814fc73700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8148157de0 con 0x7f81480c3500 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814d20e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8148156830 0x7f8148146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814d20e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8148156830 0x7f8148146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36416/0 (socket says 172.21.15.61:36416) 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814d20e700 1 -- 172.21.15.61:0/851892547 learned_addr learned my addr 172.21.15.61:0/851892547 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814d20e700 1 -- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81480c3500 msgr2=0x7f8148158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814d20e700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81480c3500 0x7f8148158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814d20e700 1 -- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8148156c00 msgr2=0x7f8148157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814d20e700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8148156c00 0x7f8148157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.419+0000 7f814d20e700 1 -- 172.21.15.61:0/851892547 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140009a20 con 0x7f8148156830 2023-12-24T19:57:38.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.420+0000 7f814d20e700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8148156830 0x7f8148146010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f813800c5b0 tx=0x7f81380020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:38.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.420+0000 7f813dffb700 1 -- 172.21.15.61:0/851892547 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138011590 con 0x7f8148156830 2023-12-24T19:57:38.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.420+0000 7f813dffb700 1 -- 172.21.15.61:0/851892547 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81380116f0 con 0x7f8148156830 2023-12-24T19:57:38.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.420+0000 7f814fc73700 1 -- 172.21.15.61:0/851892547 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81481580c0 con 0x7f8148156830 2023-12-24T19:57:38.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.420+0000 7f813dffb700 1 -- 172.21.15.61:0/851892547 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138011a90 con 0x7f8148156830 2023-12-24T19:57:38.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.420+0000 7f814fc73700 1 -- 172.21.15.61:0/851892547 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8148152740 con 0x7f8148156830 2023-12-24T19:57:38.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.421+0000 7f814fc73700 1 -- 172.21.15.61:0/851892547 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81480cd510 con 0x7f8148156830 2023-12-24T19:57:38.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.421+0000 7f813dffb700 1 -- 172.21.15.61:0/851892547 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8138012420 con 0x7f8148156830 2023-12-24T19:57:38.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.422+0000 7f813dffb700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f812c066f30 0x7f812c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.422+0000 7f813dffb700 1 -- 172.21.15.61:0/851892547 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8138083fc0 con 0x7f8148156830 2023-12-24T19:57:38.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.422+0000 7f814da0f700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f812c066f30 0x7f812c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.422+0000 7f814da0f700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f812c066f30 0x7f812c0693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f81440016a0 tx=0x7f8144007b30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:38.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.426+0000 7f813dffb700 1 -- 172.21.15.61:0/851892547 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8138051230 con 0x7f8148156830 2023-12-24T19:57:38.624 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.622+0000 7f814fc73700 1 -- 172.21.15.61:0/851892547 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f814806ad80 con 0x7f8148156830 2023-12-24T19:57:38.624 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.623+0000 7f813dffb700 1 -- 172.21.15.61:0/851892547 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8138054850 con 0x7f8148156830 2023-12-24T19:57:38.624 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T19:57:38.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 -- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f812c066f30 msgr2=0x7f812c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f812c066f30 0x7f812c0693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f81440016a0 tx=0x7f8144007b30 comp rx=0 tx=0).stop 2023-12-24T19:57:38.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 -- 172.21.15.61:0/851892547 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8148156830 msgr2=0x7f8148146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8148156830 0x7f8148146010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f813800c5b0 tx=0x7f81380020e0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 -- 172.21.15.61:0/851892547 shutdown_connections 2023-12-24T19:57:38.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81480c3500 0x7f8148158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f812c066f30 0x7f812c0693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8148156c00 0x7f8148157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 --2- 172.21.15.61:0/851892547 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8148156830 0x7f8148146010 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 -- 172.21.15.61:0/851892547 >> 172.21.15.61:0/851892547 conn(0x7f81480ce1f0 msgr2=0x7f81480c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:38.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 -- 172.21.15.61:0/851892547 shutdown_connections 2023-12-24T19:57:38.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.625+0000 7f814fc73700 1 -- 172.21.15.61:0/851892547 wait complete. 2023-12-24T19:57:38.638 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:38.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.759+0000 7fd8a3312700 1 Processor -- start 2023-12-24T19:57:38.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.759+0000 7fd8a3312700 1 -- start start 2023-12-24T19:57:38.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.760+0000 7fd8a3312700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd89c15acf0 0x7fd89c0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.760+0000 7fd8a3312700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0687f0 con 0x7fd89c0af710 2023-12-24T19:57:38.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.760+0000 7fd8a3312700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c067be0 con 0x7fd89c068c80 2023-12-24T19:57:38.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.760+0000 7fd8a3312700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c067ec0 con 0x7fd89c15acf0 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.760+0000 7fd8a10ae700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd89c0af710 0x7fd89c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46398/0 (socket says 172.21.15.61:46398) 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.760+0000 7fd8a18af700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd89c15acf0 0x7fd89c0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.760+0000 7fd8a10ae700 1 -- 172.21.15.61:0/2670347232 learned_addr learned my addr 172.21.15.61:0/2670347232 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.761+0000 7fd8a18af700 1 -- 172.21.15.61:0/2670347232 >> v1:172.21.15.133:6789/0 conn(0x7fd89c068c80 legacy=0x7fd89c0ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.761+0000 7fd8a18af700 1 -- 172.21.15.61:0/2670347232 >> v1:172.21.15.61:6789/0 conn(0x7fd89c0af710 legacy=0x7fd89c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.761+0000 7fd893fff700 1 -- 172.21.15.61:0/2670347232 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621737597 0 0) 0x7fd89c0687f0 con 0x7fd89c0af710 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.761+0000 7fd8a18af700 1 -- 172.21.15.61:0/2670347232 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0681a0 con 0x7fd89c15acf0 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.761+0000 7fd8a18af700 1 --2- 172.21.15.61:0/2670347232 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c15acf0 0x7fd89c0afae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd894009e60 tx=0x7fd894009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cea4f5ac25f98b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.761+0000 7fd893fff700 1 -- 172.21.15.61:0/2670347232 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400e070 con 0x7fd89c15acf0 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.761+0000 7fd893fff700 1 -- 172.21.15.61:0/2670347232 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89400bc30 con 0x7fd89c15acf0 2023-12-24T19:57:38.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.761+0000 7fd893fff700 1 -- 172.21.15.61:0/2670347232 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894012430 con 0x7fd89c15acf0 2023-12-24T19:57:38.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.762+0000 7fd8a3312700 1 -- 172.21.15.61:0/2670347232 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c15acf0 msgr2=0x7fd89c0afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.762+0000 7fd8a3312700 1 --2- 172.21.15.61:0/2670347232 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c15acf0 0x7fd89c0afae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd894009e60 tx=0x7fd894009780 comp rx=0 tx=0).stop 2023-12-24T19:57:38.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.762+0000 7fd8a3312700 1 -- 172.21.15.61:0/2670347232 shutdown_connections 2023-12-24T19:57:38.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.762+0000 7fd8a3312700 1 --2- 172.21.15.61:0/2670347232 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c15acf0 0x7fd89c0afae0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.762+0000 7fd8a3312700 1 -- 172.21.15.61:0/2670347232 >> 172.21.15.61:0/2670347232 conn(0x7fd89c0ca200 msgr2=0x7fd89c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:38.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.762+0000 7fd8a3312700 1 -- 172.21.15.61:0/2670347232 shutdown_connections 2023-12-24T19:57:38.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.762+0000 7fd8a3312700 1 -- 172.21.15.61:0/2670347232 wait complete. 2023-12-24T19:57:38.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.763+0000 7fd8a3312700 1 Processor -- start 2023-12-24T19:57:38.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.763+0000 7fd8a3312700 1 -- start start 2023-12-24T19:57:38.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a3312700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c068c80 0x7fd89c157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a3312700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd89c0af710 0x7fd89c155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a3312700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c15acf0 0x7fd89c155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a3312700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c143bb0 con 0x7fd89c068c80 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a3312700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c142fa0 con 0x7fd89c15acf0 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a3312700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c143280 con 0x7fd89c0af710 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a10ae700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c068c80 0x7fd89c157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a10ae700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c068c80 0x7fd89c157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36430/0 (socket says 172.21.15.61:36430) 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a10ae700 1 -- 172.21.15.61:0/2831968061 learned_addr learned my addr 172.21.15.61:0/2831968061 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a10ae700 1 -- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd89c0af710 msgr2=0x7fd89c155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a10ae700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd89c0af710 0x7fd89c155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a10ae700 1 -- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c15acf0 msgr2=0x7fd89c155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a10ae700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c15acf0 0x7fd89c155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a10ae700 1 -- 172.21.15.61:0/2831968061 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894009a20 con 0x7fd89c068c80 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a10ae700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c068c80 0x7fd89c157530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00c5b0 tx=0x7fd88c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8917fa700 1 -- 172.21.15.61:0/2831968061 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c005b30 con 0x7fd89c068c80 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8917fa700 1 -- 172.21.15.61:0/2831968061 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c005c90 con 0x7fd89c068c80 2023-12-24T19:57:38.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8a3312700 1 -- 172.21.15.61:0/2831968061 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c143560 con 0x7fd89c068c80 2023-12-24T19:57:38.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.764+0000 7fd8917fa700 1 -- 172.21.15.61:0/2831968061 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c007320 con 0x7fd89c068c80 2023-12-24T19:57:38.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.765+0000 7fd8a3312700 1 -- 172.21.15.61:0/2831968061 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c142a30 con 0x7fd89c068c80 2023-12-24T19:57:38.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.766+0000 7fd8a3312700 1 -- 172.21.15.61:0/2831968061 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c142d10 con 0x7fd89c068c80 2023-12-24T19:57:38.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.766+0000 7fd8917fa700 1 -- 172.21.15.61:0/2831968061 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd88c01b400 con 0x7fd89c068c80 2023-12-24T19:57:38.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.766+0000 7fd8917fa700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd880066f30 0x7fd8800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:38.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.766+0000 7fd8917fa700 1 -- 172.21.15.61:0/2831968061 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd88c084010 con 0x7fd89c068c80 2023-12-24T19:57:38.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.767+0000 7fd8a08ad700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd880066f30 0x7fd8800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:38.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.767+0000 7fd8a08ad700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd880066f30 0x7fd8800693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd898007fd0 tx=0x7fd898007b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:38.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.771+0000 7fd8917fa700 1 -- 172.21.15.61:0/2831968061 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd88c051300 con 0x7fd89c068c80 2023-12-24T19:57:38.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.965+0000 7fd8a3312700 1 -- 172.21.15.61:0/2831968061 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd89c04c3c0 con 0x7fd89c068c80 2023-12-24T19:57:38.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.966+0000 7fd8917fa700 1 -- 172.21.15.61:0/2831968061 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd88c054920 con 0x7fd89c068c80 2023-12-24T19:57:38.968 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:38.968 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:38.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 -- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd880066f30 msgr2=0x7fd8800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd880066f30 0x7fd8800693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd898007fd0 tx=0x7fd898007b20 comp rx=0 tx=0).stop 2023-12-24T19:57:38.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 -- 172.21.15.61:0/2831968061 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c068c80 msgr2=0x7fd89c157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:38.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c068c80 0x7fd89c157530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00c5b0 tx=0x7fd88c001070 comp rx=0 tx=0).stop 2023-12-24T19:57:38.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 -- 172.21.15.61:0/2831968061 shutdown_connections 2023-12-24T19:57:38.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd880066f30 0x7fd8800693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c15acf0 0x7fd89c155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c068c80 0x7fd89c157530 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 --2- 172.21.15.61:0/2831968061 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd89c0af710 0x7fd89c155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:38.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 -- 172.21.15.61:0/2831968061 >> 172.21.15.61:0/2831968061 conn(0x7fd89c0ca200 msgr2=0x7fd89c0cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:38.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 -- 172.21.15.61:0/2831968061 shutdown_connections 2023-12-24T19:57:38.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:38.968+0000 7fd8a3312700 1 -- 172.21.15.61:0/2831968061 wait complete. 2023-12-24T19:57:38.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:57:04.595282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:57:05.898273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:57:38.982 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:57:39.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.105+0000 7fe150f23700 1 Processor -- start 2023-12-24T19:57:39.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.105+0000 7fe150f23700 1 -- start start 2023-12-24T19:57:39.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe150f23700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe14c0af7b0 0x7fe14c070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe150f23700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c070b80 0x7fe14c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe150f23700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c0b03a0 con 0x7fe14c157b70 2023-12-24T19:57:39.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe150f23700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c15bcb0 con 0x7fe14c0af7b0 2023-12-24T19:57:39.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe150f23700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c070fc0 con 0x7fe14c070b80 2023-12-24T19:57:39.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe149d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe14c0af7b0 0x7fe14c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe149d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe14c0af7b0 0x7fe14c070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36444/0 (socket says 172.21.15.61:36444) 2023-12-24T19:57:39.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe149d9b700 1 -- 172.21.15.61:0/3933232379 learned_addr learned my addr 172.21.15.61:0/3933232379 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:39.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe14ad9d700 1 --2- 172.21.15.61:0/3933232379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c070b80 0x7fe14c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe149d9b700 1 -- 172.21.15.61:0/3933232379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c070b80 msgr2=0x7fe14c067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe149d9b700 1 --2- 172.21.15.61:0/3933232379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c070b80 0x7fe14c067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe149d9b700 1 -- 172.21.15.61:0/3933232379 >> v1:172.21.15.133:6789/0 conn(0x7fe14c157b70 legacy=0x7fe14c068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.106+0000 7fe149d9b700 1 -- 172.21.15.61:0/3933232379 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0afde0 con 0x7fe14c0af7b0 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe149d9b700 1 --2- 172.21.15.61:0/3933232379 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 0x7fe14c070640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0099b0 tx=0x7fe13c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54c3093e4e59488 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe14959a700 1 -- 172.21.15.61:0/3933232379 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00b820 con 0x7fe14c0af7b0 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe14959a700 1 -- 172.21.15.61:0/3933232379 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c00b980 con 0x7fe14c0af7b0 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe14959a700 1 -- 172.21.15.61:0/3933232379 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00bd40 con 0x7fe14c0af7b0 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe150f23700 1 -- 172.21.15.61:0/3933232379 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 msgr2=0x7fe14c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe150f23700 1 --2- 172.21.15.61:0/3933232379 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 0x7fe14c070640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0099b0 tx=0x7fe13c009250 comp rx=0 tx=0).stop 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe150f23700 1 -- 172.21.15.61:0/3933232379 shutdown_connections 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe150f23700 1 --2- 172.21.15.61:0/3933232379 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c070b80 0x7fe14c067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe150f23700 1 --2- 172.21.15.61:0/3933232379 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 0x7fe14c070640 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe150f23700 1 -- 172.21.15.61:0/3933232379 >> 172.21.15.61:0/3933232379 conn(0x7fe14c0ce420 msgr2=0x7fe14c0ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:39.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe150f23700 1 -- 172.21.15.61:0/3933232379 shutdown_connections 2023-12-24T19:57:39.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.107+0000 7fe150f23700 1 -- 172.21.15.61:0/3933232379 wait complete. 2023-12-24T19:57:39.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe150f23700 1 Processor -- start 2023-12-24T19:57:39.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe150f23700 1 -- start start 2023-12-24T19:57:39.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe150f23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe14c070b80 0x7fe14c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe150f23700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 0x7fe14c1520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe150f23700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c157b70 0x7fe14c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe150f23700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c13df00 con 0x7fe14c0af7b0 2023-12-24T19:57:39.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe150f23700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0c62b0 con 0x7fe14c070b80 2023-12-24T19:57:39.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe150f23700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b3750 con 0x7fe14c157b70 2023-12-24T19:57:39.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe149d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 0x7fe14c1520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe149d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 0x7fe14c1520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36448/0 (socket says 172.21.15.61:36448) 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.109+0000 7fe149d9b700 1 -- 172.21.15.61:0/1434845950 learned_addr learned my addr 172.21.15.61:0/1434845950 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe14ad9d700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c157b70 0x7fe14c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe14a59c700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe14c070b80 0x7fe14c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe149d9b700 1 -- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c157b70 msgr2=0x7fe14c1525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe149d9b700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c157b70 0x7fe14c1525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe149d9b700 1 -- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe14c070b80 msgr2=0x7fe14c156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe149d9b700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe14c070b80 0x7fe14c156d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe149d9b700 1 -- 172.21.15.61:0/1434845950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0094f0 con 0x7fe14c0af7b0 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe149d9b700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 0x7fe14c1520b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe14c06d260 tx=0x7fe13c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe13a7fc700 1 -- 172.21.15.61:0/1434845950 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00b820 con 0x7fe14c0af7b0 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe13a7fc700 1 -- 172.21.15.61:0/1434845950 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c020070 con 0x7fe14c0af7b0 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe150f23700 1 -- 172.21.15.61:0/1434845950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c0c5980 con 0x7fe14c0af7b0 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe13a7fc700 1 -- 172.21.15.61:0/1434845950 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c011e50 con 0x7fe14c0af7b0 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.110+0000 7fe150f23700 1 -- 172.21.15.61:0/1434845950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c0c5f40 con 0x7fe14c0af7b0 2023-12-24T19:57:39.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.111+0000 7fe150f23700 1 -- 172.21.15.61:0/1434845950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c0c6440 con 0x7fe14c0af7b0 2023-12-24T19:57:39.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.111+0000 7fe13a7fc700 1 -- 172.21.15.61:0/1434845950 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe13c022030 con 0x7fe14c0af7b0 2023-12-24T19:57:39.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.112+0000 7fe13a7fc700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe12c066f30 0x7fe12c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.112+0000 7fe13a7fc700 1 -- 172.21.15.61:0/1434845950 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe13c086350 con 0x7fe14c0af7b0 2023-12-24T19:57:39.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.112+0000 7fe14a59c700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe12c066f30 0x7fe12c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.112+0000 7fe14a59c700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe12c066f30 0x7fe12c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe140003870 tx=0x7fe140009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:39.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.116+0000 7fe13a7fc700 1 -- 172.21.15.61:0/1434845950 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe13c0535c0 con 0x7fe14c0af7b0 2023-12-24T19:57:39.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.307+0000 7fe150f23700 1 -- 172.21.15.61:0/1434845950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe14c04c3c0 con 0x7fe14c0af7b0 2023-12-24T19:57:39.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.307+0000 7fe13a7fc700 1 -- 172.21.15.61:0/1434845950 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe13c056be0 con 0x7fe14c0af7b0 2023-12-24T19:57:39.309 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:57:39.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 -- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe12c066f30 msgr2=0x7fe12c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe12c066f30 0x7fe12c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe140003870 tx=0x7fe140009040 comp rx=0 tx=0).stop 2023-12-24T19:57:39.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 -- 172.21.15.61:0/1434845950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 msgr2=0x7fe14c1520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 0x7fe14c1520b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe14c06d260 tx=0x7fe13c016000 comp rx=0 tx=0).stop 2023-12-24T19:57:39.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 -- 172.21.15.61:0/1434845950 shutdown_connections 2023-12-24T19:57:39.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe14c157b70 0x7fe14c1525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe12c066f30 0x7fe12c0693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe14c070b80 0x7fe14c156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 --2- 172.21.15.61:0/1434845950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe14c0af7b0 0x7fe14c1520b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 -- 172.21.15.61:0/1434845950 >> 172.21.15.61:0/1434845950 conn(0x7fe14c0ce420 msgr2=0x7fe14c1589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:39.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 -- 172.21.15.61:0/1434845950 shutdown_connections 2023-12-24T19:57:39.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.309+0000 7fe150f23700 1 -- 172.21.15.61:0/1434845950 wait complete. 2023-12-24T19:57:39.322 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:57:39.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.446+0000 7fed4d9ca700 1 Processor -- start 2023-12-24T19:57:39.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.446+0000 7fed4d9ca700 1 -- start start 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed4d9ca700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fed481598d0 0x7fed480b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed4d9ca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed4806e280 0x7fed480cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed4d9ca700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480cbf80 con 0x7fed48159ca0 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed4d9ca700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4815a110 con 0x7fed481598d0 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed4d9ca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed480b11c0 con 0x7fed4806e280 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed46ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fed481598d0 0x7fed480b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed46ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fed481598d0 0x7fed480b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36450/0 (socket says 172.21.15.61:36450) 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed46ffd700 1 -- 172.21.15.61:0/2684147566 learned_addr learned my addr 172.21.15.61:0/2684147566 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed477fe700 1 --2- 172.21.15.61:0/2684147566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed4806e280 0x7fed480cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed46ffd700 1 -- 172.21.15.61:0/2684147566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed4806e280 msgr2=0x7fed480cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:39.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed46ffd700 1 --2- 172.21.15.61:0/2684147566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed4806e280 0x7fed480cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed46ffd700 1 -- 172.21.15.61:0/2684147566 >> v1:172.21.15.133:6789/0 conn(0x7fed48159ca0 legacy=0x7fed4806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed46ffd700 1 -- 172.21.15.61:0/2684147566 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480b14a0 con 0x7fed481598d0 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.447+0000 7fed46ffd700 1 --2- 172.21.15.61:0/2684147566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed481598d0 0x7fed480b2aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0099b0 tx=0x7fed3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a21e62f26979729 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed45ffb700 1 -- 172.21.15.61:0/2684147566 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c009ea0 con 0x7fed481598d0 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed45ffb700 1 -- 172.21.15.61:0/2684147566 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c00b860 con 0x7fed481598d0 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed45ffb700 1 -- 172.21.15.61:0/2684147566 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00bc00 con 0x7fed481598d0 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed4d9ca700 1 -- 172.21.15.61:0/2684147566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed481598d0 msgr2=0x7fed480b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed4d9ca700 1 --2- 172.21.15.61:0/2684147566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed481598d0 0x7fed480b2aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0099b0 tx=0x7fed3c009250 comp rx=0 tx=0).stop 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed4d9ca700 1 -- 172.21.15.61:0/2684147566 shutdown_connections 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed4d9ca700 1 --2- 172.21.15.61:0/2684147566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed4806e280 0x7fed480cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed4d9ca700 1 --2- 172.21.15.61:0/2684147566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed481598d0 0x7fed480b2aa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed4d9ca700 1 -- 172.21.15.61:0/2684147566 >> 172.21.15.61:0/2684147566 conn(0x7fed48067550 msgr2=0x7fed48067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed4d9ca700 1 -- 172.21.15.61:0/2684147566 shutdown_connections 2023-12-24T19:57:39.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.448+0000 7fed4d9ca700 1 -- 172.21.15.61:0/2684147566 wait complete. 2023-12-24T19:57:39.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.450+0000 7fed4d9ca700 1 Processor -- start 2023-12-24T19:57:39.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.450+0000 7fed4d9ca700 1 -- start start 2023-12-24T19:57:39.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.450+0000 7fed4d9ca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed4806e280 0x7fed4815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.450+0000 7fed4d9ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed481598d0 0x7fed48067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.450+0000 7fed4d9ca700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed48159ca0 0x7fed48067e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.450+0000 7fed4d9ca700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4815c310 con 0x7fed48159ca0 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.450+0000 7fed4d9ca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4815c5f0 con 0x7fed481598d0 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.450+0000 7fed4d9ca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4815c8d0 con 0x7fed4806e280 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.450+0000 7fed477fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed48159ca0 0x7fed48067e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed477fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed48159ca0 0x7fed48067e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36452/0 (socket says 172.21.15.61:36452) 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed477fe700 1 -- 172.21.15.61:0/198350999 learned_addr learned my addr 172.21.15.61:0/198350999 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed46ffd700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed4806e280 0x7fed4815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed467fc700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed481598d0 0x7fed48067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed477fe700 1 -- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed4806e280 msgr2=0x7fed4815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed477fe700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed4806e280 0x7fed4815d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed477fe700 1 -- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed481598d0 msgr2=0x7fed48067920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed477fe700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed481598d0 0x7fed48067920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed477fe700 1 -- 172.21.15.61:0/198350999 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c0094f0 con 0x7fed48159ca0 2023-12-24T19:57:39.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed467fc700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed481598d0 0x7fed48067920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed477fe700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed48159ca0 0x7fed48067e60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fed40009df0 tx=0x7fed4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed2effd700 1 -- 172.21.15.61:0/198350999 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4000cb50 con 0x7fed48159ca0 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed2effd700 1 -- 172.21.15.61:0/198350999 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4000f040 con 0x7fed48159ca0 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed4d9ca700 1 -- 172.21.15.61:0/198350999 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4815cbb0 con 0x7fed48159ca0 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed2effd700 1 -- 172.21.15.61:0/198350999 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40014480 con 0x7fed48159ca0 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.451+0000 7fed4d9ca700 1 -- 172.21.15.61:0/198350999 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4815bfc0 con 0x7fed48159ca0 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.452+0000 7fed4d9ca700 1 -- 172.21.15.61:0/198350999 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed48089120 con 0x7fed48159ca0 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.453+0000 7fed2effd700 1 -- 172.21.15.61:0/198350999 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fed40014830 con 0x7fed48159ca0 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.453+0000 7fed2effd700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.453+0000 7fed2effd700 1 -- 172.21.15.61:0/198350999 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed40084eb0 con 0x7fed48159ca0 2023-12-24T19:57:39.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.453+0000 7fed46ffd700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.454+0000 7fed46ffd700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed34066f30 0x7fed340693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0099b0 tx=0x7fed3c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:39.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.457+0000 7fed2effd700 1 -- 172.21.15.61:0/198350999 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed40052120 con 0x7fed48159ca0 2023-12-24T19:57:39.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.655+0000 7fed4d9ca700 1 -- 172.21.15.61:0/198350999 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed4815d0d0 con 0x7fed48159ca0 2023-12-24T19:57:39.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.656+0000 7fed2effd700 1 -- 172.21.15.61:0/198350999 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed4815d0d0 con 0x7fed48159ca0 2023-12-24T19:57:39.657 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T19:57:39.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 -- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed34066f30 msgr2=0x7fed340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed34066f30 0x7fed340693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0099b0 tx=0x7fed3c017000 comp rx=0 tx=0).stop 2023-12-24T19:57:39.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 -- 172.21.15.61:0/198350999 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed48159ca0 msgr2=0x7fed48067e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed48159ca0 0x7fed48067e60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fed40009df0 tx=0x7fed4000b040 comp rx=0 tx=0).stop 2023-12-24T19:57:39.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 -- 172.21.15.61:0/198350999 shutdown_connections 2023-12-24T19:57:39.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed4806e280 0x7fed4815d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed48159ca0 0x7fed48067e60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 --2- 172.21.15.61:0/198350999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed481598d0 0x7fed48067920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 -- 172.21.15.61:0/198350999 >> 172.21.15.61:0/198350999 conn(0x7fed48067550 msgr2=0x7fed480b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:39.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 -- 172.21.15.61:0/198350999 shutdown_connections 2023-12-24T19:57:39.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.658+0000 7fed4d9ca700 1 -- 172.21.15.61:0/198350999 wait complete. 2023-12-24T19:57:39.671 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:57:39.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.794+0000 7f8ce2cba700 1 Processor -- start 2023-12-24T19:57:39.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.794+0000 7f8ce2cba700 1 -- start start 2023-12-24T19:57:39.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.795+0000 7f8ce2cba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8cdc157820 0x7f8cdc0cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.795+0000 7f8ce2cba700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8cdc0aa880 0x7f8cdc0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.795+0000 7f8ce2cba700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cdc15b0b0 con 0x7f8cdc069610 2023-12-24T19:57:39.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.795+0000 7f8ce2cba700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc15a290 con 0x7f8cdc0aa880 2023-12-24T19:57:39.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.795+0000 7f8ce2cba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc15a4a0 con 0x7f8cdc157820 2023-12-24T19:57:39.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.795+0000 7f8cdbfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8cdc0aa880 0x7f8cdc0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.795+0000 7f8ce1257700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8cdc069610 0x7f8cdc069a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46412/0 (socket says 172.21.15.61:46412) 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.795+0000 7f8ce1257700 1 -- 172.21.15.61:0/3300199712 learned_addr learned my addr 172.21.15.61:0/3300199712 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8ce0a56700 1 --2- 172.21.15.61:0/3300199712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8cdc157820 0x7f8cdc0cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8cdbfff700 1 -- 172.21.15.61:0/3300199712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8cdc157820 msgr2=0x7f8cdc0cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8cdbfff700 1 --2- 172.21.15.61:0/3300199712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8cdc157820 0x7f8cdc0cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8cdbfff700 1 -- 172.21.15.61:0/3300199712 >> v1:172.21.15.61:6789/0 conn(0x7f8cdc069610 legacy=0x7f8cdc069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8cdbfff700 1 -- 172.21.15.61:0/3300199712 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0ab230 con 0x7f8cdc0aa880 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8cdb7fe700 1 -- 172.21.15.61:0/3300199712 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259177403 0 0) 0x7f8cdc15b0b0 con 0x7f8cdc069610 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8ce0a56700 1 --2- 172.21.15.61:0/3300199712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8cdc157820 0x7f8cdc0cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8cdbfff700 1 --2- 172.21.15.61:0/3300199712 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc0aa880 0x7f8cdc0aacf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80098e0 tx=0x7f8cc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1be3d3e3a7117f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8cdb7fe700 1 -- 172.21.15.61:0/3300199712 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8009e80 con 0x7f8cdc0aa880 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8cdb7fe700 1 -- 172.21.15.61:0/3300199712 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc800b860 con 0x7f8cdc0aa880 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.796+0000 7f8cdb7fe700 1 -- 172.21.15.61:0/3300199712 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800bbe0 con 0x7f8cdc0aa880 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.797+0000 7f8ce2cba700 1 -- 172.21.15.61:0/3300199712 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc0aa880 msgr2=0x7f8cdc0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.797+0000 7f8ce2cba700 1 --2- 172.21.15.61:0/3300199712 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc0aa880 0x7f8cdc0aacf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80098e0 tx=0x7f8cc80091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.797+0000 7f8ce2cba700 1 -- 172.21.15.61:0/3300199712 shutdown_connections 2023-12-24T19:57:39.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.797+0000 7f8ce2cba700 1 --2- 172.21.15.61:0/3300199712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8cdc157820 0x7f8cdc0cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.797+0000 7f8ce2cba700 1 --2- 172.21.15.61:0/3300199712 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc0aa880 0x7f8cdc0aacf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.797+0000 7f8ce2cba700 1 -- 172.21.15.61:0/3300199712 >> 172.21.15.61:0/3300199712 conn(0x7f8cdc068020 msgr2=0x7f8cdc0cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:39.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.797+0000 7f8ce2cba700 1 -- 172.21.15.61:0/3300199712 shutdown_connections 2023-12-24T19:57:39.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.797+0000 7f8ce2cba700 1 -- 172.21.15.61:0/3300199712 wait complete. 2023-12-24T19:57:39.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.798+0000 7f8ce2cba700 1 Processor -- start 2023-12-24T19:57:39.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.798+0000 7f8ce2cba700 1 -- start start 2023-12-24T19:57:39.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce2cba700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc069610 0x7f8cdc14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce2cba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc0aa880 0x7f8cdc0c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce2cba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8cdc157820 0x7f8cdc0afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce2cba700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc15e040 con 0x7f8cdc069610 2023-12-24T19:57:39.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce2cba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc154630 con 0x7f8cdc0aa880 2023-12-24T19:57:39.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce2cba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc1500c0 con 0x7f8cdc157820 2023-12-24T19:57:39.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce0a56700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc069610 0x7f8cdc14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce0a56700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc069610 0x7f8cdc14fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36460/0 (socket says 172.21.15.61:36460) 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce0a56700 1 -- 172.21.15.61:0/447833217 learned_addr learned my addr 172.21.15.61:0/447833217 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce0a56700 1 -- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8cdc157820 msgr2=0x7f8cdc0afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce0a56700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8cdc157820 0x7f8cdc0afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce0a56700 1 -- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc0aa880 msgr2=0x7f8cdc0c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce0a56700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc0aa880 0x7f8cdc0c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce0a56700 1 -- 172.21.15.61:0/447833217 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8009420 con 0x7f8cdc069610 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce0a56700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc069610 0x7f8cdc14fb80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000d860 tx=0x7f8cd0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8cd8ff9700 1 -- 172.21.15.61:0/447833217 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000b630 con 0x7f8cdc069610 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8cd8ff9700 1 -- 172.21.15.61:0/447833217 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd000b790 con 0x7f8cdc069610 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce2cba700 1 -- 172.21.15.61:0/447833217 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cdc15e220 con 0x7f8cdc069610 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8cd8ff9700 1 -- 172.21.15.61:0/447833217 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd000bb10 con 0x7f8cdc069610 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce2cba700 1 -- 172.21.15.61:0/447833217 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc153e10 con 0x7f8cdc069610 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.800+0000 7f8ce2cba700 1 -- 172.21.15.61:0/447833217 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc04c3c0 con 0x7f8cdc069610 2023-12-24T19:57:39.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.801+0000 7f8cd8ff9700 1 -- 172.21.15.61:0/447833217 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8cd0014430 con 0x7f8cdc069610 2023-12-24T19:57:39.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.801+0000 7f8cd8ff9700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8cc0066f30 0x7f8cc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:39.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.801+0000 7f8cd8ff9700 1 -- 172.21.15.61:0/447833217 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8cd0084a40 con 0x7f8cdc069610 2023-12-24T19:57:39.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.801+0000 7f8cdbfff700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8cc0066f30 0x7f8cc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:39.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.802+0000 7f8cdbfff700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8cc0066f30 0x7f8cc00693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0c7f20 tx=0x7f8cc8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:39.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:39.805+0000 7f8cd8ff9700 1 -- 172.21.15.61:0/447833217 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cd0086e60 con 0x7f8cdc069610 2023-12-24T19:57:40.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.003+0000 7f8ce2cba700 1 -- 172.21.15.61:0/447833217 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8cdc15a780 con 0x7f8cdc069610 2023-12-24T19:57:40.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.003+0000 7f8cd8ff9700 1 -- 172.21.15.61:0/447833217 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8cd0051cb0 con 0x7f8cdc069610 2023-12-24T19:57:40.005 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T19:57:40.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.005+0000 7f8ce2cba700 1 -- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8cc0066f30 msgr2=0x7f8cc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.005+0000 7f8ce2cba700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8cc0066f30 0x7f8cc00693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0c7f20 tx=0x7f8cc8017000 comp rx=0 tx=0).stop 2023-12-24T19:57:40.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.005+0000 7f8ce2cba700 1 -- 172.21.15.61:0/447833217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc069610 msgr2=0x7f8cdc14fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.005+0000 7f8ce2cba700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc069610 0x7f8cdc14fb80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000d860 tx=0x7f8cd0008040 comp rx=0 tx=0).stop 2023-12-24T19:57:40.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.005+0000 7f8ce2cba700 1 -- 172.21.15.61:0/447833217 shutdown_connections 2023-12-24T19:57:40.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.005+0000 7f8ce2cba700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8cdc157820 0x7f8cdc0afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.005+0000 7f8ce2cba700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8cc0066f30 0x7f8cc00693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.005+0000 7f8ce2cba700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8cdc069610 0x7f8cdc14fb80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.005+0000 7f8ce2cba700 1 --2- 172.21.15.61:0/447833217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc0aa880 0x7f8cdc0c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.005+0000 7f8ce2cba700 1 -- 172.21.15.61:0/447833217 >> 172.21.15.61:0/447833217 conn(0x7f8cdc068020 msgr2=0x7f8cdc15ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:40.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.006+0000 7f8ce2cba700 1 -- 172.21.15.61:0/447833217 shutdown_connections 2023-12-24T19:57:40.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.006+0000 7f8ce2cba700 1 -- 172.21.15.61:0/447833217 wait complete. 2023-12-24T19:57:40.019 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:40.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.139+0000 7fb745ec5700 1 Processor -- start 2023-12-24T19:57:40.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.139+0000 7fb745ec5700 1 -- start start 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.140+0000 7fb745ec5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb740068510 0x7fb7400cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.140+0000 7fb745ec5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb740159a60 0x7fb740159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.140+0000 7fb745ec5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400b2890 con 0x7fb740068140 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.140+0000 7fb745ec5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400cf630 con 0x7fb740068510 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.140+0000 7fb745ec5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400b2240 con 0x7fb740159a60 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.140+0000 7fb73effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb740068510 0x7fb7400cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.140+0000 7fb73f7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb740068140 0x7fb7400b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46414/0 (socket says 172.21.15.61:46414) 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.140+0000 7fb73f7fe700 1 -- 172.21.15.61:0/4129577870 learned_addr learned my addr 172.21.15.61:0/4129577870 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb73effd700 1 -- 172.21.15.61:0/4129577870 >> v2:172.21.15.133:3300/0 conn(0x7fb740159a60 msgr2=0x7fb740159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb73effd700 1 --2- 172.21.15.61:0/4129577870 >> v2:172.21.15.133:3300/0 conn(0x7fb740159a60 0x7fb740159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb73effd700 1 -- 172.21.15.61:0/4129577870 >> v1:172.21.15.61:6789/0 conn(0x7fb740068140 legacy=0x7fb7400b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb73effd700 1 -- 172.21.15.61:0/4129577870 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400b2520 con 0x7fb740068510 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb73e7fc700 1 -- 172.21.15.61:0/4129577870 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481403439 0 0) 0x7fb7400b2890 con 0x7fb740068140 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb73effd700 1 --2- 172.21.15.61:0/4129577870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740068510 0x7fb7400cefa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb74006eaf0 tx=0x7fb7340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323df2c6b924b95c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb73e7fc700 1 -- 172.21.15.61:0/4129577870 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73400b6b0 con 0x7fb740068510 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb73e7fc700 1 -- 172.21.15.61:0/4129577870 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73400b810 con 0x7fb740068510 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb73e7fc700 1 -- 172.21.15.61:0/4129577870 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73400bbb0 con 0x7fb740068510 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb745ec5700 1 -- 172.21.15.61:0/4129577870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740068510 msgr2=0x7fb7400cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb745ec5700 1 --2- 172.21.15.61:0/4129577870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740068510 0x7fb7400cefa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb74006eaf0 tx=0x7fb7340091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb745ec5700 1 -- 172.21.15.61:0/4129577870 shutdown_connections 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb745ec5700 1 --2- 172.21.15.61:0/4129577870 >> v2:172.21.15.133:3300/0 conn(0x7fb740159a60 0x7fb740159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb745ec5700 1 --2- 172.21.15.61:0/4129577870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740068510 0x7fb7400cefa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.141+0000 7fb745ec5700 1 -- 172.21.15.61:0/4129577870 >> 172.21.15.61:0/4129577870 conn(0x7fb740097a10 msgr2=0x7fb7400ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.142+0000 7fb745ec5700 1 -- 172.21.15.61:0/4129577870 shutdown_connections 2023-12-24T19:57:40.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.142+0000 7fb745ec5700 1 -- 172.21.15.61:0/4129577870 wait complete. 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.143+0000 7fb745ec5700 1 Processor -- start 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.143+0000 7fb745ec5700 1 -- start start 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.143+0000 7fb745ec5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb740068140 0x7fb74009a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.143+0000 7fb745ec5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb740068510 0x7fb740099270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.143+0000 7fb745ec5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740159a60 0x7fb7400997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.143+0000 7fb745ec5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74006b020 con 0x7fb740159a60 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.143+0000 7fb745ec5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74006ad20 con 0x7fb740068510 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.143+0000 7fb745ec5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74009a830 con 0x7fb740068140 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740159a60 0x7fb7400997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740159a60 0x7fb7400997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36472/0 (socket says 172.21.15.61:36472) 2023-12-24T19:57:40.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73ffff700 1 -- 172.21.15.61:0/3605991182 learned_addr learned my addr 172.21.15.61:0/3605991182 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73f7fe700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb740068140 0x7fb74009a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73effd700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb740068510 0x7fb740099270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73ffff700 1 -- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb740068140 msgr2=0x7fb74009a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73ffff700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb740068140 0x7fb74009a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73ffff700 1 -- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb740068510 msgr2=0x7fb740099270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73ffff700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb740068510 0x7fb740099270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73ffff700 1 -- 172.21.15.61:0/3605991182 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734009420 con 0x7fb740159a60 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb73ffff700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740159a60 0x7fb7400997b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb73800bc60 tx=0x7fb738009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb7277fe700 1 -- 172.21.15.61:0/3605991182 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380092e0 con 0x7fb740159a60 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb7277fe700 1 -- 172.21.15.61:0/3605991182 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73800c630 con 0x7fb740159a60 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb745ec5700 1 -- 172.21.15.61:0/3605991182 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74009bca0 con 0x7fb740159a60 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb7277fe700 1 -- 172.21.15.61:0/3605991182 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73800c9f0 con 0x7fb740159a60 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.144+0000 7fb745ec5700 1 -- 172.21.15.61:0/3605991182 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb740169e80 con 0x7fb740159a60 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.145+0000 7fb745ec5700 1 -- 172.21.15.61:0/3605991182 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74006b1d0 con 0x7fb740159a60 2023-12-24T19:57:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.146+0000 7fb7277fe700 1 -- 172.21.15.61:0/3605991182 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb738012070 con 0x7fb740159a60 2023-12-24T19:57:40.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.146+0000 7fb7277fe700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb72c066f30 0x7fb72c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.146+0000 7fb7277fe700 1 -- 172.21.15.61:0/3605991182 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7380840e0 con 0x7fb740159a60 2023-12-24T19:57:40.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.147+0000 7fb73f7fe700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb72c066f30 0x7fb72c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.147+0000 7fb73f7fe700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb72c066f30 0x7fb72c0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb74006c920 tx=0x7fb730009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:40.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.151+0000 7fb7277fe700 1 -- 172.21.15.61:0/3605991182 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb74006b1d0 con 0x7fb740159a60 2023-12-24T19:57:40.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.348+0000 7fb745ec5700 1 -- 172.21.15.61:0/3605991182 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb74006b1d0 con 0x7fb740159a60 2023-12-24T19:57:40.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.349+0000 7fb7277fe700 1 -- 172.21.15.61:0/3605991182 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb74006b1d0 con 0x7fb740159a60 2023-12-24T19:57:40.350 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:40.350 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:40.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 -- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb72c066f30 msgr2=0x7fb72c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb72c066f30 0x7fb72c0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb74006c920 tx=0x7fb730009040 comp rx=0 tx=0).stop 2023-12-24T19:57:40.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 -- 172.21.15.61:0/3605991182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740159a60 msgr2=0x7fb7400997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740159a60 0x7fb7400997b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb73800bc60 tx=0x7fb738009840 comp rx=0 tx=0).stop 2023-12-24T19:57:40.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 -- 172.21.15.61:0/3605991182 shutdown_connections 2023-12-24T19:57:40.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb740068140 0x7fb74009a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb72c066f30 0x7fb72c0693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb740159a60 0x7fb7400997b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 --2- 172.21.15.61:0/3605991182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb740068510 0x7fb740099270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 -- 172.21.15.61:0/3605991182 >> 172.21.15.61:0/3605991182 conn(0x7fb740097a10 msgr2=0x7fb740154000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:40.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 -- 172.21.15.61:0/3605991182 shutdown_connections 2023-12-24T19:57:40.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.351+0000 7fb745ec5700 1 -- 172.21.15.61:0/3605991182 wait complete. 2023-12-24T19:57:40.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:57:04.595282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:57:05.898273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:57:40.365 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:57:40.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.488+0000 7f28cd024700 1 Processor -- start 2023-12-24T19:57:40.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.488+0000 7f28cd024700 1 -- start start 2023-12-24T19:57:40.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28cd024700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80c3b80 0x7f28c815e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28cd024700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c815e750 con 0x7f28c8070d50 2023-12-24T19:57:40.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28cd024700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c8067550 con 0x7f28c8159a30 2023-12-24T19:57:40.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28cd024700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8067b10 con 0x7f28c80c3b80 2023-12-24T19:57:40.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c659c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f28c8070d50 0x7f28c8067fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46428/0 (socket says 172.21.15.61:46428) 2023-12-24T19:57:40.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c659c700 1 -- 172.21.15.61:0/1044192054 learned_addr learned my addr 172.21.15.61:0/1044192054 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270959041 0 0) 0x7f28b8001290 con 0x7f28c8070d50 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b4003570 con 0x7f28c8070d50 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c759e700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80c3b80 0x7f28c815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627456054 0 0) 0x7f28b4003570 con 0x7f28c8070d50 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80c3b80 msgr2=0x7f28c815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80c3b80 0x7f28c815e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 >> v1:172.21.15.133:6789/0 conn(0x7f28c8159a30 legacy=0x7f28c8070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c8071550 con 0x7f28c8070d50 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f28b8001780 con 0x7f28c8070d50 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 >> v1:172.21.15.61:6789/0 conn(0x7f28c8070d50 legacy=0x7f28c8067fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b10 0x7f28b4003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 0x7f28b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80c3b80 0x7f28b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8067b10 con 0x7f28b4004810 2023-12-24T19:57:40.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b4005520 con 0x7f28b4003b10 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b4005690 con 0x7f28c80c3b80 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c659c700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 0x7f28b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c6d9d700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b10 0x7f28b4003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c759e700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80c3b80 0x7f28b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c659c700 1 -- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80c3b80 msgr2=0x7f28b400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c659c700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80c3b80 0x7f28b400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c659c700 1 -- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b10 msgr2=0x7f28b4003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c659c700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28b4003b10 0x7f28b4003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c659c700 1 -- 172.21.15.61:0/1044192054 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4003570 con 0x7f28b4004810 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.490+0000 7f28c659c700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 0x7f28b4004c80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28b8002850 tx=0x7f28b8008be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2152933ae3c601 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.492+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8008150 con 0x7f28b4004810 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.492+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b80082b0 con 0x7f28b4004810 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.492+0000 7f28c5d9b700 1 -- 172.21.15.61:0/1044192054 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8008650 con 0x7f28b4004810 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.492+0000 7f28cd024700 1 -- 172.21.15.61:0/1044192054 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 msgr2=0x7f28b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.492+0000 7f28cd024700 1 --2- 172.21.15.61:0/1044192054 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 0x7f28b4004c80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f28b8002850 tx=0x7f28b8008be0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.492+0000 7f28c759e700 1 -- 172.21.15.61:0/1044192054 reap_dead start 2023-12-24T19:57:40.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.492+0000 7f28cd024700 1 -- 172.21.15.61:0/1044192054 shutdown_connections 2023-12-24T19:57:40.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.492+0000 7f28cd024700 1 -- 172.21.15.61:0/1044192054 >> 172.21.15.61:0/1044192054 conn(0x7f28c80ce1f0 msgr2=0x7f28c80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:40.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.492+0000 7f28cd024700 1 -- 172.21.15.61:0/1044192054 shutdown_connections 2023-12-24T19:57:40.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.492+0000 7f28cd024700 1 -- 172.21.15.61:0/1044192054 wait complete. 2023-12-24T19:57:40.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.494+0000 7f28cd024700 1 Processor -- start 2023-12-24T19:57:40.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.494+0000 7f28cd024700 1 -- start start 2023-12-24T19:57:40.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28cd024700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 0x7f28c815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28cd024700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28c80c77b0 0x7f28c80b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28cd024700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80b2e60 0x7f28c8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28cd024700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c816e050 con 0x7f28b4004810 2023-12-24T19:57:40.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28cd024700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c816d480 con 0x7f28c80c77b0 2023-12-24T19:57:40.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28cd024700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80c7c20 con 0x7f28c80b2e60 2023-12-24T19:57:40.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c6d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 0x7f28c815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c6d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 0x7f28c815e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36488/0 (socket says 172.21.15.61:36488) 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c6d9d700 1 -- 172.21.15.61:0/3426773240 learned_addr learned my addr 172.21.15.61:0/3426773240 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c759e700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80b2e60 0x7f28c8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c659c700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28c80c77b0 0x7f28c80b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c6d9d700 1 -- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80b2e60 msgr2=0x7f28c8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c6d9d700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80b2e60 0x7f28c8158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c6d9d700 1 -- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28c80c77b0 msgr2=0x7f28c80b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c6d9d700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28c80c77b0 0x7f28c80b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c6d9d700 1 -- 172.21.15.61:0/3426773240 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c816d720 con 0x7f28b4004810 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c759e700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80b2e60 0x7f28c8158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c659c700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28c80c77b0 0x7f28c80b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28c6d9d700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 0x7f28c815e080 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f28b0002980 tx=0x7f28b0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28beffd700 1 -- 172.21.15.61:0/3426773240 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000f870 con 0x7f28b4004810 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28beffd700 1 -- 172.21.15.61:0/3426773240 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b000f9d0 con 0x7f28b4004810 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28cd024700 1 -- 172.21.15.61:0/3426773240 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c816da00 con 0x7f28b4004810 2023-12-24T19:57:40.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28beffd700 1 -- 172.21.15.61:0/3426773240 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000fd90 con 0x7f28b4004810 2023-12-24T19:57:40.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28cd024700 1 -- 172.21.15.61:0/3426773240 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c81593d0 con 0x7f28b4004810 2023-12-24T19:57:40.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.495+0000 7f28cd024700 1 -- 172.21.15.61:0/3426773240 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c816e330 con 0x7f28b4004810 2023-12-24T19:57:40.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.497+0000 7f28beffd700 1 -- 172.21.15.61:0/3426773240 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f28b0006a30 con 0x7f28b4004810 2023-12-24T19:57:40.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.497+0000 7f28beffd700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28a8066f30 0x7f28a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.497+0000 7f28beffd700 1 -- 172.21.15.61:0/3426773240 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28b0084560 con 0x7f28b4004810 2023-12-24T19:57:40.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.498+0000 7f28c659c700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28a8066f30 0x7f28a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.498+0000 7f28c659c700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28a8066f30 0x7f28a80693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f28b8002850 tx=0x7f28b8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:40.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.502+0000 7f28beffd700 1 -- 172.21.15.61:0/3426773240 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28b00517d0 con 0x7f28b4004810 2023-12-24T19:57:40.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.693+0000 7f28cd024700 1 -- 172.21.15.61:0/3426773240 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28c804c3c0 con 0x7f28b4004810 2023-12-24T19:57:40.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.694+0000 7f28beffd700 1 -- 172.21.15.61:0/3426773240 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28b0054df0 con 0x7f28b4004810 2023-12-24T19:57:40.694 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:57:40.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 -- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28a8066f30 msgr2=0x7f28a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28a8066f30 0x7f28a80693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f28b8002850 tx=0x7f28b8016000 comp rx=0 tx=0).stop 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 -- 172.21.15.61:0/3426773240 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 msgr2=0x7f28c815e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 0x7f28c815e080 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f28b0002980 tx=0x7f28b0007d30 comp rx=0 tx=0).stop 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 -- 172.21.15.61:0/3426773240 shutdown_connections 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f28c80b2e60 0x7f28c8158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f28a8066f30 0x7f28a80693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f28b4004810 0x7f28c815e080 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 --2- 172.21.15.61:0/3426773240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28c80c77b0 0x7f28c80b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 -- 172.21.15.61:0/3426773240 >> 172.21.15.61:0/3426773240 conn(0x7f28c80ce1f0 msgr2=0x7f28c806d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 -- 172.21.15.61:0/3426773240 shutdown_connections 2023-12-24T19:57:40.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.696+0000 7f28cd024700 1 -- 172.21.15.61:0/3426773240 wait complete. 2023-12-24T19:57:40.708 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:57:40.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.833+0000 7f9682b01700 1 Processor -- start 2023-12-24T19:57:40.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.833+0000 7f9682b01700 1 -- start start 2023-12-24T19:57:40.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.834+0000 7f9682b01700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 0x7f967c069b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.834+0000 7f9682b01700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f967c0cab60 0x7f967c0c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.834+0000 7f9682b01700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967c06a4f0 con 0x7f967c0b3370 2023-12-24T19:57:40.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.834+0000 7f9682b01700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c0c84d0 con 0x7f967c0cab60 2023-12-24T19:57:40.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.834+0000 7f9682b01700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c0c87b0 con 0x7f967c0b2fa0 2023-12-24T19:57:40.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.834+0000 7f968109e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f967c0cab60 0x7f967c0c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.834+0000 7f968109e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f967c0cab60 0x7f967c0c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36500/0 (socket says 172.21.15.61:36500) 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.834+0000 7f968109e700 1 -- 172.21.15.61:0/3137524642 learned_addr learned my addr 172.21.15.61:0/3137524642 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.834+0000 7f968089d700 1 --2- 172.21.15.61:0/3137524642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 0x7f967c069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f968109e700 1 -- 172.21.15.61:0/3137524642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 msgr2=0x7f967c069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f968109e700 1 --2- 172.21.15.61:0/3137524642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 0x7f967c069b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f968109e700 1 -- 172.21.15.61:0/3137524642 >> v1:172.21.15.133:6789/0 conn(0x7f967c0b3370 legacy=0x7f967c0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f968109e700 1 -- 172.21.15.61:0/3137524642 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c0c8a90 con 0x7f967c0cab60 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f968089d700 1 --2- 172.21.15.61:0/3137524642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 0x7f967c069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f968109e700 1 --2- 172.21.15.61:0/3137524642 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0cab60 0x7f967c0c8fb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9674009f20 tx=0x7f9674009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80d93e0069b1852 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f967b7fe700 1 -- 172.21.15.61:0/3137524642 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400e070 con 0x7f967c0cab60 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f967b7fe700 1 -- 172.21.15.61:0/3137524642 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967400ba40 con 0x7f967c0cab60 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f967b7fe700 1 -- 172.21.15.61:0/3137524642 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96740092e0 con 0x7f967c0cab60 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f9682b01700 1 -- 172.21.15.61:0/3137524642 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0cab60 msgr2=0x7f967c0c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f9682b01700 1 --2- 172.21.15.61:0/3137524642 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0cab60 0x7f967c0c8fb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9674009f20 tx=0x7f9674009840 comp rx=0 tx=0).stop 2023-12-24T19:57:40.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f9682b01700 1 -- 172.21.15.61:0/3137524642 shutdown_connections 2023-12-24T19:57:40.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f9682b01700 1 --2- 172.21.15.61:0/3137524642 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0cab60 0x7f967c0c8fb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f9682b01700 1 --2- 172.21.15.61:0/3137524642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 0x7f967c069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.835+0000 7f9682b01700 1 -- 172.21.15.61:0/3137524642 >> 172.21.15.61:0/3137524642 conn(0x7f967c0ce170 msgr2=0x7f967c0ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:40.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.836+0000 7f9682b01700 1 -- 172.21.15.61:0/3137524642 shutdown_connections 2023-12-24T19:57:40.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.836+0000 7f9682b01700 1 -- 172.21.15.61:0/3137524642 wait complete. 2023-12-24T19:57:40.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.837+0000 7f9682b01700 1 Processor -- start 2023-12-24T19:57:40.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.837+0000 7f9682b01700 1 -- start start 2023-12-24T19:57:40.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.837+0000 7f9682b01700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 0x7f967c1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.837+0000 7f9682b01700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0b3370 0x7f967c15a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.837+0000 7f9682b01700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c0cab60 0x7f967c153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f9682b01700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c15af10 con 0x7f967c0b3370 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f9682b01700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1588b0 con 0x7f967c0cab60 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f9682b01700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c158b90 con 0x7f967c0b2fa0 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f967bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0b3370 0x7f967c15a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f967bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0b3370 0x7f967c15a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36514/0 (socket says 172.21.15.61:36514) 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f967bfff700 1 -- 172.21.15.61:0/4179008372 learned_addr learned my addr 172.21.15.61:0/4179008372 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f968089d700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 0x7f967c1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f968109e700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c0cab60 0x7f967c153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f967bfff700 1 -- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 msgr2=0x7f967c1581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f967bfff700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 0x7f967c1581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f967bfff700 1 -- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c0cab60 msgr2=0x7f967c153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:40.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f967bfff700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c0cab60 0x7f967c153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f967bfff700 1 -- 172.21.15.61:0/4179008372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674009ae0 con 0x7f967c0b3370 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f968109e700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c0cab60 0x7f967c153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f967bfff700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0b3370 0x7f967c15a9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f966800c5d0 tx=0x7f9668007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f9678ff9700 1 -- 172.21.15.61:0/4179008372 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668011590 con 0x7f967c0b3370 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f9678ff9700 1 -- 172.21.15.61:0/4179008372 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96680116f0 con 0x7f967c0b3370 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f9678ff9700 1 -- 172.21.15.61:0/4179008372 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9668011ab0 con 0x7f967c0b3370 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f9682b01700 1 -- 172.21.15.61:0/4179008372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c158e70 con 0x7f967c0b3370 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.838+0000 7f9682b01700 1 -- 172.21.15.61:0/4179008372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c1544a0 con 0x7f967c0b3370 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.839+0000 7f9682b01700 1 -- 172.21.15.61:0/4179008372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967c0c5a90 con 0x7f967c0b3370 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.840+0000 7f9678ff9700 1 -- 172.21.15.61:0/4179008372 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f966801c460 con 0x7f967c0b3370 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.840+0000 7f9678ff9700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9660066f30 0x7f96600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:40.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.840+0000 7f9678ff9700 1 -- 172.21.15.61:0/4179008372 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96680842a0 con 0x7f967c0b3370 2023-12-24T19:57:40.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.841+0000 7f968089d700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9660066f30 0x7f96600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:40.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.841+0000 7f968089d700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9660066f30 0x7f96600693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9670006fd0 tx=0x7f9670008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:40.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:40.844+0000 7f9678ff9700 1 -- 172.21.15.61:0/4179008372 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f967c0c5a90 con 0x7f967c0b3370 2023-12-24T19:57:41.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.039+0000 7f9682b01700 1 -- 172.21.15.61:0/4179008372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f967c0c5a90 con 0x7f967c0b3370 2023-12-24T19:57:41.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.039+0000 7f9678ff9700 1 -- 172.21.15.61:0/4179008372 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f967c0c5a90 con 0x7f967c0b3370 2023-12-24T19:57:41.040 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T19:57:41.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 -- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9660066f30 msgr2=0x7f96600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9660066f30 0x7f96600693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9670006fd0 tx=0x7f9670008040 comp rx=0 tx=0).stop 2023-12-24T19:57:41.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 -- 172.21.15.61:0/4179008372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0b3370 msgr2=0x7f967c15a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0b3370 0x7f967c15a9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f966800c5d0 tx=0x7f9668007f60 comp rx=0 tx=0).stop 2023-12-24T19:57:41.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 -- 172.21.15.61:0/4179008372 shutdown_connections 2023-12-24T19:57:41.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f967c0b2fa0 0x7f967c1581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9660066f30 0x7f96600693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c0cab60 0x7f967c153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 --2- 172.21.15.61:0/4179008372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967c0b3370 0x7f967c15a9d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 -- 172.21.15.61:0/4179008372 >> 172.21.15.61:0/4179008372 conn(0x7f967c0ce170 msgr2=0x7f967c155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:41.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 -- 172.21.15.61:0/4179008372 shutdown_connections 2023-12-24T19:57:41.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.042+0000 7f9682b01700 1 -- 172.21.15.61:0/4179008372 wait complete. 2023-12-24T19:57:41.054 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:57:41.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.178+0000 7f1cc01b6700 1 Processor -- start 2023-12-24T19:57:41.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.178+0000 7f1cc01b6700 1 -- start start 2023-12-24T19:57:41.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.179+0000 7f1cc01b6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb8159a30 0x7f1cb815e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.179+0000 7f1cc01b6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1cb80c3b80 0x7f1cb8070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.179+0000 7f1cc01b6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb815e750 con 0x7f1cb8159e00 2023-12-24T19:57:41.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.179+0000 7f1cc01b6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb8067550 con 0x7f1cb80c3b80 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.179+0000 7f1cc01b6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8067b10 con 0x7f1cb8159a30 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.179+0000 7f1cbd751700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1cb80c3b80 0x7f1cb8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.179+0000 7f1cbd751700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1cb80c3b80 0x7f1cb8070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36528/0 (socket says 172.21.15.61:36528) 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbd751700 1 -- 172.21.15.61:0/4207263119 learned_addr learned my addr 172.21.15.61:0/4207263119 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbdf52700 1 --2- 172.21.15.61:0/4207263119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb8159a30 0x7f1cb815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbd751700 1 -- 172.21.15.61:0/4207263119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb8159a30 msgr2=0x7f1cb815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbd751700 1 --2- 172.21.15.61:0/4207263119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb8159a30 0x7f1cb815e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbd751700 1 -- 172.21.15.61:0/4207263119 >> v1:172.21.15.133:6789/0 conn(0x7f1cb8159e00 legacy=0x7f1cb8069b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbd751700 1 -- 172.21.15.61:0/4207263119 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8071550 con 0x7f1cb80c3b80 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbdf52700 1 --2- 172.21.15.61:0/4207263119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb8159a30 0x7f1cb815e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbd751700 1 --2- 172.21.15.61:0/4207263119 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb80c3b80 0x7f1cb8070640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009990 tx=0x7f1cb4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98336b0acea5f9d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbcf50700 1 -- 172.21.15.61:0/4207263119 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4005c10 con 0x7f1cb80c3b80 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbcf50700 1 -- 172.21.15.61:0/4207263119 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb4005d70 con 0x7f1cb80c3b80 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.180+0000 7f1cbcf50700 1 -- 172.21.15.61:0/4207263119 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb400b880 con 0x7f1cb80c3b80 2023-12-24T19:57:41.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.181+0000 7f1cc01b6700 1 -- 172.21.15.61:0/4207263119 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb80c3b80 msgr2=0x7f1cb8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.181+0000 7f1cc01b6700 1 --2- 172.21.15.61:0/4207263119 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb80c3b80 0x7f1cb8070640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4009990 tx=0x7f1cb4009220 comp rx=0 tx=0).stop 2023-12-24T19:57:41.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.181+0000 7f1cc01b6700 1 -- 172.21.15.61:0/4207263119 shutdown_connections 2023-12-24T19:57:41.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.181+0000 7f1cc01b6700 1 --2- 172.21.15.61:0/4207263119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb8159a30 0x7f1cb815e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.181+0000 7f1cc01b6700 1 --2- 172.21.15.61:0/4207263119 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb80c3b80 0x7f1cb8070640 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.181+0000 7f1cc01b6700 1 -- 172.21.15.61:0/4207263119 >> 172.21.15.61:0/4207263119 conn(0x7f1cb80ce1f0 msgr2=0x7f1cb80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:41.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.181+0000 7f1cc01b6700 1 -- 172.21.15.61:0/4207263119 shutdown_connections 2023-12-24T19:57:41.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.181+0000 7f1cc01b6700 1 -- 172.21.15.61:0/4207263119 wait complete. 2023-12-24T19:57:41.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.182+0000 7f1cc01b6700 1 Processor -- start 2023-12-24T19:57:41.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.182+0000 7f1cc01b6700 1 -- start start 2023-12-24T19:57:41.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cc01b6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb80c3b80 0x7f1cb816dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cc01b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb8159a30 0x7f1cb815df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cc01b6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb8159e00 0x7f1cb80c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cc01b6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80b0c10 con 0x7f1cb8159e00 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cc01b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80b1790 con 0x7f1cb8159a30 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cc01b6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8154620 con 0x7f1cb80c3b80 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbe753700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb8159e00 0x7f1cb80c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbe753700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb8159e00 0x7f1cb80c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36542/0 (socket says 172.21.15.61:36542) 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbe753700 1 -- 172.21.15.61:0/2676550408 learned_addr learned my addr 172.21.15.61:0/2676550408 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbdf52700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb80c3b80 0x7f1cb816dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbd751700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb8159a30 0x7f1cb815df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbe753700 1 -- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb80c3b80 msgr2=0x7f1cb816dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbe753700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb80c3b80 0x7f1cb816dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbe753700 1 -- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb8159a30 msgr2=0x7f1cb815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbe753700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb8159a30 0x7f1cb815df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbe753700 1 -- 172.21.15.61:0/2676550408 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb4009480 con 0x7f1cb8159e00 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.183+0000 7f1cbe753700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb8159e00 0x7f1cb80c47d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000c8e0 tx=0x7f1cb0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.184+0000 7f1ca9ffb700 1 -- 172.21.15.61:0/2676550408 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0012630 con 0x7f1cb8159e00 2023-12-24T19:57:41.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.184+0000 7f1ca9ffb700 1 -- 172.21.15.61:0/2676550408 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb0012790 con 0x7f1cb8159e00 2023-12-24T19:57:41.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.184+0000 7f1cc01b6700 1 -- 172.21.15.61:0/2676550408 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb80b0e60 con 0x7f1cb8159e00 2023-12-24T19:57:41.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.184+0000 7f1ca9ffb700 1 -- 172.21.15.61:0/2676550408 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0012b50 con 0x7f1cb8159e00 2023-12-24T19:57:41.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.184+0000 7f1cc01b6700 1 -- 172.21.15.61:0/2676550408 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb80b1420 con 0x7f1cb8159e00 2023-12-24T19:57:41.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.185+0000 7f1cc01b6700 1 -- 172.21.15.61:0/2676550408 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb80b1900 con 0x7f1cb8159e00 2023-12-24T19:57:41.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.185+0000 7f1ca9ffb700 1 -- 172.21.15.61:0/2676550408 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1cb001a3a0 con 0x7f1cb8159e00 2023-12-24T19:57:41.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.185+0000 7f1ca9ffb700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c9c066f30 0x7f1c9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.185+0000 7f1ca9ffb700 1 -- 172.21.15.61:0/2676550408 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1cb0084510 con 0x7f1cb8159e00 2023-12-24T19:57:41.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.186+0000 7f1cbdf52700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c9c066f30 0x7f1c9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.186+0000 7f1cbdf52700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c9c066f30 0x7f1c9c0693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1cac006f00 tx=0x7f1cac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:41.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.190+0000 7f1ca9ffb700 1 -- 172.21.15.61:0/2676550408 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cb0055210 con 0x7f1cb8159e00 2023-12-24T19:57:41.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.383+0000 7f1cc01b6700 1 -- 172.21.15.61:0/2676550408 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1cb804c3c0 con 0x7f1cb8159e00 2023-12-24T19:57:41.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.384+0000 7f1ca9ffb700 1 -- 172.21.15.61:0/2676550408 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1cb0054da0 con 0x7f1cb8159e00 2023-12-24T19:57:41.384 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T19:57:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 -- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c9c066f30 msgr2=0x7f1c9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c9c066f30 0x7f1c9c0693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1cac006f00 tx=0x7f1cac008040 comp rx=0 tx=0).stop 2023-12-24T19:57:41.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 -- 172.21.15.61:0/2676550408 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb8159e00 msgr2=0x7f1cb80c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb8159e00 0x7f1cb80c47d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000c8e0 tx=0x7f1cb0001710 comp rx=0 tx=0).stop 2023-12-24T19:57:41.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 -- 172.21.15.61:0/2676550408 shutdown_connections 2023-12-24T19:57:41.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cb80c3b80 0x7f1cb816dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c9c066f30 0x7f1c9c0693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cb8159e00 0x7f1cb80c47d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 --2- 172.21.15.61:0/2676550408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb8159a30 0x7f1cb815df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 -- 172.21.15.61:0/2676550408 >> 172.21.15.61:0/2676550408 conn(0x7f1cb80ce1f0 msgr2=0x7f1cb80afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:41.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 -- 172.21.15.61:0/2676550408 shutdown_connections 2023-12-24T19:57:41.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.386+0000 7f1cc01b6700 1 -- 172.21.15.61:0/2676550408 wait complete. 2023-12-24T19:57:41.427 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-12-24T19:57:41.427 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-12-24T19:57:41.428 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-12-24T19:57:41.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.549+0000 7f10bce9a700 1 Processor -- start 2023-12-24T19:57:41.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.549+0000 7f10bce9a700 1 -- start start 2023-12-24T19:57:41.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10bce9a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10b80b3d30 0x7f10b80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10bce9a700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b80b2890 con 0x7f10b8068510 2023-12-24T19:57:41.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10bce9a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b80cf630 con 0x7f10b8068140 2023-12-24T19:57:41.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10bce9a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b80b2240 con 0x7f10b80b3d30 2023-12-24T19:57:41.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b5d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f10b8068510 0x7f10b8159a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46444/0 (socket says 172.21.15.61:46444) 2023-12-24T19:57:41.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b5d9b700 1 -- 172.21.15.61:0/3647400692 learned_addr learned my addr 172.21.15.61:0/3647400692 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:41.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721852021 0 0) 0x7f10b80b2890 con 0x7f10b8068510 2023-12-24T19:57:41.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b6d9d700 1 --2- 172.21.15.61:0/3647400692 >> v2:172.21.15.133:3300/0 conn(0x7f10b80b3d30 0x7f10b80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a4003570 con 0x7f10b8068510 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4258448409 0 0) 0x7f10a4003570 con 0x7f10b8068510 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 >> v2:172.21.15.133:3300/0 conn(0x7f10b80b3d30 msgr2=0x7f10b80cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b559a700 1 --2- 172.21.15.61:0/3647400692 >> v2:172.21.15.133:3300/0 conn(0x7f10b80b3d30 0x7f10b80cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 >> v1:172.21.15.133:6789/0 conn(0x7f10b8068140 legacy=0x7f10b80b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b80b2520 con 0x7f10b8068510 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f10a8001470 con 0x7f10b8068510 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.550+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 >> v1:172.21.15.61:6789/0 conn(0x7f10b8068510 legacy=0x7f10b8159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b559a700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a4003a60 0x7f10a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b559a700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10a4004810 0x7f10a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b559a700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10a40051c0 0x7f10a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b80b2240 con 0x7f10a4004810 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a400c160 con 0x7f10a4003a60 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a400c320 con 0x7f10a40051c0 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b5d9b700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10a4004810 0x7f10a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b659c700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a4003a60 0x7f10a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b6d9d700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10a40051c0 0x7f10a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b5d9b700 1 -- 172.21.15.61:0/3647400692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10a40051c0 msgr2=0x7f10a400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b5d9b700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10a40051c0 0x7f10a400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b5d9b700 1 -- 172.21.15.61:0/3647400692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a4003a60 msgr2=0x7f10a4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b5d9b700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a4003a60 0x7f10a4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b5d9b700 1 -- 172.21.15.61:0/3647400692 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a4003570 con 0x7f10a4004810 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b659c700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a4003a60 0x7f10a4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b6d9d700 1 -- 172.21.15.61:0/3647400692 reap_dead start 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b5d9b700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10a4004810 0x7f10a4004c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c3c0 tx=0x7f10a8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33234379d3bc379 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a800cc90 con 0x7f10a4004810 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a800cdf0 con 0x7f10a4004810 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.551+0000 7f10b559a700 1 -- 172.21.15.61:0/3647400692 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a8005b50 con 0x7f10a4004810 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.552+0000 7f10bce9a700 1 -- 172.21.15.61:0/3647400692 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10a4004810 msgr2=0x7f10a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.552+0000 7f10bce9a700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10a4004810 0x7f10a4004c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c3c0 tx=0x7f10a8001e50 comp rx=0 tx=0).stop 2023-12-24T19:57:41.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.552+0000 7f10bce9a700 1 -- 172.21.15.61:0/3647400692 shutdown_connections 2023-12-24T19:57:41.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.552+0000 7f10bce9a700 1 --2- 172.21.15.61:0/3647400692 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10a4004810 0x7f10a4004c80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.552+0000 7f10bce9a700 1 -- 172.21.15.61:0/3647400692 >> 172.21.15.61:0/3647400692 conn(0x7f10b8097a10 msgr2=0x7f10b80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:41.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.552+0000 7f10bce9a700 1 -- 172.21.15.61:0/3647400692 shutdown_connections 2023-12-24T19:57:41.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.552+0000 7f10bce9a700 1 -- 172.21.15.61:0/3647400692 wait complete. 2023-12-24T19:57:41.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.553+0000 7f10bce9a700 1 Processor -- start 2023-12-24T19:57:41.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.553+0000 7f10bce9a700 1 -- start start 2023-12-24T19:57:41.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10bce9a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10a4004810 0x7f10b8149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10bce9a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10b809ba70 0x7f10b815a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10bce9a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b815b9d0 0x7f10b815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10bce9a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8098930 con 0x7f10b809ba70 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10bce9a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b815c390 con 0x7f10b815b9d0 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10bce9a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8098eb0 con 0x7f10a4004810 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b5d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10b809ba70 0x7f10b815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b5d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10b809ba70 0x7f10b815a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36552/0 (socket says 172.21.15.61:36552) 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b5d9b700 1 -- 172.21.15.61:0/1115435703 learned_addr learned my addr 172.21.15.61:0/1115435703 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b6d9d700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b815b9d0 0x7f10b815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b659c700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10a4004810 0x7f10b8149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b5d9b700 1 -- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10a4004810 msgr2=0x7f10b8149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b5d9b700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10a4004810 0x7f10b8149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b5d9b700 1 -- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b815b9d0 msgr2=0x7f10b815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b5d9b700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b815b9d0 0x7f10b815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b5d9b700 1 -- 172.21.15.61:0/1115435703 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b815ab40 con 0x7f10b809ba70 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.554+0000 7f10b5d9b700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10b809ba70 0x7f10b815a240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c9b0 tx=0x7f10a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:41.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.555+0000 7f10ae7fc700 1 -- 172.21.15.61:0/1115435703 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a800cc90 con 0x7f10b809ba70 2023-12-24T19:57:41.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.555+0000 7f10ae7fc700 1 -- 172.21.15.61:0/1115435703 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a800c9e0 con 0x7f10b809ba70 2023-12-24T19:57:41.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.555+0000 7f10ae7fc700 1 -- 172.21.15.61:0/1115435703 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a8004ea0 con 0x7f10b809ba70 2023-12-24T19:57:41.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.555+0000 7f10bce9a700 1 -- 172.21.15.61:0/1115435703 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b815ae20 con 0x7f10b809ba70 2023-12-24T19:57:41.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.555+0000 7f10bce9a700 1 -- 172.21.15.61:0/1115435703 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b816a2a0 con 0x7f10b809ba70 2023-12-24T19:57:41.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.556+0000 7f10bce9a700 1 -- 172.21.15.61:0/1115435703 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b806d440 con 0x7f10b809ba70 2023-12-24T19:57:41.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.556+0000 7f10ae7fc700 1 -- 172.21.15.61:0/1115435703 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f10a80075b0 con 0x7f10b809ba70 2023-12-24T19:57:41.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.556+0000 7f10ae7fc700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1098066f30 0x7f10980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:41.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.556+0000 7f10ae7fc700 1 -- 172.21.15.61:0/1115435703 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10a8085bb0 con 0x7f10b809ba70 2023-12-24T19:57:41.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.557+0000 7f10b659c700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1098066f30 0x7f10980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:41.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.557+0000 7f10b659c700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1098066f30 0x7f10980693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f10a0007fd0 tx=0x7f10a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:41.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.561+0000 7f10ae7fc700 1 -- 172.21.15.61:0/1115435703 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10a8052d80 con 0x7f10b809ba70 2023-12-24T19:57:41.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:41.837+0000 7f10bce9a700 1 -- 172.21.15.61:0/1115435703 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f10b804c3c0 con 0x7f10b809ba70 2023-12-24T19:57:42.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.681+0000 7f10ae7fc700 1 -- 172.21.15.61:0/1115435703 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f10a8017020 con 0x7f10b809ba70 2023-12-24T19:57:42.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.683+0000 7f10bce9a700 1 -- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1098066f30 msgr2=0x7f10980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:42.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.683+0000 7f10bce9a700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1098066f30 0x7f10980693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f10a0007fd0 tx=0x7f10a0009040 comp rx=0 tx=0).stop 2023-12-24T19:57:42.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.684+0000 7f10bce9a700 1 -- 172.21.15.61:0/1115435703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10b809ba70 msgr2=0x7f10b815a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:42.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.684+0000 7f10bce9a700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10b809ba70 0x7f10b815a240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c9b0 tx=0x7f10a8015000 comp rx=0 tx=0).stop 2023-12-24T19:57:42.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.684+0000 7f10bce9a700 1 -- 172.21.15.61:0/1115435703 shutdown_connections 2023-12-24T19:57:42.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.684+0000 7f10bce9a700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10a4004810 0x7f10b8149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:42.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.684+0000 7f10bce9a700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1098066f30 0x7f10980693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:42.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.684+0000 7f10bce9a700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10b815b9d0 0x7f10b815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:42.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.684+0000 7f10bce9a700 1 --2- 172.21.15.61:0/1115435703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10b809ba70 0x7f10b815a240 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:42.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.684+0000 7f10bce9a700 1 -- 172.21.15.61:0/1115435703 >> 172.21.15.61:0/1115435703 conn(0x7f10b8097a10 msgr2=0x7f10b80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:42.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.684+0000 7f10bce9a700 1 -- 172.21.15.61:0/1115435703 shutdown_connections 2023-12-24T19:57:42.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.684+0000 7f10bce9a700 1 -- 172.21.15.61:0/1115435703 wait complete. 2023-12-24T19:57:42.699 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-24T19:57:42.843 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_objectstore":"memstore"} 2023-12-24T19:57:42.843 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-24T19:57:42.843 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T19:57:42.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.967+0000 7f3d71fa2700 1 Processor -- start 2023-12-24T19:57:42.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.967+0000 7f3d71fa2700 1 -- start start 2023-12-24T19:57:42.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d71fa2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d6c1580d0 0x7f3d6c0c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:42.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d71fa2700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c1585d0 con 0x7f3d6c152390 2023-12-24T19:57:42.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d71fa2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c1588b0 con 0x7f3d6c151fc0 2023-12-24T19:57:42.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d71fa2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c158b90 con 0x7f3d6c1580d0 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6affd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3d6c152390 0x7f3d6c06ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46456/0 (socket says 172.21.15.61:46456) 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6affd700 1 -- 172.21.15.61:0/3810826563 learned_addr learned my addr 172.21.15.61:0/3810826563 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6bfff700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d6c1580d0 0x7f3d6c0c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121562301 0 0) 0x7f3d6c1585d0 con 0x7f3d6c152390 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d54003570 con 0x7f3d6c152390 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984117347 0 0) 0x7f3d6c1588b0 con 0x7f3d6c151fc0 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d6c1585d0 con 0x7f3d6c151fc0 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3662482740 0 0) 0x7f3d54003570 con 0x7f3d6c152390 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d6c1580d0 msgr2=0x7f3d6c0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d6c1580d0 0x7f3d6c0c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 >> v1:172.21.15.133:6789/0 conn(0x7f3d6c151fc0 legacy=0x7f3d6c069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c158e70 con 0x7f3d6c152390 2023-12-24T19:57:42.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f3d60001470 con 0x7f3d6c152390 2023-12-24T19:57:42.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 >> v1:172.21.15.61:6789/0 conn(0x7f3d6c152390 legacy=0x7f3d6c06ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:42.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.968+0000 7f3d6a7fc700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d6c1580d0 0x7f3d54003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:42.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6a7fc700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d540041d0 0x7f3d54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:42.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6a7fc700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d54004d50 0x7f3d540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:42.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c158b90 con 0x7f3d540041d0 2023-12-24T19:57:42.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400bbf0 con 0x7f3d54004d50 2023-12-24T19:57:42.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5400bdb0 con 0x7f3d6c1580d0 2023-12-24T19:57:42.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6affd700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d540041d0 0x7f3d54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:42.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6b7fe700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d6c1580d0 0x7f3d54003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6bfff700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d54004d50 0x7f3d540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6affd700 1 -- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d6c1580d0 msgr2=0x7f3d54003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6affd700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d6c1580d0 0x7f3d54003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6affd700 1 -- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d54004d50 msgr2=0x7f3d540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6affd700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d54004d50 0x7f3d540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6affd700 1 -- 172.21.15.61:0/3810826563 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54003570 con 0x7f3d540041d0 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6b7fe700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d6c1580d0 0x7f3d54003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6bfff700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d54004d50 0x7f3d540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6affd700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d540041d0 0x7f3d54004810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000c1e0 tx=0x7f3d60001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6100e91281898298 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000cb10 con 0x7f3d540041d0 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6000cc90 con 0x7f3d540041d0 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.969+0000 7f3d6a7fc700 1 -- 172.21.15.61:0/3810826563 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60005b70 con 0x7f3d540041d0 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.970+0000 7f3d71fa2700 1 -- 172.21.15.61:0/3810826563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d540041d0 msgr2=0x7f3d54004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:42.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.970+0000 7f3d71fa2700 1 --2- 172.21.15.61:0/3810826563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d540041d0 0x7f3d54004810 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000c1e0 tx=0x7f3d60001d40 comp rx=0 tx=0).stop 2023-12-24T19:57:42.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.970+0000 7f3d6bfff700 1 -- 172.21.15.61:0/3810826563 reap_dead start 2023-12-24T19:57:42.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.970+0000 7f3d71fa2700 1 -- 172.21.15.61:0/3810826563 shutdown_connections 2023-12-24T19:57:42.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.970+0000 7f3d71fa2700 1 -- 172.21.15.61:0/3810826563 >> 172.21.15.61:0/3810826563 conn(0x7f3d6c068020 msgr2=0x7f3d6c0cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:42.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.970+0000 7f3d71fa2700 1 -- 172.21.15.61:0/3810826563 shutdown_connections 2023-12-24T19:57:42.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.970+0000 7f3d71fa2700 1 -- 172.21.15.61:0/3810826563 wait complete. 2023-12-24T19:57:42.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.971+0000 7f3d71fa2700 1 Processor -- start 2023-12-24T19:57:42.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.971+0000 7f3d71fa2700 1 -- start start 2023-12-24T19:57:42.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d71fa2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d540041d0 0x7f3d6c0b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:42.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d71fa2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d6c1474f0 0x7f3d6c0b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d71fa2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d6c15d0c0 0x7f3d6c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d71fa2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c15daa0 con 0x7f3d6c15d0c0 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d71fa2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0b0d90 con 0x7f3d6c1474f0 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d71fa2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0b0180 con 0x7f3d540041d0 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d6c15d0c0 0x7f3d6c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d6c15d0c0 0x7f3d6c15d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36572/0 (socket says 172.21.15.61:36572) 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6bfff700 1 -- 172.21.15.61:0/4075370403 learned_addr learned my addr 172.21.15.61:0/4075370403 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6b7fe700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d540041d0 0x7f3d6c0b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6affd700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d6c1474f0 0x7f3d6c0b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6bfff700 1 -- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d540041d0 msgr2=0x7f3d6c0b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6bfff700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d540041d0 0x7f3d6c0b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6bfff700 1 -- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d6c1474f0 msgr2=0x7f3d6c0b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6bfff700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d6c1474f0 0x7f3d6c0b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6bfff700 1 -- 172.21.15.61:0/4075370403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0b0460 con 0x7f3d6c15d0c0 2023-12-24T19:57:42.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d6bfff700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d6c15d0c0 0x7f3d6c15d560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c063f70 tx=0x7f3d6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d537fe700 1 -- 172.21.15.61:0/4075370403 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400e030 con 0x7f3d6c15d0c0 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d537fe700 1 -- 172.21.15.61:0/4075370403 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d64011d00 con 0x7f3d6c15d0c0 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.972+0000 7f3d71fa2700 1 -- 172.21.15.61:0/4075370403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c0b0740 con 0x7f3d6c15d0c0 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.973+0000 7f3d537fe700 1 -- 172.21.15.61:0/4075370403 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d640166c0 con 0x7f3d6c15d0c0 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.973+0000 7f3d71fa2700 1 -- 172.21.15.61:0/4075370403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c147960 con 0x7f3d6c15d0c0 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.973+0000 7f3d71fa2700 1 -- 172.21.15.61:0/4075370403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c0b0f40 con 0x7f3d6c15d0c0 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.974+0000 7f3d537fe700 1 -- 172.21.15.61:0/4075370403 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3d64016a70 con 0x7f3d6c15d0c0 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.974+0000 7f3d537fe700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d58066f30 0x7f3d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.974+0000 7f3d537fe700 1 -- 172.21.15.61:0/4075370403 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d6400f070 con 0x7f3d6c15d0c0 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.975+0000 7f3d6b7fe700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d58066f30 0x7f3d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:42.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.975+0000 7f3d6b7fe700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d58066f30 0x7f3d580693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c007bc0 tx=0x7f3d5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:42.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:42.979+0000 7f3d537fe700 1 -- 172.21.15.61:0/4075370403 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d6c0b0f40 con 0x7f3d6c15d0c0 2023-12-24T19:57:43.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.177+0000 7f3d71fa2700 1 -- 172.21.15.61:0/4075370403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3d6c0b0f00 con 0x7f3d6c15d0c0 2023-12-24T19:57:43.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.181+0000 7f3d537fe700 1 -- 172.21.15.61:0/4075370403 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d6408b080 con 0x7f3d6c15d0c0 2023-12-24T19:57:43.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 -- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d58066f30 msgr2=0x7f3d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:43.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d58066f30 0x7f3d580693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c007bc0 tx=0x7f3d5c009040 comp rx=0 tx=0).stop 2023-12-24T19:57:43.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 -- 172.21.15.61:0/4075370403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d6c15d0c0 msgr2=0x7f3d6c15d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:43.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d6c15d0c0 0x7f3d6c15d560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c063f70 tx=0x7f3d6400b040 comp rx=0 tx=0).stop 2023-12-24T19:57:43.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 -- 172.21.15.61:0/4075370403 shutdown_connections 2023-12-24T19:57:43.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3d540041d0 0x7f3d6c0b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d58066f30 0x7f3d580693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d6c15d0c0 0x7f3d6c15d560 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 --2- 172.21.15.61:0/4075370403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d6c1474f0 0x7f3d6c0b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 -- 172.21.15.61:0/4075370403 >> 172.21.15.61:0/4075370403 conn(0x7f3d6c068020 msgr2=0x7f3d6c069510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:43.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 -- 172.21.15.61:0/4075370403 shutdown_connections 2023-12-24T19:57:43.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.183+0000 7f3d71fa2700 1 -- 172.21.15.61:0/4075370403 wait complete. 2023-12-24T19:57:43.195 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T19:57:43.195 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:57:43.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:57:43.289 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T19:57:43.289 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T19:57:43.289 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T19:57:43.290 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T19:57:43.327 INFO:teuthology.orchestra.run:waiting for 900 2023-12-24T19:57:43.328 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:57:43.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:43.328 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T19:57:43.392 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T19:57:43.392 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T19:57:43.392 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T19:57:43.433 INFO:teuthology.orchestra.run:waiting for 900 2023-12-24T19:57:43.433 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:57:43.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:43.433 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T19:57:43.506 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T19:57:43.506 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T19:57:43.506 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-12-24T19:57:43.542 INFO:teuthology.orchestra.run:waiting for 900 2023-12-24T19:57:43.543 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:57:43.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:43.543 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T19:57:43.601 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T19:57:43.601 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T19:57:43.601 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-12-24T19:57:43.640 INFO:teuthology.orchestra.run:waiting for 900 2023-12-24T19:57:43.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:57:43.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:57:43.641 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T19:57:43.700 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T19:57:43.701 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:57:43.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.822+0000 7febff362700 1 Processor -- start 2023-12-24T19:57:43.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.823+0000 7febff362700 1 -- start start 2023-12-24T19:57:43.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.823+0000 7febff362700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7febf8156730 0x7febf8156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.823+0000 7febff362700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7febf80b0830 0x7febf806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.823+0000 7febff362700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf806de20 0x7febf80c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.823+0000 7febff362700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf8067a60 con 0x7febf80b0830 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.823+0000 7febff362700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf806e240 con 0x7febf8156730 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.823+0000 7febff362700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf80c88e0 con 0x7febf806de20 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.823+0000 7febfc8fd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7febf80b0830 0x7febf806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfc8fd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7febf80b0830 0x7febf806d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36576/0 (socket says 172.21.15.61:36576) 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfc8fd700 1 -- 172.21.15.61:0/3175307117 learned_addr learned my addr 172.21.15.61:0/3175307117 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfd0fe700 1 --2- 172.21.15.61:0/3175307117 >> v2:172.21.15.133:3300/0 conn(0x7febf8156730 0x7febf8156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfc8fd700 1 -- 172.21.15.61:0/3175307117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf806de20 msgr2=0x7febf80c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:43.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfd8ff700 1 --2- 172.21.15.61:0/3175307117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf806de20 0x7febf80c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfc8fd700 1 --2- 172.21.15.61:0/3175307117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf806de20 0x7febf80c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfc8fd700 1 -- 172.21.15.61:0/3175307117 >> v2:172.21.15.133:3300/0 conn(0x7febf8156730 msgr2=0x7febf8156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfc8fd700 1 --2- 172.21.15.61:0/3175307117 >> v2:172.21.15.133:3300/0 conn(0x7febf8156730 0x7febf8156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfc8fd700 1 -- 172.21.15.61:0/3175307117 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80c8bc0 con 0x7febf80b0830 2023-12-24T19:57:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfd0fe700 1 --2- 172.21.15.61:0/3175307117 >> v2:172.21.15.133:3300/0 conn(0x7febf8156730 0x7febf8156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febfc8fd700 1 --2- 172.21.15.61:0/3175307117 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf80b0830 0x7febf806d8e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7febf80ca130 tx=0x7febf400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191a8d7fd815c267 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febeffff700 1 -- 172.21.15.61:0/3175307117 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf400dc50 con 0x7febf80b0830 2023-12-24T19:57:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febeffff700 1 -- 172.21.15.61:0/3175307117 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf400ddb0 con 0x7febf80b0830 2023-12-24T19:57:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.824+0000 7febeffff700 1 -- 172.21.15.61:0/3175307117 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40196d0 con 0x7febf80b0830 2023-12-24T19:57:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.825+0000 7febff362700 1 -- 172.21.15.61:0/3175307117 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf80b0830 msgr2=0x7febf806d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.825+0000 7febff362700 1 --2- 172.21.15.61:0/3175307117 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf80b0830 0x7febf806d8e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7febf80ca130 tx=0x7febf400b4f0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.825+0000 7febff362700 1 -- 172.21.15.61:0/3175307117 shutdown_connections 2023-12-24T19:57:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.825+0000 7febff362700 1 --2- 172.21.15.61:0/3175307117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf806de20 0x7febf80c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.825+0000 7febff362700 1 --2- 172.21.15.61:0/3175307117 >> v2:172.21.15.133:3300/0 conn(0x7febf8156730 0x7febf8156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.825+0000 7febff362700 1 --2- 172.21.15.61:0/3175307117 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf80b0830 0x7febf806d8e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.825+0000 7febff362700 1 -- 172.21.15.61:0/3175307117 >> 172.21.15.61:0/3175307117 conn(0x7febf80cd6f0 msgr2=0x7febf80cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.825+0000 7febff362700 1 -- 172.21.15.61:0/3175307117 shutdown_connections 2023-12-24T19:57:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.825+0000 7febff362700 1 -- 172.21.15.61:0/3175307117 wait complete. 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.826+0000 7febff362700 1 Processor -- start 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.826+0000 7febff362700 1 -- start start 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febff362700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf806de20 0x7febf8154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febff362700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf80b0830 0x7febf8155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febff362700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf8156730 0x7febf8155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febff362700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80ccc20 con 0x7febf8156730 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febff362700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf815a180 con 0x7febf80b0830 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febff362700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf8159570 con 0x7febf806de20 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfd8ff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf8156730 0x7febf8155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfd8ff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf8156730 0x7febf8155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36578/0 (socket says 172.21.15.61:36578) 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfd8ff700 1 -- 172.21.15.61:0/2859626195 learned_addr learned my addr 172.21.15.61:0/2859626195 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfd0fe700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf806de20 0x7febf8154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfc8fd700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf80b0830 0x7febf8155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfd8ff700 1 -- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf806de20 msgr2=0x7febf8154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfd8ff700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf806de20 0x7febf8154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfd8ff700 1 -- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf80b0830 msgr2=0x7febf8155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfd8ff700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf80b0830 0x7febf8155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfd8ff700 1 -- 172.21.15.61:0/2859626195 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf400b790 con 0x7febf8156730 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.827+0000 7febfd8ff700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf8156730 0x7febf8155cd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febf000ceb0 tx=0x7febf0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.828+0000 7febed7fa700 1 -- 172.21.15.61:0/2859626195 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000ae40 con 0x7febf8156730 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.828+0000 7febed7fa700 1 -- 172.21.15.61:0/2859626195 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf0016430 con 0x7febf8156730 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.828+0000 7febff362700 1 -- 172.21.15.61:0/2859626195 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf8159850 con 0x7febf8156730 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.828+0000 7febed7fa700 1 -- 172.21.15.61:0/2859626195 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf00167d0 con 0x7febf8156730 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.828+0000 7febff362700 1 -- 172.21.15.61:0/2859626195 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf8159e10 con 0x7febf8156730 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.829+0000 7febff362700 1 -- 172.21.15.61:0/2859626195 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf815a2f0 con 0x7febf8156730 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.829+0000 7febed7fa700 1 -- 172.21.15.61:0/2859626195 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7febf0003020 con 0x7febf8156730 2023-12-24T19:57:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.829+0000 7febed7fa700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7febdc066f30 0x7febdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:43.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.829+0000 7febed7fa700 1 -- 172.21.15.61:0/2859626195 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7febf0012070 con 0x7febf8156730 2023-12-24T19:57:43.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.830+0000 7febfd0fe700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7febdc066f30 0x7febdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:43.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.830+0000 7febfd0fe700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7febdc066f30 0x7febdc0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7febe8006fd0 tx=0x7febe8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:43.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:43.834+0000 7febed7fa700 1 -- 172.21.15.61:0/2859626195 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febf00560e0 con 0x7febf8156730 2023-12-24T19:57:44.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.074+0000 7febff362700 1 -- 172.21.15.61:0/2859626195 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febf804c3c0 con 0x7febf8156730 2023-12-24T19:57:44.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.074+0000 7febed7fa700 1 -- 172.21.15.61:0/2859626195 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7febf0055c70 con 0x7febf8156730 2023-12-24T19:57:44.075 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:44.075 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3729732902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3729732902},{"type":"v1","addr":"172.21.15.61:6834","nonce":3729732902}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/402997858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":402997858},{"type":"v1","addr":"172.21.15.133:6837","nonce":402997858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/180373533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":180373533},{"type":"v1","addr":"172.21.15.61:6835","nonce":180373533}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:06.924129+0000","modified":"2023-12-24T19:57:10.540414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/74793696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":74793696},{"type":"v1","addr":"172.21.15.133:6836","nonce":74793696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T19:57:44.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 -- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7febdc066f30 msgr2=0x7febdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7febdc066f30 0x7febdc0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7febe8006fd0 tx=0x7febe8008040 comp rx=0 tx=0).stop 2023-12-24T19:57:44.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 -- 172.21.15.61:0/2859626195 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf8156730 msgr2=0x7febf8155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf8156730 0x7febf8155cd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febf000ceb0 tx=0x7febf0007870 comp rx=0 tx=0).stop 2023-12-24T19:57:44.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 -- 172.21.15.61:0/2859626195 shutdown_connections 2023-12-24T19:57:44.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7febf806de20 0x7febf8154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7febdc066f30 0x7febdc0693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7febf8156730 0x7febf8155cd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 --2- 172.21.15.61:0/2859626195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf80b0830 0x7febf8155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 -- 172.21.15.61:0/2859626195 >> 172.21.15.61:0/2859626195 conn(0x7febf80cd6f0 msgr2=0x7febf80cba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:44.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 -- 172.21.15.61:0/2859626195 shutdown_connections 2023-12-24T19:57:44.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.076+0000 7febff362700 1 -- 172.21.15.61:0/2859626195 wait complete. 2023-12-24T19:57:44.078 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 7 2023-12-24T19:57:44.089 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:44.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.211+0000 7f78ad0ef700 1 Processor -- start 2023-12-24T19:57:44.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.211+0000 7f78ad0ef700 1 -- start start 2023-12-24T19:57:44.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.211+0000 7f78ad0ef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a80af710 0x7f78a80afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78ad0ef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78a8068c80 0x7f78a8067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78ad0ef700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80687f0 con 0x7f78a80a6c80 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78ad0ef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a80a7100 con 0x7f78a8068c80 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78ad0ef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8067be0 con 0x7f78a80af710 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78a6d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a80af710 0x7f78a80afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78a6d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a80af710 0x7f78a80afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:52566/0 (socket says 172.21.15.61:52566) 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78a659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78a8068c80 0x7f78a8067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78a6d9d700 1 -- 172.21.15.61:0/3509594740 learned_addr learned my addr 172.21.15.61:0/3509594740 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78a6d9d700 1 -- 172.21.15.61:0/3509594740 >> v2:172.21.15.133:3300/0 conn(0x7f78a8068c80 msgr2=0x7f78a8067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78a6d9d700 1 --2- 172.21.15.61:0/3509594740 >> v2:172.21.15.133:3300/0 conn(0x7f78a8068c80 0x7f78a8067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78a6d9d700 1 -- 172.21.15.61:0/3509594740 >> v1:172.21.15.133:6789/0 conn(0x7f78a80a6c80 legacy=0x7f78a815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78a6d9d700 1 -- 172.21.15.61:0/3509594740 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a8067ec0 con 0x7f78a80af710 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.212+0000 7f78a6d9d700 1 --2- 172.21.15.61:0/3509594740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a80af710 0x7f78a80afae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f789c0099b0 tx=0x7f789c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d01321e86fe52ca1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:44.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78a5d9b700 1 -- 172.21.15.61:0/3509594740 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c009ea0 con 0x7f78a80af710 2023-12-24T19:57:44.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78a5d9b700 1 -- 172.21.15.61:0/3509594740 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c00b860 con 0x7f78a80af710 2023-12-24T19:57:44.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78a5d9b700 1 -- 172.21.15.61:0/3509594740 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00bc00 con 0x7f78a80af710 2023-12-24T19:57:44.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78ad0ef700 1 -- 172.21.15.61:0/3509594740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a80af710 msgr2=0x7f78a80afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78ad0ef700 1 --2- 172.21.15.61:0/3509594740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a80af710 0x7f78a80afae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f789c0099b0 tx=0x7f789c009250 comp rx=0 tx=0).stop 2023-12-24T19:57:44.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78ad0ef700 1 -- 172.21.15.61:0/3509594740 shutdown_connections 2023-12-24T19:57:44.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78ad0ef700 1 --2- 172.21.15.61:0/3509594740 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a80af710 0x7f78a80afae0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78ad0ef700 1 --2- 172.21.15.61:0/3509594740 >> v2:172.21.15.133:3300/0 conn(0x7f78a8068c80 0x7f78a8067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78ad0ef700 1 -- 172.21.15.61:0/3509594740 >> 172.21.15.61:0/3509594740 conn(0x7f78a80ca200 msgr2=0x7f78a80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:44.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78ad0ef700 1 -- 172.21.15.61:0/3509594740 shutdown_connections 2023-12-24T19:57:44.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.213+0000 7f78ad0ef700 1 -- 172.21.15.61:0/3509594740 wait complete. 2023-12-24T19:57:44.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.214+0000 7f78ad0ef700 1 Processor -- start 2023-12-24T19:57:44.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.215+0000 7f78ad0ef700 1 -- start start 2023-12-24T19:57:44.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.215+0000 7f78ad0ef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a8068c80 0x7f78a816b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.215+0000 7f78ad0ef700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78a80a6c80 0x7f78a80ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.215+0000 7f78ad0ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78a80af710 0x7f78a80c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.215+0000 7f78ad0ef700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80ad790 con 0x7f78a80a6c80 2023-12-24T19:57:44.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.215+0000 7f78ad0ef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80ae5d0 con 0x7f78a80af710 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.215+0000 7f78ad0ef700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80ad9c0 con 0x7f78a8068c80 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.215+0000 7f78a659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78a80a6c80 0x7f78a80ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.215+0000 7f78a659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78a80a6c80 0x7f78a80ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36588/0 (socket says 172.21.15.61:36588) 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.215+0000 7f78a659c700 1 -- 172.21.15.61:0/2152759186 learned_addr learned my addr 172.21.15.61:0/2152759186 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f78a759e700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78a80af710 0x7f78a80c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f78a6d9d700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a8068c80 0x7f78a816b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f78a659c700 1 -- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a8068c80 msgr2=0x7f78a816b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f78a659c700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a8068c80 0x7f78a816b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f78a659c700 1 -- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78a80af710 msgr2=0x7f78a80c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f78a659c700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78a80af710 0x7f78a80c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f78a659c700 1 -- 172.21.15.61:0/2152759186 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c0094f0 con 0x7f78a80a6c80 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f78a659c700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78a80a6c80 0x7f78a80ad250 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f789800e900 tx=0x7f78980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f788effd700 1 -- 172.21.15.61:0/2152759186 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898013680 con 0x7f78a80a6c80 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f788effd700 1 -- 172.21.15.61:0/2152759186 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78980137e0 con 0x7f78a80a6c80 2023-12-24T19:57:44.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f78ad0ef700 1 -- 172.21.15.61:0/2152759186 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a80adca0 con 0x7f78a80a6c80 2023-12-24T19:57:44.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f788effd700 1 -- 172.21.15.61:0/2152759186 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898013ba0 con 0x7f78a80a6c80 2023-12-24T19:57:44.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.216+0000 7f78ad0ef700 1 -- 172.21.15.61:0/2152759186 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a80ae260 con 0x7f78a80a6c80 2023-12-24T19:57:44.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.217+0000 7f78ad0ef700 1 -- 172.21.15.61:0/2152759186 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a81554e0 con 0x7f78a80a6c80 2023-12-24T19:57:44.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.218+0000 7f788effd700 1 -- 172.21.15.61:0/2152759186 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f78980123d0 con 0x7f78a80a6c80 2023-12-24T19:57:44.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.218+0000 7f788effd700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7894066f30 0x7f78940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.218+0000 7f788effd700 1 -- 172.21.15.61:0/2152759186 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78980845b0 con 0x7f78a80a6c80 2023-12-24T19:57:44.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.218+0000 7f78a6d9d700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7894066f30 0x7f78940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.219+0000 7f78a6d9d700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7894066f30 0x7f78940693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f789c0099b0 tx=0x7f789c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:44.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.222+0000 7f788effd700 1 -- 172.21.15.61:0/2152759186 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7898051820 con 0x7f78a80a6c80 2023-12-24T19:57:44.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.419+0000 7f78ad0ef700 1 -- 172.21.15.61:0/2152759186 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78a804c3c0 con 0x7f78a80a6c80 2023-12-24T19:57:44.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.420+0000 7f788effd700 1 -- 172.21.15.61:0/2152759186 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f7898054e40 con 0x7f78a80a6c80 2023-12-24T19:57:44.420 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:44.420 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:44.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 -- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7894066f30 msgr2=0x7f78940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7894066f30 0x7f78940693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f789c0099b0 tx=0x7f789c017000 comp rx=0 tx=0).stop 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 -- 172.21.15.61:0/2152759186 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78a80a6c80 msgr2=0x7f78a80ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78a80a6c80 0x7f78a80ad250 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f789800e900 tx=0x7f78980091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 -- 172.21.15.61:0/2152759186 shutdown_connections 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f78a8068c80 0x7f78a816b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7894066f30 0x7f78940693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78a80af710 0x7f78a80c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 --2- 172.21.15.61:0/2152759186 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f78a80a6c80 0x7f78a80ad250 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 -- 172.21.15.61:0/2152759186 >> 172.21.15.61:0/2152759186 conn(0x7f78a80ca200 msgr2=0x7f78a8155f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 -- 172.21.15.61:0/2152759186 shutdown_connections 2023-12-24T19:57:44.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.422+0000 7f78ad0ef700 1 -- 172.21.15.61:0/2152759186 wait complete. 2023-12-24T19:57:44.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:57:04.595282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:57:05.898273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:57:44.435 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:57:44.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.559+0000 7f4a67bc6700 1 Processor -- start 2023-12-24T19:57:44.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.559+0000 7f4a67bc6700 1 -- start start 2023-12-24T19:57:44.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.560+0000 7f4a67bc6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4a601578d0 0x7f4a600af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.560+0000 7f4a67bc6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a6006b320 0x7f4a600c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.560+0000 7f4a67bc6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a600caf30 con 0x7f4a6006f6e0 2023-12-24T19:57:44.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.560+0000 7f4a67bc6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a600af9f0 con 0x7f4a601578d0 2023-12-24T19:57:44.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.560+0000 7f4a67bc6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600afcd0 con 0x7f4a6006b320 2023-12-24T19:57:44.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.560+0000 7f4a65962700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4a601578d0 0x7f4a600af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.560+0000 7f4a65962700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4a601578d0 0x7f4a600af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36604/0 (socket says 172.21.15.61:36604) 2023-12-24T19:57:44.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.560+0000 7f4a65962700 1 -- 172.21.15.61:0/3513757399 learned_addr learned my addr 172.21.15.61:0/3513757399 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.560+0000 7f4a66163700 1 --2- 172.21.15.61:0/3513757399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a6006b320 0x7f4a600c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.560+0000 7f4a65962700 1 -- 172.21.15.61:0/3513757399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a6006b320 msgr2=0x7f4a600c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a65962700 1 --2- 172.21.15.61:0/3513757399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a6006b320 0x7f4a600c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a65962700 1 -- 172.21.15.61:0/3513757399 >> v1:172.21.15.133:6789/0 conn(0x7f4a6006f6e0 legacy=0x7f4a6006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a65962700 1 -- 172.21.15.61:0/3513757399 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a600affb0 con 0x7f4a601578d0 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a65962700 1 --2- 172.21.15.61:0/3513757399 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 0x7f4a600af330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4a540099b0 tx=0x7f4a54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77556471315157d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a64960700 1 -- 172.21.15.61:0/3513757399 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5400b820 con 0x7f4a601578d0 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a64960700 1 -- 172.21.15.61:0/3513757399 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5400b980 con 0x7f4a601578d0 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a64960700 1 -- 172.21.15.61:0/3513757399 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5400bd20 con 0x7f4a601578d0 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a67bc6700 1 -- 172.21.15.61:0/3513757399 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 msgr2=0x7f4a600af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a67bc6700 1 --2- 172.21.15.61:0/3513757399 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 0x7f4a600af330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4a540099b0 tx=0x7f4a54009250 comp rx=0 tx=0).stop 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a67bc6700 1 -- 172.21.15.61:0/3513757399 shutdown_connections 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a67bc6700 1 --2- 172.21.15.61:0/3513757399 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a6006b320 0x7f4a600c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a67bc6700 1 --2- 172.21.15.61:0/3513757399 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 0x7f4a600af330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.561+0000 7f4a67bc6700 1 -- 172.21.15.61:0/3513757399 >> 172.21.15.61:0/3513757399 conn(0x7f4a600ce800 msgr2=0x7f4a600cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:44.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.562+0000 7f4a67bc6700 1 -- 172.21.15.61:0/3513757399 shutdown_connections 2023-12-24T19:57:44.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.562+0000 7f4a67bc6700 1 -- 172.21.15.61:0/3513757399 wait complete. 2023-12-24T19:57:44.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.563+0000 7f4a67bc6700 1 Processor -- start 2023-12-24T19:57:44.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.563+0000 7f4a67bc6700 1 -- start start 2023-12-24T19:57:44.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.563+0000 7f4a67bc6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a6006b320 0x7f4a600c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.563+0000 7f4a67bc6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a6006f6e0 0x7f4a6016d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.563+0000 7f4a67bc6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 0x7f4a6016d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.563+0000 7f4a67bc6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600b15b0 con 0x7f4a601578d0 2023-12-24T19:57:44.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.563+0000 7f4a67bc6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60067920 con 0x7f4a6006f6e0 2023-12-24T19:57:44.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.563+0000 7f4a67bc6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600675f0 con 0x7f4a6006b320 2023-12-24T19:57:44.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.563+0000 7f4a66163700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 0x7f4a6016d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a66163700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 0x7f4a6016d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36612/0 (socket says 172.21.15.61:36612) 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a66163700 1 -- 172.21.15.61:0/2786015724 learned_addr learned my addr 172.21.15.61:0/2786015724 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a66163700 1 -- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a6006b320 msgr2=0x7f4a600c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a66163700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a6006b320 0x7f4a600c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a66163700 1 -- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a6006f6e0 msgr2=0x7f4a6016d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a66163700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a6006f6e0 0x7f4a6016d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a66163700 1 -- 172.21.15.61:0/2786015724 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540094f0 con 0x7f4a601578d0 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a66163700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 0x7f4a6016d8a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800ce80 tx=0x7f4a58007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a51ffb700 1 -- 172.21.15.61:0/2786015724 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800ae40 con 0x7f4a601578d0 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a51ffb700 1 -- 172.21.15.61:0/2786015724 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a58016430 con 0x7f4a601578d0 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a67bc6700 1 -- 172.21.15.61:0/2786015724 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a600c3960 con 0x7f4a601578d0 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a51ffb700 1 -- 172.21.15.61:0/2786015724 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a580167d0 con 0x7f4a601578d0 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.564+0000 7f4a67bc6700 1 -- 172.21.15.61:0/2786015724 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a600c3f20 con 0x7f4a601578d0 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.565+0000 7f4a67bc6700 1 -- 172.21.15.61:0/2786015724 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6004c3c0 con 0x7f4a601578d0 2023-12-24T19:57:44.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.566+0000 7f4a51ffb700 1 -- 172.21.15.61:0/2786015724 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4a58003020 con 0x7f4a601578d0 2023-12-24T19:57:44.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.566+0000 7f4a51ffb700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4a44066f30 0x7f4a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.566+0000 7f4a51ffb700 1 -- 172.21.15.61:0/2786015724 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a58012070 con 0x7f4a601578d0 2023-12-24T19:57:44.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.566+0000 7f4a65962700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4a44066f30 0x7f4a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.567+0000 7f4a65962700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4a44066f30 0x7f4a440693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4a540099b0 tx=0x7f4a54016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:44.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.570+0000 7f4a51ffb700 1 -- 172.21.15.61:0/2786015724 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a580526b0 con 0x7f4a601578d0 2023-12-24T19:57:44.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.763+0000 7f4a67bc6700 1 -- 172.21.15.61:0/2786015724 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a60067a90 con 0x7f4a601578d0 2023-12-24T19:57:44.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.764+0000 7f4a51ffb700 1 -- 172.21.15.61:0/2786015724 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a58055cd0 con 0x7f4a601578d0 2023-12-24T19:57:44.764 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:57:44.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 -- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4a44066f30 msgr2=0x7f4a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4a44066f30 0x7f4a440693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4a540099b0 tx=0x7f4a54016000 comp rx=0 tx=0).stop 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 -- 172.21.15.61:0/2786015724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 msgr2=0x7f4a6016d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 0x7f4a6016d8a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800ce80 tx=0x7f4a58007840 comp rx=0 tx=0).stop 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 -- 172.21.15.61:0/2786015724 shutdown_connections 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4a6006b320 0x7f4a600c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4a44066f30 0x7f4a440693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4a601578d0 0x7f4a6016d8a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 --2- 172.21.15.61:0/2786015724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a6006f6e0 0x7f4a6016d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 -- 172.21.15.61:0/2786015724 >> 172.21.15.61:0/2786015724 conn(0x7f4a600ce800 msgr2=0x7f4a600cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 -- 172.21.15.61:0/2786015724 shutdown_connections 2023-12-24T19:57:44.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.766+0000 7f4a67bc6700 1 -- 172.21.15.61:0/2786015724 wait complete. 2023-12-24T19:57:44.779 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:57:44.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.903+0000 7f7634b65700 1 Processor -- start 2023-12-24T19:57:44.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.903+0000 7f7634b65700 1 -- start start 2023-12-24T19:57:44.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f7634b65700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f76300afd60 0x7f76300cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f7634b65700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76300b0130 0x7f7630070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f7634b65700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f76300688b0 0x7f7630070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f7634b65700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763015e470 con 0x7f76300688b0 2023-12-24T19:57:44.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f7634b65700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7630068db0 con 0x7f76300b0130 2023-12-24T19:57:44.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f7634b65700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763015db40 con 0x7f76300afd60 2023-12-24T19:57:44.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762ed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f76300688b0 0x7f7630070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762ed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f76300688b0 0x7f7630070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36622/0 (socket says 172.21.15.61:36622) 2023-12-24T19:57:44.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762ed9d700 1 -- 172.21.15.61:0/3732940651 learned_addr learned my addr 172.21.15.61:0/3732940651 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:44.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762e59c700 1 --2- 172.21.15.61:0/3732940651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f76300afd60 0x7f76300cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762dd9b700 1 --2- 172.21.15.61:0/3732940651 >> v2:172.21.15.133:3300/0 conn(0x7f76300b0130 0x7f7630070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762ed9d700 1 -- 172.21.15.61:0/3732940651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f76300afd60 msgr2=0x7f76300cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762ed9d700 1 --2- 172.21.15.61:0/3732940651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f76300afd60 0x7f76300cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762ed9d700 1 -- 172.21.15.61:0/3732940651 >> v2:172.21.15.133:3300/0 conn(0x7f76300b0130 msgr2=0x7f7630070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762ed9d700 1 --2- 172.21.15.61:0/3732940651 >> v2:172.21.15.133:3300/0 conn(0x7f76300b0130 0x7f7630070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762ed9d700 1 -- 172.21.15.61:0/3732940651 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763015de20 con 0x7f76300688b0 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.904+0000 7f762ed9d700 1 --2- 172.21.15.61:0/3732940651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f76300688b0 0x7f7630070b80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f763006d0a0 tx=0x7f7628009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d64ac8bc3674d56 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f762d59a700 1 -- 172.21.15.61:0/3732940651 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762800e070 con 0x7f76300688b0 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f762d59a700 1 -- 172.21.15.61:0/3732940651 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762800ba50 con 0x7f76300688b0 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f762d59a700 1 -- 172.21.15.61:0/3732940651 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280092e0 con 0x7f76300688b0 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f7634b65700 1 -- 172.21.15.61:0/3732940651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f76300688b0 msgr2=0x7f7630070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f7634b65700 1 --2- 172.21.15.61:0/3732940651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f76300688b0 0x7f7630070b80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f763006d0a0 tx=0x7f7628009840 comp rx=0 tx=0).stop 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f7634b65700 1 -- 172.21.15.61:0/3732940651 shutdown_connections 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f7634b65700 1 --2- 172.21.15.61:0/3732940651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f76300688b0 0x7f7630070b80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f7634b65700 1 --2- 172.21.15.61:0/3732940651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f76300afd60 0x7f76300cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f7634b65700 1 --2- 172.21.15.61:0/3732940651 >> v2:172.21.15.133:3300/0 conn(0x7f76300b0130 0x7f7630070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f7634b65700 1 -- 172.21.15.61:0/3732940651 >> 172.21.15.61:0/3732940651 conn(0x7f76300ce400 msgr2=0x7f76300ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:44.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f7634b65700 1 -- 172.21.15.61:0/3732940651 shutdown_connections 2023-12-24T19:57:44.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.905+0000 7f7634b65700 1 -- 172.21.15.61:0/3732940651 wait complete. 2023-12-24T19:57:44.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.907+0000 7f7634b65700 1 Processor -- start 2023-12-24T19:57:44.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.907+0000 7f7634b65700 1 -- start start 2023-12-24T19:57:44.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.907+0000 7f7634b65700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f76300688b0 0x7f7630146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.907+0000 7f7634b65700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76300afd60 0x7f7630169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.907+0000 7f7634b65700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f763016a2c0 0x7f76300b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.907+0000 7f7634b65700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763016a710 con 0x7f763016a2c0 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.907+0000 7f7634b65700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76300c5610 con 0x7f76300afd60 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.907+0000 7f7634b65700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7630158680 con 0x7f76300688b0 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.907+0000 7f762ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f763016a2c0 0x7f76300b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.907+0000 7f762ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f763016a2c0 0x7f76300b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36638/0 (socket says 172.21.15.61:36638) 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f762ed9d700 1 -- 172.21.15.61:0/668663702 learned_addr learned my addr 172.21.15.61:0/668663702 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f762e59c700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f76300688b0 0x7f7630146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f762dd9b700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76300afd60 0x7f7630169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f762ed9d700 1 -- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f76300688b0 msgr2=0x7f7630146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f762ed9d700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f76300688b0 0x7f7630146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f762ed9d700 1 -- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76300afd60 msgr2=0x7f7630169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f762ed9d700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76300afd60 0x7f7630169d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f762ed9d700 1 -- 172.21.15.61:0/668663702 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7628009ae0 con 0x7f763016a2c0 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f762ed9d700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f763016a2c0 0x7f76300b18a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f763006cbb0 tx=0x7f7628018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:44.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f761e7fc700 1 -- 172.21.15.61:0/668663702 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280032f0 con 0x7f763016a2c0 2023-12-24T19:57:44.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f761e7fc700 1 -- 172.21.15.61:0/668663702 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7628008e80 con 0x7f763016a2c0 2023-12-24T19:57:44.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f7634b65700 1 -- 172.21.15.61:0/668663702 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763016a940 con 0x7f763016a2c0 2023-12-24T19:57:44.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f761e7fc700 1 -- 172.21.15.61:0/668663702 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280266b0 con 0x7f763016a2c0 2023-12-24T19:57:44.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.908+0000 7f7634b65700 1 -- 172.21.15.61:0/668663702 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763016d4a0 con 0x7f763016a2c0 2023-12-24T19:57:44.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.909+0000 7f7634b65700 1 -- 172.21.15.61:0/668663702 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763004c3c0 con 0x7f763016a2c0 2023-12-24T19:57:44.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.910+0000 7f761e7fc700 1 -- 172.21.15.61:0/668663702 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7628003040 con 0x7f763016a2c0 2023-12-24T19:57:44.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.910+0000 7f761e7fc700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7610066f30 0x7f76100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:44.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.910+0000 7f761e7fc700 1 -- 172.21.15.61:0/668663702 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f76280865b0 con 0x7f763016a2c0 2023-12-24T19:57:44.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.910+0000 7f762e59c700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7610066f30 0x7f76100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:44.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.911+0000 7f762e59c700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7610066f30 0x7f76100693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7620006fd0 tx=0x7f7620008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:44.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:44.914+0000 7f761e7fc700 1 -- 172.21.15.61:0/668663702 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7628053820 con 0x7f763016a2c0 2023-12-24T19:57:45.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.109+0000 7f7634b65700 1 -- 172.21.15.61:0/668663702 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7630071490 con 0x7f763016a2c0 2023-12-24T19:57:45.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.110+0000 7f761e7fc700 1 -- 172.21.15.61:0/668663702 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7628009940 con 0x7f763016a2c0 2023-12-24T19:57:45.110 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T19:57:45.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.111+0000 7f7634b65700 1 -- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7610066f30 msgr2=0x7f76100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.111+0000 7f7634b65700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7610066f30 0x7f76100693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7620006fd0 tx=0x7f7620008040 comp rx=0 tx=0).stop 2023-12-24T19:57:45.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.112+0000 7f7634b65700 1 -- 172.21.15.61:0/668663702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f763016a2c0 msgr2=0x7f76300b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.112+0000 7f7634b65700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f763016a2c0 0x7f76300b18a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f763006cbb0 tx=0x7f7628018000 comp rx=0 tx=0).stop 2023-12-24T19:57:45.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.112+0000 7f7634b65700 1 -- 172.21.15.61:0/668663702 shutdown_connections 2023-12-24T19:57:45.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.112+0000 7f7634b65700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f76300688b0 0x7f7630146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.112+0000 7f7634b65700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7610066f30 0x7f76100693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.112+0000 7f7634b65700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f763016a2c0 0x7f76300b18a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.112+0000 7f7634b65700 1 --2- 172.21.15.61:0/668663702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76300afd60 0x7f7630169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.112+0000 7f7634b65700 1 -- 172.21.15.61:0/668663702 >> 172.21.15.61:0/668663702 conn(0x7f76300ce400 msgr2=0x7f7630158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:45.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.112+0000 7f7634b65700 1 -- 172.21.15.61:0/668663702 shutdown_connections 2023-12-24T19:57:45.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.112+0000 7f7634b65700 1 -- 172.21.15.61:0/668663702 wait complete. 2023-12-24T19:57:45.124 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:57:45.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.248+0000 7f7a5e64a700 1 Processor -- start 2023-12-24T19:57:45.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.248+0000 7f7a5e64a700 1 -- start start 2023-12-24T19:57:45.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.249+0000 7f7a5e64a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580af7b0 0x7f7a58070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.249+0000 7f7a5e64a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a58070b80 0x7f7a58067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.249+0000 7f7a5e64a700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a580b03a0 con 0x7f7a58157b70 2023-12-24T19:57:45.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.249+0000 7f7a5e64a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5815bcb0 con 0x7f7a58070b80 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.249+0000 7f7a5e64a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58070fc0 con 0x7f7a580af7b0 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.249+0000 7f7a57fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7a58157b70 0x7f7a58068980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46472/0 (socket says 172.21.15.61:46472) 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.249+0000 7f7a57fff700 1 -- 172.21.15.61:0/1410019120 learned_addr learned my addr 172.21.15.61:0/1410019120 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.249+0000 7f7a577fe700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580af7b0 0x7f7a58070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.249+0000 7f7a5cbe7700 1 --2- 172.21.15.61:0/1410019120 >> v2:172.21.15.133:3300/0 conn(0x7f7a58070b80 0x7f7a58067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134884907 0 0) 0x7f7a580b03a0 con 0x7f7a58157b70 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a40003570 con 0x7f7a58157b70 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4048601914 0 0) 0x7f7a40003570 con 0x7f7a58157b70 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580af7b0 msgr2=0x7f7a58070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580af7b0 0x7f7a58070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 >> v2:172.21.15.133:3300/0 conn(0x7f7a58070b80 msgr2=0x7f7a58067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 --2- 172.21.15.61:0/1410019120 >> v2:172.21.15.133:3300/0 conn(0x7f7a58070b80 0x7f7a58067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a580afde0 con 0x7f7a58157b70 2023-12-24T19:57:45.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f7a48001470 con 0x7f7a58157b70 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 >> v1:172.21.15.61:6789/0 conn(0x7f7a58157b70 legacy=0x7f7a58068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580af7b0 0x7f7a40003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a40003fe0 0x7f7a40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 0x7f7a400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5815bcb0 con 0x7f7a40004d50 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58070fc0 con 0x7f7a40003fe0 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4000bb40 con 0x7f7a580af7b0 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a5cbe7700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 0x7f7a400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a577fe700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a40003fe0 0x7f7a40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a57fff700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580af7b0 0x7f7a40003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a5cbe7700 1 -- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580af7b0 msgr2=0x7f7a40003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a5cbe7700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580af7b0 0x7f7a40003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a5cbe7700 1 -- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a40003fe0 msgr2=0x7f7a40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a5cbe7700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a40003fe0 0x7f7a40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.250+0000 7f7a5cbe7700 1 -- 172.21.15.61:0/1410019120 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40003570 con 0x7f7a40004d50 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a5cbe7700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 0x7f7a400051c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7a500094d0 tx=0x7f7a5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f751a0aa456e3f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000ea90 con 0x7f7a40004d50 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5000f040 con 0x7f7a40004d50 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a56ffd700 1 -- 172.21.15.61:0/1410019120 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000ee20 con 0x7f7a40004d50 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a5e64a700 1 -- 172.21.15.61:0/1410019120 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 msgr2=0x7f7a400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a5e64a700 1 --2- 172.21.15.61:0/1410019120 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 0x7f7a400051c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7a500094d0 tx=0x7f7a5000b040 comp rx=0 tx=0).stop 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a5cbe7700 1 -- 172.21.15.61:0/1410019120 reap_dead start 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a5e64a700 1 -- 172.21.15.61:0/1410019120 shutdown_connections 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a5e64a700 1 -- 172.21.15.61:0/1410019120 >> 172.21.15.61:0/1410019120 conn(0x7f7a580ce420 msgr2=0x7f7a580ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:45.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a5e64a700 1 -- 172.21.15.61:0/1410019120 shutdown_connections 2023-12-24T19:57:45.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.251+0000 7f7a5e64a700 1 -- 172.21.15.61:0/1410019120 wait complete. 2023-12-24T19:57:45.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.253+0000 7f7a5e64a700 1 Processor -- start 2023-12-24T19:57:45.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.253+0000 7f7a5e64a700 1 -- start start 2023-12-24T19:57:45.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a5e64a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 0x7f7a5814f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a5e64a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580b1150 0x7f7a581662c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a5e64a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a580c6c00 0x7f7a580b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a5e64a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58165e30 con 0x7f7a40004d50 2023-12-24T19:57:45.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a5e64a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a58165570 con 0x7f7a580c6c00 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a5e64a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a580b16a0 con 0x7f7a580b1150 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a57fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 0x7f7a5814f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a57fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 0x7f7a5814f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36660/0 (socket says 172.21.15.61:36660) 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a57fff700 1 -- 172.21.15.61:0/2340888162 learned_addr learned my addr 172.21.15.61:0/2340888162 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a577fe700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580b1150 0x7f7a581662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a5cbe7700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a580c6c00 0x7f7a580b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a57fff700 1 -- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580b1150 msgr2=0x7f7a581662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a57fff700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580b1150 0x7f7a581662c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a57fff700 1 -- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a580c6c00 msgr2=0x7f7a580b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a57fff700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a580c6c00 0x7f7a580b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a57fff700 1 -- 172.21.15.61:0/2340888162 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a581657e0 con 0x7f7a40004d50 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.254+0000 7f7a5cbe7700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a580c6c00 0x7f7a580b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.255+0000 7f7a57fff700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 0x7f7a5814f7b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7a480010e0 tx=0x7f7a48001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:45.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.255+0000 7f7a3ffff700 1 -- 172.21.15.61:0/2340888162 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a480173f0 con 0x7f7a40004d50 2023-12-24T19:57:45.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.255+0000 7f7a3ffff700 1 -- 172.21.15.61:0/2340888162 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48017550 con 0x7f7a40004d50 2023-12-24T19:57:45.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.255+0000 7f7a5e64a700 1 -- 172.21.15.61:0/2340888162 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a58165ac0 con 0x7f7a40004d50 2023-12-24T19:57:45.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.255+0000 7f7a3ffff700 1 -- 172.21.15.61:0/2340888162 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48017910 con 0x7f7a40004d50 2023-12-24T19:57:45.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.255+0000 7f7a5e64a700 1 -- 172.21.15.61:0/2340888162 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a580c7230 con 0x7f7a40004d50 2023-12-24T19:57:45.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.256+0000 7f7a5e64a700 1 -- 172.21.15.61:0/2340888162 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a58166800 con 0x7f7a40004d50 2023-12-24T19:57:45.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.256+0000 7f7a3ffff700 1 -- 172.21.15.61:0/2340888162 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7a4800bd50 con 0x7f7a40004d50 2023-12-24T19:57:45.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.257+0000 7f7a3ffff700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a44066f30 0x7f7a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.257+0000 7f7a3ffff700 1 -- 172.21.15.61:0/2340888162 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a48089030 con 0x7f7a40004d50 2023-12-24T19:57:45.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.257+0000 7f7a577fe700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a44066f30 0x7f7a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.258+0000 7f7a577fe700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a44066f30 0x7f7a440693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c006eb0 tx=0x7f7a4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:45.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.261+0000 7f7a3ffff700 1 -- 172.21.15.61:0/2340888162 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a480562a0 con 0x7f7a40004d50 2023-12-24T19:57:45.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.454+0000 7f7a5e64a700 1 -- 172.21.15.61:0/2340888162 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a5804c3c0 con 0x7f7a40004d50 2023-12-24T19:57:45.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.454+0000 7f7a3ffff700 1 -- 172.21.15.61:0/2340888162 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a480598c0 con 0x7f7a40004d50 2023-12-24T19:57:45.455 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T19:57:45.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 -- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a44066f30 msgr2=0x7f7a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a44066f30 0x7f7a440693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c006eb0 tx=0x7f7a4c008040 comp rx=0 tx=0).stop 2023-12-24T19:57:45.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 -- 172.21.15.61:0/2340888162 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 msgr2=0x7f7a5814f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 0x7f7a5814f7b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7a480010e0 tx=0x7f7a48001e90 comp rx=0 tx=0).stop 2023-12-24T19:57:45.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 -- 172.21.15.61:0/2340888162 shutdown_connections 2023-12-24T19:57:45.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a44066f30 0x7f7a440693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a580c6c00 0x7f7a580b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a40004d50 0x7f7a5814f7b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 --2- 172.21.15.61:0/2340888162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a580b1150 0x7f7a581662c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 -- 172.21.15.61:0/2340888162 >> 172.21.15.61:0/2340888162 conn(0x7f7a580ce420 msgr2=0x7f7a58152470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:45.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 -- 172.21.15.61:0/2340888162 shutdown_connections 2023-12-24T19:57:45.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.456+0000 7f7a5e64a700 1 -- 172.21.15.61:0/2340888162 wait complete. 2023-12-24T19:57:45.469 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:57:45.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.590+0000 7fce53a07700 1 Processor -- start 2023-12-24T19:57:45.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.590+0000 7fce53a07700 1 -- start start 2023-12-24T19:57:45.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.591+0000 7fce53a07700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fce4c159b00 0x7fce4c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.591+0000 7fce53a07700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce4c0af7d0 0x7fce4c0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.591+0000 7fce53a07700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c0a84d0 con 0x7fce4c070640 2023-12-24T19:57:45.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.591+0000 7fce53a07700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c0b01b0 con 0x7fce4c159b00 2023-12-24T19:57:45.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.591+0000 7fce53a07700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c0a7620 con 0x7fce4c0af7d0 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.591+0000 7fce517a3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fce4c159b00 0x7fce4c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.591+0000 7fce517a3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fce4c159b00 0x7fce4c067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36668/0 (socket says 172.21.15.61:36668) 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.591+0000 7fce517a3700 1 -- 172.21.15.61:0/542131721 learned_addr learned my addr 172.21.15.61:0/542131721 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.592+0000 7fce50fa2700 1 --2- 172.21.15.61:0/542131721 >> v2:172.21.15.133:3300/0 conn(0x7fce4c0af7d0 0x7fce4c0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.592+0000 7fce517a3700 1 -- 172.21.15.61:0/542131721 >> v2:172.21.15.133:3300/0 conn(0x7fce4c0af7d0 msgr2=0x7fce4c0afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.592+0000 7fce517a3700 1 --2- 172.21.15.61:0/542131721 >> v2:172.21.15.133:3300/0 conn(0x7fce4c0af7d0 0x7fce4c0afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.592+0000 7fce517a3700 1 -- 172.21.15.61:0/542131721 >> v1:172.21.15.133:6789/0 conn(0x7fce4c070640 legacy=0x7fce4c070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.592+0000 7fce517a3700 1 -- 172.21.15.61:0/542131721 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c0a78c0 con 0x7fce4c159b00 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.592+0000 7fce517a3700 1 --2- 172.21.15.61:0/542131721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c159b00 0x7fce4c067550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0cd6c0 tx=0x7fce3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855fc1b50dcff1ac server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.592+0000 7fce43fff700 1 -- 172.21.15.61:0/542131721 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c009e70 con 0x7fce4c159b00 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.592+0000 7fce43fff700 1 -- 172.21.15.61:0/542131721 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c00b860 con 0x7fce4c159b00 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.592+0000 7fce43fff700 1 -- 172.21.15.61:0/542131721 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00bc00 con 0x7fce4c159b00 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.593+0000 7fce53a07700 1 -- 172.21.15.61:0/542131721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c159b00 msgr2=0x7fce4c067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.593+0000 7fce53a07700 1 --2- 172.21.15.61:0/542131721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c159b00 0x7fce4c067550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0cd6c0 tx=0x7fce3c009250 comp rx=0 tx=0).stop 2023-12-24T19:57:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.593+0000 7fce53a07700 1 -- 172.21.15.61:0/542131721 shutdown_connections 2023-12-24T19:57:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.593+0000 7fce53a07700 1 --2- 172.21.15.61:0/542131721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c159b00 0x7fce4c067550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.593+0000 7fce53a07700 1 --2- 172.21.15.61:0/542131721 >> v2:172.21.15.133:3300/0 conn(0x7fce4c0af7d0 0x7fce4c0afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.593+0000 7fce53a07700 1 -- 172.21.15.61:0/542131721 >> 172.21.15.61:0/542131721 conn(0x7fce4c0ca200 msgr2=0x7fce4c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.593+0000 7fce53a07700 1 -- 172.21.15.61:0/542131721 shutdown_connections 2023-12-24T19:57:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.593+0000 7fce53a07700 1 -- 172.21.15.61:0/542131721 wait complete. 2023-12-24T19:57:45.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.594+0000 7fce53a07700 1 Processor -- start 2023-12-24T19:57:45.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.594+0000 7fce53a07700 1 -- start start 2023-12-24T19:57:45.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce53a07700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce4c070640 0x7fce4c15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce53a07700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c0af7d0 0x7fce4c15c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce53a07700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c159b00 0x7fce4c14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce53a07700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1592f0 con 0x7fce4c0af7d0 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce53a07700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c15e9f0 con 0x7fce4c159b00 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce53a07700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c15f3c0 con 0x7fce4c070640 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce50fa2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c0af7d0 0x7fce4c15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce50fa2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c0af7d0 0x7fce4c15c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36676/0 (socket says 172.21.15.61:36676) 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce50fa2700 1 -- 172.21.15.61:0/2544168825 learned_addr learned my addr 172.21.15.61:0/2544168825 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce51fa4700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c159b00 0x7fce4c14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce517a3700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce4c070640 0x7fce4c15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce50fa2700 1 -- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce4c070640 msgr2=0x7fce4c15ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce50fa2700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce4c070640 0x7fce4c15ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce50fa2700 1 -- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c159b00 msgr2=0x7fce4c14c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce50fa2700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c159b00 0x7fce4c14c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.595+0000 7fce50fa2700 1 -- 172.21.15.61:0/2544168825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0094f0 con 0x7fce4c0af7d0 2023-12-24T19:57:45.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.596+0000 7fce50fa2700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c0af7d0 0x7fce4c15c900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce4800ecb0 tx=0x7fce480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:45.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.596+0000 7fce417fa700 1 -- 172.21.15.61:0/2544168825 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4800c850 con 0x7fce4c0af7d0 2023-12-24T19:57:45.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.596+0000 7fce417fa700 1 -- 172.21.15.61:0/2544168825 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4800c9b0 con 0x7fce4c0af7d0 2023-12-24T19:57:45.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.596+0000 7fce53a07700 1 -- 172.21.15.61:0/2544168825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c158a50 con 0x7fce4c0af7d0 2023-12-24T19:57:45.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.596+0000 7fce417fa700 1 -- 172.21.15.61:0/2544168825 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4800cd50 con 0x7fce4c0af7d0 2023-12-24T19:57:45.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.596+0000 7fce53a07700 1 -- 172.21.15.61:0/2544168825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c159010 con 0x7fce4c0af7d0 2023-12-24T19:57:45.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.597+0000 7fce53a07700 1 -- 172.21.15.61:0/2544168825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4c15eb80 con 0x7fce4c0af7d0 2023-12-24T19:57:45.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.597+0000 7fce417fa700 1 -- 172.21.15.61:0/2544168825 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fce48013680 con 0x7fce4c0af7d0 2023-12-24T19:57:45.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.598+0000 7fce417fa700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fce30066f30 0x7fce300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.598+0000 7fce417fa700 1 -- 172.21.15.61:0/2544168825 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce48084760 con 0x7fce4c0af7d0 2023-12-24T19:57:45.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.599+0000 7fce517a3700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fce30066f30 0x7fce300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.600+0000 7fce517a3700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fce30066f30 0x7fce300693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0cd6c0 tx=0x7fce3c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:45.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.602+0000 7fce417fa700 1 -- 172.21.15.61:0/2544168825 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce480519d0 con 0x7fce4c0af7d0 2023-12-24T19:57:45.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.843+0000 7fce53a07700 1 -- 172.21.15.61:0/2544168825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce4c04c3c0 con 0x7fce4c0af7d0 2023-12-24T19:57:45.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.844+0000 7fce417fa700 1 -- 172.21.15.61:0/2544168825 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fce48054ff0 con 0x7fce4c0af7d0 2023-12-24T19:57:45.845 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:45.845 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3729732902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3729732902},{"type":"v1","addr":"172.21.15.61:6834","nonce":3729732902}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/402997858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":402997858},{"type":"v1","addr":"172.21.15.133:6837","nonce":402997858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/180373533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":180373533},{"type":"v1","addr":"172.21.15.61:6835","nonce":180373533}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:06.924129+0000","modified":"2023-12-24T19:57:10.540414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/74793696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":74793696},{"type":"v1","addr":"172.21.15.133:6836","nonce":74793696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T19:57:45.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.845+0000 7fce53a07700 1 -- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fce30066f30 msgr2=0x7fce300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.845+0000 7fce53a07700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fce30066f30 0x7fce300693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0cd6c0 tx=0x7fce3c017000 comp rx=0 tx=0).stop 2023-12-24T19:57:45.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.845+0000 7fce53a07700 1 -- 172.21.15.61:0/2544168825 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c0af7d0 msgr2=0x7fce4c15c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.845+0000 7fce53a07700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c0af7d0 0x7fce4c15c900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce4800ecb0 tx=0x7fce480091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.846+0000 7fce53a07700 1 -- 172.21.15.61:0/2544168825 shutdown_connections 2023-12-24T19:57:45.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.846+0000 7fce53a07700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fce4c070640 0x7fce4c15ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.846+0000 7fce53a07700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fce30066f30 0x7fce300693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.846+0000 7fce53a07700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c159b00 0x7fce4c14c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.846+0000 7fce53a07700 1 --2- 172.21.15.61:0/2544168825 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fce4c0af7d0 0x7fce4c15c900 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.846+0000 7fce53a07700 1 -- 172.21.15.61:0/2544168825 >> 172.21.15.61:0/2544168825 conn(0x7fce4c0ca200 msgr2=0x7fce4c0cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:45.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.846+0000 7fce53a07700 1 -- 172.21.15.61:0/2544168825 shutdown_connections 2023-12-24T19:57:45.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.846+0000 7fce53a07700 1 -- 172.21.15.61:0/2544168825 wait complete. 2023-12-24T19:57:45.849 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 7 2023-12-24T19:57:45.859 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:45.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.980+0000 7fda7a606700 1 Processor -- start 2023-12-24T19:57:45.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.980+0000 7fda7a606700 1 -- start start 2023-12-24T19:57:45.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.981+0000 7fda7a606700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068140 0x7fda740cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.981+0000 7fda7a606700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda74068510 0x7fda740b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.981+0000 7fda7a606700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fda74159a60 0x7fda74159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.981+0000 7fda7a606700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda740b2890 con 0x7fda74159a60 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.981+0000 7fda7a606700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda740b11e0 con 0x7fda74068510 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.981+0000 7fda7a606700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda740cf630 con 0x7fda74068140 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.981+0000 7fda78ba3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fda74159a60 0x7fda74159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.981+0000 7fda78ba3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fda74159a60 0x7fda74159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36678/0 (socket says 172.21.15.61:36678) 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.981+0000 7fda78ba3700 1 -- 172.21.15.61:0/2612343335 learned_addr learned my addr 172.21.15.61:0/2612343335 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda737fe700 1 --2- 172.21.15.61:0/2612343335 >> v2:172.21.15.133:3300/0 conn(0x7fda74068510 0x7fda740b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda73fff700 1 --2- 172.21.15.61:0/2612343335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068140 0x7fda740cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda78ba3700 1 -- 172.21.15.61:0/2612343335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068140 msgr2=0x7fda740cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda78ba3700 1 --2- 172.21.15.61:0/2612343335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068140 0x7fda740cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda78ba3700 1 -- 172.21.15.61:0/2612343335 >> v2:172.21.15.133:3300/0 conn(0x7fda74068510 msgr2=0x7fda740b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda78ba3700 1 --2- 172.21.15.61:0/2612343335 >> v2:172.21.15.133:3300/0 conn(0x7fda74068510 0x7fda740b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda78ba3700 1 -- 172.21.15.61:0/2612343335 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740b2240 con 0x7fda74159a60 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda78ba3700 1 --2- 172.21.15.61:0/2612343335 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74159a60 0x7fda74159ee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fda7406d830 tx=0x7fda6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29de54d95fb0819e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda72ffd700 1 -- 172.21.15.61:0/2612343335 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c00e070 con 0x7fda74159a60 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda72ffd700 1 -- 172.21.15.61:0/2612343335 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c00ba50 con 0x7fda74159a60 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.982+0000 7fda72ffd700 1 -- 172.21.15.61:0/2612343335 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0092e0 con 0x7fda74159a60 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.983+0000 7fda7a606700 1 -- 172.21.15.61:0/2612343335 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74159a60 msgr2=0x7fda74159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.983+0000 7fda7a606700 1 --2- 172.21.15.61:0/2612343335 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74159a60 0x7fda74159ee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fda7406d830 tx=0x7fda6c009840 comp rx=0 tx=0).stop 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.983+0000 7fda7a606700 1 -- 172.21.15.61:0/2612343335 shutdown_connections 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.983+0000 7fda7a606700 1 --2- 172.21.15.61:0/2612343335 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74159a60 0x7fda74159ee0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.983+0000 7fda7a606700 1 --2- 172.21.15.61:0/2612343335 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068140 0x7fda740cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.983+0000 7fda7a606700 1 --2- 172.21.15.61:0/2612343335 >> v2:172.21.15.133:3300/0 conn(0x7fda74068510 0x7fda740b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.983+0000 7fda7a606700 1 -- 172.21.15.61:0/2612343335 >> 172.21.15.61:0/2612343335 conn(0x7fda74097a10 msgr2=0x7fda740ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:45.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.983+0000 7fda7a606700 1 -- 172.21.15.61:0/2612343335 shutdown_connections 2023-12-24T19:57:45.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.983+0000 7fda7a606700 1 -- 172.21.15.61:0/2612343335 wait complete. 2023-12-24T19:57:45.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.984+0000 7fda7a606700 1 Processor -- start 2023-12-24T19:57:45.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.984+0000 7fda7a606700 1 -- start start 2023-12-24T19:57:45.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.985+0000 7fda7a606700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74068140 0x7fda74156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.985+0000 7fda7a606700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068510 0x7fda74169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.985+0000 7fda7a606700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda74159a60 0x7fda7416c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.985+0000 7fda7a606700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda740995e0 con 0x7fda74068140 2023-12-24T19:57:45.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.985+0000 7fda7a606700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda740989d0 con 0x7fda74159a60 2023-12-24T19:57:45.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.985+0000 7fda7a606700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda74098cb0 con 0x7fda74068510 2023-12-24T19:57:45.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.985+0000 7fda73fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74068140 0x7fda74156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.985+0000 7fda73fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74068140 0x7fda74156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36692/0 (socket says 172.21.15.61:36692) 2023-12-24T19:57:45.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.985+0000 7fda73fff700 1 -- 172.21.15.61:0/3357460742 learned_addr learned my addr 172.21.15.61:0/3357460742 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:45.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda78ba3700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda74159a60 0x7fda7416c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda73fff700 1 -- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068510 msgr2=0x7fda74169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda737fe700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068510 0x7fda74169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda73fff700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068510 0x7fda74169b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda73fff700 1 -- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda74159a60 msgr2=0x7fda7416c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:45.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda73fff700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda74159a60 0x7fda7416c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:45.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda73fff700 1 -- 172.21.15.61:0/3357460742 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c009ae0 con 0x7fda74068140 2023-12-24T19:57:45.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda78ba3700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda74159a60 0x7fda7416c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:45.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda737fe700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068510 0x7fda74169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:45.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda73fff700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74068140 0x7fda74156df0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fda6400c850 tx=0x7fda64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:45.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda5bfff700 1 -- 172.21.15.61:0/3357460742 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64011600 con 0x7fda74068140 2023-12-24T19:57:45.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda5bfff700 1 -- 172.21.15.61:0/3357460742 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda64011780 con 0x7fda74068140 2023-12-24T19:57:45.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda7a606700 1 -- 172.21.15.61:0/3357460742 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda74098f90 con 0x7fda74068140 2023-12-24T19:57:45.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda5bfff700 1 -- 172.21.15.61:0/3357460742 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64011b40 con 0x7fda74068140 2023-12-24T19:57:45.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.986+0000 7fda7a606700 1 -- 172.21.15.61:0/3357460742 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7416ce50 con 0x7fda74068140 2023-12-24T19:57:45.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.987+0000 7fda7a606700 1 -- 172.21.15.61:0/3357460742 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7406d440 con 0x7fda74068140 2023-12-24T19:57:45.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.987+0000 7fda5bfff700 1 -- 172.21.15.61:0/3357460742 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fda640193f0 con 0x7fda74068140 2023-12-24T19:57:45.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.988+0000 7fda5bfff700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fda60066f60 0x7fda60069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:45.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.988+0000 7fda5bfff700 1 -- 172.21.15.61:0/3357460742 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda640848e0 con 0x7fda74068140 2023-12-24T19:57:45.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.988+0000 7fda737fe700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fda60066f60 0x7fda60069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:45.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.989+0000 7fda737fe700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fda60066f60 0x7fda60069410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fda74097e00 tx=0x7fda68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:45.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:45.992+0000 7fda5bfff700 1 -- 172.21.15.61:0/3357460742 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda64051b50 con 0x7fda74068140 2023-12-24T19:57:46.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.186+0000 7fda7a606700 1 -- 172.21.15.61:0/3357460742 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda7404c3c0 con 0x7fda74068140 2023-12-24T19:57:46.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.187+0000 7fda5bfff700 1 -- 172.21.15.61:0/3357460742 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fda64055170 con 0x7fda74068140 2023-12-24T19:57:46.188 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:46.188 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:46.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.189+0000 7fda7a606700 1 -- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fda60066f60 msgr2=0x7fda60069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.189+0000 7fda7a606700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fda60066f60 0x7fda60069410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fda74097e00 tx=0x7fda68008040 comp rx=0 tx=0).stop 2023-12-24T19:57:46.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.189+0000 7fda7a606700 1 -- 172.21.15.61:0/3357460742 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74068140 msgr2=0x7fda74156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.189+0000 7fda7a606700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74068140 0x7fda74156df0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fda6400c850 tx=0x7fda64008040 comp rx=0 tx=0).stop 2023-12-24T19:57:46.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.189+0000 7fda7a606700 1 -- 172.21.15.61:0/3357460742 shutdown_connections 2023-12-24T19:57:46.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.189+0000 7fda7a606700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fda60066f60 0x7fda60069410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.189+0000 7fda7a606700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda74159a60 0x7fda7416c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.189+0000 7fda7a606700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fda74068140 0x7fda74156df0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.189+0000 7fda7a606700 1 --2- 172.21.15.61:0/3357460742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fda74068510 0x7fda74169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.189+0000 7fda7a606700 1 -- 172.21.15.61:0/3357460742 >> 172.21.15.61:0/3357460742 conn(0x7fda74097a10 msgr2=0x7fda74157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:46.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.190+0000 7fda7a606700 1 -- 172.21.15.61:0/3357460742 shutdown_connections 2023-12-24T19:57:46.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.190+0000 7fda7a606700 1 -- 172.21.15.61:0/3357460742 wait complete. 2023-12-24T19:57:46.202 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T19:57:46.203 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:57:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.324+0000 7fbacdd9e700 1 Processor -- start 2023-12-24T19:57:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.324+0000 7fbacdd9e700 1 -- start start 2023-12-24T19:57:46.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbacdd9e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80ae3a0 0x7fbac81612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbacdd9e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac80acf00 con 0x7fbac80b2320 2023-12-24T19:57:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbacdd9e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac80b27a0 con 0x7fbac806e380 2023-12-24T19:57:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbacdd9e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac806f210 con 0x7fbac80ae3a0 2023-12-24T19:57:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac7fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fbac80b2320 0x7fbac8159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46474/0 (socket says 172.21.15.61:46474) 2023-12-24T19:57:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac7fff700 1 -- 172.21.15.61:0/1935129217 learned_addr learned my addr 172.21.15.61:0/1935129217 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbacd59d700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80ae3a0 0x7fbac81612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287233051 0 0) 0x7fbac80acf00 con 0x7fbac80b2320 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab8003570 con 0x7fbac80b2320 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2841358254 0 0) 0x7fbab8003570 con 0x7fbac80b2320 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80ae3a0 msgr2=0x7fbac81612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80ae3a0 0x7fbac81612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 >> v1:172.21.15.133:6789/0 conn(0x7fbac806e380 legacy=0x7fbac806e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80ac5d0 con 0x7fbac80b2320 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fbab4001470 con 0x7fbac80b2320 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 >> v1:172.21.15.61:6789/0 conn(0x7fbac80b2320 legacy=0x7fbac8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbab8003a90 0x7fbab8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 0x7fbab8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80ae3a0 0x7fbab80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac806f210 con 0x7fbab8004810 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab800bb10 con 0x7fbab8003a90 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.325+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab800dee0 con 0x7fbac80ae3a0 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbac7fff700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 0x7fbab8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbaccd9c700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbab8003a90 0x7fbab8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbacd59d700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80ae3a0 0x7fbab80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbac7fff700 1 -- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80ae3a0 msgr2=0x7fbab80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbac7fff700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80ae3a0 0x7fbab80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbac7fff700 1 -- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbab8003a90 msgr2=0x7fbab8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbac7fff700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbab8003a90 0x7fbab8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbac7fff700 1 -- 172.21.15.61:0/1935129217 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8003570 con 0x7fbab8004810 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbac7fff700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 0x7fbab8004c80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c390 tx=0x7fbac80ace70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8954452051bdb3a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab400cc60 con 0x7fbab8004810 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab400ce00 con 0x7fbab8004810 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.326+0000 7fbac77fe700 1 -- 172.21.15.61:0/1935129217 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab4005b70 con 0x7fbab8004810 2023-12-24T19:57:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.327+0000 7fbacdd9e700 1 -- 172.21.15.61:0/1935129217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 msgr2=0x7fbab8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.327+0000 7fbacdd9e700 1 --2- 172.21.15.61:0/1935129217 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 0x7fbab8004c80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c390 tx=0x7fbac80ace70 comp rx=0 tx=0).stop 2023-12-24T19:57:46.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.327+0000 7fbacd59d700 1 -- 172.21.15.61:0/1935129217 reap_dead start 2023-12-24T19:57:46.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.327+0000 7fbacdd9e700 1 -- 172.21.15.61:0/1935129217 shutdown_connections 2023-12-24T19:57:46.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.327+0000 7fbacdd9e700 1 -- 172.21.15.61:0/1935129217 >> 172.21.15.61:0/1935129217 conn(0x7fbac80ccd10 msgr2=0x7fbac80cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:46.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.327+0000 7fbacdd9e700 1 -- 172.21.15.61:0/1935129217 shutdown_connections 2023-12-24T19:57:46.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.327+0000 7fbacdd9e700 1 -- 172.21.15.61:0/1935129217 wait complete. 2023-12-24T19:57:46.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.328+0000 7fbacdd9e700 1 Processor -- start 2023-12-24T19:57:46.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.328+0000 7fbacdd9e700 1 -- start start 2023-12-24T19:57:46.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbacdd9e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 0x7fbac8165cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbacdd9e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8168ab0 0x7fbac80c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbacdd9e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80c4200 0x7fbac80aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbacdd9e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80c46a0 con 0x7fbab8004810 2023-12-24T19:57:46.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbacdd9e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80c23e0 con 0x7fbac8168ab0 2023-12-24T19:57:46.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbacdd9e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac8166210 con 0x7fbac80c4200 2023-12-24T19:57:46.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbaccd9c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 0x7fbac8165cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbaccd9c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 0x7fbac8165cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36718/0 (socket says 172.21.15.61:36718) 2023-12-24T19:57:46.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbaccd9c700 1 -- 172.21.15.61:0/2027770353 learned_addr learned my addr 172.21.15.61:0/2027770353 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:46.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbac7fff700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8168ab0 0x7fbac80c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbacd59d700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80c4200 0x7fbac80aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbaccd9c700 1 -- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80c4200 msgr2=0x7fbac80aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbaccd9c700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80c4200 0x7fbac80aa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbaccd9c700 1 -- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8168ab0 msgr2=0x7fbac80c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbaccd9c700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8168ab0 0x7fbac80c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbaccd9c700 1 -- 172.21.15.61:0/2027770353 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80ab2c0 con 0x7fbab8004810 2023-12-24T19:57:46.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbacd59d700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80c4200 0x7fbac80aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:46.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbaccd9c700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 0x7fbac8165cd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbabc002be0 tx=0x7fbabc007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:46.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.329+0000 7fbac4ff9700 1 -- 172.21.15.61:0/2027770353 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00f9a0 con 0x7fbab8004810 2023-12-24T19:57:46.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.330+0000 7fbac4ff9700 1 -- 172.21.15.61:0/2027770353 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc00fb20 con 0x7fbab8004810 2023-12-24T19:57:46.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.330+0000 7fbacdd9e700 1 -- 172.21.15.61:0/2027770353 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac80c1ab0 con 0x7fbab8004810 2023-12-24T19:57:46.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.330+0000 7fbac4ff9700 1 -- 172.21.15.61:0/2027770353 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00fee0 con 0x7fbab8004810 2023-12-24T19:57:46.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.330+0000 7fbacdd9e700 1 -- 172.21.15.61:0/2027770353 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac80c2070 con 0x7fbab8004810 2023-12-24T19:57:46.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.331+0000 7fbacdd9e700 1 -- 172.21.15.61:0/2027770353 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac804bb80 con 0x7fbab8004810 2023-12-24T19:57:46.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.331+0000 7fbac4ff9700 1 -- 172.21.15.61:0/2027770353 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbabc013600 con 0x7fbab8004810 2023-12-24T19:57:46.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.331+0000 7fbac4ff9700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbaac066f30 0x7fbaac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.331+0000 7fbac4ff9700 1 -- 172.21.15.61:0/2027770353 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbabc084c70 con 0x7fbab8004810 2023-12-24T19:57:46.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.332+0000 7fbac7fff700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbaac066f30 0x7fbaac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.332+0000 7fbac7fff700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbaac066f30 0x7fbaac0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c390 tx=0x7fbab4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:46.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.336+0000 7fbac4ff9700 1 -- 172.21.15.61:0/2027770353 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbabc051ee0 con 0x7fbab8004810 2023-12-24T19:57:46.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.575+0000 7fbacdd9e700 1 -- 172.21.15.61:0/2027770353 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbac80cd4e0 con 0x7fbab8004810 2023-12-24T19:57:46.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.576+0000 7fbac4ff9700 1 -- 172.21.15.61:0/2027770353 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fbabc055500 con 0x7fbab8004810 2023-12-24T19:57:46.576 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:46.577 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3729732902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3729732902},{"type":"v1","addr":"172.21.15.61:6834","nonce":3729732902}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/402997858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":402997858},{"type":"v1","addr":"172.21.15.133:6837","nonce":402997858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/180373533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":180373533},{"type":"v1","addr":"172.21.15.61:6835","nonce":180373533}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:06.924129+0000","modified":"2023-12-24T19:57:10.540414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/74793696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":74793696},{"type":"v1","addr":"172.21.15.133:6836","nonce":74793696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T19:57:46.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.578+0000 7fbacdd9e700 1 -- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbaac066f30 msgr2=0x7fbaac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.578+0000 7fbacdd9e700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbaac066f30 0x7fbaac0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c390 tx=0x7fbab4015000 comp rx=0 tx=0).stop 2023-12-24T19:57:46.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.578+0000 7fbacdd9e700 1 -- 172.21.15.61:0/2027770353 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 msgr2=0x7fbac8165cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.578+0000 7fbacdd9e700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 0x7fbac8165cd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbabc002be0 tx=0x7fbabc007d10 comp rx=0 tx=0).stop 2023-12-24T19:57:46.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.578+0000 7fbacdd9e700 1 -- 172.21.15.61:0/2027770353 shutdown_connections 2023-12-24T19:57:46.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.578+0000 7fbacdd9e700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbac80c4200 0x7fbac80aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.578+0000 7fbacdd9e700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbaac066f30 0x7fbaac0693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.578+0000 7fbacdd9e700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbab8004810 0x7fbac8165cd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.578+0000 7fbacdd9e700 1 --2- 172.21.15.61:0/2027770353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8168ab0 0x7fbac80c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.578+0000 7fbacdd9e700 1 -- 172.21.15.61:0/2027770353 >> 172.21.15.61:0/2027770353 conn(0x7fbac80ccd10 msgr2=0x7fbac80b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:46.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.579+0000 7fbacdd9e700 1 -- 172.21.15.61:0/2027770353 shutdown_connections 2023-12-24T19:57:46.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.579+0000 7fbacdd9e700 1 -- 172.21.15.61:0/2027770353 wait complete. 2023-12-24T19:57:46.580 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 7 2023-12-24T19:57:46.591 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:57:46.714 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.713+0000 7f171b36f700 1 Processor -- start 2023-12-24T19:57:46.714 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.713+0000 7f171b36f700 1 -- start start 2023-12-24T19:57:46.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.714+0000 7f171b36f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f171406dff0 0x7f1714156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.714+0000 7f171b36f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17140b0830 0x7f17140c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.714+0000 7f171b36f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1714067a60 con 0x7f1714156730 2023-12-24T19:57:46.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.714+0000 7f171b36f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17140c88e0 con 0x7f171406dff0 2023-12-24T19:57:46.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.714+0000 7f171b36f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17140c8bc0 con 0x7f17140b0830 2023-12-24T19:57:46.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.714+0000 7f171890a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f171406dff0 0x7f1714156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.714+0000 7f171910b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1714156730 0x7f171406d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38966/0 (socket says 172.21.15.61:38966) 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.714+0000 7f171910b700 1 -- 172.21.15.61:0/2946373469 learned_addr learned my addr 172.21.15.61:0/2946373469 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f171890a700 1 -- 172.21.15.61:0/2946373469 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17140b0830 msgr2=0x7f17140c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f171990c700 1 --2- 172.21.15.61:0/2946373469 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17140b0830 0x7f17140c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f171890a700 1 --2- 172.21.15.61:0/2946373469 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17140b0830 0x7f17140c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f170bfff700 1 -- 172.21.15.61:0/2946373469 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934469927 0 0) 0x7f1714067a60 con 0x7f1714156730 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f171890a700 1 -- 172.21.15.61:0/2946373469 >> v1:172.21.15.61:6789/0 conn(0x7f1714156730 legacy=0x7f171406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f171890a700 1 -- 172.21.15.61:0/2946373469 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140676f0 con 0x7f171406dff0 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f171990c700 1 --2- 172.21.15.61:0/2946373469 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17140b0830 0x7f17140c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f171890a700 1 --2- 172.21.15.61:0/2946373469 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 0x7f1714156b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f17100098e0 tx=0x7f17100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7daaa613a65206ee server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f170bfff700 1 -- 172.21.15.61:0/2946373469 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710009e80 con 0x7f171406dff0 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f170bfff700 1 -- 172.21.15.61:0/2946373469 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171000b860 con 0x7f171406dff0 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.715+0000 7f170bfff700 1 -- 172.21.15.61:0/2946373469 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171000bbe0 con 0x7f171406dff0 2023-12-24T19:57:46.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.716+0000 7f171b36f700 1 -- 172.21.15.61:0/2946373469 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 msgr2=0x7f1714156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.716+0000 7f171b36f700 1 --2- 172.21.15.61:0/2946373469 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 0x7f1714156b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f17100098e0 tx=0x7f17100091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.716+0000 7f171b36f700 1 -- 172.21.15.61:0/2946373469 shutdown_connections 2023-12-24T19:57:46.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.716+0000 7f171b36f700 1 --2- 172.21.15.61:0/2946373469 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f17140b0830 0x7f17140c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.716+0000 7f171b36f700 1 --2- 172.21.15.61:0/2946373469 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 0x7f1714156b00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.716+0000 7f171b36f700 1 -- 172.21.15.61:0/2946373469 >> 172.21.15.61:0/2946373469 conn(0x7f17140cd6f0 msgr2=0x7f17140cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:46.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.716+0000 7f171b36f700 1 -- 172.21.15.61:0/2946373469 shutdown_connections 2023-12-24T19:57:46.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.716+0000 7f171b36f700 1 -- 172.21.15.61:0/2946373469 wait complete. 2023-12-24T19:57:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.717+0000 7f171b36f700 1 Processor -- start 2023-12-24T19:57:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.717+0000 7f171b36f700 1 -- start start 2023-12-24T19:57:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171b36f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 0x7f1714155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171b36f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17140b0830 0x7f17140c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171b36f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1714156730 0x7f17140c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171b36f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17141561d0 con 0x7f171406dff0 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171b36f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171415c650 con 0x7f17140b0830 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171b36f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171415c930 con 0x7f1714156730 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171910b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 0x7f1714155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171910b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 0x7f1714155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59002/0 (socket says 172.21.15.61:59002) 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171910b700 1 -- 172.21.15.61:0/1802666713 learned_addr learned my addr 172.21.15.61:0/1802666713 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171890a700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17140b0830 0x7f17140c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171990c700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1714156730 0x7f17140c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171910b700 1 -- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1714156730 msgr2=0x7f17140c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171910b700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1714156730 0x7f17140c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171910b700 1 -- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17140b0830 msgr2=0x7f17140c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171910b700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17140b0830 0x7f17140c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171910b700 1 -- 172.21.15.61:0/1802666713 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1710009420 con 0x7f171406dff0 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171990c700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1714156730 0x7f17140c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.718+0000 7f171910b700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 0x7f1714155c90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f170400c5b0 tx=0x7f1704001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.719+0000 7f17097fa700 1 -- 172.21.15.61:0/1802666713 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704005b30 con 0x7f171406dff0 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.719+0000 7f17097fa700 1 -- 172.21.15.61:0/1802666713 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1704005c90 con 0x7f171406dff0 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.719+0000 7f171b36f700 1 -- 172.21.15.61:0/1802666713 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171415cc10 con 0x7f171406dff0 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.719+0000 7f17097fa700 1 -- 172.21.15.61:0/1802666713 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704007300 con 0x7f171406dff0 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.719+0000 7f171b36f700 1 -- 172.21.15.61:0/1802666713 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17141572a0 con 0x7f171406dff0 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.720+0000 7f171b36f700 1 -- 172.21.15.61:0/1802666713 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f171415d0b0 con 0x7f171406dff0 2023-12-24T19:57:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.720+0000 7f17097fa700 1 -- 172.21.15.61:0/1802666713 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f170401b3b0 con 0x7f171406dff0 2023-12-24T19:57:46.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.720+0000 7f17097fa700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f16f8066f30 0x7f16f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:46.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.720+0000 7f17097fa700 1 -- 172.21.15.61:0/1802666713 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1704083b10 con 0x7f171406dff0 2023-12-24T19:57:46.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.721+0000 7f171890a700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f16f8066f30 0x7f16f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:46.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.721+0000 7f171890a700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f16f8066f30 0x7f16f80693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f171406e3f0 tx=0x7f1710019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.725+0000 7f17097fa700 1 -- 172.21.15.61:0/1802666713 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1704050ce0 con 0x7f171406dff0 2023-12-24T19:57:46.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.964+0000 7f171b36f700 1 -- 172.21.15.61:0/1802666713 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1714157680 con 0x7f171406dff0 2023-12-24T19:57:46.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.965+0000 7f17097fa700 1 -- 172.21.15.61:0/1802666713 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f1704017090 con 0x7f171406dff0 2023-12-24T19:57:46.966 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:46.966 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3729732902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3729732902},{"type":"v1","addr":"172.21.15.61:6834","nonce":3729732902}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/402997858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":402997858},{"type":"v1","addr":"172.21.15.133:6837","nonce":402997858}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/180373533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":180373533},{"type":"v1","addr":"172.21.15.61:6835","nonce":180373533}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:06.924129+0000","modified":"2023-12-24T19:57:10.540414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/74793696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":74793696},{"type":"v1","addr":"172.21.15.133:6836","nonce":74793696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-12-24T19:57:46.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 -- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f16f8066f30 msgr2=0x7f16f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f16f8066f30 0x7f16f80693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f171406e3f0 tx=0x7f1710019000 comp rx=0 tx=0).stop 2023-12-24T19:57:46.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 -- 172.21.15.61:0/1802666713 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 msgr2=0x7f1714155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:46.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 0x7f1714155c90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f170400c5b0 tx=0x7f1704001070 comp rx=0 tx=0).stop 2023-12-24T19:57:46.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 -- 172.21.15.61:0/1802666713 shutdown_connections 2023-12-24T19:57:46.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1714156730 0x7f17140c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f16f8066f30 0x7f16f80693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f171406dff0 0x7f1714155c90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 --2- 172.21.15.61:0/1802666713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17140b0830 0x7f17140c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:46.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 -- 172.21.15.61:0/1802666713 >> 172.21.15.61:0/1802666713 conn(0x7f17140cd6f0 msgr2=0x7f171415a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:46.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 -- 172.21.15.61:0/1802666713 shutdown_connections 2023-12-24T19:57:46.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:46.967+0000 7f171b36f700 1 -- 172.21.15.61:0/1802666713 wait complete. 2023-12-24T19:57:46.971 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 7 2023-12-24T19:57:46.980 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:47.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.102+0000 7f9ccafa1700 1 Processor -- start 2023-12-24T19:57:47.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.102+0000 7f9ccafa1700 1 -- start start 2023-12-24T19:57:47.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.103+0000 7f9ccafa1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9cc4068140 0x7f9cc40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.103+0000 7f9ccafa1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cc4159a60 0x7f9cc4159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.103+0000 7f9ccafa1700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc40b2890 con 0x7f9cc4068510 2023-12-24T19:57:47.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.103+0000 7f9ccafa1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc40cf630 con 0x7f9cc4068140 2023-12-24T19:57:47.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.103+0000 7f9ccafa1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40b2240 con 0x7f9cc4159a60 2023-12-24T19:57:47.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.103+0000 7f9cc3fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9cc4068510 0x7f9cc40b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38974/0 (socket says 172.21.15.61:38974) 2023-12-24T19:57:47.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.103+0000 7f9cc3fff700 1 -- 172.21.15.61:0/402887257 learned_addr learned my addr 172.21.15.61:0/402887257 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc8d3d700 1 --2- 172.21.15.61:0/402887257 >> v2:172.21.15.133:3300/0 conn(0x7f9cc4068140 0x7f9cc40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc953e700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cc4159a60 0x7f9cc4159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639878871 0 0) 0x7f9cc40b2890 con 0x7f9cc4068510 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb4003570 con 0x7f9cc4068510 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658730629 0 0) 0x7f9cb4003570 con 0x7f9cc4068510 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cc4159a60 msgr2=0x7f9cc4159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cc4159a60 0x7f9cc4159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 >> v2:172.21.15.133:3300/0 conn(0x7f9cc4068140 msgr2=0x7f9cc40cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 --2- 172.21.15.61:0/402887257 >> v2:172.21.15.133:3300/0 conn(0x7f9cc4068140 0x7f9cc40cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc40b2520 con 0x7f9cc4068510 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f9cb0001470 con 0x7f9cc4068510 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 >> v1:172.21.15.61:6789/0 conn(0x7f9cc4068510 legacy=0x7f9cc40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cb4003a60 0x7f9cb4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cb4004810 0x7f9cb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cc4159a60 0x7f9cb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40cf630 con 0x7f9cb4003a60 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40b2240 con 0x7f9cb4004810 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb400ba60 con 0x7f9cc4159a60 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc8d3d700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cb4003a60 0x7f9cb4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc3fff700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cb4004810 0x7f9cb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc953e700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cc4159a60 0x7f9cb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc8d3d700 1 -- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cc4159a60 msgr2=0x7f9cb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc8d3d700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cc4159a60 0x7f9cb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc8d3d700 1 -- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cb4004810 msgr2=0x7f9cb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc8d3d700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cb4004810 0x7f9cb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc8d3d700 1 -- 172.21.15.61:0/402887257 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4003570 con 0x7f9cb4003a60 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.104+0000 7f9cc3fff700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cb4004810 0x7f9cb4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9cc8d3d700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cb4003a60 0x7f9cb4003e70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009c20 tx=0x7f9cb8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157540bab404beb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8005a00 con 0x7f9cb4003a60 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb8005b60 con 0x7f9cb4003a60 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9cc37fe700 1 -- 172.21.15.61:0/402887257 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb800e710 con 0x7f9cb4003a60 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9ccafa1700 1 -- 172.21.15.61:0/402887257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cb4003a60 msgr2=0x7f9cb4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9ccafa1700 1 --2- 172.21.15.61:0/402887257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cb4003a60 0x7f9cb4003e70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009c20 tx=0x7f9cb8009120 comp rx=0 tx=0).stop 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9cc953e700 1 -- 172.21.15.61:0/402887257 reap_dead start 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9ccafa1700 1 -- 172.21.15.61:0/402887257 shutdown_connections 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9ccafa1700 1 -- 172.21.15.61:0/402887257 >> 172.21.15.61:0/402887257 conn(0x7f9cc4097a10 msgr2=0x7f9cc40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9ccafa1700 1 -- 172.21.15.61:0/402887257 shutdown_connections 2023-12-24T19:57:47.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.105+0000 7f9ccafa1700 1 -- 172.21.15.61:0/402887257 wait complete. 2023-12-24T19:57:47.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.106+0000 7f9ccafa1700 1 Processor -- start 2023-12-24T19:57:47.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.107+0000 7f9ccafa1700 1 -- start start 2023-12-24T19:57:47.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.107+0000 7f9ccafa1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cb4003a60 0x7f9cc41564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.107+0000 7f9ccafa1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cc415cdb0 0x7f9cc416d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.107+0000 7f9ccafa1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc416ddc0 0x7f9cc416e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.107+0000 7f9ccafa1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc415db50 con 0x7f9cc415cdb0 2023-12-24T19:57:47.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.107+0000 7f9ccafa1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc415d2b0 con 0x7f9cc416ddc0 2023-12-24T19:57:47.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.107+0000 7f9ccafa1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc415d590 con 0x7f9cb4003a60 2023-12-24T19:57:47.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.107+0000 7f9cc3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cc415cdb0 0x7f9cc416d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.107+0000 7f9cc3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cc415cdb0 0x7f9cc416d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59028/0 (socket says 172.21.15.61:59028) 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.107+0000 7f9cc3fff700 1 -- 172.21.15.61:0/2266204373 learned_addr learned my addr 172.21.15.61:0/2266204373 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc953e700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc416ddc0 0x7f9cc416e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc8d3d700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cb4003a60 0x7f9cc41564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc3fff700 1 -- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cb4003a60 msgr2=0x7f9cc41564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc3fff700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cb4003a60 0x7f9cc41564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc3fff700 1 -- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc416ddc0 msgr2=0x7f9cc416e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc3fff700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc416ddc0 0x7f9cc416e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc3fff700 1 -- 172.21.15.61:0/2266204373 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc415d870 con 0x7f9cc415cdb0 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc8d3d700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cb4003a60 0x7f9cc41564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc3fff700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cc415cdb0 0x7f9cc416d880 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000eb90 tx=0x7f9cb00014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc0ff9700 1 -- 172.21.15.61:0/2266204373 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb000c760 con 0x7f9cc415cdb0 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc0ff9700 1 -- 172.21.15.61:0/2266204373 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb000c8c0 con 0x7f9cc415cdb0 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9ccafa1700 1 -- 172.21.15.61:0/2266204373 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc415e030 con 0x7f9cc415cdb0 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9cc0ff9700 1 -- 172.21.15.61:0/2266204373 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb000cc80 con 0x7f9cc415cdb0 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.108+0000 7f9ccafa1700 1 -- 172.21.15.61:0/2266204373 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc41574a0 con 0x7f9cc415cdb0 2023-12-24T19:57:47.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.109+0000 7f9ccafa1700 1 -- 172.21.15.61:0/2266204373 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc406d440 con 0x7f9cc415cdb0 2023-12-24T19:57:47.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.109+0000 7f9cc0ff9700 1 -- 172.21.15.61:0/2266204373 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9cb001d460 con 0x7f9cc415cdb0 2023-12-24T19:57:47.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.110+0000 7f9cc0ff9700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ca8066f30 0x7f9ca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.110+0000 7f9cc0ff9700 1 -- 172.21.15.61:0/2266204373 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9cb0084670 con 0x7f9cc415cdb0 2023-12-24T19:57:47.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.110+0000 7f9cc8d3d700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ca8066f30 0x7f9ca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.111+0000 7f9cc8d3d700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ca8066f30 0x7f9ca80693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009160 tx=0x7f9cb8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:47.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.114+0000 7f9cc0ff9700 1 -- 172.21.15.61:0/2266204373 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cb0055370 con 0x7f9cc415cdb0 2023-12-24T19:57:47.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.311+0000 7f9ccafa1700 1 -- 172.21.15.61:0/2266204373 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cc404c3c0 con 0x7f9cc415cdb0 2023-12-24T19:57:47.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.312+0000 7f9cc0ff9700 1 -- 172.21.15.61:0/2266204373 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f9cb0054f00 con 0x7f9cc415cdb0 2023-12-24T19:57:47.312 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:47.312 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":20,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:08.511533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:04.595282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:05.898273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 -- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ca8066f30 msgr2=0x7f9ca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ca8066f30 0x7f9ca80693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009160 tx=0x7f9cb8019000 comp rx=0 tx=0).stop 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 -- 172.21.15.61:0/2266204373 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cc415cdb0 msgr2=0x7f9cc416d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cc415cdb0 0x7f9cc416d880 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000eb90 tx=0x7f9cb00014e0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 -- 172.21.15.61:0/2266204373 shutdown_connections 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9cb4003a60 0x7f9cc41564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ca8066f30 0x7f9ca80693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9cc416ddc0 0x7f9cc416e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 --2- 172.21.15.61:0/2266204373 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cc415cdb0 0x7f9cc416d880 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 -- 172.21.15.61:0/2266204373 >> 172.21.15.61:0/2266204373 conn(0x7f9cc4097a10 msgr2=0x7f9cc40aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 -- 172.21.15.61:0/2266204373 shutdown_connections 2023-12-24T19:57:47.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.314+0000 7f9ccafa1700 1 -- 172.21.15.61:0/2266204373 wait complete. 2023-12-24T19:57:47.327 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T19:57:47.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.449+0000 7f0478ab0700 1 Processor -- start 2023-12-24T19:57:47.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.449+0000 7f0478ab0700 1 -- start start 2023-12-24T19:57:47.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f0478ab0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f04740b0a50 0x7f047406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f0478ab0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04740b0e20 0x7f047406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f0478ab0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04740ae510 0x7f04740ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f0478ab0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047406f700 con 0x7f04740b0a50 2023-12-24T19:57:47.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f0478ab0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047406eaf0 con 0x7f04740ae510 2023-12-24T19:57:47.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f0478ab0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047406edd0 con 0x7f04740b0e20 2023-12-24T19:57:47.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f047259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f04740b0a50 0x7f047406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f047259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f04740b0a50 0x7f047406ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59040/0 (socket says 172.21.15.61:59040) 2023-12-24T19:57:47.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f047259c700 1 -- 172.21.15.61:0/1367749287 learned_addr learned my addr 172.21.15.61:0/1367749287 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:47.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f0471d9b700 1 --2- 172.21.15.61:0/1367749287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04740b0e20 0x7f047406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f0472d9d700 1 --2- 172.21.15.61:0/1367749287 >> v2:172.21.15.133:3300/0 conn(0x7f04740ae510 0x7f04740ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f047259c700 1 -- 172.21.15.61:0/1367749287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04740b0e20 msgr2=0x7f047406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f047259c700 1 --2- 172.21.15.61:0/1367749287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04740b0e20 0x7f047406b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f047259c700 1 -- 172.21.15.61:0/1367749287 >> v2:172.21.15.133:3300/0 conn(0x7f04740ae510 msgr2=0x7f04740ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f047259c700 1 --2- 172.21.15.61:0/1367749287 >> v2:172.21.15.133:3300/0 conn(0x7f04740ae510 0x7f04740ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f047259c700 1 -- 172.21.15.61:0/1367749287 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047406f0b0 con 0x7f04740b0a50 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f047259c700 1 --2- 172.21.15.61:0/1367749287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 0x7f047406ac10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f04740b48a0 tx=0x7f0464009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcfb3dd3317766e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.450+0000 7f047159a700 1 -- 172.21.15.61:0/1367749287 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046400b640 con 0x7f04740b0a50 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f047159a700 1 -- 172.21.15.61:0/1367749287 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046400b7a0 con 0x7f04740b0a50 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f047159a700 1 -- 172.21.15.61:0/1367749287 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046400bb60 con 0x7f04740b0a50 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f0478ab0700 1 -- 172.21.15.61:0/1367749287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 msgr2=0x7f047406ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f0478ab0700 1 --2- 172.21.15.61:0/1367749287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 0x7f047406ac10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f04740b48a0 tx=0x7f0464009250 comp rx=0 tx=0).stop 2023-12-24T19:57:47.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f0478ab0700 1 -- 172.21.15.61:0/1367749287 shutdown_connections 2023-12-24T19:57:47.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f0478ab0700 1 --2- 172.21.15.61:0/1367749287 >> v2:172.21.15.133:3300/0 conn(0x7f04740ae510 0x7f04740ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f0478ab0700 1 --2- 172.21.15.61:0/1367749287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 0x7f047406ac10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f0478ab0700 1 --2- 172.21.15.61:0/1367749287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04740b0e20 0x7f047406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f0478ab0700 1 -- 172.21.15.61:0/1367749287 >> 172.21.15.61:0/1367749287 conn(0x7f04740ce7e0 msgr2=0x7f04740cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:47.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f0478ab0700 1 -- 172.21.15.61:0/1367749287 shutdown_connections 2023-12-24T19:57:47.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.451+0000 7f0478ab0700 1 -- 172.21.15.61:0/1367749287 wait complete. 2023-12-24T19:57:47.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.452+0000 7f0478ab0700 1 Processor -- start 2023-12-24T19:57:47.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.452+0000 7f0478ab0700 1 -- start start 2023-12-24T19:57:47.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0478ab0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04740ae510 0x7f04740c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0478ab0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 0x7f04740ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0478ab0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04740b0e20 0x7f04740ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0478ab0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04740ad0c0 con 0x7f04740b0a50 2023-12-24T19:57:47.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0478ab0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04740ac4b0 con 0x7f04740b0e20 2023-12-24T19:57:47.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0478ab0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04740ac790 con 0x7f04740ae510 2023-12-24T19:57:47.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0471d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 0x7f04740ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0471d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 0x7f04740ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59052/0 (socket says 172.21.15.61:59052) 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0471d9b700 1 -- 172.21.15.61:0/2237505527 learned_addr learned my addr 172.21.15.61:0/2237505527 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0472d9d700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04740b0e20 0x7f04740ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0471d9b700 1 -- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04740ae510 msgr2=0x7f04740c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0471d9b700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04740ae510 0x7f04740c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0471d9b700 1 -- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04740b0e20 msgr2=0x7f04740ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0471d9b700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04740b0e20 0x7f04740ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.453+0000 7f0471d9b700 1 -- 172.21.15.61:0/2237505527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04640094f0 con 0x7f04740b0a50 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.454+0000 7f0471d9b700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 0x7f04740ad550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f046800ec80 tx=0x7f04680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.454+0000 7f04627fc700 1 -- 172.21.15.61:0/2237505527 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800c9d0 con 0x7f04740b0a50 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.454+0000 7f04627fc700 1 -- 172.21.15.61:0/2237505527 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046800cb30 con 0x7f04740b0a50 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.454+0000 7f0478ab0700 1 -- 172.21.15.61:0/2237505527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04740aca70 con 0x7f04740b0a50 2023-12-24T19:57:47.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.454+0000 7f04627fc700 1 -- 172.21.15.61:0/2237505527 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0468013470 con 0x7f04740b0a50 2023-12-24T19:57:47.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.454+0000 7f0478ab0700 1 -- 172.21.15.61:0/2237505527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0474069040 con 0x7f04740b0a50 2023-12-24T19:57:47.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.455+0000 7f0478ab0700 1 -- 172.21.15.61:0/2237505527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04740ad3a0 con 0x7f04740b0a50 2023-12-24T19:57:47.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.455+0000 7f04627fc700 1 -- 172.21.15.61:0/2237505527 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0468013820 con 0x7f04740b0a50 2023-12-24T19:57:47.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.456+0000 7f04627fc700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0454066f30 0x7f04540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.456+0000 7f04627fc700 1 -- 172.21.15.61:0/2237505527 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0468084940 con 0x7f04740b0a50 2023-12-24T19:57:47.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.456+0000 7f047259c700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0454066f30 0x7f04540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.456+0000 7f047259c700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0454066f30 0x7f04540693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f04740b48a0 tx=0x7f0464017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:47.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.460+0000 7f04627fc700 1 -- 172.21.15.61:0/2237505527 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0468051b10 con 0x7f04740b0a50 2023-12-24T19:57:47.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.703+0000 7f0478ab0700 1 -- 172.21.15.61:0/2237505527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f04740ad200 con 0x7f04740b0a50 2023-12-24T19:57:47.704 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T19:57:47.704+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T19:57:47.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.707+0000 7f04627fc700 1 -- 172.21.15.61:0/2237505527 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f04740ad200 con 0x7f04740b0a50 2023-12-24T19:57:47.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 -- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0454066f30 msgr2=0x7f04540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0454066f30 0x7f04540693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f04740b48a0 tx=0x7f0464017000 comp rx=0 tx=0).stop 2023-12-24T19:57:47.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 -- 172.21.15.61:0/2237505527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 msgr2=0x7f04740ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 0x7f04740ad550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f046800ec80 tx=0x7f04680091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 -- 172.21.15.61:0/2237505527 shutdown_connections 2023-12-24T19:57:47.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04740ae510 0x7f04740c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0454066f30 0x7f04540693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04740b0e20 0x7f04740ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 --2- 172.21.15.61:0/2237505527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04740b0a50 0x7f04740ad550 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 -- 172.21.15.61:0/2237505527 >> 172.21.15.61:0/2237505527 conn(0x7f04740ce7e0 msgr2=0x7f04740b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:47.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 -- 172.21.15.61:0/2237505527 shutdown_connections 2023-12-24T19:57:47.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.709+0000 7f0478ab0700 1 -- 172.21.15.61:0/2237505527 wait complete. 2023-12-24T19:57:47.711 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T19:57:47.711 INFO:tasks.ceph.mds.b.smithi133.stderr: -2235> 2023-12-24T19:57:10.802+0000 7fa43507a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T19:57:47.721 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T19:57:47.735 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T19:57:47.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.845+0000 7fa03748e700 1 Processor -- start 2023-12-24T19:57:47.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.845+0000 7fa03748e700 1 -- start start 2023-12-24T19:57:47.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa03748e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa030070d50 0x7fa0300aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa03748e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa030157e80 0x7fa0300cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa03748e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0300b1ec0 con 0x7fa030157ab0 2023-12-24T19:57:47.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa03748e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0300cb200 con 0x7fa030157e80 2023-12-24T19:57:47.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa03748e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03006a830 con 0x7fa030070d50 2023-12-24T19:57:47.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa035a2b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa030157e80 0x7fa0300cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa03522a700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa030157ab0 0x7fa030070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38976/0 (socket says 172.21.15.61:38976) 2023-12-24T19:57:47.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa03522a700 1 -- 172.21.15.61:0/4019491083 learned_addr learned my addr 172.21.15.61:0/4019491083 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:47.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa034a29700 1 --2- 172.21.15.61:0/4019491083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa030070d50 0x7fa0300aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa035a2b700 1 -- 172.21.15.61:0/4019491083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa030070d50 msgr2=0x7fa0300aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:47.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa035a2b700 1 --2- 172.21.15.61:0/4019491083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa030070d50 0x7fa0300aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa035a2b700 1 -- 172.21.15.61:0/4019491083 >> v1:172.21.15.61:6789/0 conn(0x7fa030157ab0 legacy=0x7fa030070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa035a2b700 1 -- 172.21.15.61:0/4019491083 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03006ab10 con 0x7fa030157e80 2023-12-24T19:57:47.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa027fff700 1 -- 172.21.15.61:0/4019491083 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537995878 0 0) 0x7fa0300b1ec0 con 0x7fa030157ab0 2023-12-24T19:57:47.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa035a2b700 1 --2- 172.21.15.61:0/4019491083 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157e80 0x7fa0300cacc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa028009e60 tx=0x7fa028009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52519af80de50eb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:47.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa027fff700 1 -- 172.21.15.61:0/4019491083 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800e070 con 0x7fa030157e80 2023-12-24T19:57:47.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa027fff700 1 -- 172.21.15.61:0/4019491083 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02800bc30 con 0x7fa030157e80 2023-12-24T19:57:47.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.846+0000 7fa027fff700 1 -- 172.21.15.61:0/4019491083 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028012430 con 0x7fa030157e80 2023-12-24T19:57:47.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.847+0000 7fa03748e700 1 -- 172.21.15.61:0/4019491083 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157e80 msgr2=0x7fa0300cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.847+0000 7fa03748e700 1 --2- 172.21.15.61:0/4019491083 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157e80 0x7fa0300cacc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa028009e60 tx=0x7fa028009780 comp rx=0 tx=0).stop 2023-12-24T19:57:47.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.847+0000 7fa03748e700 1 -- 172.21.15.61:0/4019491083 shutdown_connections 2023-12-24T19:57:47.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.847+0000 7fa03748e700 1 --2- 172.21.15.61:0/4019491083 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157e80 0x7fa0300cacc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.847+0000 7fa03748e700 1 --2- 172.21.15.61:0/4019491083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa030070d50 0x7fa0300aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.847+0000 7fa03748e700 1 -- 172.21.15.61:0/4019491083 >> 172.21.15.61:0/4019491083 conn(0x7fa0300ce400 msgr2=0x7fa0300ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:47.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.847+0000 7fa03748e700 1 -- 172.21.15.61:0/4019491083 shutdown_connections 2023-12-24T19:57:47.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.847+0000 7fa03748e700 1 -- 172.21.15.61:0/4019491083 wait complete. 2023-12-24T19:57:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.848+0000 7fa03748e700 1 Processor -- start 2023-12-24T19:57:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.848+0000 7fa03748e700 1 -- start start 2023-12-24T19:57:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa03748e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa030070d50 0x7fa0300aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa03748e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157ab0 0x7fa03016cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa03748e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa030157e80 0x7fa03016b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa03748e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03016c810 con 0x7fa030157ab0 2023-12-24T19:57:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa03748e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03016a430 con 0x7fa030070d50 2023-12-24T19:57:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa03748e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03016bc00 con 0x7fa030157e80 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa034a29700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157ab0 0x7fa03016cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa034a29700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157ab0 0x7fa03016cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59070/0 (socket says 172.21.15.61:59070) 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa034a29700 1 -- 172.21.15.61:0/3834193474 learned_addr learned my addr 172.21.15.61:0/3834193474 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa03522a700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa030070d50 0x7fa0300aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa035a2b700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa030157e80 0x7fa03016b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa034a29700 1 -- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa030157e80 msgr2=0x7fa03016b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa034a29700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa030157e80 0x7fa03016b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa034a29700 1 -- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa030070d50 msgr2=0x7fa0300aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.849+0000 7fa034a29700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa030070d50 0x7fa0300aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.850+0000 7fa034a29700 1 -- 172.21.15.61:0/3834193474 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028009a20 con 0x7fa030157ab0 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.850+0000 7fa034a29700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157ab0 0x7fa03016cca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa02000d890 tx=0x7fa020008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.850+0000 7fa0257fa700 1 -- 172.21.15.61:0/3834193474 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0200125f0 con 0x7fa030157ab0 2023-12-24T19:57:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.850+0000 7fa0257fa700 1 -- 172.21.15.61:0/3834193474 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa020012750 con 0x7fa030157ab0 2023-12-24T19:57:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.850+0000 7fa03748e700 1 -- 172.21.15.61:0/3834193474 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03016bee0 con 0x7fa030157ab0 2023-12-24T19:57:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.850+0000 7fa0257fa700 1 -- 172.21.15.61:0/3834193474 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020012af0 con 0x7fa030157ab0 2023-12-24T19:57:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.850+0000 7fa03748e700 1 -- 172.21.15.61:0/3834193474 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03016c4a0 con 0x7fa030157ab0 2023-12-24T19:57:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.851+0000 7fa03748e700 1 -- 172.21.15.61:0/3834193474 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03016caf0 con 0x7fa030157ab0 2023-12-24T19:57:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.851+0000 7fa0257fa700 1 -- 172.21.15.61:0/3834193474 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa02001e460 con 0x7fa030157ab0 2023-12-24T19:57:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.852+0000 7fa0257fa700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa014066f00 0x7fa0140693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.852+0000 7fa0257fa700 1 -- 172.21.15.61:0/3834193474 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa020084af0 con 0x7fa030157ab0 2023-12-24T19:57:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.852+0000 7fa03522a700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa014066f00 0x7fa0140693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.852+0000 7fa03522a700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa014066f00 0x7fa0140693b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa02c007fd0 tx=0x7fa02c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:47.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:47.856+0000 7fa0257fa700 1 -- 172.21.15.61:0/3834193474 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa020051d10 con 0x7fa030157ab0 2023-12-24T19:57:48.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.093+0000 7fa03748e700 1 -- 172.21.15.61:0/3834193474 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa03004c3c0 con 0x7fa030157ab0 2023-12-24T19:57:48.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.710+0000 7fa0257fa700 1 -- 172.21.15.61:0/3834193474 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa020055330 con 0x7fa030157ab0 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 -- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa014066f00 msgr2=0x7fa0140693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa014066f00 0x7fa0140693b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa02c007fd0 tx=0x7fa02c007d30 comp rx=0 tx=0).stop 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 -- 172.21.15.61:0/3834193474 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157ab0 msgr2=0x7fa03016cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157ab0 0x7fa03016cca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa02000d890 tx=0x7fa020008040 comp rx=0 tx=0).stop 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 -- 172.21.15.61:0/3834193474 shutdown_connections 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa030157e80 0x7fa03016b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa014066f00 0x7fa0140693b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa030070d50 0x7fa0300aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 --2- 172.21.15.61:0/3834193474 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa030157ab0 0x7fa03016cca0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 -- 172.21.15.61:0/3834193474 >> 172.21.15.61:0/3834193474 conn(0x7fa0300ce400 msgr2=0x7fa0300c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:48.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 -- 172.21.15.61:0/3834193474 shutdown_connections 2023-12-24T19:57:48.714 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.712+0000 7fa03748e700 1 -- 172.21.15.61:0/3834193474 wait complete. 2023-12-24T19:57:48.726 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T19:57:48.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.855+0000 7f4782dd2700 1 Processor -- start 2023-12-24T19:57:48.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.855+0000 7f4782dd2700 1 -- start start 2023-12-24T19:57:48.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f4782dd2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f477c06f1f0 0x7f477c06abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:48.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f4782dd2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f477c157c70 0x7f477c06b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:48.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f4782dd2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c0b15a0 con 0x7f477c1578a0 2023-12-24T19:57:48.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f4782dd2700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0c9840 con 0x7f477c06f1f0 2023-12-24T19:57:48.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f4782dd2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0b0590 con 0x7f477c157c70 2023-12-24T19:57:48.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f477bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f477c06f1f0 0x7f477c06abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:48.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f477bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f477c06f1f0 0x7f477c06abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59082/0 (socket says 172.21.15.61:59082) 2023-12-24T19:57:48.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f477bfff700 1 -- 172.21.15.61:0/2979632328 learned_addr learned my addr 172.21.15.61:0/2979632328 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f478136f700 1 --2- 172.21.15.61:0/2979632328 >> v2:172.21.15.133:3300/0 conn(0x7f477c157c70 0x7f477c06b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f477bfff700 1 -- 172.21.15.61:0/2979632328 >> v2:172.21.15.133:3300/0 conn(0x7f477c157c70 msgr2=0x7f477c06b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f477bfff700 1 --2- 172.21.15.61:0/2979632328 >> v2:172.21.15.133:3300/0 conn(0x7f477c157c70 0x7f477c06b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.856+0000 7f477bfff700 1 -- 172.21.15.61:0/2979632328 >> v1:172.21.15.133:6789/0 conn(0x7f477c1578a0 legacy=0x7f477c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:48.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f477bfff700 1 -- 172.21.15.61:0/2979632328 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0c8f10 con 0x7f477c06f1f0 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f477bfff700 1 --2- 172.21.15.61:0/2979632328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c06f1f0 0x7f477c06abb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f477c0c97b0 tx=0x7f4768009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96786e5f1f4cea59 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f477b7fe700 1 -- 172.21.15.61:0/2979632328 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476800b820 con 0x7f477c06f1f0 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f477b7fe700 1 -- 172.21.15.61:0/2979632328 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476800b980 con 0x7f477c06f1f0 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f477b7fe700 1 -- 172.21.15.61:0/2979632328 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476800bd20 con 0x7f477c06f1f0 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f4782dd2700 1 -- 172.21.15.61:0/2979632328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c06f1f0 msgr2=0x7f477c06abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f4782dd2700 1 --2- 172.21.15.61:0/2979632328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c06f1f0 0x7f477c06abb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f477c0c97b0 tx=0x7f4768009250 comp rx=0 tx=0).stop 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f4782dd2700 1 -- 172.21.15.61:0/2979632328 shutdown_connections 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f4782dd2700 1 --2- 172.21.15.61:0/2979632328 >> v2:172.21.15.133:3300/0 conn(0x7f477c157c70 0x7f477c06b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f4782dd2700 1 --2- 172.21.15.61:0/2979632328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c06f1f0 0x7f477c06abb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f4782dd2700 1 -- 172.21.15.61:0/2979632328 >> 172.21.15.61:0/2979632328 conn(0x7f477c0ce7d0 msgr2=0x7f477c0cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f4782dd2700 1 -- 172.21.15.61:0/2979632328 shutdown_connections 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.857+0000 7f4782dd2700 1 -- 172.21.15.61:0/2979632328 wait complete. 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.858+0000 7f4782dd2700 1 Processor -- start 2023-12-24T19:57:48.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.859+0000 7f4782dd2700 1 -- start start 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.859+0000 7f4782dd2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f477c1578a0 0x7f477c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.859+0000 7f4782dd2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c157c70 0x7f477c0b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.859+0000 7f4782dd2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f477c0b1c70 0x7f477c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.859+0000 7f4782dd2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0c3160 con 0x7f477c157c70 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.859+0000 7f4782dd2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c1572a0 con 0x7f477c1578a0 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.859+0000 7f4782dd2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0b2180 con 0x7f477c0b1c70 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.859+0000 7f477bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c157c70 0x7f477c0b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f477bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c157c70 0x7f477c0b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59084/0 (socket says 172.21.15.61:59084) 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f477bfff700 1 -- 172.21.15.61:0/4100659508 learned_addr learned my addr 172.21.15.61:0/4100659508 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f478136f700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f477c0b1c70 0x7f477c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f4780b6e700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f477c1578a0 0x7f477c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f477bfff700 1 -- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f477c0b1c70 msgr2=0x7f477c0af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f477bfff700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f477c0b1c70 0x7f477c0af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f477bfff700 1 -- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f477c1578a0 msgr2=0x7f477c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:48.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f477bfff700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f477c1578a0 0x7f477c156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f477bfff700 1 -- 172.21.15.61:0/4100659508 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47680094f0 con 0x7f477c157c70 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f478136f700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f477c0b1c70 0x7f477c0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f4780b6e700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f477c1578a0 0x7f477c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f477bfff700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c157c70 0x7f477c0b1730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f47680030c0 tx=0x7f4768016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f4778ff9700 1 -- 172.21.15.61:0/4100659508 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476800bd10 con 0x7f477c157c70 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f4778ff9700 1 -- 172.21.15.61:0/4100659508 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4768006bc0 con 0x7f477c157c70 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f4782dd2700 1 -- 172.21.15.61:0/4100659508 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c0b2460 con 0x7f477c157c70 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f4778ff9700 1 -- 172.21.15.61:0/4100659508 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476801b8d0 con 0x7f477c157c70 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.860+0000 7f4782dd2700 1 -- 172.21.15.61:0/4100659508 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c0b2a20 con 0x7f477c157c70 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.861+0000 7f4782dd2700 1 -- 172.21.15.61:0/4100659508 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c0c2f30 con 0x7f477c157c70 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.861+0000 7f4778ff9700 1 -- 172.21.15.61:0/4100659508 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f476801bc80 con 0x7f477c157c70 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.862+0000 7f4778ff9700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4760066f30 0x7f47600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.862+0000 7f4778ff9700 1 -- 172.21.15.61:0/4100659508 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4768086360 con 0x7f477c157c70 2023-12-24T19:57:48.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.862+0000 7f4780b6e700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4760066f30 0x7f47600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:48.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.863+0000 7f4780b6e700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4760066f30 0x7f47600693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4770002880 tx=0x7f4770009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:48.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:48.866+0000 7f4778ff9700 1 -- 172.21.15.61:0/4100659508 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f477c0c2f30 con 0x7f477c157c70 2023-12-24T19:57:49.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.062+0000 7f4782dd2700 1 -- 172.21.15.61:0/4100659508 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f477c0c2f30 con 0x7f477c157c70 2023-12-24T19:57:49.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.713+0000 7f4778ff9700 1 -- 172.21.15.61:0/4100659508 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f477c0c2f30 con 0x7f477c157c70 2023-12-24T19:57:49.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.717+0000 7f4782dd2700 1 -- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4760066f30 msgr2=0x7f47600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:49.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.717+0000 7f4782dd2700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4760066f30 0x7f47600693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4770002880 tx=0x7f4770009040 comp rx=0 tx=0).stop 2023-12-24T19:57:49.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.717+0000 7f4782dd2700 1 -- 172.21.15.61:0/4100659508 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c157c70 msgr2=0x7f477c0b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:49.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.717+0000 7f4782dd2700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c157c70 0x7f477c0b1730 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f47680030c0 tx=0x7f4768016000 comp rx=0 tx=0).stop 2023-12-24T19:57:49.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.718+0000 7f4782dd2700 1 -- 172.21.15.61:0/4100659508 shutdown_connections 2023-12-24T19:57:49.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.718+0000 7f4782dd2700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f477c0b1c70 0x7f477c0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:49.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.718+0000 7f4782dd2700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4760066f30 0x7f47600693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:49.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.718+0000 7f4782dd2700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f477c1578a0 0x7f477c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:49.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.718+0000 7f4782dd2700 1 --2- 172.21.15.61:0/4100659508 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f477c157c70 0x7f477c0b1730 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:49.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.718+0000 7f4782dd2700 1 -- 172.21.15.61:0/4100659508 >> 172.21.15.61:0/4100659508 conn(0x7f477c0ce7d0 msgr2=0x7f477c0cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:49.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.718+0000 7f4782dd2700 1 -- 172.21.15.61:0/4100659508 shutdown_connections 2023-12-24T19:57:49.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.718+0000 7f4782dd2700 1 -- 172.21.15.61:0/4100659508 wait complete. 2023-12-24T19:57:49.719 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T19:57:49.732 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T19:57:49.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.862+0000 7fd14562e700 1 Processor -- start 2023-12-24T19:57:49.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.862+0000 7fd14562e700 1 -- start start 2023-12-24T19:57:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.863+0000 7fd14562e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd140159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.863+0000 7fd14562e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1400cd130 0x7fd1400b6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.863+0000 7fd14562e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400d00e0 con 0x7fd14006db70 2023-12-24T19:57:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.863+0000 7fd14562e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400b3280 con 0x7fd1400cd130 2023-12-24T19:57:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.863+0000 7fd14562e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400b6940 con 0x7fd1401597f0 2023-12-24T19:57:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.863+0000 7fd13effd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd140159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.863+0000 7fd13effd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd140159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:42118/0 (socket says 172.21.15.61:42118) 2023-12-24T19:57:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.863+0000 7fd13effd700 1 -- 172.21.15.61:0/325169616 learned_addr learned my addr 172.21.15.61:0/325169616 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.863+0000 7fd13e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1400cd130 0x7fd1400b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:49.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd13effd700 1 -- 172.21.15.61:0/325169616 >> v2:172.21.15.133:3300/0 conn(0x7fd1400cd130 msgr2=0x7fd1400b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:49.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd13effd700 1 --2- 172.21.15.61:0/325169616 >> v2:172.21.15.133:3300/0 conn(0x7fd1400cd130 0x7fd1400b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:49.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd13effd700 1 -- 172.21.15.61:0/325169616 >> v1:172.21.15.133:6789/0 conn(0x7fd14006db70 legacy=0x7fd14015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd13effd700 1 -- 172.21.15.61:0/325169616 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400cd6a0 con 0x7fd1401597f0 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd13e7fc700 1 --2- 172.21.15.61:0/325169616 >> v2:172.21.15.133:3300/0 conn(0x7fd1400cd130 0x7fd1400b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd13dffb700 1 -- 172.21.15.61:0/325169616 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436397393 0 0) 0x7fd1400d00e0 con 0x7fd14006db70 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd13effd700 1 --2- 172.21.15.61:0/325169616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd140159bc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd1280099b0 tx=0x7fd128009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8313c7b782ecf38a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd13dffb700 1 -- 172.21.15.61:0/325169616 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128009ea0 con 0x7fd1401597f0 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd13dffb700 1 -- 172.21.15.61:0/325169616 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12800b860 con 0x7fd1401597f0 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd13dffb700 1 -- 172.21.15.61:0/325169616 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12800bc00 con 0x7fd1401597f0 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd14562e700 1 -- 172.21.15.61:0/325169616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 msgr2=0x7fd140159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.864+0000 7fd14562e700 1 --2- 172.21.15.61:0/325169616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd140159bc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd1280099b0 tx=0x7fd128009250 comp rx=0 tx=0).stop 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.865+0000 7fd14562e700 1 -- 172.21.15.61:0/325169616 shutdown_connections 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.865+0000 7fd14562e700 1 --2- 172.21.15.61:0/325169616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd140159bc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.865+0000 7fd14562e700 1 --2- 172.21.15.61:0/325169616 >> v2:172.21.15.133:3300/0 conn(0x7fd1400cd130 0x7fd1400b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.865+0000 7fd14562e700 1 -- 172.21.15.61:0/325169616 >> 172.21.15.61:0/325169616 conn(0x7fd140067fd0 msgr2=0x7fd1400b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:49.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.865+0000 7fd14562e700 1 -- 172.21.15.61:0/325169616 shutdown_connections 2023-12-24T19:57:49.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.865+0000 7fd14562e700 1 -- 172.21.15.61:0/325169616 wait complete. 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.866+0000 7fd14562e700 1 Processor -- start 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.866+0000 7fd14562e700 1 -- start start 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd14562e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd14006db70 0x7fd1401560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd14562e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1400cd130 0x7fd14016a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd14562e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd14015cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd14562e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400c78a0 con 0x7fd1400cd130 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd14562e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14016abb0 con 0x7fd14006db70 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd14562e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400cc670 con 0x7fd1401597f0 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13e7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1400cd130 0x7fd14016a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13e7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1400cd130 0x7fd14016a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59086/0 (socket says 172.21.15.61:59086) 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13e7fc700 1 -- 172.21.15.61:0/1476800072 learned_addr learned my addr 172.21.15.61:0/1476800072 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:49.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13effd700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd14006db70 0x7fd1401560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13f7fe700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd14015cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13e7fc700 1 -- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 msgr2=0x7fd14015cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13e7fc700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd14015cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13e7fc700 1 -- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd14006db70 msgr2=0x7fd1401560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13e7fc700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd14006db70 0x7fd1401560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13e7fc700 1 -- 172.21.15.61:0/1476800072 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130009420 con 0x7fd1400cd130 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13f7fe700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd14015cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.867+0000 7fd13e7fc700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1400cd130 0x7fd14016a670 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd13000ec80 tx=0x7fd1300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.868+0000 7fd136ffd700 1 -- 172.21.15.61:0/1476800072 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000c890 con 0x7fd1400cd130 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.868+0000 7fd14562e700 1 -- 172.21.15.61:0/1476800072 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1280094f0 con 0x7fd1400cd130 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.868+0000 7fd136ffd700 1 -- 172.21.15.61:0/1476800072 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13000c9f0 con 0x7fd1400cd130 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.868+0000 7fd136ffd700 1 -- 172.21.15.61:0/1476800072 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000cd70 con 0x7fd1400cd130 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.868+0000 7fd14562e700 1 -- 172.21.15.61:0/1476800072 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1400c85c0 con 0x7fd1400cd130 2023-12-24T19:57:49.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.869+0000 7fd14562e700 1 -- 172.21.15.61:0/1476800072 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1400c8750 con 0x7fd1400cd130 2023-12-24T19:57:49.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.869+0000 7fd136ffd700 1 -- 172.21.15.61:0/1476800072 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd130013680 con 0x7fd1400cd130 2023-12-24T19:57:49.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.869+0000 7fd136ffd700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd120066f30 0x7fd1200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:49.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.870+0000 7fd136ffd700 1 -- 172.21.15.61:0/1476800072 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fd130084770 con 0x7fd1400cd130 2023-12-24T19:57:49.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.870+0000 7fd13effd700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd120066f30 0x7fd1200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:49.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.870+0000 7fd13effd700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd120066f30 0x7fd1200693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd1280099b0 tx=0x7fd128017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:49.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:49.874+0000 7fd136ffd700 1 -- 172.21.15.61:0/1476800072 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd130051b40 con 0x7fd1400cd130 2023-12-24T19:57:50.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.074+0000 7fd14562e700 1 -- 172.21.15.61:0/1476800072 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd1400cfa90 con 0x7fd1400cd130 2023-12-24T19:57:50.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.725+0000 7fd136ffd700 1 -- 172.21.15.61:0/1476800072 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd130055160 con 0x7fd1400cd130 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 -- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd120066f30 msgr2=0x7fd1200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd120066f30 0x7fd1200693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd1280099b0 tx=0x7fd128017000 comp rx=0 tx=0).stop 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 -- 172.21.15.61:0/1476800072 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1400cd130 msgr2=0x7fd14016a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1400cd130 0x7fd14016a670 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd13000ec80 tx=0x7fd1300091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 -- 172.21.15.61:0/1476800072 shutdown_connections 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1401597f0 0x7fd14015cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd120066f30 0x7fd1200693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd14006db70 0x7fd1401560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 --2- 172.21.15.61:0/1476800072 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1400cd130 0x7fd14016a670 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 -- 172.21.15.61:0/1476800072 >> 172.21.15.61:0/1476800072 conn(0x7fd140067fd0 msgr2=0x7fd1400b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 -- 172.21.15.61:0/1476800072 shutdown_connections 2023-12-24T19:57:50.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.728+0000 7fd14562e700 1 -- 172.21.15.61:0/1476800072 wait complete. 2023-12-24T19:57:50.730 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T19:57:50.743 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T19:57:50.743 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T19:57:50.743 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T19:57:50.743 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:57:50.743 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T19:57:50.744 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T19:57:50.744 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T19:57:50.744 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:57:50.744 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T19:57:50.744 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T19:57:50.744 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T19:57:50.744 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:57:50.745 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T19:57:50.745 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T19:57:50.745 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T19:57:50.745 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:57:50.752 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T19:57:50.753 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T19:57:50.753 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T19:57:50.754 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T19:57:50.755 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T19:57:50.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T19:57:50.756 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T19:57:50.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T19:57:50.795 INFO:tasks.ceph.mds.a:Started 2023-12-24T19:57:50.796 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:50.797 INFO:tasks.ceph.mds.c:Started 2023-12-24T19:57:50.797 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:50.798 INFO:tasks.ceph.mds.d:Started 2023-12-24T19:57:50.798 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:50.798 INFO:tasks.ceph.mds.b:Started 2023-12-24T19:57:50.799 DEBUG:teuthology.parallel:result is None 2023-12-24T19:57:50.799 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T19:57:50.879 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T19:57:50.879 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T19:57:50.881 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T19:57:50.881 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T19:57:50.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.930+0000 7f801b114700 1 Processor -- start 2023-12-24T19:57:50.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.930+0000 7f801b114700 1 -- start start 2023-12-24T19:57:50.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.931+0000 7f801b114700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014156b80 0x7f8014068560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.931+0000 7f801b114700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80140c8a90 con 0x7f80141567b0 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.931+0000 7f801b114700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8014068ee0 con 0x7f8014068aa0 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.931+0000 7f801b114700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80140c7e80 con 0x7f8014156b80 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.931+0000 7f8018eb0700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f80141567b0 0x7f80140c97d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38992/0 (socket says 172.21.15.61:38992) 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.931+0000 7f8018eb0700 1 -- 172.21.15.61:0/1257114013 learned_addr learned my addr 172.21.15.61:0/1257114013 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f8013fff700 1 --2- 172.21.15.61:0/1257114013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014156b80 0x7f8014068560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f80137fe700 1 -- 172.21.15.61:0/1257114013 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321314645 0 0) 0x7f80140c8a90 con 0x7f80141567b0 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f80137fe700 1 -- 172.21.15.61:0/1257114013 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8004003570 con 0x7f80141567b0 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f80137fe700 1 -- 172.21.15.61:0/1257114013 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163044946 0 0) 0x7f8014068ee0 con 0x7f8014068aa0 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f80137fe700 1 -- 172.21.15.61:0/1257114013 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80140c8a90 con 0x7f8014068aa0 2023-12-24T19:57:50.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f80137fe700 1 -- 172.21.15.61:0/1257114013 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2422091069 0 0) 0x7f8004003570 con 0x7f80141567b0 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f8013fff700 1 -- 172.21.15.61:0/1257114013 >> v1:172.21.15.133:6789/0 conn(0x7f8014068aa0 legacy=0x7f80140ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f8013fff700 1 -- 172.21.15.61:0/1257114013 >> v1:172.21.15.61:6789/0 conn(0x7f80141567b0 legacy=0x7f80140c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f8013fff700 1 -- 172.21.15.61:0/1257114013 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140c8160 con 0x7f8014156b80 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f8013fff700 1 --2- 172.21.15.61:0/1257114013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014156b80 0x7f8014068560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8000009910 tx=0x7f80000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0bb5ebd57a6cbb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f80137fe700 1 -- 172.21.15.61:0/1257114013 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008001470 con 0x7f8014156b80 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f80137fe700 1 -- 172.21.15.61:0/1257114013 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8000011420 con 0x7f8014156b80 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.932+0000 7f80137fe700 1 -- 172.21.15.61:0/1257114013 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80000117c0 con 0x7f8014156b80 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.933+0000 7f801b114700 1 -- 172.21.15.61:0/1257114013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014156b80 msgr2=0x7f8014068560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.933+0000 7f801b114700 1 --2- 172.21.15.61:0/1257114013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014156b80 0x7f8014068560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8000009910 tx=0x7f80000091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.933+0000 7f801b114700 1 -- 172.21.15.61:0/1257114013 shutdown_connections 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.933+0000 7f801b114700 1 --2- 172.21.15.61:0/1257114013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014156b80 0x7f8014068560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.933+0000 7f801b114700 1 -- 172.21.15.61:0/1257114013 >> 172.21.15.61:0/1257114013 conn(0x7f80140cac10 msgr2=0x7f801406da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.933+0000 7f801b114700 1 -- 172.21.15.61:0/1257114013 shutdown_connections 2023-12-24T19:57:50.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.933+0000 7f801b114700 1 -- 172.21.15.61:0/1257114013 wait complete. 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.934+0000 7f801b114700 1 Processor -- start 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.935+0000 7f801b114700 1 -- start start 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.935+0000 7f801b114700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014068aa0 0x7f80140b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.935+0000 7f801b114700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80141567b0 0x7f8014143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.935+0000 7f801b114700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8014156b80 0x7f8014157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.935+0000 7f801b114700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80140b0680 con 0x7f8014156b80 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.935+0000 7f801b114700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8014167800 con 0x7f80141567b0 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.935+0000 7f801b114700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8014167ae0 con 0x7f8014068aa0 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f80196b1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8014156b80 0x7f8014157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f80196b1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8014156b80 0x7f8014157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59116/0 (socket says 172.21.15.61:59116) 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f80196b1700 1 -- 172.21.15.61:0/157090295 learned_addr learned my addr 172.21.15.61:0/157090295 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f8013fff700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80141567b0 0x7f8014143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f8018eb0700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014068aa0 0x7f80140b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f80196b1700 1 -- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014068aa0 msgr2=0x7f80140b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f80196b1700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014068aa0 0x7f80140b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f80196b1700 1 -- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80141567b0 msgr2=0x7f8014143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f80196b1700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80141567b0 0x7f8014143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f80196b1700 1 -- 172.21.15.61:0/157090295 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8000009420 con 0x7f8014156b80 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f80196b1700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8014156b80 0x7f8014157320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c860 tx=0x7f800c002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f8010ff9700 1 -- 172.21.15.61:0/157090295 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c002030 con 0x7f8014156b80 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f8010ff9700 1 -- 172.21.15.61:0/157090295 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c0021b0 con 0x7f8014156b80 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f801b114700 1 -- 172.21.15.61:0/157090295 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8014167dc0 con 0x7f8014156b80 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f8010ff9700 1 -- 172.21.15.61:0/157090295 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c012630 con 0x7f8014156b80 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.936+0000 7f801b114700 1 -- 172.21.15.61:0/157090295 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80140b21c0 con 0x7f8014156b80 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.937+0000 7f801b114700 1 -- 172.21.15.61:0/157090295 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80140b07f0 con 0x7f8014156b80 2023-12-24T19:57:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.938+0000 7f8010ff9700 1 -- 172.21.15.61:0/157090295 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f800c0129e0 con 0x7f8014156b80 2023-12-24T19:57:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.938+0000 7f8010ff9700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7ff8066f30 0x7f7ff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.938+0000 7f8010ff9700 1 -- 172.21.15.61:0/157090295 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f800c0840f0 con 0x7f8014156b80 2023-12-24T19:57:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.938+0000 7f8018eb0700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7ff8066f30 0x7f7ff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.939+0000 7f8018eb0700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7ff8066f30 0x7f7ff80693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8008001ed0 tx=0x7f80080019d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:50.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:50.942+0000 7f8010ff9700 1 -- 172.21.15.61:0/157090295 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80140b07f0 con 0x7f8014156b80 2023-12-24T19:57:51.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.151+0000 7f801b114700 1 -- 172.21.15.61:0/157090295 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f80140b07f0 con 0x7f8014156b80 2023-12-24T19:57:51.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.731+0000 7f8010ff9700 1 -- 172.21.15.61:0/157090295 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f80140b07f0 con 0x7f8014156b80 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 -- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7ff8066f30 msgr2=0x7f7ff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7ff8066f30 0x7f7ff80693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8008001ed0 tx=0x7f80080019d0 comp rx=0 tx=0).stop 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 -- 172.21.15.61:0/157090295 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8014156b80 msgr2=0x7f8014157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8014156b80 0x7f8014157320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c860 tx=0x7f800c002700 comp rx=0 tx=0).stop 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 -- 172.21.15.61:0/157090295 shutdown_connections 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8014068aa0 0x7f80140b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7ff8066f30 0x7f7ff80693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8014156b80 0x7f8014157320 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 --2- 172.21.15.61:0/157090295 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80141567b0 0x7f8014143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 -- 172.21.15.61:0/157090295 >> 172.21.15.61:0/157090295 conn(0x7f80140cac10 msgr2=0x7f8014067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 -- 172.21.15.61:0/157090295 shutdown_connections 2023-12-24T19:57:51.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.733+0000 7f801b114700 1 -- 172.21.15.61:0/157090295 wait complete. 2023-12-24T19:57:51.735 INFO:teuthology.orchestra.run.smithi061.stderr: removed all blocklist entries 2023-12-24T19:57:51.748 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T19:57:51.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.873+0000 7fc3b92ed700 1 Processor -- start 2023-12-24T19:57:51.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.873+0000 7fc3b92ed700 1 -- start start 2023-12-24T19:57:51.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.874+0000 7fc3b92ed700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3b4159850 0x7fc3b4159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.874+0000 7fc3b92ed700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc3b40caa80 0x7fc3b40aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.874+0000 7fc3b92ed700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b406a630 con 0x7fc3b406aac0 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.874+0000 7fc3b92ed700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40cccf0 con 0x7fc3b40caa80 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.874+0000 7fc3b92ed700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b4069d00 con 0x7fc3b4159850 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.874+0000 7fc3b37fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc3b40caa80 0x7fc3b40aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.874+0000 7fc3b37fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc3b40caa80 0x7fc3b40aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59132/0 (socket says 172.21.15.61:59132) 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.874+0000 7fc3b37fe700 1 -- 172.21.15.61:0/98693599 learned_addr learned my addr 172.21.15.61:0/98693599 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.874+0000 7fc3b2ffd700 1 --2- 172.21.15.61:0/98693599 >> v2:172.21.15.133:3300/0 conn(0x7fc3b4159850 0x7fc3b4159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b37fe700 1 -- 172.21.15.61:0/98693599 >> v2:172.21.15.133:3300/0 conn(0x7fc3b4159850 msgr2=0x7fc3b4159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b37fe700 1 --2- 172.21.15.61:0/98693599 >> v2:172.21.15.133:3300/0 conn(0x7fc3b4159850 0x7fc3b4159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b37fe700 1 -- 172.21.15.61:0/98693599 >> v1:172.21.15.133:6789/0 conn(0x7fc3b406aac0 legacy=0x7fc3b40cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b37fe700 1 -- 172.21.15.61:0/98693599 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b4069fe0 con 0x7fc3b40caa80 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b2ffd700 1 --2- 172.21.15.61:0/98693599 >> v2:172.21.15.133:3300/0 conn(0x7fc3b4159850 0x7fc3b4159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:51.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b37fe700 1 --2- 172.21.15.61:0/98693599 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 0x7fc3b40aa880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40ca970 tx=0x7fc3a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad01be1fe6ce13e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b1ffb700 1 -- 172.21.15.61:0/98693599 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400e070 con 0x7fc3b40caa80 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b1ffb700 1 -- 172.21.15.61:0/98693599 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a400ba50 con 0x7fc3b40caa80 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b1ffb700 1 -- 172.21.15.61:0/98693599 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40092e0 con 0x7fc3b40caa80 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b92ed700 1 -- 172.21.15.61:0/98693599 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 msgr2=0x7fc3b40aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.875+0000 7fc3b92ed700 1 --2- 172.21.15.61:0/98693599 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 0x7fc3b40aa880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40ca970 tx=0x7fc3a4009840 comp rx=0 tx=0).stop 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.876+0000 7fc3b92ed700 1 -- 172.21.15.61:0/98693599 shutdown_connections 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.876+0000 7fc3b92ed700 1 --2- 172.21.15.61:0/98693599 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 0x7fc3b40aa880 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.876+0000 7fc3b92ed700 1 --2- 172.21.15.61:0/98693599 >> v2:172.21.15.133:3300/0 conn(0x7fc3b4159850 0x7fc3b4159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.876+0000 7fc3b92ed700 1 -- 172.21.15.61:0/98693599 >> 172.21.15.61:0/98693599 conn(0x7fc3b40cceb0 msgr2=0x7fc3b40cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.876+0000 7fc3b92ed700 1 -- 172.21.15.61:0/98693599 shutdown_connections 2023-12-24T19:57:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.876+0000 7fc3b92ed700 1 -- 172.21.15.61:0/98693599 wait complete. 2023-12-24T19:57:51.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.877+0000 7fc3b92ed700 1 Processor -- start 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.877+0000 7fc3b92ed700 1 -- start start 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b92ed700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3b406aac0 0x7fc3b40b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b92ed700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 0x7fc3b415bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b92ed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3b4159850 0x7fc3b415c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b92ed700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4169c80 con 0x7fc3b40caa80 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b92ed700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b40b1180 con 0x7fc3b4159850 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b92ed700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b40b1460 con 0x7fc3b406aac0 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b27fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 0x7fc3b415bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b27fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 0x7fc3b415bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59138/0 (socket says 172.21.15.61:59138) 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b27fc700 1 -- 172.21.15.61:0/4065091624 learned_addr learned my addr 172.21.15.61:0/4065091624 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b37fe700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3b4159850 0x7fc3b415c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b2ffd700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3b406aac0 0x7fc3b40b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b27fc700 1 -- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3b406aac0 msgr2=0x7fc3b40b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b27fc700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3b406aac0 0x7fc3b40b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b27fc700 1 -- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3b4159850 msgr2=0x7fc3b415c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b27fc700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3b4159850 0x7fc3b415c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b27fc700 1 -- 172.21.15.61:0/4065091624 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4009ae0 con 0x7fc3b40caa80 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b27fc700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 0x7fc3b415bc10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00c590 tx=0x7fc39c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3aaffd700 1 -- 172.21.15.61:0/4065091624 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c011590 con 0x7fc3b40caa80 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3aaffd700 1 -- 172.21.15.61:0/4065091624 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c0116f0 con 0x7fc3b40caa80 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3aaffd700 1 -- 172.21.15.61:0/4065091624 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c011ab0 con 0x7fc3b40caa80 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b92ed700 1 -- 172.21.15.61:0/4065091624 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b40b1740 con 0x7fc3b40caa80 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.878+0000 7fc3b92ed700 1 -- 172.21.15.61:0/4065091624 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b40b2470 con 0x7fc3b40caa80 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.879+0000 7fc3b92ed700 1 -- 172.21.15.61:0/4065091624 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b4169e30 con 0x7fc3b40caa80 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.880+0000 7fc3aaffd700 1 -- 172.21.15.61:0/4065091624 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc39c01b3b0 con 0x7fc3b40caa80 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.880+0000 7fc3aaffd700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc394066f30 0x7fc3940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.880+0000 7fc3aaffd700 1 -- 172.21.15.61:0/4065091624 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc39c083740 con 0x7fc3b40caa80 2023-12-24T19:57:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.880+0000 7fc3b2ffd700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc394066f30 0x7fc3940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:51.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.881+0000 7fc3b2ffd700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc394066f30 0x7fc3940693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac006f00 tx=0x7fc3ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:51.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:51.885+0000 7fc3aaffd700 1 -- 172.21.15.61:0/4065091624 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3b4169e30 con 0x7fc3b40caa80 2023-12-24T19:57:52.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.156+0000 7fc3b92ed700 1 -- 172.21.15.61:0/4065091624 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc3b404c3c0 con 0x7fc3b40caa80 2023-12-24T19:57:52.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.157+0000 7fc3aaffd700 1 -- 172.21.15.61:0/4065091624 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fc39c017090 con 0x7fc3b40caa80 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: "auth_dump": [ 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.a", 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew==", 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.158 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.b", 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw==", 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.c", 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g==", 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.d", 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg==", 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.160 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.0", 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag==", 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.1", 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw==", 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.161 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.2", 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ==", 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.162 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.3", 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA==", 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.4", 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ==", 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:57:52.163 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.5", 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w==", 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.164 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.6", 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw==", 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.7", 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw==", 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:57:52.165 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.0", 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA==", 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.1", 2023-12-24T19:57:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w==", 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.2", 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg==", 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T19:57:52.167 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.3", 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g==", 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.168 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.admin", 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlwF3pGRAA8h0Cld7lwZprlrgMAN7tSg==", 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.bootstrap-mds", 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQAAjYhl8MU3LBAAm0BJJbSOjtlwP17VKHrTQw==", 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.169 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile bootstrap-mds" 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.bootstrap-mgr", 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQAAjYhlwc83LBAAitDZbTTbqF4Ohf+WNgFKlw==", 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.bootstrap-osd", 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQAAjYhlatk3LBAADQglfn8xcwePl1Fs5l4Tbg==", 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile bootstrap-osd" 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.170 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.bootstrap-rbd", 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQAAjYhlq+M3LBAApzNia/z18btImt4PYPKbtQ==", 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQAAjYhl/+s3LBAA3mtuRTQ2g64CndI/CsVJCA==", 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.171 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.bootstrap-rgw", 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQAAjYhlbPQ3LBAAfLdN9vh3G83DSYckcRYdzQ==", 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.x", 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg==", 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.y", 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A==", 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:57:52.173 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 -- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc394066f30 msgr2=0x7fc3940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc394066f30 0x7fc3940693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac006f00 tx=0x7fc3ac008040 comp rx=0 tx=0).stop 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 -- 172.21.15.61:0/4065091624 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 msgr2=0x7fc3b415bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 0x7fc3b415bc10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00c590 tx=0x7fc39c00c950 comp rx=0 tx=0).stop 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 -- 172.21.15.61:0/4065091624 shutdown_connections 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3b406aac0 0x7fc3b40b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc394066f30 0x7fc3940693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3b4159850 0x7fc3b415c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 --2- 172.21.15.61:0/4065091624 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3b40caa80 0x7fc3b415bc10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 -- 172.21.15.61:0/4065091624 >> 172.21.15.61:0/4065091624 conn(0x7fc3b40cceb0 msgr2=0x7fc3b406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:52.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 -- 172.21.15.61:0/4065091624 shutdown_connections 2023-12-24T19:57:52.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.159+0000 7fc3b92ed700 1 -- 172.21.15.61:0/4065091624 wait complete. 2023-12-24T19:57:52.176 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-24T19:57:52.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.298+0000 7f4d1563c700 1 Processor -- start 2023-12-24T19:57:52.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.298+0000 7f4d1563c700 1 -- start start 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.299+0000 7f4d1563c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d10157a70 0x7f4d10063ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.299+0000 7f4d1563c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d100cba70 0x7f4d100cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.299+0000 7f4d1563c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d10158430 con 0x7f4d101576a0 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.299+0000 7f4d1563c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d10157ee0 con 0x7f4d100cba70 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.299+0000 7f4d1563c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d100cc3f0 con 0x7f4d10157a70 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.299+0000 7f4d0f7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d100cba70 0x7f4d100cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.299+0000 7f4d0f7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d100cba70 0x7f4d100cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59142/0 (socket says 172.21.15.61:59142) 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.299+0000 7f4d0f7fe700 1 -- 172.21.15.61:0/2590370553 learned_addr learned my addr 172.21.15.61:0/2590370553 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.300+0000 7f4d0e7fc700 1 --2- 172.21.15.61:0/2590370553 >> v2:172.21.15.133:3300/0 conn(0x7f4d10157a70 0x7f4d10063ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.300+0000 7f4d0f7fe700 1 -- 172.21.15.61:0/2590370553 >> v2:172.21.15.133:3300/0 conn(0x7f4d10157a70 msgr2=0x7f4d10063ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.300+0000 7f4d0f7fe700 1 --2- 172.21.15.61:0/2590370553 >> v2:172.21.15.133:3300/0 conn(0x7f4d10157a70 0x7f4d10063ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.300+0000 7f4d0f7fe700 1 -- 172.21.15.61:0/2590370553 >> v1:172.21.15.133:6789/0 conn(0x7f4d101576a0 legacy=0x7f4d101588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.300+0000 7f4d0f7fe700 1 -- 172.21.15.61:0/2590370553 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d10158100 con 0x7f4d100cba70 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.300+0000 7f4d0f7fe700 1 --2- 172.21.15.61:0/2590370553 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d100cba70 0x7f4d100cbeb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d1006acd0 tx=0x7f4d08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eadb11cbfd87119 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.300+0000 7f4d0dffb700 1 -- 172.21.15.61:0/2590370553 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0800e070 con 0x7f4d100cba70 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.300+0000 7f4d0dffb700 1 -- 172.21.15.61:0/2590370553 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0800ba50 con 0x7f4d100cba70 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.300+0000 7f4d0dffb700 1 -- 172.21.15.61:0/2590370553 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080092e0 con 0x7f4d100cba70 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.301+0000 7f4d1563c700 1 -- 172.21.15.61:0/2590370553 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d100cba70 msgr2=0x7f4d100cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.301+0000 7f4d1563c700 1 --2- 172.21.15.61:0/2590370553 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d100cba70 0x7f4d100cbeb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d1006acd0 tx=0x7f4d08009840 comp rx=0 tx=0).stop 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.301+0000 7f4d1563c700 1 -- 172.21.15.61:0/2590370553 shutdown_connections 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.301+0000 7f4d1563c700 1 --2- 172.21.15.61:0/2590370553 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d100cba70 0x7f4d100cbeb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.301+0000 7f4d1563c700 1 --2- 172.21.15.61:0/2590370553 >> v2:172.21.15.133:3300/0 conn(0x7f4d10157a70 0x7f4d10063ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.301+0000 7f4d1563c700 1 -- 172.21.15.61:0/2590370553 >> 172.21.15.61:0/2590370553 conn(0x7f4d100ca3c0 msgr2=0x7f4d10067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.301+0000 7f4d1563c700 1 -- 172.21.15.61:0/2590370553 shutdown_connections 2023-12-24T19:57:52.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.301+0000 7f4d1563c700 1 -- 172.21.15.61:0/2590370553 wait complete. 2023-12-24T19:57:52.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.302+0000 7f4d1563c700 1 Processor -- start 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.302+0000 7f4d1563c700 1 -- start start 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d1563c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d100cba70 0x7f4d100c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d1563c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d101576a0 0x7f4d101438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d1563c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d10157a70 0x7f4d101678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d1563c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100c6170 con 0x7f4d10157a70 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d1563c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d10168150 con 0x7f4d101576a0 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d1563c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d10168430 con 0x7f4d100cba70 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d10157a70 0x7f4d101678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d10157a70 0x7f4d101678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59154/0 (socket says 172.21.15.61:59154) 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0f7fe700 1 -- 172.21.15.61:0/2179382670 learned_addr learned my addr 172.21.15.61:0/2179382670 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0e7fc700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d101576a0 0x7f4d101438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0effd700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d100cba70 0x7f4d100c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0f7fe700 1 -- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d100cba70 msgr2=0x7f4d100c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0f7fe700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d100cba70 0x7f4d100c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0f7fe700 1 -- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d101576a0 msgr2=0x7f4d101438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0f7fe700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d101576a0 0x7f4d101438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0f7fe700 1 -- 172.21.15.61:0/2179382670 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d08009ae0 con 0x7f4d10157a70 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4d0f7fe700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d10157a70 0x7f4d101678a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4d1006bf80 tx=0x7f4d08018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4cf6ffd700 1 -- 172.21.15.61:0/2179382670 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08008ce0 con 0x7f4d10157a70 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.303+0000 7f4cf6ffd700 1 -- 172.21.15.61:0/2179382670 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d08008e60 con 0x7f4d10157a70 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.304+0000 7f4d1563c700 1 -- 172.21.15.61:0/2179382670 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d10168710 con 0x7f4d10157a70 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.304+0000 7f4cf6ffd700 1 -- 172.21.15.61:0/2179382670 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080266b0 con 0x7f4d10157a70 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.304+0000 7f4d1563c700 1 -- 172.21.15.61:0/2179382670 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d10167de0 con 0x7f4d10157a70 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.304+0000 7f4d1563c700 1 -- 172.21.15.61:0/2179382670 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d100c6320 con 0x7f4d10157a70 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.305+0000 7f4cf6ffd700 1 -- 172.21.15.61:0/2179382670 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4d08003040 con 0x7f4d10157a70 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.305+0000 7f4cf6ffd700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4cfc066f30 0x7f4cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.305+0000 7f4cf6ffd700 1 -- 172.21.15.61:0/2179382670 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4d080860c0 con 0x7f4d10157a70 2023-12-24T19:57:52.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.305+0000 7f4d0effd700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4cfc066f30 0x7f4cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.306+0000 7f4d0effd700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4cfc066f30 0x7f4cfc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d04003a80 tx=0x7f4d04007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:52.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.310+0000 7f4cf6ffd700 1 -- 172.21.15.61:0/2179382670 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d100c6320 con 0x7f4d10157a70 2023-12-24T19:57:52.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.588+0000 7f4d1563c700 1 -- 172.21.15.61:0/2179382670 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f4d1004c3c0 con 0x7f4d10157a70 2023-12-24T19:57:52.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.591+0000 7f4cf6ffd700 1 -- 172.21.15.61:0/2179382670 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4d08053680 con 0x7f4d10157a70 2023-12-24T19:57:52.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 -- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4cfc066f30 msgr2=0x7f4cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4cfc066f30 0x7f4cfc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4d04003a80 tx=0x7f4d04007ec0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 -- 172.21.15.61:0/2179382670 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d10157a70 msgr2=0x7f4d101678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d10157a70 0x7f4d101678a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4d1006bf80 tx=0x7f4d08018000 comp rx=0 tx=0).stop 2023-12-24T19:57:52.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 -- 172.21.15.61:0/2179382670 shutdown_connections 2023-12-24T19:57:52.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d100cba70 0x7f4d100c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4cfc066f30 0x7f4cfc0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d10157a70 0x7f4d101678a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 --2- 172.21.15.61:0/2179382670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d101576a0 0x7f4d101438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 -- 172.21.15.61:0/2179382670 >> 172.21.15.61:0/2179382670 conn(0x7f4d100ca3c0 msgr2=0x7f4d100ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:52.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 -- 172.21.15.61:0/2179382670 shutdown_connections 2023-12-24T19:57:52.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.593+0000 7f4d1563c700 1 -- 172.21.15.61:0/2179382670 wait complete. 2023-12-24T19:57:52.605 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-24T19:57:52.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.727+0000 7fd42b510700 1 Processor -- start 2023-12-24T19:57:52.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.728+0000 7fd42b510700 1 -- start start 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd42b510700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd424159be0 0x7fd4240b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd42b510700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd424159fb0 0x7fd4240af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd42b510700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4240ad2f0 con 0x7fd4240afdc0 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd42b510700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4240b13f0 con 0x7fd424159fb0 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd42b510700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4240ac6e0 con 0x7fd424159be0 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd428aab700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd424159fb0 0x7fd4240af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd428aab700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd424159fb0 0x7fd4240af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59162/0 (socket says 172.21.15.61:59162) 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd428aab700 1 -- 172.21.15.61:0/1392701314 learned_addr learned my addr 172.21.15.61:0/1392701314 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd4292ac700 1 --2- 172.21.15.61:0/1392701314 >> v2:172.21.15.133:3300/0 conn(0x7fd424159be0 0x7fd4240b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd428aab700 1 -- 172.21.15.61:0/1392701314 >> v2:172.21.15.133:3300/0 conn(0x7fd424159be0 msgr2=0x7fd4240b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd428aab700 1 --2- 172.21.15.61:0/1392701314 >> v2:172.21.15.133:3300/0 conn(0x7fd424159be0 0x7fd4240b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd428aab700 1 -- 172.21.15.61:0/1392701314 >> v1:172.21.15.133:6789/0 conn(0x7fd4240afdc0 legacy=0x7fd42415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd428aab700 1 -- 172.21.15.61:0/1392701314 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4240ac9c0 con 0x7fd424159fb0 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.729+0000 7fd428aab700 1 --2- 172.21.15.61:0/1392701314 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd424159fb0 0x7fd4240af410 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd4240af190 tx=0x7fd414009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3c0d49fa2b0fc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd41bfff700 1 -- 172.21.15.61:0/1392701314 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414009e70 con 0x7fd424159fb0 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd41bfff700 1 -- 172.21.15.61:0/1392701314 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41400b860 con 0x7fd424159fb0 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd41bfff700 1 -- 172.21.15.61:0/1392701314 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41400bc00 con 0x7fd424159fb0 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd42b510700 1 -- 172.21.15.61:0/1392701314 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd424159fb0 msgr2=0x7fd4240af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd42b510700 1 --2- 172.21.15.61:0/1392701314 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd424159fb0 0x7fd4240af410 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd4240af190 tx=0x7fd414009250 comp rx=0 tx=0).stop 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd42b510700 1 -- 172.21.15.61:0/1392701314 shutdown_connections 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd42b510700 1 --2- 172.21.15.61:0/1392701314 >> v2:172.21.15.133:3300/0 conn(0x7fd424159be0 0x7fd4240b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd42b510700 1 --2- 172.21.15.61:0/1392701314 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd424159fb0 0x7fd4240af410 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd42b510700 1 -- 172.21.15.61:0/1392701314 >> 172.21.15.61:0/1392701314 conn(0x7fd424068020 msgr2=0x7fd4240cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd42b510700 1 -- 172.21.15.61:0/1392701314 shutdown_connections 2023-12-24T19:57:52.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.730+0000 7fd42b510700 1 -- 172.21.15.61:0/1392701314 wait complete. 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.732+0000 7fd42b510700 1 Processor -- start 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.732+0000 7fd42b510700 1 -- start start 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.732+0000 7fd42b510700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4240afdc0 0x7fd42414e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.732+0000 7fd42b510700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd424159be0 0x7fd4240abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd42b510700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd424159fb0 0x7fd42416df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd42b510700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42416d7e0 con 0x7fd4240afdc0 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd42b510700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42416dac0 con 0x7fd424159fb0 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd42b510700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42414e790 con 0x7fd424159be0 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4292ac700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4240afdc0 0x7fd42414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4292ac700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4240afdc0 0x7fd42414e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59178/0 (socket says 172.21.15.61:59178) 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4292ac700 1 -- 172.21.15.61:0/1615629926 learned_addr learned my addr 172.21.15.61:0/1615629926 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:52.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd428aab700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd424159be0 0x7fd4240abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd429aad700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd424159fb0 0x7fd42416df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4292ac700 1 -- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd424159be0 msgr2=0x7fd4240abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4292ac700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd424159be0 0x7fd4240abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4292ac700 1 -- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd424159fb0 msgr2=0x7fd42416df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4292ac700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd424159fb0 0x7fd42416df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4292ac700 1 -- 172.21.15.61:0/1615629926 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140094f0 con 0x7fd4240afdc0 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4292ac700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4240afdc0 0x7fd42414e250 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd42000ee10 tx=0x7fd42000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4197fa700 1 -- 172.21.15.61:0/1615629926 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42000dd30 con 0x7fd4240afdc0 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4197fa700 1 -- 172.21.15.61:0/1615629926 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42000de90 con 0x7fd4240afdc0 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd42b510700 1 -- 172.21.15.61:0/1615629926 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42414ea30 con 0x7fd4240afdc0 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.733+0000 7fd4197fa700 1 -- 172.21.15.61:0/1615629926 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420010650 con 0x7fd4240afdc0 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.734+0000 7fd42b510700 1 -- 172.21.15.61:0/1615629926 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42414eff0 con 0x7fd4240afdc0 2023-12-24T19:57:52.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.734+0000 7fd42b510700 1 -- 172.21.15.61:0/1615629926 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42414f1e0 con 0x7fd4240afdc0 2023-12-24T19:57:52.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.735+0000 7fd4197fa700 1 -- 172.21.15.61:0/1615629926 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd420010a40 con 0x7fd4240afdc0 2023-12-24T19:57:52.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.735+0000 7fd4197fa700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd408066f30 0x7fd4080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:52.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.735+0000 7fd4197fa700 1 -- 172.21.15.61:0/1615629926 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd4200844e0 con 0x7fd4240afdc0 2023-12-24T19:57:52.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.735+0000 7fd428aab700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd408066f30 0x7fd4080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:52.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.736+0000 7fd428aab700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd408066f30 0x7fd4080693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd42406ee00 tx=0x7fd414017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:52.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:52.739+0000 7fd4197fa700 1 -- 172.21.15.61:0/1615629926 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd420051aa0 con 0x7fd4240afdc0 2023-12-24T19:57:53.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.014+0000 7fd42b510700 1 -- 172.21.15.61:0/1615629926 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd42416dda0 con 0x7fd4240afdc0 2023-12-24T19:57:53.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.018+0000 7fd4197fa700 1 -- 172.21.15.61:0/1615629926 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd420084030 con 0x7fd4240afdc0 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 -- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd408066f30 msgr2=0x7fd4080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd408066f30 0x7fd4080693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd42406ee00 tx=0x7fd414017000 comp rx=0 tx=0).stop 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 -- 172.21.15.61:0/1615629926 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4240afdc0 msgr2=0x7fd42414e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4240afdc0 0x7fd42414e250 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd42000ee10 tx=0x7fd42000b430 comp rx=0 tx=0).stop 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 -- 172.21.15.61:0/1615629926 shutdown_connections 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd408066f30 0x7fd4080693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd424159fb0 0x7fd42416df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd4240afdc0 0x7fd42414e250 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 --2- 172.21.15.61:0/1615629926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd424159be0 0x7fd4240abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 -- 172.21.15.61:0/1615629926 >> 172.21.15.61:0/1615629926 conn(0x7fd424068020 msgr2=0x7fd4240696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:53.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 -- 172.21.15.61:0/1615629926 shutdown_connections 2023-12-24T19:57:53.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.020+0000 7fd42b510700 1 -- 172.21.15.61:0/1615629926 wait complete. 2023-12-24T19:57:53.032 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-24T19:57:53.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.154+0000 7f80f4578700 1 Processor -- start 2023-12-24T19:57:53.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.154+0000 7f80f4578700 1 -- start start 2023-12-24T19:57:53.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f4578700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80ec1599f0 0x7f80ec071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f4578700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f80ec15e2a0 0x7f80ec0c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f4578700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec0c9230 con 0x7f80ec068560 2023-12-24T19:57:53.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f4578700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ec0c9510 con 0x7f80ec15e2a0 2023-12-24T19:57:53.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f4578700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec15d7c0 con 0x7f80ec1599f0 2023-12-24T19:57:53.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f1b13700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f80ec15e2a0 0x7f80ec0c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f1b13700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f80ec15e2a0 0x7f80ec0c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59180/0 (socket says 172.21.15.61:59180) 2023-12-24T19:57:53.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f1b13700 1 -- 172.21.15.61:0/3578546112 learned_addr learned my addr 172.21.15.61:0/3578546112 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:53.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f2314700 1 --2- 172.21.15.61:0/3578546112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80ec1599f0 0x7f80ec071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f1b13700 1 -- 172.21.15.61:0/3578546112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80ec1599f0 msgr2=0x7f80ec071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:53.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f1b13700 1 --2- 172.21.15.61:0/3578546112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80ec1599f0 0x7f80ec071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f1b13700 1 -- 172.21.15.61:0/3578546112 >> v1:172.21.15.133:6789/0 conn(0x7f80ec068560 legacy=0x7f80ec0c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.155+0000 7f80f1b13700 1 -- 172.21.15.61:0/3578546112 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec15daa0 con 0x7f80ec15e2a0 2023-12-24T19:57:53.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f1b13700 1 --2- 172.21.15.61:0/3578546112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec15e2a0 0x7f80ec0c89e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0099b0 tx=0x7f80dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b8ab498f08cdd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:53.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f1312700 1 -- 172.21.15.61:0/3578546112 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc009ea0 con 0x7f80ec15e2a0 2023-12-24T19:57:53.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f1312700 1 -- 172.21.15.61:0/3578546112 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc00b860 con 0x7f80ec15e2a0 2023-12-24T19:57:53.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f1312700 1 -- 172.21.15.61:0/3578546112 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00bc20 con 0x7f80ec15e2a0 2023-12-24T19:57:53.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f4578700 1 -- 172.21.15.61:0/3578546112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec15e2a0 msgr2=0x7f80ec0c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f4578700 1 --2- 172.21.15.61:0/3578546112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec15e2a0 0x7f80ec0c89e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0099b0 tx=0x7f80dc009250 comp rx=0 tx=0).stop 2023-12-24T19:57:53.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f4578700 1 -- 172.21.15.61:0/3578546112 shutdown_connections 2023-12-24T19:57:53.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f4578700 1 --2- 172.21.15.61:0/3578546112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80ec1599f0 0x7f80ec071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f4578700 1 --2- 172.21.15.61:0/3578546112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec15e2a0 0x7f80ec0c89e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f4578700 1 -- 172.21.15.61:0/3578546112 >> 172.21.15.61:0/3578546112 conn(0x7f80ec0cac50 msgr2=0x7f80ec06da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:53.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f4578700 1 -- 172.21.15.61:0/3578546112 shutdown_connections 2023-12-24T19:57:53.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.156+0000 7f80f4578700 1 -- 172.21.15.61:0/3578546112 wait complete. 2023-12-24T19:57:53.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.158+0000 7f80f4578700 1 Processor -- start 2023-12-24T19:57:53.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.158+0000 7f80f4578700 1 -- start start 2023-12-24T19:57:53.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f4578700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec068560 0x7f80ec15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f4578700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80ec1599f0 0x7f80ec147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f4578700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80ec15e2a0 0x7f80ec158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f4578700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec15c8b0 con 0x7f80ec068560 2023-12-24T19:57:53.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f4578700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec15bca0 con 0x7f80ec15e2a0 2023-12-24T19:57:53.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f4578700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec15bf80 con 0x7f80ec1599f0 2023-12-24T19:57:53.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f2314700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec068560 0x7f80ec15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f2314700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec068560 0x7f80ec15b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59188/0 (socket says 172.21.15.61:59188) 2023-12-24T19:57:53.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f2314700 1 -- 172.21.15.61:0/1986684739 learned_addr learned my addr 172.21.15.61:0/1986684739 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:53.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f1b13700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80ec1599f0 0x7f80ec147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f2b15700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80ec15e2a0 0x7f80ec158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f2314700 1 -- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80ec1599f0 msgr2=0x7f80ec147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f2314700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80ec1599f0 0x7f80ec147010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f2314700 1 -- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80ec15e2a0 msgr2=0x7f80ec158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f2314700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80ec15e2a0 0x7f80ec158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.159+0000 7f80f2314700 1 -- 172.21.15.61:0/1986684739 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0094f0 con 0x7f80ec068560 2023-12-24T19:57:53.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.160+0000 7f80f2314700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec068560 0x7f80ec15b420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f80e800ec80 tx=0x7f80e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:53.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.160+0000 7f80e27fc700 1 -- 172.21.15.61:0/1986684739 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e800c850 con 0x7f80ec068560 2023-12-24T19:57:53.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.160+0000 7f80e27fc700 1 -- 172.21.15.61:0/1986684739 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e800c9b0 con 0x7f80ec068560 2023-12-24T19:57:53.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.160+0000 7f80f4578700 1 -- 172.21.15.61:0/1986684739 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec15c260 con 0x7f80ec068560 2023-12-24T19:57:53.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.160+0000 7f80e27fc700 1 -- 172.21.15.61:0/1986684739 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e800cd50 con 0x7f80ec068560 2023-12-24T19:57:53.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.160+0000 7f80f4578700 1 -- 172.21.15.61:0/1986684739 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec15b960 con 0x7f80ec068560 2023-12-24T19:57:53.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.161+0000 7f80f4578700 1 -- 172.21.15.61:0/1986684739 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec04c3c0 con 0x7f80ec068560 2023-12-24T19:57:53.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.161+0000 7f80e27fc700 1 -- 172.21.15.61:0/1986684739 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f80e8013680 con 0x7f80ec068560 2023-12-24T19:57:53.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.161+0000 7f80e27fc700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80d0066f30 0x7f80d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.162+0000 7f80e27fc700 1 -- 172.21.15.61:0/1986684739 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f80e80844a0 con 0x7f80ec068560 2023-12-24T19:57:53.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.162+0000 7f80f1b13700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80d0066f30 0x7f80d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.162+0000 7f80f1b13700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80d0066f30 0x7f80d00693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0099b0 tx=0x7f80dc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:53.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.166+0000 7f80e27fc700 1 -- 172.21.15.61:0/1986684739 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80e80519c0 con 0x7f80ec068560 2023-12-24T19:57:53.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.440+0000 7f80f4578700 1 -- 172.21.15.61:0/1986684739 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f80ec15dd80 con 0x7f80ec068560 2023-12-24T19:57:53.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.444+0000 7f80e27fc700 1 -- 172.21.15.61:0/1986684739 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f80e8054fe0 con 0x7f80ec068560 2023-12-24T19:57:53.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 -- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80d0066f30 msgr2=0x7f80d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80d0066f30 0x7f80d00693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0099b0 tx=0x7f80dc017000 comp rx=0 tx=0).stop 2023-12-24T19:57:53.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 -- 172.21.15.61:0/1986684739 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec068560 msgr2=0x7f80ec15b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec068560 0x7f80ec15b420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f80e800ec80 tx=0x7f80e80091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 -- 172.21.15.61:0/1986684739 shutdown_connections 2023-12-24T19:57:53.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80d0066f30 0x7f80d00693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80ec15e2a0 0x7f80ec158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80ec068560 0x7f80ec15b420 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 --2- 172.21.15.61:0/1986684739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80ec1599f0 0x7f80ec147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 -- 172.21.15.61:0/1986684739 >> 172.21.15.61:0/1986684739 conn(0x7f80ec0cac50 msgr2=0x7f80ec067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:53.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 -- 172.21.15.61:0/1986684739 shutdown_connections 2023-12-24T19:57:53.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.446+0000 7f80f4578700 1 -- 172.21.15.61:0/1986684739 wait complete. 2023-12-24T19:57:53.458 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-24T19:57:53.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.582+0000 7f94b35b6700 1 Processor -- start 2023-12-24T19:57:53.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.582+0000 7f94b35b6700 1 -- start start 2023-12-24T19:57:53.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94b35b6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94ac1599f0 0x7f94ac071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94b35b6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 0x7f94ac0c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94b35b6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac0c9230 con 0x7f94ac068560 2023-12-24T19:57:53.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94b35b6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac0c9510 con 0x7f94ac1599f0 2023-12-24T19:57:53.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94b35b6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac15d7c0 con 0x7f94ac15e2a0 2023-12-24T19:57:53.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94b1b53700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f94ac068560 0x7f94ac0c6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39006/0 (socket says 172.21.15.61:39006) 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94b1b53700 1 -- 172.21.15.61:0/2817023454 learned_addr learned my addr 172.21.15.61:0/2817023454 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94b0b51700 1 --2- 172.21.15.61:0/2817023454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 0x7f94ac0c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94b1352700 1 --2- 172.21.15.61:0/2817023454 >> v2:172.21.15.133:3300/0 conn(0x7f94ac1599f0 0x7f94ac071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94a3fff700 1 -- 172.21.15.61:0/2817023454 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652807803 0 0) 0x7f94ac0c9230 con 0x7f94ac068560 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.583+0000 7f94a3fff700 1 -- 172.21.15.61:0/2817023454 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9498003570 con 0x7f94ac068560 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.584+0000 7f94b0b51700 1 -- 172.21.15.61:0/2817023454 >> v2:172.21.15.133:3300/0 conn(0x7f94ac1599f0 msgr2=0x7f94ac071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.584+0000 7f94b0b51700 1 --2- 172.21.15.61:0/2817023454 >> v2:172.21.15.133:3300/0 conn(0x7f94ac1599f0 0x7f94ac071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.584+0000 7f94b0b51700 1 -- 172.21.15.61:0/2817023454 >> v1:172.21.15.61:6789/0 conn(0x7f94ac068560 legacy=0x7f94ac0c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.584+0000 7f94b0b51700 1 -- 172.21.15.61:0/2817023454 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac15daa0 con 0x7f94ac15e2a0 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.584+0000 7f94b0b51700 1 --2- 172.21.15.61:0/2817023454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 0x7f94ac0c89e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94a80098e0 tx=0x7f94a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2948bacb269c8d53 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.584+0000 7f94a3fff700 1 -- 172.21.15.61:0/2817023454 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8011630 con 0x7f94ac15e2a0 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.584+0000 7f94a3fff700 1 -- 172.21.15.61:0/2817023454 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a8011790 con 0x7f94ac15e2a0 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.584+0000 7f94a3fff700 1 -- 172.21.15.61:0/2817023454 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8011b10 con 0x7f94ac15e2a0 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.584+0000 7f94b35b6700 1 -- 172.21.15.61:0/2817023454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 msgr2=0x7f94ac0c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.584+0000 7f94b35b6700 1 --2- 172.21.15.61:0/2817023454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 0x7f94ac0c89e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94a80098e0 tx=0x7f94a80091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.585+0000 7f94b35b6700 1 -- 172.21.15.61:0/2817023454 shutdown_connections 2023-12-24T19:57:53.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.585+0000 7f94b35b6700 1 --2- 172.21.15.61:0/2817023454 >> v2:172.21.15.133:3300/0 conn(0x7f94ac1599f0 0x7f94ac071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.585+0000 7f94b35b6700 1 --2- 172.21.15.61:0/2817023454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 0x7f94ac0c89e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.585+0000 7f94b35b6700 1 -- 172.21.15.61:0/2817023454 >> 172.21.15.61:0/2817023454 conn(0x7f94ac0cac50 msgr2=0x7f94ac06da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:53.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.585+0000 7f94b35b6700 1 -- 172.21.15.61:0/2817023454 shutdown_connections 2023-12-24T19:57:53.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.585+0000 7f94b35b6700 1 -- 172.21.15.61:0/2817023454 wait complete. 2023-12-24T19:57:53.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.586+0000 7f94b35b6700 1 Processor -- start 2023-12-24T19:57:53.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.586+0000 7f94b35b6700 1 -- start start 2023-12-24T19:57:53.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b35b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94ac068560 0x7f94ac158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b35b6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94ac1599f0 0x7f94ac16a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b35b6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 0x7f94ac0b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b35b6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac16a880 con 0x7f94ac1599f0 2023-12-24T19:57:53.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b35b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac159fd0 con 0x7f94ac068560 2023-12-24T19:57:53.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b35b6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac16aab0 con 0x7f94ac15e2a0 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b0b51700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94ac1599f0 0x7f94ac16a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b0b51700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94ac1599f0 0x7f94ac16a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59200/0 (socket says 172.21.15.61:59200) 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b0b51700 1 -- 172.21.15.61:0/256629156 learned_addr learned my addr 172.21.15.61:0/256629156 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b1b53700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 0x7f94ac0b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b1352700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94ac068560 0x7f94ac158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b0b51700 1 -- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 msgr2=0x7f94ac0b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b0b51700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 0x7f94ac0b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b0b51700 1 -- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94ac068560 msgr2=0x7f94ac158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b0b51700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94ac068560 0x7f94ac158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b0b51700 1 -- 172.21.15.61:0/256629156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8009420 con 0x7f94ac1599f0 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94b0b51700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94ac1599f0 0x7f94ac16a340 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009ed0 tx=0x7f94a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94a17fa700 1 -- 172.21.15.61:0/256629156 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8002f90 con 0x7f94ac1599f0 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.587+0000 7f94a17fa700 1 -- 172.21.15.61:0/256629156 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a8011900 con 0x7f94ac1599f0 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.588+0000 7f94b35b6700 1 -- 172.21.15.61:0/256629156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac16ad90 con 0x7f94ac1599f0 2023-12-24T19:57:53.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.588+0000 7f94a17fa700 1 -- 172.21.15.61:0/256629156 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a801a680 con 0x7f94ac1599f0 2023-12-24T19:57:53.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.588+0000 7f94b35b6700 1 -- 172.21.15.61:0/256629156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac0b0bc0 con 0x7f94ac1599f0 2023-12-24T19:57:53.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.589+0000 7f94b35b6700 1 -- 172.21.15.61:0/256629156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac16b2b0 con 0x7f94ac1599f0 2023-12-24T19:57:53.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.589+0000 7f94a17fa700 1 -- 172.21.15.61:0/256629156 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f94a801aa70 con 0x7f94ac1599f0 2023-12-24T19:57:53.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.589+0000 7f94a17fa700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9490066f30 0x7f94900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:53.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.589+0000 7f94a17fa700 1 -- 172.21.15.61:0/256629156 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f94a8085cf0 con 0x7f94ac1599f0 2023-12-24T19:57:53.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.589+0000 7f94b1352700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9490066f30 0x7f94900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:53.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.590+0000 7f94b1352700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9490066f30 0x7f94900693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f949c009db0 tx=0x7f949c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:53.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.593+0000 7f94a17fa700 1 -- 172.21.15.61:0/256629156 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94a808a070 con 0x7f94ac1599f0 2023-12-24T19:57:53.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.869+0000 7f94b35b6700 1 -- 172.21.15.61:0/256629156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f94ac0cb320 con 0x7f94ac1599f0 2023-12-24T19:57:53.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.872+0000 7f94a17fa700 1 -- 172.21.15.61:0/256629156 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f94a80532b0 con 0x7f94ac1599f0 2023-12-24T19:57:53.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 -- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9490066f30 msgr2=0x7f94900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9490066f30 0x7f94900693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f949c009db0 tx=0x7f949c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 -- 172.21.15.61:0/256629156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94ac1599f0 msgr2=0x7f94ac16a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:53.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94ac1599f0 0x7f94ac16a340 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009ed0 tx=0x7f94a8017000 comp rx=0 tx=0).stop 2023-12-24T19:57:53.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 -- 172.21.15.61:0/256629156 shutdown_connections 2023-12-24T19:57:53.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94ac15e2a0 0x7f94ac0b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9490066f30 0x7f94900693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94ac068560 0x7f94ac158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 --2- 172.21.15.61:0/256629156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94ac1599f0 0x7f94ac16a340 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:53.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 -- 172.21.15.61:0/256629156 >> 172.21.15.61:0/256629156 conn(0x7f94ac0cac50 msgr2=0x7f94ac06bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:53.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 -- 172.21.15.61:0/256629156 shutdown_connections 2023-12-24T19:57:53.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:53.874+0000 7f94b35b6700 1 -- 172.21.15.61:0/256629156 wait complete. 2023-12-24T19:57:53.887 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-24T19:57:54.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.009+0000 7f7a177ca700 1 Processor -- start 2023-12-24T19:57:54.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.009+0000 7f7a177ca700 1 -- start start 2023-12-24T19:57:54.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a177ca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a10159920 0x7f7a1006f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a177ca700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1015aba0 con 0x7f7a10159cf0 2023-12-24T19:57:54.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a177ca700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1015ae80 con 0x7f7a100cd920 2023-12-24T19:57:54.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a177ca700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1006fbe0 con 0x7f7a10159920 2023-12-24T19:57:54.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a15d67700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7a10159cf0 0x7f7a1015a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39016/0 (socket says 172.21.15.61:39016) 2023-12-24T19:57:54.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a15d67700 1 -- 172.21.15.61:0/3917460660 learned_addr learned my addr 172.21.15.61:0/3917460660 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a15566700 1 --2- 172.21.15.61:0/3917460660 >> v2:172.21.15.133:3300/0 conn(0x7f7a10159920 0x7f7a1006f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a07fff700 1 -- 172.21.15.61:0/3917460660 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67412051 0 0) 0x7f7a1015aba0 con 0x7f7a10159cf0 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a07fff700 1 -- 172.21.15.61:0/3917460660 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79fc003570 con 0x7f7a10159cf0 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a07fff700 1 -- 172.21.15.61:0/3917460660 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388632208 0 0) 0x7f7a1015ae80 con 0x7f7a100cd920 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a07fff700 1 -- 172.21.15.61:0/3917460660 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a1015aba0 con 0x7f7a100cd920 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a07fff700 1 -- 172.21.15.61:0/3917460660 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1736713775 0 0) 0x7f79fc003570 con 0x7f7a10159cf0 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a15566700 1 -- 172.21.15.61:0/3917460660 >> v1:172.21.15.133:6789/0 conn(0x7f7a100cd920 legacy=0x7f7a100cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a15566700 1 -- 172.21.15.61:0/3917460660 >> v1:172.21.15.61:6789/0 conn(0x7f7a10159cf0 legacy=0x7f7a1015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.010+0000 7f7a15566700 1 -- 172.21.15.61:0/3917460660 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1006ebc0 con 0x7f7a10159920 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.011+0000 7f7a15566700 1 --2- 172.21.15.61:0/3917460660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a10159920 0x7f7a1006f6a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0098e0 tx=0x7f7a0c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bb1ea2dec448f8a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.011+0000 7f7a07fff700 1 -- 172.21.15.61:0/3917460660 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080017f0 con 0x7f7a10159920 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.011+0000 7f7a07fff700 1 -- 172.21.15.61:0/3917460660 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c011420 con 0x7f7a10159920 2023-12-24T19:57:54.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.011+0000 7f7a07fff700 1 -- 172.21.15.61:0/3917460660 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0117c0 con 0x7f7a10159920 2023-12-24T19:57:54.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.011+0000 7f7a177ca700 1 -- 172.21.15.61:0/3917460660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a10159920 msgr2=0x7f7a1006f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.011+0000 7f7a177ca700 1 --2- 172.21.15.61:0/3917460660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a10159920 0x7f7a1006f6a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0098e0 tx=0x7f7a0c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.011+0000 7f7a177ca700 1 -- 172.21.15.61:0/3917460660 shutdown_connections 2023-12-24T19:57:54.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.011+0000 7f7a177ca700 1 --2- 172.21.15.61:0/3917460660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a10159920 0x7f7a1006f6a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.011+0000 7f7a177ca700 1 -- 172.21.15.61:0/3917460660 >> 172.21.15.61:0/3917460660 conn(0x7f7a1006b790 msgr2=0x7f7a10069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:54.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.012+0000 7f7a177ca700 1 -- 172.21.15.61:0/3917460660 shutdown_connections 2023-12-24T19:57:54.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.012+0000 7f7a177ca700 1 -- 172.21.15.61:0/3917460660 wait complete. 2023-12-24T19:57:54.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.013+0000 7f7a177ca700 1 Processor -- start 2023-12-24T19:57:54.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.013+0000 7f7a177ca700 1 -- start start 2023-12-24T19:57:54.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a177ca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a100cd920 0x7f7a100c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a177ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a10159920 0x7f7a100caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a177ca700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a10159cf0 0x7f7a100c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a177ca700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100c6290 con 0x7f7a10159cf0 2023-12-24T19:57:54.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a177ca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100ad6b0 con 0x7f7a10159920 2023-12-24T19:57:54.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a177ca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a100c5960 con 0x7f7a100cd920 2023-12-24T19:57:54.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a15d67700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a10159cf0 0x7f7a100c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a15d67700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a10159cf0 0x7f7a100c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59212/0 (socket says 172.21.15.61:59212) 2023-12-24T19:57:54.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a15d67700 1 -- 172.21.15.61:0/1973218685 learned_addr learned my addr 172.21.15.61:0/1973218685 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:54.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a14d65700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a10159920 0x7f7a100caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a15566700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a100cd920 0x7f7a100c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a15d67700 1 -- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a100cd920 msgr2=0x7f7a100c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a15d67700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a100cd920 0x7f7a100c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a15d67700 1 -- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a10159920 msgr2=0x7f7a100caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a15d67700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a10159920 0x7f7a100caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a15d67700 1 -- 172.21.15.61:0/1973218685 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c009420 con 0x7f7a10159cf0 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a15d67700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a10159cf0 0x7f7a100c6720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800cbf0 tx=0x7f7a08007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a057fa700 1 -- 172.21.15.61:0/1973218685 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08004dc0 con 0x7f7a10159cf0 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a057fa700 1 -- 172.21.15.61:0/1973218685 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0800a710 con 0x7f7a10159cf0 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a177ca700 1 -- 172.21.15.61:0/1973218685 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a100c5c40 con 0x7f7a10159cf0 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a057fa700 1 -- 172.21.15.61:0/1973218685 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800aad0 con 0x7f7a10159cf0 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.014+0000 7f7a177ca700 1 -- 172.21.15.61:0/1973218685 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a100c9330 con 0x7f7a10159cf0 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.015+0000 7f7a177ca700 1 -- 172.21.15.61:0/1973218685 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1004c3c0 con 0x7f7a10159cf0 2023-12-24T19:57:54.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.016+0000 7f7a057fa700 1 -- 172.21.15.61:0/1973218685 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7a08007150 con 0x7f7a10159cf0 2023-12-24T19:57:54.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.016+0000 7f7a057fa700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f79f4066f30 0x7f79f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.016+0000 7f7a057fa700 1 -- 172.21.15.61:0/1973218685 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7a080839e0 con 0x7f7a10159cf0 2023-12-24T19:57:54.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.016+0000 7f7a15566700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f79f4066f30 0x7f79f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.017+0000 7f7a15566700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f79f4066f30 0x7f79f40693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0091e0 tx=0x7f7a0c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:54.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.020+0000 7f7a057fa700 1 -- 172.21.15.61:0/1973218685 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a08051020 con 0x7f7a10159cf0 2023-12-24T19:57:54.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.296+0000 7f7a177ca700 1 -- 172.21.15.61:0/1973218685 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f7a100c88f0 con 0x7f7a10159cf0 2023-12-24T19:57:54.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.300+0000 7f7a057fa700 1 -- 172.21.15.61:0/1973218685 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7a08018020 con 0x7f7a10159cf0 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 -- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f79f4066f30 msgr2=0x7f79f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f79f4066f30 0x7f79f40693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0091e0 tx=0x7f7a0c016000 comp rx=0 tx=0).stop 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 -- 172.21.15.61:0/1973218685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a10159cf0 msgr2=0x7f7a100c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a10159cf0 0x7f7a100c6720 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800cbf0 tx=0x7f7a08007d20 comp rx=0 tx=0).stop 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 -- 172.21.15.61:0/1973218685 shutdown_connections 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a100cd920 0x7f7a100c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f79f4066f30 0x7f79f40693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a10159cf0 0x7f7a100c6720 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 --2- 172.21.15.61:0/1973218685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a10159920 0x7f7a100caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 -- 172.21.15.61:0/1973218685 >> 172.21.15.61:0/1973218685 conn(0x7f7a1006b790 msgr2=0x7f7a101589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 -- 172.21.15.61:0/1973218685 shutdown_connections 2023-12-24T19:57:54.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.302+0000 7f7a177ca700 1 -- 172.21.15.61:0/1973218685 wait complete. 2023-12-24T19:57:54.314 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-24T19:57:54.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.435+0000 7f1cfa5ce700 1 Processor -- start 2023-12-24T19:57:54.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.435+0000 7f1cfa5ce700 1 -- start start 2023-12-24T19:57:54.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.436+0000 7f1cfa5ce700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 0x7f1cf40c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.436+0000 7f1cfa5ce700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf4068d10 con 0x7f1cf4159c40 2023-12-24T19:57:54.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.436+0000 7f1cfa5ce700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf4068100 con 0x7f1cf40c4010 2023-12-24T19:57:54.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.436+0000 7f1cfa5ce700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf4067f10 con 0x7f1cf4070f80 2023-12-24T19:57:54.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.436+0000 7f1cf3fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1cf4159c40 0x7f1cf4070870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39030/0 (socket says 172.21.15.61:39030) 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.436+0000 7f1cf3fff700 1 -- 172.21.15.61:0/3224359905 learned_addr learned my addr 172.21.15.61:0/3224359905 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf37fe700 1 --2- 172.21.15.61:0/3224359905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 0x7f1cf40c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf2ffd700 1 -- 172.21.15.61:0/3224359905 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566925265 0 0) 0x7f1cf4068d10 con 0x7f1cf4159c40 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf2ffd700 1 -- 172.21.15.61:0/3224359905 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce0003570 con 0x7f1cf4159c40 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf2ffd700 1 -- 172.21.15.61:0/3224359905 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644172850 0 0) 0x7f1cf4068100 con 0x7f1cf40c4010 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf2ffd700 1 -- 172.21.15.61:0/3224359905 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cf4068d10 con 0x7f1cf40c4010 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf2ffd700 1 -- 172.21.15.61:0/3224359905 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4226526302 0 0) 0x7f1ce0003570 con 0x7f1cf4159c40 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf37fe700 1 -- 172.21.15.61:0/3224359905 >> v1:172.21.15.133:6789/0 conn(0x7f1cf40c4010 legacy=0x7f1cf40c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf37fe700 1 -- 172.21.15.61:0/3224359905 >> v1:172.21.15.61:6789/0 conn(0x7f1cf4159c40 legacy=0x7f1cf4070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf37fe700 1 -- 172.21.15.61:0/3224359905 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40683e0 con 0x7f1cf4070f80 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf37fe700 1 --2- 172.21.15.61:0/3224359905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 0x7f1cf40c3ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009910 tx=0x7f1cdc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=406d4df10e7c2359 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf2ffd700 1 -- 172.21.15.61:0/3224359905 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4001470 con 0x7f1cf4070f80 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf2ffd700 1 -- 172.21.15.61:0/3224359905 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc011420 con 0x7f1cf4070f80 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.437+0000 7f1cf2ffd700 1 -- 172.21.15.61:0/3224359905 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0117a0 con 0x7f1cf4070f80 2023-12-24T19:57:54.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.438+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/3224359905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 msgr2=0x7f1cf40c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.438+0000 7f1cfa5ce700 1 --2- 172.21.15.61:0/3224359905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 0x7f1cf40c3ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009910 tx=0x7f1cdc0091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.438+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/3224359905 shutdown_connections 2023-12-24T19:57:54.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.438+0000 7f1cfa5ce700 1 --2- 172.21.15.61:0/3224359905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 0x7f1cf40c3ad0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.438+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/3224359905 >> 172.21.15.61:0/3224359905 conn(0x7f1cf40ce190 msgr2=0x7f1cf40ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:54.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.438+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/3224359905 shutdown_connections 2023-12-24T19:57:54.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.438+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/3224359905 wait complete. 2023-12-24T19:57:54.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.439+0000 7f1cfa5ce700 1 Processor -- start 2023-12-24T19:57:54.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.439+0000 7f1cfa5ce700 1 -- start start 2023-12-24T19:57:54.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cfa5ce700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 0x7f1cf416cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cfa5ce700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cf40c4010 0x7f1cf40cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cfa5ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf4159c40 0x7f1cf4157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cfa5ce700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf415a370 con 0x7f1cf40c4010 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cfa5ce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf416d5c0 con 0x7f1cf4159c40 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cfa5ce700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf416d8a0 con 0x7f1cf4070f80 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cf37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cf40c4010 0x7f1cf40cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cf37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cf40c4010 0x7f1cf40cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59216/0 (socket says 172.21.15.61:59216) 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cf37fe700 1 -- 172.21.15.61:0/2817063079 learned_addr learned my addr 172.21.15.61:0/2817063079 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cf3fff700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 0x7f1cf416cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cf8b6b700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf4159c40 0x7f1cf4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cf37fe700 1 -- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 msgr2=0x7f1cf416cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cf37fe700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 0x7f1cf416cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cf37fe700 1 -- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf4159c40 msgr2=0x7f1cf4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cf37fe700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf4159c40 0x7f1cf4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.440+0000 7f1cf37fe700 1 -- 172.21.15.61:0/2817063079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc009420 con 0x7f1cf40c4010 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.441+0000 7f1cf37fe700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cf40c4010 0x7f1cf40cb850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009860 tx=0x7f1cdc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:54.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.441+0000 7f1cebfff700 1 -- 172.21.15.61:0/2817063079 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc01cc50 con 0x7f1cf40c4010 2023-12-24T19:57:54.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.441+0000 7f1cebfff700 1 -- 172.21.15.61:0/2817063079 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc01cdb0 con 0x7f1cf40c4010 2023-12-24T19:57:54.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.441+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/2817063079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf416db80 con 0x7f1cf40c4010 2023-12-24T19:57:54.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.441+0000 7f1cebfff700 1 -- 172.21.15.61:0/2817063079 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc01a6a0 con 0x7f1cf40c4010 2023-12-24T19:57:54.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.441+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/2817063079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf40cbd90 con 0x7f1cf40c4010 2023-12-24T19:57:54.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.442+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/2817063079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf40cbfe0 con 0x7f1cf40c4010 2023-12-24T19:57:54.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.442+0000 7f1cebfff700 1 -- 172.21.15.61:0/2817063079 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1cdc01aad0 con 0x7f1cf40c4010 2023-12-24T19:57:54.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.442+0000 7f1cebfff700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.443+0000 7f1cebfff700 1 -- 172.21.15.61:0/2817063079 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1cdc085b40 con 0x7f1cf40c4010 2023-12-24T19:57:54.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.443+0000 7f1cf3fff700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.443+0000 7f1cf3fff700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1cd4066f30 0x7f1cd40693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40011e0 tx=0x7f1ce4000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:54.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.447+0000 7f1cebfff700 1 -- 172.21.15.61:0/2817063079 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cdc053100 con 0x7f1cf40c4010 2023-12-24T19:57:54.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.726+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/2817063079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f1cf404c3c0 con 0x7f1cf40c4010 2023-12-24T19:57:54.730 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.730+0000 7f1cebfff700 1 -- 172.21.15.61:0/2817063079 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1cdc056720 con 0x7f1cf40c4010 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1cd4066f30 msgr2=0x7f1cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1cd4066f30 0x7f1cd40693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40011e0 tx=0x7f1ce4000bc0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/2817063079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cf40c4010 msgr2=0x7f1cf40cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cf40c4010 0x7f1cf40cb850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009860 tx=0x7f1cdc016000 comp rx=0 tx=0).stop 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/2817063079 shutdown_connections 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1cf4070f80 0x7f1cf416cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1cd4066f30 0x7f1cd40693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf4159c40 0x7f1cf4157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 --2- 172.21.15.61:0/2817063079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1cf40c4010 0x7f1cf40cb850 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/2817063079 >> 172.21.15.61:0/2817063079 conn(0x7f1cf40ce190 msgr2=0x7f1cf4159000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/2817063079 shutdown_connections 2023-12-24T19:57:54.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.732+0000 7f1cfa5ce700 1 -- 172.21.15.61:0/2817063079 wait complete. 2023-12-24T19:57:54.745 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:54.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.868+0000 7f82a7e16700 1 Processor -- start 2023-12-24T19:57:54.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.868+0000 7f82a7e16700 1 -- start start 2023-12-24T19:57:54.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a7e16700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a0159cf0 0x7f82a006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a7e16700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82a00cd9c0 0x7f82a00cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a7e16700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a006c300 con 0x7f82a006ec70 2023-12-24T19:57:54.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a7e16700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a006ce80 con 0x7f82a00cd9c0 2023-12-24T19:57:54.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a7e16700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a0068560 con 0x7f82a0159cf0 2023-12-24T19:57:54.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a53b1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a0159cf0 0x7f82a006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a63b3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82a00cd9c0 0x7f82a00cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a5bb2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f82a006ec70 0x7f82a01595e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:55926/0 (socket says 172.21.15.61:55926) 2023-12-24T19:57:54.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a5bb2700 1 -- 172.21.15.61:0/42451836 learned_addr learned my addr 172.21.15.61:0/42451836 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:54.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a63b3700 1 -- 172.21.15.61:0/42451836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a0159cf0 msgr2=0x7f82a006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:54.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a63b3700 1 --2- 172.21.15.61:0/42451836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a0159cf0 0x7f82a006f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a63b3700 1 -- 172.21.15.61:0/42451836 >> v1:172.21.15.133:6789/0 conn(0x7f82a006ec70 legacy=0x7f82a01595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a4bb0700 1 -- 172.21.15.61:0/42451836 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193176222 0 0) 0x7f82a006c300 con 0x7f82a006ec70 2023-12-24T19:57:54.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.869+0000 7f82a63b3700 1 -- 172.21.15.61:0/42451836 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a006c550 con 0x7f82a00cd9c0 2023-12-24T19:57:54.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a63b3700 1 --2- 172.21.15.61:0/42451836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a00cd9c0 0x7f82a00cde20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8298009e60 tx=0x7f8298009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3249f771e30193d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:54.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a4bb0700 1 -- 172.21.15.61:0/42451836 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829800e070 con 0x7f82a00cd9c0 2023-12-24T19:57:54.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a4bb0700 1 -- 172.21.15.61:0/42451836 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829800bb60 con 0x7f82a00cd9c0 2023-12-24T19:57:54.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a4bb0700 1 -- 172.21.15.61:0/42451836 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298012430 con 0x7f82a00cd9c0 2023-12-24T19:57:54.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a7e16700 1 -- 172.21.15.61:0/42451836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a00cd9c0 msgr2=0x7f82a00cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a7e16700 1 --2- 172.21.15.61:0/42451836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a00cd9c0 0x7f82a00cde20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8298009e60 tx=0x7f8298009780 comp rx=0 tx=0).stop 2023-12-24T19:57:54.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a7e16700 1 -- 172.21.15.61:0/42451836 shutdown_connections 2023-12-24T19:57:54.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a7e16700 1 --2- 172.21.15.61:0/42451836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a00cd9c0 0x7f82a00cde20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a7e16700 1 --2- 172.21.15.61:0/42451836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a0159cf0 0x7f82a006f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a7e16700 1 -- 172.21.15.61:0/42451836 >> 172.21.15.61:0/42451836 conn(0x7f82a006b650 msgr2=0x7f82a00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:54.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a7e16700 1 -- 172.21.15.61:0/42451836 shutdown_connections 2023-12-24T19:57:54.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.870+0000 7f82a7e16700 1 -- 172.21.15.61:0/42451836 wait complete. 2023-12-24T19:57:54.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a7e16700 1 Processor -- start 2023-12-24T19:57:54.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a7e16700 1 -- start start 2023-12-24T19:57:54.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a7e16700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a006ec70 0x7f82a0156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a7e16700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a00cd9c0 0x7f82a0152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a7e16700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82a0159cf0 0x7f82a01576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a7e16700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a01563a0 con 0x7f82a0159cf0 2023-12-24T19:57:54.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a7e16700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a0156d70 con 0x7f82a006ec70 2023-12-24T19:57:54.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a7e16700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a0155d70 con 0x7f82a00cd9c0 2023-12-24T19:57:54.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a63b3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82a0159cf0 0x7f82a01576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a63b3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82a0159cf0 0x7f82a01576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59218/0 (socket says 172.21.15.61:59218) 2023-12-24T19:57:54.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.872+0000 7f82a63b3700 1 -- 172.21.15.61:0/3666484883 learned_addr learned my addr 172.21.15.61:0/3666484883 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:54.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f82a5bb2700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a006ec70 0x7f82a0156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f82a53b1700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a00cd9c0 0x7f82a0152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f82a63b3700 1 -- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a00cd9c0 msgr2=0x7f82a0152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f82a63b3700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a00cd9c0 0x7f82a0152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f82a63b3700 1 -- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a006ec70 msgr2=0x7f82a0156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:54.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f82a63b3700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a006ec70 0x7f82a0156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:54.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f82a63b3700 1 -- 172.21.15.61:0/3666484883 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8298009a20 con 0x7f82a0159cf0 2023-12-24T19:57:54.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f82a63b3700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82a0159cf0 0x7f82a01576a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f82a00cc3b0 tx=0x7f8298019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:54.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f8295ffb700 1 -- 172.21.15.61:0/3666484883 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298027470 con 0x7f82a0159cf0 2023-12-24T19:57:54.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f8295ffb700 1 -- 172.21.15.61:0/3666484883 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82980275f0 con 0x7f82a0159cf0 2023-12-24T19:57:54.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f82a7e16700 1 -- 172.21.15.61:0/3666484883 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a00b0f70 con 0x7f82a0159cf0 2023-12-24T19:57:54.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f8295ffb700 1 -- 172.21.15.61:0/3666484883 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980279b0 con 0x7f82a0159cf0 2023-12-24T19:57:54.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.873+0000 7f82a7e16700 1 -- 172.21.15.61:0/3666484883 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a0153530 con 0x7f82a0159cf0 2023-12-24T19:57:54.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.874+0000 7f82a7e16700 1 -- 172.21.15.61:0/3666484883 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a0156510 con 0x7f82a0159cf0 2023-12-24T19:57:54.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.875+0000 7f8295ffb700 1 -- 172.21.15.61:0/3666484883 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8298024070 con 0x7f82a0159cf0 2023-12-24T19:57:54.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.875+0000 7f8295ffb700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8284066f30 0x7f82840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:54.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.875+0000 7f8295ffb700 1 -- 172.21.15.61:0/3666484883 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8298086b60 con 0x7f82a0159cf0 2023-12-24T19:57:54.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.876+0000 7f82a5bb2700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8284066f30 0x7f82840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:54.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.876+0000 7f82a5bb2700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8284066f30 0x7f82840693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f829c0011e0 tx=0x7f829c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:54.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:54.880+0000 7f8295ffb700 1 -- 172.21.15.61:0/3666484883 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8298054080 con 0x7f82a0159cf0 2023-12-24T19:57:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.077+0000 7f82a7e16700 1 -- 172.21.15.61:0/3666484883 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82a004c3c0 con 0x7f82a0159cf0 2023-12-24T19:57:55.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.078+0000 7f8295ffb700 1 -- 172.21.15.61:0/3666484883 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f829802c090 con 0x7f82a0159cf0 2023-12-24T19:57:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:55.079 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":27,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:51.736936+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:55.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 -- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8284066f30 msgr2=0x7f82840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8284066f30 0x7f82840693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f829c0011e0 tx=0x7f829c009040 comp rx=0 tx=0).stop 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 -- 172.21.15.61:0/3666484883 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82a0159cf0 msgr2=0x7f82a01576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82a0159cf0 0x7f82a01576a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f82a00cc3b0 tx=0x7f8298019000 comp rx=0 tx=0).stop 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 -- 172.21.15.61:0/3666484883 shutdown_connections 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8284066f30 0x7f82840693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f82a0159cf0 0x7f82a01576a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a006ec70 0x7f82a0156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 --2- 172.21.15.61:0/3666484883 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f82a00cd9c0 0x7f82a0152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 -- 172.21.15.61:0/3666484883 >> 172.21.15.61:0/3666484883 conn(0x7f82a006b650 msgr2=0x7f82a00c4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 -- 172.21.15.61:0/3666484883 shutdown_connections 2023-12-24T19:57:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.080+0000 7f82a7e16700 1 -- 172.21.15.61:0/3666484883 wait complete. 2023-12-24T19:57:55.094 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T19:57:55.094 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:57:55.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.218+0000 7fbe7b214700 1 Processor -- start 2023-12-24T19:57:55.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.218+0000 7fbe7b214700 1 -- start start 2023-12-24T19:57:55.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe7b214700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbe74157840 0x7fbe74069b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe7b214700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe740706b0 0x7fbe740c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe7b214700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7406a460 con 0x7fbe74157c10 2023-12-24T19:57:55.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe7b214700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe74067550 con 0x7fbe74157840 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe7b214700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7406a740 con 0x7fbe740706b0 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe78fb0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbe74157840 0x7fbe74069b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe797b1700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fbe74157c10 0x7fbe7415b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39034/0 (socket says 172.21.15.61:39034) 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe797b1700 1 -- 172.21.15.61:0/3087323007 learned_addr learned my addr 172.21.15.61:0/3087323007 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe73fff700 1 --2- 172.21.15.61:0/3087323007 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe740706b0 0x7fbe740c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe78fb0700 1 -- 172.21.15.61:0/3087323007 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe740706b0 msgr2=0x7fbe740c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe78fb0700 1 --2- 172.21.15.61:0/3087323007 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe740706b0 0x7fbe740c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe78fb0700 1 -- 172.21.15.61:0/3087323007 >> v1:172.21.15.61:6789/0 conn(0x7fbe74157c10 legacy=0x7fbe7415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe78fb0700 1 -- 172.21.15.61:0/3087323007 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7406aa20 con 0x7fbe74157840 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.219+0000 7fbe737fe700 1 -- 172.21.15.61:0/3087323007 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829182785 0 0) 0x7fbe7406a460 con 0x7fbe74157c10 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe78fb0700 1 --2- 172.21.15.61:0/3087323007 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157840 0x7fbe74069b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbe680098e0 tx=0x7fbe680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f17ecaebb1e66f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe737fe700 1 -- 172.21.15.61:0/3087323007 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68009e80 con 0x7fbe74157840 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe737fe700 1 -- 172.21.15.61:0/3087323007 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6800b860 con 0x7fbe74157840 2023-12-24T19:57:55.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe737fe700 1 -- 172.21.15.61:0/3087323007 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800bbe0 con 0x7fbe74157840 2023-12-24T19:57:55.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe7b214700 1 -- 172.21.15.61:0/3087323007 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157840 msgr2=0x7fbe74069b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe7b214700 1 --2- 172.21.15.61:0/3087323007 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157840 0x7fbe74069b60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbe680098e0 tx=0x7fbe680091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe7b214700 1 -- 172.21.15.61:0/3087323007 shutdown_connections 2023-12-24T19:57:55.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe7b214700 1 --2- 172.21.15.61:0/3087323007 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157840 0x7fbe74069b60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe7b214700 1 --2- 172.21.15.61:0/3087323007 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe740706b0 0x7fbe740c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe7b214700 1 -- 172.21.15.61:0/3087323007 >> 172.21.15.61:0/3087323007 conn(0x7fbe740ce1f0 msgr2=0x7fbe740ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:55.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe7b214700 1 -- 172.21.15.61:0/3087323007 shutdown_connections 2023-12-24T19:57:55.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.220+0000 7fbe7b214700 1 -- 172.21.15.61:0/3087323007 wait complete. 2023-12-24T19:57:55.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.222+0000 7fbe7b214700 1 Processor -- start 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.222+0000 7fbe7b214700 1 -- start start 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe7b214700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe740706b0 0x7fbe74152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe7b214700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe74157840 0x7fbe740c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe7b214700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157c10 0x7fbe740c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe7b214700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740c6760 con 0x7fbe74157c10 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe7b214700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740c5b50 con 0x7fbe74157840 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe7b214700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740c5e30 con 0x7fbe740706b0 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe797b1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157c10 0x7fbe740c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe797b1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157c10 0x7fbe740c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59242/0 (socket says 172.21.15.61:59242) 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe797b1700 1 -- 172.21.15.61:0/242054225 learned_addr learned my addr 172.21.15.61:0/242054225 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe78fb0700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe740706b0 0x7fbe74152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe73fff700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe74157840 0x7fbe740c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe797b1700 1 -- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe740706b0 msgr2=0x7fbe74152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe797b1700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe740706b0 0x7fbe74152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe797b1700 1 -- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe74157840 msgr2=0x7fbe740c51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe797b1700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe74157840 0x7fbe740c51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.223+0000 7fbe797b1700 1 -- 172.21.15.61:0/242054225 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe68009420 con 0x7fbe74157c10 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.224+0000 7fbe797b1700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157c10 0x7fbe740c9850 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00cc90 tx=0x7fbe6c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.224+0000 7fbe70ff9700 1 -- 172.21.15.61:0/242054225 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00cea0 con 0x7fbe74157c10 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.224+0000 7fbe70ff9700 1 -- 172.21.15.61:0/242054225 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00ab70 con 0x7fbe74157c10 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.224+0000 7fbe7b214700 1 -- 172.21.15.61:0/242054225 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe740c6110 con 0x7fbe74157c10 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.224+0000 7fbe70ff9700 1 -- 172.21.15.61:0/242054225 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0070f0 con 0x7fbe74157c10 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.224+0000 7fbe7b214700 1 -- 172.21.15.61:0/242054225 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe74152770 con 0x7fbe74157c10 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.225+0000 7fbe7b214700 1 -- 172.21.15.61:0/242054225 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe740c68d0 con 0x7fbe74157c10 2023-12-24T19:57:55.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.225+0000 7fbe70ff9700 1 -- 172.21.15.61:0/242054225 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbe6c0074a0 con 0x7fbe74157c10 2023-12-24T19:57:55.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.226+0000 7fbe70ff9700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe58066f30 0x7fbe580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.226+0000 7fbe70ff9700 1 -- 172.21.15.61:0/242054225 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbe6c084700 con 0x7fbe74157c10 2023-12-24T19:57:55.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.226+0000 7fbe78fb0700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe58066f30 0x7fbe580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.226+0000 7fbe78fb0700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe58066f30 0x7fbe580693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbe680091e0 tx=0x7fbe68017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:55.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.230+0000 7fbe70ff9700 1 -- 172.21.15.61:0/242054225 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe6c051ca0 con 0x7fbe74157c10 2023-12-24T19:57:55.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.423+0000 7fbe7b214700 1 -- 172.21.15.61:0/242054225 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe7404c3c0 con 0x7fbe74157c10 2023-12-24T19:57:55.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.423+0000 7fbe70ff9700 1 -- 172.21.15.61:0/242054225 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe6c0552c0 con 0x7fbe74157c10 2023-12-24T19:57:55.424 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 -- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe58066f30 msgr2=0x7fbe580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe58066f30 0x7fbe580693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbe680091e0 tx=0x7fbe68017000 comp rx=0 tx=0).stop 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 -- 172.21.15.61:0/242054225 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157c10 msgr2=0x7fbe740c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157c10 0x7fbe740c9850 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00cc90 tx=0x7fbe6c001a80 comp rx=0 tx=0).stop 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 -- 172.21.15.61:0/242054225 shutdown_connections 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe740706b0 0x7fbe74152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe58066f30 0x7fbe580693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe74157c10 0x7fbe740c9850 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 --2- 172.21.15.61:0/242054225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe74157840 0x7fbe740c51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 -- 172.21.15.61:0/242054225 >> 172.21.15.61:0/242054225 conn(0x7fbe740ce1f0 msgr2=0x7fbe740cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 -- 172.21.15.61:0/242054225 shutdown_connections 2023-12-24T19:57:55.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.425+0000 7fbe7b214700 1 -- 172.21.15.61:0/242054225 wait complete. 2023-12-24T19:57:55.437 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T19:57:55.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.558+0000 7f0f22bad700 1 Processor -- start 2023-12-24T19:57:55.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.559+0000 7f0f22bad700 1 -- start start 2023-12-24T19:57:55.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.559+0000 7f0f22bad700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c068140 0x7f0f1c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.559+0000 7f0f22bad700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f1c068510 0x7f0f1c0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.559+0000 7f0f22bad700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1c0b2890 con 0x7f0f1c159a60 2023-12-24T19:57:55.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.559+0000 7f0f22bad700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b11e0 con 0x7f0f1c068510 2023-12-24T19:57:55.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.559+0000 7f0f22bad700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0cf630 con 0x7f0f1c068140 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.559+0000 7f0f2114a700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0f1c159a60 0x7f0f1c159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39038/0 (socket says 172.21.15.61:39038) 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.559+0000 7f0f2114a700 1 -- 172.21.15.61:0/1331227041 learned_addr learned my addr 172.21.15.61:0/1331227041 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765547593 0 0) 0x7f0f1c0b2890 con 0x7f0f1c159a60 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1bfff700 1 --2- 172.21.15.61:0/1331227041 >> v2:172.21.15.133:3300/0 conn(0x7f0f1c068510 0x7f0f1c0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f20949700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c068140 0x7f0f1c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f0c003570 con 0x7f0f1c159a60 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148295353 0 0) 0x7f0f0c003570 con 0x7f0f1c159a60 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c068140 msgr2=0x7f0f1c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c068140 0x7f0f1c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 >> v2:172.21.15.133:3300/0 conn(0x7f0f1c068510 msgr2=0x7f0f1c0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 --2- 172.21.15.61:0/1331227041 >> v2:172.21.15.133:3300/0 conn(0x7f0f1c068510 0x7f0f1c0b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0b2240 con 0x7f0f1c159a60 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f0f140017f0 con 0x7f0f1c159a60 2023-12-24T19:57:55.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 >> v1:172.21.15.61:6789/0 conn(0x7f0f1c159a60 legacy=0x7f0f1c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c068140 0x7f0f0c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f0c003fe0 0x7f0f0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c004d50 0x7f0f0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b11e0 con 0x7f0f0c003fe0 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0cf630 con 0x7f0f0c004d50 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c00bb40 con 0x7f0f1c068140 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f1bfff700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f0c003fe0 0x7f0f0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f20949700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c068140 0x7f0f0c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.560+0000 7f0f2114a700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c004d50 0x7f0f0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f1bfff700 1 -- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c068140 msgr2=0x7f0f0c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f1bfff700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c068140 0x7f0f0c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f1bfff700 1 -- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c004d50 msgr2=0x7f0f0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f1bfff700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c004d50 0x7f0f0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f1bfff700 1 -- 172.21.15.61:0/1331227041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c003570 con 0x7f0f0c003fe0 2023-12-24T19:57:55.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f1bfff700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f0c003fe0 0x7f0f0c004810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0f08006f00 tx=0x7f0f080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751bd4c397ed4b61 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:55.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0800e710 con 0x7f0f0c003fe0 2023-12-24T19:57:55.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0800e870 con 0x7f0f0c003fe0 2023-12-24T19:57:55.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f1b7fe700 1 -- 172.21.15.61:0/1331227041 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0800ec30 con 0x7f0f0c003fe0 2023-12-24T19:57:55.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f22bad700 1 -- 172.21.15.61:0/1331227041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f0c003fe0 msgr2=0x7f0f0c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f22bad700 1 --2- 172.21.15.61:0/1331227041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f0c003fe0 0x7f0f0c004810 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0f08006f00 tx=0x7f0f080091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f2114a700 1 -- 172.21.15.61:0/1331227041 reap_dead start 2023-12-24T19:57:55.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f22bad700 1 -- 172.21.15.61:0/1331227041 shutdown_connections 2023-12-24T19:57:55.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f22bad700 1 -- 172.21.15.61:0/1331227041 >> 172.21.15.61:0/1331227041 conn(0x7f0f1c097a10 msgr2=0x7f0f1c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:55.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.561+0000 7f0f22bad700 1 -- 172.21.15.61:0/1331227041 shutdown_connections 2023-12-24T19:57:55.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.562+0000 7f0f22bad700 1 -- 172.21.15.61:0/1331227041 wait complete. 2023-12-24T19:57:55.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.563+0000 7f0f22bad700 1 Processor -- start 2023-12-24T19:57:55.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.563+0000 7f0f22bad700 1 -- start start 2023-12-24T19:57:55.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f22bad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c003fe0 0x7f0f1c09a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f22bad700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c1531a0 0x7f0f1c153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f22bad700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f1c153e40 0x7f0f1c0b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f22bad700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c16a850 con 0x7f0f1c153e40 2023-12-24T19:57:55.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f22bad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c169a00 con 0x7f0f0c003fe0 2023-12-24T19:57:55.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f22bad700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c09c3c0 con 0x7f0f1c1531a0 2023-12-24T19:57:55.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f2114a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f1c153e40 0x7f0f1c0b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f2114a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f1c153e40 0x7f0f1c0b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59262/0 (socket says 172.21.15.61:59262) 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f2114a700 1 -- 172.21.15.61:0/4070481978 learned_addr learned my addr 172.21.15.61:0/4070481978 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f20949700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c003fe0 0x7f0f1c09a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f1bfff700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c1531a0 0x7f0f1c153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f2114a700 1 -- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c1531a0 msgr2=0x7f0f1c153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f2114a700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c1531a0 0x7f0f1c153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f2114a700 1 -- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c003fe0 msgr2=0x7f0f1c09a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f2114a700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c003fe0 0x7f0f1c09a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f2114a700 1 -- 172.21.15.61:0/4070481978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c169c40 con 0x7f0f1c153e40 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f20949700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c003fe0 0x7f0f1c09a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f2114a700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f1c153e40 0x7f0f1c0b3b40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c06eaf0 tx=0x7f0f14002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f18ff9700 1 -- 172.21.15.61:0/4070481978 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1400ae50 con 0x7f0f1c153e40 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f18ff9700 1 -- 172.21.15.61:0/4070481978 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f140133f0 con 0x7f0f1c153e40 2023-12-24T19:57:55.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f18ff9700 1 -- 172.21.15.61:0/4070481978 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f140137b0 con 0x7f0f1c153e40 2023-12-24T19:57:55.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f22bad700 1 -- 172.21.15.61:0/4070481978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1c169f20 con 0x7f0f1c153e40 2023-12-24T19:57:55.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.564+0000 7f0f22bad700 1 -- 172.21.15.61:0/4070481978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1c16a4e0 con 0x7f0f1c153e40 2023-12-24T19:57:55.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.565+0000 7f0f22bad700 1 -- 172.21.15.61:0/4070481978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1c16d030 con 0x7f0f1c153e40 2023-12-24T19:57:55.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.566+0000 7f0f18ff9700 1 -- 172.21.15.61:0/4070481978 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0f14013b60 con 0x7f0f1c153e40 2023-12-24T19:57:55.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.566+0000 7f0f18ff9700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f00066f30 0x7f0f000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.566+0000 7f0f18ff9700 1 -- 172.21.15.61:0/4070481978 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0f14084aa0 con 0x7f0f1c153e40 2023-12-24T19:57:55.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.566+0000 7f0f20949700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f00066f30 0x7f0f000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.567+0000 7f0f20949700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f00066f30 0x7f0f000693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0f10006d00 tx=0x7f0f10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:55.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.570+0000 7f0f18ff9700 1 -- 172.21.15.61:0/4070481978 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f14052060 con 0x7f0f1c153e40 2023-12-24T19:57:55.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.767+0000 7f0f22bad700 1 -- 172.21.15.61:0/4070481978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0f1c06d440 con 0x7f0f1c153e40 2023-12-24T19:57:55.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.768+0000 7f0f18ff9700 1 -- 172.21.15.61:0/4070481978 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0f14055680 con 0x7f0f1c153e40 2023-12-24T19:57:55.768 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:55.768 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T19:57:55.769 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:57:55.769 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T19:57:55.769 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T19:57:55.769 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:57:55.769 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T19:57:55.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 -- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f00066f30 msgr2=0x7f0f000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f00066f30 0x7f0f000693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0f10006d00 tx=0x7f0f10008040 comp rx=0 tx=0).stop 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 -- 172.21.15.61:0/4070481978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f1c153e40 msgr2=0x7f0f1c0b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f1c153e40 0x7f0f1c0b3b40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c06eaf0 tx=0x7f0f14002210 comp rx=0 tx=0).stop 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 -- 172.21.15.61:0/4070481978 shutdown_connections 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f00066f30 0x7f0f000693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f1c153e40 0x7f0f1c0b3b40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c003fe0 0x7f0f1c09a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 --2- 172.21.15.61:0/4070481978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f1c1531a0 0x7f0f1c153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 -- 172.21.15.61:0/4070481978 >> 172.21.15.61:0/4070481978 conn(0x7f0f1c097a10 msgr2=0x7f0f1c0aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 -- 172.21.15.61:0/4070481978 shutdown_connections 2023-12-24T19:57:55.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.770+0000 7f0f22bad700 1 -- 172.21.15.61:0/4070481978 wait complete. 2023-12-24T19:57:55.782 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T19:57:55.782 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T19:57:55.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.908+0000 7f4b6d9ad700 1 Processor -- start 2023-12-24T19:57:55.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.908+0000 7f4b6d9ad700 1 -- start start 2023-12-24T19:57:55.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.908+0000 7f4b6d9ad700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b680cd130 0x7f4b68159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.908+0000 7f4b6d9ad700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4b6806db70 0x7f4b6806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.908+0000 7f4b6d9ad700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b680d00e0 con 0x7f4b681597f0 2023-12-24T19:57:55.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.908+0000 7f4b6d9ad700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b680b3280 con 0x7f4b6806db70 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.908+0000 7f4b6d9ad700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6806e530 con 0x7f4b680cd130 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b677fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4b6806db70 0x7f4b6806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b66ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4b681597f0 0x7f4b680b6400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39052/0 (socket says 172.21.15.61:39052) 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b66ffd700 1 -- 172.21.15.61:0/2367553747 learned_addr learned my addr 172.21.15.61:0/2367553747 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b667fc700 1 --2- 172.21.15.61:0/2367553747 >> v2:172.21.15.133:3300/0 conn(0x7f4b680cd130 0x7f4b68159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b677fe700 1 -- 172.21.15.61:0/2367553747 >> v2:172.21.15.133:3300/0 conn(0x7f4b680cd130 msgr2=0x7f4b68159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b677fe700 1 --2- 172.21.15.61:0/2367553747 >> v2:172.21.15.133:3300/0 conn(0x7f4b680cd130 0x7f4b68159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b677fe700 1 -- 172.21.15.61:0/2367553747 >> v1:172.21.15.61:6789/0 conn(0x7f4b681597f0 legacy=0x7f4b680b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b677fe700 1 -- 172.21.15.61:0/2367553747 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b680cd6a0 con 0x7f4b6806db70 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b65ffb700 1 -- 172.21.15.61:0/2367553747 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513528741 0 0) 0x7f4b680d00e0 con 0x7f4b681597f0 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b667fc700 1 --2- 172.21.15.61:0/2367553747 >> v2:172.21.15.133:3300/0 conn(0x7f4b680cd130 0x7f4b68159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b677fe700 1 --2- 172.21.15.61:0/2367553747 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b6806db70 0x7f4b6806dff0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4b680668b0 tx=0x7f4b60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5074d4640a75ea08 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:55.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b65ffb700 1 -- 172.21.15.61:0/2367553747 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6000e070 con 0x7f4b6806db70 2023-12-24T19:57:55.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b65ffb700 1 -- 172.21.15.61:0/2367553747 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6000bc30 con 0x7f4b6806db70 2023-12-24T19:57:55.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.909+0000 7f4b65ffb700 1 -- 172.21.15.61:0/2367553747 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60012430 con 0x7f4b6806db70 2023-12-24T19:57:55.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.910+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/2367553747 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b6806db70 msgr2=0x7f4b6806dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.910+0000 7f4b6d9ad700 1 --2- 172.21.15.61:0/2367553747 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b6806db70 0x7f4b6806dff0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4b680668b0 tx=0x7f4b60009780 comp rx=0 tx=0).stop 2023-12-24T19:57:55.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.910+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/2367553747 shutdown_connections 2023-12-24T19:57:55.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.910+0000 7f4b6d9ad700 1 --2- 172.21.15.61:0/2367553747 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b6806db70 0x7f4b6806dff0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.910+0000 7f4b6d9ad700 1 --2- 172.21.15.61:0/2367553747 >> v2:172.21.15.133:3300/0 conn(0x7f4b680cd130 0x7f4b68159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.910+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/2367553747 >> 172.21.15.61:0/2367553747 conn(0x7f4b68067fd0 msgr2=0x7f4b680b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:55.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.910+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/2367553747 shutdown_connections 2023-12-24T19:57:55.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.910+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/2367553747 wait complete. 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.912+0000 7f4b6d9ad700 1 Processor -- start 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.912+0000 7f4b6d9ad700 1 -- start start 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b6d9ad700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b6806db70 0x7f4b680af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b6d9ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b680cd130 0x7f4b681519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b6d9ad700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b681597f0 0x7f4b68151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b6d9ad700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6815e850 con 0x7f4b681597f0 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b6d9ad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68152560 con 0x7f4b680cd130 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b6d9ad700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68152840 con 0x7f4b6806db70 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b677fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b681597f0 0x7f4b68151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b677fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b681597f0 0x7f4b68151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59280/0 (socket says 172.21.15.61:59280) 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b677fe700 1 -- 172.21.15.61:0/654515521 learned_addr learned my addr 172.21.15.61:0/654515521 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:55.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b667fc700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b680cd130 0x7f4b681519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b66ffd700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b6806db70 0x7f4b680af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b677fe700 1 -- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b6806db70 msgr2=0x7f4b680af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b677fe700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b6806db70 0x7f4b680af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b677fe700 1 -- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b680cd130 msgr2=0x7f4b681519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b677fe700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b680cd130 0x7f4b681519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b677fe700 1 -- 172.21.15.61:0/654515521 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60009a20 con 0x7f4b681597f0 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b677fe700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b681597f0 0x7f4b68151f30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4b68071d80 tx=0x7f4b60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b4effd700 1 -- 172.21.15.61:0/654515521 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6001d630 con 0x7f4b681597f0 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b4effd700 1 -- 172.21.15.61:0/654515521 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6001d790 con 0x7f4b681597f0 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/654515521 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6815eac0 con 0x7f4b681597f0 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b4effd700 1 -- 172.21.15.61:0/654515521 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6001db50 con 0x7f4b681597f0 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.913+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/654515521 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b680afaa0 con 0x7f4b681597f0 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.915+0000 7f4b4effd700 1 -- 172.21.15.61:0/654515521 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4b60024070 con 0x7f4b681597f0 2023-12-24T19:57:55.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.915+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/654515521 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6804c3c0 con 0x7f4b681597f0 2023-12-24T19:57:55.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.915+0000 7f4b4effd700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b54066f30 0x7f4b540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:55.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.915+0000 7f4b4effd700 1 -- 172.21.15.61:0/654515521 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4b60086b30 con 0x7f4b681597f0 2023-12-24T19:57:55.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.915+0000 7f4b66ffd700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b54066f30 0x7f4b540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:55.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.916+0000 7f4b66ffd700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b54066f30 0x7f4b540693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800c8f0 tx=0x7f4b58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:55.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:55.919+0000 7f4b4effd700 1 -- 172.21.15.61:0/654515521 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b600541a0 con 0x7f4b681597f0 2023-12-24T19:57:56.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.113+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/654515521 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4b6815ecb0 con 0x7f4b681597f0 2023-12-24T19:57:56.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.749+0000 7f4b4effd700 1 -- 172.21.15.61:0/654515521 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4b60009880 con 0x7f4b681597f0 2023-12-24T19:57:56.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b54066f30 msgr2=0x7f4b540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:56.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b54066f30 0x7f4b540693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800c8f0 tx=0x7f4b58009040 comp rx=0 tx=0).stop 2023-12-24T19:57:56.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/654515521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b681597f0 msgr2=0x7f4b68151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:56.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b681597f0 0x7f4b68151f30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4b68071d80 tx=0x7f4b60019000 comp rx=0 tx=0).stop 2023-12-24T19:57:56.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/654515521 shutdown_connections 2023-12-24T19:57:56.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b6806db70 0x7f4b680af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:56.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b54066f30 0x7f4b540693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:56.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b681597f0 0x7f4b68151f30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:56.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 --2- 172.21.15.61:0/654515521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b680cd130 0x7f4b681519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:56.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/654515521 >> 172.21.15.61:0/654515521 conn(0x7f4b68067fd0 msgr2=0x7f4b680b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:56.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.752+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/654515521 shutdown_connections 2023-12-24T19:57:56.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.753+0000 7f4b6d9ad700 1 -- 172.21.15.61:0/654515521 wait complete. 2023-12-24T19:57:56.754 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T19:57:56.767 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T19:57:56.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.900+0000 7fd0e6ba7700 1 Processor -- start 2023-12-24T19:57:56.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.900+0000 7fd0e6ba7700 1 -- start start 2023-12-24T19:57:56.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.901+0000 7fd0e6ba7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd0e01598d0 0x7fd0e00b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:56.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.901+0000 7fd0e6ba7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 0x7fd0e00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:56.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.901+0000 7fd0e6ba7700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e00cbf80 con 0x7fd0e0159ca0 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.901+0000 7fd0e6ba7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e015a110 con 0x7fd0e01598d0 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.901+0000 7fd0e6ba7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00b11c0 con 0x7fd0e006e280 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.901+0000 7fd0e4943700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd0e01598d0 0x7fd0e00b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.901+0000 7fd0dffff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd0e0159ca0 0x7fd0e006db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56630/0 (socket says 172.21.15.61:56630) 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.901+0000 7fd0e4943700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd0e01598d0 0x7fd0e00b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43304/0 (socket says 172.21.15.61:43304) 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.901+0000 7fd0dffff700 1 -- 172.21.15.61:0/1892092444 learned_addr learned my addr 172.21.15.61:0/1892092444 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0e5144700 1 --2- 172.21.15.61:0/1892092444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 0x7fd0e00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0e4943700 1 -- 172.21.15.61:0/1892092444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 msgr2=0x7fd0e00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0e4943700 1 --2- 172.21.15.61:0/1892092444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 0x7fd0e00cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0e4943700 1 -- 172.21.15.61:0/1892092444 >> v1:172.21.15.61:6789/0 conn(0x7fd0e0159ca0 legacy=0x7fd0e006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0e4943700 1 -- 172.21.15.61:0/1892092444 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e00b14a0 con 0x7fd0e01598d0 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0e4943700 1 --2- 172.21.15.61:0/1892092444 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e01598d0 0x7fd0e00b2aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009e60 tx=0x7fd0d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91242d077784cba server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0df7fe700 1 -- 172.21.15.61:0/1892092444 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d800e070 con 0x7fd0e01598d0 2023-12-24T19:57:56.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0df7fe700 1 -- 172.21.15.61:0/1892092444 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d800bc30 con 0x7fd0e01598d0 2023-12-24T19:57:56.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0df7fe700 1 -- 172.21.15.61:0/1892092444 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8012430 con 0x7fd0e01598d0 2023-12-24T19:57:56.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/1892092444 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e01598d0 msgr2=0x7fd0e00b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:56.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.902+0000 7fd0e6ba7700 1 --2- 172.21.15.61:0/1892092444 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e01598d0 0x7fd0e00b2aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009e60 tx=0x7fd0d8009780 comp rx=0 tx=0).stop 2023-12-24T19:57:56.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.903+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/1892092444 shutdown_connections 2023-12-24T19:57:56.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.903+0000 7fd0e6ba7700 1 --2- 172.21.15.61:0/1892092444 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 0x7fd0e00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:56.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.903+0000 7fd0e6ba7700 1 --2- 172.21.15.61:0/1892092444 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e01598d0 0x7fd0e00b2aa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:56.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.903+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/1892092444 >> 172.21.15.61:0/1892092444 conn(0x7fd0e0067550 msgr2=0x7fd0e0067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:56.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.903+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/1892092444 shutdown_connections 2023-12-24T19:57:56.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.903+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/1892092444 wait complete. 2023-12-24T19:57:56.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.904+0000 7fd0e6ba7700 1 Processor -- start 2023-12-24T19:57:56.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.904+0000 7fd0e6ba7700 1 -- start start 2023-12-24T19:57:56.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e6ba7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 0x7fd0e016d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e6ba7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e01598d0 0x7fd0e016d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e6ba7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e0159ca0 0x7fd0e015d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e6ba7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e016b580 con 0x7fd0e0159ca0 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e6ba7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e016af70 con 0x7fd0e01598d0 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e6ba7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e01600c0 con 0x7fd0e006e280 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e5144700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e0159ca0 0x7fd0e015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e5144700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e0159ca0 0x7fd0e015d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43314/0 (socket says 172.21.15.61:43314) 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e5144700 1 -- 172.21.15.61:0/2706252931 learned_addr learned my addr 172.21.15.61:0/2706252931 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e4943700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 0x7fd0e016d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0dffff700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e01598d0 0x7fd0e016d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e5144700 1 -- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 msgr2=0x7fd0e016d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e5144700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 0x7fd0e016d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e5144700 1 -- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e01598d0 msgr2=0x7fd0e016d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e5144700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e01598d0 0x7fd0e016d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:56.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e5144700 1 -- 172.21.15.61:0/2706252931 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8009a20 con 0x7fd0e0159ca0 2023-12-24T19:57:56.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e4943700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 0x7fd0e016d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:56.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0dffff700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e01598d0 0x7fd0e016d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:56.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e5144700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e0159ca0 0x7fd0e015d940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000c880 tx=0x7fd0d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:56.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0dcff9700 1 -- 172.21.15.61:0/2706252931 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0011600 con 0x7fd0e0159ca0 2023-12-24T19:57:56.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/2706252931 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e016b210 con 0x7fd0e0159ca0 2023-12-24T19:57:56.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.905+0000 7fd0dcff9700 1 -- 172.21.15.61:0/2706252931 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d0011760 con 0x7fd0e0159ca0 2023-12-24T19:57:56.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.906+0000 7fd0dcff9700 1 -- 172.21.15.61:0/2706252931 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0011b00 con 0x7fd0e0159ca0 2023-12-24T19:57:56.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.906+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/2706252931 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e015de80 con 0x7fd0e0159ca0 2023-12-24T19:57:56.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.906+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/2706252931 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e0089120 con 0x7fd0e0159ca0 2023-12-24T19:57:56.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.907+0000 7fd0dcff9700 1 -- 172.21.15.61:0/2706252931 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd0d0023480 con 0x7fd0e0159ca0 2023-12-24T19:57:56.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.908+0000 7fd0dcff9700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0c0066f30 0x7fd0c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:56.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.908+0000 7fd0dcff9700 1 -- 172.21.15.61:0/2706252931 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd0d0084570 con 0x7fd0e0159ca0 2023-12-24T19:57:56.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.908+0000 7fd0e4943700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0c0066f30 0x7fd0c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:56.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.908+0000 7fd0e4943700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0c0066f30 0x7fd0c00693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009e60 tx=0x7fd0d8019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:56.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:56.912+0000 7fd0dcff9700 1 -- 172.21.15.61:0/2706252931 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0d0055450 con 0x7fd0e0159ca0 2023-12-24T19:57:57.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.105+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/2706252931 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd0e004c3c0 con 0x7fd0e0159ca0 2023-12-24T19:57:57.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.752+0000 7fd0dcff9700 1 -- 172.21.15.61:0/2706252931 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd0d00150d0 con 0x7fd0e0159ca0 2023-12-24T19:57:57.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0c0066f30 msgr2=0x7fd0c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:57.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0c0066f30 0x7fd0c00693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009e60 tx=0x7fd0d8019000 comp rx=0 tx=0).stop 2023-12-24T19:57:57.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/2706252931 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e0159ca0 msgr2=0x7fd0e015d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:57.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e0159ca0 0x7fd0e015d940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd0d000c880 tx=0x7fd0d0008040 comp rx=0 tx=0).stop 2023-12-24T19:57:57.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/2706252931 shutdown_connections 2023-12-24T19:57:57.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0e006e280 0x7fd0e016d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:57.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0c0066f30 0x7fd0c00693e0 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009e60 tx=0x7fd0d8019000 comp rx=0 tx=0).stop 2023-12-24T19:57:57.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0e0159ca0 0x7fd0e015d940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:57.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 --2- 172.21.15.61:0/2706252931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e01598d0 0x7fd0e016d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:57.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/2706252931 >> 172.21.15.61:0/2706252931 conn(0x7fd0e0067550 msgr2=0x7fd0e00ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:57.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/2706252931 shutdown_connections 2023-12-24T19:57:57.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.760+0000 7fd0e6ba7700 1 -- 172.21.15.61:0/2706252931 wait complete. 2023-12-24T19:57:57.761 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T19:57:57.775 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T19:57:57.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.904+0000 7f81a016b700 1 Processor -- start 2023-12-24T19:57:57.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.905+0000 7f81a016b700 1 -- start start 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f81a016b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81980cdf90 0x7f819806b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f81a016b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f81980ce360 0x7f8198158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f81a016b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8198158a80 0x7f819806c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f81a016b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819815bad0 con 0x7f81980ce360 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f81a016b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819815bdb0 con 0x7f8198158a80 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f81a016b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819815c090 con 0x7f81980cdf90 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819d706700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f81980ce360 0x7f8198158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819d706700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f81980ce360 0x7f8198158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43316/0 (socket says 172.21.15.61:43316) 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819d706700 1 -- 172.21.15.61:0/4176525696 learned_addr learned my addr 172.21.15.61:0/4176525696 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819e708700 1 --2- 172.21.15.61:0/4176525696 >> v2:172.21.15.133:3300/0 conn(0x7f8198158a80 0x7f819806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819df07700 1 --2- 172.21.15.61:0/4176525696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81980cdf90 0x7f819806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819d706700 1 -- 172.21.15.61:0/4176525696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81980cdf90 msgr2=0x7f819806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:57.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819d706700 1 --2- 172.21.15.61:0/4176525696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81980cdf90 0x7f819806b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819d706700 1 -- 172.21.15.61:0/4176525696 >> v2:172.21.15.133:3300/0 conn(0x7f8198158a80 msgr2=0x7f819806c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819d706700 1 --2- 172.21.15.61:0/4176525696 >> v2:172.21.15.133:3300/0 conn(0x7f8198158a80 0x7f819806c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819d706700 1 -- 172.21.15.61:0/4176525696 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819815c370 con 0x7f81980ce360 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.906+0000 7f819d706700 1 --2- 172.21.15.61:0/4176525696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81980ce360 0x7f8198158540 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f81980b1570 tx=0x7f8188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85013850922dccbe server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f819cf05700 1 -- 172.21.15.61:0/4176525696 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818800b860 con 0x7f81980ce360 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f819cf05700 1 -- 172.21.15.61:0/4176525696 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818800b9c0 con 0x7f81980ce360 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f819cf05700 1 -- 172.21.15.61:0/4176525696 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818800bd60 con 0x7f81980ce360 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f81a016b700 1 -- 172.21.15.61:0/4176525696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81980ce360 msgr2=0x7f8198158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f81a016b700 1 --2- 172.21.15.61:0/4176525696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81980ce360 0x7f8198158540 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f81980b1570 tx=0x7f8188009250 comp rx=0 tx=0).stop 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f81a016b700 1 -- 172.21.15.61:0/4176525696 shutdown_connections 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f81a016b700 1 --2- 172.21.15.61:0/4176525696 >> v2:172.21.15.133:3300/0 conn(0x7f8198158a80 0x7f819806c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f81a016b700 1 --2- 172.21.15.61:0/4176525696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81980cdf90 0x7f819806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f81a016b700 1 --2- 172.21.15.61:0/4176525696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81980ce360 0x7f8198158540 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:57.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f81a016b700 1 -- 172.21.15.61:0/4176525696 >> 172.21.15.61:0/4176525696 conn(0x7f819806f810 msgr2=0x7f819806ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:57.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f81a016b700 1 -- 172.21.15.61:0/4176525696 shutdown_connections 2023-12-24T19:57:57.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.907+0000 7f81a016b700 1 -- 172.21.15.61:0/4176525696 wait complete. 2023-12-24T19:57:57.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.908+0000 7f81a016b700 1 Processor -- start 2023-12-24T19:57:57.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.908+0000 7f81a016b700 1 -- start start 2023-12-24T19:57:57.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f81a016b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81980cdf90 0x7f8198156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:57.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f81a016b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81980ce360 0x7f81980b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:57.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f81a016b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8198158a80 0x7f819814b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f81a016b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81980b29d0 con 0x7f8198158a80 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f81a016b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81980b3ac0 con 0x7f81980ce360 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f81a016b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81980b2380 con 0x7f81980cdf90 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f819e708700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8198158a80 0x7f819814b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f819e708700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8198158a80 0x7f819814b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43318/0 (socket says 172.21.15.61:43318) 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f819e708700 1 -- 172.21.15.61:0/4016346019 learned_addr learned my addr 172.21.15.61:0/4016346019 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f819d706700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81980ce360 0x7f81980b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.909+0000 7f819df07700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81980cdf90 0x7f8198156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f819e708700 1 -- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81980cdf90 msgr2=0x7f8198156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f819e708700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81980cdf90 0x7f8198156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f819e708700 1 -- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81980ce360 msgr2=0x7f81980b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f819e708700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81980ce360 0x7f81980b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f819e708700 1 -- 172.21.15.61:0/4016346019 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81880094f0 con 0x7f8198158a80 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f819d706700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81980ce360 0x7f81980b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:57.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f819e708700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8198158a80 0x7f819814b660 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8190009fa0 tx=0x7f8190009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:57.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f818dffb700 1 -- 172.21.15.61:0/4016346019 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000ed20 con 0x7f8198158a80 2023-12-24T19:57:57.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f818dffb700 1 -- 172.21.15.61:0/4016346019 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819000ee80 con 0x7f8198158a80 2023-12-24T19:57:57.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f81a016b700 1 -- 172.21.15.61:0/4016346019 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81980b2660 con 0x7f8198158a80 2023-12-24T19:57:57.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f818dffb700 1 -- 172.21.15.61:0/4016346019 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190014670 con 0x7f8198158a80 2023-12-24T19:57:57.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.910+0000 7f81a016b700 1 -- 172.21.15.61:0/4016346019 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81980b37f0 con 0x7f8198158a80 2023-12-24T19:57:57.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.911+0000 7f81a016b700 1 -- 172.21.15.61:0/4016346019 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81980b3e30 con 0x7f8198158a80 2023-12-24T19:57:57.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.912+0000 7f818dffb700 1 -- 172.21.15.61:0/4016346019 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f81900149e0 con 0x7f8198158a80 2023-12-24T19:57:57.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.912+0000 7f818dffb700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f817c066f30 0x7f817c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:57.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.912+0000 7f818dffb700 1 -- 172.21.15.61:0/4016346019 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f8190084cc0 con 0x7f8198158a80 2023-12-24T19:57:57.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.912+0000 7f819df07700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f817c066f30 0x7f817c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:57.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.913+0000 7f819df07700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f817c066f30 0x7f817c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8194006fd0 tx=0x7f8194008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:57.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:57.917+0000 7f818dffb700 1 -- 172.21.15.61:0/4016346019 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8190051f90 con 0x7f8198158a80 2023-12-24T19:57:58.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.159+0000 7f81a016b700 1 -- 172.21.15.61:0/4016346019 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f819804c3c0 con 0x7f8198158a80 2023-12-24T19:57:58.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.769+0000 7f818dffb700 1 -- 172.21.15.61:0/4016346019 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f81900555b0 con 0x7f8198158a80 2023-12-24T19:57:58.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 -- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f817c066f30 msgr2=0x7f817c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:58.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f817c066f30 0x7f817c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8194006fd0 tx=0x7f8194008040 comp rx=0 tx=0).stop 2023-12-24T19:57:58.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 -- 172.21.15.61:0/4016346019 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8198158a80 msgr2=0x7f819814b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:58.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8198158a80 0x7f819814b660 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8190009fa0 tx=0x7f8190009900 comp rx=0 tx=0).stop 2023-12-24T19:57:58.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 -- 172.21.15.61:0/4016346019 shutdown_connections 2023-12-24T19:57:58.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81980cdf90 0x7f8198156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:58.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f817c066f30 0x7f817c0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:58.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8198158a80 0x7f819814b660 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:58.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 --2- 172.21.15.61:0/4016346019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81980ce360 0x7f81980b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:58.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 -- 172.21.15.61:0/4016346019 >> 172.21.15.61:0/4016346019 conn(0x7f819806f810 msgr2=0x7f81980ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:58.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 -- 172.21.15.61:0/4016346019 shutdown_connections 2023-12-24T19:57:58.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.772+0000 7f81a016b700 1 -- 172.21.15.61:0/4016346019 wait complete. 2023-12-24T19:57:58.775 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 4 and data pool 5 2023-12-24T19:57:58.791 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:58.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.920+0000 7f6dc76c8700 1 Processor -- start 2023-12-24T19:57:58.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.920+0000 7f6dc76c8700 1 -- start start 2023-12-24T19:57:58.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.921+0000 7f6dc76c8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6dc006ec70 0x7f6dc006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:58.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.921+0000 7f6dc76c8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dc00cd9c0 0x7f6dc00cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:58.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.921+0000 7f6dc76c8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc006c300 con 0x7f6dc01595e0 2023-12-24T19:57:58.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.921+0000 7f6dc76c8700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc006ce80 con 0x7f6dc006ec70 2023-12-24T19:57:58.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.921+0000 7f6dc76c8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc0068560 con 0x7f6dc00cd9c0 2023-12-24T19:57:58.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.921+0000 7f6dc5464700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6dc006ec70 0x7f6dc006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:58.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.921+0000 7f6dc5464700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6dc006ec70 0x7f6dc006f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43324/0 (socket says 172.21.15.61:43324) 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.921+0000 7f6dc5464700 1 -- 172.21.15.61:0/1820259079 learned_addr learned my addr 172.21.15.61:0/1820259079 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.921+0000 7f6dc5c65700 1 --2- 172.21.15.61:0/1820259079 >> v2:172.21.15.133:3300/0 conn(0x7f6dc00cd9c0 0x7f6dc00cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc5464700 1 -- 172.21.15.61:0/1820259079 >> v2:172.21.15.133:3300/0 conn(0x7f6dc00cd9c0 msgr2=0x7f6dc00cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc5464700 1 --2- 172.21.15.61:0/1820259079 >> v2:172.21.15.133:3300/0 conn(0x7f6dc00cd9c0 0x7f6dc00cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc5464700 1 -- 172.21.15.61:0/1820259079 >> v1:172.21.15.133:6789/0 conn(0x7f6dc01595e0 legacy=0x7f6dc0159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc5464700 1 -- 172.21.15.61:0/1820259079 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc006c550 con 0x7f6dc006ec70 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc5c65700 1 --2- 172.21.15.61:0/1820259079 >> v2:172.21.15.133:3300/0 conn(0x7f6dc00cd9c0 0x7f6dc00cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc5464700 1 --2- 172.21.15.61:0/1820259079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc006ec70 0x7f6dc006f040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00cf360 tx=0x7f6dbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a131c03510547b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6db7fff700 1 -- 172.21.15.61:0/1820259079 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00b860 con 0x7f6dc006ec70 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6db7fff700 1 -- 172.21.15.61:0/1820259079 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc00b9c0 con 0x7f6dc006ec70 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6db7fff700 1 -- 172.21.15.61:0/1820259079 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc00bd60 con 0x7f6dc006ec70 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc76c8700 1 -- 172.21.15.61:0/1820259079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc006ec70 msgr2=0x7f6dc006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc76c8700 1 --2- 172.21.15.61:0/1820259079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc006ec70 0x7f6dc006f040 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00cf360 tx=0x7f6dbc009250 comp rx=0 tx=0).stop 2023-12-24T19:57:58.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc76c8700 1 -- 172.21.15.61:0/1820259079 shutdown_connections 2023-12-24T19:57:58.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc76c8700 1 --2- 172.21.15.61:0/1820259079 >> v2:172.21.15.133:3300/0 conn(0x7f6dc00cd9c0 0x7f6dc00cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:58.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc76c8700 1 --2- 172.21.15.61:0/1820259079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc006ec70 0x7f6dc006f040 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:58.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.922+0000 7f6dc76c8700 1 -- 172.21.15.61:0/1820259079 >> 172.21.15.61:0/1820259079 conn(0x7f6dc006b650 msgr2=0x7f6dc00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:58.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.923+0000 7f6dc76c8700 1 -- 172.21.15.61:0/1820259079 shutdown_connections 2023-12-24T19:57:58.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.923+0000 7f6dc76c8700 1 -- 172.21.15.61:0/1820259079 wait complete. 2023-12-24T19:57:58.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.924+0000 7f6dc76c8700 1 Processor -- start 2023-12-24T19:57:58.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.924+0000 7f6dc76c8700 1 -- start start 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc76c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc006ec70 0x7f6dc0140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc76c8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc00cd9c0 0x7f6dc0157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc76c8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc01595e0 0x7f6dc0155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc76c8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc00aec70 con 0x7f6dc01595e0 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc76c8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc0158780 con 0x7f6dc006ec70 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc76c8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc0158a60 con 0x7f6dc00cd9c0 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5c65700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc01595e0 0x7f6dc0155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5c65700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc01595e0 0x7f6dc0155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43336/0 (socket says 172.21.15.61:43336) 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5c65700 1 -- 172.21.15.61:0/666098368 learned_addr learned my addr 172.21.15.61:0/666098368 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5464700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc006ec70 0x7f6dc0140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc4c63700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc00cd9c0 0x7f6dc0157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5c65700 1 -- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc00cd9c0 msgr2=0x7f6dc0157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5c65700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc00cd9c0 0x7f6dc0157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:58.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5c65700 1 -- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc006ec70 msgr2=0x7f6dc0140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5c65700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc006ec70 0x7f6dc0140a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5c65700 1 -- 172.21.15.61:0/666098368 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc0094f0 con 0x7f6dc01595e0 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5464700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc006ec70 0x7f6dc0140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6dc5c65700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc01595e0 0x7f6dc0155c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d180 tx=0x7f6db8009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.925+0000 7f6db57fa700 1 -- 172.21.15.61:0/666098368 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db800de20 con 0x7f6dc01595e0 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.926+0000 7f6db57fa700 1 -- 172.21.15.61:0/666098368 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db800f040 con 0x7f6dc01595e0 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.926+0000 7f6dc76c8700 1 -- 172.21.15.61:0/666098368 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc0158d40 con 0x7f6dc01595e0 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.926+0000 7f6db57fa700 1 -- 172.21.15.61:0/666098368 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8015690 con 0x7f6dc01595e0 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.926+0000 7f6dc76c8700 1 -- 172.21.15.61:0/666098368 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc0140f40 con 0x7f6dc01595e0 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.926+0000 7f6dc76c8700 1 -- 172.21.15.61:0/666098368 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc004c3c0 con 0x7f6dc01595e0 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.927+0000 7f6db57fa700 1 -- 172.21.15.61:0/666098368 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6db801e3b0 con 0x7f6dc01595e0 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.927+0000 7f6db57fa700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6da4066f30 0x7f6da40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:58.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.927+0000 7f6db57fa700 1 -- 172.21.15.61:0/666098368 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6db8084b40 con 0x7f6dc01595e0 2023-12-24T19:57:58.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.928+0000 7f6dc5464700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6da4066f30 0x7f6da40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:58.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.928+0000 7f6dc5464700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6da4066f30 0x7f6da40693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00cf360 tx=0x7f6dbc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:58.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:58.932+0000 7f6db57fa700 1 -- 172.21.15.61:0/666098368 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6db8051db0 con 0x7f6dc01595e0 2023-12-24T19:57:59.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.127+0000 7f6dc76c8700 1 -- 172.21.15.61:0/666098368 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6dc006c830 con 0x7f6dc01595e0 2023-12-24T19:57:59.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.128+0000 7f6db57fa700 1 -- 172.21.15.61:0/666098368 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f6db801a090 con 0x7f6dc01595e0 2023-12-24T19:57:59.128 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:59.128 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":30,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:58.160801+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:56.143696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:57.136484+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:59.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 -- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6da4066f30 msgr2=0x7f6da40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6da4066f30 0x7f6da40693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00cf360 tx=0x7f6dbc017000 comp rx=0 tx=0).stop 2023-12-24T19:57:59.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 -- 172.21.15.61:0/666098368 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc01595e0 msgr2=0x7f6dc0155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc01595e0 0x7f6dc0155c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6db800d180 tx=0x7f6db8009a50 comp rx=0 tx=0).stop 2023-12-24T19:57:59.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 -- 172.21.15.61:0/666098368 shutdown_connections 2023-12-24T19:57:59.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6da4066f30 0x7f6da40693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6dc01595e0 0x7f6dc0155c40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc006ec70 0x7f6dc0140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 --2- 172.21.15.61:0/666098368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6dc00cd9c0 0x7f6dc0157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 -- 172.21.15.61:0/666098368 >> 172.21.15.61:0/666098368 conn(0x7f6dc006b650 msgr2=0x7f6dc00c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:59.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 -- 172.21.15.61:0/666098368 shutdown_connections 2023-12-24T19:57:59.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.130+0000 7f6dc76c8700 1 -- 172.21.15.61:0/666098368 wait complete. 2023-12-24T19:57:59.143 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:57:59.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.263+0000 7f6e7b5d3700 1 Processor -- start 2023-12-24T19:57:59.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.263+0000 7f6e7b5d3700 1 -- start start 2023-12-24T19:57:59.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.264+0000 7f6e7b5d3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e740af710 0x7f6e740afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.264+0000 7f6e7b5d3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e74068c80 0x7f6e74067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.264+0000 7f6e7b5d3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6e740a6c80 0x7f6e7415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.264+0000 7f6e7b5d3700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e740687f0 con 0x7f6e740a6c80 2023-12-24T19:57:59.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.264+0000 7f6e7b5d3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e740a7100 con 0x7f6e74068c80 2023-12-24T19:57:59.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.264+0000 7f6e7b5d3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e74067be0 con 0x7f6e740af710 2023-12-24T19:57:59.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.264+0000 7f6e79b70700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6e740a6c80 0x7f6e7415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.264+0000 7f6e79b70700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6e740a6c80 0x7f6e7415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43352/0 (socket says 172.21.15.61:43352) 2023-12-24T19:57:59.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.264+0000 7f6e79b70700 1 -- 172.21.15.61:0/59647913 learned_addr learned my addr 172.21.15.61:0/59647913 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e78b6e700 1 --2- 172.21.15.61:0/59647913 >> v2:172.21.15.133:3300/0 conn(0x7f6e74068c80 0x7f6e74067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e7936f700 1 --2- 172.21.15.61:0/59647913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e740af710 0x7f6e740afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e79b70700 1 -- 172.21.15.61:0/59647913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e740af710 msgr2=0x7f6e740afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e79b70700 1 --2- 172.21.15.61:0/59647913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e740af710 0x7f6e740afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e79b70700 1 -- 172.21.15.61:0/59647913 >> v2:172.21.15.133:3300/0 conn(0x7f6e74068c80 msgr2=0x7f6e74067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e79b70700 1 --2- 172.21.15.61:0/59647913 >> v2:172.21.15.133:3300/0 conn(0x7f6e74068c80 0x7f6e74067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e79b70700 1 -- 172.21.15.61:0/59647913 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74067ec0 con 0x7f6e740a6c80 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e79b70700 1 --2- 172.21.15.61:0/59647913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 0x7f6e7415a5e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6e7406d660 tx=0x7f6e6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32892ecdce9ba8af server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e6bfff700 1 -- 172.21.15.61:0/59647913 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00e070 con 0x7f6e740a6c80 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e6bfff700 1 -- 172.21.15.61:0/59647913 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c00b970 con 0x7f6e740a6c80 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.265+0000 7f6e6bfff700 1 -- 172.21.15.61:0/59647913 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c0092e0 con 0x7f6e740a6c80 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.266+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/59647913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 msgr2=0x7f6e7415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.266+0000 7f6e7b5d3700 1 --2- 172.21.15.61:0/59647913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 0x7f6e7415a5e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6e7406d660 tx=0x7f6e6c009840 comp rx=0 tx=0).stop 2023-12-24T19:57:59.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.266+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/59647913 shutdown_connections 2023-12-24T19:57:59.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.266+0000 7f6e7b5d3700 1 --2- 172.21.15.61:0/59647913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 0x7f6e7415a5e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.266+0000 7f6e7b5d3700 1 --2- 172.21.15.61:0/59647913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e740af710 0x7f6e740afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.266+0000 7f6e7b5d3700 1 --2- 172.21.15.61:0/59647913 >> v2:172.21.15.133:3300/0 conn(0x7f6e74068c80 0x7f6e74067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.266+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/59647913 >> 172.21.15.61:0/59647913 conn(0x7f6e740ca200 msgr2=0x7f6e740ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:59.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.266+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/59647913 shutdown_connections 2023-12-24T19:57:59.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.266+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/59647913 wait complete. 2023-12-24T19:57:59.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.267+0000 7f6e7b5d3700 1 Processor -- start 2023-12-24T19:57:59.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.267+0000 7f6e7b5d3700 1 -- start start 2023-12-24T19:57:59.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e7b5d3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e74068c80 0x7f6e740a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e7b5d3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 0x7f6e74159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e7b5d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e740af710 0x7f6e741679c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e7b5d3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740acb50 con 0x7f6e740a6c80 2023-12-24T19:57:59.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e7b5d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740c2980 con 0x7f6e740af710 2023-12-24T19:57:59.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e7b5d3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740aa790 con 0x7f6e74068c80 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e78b6e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 0x7f6e74159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e78b6e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 0x7f6e74159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43358/0 (socket says 172.21.15.61:43358) 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e78b6e700 1 -- 172.21.15.61:0/274954023 learned_addr learned my addr 172.21.15.61:0/274954023 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e7936f700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e74068c80 0x7f6e740a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e79b70700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e740af710 0x7f6e741679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e78b6e700 1 -- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e74068c80 msgr2=0x7f6e740a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e78b6e700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e74068c80 0x7f6e740a9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e78b6e700 1 -- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e740af710 msgr2=0x7f6e741679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e78b6e700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e740af710 0x7f6e741679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e78b6e700 1 -- 172.21.15.61:0/274954023 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c009ae0 con 0x7f6e740a6c80 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.268+0000 7f6e78b6e700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 0x7f6e74159470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000e900 tx=0x7f6e700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.269+0000 7f6e697fa700 1 -- 172.21.15.61:0/274954023 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70013680 con 0x7f6e740a6c80 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.269+0000 7f6e697fa700 1 -- 172.21.15.61:0/274954023 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e700137e0 con 0x7f6e740a6c80 2023-12-24T19:57:59.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.269+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/274954023 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e740aaa70 con 0x7f6e740a6c80 2023-12-24T19:57:59.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.269+0000 7f6e697fa700 1 -- 172.21.15.61:0/274954023 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70013ba0 con 0x7f6e740a6c80 2023-12-24T19:57:59.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.269+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/274954023 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e740a9750 con 0x7f6e740a6c80 2023-12-24T19:57:59.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.270+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/274954023 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7404c3c0 con 0x7f6e740a6c80 2023-12-24T19:57:59.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.270+0000 7f6e697fa700 1 -- 172.21.15.61:0/274954023 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6e700123d0 con 0x7f6e740a6c80 2023-12-24T19:57:59.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.270+0000 7f6e697fa700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6e58066f30 0x7f6e580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.271+0000 7f6e697fa700 1 -- 172.21.15.61:0/274954023 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e700845b0 con 0x7f6e740a6c80 2023-12-24T19:57:59.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.271+0000 7f6e7936f700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6e58066f30 0x7f6e580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.271+0000 7f6e7936f700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6e58066f30 0x7f6e580693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e74159f10 tx=0x7f6e640091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:59.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.275+0000 7f6e697fa700 1 -- 172.21.15.61:0/274954023 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e70051820 con 0x7f6e740a6c80 2023-12-24T19:57:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.470+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/274954023 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e7406f110 con 0x7f6e740a6c80 2023-12-24T19:57:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.471+0000 7f6e697fa700 1 -- 172.21.15.61:0/274954023 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f6e70054e40 con 0x7f6e740a6c80 2023-12-24T19:57:59.472 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:57:59.472 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":30,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:58.160801+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:56.143696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:57.136484+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:57:59.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.473+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6e58066f30 msgr2=0x7f6e580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.473+0000 7f6e7b5d3700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6e58066f30 0x7f6e580693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e74159f10 tx=0x7f6e640091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.473+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/274954023 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 msgr2=0x7f6e74159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.473+0000 7f6e7b5d3700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 0x7f6e74159470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000e900 tx=0x7f6e700091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.474+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/274954023 shutdown_connections 2023-12-24T19:57:59.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.474+0000 7f6e7b5d3700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6e74068c80 0x7f6e740a9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.474+0000 7f6e7b5d3700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6e58066f30 0x7f6e580693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.474+0000 7f6e7b5d3700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e740af710 0x7f6e741679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.474+0000 7f6e7b5d3700 1 --2- 172.21.15.61:0/274954023 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6e740a6c80 0x7f6e74159470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.474+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/274954023 >> 172.21.15.61:0/274954023 conn(0x7f6e740ca200 msgr2=0x7f6e741561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:59.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.474+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/274954023 shutdown_connections 2023-12-24T19:57:59.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.474+0000 7f6e7b5d3700 1 -- 172.21.15.61:0/274954023 wait complete. 2023-12-24T19:57:59.486 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T19:57:59.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.611+0000 7f5ad72e4700 1 Processor -- start 2023-12-24T19:57:59.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.612+0000 7f5ad72e4700 1 -- start start 2023-12-24T19:57:59.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.612+0000 7f5ad72e4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad72e4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ad0069500 0x7f5ad0069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad72e4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad00ab770 con 0x7f5ad00caa70 2023-12-24T19:57:59.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad72e4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad015b250 con 0x7f5ad0069500 2023-12-24T19:57:59.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad72e4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00aa880 con 0x7f5ad01578b0 2023-12-24T19:57:59.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad5080700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad5881700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ad0069500 0x7f5ad0069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad5881700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ad0069500 0x7f5ad0069910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:44144/0 (socket says 172.21.15.61:44144) 2023-12-24T19:57:59.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad5080700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:45538/0 (socket says 172.21.15.61:45538) 2023-12-24T19:57:59.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad5881700 1 -- 172.21.15.61:0/2571822325 learned_addr learned my addr 172.21.15.61:0/2571822325 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:59.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad487f700 1 --1- 172.21.15.61:0/2571822325 >> v1:172.21.15.133:6789/0 conn(0x7f5ad00caa70 0x7f5ad00caee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:56600/0 (socket says 172.21.15.61:56600) 2023-12-24T19:57:59.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad5080700 1 -- 172.21.15.61:0/2571822325 >> v2:172.21.15.133:3300/0 conn(0x7f5ad0069500 msgr2=0x7f5ad0069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:57:59.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad5080700 1 --2- 172.21.15.61:0/2571822325 >> v2:172.21.15.133:3300/0 conn(0x7f5ad0069500 0x7f5ad0069910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad5080700 1 -- 172.21.15.61:0/2571822325 >> v1:172.21.15.133:6789/0 conn(0x7f5ad00caa70 legacy=0x7f5ad00caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.613+0000 7f5ad5080700 1 -- 172.21.15.61:0/2571822325 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00aab60 con 0x7f5ad01578b0 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ad5080700 1 --2- 172.21.15.61:0/2571822325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015ad10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00098e0 tx=0x7f5ac00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea8ca519c559487 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ac7fff700 1 -- 172.21.15.61:0/2571822325 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac000b640 con 0x7f5ad01578b0 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ac7fff700 1 -- 172.21.15.61:0/2571822325 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac000b7a0 con 0x7f5ad01578b0 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ac7fff700 1 -- 172.21.15.61:0/2571822325 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac000bb40 con 0x7f5ad01578b0 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ad72e4700 1 -- 172.21.15.61:0/2571822325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 msgr2=0x7f5ad015ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ad72e4700 1 --2- 172.21.15.61:0/2571822325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015ad10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00098e0 tx=0x7f5ac00091a0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ad72e4700 1 -- 172.21.15.61:0/2571822325 shutdown_connections 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ad72e4700 1 --2- 172.21.15.61:0/2571822325 >> v2:172.21.15.133:3300/0 conn(0x7f5ad0069500 0x7f5ad0069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ad72e4700 1 --2- 172.21.15.61:0/2571822325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015ad10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ad72e4700 1 -- 172.21.15.61:0/2571822325 >> 172.21.15.61:0/2571822325 conn(0x7f5ad0067fd0 msgr2=0x7f5ad00ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ad72e4700 1 -- 172.21.15.61:0/2571822325 shutdown_connections 2023-12-24T19:57:59.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.614+0000 7f5ad72e4700 1 -- 172.21.15.61:0/2571822325 wait complete. 2023-12-24T19:57:59.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.616+0000 7f5ad72e4700 1 Processor -- start 2023-12-24T19:57:59.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.616+0000 7f5ad72e4700 1 -- start start 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.616+0000 7f5ad72e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ad0069500 0x7f5ad016b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.616+0000 7f5ad72e4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ad00caa70 0x7f5ad01548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad72e4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad72e4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00c8230 con 0x7f5ad00caa70 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad72e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00c7620 con 0x7f5ad0069500 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad72e4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00c7900 con 0x7f5ad01578b0 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad487f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ad00caa70 0x7f5ad01548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad487f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ad00caa70 0x7f5ad01548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43368/0 (socket says 172.21.15.61:43368) 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad487f700 1 -- 172.21.15.61:0/474093964 learned_addr learned my addr 172.21.15.61:0/474093964 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad5080700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ad0069500 0x7f5ad016b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad5881700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad487f700 1 -- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 msgr2=0x7f5ad015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad487f700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad487f700 1 -- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ad0069500 msgr2=0x7f5ad016b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:57:59.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad487f700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ad0069500 0x7f5ad016b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:57:59.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad487f700 1 -- 172.21.15.61:0/474093964 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac0009420 con 0x7f5ad00caa70 2023-12-24T19:57:59.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad5881700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:57:59.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad487f700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ad00caa70 0x7f5ad01548b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c7c0 tx=0x7f5acc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:59.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ac57fa700 1 -- 172.21.15.61:0/474093964 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc005a70 con 0x7f5ad00caa70 2023-12-24T19:57:59.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ac57fa700 1 -- 172.21.15.61:0/474093964 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc005bd0 con 0x7f5ad00caa70 2023-12-24T19:57:59.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ad72e4700 1 -- 172.21.15.61:0/474093964 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad00c7be0 con 0x7f5ad00caa70 2023-12-24T19:57:59.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.617+0000 7f5ac57fa700 1 -- 172.21.15.61:0/474093964 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0070d0 con 0x7f5ad00caa70 2023-12-24T19:57:59.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.618+0000 7f5ad72e4700 1 -- 172.21.15.61:0/474093964 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad016b920 con 0x7f5ad00caa70 2023-12-24T19:57:59.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.619+0000 7f5ad72e4700 1 -- 172.21.15.61:0/474093964 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad00c83a0 con 0x7f5ad00caa70 2023-12-24T19:57:59.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.619+0000 7f5ac57fa700 1 -- 172.21.15.61:0/474093964 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5acc007480 con 0x7f5ad00caa70 2023-12-24T19:57:59.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.619+0000 7f5ac57fa700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ab4066f30 0x7f5ab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:57:59.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.619+0000 7f5ac57fa700 1 -- 172.21.15.61:0/474093964 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5acc083a00 con 0x7f5ad00caa70 2023-12-24T19:57:59.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.620+0000 7f5ad5080700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ab4066f30 0x7f5ab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:57:59.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.620+0000 7f5ad5080700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ab4066f30 0x7f5ab40693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00093f0 tx=0x7f5ac0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:57:59.624 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.623+0000 7f5ac57fa700 1 -- 172.21.15.61:0/474093964 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5acc050c70 con 0x7f5ad00caa70 2023-12-24T19:57:59.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:57:59.868+0000 7f5ad72e4700 1 -- 172.21.15.61:0/474093964 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5ad004c3c0 con 0x7f5ad00caa70 2023-12-24T19:58:00.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.793+0000 7f5ac57fa700 1 -- 172.21.15.61:0/474093964 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5acc017020 con 0x7f5ad00caa70 2023-12-24T19:58:00.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 -- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ab4066f30 msgr2=0x7f5ab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:00.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ab4066f30 0x7f5ab40693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00093f0 tx=0x7f5ac0017000 comp rx=0 tx=0).stop 2023-12-24T19:58:00.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 -- 172.21.15.61:0/474093964 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ad00caa70 msgr2=0x7f5ad01548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:00.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ad00caa70 0x7f5ad01548b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c7c0 tx=0x7f5acc007f70 comp rx=0 tx=0).stop 2023-12-24T19:58:00.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 -- 172.21.15.61:0/474093964 shutdown_connections 2023-12-24T19:58:00.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ad01578b0 0x7f5ad015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:00.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ab4066f30 0x7f5ab40693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:00.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ad0069500 0x7f5ad016b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:00.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 --2- 172.21.15.61:0/474093964 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ad00caa70 0x7f5ad01548b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:00.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 -- 172.21.15.61:0/474093964 >> 172.21.15.61:0/474093964 conn(0x7f5ad0067fd0 msgr2=0x7f5ad0155270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:00.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.796+0000 7f5ad72e4700 1 -- 172.21.15.61:0/474093964 shutdown_connections 2023-12-24T19:58:00.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.797+0000 7f5ad72e4700 1 -- 172.21.15.61:0/474093964 wait complete. 2023-12-24T19:58:00.812 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T19:58:00.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.944+0000 7efffe0ae700 1 Processor -- start 2023-12-24T19:58:00.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.944+0000 7efffe0ae700 1 -- start start 2023-12-24T19:58:00.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.944+0000 7efffe0ae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efff80c3500 0x7efff80c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.944+0000 7efffe0ae700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff80c8690 con 0x7efff8156830 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.944+0000 7efffe0ae700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff8069f00 con 0x7efff8156c00 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.944+0000 7efffe0ae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff806a1e0 con 0x7efff80c3500 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff77fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7efff8156830 0x7efff80c2df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56638/0 (socket says 172.21.15.61:56638) 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff77fe700 1 -- 172.21.15.61:0/2549642848 learned_addr learned my addr 172.21.15.61:0/2549642848 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420692010 0 0) 0x7efff80c8690 con 0x7efff8156830 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effe0003570 con 0x7efff8156830 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff7fff700 1 --2- 172.21.15.61:0/2549642848 >> v2:172.21.15.133:3300/0 conn(0x7efff80c3500 0x7efff80c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3602971221 0 0) 0x7effe0003570 con 0x7efff8156830 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 >> v2:172.21.15.133:3300/0 conn(0x7efff80c3500 msgr2=0x7efff80c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 --2- 172.21.15.61:0/2549642848 >> v2:172.21.15.133:3300/0 conn(0x7efff80c3500 0x7efff80c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:00.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 >> v1:172.21.15.133:6789/0 conn(0x7efff8156c00 legacy=0x7efff80c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff806a4c0 con 0x7efff8156830 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7effe8001470 con 0x7efff8156830 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 >> v1:172.21.15.61:6789/0 conn(0x7efff8156830 legacy=0x7efff80c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effe0003a60 0x7effe0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe0004810 0x7effe0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effe00052e0 0x7effe000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff806a1e0 con 0x7effe00052e0 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe000c2a0 con 0x7effe0004810 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe000c460 con 0x7effe0003a60 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff7fff700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effe00052e0 0x7effe000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff77fe700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effe0003a60 0x7effe0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.945+0000 7efff6ffd700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe0004810 0x7effe0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.946+0000 7efff7fff700 1 -- 172.21.15.61:0/2549642848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effe0003a60 msgr2=0x7effe0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:00.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.946+0000 7efff7fff700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effe0003a60 0x7effe0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.946+0000 7efff7fff700 1 -- 172.21.15.61:0/2549642848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe0004810 msgr2=0x7effe0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.946+0000 7efff7fff700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effe0004810 0x7effe0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.946+0000 7efff7fff700 1 -- 172.21.15.61:0/2549642848 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe0003570 con 0x7effe00052e0 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.946+0000 7efff7fff700 1 -- 172.21.15.61:0/2549642848 reap_dead start 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.946+0000 7efff7fff700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effe00052e0 0x7effe000ba60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efff000e210 tx=0x7efff000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb8968b00680abd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.946+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000eac0 con 0x7effe00052e0 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.946+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff000f040 con 0x7effe00052e0 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.946+0000 7efff67fc700 1 -- 172.21.15.61:0/2549642848 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000ee70 con 0x7effe00052e0 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.947+0000 7efffe0ae700 1 -- 172.21.15.61:0/2549642848 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effe00052e0 msgr2=0x7effe000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.947+0000 7efffe0ae700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effe00052e0 0x7effe000ba60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efff000e210 tx=0x7efff000b040 comp rx=0 tx=0).stop 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.947+0000 7efffe0ae700 1 -- 172.21.15.61:0/2549642848 shutdown_connections 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.947+0000 7efffe0ae700 1 --2- 172.21.15.61:0/2549642848 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effe00052e0 0x7effe000ba60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.947+0000 7efffe0ae700 1 -- 172.21.15.61:0/2549642848 >> 172.21.15.61:0/2549642848 conn(0x7efff80ce1f0 msgr2=0x7efff80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.947+0000 7efffe0ae700 1 -- 172.21.15.61:0/2549642848 shutdown_connections 2023-12-24T19:58:00.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.947+0000 7efffe0ae700 1 -- 172.21.15.61:0/2549642848 wait complete. 2023-12-24T19:58:00.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.948+0000 7efffe0ae700 1 Processor -- start 2023-12-24T19:58:00.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.948+0000 7efffe0ae700 1 -- start start 2023-12-24T19:58:00.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efffe0ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effe00052e0 0x7efff816dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:00.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efffe0ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80b2340 0x7efff8150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:00.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efffe0ae700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efff81577c0 0x7efff8067e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:00.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efffe0ae700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff816ec10 con 0x7efff81577c0 2023-12-24T19:58:00.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efffe0ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff80c6830 con 0x7efff80b2340 2023-12-24T19:58:00.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efffe0ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff80c4a00 con 0x7effe00052e0 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efff81577c0 0x7efff8067e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efff81577c0 0x7efff8067e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43376/0 (socket says 172.21.15.61:43376) 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff7fff700 1 -- 172.21.15.61:0/239809928 learned_addr learned my addr 172.21.15.61:0/239809928 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff6ffd700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80b2340 0x7efff8150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff77fe700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effe00052e0 0x7efff816dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff7fff700 1 -- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effe00052e0 msgr2=0x7efff816dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff7fff700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effe00052e0 0x7efff816dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff7fff700 1 -- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80b2340 msgr2=0x7efff8150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff7fff700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80b2340 0x7efff8150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff7fff700 1 -- 172.21.15.61:0/239809928 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff816e370 con 0x7efff81577c0 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.949+0000 7efff7fff700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efff81577c0 0x7efff8067e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efff806aca0 tx=0x7efff0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.950+0000 7effdf7fe700 1 -- 172.21.15.61:0/239809928 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff001d650 con 0x7efff81577c0 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.950+0000 7effdf7fe700 1 -- 172.21.15.61:0/239809928 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff001d7d0 con 0x7efff81577c0 2023-12-24T19:58:00.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.950+0000 7efffe0ae700 1 -- 172.21.15.61:0/239809928 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff816e650 con 0x7efff81577c0 2023-12-24T19:58:00.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.950+0000 7effdf7fe700 1 -- 172.21.15.61:0/239809928 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff001db90 con 0x7efff81577c0 2023-12-24T19:58:00.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.950+0000 7efffe0ae700 1 -- 172.21.15.61:0/239809928 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff81508b0 con 0x7efff81577c0 2023-12-24T19:58:00.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.951+0000 7efffe0ae700 1 -- 172.21.15.61:0/239809928 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff8150aa0 con 0x7efff81577c0 2023-12-24T19:58:00.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.951+0000 7effdf7fe700 1 -- 172.21.15.61:0/239809928 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7efff0003020 con 0x7efff81577c0 2023-12-24T19:58:00.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.952+0000 7effdf7fe700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe4066f30 0x7effe40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:00.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.952+0000 7effdf7fe700 1 -- 172.21.15.61:0/239809928 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efff0086a30 con 0x7efff81577c0 2023-12-24T19:58:00.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.952+0000 7efff77fe700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe4066f30 0x7effe40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:00.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.953+0000 7efff77fe700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe4066f30 0x7effe40693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7effe8001120 tx=0x7effe8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:00.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:00.956+0000 7effdf7fe700 1 -- 172.21.15.61:0/239809928 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efff0053de0 con 0x7efff81577c0 2023-12-24T19:58:01.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.197+0000 7efffe0ae700 1 -- 172.21.15.61:0/239809928 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efff8150aa0 con 0x7efff81577c0 2023-12-24T19:58:01.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.797+0000 7effdf7fe700 1 -- 172.21.15.61:0/239809928 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7efff8150aa0 con 0x7efff81577c0 2023-12-24T19:58:01.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 -- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe4066f30 msgr2=0x7effe40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:01.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe4066f30 0x7effe40693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7effe8001120 tx=0x7effe8009040 comp rx=0 tx=0).stop 2023-12-24T19:58:01.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 -- 172.21.15.61:0/239809928 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efff81577c0 msgr2=0x7efff8067e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:01.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efff81577c0 0x7efff8067e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efff806aca0 tx=0x7efff0019000 comp rx=0 tx=0).stop 2023-12-24T19:58:01.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 -- 172.21.15.61:0/239809928 shutdown_connections 2023-12-24T19:58:01.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effe00052e0 0x7efff816dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:01.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe4066f30 0x7effe40693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:01.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efff81577c0 0x7efff8067e10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:01.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 --2- 172.21.15.61:0/239809928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff80b2340 0x7efff8150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:01.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 -- 172.21.15.61:0/239809928 >> 172.21.15.61:0/239809928 conn(0x7efff80ce1f0 msgr2=0x7efff8150d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:01.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 -- 172.21.15.61:0/239809928 shutdown_connections 2023-12-24T19:58:01.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.799+0000 7efffe0ae700 1 -- 172.21.15.61:0/239809928 wait complete. 2023-12-24T19:58:01.814 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:01.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.941+0000 7f2ed52dc700 1 Processor -- start 2023-12-24T19:58:01.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.941+0000 7f2ed52dc700 1 -- start start 2023-12-24T19:58:01.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.942+0000 7f2ed52dc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ed00b08f0 0x7f2ed00b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:01.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.942+0000 7f2ed52dc700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed00b2eb0 con 0x7f2ed00b2660 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.942+0000 7f2ed52dc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed00b2bd0 con 0x7f2ed015bb60 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.942+0000 7f2ed52dc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed00afc20 con 0x7f2ed00b08f0 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.942+0000 7f2ece7fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2ed00b2660 0x7f2ed015bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56654/0 (socket says 172.21.15.61:56654) 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.942+0000 7f2ece7fc700 1 -- 172.21.15.61:0/1496700494 learned_addr learned my addr 172.21.15.61:0/1496700494 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecf7fe700 1 --2- 172.21.15.61:0/1496700494 >> v2:172.21.15.133:3300/0 conn(0x7f2ed00b08f0 0x7f2ed00b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794663795 0 0) 0x7f2ed00b2eb0 con 0x7f2ed00b2660 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb8003570 con 0x7f2ed00b2660 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757692649 0 0) 0x7f2eb8003570 con 0x7f2ed00b2660 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 >> v2:172.21.15.133:3300/0 conn(0x7f2ed00b08f0 msgr2=0x7f2ed00b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 --2- 172.21.15.61:0/1496700494 >> v2:172.21.15.133:3300/0 conn(0x7f2ed00b08f0 0x7f2ed00b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 >> v1:172.21.15.133:6789/0 conn(0x7f2ed015bb60 legacy=0x7f2ed0098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed00afe10 con 0x7f2ed00b2660 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f2ec0001470 con 0x7f2ed00b2660 2023-12-24T19:58:01.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 >> v1:172.21.15.61:6789/0 conn(0x7f2ed00b2660 legacy=0x7f2ed015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb8003a60 0x7f2eb8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2eb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb80051c0 0x7f2eb800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb800c0a0 con 0x7f2eb8004810 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb800c210 con 0x7f2eb80051c0 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb800c3d0 con 0x7f2eb8003a60 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ece7fc700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2eb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2eceffd700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb8003a60 0x7f2eb8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.943+0000 7f2ecf7fe700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb80051c0 0x7f2eb800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ece7fc700 1 -- 172.21.15.61:0/1496700494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb8003a60 msgr2=0x7f2eb8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ece7fc700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb8003a60 0x7f2eb8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ece7fc700 1 -- 172.21.15.61:0/1496700494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb80051c0 msgr2=0x7f2eb800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ece7fc700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb80051c0 0x7f2eb800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ece7fc700 1 -- 172.21.15.61:0/1496700494 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8003570 con 0x7f2eb8004810 2023-12-24T19:58:01.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ecf7fe700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2eb80051c0 0x7f2eb800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2eceffd700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2eb8003a60 0x7f2eb8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ecf7fe700 1 -- 172.21.15.61:0/1496700494 reap_dead start 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ece7fc700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2eb8004c80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c3c0 tx=0x7f2ec0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d628c17e42cf163b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000cc90 con 0x7f2eb8004810 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000cdf0 con 0x7f2eb8004810 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ecdffb700 1 -- 172.21.15.61:0/1496700494 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0005b50 con 0x7f2eb8004810 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ed52dc700 1 -- 172.21.15.61:0/1496700494 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 msgr2=0x7f2eb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ed52dc700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2eb8004c80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c3c0 tx=0x7f2ec0001e50 comp rx=0 tx=0).stop 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ed52dc700 1 -- 172.21.15.61:0/1496700494 shutdown_connections 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ed52dc700 1 --2- 172.21.15.61:0/1496700494 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2eb8004c80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ed52dc700 1 -- 172.21.15.61:0/1496700494 >> 172.21.15.61:0/1496700494 conn(0x7f2ed0097a10 msgr2=0x7f2ed00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ed52dc700 1 -- 172.21.15.61:0/1496700494 shutdown_connections 2023-12-24T19:58:01.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.944+0000 7f2ed52dc700 1 -- 172.21.15.61:0/1496700494 wait complete. 2023-12-24T19:58:01.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.946+0000 7f2ed52dc700 1 Processor -- start 2023-12-24T19:58:01.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.946+0000 7f2ed52dc700 1 -- start start 2023-12-24T19:58:01.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.946+0000 7f2ed52dc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2ed0150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:01.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.946+0000 7f2ed52dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed009be10 0x7f2ed016ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:01.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.946+0000 7f2ed52dc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ed0098bd0 0x7f2ed0099030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:01.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.946+0000 7f2ed52dc700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0099570 con 0x7f2eb8004810 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.946+0000 7f2ed52dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed009b980 con 0x7f2ed009be10 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.946+0000 7f2ed52dc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed01513a0 con 0x7f2ed0098bd0 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eceffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2ed0150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eceffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2ed0150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43386/0 (socket says 172.21.15.61:43386) 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eceffd700 1 -- 172.21.15.61:0/3097277389 learned_addr learned my addr 172.21.15.61:0/3097277389 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2ece7fc700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed009be10 0x7f2ed016ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2ecf7fe700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ed0098bd0 0x7f2ed0099030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eceffd700 1 -- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ed0098bd0 msgr2=0x7f2ed0099030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eceffd700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ed0098bd0 0x7f2ed0099030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eceffd700 1 -- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed009be10 msgr2=0x7f2ed016ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eceffd700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed009be10 0x7f2ed016ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eceffd700 1 -- 172.21.15.61:0/3097277389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed009aad0 con 0x7f2eb8004810 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2ecf7fe700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ed0098bd0 0x7f2ed0099030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:01.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eceffd700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2ed0150e60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400e560 tx=0x7f2ec4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eb6ffd700 1 -- 172.21.15.61:0/3097277389 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40114f0 con 0x7f2eb8004810 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eb6ffd700 1 -- 172.21.15.61:0/3097277389 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec4011650 con 0x7f2eb8004810 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2ed52dc700 1 -- 172.21.15.61:0/3097277389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed009ad70 con 0x7f2eb8004810 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2eb6ffd700 1 -- 172.21.15.61:0/3097277389 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40119d0 con 0x7f2eb8004810 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.947+0000 7f2ed52dc700 1 -- 172.21.15.61:0/3097277389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed009b330 con 0x7f2eb8004810 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.948+0000 7f2ed52dc700 1 -- 172.21.15.61:0/3097277389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed006d440 con 0x7f2eb8004810 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.949+0000 7f2eb6ffd700 1 -- 172.21.15.61:0/3097277389 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2ec4014480 con 0x7f2eb8004810 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.949+0000 7f2eb6ffd700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ebc066f30 0x7f2ebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.949+0000 7f2eb6ffd700 1 -- 172.21.15.61:0/3097277389 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ec4083e50 con 0x7f2eb8004810 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.949+0000 7f2ece7fc700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ebc066f30 0x7f2ebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:01.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.950+0000 7f2ece7fc700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ebc066f30 0x7f2ebc0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0097e90 tx=0x7f2ec0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:01.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:01.953+0000 7f2eb6ffd700 1 -- 172.21.15.61:0/3097277389 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ec404d5a0 con 0x7f2eb8004810 2023-12-24T19:58:02.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.193+0000 7f2ed52dc700 1 -- 172.21.15.61:0/3097277389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ed009bc60 con 0x7f2eb8004810 2023-12-24T19:58:02.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.194+0000 7f2eb6ffd700 1 -- 172.21.15.61:0/3097277389 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f2ec4019020 con 0x7f2eb8004810 2023-12-24T19:58:02.194 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:02.194 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2779978406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2779978406},{"type":"v1","addr":"172.21.15.61:6835","nonce":2779978406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1935570272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1935570272},{"type":"v1","addr":"172.21.15.133:6836","nonce":1935570272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3983510237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3983510237},{"type":"v1","addr":"172.21.15.133:6837","nonce":3983510237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:58.161119+0000","modified":"2023-12-24T19:58:01.793217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4777},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4777":{"gid":4777,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2729904701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2729904701},{"type":"v1","addr":"172.21.15.61:6834","nonce":2729904701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T19:58:02.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 -- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ebc066f30 msgr2=0x7f2ebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ebc066f30 0x7f2ebc0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0097e90 tx=0x7f2ec0015000 comp rx=0 tx=0).stop 2023-12-24T19:58:02.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 -- 172.21.15.61:0/3097277389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 msgr2=0x7f2ed0150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2ed0150e60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400e560 tx=0x7f2ec4009040 comp rx=0 tx=0).stop 2023-12-24T19:58:02.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 -- 172.21.15.61:0/3097277389 shutdown_connections 2023-12-24T19:58:02.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2ed0098bd0 0x7f2ed0099030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ebc066f30 0x7f2ebc0693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2eb8004810 0x7f2ed0150e60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 --2- 172.21.15.61:0/3097277389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ed009be10 0x7f2ed016ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 -- 172.21.15.61:0/3097277389 >> 172.21.15.61:0/3097277389 conn(0x7f2ed0097a10 msgr2=0x7f2ed0067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:02.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 -- 172.21.15.61:0/3097277389 shutdown_connections 2023-12-24T19:58:02.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.196+0000 7f2ed52dc700 1 -- 172.21.15.61:0/3097277389 wait complete. 2023-12-24T19:58:02.198 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 16 2023-12-24T19:58:02.209 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:58:02.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.331+0000 7f4736d80700 1 Processor -- start 2023-12-24T19:58:02.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.331+0000 7f4736d80700 1 -- start start 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f4736d80700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473015bb60 0x7f4730098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f4736d80700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4730098aa0 0x7f473015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f4736d80700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47300b2eb0 con 0x7f473015c470 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f4736d80700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47300afc20 con 0x7f4730098aa0 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f4736d80700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47300b2bd0 con 0x7f473015bb60 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f472ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4730098aa0 0x7f473015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f473531d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f473015c470 0x7f47300b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56666/0 (socket says 172.21.15.61:56666) 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f473531d700 1 -- 172.21.15.61:0/4101966091 learned_addr learned my addr 172.21.15.61:0/4101966091 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f472f7fe700 1 -- 172.21.15.61:0/4101966091 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286579207 0 0) 0x7f47300b2eb0 con 0x7f473015c470 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f4734b1c700 1 --2- 172.21.15.61:0/4101966091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473015bb60 0x7f4730098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f472f7fe700 1 -- 172.21.15.61:0/4101966091 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4720003570 con 0x7f473015c470 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f472ffff700 1 -- 172.21.15.61:0/4101966091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473015bb60 msgr2=0x7f4730098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:02.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f472ffff700 1 --2- 172.21.15.61:0/4101966091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473015bb60 0x7f4730098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f472ffff700 1 -- 172.21.15.61:0/4101966091 >> v1:172.21.15.61:6789/0 conn(0x7f473015c470 legacy=0x7f47300b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f472ffff700 1 -- 172.21.15.61:0/4101966091 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300afe10 con 0x7f4730098aa0 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f472ffff700 1 --2- 172.21.15.61:0/4101966091 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4730098aa0 0x7f473015bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f471c0098e0 tx=0x7f471c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c392436360c67cb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.332+0000 7f472f7fe700 1 -- 172.21.15.61:0/4101966091 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c00b640 con 0x7f4730098aa0 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.333+0000 7f472f7fe700 1 -- 172.21.15.61:0/4101966091 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c00b7a0 con 0x7f4730098aa0 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.333+0000 7f472f7fe700 1 -- 172.21.15.61:0/4101966091 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c00bb20 con 0x7f4730098aa0 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.333+0000 7f4736d80700 1 -- 172.21.15.61:0/4101966091 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4730098aa0 msgr2=0x7f473015bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.333+0000 7f4736d80700 1 --2- 172.21.15.61:0/4101966091 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4730098aa0 0x7f473015bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f471c0098e0 tx=0x7f471c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.333+0000 7f4736d80700 1 -- 172.21.15.61:0/4101966091 shutdown_connections 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.333+0000 7f4736d80700 1 --2- 172.21.15.61:0/4101966091 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f473015bb60 0x7f4730098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.333+0000 7f4736d80700 1 --2- 172.21.15.61:0/4101966091 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4730098aa0 0x7f473015bf30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.333+0000 7f4736d80700 1 -- 172.21.15.61:0/4101966091 >> 172.21.15.61:0/4101966091 conn(0x7f4730097a10 msgr2=0x7f47300ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.333+0000 7f4736d80700 1 -- 172.21.15.61:0/4101966091 shutdown_connections 2023-12-24T19:58:02.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.333+0000 7f4736d80700 1 -- 172.21.15.61:0/4101966091 wait complete. 2023-12-24T19:58:02.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.334+0000 7f4736d80700 1 Processor -- start 2023-12-24T19:58:02.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.334+0000 7f4736d80700 1 -- start start 2023-12-24T19:58:02.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.335+0000 7f4736d80700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4730098aa0 0x7f473016dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.335+0000 7f4736d80700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473015bb60 0x7f473016b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.335+0000 7f4736d80700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f473015c470 0x7f4730158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.335+0000 7f4736d80700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300ad3e0 con 0x7f473015c470 2023-12-24T19:58:02.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.335+0000 7f4736d80700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473016e4f0 con 0x7f473015bb60 2023-12-24T19:58:02.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.335+0000 7f4736d80700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473016ad00 con 0x7f4730098aa0 2023-12-24T19:58:02.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.335+0000 7f473531d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f473015c470 0x7f4730158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.335+0000 7f473531d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f473015c470 0x7f4730158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43400/0 (socket says 172.21.15.61:43400) 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.335+0000 7f473531d700 1 -- 172.21.15.61:0/4009905788 learned_addr learned my addr 172.21.15.61:0/4009905788 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f472ffff700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473015bb60 0x7f473016b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f4734b1c700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4730098aa0 0x7f473016dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f473531d700 1 -- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4730098aa0 msgr2=0x7f473016dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f473531d700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4730098aa0 0x7f473016dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f473531d700 1 -- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473015bb60 msgr2=0x7f473016b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f473531d700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473015bb60 0x7f473016b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f473531d700 1 -- 172.21.15.61:0/4009905788 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c009420 con 0x7f473015c470 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f473531d700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f473015c470 0x7f4730158600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f472800cc40 tx=0x7f4728001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f472cff9700 1 -- 172.21.15.61:0/4009905788 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472800a940 con 0x7f473015c470 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f472cff9700 1 -- 172.21.15.61:0/4009905788 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472800aaa0 con 0x7f473015c470 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f4736d80700 1 -- 172.21.15.61:0/4009905788 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473016a9e0 con 0x7f473015c470 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f472cff9700 1 -- 172.21.15.61:0/4009905788 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472800ae20 con 0x7f473015c470 2023-12-24T19:58:02.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.336+0000 7f4736d80700 1 -- 172.21.15.61:0/4009905788 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473016ea00 con 0x7f473015c470 2023-12-24T19:58:02.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.337+0000 7f4736d80700 1 -- 172.21.15.61:0/4009905788 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47300ce8f0 con 0x7f473015c470 2023-12-24T19:58:02.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.337+0000 7f472cff9700 1 -- 172.21.15.61:0/4009905788 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4728007300 con 0x7f473015c470 2023-12-24T19:58:02.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.338+0000 7f472cff9700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4714066f30 0x7f47140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.338+0000 7f472cff9700 1 -- 172.21.15.61:0/4009905788 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4728084920 con 0x7f473015c470 2023-12-24T19:58:02.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.338+0000 7f4734b1c700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4714066f30 0x7f47140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.338+0000 7f4734b1c700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4714066f30 0x7f47140693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f47300acab0 tx=0x7f4724008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:02.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.342+0000 7f472cff9700 1 -- 172.21.15.61:0/4009905788 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4728051c10 con 0x7f473015c470 2023-12-24T19:58:02.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.536+0000 7f4736d80700 1 -- 172.21.15.61:0/4009905788 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f473006d440 con 0x7f473015c470 2023-12-24T19:58:02.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.537+0000 7f472cff9700 1 -- 172.21.15.61:0/4009905788 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4728055230 con 0x7f473015c470 2023-12-24T19:58:02.537 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:02.537 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":31,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:57:59.508071+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:56.143696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:57.136484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:58:02.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.538+0000 7f4736d80700 1 -- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4714066f30 msgr2=0x7f47140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.538+0000 7f4736d80700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4714066f30 0x7f47140693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f47300acab0 tx=0x7f4724008040 comp rx=0 tx=0).stop 2023-12-24T19:58:02.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.538+0000 7f4736d80700 1 -- 172.21.15.61:0/4009905788 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f473015c470 msgr2=0x7f4730158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.538+0000 7f4736d80700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f473015c470 0x7f4730158600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f472800cc40 tx=0x7f4728001a40 comp rx=0 tx=0).stop 2023-12-24T19:58:02.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.538+0000 7f4736d80700 1 -- 172.21.15.61:0/4009905788 shutdown_connections 2023-12-24T19:58:02.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.538+0000 7f4736d80700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4730098aa0 0x7f473016dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.538+0000 7f4736d80700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4714066f30 0x7f47140693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.538+0000 7f4736d80700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f473015c470 0x7f4730158600 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.538+0000 7f4736d80700 1 --2- 172.21.15.61:0/4009905788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f473015bb60 0x7f473016b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.538+0000 7f4736d80700 1 -- 172.21.15.61:0/4009905788 >> 172.21.15.61:0/4009905788 conn(0x7f4730097a10 msgr2=0x7f47300a8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:02.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.539+0000 7f4736d80700 1 -- 172.21.15.61:0/4009905788 shutdown_connections 2023-12-24T19:58:02.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.539+0000 7f4736d80700 1 -- 172.21.15.61:0/4009905788 wait complete. 2023-12-24T19:58:02.551 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T19:58:02.551 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:58:02.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.672+0000 7ff6f7043700 1 Processor -- start 2023-12-24T19:58:02.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.672+0000 7ff6f7043700 1 -- start start 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6f7043700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff6f00afee0 0x7ff6f0067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6f7043700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f00a84d0 con 0x7ff6f0070640 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6f7043700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f00a7620 con 0x7ff6f0159b00 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6f7043700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f00a78c0 con 0x7ff6f00afee0 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6effff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff6f00afee0 0x7ff6f0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6f55e0700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff6f0070640 0x7ff6f015a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56678/0 (socket says 172.21.15.61:56678) 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6f55e0700 1 -- 172.21.15.61:0/2185883045 learned_addr learned my addr 172.21.15.61:0/2185883045 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6ef7fe700 1 -- 172.21.15.61:0/2185883045 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105838977 0 0) 0x7ff6f00a84d0 con 0x7ff6f0070640 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6ef7fe700 1 -- 172.21.15.61:0/2185883045 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e0003570 con 0x7ff6f0070640 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6effff700 1 -- 172.21.15.61:0/2185883045 >> v1:172.21.15.133:6789/0 conn(0x7ff6f0159b00 legacy=0x7ff6f00af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6ef7fe700 1 -- 172.21.15.61:0/2185883045 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358223009 0 0) 0x7ff6f00a7620 con 0x7ff6f0159b00 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6effff700 1 -- 172.21.15.61:0/2185883045 >> v1:172.21.15.61:6789/0 conn(0x7ff6f0070640 legacy=0x7ff6f015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.673+0000 7ff6effff700 1 -- 172.21.15.61:0/2185883045 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f00a7ba0 con 0x7ff6f00afee0 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6effff700 1 --2- 172.21.15.61:0/2185883045 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 0x7ff6f0067550 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0098e0 tx=0x7ff6dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511a0606429c6b2b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6ef7fe700 1 -- 172.21.15.61:0/2185883045 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc00b640 con 0x7ff6f00afee0 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6ef7fe700 1 -- 172.21.15.61:0/2185883045 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc00b7a0 con 0x7ff6f00afee0 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6ef7fe700 1 -- 172.21.15.61:0/2185883045 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc00bb40 con 0x7ff6f00afee0 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6f7043700 1 -- 172.21.15.61:0/2185883045 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 msgr2=0x7ff6f0067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6f7043700 1 --2- 172.21.15.61:0/2185883045 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 0x7ff6f0067550 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0098e0 tx=0x7ff6dc0091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6f7043700 1 -- 172.21.15.61:0/2185883045 shutdown_connections 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6f7043700 1 --2- 172.21.15.61:0/2185883045 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 0x7ff6f0067550 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6f7043700 1 -- 172.21.15.61:0/2185883045 >> 172.21.15.61:0/2185883045 conn(0x7ff6f00ca200 msgr2=0x7ff6f00ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6f7043700 1 -- 172.21.15.61:0/2185883045 shutdown_connections 2023-12-24T19:58:02.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.674+0000 7ff6f7043700 1 -- 172.21.15.61:0/2185883045 wait complete. 2023-12-24T19:58:02.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.676+0000 7ff6f7043700 1 Processor -- start 2023-12-24T19:58:02.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.676+0000 7ff6f7043700 1 -- start start 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6f7043700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6f0070640 0x7ff6f01535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6f7043700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 0x7ff6f0154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6f7043700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6f0159b00 0x7ff6f01547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6f7043700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f016d7d0 con 0x7ff6f00afee0 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6f7043700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f016e630 con 0x7ff6f0159b00 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6f7043700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f016da20 con 0x7ff6f0070640 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6effff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 0x7ff6f0154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6effff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 0x7ff6f0154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43416/0 (socket says 172.21.15.61:43416) 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6effff700 1 -- 172.21.15.61:0/2022569028 learned_addr learned my addr 172.21.15.61:0/2022569028 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6f4ddf700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6f0070640 0x7ff6f01535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6f55e0700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6f0159b00 0x7ff6f01547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6effff700 1 -- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6f0070640 msgr2=0x7ff6f01535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.677+0000 7ff6effff700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6f0070640 0x7ff6f01535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6effff700 1 -- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6f0159b00 msgr2=0x7ff6f01547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6effff700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6f0159b00 0x7ff6f01547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6effff700 1 -- 172.21.15.61:0/2022569028 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc009420 con 0x7ff6f00afee0 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6f55e0700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6f0159b00 0x7ff6f01547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6f4ddf700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6f0070640 0x7ff6f01535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6effff700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 0x7ff6f0154260 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc013000 tx=0x7ff6dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6ecff9700 1 -- 172.21.15.61:0/2022569028 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc01f070 con 0x7ff6f00afee0 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6ecff9700 1 -- 172.21.15.61:0/2022569028 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc000c90 con 0x7ff6f00afee0 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6f7043700 1 -- 172.21.15.61:0/2022569028 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f016dd00 con 0x7ff6f00afee0 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6ecff9700 1 -- 172.21.15.61:0/2022569028 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc00bb40 con 0x7ff6f00afee0 2023-12-24T19:58:02.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.678+0000 7ff6f7043700 1 -- 172.21.15.61:0/2022569028 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f016e2c0 con 0x7ff6f00afee0 2023-12-24T19:58:02.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.679+0000 7ff6f7043700 1 -- 172.21.15.61:0/2022569028 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f004c3c0 con 0x7ff6f00afee0 2023-12-24T19:58:02.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.679+0000 7ff6ecff9700 1 -- 172.21.15.61:0/2022569028 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff6dc023070 con 0x7ff6f00afee0 2023-12-24T19:58:02.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.680+0000 7ff6ecff9700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff6d4066f30 0x7ff6d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:02.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.680+0000 7ff6ecff9700 1 -- 172.21.15.61:0/2022569028 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff6dc0859e0 con 0x7ff6f00afee0 2023-12-24T19:58:02.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.680+0000 7ff6f4ddf700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff6d4066f30 0x7ff6d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:02.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.680+0000 7ff6f4ddf700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff6d4066f30 0x7ff6d40693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4001820 tx=0x7ff6e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:02.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.684+0000 7ff6ecff9700 1 -- 172.21.15.61:0/2022569028 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6dc052bb0 con 0x7ff6f00afee0 2023-12-24T19:58:02.738 INFO:tasks.ceph.mds.c.smithi061.stderr:2023-12-24T19:58:02.738+0000 7f8e84710700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T19:58:02.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.878+0000 7ff6f7043700 1 -- 172.21.15.61:0/2022569028 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6f016e7a0 con 0x7ff6d4066f30 2023-12-24T19:58:02.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.888+0000 7ff6ecff9700 1 -- 172.21.15.61:0/2022569028 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284808 (secure 0 0 0) 0x7ff6f016e7a0 con 0x7ff6d4066f30 2023-12-24T19:58:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:02.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 -- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff6d4066f30 msgr2=0x7ff6d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff6d4066f30 0x7ff6d40693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4001820 tx=0x7ff6e4009040 comp rx=0 tx=0).stop 2023-12-24T19:58:02.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 -- 172.21.15.61:0/2022569028 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 msgr2=0x7ff6f0154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:02.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 0x7ff6f0154260 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc013000 tx=0x7ff6dc017000 comp rx=0 tx=0).stop 2023-12-24T19:58:02.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 -- 172.21.15.61:0/2022569028 shutdown_connections 2023-12-24T19:58:02.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff6f0070640 0x7ff6f01535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff6d4066f30 0x7ff6d40693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6f0159b00 0x7ff6f01547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 --2- 172.21.15.61:0/2022569028 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff6f00afee0 0x7ff6f0154260 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:02.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 -- 172.21.15.61:0/2022569028 >> 172.21.15.61:0/2022569028 conn(0x7ff6f00ca200 msgr2=0x7ff6f0067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:02.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 -- 172.21.15.61:0/2022569028 shutdown_connections 2023-12-24T19:58:02.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:02.891+0000 7ff6f7043700 1 -- 172.21.15.61:0/2022569028 wait complete. 2023-12-24T19:58:02.895 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:58:02.903 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-12-24T19:58:02.321298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2176,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560323,"statfs":{"total":1600000000,"available":1597771372,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.576625"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.517205+0000","last_change":"2023-12-24T19:57:58.517130+0000","last_active":"2023-12-24T19:57:58.517205+0000","last_peered":"2023-12-24T19:57:58.517205+0000","last_clean":"2023-12-24T19:57:58.517205+0000","last_became_active":"2023-12-24T19:57:58.516901+0000","last_became_peered":"2023-12-24T19:57:58.516901+0000","last_unstale":"2023-12-24T19:57:58.517205+0000","last_undegraded":"2023-12-24T19:57:58.517205+0000","last_fullsized":"2023-12-24T19:57:58.517205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:57:01.832245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518851+0000","last_change":"2023-12-24T19:57:58.518708+0000","last_active":"2023-12-24T19:57:58.518851+0000","last_peered":"2023-12-24T19:57:58.518851+0000","last_clean":"2023-12-24T19:57:58.518851+0000","last_became_active":"2023-12-24T19:57:58.518472+0000","last_became_peered":"2023-12-24T19:57:58.518472+0000","last_unstale":"2023-12-24T19:57:58.518851+0000","last_undegraded":"2023-12-24T19:57:58.518851+0000","last_fullsized":"2023-12-24T19:57:58.518851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:47:21.652003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514482+0000","last_change":"2023-12-24T19:57:58.514391+0000","last_active":"2023-12-24T19:57:58.514482+0000","last_peered":"2023-12-24T19:57:58.514482+0000","last_clean":"2023-12-24T19:57:58.514482+0000","last_became_active":"2023-12-24T19:57:58.513985+0000","last_became_peered":"2023-12-24T19:57:58.513985+0000","last_unstale":"2023-12-24T19:57:58.514482+0000","last_undegraded":"2023-12-24T19:57:58.514482+0000","last_fullsized":"2023-12-24T19:57:58.514482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:02.074503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.522457+0000","last_change":"2023-12-24T19:57:58.522413+0000","last_active":"2023-12-24T19:57:58.522457+0000","last_peered":"2023-12-24T19:57:58.522457+0000","last_clean":"2023-12-24T19:57:58.522457+0000","last_became_active":"2023-12-24T19:57:58.522079+0000","last_became_peered":"2023-12-24T19:57:58.522079+0000","last_unstale":"2023-12-24T19:57:58.522457+0000","last_undegraded":"2023-12-24T19:57:58.522457+0000","last_fullsized":"2023-12-24T19:57:58.522457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:02.701078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518772+0000","last_change":"2023-12-24T19:57:58.518709+0000","last_active":"2023-12-24T19:57:58.518772+0000","last_peered":"2023-12-24T19:57:58.518772+0000","last_clean":"2023-12-24T19:57:58.518772+0000","last_became_active":"2023-12-24T19:57:58.518381+0000","last_became_peered":"2023-12-24T19:57:58.518381+0000","last_unstale":"2023-12-24T19:57:58.518772+0000","last_undegraded":"2023-12-24T19:57:58.518772+0000","last_fullsized":"2023-12-24T19:57:58.518772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:14:01.154512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.522572+0000","last_change":"2023-12-24T19:57:58.522521+0000","last_active":"2023-12-24T19:57:58.522572+0000","last_peered":"2023-12-24T19:57:58.522572+0000","last_clean":"2023-12-24T19:57:58.522572+0000","last_became_active":"2023-12-24T19:57:58.522253+0000","last_became_peered":"2023-12-24T19:57:58.522253+0000","last_unstale":"2023-12-24T19:57:58.522572+0000","last_undegraded":"2023-12-24T19:57:58.522572+0000","last_fullsized":"2023-12-24T19:57:58.522572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:18.240578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521346+0000","last_change":"2023-12-24T19:57:58.521277+0000","last_active":"2023-12-24T19:57:58.521346+0000","last_peered":"2023-12-24T19:57:58.521346+0000","last_clean":"2023-12-24T19:57:58.521346+0000","last_became_active":"2023-12-24T19:57:58.520614+0000","last_became_peered":"2023-12-24T19:57:58.520614+0000","last_unstale":"2023-12-24T19:57:58.521346+0000","last_undegraded":"2023-12-24T19:57:58.521346+0000","last_fullsized":"2023-12-24T19:57:58.521346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:39.765581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.526278+0000","last_change":"2023-12-24T19:57:58.523674+0000","last_active":"2023-12-24T19:57:58.526278+0000","last_peered":"2023-12-24T19:57:58.526278+0000","last_clean":"2023-12-24T19:57:58.526278+0000","last_became_active":"2023-12-24T19:57:58.522220+0000","last_became_peered":"2023-12-24T19:57:58.522220+0000","last_unstale":"2023-12-24T19:57:58.526278+0000","last_undegraded":"2023-12-24T19:57:58.526278+0000","last_fullsized":"2023-12-24T19:57:58.526278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:59.151270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523970+0000","last_change":"2023-12-24T19:57:58.521681+0000","last_active":"2023-12-24T19:57:58.523970+0000","last_peered":"2023-12-24T19:57:58.523970+0000","last_clean":"2023-12-24T19:57:58.523970+0000","last_became_active":"2023-12-24T19:57:58.521408+0000","last_became_peered":"2023-12-24T19:57:58.521408+0000","last_unstale":"2023-12-24T19:57:58.523970+0000","last_undegraded":"2023-12-24T19:57:58.523970+0000","last_fullsized":"2023-12-24T19:57:58.523970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:37.069464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518466+0000","last_change":"2023-12-24T19:57:58.518318+0000","last_active":"2023-12-24T19:57:58.518466+0000","last_peered":"2023-12-24T19:57:58.518466+0000","last_clean":"2023-12-24T19:57:58.518466+0000","last_became_active":"2023-12-24T19:57:58.518095+0000","last_became_peered":"2023-12-24T19:57:58.518095+0000","last_unstale":"2023-12-24T19:57:58.518466+0000","last_undegraded":"2023-12-24T19:57:58.518466+0000","last_fullsized":"2023-12-24T19:57:58.518466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:27.726827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520149+0000","last_change":"2023-12-24T19:57:58.520044+0000","last_active":"2023-12-24T19:57:58.520149+0000","last_peered":"2023-12-24T19:57:58.520149+0000","last_clean":"2023-12-24T19:57:58.520149+0000","last_became_active":"2023-12-24T19:57:58.519727+0000","last_became_peered":"2023-12-24T19:57:58.519727+0000","last_unstale":"2023-12-24T19:57:58.520149+0000","last_undegraded":"2023-12-24T19:57:58.520149+0000","last_fullsized":"2023-12-24T19:57:58.520149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:31:00.573397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520302+0000","last_change":"2023-12-24T19:57:58.520003+0000","last_active":"2023-12-24T19:57:58.520302+0000","last_peered":"2023-12-24T19:57:58.520302+0000","last_clean":"2023-12-24T19:57:58.520302+0000","last_became_active":"2023-12-24T19:57:58.519638+0000","last_became_peered":"2023-12-24T19:57:58.519638+0000","last_unstale":"2023-12-24T19:57:58.520302+0000","last_undegraded":"2023-12-24T19:57:58.520302+0000","last_fullsized":"2023-12-24T19:57:58.520302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:59.151270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514379+0000","last_change":"2023-12-24T19:57:58.514290+0000","last_active":"2023-12-24T19:57:58.514379+0000","last_peered":"2023-12-24T19:57:58.514379+0000","last_clean":"2023-12-24T19:57:58.514379+0000","last_became_active":"2023-12-24T19:57:58.513905+0000","last_became_peered":"2023-12-24T19:57:58.513905+0000","last_unstale":"2023-12-24T19:57:58.514379+0000","last_undegraded":"2023-12-24T19:57:58.514379+0000","last_fullsized":"2023-12-24T19:57:58.514379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:24.858624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521471+0000","last_change":"2023-12-24T19:57:58.521034+0000","last_active":"2023-12-24T19:57:58.521471+0000","last_peered":"2023-12-24T19:57:58.521471+0000","last_clean":"2023-12-24T19:57:58.521471+0000","last_became_active":"2023-12-24T19:57:58.519611+0000","last_became_peered":"2023-12-24T19:57:58.519611+0000","last_unstale":"2023-12-24T19:57:58.521471+0000","last_undegraded":"2023-12-24T19:57:58.521471+0000","last_fullsized":"2023-12-24T19:57:58.521471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:31:00.573397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514848+0000","last_change":"2023-12-24T19:57:58.514756+0000","last_active":"2023-12-24T19:57:58.514848+0000","last_peered":"2023-12-24T19:57:58.514848+0000","last_clean":"2023-12-24T19:57:58.514848+0000","last_became_active":"2023-12-24T19:57:58.514491+0000","last_became_peered":"2023-12-24T19:57:58.514491+0000","last_unstale":"2023-12-24T19:57:58.514848+0000","last_undegraded":"2023-12-24T19:57:58.514848+0000","last_fullsized":"2023-12-24T19:57:58.514848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:20:19.721200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.528059+0000","last_change":"2023-12-24T19:57:58.527978+0000","last_active":"2023-12-24T19:57:58.528059+0000","last_peered":"2023-12-24T19:57:58.528059+0000","last_clean":"2023-12-24T19:57:58.528059+0000","last_became_active":"2023-12-24T19:57:58.527556+0000","last_became_peered":"2023-12-24T19:57:58.527556+0000","last_unstale":"2023-12-24T19:57:58.528059+0000","last_undegraded":"2023-12-24T19:57:58.528059+0000","last_fullsized":"2023-12-24T19:57:58.528059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:51.125001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521464+0000","last_change":"2023-12-24T19:57:58.521413+0000","last_active":"2023-12-24T19:57:58.521464+0000","last_peered":"2023-12-24T19:57:58.521464+0000","last_clean":"2023-12-24T19:57:58.521464+0000","last_became_active":"2023-12-24T19:57:58.520963+0000","last_became_peered":"2023-12-24T19:57:58.520963+0000","last_unstale":"2023-12-24T19:57:58.521464+0000","last_undegraded":"2023-12-24T19:57:58.521464+0000","last_fullsized":"2023-12-24T19:57:58.521464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:18.240578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518032+0000","last_change":"2023-12-24T19:57:58.517940+0000","last_active":"2023-12-24T19:57:58.518032+0000","last_peered":"2023-12-24T19:57:58.518032+0000","last_clean":"2023-12-24T19:57:58.518032+0000","last_became_active":"2023-12-24T19:57:58.517700+0000","last_became_peered":"2023-12-24T19:57:58.517700+0000","last_unstale":"2023-12-24T19:57:58.518032+0000","last_undegraded":"2023-12-24T19:57:58.518032+0000","last_fullsized":"2023-12-24T19:57:58.518032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:27.726827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521513+0000","last_change":"2023-12-24T19:57:58.521222+0000","last_active":"2023-12-24T19:57:58.521513+0000","last_peered":"2023-12-24T19:57:58.521513+0000","last_clean":"2023-12-24T19:57:58.521513+0000","last_became_active":"2023-12-24T19:57:58.519946+0000","last_became_peered":"2023-12-24T19:57:58.519946+0000","last_unstale":"2023-12-24T19:57:58.521513+0000","last_undegraded":"2023-12-24T19:57:58.521513+0000","last_fullsized":"2023-12-24T19:57:58.521513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:02.074503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.512552+0000","last_change":"2023-12-24T19:57:58.512263+0000","last_active":"2023-12-24T19:57:58.512552+0000","last_peered":"2023-12-24T19:57:58.512552+0000","last_clean":"2023-12-24T19:57:58.512552+0000","last_became_active":"2023-12-24T19:57:58.512016+0000","last_became_peered":"2023-12-24T19:57:58.512016+0000","last_unstale":"2023-12-24T19:57:58.512552+0000","last_undegraded":"2023-12-24T19:57:58.512552+0000","last_fullsized":"2023-12-24T19:57:58.512552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:36.935252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525778+0000","last_change":"2023-12-24T19:57:58.525121+0000","last_active":"2023-12-24T19:57:58.525778+0000","last_peered":"2023-12-24T19:57:58.525778+0000","last_clean":"2023-12-24T19:57:58.525778+0000","last_became_active":"2023-12-24T19:57:58.524694+0000","last_became_peered":"2023-12-24T19:57:58.524694+0000","last_unstale":"2023-12-24T19:57:58.525778+0000","last_undegraded":"2023-12-24T19:57:58.525778+0000","last_fullsized":"2023-12-24T19:57:58.525778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:41.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525072+0000","last_change":"2023-12-24T19:57:58.525013+0000","last_active":"2023-12-24T19:57:58.525072+0000","last_peered":"2023-12-24T19:57:58.525072+0000","last_clean":"2023-12-24T19:57:58.525072+0000","last_became_active":"2023-12-24T19:57:58.524509+0000","last_became_peered":"2023-12-24T19:57:58.524509+0000","last_unstale":"2023-12-24T19:57:58.525072+0000","last_undegraded":"2023-12-24T19:57:58.525072+0000","last_fullsized":"2023-12-24T19:57:58.525072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:57:01.832245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.517849+0000","last_change":"2023-12-24T19:57:58.517787+0000","last_active":"2023-12-24T19:57:58.517849+0000","last_peered":"2023-12-24T19:57:58.517849+0000","last_clean":"2023-12-24T19:57:58.517849+0000","last_became_active":"2023-12-24T19:57:58.517510+0000","last_became_peered":"2023-12-24T19:57:58.517510+0000","last_unstale":"2023-12-24T19:57:58.517849+0000","last_undegraded":"2023-12-24T19:57:58.517849+0000","last_fullsized":"2023-12-24T19:57:58.517849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:08.035263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.512368+0000","last_change":"2023-12-24T19:57:58.512300+0000","last_active":"2023-12-24T19:57:58.512368+0000","last_peered":"2023-12-24T19:57:58.512368+0000","last_clean":"2023-12-24T19:57:58.512368+0000","last_became_active":"2023-12-24T19:57:58.512059+0000","last_became_peered":"2023-12-24T19:57:58.512059+0000","last_unstale":"2023-12-24T19:57:58.512368+0000","last_undegraded":"2023-12-24T19:57:58.512368+0000","last_fullsized":"2023-12-24T19:57:58.512368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:27.726827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520330+0000","last_change":"2023-12-24T19:57:58.520277+0000","last_active":"2023-12-24T19:57:58.520330+0000","last_peered":"2023-12-24T19:57:58.520330+0000","last_clean":"2023-12-24T19:57:58.520330+0000","last_became_active":"2023-12-24T19:57:58.520057+0000","last_became_peered":"2023-12-24T19:57:58.520057+0000","last_unstale":"2023-12-24T19:57:58.520330+0000","last_undegraded":"2023-12-24T19:57:58.520330+0000","last_fullsized":"2023-12-24T19:57:58.520330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:42.434307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.522459+0000","last_change":"2023-12-24T19:57:58.522397+0000","last_active":"2023-12-24T19:57:58.522459+0000","last_peered":"2023-12-24T19:57:58.522459+0000","last_clean":"2023-12-24T19:57:58.522459+0000","last_became_active":"2023-12-24T19:57:58.521951+0000","last_became_peered":"2023-12-24T19:57:58.521951+0000","last_unstale":"2023-12-24T19:57:58.522459+0000","last_undegraded":"2023-12-24T19:57:58.522459+0000","last_fullsized":"2023-12-24T19:57:58.522459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:42.515021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525884+0000","last_change":"2023-12-24T19:57:58.525814+0000","last_active":"2023-12-24T19:57:58.525884+0000","last_peered":"2023-12-24T19:57:58.525884+0000","last_clean":"2023-12-24T19:57:58.525884+0000","last_became_active":"2023-12-24T19:57:58.525410+0000","last_became_peered":"2023-12-24T19:57:58.525410+0000","last_unstale":"2023-12-24T19:57:58.525884+0000","last_undegraded":"2023-12-24T19:57:58.525884+0000","last_fullsized":"2023-12-24T19:57:58.525884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:01:02.919958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.519136+0000","last_change":"2023-12-24T19:57:58.519040+0000","last_active":"2023-12-24T19:57:58.519136+0000","last_peered":"2023-12-24T19:57:58.519136+0000","last_clean":"2023-12-24T19:57:58.519136+0000","last_became_active":"2023-12-24T19:57:58.518721+0000","last_became_peered":"2023-12-24T19:57:58.518721+0000","last_unstale":"2023-12-24T19:57:58.519136+0000","last_undegraded":"2023-12-24T19:57:58.519136+0000","last_fullsized":"2023-12-24T19:57:58.519136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:02.701078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.526250+0000","last_change":"2023-12-24T19:57:58.526179+0000","last_active":"2023-12-24T19:57:58.526250+0000","last_peered":"2023-12-24T19:57:58.526250+0000","last_clean":"2023-12-24T19:57:58.526250+0000","last_became_active":"2023-12-24T19:57:58.525741+0000","last_became_peered":"2023-12-24T19:57:58.525741+0000","last_unstale":"2023-12-24T19:57:58.526250+0000","last_undegraded":"2023-12-24T19:57:58.526250+0000","last_fullsized":"2023-12-24T19:57:58.526250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:27.726129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523001+0000","last_change":"2023-12-24T19:57:58.522725+0000","last_active":"2023-12-24T19:57:58.523001+0000","last_peered":"2023-12-24T19:57:58.523001+0000","last_clean":"2023-12-24T19:57:58.523001+0000","last_became_active":"2023-12-24T19:57:58.522134+0000","last_became_peered":"2023-12-24T19:57:58.522134+0000","last_unstale":"2023-12-24T19:57:58.523001+0000","last_undegraded":"2023-12-24T19:57:58.523001+0000","last_fullsized":"2023-12-24T19:57:58.523001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:42.515021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520654+0000","last_change":"2023-12-24T19:57:58.520587+0000","last_active":"2023-12-24T19:57:58.520654+0000","last_peered":"2023-12-24T19:57:58.520654+0000","last_clean":"2023-12-24T19:57:58.520654+0000","last_became_active":"2023-12-24T19:57:58.520344+0000","last_became_peered":"2023-12-24T19:57:58.520344+0000","last_unstale":"2023-12-24T19:57:58.520654+0000","last_undegraded":"2023-12-24T19:57:58.520654+0000","last_fullsized":"2023-12-24T19:57:58.520654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:27.726129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.526917+0000","last_change":"2023-12-24T19:57:58.526823+0000","last_active":"2023-12-24T19:57:58.526917+0000","last_peered":"2023-12-24T19:57:58.526917+0000","last_clean":"2023-12-24T19:57:58.526917+0000","last_became_active":"2023-12-24T19:57:58.526590+0000","last_became_peered":"2023-12-24T19:57:58.526590+0000","last_unstale":"2023-12-24T19:57:58.526917+0000","last_undegraded":"2023-12-24T19:57:58.526917+0000","last_fullsized":"2023-12-24T19:57:58.526917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:20:19.721200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.517253+0000","last_change":"2023-12-24T19:57:58.517188+0000","last_active":"2023-12-24T19:57:58.517253+0000","last_peered":"2023-12-24T19:57:58.517253+0000","last_clean":"2023-12-24T19:57:58.517253+0000","last_became_active":"2023-12-24T19:57:58.516967+0000","last_became_peered":"2023-12-24T19:57:58.516967+0000","last_unstale":"2023-12-24T19:57:58.517253+0000","last_undegraded":"2023-12-24T19:57:58.517253+0000","last_fullsized":"2023-12-24T19:57:58.517253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:05.595141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.780601+0000","last_change":"2023-12-24T19:57:57.760090+0000","last_active":"2023-12-24T19:57:58.780601+0000","last_peered":"2023-12-24T19:57:58.780601+0000","last_clean":"2023-12-24T19:57:58.780601+0000","last_became_active":"2023-12-24T19:57:57.759215+0000","last_became_peered":"2023-12-24T19:57:57.759215+0000","last_unstale":"2023-12-24T19:57:58.780601+0000","last_undegraded":"2023-12-24T19:57:58.780601+0000","last_fullsized":"2023-12-24T19:57:58.780601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:53.813406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518008+0000","last_change":"2023-12-24T19:57:58.517926+0000","last_active":"2023-12-24T19:57:58.518008+0000","last_peered":"2023-12-24T19:57:58.518008+0000","last_clean":"2023-12-24T19:57:58.518008+0000","last_became_active":"2023-12-24T19:57:58.517663+0000","last_became_peered":"2023-12-24T19:57:58.517663+0000","last_unstale":"2023-12-24T19:57:58.518008+0000","last_undegraded":"2023-12-24T19:57:58.518008+0000","last_fullsized":"2023-12-24T19:57:58.518008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:20:45.757755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.778611+0000","last_change":"2023-12-24T19:57:57.758463+0000","last_active":"2023-12-24T19:57:58.778611+0000","last_peered":"2023-12-24T19:57:58.778611+0000","last_clean":"2023-12-24T19:57:58.778611+0000","last_became_active":"2023-12-24T19:57:57.758233+0000","last_became_peered":"2023-12-24T19:57:57.758233+0000","last_unstale":"2023-12-24T19:57:58.778611+0000","last_undegraded":"2023-12-24T19:57:58.778611+0000","last_fullsized":"2023-12-24T19:57:58.778611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:51.245549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525043+0000","last_change":"2023-12-24T19:57:58.524938+0000","last_active":"2023-12-24T19:57:58.525043+0000","last_peered":"2023-12-24T19:57:58.525043+0000","last_clean":"2023-12-24T19:57:58.525043+0000","last_became_active":"2023-12-24T19:57:58.524379+0000","last_became_peered":"2023-12-24T19:57:58.524379+0000","last_unstale":"2023-12-24T19:57:58.525043+0000","last_undegraded":"2023-12-24T19:57:58.525043+0000","last_fullsized":"2023-12-24T19:57:58.525043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:42:19.167753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.781280+0000","last_change":"2023-12-24T19:57:57.755534+0000","last_active":"2023-12-24T19:57:58.781280+0000","last_peered":"2023-12-24T19:57:58.781280+0000","last_clean":"2023-12-24T19:57:58.781280+0000","last_became_active":"2023-12-24T19:57:57.755041+0000","last_became_peered":"2023-12-24T19:57:57.755041+0000","last_unstale":"2023-12-24T19:57:58.781280+0000","last_undegraded":"2023-12-24T19:57:58.781280+0000","last_fullsized":"2023-12-24T19:57:58.781280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:40:31.820818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.517206+0000","last_change":"2023-12-24T19:57:58.517142+0000","last_active":"2023-12-24T19:57:58.517206+0000","last_peered":"2023-12-24T19:57:58.517206+0000","last_clean":"2023-12-24T19:57:58.517206+0000","last_became_active":"2023-12-24T19:57:58.516899+0000","last_became_peered":"2023-12-24T19:57:58.516899+0000","last_unstale":"2023-12-24T19:57:58.517206+0000","last_undegraded":"2023-12-24T19:57:58.517206+0000","last_fullsized":"2023-12-24T19:57:58.517206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:08.199656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.779797+0000","last_change":"2023-12-24T19:57:57.754946+0000","last_active":"2023-12-24T19:57:58.779797+0000","last_peered":"2023-12-24T19:57:58.779797+0000","last_clean":"2023-12-24T19:57:58.779797+0000","last_became_active":"2023-12-24T19:57:57.754691+0000","last_became_peered":"2023-12-24T19:57:57.754691+0000","last_unstale":"2023-12-24T19:57:58.779797+0000","last_undegraded":"2023-12-24T19:57:58.779797+0000","last_fullsized":"2023-12-24T19:57:58.779797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:33.995091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.526426+0000","last_change":"2023-12-24T19:57:58.526361+0000","last_active":"2023-12-24T19:57:58.526426+0000","last_peered":"2023-12-24T19:57:58.526426+0000","last_clean":"2023-12-24T19:57:58.526426+0000","last_became_active":"2023-12-24T19:57:58.523442+0000","last_became_peered":"2023-12-24T19:57:58.523442+0000","last_unstale":"2023-12-24T19:57:58.526426+0000","last_undegraded":"2023-12-24T19:57:58.526426+0000","last_fullsized":"2023-12-24T19:57:58.526426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:27.726827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.781320+0000","last_change":"2023-12-24T19:57:57.759223+0000","last_active":"2023-12-24T19:57:58.781320+0000","last_peered":"2023-12-24T19:57:58.781320+0000","last_clean":"2023-12-24T19:57:58.781320+0000","last_became_active":"2023-12-24T19:57:57.758815+0000","last_became_peered":"2023-12-24T19:57:57.758815+0000","last_unstale":"2023-12-24T19:57:58.781320+0000","last_undegraded":"2023-12-24T19:57:58.781320+0000","last_fullsized":"2023-12-24T19:57:58.781320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:35.928823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.512253+0000","last_change":"2023-12-24T19:57:58.512177+0000","last_active":"2023-12-24T19:57:58.512253+0000","last_peered":"2023-12-24T19:57:58.512253+0000","last_clean":"2023-12-24T19:57:58.512253+0000","last_became_active":"2023-12-24T19:57:58.511889+0000","last_became_peered":"2023-12-24T19:57:58.511889+0000","last_unstale":"2023-12-24T19:57:58.512253+0000","last_undegraded":"2023-12-24T19:57:58.512253+0000","last_fullsized":"2023-12-24T19:57:58.512253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:42.434307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.781485+0000","last_change":"2023-12-24T19:57:57.754559+0000","last_active":"2023-12-24T19:57:58.781485+0000","last_peered":"2023-12-24T19:57:58.781485+0000","last_clean":"2023-12-24T19:57:58.781485+0000","last_became_active":"2023-12-24T19:57:57.753910+0000","last_became_peered":"2023-12-24T19:57:57.753910+0000","last_unstale":"2023-12-24T19:57:58.781485+0000","last_undegraded":"2023-12-24T19:57:58.781485+0000","last_fullsized":"2023-12-24T19:57:58.781485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:06:50.611506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523850+0000","last_change":"2023-12-24T19:57:58.521533+0000","last_active":"2023-12-24T19:57:58.523850+0000","last_peered":"2023-12-24T19:57:58.523850+0000","last_clean":"2023-12-24T19:57:58.523850+0000","last_became_active":"2023-12-24T19:57:58.520911+0000","last_became_peered":"2023-12-24T19:57:58.520911+0000","last_unstale":"2023-12-24T19:57:58.523850+0000","last_undegraded":"2023-12-24T19:57:58.523850+0000","last_fullsized":"2023-12-24T19:57:58.523850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:17:45.293694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.515664+0000","last_change":"2023-12-24T19:57:57.755198+0000","last_active":"2023-12-24T19:57:58.515664+0000","last_peered":"2023-12-24T19:57:58.515664+0000","last_clean":"2023-12-24T19:57:58.515664+0000","last_became_active":"2023-12-24T19:57:57.754578+0000","last_became_peered":"2023-12-24T19:57:57.754578+0000","last_unstale":"2023-12-24T19:57:58.515664+0000","last_undegraded":"2023-12-24T19:57:58.515664+0000","last_fullsized":"2023-12-24T19:57:58.515664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:57:00.825816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521269+0000","last_change":"2023-12-24T19:57:58.521096+0000","last_active":"2023-12-24T19:57:58.521269+0000","last_peered":"2023-12-24T19:57:58.521269+0000","last_clean":"2023-12-24T19:57:58.521269+0000","last_became_active":"2023-12-24T19:57:58.520881+0000","last_became_peered":"2023-12-24T19:57:58.520881+0000","last_unstale":"2023-12-24T19:57:58.521269+0000","last_undegraded":"2023-12-24T19:57:58.521269+0000","last_fullsized":"2023-12-24T19:57:58.521269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:29:26.157021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.515854+0000","last_change":"2023-12-24T19:57:57.761999+0000","last_active":"2023-12-24T19:57:58.515854+0000","last_peered":"2023-12-24T19:57:58.515854+0000","last_clean":"2023-12-24T19:57:58.515854+0000","last_became_active":"2023-12-24T19:57:57.760804+0000","last_became_peered":"2023-12-24T19:57:57.760804+0000","last_unstale":"2023-12-24T19:57:58.515854+0000","last_undegraded":"2023-12-24T19:57:58.515854+0000","last_fullsized":"2023-12-24T19:57:58.515854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:23.852195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520281+0000","last_change":"2023-12-24T19:57:58.519857+0000","last_active":"2023-12-24T19:57:58.520281+0000","last_peered":"2023-12-24T19:57:58.520281+0000","last_clean":"2023-12-24T19:57:58.520281+0000","last_became_active":"2023-12-24T19:57:58.519312+0000","last_became_peered":"2023-12-24T19:57:58.519312+0000","last_unstale":"2023-12-24T19:57:58.520281+0000","last_undegraded":"2023-12-24T19:57:58.520281+0000","last_fullsized":"2023-12-24T19:57:58.520281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:31:00.573397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.516615+0000","last_change":"2023-12-24T19:57:57.759247+0000","last_active":"2023-12-24T19:57:58.516615+0000","last_peered":"2023-12-24T19:57:58.516615+0000","last_clean":"2023-12-24T19:57:58.516615+0000","last_became_active":"2023-12-24T19:57:57.759082+0000","last_became_peered":"2023-12-24T19:57:57.759082+0000","last_unstale":"2023-12-24T19:57:58.516615+0000","last_undegraded":"2023-12-24T19:57:58.516615+0000","last_fullsized":"2023-12-24T19:57:58.516615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:26.719700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521534+0000","last_change":"2023-12-24T19:57:58.521362+0000","last_active":"2023-12-24T19:57:58.521534+0000","last_peered":"2023-12-24T19:57:58.521534+0000","last_clean":"2023-12-24T19:57:58.521534+0000","last_became_active":"2023-12-24T19:57:58.520770+0000","last_became_peered":"2023-12-24T19:57:58.520770+0000","last_unstale":"2023-12-24T19:57:58.521534+0000","last_undegraded":"2023-12-24T19:57:58.521534+0000","last_fullsized":"2023-12-24T19:57:58.521534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:39.765581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.508967+0000","last_change":"2023-12-24T19:57:57.757771+0000","last_active":"2023-12-24T19:57:58.508967+0000","last_peered":"2023-12-24T19:57:58.508967+0000","last_clean":"2023-12-24T19:57:58.508967+0000","last_became_active":"2023-12-24T19:57:57.757535+0000","last_became_peered":"2023-12-24T19:57:57.757535+0000","last_unstale":"2023-12-24T19:57:58.508967+0000","last_undegraded":"2023-12-24T19:57:58.508967+0000","last_fullsized":"2023-12-24T19:57:58.508967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:22:40.100390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521549+0000","last_change":"2023-12-24T19:57:58.521378+0000","last_active":"2023-12-24T19:57:58.521549+0000","last_peered":"2023-12-24T19:57:58.521549+0000","last_clean":"2023-12-24T19:57:58.521549+0000","last_became_active":"2023-12-24T19:57:58.520817+0000","last_became_peered":"2023-12-24T19:57:58.520817+0000","last_unstale":"2023-12-24T19:57:58.521549+0000","last_undegraded":"2023-12-24T19:57:58.521549+0000","last_fullsized":"2023-12-24T19:57:58.521549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:51.125001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.780538+0000","last_change":"2023-12-24T19:57:57.758289+0000","last_active":"2023-12-24T19:57:58.780538+0000","last_peered":"2023-12-24T19:57:58.780538+0000","last_clean":"2023-12-24T19:57:58.780538+0000","last_became_active":"2023-12-24T19:57:57.758033+0000","last_became_peered":"2023-12-24T19:57:57.758033+0000","last_unstale":"2023-12-24T19:57:58.780538+0000","last_undegraded":"2023-12-24T19:57:58.780538+0000","last_fullsized":"2023-12-24T19:57:58.780538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:39.987950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514462+0000","last_change":"2023-12-24T19:57:58.514222+0000","last_active":"2023-12-24T19:57:58.514462+0000","last_peered":"2023-12-24T19:57:58.514462+0000","last_clean":"2023-12-24T19:57:58.514462+0000","last_became_active":"2023-12-24T19:57:58.513668+0000","last_became_peered":"2023-12-24T19:57:58.513668+0000","last_unstale":"2023-12-24T19:57:58.514462+0000","last_undegraded":"2023-12-24T19:57:58.514462+0000","last_fullsized":"2023-12-24T19:57:58.514462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:51.125001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.784399+0000","last_change":"2023-12-24T19:57:57.755036+0000","last_active":"2023-12-24T19:57:58.784399+0000","last_peered":"2023-12-24T19:57:58.784399+0000","last_clean":"2023-12-24T19:57:58.784399+0000","last_became_active":"2023-12-24T19:57:57.754056+0000","last_became_peered":"2023-12-24T19:57:57.754056+0000","last_unstale":"2023-12-24T19:57:58.784399+0000","last_undegraded":"2023-12-24T19:57:58.784399+0000","last_fullsized":"2023-12-24T19:57:58.784399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:04.588712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.516246+0000","last_change":"2023-12-24T19:57:58.515747+0000","last_active":"2023-12-24T19:57:58.516246+0000","last_peered":"2023-12-24T19:57:58.516246+0000","last_clean":"2023-12-24T19:57:58.516246+0000","last_became_active":"2023-12-24T19:57:58.515515+0000","last_became_peered":"2023-12-24T19:57:58.515515+0000","last_unstale":"2023-12-24T19:57:58.516246+0000","last_undegraded":"2023-12-24T19:57:58.516246+0000","last_fullsized":"2023-12-24T19:57:58.516246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:17:45.293694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.779911+0000","last_change":"2023-12-24T19:57:57.761814+0000","last_active":"2023-12-24T19:57:58.779911+0000","last_peered":"2023-12-24T19:57:58.779911+0000","last_clean":"2023-12-24T19:57:58.779911+0000","last_became_active":"2023-12-24T19:57:57.760466+0000","last_became_peered":"2023-12-24T19:57:57.760466+0000","last_unstale":"2023-12-24T19:57:58.779911+0000","last_undegraded":"2023-12-24T19:57:58.779911+0000","last_fullsized":"2023-12-24T19:57:58.779911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:08:37.588856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518005+0000","last_change":"2023-12-24T19:57:58.517397+0000","last_active":"2023-12-24T19:57:58.518005+0000","last_peered":"2023-12-24T19:57:58.518005+0000","last_clean":"2023-12-24T19:57:58.518005+0000","last_became_active":"2023-12-24T19:57:58.517158+0000","last_became_peered":"2023-12-24T19:57:58.517158+0000","last_unstale":"2023-12-24T19:57:58.518005+0000","last_undegraded":"2023-12-24T19:57:58.518005+0000","last_fullsized":"2023-12-24T19:57:58.518005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:59.151270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.513108+0000","last_change":"2023-12-24T19:57:57.760838+0000","last_active":"2023-12-24T19:57:58.513108+0000","last_peered":"2023-12-24T19:57:58.513108+0000","last_clean":"2023-12-24T19:57:58.513108+0000","last_became_active":"2023-12-24T19:57:57.760615+0000","last_became_peered":"2023-12-24T19:57:57.760615+0000","last_unstale":"2023-12-24T19:57:58.513108+0000","last_undegraded":"2023-12-24T19:57:58.513108+0000","last_fullsized":"2023-12-24T19:57:58.513108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:49.895852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.526301+0000","last_change":"2023-12-24T19:57:58.523849+0000","last_active":"2023-12-24T19:57:58.526301+0000","last_peered":"2023-12-24T19:57:58.526301+0000","last_clean":"2023-12-24T19:57:58.526301+0000","last_became_active":"2023-12-24T19:57:58.523096+0000","last_became_peered":"2023-12-24T19:57:58.523096+0000","last_unstale":"2023-12-24T19:57:58.526301+0000","last_undegraded":"2023-12-24T19:57:58.526301+0000","last_fullsized":"2023-12-24T19:57:58.526301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:02.074503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.516813+0000","last_change":"2023-12-24T19:57:57.758697+0000","last_active":"2023-12-24T19:57:58.516813+0000","last_peered":"2023-12-24T19:57:58.516813+0000","last_clean":"2023-12-24T19:57:58.516813+0000","last_became_active":"2023-12-24T19:57:57.758328+0000","last_became_peered":"2023-12-24T19:57:57.758328+0000","last_unstale":"2023-12-24T19:57:58.516813+0000","last_undegraded":"2023-12-24T19:57:58.516813+0000","last_fullsized":"2023-12-24T19:57:58.516813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:39.987950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525722+0000","last_change":"2023-12-24T19:57:58.525652+0000","last_active":"2023-12-24T19:57:58.525722+0000","last_peered":"2023-12-24T19:57:58.525722+0000","last_clean":"2023-12-24T19:57:58.525722+0000","last_became_active":"2023-12-24T19:57:58.525390+0000","last_became_peered":"2023-12-24T19:57:58.525390+0000","last_unstale":"2023-12-24T19:57:58.525722+0000","last_undegraded":"2023-12-24T19:57:58.525722+0000","last_fullsized":"2023-12-24T19:57:58.525722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:40.994379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.782605+0000","last_change":"2023-12-24T19:57:57.753774+0000","last_active":"2023-12-24T19:57:58.782605+0000","last_peered":"2023-12-24T19:57:58.782605+0000","last_clean":"2023-12-24T19:57:58.782605+0000","last_became_active":"2023-12-24T19:57:57.753506+0000","last_became_peered":"2023-12-24T19:57:57.753506+0000","last_unstale":"2023-12-24T19:57:58.782605+0000","last_undegraded":"2023-12-24T19:57:58.782605+0000","last_fullsized":"2023-12-24T19:57:58.782605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:32.859719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523944+0000","last_change":"2023-12-24T19:57:58.521684+0000","last_active":"2023-12-24T19:57:58.523944+0000","last_peered":"2023-12-24T19:57:58.523944+0000","last_clean":"2023-12-24T19:57:58.523944+0000","last_became_active":"2023-12-24T19:57:58.521290+0000","last_became_peered":"2023-12-24T19:57:58.521290+0000","last_unstale":"2023-12-24T19:57:58.523944+0000","last_undegraded":"2023-12-24T19:57:58.523944+0000","last_fullsized":"2023-12-24T19:57:58.523944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:31.588092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.782166+0000","last_change":"2023-12-24T19:57:57.759095+0000","last_active":"2023-12-24T19:57:58.782166+0000","last_peered":"2023-12-24T19:57:58.782166+0000","last_clean":"2023-12-24T19:57:58.782166+0000","last_became_active":"2023-12-24T19:57:57.755014+0000","last_became_peered":"2023-12-24T19:57:57.755014+0000","last_unstale":"2023-12-24T19:57:58.782166+0000","last_undegraded":"2023-12-24T19:57:58.782166+0000","last_fullsized":"2023-12-24T19:57:58.782166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:51.245549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.524727+0000","last_change":"2023-12-24T19:57:58.524653+0000","last_active":"2023-12-24T19:57:58.524727+0000","last_peered":"2023-12-24T19:57:58.524727+0000","last_clean":"2023-12-24T19:57:58.524727+0000","last_became_active":"2023-12-24T19:57:58.524217+0000","last_became_peered":"2023-12-24T19:57:58.524217+0000","last_unstale":"2023-12-24T19:57:58.524727+0000","last_undegraded":"2023-12-24T19:57:58.524727+0000","last_fullsized":"2023-12-24T19:57:58.524727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:31.588092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.779538+0000","last_change":"2023-12-24T19:57:57.761362+0000","last_active":"2023-12-24T19:57:58.779538+0000","last_peered":"2023-12-24T19:57:58.779538+0000","last_clean":"2023-12-24T19:57:58.779538+0000","last_became_active":"2023-12-24T19:57:57.760126+0000","last_became_peered":"2023-12-24T19:57:57.760126+0000","last_unstale":"2023-12-24T19:57:58.779538+0000","last_undegraded":"2023-12-24T19:57:58.779538+0000","last_fullsized":"2023-12-24T19:57:58.779538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:34.023511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525729+0000","last_change":"2023-12-24T19:57:58.525638+0000","last_active":"2023-12-24T19:57:58.525729+0000","last_peered":"2023-12-24T19:57:58.525729+0000","last_clean":"2023-12-24T19:57:58.525729+0000","last_became_active":"2023-12-24T19:57:58.525103+0000","last_became_peered":"2023-12-24T19:57:58.525103+0000","last_unstale":"2023-12-24T19:57:58.525729+0000","last_undegraded":"2023-12-24T19:57:58.525729+0000","last_fullsized":"2023-12-24T19:57:58.525729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:08:59.240415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.779816+0000","last_change":"2023-12-24T19:57:57.756610+0000","last_active":"2023-12-24T19:57:58.779816+0000","last_peered":"2023-12-24T19:57:58.779816+0000","last_clean":"2023-12-24T19:57:58.779816+0000","last_became_active":"2023-12-24T19:57:57.756335+0000","last_became_peered":"2023-12-24T19:57:57.756335+0000","last_unstale":"2023-12-24T19:57:58.779816+0000","last_undegraded":"2023-12-24T19:57:58.779816+0000","last_fullsized":"2023-12-24T19:57:58.779816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:20.134833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520949+0000","last_change":"2023-12-24T19:57:58.520644+0000","last_active":"2023-12-24T19:57:58.520949+0000","last_peered":"2023-12-24T19:57:58.520949+0000","last_clean":"2023-12-24T19:57:58.520949+0000","last_became_active":"2023-12-24T19:57:58.520406+0000","last_became_peered":"2023-12-24T19:57:58.520406+0000","last_unstale":"2023-12-24T19:57:58.520949+0000","last_undegraded":"2023-12-24T19:57:58.520949+0000","last_fullsized":"2023-12-24T19:57:58.520949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:52.251978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523190+0000","last_change":"2023-12-24T19:57:57.759051+0000","last_active":"2023-12-24T19:57:58.523190+0000","last_peered":"2023-12-24T19:57:58.523190+0000","last_clean":"2023-12-24T19:57:58.523190+0000","last_became_active":"2023-12-24T19:57:57.758499+0000","last_became_peered":"2023-12-24T19:57:57.758499+0000","last_unstale":"2023-12-24T19:57:58.523190+0000","last_undegraded":"2023-12-24T19:57:58.523190+0000","last_fullsized":"2023-12-24T19:57:58.523190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:53.813406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521769+0000","last_change":"2023-12-24T19:57:58.521694+0000","last_active":"2023-12-24T19:57:58.521769+0000","last_peered":"2023-12-24T19:57:58.521769+0000","last_clean":"2023-12-24T19:57:58.521769+0000","last_became_active":"2023-12-24T19:57:58.521457+0000","last_became_peered":"2023-12-24T19:57:58.521457+0000","last_unstale":"2023-12-24T19:57:58.521769+0000","last_undegraded":"2023-12-24T19:57:58.521769+0000","last_fullsized":"2023-12-24T19:57:58.521769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:08:38.595285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.779474+0000","last_change":"2023-12-24T19:57:57.753078+0000","last_active":"2023-12-24T19:57:58.779474+0000","last_peered":"2023-12-24T19:57:58.779474+0000","last_clean":"2023-12-24T19:57:58.779474+0000","last_became_active":"2023-12-24T19:57:57.752509+0000","last_became_peered":"2023-12-24T19:57:57.752509+0000","last_unstale":"2023-12-24T19:57:58.779474+0000","last_undegraded":"2023-12-24T19:57:58.779474+0000","last_fullsized":"2023-12-24T19:57:58.779474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:40:31.820818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514347+0000","last_change":"2023-12-24T19:57:58.513681+0000","last_active":"2023-12-24T19:57:58.514347+0000","last_peered":"2023-12-24T19:57:58.514347+0000","last_clean":"2023-12-24T19:57:58.514347+0000","last_became_active":"2023-12-24T19:57:58.512847+0000","last_became_peered":"2023-12-24T19:57:58.512847+0000","last_unstale":"2023-12-24T19:57:58.514347+0000","last_undegraded":"2023-12-24T19:57:58.514347+0000","last_fullsized":"2023-12-24T19:57:58.514347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:54.819835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.512781+0000","last_change":"2023-12-24T19:57:57.761251+0000","last_active":"2023-12-24T19:57:58.512781+0000","last_peered":"2023-12-24T19:57:58.512781+0000","last_clean":"2023-12-24T19:57:58.512781+0000","last_became_active":"2023-12-24T19:57:57.760988+0000","last_became_peered":"2023-12-24T19:57:57.760988+0000","last_unstale":"2023-12-24T19:57:58.512781+0000","last_undegraded":"2023-12-24T19:57:58.512781+0000","last_fullsized":"2023-12-24T19:57:58.512781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:08:37.588856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.511720+0000","last_change":"2023-12-24T19:57:58.511541+0000","last_active":"2023-12-24T19:57:58.511720+0000","last_peered":"2023-12-24T19:57:58.511720+0000","last_clean":"2023-12-24T19:57:58.511720+0000","last_became_active":"2023-12-24T19:57:58.511279+0000","last_became_peered":"2023-12-24T19:57:58.511279+0000","last_unstale":"2023-12-24T19:57:58.511720+0000","last_undegraded":"2023-12-24T19:57:58.511720+0000","last_fullsized":"2023-12-24T19:57:58.511720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:21.141262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.516062+0000","last_change":"2023-12-24T19:57:57.762387+0000","last_active":"2023-12-24T19:57:58.516062+0000","last_peered":"2023-12-24T19:57:58.516062+0000","last_clean":"2023-12-24T19:57:58.516062+0000","last_became_active":"2023-12-24T19:57:57.761616+0000","last_became_peered":"2023-12-24T19:57:57.761616+0000","last_unstale":"2023-12-24T19:57:58.516062+0000","last_undegraded":"2023-12-24T19:57:58.516062+0000","last_fullsized":"2023-12-24T19:57:58.516062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:57:02.016336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523020+0000","last_change":"2023-12-24T19:57:58.522894+0000","last_active":"2023-12-24T19:57:58.523020+0000","last_peered":"2023-12-24T19:57:58.523020+0000","last_clean":"2023-12-24T19:57:58.523020+0000","last_became_active":"2023-12-24T19:57:58.522449+0000","last_became_peered":"2023-12-24T19:57:58.522449+0000","last_unstale":"2023-12-24T19:57:58.523020+0000","last_undegraded":"2023-12-24T19:57:58.523020+0000","last_fullsized":"2023-12-24T19:57:58.523020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:08.199656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.510158+0000","last_change":"2023-12-24T19:57:57.758998+0000","last_active":"2023-12-24T19:57:58.510158+0000","last_peered":"2023-12-24T19:57:58.510158+0000","last_clean":"2023-12-24T19:57:58.510158+0000","last_became_active":"2023-12-24T19:57:57.758744+0000","last_became_peered":"2023-12-24T19:57:57.758744+0000","last_unstale":"2023-12-24T19:57:58.510158+0000","last_undegraded":"2023-12-24T19:57:58.510158+0000","last_fullsized":"2023-12-24T19:57:58.510158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:36.063035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514364+0000","last_change":"2023-12-24T19:57:58.514128+0000","last_active":"2023-12-24T19:57:58.514364+0000","last_peered":"2023-12-24T19:57:58.514364+0000","last_clean":"2023-12-24T19:57:58.514364+0000","last_became_active":"2023-12-24T19:57:58.513157+0000","last_became_peered":"2023-12-24T19:57:58.513157+0000","last_unstale":"2023-12-24T19:57:58.514364+0000","last_undegraded":"2023-12-24T19:57:58.514364+0000","last_fullsized":"2023-12-24T19:57:58.514364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:22:41.106819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.780844+0000","last_change":"2023-12-24T19:57:57.757975+0000","last_active":"2023-12-24T19:57:58.780844+0000","last_peered":"2023-12-24T19:57:58.780844+0000","last_clean":"2023-12-24T19:57:58.780844+0000","last_became_active":"2023-12-24T19:57:57.756924+0000","last_became_peered":"2023-12-24T19:57:57.756924+0000","last_unstale":"2023-12-24T19:57:58.780844+0000","last_undegraded":"2023-12-24T19:57:58.780844+0000","last_fullsized":"2023-12-24T19:57:58.780844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:32.859719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514072+0000","last_change":"2023-12-24T19:57:58.514007+0000","last_active":"2023-12-24T19:57:58.514072+0000","last_peered":"2023-12-24T19:57:58.514072+0000","last_clean":"2023-12-24T19:57:58.514072+0000","last_became_active":"2023-12-24T19:57:58.513750+0000","last_became_peered":"2023-12-24T19:57:58.513750+0000","last_unstale":"2023-12-24T19:57:58.514072+0000","last_undegraded":"2023-12-24T19:57:58.514072+0000","last_fullsized":"2023-12-24T19:57:58.514072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:08.199656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.509326+0000","last_change":"2023-12-24T19:57:57.753234+0000","last_active":"2023-12-24T19:57:58.509326+0000","last_peered":"2023-12-24T19:57:58.509326+0000","last_clean":"2023-12-24T19:57:58.509326+0000","last_became_active":"2023-12-24T19:57:57.752826+0000","last_became_peered":"2023-12-24T19:57:57.752826+0000","last_unstale":"2023-12-24T19:57:58.509326+0000","last_undegraded":"2023-12-24T19:57:58.509326+0000","last_fullsized":"2023-12-24T19:57:58.509326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:14:00.148083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.513966+0000","last_change":"2023-12-24T19:57:58.513898+0000","last_active":"2023-12-24T19:57:58.513966+0000","last_peered":"2023-12-24T19:57:58.513966+0000","last_clean":"2023-12-24T19:57:58.513966+0000","last_became_active":"2023-12-24T19:57:58.513671+0000","last_became_peered":"2023-12-24T19:57:58.513671+0000","last_unstale":"2023-12-24T19:57:58.513966+0000","last_undegraded":"2023-12-24T19:57:58.513966+0000","last_fullsized":"2023-12-24T19:57:58.513966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:42:19.167753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.513687+0000","last_change":"2023-12-24T19:57:57.752924+0000","last_active":"2023-12-24T19:57:58.513687+0000","last_peered":"2023-12-24T19:57:58.513687+0000","last_clean":"2023-12-24T19:57:58.513687+0000","last_became_active":"2023-12-24T19:57:57.752678+0000","last_became_peered":"2023-12-24T19:57:57.752678+0000","last_unstale":"2023-12-24T19:57:58.513687+0000","last_undegraded":"2023-12-24T19:57:58.513687+0000","last_fullsized":"2023-12-24T19:57:58.513687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:40:31.820818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.515444+0000","last_change":"2023-12-24T19:57:58.515360+0000","last_active":"2023-12-24T19:57:58.515444+0000","last_peered":"2023-12-24T19:57:58.515444+0000","last_clean":"2023-12-24T19:57:58.515444+0000","last_became_active":"2023-12-24T19:57:58.515127+0000","last_became_peered":"2023-12-24T19:57:58.515127+0000","last_unstale":"2023-12-24T19:57:58.515444+0000","last_undegraded":"2023-12-24T19:57:58.515444+0000","last_fullsized":"2023-12-24T19:57:58.515444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:37.069464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.509225+0000","last_change":"2023-12-24T19:57:57.756429+0000","last_active":"2023-12-24T19:57:58.509225+0000","last_peered":"2023-12-24T19:57:58.509225+0000","last_clean":"2023-12-24T19:57:58.509225+0000","last_became_active":"2023-12-24T19:57:57.756192+0000","last_became_peered":"2023-12-24T19:57:57.756192+0000","last_unstale":"2023-12-24T19:57:58.509225+0000","last_undegraded":"2023-12-24T19:57:58.509225+0000","last_fullsized":"2023-12-24T19:57:58.509225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:49.895852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518008+0000","last_change":"2023-12-24T19:57:58.517945+0000","last_active":"2023-12-24T19:57:58.518008+0000","last_peered":"2023-12-24T19:57:58.518008+0000","last_clean":"2023-12-24T19:57:58.518008+0000","last_became_active":"2023-12-24T19:57:58.517701+0000","last_became_peered":"2023-12-24T19:57:58.517701+0000","last_unstale":"2023-12-24T19:57:58.518008+0000","last_undegraded":"2023-12-24T19:57:58.518008+0000","last_fullsized":"2023-12-24T19:57:58.518008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:41.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.513323+0000","last_change":"2023-12-24T19:57:57.758157+0000","last_active":"2023-12-24T19:57:58.513323+0000","last_peered":"2023-12-24T19:57:58.513323+0000","last_clean":"2023-12-24T19:57:58.513323+0000","last_became_active":"2023-12-24T19:57:57.757267+0000","last_became_peered":"2023-12-24T19:57:57.757267+0000","last_unstale":"2023-12-24T19:57:58.513323+0000","last_undegraded":"2023-12-24T19:57:58.513323+0000","last_fullsized":"2023-12-24T19:57:58.513323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:22:40.100390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521453+0000","last_change":"2023-12-24T19:57:58.520602+0000","last_active":"2023-12-24T19:57:58.521453+0000","last_peered":"2023-12-24T19:57:58.521453+0000","last_clean":"2023-12-24T19:57:58.521453+0000","last_became_active":"2023-12-24T19:57:58.519255+0000","last_became_peered":"2023-12-24T19:57:58.519255+0000","last_unstale":"2023-12-24T19:57:58.521453+0000","last_undegraded":"2023-12-24T19:57:58.521453+0000","last_fullsized":"2023-12-24T19:57:58.521453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:20:19.721200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.515650+0000","last_change":"2023-12-24T19:57:57.754725+0000","last_active":"2023-12-24T19:57:58.515650+0000","last_peered":"2023-12-24T19:57:58.515650+0000","last_clean":"2023-12-24T19:57:58.515650+0000","last_became_active":"2023-12-24T19:57:57.754264+0000","last_became_peered":"2023-12-24T19:57:57.754264+0000","last_unstale":"2023-12-24T19:57:58.515650+0000","last_undegraded":"2023-12-24T19:57:58.515650+0000","last_fullsized":"2023-12-24T19:57:58.515650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:21.762387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523830+0000","last_change":"2023-12-24T19:57:58.520753+0000","last_active":"2023-12-24T19:57:58.523830+0000","last_peered":"2023-12-24T19:57:58.523830+0000","last_clean":"2023-12-24T19:57:58.523830+0000","last_became_active":"2023-12-24T19:57:58.520485+0000","last_became_peered":"2023-12-24T19:57:58.520485+0000","last_unstale":"2023-12-24T19:57:58.523830+0000","last_undegraded":"2023-12-24T19:57:58.523830+0000","last_fullsized":"2023-12-24T19:57:58.523830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:20:45.757755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.515559+0000","last_change":"2023-12-24T19:57:57.758422+0000","last_active":"2023-12-24T19:57:58.515559+0000","last_peered":"2023-12-24T19:57:58.515559+0000","last_clean":"2023-12-24T19:57:58.515559+0000","last_became_active":"2023-12-24T19:57:57.758173+0000","last_became_peered":"2023-12-24T19:57:57.758173+0000","last_unstale":"2023-12-24T19:57:58.515559+0000","last_undegraded":"2023-12-24T19:57:58.515559+0000","last_fullsized":"2023-12-24T19:57:58.515559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:20:44.751326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.519823+0000","last_change":"2023-12-24T19:57:58.519750+0000","last_active":"2023-12-24T19:57:58.519823+0000","last_peered":"2023-12-24T19:57:58.519823+0000","last_clean":"2023-12-24T19:57:58.519823+0000","last_became_active":"2023-12-24T19:57:58.519389+0000","last_became_peered":"2023-12-24T19:57:58.519389+0000","last_unstale":"2023-12-24T19:57:58.519823+0000","last_undegraded":"2023-12-24T19:57:58.519823+0000","last_fullsized":"2023-12-24T19:57:58.519823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:02.701078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.512914+0000","last_change":"2023-12-24T19:57:57.759746+0000","last_active":"2023-12-24T19:57:58.512914+0000","last_peered":"2023-12-24T19:57:58.512914+0000","last_clean":"2023-12-24T19:57:58.512914+0000","last_became_active":"2023-12-24T19:57:57.759514+0000","last_became_peered":"2023-12-24T19:57:57.759514+0000","last_unstale":"2023-12-24T19:57:58.512914+0000","last_undegraded":"2023-12-24T19:57:58.512914+0000","last_fullsized":"2023-12-24T19:57:58.512914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:23.852195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.513647+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:57:58.513647+0000","last_peered":"2023-12-24T19:57:58.513647+0000","last_clean":"2023-12-24T19:57:58.513647+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:57:58.513647+0000","last_undegraded":"2023-12-24T19:57:58.513647+0000","last_fullsized":"2023-12-24T19:57:58.513647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199275988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.62}]},{"osd":1,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51600000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59899999999999998}]},{"osd":5,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46700000000000003}]},{"osd":6,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.58599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58599999999999997}]},{"osd":4,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.375},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.36399999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":125,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195186,"statfs":{"total":200000000,"available":199871176,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.315}]},{"osd":2,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.35899999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.34300000000000003}]},{"osd":4,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.504},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46000000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46800000000000003}]},{"osd":6,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56000000000000005}]},{"osd":7,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":706,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199276078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.311}]},{"osd":2,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.34499999999999997}]},{"osd":4,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.6859999999999999,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53800000000000003}]},{"osd":6,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195188,"statfs":{"total":200000000,"available":199872664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.39300000000000002}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.379},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.44500000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.503}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67600000000000005}]},{"osd":5,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71699999999999997}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.80200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.36599999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.438}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67900000000000005}]},{"osd":5,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61399999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.74099999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.70599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195188,"statfs":{"total":200000000,"available":199872630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.48799999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53600000000000003}]},{"osd":3,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":8.8200000000000003,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.8279999999999998,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.58599999999999997}]},{"osd":6,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":14.039999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.61599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195187,"statfs":{"total":200000000,"available":199872090,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.61499999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.502}]},{"osd":2,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.51500000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57199999999999995}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.443},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.63}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.53400000000000003}]}]}],"pool_statfs":[]}} 2023-12-24T19:58:02.909 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:58:03.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.065+0000 7f11f7f3b700 1 Processor -- start 2023-12-24T19:58:03.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.065+0000 7f11f7f3b700 1 -- start start 2023-12-24T19:58:03.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f7f3b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f11f0068510 0x7f11f00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f7f3b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11f0159a60 0x7f11f0159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f7f3b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f00b2890 con 0x7f11f0068140 2023-12-24T19:58:03.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f7f3b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f00cf630 con 0x7f11f0068510 2023-12-24T19:58:03.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f7f3b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f00b2240 con 0x7f11f0159a60 2023-12-24T19:58:03.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f54d6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f11f0068510 0x7f11f00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f5cd7700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f11f0068140 0x7f11f00b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56686/0 (socket says 172.21.15.61:56686) 2023-12-24T19:58:03.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f5cd7700 1 -- 172.21.15.61:0/445024298 learned_addr learned my addr 172.21.15.61:0/445024298 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:03.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f64d8700 1 --2- 172.21.15.61:0/445024298 >> v2:172.21.15.133:3300/0 conn(0x7f11f0159a60 0x7f11f0159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f54d6700 1 -- 172.21.15.61:0/445024298 >> v2:172.21.15.133:3300/0 conn(0x7f11f0159a60 msgr2=0x7f11f0159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:03.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f54d6700 1 --2- 172.21.15.61:0/445024298 >> v2:172.21.15.133:3300/0 conn(0x7f11f0159a60 0x7f11f0159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f54d6700 1 -- 172.21.15.61:0/445024298 >> v1:172.21.15.61:6789/0 conn(0x7f11f0068140 legacy=0x7f11f00b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f54d6700 1 -- 172.21.15.61:0/445024298 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f00b2520 con 0x7f11f0068510 2023-12-24T19:58:03.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.066+0000 7f11f64d8700 1 --2- 172.21.15.61:0/445024298 >> v2:172.21.15.133:3300/0 conn(0x7f11f0159a60 0x7f11f0159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:03.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f54d6700 1 --2- 172.21.15.61:0/445024298 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068510 0x7f11f00cefa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f11f006eaf0 tx=0x7f11ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d929030042678ee3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:03.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f4cd5700 1 -- 172.21.15.61:0/445024298 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec00b6b0 con 0x7f11f0068510 2023-12-24T19:58:03.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f4cd5700 1 -- 172.21.15.61:0/445024298 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec00b810 con 0x7f11f0068510 2023-12-24T19:58:03.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f4cd5700 1 -- 172.21.15.61:0/445024298 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec00bbb0 con 0x7f11f0068510 2023-12-24T19:58:03.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f7f3b700 1 -- 172.21.15.61:0/445024298 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068510 msgr2=0x7f11f00cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f7f3b700 1 --2- 172.21.15.61:0/445024298 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068510 0x7f11f00cefa0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f11f006eaf0 tx=0x7f11ec0091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f7f3b700 1 -- 172.21.15.61:0/445024298 shutdown_connections 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f7f3b700 1 --2- 172.21.15.61:0/445024298 >> v2:172.21.15.133:3300/0 conn(0x7f11f0159a60 0x7f11f0159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f7f3b700 1 --2- 172.21.15.61:0/445024298 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068510 0x7f11f00cefa0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f7f3b700 1 -- 172.21.15.61:0/445024298 >> 172.21.15.61:0/445024298 conn(0x7f11f0097a10 msgr2=0x7f11f00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f7f3b700 1 -- 172.21.15.61:0/445024298 shutdown_connections 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.067+0000 7f11f7f3b700 1 -- 172.21.15.61:0/445024298 wait complete. 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.068+0000 7f11f7f3b700 1 Processor -- start 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.068+0000 7f11f7f3b700 1 -- start start 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.069+0000 7f11f7f3b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068140 0x7f11f01433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.069+0000 7f11f7f3b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0068510 0x7f11f006be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.069+0000 7f11f7f3b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11f0159a60 0x7f11f006c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.069+0000 7f11f7f3b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f0146700 con 0x7f11f0068140 2023-12-24T19:58:03.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.069+0000 7f11f7f3b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f0145af0 con 0x7f11f0068510 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.069+0000 7f11f7f3b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f0145dd0 con 0x7f11f0159a60 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.069+0000 7f11f5cd7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068140 0x7f11f01433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.069+0000 7f11f5cd7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068140 0x7f11f01433a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43426/0 (socket says 172.21.15.61:43426) 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.069+0000 7f11f5cd7700 1 -- 172.21.15.61:0/1634697781 learned_addr learned my addr 172.21.15.61:0/1634697781 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f54d6700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0068510 0x7f11f006be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f64d8700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11f0159a60 0x7f11f006c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f5cd7700 1 -- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11f0159a60 msgr2=0x7f11f006c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f5cd7700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11f0159a60 0x7f11f006c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f5cd7700 1 -- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0068510 msgr2=0x7f11f006be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f5cd7700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0068510 0x7f11f006be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f5cd7700 1 -- 172.21.15.61:0/1634697781 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec009420 con 0x7f11f0068140 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f54d6700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0068510 0x7f11f006be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f5cd7700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068140 0x7f11f01433a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f11e000c7c0 tx=0x7f11e0007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:03.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11e5ffb700 1 -- 172.21.15.61:0/1634697781 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e00073d0 con 0x7f11f0068140 2023-12-24T19:58:03.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11e5ffb700 1 -- 172.21.15.61:0/1634697781 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0007530 con 0x7f11f0068140 2023-12-24T19:58:03.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11e5ffb700 1 -- 172.21.15.61:0/1634697781 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0005a40 con 0x7f11f0068140 2023-12-24T19:58:03.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f7f3b700 1 -- 172.21.15.61:0/1634697781 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f01460b0 con 0x7f11f0068140 2023-12-24T19:58:03.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.070+0000 7f11f7f3b700 1 -- 172.21.15.61:0/1634697781 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f0146b90 con 0x7f11f0068140 2023-12-24T19:58:03.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.071+0000 7f11f7f3b700 1 -- 172.21.15.61:0/1634697781 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f006d440 con 0x7f11f0068140 2023-12-24T19:58:03.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.072+0000 7f11e5ffb700 1 -- 172.21.15.61:0/1634697781 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f11e001b400 con 0x7f11f0068140 2023-12-24T19:58:03.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.072+0000 7f11e5ffb700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f11d4066f30 0x7f11d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.072+0000 7f11e5ffb700 1 -- 172.21.15.61:0/1634697781 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f11e0083fa0 con 0x7f11f0068140 2023-12-24T19:58:03.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.072+0000 7f11f54d6700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f11d4066f30 0x7f11d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.073+0000 7f11f54d6700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f11d4066f30 0x7f11d40693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f11f006cc90 tx=0x7f11ec017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:03.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.076+0000 7f11e5ffb700 1 -- 172.21.15.61:0/1634697781 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11e0051290 con 0x7f11f0068140 2023-12-24T19:58:03.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.265+0000 7f11f7f3b700 1 -- 172.21.15.61:0/1634697781 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11f0146840 con 0x7f11d4066f30 2023-12-24T19:58:03.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.274+0000 7f11e5ffb700 1 -- 172.21.15.61:0/1634697781 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284808 (secure 0 0 0) 0x7f11ec00ba50 con 0x7f11d4066f30 2023-12-24T19:58:03.278 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:03.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 -- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f11d4066f30 msgr2=0x7f11d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f11d4066f30 0x7f11d40693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f11f006cc90 tx=0x7f11ec017000 comp rx=0 tx=0).stop 2023-12-24T19:58:03.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 -- 172.21.15.61:0/1634697781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068140 msgr2=0x7f11f01433a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068140 0x7f11f01433a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f11e000c7c0 tx=0x7f11e0007de0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 -- 172.21.15.61:0/1634697781 shutdown_connections 2023-12-24T19:58:03.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f11f0159a60 0x7f11f006c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f11d4066f30 0x7f11d40693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f11f0068140 0x7f11f01433a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 --2- 172.21.15.61:0/1634697781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0068510 0x7f11f006be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 -- 172.21.15.61:0/1634697781 >> 172.21.15.61:0/1634697781 conn(0x7f11f0097a10 msgr2=0x7f11f00af330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:03.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 -- 172.21.15.61:0/1634697781 shutdown_connections 2023-12-24T19:58:03.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.277+0000 7f11f7f3b700 1 -- 172.21.15.61:0/1634697781 wait complete. 2023-12-24T19:58:03.281 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:58:03.289 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-12-24T19:58:02.321298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2176,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560323,"statfs":{"total":1600000000,"available":1597771372,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.576625"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.517205+0000","last_change":"2023-12-24T19:57:58.517130+0000","last_active":"2023-12-24T19:57:58.517205+0000","last_peered":"2023-12-24T19:57:58.517205+0000","last_clean":"2023-12-24T19:57:58.517205+0000","last_became_active":"2023-12-24T19:57:58.516901+0000","last_became_peered":"2023-12-24T19:57:58.516901+0000","last_unstale":"2023-12-24T19:57:58.517205+0000","last_undegraded":"2023-12-24T19:57:58.517205+0000","last_fullsized":"2023-12-24T19:57:58.517205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:57:01.832245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518851+0000","last_change":"2023-12-24T19:57:58.518708+0000","last_active":"2023-12-24T19:57:58.518851+0000","last_peered":"2023-12-24T19:57:58.518851+0000","last_clean":"2023-12-24T19:57:58.518851+0000","last_became_active":"2023-12-24T19:57:58.518472+0000","last_became_peered":"2023-12-24T19:57:58.518472+0000","last_unstale":"2023-12-24T19:57:58.518851+0000","last_undegraded":"2023-12-24T19:57:58.518851+0000","last_fullsized":"2023-12-24T19:57:58.518851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:47:21.652003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514482+0000","last_change":"2023-12-24T19:57:58.514391+0000","last_active":"2023-12-24T19:57:58.514482+0000","last_peered":"2023-12-24T19:57:58.514482+0000","last_clean":"2023-12-24T19:57:58.514482+0000","last_became_active":"2023-12-24T19:57:58.513985+0000","last_became_peered":"2023-12-24T19:57:58.513985+0000","last_unstale":"2023-12-24T19:57:58.514482+0000","last_undegraded":"2023-12-24T19:57:58.514482+0000","last_fullsized":"2023-12-24T19:57:58.514482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:02.074503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.522457+0000","last_change":"2023-12-24T19:57:58.522413+0000","last_active":"2023-12-24T19:57:58.522457+0000","last_peered":"2023-12-24T19:57:58.522457+0000","last_clean":"2023-12-24T19:57:58.522457+0000","last_became_active":"2023-12-24T19:57:58.522079+0000","last_became_peered":"2023-12-24T19:57:58.522079+0000","last_unstale":"2023-12-24T19:57:58.522457+0000","last_undegraded":"2023-12-24T19:57:58.522457+0000","last_fullsized":"2023-12-24T19:57:58.522457+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:02.701078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518772+0000","last_change":"2023-12-24T19:57:58.518709+0000","last_active":"2023-12-24T19:57:58.518772+0000","last_peered":"2023-12-24T19:57:58.518772+0000","last_clean":"2023-12-24T19:57:58.518772+0000","last_became_active":"2023-12-24T19:57:58.518381+0000","last_became_peered":"2023-12-24T19:57:58.518381+0000","last_unstale":"2023-12-24T19:57:58.518772+0000","last_undegraded":"2023-12-24T19:57:58.518772+0000","last_fullsized":"2023-12-24T19:57:58.518772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:14:01.154512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.522572+0000","last_change":"2023-12-24T19:57:58.522521+0000","last_active":"2023-12-24T19:57:58.522572+0000","last_peered":"2023-12-24T19:57:58.522572+0000","last_clean":"2023-12-24T19:57:58.522572+0000","last_became_active":"2023-12-24T19:57:58.522253+0000","last_became_peered":"2023-12-24T19:57:58.522253+0000","last_unstale":"2023-12-24T19:57:58.522572+0000","last_undegraded":"2023-12-24T19:57:58.522572+0000","last_fullsized":"2023-12-24T19:57:58.522572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:18.240578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521346+0000","last_change":"2023-12-24T19:57:58.521277+0000","last_active":"2023-12-24T19:57:58.521346+0000","last_peered":"2023-12-24T19:57:58.521346+0000","last_clean":"2023-12-24T19:57:58.521346+0000","last_became_active":"2023-12-24T19:57:58.520614+0000","last_became_peered":"2023-12-24T19:57:58.520614+0000","last_unstale":"2023-12-24T19:57:58.521346+0000","last_undegraded":"2023-12-24T19:57:58.521346+0000","last_fullsized":"2023-12-24T19:57:58.521346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:39.765581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.526278+0000","last_change":"2023-12-24T19:57:58.523674+0000","last_active":"2023-12-24T19:57:58.526278+0000","last_peered":"2023-12-24T19:57:58.526278+0000","last_clean":"2023-12-24T19:57:58.526278+0000","last_became_active":"2023-12-24T19:57:58.522220+0000","last_became_peered":"2023-12-24T19:57:58.522220+0000","last_unstale":"2023-12-24T19:57:58.526278+0000","last_undegraded":"2023-12-24T19:57:58.526278+0000","last_fullsized":"2023-12-24T19:57:58.526278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:59.151270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523970+0000","last_change":"2023-12-24T19:57:58.521681+0000","last_active":"2023-12-24T19:57:58.523970+0000","last_peered":"2023-12-24T19:57:58.523970+0000","last_clean":"2023-12-24T19:57:58.523970+0000","last_became_active":"2023-12-24T19:57:58.521408+0000","last_became_peered":"2023-12-24T19:57:58.521408+0000","last_unstale":"2023-12-24T19:57:58.523970+0000","last_undegraded":"2023-12-24T19:57:58.523970+0000","last_fullsized":"2023-12-24T19:57:58.523970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:37.069464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518466+0000","last_change":"2023-12-24T19:57:58.518318+0000","last_active":"2023-12-24T19:57:58.518466+0000","last_peered":"2023-12-24T19:57:58.518466+0000","last_clean":"2023-12-24T19:57:58.518466+0000","last_became_active":"2023-12-24T19:57:58.518095+0000","last_became_peered":"2023-12-24T19:57:58.518095+0000","last_unstale":"2023-12-24T19:57:58.518466+0000","last_undegraded":"2023-12-24T19:57:58.518466+0000","last_fullsized":"2023-12-24T19:57:58.518466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:27.726827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520149+0000","last_change":"2023-12-24T19:57:58.520044+0000","last_active":"2023-12-24T19:57:58.520149+0000","last_peered":"2023-12-24T19:57:58.520149+0000","last_clean":"2023-12-24T19:57:58.520149+0000","last_became_active":"2023-12-24T19:57:58.519727+0000","last_became_peered":"2023-12-24T19:57:58.519727+0000","last_unstale":"2023-12-24T19:57:58.520149+0000","last_undegraded":"2023-12-24T19:57:58.520149+0000","last_fullsized":"2023-12-24T19:57:58.520149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:31:00.573397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520302+0000","last_change":"2023-12-24T19:57:58.520003+0000","last_active":"2023-12-24T19:57:58.520302+0000","last_peered":"2023-12-24T19:57:58.520302+0000","last_clean":"2023-12-24T19:57:58.520302+0000","last_became_active":"2023-12-24T19:57:58.519638+0000","last_became_peered":"2023-12-24T19:57:58.519638+0000","last_unstale":"2023-12-24T19:57:58.520302+0000","last_undegraded":"2023-12-24T19:57:58.520302+0000","last_fullsized":"2023-12-24T19:57:58.520302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:59.151270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514379+0000","last_change":"2023-12-24T19:57:58.514290+0000","last_active":"2023-12-24T19:57:58.514379+0000","last_peered":"2023-12-24T19:57:58.514379+0000","last_clean":"2023-12-24T19:57:58.514379+0000","last_became_active":"2023-12-24T19:57:58.513905+0000","last_became_peered":"2023-12-24T19:57:58.513905+0000","last_unstale":"2023-12-24T19:57:58.514379+0000","last_undegraded":"2023-12-24T19:57:58.514379+0000","last_fullsized":"2023-12-24T19:57:58.514379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:24.858624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521471+0000","last_change":"2023-12-24T19:57:58.521034+0000","last_active":"2023-12-24T19:57:58.521471+0000","last_peered":"2023-12-24T19:57:58.521471+0000","last_clean":"2023-12-24T19:57:58.521471+0000","last_became_active":"2023-12-24T19:57:58.519611+0000","last_became_peered":"2023-12-24T19:57:58.519611+0000","last_unstale":"2023-12-24T19:57:58.521471+0000","last_undegraded":"2023-12-24T19:57:58.521471+0000","last_fullsized":"2023-12-24T19:57:58.521471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:31:00.573397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514848+0000","last_change":"2023-12-24T19:57:58.514756+0000","last_active":"2023-12-24T19:57:58.514848+0000","last_peered":"2023-12-24T19:57:58.514848+0000","last_clean":"2023-12-24T19:57:58.514848+0000","last_became_active":"2023-12-24T19:57:58.514491+0000","last_became_peered":"2023-12-24T19:57:58.514491+0000","last_unstale":"2023-12-24T19:57:58.514848+0000","last_undegraded":"2023-12-24T19:57:58.514848+0000","last_fullsized":"2023-12-24T19:57:58.514848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:20:19.721200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.528059+0000","last_change":"2023-12-24T19:57:58.527978+0000","last_active":"2023-12-24T19:57:58.528059+0000","last_peered":"2023-12-24T19:57:58.528059+0000","last_clean":"2023-12-24T19:57:58.528059+0000","last_became_active":"2023-12-24T19:57:58.527556+0000","last_became_peered":"2023-12-24T19:57:58.527556+0000","last_unstale":"2023-12-24T19:57:58.528059+0000","last_undegraded":"2023-12-24T19:57:58.528059+0000","last_fullsized":"2023-12-24T19:57:58.528059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:51.125001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521464+0000","last_change":"2023-12-24T19:57:58.521413+0000","last_active":"2023-12-24T19:57:58.521464+0000","last_peered":"2023-12-24T19:57:58.521464+0000","last_clean":"2023-12-24T19:57:58.521464+0000","last_became_active":"2023-12-24T19:57:58.520963+0000","last_became_peered":"2023-12-24T19:57:58.520963+0000","last_unstale":"2023-12-24T19:57:58.521464+0000","last_undegraded":"2023-12-24T19:57:58.521464+0000","last_fullsized":"2023-12-24T19:57:58.521464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:18.240578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518032+0000","last_change":"2023-12-24T19:57:58.517940+0000","last_active":"2023-12-24T19:57:58.518032+0000","last_peered":"2023-12-24T19:57:58.518032+0000","last_clean":"2023-12-24T19:57:58.518032+0000","last_became_active":"2023-12-24T19:57:58.517700+0000","last_became_peered":"2023-12-24T19:57:58.517700+0000","last_unstale":"2023-12-24T19:57:58.518032+0000","last_undegraded":"2023-12-24T19:57:58.518032+0000","last_fullsized":"2023-12-24T19:57:58.518032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:27.726827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521513+0000","last_change":"2023-12-24T19:57:58.521222+0000","last_active":"2023-12-24T19:57:58.521513+0000","last_peered":"2023-12-24T19:57:58.521513+0000","last_clean":"2023-12-24T19:57:58.521513+0000","last_became_active":"2023-12-24T19:57:58.519946+0000","last_became_peered":"2023-12-24T19:57:58.519946+0000","last_unstale":"2023-12-24T19:57:58.521513+0000","last_undegraded":"2023-12-24T19:57:58.521513+0000","last_fullsized":"2023-12-24T19:57:58.521513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:02.074503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.512552+0000","last_change":"2023-12-24T19:57:58.512263+0000","last_active":"2023-12-24T19:57:58.512552+0000","last_peered":"2023-12-24T19:57:58.512552+0000","last_clean":"2023-12-24T19:57:58.512552+0000","last_became_active":"2023-12-24T19:57:58.512016+0000","last_became_peered":"2023-12-24T19:57:58.512016+0000","last_unstale":"2023-12-24T19:57:58.512552+0000","last_undegraded":"2023-12-24T19:57:58.512552+0000","last_fullsized":"2023-12-24T19:57:58.512552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:36.935252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525778+0000","last_change":"2023-12-24T19:57:58.525121+0000","last_active":"2023-12-24T19:57:58.525778+0000","last_peered":"2023-12-24T19:57:58.525778+0000","last_clean":"2023-12-24T19:57:58.525778+0000","last_became_active":"2023-12-24T19:57:58.524694+0000","last_became_peered":"2023-12-24T19:57:58.524694+0000","last_unstale":"2023-12-24T19:57:58.525778+0000","last_undegraded":"2023-12-24T19:57:58.525778+0000","last_fullsized":"2023-12-24T19:57:58.525778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:41.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525072+0000","last_change":"2023-12-24T19:57:58.525013+0000","last_active":"2023-12-24T19:57:58.525072+0000","last_peered":"2023-12-24T19:57:58.525072+0000","last_clean":"2023-12-24T19:57:58.525072+0000","last_became_active":"2023-12-24T19:57:58.524509+0000","last_became_peered":"2023-12-24T19:57:58.524509+0000","last_unstale":"2023-12-24T19:57:58.525072+0000","last_undegraded":"2023-12-24T19:57:58.525072+0000","last_fullsized":"2023-12-24T19:57:58.525072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:57:01.832245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.517849+0000","last_change":"2023-12-24T19:57:58.517787+0000","last_active":"2023-12-24T19:57:58.517849+0000","last_peered":"2023-12-24T19:57:58.517849+0000","last_clean":"2023-12-24T19:57:58.517849+0000","last_became_active":"2023-12-24T19:57:58.517510+0000","last_became_peered":"2023-12-24T19:57:58.517510+0000","last_unstale":"2023-12-24T19:57:58.517849+0000","last_undegraded":"2023-12-24T19:57:58.517849+0000","last_fullsized":"2023-12-24T19:57:58.517849+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:08.035263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.512368+0000","last_change":"2023-12-24T19:57:58.512300+0000","last_active":"2023-12-24T19:57:58.512368+0000","last_peered":"2023-12-24T19:57:58.512368+0000","last_clean":"2023-12-24T19:57:58.512368+0000","last_became_active":"2023-12-24T19:57:58.512059+0000","last_became_peered":"2023-12-24T19:57:58.512059+0000","last_unstale":"2023-12-24T19:57:58.512368+0000","last_undegraded":"2023-12-24T19:57:58.512368+0000","last_fullsized":"2023-12-24T19:57:58.512368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:27.726827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520330+0000","last_change":"2023-12-24T19:57:58.520277+0000","last_active":"2023-12-24T19:57:58.520330+0000","last_peered":"2023-12-24T19:57:58.520330+0000","last_clean":"2023-12-24T19:57:58.520330+0000","last_became_active":"2023-12-24T19:57:58.520057+0000","last_became_peered":"2023-12-24T19:57:58.520057+0000","last_unstale":"2023-12-24T19:57:58.520330+0000","last_undegraded":"2023-12-24T19:57:58.520330+0000","last_fullsized":"2023-12-24T19:57:58.520330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:42.434307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.522459+0000","last_change":"2023-12-24T19:57:58.522397+0000","last_active":"2023-12-24T19:57:58.522459+0000","last_peered":"2023-12-24T19:57:58.522459+0000","last_clean":"2023-12-24T19:57:58.522459+0000","last_became_active":"2023-12-24T19:57:58.521951+0000","last_became_peered":"2023-12-24T19:57:58.521951+0000","last_unstale":"2023-12-24T19:57:58.522459+0000","last_undegraded":"2023-12-24T19:57:58.522459+0000","last_fullsized":"2023-12-24T19:57:58.522459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:42.515021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525884+0000","last_change":"2023-12-24T19:57:58.525814+0000","last_active":"2023-12-24T19:57:58.525884+0000","last_peered":"2023-12-24T19:57:58.525884+0000","last_clean":"2023-12-24T19:57:58.525884+0000","last_became_active":"2023-12-24T19:57:58.525410+0000","last_became_peered":"2023-12-24T19:57:58.525410+0000","last_unstale":"2023-12-24T19:57:58.525884+0000","last_undegraded":"2023-12-24T19:57:58.525884+0000","last_fullsized":"2023-12-24T19:57:58.525884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:01:02.919958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.519136+0000","last_change":"2023-12-24T19:57:58.519040+0000","last_active":"2023-12-24T19:57:58.519136+0000","last_peered":"2023-12-24T19:57:58.519136+0000","last_clean":"2023-12-24T19:57:58.519136+0000","last_became_active":"2023-12-24T19:57:58.518721+0000","last_became_peered":"2023-12-24T19:57:58.518721+0000","last_unstale":"2023-12-24T19:57:58.519136+0000","last_undegraded":"2023-12-24T19:57:58.519136+0000","last_fullsized":"2023-12-24T19:57:58.519136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:02.701078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.526250+0000","last_change":"2023-12-24T19:57:58.526179+0000","last_active":"2023-12-24T19:57:58.526250+0000","last_peered":"2023-12-24T19:57:58.526250+0000","last_clean":"2023-12-24T19:57:58.526250+0000","last_became_active":"2023-12-24T19:57:58.525741+0000","last_became_peered":"2023-12-24T19:57:58.525741+0000","last_unstale":"2023-12-24T19:57:58.526250+0000","last_undegraded":"2023-12-24T19:57:58.526250+0000","last_fullsized":"2023-12-24T19:57:58.526250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:27.726129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523001+0000","last_change":"2023-12-24T19:57:58.522725+0000","last_active":"2023-12-24T19:57:58.523001+0000","last_peered":"2023-12-24T19:57:58.523001+0000","last_clean":"2023-12-24T19:57:58.523001+0000","last_became_active":"2023-12-24T19:57:58.522134+0000","last_became_peered":"2023-12-24T19:57:58.522134+0000","last_unstale":"2023-12-24T19:57:58.523001+0000","last_undegraded":"2023-12-24T19:57:58.523001+0000","last_fullsized":"2023-12-24T19:57:58.523001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:42.515021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520654+0000","last_change":"2023-12-24T19:57:58.520587+0000","last_active":"2023-12-24T19:57:58.520654+0000","last_peered":"2023-12-24T19:57:58.520654+0000","last_clean":"2023-12-24T19:57:58.520654+0000","last_became_active":"2023-12-24T19:57:58.520344+0000","last_became_peered":"2023-12-24T19:57:58.520344+0000","last_unstale":"2023-12-24T19:57:58.520654+0000","last_undegraded":"2023-12-24T19:57:58.520654+0000","last_fullsized":"2023-12-24T19:57:58.520654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:27.726129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.526917+0000","last_change":"2023-12-24T19:57:58.526823+0000","last_active":"2023-12-24T19:57:58.526917+0000","last_peered":"2023-12-24T19:57:58.526917+0000","last_clean":"2023-12-24T19:57:58.526917+0000","last_became_active":"2023-12-24T19:57:58.526590+0000","last_became_peered":"2023-12-24T19:57:58.526590+0000","last_unstale":"2023-12-24T19:57:58.526917+0000","last_undegraded":"2023-12-24T19:57:58.526917+0000","last_fullsized":"2023-12-24T19:57:58.526917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:20:19.721200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.517253+0000","last_change":"2023-12-24T19:57:58.517188+0000","last_active":"2023-12-24T19:57:58.517253+0000","last_peered":"2023-12-24T19:57:58.517253+0000","last_clean":"2023-12-24T19:57:58.517253+0000","last_became_active":"2023-12-24T19:57:58.516967+0000","last_became_peered":"2023-12-24T19:57:58.516967+0000","last_unstale":"2023-12-24T19:57:58.517253+0000","last_undegraded":"2023-12-24T19:57:58.517253+0000","last_fullsized":"2023-12-24T19:57:58.517253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:05.595141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.780601+0000","last_change":"2023-12-24T19:57:57.760090+0000","last_active":"2023-12-24T19:57:58.780601+0000","last_peered":"2023-12-24T19:57:58.780601+0000","last_clean":"2023-12-24T19:57:58.780601+0000","last_became_active":"2023-12-24T19:57:57.759215+0000","last_became_peered":"2023-12-24T19:57:57.759215+0000","last_unstale":"2023-12-24T19:57:58.780601+0000","last_undegraded":"2023-12-24T19:57:58.780601+0000","last_fullsized":"2023-12-24T19:57:58.780601+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:53.813406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518008+0000","last_change":"2023-12-24T19:57:58.517926+0000","last_active":"2023-12-24T19:57:58.518008+0000","last_peered":"2023-12-24T19:57:58.518008+0000","last_clean":"2023-12-24T19:57:58.518008+0000","last_became_active":"2023-12-24T19:57:58.517663+0000","last_became_peered":"2023-12-24T19:57:58.517663+0000","last_unstale":"2023-12-24T19:57:58.518008+0000","last_undegraded":"2023-12-24T19:57:58.518008+0000","last_fullsized":"2023-12-24T19:57:58.518008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:20:45.757755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.778611+0000","last_change":"2023-12-24T19:57:57.758463+0000","last_active":"2023-12-24T19:57:58.778611+0000","last_peered":"2023-12-24T19:57:58.778611+0000","last_clean":"2023-12-24T19:57:58.778611+0000","last_became_active":"2023-12-24T19:57:57.758233+0000","last_became_peered":"2023-12-24T19:57:57.758233+0000","last_unstale":"2023-12-24T19:57:58.778611+0000","last_undegraded":"2023-12-24T19:57:58.778611+0000","last_fullsized":"2023-12-24T19:57:58.778611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:51.245549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525043+0000","last_change":"2023-12-24T19:57:58.524938+0000","last_active":"2023-12-24T19:57:58.525043+0000","last_peered":"2023-12-24T19:57:58.525043+0000","last_clean":"2023-12-24T19:57:58.525043+0000","last_became_active":"2023-12-24T19:57:58.524379+0000","last_became_peered":"2023-12-24T19:57:58.524379+0000","last_unstale":"2023-12-24T19:57:58.525043+0000","last_undegraded":"2023-12-24T19:57:58.525043+0000","last_fullsized":"2023-12-24T19:57:58.525043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:42:19.167753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.781280+0000","last_change":"2023-12-24T19:57:57.755534+0000","last_active":"2023-12-24T19:57:58.781280+0000","last_peered":"2023-12-24T19:57:58.781280+0000","last_clean":"2023-12-24T19:57:58.781280+0000","last_became_active":"2023-12-24T19:57:57.755041+0000","last_became_peered":"2023-12-24T19:57:57.755041+0000","last_unstale":"2023-12-24T19:57:58.781280+0000","last_undegraded":"2023-12-24T19:57:58.781280+0000","last_fullsized":"2023-12-24T19:57:58.781280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:40:31.820818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.517206+0000","last_change":"2023-12-24T19:57:58.517142+0000","last_active":"2023-12-24T19:57:58.517206+0000","last_peered":"2023-12-24T19:57:58.517206+0000","last_clean":"2023-12-24T19:57:58.517206+0000","last_became_active":"2023-12-24T19:57:58.516899+0000","last_became_peered":"2023-12-24T19:57:58.516899+0000","last_unstale":"2023-12-24T19:57:58.517206+0000","last_undegraded":"2023-12-24T19:57:58.517206+0000","last_fullsized":"2023-12-24T19:57:58.517206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:08.199656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.779797+0000","last_change":"2023-12-24T19:57:57.754946+0000","last_active":"2023-12-24T19:57:58.779797+0000","last_peered":"2023-12-24T19:57:58.779797+0000","last_clean":"2023-12-24T19:57:58.779797+0000","last_became_active":"2023-12-24T19:57:57.754691+0000","last_became_peered":"2023-12-24T19:57:57.754691+0000","last_unstale":"2023-12-24T19:57:58.779797+0000","last_undegraded":"2023-12-24T19:57:58.779797+0000","last_fullsized":"2023-12-24T19:57:58.779797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:33.995091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.526426+0000","last_change":"2023-12-24T19:57:58.526361+0000","last_active":"2023-12-24T19:57:58.526426+0000","last_peered":"2023-12-24T19:57:58.526426+0000","last_clean":"2023-12-24T19:57:58.526426+0000","last_became_active":"2023-12-24T19:57:58.523442+0000","last_became_peered":"2023-12-24T19:57:58.523442+0000","last_unstale":"2023-12-24T19:57:58.526426+0000","last_undegraded":"2023-12-24T19:57:58.526426+0000","last_fullsized":"2023-12-24T19:57:58.526426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:06:27.726827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.781320+0000","last_change":"2023-12-24T19:57:57.759223+0000","last_active":"2023-12-24T19:57:58.781320+0000","last_peered":"2023-12-24T19:57:58.781320+0000","last_clean":"2023-12-24T19:57:58.781320+0000","last_became_active":"2023-12-24T19:57:57.758815+0000","last_became_peered":"2023-12-24T19:57:57.758815+0000","last_unstale":"2023-12-24T19:57:58.781320+0000","last_undegraded":"2023-12-24T19:57:58.781320+0000","last_fullsized":"2023-12-24T19:57:58.781320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:35.928823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.512253+0000","last_change":"2023-12-24T19:57:58.512177+0000","last_active":"2023-12-24T19:57:58.512253+0000","last_peered":"2023-12-24T19:57:58.512253+0000","last_clean":"2023-12-24T19:57:58.512253+0000","last_became_active":"2023-12-24T19:57:58.511889+0000","last_became_peered":"2023-12-24T19:57:58.511889+0000","last_unstale":"2023-12-24T19:57:58.512253+0000","last_undegraded":"2023-12-24T19:57:58.512253+0000","last_fullsized":"2023-12-24T19:57:58.512253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:42.434307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.781485+0000","last_change":"2023-12-24T19:57:57.754559+0000","last_active":"2023-12-24T19:57:58.781485+0000","last_peered":"2023-12-24T19:57:58.781485+0000","last_clean":"2023-12-24T19:57:58.781485+0000","last_became_active":"2023-12-24T19:57:57.753910+0000","last_became_peered":"2023-12-24T19:57:57.753910+0000","last_unstale":"2023-12-24T19:57:58.781485+0000","last_undegraded":"2023-12-24T19:57:58.781485+0000","last_fullsized":"2023-12-24T19:57:58.781485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:06:50.611506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523850+0000","last_change":"2023-12-24T19:57:58.521533+0000","last_active":"2023-12-24T19:57:58.523850+0000","last_peered":"2023-12-24T19:57:58.523850+0000","last_clean":"2023-12-24T19:57:58.523850+0000","last_became_active":"2023-12-24T19:57:58.520911+0000","last_became_peered":"2023-12-24T19:57:58.520911+0000","last_unstale":"2023-12-24T19:57:58.523850+0000","last_undegraded":"2023-12-24T19:57:58.523850+0000","last_fullsized":"2023-12-24T19:57:58.523850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:17:45.293694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.515664+0000","last_change":"2023-12-24T19:57:57.755198+0000","last_active":"2023-12-24T19:57:58.515664+0000","last_peered":"2023-12-24T19:57:58.515664+0000","last_clean":"2023-12-24T19:57:58.515664+0000","last_became_active":"2023-12-24T19:57:57.754578+0000","last_became_peered":"2023-12-24T19:57:57.754578+0000","last_unstale":"2023-12-24T19:57:58.515664+0000","last_undegraded":"2023-12-24T19:57:58.515664+0000","last_fullsized":"2023-12-24T19:57:58.515664+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:57:00.825816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521269+0000","last_change":"2023-12-24T19:57:58.521096+0000","last_active":"2023-12-24T19:57:58.521269+0000","last_peered":"2023-12-24T19:57:58.521269+0000","last_clean":"2023-12-24T19:57:58.521269+0000","last_became_active":"2023-12-24T19:57:58.520881+0000","last_became_peered":"2023-12-24T19:57:58.520881+0000","last_unstale":"2023-12-24T19:57:58.521269+0000","last_undegraded":"2023-12-24T19:57:58.521269+0000","last_fullsized":"2023-12-24T19:57:58.521269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:29:26.157021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.515854+0000","last_change":"2023-12-24T19:57:57.761999+0000","last_active":"2023-12-24T19:57:58.515854+0000","last_peered":"2023-12-24T19:57:58.515854+0000","last_clean":"2023-12-24T19:57:58.515854+0000","last_became_active":"2023-12-24T19:57:57.760804+0000","last_became_peered":"2023-12-24T19:57:57.760804+0000","last_unstale":"2023-12-24T19:57:58.515854+0000","last_undegraded":"2023-12-24T19:57:58.515854+0000","last_fullsized":"2023-12-24T19:57:58.515854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:23.852195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520281+0000","last_change":"2023-12-24T19:57:58.519857+0000","last_active":"2023-12-24T19:57:58.520281+0000","last_peered":"2023-12-24T19:57:58.520281+0000","last_clean":"2023-12-24T19:57:58.520281+0000","last_became_active":"2023-12-24T19:57:58.519312+0000","last_became_peered":"2023-12-24T19:57:58.519312+0000","last_unstale":"2023-12-24T19:57:58.520281+0000","last_undegraded":"2023-12-24T19:57:58.520281+0000","last_fullsized":"2023-12-24T19:57:58.520281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:31:00.573397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.516615+0000","last_change":"2023-12-24T19:57:57.759247+0000","last_active":"2023-12-24T19:57:58.516615+0000","last_peered":"2023-12-24T19:57:58.516615+0000","last_clean":"2023-12-24T19:57:58.516615+0000","last_became_active":"2023-12-24T19:57:57.759082+0000","last_became_peered":"2023-12-24T19:57:57.759082+0000","last_unstale":"2023-12-24T19:57:58.516615+0000","last_undegraded":"2023-12-24T19:57:58.516615+0000","last_fullsized":"2023-12-24T19:57:58.516615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:26.719700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521534+0000","last_change":"2023-12-24T19:57:58.521362+0000","last_active":"2023-12-24T19:57:58.521534+0000","last_peered":"2023-12-24T19:57:58.521534+0000","last_clean":"2023-12-24T19:57:58.521534+0000","last_became_active":"2023-12-24T19:57:58.520770+0000","last_became_peered":"2023-12-24T19:57:58.520770+0000","last_unstale":"2023-12-24T19:57:58.521534+0000","last_undegraded":"2023-12-24T19:57:58.521534+0000","last_fullsized":"2023-12-24T19:57:58.521534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:08:39.765581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.508967+0000","last_change":"2023-12-24T19:57:57.757771+0000","last_active":"2023-12-24T19:57:58.508967+0000","last_peered":"2023-12-24T19:57:58.508967+0000","last_clean":"2023-12-24T19:57:58.508967+0000","last_became_active":"2023-12-24T19:57:57.757535+0000","last_became_peered":"2023-12-24T19:57:57.757535+0000","last_unstale":"2023-12-24T19:57:58.508967+0000","last_undegraded":"2023-12-24T19:57:58.508967+0000","last_fullsized":"2023-12-24T19:57:58.508967+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:22:40.100390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521549+0000","last_change":"2023-12-24T19:57:58.521378+0000","last_active":"2023-12-24T19:57:58.521549+0000","last_peered":"2023-12-24T19:57:58.521549+0000","last_clean":"2023-12-24T19:57:58.521549+0000","last_became_active":"2023-12-24T19:57:58.520817+0000","last_became_peered":"2023-12-24T19:57:58.520817+0000","last_unstale":"2023-12-24T19:57:58.521549+0000","last_undegraded":"2023-12-24T19:57:58.521549+0000","last_fullsized":"2023-12-24T19:57:58.521549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:51.125001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.780538+0000","last_change":"2023-12-24T19:57:57.758289+0000","last_active":"2023-12-24T19:57:58.780538+0000","last_peered":"2023-12-24T19:57:58.780538+0000","last_clean":"2023-12-24T19:57:58.780538+0000","last_became_active":"2023-12-24T19:57:57.758033+0000","last_became_peered":"2023-12-24T19:57:57.758033+0000","last_unstale":"2023-12-24T19:57:58.780538+0000","last_undegraded":"2023-12-24T19:57:58.780538+0000","last_fullsized":"2023-12-24T19:57:58.780538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:39.987950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514462+0000","last_change":"2023-12-24T19:57:58.514222+0000","last_active":"2023-12-24T19:57:58.514462+0000","last_peered":"2023-12-24T19:57:58.514462+0000","last_clean":"2023-12-24T19:57:58.514462+0000","last_became_active":"2023-12-24T19:57:58.513668+0000","last_became_peered":"2023-12-24T19:57:58.513668+0000","last_unstale":"2023-12-24T19:57:58.514462+0000","last_undegraded":"2023-12-24T19:57:58.514462+0000","last_fullsized":"2023-12-24T19:57:58.514462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:51.125001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.784399+0000","last_change":"2023-12-24T19:57:57.755036+0000","last_active":"2023-12-24T19:57:58.784399+0000","last_peered":"2023-12-24T19:57:58.784399+0000","last_clean":"2023-12-24T19:57:58.784399+0000","last_became_active":"2023-12-24T19:57:57.754056+0000","last_became_peered":"2023-12-24T19:57:57.754056+0000","last_unstale":"2023-12-24T19:57:58.784399+0000","last_undegraded":"2023-12-24T19:57:58.784399+0000","last_fullsized":"2023-12-24T19:57:58.784399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:04.588712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.516246+0000","last_change":"2023-12-24T19:57:58.515747+0000","last_active":"2023-12-24T19:57:58.516246+0000","last_peered":"2023-12-24T19:57:58.516246+0000","last_clean":"2023-12-24T19:57:58.516246+0000","last_became_active":"2023-12-24T19:57:58.515515+0000","last_became_peered":"2023-12-24T19:57:58.515515+0000","last_unstale":"2023-12-24T19:57:58.516246+0000","last_undegraded":"2023-12-24T19:57:58.516246+0000","last_fullsized":"2023-12-24T19:57:58.516246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:17:45.293694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.779911+0000","last_change":"2023-12-24T19:57:57.761814+0000","last_active":"2023-12-24T19:57:58.779911+0000","last_peered":"2023-12-24T19:57:58.779911+0000","last_clean":"2023-12-24T19:57:58.779911+0000","last_became_active":"2023-12-24T19:57:57.760466+0000","last_became_peered":"2023-12-24T19:57:57.760466+0000","last_unstale":"2023-12-24T19:57:58.779911+0000","last_undegraded":"2023-12-24T19:57:58.779911+0000","last_fullsized":"2023-12-24T19:57:58.779911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:08:37.588856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518005+0000","last_change":"2023-12-24T19:57:58.517397+0000","last_active":"2023-12-24T19:57:58.518005+0000","last_peered":"2023-12-24T19:57:58.518005+0000","last_clean":"2023-12-24T19:57:58.518005+0000","last_became_active":"2023-12-24T19:57:58.517158+0000","last_became_peered":"2023-12-24T19:57:58.517158+0000","last_unstale":"2023-12-24T19:57:58.518005+0000","last_undegraded":"2023-12-24T19:57:58.518005+0000","last_fullsized":"2023-12-24T19:57:58.518005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:59.151270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.513108+0000","last_change":"2023-12-24T19:57:57.760838+0000","last_active":"2023-12-24T19:57:58.513108+0000","last_peered":"2023-12-24T19:57:58.513108+0000","last_clean":"2023-12-24T19:57:58.513108+0000","last_became_active":"2023-12-24T19:57:57.760615+0000","last_became_peered":"2023-12-24T19:57:57.760615+0000","last_unstale":"2023-12-24T19:57:58.513108+0000","last_undegraded":"2023-12-24T19:57:58.513108+0000","last_fullsized":"2023-12-24T19:57:58.513108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:49.895852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.526301+0000","last_change":"2023-12-24T19:57:58.523849+0000","last_active":"2023-12-24T19:57:58.526301+0000","last_peered":"2023-12-24T19:57:58.526301+0000","last_clean":"2023-12-24T19:57:58.526301+0000","last_became_active":"2023-12-24T19:57:58.523096+0000","last_became_peered":"2023-12-24T19:57:58.523096+0000","last_unstale":"2023-12-24T19:57:58.526301+0000","last_undegraded":"2023-12-24T19:57:58.526301+0000","last_fullsized":"2023-12-24T19:57:58.526301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:09:02.074503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.516813+0000","last_change":"2023-12-24T19:57:57.758697+0000","last_active":"2023-12-24T19:57:58.516813+0000","last_peered":"2023-12-24T19:57:58.516813+0000","last_clean":"2023-12-24T19:57:58.516813+0000","last_became_active":"2023-12-24T19:57:57.758328+0000","last_became_peered":"2023-12-24T19:57:57.758328+0000","last_unstale":"2023-12-24T19:57:58.516813+0000","last_undegraded":"2023-12-24T19:57:58.516813+0000","last_fullsized":"2023-12-24T19:57:58.516813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:39.987950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525722+0000","last_change":"2023-12-24T19:57:58.525652+0000","last_active":"2023-12-24T19:57:58.525722+0000","last_peered":"2023-12-24T19:57:58.525722+0000","last_clean":"2023-12-24T19:57:58.525722+0000","last_became_active":"2023-12-24T19:57:58.525390+0000","last_became_peered":"2023-12-24T19:57:58.525390+0000","last_unstale":"2023-12-24T19:57:58.525722+0000","last_undegraded":"2023-12-24T19:57:58.525722+0000","last_fullsized":"2023-12-24T19:57:58.525722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:40.994379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.782605+0000","last_change":"2023-12-24T19:57:57.753774+0000","last_active":"2023-12-24T19:57:58.782605+0000","last_peered":"2023-12-24T19:57:58.782605+0000","last_clean":"2023-12-24T19:57:58.782605+0000","last_became_active":"2023-12-24T19:57:57.753506+0000","last_became_peered":"2023-12-24T19:57:57.753506+0000","last_unstale":"2023-12-24T19:57:58.782605+0000","last_undegraded":"2023-12-24T19:57:58.782605+0000","last_fullsized":"2023-12-24T19:57:58.782605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:32.859719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523944+0000","last_change":"2023-12-24T19:57:58.521684+0000","last_active":"2023-12-24T19:57:58.523944+0000","last_peered":"2023-12-24T19:57:58.523944+0000","last_clean":"2023-12-24T19:57:58.523944+0000","last_became_active":"2023-12-24T19:57:58.521290+0000","last_became_peered":"2023-12-24T19:57:58.521290+0000","last_unstale":"2023-12-24T19:57:58.523944+0000","last_undegraded":"2023-12-24T19:57:58.523944+0000","last_fullsized":"2023-12-24T19:57:58.523944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:31.588092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.782166+0000","last_change":"2023-12-24T19:57:57.759095+0000","last_active":"2023-12-24T19:57:58.782166+0000","last_peered":"2023-12-24T19:57:58.782166+0000","last_clean":"2023-12-24T19:57:58.782166+0000","last_became_active":"2023-12-24T19:57:57.755014+0000","last_became_peered":"2023-12-24T19:57:57.755014+0000","last_unstale":"2023-12-24T19:57:58.782166+0000","last_undegraded":"2023-12-24T19:57:58.782166+0000","last_fullsized":"2023-12-24T19:57:58.782166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:51.245549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.524727+0000","last_change":"2023-12-24T19:57:58.524653+0000","last_active":"2023-12-24T19:57:58.524727+0000","last_peered":"2023-12-24T19:57:58.524727+0000","last_clean":"2023-12-24T19:57:58.524727+0000","last_became_active":"2023-12-24T19:57:58.524217+0000","last_became_peered":"2023-12-24T19:57:58.524217+0000","last_unstale":"2023-12-24T19:57:58.524727+0000","last_undegraded":"2023-12-24T19:57:58.524727+0000","last_fullsized":"2023-12-24T19:57:58.524727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:26:31.588092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.779538+0000","last_change":"2023-12-24T19:57:57.761362+0000","last_active":"2023-12-24T19:57:58.779538+0000","last_peered":"2023-12-24T19:57:58.779538+0000","last_clean":"2023-12-24T19:57:58.779538+0000","last_became_active":"2023-12-24T19:57:57.760126+0000","last_became_peered":"2023-12-24T19:57:57.760126+0000","last_unstale":"2023-12-24T19:57:58.779538+0000","last_undegraded":"2023-12-24T19:57:58.779538+0000","last_fullsized":"2023-12-24T19:57:58.779538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:34.023511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.525729+0000","last_change":"2023-12-24T19:57:58.525638+0000","last_active":"2023-12-24T19:57:58.525729+0000","last_peered":"2023-12-24T19:57:58.525729+0000","last_clean":"2023-12-24T19:57:58.525729+0000","last_became_active":"2023-12-24T19:57:58.525103+0000","last_became_peered":"2023-12-24T19:57:58.525103+0000","last_unstale":"2023-12-24T19:57:58.525729+0000","last_undegraded":"2023-12-24T19:57:58.525729+0000","last_fullsized":"2023-12-24T19:57:58.525729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:08:59.240415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.779816+0000","last_change":"2023-12-24T19:57:57.756610+0000","last_active":"2023-12-24T19:57:58.779816+0000","last_peered":"2023-12-24T19:57:58.779816+0000","last_clean":"2023-12-24T19:57:58.779816+0000","last_became_active":"2023-12-24T19:57:57.756335+0000","last_became_peered":"2023-12-24T19:57:57.756335+0000","last_unstale":"2023-12-24T19:57:58.779816+0000","last_undegraded":"2023-12-24T19:57:58.779816+0000","last_fullsized":"2023-12-24T19:57:58.779816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:20.134833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.520949+0000","last_change":"2023-12-24T19:57:58.520644+0000","last_active":"2023-12-24T19:57:58.520949+0000","last_peered":"2023-12-24T19:57:58.520949+0000","last_clean":"2023-12-24T19:57:58.520949+0000","last_became_active":"2023-12-24T19:57:58.520406+0000","last_became_peered":"2023-12-24T19:57:58.520406+0000","last_unstale":"2023-12-24T19:57:58.520949+0000","last_undegraded":"2023-12-24T19:57:58.520949+0000","last_fullsized":"2023-12-24T19:57:58.520949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:52.251978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523190+0000","last_change":"2023-12-24T19:57:57.759051+0000","last_active":"2023-12-24T19:57:58.523190+0000","last_peered":"2023-12-24T19:57:58.523190+0000","last_clean":"2023-12-24T19:57:58.523190+0000","last_became_active":"2023-12-24T19:57:57.758499+0000","last_became_peered":"2023-12-24T19:57:57.758499+0000","last_unstale":"2023-12-24T19:57:58.523190+0000","last_undegraded":"2023-12-24T19:57:58.523190+0000","last_fullsized":"2023-12-24T19:57:58.523190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:53.813406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521769+0000","last_change":"2023-12-24T19:57:58.521694+0000","last_active":"2023-12-24T19:57:58.521769+0000","last_peered":"2023-12-24T19:57:58.521769+0000","last_clean":"2023-12-24T19:57:58.521769+0000","last_became_active":"2023-12-24T19:57:58.521457+0000","last_became_peered":"2023-12-24T19:57:58.521457+0000","last_unstale":"2023-12-24T19:57:58.521769+0000","last_undegraded":"2023-12-24T19:57:58.521769+0000","last_fullsized":"2023-12-24T19:57:58.521769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:08:38.595285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.779474+0000","last_change":"2023-12-24T19:57:57.753078+0000","last_active":"2023-12-24T19:57:58.779474+0000","last_peered":"2023-12-24T19:57:58.779474+0000","last_clean":"2023-12-24T19:57:58.779474+0000","last_became_active":"2023-12-24T19:57:57.752509+0000","last_became_peered":"2023-12-24T19:57:57.752509+0000","last_unstale":"2023-12-24T19:57:58.779474+0000","last_undegraded":"2023-12-24T19:57:58.779474+0000","last_fullsized":"2023-12-24T19:57:58.779474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:40:31.820818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514347+0000","last_change":"2023-12-24T19:57:58.513681+0000","last_active":"2023-12-24T19:57:58.514347+0000","last_peered":"2023-12-24T19:57:58.514347+0000","last_clean":"2023-12-24T19:57:58.514347+0000","last_became_active":"2023-12-24T19:57:58.512847+0000","last_became_peered":"2023-12-24T19:57:58.512847+0000","last_unstale":"2023-12-24T19:57:58.514347+0000","last_undegraded":"2023-12-24T19:57:58.514347+0000","last_fullsized":"2023-12-24T19:57:58.514347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:15:54.819835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.512781+0000","last_change":"2023-12-24T19:57:57.761251+0000","last_active":"2023-12-24T19:57:58.512781+0000","last_peered":"2023-12-24T19:57:58.512781+0000","last_clean":"2023-12-24T19:57:58.512781+0000","last_became_active":"2023-12-24T19:57:57.760988+0000","last_became_peered":"2023-12-24T19:57:57.760988+0000","last_unstale":"2023-12-24T19:57:58.512781+0000","last_undegraded":"2023-12-24T19:57:58.512781+0000","last_fullsized":"2023-12-24T19:57:58.512781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:08:37.588856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.511720+0000","last_change":"2023-12-24T19:57:58.511541+0000","last_active":"2023-12-24T19:57:58.511720+0000","last_peered":"2023-12-24T19:57:58.511720+0000","last_clean":"2023-12-24T19:57:58.511720+0000","last_became_active":"2023-12-24T19:57:58.511279+0000","last_became_peered":"2023-12-24T19:57:58.511279+0000","last_unstale":"2023-12-24T19:57:58.511720+0000","last_undegraded":"2023-12-24T19:57:58.511720+0000","last_fullsized":"2023-12-24T19:57:58.511720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:21.141262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.516062+0000","last_change":"2023-12-24T19:57:57.762387+0000","last_active":"2023-12-24T19:57:58.516062+0000","last_peered":"2023-12-24T19:57:58.516062+0000","last_clean":"2023-12-24T19:57:58.516062+0000","last_became_active":"2023-12-24T19:57:57.761616+0000","last_became_peered":"2023-12-24T19:57:57.761616+0000","last_unstale":"2023-12-24T19:57:58.516062+0000","last_undegraded":"2023-12-24T19:57:58.516062+0000","last_fullsized":"2023-12-24T19:57:58.516062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:57:02.016336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523020+0000","last_change":"2023-12-24T19:57:58.522894+0000","last_active":"2023-12-24T19:57:58.523020+0000","last_peered":"2023-12-24T19:57:58.523020+0000","last_clean":"2023-12-24T19:57:58.523020+0000","last_became_active":"2023-12-24T19:57:58.522449+0000","last_became_peered":"2023-12-24T19:57:58.522449+0000","last_unstale":"2023-12-24T19:57:58.523020+0000","last_undegraded":"2023-12-24T19:57:58.523020+0000","last_fullsized":"2023-12-24T19:57:58.523020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:08.199656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.510158+0000","last_change":"2023-12-24T19:57:57.758998+0000","last_active":"2023-12-24T19:57:58.510158+0000","last_peered":"2023-12-24T19:57:58.510158+0000","last_clean":"2023-12-24T19:57:58.510158+0000","last_became_active":"2023-12-24T19:57:57.758744+0000","last_became_peered":"2023-12-24T19:57:57.758744+0000","last_unstale":"2023-12-24T19:57:58.510158+0000","last_undegraded":"2023-12-24T19:57:58.510158+0000","last_fullsized":"2023-12-24T19:57:58.510158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:36.063035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514364+0000","last_change":"2023-12-24T19:57:58.514128+0000","last_active":"2023-12-24T19:57:58.514364+0000","last_peered":"2023-12-24T19:57:58.514364+0000","last_clean":"2023-12-24T19:57:58.514364+0000","last_became_active":"2023-12-24T19:57:58.513157+0000","last_became_peered":"2023-12-24T19:57:58.513157+0000","last_unstale":"2023-12-24T19:57:58.514364+0000","last_undegraded":"2023-12-24T19:57:58.514364+0000","last_fullsized":"2023-12-24T19:57:58.514364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:22:41.106819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.780844+0000","last_change":"2023-12-24T19:57:57.757975+0000","last_active":"2023-12-24T19:57:58.780844+0000","last_peered":"2023-12-24T19:57:58.780844+0000","last_clean":"2023-12-24T19:57:58.780844+0000","last_became_active":"2023-12-24T19:57:57.756924+0000","last_became_peered":"2023-12-24T19:57:57.756924+0000","last_unstale":"2023-12-24T19:57:58.780844+0000","last_undegraded":"2023-12-24T19:57:58.780844+0000","last_fullsized":"2023-12-24T19:57:58.780844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:32.859719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.514072+0000","last_change":"2023-12-24T19:57:58.514007+0000","last_active":"2023-12-24T19:57:58.514072+0000","last_peered":"2023-12-24T19:57:58.514072+0000","last_clean":"2023-12-24T19:57:58.514072+0000","last_became_active":"2023-12-24T19:57:58.513750+0000","last_became_peered":"2023-12-24T19:57:58.513750+0000","last_unstale":"2023-12-24T19:57:58.514072+0000","last_undegraded":"2023-12-24T19:57:58.514072+0000","last_fullsized":"2023-12-24T19:57:58.514072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:00:08.199656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.509326+0000","last_change":"2023-12-24T19:57:57.753234+0000","last_active":"2023-12-24T19:57:58.509326+0000","last_peered":"2023-12-24T19:57:58.509326+0000","last_clean":"2023-12-24T19:57:58.509326+0000","last_became_active":"2023-12-24T19:57:57.752826+0000","last_became_peered":"2023-12-24T19:57:57.752826+0000","last_unstale":"2023-12-24T19:57:58.509326+0000","last_undegraded":"2023-12-24T19:57:58.509326+0000","last_fullsized":"2023-12-24T19:57:58.509326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:14:00.148083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.513966+0000","last_change":"2023-12-24T19:57:58.513898+0000","last_active":"2023-12-24T19:57:58.513966+0000","last_peered":"2023-12-24T19:57:58.513966+0000","last_clean":"2023-12-24T19:57:58.513966+0000","last_became_active":"2023-12-24T19:57:58.513671+0000","last_became_peered":"2023-12-24T19:57:58.513671+0000","last_unstale":"2023-12-24T19:57:58.513966+0000","last_undegraded":"2023-12-24T19:57:58.513966+0000","last_fullsized":"2023-12-24T19:57:58.513966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:42:19.167753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.513687+0000","last_change":"2023-12-24T19:57:57.752924+0000","last_active":"2023-12-24T19:57:58.513687+0000","last_peered":"2023-12-24T19:57:58.513687+0000","last_clean":"2023-12-24T19:57:58.513687+0000","last_became_active":"2023-12-24T19:57:57.752678+0000","last_became_peered":"2023-12-24T19:57:57.752678+0000","last_unstale":"2023-12-24T19:57:58.513687+0000","last_undegraded":"2023-12-24T19:57:58.513687+0000","last_fullsized":"2023-12-24T19:57:58.513687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:40:31.820818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.515444+0000","last_change":"2023-12-24T19:57:58.515360+0000","last_active":"2023-12-24T19:57:58.515444+0000","last_peered":"2023-12-24T19:57:58.515444+0000","last_clean":"2023-12-24T19:57:58.515444+0000","last_became_active":"2023-12-24T19:57:58.515127+0000","last_became_peered":"2023-12-24T19:57:58.515127+0000","last_unstale":"2023-12-24T19:57:58.515444+0000","last_undegraded":"2023-12-24T19:57:58.515444+0000","last_fullsized":"2023-12-24T19:57:58.515444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:39:37.069464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.509225+0000","last_change":"2023-12-24T19:57:57.756429+0000","last_active":"2023-12-24T19:57:58.509225+0000","last_peered":"2023-12-24T19:57:58.509225+0000","last_clean":"2023-12-24T19:57:58.509225+0000","last_became_active":"2023-12-24T19:57:57.756192+0000","last_became_peered":"2023-12-24T19:57:57.756192+0000","last_unstale":"2023-12-24T19:57:58.509225+0000","last_undegraded":"2023-12-24T19:57:58.509225+0000","last_fullsized":"2023-12-24T19:57:58.509225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:49.895852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.518008+0000","last_change":"2023-12-24T19:57:58.517945+0000","last_active":"2023-12-24T19:57:58.518008+0000","last_peered":"2023-12-24T19:57:58.518008+0000","last_clean":"2023-12-24T19:57:58.518008+0000","last_became_active":"2023-12-24T19:57:58.517701+0000","last_became_peered":"2023-12-24T19:57:58.517701+0000","last_unstale":"2023-12-24T19:57:58.518008+0000","last_undegraded":"2023-12-24T19:57:58.518008+0000","last_fullsized":"2023-12-24T19:57:58.518008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:41.279569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.513323+0000","last_change":"2023-12-24T19:57:57.758157+0000","last_active":"2023-12-24T19:57:58.513323+0000","last_peered":"2023-12-24T19:57:58.513323+0000","last_clean":"2023-12-24T19:57:58.513323+0000","last_became_active":"2023-12-24T19:57:57.757267+0000","last_became_peered":"2023-12-24T19:57:57.757267+0000","last_unstale":"2023-12-24T19:57:58.513323+0000","last_undegraded":"2023-12-24T19:57:58.513323+0000","last_fullsized":"2023-12-24T19:57:58.513323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:22:40.100390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.521453+0000","last_change":"2023-12-24T19:57:58.520602+0000","last_active":"2023-12-24T19:57:58.521453+0000","last_peered":"2023-12-24T19:57:58.521453+0000","last_clean":"2023-12-24T19:57:58.521453+0000","last_became_active":"2023-12-24T19:57:58.519255+0000","last_became_peered":"2023-12-24T19:57:58.519255+0000","last_unstale":"2023-12-24T19:57:58.521453+0000","last_undegraded":"2023-12-24T19:57:58.521453+0000","last_fullsized":"2023-12-24T19:57:58.521453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:20:19.721200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.515650+0000","last_change":"2023-12-24T19:57:57.754725+0000","last_active":"2023-12-24T19:57:58.515650+0000","last_peered":"2023-12-24T19:57:58.515650+0000","last_clean":"2023-12-24T19:57:58.515650+0000","last_became_active":"2023-12-24T19:57:57.754264+0000","last_became_peered":"2023-12-24T19:57:57.754264+0000","last_unstale":"2023-12-24T19:57:58.515650+0000","last_undegraded":"2023-12-24T19:57:58.515650+0000","last_fullsized":"2023-12-24T19:57:58.515650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:21.762387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.523830+0000","last_change":"2023-12-24T19:57:58.520753+0000","last_active":"2023-12-24T19:57:58.523830+0000","last_peered":"2023-12-24T19:57:58.523830+0000","last_clean":"2023-12-24T19:57:58.523830+0000","last_became_active":"2023-12-24T19:57:58.520485+0000","last_became_peered":"2023-12-24T19:57:58.520485+0000","last_unstale":"2023-12-24T19:57:58.523830+0000","last_undegraded":"2023-12-24T19:57:58.523830+0000","last_fullsized":"2023-12-24T19:57:58.523830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:20:45.757755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.515559+0000","last_change":"2023-12-24T19:57:57.758422+0000","last_active":"2023-12-24T19:57:58.515559+0000","last_peered":"2023-12-24T19:57:58.515559+0000","last_clean":"2023-12-24T19:57:58.515559+0000","last_became_active":"2023-12-24T19:57:57.758173+0000","last_became_peered":"2023-12-24T19:57:57.758173+0000","last_unstale":"2023-12-24T19:57:58.515559+0000","last_undegraded":"2023-12-24T19:57:58.515559+0000","last_fullsized":"2023-12-24T19:57:58.515559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:20:44.751326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.519823+0000","last_change":"2023-12-24T19:57:58.519750+0000","last_active":"2023-12-24T19:57:58.519823+0000","last_peered":"2023-12-24T19:57:58.519823+0000","last_clean":"2023-12-24T19:57:58.519823+0000","last_became_active":"2023-12-24T19:57:58.519389+0000","last_became_peered":"2023-12-24T19:57:58.519389+0000","last_unstale":"2023-12-24T19:57:58.519823+0000","last_undegraded":"2023-12-24T19:57:58.519823+0000","last_fullsized":"2023-12-24T19:57:58.519823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:57.743068+0000","last_clean_scrub_stamp":"2023-12-24T19:57:57.743068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:02.701078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.512914+0000","last_change":"2023-12-24T19:57:57.759746+0000","last_active":"2023-12-24T19:57:58.512914+0000","last_peered":"2023-12-24T19:57:58.512914+0000","last_clean":"2023-12-24T19:57:58.512914+0000","last_became_active":"2023-12-24T19:57:57.759514+0000","last_became_peered":"2023-12-24T19:57:57.759514+0000","last_unstale":"2023-12-24T19:57:58.512914+0000","last_undegraded":"2023-12-24T19:57:58.512914+0000","last_fullsized":"2023-12-24T19:57:58.512914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:57:56.736639+0000","last_clean_scrub_stamp":"2023-12-24T19:57:56.736639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:23.852195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":171,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-24T19:57:58.513647+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:57:58.513647+0000","last_peered":"2023-12-24T19:57:58.513647+0000","last_clean":"2023-12-24T19:57:58.513647+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:57:58.513647+0000","last_undegraded":"2023-12-24T19:57:58.513647+0000","last_fullsized":"2023-12-24T19:57:58.513647+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":707,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199275988,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.62}]},{"osd":1,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51600000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.59899999999999998}]},{"osd":5,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46700000000000003}]},{"osd":6,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.58599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195181,"statfs":{"total":200000000,"available":199865858,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58599999999999997}]},{"osd":4,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.375},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.36399999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.54700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":125,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195186,"statfs":{"total":200000000,"available":199871176,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.315}]},{"osd":2,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.35899999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.34300000000000003}]},{"osd":4,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.504},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46000000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.46800000000000003}]},{"osd":6,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56000000000000005}]},{"osd":7,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":706,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194605,"statfs":{"total":200000000,"available":199276078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.311}]},{"osd":2,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.34499999999999997}]},{"osd":4,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.6859999999999999,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53800000000000003}]},{"osd":6,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195188,"statfs":{"total":200000000,"available":199872664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.39300000000000002}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.379},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.44500000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.503}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67600000000000005}]},{"osd":5,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71699999999999997}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.80200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":131,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195180,"statfs":{"total":200000000,"available":199864888,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.36599999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.438}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67900000000000005}]},{"osd":5,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61399999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.74099999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.70599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195188,"statfs":{"total":200000000,"available":199872630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.48799999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53600000000000003}]},{"osd":3,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":8.8200000000000003,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.8279999999999998,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.58599999999999997}]},{"osd":6,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":14.039999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.61599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195187,"statfs":{"total":200000000,"available":199872090,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.61499999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.502}]},{"osd":2,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.51500000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57199999999999995}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.443},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.63}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.53400000000000003}]}]}],"pool_statfs":[]}} 2023-12-24T19:58:03.294 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T19:58:03.294 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T19:58:03.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.458+0000 7f496c64d700 1 Processor -- start 2023-12-24T19:58:03.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.458+0000 7f496c64d700 1 -- start start 2023-12-24T19:58:03.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496c64d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f49640cdf90 0x7f496406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496c64d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49640ce360 0x7f4964158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496c64d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496415bad0 con 0x7f4964158a80 2023-12-24T19:58:03.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496c64d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496415bdb0 con 0x7f49640cdf90 2023-12-24T19:58:03.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496c64d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496415c090 con 0x7f49640ce360 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496a3e9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f49640cdf90 0x7f496406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496a3e9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f49640cdf90 0x7f496406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43436/0 (socket says 172.21.15.61:43436) 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496a3e9700 1 -- 172.21.15.61:0/1215740320 learned_addr learned my addr 172.21.15.61:0/1215740320 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496a3e9700 1 -- 172.21.15.61:0/1215740320 >> v2:172.21.15.133:3300/0 conn(0x7f49640ce360 msgr2=0x7f4964158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496a3e9700 1 --2- 172.21.15.61:0/1215740320 >> v2:172.21.15.133:3300/0 conn(0x7f49640ce360 0x7f4964158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496a3e9700 1 -- 172.21.15.61:0/1215740320 >> v1:172.21.15.133:6789/0 conn(0x7f4964158a80 legacy=0x7f496406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.459+0000 7f496a3e9700 1 -- 172.21.15.61:0/1215740320 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496415c370 con 0x7f49640cdf90 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.460+0000 7f496a3e9700 1 --2- 172.21.15.61:0/1215740320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 0x7f496406b700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f49640cfad0 tx=0x7f4958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ef810b52458c85 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.460+0000 7f49693e7700 1 -- 172.21.15.61:0/1215740320 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800b820 con 0x7f49640cdf90 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.460+0000 7f49693e7700 1 -- 172.21.15.61:0/1215740320 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495800b980 con 0x7f49640cdf90 2023-12-24T19:58:03.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.460+0000 7f49693e7700 1 -- 172.21.15.61:0/1215740320 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800bd20 con 0x7f49640cdf90 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.460+0000 7f496c64d700 1 -- 172.21.15.61:0/1215740320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 msgr2=0x7f496406b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.460+0000 7f496c64d700 1 --2- 172.21.15.61:0/1215740320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 0x7f496406b700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f49640cfad0 tx=0x7f4958009250 comp rx=0 tx=0).stop 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.460+0000 7f496c64d700 1 -- 172.21.15.61:0/1215740320 shutdown_connections 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.460+0000 7f496c64d700 1 --2- 172.21.15.61:0/1215740320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 0x7f496406b700 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.460+0000 7f496c64d700 1 --2- 172.21.15.61:0/1215740320 >> v2:172.21.15.133:3300/0 conn(0x7f49640ce360 0x7f4964158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.460+0000 7f496c64d700 1 -- 172.21.15.61:0/1215740320 >> 172.21.15.61:0/1215740320 conn(0x7f496406f810 msgr2=0x7f496406ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.461+0000 7f496c64d700 1 -- 172.21.15.61:0/1215740320 shutdown_connections 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.461+0000 7f496c64d700 1 -- 172.21.15.61:0/1215740320 wait complete. 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496c64d700 1 Processor -- start 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496c64d700 1 -- start start 2023-12-24T19:58:03.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496c64d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 0x7f4964169450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496c64d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49640ce360 0x7f496416b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496c64d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4964158a80 0x7f4964168a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496c64d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640b2400 con 0x7f49640cdf90 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496c64d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496416b640 con 0x7f49640ce360 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496c64d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640b17f0 con 0x7f4964158a80 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496a3e9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 0x7f4964169450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496a3e9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 0x7f4964169450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43438/0 (socket says 172.21.15.61:43438) 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.462+0000 7f496a3e9700 1 -- 172.21.15.61:0/211924141 learned_addr learned my addr 172.21.15.61:0/211924141 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f4969be8700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49640ce360 0x7f496416b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f496a3e9700 1 -- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4964158a80 msgr2=0x7f4964168a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f496a3e9700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4964158a80 0x7f4964168a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f496a3e9700 1 -- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49640ce360 msgr2=0x7f496416b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f496a3e9700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49640ce360 0x7f496416b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f496a3e9700 1 -- 172.21.15.61:0/211924141 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580094f0 con 0x7f49640cdf90 2023-12-24T19:58:03.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f496a3e9700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 0x7f4964169450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f496406e760 tx=0x7f4958016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:03.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f49567fc700 1 -- 172.21.15.61:0/211924141 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958026480 con 0x7f49640cdf90 2023-12-24T19:58:03.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f49567fc700 1 -- 172.21.15.61:0/211924141 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495801f070 con 0x7f49640cdf90 2023-12-24T19:58:03.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f496c64d700 1 -- 172.21.15.61:0/211924141 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49640b1ad0 con 0x7f49640cdf90 2023-12-24T19:58:03.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f49567fc700 1 -- 172.21.15.61:0/211924141 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958026850 con 0x7f49640cdf90 2023-12-24T19:58:03.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.463+0000 7f496c64d700 1 -- 172.21.15.61:0/211924141 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49640b2090 con 0x7f49640cdf90 2023-12-24T19:58:03.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.464+0000 7f496c64d700 1 -- 172.21.15.61:0/211924141 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496404c3c0 con 0x7f49640cdf90 2023-12-24T19:58:03.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.465+0000 7f49567fc700 1 -- 172.21.15.61:0/211924141 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f495801a440 con 0x7f49640cdf90 2023-12-24T19:58:03.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.465+0000 7f49567fc700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 0x7f49480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.465+0000 7f49567fc700 1 -- 172.21.15.61:0/211924141 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4958021070 con 0x7f49640cdf90 2023-12-24T19:58:03.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.465+0000 7f4969be8700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 0x7f49480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.466+0000 7f4969be8700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 0x7f49480693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4960006fd0 tx=0x7f4960008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:03.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.470+0000 7f49567fc700 1 -- 172.21.15.61:0/211924141 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4958053cf0 con 0x7f49640cdf90 2023-12-24T19:58:03.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.748+0000 7f496c64d700 1 -- 172.21.15.61:0/211924141 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f49640adf10 con 0x7f49640cdf90 2023-12-24T19:58:03.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.753+0000 7f49567fc700 1 -- 172.21.15.61:0/211924141 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4958057310 con 0x7f49640cdf90 2023-12-24T19:58:03.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 -- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 msgr2=0x7f49480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 0x7f49480693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4960006fd0 tx=0x7f4960008040 comp rx=0 tx=0).stop 2023-12-24T19:58:03.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 -- 172.21.15.61:0/211924141 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 msgr2=0x7f4964169450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 0x7f4964169450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f496406e760 tx=0x7f4958016000 comp rx=0 tx=0).stop 2023-12-24T19:58:03.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 -- 172.21.15.61:0/211924141 shutdown_connections 2023-12-24T19:58:03.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4964158a80 0x7f4964168a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 0x7f49480693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640cdf90 0x7f4964169450 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 --2- 172.21.15.61:0/211924141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49640ce360 0x7f496416b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 -- 172.21.15.61:0/211924141 >> 172.21.15.61:0/211924141 conn(0x7f496406f810 msgr2=0x7f49640c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:03.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 -- 172.21.15.61:0/211924141 shutdown_connections 2023-12-24T19:58:03.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.756+0000 7f496c64d700 1 -- 172.21.15.61:0/211924141 wait complete. 2023-12-24T19:58:03.757 INFO:teuthology.orchestra.run.smithi061.stderr:updated caps for client.0 2023-12-24T19:58:03.768 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:03.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.889+0000 7fa3c7790700 1 Processor -- start 2023-12-24T19:58:03.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.889+0000 7fa3c7790700 1 -- start start 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.890+0000 7fa3c7790700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3c0156730 0x7fa3c0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.890+0000 7fa3c7790700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c00b0830 0x7fa3c006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.890+0000 7fa3c7790700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c0067a60 con 0x7fa3c006de20 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.890+0000 7fa3c7790700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c006e280 con 0x7fa3c0156730 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.890+0000 7fa3c7790700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c00c88e0 con 0x7fa3c00b0830 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.890+0000 7fa3c4d2b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c00b0830 0x7fa3c006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.890+0000 7fa3c552c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3c0156730 0x7fa3c0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.890+0000 7fa3c5d2d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa3c006de20 0x7fa3c00c7c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:56650/0 (socket says 172.21.15.61:56650) 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.890+0000 7fa3c5d2d700 1 -- 172.21.15.61:0/4277806613 learned_addr learned my addr 172.21.15.61:0/4277806613 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.891+0000 7fa3c4d2b700 1 -- 172.21.15.61:0/4277806613 >> v2:172.21.15.133:3300/0 conn(0x7fa3c0156730 msgr2=0x7fa3c0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.891+0000 7fa3c4d2b700 1 --2- 172.21.15.61:0/4277806613 >> v2:172.21.15.133:3300/0 conn(0x7fa3c0156730 0x7fa3c0156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.891+0000 7fa3c4d2b700 1 -- 172.21.15.61:0/4277806613 >> v1:172.21.15.133:6789/0 conn(0x7fa3c006de20 legacy=0x7fa3c00c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.891+0000 7fa3c4d2b700 1 -- 172.21.15.61:0/4277806613 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00c8bc0 con 0x7fa3c00b0830 2023-12-24T19:58:03.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.891+0000 7fa3c4d2b700 1 --2- 172.21.15.61:0/4277806613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c00b0830 0x7fa3c006d8e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0098e0 tx=0x7fa3bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa604782846f2f2d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:03.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.891+0000 7fa3b7fff700 1 -- 172.21.15.61:0/4277806613 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc00b640 con 0x7fa3c00b0830 2023-12-24T19:58:03.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.891+0000 7fa3b7fff700 1 -- 172.21.15.61:0/4277806613 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc00b7a0 con 0x7fa3c00b0830 2023-12-24T19:58:03.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.891+0000 7fa3b7fff700 1 -- 172.21.15.61:0/4277806613 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc00bb40 con 0x7fa3c00b0830 2023-12-24T19:58:03.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.892+0000 7fa3c7790700 1 -- 172.21.15.61:0/4277806613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c00b0830 msgr2=0x7fa3c006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.892+0000 7fa3c7790700 1 --2- 172.21.15.61:0/4277806613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c00b0830 0x7fa3c006d8e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0098e0 tx=0x7fa3bc0091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.892+0000 7fa3c7790700 1 -- 172.21.15.61:0/4277806613 shutdown_connections 2023-12-24T19:58:03.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.892+0000 7fa3c7790700 1 --2- 172.21.15.61:0/4277806613 >> v2:172.21.15.133:3300/0 conn(0x7fa3c0156730 0x7fa3c0156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.892+0000 7fa3c7790700 1 --2- 172.21.15.61:0/4277806613 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c00b0830 0x7fa3c006d8e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.892+0000 7fa3c7790700 1 -- 172.21.15.61:0/4277806613 >> 172.21.15.61:0/4277806613 conn(0x7fa3c00cd6f0 msgr2=0x7fa3c00cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:03.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.892+0000 7fa3c7790700 1 -- 172.21.15.61:0/4277806613 shutdown_connections 2023-12-24T19:58:03.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.892+0000 7fa3c7790700 1 -- 172.21.15.61:0/4277806613 wait complete. 2023-12-24T19:58:03.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.893+0000 7fa3c7790700 1 Processor -- start 2023-12-24T19:58:03.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.893+0000 7fa3c7790700 1 -- start start 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c7790700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c006de20 0x7fa3c0158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c7790700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c00b0830 0x7fa3c0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c7790700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa3c0156730 0x7fa3c0157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c7790700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c00c3e40 con 0x7fa3c0156730 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c7790700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c016a290 con 0x7fa3c00b0830 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c7790700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0157670 con 0x7fa3c006de20 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c5d2d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa3c0156730 0x7fa3c0157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c5d2d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa3c0156730 0x7fa3c0157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43452/0 (socket says 172.21.15.61:43452) 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c5d2d700 1 -- 172.21.15.61:0/1653195152 learned_addr learned my addr 172.21.15.61:0/1653195152 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c552c700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c006de20 0x7fa3c0158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.894+0000 7fa3c4d2b700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c00b0830 0x7fa3c0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3c5d2d700 1 -- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c006de20 msgr2=0x7fa3c0158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3c5d2d700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c006de20 0x7fa3c0158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3c5d2d700 1 -- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c00b0830 msgr2=0x7fa3c0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3c5d2d700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c00b0830 0x7fa3c0156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3c5d2d700 1 -- 172.21.15.61:0/1653195152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc009420 con 0x7fa3c0156730 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3c552c700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c006de20 0x7fa3c0158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3c4d2b700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c00b0830 0x7fa3c0156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3c5d2d700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa3c0156730 0x7fa3c0157040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800cc40 tx=0x7fa3b8001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3b57fa700 1 -- 172.21.15.61:0/1653195152 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800a9c0 con 0x7fa3c0156730 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3b57fa700 1 -- 172.21.15.61:0/1653195152 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b800ab20 con 0x7fa3c0156730 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3c7790700 1 -- 172.21.15.61:0/1653195152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c0157950 con 0x7fa3c0156730 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3b57fa700 1 -- 172.21.15.61:0/1653195152 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80070f0 con 0x7fa3c0156730 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.895+0000 7fa3c7790700 1 -- 172.21.15.61:0/1653195152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c016a550 con 0x7fa3c0156730 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.896+0000 7fa3c7790700 1 -- 172.21.15.61:0/1653195152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c004c3c0 con 0x7fa3c0156730 2023-12-24T19:58:03.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.896+0000 7fa3b57fa700 1 -- 172.21.15.61:0/1653195152 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa3b80074e0 con 0x7fa3c0156730 2023-12-24T19:58:03.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.897+0000 7fa3b57fa700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa3a4066f30 0x7fa3a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:03.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.897+0000 7fa3b57fa700 1 -- 172.21.15.61:0/1653195152 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3b8084950 con 0x7fa3c0156730 2023-12-24T19:58:03.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.897+0000 7fa3c552c700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa3a4066f30 0x7fa3a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:03.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.898+0000 7fa3c552c700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa3a4066f30 0x7fa3a40693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009ce0 tx=0x7fa3b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:03.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:03.901+0000 7fa3b57fa700 1 -- 172.21.15.61:0/1653195152 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3b8051c40 con 0x7fa3c0156730 2023-12-24T19:58:04.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.140+0000 7fa3c7790700 1 -- 172.21.15.61:0/1653195152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3c00c3960 con 0x7fa3c0156730 2023-12-24T19:58:04.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.140+0000 7fa3b57fa700 1 -- 172.21.15.61:0/1653195152 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fa3b8055260 con 0x7fa3c0156730 2023-12-24T19:58:04.141 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:04.141 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2779978406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2779978406},{"type":"v1","addr":"172.21.15.61:6835","nonce":2779978406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1935570272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1935570272},{"type":"v1","addr":"172.21.15.133:6836","nonce":1935570272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3983510237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3983510237},{"type":"v1","addr":"172.21.15.133:6837","nonce":3983510237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:58.161119+0000","modified":"2023-12-24T19:58:01.793217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4777},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4777":{"gid":4777,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2729904701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2729904701},{"type":"v1","addr":"172.21.15.61:6834","nonce":2729904701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T19:58:04.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 -- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa3a4066f30 msgr2=0x7fa3a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa3a4066f30 0x7fa3a40693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009ce0 tx=0x7fa3b0008040 comp rx=0 tx=0).stop 2023-12-24T19:58:04.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 -- 172.21.15.61:0/1653195152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa3c0156730 msgr2=0x7fa3c0157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa3c0156730 0x7fa3c0157040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800cc40 tx=0x7fa3b8001a50 comp rx=0 tx=0).stop 2023-12-24T19:58:04.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 -- 172.21.15.61:0/1653195152 shutdown_connections 2023-12-24T19:58:04.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3c006de20 0x7fa3c0158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa3a4066f30 0x7fa3a40693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa3c0156730 0x7fa3c0157040 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 --2- 172.21.15.61:0/1653195152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c00b0830 0x7fa3c0156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 -- 172.21.15.61:0/1653195152 >> 172.21.15.61:0/1653195152 conn(0x7fa3c00cd6f0 msgr2=0x7fa3c006a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:04.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 -- 172.21.15.61:0/1653195152 shutdown_connections 2023-12-24T19:58:04.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.142+0000 7fa3c7790700 1 -- 172.21.15.61:0/1653195152 wait complete. 2023-12-24T19:58:04.144 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 16 2023-12-24T19:58:04.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T19:57:58.161119+0000', 'modified': '2023-12-24T19:58:01.793217+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4777}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4777': {'gid': 4777, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.61:6834/2729904701', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.61:6832', 'nonce': 2729904701}, {'type': 'v1', 'addr': '172.21.15.61:6834', 'nonce': 2729904701}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T19:58:04.558 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T19:58:04.558 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-24T19:58:04.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.682+0000 7fa42f46d700 1 Processor -- start 2023-12-24T19:58:04.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.682+0000 7fa42f46d700 1 -- start start 2023-12-24T19:58:04.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.683+0000 7fa42f46d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159d10 0x7fa4280af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.683+0000 7fa42f46d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4280ac5b0 con 0x7fa428159940 2023-12-24T19:58:04.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.683+0000 7fa42f46d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa428063ac0 con 0x7fa4280aba00 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.683+0000 7fa42f46d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280af8e0 con 0x7fa428159d10 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.683+0000 7fa42d209700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa428159940 0x7fa4280afc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56696/0 (socket says 172.21.15.61:56696) 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.683+0000 7fa42d209700 1 -- 172.21.15.61:0/860847928 learned_addr learned my addr 172.21.15.61:0/860847928 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.683+0000 7fa42ca08700 1 --2- 172.21.15.61:0/860847928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159d10 0x7fa4280af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.683+0000 7fa41ffff700 1 -- 172.21.15.61:0/860847928 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559303230 0 0) 0x7fa418001110 con 0x7fa428159940 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.683+0000 7fa41ffff700 1 -- 172.21.15.61:0/860847928 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa414003570 con 0x7fa428159940 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.684+0000 7fa41ffff700 1 -- 172.21.15.61:0/860847928 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171044828 0 0) 0x7fa428063ac0 con 0x7fa4280aba00 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.684+0000 7fa41ffff700 1 -- 172.21.15.61:0/860847928 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa418001110 con 0x7fa4280aba00 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.684+0000 7fa41ffff700 1 -- 172.21.15.61:0/860847928 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 178542225 0 0) 0x7fa414003570 con 0x7fa428159940 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.684+0000 7fa42ca08700 1 -- 172.21.15.61:0/860847928 >> v1:172.21.15.133:6789/0 conn(0x7fa4280aba00 legacy=0x7fa4280abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.684+0000 7fa42ca08700 1 -- 172.21.15.61:0/860847928 >> v1:172.21.15.61:6789/0 conn(0x7fa428159940 legacy=0x7fa4280afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.684+0000 7fa42ca08700 1 -- 172.21.15.61:0/860847928 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4280ab290 con 0x7fa428159d10 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.684+0000 7fa42ca08700 1 --2- 172.21.15.61:0/860847928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159d10 0x7fa4280af3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa424009910 tx=0x7fa4240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d47dd749d3bd0b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:04.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.684+0000 7fa41ffff700 1 -- 172.21.15.61:0/860847928 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418001600 con 0x7fa428159d10 2023-12-24T19:58:04.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.684+0000 7fa41ffff700 1 -- 172.21.15.61:0/860847928 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424011420 con 0x7fa428159d10 2023-12-24T19:58:04.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.684+0000 7fa41ffff700 1 -- 172.21.15.61:0/860847928 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4240117c0 con 0x7fa428159d10 2023-12-24T19:58:04.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.685+0000 7fa42f46d700 1 -- 172.21.15.61:0/860847928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159d10 msgr2=0x7fa4280af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.685+0000 7fa42f46d700 1 --2- 172.21.15.61:0/860847928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159d10 0x7fa4280af3a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa424009910 tx=0x7fa4240091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.685+0000 7fa42f46d700 1 -- 172.21.15.61:0/860847928 shutdown_connections 2023-12-24T19:58:04.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.685+0000 7fa42f46d700 1 --2- 172.21.15.61:0/860847928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159d10 0x7fa4280af3a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.685+0000 7fa42f46d700 1 -- 172.21.15.61:0/860847928 >> 172.21.15.61:0/860847928 conn(0x7fa428068020 msgr2=0x7fa4280cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:04.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.685+0000 7fa42f46d700 1 -- 172.21.15.61:0/860847928 shutdown_connections 2023-12-24T19:58:04.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.685+0000 7fa42f46d700 1 -- 172.21.15.61:0/860847928 wait complete. 2023-12-24T19:58:04.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.686+0000 7fa42f46d700 1 Processor -- start 2023-12-24T19:58:04.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.686+0000 7fa42f46d700 1 -- start start 2023-12-24T19:58:04.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42f46d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa4280aba00 0x7fa4280cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42f46d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159940 0x7fa4280c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42f46d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa428159d10 0x7fa42816ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42f46d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280cc270 con 0x7fa4280aba00 2023-12-24T19:58:04.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42f46d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280cb770 con 0x7fa428159d10 2023-12-24T19:58:04.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42f46d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42816c730 con 0x7fa428159940 2023-12-24T19:58:04.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42d209700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa4280aba00 0x7fa4280cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42d209700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa4280aba00 0x7fa4280cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43466/0 (socket says 172.21.15.61:43466) 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42d209700 1 -- 172.21.15.61:0/2618513046 learned_addr learned my addr 172.21.15.61:0/2618513046 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42ca08700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159940 0x7fa4280c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42da0a700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa428159d10 0x7fa42816ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42d209700 1 -- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159940 msgr2=0x7fa4280c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42d209700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159940 0x7fa4280c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42d209700 1 -- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa428159d10 msgr2=0x7fa42816ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42d209700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa428159d10 0x7fa42816ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42d209700 1 -- 172.21.15.61:0/2618513046 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424009420 con 0x7fa4280aba00 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42ca08700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159940 0x7fa4280c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42da0a700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa428159d10 0x7fa42816ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.687+0000 7fa42d209700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa4280aba00 0x7fa4280cb230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa41800cb90 tx=0x7fa418001c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.688+0000 7fa41d7fa700 1 -- 172.21.15.61:0/2618513046 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418007360 con 0x7fa4280aba00 2023-12-24T19:58:04.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.688+0000 7fa41d7fa700 1 -- 172.21.15.61:0/2618513046 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa418007500 con 0x7fa4280aba00 2023-12-24T19:58:04.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.688+0000 7fa42f46d700 1 -- 172.21.15.61:0/2618513046 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4280c9a30 con 0x7fa4280aba00 2023-12-24T19:58:04.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.688+0000 7fa41d7fa700 1 -- 172.21.15.61:0/2618513046 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418004830 con 0x7fa4280aba00 2023-12-24T19:58:04.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.688+0000 7fa42f46d700 1 -- 172.21.15.61:0/2618513046 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42816be00 con 0x7fa4280aba00 2023-12-24T19:58:04.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.689+0000 7fa41d7fa700 1 -- 172.21.15.61:0/2618513046 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa418004c60 con 0x7fa4280aba00 2023-12-24T19:58:04.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.690+0000 7fa41d7fa700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa40c066f30 0x7fa40c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.690+0000 7fa41d7fa700 1 -- 172.21.15.61:0/2618513046 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa418083d10 con 0x7fa4280aba00 2023-12-24T19:58:04.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.690+0000 7fa42ca08700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa40c066f30 0x7fa40c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.690+0000 7fa42ca08700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa40c066f30 0x7fa40c0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa42815a140 tx=0x7fa424016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:04.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.691+0000 7fa43876db80 1 Processor -- start 2023-12-24T19:58:04.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.691+0000 7fa43876db80 1 -- start start 2023-12-24T19:58:04.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa43876db80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b474f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa43876db80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 0x5582b474ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa43876db80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b476b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa43876db80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b467d3e0 con 0x5582b474efa0 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa43876db80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b467abe0 con 0x5582b474f8b0 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa43876db80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582b46769d0 con 0x5582b474b170 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa42d209700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b474f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa42d209700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b474f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43482/0 (socket says 172.21.15.61:43482) 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa42d209700 1 -- 172.21.15.61:0/1720870722 learned_addr learned my addr 172.21.15.61:0/1720870722 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa42ca08700 1 --2- 172.21.15.61:0/1720870722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 0x5582b474ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.692+0000 7fa42da0a700 1 --2- 172.21.15.61:0/1720870722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b476b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa42d209700 1 -- 172.21.15.61:0/1720870722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 msgr2=0x5582b476b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa42d209700 1 --2- 172.21.15.61:0/1720870722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b476b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa42d209700 1 -- 172.21.15.61:0/1720870722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 msgr2=0x5582b474ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa42d209700 1 --2- 172.21.15.61:0/1720870722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 0x5582b474ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa42d209700 1 -- 172.21.15.61:0/1720870722 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582b450a360 con 0x5582b474efa0 2023-12-24T19:58:04.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa42ca08700 1 --2- 172.21.15.61:0/1720870722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 0x5582b474ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa42d209700 1 --2- 172.21.15.61:0/1720870722 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b474f370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa4180511f0 tx=0x7fa418009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489052d2541ab7bb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa4127fc700 1 -- 172.21.15.61:0/1720870722 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41805bbe0 con 0x5582b474efa0 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa4127fc700 1 -- 172.21.15.61:0/1720870722 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa418052e30 con 0x5582b474efa0 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa4127fc700 1 -- 172.21.15.61:0/1720870722 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180541e0 con 0x5582b474efa0 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa43876db80 1 -- 172.21.15.61:0/1720870722 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 msgr2=0x5582b474f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa43876db80 1 --2- 172.21.15.61:0/1720870722 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b474f370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa4180511f0 tx=0x7fa418009040 comp rx=0 tx=0).stop 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa43876db80 1 -- 172.21.15.61:0/1720870722 shutdown_connections 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa43876db80 1 --2- 172.21.15.61:0/1720870722 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b476b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa43876db80 1 --2- 172.21.15.61:0/1720870722 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b474f370 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa43876db80 1 --2- 172.21.15.61:0/1720870722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 0x5582b474ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.693+0000 7fa43876db80 1 -- 172.21.15.61:0/1720870722 >> 172.21.15.61:0/1720870722 conn(0x5582b4725440 msgr2=0x5582b4770dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.694+0000 7fa43876db80 1 -- 172.21.15.61:0/1720870722 shutdown_connections 2023-12-24T19:58:04.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.694+0000 7fa43876db80 1 -- 172.21.15.61:0/1720870722 wait complete. 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.694+0000 7fa43876db80 1 -- start start 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.694+0000 7fa43876db80 1 Processor -- start 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa43876db80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474b170 0x5582b473af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa43876db80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 0x5582b4767f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa43876db80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474f8b0 0x5582b476dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa43876db80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b46231b0 con 0x5582b474b170 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa43876db80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b4622e50 con 0x5582b474efa0 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa43876db80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582b456fe40 con 0x5582b474f8b0 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa43876db80 10 client.0 _ll_register_callbacks cb 0x5582b45727b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42d209700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474b170 0x5582b473af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42d209700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474b170 0x5582b473af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43484/0 (socket says 172.21.15.61:43484) 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42d209700 1 -- 172.21.15.61:0/3087846528 learned_addr learned my addr 172.21.15.61:0/3087846528 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:04.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42ca08700 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 0x5582b4767f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42da0a700 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474f8b0 0x5582b476dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42d209700 1 -- 172.21.15.61:0/3087846528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474f8b0 msgr2=0x5582b476dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:04.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42d209700 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474f8b0 0x5582b476dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42d209700 1 -- 172.21.15.61:0/3087846528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 msgr2=0x5582b4767f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:04.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42d209700 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 0x5582b4767f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42d209700 1 -- 172.21.15.61:0/3087846528 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42816be00 con 0x5582b474b170 2023-12-24T19:58:04.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.695+0000 7fa42ca08700 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 0x5582b4767f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:04.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa42d209700 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474b170 0x5582b473af40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa418057010 tx=0x7fa418068000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4824b28721f8009f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:04.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa4077fe700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa4077fe700 1 -- 172.21.15.61:0/3087846528 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418004990 con 0x5582b474b170 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa4077fe700 1 -- 172.21.15.61:0/3087846528 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa41805b750 con 0x5582b474b170 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa43876db80 1 -- 172.21.15.61:0/3087846528 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582b46f7eb0 con 0x5582b474b170 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa4077fe700 1 -- 172.21.15.61:0/3087846528 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa418004af0 con 0x5582b474b170 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa43876db80 10 client.5067 fetch_fsmap learned FSMap version 16 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa43876db80 1 -- 172.21.15.61:0/3087846528 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5582b44b6b10 con 0x5582b474b170 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa4077fe700 1 -- 172.21.15.61:0/3087846528 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582b46f7eb0 con 0x5582b474b170 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa4077fe700 1 -- 172.21.15.61:0/3087846528 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa41806d070 con 0x5582b474b170 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa43876db80 10 client.5067 fetch_fsmap finished waiting for FSMap version 16 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa43876db80 10 client.5067 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa43876db80 20 client.5067 populate_metadata read hostname 'smithi061' 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa43876db80 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.61:6832/2729904701,v1:172.21.15.61:6834/2729904701] conn(0x5582b4766bc0 0x5582b4766f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa43876db80 4 client.5067 mds_command: new command op to 4777 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa43876db80 1 -- 172.21.15.61:0/3087846528 --> [v2:172.21.15.61:6832/2729904701,v1:172.21.15.61:6834/2729904701] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582b464d880 con 0x5582b4766bc0 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.696+0000 7fa42ca08700 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.61:6832/2729904701,v1:172.21.15.61:6834/2729904701] conn(0x5582b4766bc0 0x5582b4766f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa4077fe700 10 client.5067 ms_handle_connect on v2:172.21.15.61:6832/2729904701 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa42ca08700 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.61:6832/2729904701,v1:172.21.15.61:6834/2729904701] conn(0x5582b4766bc0 0x5582b4766f90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f42b3280af7a00e server_cookie=275b852eb59bf69c in_seq=0 out_seq=0 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa4077fe700 1 -- 172.21.15.61:0/3087846528 <== mds.0 v2:172.21.15.61:6832/2729904701 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5582b464d880 con 0x5582b4766bc0 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa4077fe700 10 client.5067 handle_command_reply: tid=0 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa43876db80 1 client.5067 shutdown 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa43876db80 1 -- 172.21.15.61:0/3087846528 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474b170 msgr2=0x5582b473af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa43876db80 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474b170 0x5582b473af40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa418057010 tx=0x7fa418068000 comp rx=0 tx=0).stop 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa43876db80 1 -- 172.21.15.61:0/3087846528 shutdown_connections 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa43876db80 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474f8b0 0x5582b476dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa43876db80 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.61:6832/2729904701,v1:172.21.15.61:6834/2729904701] conn(0x5582b4766bc0 0x5582b4766f90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa43876db80 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474b170 0x5582b473af40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.697+0000 7fa43876db80 1 --2- 172.21.15.61:0/3087846528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 0x5582b4767f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.698+0000 7fa4077fe700 0 client.5067 ms_handle_reset on v2:172.21.15.61:6832/2729904701 2023-12-24T19:58:04.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.698+0000 7fa43876db80 1 -- 172.21.15.61:0/3087846528 >> 172.21.15.61:0/3087846528 conn(0x5582b4725440 msgr2=0x5582b474a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:04.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.698+0000 7fa43876db80 1 -- 172.21.15.61:0/3087846528 shutdown_connections 2023-12-24T19:58:04.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.698+0000 7fa43876db80 1 -- 172.21.15.61:0/3087846528 wait complete. 2023-12-24T19:58:04.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.698+0000 7fa43876db80 20 client.5067 trim_cache size 0 max 16384 2023-12-24T19:58:04.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa43876db80 1 Processor -- start 2023-12-24T19:58:04.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa43876db80 1 -- start start 2023-12-24T19:58:04.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa43876db80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b476d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa43876db80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 0x5582b476bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa43876db80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474f8b0 0x5582b476c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa43876db80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b474f640 con 0x5582b474f8b0 2023-12-24T19:58:04.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa43876db80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b4726630 con 0x5582b474efa0 2023-12-24T19:58:04.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa43876db80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582b471efc0 con 0x5582b474b170 2023-12-24T19:58:04.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa42da0a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474f8b0 0x5582b476c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa42da0a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474f8b0 0x5582b476c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43496/0 (socket says 172.21.15.61:43496) 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.715+0000 7fa42da0a700 1 -- 172.21.15.61:0/214276307 learned_addr learned my addr 172.21.15.61:0/214276307 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa42da0a700 1 -- 172.21.15.61:0/214276307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 msgr2=0x5582b476d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa42d209700 1 --2- 172.21.15.61:0/214276307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b476d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa42da0a700 1 --2- 172.21.15.61:0/214276307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b476d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa42ca08700 1 --2- 172.21.15.61:0/214276307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 0x5582b476bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa42da0a700 1 -- 172.21.15.61:0/214276307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 msgr2=0x5582b476bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa42da0a700 1 --2- 172.21.15.61:0/214276307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 0x5582b476bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa42da0a700 1 -- 172.21.15.61:0/214276307 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582b4645290 con 0x5582b474f8b0 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa42da0a700 1 --2- 172.21.15.61:0/214276307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474f8b0 0x5582b476c320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa4200015b0 tx=0x7fa420009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cde39e3efddbd5a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa412ffd700 1 -- 172.21.15.61:0/214276307 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420003940 con 0x5582b474f8b0 2023-12-24T19:58:04.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa412ffd700 1 -- 172.21.15.61:0/214276307 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42000d030 con 0x5582b474f8b0 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.716+0000 7fa412ffd700 1 -- 172.21.15.61:0/214276307 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420003cf0 con 0x5582b474f8b0 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 -- 172.21.15.61:0/214276307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474f8b0 msgr2=0x5582b476c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 --2- 172.21.15.61:0/214276307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474f8b0 0x5582b476c320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa4200015b0 tx=0x7fa420009040 comp rx=0 tx=0).stop 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 -- 172.21.15.61:0/214276307 shutdown_connections 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 --2- 172.21.15.61:0/214276307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b476d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 --2- 172.21.15.61:0/214276307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474f8b0 0x5582b476c320 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 --2- 172.21.15.61:0/214276307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474efa0 0x5582b476bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 -- 172.21.15.61:0/214276307 >> 172.21.15.61:0/214276307 conn(0x5582b4725440 msgr2=0x5582b4726ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 -- 172.21.15.61:0/214276307 shutdown_connections 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 -- 172.21.15.61:0/214276307 wait complete. 2023-12-24T19:58:04.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 -- start start 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.717+0000 7fa43876db80 1 Processor -- start 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.718+0000 7fa43876db80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b477f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.718+0000 7fa43876db80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b47ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.718+0000 7fa43876db80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 0x5582b4786030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.718+0000 7fa43876db80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b476cd00 con 0x5582b474efa0 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.718+0000 7fa43876db80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582b476be70 con 0x5582b474f8b0 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.718+0000 7fa43876db80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5582b47ac800 con 0x5582b474b170 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.718+0000 7fa43876db80 10 client.0 _ll_register_callbacks cb 0x7fa4180552b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.718+0000 7fa42ca08700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b47ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.718+0000 7fa42ca08700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b47ac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43506/0 (socket says 172.21.15.61:43506) 2023-12-24T19:58:04.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.718+0000 7fa42ca08700 1 -- 172.21.15.61:0/2601612539 learned_addr learned my addr 172.21.15.61:0/2601612539 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:04.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa42d209700 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b477f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa42ca08700 1 -- 172.21.15.61:0/2601612539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 msgr2=0x5582b477f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:04.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa42da0a700 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 0x5582b4786030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa42ca08700 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b477f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa42ca08700 1 -- 172.21.15.61:0/2601612539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 msgr2=0x5582b4786030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:04.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa42ca08700 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 0x5582b4786030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa42ca08700 1 -- 172.21.15.61:0/2601612539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa418001110 con 0x5582b474efa0 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa42d209700 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b477f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa42ca08700 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b47ac2c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa424009f00 tx=0x7fa424032250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d12482922372c81 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa4077fe700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa4077fe700 1 -- 172.21.15.61:0/2601612539 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424031070 con 0x5582b474efa0 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa4077fe700 1 -- 172.21.15.61:0/2601612539 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa42401d910 con 0x5582b474efa0 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa43876db80 1 -- 172.21.15.61:0/2601612539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582b471b490 con 0x5582b474efa0 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa4077fe700 1 -- 172.21.15.61:0/2601612539 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa42401dd20 con 0x5582b474efa0 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa43876db80 10 client.5073 fetch_fsmap learned FSMap version 16 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa43876db80 1 -- 172.21.15.61:0/2601612539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5582b450ec80 con 0x5582b474efa0 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa4077fe700 1 -- 172.21.15.61:0/2601612539 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5582b471b490 con 0x5582b474efa0 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa4077fe700 1 -- 172.21.15.61:0/2601612539 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa424035470 con 0x5582b474efa0 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa43876db80 10 client.5073 fetch_fsmap finished waiting for FSMap version 16 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa43876db80 10 client.5073 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa43876db80 20 client.5073 populate_metadata read hostname 'smithi061' 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa43876db80 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.61:6832/2729904701,v1:172.21.15.61:6834/2729904701] conn(0x5582b4770a10 0x5582b4770de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa43876db80 4 client.5073 mds_command: new command op to 4777 tid=0[{"prefix": "status"}] 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.719+0000 7fa43876db80 1 -- 172.21.15.61:0/2601612539 --> [v2:172.21.15.61:6832/2729904701,v1:172.21.15.61:6834/2729904701] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5582b4619910 con 0x5582b4770a10 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa42d209700 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.61:6832/2729904701,v1:172.21.15.61:6834/2729904701] conn(0x5582b4770a10 0x5582b4770de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa42d209700 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.61:6832/2729904701,v1:172.21.15.61:6834/2729904701] conn(0x5582b4770a10 0x5582b4770de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45816de8d2a90c99 server_cookie=bcc16d200ac3ba0e in_seq=0 out_seq=0 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa4077fe700 10 client.5073 ms_handle_connect on v2:172.21.15.61:6832/2729904701 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa4077fe700 1 -- 172.21.15.61:0/2601612539 <== mds.0 v2:172.21.15.61:6832/2729904701 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5582b4619910 con 0x5582b4770a10 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa4077fe700 10 client.5073 handle_command_reply: tid=0 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 client.5073 shutdown 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 -- 172.21.15.61:0/2601612539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 msgr2=0x5582b47ac2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b47ac2c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa424009f00 tx=0x7fa424032250 comp rx=0 tx=0).stop 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 -- 172.21.15.61:0/2601612539 shutdown_connections 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5582b474b170 0x5582b477f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.61:6832/2729904701,v1:172.21.15.61:6834/2729904701] conn(0x5582b4770a10 0x5582b4770de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5582b474f8b0 0x5582b4786030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 --2- 172.21.15.61:0/2601612539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5582b474efa0 0x5582b47ac2c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa4077fe700 0 client.5073 ms_handle_reset on v2:172.21.15.61:6832/2729904701 2023-12-24T19:58:04.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 -- 172.21.15.61:0/2601612539 >> 172.21.15.61:0/2601612539 conn(0x5582b4725440 msgr2=0x5582b47269d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:04.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 -- 172.21.15.61:0/2601612539 shutdown_connections 2023-12-24T19:58:04.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.720+0000 7fa43876db80 1 -- 172.21.15.61:0/2601612539 wait complete. 2023-12-24T19:58:04.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa43876db80 20 client.5073 trim_cache size 0 max 16384 2023-12-24T19:58:04.729 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:04.729 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:58:04.729 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T19:58:04.729 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 4777, 2023-12-24T19:58:04.729 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T19:58:04.729 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T19:58:04.730 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T19:58:04.730 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 5.9500376340000001, 2023-12-24T19:58:04.730 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 16, 2023-12-24T19:58:04.730 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 31, 2023-12-24T19:58:04.730 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 31, 2023-12-24T19:58:04.730 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 13.840047229 2023-12-24T19:58:04.730 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:04.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 -- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa40c066f30 msgr2=0x7fa40c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa40c066f30 0x7fa40c0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa42815a140 tx=0x7fa424016000 comp rx=0 tx=0).stop 2023-12-24T19:58:04.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 -- 172.21.15.61:0/2618513046 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa4280aba00 msgr2=0x7fa4280cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa4280aba00 0x7fa4280cb230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa41800cb90 tx=0x7fa418001c40 comp rx=0 tx=0).stop 2023-12-24T19:58:04.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 -- 172.21.15.61:0/2618513046 shutdown_connections 2023-12-24T19:58:04.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa40c066f30 0x7fa40c0693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa428159d10 0x7fa42816ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa4280aba00 0x7fa4280cb230 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 --2- 172.21.15.61:0/2618513046 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa428159940 0x7fa4280c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 -- 172.21.15.61:0/2618513046 >> 172.21.15.61:0/2618513046 conn(0x7fa428068020 msgr2=0x7fa4281566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 -- 172.21.15.61:0/2618513046 shutdown_connections 2023-12-24T19:58:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.721+0000 7fa42f46d700 1 -- 172.21.15.61:0/2618513046 wait complete. 2023-12-24T19:58:04.734 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:58:04.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.856+0000 7ff723dcc700 1 Processor -- start 2023-12-24T19:58:04.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.856+0000 7ff723dcc700 1 -- start start 2023-12-24T19:58:04.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.857+0000 7ff723dcc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 0x7ff71c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.857+0000 7ff723dcc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff71c0cd9c0 0x7ff71c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.857+0000 7ff723dcc700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c06c300 con 0x7ff71c1595e0 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.857+0000 7ff723dcc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c06ce80 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.857+0000 7ff723dcc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c068560 con 0x7ff71c06ec70 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.857+0000 7ff721367700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff71c1595e0 0x7ff71c159a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56702/0 (socket says 172.21.15.61:56702) 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.857+0000 7ff721367700 1 -- 172.21.15.61:0/1623911556 learned_addr learned my addr 172.21.15.61:0/1623911556 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff722369700 1 --2- 172.21.15.61:0/1623911556 >> v2:172.21.15.133:3300/0 conn(0x7ff71c0cd9c0 0x7ff71c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff721b68700 1 --2- 172.21.15.61:0/1623911556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 0x7ff71c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff720b66700 1 -- 172.21.15.61:0/1623911556 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137109268 0 0) 0x7ff71c06c300 con 0x7ff71c1595e0 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff720b66700 1 -- 172.21.15.61:0/1623911556 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff708003570 con 0x7ff71c1595e0 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff721b68700 1 -- 172.21.15.61:0/1623911556 >> v2:172.21.15.133:3300/0 conn(0x7ff71c0cd9c0 msgr2=0x7ff71c0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff721b68700 1 --2- 172.21.15.61:0/1623911556 >> v2:172.21.15.133:3300/0 conn(0x7ff71c0cd9c0 0x7ff71c0cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff721b68700 1 -- 172.21.15.61:0/1623911556 >> v1:172.21.15.61:6789/0 conn(0x7ff71c1595e0 legacy=0x7ff71c159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff721b68700 1 -- 172.21.15.61:0/1623911556 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c06c550 con 0x7ff71c06ec70 2023-12-24T19:58:04.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff721b68700 1 --2- 172.21.15.61:0/1623911556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 0x7ff71c06f040 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff7180098e0 tx=0x7ff7180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=416c6e59e5d0fc13 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff720b66700 1 -- 172.21.15.61:0/1623911556 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718011630 con 0x7ff71c06ec70 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff720b66700 1 -- 172.21.15.61:0/1623911556 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff718011790 con 0x7ff71c06ec70 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.858+0000 7ff720b66700 1 -- 172.21.15.61:0/1623911556 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718011b10 con 0x7ff71c06ec70 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.859+0000 7ff723dcc700 1 -- 172.21.15.61:0/1623911556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 msgr2=0x7ff71c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.859+0000 7ff723dcc700 1 --2- 172.21.15.61:0/1623911556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 0x7ff71c06f040 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff7180098e0 tx=0x7ff7180091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.859+0000 7ff723dcc700 1 -- 172.21.15.61:0/1623911556 shutdown_connections 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.859+0000 7ff723dcc700 1 --2- 172.21.15.61:0/1623911556 >> v2:172.21.15.133:3300/0 conn(0x7ff71c0cd9c0 0x7ff71c0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.859+0000 7ff723dcc700 1 --2- 172.21.15.61:0/1623911556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 0x7ff71c06f040 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.859+0000 7ff723dcc700 1 -- 172.21.15.61:0/1623911556 >> 172.21.15.61:0/1623911556 conn(0x7ff71c06b650 msgr2=0x7ff71c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.859+0000 7ff723dcc700 1 -- 172.21.15.61:0/1623911556 shutdown_connections 2023-12-24T19:58:04.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.859+0000 7ff723dcc700 1 -- 172.21.15.61:0/1623911556 wait complete. 2023-12-24T19:58:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.860+0000 7ff723dcc700 1 Processor -- start 2023-12-24T19:58:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.860+0000 7ff723dcc700 1 -- start start 2023-12-24T19:58:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff723dcc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 0x7ff71c0ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff723dcc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff71c0cd9c0 0x7ff71c14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff723dcc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff71c1595e0 0x7ff71c154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff723dcc700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0acfc0 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff723dcc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0ac3f0 con 0x7ff71c1595e0 2023-12-24T19:58:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff723dcc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c0ac690 con 0x7ff71c06ec70 2023-12-24T19:58:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff721367700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff71c0cd9c0 0x7ff71c14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff721367700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff71c0cd9c0 0x7ff71c14e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:43520/0 (socket says 172.21.15.61:43520) 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff721367700 1 -- 172.21.15.61:0/1074404477 learned_addr learned my addr 172.21.15.61:0/1074404477 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff721b68700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 0x7ff71c0ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.861+0000 7ff722369700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff71c1595e0 0x7ff71c154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff721367700 1 -- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 msgr2=0x7ff71c0ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff721367700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 0x7ff71c0ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff721367700 1 -- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff71c1595e0 msgr2=0x7ff71c154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff721367700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff71c1595e0 0x7ff71c154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff721367700 1 -- 172.21.15.61:0/1074404477 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718009420 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff721367700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff71c0cd9c0 0x7ff71c14e7b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff7100011e0 tx=0x7ff710007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff70dffb700 1 -- 172.21.15.61:0/1074404477 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff710005b30 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff70dffb700 1 -- 172.21.15.61:0/1074404477 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff710005c90 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff723dcc700 1 -- 172.21.15.61:0/1074404477 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c0ac970 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff70dffb700 1 -- 172.21.15.61:0/1074404477 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff710007320 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.862+0000 7ff723dcc700 1 -- 172.21.15.61:0/1074404477 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c14ecf0 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.863+0000 7ff723dcc700 1 -- 172.21.15.61:0/1074404477 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71c0ad130 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.863+0000 7ff70dffb700 1 -- 172.21.15.61:0/1074404477 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff710007690 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.864+0000 7ff70dffb700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff700066f30 0x7ff7000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:04.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.864+0000 7ff70dffb700 1 -- 172.21.15.61:0/1074404477 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7100838b0 con 0x7ff71c0cd9c0 2023-12-24T19:58:04.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.864+0000 7ff721b68700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff700066f30 0x7ff7000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:04.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.864+0000 7ff721b68700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff700066f30 0x7ff7000693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff7180091e0 tx=0x7ff718017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:04.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:04.868+0000 7ff70dffb700 1 -- 172.21.15.61:0/1074404477 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff710050b20 con 0x7ff71c0cd9c0 2023-12-24T19:58:05.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.104+0000 7ff723dcc700 1 -- 172.21.15.61:0/1074404477 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff71c04c3c0 con 0x7ff71c0cd9c0 2023-12-24T19:58:05.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.105+0000 7ff70dffb700 1 -- 172.21.15.61:0/1074404477 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff710017020 con 0x7ff71c0cd9c0 2023-12-24T19:58:05.105 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:58:05.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 -- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff700066f30 msgr2=0x7ff7000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:05.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff700066f30 0x7ff7000693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff7180091e0 tx=0x7ff718017000 comp rx=0 tx=0).stop 2023-12-24T19:58:05.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 -- 172.21.15.61:0/1074404477 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff71c0cd9c0 msgr2=0x7ff71c14e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:05.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff71c0cd9c0 0x7ff71c14e7b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff7100011e0 tx=0x7ff710007df0 comp rx=0 tx=0).stop 2023-12-24T19:58:05.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 -- 172.21.15.61:0/1074404477 shutdown_connections 2023-12-24T19:58:05.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff71c06ec70 0x7ff71c0ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:05.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff700066f30 0x7ff7000693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:05.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff71c1595e0 0x7ff71c154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:05.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 --2- 172.21.15.61:0/1074404477 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff71c0cd9c0 0x7ff71c14e7b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:05.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 -- 172.21.15.61:0/1074404477 >> 172.21.15.61:0/1074404477 conn(0x7ff71c06b650 msgr2=0x7ff71c0c4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:05.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 -- 172.21.15.61:0/1074404477 shutdown_connections 2023-12-24T19:58:05.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:05.107+0000 7ff723dcc700 1 -- 172.21.15.61:0/1074404477 wait complete. 2023-12-24T19:58:05.119 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T19:58:05.119 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:58:05.119 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T19:58:05.119 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T19:58:05.119 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:05.119 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T19:58:05.119 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T19:58:05.119 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:58:05.120 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:58:05.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:05.120 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T19:58:05.138 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:58:05.138 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:58:05.138 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:58:05.138 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:05.138 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T19:58:05.138 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:05.138 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:05.138 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:05.138 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42481sec preferred_lft 42481sec 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:58:05.139 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 12:83:d1:9f:62:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1083:d1ff:fe9f:62aa/64 scope link 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:05.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:05.141 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:58:05.205 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T19:58:05.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:05.206 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T19:58:05.265 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T19:58:05.265 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:58:05.265 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T19:58:05.265 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T19:58:05.265 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:58:05.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:05.266 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:58:05.266 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:58:05.266 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T19:58:05.266 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T19:58:05.266 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T19:58:05.266 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:58:05.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:05.373 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T19:58:05.390 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T19:58:05.390 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T19:58:05.390 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:58:05.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:05.390 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T19:58:05.419 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:58:05.433 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:58:05.459 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T19:58:05.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:58:05.459 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:05.544 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:58:05.545 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:58:05.545 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:05.602 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T19:58:05.670 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:58:05.670 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:58:05.737 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:58:05.738 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:58:05.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:05.739 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T19:58:05.796 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T19:58:05.797 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T19:58:05.839 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T19:58:05.866 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:58:05.867 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:58:05.924 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T19:58:05.924+0000 7f31086cf540 -1 init, newargv = 0x55bb2cfe7580 newargc=15 2023-12-24T19:58:05.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[48455]: starting ceph client 2023-12-24T19:58:05.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[48455]: starting fuse 2023-12-24T19:58:05.938 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:58:05.939 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:58:05.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:05.940 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T19:58:05.998 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T19:58:05.998 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T19:58:05.998 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:05.998 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T19:58:05.998 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T19:58:05.998 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:58:05.998 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T19:58:05.998 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:05.998 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T19:58:05.999 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:58:06.000 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:06.000 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T19:58:06.000 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:58:06.123 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.48455.asok 2023-12-24T19:58:06.306 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48455.asok 2023-12-24T19:58:06.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:06.306 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48455.asok status 2023-12-24T19:58:06.463 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "48455", 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T19:58:06.464 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T19:58:06.465 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5088, 2023-12-24T19:58:06.465 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T19:58:06.465 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T19:58:06.465 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T19:58:06.465 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 5088 2023-12-24T19:58:06.465 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:06.465 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:06.465 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2052275700 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2052275700 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.5088 192.168.0.1:0/2052275700", 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2052275700", 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 16, 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 31, 2023-12-24T19:58:06.466 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T19:58:06.467 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T19:58:06.467 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T19:58:06.467 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:06.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:06.474 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T19:58:06.474 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:06.491 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T19:58:06.492 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:06.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:06.492 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:06.560 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:58:06.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.721+0000 7f8f17637700 1 Processor -- start 2023-12-24T19:58:06.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.721+0000 7f8f17637700 1 -- start start 2023-12-24T19:58:06.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.722+0000 7f8f17637700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f1015bb60 0x7f8f10098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:06.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f17637700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f100b2eb0 con 0x7f8f10098aa0 2023-12-24T19:58:06.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f17637700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f100b2bd0 con 0x7f8f100b2660 2023-12-24T19:58:06.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f17637700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f100afc20 con 0x7f8f1015bb60 2023-12-24T19:58:06.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f14bd2700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8f10098aa0 0x7f8f1015bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46884/0 (socket says 172.21.15.61:46884) 2023-12-24T19:58:06.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f14bd2700 1 -- 172.21.15.61:0/3201165711 learned_addr learned my addr 172.21.15.61:0/3201165711 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:06.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f153d3700 1 --2- 172.21.15.61:0/3201165711 >> v2:172.21.15.133:3300/0 conn(0x7f8f1015bb60 0x7f8f10098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:06.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121033947 0 0) 0x7f8f100b2eb0 con 0x7f8f10098aa0 2023-12-24T19:58:06.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8efc003570 con 0x7f8f10098aa0 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171619031 0 0) 0x7f8f100b2bd0 con 0x7f8f100b2660 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f100b2eb0 con 0x7f8f100b2660 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 104097779 0 0) 0x7f8efc003570 con 0x7f8f10098aa0 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 >> v2:172.21.15.133:3300/0 conn(0x7f8f1015bb60 msgr2=0x7f8f10098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 --2- 172.21.15.61:0/3201165711 >> v2:172.21.15.133:3300/0 conn(0x7f8f1015bb60 0x7f8f10098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 >> v1:172.21.15.133:6789/0 conn(0x7f8f100b2660 legacy=0x7f8f100b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f100afe10 con 0x7f8f10098aa0 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f8f0c001470 con 0x7f8f10098aa0 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f153d3700 1 --2- 172.21.15.61:0/3201165711 >> v2:172.21.15.133:3300/0 conn(0x7f8f1015bb60 0x7f8f10098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 >> v1:172.21.15.61:6789/0 conn(0x7f8f10098aa0 legacy=0x7f8f1015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8efc003c40 0x7f8efc004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8efc004810 0x7f8efc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8efc005210 0x7f8efc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:06.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc00c180 con 0x7f8efc004810 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc00c2f0 con 0x7f8efc005210 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc00c4b0 con 0x7f8efc003c40 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.723+0000 7f8f14bd2700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8efc004810 0x7f8efc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f153d3700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8efc003c40 0x7f8efc004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f15bd4700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8efc005210 0x7f8efc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f14bd2700 1 -- 172.21.15.61:0/3201165711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8efc003c40 msgr2=0x7f8efc004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f14bd2700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8efc003c40 0x7f8efc004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f14bd2700 1 -- 172.21.15.61:0/3201165711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8efc005210 msgr2=0x7f8efc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f14bd2700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8efc005210 0x7f8efc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f14bd2700 1 -- 172.21.15.61:0/3201165711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc003570 con 0x7f8efc004810 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f15bd4700 1 -- 172.21.15.61:0/3201165711 reap_dead start 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f14bd2700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8efc004810 0x7f8efc004c80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c007fd0 tx=0x7f8f0c001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f69614fe15e14a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c00cb30 con 0x7f8efc004810 2023-12-24T19:58:06.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c00cc90 con 0x7f8efc004810 2023-12-24T19:58:06.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.724+0000 7f8f07fff700 1 -- 172.21.15.61:0/3201165711 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c005b70 con 0x7f8efc004810 2023-12-24T19:58:06.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.725+0000 7f8f17637700 1 -- 172.21.15.61:0/3201165711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8efc004810 msgr2=0x7f8efc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:06.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.725+0000 7f8f17637700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8efc004810 0x7f8efc004c80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c007fd0 tx=0x7f8f0c001d40 comp rx=0 tx=0).stop 2023-12-24T19:58:06.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.725+0000 7f8f17637700 1 -- 172.21.15.61:0/3201165711 shutdown_connections 2023-12-24T19:58:06.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.725+0000 7f8f17637700 1 --2- 172.21.15.61:0/3201165711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8efc004810 0x7f8efc004c80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:06.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.725+0000 7f8f17637700 1 -- 172.21.15.61:0/3201165711 >> 172.21.15.61:0/3201165711 conn(0x7f8f10097a10 msgr2=0x7f8f100ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:06.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.725+0000 7f8f17637700 1 -- 172.21.15.61:0/3201165711 shutdown_connections 2023-12-24T19:58:06.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.725+0000 7f8f17637700 1 -- 172.21.15.61:0/3201165711 wait complete. 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.726+0000 7f8f17637700 1 Processor -- start 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.726+0000 7f8f17637700 1 -- start start 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.727+0000 7f8f17637700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8efc004810 0x7f8f1009bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.727+0000 7f8f17637700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f100aef80 0x7f8f10166a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.727+0000 7f8f17637700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f10153b50 0x7f8f10158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.727+0000 7f8f17637700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1009c420 con 0x7f8f10153b50 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.727+0000 7f8f17637700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100aeaf0 con 0x7f8f100aef80 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.727+0000 7f8f17637700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10166f80 con 0x7f8efc004810 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f15bd4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f10153b50 0x7f8f10158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f15bd4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f10153b50 0x7f8f10158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59898/0 (socket says 172.21.15.61:59898) 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f15bd4700 1 -- 172.21.15.61:0/4040218000 learned_addr learned my addr 172.21.15.61:0/4040218000 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:06.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f14bd2700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f100aef80 0x7f8f10166a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f153d3700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8efc004810 0x7f8f1009bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f15bd4700 1 -- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8efc004810 msgr2=0x7f8f1009bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f15bd4700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8efc004810 0x7f8f1009bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f15bd4700 1 -- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f100aef80 msgr2=0x7f8f10166a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f15bd4700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f100aef80 0x7f8f10166a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f15bd4700 1 -- 172.21.15.61:0/4040218000 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f101671d0 con 0x7f8f10153b50 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f15bd4700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f10153b50 0x7f8f10158ec0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8f100b3300 tx=0x7f8f08009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f057fa700 1 -- 172.21.15.61:0/4040218000 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08019070 con 0x7f8f10153b50 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f057fa700 1 -- 172.21.15.61:0/4040218000 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08006db0 con 0x7f8f10153b50 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f17637700 1 -- 172.21.15.61:0/4040218000 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f100ae1c0 con 0x7f8f10153b50 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f057fa700 1 -- 172.21.15.61:0/4040218000 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08003260 con 0x7f8f10153b50 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.728+0000 7f8f17637700 1 -- 172.21.15.61:0/4040218000 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f100ae780 con 0x7f8f10153b50 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.729+0000 7f8f17637700 1 -- 172.21.15.61:0/4040218000 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f100aeca0 con 0x7f8f10153b50 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.731+0000 7f8f057fa700 1 -- 172.21.15.61:0/4040218000 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8f0800a930 con 0x7f8f10153b50 2023-12-24T19:58:06.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.731+0000 7f8f057fa700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ef4066f30 0x7f8ef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:06.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.731+0000 7f8f057fa700 1 -- 172.21.15.61:0/4040218000 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f0808bf90 con 0x7f8f10153b50 2023-12-24T19:58:06.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.731+0000 7f8f153d3700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ef4066f30 0x7f8ef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:06.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.732+0000 7f8f153d3700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ef4066f30 0x7f8ef40693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f00006ea0 tx=0x7f8f00009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:06.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.735+0000 7f8f057fa700 1 -- 172.21.15.61:0/4040218000 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f080591e0 con 0x7f8f10153b50 2023-12-24T19:58:06.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.977+0000 7f8f17637700 1 -- 172.21.15.61:0/4040218000 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8f100aeca0 con 0x7f8f10153b50 2023-12-24T19:58:06.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.977+0000 7f8f057fa700 1 -- 172.21.15.61:0/4040218000 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8f100aeca0 con 0x7f8f10153b50 2023-12-24T19:58:06.978 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:58:06.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 -- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ef4066f30 msgr2=0x7f8ef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:06.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ef4066f30 0x7f8ef40693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f00006ea0 tx=0x7f8f00009120 comp rx=0 tx=0).stop 2023-12-24T19:58:06.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 -- 172.21.15.61:0/4040218000 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f10153b50 msgr2=0x7f8f10158ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:06.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f10153b50 0x7f8f10158ec0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8f100b3300 tx=0x7f8f08009040 comp rx=0 tx=0).stop 2023-12-24T19:58:06.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 -- 172.21.15.61:0/4040218000 shutdown_connections 2023-12-24T19:58:06.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8efc004810 0x7f8f1009bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:06.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ef4066f30 0x7f8ef40693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:06.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f10153b50 0x7f8f10158ec0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:06.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 --2- 172.21.15.61:0/4040218000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f100aef80 0x7f8f10166a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:06.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 -- 172.21.15.61:0/4040218000 >> 172.21.15.61:0/4040218000 conn(0x7f8f10097a10 msgr2=0x7f8f10068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:06.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 -- 172.21.15.61:0/4040218000 shutdown_connections 2023-12-24T19:58:06.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:06.979+0000 7f8f17637700 1 -- 172.21.15.61:0/4040218000 wait complete. 2023-12-24T19:58:06.991 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T19:58:06.991 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:58:06.991 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T19:58:06.991 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T19:58:06.991 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:06.992 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T19:58:06.992 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T19:58:06.992 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:58:06.992 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:58:06.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:06.992 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T19:58:07.013 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:58:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:58:07.013 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:58:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T19:58:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:07.014 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T19:58:07.014 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:07.014 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42485sec preferred_lft 42485sec 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:07.015 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:58:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T19:58:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link 2023-12-24T19:58:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:07.016 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:58:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T19:58:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::accb:c5ff:feae:915/64 scope link 2023-12-24T19:58:07.016 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:07.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:07.017 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:58:07.084 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T19:58:07.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:07.086 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T19:58:07.150 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T19:58:07.150 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:58:07.150 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T19:58:07.150 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T19:58:07.150 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:58:07.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:07.150 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:58:07.151 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:58:07.151 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T19:58:07.151 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T19:58:07.151 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T19:58:07.151 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:58:07.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:07.261 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T19:58:07.278 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T19:58:07.279 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T19:58:07.279 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:58:07.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:07.279 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T19:58:07.347 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T19:58:07.347 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:58:07.347 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:07.403 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:58:07.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:58:07.404 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:07.460 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T19:58:07.526 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:58:07.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:58:07.593 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:58:07.594 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:58:07.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:07.594 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T19:58:07.651 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T19:58:07.651 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T19:58:07.694 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T19:58:07.719 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:58:07.720 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:58:07.777 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T19:58:07.776+0000 7f047b612540 -1 init, newargv = 0x55a01b1446c0 newargc=15 2023-12-24T19:58:07.777 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[43000]: starting ceph client 2023-12-24T19:58:07.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[43000]: starting fuse 2023-12-24T19:58:07.788 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:58:07.789 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:58:07.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:07.790 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T19:58:07.846 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T19:58:07.846 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T19:58:07.846 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:58:07.847 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T19:58:07.848 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:58:07.848 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:58:07.848 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:58:07.848 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T19:58:07.848 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T19:58:07.848 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T19:58:07.848 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:58:07.848 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:58:07.848 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T19:58:07.848 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T19:58:07.969 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.43000.asok 2023-12-24T19:58:08.152 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43000.asok 2023-12-24T19:58:08.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:08.152 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43000.asok status 2023-12-24T19:58:08.304 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T19:58:08.304 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T19:58:08.304 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:58:08.304 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "43000", 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4778, 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T19:58:08.305 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 4778 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 396651327 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 396651327 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.4778 192.168.0.1:0/396651327", 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/396651327", 2023-12-24T19:58:08.306 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T19:58:08.307 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 16, 2023-12-24T19:58:08.307 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 31, 2023-12-24T19:58:08.307 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T19:58:08.307 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T19:58:08.307 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T19:58:08.307 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T19:58:08.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:08.314 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T19:58:08.314 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:08.332 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T19:58:08.332 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:08.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:08.332 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:08.400 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:08.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.536+0000 7f2ae1ce7700 1 Processor -- start 2023-12-24T19:58:08.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.536+0000 7f2ae1ce7700 1 -- start start 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2ae1ce7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2adc06aac0 0x7f2adc159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2ae1ce7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2adc0caa80 0x7f2adc0aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2ae1ce7700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc06a630 con 0x7f2adc159850 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2ae1ce7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0cccf0 con 0x7f2adc06aac0 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2ae1ce7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc069d00 con 0x7f2adc0caa80 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2adaffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2adc06aac0 0x7f2adc159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2adb7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2adc159850 0x7f2adc0cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46896/0 (socket says 172.21.15.61:46896) 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2adb7fe700 1 -- 172.21.15.61:0/1257600384 learned_addr learned my addr 172.21.15.61:0/1257600384 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2adbfff700 1 --2- 172.21.15.61:0/1257600384 >> v2:172.21.15.133:3300/0 conn(0x7f2adc0caa80 0x7f2adc0aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2adaffd700 1 -- 172.21.15.61:0/1257600384 >> v2:172.21.15.133:3300/0 conn(0x7f2adc0caa80 msgr2=0x7f2adc0aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:08.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2adaffd700 1 --2- 172.21.15.61:0/1257600384 >> v2:172.21.15.133:3300/0 conn(0x7f2adc0caa80 0x7f2adc0aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2adaffd700 1 -- 172.21.15.61:0/1257600384 >> v1:172.21.15.61:6789/0 conn(0x7f2adc159850 legacy=0x7f2adc0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2adaffd700 1 -- 172.21.15.61:0/1257600384 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc069fe0 con 0x7f2adc06aac0 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2ada7fc700 1 -- 172.21.15.61:0/1257600384 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172786635 0 0) 0x7f2adc06a630 con 0x7f2adc159850 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.537+0000 7f2adaffd700 1 --2- 172.21.15.61:0/1257600384 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 0x7f2adc159c20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0caa10 tx=0x7f2ad00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f5fa0cda104a74 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ada7fc700 1 -- 172.21.15.61:0/1257600384 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0011630 con 0x7f2adc06aac0 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ada7fc700 1 -- 172.21.15.61:0/1257600384 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad0011790 con 0x7f2adc06aac0 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ada7fc700 1 -- 172.21.15.61:0/1257600384 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0011b30 con 0x7f2adc06aac0 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/1257600384 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 msgr2=0x7f2adc159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ae1ce7700 1 --2- 172.21.15.61:0/1257600384 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 0x7f2adc159c20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0caa10 tx=0x7f2ad00091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/1257600384 shutdown_connections 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ae1ce7700 1 --2- 172.21.15.61:0/1257600384 >> v2:172.21.15.133:3300/0 conn(0x7f2adc0caa80 0x7f2adc0aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ae1ce7700 1 --2- 172.21.15.61:0/1257600384 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 0x7f2adc159c20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/1257600384 >> 172.21.15.61:0/1257600384 conn(0x7f2adc0cceb0 msgr2=0x7f2adc0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:08.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/1257600384 shutdown_connections 2023-12-24T19:58:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.538+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/1257600384 wait complete. 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.540+0000 7f2ae1ce7700 1 Processor -- start 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.540+0000 7f2ae1ce7700 1 -- start start 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.540+0000 7f2ae1ce7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 0x7f2adc14bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.540+0000 7f2ae1ce7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc0caa80 0x7f2adc15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.540+0000 7f2ae1ce7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2adc159850 0x7f2adc14db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.540+0000 7f2ae1ce7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc14c080 con 0x7f2adc06aac0 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.540+0000 7f2ae1ce7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc15ba10 con 0x7f2adc0caa80 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.540+0000 7f2ae1ce7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b0dd0 con 0x7f2adc159850 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.540+0000 7f2adb7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 0x7f2adc14bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.540+0000 7f2adb7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 0x7f2adc14bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59908/0 (socket says 172.21.15.61:59908) 2023-12-24T19:58:08.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2adb7fe700 1 -- 172.21.15.61:0/3268573894 learned_addr learned my addr 172.21.15.61:0/3268573894 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2adaffd700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc0caa80 0x7f2adc15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2adbfff700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2adc159850 0x7f2adc14db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2adb7fe700 1 -- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2adc159850 msgr2=0x7f2adc14db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2adb7fe700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2adc159850 0x7f2adc14db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2adb7fe700 1 -- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc0caa80 msgr2=0x7f2adc15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2adb7fe700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc0caa80 0x7f2adc15b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2adb7fe700 1 -- 172.21.15.61:0/3268573894 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0009420 con 0x7f2adc06aac0 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2adaffd700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc0caa80 0x7f2adc15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2adb7fe700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 0x7f2adc14bb40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00c5b0 tx=0x7f2acc001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2ac37fe700 1 -- 172.21.15.61:0/3268573894 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc005b30 con 0x7f2adc06aac0 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2ac37fe700 1 -- 172.21.15.61:0/3268573894 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc005c90 con 0x7f2adc06aac0 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/3268573894 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc0b1070 con 0x7f2adc06aac0 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2ac37fe700 1 -- 172.21.15.61:0/3268573894 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc007320 con 0x7f2adc06aac0 2023-12-24T19:58:08.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.541+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/3268573894 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc0b1630 con 0x7f2adc06aac0 2023-12-24T19:58:08.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.542+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/3268573894 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc04c3c0 con 0x7f2adc06aac0 2023-12-24T19:58:08.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.543+0000 7f2ac37fe700 1 -- 172.21.15.61:0/3268573894 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2acc01b3b0 con 0x7f2adc06aac0 2023-12-24T19:58:08.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.543+0000 7f2ac37fe700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac8066f30 0x7f2ac80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:08.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.543+0000 7f2ac37fe700 1 -- 172.21.15.61:0/3268573894 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2acc083990 con 0x7f2adc06aac0 2023-12-24T19:58:08.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.543+0000 7f2adaffd700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac8066f30 0x7f2ac80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:08.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.544+0000 7f2adaffd700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac8066f30 0x7f2ac80693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00093f0 tx=0x7f2ad0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:08.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.547+0000 7f2ac37fe700 1 -- 172.21.15.61:0/3268573894 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2acc050c00 con 0x7f2adc06aac0 2023-12-24T19:58:08.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.789+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/3268573894 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2adc0b1850 con 0x7f2adc06aac0 2023-12-24T19:58:08.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.789+0000 7f2ac37fe700 1 -- 172.21.15.61:0/3268573894 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f2acc017090 con 0x7f2adc06aac0 2023-12-24T19:58:08.790 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:08.790 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2779978406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2779978406},{"type":"v1","addr":"172.21.15.61:6835","nonce":2779978406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1935570272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1935570272},{"type":"v1","addr":"172.21.15.133:6836","nonce":1935570272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3983510237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3983510237},{"type":"v1","addr":"172.21.15.133:6837","nonce":3983510237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:58.161119+0000","modified":"2023-12-24T19:58:01.793217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4777},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4777":{"gid":4777,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2729904701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2729904701},{"type":"v1","addr":"172.21.15.61:6834","nonce":2729904701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T19:58:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac8066f30 msgr2=0x7f2ac80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac8066f30 0x7f2ac80693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00093f0 tx=0x7f2ad0017000 comp rx=0 tx=0).stop 2023-12-24T19:58:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/3268573894 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 msgr2=0x7f2adc14bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 0x7f2adc14bb40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00c5b0 tx=0x7f2acc001070 comp rx=0 tx=0).stop 2023-12-24T19:58:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/3268573894 shutdown_connections 2023-12-24T19:58:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2adc159850 0x7f2adc14db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac8066f30 0x7f2ac80693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc06aac0 0x7f2adc14bb40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 --2- 172.21.15.61:0/3268573894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc0caa80 0x7f2adc15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/3268573894 >> 172.21.15.61:0/3268573894 conn(0x7f2adc0cceb0 msgr2=0x7f2adc14c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:08.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/3268573894 shutdown_connections 2023-12-24T19:58:08.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:08.791+0000 7f2ae1ce7700 1 -- 172.21.15.61:0/3268573894 wait complete. 2023-12-24T19:58:08.793 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 16 2023-12-24T19:58:08.803 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-24T19:58:08.944 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":4777,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.163210783,"mdsmap_epoch":16,"osdmap_epoch":31,"osdmap_epoch_barrier":31,"uptime":18.053227606} 2023-12-24T19:58:08.944 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 4777, "mdsmap_epoch": 16, "osdmap_epoch": 31, "osdmap_epoch_barrier": 31, "rank_uptime": 10.163210783, "state": "up:active", "uptime": 18.053227606, "want_state": "up:active", "whoami": 0 } 2023-12-24T19:58:08.944 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-12-24T19:58:09.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.065+0000 7fee5a771700 1 Processor -- start 2023-12-24T19:58:09.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.065+0000 7fee5a771700 1 -- start start 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee5a771700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee54159cf0 0x7fee5406f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee5a771700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee540cd9c0 0x7fee540cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee5a771700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5406c300 con 0x7fee5406ec70 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee5a771700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5406ce80 con 0x7fee540cd9c0 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee5a771700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee54068560 con 0x7fee54159cf0 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee53fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fee5406ec70 0x7fee541595e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46906/0 (socket says 172.21.15.61:46906) 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee53fff700 1 -- 172.21.15.61:0/246506230 learned_addr learned my addr 172.21.15.61:0/246506230 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee58d0e700 1 --2- 172.21.15.61:0/246506230 >> v2:172.21.15.133:3300/0 conn(0x7fee540cd9c0 0x7fee540cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee537fe700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee54159cf0 0x7fee5406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751510436 0 0) 0x7fee5406c300 con 0x7fee5406ec70 2023-12-24T19:58:09.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee3c003570 con 0x7fee5406ec70 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032652062 0 0) 0x7fee3c003570 con 0x7fee5406ec70 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee54159cf0 msgr2=0x7fee5406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee54159cf0 0x7fee5406f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 >> v2:172.21.15.133:3300/0 conn(0x7fee540cd9c0 msgr2=0x7fee540cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 --2- 172.21.15.61:0/246506230 >> v2:172.21.15.133:3300/0 conn(0x7fee540cd9c0 0x7fee540cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5406c550 con 0x7fee5406ec70 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fee44001470 con 0x7fee5406ec70 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 >> v1:172.21.15.61:6789/0 conn(0x7fee5406ec70 legacy=0x7fee541595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.066+0000 7fee52ffd700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee3c003a60 0x7fee3c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee52ffd700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee54159cf0 0x7fee3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee52ffd700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee3c004d50 0x7fee3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5406ce80 con 0x7fee3c004d50 2023-12-24T19:58:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee54068560 con 0x7fee3c003a60 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c00ba60 con 0x7fee54159cf0 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee53fff700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee3c003a60 0x7fee3c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee58d0e700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee3c004d50 0x7fee3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee537fe700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee54159cf0 0x7fee3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee53fff700 1 -- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee54159cf0 msgr2=0x7fee3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee53fff700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee54159cf0 0x7fee3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee53fff700 1 -- 172.21.15.61:0/246506230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee3c004d50 msgr2=0x7fee3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee53fff700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee3c004d50 0x7fee3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee53fff700 1 -- 172.21.15.61:0/246506230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c003570 con 0x7fee3c003a60 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee53fff700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee3c003a60 0x7fee3c003e70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee4400c3c0 tx=0x7fee540cf7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f0bd702a87321c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4400cc90 con 0x7fee3c003a60 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4400ce30 con 0x7fee3c003a60 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.067+0000 7fee52ffd700 1 -- 172.21.15.61:0/246506230 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44005b70 con 0x7fee3c003a60 2023-12-24T19:58:09.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.068+0000 7fee5a771700 1 -- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee3c003a60 msgr2=0x7fee3c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.068+0000 7fee5a771700 1 --2- 172.21.15.61:0/246506230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee3c003a60 0x7fee3c003e70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee4400c3c0 tx=0x7fee540cf7f0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.068+0000 7fee58d0e700 1 -- 172.21.15.61:0/246506230 reap_dead start 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.068+0000 7fee5a771700 1 -- 172.21.15.61:0/246506230 shutdown_connections 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.068+0000 7fee5a771700 1 -- 172.21.15.61:0/246506230 >> 172.21.15.61:0/246506230 conn(0x7fee5406b650 msgr2=0x7fee540ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.068+0000 7fee5a771700 1 -- 172.21.15.61:0/246506230 shutdown_connections 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.068+0000 7fee5a771700 1 -- 172.21.15.61:0/246506230 wait complete. 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.069+0000 7fee5a771700 1 Processor -- start 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.069+0000 7fee5a771700 1 -- start start 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee5a771700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee3c003a60 0x7fee54144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee5a771700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee540aebb0 0x7fee540af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee5a771700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee540b2940 0x7fee540b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee5a771700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5415d630 con 0x7fee540b2940 2023-12-24T19:58:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee5a771700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540af560 con 0x7fee3c003a60 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee5a771700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540b36c0 con 0x7fee540aebb0 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee58d0e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee540b2940 0x7fee540b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee53fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee3c003a60 0x7fee54144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee537fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee540aebb0 0x7fee540af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee58d0e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee540b2940 0x7fee540b2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59926/0 (socket says 172.21.15.61:59926) 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee58d0e700 1 -- 172.21.15.61:0/1115325224 learned_addr learned my addr 172.21.15.61:0/1115325224 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee58d0e700 1 -- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee540aebb0 msgr2=0x7fee540af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee58d0e700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee540aebb0 0x7fee540af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee58d0e700 1 -- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee3c003a60 msgr2=0x7fee54144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee58d0e700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee3c003a60 0x7fee54144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee58d0e700 1 -- 172.21.15.61:0/1115325224 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540b39a0 con 0x7fee540b2940 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.070+0000 7fee58d0e700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee540b2940 0x7fee540b2db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fee54064630 tx=0x7fee4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.071+0000 7fee3bfff700 1 -- 172.21.15.61:0/1115325224 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00e040 con 0x7fee540b2940 2023-12-24T19:58:09.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.071+0000 7fee3bfff700 1 -- 172.21.15.61:0/1115325224 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c00f040 con 0x7fee540b2940 2023-12-24T19:58:09.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.071+0000 7fee5a771700 1 -- 172.21.15.61:0/1115325224 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee540b3c80 con 0x7fee540b2940 2023-12-24T19:58:09.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.071+0000 7fee3bfff700 1 -- 172.21.15.61:0/1115325224 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00fd70 con 0x7fee540b2940 2023-12-24T19:58:09.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.071+0000 7fee5a771700 1 -- 172.21.15.61:0/1115325224 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee54144770 con 0x7fee540b2940 2023-12-24T19:58:09.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.072+0000 7fee5a771700 1 -- 172.21.15.61:0/1115325224 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5415d7e0 con 0x7fee540b2940 2023-12-24T19:58:09.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.072+0000 7fee3bfff700 1 -- 172.21.15.61:0/1115325224 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fee4c015640 con 0x7fee540b2940 2023-12-24T19:58:09.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.072+0000 7fee3bfff700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee40066f30 0x7fee400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:09.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.073+0000 7fee3bfff700 1 -- 172.21.15.61:0/1115325224 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee4c084c60 con 0x7fee540b2940 2023-12-24T19:58:09.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.073+0000 7fee53fff700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee40066f30 0x7fee400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:09.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.073+0000 7fee53fff700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee40066f30 0x7fee400693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee4400c3c0 tx=0x7fee44015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:09.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.077+0000 7fee3bfff700 1 -- 172.21.15.61:0/1115325224 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee5415d7e0 con 0x7fee540b2940 2023-12-24T19:58:09.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.355+0000 7fee5a771700 1 -- 172.21.15.61:0/1115325224 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fee5415d7e0 con 0x7fee540b2940 2023-12-24T19:58:09.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.355+0000 7fee3bfff700 1 -- 172.21.15.61:0/1115325224 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1620 (secure 0 0 0) 0x7fee5415d7e0 con 0x7fee540b2940 2023-12-24T19:58:09.355 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "stats": { 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "total_bytes": 1600000000, 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "total_avail_bytes": 1597746220, 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "total_used_bytes": 2253780, 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "total_used_raw_bytes": 2253780, 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "total_used_raw_ratio": 0.0014086124720051885, 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "num_osds": 8, 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "num_per_pool_osds": 0, 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "num_per_pool_omap_osds": 0 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "stats_by_class": { 2023-12-24T19:58:09.356 INFO:teuthology.orchestra.run.smithi061.stdout: "hdd": { 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "total_bytes": 1600000000, 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "total_avail_bytes": 1597746220, 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "total_used_bytes": 2253780, 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "total_used_raw_bytes": 2253780, 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "total_used_raw_ratio": 0.0014086124720051885 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "name": ".mgr", 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 1, 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "stats": { 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "stored": 590368, 2023-12-24T19:58:09.357 INFO:teuthology.orchestra.run.smithi061.stdout: "objects": 2, 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "kb_used": 577, 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "bytes_used": 590368, 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "percent_used": 0.00052957510342821479, 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "max_avail": 557102656 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "name": "cephfs_metadata", 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 4, 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "stats": { 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "stored": 2306, 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "objects": 22, 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "kb_used": 3, 2023-12-24T19:58:09.358 INFO:teuthology.orchestra.run.smithi061.stdout: "bytes_used": 2306, 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "percent_used": 2.0696322735602735e-06, 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "max_avail": 557102656 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "name": "cephfs_data", 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5, 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "stats": { 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "stored": 0, 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "objects": 0, 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "kb_used": 0, 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "bytes_used": 0, 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "percent_used": 0, 2023-12-24T19:58:09.359 INFO:teuthology.orchestra.run.smithi061.stdout: "max_avail": 557102656 2023-12-24T19:58:09.360 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:09.360 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:09.360 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:09.360 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 -- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee40066f30 msgr2=0x7fee400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee40066f30 0x7fee400693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee4400c3c0 tx=0x7fee44015000 comp rx=0 tx=0).stop 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 -- 172.21.15.61:0/1115325224 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee540b2940 msgr2=0x7fee540b2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee540b2940 0x7fee540b2db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fee54064630 tx=0x7fee4c00b040 comp rx=0 tx=0).stop 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 -- 172.21.15.61:0/1115325224 shutdown_connections 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee40066f30 0x7fee400693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee540b2940 0x7fee540b2db0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee3c003a60 0x7fee54144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 --2- 172.21.15.61:0/1115325224 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee540aebb0 0x7fee540af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 -- 172.21.15.61:0/1115325224 >> 172.21.15.61:0/1115325224 conn(0x7fee5406b650 msgr2=0x7fee54158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 -- 172.21.15.61:0/1115325224 shutdown_connections 2023-12-24T19:58:09.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:09.357+0000 7fee5a771700 1 -- 172.21.15.61:0/1115325224 wait complete. 2023-12-24T19:58:09.370 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:09.370 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:58:09.370 DEBUG:teuthology.orchestra.run.smithi061:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-24T19:58:09.370 DEBUG:teuthology.orchestra.run.smithi061:> os.fchmod(fd, 0O666) 2023-12-24T19:58:09.370 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(fd) 2023-12-24T19:58:09.370 DEBUG:teuthology.orchestra.run.smithi061:> os.close(fd) 2023-12-24T19:58:09.370 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T19:58:09.627 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T19:58:09.628 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:58:09.754 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.48455.asok 2023-12-24T19:58:09.936 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48455.asok 2023-12-24T19:58:09.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:09.937 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48455.asok status 2023-12-24T19:58:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:10.093 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T19:58:10.093 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:58:10.093 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:58:10.093 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T19:58:10.093 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "48455", 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 1, 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5088, 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 5088 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:10.094 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2052275700 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2052275700 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.5088 192.168.0.1:0/2052275700", 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2052275700", 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 2, 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 16, 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 31, 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 31, 2023-12-24T19:58:10.095 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T19:58:10.096 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T19:58:10.096 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:10.103 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-12-24T19:58:10.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.225+0000 7f0023274700 1 Processor -- start 2023-12-24T19:58:10.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.225+0000 7f0023274700 1 -- start start 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0023274700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f001c06de80 0x7f001c06e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0023274700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c0cb820 0x7f001c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0023274700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f001c0685d0 0x7f001c15a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0023274700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001c0b3840 con 0x7f001c06de80 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0023274700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001c068140 con 0x7f001c0685d0 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0023274700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c067550 con 0x7f001c0cb820 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0021010700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f001c06de80 0x7f001c06e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0021010700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f001c06de80 0x7f001c06e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59936/0 (socket says 172.21.15.61:59936) 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0021010700 1 -- 172.21.15.61:0/2769204407 learned_addr learned my addr 172.21.15.61:0/2769204407 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0021010700 1 -- 172.21.15.61:0/2769204407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c0cb820 msgr2=0x7f001c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0021811700 1 --2- 172.21.15.61:0/2769204407 >> v2:172.21.15.133:3300/0 conn(0x7f001c0685d0 0x7f001c15a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f002080f700 1 --2- 172.21.15.61:0/2769204407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c0cb820 0x7f001c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0021010700 1 --2- 172.21.15.61:0/2769204407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c0cb820 0x7f001c0b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0021010700 1 -- 172.21.15.61:0/2769204407 >> v2:172.21.15.133:3300/0 conn(0x7f001c0685d0 msgr2=0x7f001c15a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0021010700 1 --2- 172.21.15.61:0/2769204407 >> v2:172.21.15.133:3300/0 conn(0x7f001c0685d0 0x7f001c15a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.226+0000 7f0021010700 1 -- 172.21.15.61:0/2769204407 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c0cbc30 con 0x7f001c06de80 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0021010700 1 --2- 172.21.15.61:0/2769204407 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c06de80 0x7f001c06e250 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f001c071a10 tx=0x7f000c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf4fc273bdb8676 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0013fff700 1 -- 172.21.15.61:0/2769204407 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c00dce0 con 0x7f001c06de80 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0013fff700 1 -- 172.21.15.61:0/2769204407 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c00de40 con 0x7f001c06de80 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0013fff700 1 -- 172.21.15.61:0/2769204407 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0196d0 con 0x7f001c06de80 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0023274700 1 -- 172.21.15.61:0/2769204407 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c06de80 msgr2=0x7f001c06e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0023274700 1 --2- 172.21.15.61:0/2769204407 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c06de80 0x7f001c06e250 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f001c071a10 tx=0x7f000c00b4f0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0023274700 1 -- 172.21.15.61:0/2769204407 shutdown_connections 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0023274700 1 --2- 172.21.15.61:0/2769204407 >> v2:172.21.15.133:3300/0 conn(0x7f001c0685d0 0x7f001c15a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0023274700 1 --2- 172.21.15.61:0/2769204407 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c06de80 0x7f001c06e250 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0023274700 1 --2- 172.21.15.61:0/2769204407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c0cb820 0x7f001c0b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0023274700 1 -- 172.21.15.61:0/2769204407 >> 172.21.15.61:0/2769204407 conn(0x7f001c0ce3f0 msgr2=0x7f001c0b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:10.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0023274700 1 -- 172.21.15.61:0/2769204407 shutdown_connections 2023-12-24T19:58:10.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.227+0000 7f0023274700 1 -- 172.21.15.61:0/2769204407 wait complete. 2023-12-24T19:58:10.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.228+0000 7f0023274700 1 Processor -- start 2023-12-24T19:58:10.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.228+0000 7f0023274700 1 -- start start 2023-12-24T19:58:10.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.229+0000 7f0023274700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f001c0685d0 0x7f001c14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.229+0000 7f0023274700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c06de80 0x7f001c0c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.229+0000 7f0023274700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c0cb820 0x7f001c153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.229+0000 7f0023274700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0c82b0 con 0x7f001c0cb820 2023-12-24T19:58:10.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.229+0000 7f0023274700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0c8440 con 0x7f001c0685d0 2023-12-24T19:58:10.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.229+0000 7f0023274700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0c6400 con 0x7f001c06de80 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.229+0000 7f0021811700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c0cb820 0x7f001c153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.229+0000 7f0021811700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c0cb820 0x7f001c153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59946/0 (socket says 172.21.15.61:59946) 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.229+0000 7f0021811700 1 -- 172.21.15.61:0/1902463652 learned_addr learned my addr 172.21.15.61:0/1902463652 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f0021010700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f001c0685d0 0x7f001c14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f002080f700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c06de80 0x7f001c0c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f0021811700 1 -- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c06de80 msgr2=0x7f001c0c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f0021811700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c06de80 0x7f001c0c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f0021811700 1 -- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f001c0685d0 msgr2=0x7f001c14c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f0021811700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f001c0685d0 0x7f001c14c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f0021811700 1 -- 172.21.15.61:0/1902463652 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c00b790 con 0x7f001c0cb820 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f0021811700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c0cb820 0x7f001c153720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f001400ceb0 tx=0x7f0014007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f00117fa700 1 -- 172.21.15.61:0/1902463652 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400ae40 con 0x7f001c0cb820 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f00117fa700 1 -- 172.21.15.61:0/1902463652 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0014016430 con 0x7f001c0cb820 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f0023274700 1 -- 172.21.15.61:0/1902463652 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c0c66e0 con 0x7f001c0cb820 2023-12-24T19:58:10.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f00117fa700 1 -- 172.21.15.61:0/1902463652 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00140167d0 con 0x7f001c0cb820 2023-12-24T19:58:10.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.230+0000 7f0023274700 1 -- 172.21.15.61:0/1902463652 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c14ced0 con 0x7f001c0cb820 2023-12-24T19:58:10.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.231+0000 7f0023274700 1 -- 172.21.15.61:0/1902463652 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c0c6ae0 con 0x7f001c0cb820 2023-12-24T19:58:10.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.232+0000 7f00117fa700 1 -- 172.21.15.61:0/1902463652 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0014003020 con 0x7f001c0cb820 2023-12-24T19:58:10.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.232+0000 7f00117fa700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0000066f30 0x7f00000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.232+0000 7f00117fa700 1 -- 172.21.15.61:0/1902463652 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0014012070 con 0x7f001c0cb820 2023-12-24T19:58:10.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.232+0000 7f0021010700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0000066f30 0x7f00000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.233+0000 7f0021010700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0000066f30 0x7f00000693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f001c071a10 tx=0x7f000c01b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:10.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.236+0000 7f00117fa700 1 -- 172.21.15.61:0/1902463652 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0014052660 con 0x7f001c0cb820 2023-12-24T19:58:10.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.444+0000 7f0023274700 1 -- 172.21.15.61:0/1902463652 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f001c0c85b0 con 0x7f001c0cb820 2023-12-24T19:58:10.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.766+0000 7f00117fa700 1 -- 172.21.15.61:0/1902463652 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v32) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0014055c80 con 0x7f001c0cb820 2023-12-24T19:58:10.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 -- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0000066f30 msgr2=0x7f00000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:10.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0000066f30 0x7f00000693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f001c071a10 tx=0x7f000c01b000 comp rx=0 tx=0).stop 2023-12-24T19:58:10.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 -- 172.21.15.61:0/1902463652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c0cb820 msgr2=0x7f001c153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:10.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c0cb820 0x7f001c153720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f001400ceb0 tx=0x7f0014007870 comp rx=0 tx=0).stop 2023-12-24T19:58:10.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 -- 172.21.15.61:0/1902463652 shutdown_connections 2023-12-24T19:58:10.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0000066f30 0x7f00000693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f001c0cb820 0x7f001c153720 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f001c0685d0 0x7f001c14c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 --2- 172.21.15.61:0/1902463652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f001c06de80 0x7f001c0c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 -- 172.21.15.61:0/1902463652 >> 172.21.15.61:0/1902463652 conn(0x7f001c0ce3f0 msgr2=0x7f001c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:10.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 -- 172.21.15.61:0/1902463652 shutdown_connections 2023-12-24T19:58:10.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.769+0000 7f0023274700 1 -- 172.21.15.61:0/1902463652 wait complete. 2023-12-24T19:58:10.772 INFO:teuthology.orchestra.run.smithi061.stderr:pauserd,pausewr is set 2023-12-24T19:58:10.782 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-12-24T19:58:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.905+0000 7faf5a8d9700 1 Processor -- start 2023-12-24T19:58:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.905+0000 7faf5a8d9700 1 -- start start 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf5a8d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf5406f6a0 0x7faf5415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf5a8d9700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5415a940 con 0x7faf54159920 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf5a8d9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5415aba0 con 0x7faf540ce030 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf5a8d9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5415ae80 con 0x7faf5406f6a0 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf53fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7faf54159920 0x7faf540cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46920/0 (socket says 172.21.15.61:46920) 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf53fff700 1 -- 172.21.15.61:0/2501048233 learned_addr learned my addr 172.21.15.61:0/2501048233 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936079100 0 0) 0x7faf5415a940 con 0x7faf54159920 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf40003570 con 0x7faf54159920 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf58e76700 1 --2- 172.21.15.61:0/2501048233 >> v2:172.21.15.133:3300/0 conn(0x7faf5406f6a0 0x7faf5415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4208659639 0 0) 0x7faf40003570 con 0x7faf54159920 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 >> v2:172.21.15.133:3300/0 conn(0x7faf5406f6a0 msgr2=0x7faf5415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf52ffd700 1 --2- 172.21.15.61:0/2501048233 >> v2:172.21.15.133:3300/0 conn(0x7faf5406f6a0 0x7faf5415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 >> v1:172.21.15.133:6789/0 conn(0x7faf540ce030 legacy=0x7faf54159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5406ebc0 con 0x7faf54159920 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.906+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7faf44001470 con 0x7faf54159920 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 >> v1:172.21.15.61:6789/0 conn(0x7faf54159920 legacy=0x7faf540cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf52ffd700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf40003a60 0x7faf40003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf52ffd700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf40004810 0x7faf40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf52ffd700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf400051c0 0x7faf4000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5415ae80 con 0x7faf40004810 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4000c0d0 con 0x7faf40003a60 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4000c290 con 0x7faf400051c0 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf537fe700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf40004810 0x7faf40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf53fff700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf40003a60 0x7faf40003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf58e76700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf400051c0 0x7faf4000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf537fe700 1 -- 172.21.15.61:0/2501048233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf400051c0 msgr2=0x7faf4000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf537fe700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf400051c0 0x7faf4000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf537fe700 1 -- 172.21.15.61:0/2501048233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf40003a60 msgr2=0x7faf40003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf537fe700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf40003a60 0x7faf40003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf537fe700 1 -- 172.21.15.61:0/2501048233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40003570 con 0x7faf40004810 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf58e76700 1 -- 172.21.15.61:0/2501048233 reap_dead start 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf537fe700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf40004810 0x7faf40004c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0018b0 tx=0x7faf3c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649b7185a007d088 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c012420 con 0x7faf40004810 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c0125a0 con 0x7faf40004810 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.907+0000 7faf52ffd700 1 -- 172.21.15.61:0/2501048233 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c012960 con 0x7faf40004810 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.908+0000 7faf5a8d9700 1 -- 172.21.15.61:0/2501048233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf40004810 msgr2=0x7faf40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.908+0000 7faf5a8d9700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf40004810 0x7faf40004c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0018b0 tx=0x7faf3c007d30 comp rx=0 tx=0).stop 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.908+0000 7faf5a8d9700 1 -- 172.21.15.61:0/2501048233 shutdown_connections 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.908+0000 7faf5a8d9700 1 --2- 172.21.15.61:0/2501048233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf40004810 0x7faf40004c80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.908+0000 7faf5a8d9700 1 -- 172.21.15.61:0/2501048233 >> 172.21.15.61:0/2501048233 conn(0x7faf5406b790 msgr2=0x7faf54069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.908+0000 7faf5a8d9700 1 -- 172.21.15.61:0/2501048233 shutdown_connections 2023-12-24T19:58:10.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.908+0000 7faf5a8d9700 1 -- 172.21.15.61:0/2501048233 wait complete. 2023-12-24T19:58:10.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.909+0000 7faf5a8d9700 1 Processor -- start 2023-12-24T19:58:10.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.909+0000 7faf5a8d9700 1 -- start start 2023-12-24T19:58:10.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf5a8d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf40004810 0x7faf5416e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf5a8d9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf540cb160 0x7faf540b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf5a8d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf540b1b10 0x7faf540b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf5a8d9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5416dd20 con 0x7faf540cb160 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf5a8d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540b2090 con 0x7faf40004810 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf5a8d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5416d6d0 con 0x7faf540b1b10 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf537fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf540cb160 0x7faf540b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf537fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf540cb160 0x7faf540b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59966/0 (socket says 172.21.15.61:59966) 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf537fe700 1 -- 172.21.15.61:0/784326125 learned_addr learned my addr 172.21.15.61:0/784326125 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf53fff700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf40004810 0x7faf5416e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf58e76700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf540b1b10 0x7faf540b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf537fe700 1 -- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf540b1b10 msgr2=0x7faf540b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf537fe700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf540b1b10 0x7faf540b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf537fe700 1 -- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf40004810 msgr2=0x7faf5416e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf537fe700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf40004810 0x7faf5416e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.910+0000 7faf537fe700 1 -- 172.21.15.61:0/784326125 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5416d9b0 con 0x7faf540cb160 2023-12-24T19:58:10.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.911+0000 7faf537fe700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf540cb160 0x7faf540b15d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf4000c0a0 tx=0x7faf3c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.911+0000 7faf4bfff700 1 -- 172.21.15.61:0/784326125 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c01f6f0 con 0x7faf540cb160 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.911+0000 7faf4bfff700 1 -- 172.21.15.61:0/784326125 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c01f850 con 0x7faf540cb160 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.911+0000 7faf5a8d9700 1 -- 172.21.15.61:0/784326125 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf540aed90 con 0x7faf540cb160 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.911+0000 7faf4bfff700 1 -- 172.21.15.61:0/784326125 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c01fbf0 con 0x7faf540cb160 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.911+0000 7faf5a8d9700 1 -- 172.21.15.61:0/784326125 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf540cb5d0 con 0x7faf540cb160 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.912+0000 7faf5a8d9700 1 -- 172.21.15.61:0/784326125 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5416e000 con 0x7faf540cb160 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.912+0000 7faf4bfff700 1 -- 172.21.15.61:0/784326125 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7faf3c00c420 con 0x7faf540cb160 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.913+0000 7faf4bfff700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf34066f30 0x7faf340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.913+0000 7faf4bfff700 1 -- 172.21.15.61:0/784326125 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf3c085b60 con 0x7faf540cb160 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.913+0000 7faf4bfff700 1 -- 172.21.15.61:0/784326125 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=33+}) v3 -- 0x7faf3406ea50 con 0x7faf540cb160 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.913+0000 7faf53fff700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf34066f30 0x7faf340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:10.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.913+0000 7faf53fff700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf34066f30 0x7faf340693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf54066960 tx=0x7faf44001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:10.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:10.917+0000 7faf4bfff700 1 -- 172.21.15.61:0/784326125 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf3c023060 con 0x7faf540cb160 2023-12-24T19:58:11.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.120+0000 7faf5a8d9700 1 -- 172.21.15.61:0/784326125 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7faf5404c3c0 con 0x7faf540cb160 2023-12-24T19:58:11.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.768+0000 7faf4bfff700 1 -- 172.21.15.61:0/784326125 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(33..33 src has 1..33) v4 ==== 280+0+0 (secure 0 0 0) 0x7faf3c057250 con 0x7faf540cb160 2023-12-24T19:58:11.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.768+0000 7faf4bfff700 1 -- 172.21.15.61:0/784326125 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=34}) v3 -- 0x7faf3406f3a0 con 0x7faf540cb160 2023-12-24T19:58:11.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.771+0000 7faf4bfff700 1 -- 172.21.15.61:0/784326125 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7faf3c017070 con 0x7faf540cb160 2023-12-24T19:58:11.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 -- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf34066f30 msgr2=0x7faf340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:11.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf34066f30 0x7faf340693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf54066960 tx=0x7faf44001e50 comp rx=0 tx=0).stop 2023-12-24T19:58:11.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 -- 172.21.15.61:0/784326125 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf540cb160 msgr2=0x7faf540b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:11.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf540cb160 0x7faf540b15d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf4000c0a0 tx=0x7faf3c015000 comp rx=0 tx=0).stop 2023-12-24T19:58:11.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 -- 172.21.15.61:0/784326125 shutdown_connections 2023-12-24T19:58:11.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf540b1b10 0x7faf540b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf34066f30 0x7faf340693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf40004810 0x7faf5416e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 --2- 172.21.15.61:0/784326125 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf540cb160 0x7faf540b15d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 -- 172.21.15.61:0/784326125 >> 172.21.15.61:0/784326125 conn(0x7faf5406b790 msgr2=0x7faf54067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:11.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 -- 172.21.15.61:0/784326125 shutdown_connections 2023-12-24T19:58:11.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.773+0000 7faf5a8d9700 1 -- 172.21.15.61:0/784326125 wait complete. 2023-12-24T19:58:11.775 INFO:teuthology.orchestra.run.smithi061.stderr:pauserd,pausewr is unset 2023-12-24T19:58:11.787 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:58:11.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.911+0000 7ff0def0f700 1 Processor -- start 2023-12-24T19:58:11.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.911+0000 7ff0def0f700 1 -- start start 2023-12-24T19:58:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0def0f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff0d80af710 0x7ff0d80afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0def0f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d8068c80 0x7ff0d8067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0def0f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0d80a6c80 0x7ff0d815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0def0f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80687f0 con 0x7ff0d80af710 2023-12-24T19:58:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0def0f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d80a7100 con 0x7ff0d80a6c80 2023-12-24T19:58:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0def0f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8067be0 con 0x7ff0d8068c80 2023-12-24T19:58:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0dccab700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff0d80af710 0x7ff0d80afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0dccab700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff0d80af710 0x7ff0d80afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59978/0 (socket says 172.21.15.61:59978) 2023-12-24T19:58:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0dccab700 1 -- 172.21.15.61:0/1990953851 learned_addr learned my addr 172.21.15.61:0/1990953851 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0d7fff700 1 --2- 172.21.15.61:0/1990953851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d8068c80 0x7ff0d8067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0dccab700 1 -- 172.21.15.61:0/1990953851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d8068c80 msgr2=0x7ff0d8067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0dccab700 1 --2- 172.21.15.61:0/1990953851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d8068c80 0x7ff0d8067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0dccab700 1 -- 172.21.15.61:0/1990953851 >> v2:172.21.15.133:3300/0 conn(0x7ff0d80a6c80 msgr2=0x7ff0d815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0dccab700 1 --2- 172.21.15.61:0/1990953851 >> v2:172.21.15.133:3300/0 conn(0x7ff0d80a6c80 0x7ff0d815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.912+0000 7ff0dccab700 1 -- 172.21.15.61:0/1990953851 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8067ec0 con 0x7ff0d80af710 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0dccab700 1 --2- 172.21.15.61:0/1990953851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 0x7ff0d80afae0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80b3840 tx=0x7ff0cc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb8a23d4666191f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0d77fe700 1 -- 172.21.15.61:0/1990953851 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00dc50 con 0x7ff0d80af710 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0d77fe700 1 -- 172.21.15.61:0/1990953851 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc00ddb0 con 0x7ff0d80af710 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0d77fe700 1 -- 172.21.15.61:0/1990953851 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0196d0 con 0x7ff0d80af710 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0def0f700 1 -- 172.21.15.61:0/1990953851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 msgr2=0x7ff0d80afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0def0f700 1 --2- 172.21.15.61:0/1990953851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 0x7ff0d80afae0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80b3840 tx=0x7ff0cc00b4f0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0def0f700 1 -- 172.21.15.61:0/1990953851 shutdown_connections 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0def0f700 1 --2- 172.21.15.61:0/1990953851 >> v2:172.21.15.133:3300/0 conn(0x7ff0d80a6c80 0x7ff0d815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0def0f700 1 --2- 172.21.15.61:0/1990953851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 0x7ff0d80afae0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0def0f700 1 --2- 172.21.15.61:0/1990953851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d8068c80 0x7ff0d8067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0def0f700 1 -- 172.21.15.61:0/1990953851 >> 172.21.15.61:0/1990953851 conn(0x7ff0d80ca200 msgr2=0x7ff0d80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:11.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0def0f700 1 -- 172.21.15.61:0/1990953851 shutdown_connections 2023-12-24T19:58:11.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.913+0000 7ff0def0f700 1 -- 172.21.15.61:0/1990953851 wait complete. 2023-12-24T19:58:11.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.914+0000 7ff0def0f700 1 Processor -- start 2023-12-24T19:58:11.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.915+0000 7ff0def0f700 1 -- start start 2023-12-24T19:58:11.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.915+0000 7ff0def0f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d8068c80 0x7ff0d814c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:11.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.915+0000 7ff0def0f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d80a6c80 0x7ff0d8155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:11.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.915+0000 7ff0def0f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 0x7ff0d8152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:11.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.915+0000 7ff0def0f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81579e0 con 0x7ff0d80af710 2023-12-24T19:58:11.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.915+0000 7ff0def0f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d814ccb0 con 0x7ff0d8068c80 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.915+0000 7ff0def0f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81549a0 con 0x7ff0d80a6c80 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.915+0000 7ff0dd4ac700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 0x7ff0d8152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.915+0000 7ff0dd4ac700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 0x7ff0d8152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:59994/0 (socket says 172.21.15.61:59994) 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.915+0000 7ff0dd4ac700 1 -- 172.21.15.61:0/2755262161 learned_addr learned my addr 172.21.15.61:0/2755262161 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0dd4ac700 1 -- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d80a6c80 msgr2=0x7ff0d8155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0dd4ac700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d80a6c80 0x7ff0d8155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0dd4ac700 1 -- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d8068c80 msgr2=0x7ff0d814c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0dd4ac700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d8068c80 0x7ff0d814c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0dd4ac700 1 -- 172.21.15.61:0/2755262161 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc00b790 con 0x7ff0d80af710 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0dd4ac700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 0x7ff0d8152070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000bc30 tx=0x7ff0d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0d4ff9700 1 -- 172.21.15.61:0/2755262161 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00092e0 con 0x7ff0d80af710 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0d4ff9700 1 -- 172.21.15.61:0/2755262161 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000c7a0 con 0x7ff0d80af710 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0def0f700 1 -- 172.21.15.61:0/2755262161 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d8154c80 con 0x7ff0d80af710 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0d4ff9700 1 -- 172.21.15.61:0/2755262161 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000cb80 con 0x7ff0d80af710 2023-12-24T19:58:11.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.916+0000 7ff0def0f700 1 -- 172.21.15.61:0/2755262161 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d8155240 con 0x7ff0d80af710 2023-12-24T19:58:11.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.917+0000 7ff0def0f700 1 -- 172.21.15.61:0/2755262161 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8157b20 con 0x7ff0d80af710 2023-12-24T19:58:11.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.918+0000 7ff0d4ff9700 1 -- 172.21.15.61:0/2755262161 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff0d0012070 con 0x7ff0d80af710 2023-12-24T19:58:11.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.918+0000 7ff0d4ff9700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff0bc066f30 0x7ff0bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:11.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.918+0000 7ff0d4ff9700 1 -- 172.21.15.61:0/2755262161 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0d00841c0 con 0x7ff0d80af710 2023-12-24T19:58:11.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.918+0000 7ff0dccab700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff0bc066f30 0x7ff0bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:11.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.920+0000 7ff0dccab700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff0bc066f30 0x7ff0bc0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80b3840 tx=0x7ff0cc01b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:11.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:11.922+0000 7ff0d4ff9700 1 -- 172.21.15.61:0/2755262161 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0d0051430 con 0x7ff0d80af710 2023-12-24T19:58:12.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.117+0000 7ff0def0f700 1 -- 172.21.15.61:0/2755262161 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0d804c3c0 con 0x7ff0d80af710 2023-12-24T19:58:12.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.118+0000 7ff0d4ff9700 1 -- 172.21.15.61:0/2755262161 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7ff0d0054a50 con 0x7ff0d80af710 2023-12-24T19:58:12.119 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:12.119 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":33,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:58:11.766399+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:56.143696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:57.136484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:58:12.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 -- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff0bc066f30 msgr2=0x7ff0bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:12.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff0bc066f30 0x7ff0bc0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80b3840 tx=0x7ff0cc01b000 comp rx=0 tx=0).stop 2023-12-24T19:58:12.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 -- 172.21.15.61:0/2755262161 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 msgr2=0x7ff0d8152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:12.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 0x7ff0d8152070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000bc30 tx=0x7ff0d0009840 comp rx=0 tx=0).stop 2023-12-24T19:58:12.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 -- 172.21.15.61:0/2755262161 shutdown_connections 2023-12-24T19:58:12.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff0bc066f30 0x7ff0bc0693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:12.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0d80af710 0x7ff0d8152070 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:12.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d8068c80 0x7ff0d814c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:12.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 --2- 172.21.15.61:0/2755262161 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0d80a6c80 0x7ff0d8155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:12.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 -- 172.21.15.61:0/2755262161 >> 172.21.15.61:0/2755262161 conn(0x7ff0d80ca200 msgr2=0x7ff0d81534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:12.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 -- 172.21.15.61:0/2755262161 shutdown_connections 2023-12-24T19:58:12.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.120+0000 7ff0def0f700 1 -- 172.21.15.61:0/2755262161 wait complete. 2023-12-24T19:58:12.133 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:12.133 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:58:12.133 DEBUG:teuthology.orchestra.run.smithi061:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-24T19:58:12.133 DEBUG:teuthology.orchestra.run.smithi061:> os.fchmod(fd, 0O666) 2023-12-24T19:58:12.133 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(fd) 2023-12-24T19:58:12.133 DEBUG:teuthology.orchestra.run.smithi061:> os.close(fd) 2023-12-24T19:58:12.133 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:58:12.390 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:12.390 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T19:58:12.390 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:58:12.391 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:58:12.392 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T19:58:12.392 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T19:58:12.392 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T19:58:12.392 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:58:12.392 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:12.392 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T19:58:12.392 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:58:12.516 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.48455.asok 2023-12-24T19:58:12.699 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48455.asok 2023-12-24T19:58:12.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:12.699 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48455.asok status 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "48455", 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 1, 2023-12-24T19:58:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5088, 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 5088 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2052275700 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2052275700 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.5088 192.168.0.1:0/2052275700", 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2052275700", 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 2, 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 16, 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 31, 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 31, 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T19:58:12.860 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:12.868 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:12.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.988+0000 7fe08138e700 1 Processor -- start 2023-12-24T19:58:12.989 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.988+0000 7fe08138e700 1 -- start start 2023-12-24T19:58:12.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.989+0000 7fe08138e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe07c159c10 0x7fe07c0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:12.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.989+0000 7fe08138e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c0af880 con 0x7fe07c159fe0 2023-12-24T19:58:12.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.989+0000 7fe08138e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c0c6fc0 con 0x7fe07c0cc190 2023-12-24T19:58:12.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.989+0000 7fe08138e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c0c63b0 con 0x7fe07c159c10 2023-12-24T19:58:12.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.989+0000 7fe07affd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe07c159c10 0x7fe07c0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:12.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.989+0000 7fe07a7fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe07c159fe0 0x7fe07c0cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46932/0 (socket says 172.21.15.61:46932) 2023-12-24T19:58:12.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.989+0000 7fe07a7fc700 1 -- 172.21.15.61:0/926261816 learned_addr learned my addr 172.21.15.61:0/926261816 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:12.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe07affd700 1 -- 172.21.15.61:0/926261816 >> v1:172.21.15.133:6789/0 conn(0x7fe07c0cc190 legacy=0x7fe07c0b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:12.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe07affd700 1 -- 172.21.15.61:0/926261816 >> v1:172.21.15.61:6789/0 conn(0x7fe07c159fe0 legacy=0x7fe07c0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:12.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe07affd700 1 -- 172.21.15.61:0/926261816 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0c6690 con 0x7fe07c159c10 2023-12-24T19:58:12.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe079ffb700 1 -- 172.21.15.61:0/926261816 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492034673 0 0) 0x7fe07c0af880 con 0x7fe07c159fe0 2023-12-24T19:58:12.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe07affd700 1 --2- 172.21.15.61:0/926261816 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 0x7fe07c0c57d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe070009910 tx=0x7fe0700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3893a967edcb6a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:12.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe079ffb700 1 -- 172.21.15.61:0/926261816 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000b7e0 con 0x7fe07c159c10 2023-12-24T19:58:12.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe079ffb700 1 -- 172.21.15.61:0/926261816 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000b940 con 0x7fe07c159c10 2023-12-24T19:58:12.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe079ffb700 1 -- 172.21.15.61:0/926261816 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000bce0 con 0x7fe07c159c10 2023-12-24T19:58:12.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe08138e700 1 -- 172.21.15.61:0/926261816 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 msgr2=0x7fe07c0c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:12.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe08138e700 1 --2- 172.21.15.61:0/926261816 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 0x7fe07c0c57d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe070009910 tx=0x7fe0700091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:12.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe08138e700 1 -- 172.21.15.61:0/926261816 shutdown_connections 2023-12-24T19:58:12.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe08138e700 1 --2- 172.21.15.61:0/926261816 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 0x7fe07c0c57d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:12.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.990+0000 7fe08138e700 1 -- 172.21.15.61:0/926261816 >> 172.21.15.61:0/926261816 conn(0x7fe07c06e640 msgr2=0x7fe07c067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:12.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.991+0000 7fe08138e700 1 -- 172.21.15.61:0/926261816 shutdown_connections 2023-12-24T19:58:12.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.991+0000 7fe08138e700 1 -- 172.21.15.61:0/926261816 wait complete. 2023-12-24T19:58:12.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.992+0000 7fe08138e700 1 Processor -- start 2023-12-24T19:58:12.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.992+0000 7fe08138e700 1 -- start start 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.993+0000 7fe08138e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe07c0cc190 0x7fe07c153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.993+0000 7fe08138e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 0x7fe07c14c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.993+0000 7fe08138e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe07c159fe0 0x7fe07c0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.993+0000 7fe08138e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0b37d0 con 0x7fe07c159c10 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.993+0000 7fe08138e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c154050 con 0x7fe07c159fe0 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.993+0000 7fe08138e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c154330 con 0x7fe07c0cc190 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.993+0000 7fe07a7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 0x7fe07c14c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.993+0000 7fe07a7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 0x7fe07c14c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:60014/0 (socket says 172.21.15.61:60014) 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.993+0000 7fe07a7fc700 1 -- 172.21.15.61:0/2871533698 learned_addr learned my addr 172.21.15.61:0/2871533698 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe07a7fc700 1 -- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe07c0cc190 msgr2=0x7fe07c153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:12.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe07a7fc700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe07c0cc190 0x7fe07c153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe07a7fc700 1 -- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe07c159fe0 msgr2=0x7fe07c0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe07b7fe700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe07c159fe0 0x7fe07c0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe07a7fc700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe07c159fe0 0x7fe07c0b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe07a7fc700 1 -- 172.21.15.61:0/2871533698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe070009420 con 0x7fe07c159c10 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe07b7fe700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe07c159fe0 0x7fe07c0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe07a7fc700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 0x7fe07c14c3f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c810 tx=0x7fe06c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe062ffd700 1 -- 172.21.15.61:0/2871533698 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c005c00 con 0x7fe07c159c10 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe062ffd700 1 -- 172.21.15.61:0/2871533698 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c005d60 con 0x7fe07c159c10 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe062ffd700 1 -- 172.21.15.61:0/2871533698 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c007320 con 0x7fe07c159c10 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe08138e700 1 -- 172.21.15.61:0/2871533698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c154610 con 0x7fe07c159c10 2023-12-24T19:58:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.994+0000 7fe08138e700 1 -- 172.21.15.61:0/2871533698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c153d40 con 0x7fe07c159c10 2023-12-24T19:58:12.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.995+0000 7fe08138e700 1 -- 172.21.15.61:0/2871533698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c154800 con 0x7fe07c159c10 2023-12-24T19:58:12.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.995+0000 7fe062ffd700 1 -- 172.21.15.61:0/2871533698 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe06c01b400 con 0x7fe07c159c10 2023-12-24T19:58:12.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.996+0000 7fe062ffd700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe068066f30 0x7fe0680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:12.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.996+0000 7fe062ffd700 1 -- 172.21.15.61:0/2871533698 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe06c083ff0 con 0x7fe07c159c10 2023-12-24T19:58:12.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.996+0000 7fe07affd700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe068066f30 0x7fe0680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:12.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:12.997+0000 7fe07affd700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe068066f30 0x7fe0680693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe070003080 tx=0x7fe070016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:13.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.000+0000 7fe062ffd700 1 -- 172.21.15.61:0/2871533698 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe07c154800 con 0x7fe07c159c10 2023-12-24T19:58:13.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.242+0000 7fe08138e700 1 -- 172.21.15.61:0/2871533698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe07c154800 con 0x7fe07c159c10 2023-12-24T19:58:13.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.243+0000 7fe062ffd700 1 -- 172.21.15.61:0/2871533698 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fe07c154800 con 0x7fe07c159c10 2023-12-24T19:58:13.243 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:13.243 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2779978406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2779978406},{"type":"v1","addr":"172.21.15.61:6835","nonce":2779978406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1935570272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1935570272},{"type":"v1","addr":"172.21.15.133:6836","nonce":1935570272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3983510237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3983510237},{"type":"v1","addr":"172.21.15.133:6837","nonce":3983510237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:58.161119+0000","modified":"2023-12-24T19:58:01.793217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4777},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4777":{"gid":4777,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2729904701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2729904701},{"type":"v1","addr":"172.21.15.61:6834","nonce":2729904701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T19:58:13.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 -- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe068066f30 msgr2=0x7fe0680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:13.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe068066f30 0x7fe0680693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe070003080 tx=0x7fe070016000 comp rx=0 tx=0).stop 2023-12-24T19:58:13.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 -- 172.21.15.61:0/2871533698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 msgr2=0x7fe07c14c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:13.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 0x7fe07c14c3f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c810 tx=0x7fe06c007db0 comp rx=0 tx=0).stop 2023-12-24T19:58:13.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 -- 172.21.15.61:0/2871533698 shutdown_connections 2023-12-24T19:58:13.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe07c0cc190 0x7fe07c153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:13.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe068066f30 0x7fe0680693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:13.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe07c159fe0 0x7fe07c0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:13.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 --2- 172.21.15.61:0/2871533698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe07c159c10 0x7fe07c14c3f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:13.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 -- 172.21.15.61:0/2871533698 >> 172.21.15.61:0/2871533698 conn(0x7fe07c06e640 msgr2=0x7fe07c0ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:13.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 -- 172.21.15.61:0/2871533698 shutdown_connections 2023-12-24T19:58:13.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:13.245+0000 7fe08138e700 1 -- 172.21.15.61:0/2871533698 wait complete. 2023-12-24T19:58:13.246 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 16 2023-12-24T19:58:13.257 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 33 2023-12-24T19:58:13.396 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-24T19:58:13.397 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:13.397 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:58:13.397 DEBUG:teuthology.orchestra.run.smithi061:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-24T19:58:13.397 DEBUG:teuthology.orchestra.run.smithi061:> os.fchmod(fd, 0O666) 2023-12-24T19:58:13.397 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(fd) 2023-12-24T19:58:13.397 DEBUG:teuthology.orchestra.run.smithi061:> os.close(fd) 2023-12-24T19:58:13.397 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:58:13.654 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:13.654 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T19:58:13.654 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T19:58:13.654 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:58:13.654 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T19:58:13.654 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:13.655 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T19:58:13.655 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T19:58:13.655 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T19:58:13.655 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T19:58:13.655 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:13.655 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T19:58:13.655 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T19:58:13.655 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T19:58:13.655 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T19:58:13.655 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T19:58:13.656 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:58:13.782 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.48455.asok 2023-12-24T19:58:13.963 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48455.asok 2023-12-24T19:58:13.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:13.963 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48455.asok status 2023-12-24T19:58:14.119 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:14.119 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T19:58:14.119 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "48455", 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 2, 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5088, 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 5088 2023-12-24T19:58:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2052275700 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2052275700 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.5088 192.168.0.1:0/2052275700", 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2052275700", 2023-12-24T19:58:14.121 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 3, 2023-12-24T19:58:14.122 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 16, 2023-12-24T19:58:14.122 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 33, 2023-12-24T19:58:14.122 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 33, 2023-12-24T19:58:14.122 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T19:58:14.122 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T19:58:14.122 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:14.129 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:14.129 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T19:58:14.129 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:58:14.130 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:58:14.131 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:58:14.131 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T19:58:14.131 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T19:58:14.131 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T19:58:14.131 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:58:14.131 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:14.131 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T19:58:14.131 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:58:14.216 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.48455.asok 2023-12-24T19:58:14.398 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48455.asok 2023-12-24T19:58:14.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:14.399 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48455.asok status 2023-12-24T19:58:14.557 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:14.557 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T19:58:14.557 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:58:14.557 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:58:14.557 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T19:58:14.557 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T19:58:14.557 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T19:58:14.557 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "48455", 2023-12-24T19:58:14.557 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 2, 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5088, 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 5088 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2052275700 2023-12-24T19:58:14.558 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2052275700 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.5088 192.168.0.1:0/2052275700", 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2052275700", 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 3, 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 16, 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 33, 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 33, 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T19:58:14.559 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:14.566 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-24T19:58:14.567 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T19:58:14.567 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:58:14.609 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:58:14.662 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T19:58:14.662 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T19:58:14.662 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T19:58:14.663 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:14.699 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[48455]: fuse finished with error 0 and tester_r 0 2023-12-24T19:58:14.700 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:58:14.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:14.701 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T19:58:14.868 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T19:58:14.868 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T19:58:14.868 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:14.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[43000]: fuse finished with error 0 and tester_r 0 2023-12-24T19:58:14.910 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:58:14.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:14.910 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T19:58:14.978 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:58:14.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:14.978 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T19:58:14.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:58:14.996 INFO:teuthology.orchestra.run.smithi061.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-24T19:58:14.996 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:58:14.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:14.997 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T19:58:15.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:58:15.037 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-24T19:58:15.037 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:15.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.159+0000 7f671ed02700 1 Processor -- start 2023-12-24T19:58:15.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.159+0000 7f671ed02700 1 -- start start 2023-12-24T19:58:15.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.159+0000 7f671ed02700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6718159850 0x7f6718159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.159+0000 7f671ed02700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671806a630 con 0x7f671806aac0 2023-12-24T19:58:15.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.159+0000 7f671ed02700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6718069d00 con 0x7f67180caa80 2023-12-24T19:58:15.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.159+0000 7f671ed02700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67180cccf0 con 0x7f6718159850 2023-12-24T19:58:15.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f6717fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f671806aac0 0x7f67180cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46936/0 (socket says 172.21.15.61:46936) 2023-12-24T19:58:15.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f6717fff700 1 -- 172.21.15.61:0/1781043190 learned_addr learned my addr 172.21.15.61:0/1781043190 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:15.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f671ca9e700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6718159850 0x7f6718159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911781728 0 0) 0x7f671806a630 con 0x7f671806aac0 2023-12-24T19:58:15.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6708003570 con 0x7f671806aac0 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301725833 0 0) 0x7f6718069d00 con 0x7f67180caa80 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f671806a630 con 0x7f67180caa80 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 784842396 0 0) 0x7f6708003570 con 0x7f671806aac0 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6718159850 msgr2=0x7f6718159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6718159850 0x7f6718159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 >> v1:172.21.15.133:6789/0 conn(0x7f67180caa80 legacy=0x7f67180aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718069fe0 con 0x7f671806aac0 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f6704001470 con 0x7f671806aac0 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 >> v1:172.21.15.61:6789/0 conn(0x7f671806aac0 legacy=0x7f67180cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6708003c20 0x7f6708004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6708004810 0x7f6708004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67080051c0 0x7f670800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67180cccf0 con 0x7f67080051c0 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670800c0b0 con 0x7f6708003c20 2023-12-24T19:58:15.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670800c270 con 0x7f6708004810 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f671ca9e700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6718159850 0x7f6718159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f671d29f700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67080051c0 0x7f670800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.160+0000 7f6717fff700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6708004810 0x7f6708004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.161+0000 7f671ca9e700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6708003c20 0x7f6708004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.161+0000 7f671d29f700 1 -- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6708004810 msgr2=0x7f6708004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.161+0000 7f671d29f700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6708004810 0x7f6708004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.161+0000 7f671d29f700 1 -- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6708003c20 msgr2=0x7f6708004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.161+0000 7f671d29f700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6708003c20 0x7f6708004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.161+0000 7f671d29f700 1 -- 172.21.15.61:0/1781043190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708003570 con 0x7f67080051c0 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.161+0000 7f671d29f700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67080051c0 0x7f670800ba60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f67100020f0 tx=0x7f67100017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80391004c3b33dde server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.161+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671000c8b0 con 0x7f67080051c0 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.161+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671000ca10 con 0x7f67080051c0 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.161+0000 7f67177fe700 1 -- 172.21.15.61:0/1781043190 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671000cdb0 con 0x7f67080051c0 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.162+0000 7f671ed02700 1 -- 172.21.15.61:0/1781043190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67080051c0 msgr2=0x7f670800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.162+0000 7f671ed02700 1 --2- 172.21.15.61:0/1781043190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67080051c0 0x7f670800ba60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f67100020f0 tx=0x7f67100017a0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.162+0000 7f671d29f700 1 -- 172.21.15.61:0/1781043190 reap_dead start 2023-12-24T19:58:15.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.162+0000 7f671ed02700 1 -- 172.21.15.61:0/1781043190 shutdown_connections 2023-12-24T19:58:15.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.162+0000 7f671ed02700 1 -- 172.21.15.61:0/1781043190 >> 172.21.15.61:0/1781043190 conn(0x7f67180cceb0 msgr2=0x7f67180cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:15.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.162+0000 7f671ed02700 1 -- 172.21.15.61:0/1781043190 shutdown_connections 2023-12-24T19:58:15.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.162+0000 7f671ed02700 1 -- 172.21.15.61:0/1781043190 wait complete. 2023-12-24T19:58:15.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.163+0000 7f671ed02700 1 Processor -- start 2023-12-24T19:58:15.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.163+0000 7f671ed02700 1 -- start start 2023-12-24T19:58:15.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671ed02700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67080051c0 0x7f6718142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671ed02700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6718142670 0x7f671815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671ed02700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f671816da40 0x7f671816deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671ed02700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671816e3f0 con 0x7f671816da40 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671ed02700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671815dc70 con 0x7f67080051c0 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671ed02700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671815d0a0 con 0x7f6718142670 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671d29f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f671816da40 0x7f671816deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671d29f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f671816da40 0x7f671816deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:60038/0 (socket says 172.21.15.61:60038) 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671d29f700 1 -- 172.21.15.61:0/3975966751 learned_addr learned my addr 172.21.15.61:0/3975966751 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671ca9e700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67080051c0 0x7f6718142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f6717fff700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6718142670 0x7f671815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671d29f700 1 -- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6718142670 msgr2=0x7f671815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671d29f700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6718142670 0x7f671815c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671d29f700 1 -- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67080051c0 msgr2=0x7f6718142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671d29f700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67080051c0 0x7f6718142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671d29f700 1 -- 172.21.15.61:0/3975966751 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671815d340 con 0x7f671816da40 2023-12-24T19:58:15.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f671d29f700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f671816da40 0x7f671816deb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6710003000 tx=0x7f6710016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.164+0000 7f6714ff9700 1 -- 172.21.15.61:0/3975966751 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671000c8b0 con 0x7f671816da40 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.165+0000 7f6714ff9700 1 -- 172.21.15.61:0/3975966751 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671000c6d0 con 0x7f671816da40 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.165+0000 7f671ed02700 1 -- 172.21.15.61:0/3975966751 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671815d620 con 0x7f671816da40 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.165+0000 7f6714ff9700 1 -- 172.21.15.61:0/3975966751 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710012cf0 con 0x7f671816da40 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.165+0000 7f671ed02700 1 -- 172.21.15.61:0/3975966751 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671815cb20 con 0x7f671816da40 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.165+0000 7f671ed02700 1 -- 172.21.15.61:0/3975966751 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671815df50 con 0x7f671816da40 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.166+0000 7f6714ff9700 1 -- 172.21.15.61:0/3975966751 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6710025020 con 0x7f671816da40 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.166+0000 7f6714ff9700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66fc066f30 0x7f66fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.166+0000 7f6714ff9700 1 -- 172.21.15.61:0/3975966751 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6710086250 con 0x7f671816da40 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.167+0000 7f671ca9e700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66fc066f30 0x7f66fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.167+0000 7f671ca9e700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66fc066f30 0x7f66fc0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f67180ca970 tx=0x7f670c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:15.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.171+0000 7f6714ff9700 1 -- 172.21.15.61:0/3975966751 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67100534c0 con 0x7f671816da40 2023-12-24T19:58:15.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.416+0000 7f671ed02700 1 -- 172.21.15.61:0/3975966751 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f671815dac0 con 0x7f671816da40 2023-12-24T19:58:15.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.416+0000 7f6714ff9700 1 -- 172.21.15.61:0/3975966751 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f671002d020 con 0x7f671816da40 2023-12-24T19:58:15.416 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:15.417 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2779978406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2779978406},{"type":"v1","addr":"172.21.15.61:6835","nonce":2779978406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1935570272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1935570272},{"type":"v1","addr":"172.21.15.133:6836","nonce":1935570272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3983510237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3983510237},{"type":"v1","addr":"172.21.15.133:6837","nonce":3983510237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:58.161119+0000","modified":"2023-12-24T19:58:01.793217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4777},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4777":{"gid":4777,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2729904701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2729904701},{"type":"v1","addr":"172.21.15.61:6834","nonce":2729904701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T19:58:15.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.418+0000 7f671ed02700 1 -- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66fc066f30 msgr2=0x7f66fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.418+0000 7f671ed02700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66fc066f30 0x7f66fc0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f67180ca970 tx=0x7f670c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.418+0000 7f671ed02700 1 -- 172.21.15.61:0/3975966751 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f671816da40 msgr2=0x7f671816deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.418+0000 7f671ed02700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f671816da40 0x7f671816deb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6710003000 tx=0x7f6710016000 comp rx=0 tx=0).stop 2023-12-24T19:58:15.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.418+0000 7f671ed02700 1 -- 172.21.15.61:0/3975966751 shutdown_connections 2023-12-24T19:58:15.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.418+0000 7f671ed02700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66fc066f30 0x7f66fc0693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.418+0000 7f671ed02700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f671816da40 0x7f671816deb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.418+0000 7f671ed02700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67080051c0 0x7f6718142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.418+0000 7f671ed02700 1 --2- 172.21.15.61:0/3975966751 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6718142670 0x7f671815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.418+0000 7f671ed02700 1 -- 172.21.15.61:0/3975966751 >> 172.21.15.61:0/3975966751 conn(0x7f67180cceb0 msgr2=0x7f671806eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:15.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.419+0000 7f671ed02700 1 -- 172.21.15.61:0/3975966751 shutdown_connections 2023-12-24T19:58:15.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.419+0000 7f671ed02700 1 -- 172.21.15.61:0/3975966751 wait complete. 2023-12-24T19:58:15.420 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 16 2023-12-24T19:58:15.431 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:58:15.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.553+0000 7f66cba88700 1 Processor -- start 2023-12-24T19:58:15.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.553+0000 7f66cba88700 1 -- start start 2023-12-24T19:58:15.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66cba88700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66c4159b00 0x7f66c4067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66cba88700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f66c4070d50 0x7f66c40afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66cba88700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c40a84d0 con 0x7f66c40af7d0 2023-12-24T19:58:15.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66cba88700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c40b0180 con 0x7f66c4070d50 2023-12-24T19:58:15.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66cba88700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c40a7620 con 0x7f66c4159b00 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66ca025700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f66c4070d50 0x7f66c40afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66ca025700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f66c4070d50 0x7f66c40afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:60044/0 (socket says 172.21.15.61:60044) 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66ca025700 1 -- 172.21.15.61:0/2209933479 learned_addr learned my addr 172.21.15.61:0/2209933479 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66c9824700 1 --2- 172.21.15.61:0/2209933479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66c4159b00 0x7f66c4067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66ca025700 1 -- 172.21.15.61:0/2209933479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66c4159b00 msgr2=0x7f66c4067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66ca025700 1 --2- 172.21.15.61:0/2209933479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66c4159b00 0x7f66c4067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66ca025700 1 -- 172.21.15.61:0/2209933479 >> v1:172.21.15.133:6789/0 conn(0x7f66c40af7d0 legacy=0x7f66c4070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66ca025700 1 -- 172.21.15.61:0/2209933479 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c40a78c0 con 0x7f66c4070d50 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.554+0000 7f66ca025700 1 --2- 172.21.15.61:0/2209933479 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 0x7f66c40afc40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009f20 tx=0x7f66bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0eed7f69da3aff server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66c8822700 1 -- 172.21.15.61:0/2209933479 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00e070 con 0x7f66c4070d50 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66c8822700 1 -- 172.21.15.61:0/2209933479 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66bc00ba40 con 0x7f66c4070d50 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66c8822700 1 -- 172.21.15.61:0/2209933479 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc0092e0 con 0x7f66c4070d50 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66cba88700 1 -- 172.21.15.61:0/2209933479 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 msgr2=0x7f66c40afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66cba88700 1 --2- 172.21.15.61:0/2209933479 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 0x7f66c40afc40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009f20 tx=0x7f66bc009840 comp rx=0 tx=0).stop 2023-12-24T19:58:15.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66cba88700 1 -- 172.21.15.61:0/2209933479 shutdown_connections 2023-12-24T19:58:15.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66cba88700 1 --2- 172.21.15.61:0/2209933479 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 0x7f66c40afc40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66cba88700 1 --2- 172.21.15.61:0/2209933479 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66c4159b00 0x7f66c4067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66cba88700 1 -- 172.21.15.61:0/2209933479 >> 172.21.15.61:0/2209933479 conn(0x7f66c40ca200 msgr2=0x7f66c40ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:15.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66cba88700 1 -- 172.21.15.61:0/2209933479 shutdown_connections 2023-12-24T19:58:15.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.555+0000 7f66cba88700 1 -- 172.21.15.61:0/2209933479 wait complete. 2023-12-24T19:58:15.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.556+0000 7f66cba88700 1 Processor -- start 2023-12-24T19:58:15.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.556+0000 7f66cba88700 1 -- start start 2023-12-24T19:58:15.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66cba88700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 0x7f66c416d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66cba88700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66c40af7d0 0x7f66c4153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66cba88700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66c4159b00 0x7f66c414a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66cba88700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c4153a40 con 0x7f66c4070d50 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66cba88700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c40ad250 con 0x7f66c4159b00 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66cba88700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c416da40 con 0x7f66c40af7d0 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66c9824700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 0x7f66c416d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66c9824700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 0x7f66c416d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:60060/0 (socket says 172.21.15.61:60060) 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66c9824700 1 -- 172.21.15.61:0/349115837 learned_addr learned my addr 172.21.15.61:0/349115837 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66c9023700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66c40af7d0 0x7f66c4153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66ca025700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66c4159b00 0x7f66c414a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66c9824700 1 -- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66c40af7d0 msgr2=0x7f66c4153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66c9824700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66c40af7d0 0x7f66c4153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66c9824700 1 -- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66c4159b00 msgr2=0x7f66c414a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66c9824700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66c4159b00 0x7f66c414a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66c9824700 1 -- 172.21.15.61:0/349115837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc009ae0 con 0x7f66c4070d50 2023-12-24T19:58:15.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.557+0000 7f66ca025700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66c4159b00 0x7f66c414a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:15.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.558+0000 7f66c9824700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 0x7f66c416d340 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f66c000d860 tx=0x7f66c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:15.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.558+0000 7f66b9ffb700 1 -- 172.21.15.61:0/349115837 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0009610 con 0x7f66c4070d50 2023-12-24T19:58:15.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.558+0000 7f66b9ffb700 1 -- 172.21.15.61:0/349115837 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c0009770 con 0x7f66c4070d50 2023-12-24T19:58:15.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.558+0000 7f66cba88700 1 -- 172.21.15.61:0/349115837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c416dd20 con 0x7f66c4070d50 2023-12-24T19:58:15.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.558+0000 7f66b9ffb700 1 -- 172.21.15.61:0/349115837 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0009b30 con 0x7f66c4070d50 2023-12-24T19:58:15.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.558+0000 7f66cba88700 1 -- 172.21.15.61:0/349115837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c414a960 con 0x7f66c4070d50 2023-12-24T19:58:15.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.559+0000 7f66cba88700 1 -- 172.21.15.61:0/349115837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c416e240 con 0x7f66c4070d50 2023-12-24T19:58:15.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.559+0000 7f66b9ffb700 1 -- 172.21.15.61:0/349115837 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f66c001e460 con 0x7f66c4070d50 2023-12-24T19:58:15.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.560+0000 7f66b9ffb700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66a8066f30 0x7f66a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.560+0000 7f66b9ffb700 1 -- 172.21.15.61:0/349115837 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66c0084b20 con 0x7f66c4070d50 2023-12-24T19:58:15.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.560+0000 7f66c9023700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66a8066f30 0x7f66a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.560+0000 7f66c9023700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66a8066f30 0x7f66a80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66c4154660 tx=0x7f66b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.564+0000 7f66b9ffb700 1 -- 172.21.15.61:0/349115837 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66c416e240 con 0x7f66c4070d50 2023-12-24T19:58:15.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.758+0000 7f66cba88700 1 -- 172.21.15.61:0/349115837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66c40ad530 con 0x7f66c4070d50 2023-12-24T19:58:15.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.759+0000 7f66b9ffb700 1 -- 172.21.15.61:0/349115837 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f66c0051d90 con 0x7f66c4070d50 2023-12-24T19:58:15.759 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:15.760 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":33,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:58:11.766399+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:56.143696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:57.136484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:58:15.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 -- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66a8066f30 msgr2=0x7f66a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66a8066f30 0x7f66a80693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66c4154660 tx=0x7f66b4009040 comp rx=0 tx=0).stop 2023-12-24T19:58:15.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 -- 172.21.15.61:0/349115837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 msgr2=0x7f66c416d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 0x7f66c416d340 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f66c000d860 tx=0x7f66c0008040 comp rx=0 tx=0).stop 2023-12-24T19:58:15.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 -- 172.21.15.61:0/349115837 shutdown_connections 2023-12-24T19:58:15.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f66a8066f30 0x7f66a80693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66c4159b00 0x7f66c414a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f66c4070d50 0x7f66c416d340 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 --2- 172.21.15.61:0/349115837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f66c40af7d0 0x7f66c4153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 -- 172.21.15.61:0/349115837 >> 172.21.15.61:0/349115837 conn(0x7f66c40ca200 msgr2=0x7f66c41552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:15.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 -- 172.21.15.61:0/349115837 shutdown_connections 2023-12-24T19:58:15.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.761+0000 7f66cba88700 1 -- 172.21.15.61:0/349115837 wait complete. 2023-12-24T19:58:15.774 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:57:56.143696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:57:57.136484+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:58:15.775 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:58:15.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.899+0000 7f846fc0b700 1 Processor -- start 2023-12-24T19:58:15.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.899+0000 7f846fc0b700 1 -- start start 2023-12-24T19:58:15.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846fc0b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f84680ce360 0x7f8468158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846fc0b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8468158a80 0x7f84680cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846fc0b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846815bad0 con 0x7f84680cdf90 2023-12-24T19:58:15.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846fc0b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846815bdb0 con 0x7f84680ce360 2023-12-24T19:58:15.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846fc0b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846815c090 con 0x7f8468158a80 2023-12-24T19:58:15.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846d1a6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f84680ce360 0x7f8468158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846d1a6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f84680ce360 0x7f8468158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:60062/0 (socket says 172.21.15.61:60062) 2023-12-24T19:58:15.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846d1a6700 1 -- 172.21.15.61:0/1717163525 learned_addr learned my addr 172.21.15.61:0/1717163525 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:15.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846e1a8700 1 --2- 172.21.15.61:0/1717163525 >> v2:172.21.15.133:3300/0 conn(0x7f8468158a80 0x7f84680cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846d1a6700 1 -- 172.21.15.61:0/1717163525 >> v2:172.21.15.133:3300/0 conn(0x7f8468158a80 msgr2=0x7f84680cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846d1a6700 1 --2- 172.21.15.61:0/1717163525 >> v2:172.21.15.133:3300/0 conn(0x7f8468158a80 0x7f84680cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846d1a6700 1 -- 172.21.15.61:0/1717163525 >> v1:172.21.15.133:6789/0 conn(0x7f84680cdf90 legacy=0x7f846806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846d1a6700 1 -- 172.21.15.61:0/1717163525 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846815c370 con 0x7f84680ce360 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846e1a8700 1 --2- 172.21.15.61:0/1717163525 >> v2:172.21.15.133:3300/0 conn(0x7f8468158a80 0x7f84680cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.900+0000 7f846d1a6700 1 --2- 172.21.15.61:0/1717163525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 0x7f8468158540 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8468064740 tx=0x7f845c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48408e1beb8fdaf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846c9a5700 1 -- 172.21.15.61:0/1717163525 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c00b860 con 0x7f84680ce360 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846c9a5700 1 -- 172.21.15.61:0/1717163525 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c00b9c0 con 0x7f84680ce360 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846c9a5700 1 -- 172.21.15.61:0/1717163525 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c00bd60 con 0x7f84680ce360 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846fc0b700 1 -- 172.21.15.61:0/1717163525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 msgr2=0x7f8468158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846fc0b700 1 --2- 172.21.15.61:0/1717163525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 0x7f8468158540 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8468064740 tx=0x7f845c009250 comp rx=0 tx=0).stop 2023-12-24T19:58:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846fc0b700 1 -- 172.21.15.61:0/1717163525 shutdown_connections 2023-12-24T19:58:15.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846fc0b700 1 --2- 172.21.15.61:0/1717163525 >> v2:172.21.15.133:3300/0 conn(0x7f8468158a80 0x7f84680cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846fc0b700 1 --2- 172.21.15.61:0/1717163525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 0x7f8468158540 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846fc0b700 1 -- 172.21.15.61:0/1717163525 >> 172.21.15.61:0/1717163525 conn(0x7f846806f810 msgr2=0x7f846806ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:15.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846fc0b700 1 -- 172.21.15.61:0/1717163525 shutdown_connections 2023-12-24T19:58:15.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.901+0000 7f846fc0b700 1 -- 172.21.15.61:0/1717163525 wait complete. 2023-12-24T19:58:15.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.902+0000 7f846fc0b700 1 Processor -- start 2023-12-24T19:58:15.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846fc0b700 1 -- start start 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846fc0b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84680cdf90 0x7f84680b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846fc0b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 0x7f8468167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846fc0b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8468158a80 0x7f84680c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846fc0b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c6690 con 0x7f84680ce360 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846fc0b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c6970 con 0x7f84680cdf90 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846fc0b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c6c50 con 0x7f8468158a80 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846d1a6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 0x7f8468167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846d1a6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 0x7f8468167c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:60074/0 (socket says 172.21.15.61:60074) 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846d1a6700 1 -- 172.21.15.61:0/124496835 learned_addr learned my addr 172.21.15.61:0/124496835 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.903+0000 7f846d9a7700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84680cdf90 0x7f84680b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f846e1a8700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8468158a80 0x7f84680c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f846d1a6700 1 -- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8468158a80 msgr2=0x7f84680c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f846d1a6700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8468158a80 0x7f84680c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f846d1a6700 1 -- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84680cdf90 msgr2=0x7f84680b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:15.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f846d1a6700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84680cdf90 0x7f84680b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f846d1a6700 1 -- 172.21.15.61:0/124496835 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0094f0 con 0x7f84680ce360 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f846d1a6700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 0x7f8468167c70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f845c009290 tx=0x7f845c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f8459ffb700 1 -- 172.21.15.61:0/124496835 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c011e60 con 0x7f84680ce360 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f8459ffb700 1 -- 172.21.15.61:0/124496835 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c01f070 con 0x7f84680ce360 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f8459ffb700 1 -- 172.21.15.61:0/124496835 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c01a870 con 0x7f84680ce360 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f846fc0b700 1 -- 172.21.15.61:0/124496835 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84680c6f30 con 0x7f84680ce360 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.904+0000 7f846fc0b700 1 -- 172.21.15.61:0/124496835 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846816af40 con 0x7f84680ce360 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.905+0000 7f846fc0b700 1 -- 172.21.15.61:0/124496835 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846804c3c0 con 0x7f84680ce360 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.905+0000 7f8459ffb700 1 -- 172.21.15.61:0/124496835 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f845c01abe0 con 0x7f84680ce360 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.906+0000 7f8459ffb700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f844c066f30 0x7f844c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.906+0000 7f8459ffb700 1 -- 172.21.15.61:0/124496835 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f845c021070 con 0x7f84680ce360 2023-12-24T19:58:15.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.906+0000 7f846d9a7700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f844c066f30 0x7f844c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:15.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.907+0000 7f846d9a7700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f844c066f30 0x7f844c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f84640037c0 tx=0x7f8464009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:15.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:15.910+0000 7f8459ffb700 1 -- 172.21.15.61:0/124496835 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f845c053640 con 0x7f84680ce360 2023-12-24T19:58:16.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.102+0000 7f846fc0b700 1 -- 172.21.15.61:0/124496835 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84680c7450 con 0x7f84680ce360 2023-12-24T19:58:16.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.103+0000 7f8459ffb700 1 -- 172.21.15.61:0/124496835 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84680c7450 con 0x7f84680ce360 2023-12-24T19:58:16.104 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 -- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f844c066f30 msgr2=0x7f844c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f844c066f30 0x7f844c0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f84640037c0 tx=0x7f8464009040 comp rx=0 tx=0).stop 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 -- 172.21.15.61:0/124496835 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 msgr2=0x7f8468167c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 0x7f8468167c70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f845c009290 tx=0x7f845c017000 comp rx=0 tx=0).stop 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 -- 172.21.15.61:0/124496835 shutdown_connections 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8468158a80 0x7f84680c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f844c066f30 0x7f844c0693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84680cdf90 0x7f84680b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 --2- 172.21.15.61:0/124496835 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f84680ce360 0x7f8468167c70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 -- 172.21.15.61:0/124496835 >> 172.21.15.61:0/124496835 conn(0x7f846806f810 msgr2=0x7f846806c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 -- 172.21.15.61:0/124496835 shutdown_connections 2023-12-24T19:58:16.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.105+0000 7f846fc0b700 1 -- 172.21.15.61:0/124496835 wait complete. 2023-12-24T19:58:16.118 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:58:16.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.242+0000 7fe298e0c700 1 Processor -- start 2023-12-24T19:58:16.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.242+0000 7fe298e0c700 1 -- start start 2023-12-24T19:58:16.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.243+0000 7fe298e0c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe2940aecf0 0x7fe294069400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.243+0000 7fe298e0c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe2940af0c0 0x7fe2940cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.243+0000 7fe298e0c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2941590e0 con 0x7fe29406e980 2023-12-24T19:58:16.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.243+0000 7fe298e0c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2941584d0 con 0x7fe2940af0c0 2023-12-24T19:58:16.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.243+0000 7fe298e0c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2941587b0 con 0x7fe2940aecf0 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.243+0000 7fe291d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe2940af0c0 0x7fe2940cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.243+0000 7fe292d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe29406e980 0x7fe29406eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46942/0 (socket says 172.21.15.61:46942) 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.243+0000 7fe292d9d700 1 -- 172.21.15.61:0/3587511794 learned_addr learned my addr 172.21.15.61:0/3587511794 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.244+0000 7fe29259c700 1 --2- 172.21.15.61:0/3587511794 >> v2:172.21.15.133:3300/0 conn(0x7fe2940aecf0 0x7fe294069400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.244+0000 7fe291d9b700 1 -- 172.21.15.61:0/3587511794 >> v2:172.21.15.133:3300/0 conn(0x7fe2940aecf0 msgr2=0x7fe294069400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.244+0000 7fe291d9b700 1 --2- 172.21.15.61:0/3587511794 >> v2:172.21.15.133:3300/0 conn(0x7fe2940aecf0 0x7fe294069400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.244+0000 7fe291d9b700 1 -- 172.21.15.61:0/3587511794 >> v1:172.21.15.61:6789/0 conn(0x7fe29406e980 legacy=0x7fe29406eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.244+0000 7fe291d9b700 1 -- 172.21.15.61:0/3587511794 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe294158a90 con 0x7fe2940af0c0 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.244+0000 7fe29159a700 1 -- 172.21.15.61:0/3587511794 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413595284 0 0) 0x7fe2941590e0 con 0x7fe29406e980 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.244+0000 7fe291d9b700 1 --2- 172.21.15.61:0/3587511794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 0x7fe2940cd7c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe29406c660 tx=0x7fe2840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea7772c2e65b077 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.244+0000 7fe29159a700 1 -- 172.21.15.61:0/3587511794 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284011630 con 0x7fe2940af0c0 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.244+0000 7fe29159a700 1 -- 172.21.15.61:0/3587511794 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe284011790 con 0x7fe2940af0c0 2023-12-24T19:58:16.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.244+0000 7fe29159a700 1 -- 172.21.15.61:0/3587511794 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284011b30 con 0x7fe2940af0c0 2023-12-24T19:58:16.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.245+0000 7fe298e0c700 1 -- 172.21.15.61:0/3587511794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 msgr2=0x7fe2940cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.245+0000 7fe298e0c700 1 --2- 172.21.15.61:0/3587511794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 0x7fe2940cd7c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe29406c660 tx=0x7fe2840091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.245+0000 7fe298e0c700 1 -- 172.21.15.61:0/3587511794 shutdown_connections 2023-12-24T19:58:16.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.245+0000 7fe298e0c700 1 --2- 172.21.15.61:0/3587511794 >> v2:172.21.15.133:3300/0 conn(0x7fe2940aecf0 0x7fe294069400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.245+0000 7fe298e0c700 1 --2- 172.21.15.61:0/3587511794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 0x7fe2940cd7c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.245+0000 7fe298e0c700 1 -- 172.21.15.61:0/3587511794 >> 172.21.15.61:0/3587511794 conn(0x7fe294067fd0 msgr2=0x7fe2940ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:16.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.245+0000 7fe298e0c700 1 -- 172.21.15.61:0/3587511794 shutdown_connections 2023-12-24T19:58:16.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.245+0000 7fe298e0c700 1 -- 172.21.15.61:0/3587511794 wait complete. 2023-12-24T19:58:16.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.246+0000 7fe298e0c700 1 Processor -- start 2023-12-24T19:58:16.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.246+0000 7fe298e0c700 1 -- start start 2023-12-24T19:58:16.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe298e0c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe29406e980 0x7fe294143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe298e0c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2940aecf0 0x7fe294156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe298e0c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 0x7fe2941570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe298e0c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29415b9a0 con 0x7fe2940af0c0 2023-12-24T19:58:16.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe298e0c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe294143e70 con 0x7fe2940aecf0 2023-12-24T19:58:16.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe298e0c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940cb030 con 0x7fe29406e980 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe292d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 0x7fe2941570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe292d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 0x7fe2941570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:60102/0 (socket says 172.21.15.61:60102) 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe292d9d700 1 -- 172.21.15.61:0/1744863778 learned_addr learned my addr 172.21.15.61:0/1744863778 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe29259c700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe29406e980 0x7fe294143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe291d9b700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2940aecf0 0x7fe294156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe292d9d700 1 -- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe29406e980 msgr2=0x7fe294143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe292d9d700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe29406e980 0x7fe294143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe292d9d700 1 -- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2940aecf0 msgr2=0x7fe294156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe292d9d700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2940aecf0 0x7fe294156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe292d9d700 1 -- 172.21.15.61:0/1744863778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284009420 con 0x7fe2940af0c0 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe292d9d700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 0x7fe2941570a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00cbf0 tx=0x7fe28c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe2827fc700 1 -- 172.21.15.61:0/1744863778 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00a8b0 con 0x7fe2940af0c0 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe2827fc700 1 -- 172.21.15.61:0/1744863778 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c00aa10 con 0x7fe2940af0c0 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe298e0c700 1 -- 172.21.15.61:0/1744863778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2940cb310 con 0x7fe2940af0c0 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.247+0000 7fe2827fc700 1 -- 172.21.15.61:0/1744863778 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00add0 con 0x7fe2940af0c0 2023-12-24T19:58:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.248+0000 7fe298e0c700 1 -- 172.21.15.61:0/1744863778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2940cb8d0 con 0x7fe2940af0c0 2023-12-24T19:58:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.248+0000 7fe298e0c700 1 -- 172.21.15.61:0/1744863778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29415bae0 con 0x7fe2940af0c0 2023-12-24T19:58:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.249+0000 7fe2827fc700 1 -- 172.21.15.61:0/1744863778 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe28c007300 con 0x7fe2940af0c0 2023-12-24T19:58:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.249+0000 7fe2827fc700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe274066f60 0x7fe274069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.249+0000 7fe2827fc700 1 -- 172.21.15.61:0/1744863778 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe28c084800 con 0x7fe2940af0c0 2023-12-24T19:58:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.250+0000 7fe29259c700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe274066f60 0x7fe274069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.250+0000 7fe29259c700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe274066f60 0x7fe274069410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe288009db0 tx=0x7fe2880091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:16.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.254+0000 7fe2827fc700 1 -- 172.21.15.61:0/1744863778 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe29415bae0 con 0x7fe2940af0c0 2023-12-24T19:58:16.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.447+0000 7fe298e0c700 1 -- 172.21.15.61:0/1744863778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe29415bae0 con 0x7fe2940af0c0 2023-12-24T19:58:16.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.448+0000 7fe2827fc700 1 -- 172.21.15.61:0/1744863778 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe29415bae0 con 0x7fe2940af0c0 2023-12-24T19:58:16.448 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 -- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe274066f60 msgr2=0x7fe274069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe274066f60 0x7fe274069410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe288009db0 tx=0x7fe2880091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 -- 172.21.15.61:0/1744863778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 msgr2=0x7fe2941570a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 0x7fe2941570a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00cbf0 tx=0x7fe28c0019b0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 -- 172.21.15.61:0/1744863778 shutdown_connections 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe29406e980 0x7fe294143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe274066f60 0x7fe274069410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe2940af0c0 0x7fe2941570a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 --2- 172.21.15.61:0/1744863778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2940aecf0 0x7fe294156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 -- 172.21.15.61:0/1744863778 >> 172.21.15.61:0/1744863778 conn(0x7fe294067fd0 msgr2=0x7fe2940c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 -- 172.21.15.61:0/1744863778 shutdown_connections 2023-12-24T19:58:16.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.450+0000 7fe298e0c700 1 -- 172.21.15.61:0/1744863778 wait complete. 2023-12-24T19:58:16.462 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:58:16.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.586+0000 7f18f758e700 1 Processor -- start 2023-12-24T19:58:16.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.586+0000 7f18f758e700 1 -- start start 2023-12-24T19:58:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f758e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18f0159df0 0x7f18f00cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f758e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18f015a1c0 0x7f18f00cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f758e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f18f00cc0e0 0x7f18f00cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f758e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f00cdef0 con 0x7f18f00cc0e0 2023-12-24T19:58:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f758e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f00cf150 con 0x7f18f015a1c0 2023-12-24T19:58:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f758e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f00cc5f0 con 0x7f18f0159df0 2023-12-24T19:58:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f5b2b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f18f00cc0e0 0x7f18f00cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f5b2b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f18f00cc0e0 0x7f18f00cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34508/0 (socket says 172.21.15.61:34508) 2023-12-24T19:58:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f5b2b700 1 -- 172.21.15.61:0/1225528139 learned_addr learned my addr 172.21.15.61:0/1225528139 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f532a700 1 --2- 172.21.15.61:0/1225528139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18f0159df0 0x7f18f00cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f4b29700 1 --2- 172.21.15.61:0/1225528139 >> v2:172.21.15.133:3300/0 conn(0x7f18f015a1c0 0x7f18f00cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f5b2b700 1 -- 172.21.15.61:0/1225528139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18f0159df0 msgr2=0x7f18f00cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f5b2b700 1 --2- 172.21.15.61:0/1225528139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18f0159df0 0x7f18f00cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f5b2b700 1 -- 172.21.15.61:0/1225528139 >> v2:172.21.15.133:3300/0 conn(0x7f18f015a1c0 msgr2=0x7f18f00cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f5b2b700 1 --2- 172.21.15.61:0/1225528139 >> v2:172.21.15.133:3300/0 conn(0x7f18f015a1c0 0x7f18f00cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f5b2b700 1 -- 172.21.15.61:0/1225528139 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f00ce820 con 0x7f18f00cc0e0 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.587+0000 7f18f4b29700 1 --2- 172.21.15.61:0/1225528139 >> v2:172.21.15.133:3300/0 conn(0x7f18f015a1c0 0x7f18f00cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18f5b2b700 1 --2- 172.21.15.61:0/1225528139 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f00cc0e0 0x7f18f00cd9b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f18f0064760 tx=0x7f18e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2192d63658103358 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18e3fff700 1 -- 172.21.15.61:0/1225528139 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800e070 con 0x7f18f00cc0e0 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18e3fff700 1 -- 172.21.15.61:0/1225528139 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e800ba50 con 0x7f18f00cc0e0 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18e3fff700 1 -- 172.21.15.61:0/1225528139 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e80092e0 con 0x7f18f00cc0e0 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18f758e700 1 -- 172.21.15.61:0/1225528139 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f00cc0e0 msgr2=0x7f18f00cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18f758e700 1 --2- 172.21.15.61:0/1225528139 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f00cc0e0 0x7f18f00cd9b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f18f0064760 tx=0x7f18e8009840 comp rx=0 tx=0).stop 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18f758e700 1 -- 172.21.15.61:0/1225528139 shutdown_connections 2023-12-24T19:58:16.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18f758e700 1 --2- 172.21.15.61:0/1225528139 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f00cc0e0 0x7f18f00cd9b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18f758e700 1 --2- 172.21.15.61:0/1225528139 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18f0159df0 0x7f18f00cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18f758e700 1 --2- 172.21.15.61:0/1225528139 >> v2:172.21.15.133:3300/0 conn(0x7f18f015a1c0 0x7f18f00cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18f758e700 1 -- 172.21.15.61:0/1225528139 >> 172.21.15.61:0/1225528139 conn(0x7f18f006e600 msgr2=0x7f18f0067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18f758e700 1 -- 172.21.15.61:0/1225528139 shutdown_connections 2023-12-24T19:58:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.588+0000 7f18f758e700 1 -- 172.21.15.61:0/1225528139 wait complete. 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.590+0000 7f18f758e700 1 Processor -- start 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.590+0000 7f18f758e700 1 -- start start 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.590+0000 7f18f758e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18f00cc0e0 0x7f18f0145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.590+0000 7f18f758e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18f0159df0 0x7f18f00b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f758e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f015a1c0 0x7f18f0153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f758e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f015b1a0 con 0x7f18f015a1c0 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f758e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0150be0 con 0x7f18f0159df0 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f758e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f00b0d10 con 0x7f18f00cc0e0 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f5b2b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f015a1c0 0x7f18f0153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f5b2b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f015a1c0 0x7f18f0153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34512/0 (socket says 172.21.15.61:34512) 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f5b2b700 1 -- 172.21.15.61:0/2979859497 learned_addr learned my addr 172.21.15.61:0/2979859497 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:16.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f4b29700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18f0159df0 0x7f18f00b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f532a700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18f00cc0e0 0x7f18f0145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f5b2b700 1 -- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18f00cc0e0 msgr2=0x7f18f0145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f5b2b700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18f00cc0e0 0x7f18f0145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f5b2b700 1 -- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18f0159df0 msgr2=0x7f18f00b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f5b2b700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18f0159df0 0x7f18f00b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f5b2b700 1 -- 172.21.15.61:0/2979859497 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e8009ae0 con 0x7f18f015a1c0 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f5b2b700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f015a1c0 0x7f18f0153d10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f18f0071630 tx=0x7f18e8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18e17fa700 1 -- 172.21.15.61:0/2979859497 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e80032f0 con 0x7f18f015a1c0 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18e17fa700 1 -- 172.21.15.61:0/2979859497 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e8008e40 con 0x7f18f015a1c0 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f758e700 1 -- 172.21.15.61:0/2979859497 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f00b0ff0 con 0x7f18f015a1c0 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18e17fa700 1 -- 172.21.15.61:0/2979859497 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e80266b0 con 0x7f18f015a1c0 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.591+0000 7f18f758e700 1 -- 172.21.15.61:0/2979859497 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f00b15b0 con 0x7f18f015a1c0 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.592+0000 7f18f758e700 1 -- 172.21.15.61:0/2979859497 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f0089040 con 0x7f18f015a1c0 2023-12-24T19:58:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.593+0000 7f18e17fa700 1 -- 172.21.15.61:0/2979859497 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f18e8003040 con 0x7f18f015a1c0 2023-12-24T19:58:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.593+0000 7f18e17fa700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f18d4066f30 0x7f18d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.593+0000 7f18e17fa700 1 -- 172.21.15.61:0/2979859497 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f18e8085f90 con 0x7f18f015a1c0 2023-12-24T19:58:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.594+0000 7f18f532a700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f18d4066f30 0x7f18d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.594+0000 7f18f532a700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f18d4066f30 0x7f18d40693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f18e4006fd0 tx=0x7f18e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:16.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.598+0000 7f18e17fa700 1 -- 172.21.15.61:0/2979859497 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18e80532b0 con 0x7f18f015a1c0 2023-12-24T19:58:16.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.790+0000 7f18f758e700 1 -- 172.21.15.61:0/2979859497 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18f004c3c0 con 0x7f18f015a1c0 2023-12-24T19:58:16.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.791+0000 7f18e17fa700 1 -- 172.21.15.61:0/2979859497 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18e80210a0 con 0x7f18f015a1c0 2023-12-24T19:58:16.791 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T19:58:16.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.792+0000 7f18f758e700 1 -- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f18d4066f30 msgr2=0x7f18d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f18d4066f30 0x7f18d40693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f18e4006fd0 tx=0x7f18e4008040 comp rx=0 tx=0).stop 2023-12-24T19:58:16.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 -- 172.21.15.61:0/2979859497 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f015a1c0 msgr2=0x7f18f0153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f015a1c0 0x7f18f0153d10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f18f0071630 tx=0x7f18e8018000 comp rx=0 tx=0).stop 2023-12-24T19:58:16.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 -- 172.21.15.61:0/2979859497 shutdown_connections 2023-12-24T19:58:16.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f18f00cc0e0 0x7f18f0145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f18d4066f30 0x7f18d40693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18f015a1c0 0x7f18f0153d10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 --2- 172.21.15.61:0/2979859497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18f0159df0 0x7f18f00b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 -- 172.21.15.61:0/2979859497 >> 172.21.15.61:0/2979859497 conn(0x7f18f006e600 msgr2=0x7f18f00c59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:16.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 -- 172.21.15.61:0/2979859497 shutdown_connections 2023-12-24T19:58:16.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.793+0000 7f18f758e700 1 -- 172.21.15.61:0/2979859497 wait complete. 2023-12-24T19:58:16.805 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:16.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.926+0000 7f219d2f4700 1 Processor -- start 2023-12-24T19:58:16.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.926+0000 7f219d2f4700 1 -- start start 2023-12-24T19:58:16.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f219d2f4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2198159c10 0x7f21980c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f219d2f4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2198159fe0 0x7f21980c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f219d2f4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21980af880 con 0x7f21980cba80 2023-12-24T19:58:16.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f219d2f4700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21980c6fc0 con 0x7f2198159fe0 2023-12-24T19:58:16.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f219d2f4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21980c63b0 con 0x7f2198159c10 2023-12-24T19:58:16.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f21967fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2198159fe0 0x7f21980c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f21967fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2198159fe0 0x7f21980c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34528/0 (socket says 172.21.15.61:34528) 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f21967fc700 1 -- 172.21.15.61:0/1627779366 learned_addr learned my addr 172.21.15.61:0/1627779366 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f2196ffd700 1 --2- 172.21.15.61:0/1627779366 >> v2:172.21.15.133:3300/0 conn(0x7f2198159c10 0x7f21980c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f21967fc700 1 -- 172.21.15.61:0/1627779366 >> v2:172.21.15.133:3300/0 conn(0x7f2198159c10 msgr2=0x7f21980c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f21967fc700 1 --2- 172.21.15.61:0/1627779366 >> v2:172.21.15.133:3300/0 conn(0x7f2198159c10 0x7f21980c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f21967fc700 1 -- 172.21.15.61:0/1627779366 >> v1:172.21.15.133:6789/0 conn(0x7f21980cba80 legacy=0x7f21980cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.927+0000 7f21967fc700 1 -- 172.21.15.61:0/1627779366 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21980c6690 con 0x7f2198159fe0 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f21967fc700 1 --2- 172.21.15.61:0/1627779366 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2198159fe0 0x7f21980c5d10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f21980d0990 tx=0x7f2188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ff9b9472825cdb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f2195ffb700 1 -- 172.21.15.61:0/1627779366 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800b860 con 0x7f2198159fe0 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f2195ffb700 1 -- 172.21.15.61:0/1627779366 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800b9c0 con 0x7f2198159fe0 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f2195ffb700 1 -- 172.21.15.61:0/1627779366 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800bd60 con 0x7f2198159fe0 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f219d2f4700 1 -- 172.21.15.61:0/1627779366 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2198159fe0 msgr2=0x7f21980c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f219d2f4700 1 --2- 172.21.15.61:0/1627779366 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2198159fe0 0x7f21980c5d10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f21980d0990 tx=0x7f2188009250 comp rx=0 tx=0).stop 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f219d2f4700 1 -- 172.21.15.61:0/1627779366 shutdown_connections 2023-12-24T19:58:16.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f219d2f4700 1 --2- 172.21.15.61:0/1627779366 >> v2:172.21.15.133:3300/0 conn(0x7f2198159c10 0x7f21980c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f219d2f4700 1 --2- 172.21.15.61:0/1627779366 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2198159fe0 0x7f21980c5d10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f219d2f4700 1 -- 172.21.15.61:0/1627779366 >> 172.21.15.61:0/1627779366 conn(0x7f219806e640 msgr2=0x7f2198067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:16.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f219d2f4700 1 -- 172.21.15.61:0/1627779366 shutdown_connections 2023-12-24T19:58:16.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.928+0000 7f219d2f4700 1 -- 172.21.15.61:0/1627779366 wait complete. 2023-12-24T19:58:16.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.930+0000 7f219d2f4700 1 Processor -- start 2023-12-24T19:58:16.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.930+0000 7f219d2f4700 1 -- start start 2023-12-24T19:58:16.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.930+0000 7f219d2f4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21980cba80 0x7f219815ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.930+0000 7f219d2f4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2198159c10 0x7f21981557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.930+0000 7f219d2f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2198159fe0 0x7f21980c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.930+0000 7f219d2f4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c8540 con 0x7f21980cba80 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.930+0000 7f219d2f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c7c10 con 0x7f2198159fe0 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.930+0000 7f219d2f4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c7ef0 con 0x7f2198159c10 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f2196ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21980cba80 0x7f219815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f2196ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21980cba80 0x7f219815ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34542/0 (socket says 172.21.15.61:34542) 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f2196ffd700 1 -- 172.21.15.61:0/2093317858 learned_addr learned my addr 172.21.15.61:0/2093317858 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f2196ffd700 1 -- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2198159c10 msgr2=0x7f21981557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f2196ffd700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2198159c10 0x7f21981557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f2196ffd700 1 -- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2198159fe0 msgr2=0x7f21980c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f21977fe700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2198159fe0 0x7f21980c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f2196ffd700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2198159fe0 0x7f21980c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f2196ffd700 1 -- 172.21.15.61:0/2093317858 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880094f0 con 0x7f21980cba80 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f21977fe700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2198159fe0 0x7f21980c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f2196ffd700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21980cba80 0x7f219815ad90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f218000d890 tx=0x7f2180008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f218effd700 1 -- 172.21.15.61:0/2093317858 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218000b600 con 0x7f21980cba80 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f218effd700 1 -- 172.21.15.61:0/2093317858 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218000b760 con 0x7f21980cba80 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f219d2f4700 1 -- 172.21.15.61:0/2093317858 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21980c81d0 con 0x7f21980cba80 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f218effd700 1 -- 172.21.15.61:0/2093317858 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218000bae0 con 0x7f21980cba80 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.931+0000 7f219d2f4700 1 -- 172.21.15.61:0/2093317858 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219815b2d0 con 0x7f21980cba80 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.932+0000 7f219d2f4700 1 -- 172.21.15.61:0/2093317858 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219815b4f0 con 0x7f21980cba80 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.933+0000 7f218effd700 1 -- 172.21.15.61:0/2093317858 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f218001e460 con 0x7f21980cba80 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.933+0000 7f218effd700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2178066f30 0x7f21780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:16.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.933+0000 7f218effd700 1 -- 172.21.15.61:0/2093317858 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2180084be0 con 0x7f21980cba80 2023-12-24T19:58:16.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.934+0000 7f21967fc700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2178066f30 0x7f21780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:16.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.934+0000 7f21967fc700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2178066f30 0x7f21780693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2198089d80 tx=0x7f2188017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:16.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:16.938+0000 7f218effd700 1 -- 172.21.15.61:0/2093317858 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2180051e50 con 0x7f21980cba80 2023-12-24T19:58:17.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.175+0000 7f219d2f4700 1 -- 172.21.15.61:0/2093317858 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21980890b0 con 0x7f21980cba80 2023-12-24T19:58:17.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.175+0000 7f218effd700 1 -- 172.21.15.61:0/2093317858 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f2180055470 con 0x7f21980cba80 2023-12-24T19:58:17.176 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:17.176 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2779978406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2779978406},{"type":"v1","addr":"172.21.15.61:6835","nonce":2779978406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1935570272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1935570272},{"type":"v1","addr":"172.21.15.133:6836","nonce":1935570272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3983510237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3983510237},{"type":"v1","addr":"172.21.15.133:6837","nonce":3983510237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:58.161119+0000","modified":"2023-12-24T19:58:01.793217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4777},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4777":{"gid":4777,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2729904701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2729904701},{"type":"v1","addr":"172.21.15.61:6834","nonce":2729904701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T19:58:17.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.177+0000 7f219d2f4700 1 -- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2178066f30 msgr2=0x7f21780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.177+0000 7f219d2f4700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2178066f30 0x7f21780693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2198089d80 tx=0x7f2188017000 comp rx=0 tx=0).stop 2023-12-24T19:58:17.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.177+0000 7f219d2f4700 1 -- 172.21.15.61:0/2093317858 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21980cba80 msgr2=0x7f219815ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.177+0000 7f219d2f4700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21980cba80 0x7f219815ad90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f218000d890 tx=0x7f2180008040 comp rx=0 tx=0).stop 2023-12-24T19:58:17.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.177+0000 7f219d2f4700 1 -- 172.21.15.61:0/2093317858 shutdown_connections 2023-12-24T19:58:17.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.178+0000 7f219d2f4700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2178066f30 0x7f21780693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.178+0000 7f219d2f4700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2198159fe0 0x7f21980c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.178+0000 7f219d2f4700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21980cba80 0x7f219815ad90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.178+0000 7f219d2f4700 1 --2- 172.21.15.61:0/2093317858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2198159c10 0x7f21981557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.178+0000 7f219d2f4700 1 -- 172.21.15.61:0/2093317858 >> 172.21.15.61:0/2093317858 conn(0x7f219806e640 msgr2=0x7f21980b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:17.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.178+0000 7f219d2f4700 1 -- 172.21.15.61:0/2093317858 shutdown_connections 2023-12-24T19:58:17.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.178+0000 7f219d2f4700 1 -- 172.21.15.61:0/2093317858 wait complete. 2023-12-24T19:58:17.179 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 16 2023-12-24T19:58:17.190 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:58:17.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.311+0000 7f5868e74700 1 Processor -- start 2023-12-24T19:58:17.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.311+0000 7f5868e74700 1 -- start start 2023-12-24T19:58:17.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.312+0000 7f5868e74700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5864068140 0x7f58640cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.312+0000 7f5868e74700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58640b2890 con 0x7f5864068510 2023-12-24T19:58:17.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.312+0000 7f5868e74700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58640cf630 con 0x7f5864159a60 2023-12-24T19:58:17.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.312+0000 7f5868e74700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58640b2240 con 0x7f5864068140 2023-12-24T19:58:17.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.312+0000 7f5861d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f5864068510 0x7f58640b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40634/0 (socket says 172.21.15.61:40634) 2023-12-24T19:58:17.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.312+0000 7f5861d9b700 1 -- 172.21.15.61:0/2339651141 learned_addr learned my addr 172.21.15.61:0/2339651141 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:17.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.312+0000 7f586259c700 1 --2- 172.21.15.61:0/2339651141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5864068140 0x7f58640cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:17.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.312+0000 7f586159a700 1 -- 172.21.15.61:0/2339651141 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104640477 0 0) 0x7f58640b2890 con 0x7f5864068510 2023-12-24T19:58:17.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.312+0000 7f586159a700 1 -- 172.21.15.61:0/2339651141 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f584c003570 con 0x7f5864068510 2023-12-24T19:58:17.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.313+0000 7f586159a700 1 -- 172.21.15.61:0/2339651141 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669397028 0 0) 0x7f58640cf630 con 0x7f5864159a60 2023-12-24T19:58:17.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.313+0000 7f586159a700 1 -- 172.21.15.61:0/2339651141 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58640b2890 con 0x7f5864159a60 2023-12-24T19:58:17.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.313+0000 7f586259c700 1 -- 172.21.15.61:0/2339651141 >> v1:172.21.15.133:6789/0 conn(0x7f5864159a60 legacy=0x7f5864159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.313+0000 7f586259c700 1 -- 172.21.15.61:0/2339651141 >> v1:172.21.15.61:6789/0 conn(0x7f5864068510 legacy=0x7f58640b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.313+0000 7f586159a700 1 -- 172.21.15.61:0/2339651141 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4110046588 0 0) 0x7f584c003570 con 0x7f5864068510 2023-12-24T19:58:17.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.313+0000 7f586259c700 1 -- 172.21.15.61:0/2339651141 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58640b2520 con 0x7f5864068140 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.313+0000 7f586259c700 1 --2- 172.21.15.61:0/2339651141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5864068140 0x7f58640cefa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5858009900 tx=0x7f5858009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e8a1dbc0136a41 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.313+0000 7f586159a700 1 -- 172.21.15.61:0/2339651141 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5854001470 con 0x7f5864068140 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.313+0000 7f586159a700 1 -- 172.21.15.61:0/2339651141 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858011420 con 0x7f5864068140 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.313+0000 7f586159a700 1 -- 172.21.15.61:0/2339651141 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58580117c0 con 0x7f5864068140 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.314+0000 7f5868e74700 1 -- 172.21.15.61:0/2339651141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5864068140 msgr2=0x7f58640cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.314+0000 7f5868e74700 1 --2- 172.21.15.61:0/2339651141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5864068140 0x7f58640cefa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5858009900 tx=0x7f5858009120 comp rx=0 tx=0).stop 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.314+0000 7f5868e74700 1 -- 172.21.15.61:0/2339651141 shutdown_connections 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.314+0000 7f5868e74700 1 --2- 172.21.15.61:0/2339651141 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5864068140 0x7f58640cefa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.314+0000 7f5868e74700 1 -- 172.21.15.61:0/2339651141 >> 172.21.15.61:0/2339651141 conn(0x7f5864097a10 msgr2=0x7f58640ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.314+0000 7f5868e74700 1 -- 172.21.15.61:0/2339651141 shutdown_connections 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.314+0000 7f5868e74700 1 -- 172.21.15.61:0/2339651141 wait complete. 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.315+0000 7f5868e74700 1 Processor -- start 2023-12-24T19:58:17.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.315+0000 7f5868e74700 1 -- start start 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f5868e74700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5864068140 0x7f5864156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f5868e74700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5864068510 0x7f586415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f5868e74700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5864159a60 0x7f586406b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f5868e74700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586415da00 con 0x7f5864068140 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f5868e74700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586415dce0 con 0x7f5864068510 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f5868e74700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586415dfc0 con 0x7f5864159a60 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f586259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5864068140 0x7f5864156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f586259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5864068140 0x7f5864156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34544/0 (socket says 172.21.15.61:34544) 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f586259c700 1 -- 172.21.15.61:0/2229861107 learned_addr learned my addr 172.21.15.61:0/2229861107 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f5861d9b700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5864068510 0x7f586415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f586259c700 1 -- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5864159a60 msgr2=0x7f586406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f586259c700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5864159a60 0x7f586406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f586259c700 1 -- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5864068510 msgr2=0x7f586415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f586259c700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5864068510 0x7f586415d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f586259c700 1 -- 172.21.15.61:0/2229861107 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580093c0 con 0x7f5864068140 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f5861d9b700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5864068510 0x7f586415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f586259c700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5864068140 0x7f5864156bf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5858009160 tx=0x7f5858016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f58527fc700 1 -- 172.21.15.61:0/2229861107 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585801cc90 con 0x7f5864068140 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f58527fc700 1 -- 172.21.15.61:0/2229861107 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585801cdf0 con 0x7f5864068140 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f5868e74700 1 -- 172.21.15.61:0/2229861107 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586415e2a0 con 0x7f5864068140 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f58527fc700 1 -- 172.21.15.61:0/2229861107 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585801a6a0 con 0x7f5864068140 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.316+0000 7f5868e74700 1 -- 172.21.15.61:0/2229861107 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586415d5d0 con 0x7f5864068140 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.317+0000 7f5868e74700 1 -- 172.21.15.61:0/2229861107 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586406d440 con 0x7f5864068140 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.318+0000 7f58527fc700 1 -- 172.21.15.61:0/2229861107 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f585801aa90 con 0x7f5864068140 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.318+0000 7f58527fc700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5844066f30 0x7f58440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.318+0000 7f58527fc700 1 -- 172.21.15.61:0/2229861107 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5858085ef0 con 0x7f5864068140 2023-12-24T19:58:17.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.319+0000 7f5861d9b700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5844066f30 0x7f58440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:17.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.319+0000 7f5861d9b700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5844066f30 0x7f58440693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f58540015a0 tx=0x7f5854009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:17.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.322+0000 7f58527fc700 1 -- 172.21.15.61:0/2229861107 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5858053160 con 0x7f5864068140 2023-12-24T19:58:17.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.521+0000 7f5868e74700 1 -- 172.21.15.61:0/2229861107 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5864169f30 con 0x7f5864068140 2023-12-24T19:58:17.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.522+0000 7f58527fc700 1 -- 172.21.15.61:0/2229861107 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5864169f30 con 0x7f5864068140 2023-12-24T19:58:17.522 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:17.522 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":33,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:58:11.766399+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:56.143696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:57.136484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:58:17.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 -- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5844066f30 msgr2=0x7f58440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5844066f30 0x7f58440693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f58540015a0 tx=0x7f5854009040 comp rx=0 tx=0).stop 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 -- 172.21.15.61:0/2229861107 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5864068140 msgr2=0x7f5864156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5864068140 0x7f5864156bf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5858009160 tx=0x7f5858016000 comp rx=0 tx=0).stop 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 -- 172.21.15.61:0/2229861107 shutdown_connections 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5864159a60 0x7f586406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5844066f30 0x7f58440693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5864068140 0x7f5864156bf0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 --2- 172.21.15.61:0/2229861107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5864068510 0x7f586415d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 -- 172.21.15.61:0/2229861107 >> 172.21.15.61:0/2229861107 conn(0x7f5864097a10 msgr2=0x7f58640ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 -- 172.21.15.61:0/2229861107 shutdown_connections 2023-12-24T19:58:17.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.524+0000 7f5868e74700 1 -- 172.21.15.61:0/2229861107 wait complete. 2023-12-24T19:58:17.536 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T19:58:17.537 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:17.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.658+0000 7f1b94810700 1 Processor -- start 2023-12-24T19:58:17.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.658+0000 7f1b94810700 1 -- start start 2023-12-24T19:58:17.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b94810700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b9006b260 0x7f1b9015c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b94810700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1b9006b630 0x7f1b90067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b94810700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1b90067a90 0x7f1b90070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b94810700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b90067ed0 con 0x7f1b90067a90 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b94810700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9015bcd0 con 0x7f1b9006b630 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b94810700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900cafb0 con 0x7f1b9006b260 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8ed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1b90067a90 0x7f1b90070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8ed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1b90067a90 0x7f1b90070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34556/0 (socket says 172.21.15.61:34556) 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8ed9d700 1 -- 172.21.15.61:0/226176515 learned_addr learned my addr 172.21.15.61:0/226176515 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8dd9b700 1 --2- 172.21.15.61:0/226176515 >> v2:172.21.15.133:3300/0 conn(0x7f1b9006b630 0x7f1b90067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8e59c700 1 --2- 172.21.15.61:0/226176515 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b9006b260 0x7f1b9015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8ed9d700 1 -- 172.21.15.61:0/226176515 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b9006b260 msgr2=0x7f1b9015c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:17.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8ed9d700 1 --2- 172.21.15.61:0/226176515 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b9006b260 0x7f1b9015c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8ed9d700 1 -- 172.21.15.61:0/226176515 >> v2:172.21.15.133:3300/0 conn(0x7f1b9006b630 msgr2=0x7f1b90067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8ed9d700 1 --2- 172.21.15.61:0/226176515 >> v2:172.21.15.133:3300/0 conn(0x7f1b9006b630 0x7f1b90067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8ed9d700 1 -- 172.21.15.61:0/226176515 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b900683a0 con 0x7f1b90067a90 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8dd9b700 1 --2- 172.21.15.61:0/226176515 >> v2:172.21.15.133:3300/0 conn(0x7f1b9006b630 0x7f1b90067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.659+0000 7f1b8ed9d700 1 --2- 172.21.15.61:0/226176515 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b90067a90 0x7f1b90070640 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1b9006cba0 tx=0x7f1b88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9605ef17e712ca5e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b8d59a700 1 -- 172.21.15.61:0/226176515 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800e070 con 0x7f1b90067a90 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b8d59a700 1 -- 172.21.15.61:0/226176515 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8800ba50 con 0x7f1b90067a90 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b8d59a700 1 -- 172.21.15.61:0/226176515 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b880092e0 con 0x7f1b90067a90 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b94810700 1 -- 172.21.15.61:0/226176515 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b90067a90 msgr2=0x7f1b90070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b94810700 1 --2- 172.21.15.61:0/226176515 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b90067a90 0x7f1b90070640 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1b9006cba0 tx=0x7f1b88009840 comp rx=0 tx=0).stop 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b94810700 1 -- 172.21.15.61:0/226176515 shutdown_connections 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b94810700 1 --2- 172.21.15.61:0/226176515 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b90067a90 0x7f1b90070640 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b94810700 1 --2- 172.21.15.61:0/226176515 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b9006b260 0x7f1b9015c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b94810700 1 --2- 172.21.15.61:0/226176515 >> v2:172.21.15.133:3300/0 conn(0x7f1b9006b630 0x7f1b90067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b94810700 1 -- 172.21.15.61:0/226176515 >> 172.21.15.61:0/226176515 conn(0x7f1b900ca200 msgr2=0x7f1b900ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:17.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b94810700 1 -- 172.21.15.61:0/226176515 shutdown_connections 2023-12-24T19:58:17.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.660+0000 7f1b94810700 1 -- 172.21.15.61:0/226176515 wait complete. 2023-12-24T19:58:17.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.661+0000 7f1b94810700 1 Processor -- start 2023-12-24T19:58:17.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.661+0000 7f1b94810700 1 -- start start 2023-12-24T19:58:17.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b94810700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b90067a90 0x7f1b90155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b94810700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b9006b260 0x7f1b900ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b94810700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b9006b630 0x7f1b900a8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b94810700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900b2060 con 0x7f1b9006b630 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b94810700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900ab890 con 0x7f1b9006b260 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b94810700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b900abb70 con 0x7f1b90067a90 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b9006b630 0x7f1b900a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b9006b630 0x7f1b900a8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34566/0 (socket says 172.21.15.61:34566) 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b8ed9d700 1 -- 172.21.15.61:0/2004614877 learned_addr learned my addr 172.21.15.61:0/2004614877 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b8ed9d700 1 -- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b90067a90 msgr2=0x7f1b90155df0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b8ed9d700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b90067a90 0x7f1b90155df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b8ed9d700 1 -- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b9006b260 msgr2=0x7f1b900ac5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b8ed9d700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b9006b260 0x7f1b900ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.662+0000 7f1b8ed9d700 1 -- 172.21.15.61:0/2004614877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b88009ae0 con 0x7f1b9006b630 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.663+0000 7f1b8ed9d700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b9006b630 0x7f1b900a8740 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1b9006c7f0 tx=0x7f1b88018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.663+0000 7f1b7e7fc700 1 -- 172.21.15.61:0/2004614877 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88008e80 con 0x7f1b9006b630 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.663+0000 7f1b7e7fc700 1 -- 172.21.15.61:0/2004614877 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8801c410 con 0x7f1b9006b630 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.663+0000 7f1b94810700 1 -- 172.21.15.61:0/2004614877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b900b1a10 con 0x7f1b9006b630 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.663+0000 7f1b7e7fc700 1 -- 172.21.15.61:0/2004614877 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8801c7d0 con 0x7f1b9006b630 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.663+0000 7f1b94810700 1 -- 172.21.15.61:0/2004614877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b90156330 con 0x7f1b9006b630 2023-12-24T19:58:17.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.664+0000 7f1b94810700 1 -- 172.21.15.61:0/2004614877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9004c3c0 con 0x7f1b9006b630 2023-12-24T19:58:17.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.664+0000 7f1b7e7fc700 1 -- 172.21.15.61:0/2004614877 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1b88003040 con 0x7f1b9006b630 2023-12-24T19:58:17.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.665+0000 7f1b7e7fc700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b70066f30 0x7f1b700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:17.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.665+0000 7f1b7e7fc700 1 -- 172.21.15.61:0/2004614877 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b88085fb0 con 0x7f1b9006b630 2023-12-24T19:58:17.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.665+0000 7f1b8e59c700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b70066f30 0x7f1b700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:17.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.666+0000 7f1b8e59c700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b70066f30 0x7f1b700693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b80007970 tx=0x7f1b80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:17.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.669+0000 7f1b7e7fc700 1 -- 172.21.15.61:0/2004614877 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b88053220 con 0x7f1b9006b630 2023-12-24T19:58:17.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.910+0000 7f1b94810700 1 -- 172.21.15.61:0/2004614877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b900cad90 con 0x7f1b9006b630 2023-12-24T19:58:17.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.911+0000 7f1b7e7fc700 1 -- 172.21.15.61:0/2004614877 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f1b88056840 con 0x7f1b9006b630 2023-12-24T19:58:17.911 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:17.911 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2779978406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2779978406},{"type":"v1","addr":"172.21.15.61:6835","nonce":2779978406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1935570272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1935570272},{"type":"v1","addr":"172.21.15.133:6836","nonce":1935570272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3983510237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3983510237},{"type":"v1","addr":"172.21.15.133:6837","nonce":3983510237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:58.161119+0000","modified":"2023-12-24T19:58:01.793217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4777},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4777":{"gid":4777,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2729904701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2729904701},{"type":"v1","addr":"172.21.15.61:6834","nonce":2729904701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T19:58:17.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.912+0000 7f1b94810700 1 -- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b70066f30 msgr2=0x7f1b700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.912+0000 7f1b94810700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b70066f30 0x7f1b700693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b80007970 tx=0x7f1b80008040 comp rx=0 tx=0).stop 2023-12-24T19:58:17.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.912+0000 7f1b94810700 1 -- 172.21.15.61:0/2004614877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b9006b630 msgr2=0x7f1b900a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:17.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.912+0000 7f1b94810700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b9006b630 0x7f1b900a8740 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1b9006c7f0 tx=0x7f1b88018000 comp rx=0 tx=0).stop 2023-12-24T19:58:17.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.913+0000 7f1b94810700 1 -- 172.21.15.61:0/2004614877 shutdown_connections 2023-12-24T19:58:17.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.913+0000 7f1b94810700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b90067a90 0x7f1b90155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.913+0000 7f1b94810700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b70066f30 0x7f1b700693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.913+0000 7f1b94810700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b9006b630 0x7f1b900a8740 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.913+0000 7f1b94810700 1 --2- 172.21.15.61:0/2004614877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b9006b260 0x7f1b900ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:17.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.913+0000 7f1b94810700 1 -- 172.21.15.61:0/2004614877 >> 172.21.15.61:0/2004614877 conn(0x7f1b900ca200 msgr2=0x7f1b900af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:17.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.913+0000 7f1b94810700 1 -- 172.21.15.61:0/2004614877 shutdown_connections 2023-12-24T19:58:17.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:17.913+0000 7f1b94810700 1 -- 172.21.15.61:0/2004614877 wait complete. 2023-12-24T19:58:17.914 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 16 2023-12-24T19:58:17.925 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:18.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.046+0000 7f767ade8700 1 Processor -- start 2023-12-24T19:58:18.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.046+0000 7f767ade8700 1 -- start start 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f767ade8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f76740b2660 0x7f767415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f767ade8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f767415c470 0x7f76740b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f767ade8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76740b2eb0 con 0x7f767415bb60 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f767ade8700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76740afc20 con 0x7f76740b2660 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f767ade8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76740b2bd0 con 0x7f767415c470 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f7673fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f76740b2660 0x7f767415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f7673fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f76740b2660 0x7f767415bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34572/0 (socket says 172.21.15.61:34572) 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f7673fff700 1 -- 172.21.15.61:0/963857465 learned_addr learned my addr 172.21.15.61:0/963857465 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f7679385700 1 --2- 172.21.15.61:0/963857465 >> v2:172.21.15.133:3300/0 conn(0x7f767415c470 0x7f76740b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f7673fff700 1 -- 172.21.15.61:0/963857465 >> v2:172.21.15.133:3300/0 conn(0x7f767415c470 msgr2=0x7f76740b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f7673fff700 1 --2- 172.21.15.61:0/963857465 >> v2:172.21.15.133:3300/0 conn(0x7f767415c470 0x7f76740b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f7673fff700 1 -- 172.21.15.61:0/963857465 >> v1:172.21.15.133:6789/0 conn(0x7f767415bb60 legacy=0x7f7674098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:18.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f7673fff700 1 -- 172.21.15.61:0/963857465 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76740afe10 con 0x7f76740b2660 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.047+0000 7f7673fff700 1 --2- 172.21.15.61:0/963857465 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f76740b2660 0x7f767415bf30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f76740a9750 tx=0x7f7660009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3c762285f03739 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f76737fe700 1 -- 172.21.15.61:0/963857465 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766000b820 con 0x7f76740b2660 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f76737fe700 1 -- 172.21.15.61:0/963857465 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766000b980 con 0x7f76740b2660 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f76737fe700 1 -- 172.21.15.61:0/963857465 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766000bd20 con 0x7f76740b2660 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f767ade8700 1 -- 172.21.15.61:0/963857465 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f76740b2660 msgr2=0x7f767415bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f767ade8700 1 --2- 172.21.15.61:0/963857465 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f76740b2660 0x7f767415bf30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f76740a9750 tx=0x7f7660009250 comp rx=0 tx=0).stop 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f767ade8700 1 -- 172.21.15.61:0/963857465 shutdown_connections 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f767ade8700 1 --2- 172.21.15.61:0/963857465 >> v2:172.21.15.133:3300/0 conn(0x7f767415c470 0x7f76740b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f767ade8700 1 --2- 172.21.15.61:0/963857465 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f76740b2660 0x7f767415bf30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f767ade8700 1 -- 172.21.15.61:0/963857465 >> 172.21.15.61:0/963857465 conn(0x7f7674097a10 msgr2=0x7f76740ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f767ade8700 1 -- 172.21.15.61:0/963857465 shutdown_connections 2023-12-24T19:58:18.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.048+0000 7f767ade8700 1 -- 172.21.15.61:0/963857465 wait complete. 2023-12-24T19:58:18.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.049+0000 7f767ade8700 1 Processor -- start 2023-12-24T19:58:18.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.050+0000 7f767ade8700 1 -- start start 2023-12-24T19:58:18.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.050+0000 7f767ade8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76740b2660 0x7f76740c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.050+0000 7f767ade8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f767415bb60 0x7f767409b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.050+0000 7f767ade8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f767415c470 0x7f7674148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.050+0000 7f767ade8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767416bb20 con 0x7f767415bb60 2023-12-24T19:58:18.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.050+0000 7f767ade8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767416be00 con 0x7f76740b2660 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.050+0000 7f767ade8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767416c0e0 con 0x7f767415c470 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.050+0000 7f7673fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f767415bb60 0x7f767409b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.050+0000 7f7673fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f767415bb60 0x7f767409b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34576/0 (socket says 172.21.15.61:34576) 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.050+0000 7f7673fff700 1 -- 172.21.15.61:0/1842070739 learned_addr learned my addr 172.21.15.61:0/1842070739 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7679385700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f767415c470 0x7f7674148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7678b84700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76740b2660 0x7f76740c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7673fff700 1 -- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f767415c470 msgr2=0x7f7674148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7673fff700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f767415c470 0x7f7674148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7673fff700 1 -- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76740b2660 msgr2=0x7f76740c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7673fff700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76740b2660 0x7f76740c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7673fff700 1 -- 172.21.15.61:0/1842070739 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600094f0 con 0x7f767415bb60 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7678b84700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76740b2660 0x7f76740c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:18.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7673fff700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f767415bb60 0x7f767409b290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7660009290 tx=0x7f7660016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:18.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7670ff9700 1 -- 172.21.15.61:0/1842070739 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660011e20 con 0x7f767415bb60 2023-12-24T19:58:18.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7670ff9700 1 -- 172.21.15.61:0/1842070739 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660020070 con 0x7f767415bb60 2023-12-24T19:58:18.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f7670ff9700 1 -- 172.21.15.61:0/1842070739 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766001b6a0 con 0x7f767415bb60 2023-12-24T19:58:18.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f767ade8700 1 -- 172.21.15.61:0/1842070739 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767416c3c0 con 0x7f767415bb60 2023-12-24T19:58:18.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.051+0000 7f767ade8700 1 -- 172.21.15.61:0/1842070739 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7674157590 con 0x7f767415bb60 2023-12-24T19:58:18.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.052+0000 7f767ade8700 1 -- 172.21.15.61:0/1842070739 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767416c860 con 0x7f767415bb60 2023-12-24T19:58:18.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.052+0000 7f7670ff9700 1 -- 172.21.15.61:0/1842070739 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7660022030 con 0x7f767415bb60 2023-12-24T19:58:18.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.053+0000 7f7670ff9700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7658066f30 0x7f76580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.053+0000 7f7670ff9700 1 -- 172.21.15.61:0/1842070739 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7660086530 con 0x7f767415bb60 2023-12-24T19:58:18.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.053+0000 7f7678b84700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7658066f30 0x7f76580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.054+0000 7f7678b84700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7658066f30 0x7f76580693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7668007970 tx=0x7f7668008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:18.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.057+0000 7f7670ff9700 1 -- 172.21.15.61:0/1842070739 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76600537a0 con 0x7f767415bb60 2023-12-24T19:58:18.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.295+0000 7f767ade8700 1 -- 172.21.15.61:0/1842070739 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f767416c860 con 0x7f767415bb60 2023-12-24T19:58:18.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.295+0000 7f7670ff9700 1 -- 172.21.15.61:0/1842070739 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f7660056dc0 con 0x7f767415bb60 2023-12-24T19:58:18.296 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:18.296 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2779978406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2779978406},{"type":"v1","addr":"172.21.15.61:6835","nonce":2779978406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1935570272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1935570272},{"type":"v1","addr":"172.21.15.133:6836","nonce":1935570272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3983510237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3983510237},{"type":"v1","addr":"172.21.15.133:6837","nonce":3983510237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:57:58.161119+0000","modified":"2023-12-24T19:58:01.793217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4777},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4777":{"gid":4777,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2729904701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2729904701},{"type":"v1","addr":"172.21.15.61:6834","nonce":2729904701}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-12-24T19:58:18.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.297+0000 7f767ade8700 1 -- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7658066f30 msgr2=0x7f76580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.297+0000 7f767ade8700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7658066f30 0x7f76580693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7668007970 tx=0x7f7668008040 comp rx=0 tx=0).stop 2023-12-24T19:58:18.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.297+0000 7f767ade8700 1 -- 172.21.15.61:0/1842070739 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f767415bb60 msgr2=0x7f767409b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.297+0000 7f767ade8700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f767415bb60 0x7f767409b290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7660009290 tx=0x7f7660016000 comp rx=0 tx=0).stop 2023-12-24T19:58:18.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.297+0000 7f767ade8700 1 -- 172.21.15.61:0/1842070739 shutdown_connections 2023-12-24T19:58:18.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.297+0000 7f767ade8700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f767415c470 0x7f7674148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.297+0000 7f767ade8700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7658066f30 0x7f76580693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.297+0000 7f767ade8700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76740b2660 0x7f76740c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.297+0000 7f767ade8700 1 --2- 172.21.15.61:0/1842070739 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f767415bb60 0x7f767409b290 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.297+0000 7f767ade8700 1 -- 172.21.15.61:0/1842070739 >> 172.21.15.61:0/1842070739 conn(0x7f7674097a10 msgr2=0x7f7674098560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:18.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.298+0000 7f767ade8700 1 -- 172.21.15.61:0/1842070739 shutdown_connections 2023-12-24T19:58:18.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.298+0000 7f767ade8700 1 -- 172.21.15.61:0/1842070739 wait complete. 2023-12-24T19:58:18.299 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 16 2023-12-24T19:58:18.310 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:58:18.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.431+0000 7fcc86677700 1 Processor -- start 2023-12-24T19:58:18.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.431+0000 7fcc86677700 1 -- start start 2023-12-24T19:58:18.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.432+0000 7fcc86677700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc800af710 0x7fcc800afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.432+0000 7fcc86677700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015acf0 0x7fcc80067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.432+0000 7fcc86677700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800687f0 con 0x7fcc80068c80 2023-12-24T19:58:18.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.432+0000 7fcc86677700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc80067be0 con 0x7fcc800af710 2023-12-24T19:58:18.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.432+0000 7fcc86677700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80067ec0 con 0x7fcc8015acf0 2023-12-24T19:58:18.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.432+0000 7fcc84c14700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015acf0 0x7fcc80067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.432+0000 7fcc7ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc800af710 0x7fcc800afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.432+0000 7fcc84c14700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015acf0 0x7fcc80067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:52156/0 (socket says 172.21.15.61:52156) 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.432+0000 7fcc84c14700 1 -- 172.21.15.61:0/3443598162 learned_addr learned my addr 172.21.15.61:0/3443598162 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc7ffff700 1 -- 172.21.15.61:0/3443598162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015acf0 msgr2=0x7fcc80067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc7ffff700 1 --2- 172.21.15.61:0/3443598162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015acf0 0x7fcc80067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc7ffff700 1 -- 172.21.15.61:0/3443598162 >> v1:172.21.15.133:6789/0 conn(0x7fcc80068c80 legacy=0x7fcc8015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc7effd700 1 -- 172.21.15.61:0/3443598162 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754719024 0 0) 0x7fcc800687f0 con 0x7fcc80068c80 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc7ffff700 1 -- 172.21.15.61:0/3443598162 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800681a0 con 0x7fcc800af710 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc84c14700 1 --2- 172.21.15.61:0/3443598162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015acf0 0x7fcc80067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc7ffff700 1 --2- 172.21.15.61:0/3443598162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc800af710 0x7fcc800afae0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcc700098e0 tx=0x7fcc700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cd4f39b4e386345 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc7effd700 1 -- 172.21.15.61:0/3443598162 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000b640 con 0x7fcc800af710 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc7effd700 1 -- 172.21.15.61:0/3443598162 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7000b7a0 con 0x7fcc800af710 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc7effd700 1 -- 172.21.15.61:0/3443598162 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000bb40 con 0x7fcc800af710 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc86677700 1 -- 172.21.15.61:0/3443598162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc800af710 msgr2=0x7fcc800afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc86677700 1 --2- 172.21.15.61:0/3443598162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc800af710 0x7fcc800afae0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcc700098e0 tx=0x7fcc700091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.433+0000 7fcc86677700 1 -- 172.21.15.61:0/3443598162 shutdown_connections 2023-12-24T19:58:18.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.434+0000 7fcc86677700 1 --2- 172.21.15.61:0/3443598162 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc8015acf0 0x7fcc80067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.434+0000 7fcc86677700 1 --2- 172.21.15.61:0/3443598162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc800af710 0x7fcc800afae0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.434+0000 7fcc86677700 1 -- 172.21.15.61:0/3443598162 >> 172.21.15.61:0/3443598162 conn(0x7fcc800ca200 msgr2=0x7fcc800ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:18.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.434+0000 7fcc86677700 1 -- 172.21.15.61:0/3443598162 shutdown_connections 2023-12-24T19:58:18.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.434+0000 7fcc86677700 1 -- 172.21.15.61:0/3443598162 wait complete. 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.435+0000 7fcc86677700 1 Processor -- start 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.435+0000 7fcc86677700 1 -- start start 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.435+0000 7fcc86677700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc80068c80 0x7fcc800b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc86677700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc800af710 0x7fcc800ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc86677700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc8015acf0 0x7fcc801511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc86677700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800b0a70 con 0x7fcc800af710 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc86677700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80155930 con 0x7fcc8015acf0 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc86677700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800b18b0 con 0x7fcc80068c80 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc7f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc800af710 0x7fcc800ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc7f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc800af710 0x7fcc800ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34588/0 (socket says 172.21.15.61:34588) 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc7f7fe700 1 -- 172.21.15.61:0/2570588578 learned_addr learned my addr 172.21.15.61:0/2570588578 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc7ffff700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc80068c80 0x7fcc800b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc84c14700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc8015acf0 0x7fcc801511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc7f7fe700 1 -- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc80068c80 msgr2=0x7fcc800b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc7f7fe700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc80068c80 0x7fcc800b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc7f7fe700 1 -- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc8015acf0 msgr2=0x7fcc801511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc7f7fe700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc8015acf0 0x7fcc801511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc7f7fe700 1 -- 172.21.15.61:0/2570588578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78009ae0 con 0x7fcc800af710 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc84c14700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc8015acf0 0x7fcc801511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc7f7fe700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc800af710 0x7fcc800ad990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800c560 tx=0x7fcc68007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc77fff700 1 -- 172.21.15.61:0/2570588578 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68011590 con 0x7fcc800af710 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc77fff700 1 -- 172.21.15.61:0/2570588578 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc68011710 con 0x7fcc800af710 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc86677700 1 -- 172.21.15.61:0/2570588578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc70009420 con 0x7fcc800af710 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc77fff700 1 -- 172.21.15.61:0/2570588578 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68011ad0 con 0x7fcc800af710 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.436+0000 7fcc86677700 1 -- 172.21.15.61:0/2570588578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc800b1260 con 0x7fcc800af710 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.437+0000 7fcc86677700 1 -- 172.21.15.61:0/2570588578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc800b1a60 con 0x7fcc800af710 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.438+0000 7fcc77fff700 1 -- 172.21.15.61:0/2570588578 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcc6801b3b0 con 0x7fcc800af710 2023-12-24T19:58:18.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.438+0000 7fcc77fff700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc60066f30 0x7fcc600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.438+0000 7fcc77fff700 1 -- 172.21.15.61:0/2570588578 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc68083a10 con 0x7fcc800af710 2023-12-24T19:58:18.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.439+0000 7fcc7ffff700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc60066f30 0x7fcc600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.440+0000 7fcc7ffff700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc60066f30 0x7fcc600693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc700091e0 tx=0x7fcc70017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:18.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.442+0000 7fcc77fff700 1 -- 172.21.15.61:0/2570588578 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc800b1a60 con 0x7fcc800af710 2023-12-24T19:58:18.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.639+0000 7fcc86677700 1 -- 172.21.15.61:0/2570588578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc800b1a20 con 0x7fcc800af710 2023-12-24T19:58:18.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.640+0000 7fcc77fff700 1 -- 172.21.15.61:0/2570588578 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fcc68017070 con 0x7fcc800af710 2023-12-24T19:58:18.640 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:18.640 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":33,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:58:11.766399+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:57:56.143696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-24T19:57:57.136484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 -- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc60066f30 msgr2=0x7fcc600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc60066f30 0x7fcc600693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcc700091e0 tx=0x7fcc70017000 comp rx=0 tx=0).stop 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 -- 172.21.15.61:0/2570588578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc800af710 msgr2=0x7fcc800ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc800af710 0x7fcc800ad990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800c560 tx=0x7fcc68007f50 comp rx=0 tx=0).stop 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 -- 172.21.15.61:0/2570588578 shutdown_connections 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc80068c80 0x7fcc800b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc60066f30 0x7fcc600693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc8015acf0 0x7fcc801511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 --2- 172.21.15.61:0/2570588578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc800af710 0x7fcc800ad990 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 -- 172.21.15.61:0/2570588578 >> 172.21.15.61:0/2570588578 conn(0x7fcc800ca200 msgr2=0x7fcc8006e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 -- 172.21.15.61:0/2570588578 shutdown_connections 2023-12-24T19:58:18.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.642+0000 7fcc86677700 1 -- 172.21.15.61:0/2570588578 wait complete. 2023-12-24T19:58:18.654 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T19:58:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.778+0000 7f4b4d171700 1 Processor -- start 2023-12-24T19:58:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.778+0000 7f4b4d171700 1 -- start start 2023-12-24T19:58:18.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.778+0000 7f4b4d171700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b48159c40 0x7f4b48070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.778+0000 7f4b4d171700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b480c41e0 0x7f4b480c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4d171700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b48068d10 con 0x7f4b48070db0 2023-12-24T19:58:18.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4d171700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b48067f10 con 0x7f4b480c41e0 2023-12-24T19:58:18.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4d171700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b48068100 con 0x7f4b48159c40 2023-12-24T19:58:18.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b480c41e0 0x7f4b480c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b46d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b48159c40 0x7f4b48070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b480c41e0 0x7f4b480c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:52714/0 (socket says 172.21.15.61:52714) 2023-12-24T19:58:18.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b46d9d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b48159c40 0x7f4b48070870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:52182/0 (socket says 172.21.15.61:52182) 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4759e700 1 -- 172.21.15.61:0/1357801930 learned_addr learned my addr 172.21.15.61:0/1357801930 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4b48070db0 0x7f4b480c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:60118/0 (socket says 172.21.15.61:60118) 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4759e700 1 -- 172.21.15.61:0/1357801930 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b48159c40 msgr2=0x7f4b48070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4759e700 1 --2- 172.21.15.61:0/1357801930 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b48159c40 0x7f4b48070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4759e700 1 -- 172.21.15.61:0/1357801930 >> v1:172.21.15.133:6789/0 conn(0x7f4b48070db0 legacy=0x7f4b480c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b45d9b700 1 -- 172.21.15.61:0/1357801930 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987552861 0 0) 0x7f4b48068d10 con 0x7f4b48070db0 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.779+0000 7f4b4759e700 1 -- 172.21.15.61:0/1357801930 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480683e0 con 0x7f4b480c41e0 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b4759e700 1 --2- 172.21.15.61:0/1357801930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b480c41e0 0x7f4b480c7e40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009f20 tx=0x7f4b40009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36672042ff525778 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b45d9b700 1 -- 172.21.15.61:0/1357801930 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4000e070 con 0x7f4b480c41e0 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b45d9b700 1 -- 172.21.15.61:0/1357801930 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4000b9d0 con 0x7f4b480c41e0 2023-12-24T19:58:18.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b45d9b700 1 -- 172.21.15.61:0/1357801930 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b400092e0 con 0x7f4b480c41e0 2023-12-24T19:58:18.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b4d171700 1 -- 172.21.15.61:0/1357801930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b480c41e0 msgr2=0x7f4b480c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b4d171700 1 --2- 172.21.15.61:0/1357801930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b480c41e0 0x7f4b480c7e40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009f20 tx=0x7f4b40009840 comp rx=0 tx=0).stop 2023-12-24T19:58:18.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b4d171700 1 -- 172.21.15.61:0/1357801930 shutdown_connections 2023-12-24T19:58:18.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b4d171700 1 --2- 172.21.15.61:0/1357801930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b480c41e0 0x7f4b480c7e40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b4d171700 1 --2- 172.21.15.61:0/1357801930 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b48159c40 0x7f4b48070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b4d171700 1 -- 172.21.15.61:0/1357801930 >> 172.21.15.61:0/1357801930 conn(0x7f4b480ce190 msgr2=0x7f4b480ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:18.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b4d171700 1 -- 172.21.15.61:0/1357801930 shutdown_connections 2023-12-24T19:58:18.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.780+0000 7f4b4d171700 1 -- 172.21.15.61:0/1357801930 wait complete. 2023-12-24T19:58:18.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.782+0000 7f4b4d171700 1 Processor -- start 2023-12-24T19:58:18.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.782+0000 7f4b4d171700 1 -- start start 2023-12-24T19:58:18.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4d171700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b48070db0 0x7f4b4815c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4d171700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b480c41e0 0x7f4b48156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4d171700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b48159c40 0x7f4b480c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4d171700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4815c6c0 con 0x7f4b48159c40 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4d171700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b48156cc0 con 0x7f4b48070db0 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4d171700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4815ea30 con 0x7f4b480c41e0 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4759e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b48159c40 0x7f4b480c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4759e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b48159c40 0x7f4b480c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34600/0 (socket says 172.21.15.61:34600) 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4759e700 1 -- 172.21.15.61:0/2659947838 learned_addr learned my addr 172.21.15.61:0/2659947838 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b46d9d700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b48070db0 0x7f4b4815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4659c700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b480c41e0 0x7f4b48156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4759e700 1 -- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b480c41e0 msgr2=0x7f4b48156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4759e700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b480c41e0 0x7f4b48156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4759e700 1 -- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b48070db0 msgr2=0x7f4b4815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:18.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4759e700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b48070db0 0x7f4b4815c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:18.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b4759e700 1 -- 172.21.15.61:0/2659947838 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40009ae0 con 0x7f4b48159c40 2023-12-24T19:58:18.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.783+0000 7f4b46d9d700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b48070db0 0x7f4b4815c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:18.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.784+0000 7f4b4759e700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b48159c40 0x7f4b480c6860 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4b4806c9c0 tx=0x7f4b40018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:18.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.786+0000 7f4b2effd700 1 -- 172.21.15.61:0/2659947838 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40008c10 con 0x7f4b48159c40 2023-12-24T19:58:18.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.786+0000 7f4b4d171700 1 -- 172.21.15.61:0/2659947838 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4815eec0 con 0x7f4b48159c40 2023-12-24T19:58:18.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.786+0000 7f4b4d171700 1 -- 172.21.15.61:0/2659947838 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4815e100 con 0x7f4b48159c40 2023-12-24T19:58:18.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.786+0000 7f4b2effd700 1 -- 172.21.15.61:0/2659947838 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40026460 con 0x7f4b48159c40 2023-12-24T19:58:18.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.786+0000 7f4b2effd700 1 -- 172.21.15.61:0/2659947838 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b400265d0 con 0x7f4b48159c40 2023-12-24T19:58:18.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.787+0000 7f4b4d171700 1 -- 172.21.15.61:0/2659947838 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b280052a0 con 0x7f4b48159c40 2023-12-24T19:58:18.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.788+0000 7f4b2effd700 1 -- 172.21.15.61:0/2659947838 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4b40003040 con 0x7f4b48159c40 2023-12-24T19:58:18.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.788+0000 7f4b2effd700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b34066f30 0x7f4b340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:18.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.788+0000 7f4b2effd700 1 -- 172.21.15.61:0/2659947838 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b40086370 con 0x7f4b48159c40 2023-12-24T19:58:18.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.788+0000 7f4b46d9d700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b34066f30 0x7f4b340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:18.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.789+0000 7f4b46d9d700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b34066f30 0x7f4b340693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009d80 tx=0x7f4b38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:18.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:18.792+0000 7f4b2effd700 1 -- 172.21.15.61:0/2659947838 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b400535e0 con 0x7f4b48159c40 2023-12-24T19:58:19.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.034+0000 7f4b4d171700 1 -- 172.21.15.61:0/2659947838 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4b28005820 con 0x7f4b48159c40 2023-12-24T19:58:19.035 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T19:58:19.034+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T19:58:19.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.041+0000 7f4b2effd700 1 -- 172.21.15.61:0/2659947838 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b40056c00 con 0x7f4b48159c40 2023-12-24T19:58:19.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 -- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b34066f30 msgr2=0x7f4b340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:19.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b34066f30 0x7f4b340693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009d80 tx=0x7f4b38008040 comp rx=0 tx=0).stop 2023-12-24T19:58:19.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 -- 172.21.15.61:0/2659947838 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b48159c40 msgr2=0x7f4b480c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:19.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b48159c40 0x7f4b480c6860 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4b4806c9c0 tx=0x7f4b40018000 comp rx=0 tx=0).stop 2023-12-24T19:58:19.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 -- 172.21.15.61:0/2659947838 shutdown_connections 2023-12-24T19:58:19.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b34066f30 0x7f4b340693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:19.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b48159c40 0x7f4b480c6860 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:19.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b48070db0 0x7f4b4815c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:19.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 --2- 172.21.15.61:0/2659947838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b480c41e0 0x7f4b48156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:19.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 -- 172.21.15.61:0/2659947838 >> 172.21.15.61:0/2659947838 conn(0x7f4b480ce190 msgr2=0x7f4b480b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:19.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 -- 172.21.15.61:0/2659947838 shutdown_connections 2023-12-24T19:58:19.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.043+0000 7f4b4d171700 1 -- 172.21.15.61:0/2659947838 wait complete. 2023-12-24T19:58:19.045 INFO:tasks.ceph.mds.c.smithi061.stderr: -3070> 2023-12-24T19:58:02.738+0000 7f8e84710700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T19:58:19.045 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T19:58:19.056 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T19:58:19.069 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T19:58:19.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.179+0000 7f20f5498700 1 Processor -- start 2023-12-24T19:58:19.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.180+0000 7f20f5498700 1 -- start start 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.180+0000 7f20f5498700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20f015e590 0x7f20f01597e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.180+0000 7f20f5498700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f20f0069170 0x7f20f0159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.180+0000 7f20f5498700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f015a260 con 0x7f20f0068da0 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.180+0000 7f20f5498700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f00ce660 con 0x7f20f0069170 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.180+0000 7f20f5498700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00ce380 con 0x7f20f015e590 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20eeffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f20f0068da0 0x7f20f00cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40642/0 (socket says 172.21.15.61:40642) 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20eeffd700 1 -- 172.21.15.61:0/2819847799 learned_addr learned my addr 172.21.15.61:0/2819847799 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20ef7fe700 1 --2- 172.21.15.61:0/2819847799 >> v2:172.21.15.61:3300/0 conn(0x7f20f0069170 0x7f20f0159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20ee7fc700 1 --2- 172.21.15.61:0/2819847799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20f015e590 0x7f20f01597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20edffb700 1 -- 172.21.15.61:0/2819847799 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049909825 0 0) 0x7f20f015a260 con 0x7f20f0068da0 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20edffb700 1 -- 172.21.15.61:0/2819847799 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d8003570 con 0x7f20f0068da0 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20ef7fe700 1 -- 172.21.15.61:0/2819847799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20f015e590 msgr2=0x7f20f01597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:19.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20ef7fe700 1 --2- 172.21.15.61:0/2819847799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20f015e590 0x7f20f01597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20ef7fe700 1 -- 172.21.15.61:0/2819847799 >> v1:172.21.15.61:6789/0 conn(0x7f20f0068da0 legacy=0x7f20f00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20ef7fe700 1 -- 172.21.15.61:0/2819847799 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f015dab0 con 0x7f20f0069170 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20ef7fe700 1 --2- 172.21.15.61:0/2819847799 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f0069170 0x7f20f0159d20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009e60 tx=0x7f20e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87ed848dd5afc9a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20edffb700 1 -- 172.21.15.61:0/2819847799 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e800e070 con 0x7f20f0069170 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20edffb700 1 -- 172.21.15.61:0/2819847799 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e800bab0 con 0x7f20f0069170 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.181+0000 7f20edffb700 1 -- 172.21.15.61:0/2819847799 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e800be70 con 0x7f20f0069170 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.182+0000 7f20f5498700 1 -- 172.21.15.61:0/2819847799 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f0069170 msgr2=0x7f20f0159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.182+0000 7f20f5498700 1 --2- 172.21.15.61:0/2819847799 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f0069170 0x7f20f0159d20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009e60 tx=0x7f20e8009780 comp rx=0 tx=0).stop 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.182+0000 7f20f5498700 1 -- 172.21.15.61:0/2819847799 shutdown_connections 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.182+0000 7f20f5498700 1 --2- 172.21.15.61:0/2819847799 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f0069170 0x7f20f0159d20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.182+0000 7f20f5498700 1 --2- 172.21.15.61:0/2819847799 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20f015e590 0x7f20f01597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.182+0000 7f20f5498700 1 -- 172.21.15.61:0/2819847799 >> 172.21.15.61:0/2819847799 conn(0x7f20f006b730 msgr2=0x7f20f00ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.182+0000 7f20f5498700 1 -- 172.21.15.61:0/2819847799 shutdown_connections 2023-12-24T19:58:19.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.182+0000 7f20f5498700 1 -- 172.21.15.61:0/2819847799 wait complete. 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.184+0000 7f20f5498700 1 Processor -- start 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.184+0000 7f20f5498700 1 -- start start 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20f5498700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20f0068da0 0x7f20f01513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20f5498700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20f0069170 0x7f20f00b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20f5498700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f015e590 0x7f20f00b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20f5498700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00b4420 con 0x7f20f015e590 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20f5498700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00c8f50 con 0x7f20f0068da0 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20f5498700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f00b3440 con 0x7f20f0069170 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20ef7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f015e590 0x7f20f00b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20ef7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f015e590 0x7f20f00b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34634/0 (socket says 172.21.15.61:34634) 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20ef7fe700 1 -- 172.21.15.61:0/3563765692 learned_addr learned my addr 172.21.15.61:0/3563765692 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:19.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20eeffd700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20f0068da0 0x7f20f01513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20ee7fc700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20f0069170 0x7f20f00b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20ef7fe700 1 -- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20f0069170 msgr2=0x7f20f00b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20ef7fe700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20f0069170 0x7f20f00b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20ef7fe700 1 -- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20f0068da0 msgr2=0x7f20f01513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20ef7fe700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20f0068da0 0x7f20f01513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20ef7fe700 1 -- 172.21.15.61:0/3563765692 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8009a20 con 0x7f20f015e590 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20ef7fe700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f015e590 0x7f20f00b1b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f20f0071e20 tx=0x7f20e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20d6ffd700 1 -- 172.21.15.61:0/3563765692 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e8027470 con 0x7f20f015e590 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20d6ffd700 1 -- 172.21.15.61:0/3563765692 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e80275f0 con 0x7f20f015e590 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20f5498700 1 -- 172.21.15.61:0/3563765692 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f00b3720 con 0x7f20f015e590 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20d6ffd700 1 -- 172.21.15.61:0/3563765692 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e80279b0 con 0x7f20f015e590 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.185+0000 7f20f5498700 1 -- 172.21.15.61:0/3563765692 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f0152420 con 0x7f20f015e590 2023-12-24T19:58:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.186+0000 7f20f5498700 1 -- 172.21.15.61:0/3563765692 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f004c3c0 con 0x7f20f015e590 2023-12-24T19:58:19.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.187+0000 7f20d6ffd700 1 -- 172.21.15.61:0/3563765692 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f20e8024070 con 0x7f20f015e590 2023-12-24T19:58:19.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.187+0000 7f20d6ffd700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f20dc066f30 0x7f20dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:19.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.187+0000 7f20d6ffd700 1 -- 172.21.15.61:0/3563765692 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f20e8086f40 con 0x7f20f015e590 2023-12-24T19:58:19.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.187+0000 7f20eeffd700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f20dc066f30 0x7f20dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:19.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.188+0000 7f20eeffd700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f20dc066f30 0x7f20dc0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f20e00058d0 tx=0x7f20e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:19.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.192+0000 7f20d6ffd700 1 -- 172.21.15.61:0/3563765692 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20e8054160 con 0x7f20f015e590 2023-12-24T19:58:19.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:19.431+0000 7f20f5498700 1 -- 172.21.15.61:0/3563765692 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f20f00cc060 con 0x7f20f015e590 2023-12-24T19:58:20.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.041+0000 7f20d6ffd700 1 -- 172.21.15.61:0/3563765692 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f20e8057780 con 0x7f20f015e590 2023-12-24T19:58:20.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.044+0000 7f20f5498700 1 -- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f20dc066f30 msgr2=0x7f20dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:20.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.044+0000 7f20f5498700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f20dc066f30 0x7f20dc0693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f20e00058d0 tx=0x7f20e0009040 comp rx=0 tx=0).stop 2023-12-24T19:58:20.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.044+0000 7f20f5498700 1 -- 172.21.15.61:0/3563765692 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f015e590 msgr2=0x7f20f00b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:20.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.044+0000 7f20f5498700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f015e590 0x7f20f00b1b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f20f0071e20 tx=0x7f20e8019000 comp rx=0 tx=0).stop 2023-12-24T19:58:20.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.044+0000 7f20f5498700 1 -- 172.21.15.61:0/3563765692 shutdown_connections 2023-12-24T19:58:20.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.044+0000 7f20f5498700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f20dc066f30 0x7f20dc0693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.044+0000 7f20f5498700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f20f015e590 0x7f20f00b1b00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.044+0000 7f20f5498700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20f0068da0 0x7f20f01513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.044+0000 7f20f5498700 1 --2- 172.21.15.61:0/3563765692 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f20f0069170 0x7f20f00b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.044+0000 7f20f5498700 1 -- 172.21.15.61:0/3563765692 >> 172.21.15.61:0/3563765692 conn(0x7f20f006b730 msgr2=0x7f20f0152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:20.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.045+0000 7f20f5498700 1 -- 172.21.15.61:0/3563765692 shutdown_connections 2023-12-24T19:58:20.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.045+0000 7f20f5498700 1 -- 172.21.15.61:0/3563765692 wait complete. 2023-12-24T19:58:20.060 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T19:58:20.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.236+0000 7f9efe5a2700 1 Processor -- start 2023-12-24T19:58:20.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.236+0000 7f9efe5a2700 1 -- start start 2023-12-24T19:58:20.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.237+0000 7f9efe5a2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8157730 0x7f9ef80aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:20.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.237+0000 7f9efe5a2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ef8157b00 0x7f9ef80ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:20.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.237+0000 7f9efe5a2700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef80adb50 con 0x7f9ef8063ac0 2023-12-24T19:58:20.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.237+0000 7f9efe5a2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80adda0 con 0x7f9ef8157b00 2023-12-24T19:58:20.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.237+0000 7f9efe5a2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80ae080 con 0x7f9ef8157730 2023-12-24T19:58:20.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.237+0000 7f9efcb3f700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9ef8063ac0 0x7f9ef80b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40656/0 (socket says 172.21.15.61:40656) 2023-12-24T19:58:20.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.237+0000 7f9efcb3f700 1 -- 172.21.15.61:0/268167324 learned_addr learned my addr 172.21.15.61:0/268167324 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.237+0000 7f9ef7fff700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8157730 0x7f9ef80aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.237+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651552750 0 0) 0x7f9ef80adb50 con 0x7f9ef8063ac0 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.237+0000 7f9ef77fe700 1 --2- 172.21.15.61:0/268167324 >> v2:172.21.15.133:3300/0 conn(0x7f9ef8157b00 0x7f9ef80ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee4003570 con 0x7f9ef8063ac0 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 984106832 0 0) 0x7f9ee4003570 con 0x7f9ef8063ac0 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8157730 msgr2=0x7f9ef80aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8157730 0x7f9ef80aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 >> v2:172.21.15.133:3300/0 conn(0x7f9ef8157b00 msgr2=0x7f9ef80ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 --2- 172.21.15.61:0/268167324 >> v2:172.21.15.133:3300/0 conn(0x7f9ef8157b00 0x7f9ef80ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80ae360 con 0x7f9ef8063ac0 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f9ef00017f0 con 0x7f9ef8063ac0 2023-12-24T19:58:20.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 >> v1:172.21.15.61:6789/0 conn(0x7f9ef8063ac0 legacy=0x7f9ef80b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 0x7f9ee4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8157730 0x7f9ee4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee4004d50 0x7f9ee40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80adda0 con 0x7f9ee4003a60 2023-12-24T19:58:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80ae080 con 0x7f9ee4004d50 2023-12-24T19:58:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee400ba60 con 0x7f9ef8157730 2023-12-24T19:58:20.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef7fff700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 0x7f9ee4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef77fe700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8157730 0x7f9ee4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9efcb3f700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee4004d50 0x7f9ee40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef7fff700 1 -- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8157730 msgr2=0x7f9ee4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef7fff700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8157730 0x7f9ee4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef7fff700 1 -- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee4004d50 msgr2=0x7f9ee40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef7fff700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee4004d50 0x7f9ee40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef7fff700 1 -- 172.21.15.61:0/268167324 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee4003570 con 0x7f9ee4003a60 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef77fe700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8157730 0x7f9ee4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.238+0000 7f9ef7fff700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 0x7f9ee4003e70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009c00 tx=0x7f9ee00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415902dbf0326f93 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.239+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000e6b0 con 0x7f9ee4003a60 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.239+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee000e810 con 0x7f9ee4003a60 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.239+0000 7f9ef6ffd700 1 -- 172.21.15.61:0/268167324 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000ebd0 con 0x7f9ee4003a60 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.239+0000 7f9efe5a2700 1 -- 172.21.15.61:0/268167324 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 msgr2=0x7f9ee4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:20.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.239+0000 7f9efe5a2700 1 --2- 172.21.15.61:0/268167324 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 0x7f9ee4003e70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009c00 tx=0x7f9ee00091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.239+0000 7f9efcb3f700 1 -- 172.21.15.61:0/268167324 reap_dead start 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.239+0000 7f9efe5a2700 1 -- 172.21.15.61:0/268167324 shutdown_connections 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.239+0000 7f9efe5a2700 1 -- 172.21.15.61:0/268167324 >> 172.21.15.61:0/268167324 conn(0x7f9ef8067fd0 msgr2=0x7f9ef80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.239+0000 7f9efe5a2700 1 -- 172.21.15.61:0/268167324 shutdown_connections 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.239+0000 7f9efe5a2700 1 -- 172.21.15.61:0/268167324 wait complete. 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.240+0000 7f9efe5a2700 1 Processor -- start 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9efe5a2700 1 -- start start 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9efe5a2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 0x7f9ef80b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9efe5a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef8169ee0 0x7f9ef8140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9efe5a2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8150250 0x7f9ef815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9efe5a2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef816a350 con 0x7f9ee4003a60 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9efe5a2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef814de10 con 0x7f9ef8169ee0 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9efe5a2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8140e50 con 0x7f9ef8150250 2023-12-24T19:58:20.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 0x7f9ef80b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9ef7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 0x7f9ef80b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34650/0 (socket says 172.21.15.61:34650) 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9ef7fff700 1 -- 172.21.15.61:0/3596445322 learned_addr learned my addr 172.21.15.61:0/3596445322 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.241+0000 7f9ef77fe700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef8169ee0 0x7f9ef8140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9efcb3f700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8150250 0x7f9ef815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9ef7fff700 1 -- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8150250 msgr2=0x7f9ef815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9ef7fff700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8150250 0x7f9ef815c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9ef7fff700 1 -- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef8169ee0 msgr2=0x7f9ef8140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9ef7fff700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef8169ee0 0x7f9ef8140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9ef7fff700 1 -- 172.21.15.61:0/3596445322 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef816a570 con 0x7f9ee4003a60 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9efcb3f700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8150250 0x7f9ef815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9ef77fe700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef8169ee0 0x7f9ef8140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9ef7fff700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 0x7f9ef80b0330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000e4b0 tx=0x7f9ee001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9eeffff700 1 -- 172.21.15.61:0/3596445322 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0022070 con 0x7f9ee4003a60 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9eeffff700 1 -- 172.21.15.61:0/3596445322 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee000e980 con 0x7f9ee4003a60 2023-12-24T19:58:20.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9efe5a2700 1 -- 172.21.15.61:0/3596445322 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef816a850 con 0x7f9ee4003a60 2023-12-24T19:58:20.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9eeffff700 1 -- 172.21.15.61:0/3596445322 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0027470 con 0x7f9ee4003a60 2023-12-24T19:58:20.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.242+0000 7f9efe5a2700 1 -- 172.21.15.61:0/3596445322 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef816ae10 con 0x7f9ee4003a60 2023-12-24T19:58:20.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.243+0000 7f9efe5a2700 1 -- 172.21.15.61:0/3596445322 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef814e0f0 con 0x7f9ee4003a60 2023-12-24T19:58:20.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.244+0000 7f9eeffff700 1 -- 172.21.15.61:0/3596445322 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9ee001c450 con 0x7f9ee4003a60 2023-12-24T19:58:20.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.244+0000 7f9eeffff700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ed8066f30 0x7f9ed80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:20.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.244+0000 7f9eeffff700 1 -- 172.21.15.61:0/3596445322 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f9ee00862e0 con 0x7f9ee4003a60 2023-12-24T19:58:20.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.244+0000 7f9ef77fe700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ed8066f30 0x7f9ed80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:20.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.245+0000 7f9ef77fe700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ed8066f30 0x7f9ed80693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8006dc0 tx=0x7f9ee8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:20.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.248+0000 7f9eeffff700 1 -- 172.21.15.61:0/3596445322 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ee0053500 con 0x7f9ee4003a60 2023-12-24T19:58:20.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:20.445+0000 7f9efe5a2700 1 -- 172.21.15.61:0/3596445322 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ef816a2f0 con 0x7f9ee4003a60 2023-12-24T19:58:21.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.045+0000 7f9eeffff700 1 -- 172.21.15.61:0/3596445322 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9ee0056b20 con 0x7f9ee4003a60 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 -- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ed8066f30 msgr2=0x7f9ed80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ed8066f30 0x7f9ed80693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8006dc0 tx=0x7f9ee8008040 comp rx=0 tx=0).stop 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 -- 172.21.15.61:0/3596445322 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 msgr2=0x7f9ef80b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 0x7f9ef80b0330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000e4b0 tx=0x7f9ee001a000 comp rx=0 tx=0).stop 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 -- 172.21.15.61:0/3596445322 shutdown_connections 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ef8150250 0x7f9ef815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ed8066f30 0x7f9ed80693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ee4003a60 0x7f9ef80b0330 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 --2- 172.21.15.61:0/3596445322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef8169ee0 0x7f9ef8140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 -- 172.21.15.61:0/3596445322 >> 172.21.15.61:0/3596445322 conn(0x7f9ef8067fd0 msgr2=0x7f9ef814f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:21.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 -- 172.21.15.61:0/3596445322 shutdown_connections 2023-12-24T19:58:21.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.048+0000 7f9efe5a2700 1 -- 172.21.15.61:0/3596445322 wait complete. 2023-12-24T19:58:21.050 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T19:58:21.063 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T19:58:21.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.192+0000 7faab2fc0700 1 Processor -- start 2023-12-24T19:58:21.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.192+0000 7faab2fc0700 1 -- start start 2023-12-24T19:58:21.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faab2fc0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac157730 0x7faaac0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:21.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faab2fc0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac0adb50 con 0x7faaac157b00 2023-12-24T19:58:21.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faab2fc0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac0adda0 con 0x7faaac063ac0 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faab2fc0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0ae080 con 0x7faaac157730 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faaabfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7faaac157b00 0x7faaac0ad0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40662/0 (socket says 172.21.15.61:40662) 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faaabfff700 1 -- 172.21.15.61:0/3985636626 learned_addr learned my addr 172.21.15.61:0/3985636626 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faab0d5c700 1 --2- 172.21.15.61:0/3985636626 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac157730 0x7faaac0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faaab7fe700 1 -- 172.21.15.61:0/3985636626 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387105634 0 0) 0x7faaac0adb50 con 0x7faaac157b00 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faaab7fe700 1 -- 172.21.15.61:0/3985636626 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa9c003570 con 0x7faaac157b00 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faaab7fe700 1 -- 172.21.15.61:0/3985636626 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205677816 0 0) 0x7faaac0adda0 con 0x7faaac063ac0 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.193+0000 7faaab7fe700 1 -- 172.21.15.61:0/3985636626 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaac0adb50 con 0x7faaac063ac0 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.194+0000 7faab0d5c700 1 -- 172.21.15.61:0/3985636626 >> v1:172.21.15.133:6789/0 conn(0x7faaac063ac0 legacy=0x7faaac0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.194+0000 7faab0d5c700 1 -- 172.21.15.61:0/3985636626 >> v1:172.21.15.61:6789/0 conn(0x7faaac157b00 legacy=0x7faaac0ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.194+0000 7faab0d5c700 1 -- 172.21.15.61:0/3985636626 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0ae360 con 0x7faaac157730 2023-12-24T19:58:21.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.194+0000 7faab0d5c700 1 --2- 172.21.15.61:0/3985636626 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac157730 0x7faaac0aeb60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009910 tx=0x7faaa00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a224f0a9c5d70101 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:21.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.194+0000 7faaab7fe700 1 -- 172.21.15.61:0/3985636626 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0011630 con 0x7faaac157730 2023-12-24T19:58:21.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.194+0000 7faaab7fe700 1 -- 172.21.15.61:0/3985636626 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa0011790 con 0x7faaac157730 2023-12-24T19:58:21.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.194+0000 7faaab7fe700 1 -- 172.21.15.61:0/3985636626 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0011b30 con 0x7faaac157730 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.195+0000 7faab2fc0700 1 -- 172.21.15.61:0/3985636626 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac157730 msgr2=0x7faaac0aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.195+0000 7faab2fc0700 1 --2- 172.21.15.61:0/3985636626 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac157730 0x7faaac0aeb60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009910 tx=0x7faaa00091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.195+0000 7faab2fc0700 1 -- 172.21.15.61:0/3985636626 shutdown_connections 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.195+0000 7faab2fc0700 1 --2- 172.21.15.61:0/3985636626 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac157730 0x7faaac0aeb60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.195+0000 7faab2fc0700 1 -- 172.21.15.61:0/3985636626 >> 172.21.15.61:0/3985636626 conn(0x7faaac067fd0 msgr2=0x7faaac0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.195+0000 7faab2fc0700 1 -- 172.21.15.61:0/3985636626 shutdown_connections 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.195+0000 7faab2fc0700 1 -- 172.21.15.61:0/3985636626 wait complete. 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.196+0000 7faab2fc0700 1 Processor -- start 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.196+0000 7faab2fc0700 1 -- start start 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faab2fc0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac063ac0 0x7faaac14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faab2fc0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaac157730 0x7faaac151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faab2fc0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaac157b00 0x7faaac0699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faab2fc0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac1526f0 con 0x7faaac157730 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faab2fc0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac1543c0 con 0x7faaac157b00 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faab2fc0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac154090 con 0x7faaac063ac0 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faaabfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaac157730 0x7faaac151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faaabfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaac157730 0x7faaac151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34662/0 (socket says 172.21.15.61:34662) 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faab0d5c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac063ac0 0x7faaac14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faaabfff700 1 -- 172.21.15.61:0/2511637305 learned_addr learned my addr 172.21.15.61:0/2511637305 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faab155d700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaac157b00 0x7faaac0699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faaabfff700 1 -- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac063ac0 msgr2=0x7faaac14c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faaabfff700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac063ac0 0x7faaac14c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faaabfff700 1 -- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaac157b00 msgr2=0x7faaac0699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faaabfff700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaac157b00 0x7faaac0699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:21.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.197+0000 7faaabfff700 1 -- 172.21.15.61:0/2511637305 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0009420 con 0x7faaac157730 2023-12-24T19:58:21.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.198+0000 7faaabfff700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaac157730 0x7faaac151350 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faa9800c790 tx=0x7faa98007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:21.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.198+0000 7faaa8ff9700 1 -- 172.21.15.61:0/2511637305 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98005b30 con 0x7faaac157730 2023-12-24T19:58:21.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.198+0000 7faaa8ff9700 1 -- 172.21.15.61:0/2511637305 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa98005cd0 con 0x7faaac157730 2023-12-24T19:58:21.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.198+0000 7faab2fc0700 1 -- 172.21.15.61:0/2511637305 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac151e50 con 0x7faaac157730 2023-12-24T19:58:21.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.198+0000 7faaa8ff9700 1 -- 172.21.15.61:0/2511637305 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98007320 con 0x7faaac157730 2023-12-24T19:58:21.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.198+0000 7faab2fc0700 1 -- 172.21.15.61:0/2511637305 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac152410 con 0x7faaac157730 2023-12-24T19:58:21.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.199+0000 7faab2fc0700 1 -- 172.21.15.61:0/2511637305 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac154550 con 0x7faaac157730 2023-12-24T19:58:21.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.199+0000 7faaa8ff9700 1 -- 172.21.15.61:0/2511637305 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7faa98012400 con 0x7faaac157730 2023-12-24T19:58:21.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.200+0000 7faaa8ff9700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa90066f30 0x7faa900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:21.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.200+0000 7faaa8ff9700 1 -- 172.21.15.61:0/2511637305 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5353+0+0 (secure 0 0 0) 0x7faa98083810 con 0x7faaac157730 2023-12-24T19:58:21.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.200+0000 7faab0d5c700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa90066f30 0x7faa900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:21.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.201+0000 7faab0d5c700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa90066f30 0x7faa900693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009860 tx=0x7faaa0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:21.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.204+0000 7faaa8ff9700 1 -- 172.21.15.61:0/2511637305 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa98050c90 con 0x7faaac157730 2023-12-24T19:58:21.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:21.399+0000 7faab2fc0700 1 -- 172.21.15.61:0/2511637305 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faaac04c3c0 con 0x7faaac157730 2023-12-24T19:58:22.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.050+0000 7faaa8ff9700 1 -- 172.21.15.61:0/2511637305 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7faa98017020 con 0x7faaac157730 2023-12-24T19:58:22.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 -- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa90066f30 msgr2=0x7faa900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa90066f30 0x7faa900693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009860 tx=0x7faaa0017000 comp rx=0 tx=0).stop 2023-12-24T19:58:22.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 -- 172.21.15.61:0/2511637305 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaac157730 msgr2=0x7faaac151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaac157730 0x7faaac151350 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faa9800c790 tx=0x7faa98007e80 comp rx=0 tx=0).stop 2023-12-24T19:58:22.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 -- 172.21.15.61:0/2511637305 shutdown_connections 2023-12-24T19:58:22.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaac063ac0 0x7faaac14c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa90066f30 0x7faa900693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaac157b00 0x7faaac0699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 --2- 172.21.15.61:0/2511637305 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaac157730 0x7faaac151350 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 -- 172.21.15.61:0/2511637305 >> 172.21.15.61:0/2511637305 conn(0x7faaac067fd0 msgr2=0x7faaac14f820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:22.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 -- 172.21.15.61:0/2511637305 shutdown_connections 2023-12-24T19:58:22.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.054+0000 7faab2fc0700 1 -- 172.21.15.61:0/2511637305 wait complete. 2023-12-24T19:58:22.055 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T19:58:22.068 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T19:58:22.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.193+0000 7f0fe5485700 1 Processor -- start 2023-12-24T19:58:22.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.193+0000 7f0fe5485700 1 -- start start 2023-12-24T19:58:22.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.194+0000 7f0fe5485700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0fe0159df0 0x7f0fe00cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.194+0000 7f0fe5485700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0fe015a1c0 0x7f0fe00cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.194+0000 7f0fe5485700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe00cf150 con 0x7f0fe00cc0e0 2023-12-24T19:58:22.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.194+0000 7f0fe5485700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe00d05f0 con 0x7f0fe015a1c0 2023-12-24T19:58:22.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.194+0000 7f0fe5485700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe00cc5f0 con 0x7f0fe0159df0 2023-12-24T19:58:22.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.194+0000 7f0fde7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0fe015a1c0 0x7f0fe00cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.194+0000 7f0fde7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0fe015a1c0 0x7f0fe00cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34670/0 (socket says 172.21.15.61:34670) 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.194+0000 7f0fde7fc700 1 -- 172.21.15.61:0/2579484303 learned_addr learned my addr 172.21.15.61:0/2579484303 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.195+0000 7f0fdeffd700 1 --2- 172.21.15.61:0/2579484303 >> v2:172.21.15.133:3300/0 conn(0x7f0fe0159df0 0x7f0fe00cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.195+0000 7f0fde7fc700 1 -- 172.21.15.61:0/2579484303 >> v2:172.21.15.133:3300/0 conn(0x7f0fe0159df0 msgr2=0x7f0fe00cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.195+0000 7f0fde7fc700 1 --2- 172.21.15.61:0/2579484303 >> v2:172.21.15.133:3300/0 conn(0x7f0fe0159df0 0x7f0fe00cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.195+0000 7f0fde7fc700 1 -- 172.21.15.61:0/2579484303 >> v1:172.21.15.133:6789/0 conn(0x7f0fe00cc0e0 legacy=0x7f0fe015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.195+0000 7f0fde7fc700 1 -- 172.21.15.61:0/2579484303 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00ce820 con 0x7f0fe015a1c0 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.195+0000 7f0fde7fc700 1 --2- 172.21.15.61:0/2579484303 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 0x7f0fe00cd470 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00646b0 tx=0x7f0fc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de52c0b49c8bc7dc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.195+0000 7f0fddffb700 1 -- 172.21.15.61:0/2579484303 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800b820 con 0x7f0fe015a1c0 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.195+0000 7f0fddffb700 1 -- 172.21.15.61:0/2579484303 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800b980 con 0x7f0fe015a1c0 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.195+0000 7f0fddffb700 1 -- 172.21.15.61:0/2579484303 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800bd20 con 0x7f0fe015a1c0 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.196+0000 7f0fe5485700 1 -- 172.21.15.61:0/2579484303 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 msgr2=0x7f0fe00cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.196+0000 7f0fe5485700 1 --2- 172.21.15.61:0/2579484303 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 0x7f0fe00cd470 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00646b0 tx=0x7f0fc8009250 comp rx=0 tx=0).stop 2023-12-24T19:58:22.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.196+0000 7f0fe5485700 1 -- 172.21.15.61:0/2579484303 shutdown_connections 2023-12-24T19:58:22.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.196+0000 7f0fe5485700 1 --2- 172.21.15.61:0/2579484303 >> v2:172.21.15.133:3300/0 conn(0x7f0fe0159df0 0x7f0fe00cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.196+0000 7f0fe5485700 1 --2- 172.21.15.61:0/2579484303 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 0x7f0fe00cd470 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.196+0000 7f0fe5485700 1 -- 172.21.15.61:0/2579484303 >> 172.21.15.61:0/2579484303 conn(0x7f0fe006e600 msgr2=0x7f0fe0067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:22.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.196+0000 7f0fe5485700 1 -- 172.21.15.61:0/2579484303 shutdown_connections 2023-12-24T19:58:22.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.196+0000 7f0fe5485700 1 -- 172.21.15.61:0/2579484303 wait complete. 2023-12-24T19:58:22.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.197+0000 7f0fe5485700 1 Processor -- start 2023-12-24T19:58:22.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.197+0000 7f0fe5485700 1 -- start start 2023-12-24T19:58:22.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fe5485700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fe00cc0e0 0x7f0fe016a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fe5485700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fe0159df0 0x7f0fe0154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fe5485700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 0x7f0fe00c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fe5485700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe016dec0 con 0x7f0fe015a1c0 2023-12-24T19:58:22.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fe5485700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe016ade0 con 0x7f0fe0159df0 2023-12-24T19:58:22.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fe5485700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe016b0c0 con 0x7f0fe00cc0e0 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fdf7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 0x7f0fe00c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fdf7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 0x7f0fe00c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34680/0 (socket says 172.21.15.61:34680) 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fdf7fe700 1 -- 172.21.15.61:0/1762017074 learned_addr learned my addr 172.21.15.61:0/1762017074 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fde7fc700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fe0159df0 0x7f0fe0154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fdeffd700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fe00cc0e0 0x7f0fe016a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fdf7fe700 1 -- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fe00cc0e0 msgr2=0x7f0fe016a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fdf7fe700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fe00cc0e0 0x7f0fe016a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fdf7fe700 1 -- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fe0159df0 msgr2=0x7f0fe0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fdf7fe700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fe0159df0 0x7f0fe0154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fdf7fe700 1 -- 172.21.15.61:0/1762017074 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc80094f0 con 0x7f0fe015a1c0 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.198+0000 7f0fdf7fe700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 0x7f0fe00c7d00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800c890 tx=0x7f0fd80026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.199+0000 7f0fd6ffd700 1 -- 172.21.15.61:0/1762017074 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8012630 con 0x7f0fe015a1c0 2023-12-24T19:58:22.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.199+0000 7f0fd6ffd700 1 -- 172.21.15.61:0/1762017074 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd80127b0 con 0x7f0fe015a1c0 2023-12-24T19:58:22.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.199+0000 7f0fe5485700 1 -- 172.21.15.61:0/1762017074 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe016b3a0 con 0x7f0fe015a1c0 2023-12-24T19:58:22.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.199+0000 7f0fd6ffd700 1 -- 172.21.15.61:0/1762017074 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8012b70 con 0x7f0fe015a1c0 2023-12-24T19:58:22.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.199+0000 7f0fe5485700 1 -- 172.21.15.61:0/1762017074 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe00b4c50 con 0x7f0fe015a1c0 2023-12-24T19:58:22.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.199+0000 7f0fe5485700 1 -- 172.21.15.61:0/1762017074 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe0089c90 con 0x7f0fe015a1c0 2023-12-24T19:58:22.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.200+0000 7f0fd6ffd700 1 -- 172.21.15.61:0/1762017074 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0fd801b400 con 0x7f0fe015a1c0 2023-12-24T19:58:22.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.200+0000 7f0fd6ffd700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fc0066f30 0x7f0fc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.200+0000 7f0fd6ffd700 1 -- 172.21.15.61:0/1762017074 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0fd80844c0 con 0x7f0fe015a1c0 2023-12-24T19:58:22.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.201+0000 7f0fdeffd700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fc0066f30 0x7f0fc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.201+0000 7f0fdeffd700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fc0066f30 0x7f0fc00693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0006fd0 tx=0x7f0fd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:22.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.204+0000 7f0fd6ffd700 1 -- 172.21.15.61:0/1762017074 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fd8051a30 con 0x7f0fe015a1c0 2023-12-24T19:58:22.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.400+0000 7f0fe5485700 1 -- 172.21.15.61:0/1762017074 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0fe0089040 con 0x7f0fe015a1c0 2023-12-24T19:58:22.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.403+0000 7f0fd6ffd700 1 -- 172.21.15.61:0/1762017074 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0fd8055050 con 0x7f0fe015a1c0 2023-12-24T19:58:22.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 -- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fc0066f30 msgr2=0x7f0fc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fc0066f30 0x7f0fc00693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0006fd0 tx=0x7f0fd0008040 comp rx=0 tx=0).stop 2023-12-24T19:58:22.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 -- 172.21.15.61:0/1762017074 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 msgr2=0x7f0fe00c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 0x7f0fe00c7d00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800c890 tx=0x7f0fd80026a0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 -- 172.21.15.61:0/1762017074 shutdown_connections 2023-12-24T19:58:22.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fe00cc0e0 0x7f0fe016a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fc0066f30 0x7f0fc00693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fe015a1c0 0x7f0fe00c7d00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 --2- 172.21.15.61:0/1762017074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fe0159df0 0x7f0fe0154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 -- 172.21.15.61:0/1762017074 >> 172.21.15.61:0/1762017074 conn(0x7f0fe006e600 msgr2=0x7f0fe00c6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:22.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 -- 172.21.15.61:0/1762017074 shutdown_connections 2023-12-24T19:58:22.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.405+0000 7f0fe5485700 1 -- 172.21.15.61:0/1762017074 wait complete. 2023-12-24T19:58:22.418 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-12-24T19:58:22.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.540+0000 7f4470f18700 1 Processor -- start 2023-12-24T19:58:22.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.540+0000 7f4470f18700 1 -- start start 2023-12-24T19:58:22.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.541+0000 7f4470f18700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f446c068510 0x7f446c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.541+0000 7f4470f18700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0b2890 con 0x7f446c159a60 2023-12-24T19:58:22.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.541+0000 7f4470f18700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0cf630 con 0x7f446c068140 2023-12-24T19:58:22.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.541+0000 7f4470f18700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0b2240 con 0x7f446c068510 2023-12-24T19:58:22.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.541+0000 7f446ad9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f446c159a60 0x7f446c159ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40666/0 (socket says 172.21.15.61:40666) 2023-12-24T19:58:22.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.541+0000 7f446ad9d700 1 -- 172.21.15.61:0/1147651577 learned_addr learned my addr 172.21.15.61:0/1147651577 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:22.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674232999 0 0) 0x7f446c0b2890 con 0x7f446c159a60 2023-12-24T19:58:22.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f4469d9b700 1 --2- 172.21.15.61:0/1147651577 >> v2:172.21.15.133:3300/0 conn(0x7f446c068510 0x7f446c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4454003570 con 0x7f446c159a60 2023-12-24T19:58:22.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3804232310 0 0) 0x7f4454003570 con 0x7f446c159a60 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 >> v2:172.21.15.133:3300/0 conn(0x7f446c068510 msgr2=0x7f446c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 --2- 172.21.15.61:0/1147651577 >> v2:172.21.15.133:3300/0 conn(0x7f446c068510 0x7f446c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 >> v1:172.21.15.133:6789/0 conn(0x7f446c068140 legacy=0x7f446c0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0b2520 con 0x7f446c159a60 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f44640017f0 con 0x7f446c159a60 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 >> v1:172.21.15.61:6789/0 conn(0x7f446c159a60 legacy=0x7f446c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4454003a60 0x7f4454003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4454004810 0x7f4454004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44540051c0 0x7f445400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b2240 con 0x7f4454003a60 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445400c160 con 0x7f4454004810 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445400c320 con 0x7f44540051c0 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446a59c700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4454003a60 0x7f4454003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f4469d9b700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4454004810 0x7f4454004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446ad9d700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44540051c0 0x7f445400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446a59c700 1 -- 172.21.15.61:0/1147651577 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44540051c0 msgr2=0x7f445400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446a59c700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f44540051c0 0x7f445400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446a59c700 1 -- 172.21.15.61:0/1147651577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4454004810 msgr2=0x7f4454004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446a59c700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4454004810 0x7f4454004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446a59c700 1 -- 172.21.15.61:0/1147651577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4454003570 con 0x7f4454003a60 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446ad9d700 1 -- 172.21.15.61:0/1147651577 reap_dead start 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.542+0000 7f446a59c700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4454003a60 0x7f4454003e70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f44600018d0 tx=0x7f4460007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2b08e027fbe46e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.543+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460001290 con 0x7f4454003a60 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.543+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4460012420 con 0x7f4454003a60 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.543+0000 7f446959a700 1 -- 172.21.15.61:0/1147651577 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44600127e0 con 0x7f4454003a60 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.543+0000 7f4470f18700 1 -- 172.21.15.61:0/1147651577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4454003a60 msgr2=0x7f4454003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.543+0000 7f4470f18700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4454003a60 0x7f4454003e70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f44600018d0 tx=0x7f4460007d80 comp rx=0 tx=0).stop 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.543+0000 7f4470f18700 1 -- 172.21.15.61:0/1147651577 shutdown_connections 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.543+0000 7f4470f18700 1 --2- 172.21.15.61:0/1147651577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4454003a60 0x7f4454003e70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.543+0000 7f4470f18700 1 -- 172.21.15.61:0/1147651577 >> 172.21.15.61:0/1147651577 conn(0x7f446c097a10 msgr2=0x7f446c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:22.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.543+0000 7f4470f18700 1 -- 172.21.15.61:0/1147651577 shutdown_connections 2023-12-24T19:58:22.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.543+0000 7f4470f18700 1 -- 172.21.15.61:0/1147651577 wait complete. 2023-12-24T19:58:22.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.544+0000 7f4470f18700 1 Processor -- start 2023-12-24T19:58:22.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.544+0000 7f4470f18700 1 -- start start 2023-12-24T19:58:22.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.545+0000 7f4470f18700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4454003a60 0x7f446c0c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.545+0000 7f4470f18700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f446c157ec0 0x7f446c16d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.545+0000 7f4470f18700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f446c16da60 0x7f446c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.545+0000 7f4470f18700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c16dee0 con 0x7f446c157ec0 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.545+0000 7f4470f18700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c15d220 con 0x7f4454003a60 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.545+0000 7f4470f18700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c15aff0 con 0x7f446c16da60 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.545+0000 7f4469d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f446c157ec0 0x7f446c16d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.545+0000 7f4469d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f446c157ec0 0x7f446c16d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34698/0 (socket says 172.21.15.61:34698) 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.545+0000 7f4469d9b700 1 -- 172.21.15.61:0/2304445487 learned_addr learned my addr 172.21.15.61:0/2304445487 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f4469d9b700 1 -- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f446c16da60 msgr2=0x7f446c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f446ad9d700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f446c16da60 0x7f446c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f446a59c700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4454003a60 0x7f446c0c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f4469d9b700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f446c16da60 0x7f446c15b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f4469d9b700 1 -- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4454003a60 msgr2=0x7f446c0c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f4469d9b700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4454003a60 0x7f446c0c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:22.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f4469d9b700 1 -- 172.21.15.61:0/2304445487 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0c3c10 con 0x7f446c157ec0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f446a59c700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4454003a60 0x7f446c0c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f446ad9d700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f446c16da60 0x7f446c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f4469d9b700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f446c157ec0 0x7f446c16d520 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f445c011d70 tx=0x7f445c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f445a7fc700 1 -- 172.21.15.61:0/2304445487 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c009e20 con 0x7f446c157ec0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f445a7fc700 1 -- 172.21.15.61:0/2304445487 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c00fcd0 con 0x7f446c157ec0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f4470f18700 1 -- 172.21.15.61:0/2304445487 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c15cc60 con 0x7f446c157ec0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f445a7fc700 1 -- 172.21.15.61:0/2304445487 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c014650 con 0x7f446c157ec0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.546+0000 7f4470f18700 1 -- 172.21.15.61:0/2304445487 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c15b9c0 con 0x7f446c157ec0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.547+0000 7f4470f18700 1 -- 172.21.15.61:0/2304445487 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c06d440 con 0x7f446c157ec0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.547+0000 7f445a7fc700 1 -- 172.21.15.61:0/2304445487 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f445c014a80 con 0x7f446c157ec0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.548+0000 7f445a7fc700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f444c066f30 0x7f444c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.548+0000 7f445a7fc700 1 -- 172.21.15.61:0/2304445487 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f445c018030 con 0x7f446c157ec0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.548+0000 7f446a59c700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f444c066f30 0x7f444c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:22.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.549+0000 7f446a59c700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f444c066f30 0x7f444c0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f44600018d0 tx=0x7f4460015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:22.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.552+0000 7f445a7fc700 1 -- 172.21.15.61:0/2304445487 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f445c052210 con 0x7f446c157ec0 2023-12-24T19:58:22.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:22.832+0000 7f4470f18700 1 -- 172.21.15.61:0/2304445487 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f446c04c3c0 con 0x7f446c157ec0 2023-12-24T19:58:23.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.057+0000 7f445a7fc700 1 -- 172.21.15.61:0/2304445487 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v84) v1 ==== 130+0+0 (secure 0 0 0) 0x7f445c0220c0 con 0x7f446c157ec0 2023-12-24T19:58:23.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 -- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f444c066f30 msgr2=0x7f444c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:23.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f444c066f30 0x7f444c0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f44600018d0 tx=0x7f4460015000 comp rx=0 tx=0).stop 2023-12-24T19:58:23.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 -- 172.21.15.61:0/2304445487 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f446c157ec0 msgr2=0x7f446c16d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:23.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f446c157ec0 0x7f446c16d520 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f445c011d70 tx=0x7f445c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:23.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 -- 172.21.15.61:0/2304445487 shutdown_connections 2023-12-24T19:58:23.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f446c16da60 0x7f446c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:23.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f444c066f30 0x7f444c0693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:23.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4454003a60 0x7f446c0c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:23.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 --2- 172.21.15.61:0/2304445487 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f446c157ec0 0x7f446c16d520 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:23.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 -- 172.21.15.61:0/2304445487 >> 172.21.15.61:0/2304445487 conn(0x7f446c097a10 msgr2=0x7f446c09baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:23.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 -- 172.21.15.61:0/2304445487 shutdown_connections 2023-12-24T19:58:23.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.060+0000 7f4470f18700 1 -- 172.21.15.61:0/2304445487 wait complete. 2023-12-24T19:58:23.073 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-12-24T19:58:23.073 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-12-24T19:58:23.073 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-12-24T19:58:23.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.195+0000 7f9fff3c0700 1 Processor -- start 2023-12-24T19:58:23.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.195+0000 7f9fff3c0700 1 -- start start 2023-12-24T19:58:23.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9fff3c0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ff80b2660 0x7f9ff815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:23.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9fff3c0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9ff815c470 0x7f9ff80b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:23.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9fff3c0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80b2eb0 con 0x7f9ff815bb60 2023-12-24T19:58:23.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9fff3c0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff80afc20 con 0x7f9ff815c470 2023-12-24T19:58:23.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9fff3c0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff80b2bd0 con 0x7f9ff80b2660 2023-12-24T19:58:23.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9ffd95d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9ff815c470 0x7f9ff80b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:23.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9ffd95d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9ff815c470 0x7f9ff80b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34704/0 (socket says 172.21.15.61:34704) 2023-12-24T19:58:23.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9ffd95d700 1 -- 172.21.15.61:0/1595513944 learned_addr learned my addr 172.21.15.61:0/1595513944 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:23.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9ffc95b700 1 --2- 172.21.15.61:0/1595513944 >> v2:172.21.15.133:3300/0 conn(0x7f9ff80b2660 0x7f9ff815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:23.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9ffd95d700 1 -- 172.21.15.61:0/1595513944 >> v2:172.21.15.133:3300/0 conn(0x7f9ff80b2660 msgr2=0x7f9ff815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:23.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9ffd95d700 1 --2- 172.21.15.61:0/1595513944 >> v2:172.21.15.133:3300/0 conn(0x7f9ff80b2660 0x7f9ff815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:23.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9ffd95d700 1 -- 172.21.15.61:0/1595513944 >> v1:172.21.15.133:6789/0 conn(0x7f9ff815bb60 legacy=0x7f9ff8098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:23.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.196+0000 7f9ffd95d700 1 -- 172.21.15.61:0/1595513944 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80afe10 con 0x7f9ff815c470 2023-12-24T19:58:23.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9ffd95d700 1 --2- 172.21.15.61:0/1595513944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815c470 0x7f9ff80b08f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9ff806e250 tx=0x7f9ff0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cd93cf0e130d81 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:23.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9febfff700 1 -- 172.21.15.61:0/1595513944 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000e070 con 0x7f9ff815c470 2023-12-24T19:58:23.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9febfff700 1 -- 172.21.15.61:0/1595513944 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff000ba50 con 0x7f9ff815c470 2023-12-24T19:58:23.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9febfff700 1 -- 172.21.15.61:0/1595513944 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00092e0 con 0x7f9ff815c470 2023-12-24T19:58:23.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9fff3c0700 1 -- 172.21.15.61:0/1595513944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815c470 msgr2=0x7f9ff80b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9fff3c0700 1 --2- 172.21.15.61:0/1595513944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815c470 0x7f9ff80b08f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9ff806e250 tx=0x7f9ff0009840 comp rx=0 tx=0).stop 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9fff3c0700 1 -- 172.21.15.61:0/1595513944 shutdown_connections 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9fff3c0700 1 --2- 172.21.15.61:0/1595513944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815c470 0x7f9ff80b08f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9fff3c0700 1 --2- 172.21.15.61:0/1595513944 >> v2:172.21.15.133:3300/0 conn(0x7f9ff80b2660 0x7f9ff815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9fff3c0700 1 -- 172.21.15.61:0/1595513944 >> 172.21.15.61:0/1595513944 conn(0x7f9ff8097a10 msgr2=0x7f9ff80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.197+0000 7f9fff3c0700 1 -- 172.21.15.61:0/1595513944 shutdown_connections 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.198+0000 7f9fff3c0700 1 -- 172.21.15.61:0/1595513944 wait complete. 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.199+0000 7f9fff3c0700 1 Processor -- start 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.199+0000 7f9fff3c0700 1 -- start start 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.199+0000 7f9fff3c0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ff80b2660 0x7f9ff809ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9fff3c0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815bb60 0x7f9ff80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9fff3c0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff815c470 0x7f9ff80aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9fff3c0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80aa650 con 0x7f9ff815bb60 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9fff3c0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80a97a0 con 0x7f9ff815c470 2023-12-24T19:58:23.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9fff3c0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80a9a40 con 0x7f9ff80b2660 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffc95b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815bb60 0x7f9ff80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffc95b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815bb60 0x7f9ff80aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34710/0 (socket says 172.21.15.61:34710) 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffc95b700 1 -- 172.21.15.61:0/2982228527 learned_addr learned my addr 172.21.15.61:0/2982228527 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffd95d700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff815c470 0x7f9ff80aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffd15c700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ff80b2660 0x7f9ff809ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffc95b700 1 -- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ff80b2660 msgr2=0x7f9ff809ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffc95b700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ff80b2660 0x7f9ff809ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffc95b700 1 -- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff815c470 msgr2=0x7f9ff80aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffc95b700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff815c470 0x7f9ff80aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffc95b700 1 -- 172.21.15.61:0/2982228527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff0009ae0 con 0x7f9ff815bb60 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9ffc95b700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815bb60 0x7f9ff80aeaf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400d890 tx=0x7f9ff4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9fe97fa700 1 -- 172.21.15.61:0/2982228527 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40125f0 con 0x7f9ff815bb60 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9fe97fa700 1 -- 172.21.15.61:0/2982228527 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff4012750 con 0x7f9ff815bb60 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9fff3c0700 1 -- 172.21.15.61:0/2982228527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff80a9d20 con 0x7f9ff815bb60 2023-12-24T19:58:23.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9fe97fa700 1 -- 172.21.15.61:0/2982228527 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4012af0 con 0x7f9ff815bb60 2023-12-24T19:58:23.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.200+0000 7f9fff3c0700 1 -- 172.21.15.61:0/2982228527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff80aa2e0 con 0x7f9ff815bb60 2023-12-24T19:58:23.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.201+0000 7f9fff3c0700 1 -- 172.21.15.61:0/2982228527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff806d440 con 0x7f9ff815bb60 2023-12-24T19:58:23.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.202+0000 7f9fe97fa700 1 -- 172.21.15.61:0/2982228527 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9ff401e460 con 0x7f9ff815bb60 2023-12-24T19:58:23.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.202+0000 7f9fe97fa700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9fdc066f30 0x7f9fdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:23.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.202+0000 7f9fe97fa700 1 -- 172.21.15.61:0/2982228527 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9ff4084820 con 0x7f9ff815bb60 2023-12-24T19:58:23.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.202+0000 7f9ffd15c700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9fdc066f30 0x7f9fdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:23.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.203+0000 7f9ffd15c700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9fdc066f30 0x7f9fdc0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9fec007fd0 tx=0x7f9fec007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:23.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.207+0000 7f9fe97fa700 1 -- 172.21.15.61:0/2982228527 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ff4055780 con 0x7f9ff815bb60 2023-12-24T19:58:23.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:23.488+0000 7f9fff3c0700 1 -- 172.21.15.61:0/2982228527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f9ff804c3c0 con 0x7f9ff815bb60 2023-12-24T19:58:24.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.059+0000 7f9fe97fa700 1 -- 172.21.15.61:0/2982228527 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v85) v1 ==== 145+0+0 (secure 0 0 0) 0x7f9ff4055310 con 0x7f9ff815bb60 2023-12-24T19:58:24.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 -- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9fdc066f30 msgr2=0x7f9fdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9fdc066f30 0x7f9fdc0693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9fec007fd0 tx=0x7f9fec007eb0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 -- 172.21.15.61:0/2982228527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815bb60 msgr2=0x7f9ff80aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815bb60 0x7f9ff80aeaf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400d890 tx=0x7f9ff4008040 comp rx=0 tx=0).stop 2023-12-24T19:58:24.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 -- 172.21.15.61:0/2982228527 shutdown_connections 2023-12-24T19:58:24.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ff80b2660 0x7f9ff809ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9fdc066f30 0x7f9fdc0693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff815c470 0x7f9ff80aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 --2- 172.21.15.61:0/2982228527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ff815bb60 0x7f9ff80aeaf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 -- 172.21.15.61:0/2982228527 >> 172.21.15.61:0/2982228527 conn(0x7f9ff8097a10 msgr2=0x7f9ff80a8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:24.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 -- 172.21.15.61:0/2982228527 shutdown_connections 2023-12-24T19:58:24.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.062+0000 7f9fff3c0700 1 -- 172.21.15.61:0/2982228527 wait complete. 2023-12-24T19:58:24.076 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-24T19:58:24.216 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_objectstore":"memstore"} 2023-12-24T19:58:24.216 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-24T19:58:24.217 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T19:58:24.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.341+0000 7f1ebf591700 1 Processor -- start 2023-12-24T19:58:24.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.341+0000 7f1ebf591700 1 -- start start 2023-12-24T19:58:24.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1ebf591700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815a030 0x7f1eb8070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1ebf591700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1eb8068b10 0x7f1eb8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1ebf591700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb80c4710 con 0x7f1eb8159c60 2023-12-24T19:58:24.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1ebf591700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb806b190 con 0x7f1eb8068b10 2023-12-24T19:58:24.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1ebf591700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb806a5c0 con 0x7f1eb815a030 2023-12-24T19:58:24.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1ebd32d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1eb8159c60 0x7f1eb80c4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40680/0 (socket says 172.21.15.61:40680) 2023-12-24T19:58:24.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1ebd32d700 1 -- 172.21.15.61:0/2326957067 learned_addr learned my addr 172.21.15.61:0/2326957067 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:24.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1ebdb2e700 1 --2- 172.21.15.61:0/2326957067 >> v2:172.21.15.133:3300/0 conn(0x7f1eb8068b10 0x7f1eb8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1ebcb2c700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815a030 0x7f1eb8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181838963 0 0) 0x7f1eb4001110 con 0x7f1eb8159c60 2023-12-24T19:58:24.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea4003570 con 0x7f1eb8159c60 2023-12-24T19:58:24.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1209634068 0 0) 0x7f1ea4003570 con 0x7f1eb8159c60 2023-12-24T19:58:24.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815a030 msgr2=0x7f1eb8070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:24.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815a030 0x7f1eb8070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 >> v2:172.21.15.133:3300/0 conn(0x7f1eb8068b10 msgr2=0x7f1eb8070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:24.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 --2- 172.21.15.61:0/2326957067 >> v2:172.21.15.133:3300/0 conn(0x7f1eb8068b10 0x7f1eb8070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb806a860 con 0x7f1eb8159c60 2023-12-24T19:58:24.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f1eb4001600 con 0x7f1eb8159c60 2023-12-24T19:58:24.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 >> v1:172.21.15.61:6789/0 conn(0x7f1eb8159c60 legacy=0x7f1eb80c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea4003a60 0x7f1ea4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ea4004810 0x7f1ea4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815a030 0x7f1ea40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb806b190 con 0x7f1ea4004810 2023-12-24T19:58:24.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb806a5c0 con 0x7f1ea4003a60 2023-12-24T19:58:24.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.342+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea400ba60 con 0x7f1eb815a030 2023-12-24T19:58:24.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1ebcb2c700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ea4004810 0x7f1ea4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1ebd32d700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea4003a60 0x7f1ea4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1ebdb2e700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815a030 0x7f1ea40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1ebcb2c700 1 -- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815a030 msgr2=0x7f1ea40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:24.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1ebcb2c700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815a030 0x7f1ea40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1ebcb2c700 1 -- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea4003a60 msgr2=0x7f1ea4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1ebcb2c700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea4003a60 0x7f1ea4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1ebcb2c700 1 -- 172.21.15.61:0/2326957067 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea4003570 con 0x7f1ea4004810 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1ebdb2e700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815a030 0x7f1ea40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1ebcb2c700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ea4004810 0x7f1ea4004c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009c30 tx=0x7f1ea80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31c081dfe44672c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800e710 con 0x7f1ea4004810 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea800e870 con 0x7f1ea4004810 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.343+0000 7f1eaffff700 1 -- 172.21.15.61:0/2326957067 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea800ec30 con 0x7f1ea4004810 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.344+0000 7f1ebf591700 1 -- 172.21.15.61:0/2326957067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ea4004810 msgr2=0x7f1ea4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.344+0000 7f1ebf591700 1 --2- 172.21.15.61:0/2326957067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ea4004810 0x7f1ea4004c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009c30 tx=0x7f1ea80091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.344+0000 7f1ebdb2e700 1 -- 172.21.15.61:0/2326957067 reap_dead start 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.344+0000 7f1ebf591700 1 -- 172.21.15.61:0/2326957067 shutdown_connections 2023-12-24T19:58:24.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.344+0000 7f1ebf591700 1 -- 172.21.15.61:0/2326957067 >> 172.21.15.61:0/2326957067 conn(0x7f1eb80ce420 msgr2=0x7f1eb80ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:24.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.344+0000 7f1ebf591700 1 -- 172.21.15.61:0/2326957067 shutdown_connections 2023-12-24T19:58:24.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.344+0000 7f1ebf591700 1 -- 172.21.15.61:0/2326957067 wait complete. 2023-12-24T19:58:24.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.345+0000 7f1ebf591700 1 Processor -- start 2023-12-24T19:58:24.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.345+0000 7f1ebf591700 1 -- start start 2023-12-24T19:58:24.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebf591700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea4004810 0x7f1eb80c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebf591700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb80c6a60 0x7f1eb80b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebf591700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815cca0 0x7f1eb815d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebf591700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80afae0 con 0x7f1eb80c6a60 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebf591700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80b02f0 con 0x7f1ea4004810 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebf591700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb80afd30 con 0x7f1eb815cca0 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebcb2c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb80c6a60 0x7f1eb80b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebcb2c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb80c6a60 0x7f1eb80b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34724/0 (socket says 172.21.15.61:34724) 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebcb2c700 1 -- 172.21.15.61:0/2314404455 learned_addr learned my addr 172.21.15.61:0/2314404455 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebd32d700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea4004810 0x7f1eb80c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebdb2e700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815cca0 0x7f1eb815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebcb2c700 1 -- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815cca0 msgr2=0x7f1eb815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebcb2c700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815cca0 0x7f1eb815d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebcb2c700 1 -- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea4004810 msgr2=0x7f1eb80c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebcb2c700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea4004810 0x7f1eb80c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.346+0000 7f1ebcb2c700 1 -- 172.21.15.61:0/2314404455 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80b0010 con 0x7f1eb80c6a60 2023-12-24T19:58:24.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.347+0000 7f1ebcb2c700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb80c6a60 0x7f1eb80b2160 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40046d0 tx=0x7f1ea801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.347+0000 7f1ead7fa700 1 -- 172.21.15.61:0/2314404455 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8022070 con 0x7f1eb80c6a60 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.347+0000 7f1ead7fa700 1 -- 172.21.15.61:0/2314404455 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea800e9e0 con 0x7f1eb80c6a60 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.347+0000 7f1ebf591700 1 -- 172.21.15.61:0/2314404455 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb816db50 con 0x7f1eb80c6a60 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.347+0000 7f1ead7fa700 1 -- 172.21.15.61:0/2314404455 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea801c450 con 0x7f1eb80c6a60 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.347+0000 7f1ebf591700 1 -- 172.21.15.61:0/2314404455 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb80b26a0 con 0x7f1eb80c6a60 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.348+0000 7f1ebf591700 1 -- 172.21.15.61:0/2314404455 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb816dec0 con 0x7f1eb80c6a60 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.348+0000 7f1ead7fa700 1 -- 172.21.15.61:0/2314404455 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1ea801c860 con 0x7f1eb80c6a60 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.349+0000 7f1ead7fa700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e9c066f30 0x7f1e9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.349+0000 7f1ead7fa700 1 -- 172.21.15.61:0/2314404455 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1ea80857c0 con 0x7f1eb80c6a60 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.349+0000 7f1ebd32d700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e9c066f30 0x7f1e9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.350+0000 7f1ebd32d700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e9c066f30 0x7f1e9c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40017b0 tx=0x7f1eb806b100 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:24.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.353+0000 7f1ead7fa700 1 -- 172.21.15.61:0/2314404455 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ea8052ea0 con 0x7f1eb80c6a60 2023-12-24T19:58:24.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.549+0000 7f1ebf591700 1 -- 172.21.15.61:0/2314404455 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1eb80afae0 con 0x7f1eb80c6a60 2023-12-24T19:58:24.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.553+0000 7f1ead7fa700 1 -- 172.21.15.61:0/2314404455 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1ea802b0c0 con 0x7f1eb80c6a60 2023-12-24T19:58:24.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 -- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e9c066f30 msgr2=0x7f1e9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e9c066f30 0x7f1e9c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40017b0 tx=0x7f1eb806b100 comp rx=0 tx=0).stop 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 -- 172.21.15.61:0/2314404455 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb80c6a60 msgr2=0x7f1eb80b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb80c6a60 0x7f1eb80b2160 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40046d0 tx=0x7f1ea801a000 comp rx=0 tx=0).stop 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 -- 172.21.15.61:0/2314404455 shutdown_connections 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb815cca0 0x7f1eb815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e9c066f30 0x7f1e9c0693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ea4004810 0x7f1eb80c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 --2- 172.21.15.61:0/2314404455 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb80c6a60 0x7f1eb80b2160 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 -- 172.21.15.61:0/2314404455 >> 172.21.15.61:0/2314404455 conn(0x7f1eb80ce420 msgr2=0x7f1eb81594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 -- 172.21.15.61:0/2314404455 shutdown_connections 2023-12-24T19:58:24.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.555+0000 7f1ebf591700 1 -- 172.21.15.61:0/2314404455 wait complete. 2023-12-24T19:58:24.567 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T19:58:24.568 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:58:24.612 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:58:24.661 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T19:58:24.662 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T19:58:24.662 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:24.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.783+0000 7f8a8356b700 1 Processor -- start 2023-12-24T19:58:24.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.783+0000 7f8a8356b700 1 -- start start 2023-12-24T19:58:24.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a8356b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8a7c068140 0x7f8a7c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a8356b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7c0b2890 con 0x7f8a7c159a60 2023-12-24T19:58:24.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a8356b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7c0cf630 con 0x7f8a7c068510 2023-12-24T19:58:24.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a8356b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7c0b2240 con 0x7f8a7c068140 2023-12-24T19:58:24.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a81307700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8a7c068140 0x7f8a7c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a81b08700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8a7c159a60 0x7f8a7c159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40694/0 (socket says 172.21.15.61:40694) 2023-12-24T19:58:24.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a81b08700 1 -- 172.21.15.61:0/3369163778 learned_addr learned my addr 172.21.15.61:0/3369163778 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:24.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a81307700 1 -- 172.21.15.61:0/3369163778 >> v1:172.21.15.133:6789/0 conn(0x7f8a7c068510 legacy=0x7f8a7c0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:24.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a81307700 1 -- 172.21.15.61:0/3369163778 >> v1:172.21.15.61:6789/0 conn(0x7f8a7c159a60 legacy=0x7f8a7c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a81307700 1 -- 172.21.15.61:0/3369163778 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c0b2520 con 0x7f8a7c068140 2023-12-24T19:58:24.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.784+0000 7f8a73fff700 1 -- 172.21.15.61:0/3369163778 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126625985 0 0) 0x7f8a7c0b2890 con 0x7f8a7c159a60 2023-12-24T19:58:24.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a81307700 1 --2- 172.21.15.61:0/3369163778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068140 0x7f8a7c0cefa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8a780098d0 tx=0x7f8a78009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdf895719e7e954 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:24.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a73fff700 1 -- 172.21.15.61:0/3369163778 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a78009e70 con 0x7f8a7c068140 2023-12-24T19:58:24.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a73fff700 1 -- 172.21.15.61:0/3369163778 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a78005c10 con 0x7f8a7c068140 2023-12-24T19:58:24.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a73fff700 1 -- 172.21.15.61:0/3369163778 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7800b610 con 0x7f8a7c068140 2023-12-24T19:58:24.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a8356b700 1 -- 172.21.15.61:0/3369163778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068140 msgr2=0x7f8a7c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a8356b700 1 --2- 172.21.15.61:0/3369163778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068140 0x7f8a7c0cefa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8a780098d0 tx=0x7f8a78009120 comp rx=0 tx=0).stop 2023-12-24T19:58:24.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a8356b700 1 -- 172.21.15.61:0/3369163778 shutdown_connections 2023-12-24T19:58:24.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a8356b700 1 --2- 172.21.15.61:0/3369163778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068140 0x7f8a7c0cefa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a8356b700 1 -- 172.21.15.61:0/3369163778 >> 172.21.15.61:0/3369163778 conn(0x7f8a7c097a10 msgr2=0x7f8a7c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:24.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a8356b700 1 -- 172.21.15.61:0/3369163778 shutdown_connections 2023-12-24T19:58:24.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.785+0000 7f8a8356b700 1 -- 172.21.15.61:0/3369163778 wait complete. 2023-12-24T19:58:24.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.787+0000 7f8a8356b700 1 Processor -- start 2023-12-24T19:58:24.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.787+0000 7f8a8356b700 1 -- start start 2023-12-24T19:58:24.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.787+0000 7f8a8356b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a7c068140 0x7f8a7c09ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.787+0000 7f8a8356b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068510 0x7f8a7c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.787+0000 7f8a8356b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a7c159a60 0x7f8a7c15d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.787+0000 7f8a8356b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c15abf0 con 0x7f8a7c068510 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.787+0000 7f8a8356b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c09b780 con 0x7f8a7c068140 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.787+0000 7f8a8356b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c09ba60 con 0x7f8a7c159a60 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a80b06700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068510 0x7f8a7c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a80b06700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068510 0x7f8a7c15cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34744/0 (socket says 172.21.15.61:34744) 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a80b06700 1 -- 172.21.15.61:0/1427725158 learned_addr learned my addr 172.21.15.61:0/1427725158 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a81307700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a7c068140 0x7f8a7c09ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a81b08700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a7c159a60 0x7f8a7c15d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a80b06700 1 -- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a7c159a60 msgr2=0x7f8a7c15d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a80b06700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a7c159a60 0x7f8a7c15d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a80b06700 1 -- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a7c068140 msgr2=0x7f8a7c09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a80b06700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a7c068140 0x7f8a7c09ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:24.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a80b06700 1 -- 172.21.15.61:0/1427725158 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a780093c0 con 0x7f8a7c068510 2023-12-24T19:58:24.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a80b06700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068510 0x7f8a7c15cf40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00b5e0 tx=0x7f8a6c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:24.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a717fa700 1 -- 172.21.15.61:0/1427725158 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00f510 con 0x7f8a7c068510 2023-12-24T19:58:24.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a717fa700 1 -- 172.21.15.61:0/1427725158 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c00f670 con 0x7f8a7c068510 2023-12-24T19:58:24.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a8356b700 1 -- 172.21.15.61:0/1427725158 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7c09bd40 con 0x7f8a7c068510 2023-12-24T19:58:24.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a717fa700 1 -- 172.21.15.61:0/1427725158 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00fa30 con 0x7f8a7c068510 2023-12-24T19:58:24.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.788+0000 7f8a8356b700 1 -- 172.21.15.61:0/1427725158 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7c09b360 con 0x7f8a7c068510 2023-12-24T19:58:24.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.789+0000 7f8a8356b700 1 -- 172.21.15.61:0/1427725158 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7c06d440 con 0x7f8a7c068510 2023-12-24T19:58:24.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.790+0000 7f8a717fa700 1 -- 172.21.15.61:0/1427725158 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8a6c01a400 con 0x7f8a7c068510 2023-12-24T19:58:24.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.790+0000 7f8a717fa700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a60066f30 0x7f8a600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:24.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.790+0000 7f8a717fa700 1 -- 172.21.15.61:0/1427725158 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8a6c083e00 con 0x7f8a7c068510 2023-12-24T19:58:24.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.790+0000 7f8a81307700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a60066f30 0x7f8a600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:24.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.791+0000 7f8a81307700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a60066f30 0x7f8a600693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8a78003080 tx=0x7f8a78015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:24.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:24.794+0000 7f8a717fa700 1 -- 172.21.15.61:0/1427725158 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a6c0513f0 con 0x7f8a7c068510 2023-12-24T19:58:25.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.035+0000 7f8a8356b700 1 -- 172.21.15.61:0/1427725158 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a7c04c3c0 con 0x7f8a7c068510 2023-12-24T19:58:25.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.036+0000 7f8a717fa700 1 -- 172.21.15.61:0/1427725158 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f8a6c054a10 con 0x7f8a7c068510 2023-12-24T19:58:25.036 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:25.036 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2779978406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2779978406},{"type":"v1","addr":"172.21.15.61:6835","nonce":2779978406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1935570272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1935570272},{"type":"v1","addr":"172.21.15.133:6836","nonce":1935570272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3983510237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3983510237},{"type":"v1","addr":"172.21.15.133:6837","nonce":3983510237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5208,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2110795984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2110795984},{"type":"v1","addr":"172.21.15.61:6834","nonce":2110795984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-12-24T19:58:25.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 -- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a60066f30 msgr2=0x7f8a600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a60066f30 0x7f8a600693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8a78003080 tx=0x7f8a78015000 comp rx=0 tx=0).stop 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 -- 172.21.15.61:0/1427725158 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068510 msgr2=0x7f8a7c15cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068510 0x7f8a7c15cf40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00b5e0 tx=0x7f8a6c009120 comp rx=0 tx=0).stop 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 -- 172.21.15.61:0/1427725158 shutdown_connections 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a7c159a60 0x7f8a7c15d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a60066f30 0x7f8a600693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a7c068140 0x7f8a7c09ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 --2- 172.21.15.61:0/1427725158 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a7c068510 0x7f8a7c15cf40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 -- 172.21.15.61:0/1427725158 >> 172.21.15.61:0/1427725158 conn(0x7f8a7c097a10 msgr2=0x7f8a7c0ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 -- 172.21.15.61:0/1427725158 shutdown_connections 2023-12-24T19:58:25.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:25.038+0000 7f8a8356b700 1 -- 172.21.15.61:0/1427725158 wait complete. 2023-12-24T19:58:25.040 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 18 2023-12-24T19:58:25.051 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T19:58:25.051 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T19:58:25.051 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T19:58:25.051 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:58:25.051 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T19:58:25.051 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T19:58:25.051 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T19:58:25.052 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:58:25.052 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T19:58:25.052 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T19:58:25.052 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T19:58:25.052 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:58:25.052 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T19:58:25.052 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T19:58:25.052 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T19:58:25.053 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:58:25.059 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T19:58:25.060 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T19:58:25.060 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T19:58:25.060 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T19:58:25.063 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T19:58:25.064 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T19:58:25.102 INFO:tasks.ceph.mds.a:Started 2023-12-24T19:58:25.103 DEBUG:teuthology.parallel:result is None 2023-12-24T19:58:25.103 INFO:tasks.ceph.mds.c:Started 2023-12-24T19:58:25.103 DEBUG:teuthology.parallel:result is None 2023-12-24T19:58:25.107 INFO:tasks.ceph.mds.b:Started 2023-12-24T19:58:25.107 DEBUG:teuthology.parallel:result is None 2023-12-24T19:58:25.180 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T19:58:25.180 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T19:58:25.181 INFO:tasks.ceph.mds.c.smithi061.stderr:2023-12-24T19:58:25.181+0000 7f74f1721700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6833/0: (98) Address already in use 2023-12-24T19:58:25.188 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T19:58:25.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-24T19:58:25.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-12-24T19:58:25.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-24T19:58:25.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-24T19:58:31.064 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T19:58:31.064 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T19:58:31.067 INFO:tasks.ceph.mds.d:Started 2023-12-24T19:58:31.067 DEBUG:teuthology.parallel:result is None 2023-12-24T19:58:31.068 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T19:58:31.151 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T19:58:31.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.206+0000 7fdbaad66700 1 Processor -- start 2023-12-24T19:58:31.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.206+0000 7fdbaad66700 1 -- start start 2023-12-24T19:58:31.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.206+0000 7fdbaad66700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdba40ce010 0x7fdba40ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.206+0000 7fdbaad66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba4069f00 0x7fdba40cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.206+0000 7fdbaad66700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba4158350 con 0x7fdba40ce3e0 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.206+0000 7fdbaad66700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba4158ef0 con 0x7fdba40ce010 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.206+0000 7fdbaad66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40ca740 con 0x7fdba4069f00 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba8b02700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdba40ce010 0x7fdba40ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba3fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fdba40ce3e0 0x7fdba41587e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39774/0 (socket says 172.21.15.61:39774) 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba3fff700 1 -- 172.21.15.61:0/2008316041 learned_addr learned my addr 172.21.15.61:0/2008316041 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba8b02700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdba40ce010 0x7fdba40ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47100/0 (socket says 172.21.15.61:47100) 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba9303700 1 --2- 172.21.15.61:0/2008316041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba4069f00 0x7fdba40cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba8b02700 1 -- 172.21.15.61:0/2008316041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba4069f00 msgr2=0x7fdba40cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba8b02700 1 --2- 172.21.15.61:0/2008316041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba4069f00 0x7fdba40cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba8b02700 1 -- 172.21.15.61:0/2008316041 >> v1:172.21.15.61:6789/0 conn(0x7fdba40ce3e0 legacy=0x7fdba41587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:31.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba8b02700 1 -- 172.21.15.61:0/2008316041 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba40b1120 con 0x7fdba40ce010 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba37fe700 1 -- 172.21.15.61:0/2008316041 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666380006 0 0) 0x7fdba4158350 con 0x7fdba40ce3e0 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba8b02700 1 --2- 172.21.15.61:0/2008316041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 0x7fdba40ca200 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdb980098e0 tx=0x7fdb980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcac21dc9f7378 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba37fe700 1 -- 172.21.15.61:0/2008316041 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb98009e80 con 0x7fdba40ce010 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba37fe700 1 -- 172.21.15.61:0/2008316041 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800b860 con 0x7fdba40ce010 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.207+0000 7fdba37fe700 1 -- 172.21.15.61:0/2008316041 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800bbe0 con 0x7fdba40ce010 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.208+0000 7fdbaad66700 1 -- 172.21.15.61:0/2008316041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 msgr2=0x7fdba40ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.208+0000 7fdbaad66700 1 --2- 172.21.15.61:0/2008316041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 0x7fdba40ca200 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdb980098e0 tx=0x7fdb980091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.208+0000 7fdbaad66700 1 -- 172.21.15.61:0/2008316041 shutdown_connections 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.208+0000 7fdbaad66700 1 --2- 172.21.15.61:0/2008316041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba4069f00 0x7fdba40cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.208+0000 7fdbaad66700 1 --2- 172.21.15.61:0/2008316041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 0x7fdba40ca200 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.208+0000 7fdbaad66700 1 -- 172.21.15.61:0/2008316041 >> 172.21.15.61:0/2008316041 conn(0x7fdba406b790 msgr2=0x7fdba4069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.208+0000 7fdbaad66700 1 -- 172.21.15.61:0/2008316041 shutdown_connections 2023-12-24T19:58:31.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.208+0000 7fdbaad66700 1 -- 172.21.15.61:0/2008316041 wait complete. 2023-12-24T19:58:31.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.209+0000 7fdbaad66700 1 Processor -- start 2023-12-24T19:58:31.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.209+0000 7fdbaad66700 1 -- start start 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdbaad66700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba4069f00 0x7fdba4155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdbaad66700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 0x7fdba40b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdbaad66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdba40ce3e0 0x7fdba4167b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdbaad66700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba4168b60 con 0x7fdba40ce010 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdbaad66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c5d90 con 0x7fdba40ce3e0 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdbaad66700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba40c5a60 con 0x7fdba4069f00 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdba3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 0x7fdba40b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdba3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 0x7fdba40b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47106/0 (socket says 172.21.15.61:47106) 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdba3fff700 1 -- 172.21.15.61:0/3689479809 learned_addr learned my addr 172.21.15.61:0/3689479809 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdba3fff700 1 -- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba4069f00 msgr2=0x7fdba4155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdba3fff700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba4069f00 0x7fdba4155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdba3fff700 1 -- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdba40ce3e0 msgr2=0x7fdba4167b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdba3fff700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdba40ce3e0 0x7fdba4167b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:31.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.210+0000 7fdba3fff700 1 -- 172.21.15.61:0/3689479809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98009420 con 0x7fdba40ce010 2023-12-24T19:58:31.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.211+0000 7fdba3fff700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 0x7fdba40b2610 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000c5b0 tx=0x7fdb90001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:31.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.211+0000 7fdba0ff9700 1 -- 172.21.15.61:0/3689479809 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90005b30 con 0x7fdba40ce010 2023-12-24T19:58:31.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.211+0000 7fdba0ff9700 1 -- 172.21.15.61:0/3689479809 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb90005c90 con 0x7fdba40ce010 2023-12-24T19:58:31.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.211+0000 7fdbaad66700 1 -- 172.21.15.61:0/3689479809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba4155950 con 0x7fdba40ce010 2023-12-24T19:58:31.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.211+0000 7fdba0ff9700 1 -- 172.21.15.61:0/3689479809 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90007300 con 0x7fdba40ce010 2023-12-24T19:58:31.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.211+0000 7fdbaad66700 1 -- 172.21.15.61:0/3689479809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba4168880 con 0x7fdba40ce010 2023-12-24T19:58:31.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.212+0000 7fdbaad66700 1 -- 172.21.15.61:0/3689479809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba404c3c0 con 0x7fdba40ce010 2023-12-24T19:58:31.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.212+0000 7fdba0ff9700 1 -- 172.21.15.61:0/3689479809 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdb900076b0 con 0x7fdba40ce010 2023-12-24T19:58:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.213+0000 7fdba0ff9700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb88066f30 0x7fdb880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.213+0000 7fdba0ff9700 1 -- 172.21.15.61:0/3689479809 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdb90083740 con 0x7fdba40ce010 2023-12-24T19:58:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.213+0000 7fdba8b02700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb88066f30 0x7fdb880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.213+0000 7fdba8b02700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb88066f30 0x7fdb880693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdb980091e0 tx=0x7fdb98017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.217+0000 7fdba0ff9700 1 -- 172.21.15.61:0/3689479809 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb90050cb0 con 0x7fdba40ce010 2023-12-24T19:58:31.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:31.427+0000 7fdbaad66700 1 -- 172.21.15.61:0/3689479809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdba40c5ed0 con 0x7fdba40ce010 2023-12-24T19:58:31.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-24T19:58:31.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-12-24T19:58:31.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-24T19:58:31.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-24T19:58:32.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.521+0000 7fdba0ff9700 1 -- 172.21.15.61:0/3689479809 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdb90017080 con 0x7fdba40ce010 2023-12-24T19:58:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 -- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb88066f30 msgr2=0x7fdb880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb88066f30 0x7fdb880693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdb980091e0 tx=0x7fdb98017000 comp rx=0 tx=0).stop 2023-12-24T19:58:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 -- 172.21.15.61:0/3689479809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 msgr2=0x7fdba40b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 0x7fdba40b2610 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000c5b0 tx=0x7fdb90001070 comp rx=0 tx=0).stop 2023-12-24T19:58:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 -- 172.21.15.61:0/3689479809 shutdown_connections 2023-12-24T19:58:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba4069f00 0x7fdba4155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb88066f30 0x7fdb880693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdba40ce3e0 0x7fdba4167b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 --2- 172.21.15.61:0/3689479809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba40ce010 0x7fdba40b2610 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 -- 172.21.15.61:0/3689479809 >> 172.21.15.61:0/3689479809 conn(0x7fdba406b790 msgr2=0x7fdba40c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 -- 172.21.15.61:0/3689479809 shutdown_connections 2023-12-24T19:58:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.524+0000 7fdbaad66700 1 -- 172.21.15.61:0/3689479809 wait complete. 2023-12-24T19:58:32.526 INFO:teuthology.orchestra.run.smithi061.stderr: removed all blocklist entries 2023-12-24T19:58:32.542 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T19:58:32.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.668+0000 7f0768463700 1 Processor -- start 2023-12-24T19:58:32.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.668+0000 7f0768463700 1 -- start start 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.669+0000 7f0768463700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0760068510 0x7f07600cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.669+0000 7f0768463700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07600b2890 con 0x7f0760068140 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.669+0000 7f0768463700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07600cf630 con 0x7f0760159a60 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.669+0000 7f0768463700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07600b2240 con 0x7f0760068510 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.669+0000 7f07661ff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0760068140 0x7f07600b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39776/0 (socket says 172.21.15.61:39776) 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07661ff700 1 -- 172.21.15.61:0/2504297807 learned_addr learned my addr 172.21.15.61:0/2504297807 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674112481 0 0) 0x7f07600b2890 con 0x7f0760068140 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07659fe700 1 --2- 172.21.15.61:0/2504297807 >> v2:172.21.15.133:3300/0 conn(0x7f0760068510 0x7f07600cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f074c003570 con 0x7f0760068140 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2474039284 0 0) 0x7f074c003570 con 0x7f0760068140 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 >> v2:172.21.15.133:3300/0 conn(0x7f0760068510 msgr2=0x7f07600cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:32.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 --2- 172.21.15.61:0/2504297807 >> v2:172.21.15.133:3300/0 conn(0x7f0760068510 0x7f07600cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 >> v1:172.21.15.133:6789/0 conn(0x7f0760159a60 legacy=0x7f0760159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600b2520 con 0x7f0760068140 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f075c0015f0 con 0x7f0760068140 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 >> v1:172.21.15.61:6789/0 conn(0x7f0760068140 legacy=0x7f07600b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f074c003a60 0x7f074c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f074c004810 0x7f074c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f074c0051c0 0x7f074c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07600b2240 con 0x7f074c004810 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074c00c0e0 con 0x7f074c0051c0 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074c00c2a0 con 0x7f074c003a60 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07659fe700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f074c004810 0x7f074c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f07661ff700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f074c003a60 0x7f074c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.670+0000 7f0766a00700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f074c0051c0 0x7f074c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.671+0000 7f07659fe700 1 -- 172.21.15.61:0/2504297807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f074c003a60 msgr2=0x7f074c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:32.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.671+0000 7f07659fe700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f074c003a60 0x7f074c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.671+0000 7f07659fe700 1 -- 172.21.15.61:0/2504297807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f074c0051c0 msgr2=0x7f074c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.671+0000 7f07659fe700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f074c0051c0 0x7f074c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.671+0000 7f07659fe700 1 -- 172.21.15.61:0/2504297807 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c003570 con 0x7f074c004810 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.671+0000 7f0766a00700 1 -- 172.21.15.61:0/2504297807 reap_dead start 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.671+0000 7f07659fe700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f074c004810 0x7f074c004c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0750009c00 tx=0x7f07500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316b123b93486db0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.671+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000e710 con 0x7f074c004810 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.671+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075000e870 con 0x7f074c004810 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.671+0000 7f07651fd700 1 -- 172.21.15.61:0/2504297807 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000ec30 con 0x7f074c004810 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.672+0000 7f0768463700 1 -- 172.21.15.61:0/2504297807 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f074c004810 msgr2=0x7f074c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.672+0000 7f0768463700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f074c004810 0x7f074c004c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0750009c00 tx=0x7f07500091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.672+0000 7f0768463700 1 -- 172.21.15.61:0/2504297807 shutdown_connections 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.672+0000 7f0768463700 1 --2- 172.21.15.61:0/2504297807 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f074c004810 0x7f074c004c80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.672+0000 7f0768463700 1 -- 172.21.15.61:0/2504297807 >> 172.21.15.61:0/2504297807 conn(0x7f0760097a10 msgr2=0x7f07600ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.672+0000 7f0768463700 1 -- 172.21.15.61:0/2504297807 shutdown_connections 2023-12-24T19:58:32.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.672+0000 7f0768463700 1 -- 172.21.15.61:0/2504297807 wait complete. 2023-12-24T19:58:32.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.673+0000 7f0768463700 1 Processor -- start 2023-12-24T19:58:32.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.673+0000 7f0768463700 1 -- start start 2023-12-24T19:58:32.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f0768463700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f074c004810 0x7f07601564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:32.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f0768463700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07600c4040 0x7f0760099e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:32.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f0768463700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f076009a3a0 0x7f076009ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:32.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f0768463700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0760169e10 con 0x7f07600c4040 2023-12-24T19:58:32.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f0768463700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076006bb90 con 0x7f076009a3a0 2023-12-24T19:58:32.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f0768463700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076016d830 con 0x7f074c004810 2023-12-24T19:58:32.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07659fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07600c4040 0x7f0760099e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:32.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07659fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07600c4040 0x7f0760099e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47134/0 (socket says 172.21.15.61:47134) 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07659fe700 1 -- 172.21.15.61:0/2188053041 learned_addr learned my addr 172.21.15.61:0/2188053041 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07661ff700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f074c004810 0x7f07601564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f0766a00700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f076009a3a0 0x7f076009ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07659fe700 1 -- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f074c004810 msgr2=0x7f07601564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07659fe700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f074c004810 0x7f07601564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07659fe700 1 -- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f076009a3a0 msgr2=0x7f076009ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07659fe700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f076009a3a0 0x7f076009ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07659fe700 1 -- 172.21.15.61:0/2188053041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076016db10 con 0x7f07600c4040 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07659fe700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07600c4040 0x7f0760099e60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f074c00c0b0 tx=0x7f075001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07567fc700 1 -- 172.21.15.61:0/2188053041 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750022070 con 0x7f07600c4040 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.674+0000 7f07567fc700 1 -- 172.21.15.61:0/2188053041 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075000e9e0 con 0x7f07600c4040 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.675+0000 7f07567fc700 1 -- 172.21.15.61:0/2188053041 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075001c450 con 0x7f07600c4040 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.675+0000 7f0768463700 1 -- 172.21.15.61:0/2188053041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076016ddf0 con 0x7f07600c4040 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.675+0000 7f0768463700 1 -- 172.21.15.61:0/2188053041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0760156a10 con 0x7f07600c4040 2023-12-24T19:58:32.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.676+0000 7f0768463700 1 -- 172.21.15.61:0/2188053041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076016a0b0 con 0x7f07600c4040 2023-12-24T19:58:32.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.676+0000 7f07567fc700 1 -- 172.21.15.61:0/2188053041 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f075001c880 con 0x7f07600c4040 2023-12-24T19:58:32.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.676+0000 7f07567fc700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0744066f30 0x7f07440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:32.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.676+0000 7f07567fc700 1 -- 172.21.15.61:0/2188053041 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0750085a40 con 0x7f07600c4040 2023-12-24T19:58:32.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.676+0000 7f07661ff700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0744066f30 0x7f07440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:32.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.677+0000 7f07661ff700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0744066f30 0x7f07440693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f075c0012a0 tx=0x7f075c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:32.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.681+0000 7f07567fc700 1 -- 172.21.15.61:0/2188053041 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0750087e60 con 0x7f07600c4040 2023-12-24T19:58:32.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.951+0000 7f0768463700 1 -- 172.21.15.61:0/2188053041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f076006d440 con 0x7f07600c4040 2023-12-24T19:58:32.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.952+0000 7f07567fc700 1 -- 172.21.15.61:0/2188053041 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f07500530f0 con 0x7f07600c4040 2023-12-24T19:58:32.953 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:32.953 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:32.953 INFO:teuthology.orchestra.run.smithi061.stdout: "auth_dump": [ 2023-12-24T19:58:32.953 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.953 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.a", 2023-12-24T19:58:32.953 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew==", 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.b", 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw==", 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:58:32.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.c", 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g==", 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.955 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.d", 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg==", 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.0", 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag==", 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:58:32.956 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.1", 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw==", 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.2", 2023-12-24T19:58:32.957 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ==", 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.3", 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA==", 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.958 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.4", 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ==", 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.5", 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w==", 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.6", 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw==", 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.7", 2023-12-24T19:58:32.960 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw==", 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.0", 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA==", 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow r", 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.961 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.1", 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w==", 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.2", 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg==", 2023-12-24T19:58:32.962 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.3", 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g==", 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T19:58:32.963 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.admin", 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlwF3pGRAA8h0Cld7lwZprlrgMAN7tSg==", 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.x", 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg==", 2023-12-24T19:58:32.964 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.y", 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A==", 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:32.965 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:32.966 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:32.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 -- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0744066f30 msgr2=0x7f07440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:32.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0744066f30 0x7f07440693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f075c0012a0 tx=0x7f075c009040 comp rx=0 tx=0).stop 2023-12-24T19:58:32.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 -- 172.21.15.61:0/2188053041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07600c4040 msgr2=0x7f0760099e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:32.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07600c4040 0x7f0760099e60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f074c00c0b0 tx=0x7f075001a000 comp rx=0 tx=0).stop 2023-12-24T19:58:32.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 -- 172.21.15.61:0/2188053041 shutdown_connections 2023-12-24T19:58:32.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f074c004810 0x7f07601564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0744066f30 0x7f07440693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f076009a3a0 0x7f076009ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 --2- 172.21.15.61:0/2188053041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f07600c4040 0x7f0760099e60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:32.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 -- 172.21.15.61:0/2188053041 >> 172.21.15.61:0/2188053041 conn(0x7f0760097a10 msgr2=0x7f0760156dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:32.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 -- 172.21.15.61:0/2188053041 shutdown_connections 2023-12-24T19:58:32.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:32.954+0000 7f0768463700 1 -- 172.21.15.61:0/2188053041 wait complete. 2023-12-24T19:58:32.969 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:58:33.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.088+0000 7fc353874700 1 Processor -- start 2023-12-24T19:58:33.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.089+0000 7fc353874700 1 -- start start 2023-12-24T19:58:33.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.089+0000 7fc353874700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc34c15bb60 0x7fc34c098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.089+0000 7fc353874700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 0x7fc34c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.089+0000 7fc353874700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc34c15c470 0x7fc34c0b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.089+0000 7fc353874700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c0afc20 con 0x7fc34c15bb60 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc353874700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34c0b2eb0 con 0x7fc34c15c470 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc353874700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0b2bd0 con 0x7fc34c098aa0 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc351610700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc34c15bb60 0x7fc34c098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc351610700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc34c15bb60 0x7fc34c098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47136/0 (socket says 172.21.15.61:47136) 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc351610700 1 -- 172.21.15.61:0/1352164056 learned_addr learned my addr 172.21.15.61:0/1352164056 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc351e11700 1 --2- 172.21.15.61:0/1352164056 >> v2:172.21.15.133:3300/0 conn(0x7fc34c15c470 0x7fc34c0b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc350e0f700 1 --2- 172.21.15.61:0/1352164056 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 0x7fc34c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc351610700 1 -- 172.21.15.61:0/1352164056 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 msgr2=0x7fc34c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc351610700 1 --2- 172.21.15.61:0/1352164056 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 0x7fc34c15bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc351610700 1 -- 172.21.15.61:0/1352164056 >> v2:172.21.15.133:3300/0 conn(0x7fc34c15c470 msgr2=0x7fc34c0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc351610700 1 --2- 172.21.15.61:0/1352164056 >> v2:172.21.15.133:3300/0 conn(0x7fc34c15c470 0x7fc34c0b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc351610700 1 -- 172.21.15.61:0/1352164056 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0afe10 con 0x7fc34c15bb60 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc351610700 1 --2- 172.21.15.61:0/1352164056 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15bb60 0x7fc34c098560 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc34c15c8f0 tx=0x7fc348009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc235cc93ab7610b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc33ffff700 1 -- 172.21.15.61:0/1352164056 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348005c10 con 0x7fc34c15bb60 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc33ffff700 1 -- 172.21.15.61:0/1352164056 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348005d70 con 0x7fc34c15bb60 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.090+0000 7fc33ffff700 1 -- 172.21.15.61:0/1352164056 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34800b880 con 0x7fc34c15bb60 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.091+0000 7fc353874700 1 -- 172.21.15.61:0/1352164056 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15bb60 msgr2=0x7fc34c098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.091+0000 7fc353874700 1 --2- 172.21.15.61:0/1352164056 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15bb60 0x7fc34c098560 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc34c15c8f0 tx=0x7fc348009220 comp rx=0 tx=0).stop 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.091+0000 7fc353874700 1 -- 172.21.15.61:0/1352164056 shutdown_connections 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.091+0000 7fc353874700 1 --2- 172.21.15.61:0/1352164056 >> v2:172.21.15.133:3300/0 conn(0x7fc34c15c470 0x7fc34c0b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.091+0000 7fc353874700 1 --2- 172.21.15.61:0/1352164056 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15bb60 0x7fc34c098560 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.091+0000 7fc353874700 1 --2- 172.21.15.61:0/1352164056 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 0x7fc34c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.091+0000 7fc353874700 1 -- 172.21.15.61:0/1352164056 >> 172.21.15.61:0/1352164056 conn(0x7fc34c097a10 msgr2=0x7fc34c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.091+0000 7fc353874700 1 -- 172.21.15.61:0/1352164056 shutdown_connections 2023-12-24T19:58:33.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.091+0000 7fc353874700 1 -- 172.21.15.61:0/1352164056 wait complete. 2023-12-24T19:58:33.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.092+0000 7fc353874700 1 Processor -- start 2023-12-24T19:58:33.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.092+0000 7fc353874700 1 -- start start 2023-12-24T19:58:33.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc353874700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 0x7fc34c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc353874700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c15bb60 0x7fc34c06bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc353874700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15c470 0x7fc34c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc353874700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c068290 con 0x7fc34c15c470 2023-12-24T19:58:33.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc353874700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c1576b0 con 0x7fc34c15bb60 2023-12-24T19:58:33.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc353874700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c067680 con 0x7fc34c098aa0 2023-12-24T19:58:33.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc351e11700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15c470 0x7fc34c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc351e11700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15c470 0x7fc34c06c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47152/0 (socket says 172.21.15.61:47152) 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc351e11700 1 -- 172.21.15.61:0/2824974588 learned_addr learned my addr 172.21.15.61:0/2824974588 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc351610700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 0x7fc34c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc350e0f700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c15bb60 0x7fc34c06bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc351e11700 1 -- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 msgr2=0x7fc34c157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc351e11700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 0x7fc34c157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc351e11700 1 -- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c15bb60 msgr2=0x7fc34c06bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc351e11700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c15bb60 0x7fc34c06bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc351e11700 1 -- 172.21.15.61:0/2824974588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348009480 con 0x7fc34c15c470 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.093+0000 7fc351610700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 0x7fc34c157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.094+0000 7fc351e11700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15c470 0x7fc34c06c190 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc344007f20 tx=0x7fc344009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.094+0000 7fc33d7fa700 1 -- 172.21.15.61:0/2824974588 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34400eca0 con 0x7fc34c15c470 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.094+0000 7fc33d7fa700 1 -- 172.21.15.61:0/2824974588 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34400ee20 con 0x7fc34c15c470 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.094+0000 7fc353874700 1 -- 172.21.15.61:0/2824974588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c067960 con 0x7fc34c15c470 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.094+0000 7fc33d7fa700 1 -- 172.21.15.61:0/2824974588 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc344014670 con 0x7fc34c15c470 2023-12-24T19:58:33.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.094+0000 7fc353874700 1 -- 172.21.15.61:0/2824974588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c067f20 con 0x7fc34c15c470 2023-12-24T19:58:33.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.095+0000 7fc353874700 1 -- 172.21.15.61:0/2824974588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c06d440 con 0x7fc34c15c470 2023-12-24T19:58:33.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.095+0000 7fc33d7fa700 1 -- 172.21.15.61:0/2824974588 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc3440149e0 con 0x7fc34c15c470 2023-12-24T19:58:33.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.096+0000 7fc33d7fa700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc330066f30 0x7fc3300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.096+0000 7fc33d7fa700 1 -- 172.21.15.61:0/2824974588 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc344084990 con 0x7fc34c15c470 2023-12-24T19:58:33.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.096+0000 7fc351610700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc330066f30 0x7fc3300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.096+0000 7fc351610700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc330066f30 0x7fc3300693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc348009260 tx=0x7fc348016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:33.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.100+0000 7fc33d7fa700 1 -- 172.21.15.61:0/2824974588 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc344051eb0 con 0x7fc34c15c470 2023-12-24T19:58:33.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.295+0000 7fc353874700 1 -- 172.21.15.61:0/2824974588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc34c04c3c0 con 0x7fc34c15c470 2023-12-24T19:58:33.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.296+0000 7fc33d7fa700 1 -- 172.21.15.61:0/2824974588 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+12134 (secure 0 0 0) 0x7fc3440554d0 con 0x7fc34c15c470 2023-12-24T19:58:33.298 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:33.298 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":41,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:58:32.517111+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:58:33.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.298+0000 7fc353874700 1 -- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc330066f30 msgr2=0x7fc3300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.298+0000 7fc353874700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc330066f30 0x7fc3300693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc348009260 tx=0x7fc348016000 comp rx=0 tx=0).stop 2023-12-24T19:58:33.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.298+0000 7fc353874700 1 -- 172.21.15.61:0/2824974588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15c470 msgr2=0x7fc34c06c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.299+0000 7fc353874700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15c470 0x7fc34c06c190 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc344007f20 tx=0x7fc344009860 comp rx=0 tx=0).stop 2023-12-24T19:58:33.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.299+0000 7fc353874700 1 -- 172.21.15.61:0/2824974588 shutdown_connections 2023-12-24T19:58:33.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.299+0000 7fc353874700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc34c098aa0 0x7fc34c157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.299+0000 7fc353874700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc330066f30 0x7fc3300693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.299+0000 7fc353874700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc34c15c470 0x7fc34c06c190 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.299+0000 7fc353874700 1 --2- 172.21.15.61:0/2824974588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c15bb60 0x7fc34c06bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.299+0000 7fc353874700 1 -- 172.21.15.61:0/2824974588 >> 172.21.15.61:0/2824974588 conn(0x7fc34c097a10 msgr2=0x7fc34c1579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:33.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.299+0000 7fc353874700 1 -- 172.21.15.61:0/2824974588 shutdown_connections 2023-12-24T19:58:33.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.299+0000 7fc353874700 1 -- 172.21.15.61:0/2824974588 wait complete. 2023-12-24T19:58:33.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T19:58:33.312 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:58:33.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.435+0000 7fa0691a5700 1 Processor -- start 2023-12-24T19:58:33.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.435+0000 7fa0691a5700 1 -- start start 2023-12-24T19:58:33.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.436+0000 7fa0691a5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0640ce360 0x7fa064158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.436+0000 7fa0691a5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06415bad0 con 0x7fa0640cdf90 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.436+0000 7fa0691a5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06415bdb0 con 0x7fa064158a80 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.436+0000 7fa0691a5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06415c090 con 0x7fa0640ce360 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.436+0000 7fa062d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa0640cdf90 0x7fa06406b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39784/0 (socket says 172.21.15.61:39784) 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.436+0000 7fa062d9d700 1 -- 172.21.15.61:0/729452673 learned_addr learned my addr 172.21.15.61:0/729452673 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.436+0000 7fa06259c700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0640ce360 0x7fa064158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682868374 0 0) 0x7fa06415bad0 con 0x7fa0640cdf90 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa04c003570 con 0x7fa0640cdf90 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1110348189 0 0) 0x7fa04c003570 con 0x7fa0640cdf90 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0640ce360 msgr2=0x7fa064158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0640ce360 0x7fa064158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 >> v1:172.21.15.133:6789/0 conn(0x7fa064158a80 legacy=0x7fa0640cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06415c370 con 0x7fa0640cdf90 2023-12-24T19:58:33.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fa058001470 con 0x7fa0640cdf90 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 >> v1:172.21.15.61:6789/0 conn(0x7fa0640cdf90 legacy=0x7fa06406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0640ce360 0x7fa04c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa04c003fd0 0x7fa04c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa04c004d50 0x7fa04c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06415c090 con 0x7fa04c004d50 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c00bb40 con 0x7fa04c003fd0 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c00bd00 con 0x7fa0640ce360 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa06259c700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa04c003fd0 0x7fa04c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa062d9d700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0640ce360 0x7fa04c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa06359e700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa04c004d50 0x7fa04c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa06259c700 1 -- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0640ce360 msgr2=0x7fa04c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa06259c700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0640ce360 0x7fa04c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa06259c700 1 -- 172.21.15.61:0/729452673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa04c004d50 msgr2=0x7fa04c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:33.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa06259c700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa04c004d50 0x7fa04c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa06259c700 1 -- 172.21.15.61:0/729452673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c003570 con 0x7fa04c003fd0 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa062d9d700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa0640ce360 0x7fa04c003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.437+0000 7fa06359e700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa04c004d50 0x7fa04c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa06259c700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa04c003fd0 0x7fa04c004810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa054009c00 tx=0x7fa0540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ff92b7d9f4a2a00 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400e710 con 0x7fa04c003fd0 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05400e870 con 0x7fa04c003fd0 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa061d9b700 1 -- 172.21.15.61:0/729452673 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400ec30 con 0x7fa04c003fd0 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa0691a5700 1 -- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa04c003fd0 msgr2=0x7fa04c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa0691a5700 1 --2- 172.21.15.61:0/729452673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa04c003fd0 0x7fa04c004810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa054009c00 tx=0x7fa0540091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa06359e700 1 -- 172.21.15.61:0/729452673 reap_dead start 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa0691a5700 1 -- 172.21.15.61:0/729452673 shutdown_connections 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa0691a5700 1 -- 172.21.15.61:0/729452673 >> 172.21.15.61:0/729452673 conn(0x7fa06406f810 msgr2=0x7fa06406ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa0691a5700 1 -- 172.21.15.61:0/729452673 shutdown_connections 2023-12-24T19:58:33.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.438+0000 7fa0691a5700 1 -- 172.21.15.61:0/729452673 wait complete. 2023-12-24T19:58:33.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa0691a5700 1 Processor -- start 2023-12-24T19:58:33.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa0691a5700 1 -- start start 2023-12-24T19:58:33.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa0691a5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa04c003fd0 0x7fa0640b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa0691a5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa0641483e0 0x7fa0640af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa0691a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa064148850 0x7fa0640afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa0691a5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa064168900 con 0x7fa0641483e0 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa0691a5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640b1e40 con 0x7fa064148850 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa0691a5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640b2810 con 0x7fa04c003fd0 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa06259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa0641483e0 0x7fa0640af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa06259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa0641483e0 0x7fa0640af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47172/0 (socket says 172.21.15.61:47172) 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.440+0000 7fa06259c700 1 -- 172.21.15.61:0/2545463966 learned_addr learned my addr 172.21.15.61:0/2545463966 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa06359e700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa064148850 0x7fa0640afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa062d9d700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa04c003fd0 0x7fa0640b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa06259c700 1 -- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa04c003fd0 msgr2=0x7fa0640b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa06259c700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa04c003fd0 0x7fa0640b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa06259c700 1 -- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa064148850 msgr2=0x7fa0640afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa06259c700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa064148850 0x7fa0640afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa06259c700 1 -- 172.21.15.61:0/2545463966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0640b3fe0 con 0x7fa0641483e0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa06259c700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa0641483e0 0x7fa0640af770 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00bcd0 tx=0x7fa05401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa04affd700 1 -- 172.21.15.61:0/2545463966 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054022070 con 0x7fa0641483e0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa04affd700 1 -- 172.21.15.61:0/2545463966 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05400e9e0 con 0x7fa0641483e0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa04affd700 1 -- 172.21.15.61:0/2545463966 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054027470 con 0x7fa0641483e0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa0691a5700 1 -- 172.21.15.61:0/2545463966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0640b42c0 con 0x7fa0641483e0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.441+0000 7fa0691a5700 1 -- 172.21.15.61:0/2545463966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0640b1ad0 con 0x7fa0641483e0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.442+0000 7fa0691a5700 1 -- 172.21.15.61:0/2545463966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0640b1fd0 con 0x7fa0641483e0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.443+0000 7fa04affd700 1 -- 172.21.15.61:0/2545463966 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa05401c450 con 0x7fa0641483e0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.443+0000 7fa04affd700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa050066f30 0x7fa0500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.443+0000 7fa04affd700 1 -- 172.21.15.61:0/2545463966 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa054085f80 con 0x7fa0641483e0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.443+0000 7fa062d9d700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa050066f30 0x7fa0500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.444+0000 7fa062d9d700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa050066f30 0x7fa0500693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa058000e10 tx=0x7fa058009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:33.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.447+0000 7fa04affd700 1 -- 172.21.15.61:0/2545463966 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0540b75a0 con 0x7fa0641483e0 2023-12-24T19:58:33.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.641+0000 7fa0691a5700 1 -- 172.21.15.61:0/2545463966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa06404c3c0 con 0x7fa0641483e0 2023-12-24T19:58:33.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.642+0000 7fa04affd700 1 -- 172.21.15.61:0/2545463966 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa054017020 con 0x7fa0641483e0 2023-12-24T19:58:33.643 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:58:33.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 -- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa050066f30 msgr2=0x7fa0500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa050066f30 0x7fa0500693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa058000e10 tx=0x7fa058009040 comp rx=0 tx=0).stop 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 -- 172.21.15.61:0/2545463966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa0641483e0 msgr2=0x7fa0640af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa0641483e0 0x7fa0640af770 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00bcd0 tx=0x7fa05401a000 comp rx=0 tx=0).stop 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 -- 172.21.15.61:0/2545463966 shutdown_connections 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa04c003fd0 0x7fa0640b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa050066f30 0x7fa0500693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa064148850 0x7fa0640afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 --2- 172.21.15.61:0/2545463966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa0641483e0 0x7fa0640af770 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 -- 172.21.15.61:0/2545463966 >> 172.21.15.61:0/2545463966 conn(0x7fa06406f810 msgr2=0x7fa0640cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 -- 172.21.15.61:0/2545463966 shutdown_connections 2023-12-24T19:58:33.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.644+0000 7fa0691a5700 1 -- 172.21.15.61:0/2545463966 wait complete. 2023-12-24T19:58:33.657 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T19:58:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.777+0000 7fe0eb364700 1 Processor -- start 2023-12-24T19:58:33.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.777+0000 7fe0eb364700 1 -- start start 2023-12-24T19:58:33.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.778+0000 7fe0eb364700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe0e4068510 0x7fe0e40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.778+0000 7fe0eb364700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0e4159a60 0x7fe0e4159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.778+0000 7fe0eb364700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e40b2890 con 0x7fe0e4068140 2023-12-24T19:58:33.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.778+0000 7fe0eb364700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e40cf630 con 0x7fe0e4068510 2023-12-24T19:58:33.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.778+0000 7fe0eb364700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e40b2240 con 0x7fe0e4159a60 2023-12-24T19:58:33.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.778+0000 7fe0e88ff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe0e4068510 0x7fe0e40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.778+0000 7fe0e9100700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe0e4068140 0x7fe0e40b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39792/0 (socket says 172.21.15.61:39792) 2023-12-24T19:58:33.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.778+0000 7fe0e88ff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe0e4068510 0x7fe0e40cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47174/0 (socket says 172.21.15.61:47174) 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.778+0000 7fe0e9100700 1 -- 172.21.15.61:0/1667365673 learned_addr learned my addr 172.21.15.61:0/1667365673 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0e9901700 1 --2- 172.21.15.61:0/1667365673 >> v2:172.21.15.133:3300/0 conn(0x7fe0e4159a60 0x7fe0e4159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0e88ff700 1 -- 172.21.15.61:0/1667365673 >> v2:172.21.15.133:3300/0 conn(0x7fe0e4159a60 msgr2=0x7fe0e4159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0e88ff700 1 --2- 172.21.15.61:0/1667365673 >> v2:172.21.15.133:3300/0 conn(0x7fe0e4159a60 0x7fe0e4159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0e88ff700 1 -- 172.21.15.61:0/1667365673 >> v1:172.21.15.61:6789/0 conn(0x7fe0e4068140 legacy=0x7fe0e40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0e88ff700 1 -- 172.21.15.61:0/1667365673 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40b2520 con 0x7fe0e4068510 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0e9901700 1 --2- 172.21.15.61:0/1667365673 >> v2:172.21.15.133:3300/0 conn(0x7fe0e4159a60 0x7fe0e4159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0e88ff700 1 --2- 172.21.15.61:0/1667365673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068510 0x7fe0e40cefa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe0e406eaf0 tx=0x7fe0e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9ebe214b318e00 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0d7fff700 1 -- 172.21.15.61:0/1667365673 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000b6b0 con 0x7fe0e4068510 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0d7fff700 1 -- 172.21.15.61:0/1667365673 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e000b810 con 0x7fe0e4068510 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0d7fff700 1 -- 172.21.15.61:0/1667365673 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000bbb0 con 0x7fe0e4068510 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0eb364700 1 -- 172.21.15.61:0/1667365673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068510 msgr2=0x7fe0e40cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.779+0000 7fe0eb364700 1 --2- 172.21.15.61:0/1667365673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068510 0x7fe0e40cefa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe0e406eaf0 tx=0x7fe0e00091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.780+0000 7fe0eb364700 1 -- 172.21.15.61:0/1667365673 shutdown_connections 2023-12-24T19:58:33.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.780+0000 7fe0eb364700 1 --2- 172.21.15.61:0/1667365673 >> v2:172.21.15.133:3300/0 conn(0x7fe0e4159a60 0x7fe0e4159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.780+0000 7fe0eb364700 1 --2- 172.21.15.61:0/1667365673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068510 0x7fe0e40cefa0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.780+0000 7fe0eb364700 1 -- 172.21.15.61:0/1667365673 >> 172.21.15.61:0/1667365673 conn(0x7fe0e4097a10 msgr2=0x7fe0e40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:33.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.780+0000 7fe0eb364700 1 -- 172.21.15.61:0/1667365673 shutdown_connections 2023-12-24T19:58:33.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.780+0000 7fe0eb364700 1 -- 172.21.15.61:0/1667365673 wait complete. 2023-12-24T19:58:33.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.781+0000 7fe0eb364700 1 Processor -- start 2023-12-24T19:58:33.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.781+0000 7fe0eb364700 1 -- start start 2023-12-24T19:58:33.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0eb364700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068140 0x7fe0e41433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0eb364700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4068510 0x7fe0e406be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0eb364700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0e4159a60 0x7fe0e406c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0eb364700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4146700 con 0x7fe0e4068140 2023-12-24T19:58:33.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0eb364700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4145af0 con 0x7fe0e4068510 2023-12-24T19:58:33.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0eb364700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4145dd0 con 0x7fe0e4159a60 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e9100700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068140 0x7fe0e41433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e9100700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068140 0x7fe0e41433a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47186/0 (socket says 172.21.15.61:47186) 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e9100700 1 -- 172.21.15.61:0/2261070008 learned_addr learned my addr 172.21.15.61:0/2261070008 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e88ff700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4068510 0x7fe0e406be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e9100700 1 -- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0e4159a60 msgr2=0x7fe0e406c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e9901700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0e4159a60 0x7fe0e406c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e9100700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0e4159a60 0x7fe0e406c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e9100700 1 -- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4068510 msgr2=0x7fe0e406be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e9100700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4068510 0x7fe0e406be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e9100700 1 -- 172.21.15.61:0/2261070008 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0009420 con 0x7fe0e4068140 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e88ff700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4068510 0x7fe0e406be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0e9100700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068140 0x7fe0e41433a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800c7c0 tx=0x7fe0d8007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0d57fa700 1 -- 172.21.15.61:0/2261070008 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d80073d0 con 0x7fe0e4068140 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0d57fa700 1 -- 172.21.15.61:0/2261070008 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d8007530 con 0x7fe0e4068140 2023-12-24T19:58:33.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0eb364700 1 -- 172.21.15.61:0/2261070008 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e41460b0 con 0x7fe0e4068140 2023-12-24T19:58:33.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.782+0000 7fe0d57fa700 1 -- 172.21.15.61:0/2261070008 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8005a40 con 0x7fe0e4068140 2023-12-24T19:58:33.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.783+0000 7fe0eb364700 1 -- 172.21.15.61:0/2261070008 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e4146b90 con 0x7fe0e4068140 2023-12-24T19:58:33.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.783+0000 7fe0eb364700 1 -- 172.21.15.61:0/2261070008 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e406d440 con 0x7fe0e4068140 2023-12-24T19:58:33.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.784+0000 7fe0d57fa700 1 -- 172.21.15.61:0/2261070008 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe0d801b400 con 0x7fe0e4068140 2023-12-24T19:58:33.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.784+0000 7fe0d57fa700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe0c8066f30 0x7fe0c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:33.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.784+0000 7fe0d57fa700 1 -- 172.21.15.61:0/2261070008 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe0d8083c50 con 0x7fe0e4068140 2023-12-24T19:58:33.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.784+0000 7fe0e88ff700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe0c8066f30 0x7fe0c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:33.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.785+0000 7fe0e88ff700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe0c8066f30 0x7fe0c80693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe0e406cc90 tx=0x7fe0e0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:33.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.789+0000 7fe0d57fa700 1 -- 172.21.15.61:0/2261070008 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0d8089020 con 0x7fe0e4068140 2023-12-24T19:58:33.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.986+0000 7fe0eb364700 1 -- 172.21.15.61:0/2261070008 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe0e404c3c0 con 0x7fe0e4068140 2023-12-24T19:58:33.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.986+0000 7fe0d57fa700 1 -- 172.21.15.61:0/2261070008 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe0d8051290 con 0x7fe0e4068140 2023-12-24T19:58:33.988 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:33.989 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T19:58:33.989 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:33.989 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T19:58:33.989 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T19:58:33.989 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:33.990 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T19:58:33.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 -- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe0c8066f30 msgr2=0x7fe0c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe0c8066f30 0x7fe0c80693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe0e406cc90 tx=0x7fe0e0017000 comp rx=0 tx=0).stop 2023-12-24T19:58:33.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 -- 172.21.15.61:0/2261070008 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068140 msgr2=0x7fe0e41433a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:33.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068140 0x7fe0e41433a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800c7c0 tx=0x7fe0d8007de0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 -- 172.21.15.61:0/2261070008 shutdown_connections 2023-12-24T19:58:33.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0e4159a60 0x7fe0e406c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe0c8066f30 0x7fe0c80693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0e4068140 0x7fe0e41433a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 --2- 172.21.15.61:0/2261070008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0e4068510 0x7fe0e406be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:33.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 -- 172.21.15.61:0/2261070008 >> 172.21.15.61:0/2261070008 conn(0x7fe0e4097a10 msgr2=0x7fe0e40af330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:33.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.988+0000 7fe0eb364700 1 -- 172.21.15.61:0/2261070008 shutdown_connections 2023-12-24T19:58:33.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:33.989+0000 7fe0eb364700 1 -- 172.21.15.61:0/2261070008 wait complete. 2023-12-24T19:58:34.002 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T19:58:34.002 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T19:58:34.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.125+0000 7f4c832ba700 1 Processor -- start 2023-12-24T19:58:34.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.125+0000 7f4c832ba700 1 -- start start 2023-12-24T19:58:34.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.126+0000 7f4c832ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c7c159af0 0x7f4c7c068770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.126+0000 7f4c832ba700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7c15adc0 con 0x7f4c7c0cd0b0 2023-12-24T19:58:34.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.126+0000 7f4c832ba700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7c15a1b0 con 0x7f4c7c068cb0 2023-12-24T19:58:34.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.126+0000 7f4c832ba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c0cc1c0 con 0x7f4c7c159af0 2023-12-24T19:58:34.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.126+0000 7f4c81857700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4c7c0cd0b0 0x7f4c7c069aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39798/0 (socket says 172.21.15.61:39798) 2023-12-24T19:58:34.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.126+0000 7f4c81857700 1 -- 172.21.15.61:0/1238810767 learned_addr learned my addr 172.21.15.61:0/1238810767 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:34.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c81056700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c7c159af0 0x7f4c7c068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591823271 0 0) 0x7f4c7c15adc0 con 0x7f4c7c0cd0b0 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c68003570 con 0x7f4c7c0cd0b0 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3831681567 0 0) 0x7f4c68003570 con 0x7f4c7c0cd0b0 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c7c159af0 msgr2=0x7f4c7c068770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c7c159af0 0x7f4c7c068770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 >> v1:172.21.15.133:6789/0 conn(0x7f4c7c068cb0 legacy=0x7f4c7c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c15a490 con 0x7f4c7c0cd0b0 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f4c740017f0 con 0x7f4c7c0cd0b0 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 >> v1:172.21.15.61:6789/0 conn(0x7f4c7c0cd0b0 legacy=0x7f4c7c069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c7c159af0 0x7f4c68003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68003fd0 0x7f4c68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c68004d50 0x7f4c680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6800bb10 con 0x7f4c68004d50 2023-12-24T19:58:34.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6800bc80 con 0x7f4c68003fd0 2023-12-24T19:58:34.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6800be40 con 0x7f4c7c159af0 2023-12-24T19:58:34.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c81857700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c68004d50 0x7f4c680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c81056700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c7c159af0 0x7f4c68003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.127+0000 7f4c80855700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68003fd0 0x7f4c68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c81857700 1 -- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c7c159af0 msgr2=0x7f4c68003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:34.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c81857700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c7c159af0 0x7f4c68003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c81857700 1 -- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68003fd0 msgr2=0x7f4c68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c81857700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68003fd0 0x7f4c68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c81857700 1 -- 172.21.15.61:0/1238810767 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68003570 con 0x7f4c68004d50 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c81056700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c7c159af0 0x7f4c68003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c81857700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c68004d50 0x7f4c680051c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400a950 tx=0x7f4c740021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c354c890d927441e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c740070d0 con 0x7f4c68004d50 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c74007230 con 0x7f4c68004d50 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c73fff700 1 -- 172.21.15.61:0/1238810767 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c740075f0 con 0x7f4c68004d50 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c832ba700 1 -- 172.21.15.61:0/1238810767 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c68004d50 msgr2=0x7f4c680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c832ba700 1 --2- 172.21.15.61:0/1238810767 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c68004d50 0x7f4c680051c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400a950 tx=0x7f4c740021f0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c81857700 1 -- 172.21.15.61:0/1238810767 reap_dead start 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c832ba700 1 -- 172.21.15.61:0/1238810767 shutdown_connections 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.128+0000 7f4c832ba700 1 -- 172.21.15.61:0/1238810767 >> 172.21.15.61:0/1238810767 conn(0x7f4c7c0ce190 msgr2=0x7f4c7c0ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.129+0000 7f4c832ba700 1 -- 172.21.15.61:0/1238810767 shutdown_connections 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.129+0000 7f4c832ba700 1 -- 172.21.15.61:0/1238810767 wait complete. 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.130+0000 7f4c832ba700 1 Processor -- start 2023-12-24T19:58:34.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.130+0000 7f4c832ba700 1 -- start start 2023-12-24T19:58:34.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c832ba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c68004d50 0x7f4c7c0c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c832ba700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c7c155fe0 0x7f4c7c0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c832ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c7c15b150 0x7f4c7c15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c832ba700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c15bb10 con 0x7f4c7c155fe0 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c832ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c0b25f0 con 0x7f4c7c15b150 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c832ba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c0b2fc0 con 0x7f4c68004d50 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c80855700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c7c155fe0 0x7f4c7c0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c80855700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c7c155fe0 0x7f4c7c0b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47202/0 (socket says 172.21.15.61:47202) 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c80855700 1 -- 172.21.15.61:0/2585740623 learned_addr learned my addr 172.21.15.61:0/2585740623 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c81056700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c68004d50 0x7f4c7c0c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c81857700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c7c15b150 0x7f4c7c15b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c80855700 1 -- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c68004d50 msgr2=0x7f4c7c0c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c80855700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c68004d50 0x7f4c7c0c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c80855700 1 -- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c7c15b150 msgr2=0x7f4c7c15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c80855700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c7c15b150 0x7f4c7c15b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c80855700 1 -- 172.21.15.61:0/2585740623 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c0b19e0 con 0x7f4c7c155fe0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c81056700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c68004d50 0x7f4c7c0c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c80855700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c7c155fe0 0x7f4c7c0b2a80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4c78002b30 tx=0x7f4c78007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c717fa700 1 -- 172.21.15.61:0/2585740623 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800f9a0 con 0x7f4c7c155fe0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c717fa700 1 -- 172.21.15.61:0/2585740623 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7800fb00 con 0x7f4c7c155fe0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c832ba700 1 -- 172.21.15.61:0/2585740623 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c0b1cc0 con 0x7f4c7c155fe0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c717fa700 1 -- 172.21.15.61:0/2585740623 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800fec0 con 0x7f4c7c155fe0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.131+0000 7f4c832ba700 1 -- 172.21.15.61:0/2585740623 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c0b2280 con 0x7f4c7c155fe0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.132+0000 7f4c832ba700 1 -- 172.21.15.61:0/2585740623 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c04c3c0 con 0x7f4c7c155fe0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.133+0000 7f4c717fa700 1 -- 172.21.15.61:0/2585740623 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4c78013600 con 0x7f4c7c155fe0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.133+0000 7f4c717fa700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c60066f30 0x7f4c600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.133+0000 7f4c717fa700 1 -- 172.21.15.61:0/2585740623 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4c78084340 con 0x7f4c7c155fe0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.133+0000 7f4c81056700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c60066f30 0x7f4c600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.134+0000 7f4c81056700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c60066f30 0x7f4c600693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c006eb0 tx=0x7f4c6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:34.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.137+0000 7f4c717fa700 1 -- 172.21.15.61:0/2585740623 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c78051900 con 0x7f4c7c155fe0 2023-12-24T19:58:34.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.331+0000 7f4c832ba700 1 -- 172.21.15.61:0/2585740623 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4c7c0b2730 con 0x7f4c7c155fe0 2023-12-24T19:58:34.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.541+0000 7f4c717fa700 1 -- 172.21.15.61:0/2585740623 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4c78054f20 con 0x7f4c7c155fe0 2023-12-24T19:58:34.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 -- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c60066f30 msgr2=0x7f4c600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c60066f30 0x7f4c600693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c006eb0 tx=0x7f4c6c008040 comp rx=0 tx=0).stop 2023-12-24T19:58:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 -- 172.21.15.61:0/2585740623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c7c155fe0 msgr2=0x7f4c7c0b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c7c155fe0 0x7f4c7c0b2a80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4c78002b30 tx=0x7f4c78007d10 comp rx=0 tx=0).stop 2023-12-24T19:58:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 -- 172.21.15.61:0/2585740623 shutdown_connections 2023-12-24T19:58:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c68004d50 0x7f4c7c0c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c60066f30 0x7f4c600693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c7c15b150 0x7f4c7c15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 --2- 172.21.15.61:0/2585740623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c7c155fe0 0x7f4c7c0b2a80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 -- 172.21.15.61:0/2585740623 >> 172.21.15.61:0/2585740623 conn(0x7f4c7c0ce190 msgr2=0x7f4c7c0c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:34.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 -- 172.21.15.61:0/2585740623 shutdown_connections 2023-12-24T19:58:34.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.544+0000 7f4c832ba700 1 -- 172.21.15.61:0/2585740623 wait complete. 2023-12-24T19:58:34.549 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T19:58:34.557 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T19:58:34.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.684+0000 7fdf82b11700 1 Processor -- start 2023-12-24T19:58:34.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.684+0000 7fdf82b11700 1 -- start start 2023-12-24T19:58:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf82b11700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdf7c15afd0 0x7fdf7c0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf82b11700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7c0c8c30 con 0x7fdf7c15ac00 2023-12-24T19:58:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf82b11700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7c0c7e00 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf82b11700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7c0cb7c0 con 0x7fdf7c15afd0 2023-12-24T19:58:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf7bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdf7c15afd0 0x7fdf7c0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf7bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdf7c15afd0 0x7fdf7c0cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47212/0 (socket says 172.21.15.61:47212) 2023-12-24T19:58:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf7bfff700 1 -- 172.21.15.61:0/22141646 learned_addr learned my addr 172.21.15.61:0/22141646 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf808ad700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fdf7c15ac00 0x7fdf7c0c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39814/0 (socket says 172.21.15.61:39814) 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf7bfff700 1 -- 172.21.15.61:0/22141646 >> v1:172.21.15.133:6789/0 conn(0x7fdf7c0cb3d0 legacy=0x7fdf7c0aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf7bfff700 1 -- 172.21.15.61:0/22141646 >> v1:172.21.15.61:6789/0 conn(0x7fdf7c15ac00 legacy=0x7fdf7c0c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf7bfff700 1 -- 172.21.15.61:0/22141646 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0c80b0 con 0x7fdf7c15afd0 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.685+0000 7fdf7b7fe700 1 -- 172.21.15.61:0/22141646 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787949180 0 0) 0x7fdf7c0c8c30 con 0x7fdf7c15ac00 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf7bfff700 1 --2- 172.21.15.61:0/22141646 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c15afd0 0x7fdf7c0cae90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdf680099b0 tx=0x7fdf68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb10b18b7ddd105 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf7b7fe700 1 -- 172.21.15.61:0/22141646 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800b860 con 0x7fdf7c15afd0 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf7b7fe700 1 -- 172.21.15.61:0/22141646 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6800b9c0 con 0x7fdf7c15afd0 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf7b7fe700 1 -- 172.21.15.61:0/22141646 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800bd60 con 0x7fdf7c15afd0 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf82b11700 1 -- 172.21.15.61:0/22141646 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c15afd0 msgr2=0x7fdf7c0cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf82b11700 1 --2- 172.21.15.61:0/22141646 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c15afd0 0x7fdf7c0cae90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdf680099b0 tx=0x7fdf68009250 comp rx=0 tx=0).stop 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf82b11700 1 -- 172.21.15.61:0/22141646 shutdown_connections 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf82b11700 1 --2- 172.21.15.61:0/22141646 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c15afd0 0x7fdf7c0cae90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf82b11700 1 -- 172.21.15.61:0/22141646 >> 172.21.15.61:0/22141646 conn(0x7fdf7c0cd0b0 msgr2=0x7fdf7c0cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf82b11700 1 -- 172.21.15.61:0/22141646 shutdown_connections 2023-12-24T19:58:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.686+0000 7fdf82b11700 1 -- 172.21.15.61:0/22141646 wait complete. 2023-12-24T19:58:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.687+0000 7fdf82b11700 1 Processor -- start 2023-12-24T19:58:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.688+0000 7fdf82b11700 1 -- start start 2023-12-24T19:58:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.688+0000 7fdf82b11700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c0cb3d0 0x7fdf7c152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.688+0000 7fdf82b11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c15ac00 0x7fdf7c0afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.688+0000 7fdf82b11700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf7c15afd0 0x7fdf7c0aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.688+0000 7fdf82b11700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0b13b0 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.688+0000 7fdf82b11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0b07a0 con 0x7fdf7c15ac00 2023-12-24T19:58:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.688+0000 7fdf82b11700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0b0a80 con 0x7fdf7c15afd0 2023-12-24T19:58:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.688+0000 7fdf808ad700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c0cb3d0 0x7fdf7c152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.688+0000 7fdf808ad700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c0cb3d0 0x7fdf7c152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47226/0 (socket says 172.21.15.61:47226) 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.688+0000 7fdf808ad700 1 -- 172.21.15.61:0/2670408456 learned_addr learned my addr 172.21.15.61:0/2670408456 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf7bfff700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c15ac00 0x7fdf7c0afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf810ae700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf7c15afd0 0x7fdf7c0aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf808ad700 1 -- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf7c15afd0 msgr2=0x7fdf7c0aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf808ad700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf7c15afd0 0x7fdf7c0aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf808ad700 1 -- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c15ac00 msgr2=0x7fdf7c0afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf808ad700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c15ac00 0x7fdf7c0afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf808ad700 1 -- 172.21.15.61:0/2670408456 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf680094f0 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf7bfff700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c15ac00 0x7fdf7c0afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf810ae700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf7c15afd0 0x7fdf7c0aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf808ad700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c0cb3d0 0x7fdf7c152f60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000c7c0 tx=0x7fdf70007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf78ff9700 1 -- 172.21.15.61:0/2670408456 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70007300 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf78ff9700 1 -- 172.21.15.61:0/2670408456 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf70007480 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf82b11700 1 -- 172.21.15.61:0/2670408456 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c0b0d60 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf78ff9700 1 -- 172.21.15.61:0/2670408456 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf700057f0 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.689+0000 7fdf82b11700 1 -- 172.21.15.61:0/2670408456 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c1534a0 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.690+0000 7fdf82b11700 1 -- 172.21.15.61:0/2670408456 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7c0c5a50 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.691+0000 7fdf78ff9700 1 -- 172.21.15.61:0/2670408456 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdf70005b60 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.691+0000 7fdf78ff9700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf60066f30 0x7fdf600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.692+0000 7fdf78ff9700 1 -- 172.21.15.61:0/2670408456 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fdf70083dc0 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.692+0000 7fdf7bfff700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf60066f30 0x7fdf600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:34.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.692+0000 7fdf7bfff700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf60066f30 0x7fdf600693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf680099b0 tx=0x7fdf68017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:34.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.696+0000 7fdf78ff9700 1 -- 172.21.15.61:0/2670408456 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf70054d20 con 0x7fdf7c0cb3d0 2023-12-24T19:58:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:34.890+0000 7fdf82b11700 1 -- 172.21.15.61:0/2670408456 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdf7c04c3c0 con 0x7fdf7c0cb3d0 2023-12-24T19:58:35.518 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:58:35.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:58:35.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.544+0000 7fdf78ff9700 1 -- 172.21.15.61:0/2670408456 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdf700548b0 con 0x7fdf7c0cb3d0 2023-12-24T19:58:35.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.551+0000 7fdf82b11700 1 -- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf60066f30 msgr2=0x7fdf600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:35.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.551+0000 7fdf82b11700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf60066f30 0x7fdf600693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf680099b0 tx=0x7fdf68017000 comp rx=0 tx=0).stop 2023-12-24T19:58:35.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.551+0000 7fdf82b11700 1 -- 172.21.15.61:0/2670408456 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c0cb3d0 msgr2=0x7fdf7c152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:35.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.551+0000 7fdf82b11700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c0cb3d0 0x7fdf7c152f60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000c7c0 tx=0x7fdf70007cd0 comp rx=0 tx=0).stop 2023-12-24T19:58:35.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.551+0000 7fdf82b11700 1 -- 172.21.15.61:0/2670408456 shutdown_connections 2023-12-24T19:58:35.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.551+0000 7fdf82b11700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf7c15afd0 0x7fdf7c0aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:35.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.551+0000 7fdf82b11700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf60066f30 0x7fdf600693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:35.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.551+0000 7fdf82b11700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf7c0cb3d0 0x7fdf7c152f60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:35.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.551+0000 7fdf82b11700 1 --2- 172.21.15.61:0/2670408456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7c15ac00 0x7fdf7c0afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:35.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.551+0000 7fdf82b11700 1 -- 172.21.15.61:0/2670408456 >> 172.21.15.61:0/2670408456 conn(0x7fdf7c0cd0b0 msgr2=0x7fdf7c06d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:35.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.552+0000 7fdf82b11700 1 -- 172.21.15.61:0/2670408456 shutdown_connections 2023-12-24T19:58:35.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.552+0000 7fdf82b11700 1 -- 172.21.15.61:0/2670408456 wait complete. 2023-12-24T19:58:35.555 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T19:58:35.569 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T19:58:35.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.763+0000 7fd8b7628700 1 Processor -- start 2023-12-24T19:58:35.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.764+0000 7fd8b7628700 1 -- start start 2023-12-24T19:58:35.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.764+0000 7fd8b7628700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b0158c50 0x7fd8b0162a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.764+0000 7fd8b7628700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b015bad0 con 0x7fd8b00ce360 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8b7628700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b015bdb0 con 0x7fd8b00cdf90 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8b7628700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b01590d0 con 0x7fd8b0158c50 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8b4bc3700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd8b00ce360 0x7fd8b0158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39826/0 (socket says 172.21.15.61:39826) 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8b4bc3700 1 -- 172.21.15.61:0/1428917752 learned_addr learned my addr 172.21.15.61:0/1428917752 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8b5bc5700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b0158c50 0x7fd8b0162a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020259402 0 0) 0x7fd8b015bad0 con 0x7fd8b00ce360 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd89c003570 con 0x7fd8b00ce360 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 785439797 0 0) 0x7fd89c003570 con 0x7fd8b00ce360 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b0158c50 msgr2=0x7fd8b0162a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b0158c50 0x7fd8b0162a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 >> v1:172.21.15.133:6789/0 conn(0x7fd8b00cdf90 legacy=0x7fd8b006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:35.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b015c090 con 0x7fd8b00ce360 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fd8a0001470 con 0x7fd8b00ce360 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 >> v1:172.21.15.61:6789/0 conn(0x7fd8b00ce360 legacy=0x7fd8b0158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c003a90 0x7fd89c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b0158c50 0x7fd89c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c004d50 0x7fd89c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b01590d0 con 0x7fd89c004d50 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c00bb40 con 0x7fd89c003a90 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c00bd00 con 0x7fd8b0158c50 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.765+0000 7fd8b5bc5700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c004d50 0x7fd89c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8b53c4700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c003a90 0x7fd89c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8b4bc3700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b0158c50 0x7fd89c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8b5bc5700 1 -- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b0158c50 msgr2=0x7fd89c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8b5bc5700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b0158c50 0x7fd89c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8b5bc5700 1 -- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c003a90 msgr2=0x7fd89c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:35.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8b5bc5700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c003a90 0x7fd89c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8b5bc5700 1 -- 172.21.15.61:0/1428917752 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c003570 con 0x7fd89c004d50 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8b5bc5700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c004d50 0x7fd89c0051c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800e210 tx=0x7fd8a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f581dcd1eb8d18ab server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a800eac0 con 0x7fd89c004d50 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a800f040 con 0x7fd89c004d50 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.766+0000 7fd8a7fff700 1 -- 172.21.15.61:0/1428917752 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a800ee70 con 0x7fd89c004d50 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.767+0000 7fd8b7628700 1 -- 172.21.15.61:0/1428917752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c004d50 msgr2=0x7fd89c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.767+0000 7fd8b7628700 1 --2- 172.21.15.61:0/1428917752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd89c004d50 0x7fd89c0051c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800e210 tx=0x7fd8a800b040 comp rx=0 tx=0).stop 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.767+0000 7fd8b5bc5700 1 -- 172.21.15.61:0/1428917752 reap_dead start 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.767+0000 7fd8b7628700 1 -- 172.21.15.61:0/1428917752 shutdown_connections 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.767+0000 7fd8b7628700 1 -- 172.21.15.61:0/1428917752 >> 172.21.15.61:0/1428917752 conn(0x7fd8b006f810 msgr2=0x7fd8b006ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.767+0000 7fd8b7628700 1 -- 172.21.15.61:0/1428917752 shutdown_connections 2023-12-24T19:58:35.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.767+0000 7fd8b7628700 1 -- 172.21.15.61:0/1428917752 wait complete. 2023-12-24T19:58:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.768+0000 7fd8b7628700 1 Processor -- start 2023-12-24T19:58:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.768+0000 7fd8b7628700 1 -- start start 2023-12-24T19:58:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b7628700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd89c004d50 0x7fd8b01577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b7628700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8b00b4280 0x7fd8b00b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b7628700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b015dd70 0x7fd8b015e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b7628700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b015e750 con 0x7fd8b015dd70 2023-12-24T19:58:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b7628700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00c6c00 con 0x7fd8b00b4280 2023-12-24T19:58:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b7628700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00c6d90 con 0x7fd89c004d50 2023-12-24T19:58:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b5bc5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b015dd70 0x7fd8b015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b5bc5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b015dd70 0x7fd8b015e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47236/0 (socket says 172.21.15.61:47236) 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b5bc5700 1 -- 172.21.15.61:0/2267920449 learned_addr learned my addr 172.21.15.61:0/2267920449 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b53c4700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd89c004d50 0x7fd8b01577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b4bc3700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8b00b4280 0x7fd8b00b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b5bc5700 1 -- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd89c004d50 msgr2=0x7fd8b01577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b5bc5700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd89c004d50 0x7fd8b01577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b5bc5700 1 -- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8b00b4280 msgr2=0x7fd8b00b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b5bc5700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8b00b4280 0x7fd8b00b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b5bc5700 1 -- 172.21.15.61:0/2267920449 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b00b2160 con 0x7fd8b015dd70 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.769+0000 7fd8b53c4700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd89c004d50 0x7fd8b01577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.770+0000 7fd8b5bc5700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b015dd70 0x7fd8b015e210 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8016000 tx=0x7fd8a801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.770+0000 7fd8a57fa700 1 -- 172.21.15.61:0/2267920449 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8014e10 con 0x7fd8b015dd70 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.770+0000 7fd8a57fa700 1 -- 172.21.15.61:0/2267920449 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a8022070 con 0x7fd8b015dd70 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.770+0000 7fd8b7628700 1 -- 172.21.15.61:0/2267920449 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b00b2440 con 0x7fd8b015dd70 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.770+0000 7fd8a57fa700 1 -- 172.21.15.61:0/2267920449 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8027680 con 0x7fd8b015dd70 2023-12-24T19:58:35.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.770+0000 7fd8b7628700 1 -- 172.21.15.61:0/2267920449 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b00b2a00 con 0x7fd8b015dd70 2023-12-24T19:58:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.771+0000 7fd8b7628700 1 -- 172.21.15.61:0/2267920449 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b00c7070 con 0x7fd8b015dd70 2023-12-24T19:58:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.771+0000 7fd8a57fa700 1 -- 172.21.15.61:0/2267920449 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd8a8024030 con 0x7fd8b015dd70 2023-12-24T19:58:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.772+0000 7fd8a57fa700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd894066f30 0x7fd8940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.772+0000 7fd8a57fa700 1 -- 172.21.15.61:0/2267920449 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fd8a8086170 con 0x7fd8b015dd70 2023-12-24T19:58:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.772+0000 7fd8b53c4700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd894066f30 0x7fd8940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.773+0000 7fd8b53c4700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd894066f30 0x7fd8940693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac000c00 tx=0x7fd8ac007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:35.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:35.776+0000 7fd8a57fa700 1 -- 172.21.15.61:0/2267920449 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8a8053440 con 0x7fd8b015dd70 2023-12-24T19:58:36.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.015+0000 7fd8b7628700 1 -- 172.21.15.61:0/2267920449 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd8b004c3c0 con 0x7fd8b015dd70 2023-12-24T19:58:36.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.570+0000 7fd8a57fa700 1 -- 172.21.15.61:0/2267920449 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd8a8056a60 con 0x7fd8b015dd70 2023-12-24T19:58:36.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.580+0000 7fd8b7628700 1 -- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd894066f30 msgr2=0x7fd8940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:36.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.580+0000 7fd8b7628700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd894066f30 0x7fd8940693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac000c00 tx=0x7fd8ac007d10 comp rx=0 tx=0).stop 2023-12-24T19:58:36.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.580+0000 7fd8b7628700 1 -- 172.21.15.61:0/2267920449 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b015dd70 msgr2=0x7fd8b015e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:36.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.580+0000 7fd8b7628700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b015dd70 0x7fd8b015e210 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8016000 tx=0x7fd8a801a000 comp rx=0 tx=0).stop 2023-12-24T19:58:36.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.580+0000 7fd8b7628700 1 -- 172.21.15.61:0/2267920449 shutdown_connections 2023-12-24T19:58:36.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.580+0000 7fd8b7628700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd89c004d50 0x7fd8b01577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.580+0000 7fd8b7628700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd894066f30 0x7fd8940693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.580+0000 7fd8b7628700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b015dd70 0x7fd8b015e210 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.580+0000 7fd8b7628700 1 --2- 172.21.15.61:0/2267920449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8b00b4280 0x7fd8b00b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.580+0000 7fd8b7628700 1 -- 172.21.15.61:0/2267920449 >> 172.21.15.61:0/2267920449 conn(0x7fd8b006f810 msgr2=0x7fd8b00c4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:36.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.581+0000 7fd8b7628700 1 -- 172.21.15.61:0/2267920449 shutdown_connections 2023-12-24T19:58:36.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.581+0000 7fd8b7628700 1 -- 172.21.15.61:0/2267920449 wait complete. 2023-12-24T19:58:36.583 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 6 and data pool 7 2023-12-24T19:58:36.594 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:58:36.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.715+0000 7fdde5765700 1 Processor -- start 2023-12-24T19:58:36.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.715+0000 7fdde5765700 1 -- start start 2023-12-24T19:58:36.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fdde5765700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdde0159c10 0x7fdde00c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:36.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fdde5765700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdde0159fe0 0x7fdde00c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:36.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fdde5765700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde00af880 con 0x7fdde00cba80 2023-12-24T19:58:36.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fdde5765700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde00c6fc0 con 0x7fdde0159fe0 2023-12-24T19:58:36.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fdde5765700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde00c63b0 con 0x7fdde0159c10 2023-12-24T19:58:36.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fddde7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdde0159fe0 0x7fdde00c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:36.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fdddf7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fdde00cba80 0x7fdde00cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44474/0 (socket says 172.21.15.61:44474) 2023-12-24T19:58:36.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fdddf7fe700 1 -- 172.21.15.61:0/1293898756 learned_addr learned my addr 172.21.15.61:0/1293898756 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:36.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fdddeffd700 1 --2- 172.21.15.61:0/1293898756 >> v2:172.21.15.133:3300/0 conn(0x7fdde0159c10 0x7fdde00c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:36.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fddde7fc700 1 -- 172.21.15.61:0/1293898756 >> v2:172.21.15.133:3300/0 conn(0x7fdde0159c10 msgr2=0x7fdde00c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fddde7fc700 1 --2- 172.21.15.61:0/1293898756 >> v2:172.21.15.133:3300/0 conn(0x7fdde0159c10 0x7fdde00c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fddde7fc700 1 -- 172.21.15.61:0/1293898756 >> v1:172.21.15.61:6789/0 conn(0x7fdde00cba80 legacy=0x7fdde00cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fddde7fc700 1 -- 172.21.15.61:0/1293898756 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde00c6690 con 0x7fdde0159fe0 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.716+0000 7fddddffb700 1 -- 172.21.15.61:0/1293898756 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100435950 0 0) 0x7fdde00af880 con 0x7fdde00cba80 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fddde7fc700 1 --2- 172.21.15.61:0/1293898756 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde0159fe0 0x7fdde00c5d10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdde00d0990 tx=0x7fddd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6665e511c17734 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fddddffb700 1 -- 172.21.15.61:0/1293898756 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000b6b0 con 0x7fdde0159fe0 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fddddffb700 1 -- 172.21.15.61:0/1293898756 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000b810 con 0x7fdde0159fe0 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fddddffb700 1 -- 172.21.15.61:0/1293898756 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000bbb0 con 0x7fdde0159fe0 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fdde5765700 1 -- 172.21.15.61:0/1293898756 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde0159fe0 msgr2=0x7fdde00c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fdde5765700 1 --2- 172.21.15.61:0/1293898756 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde0159fe0 0x7fdde00c5d10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdde00d0990 tx=0x7fddd00091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fdde5765700 1 -- 172.21.15.61:0/1293898756 shutdown_connections 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fdde5765700 1 --2- 172.21.15.61:0/1293898756 >> v2:172.21.15.133:3300/0 conn(0x7fdde0159c10 0x7fdde00c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fdde5765700 1 --2- 172.21.15.61:0/1293898756 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde0159fe0 0x7fdde00c5d10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fdde5765700 1 -- 172.21.15.61:0/1293898756 >> 172.21.15.61:0/1293898756 conn(0x7fdde006e640 msgr2=0x7fdde0067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fdde5765700 1 -- 172.21.15.61:0/1293898756 shutdown_connections 2023-12-24T19:58:36.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.717+0000 7fdde5765700 1 -- 172.21.15.61:0/1293898756 wait complete. 2023-12-24T19:58:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdde5765700 1 Processor -- start 2023-12-24T19:58:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdde5765700 1 -- start start 2023-12-24T19:58:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdde5765700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde00cba80 0x7fdde00b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdde5765700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde0159c10 0x7fdde015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdde5765700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde0159fe0 0x7fdde016d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdde5765700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde015e3b0 con 0x7fdde00cba80 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdde5765700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde015d4b0 con 0x7fdde0159c10 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdde5765700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde016d640 con 0x7fdde0159fe0 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdddeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde00cba80 0x7fdde00b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdddeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde00cba80 0x7fdde00b5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51416/0 (socket says 172.21.15.61:51416) 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.719+0000 7fdddeffd700 1 -- 172.21.15.61:0/1320025527 learned_addr learned my addr 172.21.15.61:0/1320025527 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fdddf7fe700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde0159fe0 0x7fdde016d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fddde7fc700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde0159c10 0x7fdde015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fdddeffd700 1 -- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde0159fe0 msgr2=0x7fdde016d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fdddeffd700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde0159fe0 0x7fdde016d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fdddeffd700 1 -- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde0159c10 msgr2=0x7fdde015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fdddeffd700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde0159c10 0x7fdde015cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fdddeffd700 1 -- 172.21.15.61:0/1320025527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0009420 con 0x7fdde00cba80 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fdddf7fe700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde0159fe0 0x7fdde016d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fdddeffd700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde00cba80 0x7fdde00b5550 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fddc800d890 tx=0x7fddc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fddd6ffd700 1 -- 172.21.15.61:0/1320025527 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800b600 con 0x7fdde00cba80 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fddd6ffd700 1 -- 172.21.15.61:0/1320025527 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc800b760 con 0x7fdde00cba80 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fdde5765700 1 -- 172.21.15.61:0/1320025527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde015d730 con 0x7fdde00cba80 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fddd6ffd700 1 -- 172.21.15.61:0/1320025527 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800bae0 con 0x7fdde00cba80 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.720+0000 7fdde5765700 1 -- 172.21.15.61:0/1320025527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde015dcf0 con 0x7fdde00cba80 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.721+0000 7fdde5765700 1 -- 172.21.15.61:0/1320025527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde00890b0 con 0x7fdde00cba80 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.722+0000 7fddd6ffd700 1 -- 172.21.15.61:0/1320025527 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fddc801e460 con 0x7fdde00cba80 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.722+0000 7fddd6ffd700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fddc0066f30 0x7fddc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.722+0000 7fddd6ffd700 1 -- 172.21.15.61:0/1320025527 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fddc8084be0 con 0x7fdde00cba80 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.722+0000 7fddde7fc700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fddc0066f30 0x7fddc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:36.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.723+0000 7fddde7fc700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fddc0066f30 0x7fddc00693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdde00d0990 tx=0x7fddd0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.726+0000 7fddd6ffd700 1 -- 172.21.15.61:0/1320025527 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddc8051e50 con 0x7fdde00cba80 2023-12-24T19:58:36.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.920+0000 7fdde5765700 1 -- 172.21.15.61:0/1320025527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdde004c3c0 con 0x7fdde00cba80 2023-12-24T19:58:36.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.921+0000 7fddd6ffd700 1 -- 172.21.15.61:0/1320025527 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fddc8055470 con 0x7fdde00cba80 2023-12-24T19:58:36.922 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:36.923 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":44,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:58:36.018045+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:58:34.362437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-24T19:58:34.922413+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:58:36.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 -- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fddc0066f30 msgr2=0x7fddc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:36.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fddc0066f30 0x7fddc00693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdde00d0990 tx=0x7fddd0017000 comp rx=0 tx=0).stop 2023-12-24T19:58:36.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 -- 172.21.15.61:0/1320025527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde00cba80 msgr2=0x7fdde00b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:36.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde00cba80 0x7fdde00b5550 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fddc800d890 tx=0x7fddc8008040 comp rx=0 tx=0).stop 2023-12-24T19:58:36.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 -- 172.21.15.61:0/1320025527 shutdown_connections 2023-12-24T19:58:36.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdde0159fe0 0x7fdde016d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fddc0066f30 0x7fddc00693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdde00cba80 0x7fdde00b5550 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 --2- 172.21.15.61:0/1320025527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdde0159c10 0x7fdde015cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:36.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 -- 172.21.15.61:0/1320025527 >> 172.21.15.61:0/1320025527 conn(0x7fdde006e640 msgr2=0x7fdde00b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:36.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 -- 172.21.15.61:0/1320025527 shutdown_connections 2023-12-24T19:58:36.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:36.923+0000 7fdde5765700 1 -- 172.21.15.61:0/1320025527 wait complete. 2023-12-24T19:58:36.937 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:58:37.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.057+0000 7fde5e011700 1 Processor -- start 2023-12-24T19:58:37.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.057+0000 7fde5e011700 1 -- start start 2023-12-24T19:58:37.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.057+0000 7fde5e011700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fde5815bb60 0x7fde58098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.057+0000 7fde5e011700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde580b2660 0x7fde580b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.057+0000 7fde5e011700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde580b2eb0 con 0x7fde58098aa0 2023-12-24T19:58:37.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.057+0000 7fde5e011700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580afc20 con 0x7fde5815bb60 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.057+0000 7fde5e011700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b2bd0 con 0x7fde580b2660 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde577fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fde5815bb60 0x7fde58098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde577fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fde5815bb60 0x7fde58098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51424/0 (socket says 172.21.15.61:51424) 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde577fe700 1 -- 172.21.15.61:0/1472922065 learned_addr learned my addr 172.21.15.61:0/1472922065 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde57fff700 1 --2- 172.21.15.61:0/1472922065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde580b2660 0x7fde580b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde577fe700 1 -- 172.21.15.61:0/1472922065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde580b2660 msgr2=0x7fde580b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde577fe700 1 --2- 172.21.15.61:0/1472922065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde580b2660 0x7fde580b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde577fe700 1 -- 172.21.15.61:0/1472922065 >> v1:172.21.15.133:6789/0 conn(0x7fde58098aa0 legacy=0x7fde5815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde577fe700 1 -- 172.21.15.61:0/1472922065 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580afe10 con 0x7fde5815bb60 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde577fe700 1 --2- 172.21.15.61:0/1472922065 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde5815bb60 0x7fde58098560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fde48009990 tx=0x7fde48009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e254d18e53c3f757 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde567fc700 1 -- 172.21.15.61:0/1472922065 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48005c10 con 0x7fde5815bb60 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde567fc700 1 -- 172.21.15.61:0/1472922065 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48005d70 con 0x7fde5815bb60 2023-12-24T19:58:37.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.058+0000 7fde567fc700 1 -- 172.21.15.61:0/1472922065 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800b880 con 0x7fde5815bb60 2023-12-24T19:58:37.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.059+0000 7fde5e011700 1 -- 172.21.15.61:0/1472922065 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde5815bb60 msgr2=0x7fde58098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:37.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.059+0000 7fde5e011700 1 --2- 172.21.15.61:0/1472922065 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde5815bb60 0x7fde58098560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fde48009990 tx=0x7fde48009220 comp rx=0 tx=0).stop 2023-12-24T19:58:37.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.059+0000 7fde5e011700 1 -- 172.21.15.61:0/1472922065 shutdown_connections 2023-12-24T19:58:37.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.059+0000 7fde5e011700 1 --2- 172.21.15.61:0/1472922065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde580b2660 0x7fde580b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.059+0000 7fde5e011700 1 --2- 172.21.15.61:0/1472922065 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde5815bb60 0x7fde58098560 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.059+0000 7fde5e011700 1 -- 172.21.15.61:0/1472922065 >> 172.21.15.61:0/1472922065 conn(0x7fde58097a10 msgr2=0x7fde580ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:37.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.059+0000 7fde5e011700 1 -- 172.21.15.61:0/1472922065 shutdown_connections 2023-12-24T19:58:37.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.059+0000 7fde5e011700 1 -- 172.21.15.61:0/1472922065 wait complete. 2023-12-24T19:58:37.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.060+0000 7fde5e011700 1 Processor -- start 2023-12-24T19:58:37.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.061+0000 7fde5e011700 1 -- start start 2023-12-24T19:58:37.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.061+0000 7fde5e011700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde58098aa0 0x7fde58144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.061+0000 7fde5e011700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde580b2660 0x7fde580a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde5e011700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde5815bb60 0x7fde580a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde5e011700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580acad0 con 0x7fde58098aa0 2023-12-24T19:58:37.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde5e011700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580acdb0 con 0x7fde5815bb60 2023-12-24T19:58:37.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde5e011700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580ad090 con 0x7fde580b2660 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde577fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde58098aa0 0x7fde58144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde577fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde58098aa0 0x7fde58144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51440/0 (socket says 172.21.15.61:51440) 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde577fe700 1 -- 172.21.15.61:0/484649929 learned_addr learned my addr 172.21.15.61:0/484649929 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde577fe700 1 -- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde580b2660 msgr2=0x7fde580a9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde577fe700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde580b2660 0x7fde580a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde577fe700 1 -- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde5815bb60 msgr2=0x7fde580a9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde577fe700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde5815bb60 0x7fde580a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde577fe700 1 -- 172.21.15.61:0/484649929 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48009480 con 0x7fde58098aa0 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde577fe700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde58098aa0 0x7fde58144be0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fde48005d40 tx=0x7fde48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde3f7fe700 1 -- 172.21.15.61:0/484649929 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48011a60 con 0x7fde58098aa0 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde3f7fe700 1 -- 172.21.15.61:0/484649929 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48011bc0 con 0x7fde58098aa0 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde5e011700 1 -- 172.21.15.61:0/484649929 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde580ad370 con 0x7fde58098aa0 2023-12-24T19:58:37.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde3f7fe700 1 -- 172.21.15.61:0/484649929 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4801b430 con 0x7fde58098aa0 2023-12-24T19:58:37.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.062+0000 7fde5e011700 1 -- 172.21.15.61:0/484649929 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde58145120 con 0x7fde58098aa0 2023-12-24T19:58:37.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.063+0000 7fde5e011700 1 -- 172.21.15.61:0/484649929 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde58145310 con 0x7fde58098aa0 2023-12-24T19:58:37.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.064+0000 7fde3f7fe700 1 -- 172.21.15.61:0/484649929 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fde4801b860 con 0x7fde58098aa0 2023-12-24T19:58:37.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.064+0000 7fde3f7fe700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde44066f30 0x7fde440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.064+0000 7fde3f7fe700 1 -- 172.21.15.61:0/484649929 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde48085ef0 con 0x7fde58098aa0 2023-12-24T19:58:37.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.064+0000 7fde56ffd700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde44066f30 0x7fde440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:37.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.065+0000 7fde56ffd700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde44066f30 0x7fde440693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fde581588c0 tx=0x7fde4c007b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:37.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.069+0000 7fde3f7fe700 1 -- 172.21.15.61:0/484649929 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde48053160 con 0x7fde58098aa0 2023-12-24T19:58:37.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.267+0000 7fde5e011700 1 -- 172.21.15.61:0/484649929 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde5806d440 con 0x7fde58098aa0 2023-12-24T19:58:37.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.267+0000 7fde3f7fe700 1 -- 172.21.15.61:0/484649929 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fde4802a090 con 0x7fde58098aa0 2023-12-24T19:58:37.269 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:37.269 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":44,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:58:36.018045+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:58:34.362437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-24T19:58:34.922413+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:58:37.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.269+0000 7fde5e011700 1 -- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde44066f30 msgr2=0x7fde440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:37.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde44066f30 0x7fde440693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fde581588c0 tx=0x7fde4c007b40 comp rx=0 tx=0).stop 2023-12-24T19:58:37.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 -- 172.21.15.61:0/484649929 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde58098aa0 msgr2=0x7fde58144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:37.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde58098aa0 0x7fde58144be0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fde48005d40 tx=0x7fde48016000 comp rx=0 tx=0).stop 2023-12-24T19:58:37.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 -- 172.21.15.61:0/484649929 shutdown_connections 2023-12-24T19:58:37.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde44066f30 0x7fde440693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde5815bb60 0x7fde580a9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde58098aa0 0x7fde58144be0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 --2- 172.21.15.61:0/484649929 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde580b2660 0x7fde580a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 -- 172.21.15.61:0/484649929 >> 172.21.15.61:0/484649929 conn(0x7fde58097a10 msgr2=0x7fde58158e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:37.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 -- 172.21.15.61:0/484649929 shutdown_connections 2023-12-24T19:58:37.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.270+0000 7fde5e011700 1 -- 172.21.15.61:0/484649929 wait complete. 2023-12-24T19:58:37.283 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T19:58:37.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.407+0000 7f3077a32700 1 Processor -- start 2023-12-24T19:58:37.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.407+0000 7f3077a32700 1 -- start start 2023-12-24T19:58:37.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.408+0000 7f3077a32700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f307006a510 0x7f3070164960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.408+0000 7f3077a32700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700ab770 con 0x7f30700caa70 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.408+0000 7f3077a32700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30700aa880 con 0x7f30701578b0 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.408+0000 7f3077a32700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30700aab60 con 0x7f307006a510 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3075fcf700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f307006a510 0x7f3070164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3075fcf700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f307006a510 0x7f3070164960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51454/0 (socket says 172.21.15.61:51454) 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3074fcd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f30700caa70 0x7f30700caf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44486/0 (socket says 172.21.15.61:44486) 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3075fcf700 1 -- 172.21.15.61:0/3761426249 learned_addr learned my addr 172.21.15.61:0/3761426249 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3075fcf700 1 -- 172.21.15.61:0/3761426249 >> v1:172.21.15.133:6789/0 conn(0x7f30701578b0 legacy=0x7f307015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3075fcf700 1 -- 172.21.15.61:0/3761426249 >> v1:172.21.15.61:6789/0 conn(0x7f30700caa70 legacy=0x7f30700caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3075fcf700 1 -- 172.21.15.61:0/3761426249 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700aae40 con 0x7f307006a510 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3067fff700 1 -- 172.21.15.61:0/3761426249 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572145619 0 0) 0x7f30700ab770 con 0x7f30700caa70 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3075fcf700 1 --2- 172.21.15.61:0/3761426249 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 0x7f3070164960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3068009f20 tx=0x7f3068009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dda8e49f800738 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3067fff700 1 -- 172.21.15.61:0/3761426249 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800e070 con 0x7f307006a510 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3067fff700 1 -- 172.21.15.61:0/3761426249 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800ba80 con 0x7f307006a510 2023-12-24T19:58:37.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.409+0000 7f3067fff700 1 -- 172.21.15.61:0/3761426249 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30680092e0 con 0x7f307006a510 2023-12-24T19:58:37.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.410+0000 7f3077a32700 1 -- 172.21.15.61:0/3761426249 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 msgr2=0x7f3070164960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:37.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.410+0000 7f3077a32700 1 --2- 172.21.15.61:0/3761426249 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 0x7f3070164960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3068009f20 tx=0x7f3068009840 comp rx=0 tx=0).stop 2023-12-24T19:58:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.410+0000 7f3077a32700 1 -- 172.21.15.61:0/3761426249 shutdown_connections 2023-12-24T19:58:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.410+0000 7f3077a32700 1 --2- 172.21.15.61:0/3761426249 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 0x7f3070164960 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.410+0000 7f3077a32700 1 -- 172.21.15.61:0/3761426249 >> 172.21.15.61:0/3761426249 conn(0x7f3070067fd0 msgr2=0x7f30700ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.410+0000 7f3077a32700 1 -- 172.21.15.61:0/3761426249 shutdown_connections 2023-12-24T19:58:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.410+0000 7f3077a32700 1 -- 172.21.15.61:0/3761426249 wait complete. 2023-12-24T19:58:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.411+0000 7f3077a32700 1 Processor -- start 2023-12-24T19:58:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.411+0000 7f3077a32700 1 -- start start 2023-12-24T19:58:37.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f3077a32700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 0x7f30700ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f3077a32700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700caa70 0x7f307016d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f3077a32700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30701578b0 0x7f307016db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f3077a32700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700c5590 con 0x7f307006a510 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f3077a32700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700c5870 con 0x7f30700caa70 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f3077a32700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30700c5b50 con 0x7f30701578b0 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f30757ce700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 0x7f30700ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f30757ce700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 0x7f30700ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51468/0 (socket says 172.21.15.61:51468) 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f30757ce700 1 -- 172.21.15.61:0/3648177704 learned_addr learned my addr 172.21.15.61:0/3648177704 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f3074fcd700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700caa70 0x7f307016d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.412+0000 7f3075fcf700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30701578b0 0x7f307016db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f30757ce700 1 -- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30701578b0 msgr2=0x7f307016db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f30757ce700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30701578b0 0x7f307016db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f30757ce700 1 -- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700caa70 msgr2=0x7f307016d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f30757ce700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700caa70 0x7f307016d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:37.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f30757ce700 1 -- 172.21.15.61:0/3648177704 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3068009ae0 con 0x7f307006a510 2023-12-24T19:58:37.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f3075fcf700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30701578b0 0x7f307016db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:37.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f30757ce700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 0x7f30700ace90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f306000c4e0 tx=0x7f306000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:37.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f30657fa700 1 -- 172.21.15.61:0/3648177704 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060011590 con 0x7f307006a510 2023-12-24T19:58:37.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f30657fa700 1 -- 172.21.15.61:0/3648177704 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3060011710 con 0x7f307006a510 2023-12-24T19:58:37.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f3077a32700 1 -- 172.21.15.61:0/3648177704 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30700c5e30 con 0x7f307006a510 2023-12-24T19:58:37.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f30657fa700 1 -- 172.21.15.61:0/3648177704 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060011ad0 con 0x7f307006a510 2023-12-24T19:58:37.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.413+0000 7f3077a32700 1 -- 172.21.15.61:0/3648177704 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30700ad3d0 con 0x7f307006a510 2023-12-24T19:58:37.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.414+0000 7f3077a32700 1 -- 172.21.15.61:0/3648177704 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30700ad5f0 con 0x7f307006a510 2023-12-24T19:58:37.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.414+0000 7f30657fa700 1 -- 172.21.15.61:0/3648177704 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f306001b3b0 con 0x7f307006a510 2023-12-24T19:58:37.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.415+0000 7f30657fa700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3054066f30 0x7f30540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:37.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.415+0000 7f30657fa700 1 -- 172.21.15.61:0/3648177704 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3060083af0 con 0x7f307006a510 2023-12-24T19:58:37.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.415+0000 7f3074fcd700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3054066f30 0x7f30540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:37.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.415+0000 7f3074fcd700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3054066f30 0x7f30540693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f30700b2c60 tx=0x7f306c007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:37.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.419+0000 7f30657fa700 1 -- 172.21.15.61:0/3648177704 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3060050d60 con 0x7f307006a510 2023-12-24T19:58:37.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:37.664+0000 7f3077a32700 1 -- 172.21.15.61:0/3648177704 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f30700c6350 con 0x7f307006a510 2023-12-24T19:58:38.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.583+0000 7f30657fa700 1 -- 172.21.15.61:0/3648177704 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3060017070 con 0x7f307006a510 2023-12-24T19:58:38.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.586+0000 7f3077a32700 1 -- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3054066f30 msgr2=0x7f30540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:38.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.586+0000 7f3077a32700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3054066f30 0x7f30540693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f30700b2c60 tx=0x7f306c007bd0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.586+0000 7f3077a32700 1 -- 172.21.15.61:0/3648177704 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 msgr2=0x7f30700ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:38.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.586+0000 7f3077a32700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 0x7f30700ace90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f306000c4e0 tx=0x7f306000c8a0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.586+0000 7f3077a32700 1 -- 172.21.15.61:0/3648177704 shutdown_connections 2023-12-24T19:58:38.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.586+0000 7f3077a32700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f30701578b0 0x7f307016db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.586+0000 7f3077a32700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3054066f30 0x7f30540693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.586+0000 7f3077a32700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f307006a510 0x7f30700ace90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.586+0000 7f3077a32700 1 --2- 172.21.15.61:0/3648177704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30700caa70 0x7f307016d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.586+0000 7f3077a32700 1 -- 172.21.15.61:0/3648177704 >> 172.21.15.61:0/3648177704 conn(0x7f3070067fd0 msgr2=0x7f30701548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:38.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.587+0000 7f3077a32700 1 -- 172.21.15.61:0/3648177704 shutdown_connections 2023-12-24T19:58:38.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.587+0000 7f3077a32700 1 -- 172.21.15.61:0/3648177704 wait complete. 2023-12-24T19:58:38.602 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T19:58:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.733+0000 7fa6aedf3700 1 Processor -- start 2023-12-24T19:58:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.733+0000 7fa6aedf3700 1 -- start start 2023-12-24T19:58:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6aedf3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6a80afd60 0x7fa6a80cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6aedf3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa6a80b0130 0x7fa6a8070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6aedf3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa6a80688b0 0x7fa6a8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6aedf3700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a815e470 con 0x7fa6a80b0130 2023-12-24T19:58:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6aedf3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a8068db0 con 0x7fa6a80688b0 2023-12-24T19:58:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6aedf3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a815db40 con 0x7fa6a80afd60 2023-12-24T19:58:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a7fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa6a80b0130 0x7fa6a8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a7fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa6a80b0130 0x7fa6a8070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51480/0 (socket says 172.21.15.61:51480) 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a7fff700 1 -- 172.21.15.61:0/2440477336 learned_addr learned my addr 172.21.15.61:0/2440477336 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6acb8f700 1 --2- 172.21.15.61:0/2440477336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6a80afd60 0x7fa6a80cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6ad390700 1 --2- 172.21.15.61:0/2440477336 >> v2:172.21.15.133:3300/0 conn(0x7fa6a80688b0 0x7fa6a8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a7fff700 1 -- 172.21.15.61:0/2440477336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6a80afd60 msgr2=0x7fa6a80cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a7fff700 1 --2- 172.21.15.61:0/2440477336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6a80afd60 0x7fa6a80cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a7fff700 1 -- 172.21.15.61:0/2440477336 >> v2:172.21.15.133:3300/0 conn(0x7fa6a80688b0 msgr2=0x7fa6a8070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a7fff700 1 --2- 172.21.15.61:0/2440477336 >> v2:172.21.15.133:3300/0 conn(0x7fa6a80688b0 0x7fa6a8070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a7fff700 1 -- 172.21.15.61:0/2440477336 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a815de20 con 0x7fa6a80b0130 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a7fff700 1 --2- 172.21.15.61:0/2440477336 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80b0130 0x7fa6a8070640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa6a815a5c0 tx=0x7fa694009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb8351e8e71be58 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a77fe700 1 -- 172.21.15.61:0/2440477336 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69400b860 con 0x7fa6a80b0130 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a77fe700 1 -- 172.21.15.61:0/2440477336 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69400b9c0 con 0x7fa6a80b0130 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.734+0000 7fa6a77fe700 1 -- 172.21.15.61:0/2440477336 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69400bd60 con 0x7fa6a80b0130 2023-12-24T19:58:38.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.735+0000 7fa6aedf3700 1 -- 172.21.15.61:0/2440477336 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80b0130 msgr2=0x7fa6a8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.735+0000 7fa6aedf3700 1 --2- 172.21.15.61:0/2440477336 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80b0130 0x7fa6a8070640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa6a815a5c0 tx=0x7fa694009250 comp rx=0 tx=0).stop 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.735+0000 7fa6aedf3700 1 -- 172.21.15.61:0/2440477336 shutdown_connections 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.735+0000 7fa6aedf3700 1 --2- 172.21.15.61:0/2440477336 >> v2:172.21.15.133:3300/0 conn(0x7fa6a80688b0 0x7fa6a8070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.735+0000 7fa6aedf3700 1 --2- 172.21.15.61:0/2440477336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6a80afd60 0x7fa6a80cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.735+0000 7fa6aedf3700 1 --2- 172.21.15.61:0/2440477336 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80b0130 0x7fa6a8070640 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.735+0000 7fa6aedf3700 1 -- 172.21.15.61:0/2440477336 >> 172.21.15.61:0/2440477336 conn(0x7fa6a80ce400 msgr2=0x7fa6a80ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.735+0000 7fa6aedf3700 1 -- 172.21.15.61:0/2440477336 shutdown_connections 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.735+0000 7fa6aedf3700 1 -- 172.21.15.61:0/2440477336 wait complete. 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.736+0000 7fa6aedf3700 1 Processor -- start 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.736+0000 7fa6aedf3700 1 -- start start 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6aedf3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6a80688b0 0x7fa6a815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6aedf3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a80afd60 0x7fa6a815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6aedf3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80c1cc0 0x7fa6a80c2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6aedf3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80c1830 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6aedf3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a815ab30 con 0x7fa6a80afd60 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6aedf3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80c4560 con 0x7fa6a80688b0 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6ad390700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80c1cc0 0x7fa6a80c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6ad390700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80c1cc0 0x7fa6a80c2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51482/0 (socket says 172.21.15.61:51482) 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6ad390700 1 -- 172.21.15.61:0/3196999945 learned_addr learned my addr 172.21.15.61:0/3196999945 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6acb8f700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6a80688b0 0x7fa6a815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.737+0000 7fa6a7fff700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a80afd60 0x7fa6a815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6ad390700 1 -- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6a80688b0 msgr2=0x7fa6a815a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6ad390700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6a80688b0 0x7fa6a815a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6ad390700 1 -- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a80afd60 msgr2=0x7fa6a815cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6ad390700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a80afd60 0x7fa6a815cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:38.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6ad390700 1 -- 172.21.15.61:0/3196999945 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940094f0 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6a7fff700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a80afd60 0x7fa6a815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:38.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6ad390700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80c1cc0 0x7fa6a80c2160 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009fa0 tx=0x7fa6a0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:38.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6a4ff9700 1 -- 172.21.15.61:0/3196999945 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000ec70 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6a4ff9700 1 -- 172.21.15.61:0/3196999945 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a000edd0 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6aedf3700 1 -- 172.21.15.61:0/3196999945 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a80c3fa0 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6a4ff9700 1 -- 172.21.15.61:0/3196999945 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0014670 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.738+0000 7fa6aedf3700 1 -- 172.21.15.61:0/3196999945 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a80c14c0 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.739+0000 7fa6aedf3700 1 -- 172.21.15.61:0/3196999945 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a80c19a0 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.739+0000 7fa6a4ff9700 1 -- 172.21.15.61:0/3196999945 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa6a00149e0 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.740+0000 7fa6a4ff9700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa68c066f30 0x7fa68c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:38.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.740+0000 7fa6a4ff9700 1 -- 172.21.15.61:0/3196999945 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6a0084c70 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.740+0000 7fa6acb8f700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa68c066f30 0x7fa68c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:38.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.740+0000 7fa6acb8f700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa68c066f30 0x7fa68c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa69c006fd0 tx=0x7fa69c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:38.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.744+0000 7fa6a4ff9700 1 -- 172.21.15.61:0/3196999945 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6a0051ee0 con 0x7fa6a80c1cc0 2023-12-24T19:58:38.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:38.986+0000 7fa6aedf3700 1 -- 172.21.15.61:0/3196999945 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa6a804c3c0 con 0x7fa6a80c1cc0 2023-12-24T19:58:39.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.586+0000 7fa6a4ff9700 1 -- 172.21.15.61:0/3196999945 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa6a0055500 con 0x7fa6a80c1cc0 2023-12-24T19:58:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 -- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa68c066f30 msgr2=0x7fa68c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa68c066f30 0x7fa68c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa69c006fd0 tx=0x7fa69c008040 comp rx=0 tx=0).stop 2023-12-24T19:58:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 -- 172.21.15.61:0/3196999945 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80c1cc0 msgr2=0x7fa6a80c2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80c1cc0 0x7fa6a80c2160 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009fa0 tx=0x7fa6a0009900 comp rx=0 tx=0).stop 2023-12-24T19:58:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 -- 172.21.15.61:0/3196999945 shutdown_connections 2023-12-24T19:58:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6a80688b0 0x7fa6a815a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa68c066f30 0x7fa68c0693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6a80c1cc0 0x7fa6a80c2160 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 --2- 172.21.15.61:0/3196999945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6a80afd60 0x7fa6a815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 -- 172.21.15.61:0/3196999945 >> 172.21.15.61:0/3196999945 conn(0x7fa6a80ce400 msgr2=0x7fa6a80b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 -- 172.21.15.61:0/3196999945 shutdown_connections 2023-12-24T19:58:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.589+0000 7fa6aedf3700 1 -- 172.21.15.61:0/3196999945 wait complete. 2023-12-24T19:58:39.604 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:39.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.727+0000 7f22b5e7f700 1 Processor -- start 2023-12-24T19:58:39.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.727+0000 7f22b5e7f700 1 -- start start 2023-12-24T19:58:39.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.728+0000 7f22b5e7f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f22b00b0830 0x7f22b0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:39.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.728+0000 7f22b5e7f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b0067a60 con 0x7f22b006dff0 2023-12-24T19:58:39.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.728+0000 7f22b5e7f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b00c88e0 con 0x7f22b0156730 2023-12-24T19:58:39.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.728+0000 7f22b5e7f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b00c8bc0 con 0x7f22b00b0830 2023-12-24T19:58:39.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.728+0000 7f22affff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f22b00b0830 0x7f22b0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:39.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.728+0000 7f22aeffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f22b006dff0 0x7f22b00c7c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44500/0 (socket says 172.21.15.61:44500) 2023-12-24T19:58:39.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.728+0000 7f22aeffd700 1 -- 172.21.15.61:0/2907307220 learned_addr learned my addr 172.21.15.61:0/2907307220 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22affff700 1 -- 172.21.15.61:0/2907307220 >> v1:172.21.15.133:6789/0 conn(0x7f22b0156730 legacy=0x7f22b006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22affff700 1 -- 172.21.15.61:0/2907307220 >> v1:172.21.15.61:6789/0 conn(0x7f22b006dff0 legacy=0x7f22b00c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22affff700 1 -- 172.21.15.61:0/2907307220 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b00676f0 con 0x7f22b00b0830 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22ae7fc700 1 -- 172.21.15.61:0/2907307220 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847930143 0 0) 0x7f22b0067a60 con 0x7f22b006dff0 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22affff700 1 --2- 172.21.15.61:0/2907307220 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b00b0830 0x7f22b0156b00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009e60 tx=0x7f22a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e05d1b188304e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22ae7fc700 1 -- 172.21.15.61:0/2907307220 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800e070 con 0x7f22b00b0830 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22ae7fc700 1 -- 172.21.15.61:0/2907307220 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a800bc30 con 0x7f22b00b0830 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22ae7fc700 1 -- 172.21.15.61:0/2907307220 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8012430 con 0x7f22b00b0830 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2907307220 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b00b0830 msgr2=0x7f22b0156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22b5e7f700 1 --2- 172.21.15.61:0/2907307220 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b00b0830 0x7f22b0156b00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009e60 tx=0x7f22a8009780 comp rx=0 tx=0).stop 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.729+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2907307220 shutdown_connections 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.730+0000 7f22b5e7f700 1 --2- 172.21.15.61:0/2907307220 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b00b0830 0x7f22b0156b00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.730+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2907307220 >> 172.21.15.61:0/2907307220 conn(0x7f22b00cd6f0 msgr2=0x7f22b00cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:39.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.730+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2907307220 shutdown_connections 2023-12-24T19:58:39.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.730+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2907307220 wait complete. 2023-12-24T19:58:39.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.731+0000 7f22b5e7f700 1 Processor -- start 2023-12-24T19:58:39.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.731+0000 7f22b5e7f700 1 -- start start 2023-12-24T19:58:39.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22b5e7f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b006dff0 0x7f22b00c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:39.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22b5e7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b00b0830 0x7f22b01559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:39.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22b5e7f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f22b0156730 0x7f22b00b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:39.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22b5e7f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0142660 con 0x7f22b006dff0 2023-12-24T19:58:39.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22b5e7f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00c5420 con 0x7f22b00b0830 2023-12-24T19:58:39.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22b5e7f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00c5700 con 0x7f22b0156730 2023-12-24T19:58:39.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b006dff0 0x7f22b00c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b006dff0 0x7f22b00c4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51496/0 (socket says 172.21.15.61:51496) 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22af7fe700 1 -- 172.21.15.61:0/2382787389 learned_addr learned my addr 172.21.15.61:0/2382787389 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22affff700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f22b0156730 0x7f22b00b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22aeffd700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b00b0830 0x7f22b01559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22af7fe700 1 -- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f22b0156730 msgr2=0x7f22b00b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22af7fe700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f22b0156730 0x7f22b00b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22af7fe700 1 -- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b00b0830 msgr2=0x7f22b01559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22af7fe700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b00b0830 0x7f22b01559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22af7fe700 1 -- 172.21.15.61:0/2382787389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8009a20 con 0x7f22b006dff0 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22af7fe700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b006dff0 0x7f22b00c4e40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f22a000c510 tx=0x7f22a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22a77fe700 1 -- 172.21.15.61:0/2382787389 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0011590 con 0x7f22b006dff0 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22a77fe700 1 -- 172.21.15.61:0/2382787389 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0011710 con 0x7f22b006dff0 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22a77fe700 1 -- 172.21.15.61:0/2382787389 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0011ad0 con 0x7f22b006dff0 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2382787389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b00b20b0 con 0x7f22b006dff0 2023-12-24T19:58:39.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.732+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2382787389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b00b2670 con 0x7f22b006dff0 2023-12-24T19:58:39.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.733+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2382787389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b004c3c0 con 0x7f22b006dff0 2023-12-24T19:58:39.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.734+0000 7f22a77fe700 1 -- 172.21.15.61:0/2382787389 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f22a0001020 con 0x7f22b006dff0 2023-12-24T19:58:39.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.734+0000 7f22a77fe700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2290066f30 0x7f22900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:39.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.734+0000 7f22a77fe700 1 -- 172.21.15.61:0/2382787389 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22a0083960 con 0x7f22b006dff0 2023-12-24T19:58:39.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.734+0000 7f22aeffd700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2290066f30 0x7f22900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:39.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.735+0000 7f22aeffd700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2290066f30 0x7f22900693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22b00cdd50 tx=0x7f2298007c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:39.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.739+0000 7f22a77fe700 1 -- 172.21.15.61:0/2382787389 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22a0050bd0 con 0x7f22b006dff0 2023-12-24T19:58:39.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.979+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2382787389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22b006e910 con 0x7f22b006dff0 2023-12-24T19:58:39.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.980+0000 7f22a77fe700 1 -- 172.21.15.61:0/2382787389 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f22a0017070 con 0x7f22b006dff0 2023-12-24T19:58:39.980 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:39.980 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1254159834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1254159834},{"type":"v1","addr":"172.21.15.133:6835","nonce":1254159834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4078121613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4078121613},{"type":"v1","addr":"172.21.15.133:6837","nonce":4078121613}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/4252611526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":4252611526},{"type":"v1","addr":"172.21.15.61:6834","nonce":4252611526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:58:36.018348+0000","modified":"2023-12-24T19:58:39.583985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.61:6835/3976042512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3976042512},{"type":"v1","addr":"172.21.15.61:6835","nonce":3976042512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T19:58:39.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2290066f30 msgr2=0x7f22900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:39.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2290066f30 0x7f22900693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22b00cdd50 tx=0x7f2298007c60 comp rx=0 tx=0).stop 2023-12-24T19:58:39.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2382787389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b006dff0 msgr2=0x7f22b00c4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:39.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b006dff0 0x7f22b00c4e40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f22a000c510 tx=0x7f22a000c8d0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2382787389 shutdown_connections 2023-12-24T19:58:39.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f22b0156730 0x7f22b00b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2290066f30 0x7f22900693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22b006dff0 0x7f22b00c4e40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 --2- 172.21.15.61:0/2382787389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b00b0830 0x7f22b01559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:39.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2382787389 >> 172.21.15.61:0/2382787389 conn(0x7f22b00cd6f0 msgr2=0x7f22b015a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:39.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2382787389 shutdown_connections 2023-12-24T19:58:39.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:39.982+0000 7f22b5e7f700 1 -- 172.21.15.61:0/2382787389 wait complete. 2023-12-24T19:58:39.984 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 26 2023-12-24T19:58:39.994 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:58:40.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.115+0000 7f155173a700 1 Processor -- start 2023-12-24T19:58:40.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.115+0000 7f155173a700 1 -- start start 2023-12-24T19:58:40.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.116+0000 7f155173a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f154c06ddc0 0x7f154c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.116+0000 7f155173a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f154c06e190 0x7f154c0cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.116+0000 7f155173a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154c0b3bf0 con 0x7f154c0b4080 2023-12-24T19:58:40.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.116+0000 7f155173a700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154c0ce170 con 0x7f154c06e190 2023-12-24T19:58:40.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.116+0000 7f155173a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c0cfc90 con 0x7f154c06ddc0 2023-12-24T19:58:40.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.116+0000 7f154a7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f154c06e190 0x7f154c0cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.116+0000 7f154a7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f154c06e190 0x7f154c0cf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51506/0 (socket says 172.21.15.61:51506) 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.116+0000 7f154a7fc700 1 -- 172.21.15.61:0/1383752789 learned_addr learned my addr 172.21.15.61:0/1383752789 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.117+0000 7f154affd700 1 --2- 172.21.15.61:0/1383752789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f154c06ddc0 0x7f154c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.117+0000 7f154a7fc700 1 -- 172.21.15.61:0/1383752789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f154c06ddc0 msgr2=0x7f154c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.117+0000 7f154a7fc700 1 --2- 172.21.15.61:0/1383752789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f154c06ddc0 0x7f154c0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.117+0000 7f154a7fc700 1 -- 172.21.15.61:0/1383752789 >> v1:172.21.15.133:6789/0 conn(0x7f154c0b4080 legacy=0x7f154c0b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.117+0000 7f154a7fc700 1 -- 172.21.15.61:0/1383752789 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0cff70 con 0x7f154c06e190 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.117+0000 7f154a7fc700 1 --2- 172.21.15.61:0/1383752789 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06e190 0x7f154c0cf450 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f153c0099b0 tx=0x7f153c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9a9ef9780c01aa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.117+0000 7f1549ffb700 1 -- 172.21.15.61:0/1383752789 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c009ea0 con 0x7f154c06e190 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.117+0000 7f1549ffb700 1 -- 172.21.15.61:0/1383752789 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c00b860 con 0x7f154c06e190 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.117+0000 7f1549ffb700 1 -- 172.21.15.61:0/1383752789 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c00bc00 con 0x7f154c06e190 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.118+0000 7f155173a700 1 -- 172.21.15.61:0/1383752789 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06e190 msgr2=0x7f154c0cf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.118+0000 7f155173a700 1 --2- 172.21.15.61:0/1383752789 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06e190 0x7f154c0cf450 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f153c0099b0 tx=0x7f153c009250 comp rx=0 tx=0).stop 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.118+0000 7f155173a700 1 -- 172.21.15.61:0/1383752789 shutdown_connections 2023-12-24T19:58:40.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.118+0000 7f155173a700 1 --2- 172.21.15.61:0/1383752789 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f154c06ddc0 0x7f154c0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.118+0000 7f155173a700 1 --2- 172.21.15.61:0/1383752789 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06e190 0x7f154c0cf450 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.118+0000 7f155173a700 1 -- 172.21.15.61:0/1383752789 >> 172.21.15.61:0/1383752789 conn(0x7f154c067fd0 msgr2=0x7f154c0b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:40.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.118+0000 7f155173a700 1 -- 172.21.15.61:0/1383752789 shutdown_connections 2023-12-24T19:58:40.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.118+0000 7f155173a700 1 -- 172.21.15.61:0/1383752789 wait complete. 2023-12-24T19:58:40.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.119+0000 7f155173a700 1 Processor -- start 2023-12-24T19:58:40.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.119+0000 7f155173a700 1 -- start start 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f155173a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06ddc0 0x7f154c0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f155173a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f154c06e190 0x7f154c0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f155173a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f154c0b4080 0x7f154c16a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f155173a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c0a74c0 con 0x7f154c06ddc0 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f155173a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c16ae60 con 0x7f154c06e190 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f155173a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c0c9740 con 0x7f154c0b4080 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06ddc0 0x7f154c0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06ddc0 0x7f154c0c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51522/0 (socket says 172.21.15.61:51522) 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154affd700 1 -- 172.21.15.61:0/1710416387 learned_addr learned my addr 172.21.15.61:0/1710416387 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154b7fe700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f154c0b4080 0x7f154c16a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154a7fc700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f154c06e190 0x7f154c0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154affd700 1 -- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f154c0b4080 msgr2=0x7f154c16a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154affd700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f154c0b4080 0x7f154c16a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154affd700 1 -- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f154c06e190 msgr2=0x7f154c0aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154affd700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f154c06e190 0x7f154c0aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154affd700 1 -- 172.21.15.61:0/1710416387 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0094f0 con 0x7f154c06ddc0 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f154affd700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06ddc0 0x7f154c0c9160 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f154000ec80 tx=0x7f15400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f1532ffd700 1 -- 172.21.15.61:0/1710416387 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154000c8e0 con 0x7f154c06ddc0 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f1532ffd700 1 -- 172.21.15.61:0/1710416387 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154000ca40 con 0x7f154c06ddc0 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f155173a700 1 -- 172.21.15.61:0/1710416387 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154c0c9a20 con 0x7f154c06ddc0 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f1532ffd700 1 -- 172.21.15.61:0/1710416387 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154000cde0 con 0x7f154c06ddc0 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.120+0000 7f155173a700 1 -- 172.21.15.61:0/1710416387 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154c0c9fe0 con 0x7f154c06ddc0 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.121+0000 7f155173a700 1 -- 172.21.15.61:0/1710416387 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154c04c3c0 con 0x7f154c06ddc0 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.122+0000 7f1532ffd700 1 -- 172.21.15.61:0/1710416387 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1540013680 con 0x7f154c06ddc0 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.122+0000 7f1532ffd700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1538066f30 0x7f15380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.122+0000 7f1532ffd700 1 -- 172.21.15.61:0/1710416387 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f15400847c0 con 0x7f154c06ddc0 2023-12-24T19:58:40.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.122+0000 7f154a7fc700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1538066f30 0x7f15380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.123+0000 7f154a7fc700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1538066f30 0x7f15380693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f153c0099b0 tx=0x7f153c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:40.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.126+0000 7f1532ffd700 1 -- 172.21.15.61:0/1710416387 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1540051a30 con 0x7f154c06ddc0 2023-12-24T19:58:40.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.320+0000 7f155173a700 1 -- 172.21.15.61:0/1710416387 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f154c0d0470 con 0x7f154c06ddc0 2023-12-24T19:58:40.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.321+0000 7f1532ffd700 1 -- 172.21.15.61:0/1710416387 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f1540055050 con 0x7f154c06ddc0 2023-12-24T19:58:40.321 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:40.322 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":45,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:58:37.555045+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:58:34.362437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-24T19:58:34.922413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:58:40.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 -- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1538066f30 msgr2=0x7f15380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1538066f30 0x7f15380693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f153c0099b0 tx=0x7f153c017000 comp rx=0 tx=0).stop 2023-12-24T19:58:40.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 -- 172.21.15.61:0/1710416387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06ddc0 msgr2=0x7f154c0c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06ddc0 0x7f154c0c9160 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f154000ec80 tx=0x7f15400091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 -- 172.21.15.61:0/1710416387 shutdown_connections 2023-12-24T19:58:40.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f154c0b4080 0x7f154c16a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1538066f30 0x7f15380693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c06ddc0 0x7f154c0c9160 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 --2- 172.21.15.61:0/1710416387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f154c06e190 0x7f154c0aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 -- 172.21.15.61:0/1710416387 >> 172.21.15.61:0/1710416387 conn(0x7f154c067fd0 msgr2=0x7f154c0b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:40.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 -- 172.21.15.61:0/1710416387 shutdown_connections 2023-12-24T19:58:40.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.323+0000 7f155173a700 1 -- 172.21.15.61:0/1710416387 wait complete. 2023-12-24T19:58:40.336 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T19:58:40.336 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:58:40.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.457+0000 7f1c87e37700 1 Processor -- start 2023-12-24T19:58:40.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.457+0000 7f1c87e37700 1 -- start start 2023-12-24T19:58:40.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.458+0000 7f1c87e37700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1c8015acf0 0x7f1c800afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.458+0000 7f1c87e37700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c800687f0 con 0x7f1c800af710 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.458+0000 7f1c87e37700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c80067be0 con 0x7f1c80068c80 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c87e37700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c80067ec0 con 0x7f1c8015acf0 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c863d4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1c8015acf0 0x7f1c800afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c85bd3700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1c800af710 0x7f1c8015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44512/0 (socket says 172.21.15.61:44512) 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c85bd3700 1 -- 172.21.15.61:0/248927597 learned_addr learned my addr 172.21.15.61:0/248927597 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c863d4700 1 -- 172.21.15.61:0/248927597 >> v1:172.21.15.133:6789/0 conn(0x7f1c80068c80 legacy=0x7f1c800ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c863d4700 1 -- 172.21.15.61:0/248927597 >> v1:172.21.15.61:6789/0 conn(0x7f1c800af710 legacy=0x7f1c8015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c863d4700 1 -- 172.21.15.61:0/248927597 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800681a0 con 0x7f1c8015acf0 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c863d4700 1 --2- 172.21.15.61:0/248927597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c8015acf0 0x7f1c800afae0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009e60 tx=0x7f1c78009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4222157f8edbbfca server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c84bd1700 1 -- 172.21.15.61:0/248927597 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800e070 con 0x7f1c8015acf0 2023-12-24T19:58:40.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c84bd1700 1 -- 172.21.15.61:0/248927597 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7800bb30 con 0x7f1c8015acf0 2023-12-24T19:58:40.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.459+0000 7f1c84bd1700 1 -- 172.21.15.61:0/248927597 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800bed0 con 0x7f1c8015acf0 2023-12-24T19:58:40.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.460+0000 7f1c87e37700 1 -- 172.21.15.61:0/248927597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c8015acf0 msgr2=0x7f1c800afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.460+0000 7f1c87e37700 1 --2- 172.21.15.61:0/248927597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c8015acf0 0x7f1c800afae0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009e60 tx=0x7f1c78009780 comp rx=0 tx=0).stop 2023-12-24T19:58:40.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.460+0000 7f1c87e37700 1 -- 172.21.15.61:0/248927597 shutdown_connections 2023-12-24T19:58:40.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.460+0000 7f1c87e37700 1 --2- 172.21.15.61:0/248927597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c8015acf0 0x7f1c800afae0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.460+0000 7f1c87e37700 1 -- 172.21.15.61:0/248927597 >> 172.21.15.61:0/248927597 conn(0x7f1c800ca200 msgr2=0x7f1c800ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:40.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.460+0000 7f1c87e37700 1 -- 172.21.15.61:0/248927597 shutdown_connections 2023-12-24T19:58:40.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.460+0000 7f1c87e37700 1 -- 172.21.15.61:0/248927597 wait complete. 2023-12-24T19:58:40.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.461+0000 7f1c87e37700 1 Processor -- start 2023-12-24T19:58:40.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.461+0000 7f1c87e37700 1 -- start start 2023-12-24T19:58:40.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c87e37700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c80068c80 0x7f1c80155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c87e37700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c800af710 0x7f1c80169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c87e37700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8015acf0 0x7f1c8016ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c87e37700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c80150de0 con 0x7f1c80068c80 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c87e37700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c801555a0 con 0x7f1c8015acf0 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c87e37700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8016a0e0 con 0x7f1c800af710 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c85bd3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c80068c80 0x7f1c80155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c85bd3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c80068c80 0x7f1c80155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51526/0 (socket says 172.21.15.61:51526) 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c85bd3700 1 -- 172.21.15.61:0/2088935433 learned_addr learned my addr 172.21.15.61:0/2088935433 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c863d4700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8015acf0 0x7f1c8016ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c853d2700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c800af710 0x7f1c80169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c85bd3700 1 -- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c800af710 msgr2=0x7f1c80169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c85bd3700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c800af710 0x7f1c80169ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c85bd3700 1 -- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8015acf0 msgr2=0x7f1c8016ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c85bd3700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8015acf0 0x7f1c8016ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c85bd3700 1 -- 172.21.15.61:0/2088935433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78009a20 con 0x7f1c80068c80 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c863d4700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8015acf0 0x7f1c8016ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:40.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.462+0000 7f1c85bd3700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c80068c80 0x7f1c80155060 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000c840 tx=0x7f1c70007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:40.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.463+0000 7f1c75ffb700 1 -- 172.21.15.61:0/2088935433 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70005b30 con 0x7f1c80068c80 2023-12-24T19:58:40.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.463+0000 7f1c75ffb700 1 -- 172.21.15.61:0/2088935433 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c70005cb0 con 0x7f1c80068c80 2023-12-24T19:58:40.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.463+0000 7f1c87e37700 1 -- 172.21.15.61:0/2088935433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c80154bd0 con 0x7f1c80068c80 2023-12-24T19:58:40.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.463+0000 7f1c75ffb700 1 -- 172.21.15.61:0/2088935433 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70007320 con 0x7f1c80068c80 2023-12-24T19:58:40.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.463+0000 7f1c87e37700 1 -- 172.21.15.61:0/2088935433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c800b0bf0 con 0x7f1c80068c80 2023-12-24T19:58:40.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.464+0000 7f1c87e37700 1 -- 172.21.15.61:0/2088935433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8004c3c0 con 0x7f1c80068c80 2023-12-24T19:58:40.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.464+0000 7f1c75ffb700 1 -- 172.21.15.61:0/2088935433 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1c70012400 con 0x7f1c80068c80 2023-12-24T19:58:40.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.465+0000 7f1c75ffb700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c64066f30 0x7f1c640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.465+0000 7f1c75ffb700 1 -- 172.21.15.61:0/2088935433 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c70083b70 con 0x7f1c80068c80 2023-12-24T19:58:40.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.465+0000 7f1c853d2700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c64066f30 0x7f1c640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.465+0000 7f1c853d2700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c64066f30 0x7f1c640693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1c800ae740 tx=0x7f1c7c009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:40.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.469+0000 7f1c75ffb700 1 -- 172.21.15.61:0/2088935433 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c70050d40 con 0x7f1c80068c80 2023-12-24T19:58:40.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.661+0000 7f1c87e37700 1 -- 172.21.15.61:0/2088935433 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c8015aad0 con 0x7f1c64066f30 2023-12-24T19:58:40.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.669+0000 7f1c75ffb700 1 -- 172.21.15.61:0/2088935433 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284798 (secure 0 0 0) 0x7f1c8015aad0 con 0x7f1c64066f30 2023-12-24T19:58:40.674 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:40.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 -- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c64066f30 msgr2=0x7f1c640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c64066f30 0x7f1c640693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1c800ae740 tx=0x7f1c7c009060 comp rx=0 tx=0).stop 2023-12-24T19:58:40.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 -- 172.21.15.61:0/2088935433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c80068c80 msgr2=0x7f1c80155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c80068c80 0x7f1c80155060 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000c840 tx=0x7f1c70007ef0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 -- 172.21.15.61:0/2088935433 shutdown_connections 2023-12-24T19:58:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1c64066f30 0x7f1c640693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c8015acf0 0x7f1c8016ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1c80068c80 0x7f1c80155060 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 --2- 172.21.15.61:0/2088935433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1c800af710 0x7f1c80169ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 -- 172.21.15.61:0/2088935433 >> 172.21.15.61:0/2088935433 conn(0x7f1c800ca200 msgr2=0x7f1c800cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 -- 172.21.15.61:0/2088935433 shutdown_connections 2023-12-24T19:58:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.673+0000 7f1c87e37700 1 -- 172.21.15.61:0/2088935433 wait complete. 2023-12-24T19:58:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:58:40.685 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-12-24T19:58:40.329663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2827,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559672,"statfs":{"total":1600000000,"available":1597104964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.791921"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.562293+0000","last_change":"2023-12-24T19:58:36.562225+0000","last_active":"2023-12-24T19:58:36.562293+0000","last_peered":"2023-12-24T19:58:36.562293+0000","last_clean":"2023-12-24T19:58:36.562293+0000","last_became_active":"2023-12-24T19:58:36.561988+0000","last_became_peered":"2023-12-24T19:58:36.561988+0000","last_unstale":"2023-12-24T19:58:36.562293+0000","last_undegraded":"2023-12-24T19:58:36.562293+0000","last_fullsized":"2023-12-24T19:58:36.562293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:10:52.962452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568488+0000","last_change":"2023-12-24T19:58:36.567830+0000","last_active":"2023-12-24T19:58:36.568488+0000","last_peered":"2023-12-24T19:58:36.568488+0000","last_clean":"2023-12-24T19:58:36.568488+0000","last_became_active":"2023-12-24T19:58:36.567427+0000","last_became_peered":"2023-12-24T19:58:36.567427+0000","last_unstale":"2023-12-24T19:58:36.568488+0000","last_undegraded":"2023-12-24T19:58:36.568488+0000","last_fullsized":"2023-12-24T19:58:36.568488+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:20.631799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568827+0000","last_change":"2023-12-24T19:58:36.568717+0000","last_active":"2023-12-24T19:58:36.568827+0000","last_peered":"2023-12-24T19:58:36.568827+0000","last_clean":"2023-12-24T19:58:36.568827+0000","last_became_active":"2023-12-24T19:58:36.567924+0000","last_became_peered":"2023-12-24T19:58:36.567924+0000","last_unstale":"2023-12-24T19:58:36.568827+0000","last_undegraded":"2023-12-24T19:58:36.568827+0000","last_fullsized":"2023-12-24T19:58:36.568827+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:53:04.974685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568663+0000","last_change":"2023-12-24T19:58:36.568605+0000","last_active":"2023-12-24T19:58:36.568663+0000","last_peered":"2023-12-24T19:58:36.568663+0000","last_clean":"2023-12-24T19:58:36.568663+0000","last_became_active":"2023-12-24T19:58:36.568315+0000","last_became_peered":"2023-12-24T19:58:36.568315+0000","last_unstale":"2023-12-24T19:58:36.568663+0000","last_undegraded":"2023-12-24T19:58:36.568663+0000","last_fullsized":"2023-12-24T19:58:36.568663+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:10:01.839291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.565424+0000","last_change":"2023-12-24T19:58:36.565141+0000","last_active":"2023-12-24T19:58:36.565424+0000","last_peered":"2023-12-24T19:58:36.565424+0000","last_clean":"2023-12-24T19:58:36.565424+0000","last_became_active":"2023-12-24T19:58:36.564905+0000","last_became_peered":"2023-12-24T19:58:36.564905+0000","last_unstale":"2023-12-24T19:58:36.565424+0000","last_undegraded":"2023-12-24T19:58:36.565424+0000","last_fullsized":"2023-12-24T19:58:36.565424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:57:18.042155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576935+0000","last_change":"2023-12-24T19:58:36.576571+0000","last_active":"2023-12-24T19:58:36.576935+0000","last_peered":"2023-12-24T19:58:36.576935+0000","last_clean":"2023-12-24T19:58:36.576935+0000","last_became_active":"2023-12-24T19:58:36.574113+0000","last_became_peered":"2023-12-24T19:58:36.574113+0000","last_unstale":"2023-12-24T19:58:36.576935+0000","last_undegraded":"2023-12-24T19:58:36.576935+0000","last_fullsized":"2023-12-24T19:58:36.576935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:42:57.577940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560121+0000","last_change":"2023-12-24T19:58:36.560056+0000","last_active":"2023-12-24T19:58:36.560121+0000","last_peered":"2023-12-24T19:58:36.560121+0000","last_clean":"2023-12-24T19:58:36.560121+0000","last_became_active":"2023-12-24T19:58:36.559805+0000","last_became_peered":"2023-12-24T19:58:36.559805+0000","last_unstale":"2023-12-24T19:58:36.560121+0000","last_undegraded":"2023-12-24T19:58:36.560121+0000","last_fullsized":"2023-12-24T19:58:36.560121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:46:33.114148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571132+0000","last_change":"2023-12-24T19:58:36.571053+0000","last_active":"2023-12-24T19:58:36.571132+0000","last_peered":"2023-12-24T19:58:36.571132+0000","last_clean":"2023-12-24T19:58:36.571132+0000","last_became_active":"2023-12-24T19:58:36.570763+0000","last_became_peered":"2023-12-24T19:58:36.570763+0000","last_unstale":"2023-12-24T19:58:36.571132+0000","last_undegraded":"2023-12-24T19:58:36.571132+0000","last_fullsized":"2023-12-24T19:58:36.571132+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:36.796357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560398+0000","last_change":"2023-12-24T19:58:36.560203+0000","last_active":"2023-12-24T19:58:36.560398+0000","last_peered":"2023-12-24T19:58:36.560398+0000","last_clean":"2023-12-24T19:58:36.560398+0000","last_became_active":"2023-12-24T19:58:36.559651+0000","last_became_peered":"2023-12-24T19:58:36.559651+0000","last_unstale":"2023-12-24T19:58:36.560398+0000","last_undegraded":"2023-12-24T19:58:36.560398+0000","last_fullsized":"2023-12-24T19:58:36.560398+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:54:01.331430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.579595+0000","last_change":"2023-12-24T19:58:36.579533+0000","last_active":"2023-12-24T19:58:36.579595+0000","last_peered":"2023-12-24T19:58:36.579595+0000","last_clean":"2023-12-24T19:58:36.579595+0000","last_became_active":"2023-12-24T19:58:36.575414+0000","last_became_peered":"2023-12-24T19:58:36.575414+0000","last_unstale":"2023-12-24T19:58:36.579595+0000","last_undegraded":"2023-12-24T19:58:36.579595+0000","last_fullsized":"2023-12-24T19:58:36.579595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:17:10.405221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.561212+0000","last_change":"2023-12-24T19:58:36.561151+0000","last_active":"2023-12-24T19:58:36.561212+0000","last_peered":"2023-12-24T19:58:36.561212+0000","last_clean":"2023-12-24T19:58:36.561212+0000","last_became_active":"2023-12-24T19:58:36.560996+0000","last_became_peered":"2023-12-24T19:58:36.560996+0000","last_unstale":"2023-12-24T19:58:36.561212+0000","last_undegraded":"2023-12-24T19:58:36.561212+0000","last_fullsized":"2023-12-24T19:58:36.561212+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:44.904761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568507+0000","last_change":"2023-12-24T19:58:36.568326+0000","last_active":"2023-12-24T19:58:36.568507+0000","last_peered":"2023-12-24T19:58:36.568507+0000","last_clean":"2023-12-24T19:58:36.568507+0000","last_became_active":"2023-12-24T19:58:36.568053+0000","last_became_peered":"2023-12-24T19:58:36.568053+0000","last_unstale":"2023-12-24T19:58:36.568507+0000","last_undegraded":"2023-12-24T19:58:36.568507+0000","last_fullsized":"2023-12-24T19:58:36.568507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:07:53.917159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.569934+0000","last_change":"2023-12-24T19:58:36.569619+0000","last_active":"2023-12-24T19:58:36.569934+0000","last_peered":"2023-12-24T19:58:36.569934+0000","last_clean":"2023-12-24T19:58:36.569934+0000","last_became_active":"2023-12-24T19:58:36.569165+0000","last_became_peered":"2023-12-24T19:58:36.569165+0000","last_unstale":"2023-12-24T19:58:36.569934+0000","last_undegraded":"2023-12-24T19:58:36.569934+0000","last_fullsized":"2023-12-24T19:58:36.569934+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:46.485876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560438+0000","last_change":"2023-12-24T19:58:36.560350+0000","last_active":"2023-12-24T19:58:36.560438+0000","last_peered":"2023-12-24T19:58:36.560438+0000","last_clean":"2023-12-24T19:58:36.560438+0000","last_became_active":"2023-12-24T19:58:36.559971+0000","last_became_peered":"2023-12-24T19:58:36.559971+0000","last_unstale":"2023-12-24T19:58:36.560438+0000","last_undegraded":"2023-12-24T19:58:36.560438+0000","last_fullsized":"2023-12-24T19:58:36.560438+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:46:33.114148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.564745+0000","last_change":"2023-12-24T19:58:36.564434+0000","last_active":"2023-12-24T19:58:36.564745+0000","last_peered":"2023-12-24T19:58:36.564745+0000","last_clean":"2023-12-24T19:58:36.564745+0000","last_became_active":"2023-12-24T19:58:36.564191+0000","last_became_peered":"2023-12-24T19:58:36.564191+0000","last_unstale":"2023-12-24T19:58:36.564745+0000","last_undegraded":"2023-12-24T19:58:36.564745+0000","last_fullsized":"2023-12-24T19:58:36.564745+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:36.796357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566883+0000","last_change":"2023-12-24T19:58:36.566423+0000","last_active":"2023-12-24T19:58:36.566883+0000","last_peered":"2023-12-24T19:58:36.566883+0000","last_clean":"2023-12-24T19:58:36.566883+0000","last_became_active":"2023-12-24T19:58:36.566034+0000","last_became_peered":"2023-12-24T19:58:36.566034+0000","last_unstale":"2023-12-24T19:58:36.566883+0000","last_undegraded":"2023-12-24T19:58:36.566883+0000","last_fullsized":"2023-12-24T19:58:36.566883+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:02.178113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.565086+0000","last_change":"2023-12-24T19:58:36.565021+0000","last_active":"2023-12-24T19:58:36.565086+0000","last_peered":"2023-12-24T19:58:36.565086+0000","last_clean":"2023-12-24T19:58:36.565086+0000","last_became_active":"2023-12-24T19:58:36.564800+0000","last_became_peered":"2023-12-24T19:58:36.564800+0000","last_unstale":"2023-12-24T19:58:36.565086+0000","last_undegraded":"2023-12-24T19:58:36.565086+0000","last_fullsized":"2023-12-24T19:58:36.565086+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:05.663561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571571+0000","last_change":"2023-12-24T19:58:36.571509+0000","last_active":"2023-12-24T19:58:36.571571+0000","last_peered":"2023-12-24T19:58:36.571571+0000","last_clean":"2023-12-24T19:58:36.571571+0000","last_became_active":"2023-12-24T19:58:36.571291+0000","last_became_peered":"2023-12-24T19:58:36.571291+0000","last_unstale":"2023-12-24T19:58:36.571571+0000","last_undegraded":"2023-12-24T19:58:36.571571+0000","last_fullsized":"2023-12-24T19:58:36.571571+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:20.631799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571424+0000","last_change":"2023-12-24T19:58:36.571366+0000","last_active":"2023-12-24T19:58:36.571424+0000","last_peered":"2023-12-24T19:58:36.571424+0000","last_clean":"2023-12-24T19:58:36.571424+0000","last_became_active":"2023-12-24T19:58:36.570361+0000","last_became_peered":"2023-12-24T19:58:36.570361+0000","last_unstale":"2023-12-24T19:58:36.571424+0000","last_undegraded":"2023-12-24T19:58:36.571424+0000","last_fullsized":"2023-12-24T19:58:36.571424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:02:28.745757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.577213+0000","last_change":"2023-12-24T19:58:36.577137+0000","last_active":"2023-12-24T19:58:36.577213+0000","last_peered":"2023-12-24T19:58:36.577213+0000","last_clean":"2023-12-24T19:58:36.577213+0000","last_became_active":"2023-12-24T19:58:36.576918+0000","last_became_peered":"2023-12-24T19:58:36.576918+0000","last_unstale":"2023-12-24T19:58:36.577213+0000","last_undegraded":"2023-12-24T19:58:36.577213+0000","last_fullsized":"2023-12-24T19:58:36.577213+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:02.399316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576917+0000","last_change":"2023-12-24T19:58:36.576394+0000","last_active":"2023-12-24T19:58:36.576917+0000","last_peered":"2023-12-24T19:58:36.576917+0000","last_clean":"2023-12-24T19:58:36.576917+0000","last_became_active":"2023-12-24T19:58:36.573595+0000","last_became_peered":"2023-12-24T19:58:36.573595+0000","last_unstale":"2023-12-24T19:58:36.576917+0000","last_undegraded":"2023-12-24T19:58:36.576917+0000","last_fullsized":"2023-12-24T19:58:36.576917+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:47:47.784774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.565117+0000","last_change":"2023-12-24T19:58:36.565057+0000","last_active":"2023-12-24T19:58:36.565117+0000","last_peered":"2023-12-24T19:58:36.565117+0000","last_clean":"2023-12-24T19:58:36.565117+0000","last_became_active":"2023-12-24T19:58:36.564784+0000","last_became_peered":"2023-12-24T19:58:36.564784+0000","last_unstale":"2023-12-24T19:58:36.565117+0000","last_undegraded":"2023-12-24T19:58:36.565117+0000","last_fullsized":"2023-12-24T19:58:36.565117+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:01:59.892624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568869+0000","last_change":"2023-12-24T19:58:36.568723+0000","last_active":"2023-12-24T19:58:36.568869+0000","last_peered":"2023-12-24T19:58:36.568869+0000","last_clean":"2023-12-24T19:58:36.568869+0000","last_became_active":"2023-12-24T19:58:36.568483+0000","last_became_peered":"2023-12-24T19:58:36.568483+0000","last_unstale":"2023-12-24T19:58:36.568869+0000","last_undegraded":"2023-12-24T19:58:36.568869+0000","last_fullsized":"2023-12-24T19:58:36.568869+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:58:04.367601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571993+0000","last_change":"2023-12-24T19:58:36.571906+0000","last_active":"2023-12-24T19:58:36.571993+0000","last_peered":"2023-12-24T19:58:36.571993+0000","last_clean":"2023-12-24T19:58:36.571993+0000","last_became_active":"2023-12-24T19:58:36.571132+0000","last_became_peered":"2023-12-24T19:58:36.571132+0000","last_unstale":"2023-12-24T19:58:36.571993+0000","last_undegraded":"2023-12-24T19:58:36.571993+0000","last_fullsized":"2023-12-24T19:58:36.571993+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:37.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566697+0000","last_change":"2023-12-24T19:58:36.564880+0000","last_active":"2023-12-24T19:58:36.566697+0000","last_peered":"2023-12-24T19:58:36.566697+0000","last_clean":"2023-12-24T19:58:36.566697+0000","last_became_active":"2023-12-24T19:58:36.564194+0000","last_became_peered":"2023-12-24T19:58:36.564194+0000","last_unstale":"2023-12-24T19:58:36.566697+0000","last_undegraded":"2023-12-24T19:58:36.566697+0000","last_fullsized":"2023-12-24T19:58:36.566697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:14.574597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571613+0000","last_change":"2023-12-24T19:58:36.571539+0000","last_active":"2023-12-24T19:58:36.571613+0000","last_peered":"2023-12-24T19:58:36.571613+0000","last_clean":"2023-12-24T19:58:36.571613+0000","last_became_active":"2023-12-24T19:58:36.571164+0000","last_became_peered":"2023-12-24T19:58:36.571164+0000","last_unstale":"2023-12-24T19:58:36.571613+0000","last_undegraded":"2023-12-24T19:58:36.571613+0000","last_fullsized":"2023-12-24T19:58:36.571613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:14:05.027829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.567902+0000","last_change":"2023-12-24T19:58:36.567838+0000","last_active":"2023-12-24T19:58:36.567902+0000","last_peered":"2023-12-24T19:58:36.567902+0000","last_clean":"2023-12-24T19:58:36.567902+0000","last_became_active":"2023-12-24T19:58:36.567612+0000","last_became_peered":"2023-12-24T19:58:36.567612+0000","last_unstale":"2023-12-24T19:58:36.567902+0000","last_undegraded":"2023-12-24T19:58:36.567902+0000","last_fullsized":"2023-12-24T19:58:36.567902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:36.763239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566274+0000","last_change":"2023-12-24T19:58:36.565808+0000","last_active":"2023-12-24T19:58:36.566274+0000","last_peered":"2023-12-24T19:58:36.566274+0000","last_clean":"2023-12-24T19:58:36.566274+0000","last_became_active":"2023-12-24T19:58:36.565582+0000","last_became_peered":"2023-12-24T19:58:36.565582+0000","last_unstale":"2023-12-24T19:58:36.566274+0000","last_undegraded":"2023-12-24T19:58:36.566274+0000","last_fullsized":"2023-12-24T19:58:36.566274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:05.663561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571593+0000","last_change":"2023-12-24T19:58:36.571508+0000","last_active":"2023-12-24T19:58:36.571593+0000","last_peered":"2023-12-24T19:58:36.571593+0000","last_clean":"2023-12-24T19:58:36.571593+0000","last_became_active":"2023-12-24T19:58:36.570585+0000","last_became_peered":"2023-12-24T19:58:36.570585+0000","last_unstale":"2023-12-24T19:58:36.571593+0000","last_undegraded":"2023-12-24T19:58:36.571593+0000","last_fullsized":"2023-12-24T19:58:36.571593+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:50:11.001638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.562997+0000","last_change":"2023-12-24T19:58:36.561862+0000","last_active":"2023-12-24T19:58:36.562997+0000","last_peered":"2023-12-24T19:58:36.562997+0000","last_clean":"2023-12-24T19:58:36.562997+0000","last_became_active":"2023-12-24T19:58:36.561630+0000","last_became_peered":"2023-12-24T19:58:36.561630+0000","last_unstale":"2023-12-24T19:58:36.562997+0000","last_undegraded":"2023-12-24T19:58:36.562997+0000","last_fullsized":"2023-12-24T19:58:36.562997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:58:04.367601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576953+0000","last_change":"2023-12-24T19:58:36.576734+0000","last_active":"2023-12-24T19:58:36.576953+0000","last_peered":"2023-12-24T19:58:36.576953+0000","last_clean":"2023-12-24T19:58:36.576953+0000","last_became_active":"2023-12-24T19:58:36.574409+0000","last_became_peered":"2023-12-24T19:58:36.574409+0000","last_unstale":"2023-12-24T19:58:36.576953+0000","last_undegraded":"2023-12-24T19:58:36.576953+0000","last_fullsized":"2023-12-24T19:58:36.576953+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:18.802165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.567699+0000","last_change":"2023-12-24T19:58:36.567635+0000","last_active":"2023-12-24T19:58:36.567699+0000","last_peered":"2023-12-24T19:58:36.567699+0000","last_clean":"2023-12-24T19:58:36.567699+0000","last_became_active":"2023-12-24T19:58:36.567395+0000","last_became_peered":"2023-12-24T19:58:36.567395+0000","last_unstale":"2023-12-24T19:58:36.567699+0000","last_undegraded":"2023-12-24T19:58:36.567699+0000","last_fullsized":"2023-12-24T19:58:36.567699+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:03.848330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.564197+0000","last_change":"2023-12-24T19:58:36.564126+0000","last_active":"2023-12-24T19:58:36.564197+0000","last_peered":"2023-12-24T19:58:36.564197+0000","last_clean":"2023-12-24T19:58:36.564197+0000","last_became_active":"2023-12-24T19:58:36.563898+0000","last_became_peered":"2023-12-24T19:58:36.563898+0000","last_unstale":"2023-12-24T19:58:36.564197+0000","last_undegraded":"2023-12-24T19:58:36.564197+0000","last_fullsized":"2023-12-24T19:58:36.564197+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:37.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578768+0000","last_change":"2023-12-24T19:58:35.554738+0000","last_active":"2023-12-24T19:58:36.578768+0000","last_peered":"2023-12-24T19:58:36.578768+0000","last_clean":"2023-12-24T19:58:36.578768+0000","last_became_active":"2023-12-24T19:58:35.554509+0000","last_became_peered":"2023-12-24T19:58:35.554509+0000","last_unstale":"2023-12-24T19:58:36.578768+0000","last_undegraded":"2023-12-24T19:58:36.578768+0000","last_fullsized":"2023-12-24T19:58:36.578768+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:53:03.968162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.569809+0000","last_change":"2023-12-24T19:58:36.569543+0000","last_active":"2023-12-24T19:58:36.569809+0000","last_peered":"2023-12-24T19:58:36.569809+0000","last_clean":"2023-12-24T19:58:36.569809+0000","last_became_active":"2023-12-24T19:58:36.569275+0000","last_became_peered":"2023-12-24T19:58:36.569275+0000","last_unstale":"2023-12-24T19:58:36.569809+0000","last_undegraded":"2023-12-24T19:58:36.569809+0000","last_fullsized":"2023-12-24T19:58:36.569809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:15:34.472869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.575487+0000","last_change":"2023-12-24T19:58:35.554561+0000","last_active":"2023-12-24T19:58:36.575487+0000","last_peered":"2023-12-24T19:58:36.575487+0000","last_clean":"2023-12-24T19:58:36.575487+0000","last_became_active":"2023-12-24T19:58:35.554337+0000","last_became_peered":"2023-12-24T19:58:35.554337+0000","last_unstale":"2023-12-24T19:58:36.575487+0000","last_undegraded":"2023-12-24T19:58:36.575487+0000","last_fullsized":"2023-12-24T19:58:36.575487+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:51.493061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570083+0000","last_change":"2023-12-24T19:58:36.569270+0000","last_active":"2023-12-24T19:58:36.570083+0000","last_peered":"2023-12-24T19:58:36.570083+0000","last_clean":"2023-12-24T19:58:36.570083+0000","last_became_active":"2023-12-24T19:58:36.569045+0000","last_became_peered":"2023-12-24T19:58:36.569045+0000","last_unstale":"2023-12-24T19:58:36.570083+0000","last_undegraded":"2023-12-24T19:58:36.570083+0000","last_fullsized":"2023-12-24T19:58:36.570083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:53:04.974685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578281+0000","last_change":"2023-12-24T19:58:35.551183+0000","last_active":"2023-12-24T19:58:36.578281+0000","last_peered":"2023-12-24T19:58:36.578281+0000","last_clean":"2023-12-24T19:58:36.578281+0000","last_became_active":"2023-12-24T19:58:35.550648+0000","last_became_peered":"2023-12-24T19:58:35.550648+0000","last_unstale":"2023-12-24T19:58:36.578281+0000","last_undegraded":"2023-12-24T19:58:36.578281+0000","last_fullsized":"2023-12-24T19:58:36.578281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:13:22.198776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.565931+0000","last_change":"2023-12-24T19:58:36.565767+0000","last_active":"2023-12-24T19:58:36.565931+0000","last_peered":"2023-12-24T19:58:36.565931+0000","last_clean":"2023-12-24T19:58:36.565931+0000","last_became_active":"2023-12-24T19:58:36.565435+0000","last_became_peered":"2023-12-24T19:58:36.565435+0000","last_unstale":"2023-12-24T19:58:36.565931+0000","last_undegraded":"2023-12-24T19:58:36.565931+0000","last_fullsized":"2023-12-24T19:58:36.565931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:37:41.318918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.577168+0000","last_change":"2023-12-24T19:58:35.552410+0000","last_active":"2023-12-24T19:58:36.577168+0000","last_peered":"2023-12-24T19:58:36.577168+0000","last_clean":"2023-12-24T19:58:36.577168+0000","last_became_active":"2023-12-24T19:58:35.551605+0000","last_became_peered":"2023-12-24T19:58:35.551605+0000","last_unstale":"2023-12-24T19:58:36.577168+0000","last_undegraded":"2023-12-24T19:58:36.577168+0000","last_fullsized":"2023-12-24T19:58:36.577168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:04.657039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.569478+0000","last_change":"2023-12-24T19:58:36.569396+0000","last_active":"2023-12-24T19:58:36.569478+0000","last_peered":"2023-12-24T19:58:36.569478+0000","last_clean":"2023-12-24T19:58:36.569478+0000","last_became_active":"2023-12-24T19:58:36.569171+0000","last_became_peered":"2023-12-24T19:58:36.569171+0000","last_unstale":"2023-12-24T19:58:36.569478+0000","last_undegraded":"2023-12-24T19:58:36.569478+0000","last_fullsized":"2023-12-24T19:58:36.569478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:07:53.917159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576315+0000","last_change":"2023-12-24T19:58:35.549243+0000","last_active":"2023-12-24T19:58:36.576315+0000","last_peered":"2023-12-24T19:58:36.576315+0000","last_clean":"2023-12-24T19:58:36.576315+0000","last_became_active":"2023-12-24T19:58:35.548993+0000","last_became_peered":"2023-12-24T19:58:35.548993+0000","last_unstale":"2023-12-24T19:58:36.576315+0000","last_undegraded":"2023-12-24T19:58:36.576315+0000","last_fullsized":"2023-12-24T19:58:36.576315+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:07.430590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.573265+0000","last_change":"2023-12-24T19:58:36.573163+0000","last_active":"2023-12-24T19:58:36.573265+0000","last_peered":"2023-12-24T19:58:36.573265+0000","last_clean":"2023-12-24T19:58:36.573265+0000","last_became_active":"2023-12-24T19:58:36.572924+0000","last_became_peered":"2023-12-24T19:58:36.572924+0000","last_unstale":"2023-12-24T19:58:36.573265+0000","last_undegraded":"2023-12-24T19:58:36.573265+0000","last_fullsized":"2023-12-24T19:58:36.573265+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:07:53.917159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576482+0000","last_change":"2023-12-24T19:58:35.553617+0000","last_active":"2023-12-24T19:58:36.576482+0000","last_peered":"2023-12-24T19:58:36.576482+0000","last_clean":"2023-12-24T19:58:36.576482+0000","last_became_active":"2023-12-24T19:58:35.553388+0000","last_became_peered":"2023-12-24T19:58:35.553388+0000","last_unstale":"2023-12-24T19:58:36.576482+0000","last_undegraded":"2023-12-24T19:58:36.576482+0000","last_fullsized":"2023-12-24T19:58:36.576482+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:50:09.995115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.579743+0000","last_change":"2023-12-24T19:58:36.579682+0000","last_active":"2023-12-24T19:58:36.579743+0000","last_peered":"2023-12-24T19:58:36.579743+0000","last_clean":"2023-12-24T19:58:36.579743+0000","last_became_active":"2023-12-24T19:58:36.575742+0000","last_became_peered":"2023-12-24T19:58:36.575742+0000","last_unstale":"2023-12-24T19:58:36.579743+0000","last_undegraded":"2023-12-24T19:58:36.579743+0000","last_fullsized":"2023-12-24T19:58:36.579743+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:10.654990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.564219+0000","last_change":"2023-12-24T19:58:35.548864+0000","last_active":"2023-12-24T19:58:36.564219+0000","last_peered":"2023-12-24T19:58:36.564219+0000","last_clean":"2023-12-24T19:58:36.564219+0000","last_became_active":"2023-12-24T19:58:35.548635+0000","last_became_peered":"2023-12-24T19:58:35.548635+0000","last_unstale":"2023-12-24T19:58:36.564219+0000","last_undegraded":"2023-12-24T19:58:36.564219+0000","last_fullsized":"2023-12-24T19:58:36.564219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:13:22.198776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571746+0000","last_change":"2023-12-24T19:58:36.571687+0000","last_active":"2023-12-24T19:58:36.571746+0000","last_peered":"2023-12-24T19:58:36.571746+0000","last_clean":"2023-12-24T19:58:36.571746+0000","last_became_active":"2023-12-24T19:58:36.570820+0000","last_became_peered":"2023-12-24T19:58:36.570820+0000","last_unstale":"2023-12-24T19:58:36.571746+0000","last_undegraded":"2023-12-24T19:58:36.571746+0000","last_fullsized":"2023-12-24T19:58:36.571746+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:13:23.205298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.557208+0000","last_change":"2023-12-24T19:58:35.551064+0000","last_active":"2023-12-24T19:58:36.557208+0000","last_peered":"2023-12-24T19:58:36.557208+0000","last_clean":"2023-12-24T19:58:36.557208+0000","last_became_active":"2023-12-24T19:58:35.549218+0000","last_became_peered":"2023-12-24T19:58:35.549218+0000","last_unstale":"2023-12-24T19:58:36.557208+0000","last_undegraded":"2023-12-24T19:58:36.557208+0000","last_fullsized":"2023-12-24T19:58:36.557208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:13.568074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.579896+0000","last_change":"2023-12-24T19:58:36.579844+0000","last_active":"2023-12-24T19:58:36.579896+0000","last_peered":"2023-12-24T19:58:36.579896+0000","last_clean":"2023-12-24T19:58:36.579896+0000","last_became_active":"2023-12-24T19:58:36.579663+0000","last_became_peered":"2023-12-24T19:58:36.579663+0000","last_unstale":"2023-12-24T19:58:36.579896+0000","last_undegraded":"2023-12-24T19:58:36.579896+0000","last_fullsized":"2023-12-24T19:58:36.579896+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:37.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.558605+0000","last_change":"2023-12-24T19:58:35.553828+0000","last_active":"2023-12-24T19:58:36.558605+0000","last_peered":"2023-12-24T19:58:36.558605+0000","last_clean":"2023-12-24T19:58:36.558605+0000","last_became_active":"2023-12-24T19:58:35.553563+0000","last_became_peered":"2023-12-24T19:58:35.553563+0000","last_unstale":"2023-12-24T19:58:36.558605+0000","last_undegraded":"2023-12-24T19:58:36.558605+0000","last_fullsized":"2023-12-24T19:58:36.558605+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:13.568074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568407+0000","last_change":"2023-12-24T19:58:36.568190+0000","last_active":"2023-12-24T19:58:36.568407+0000","last_peered":"2023-12-24T19:58:36.568407+0000","last_clean":"2023-12-24T19:58:36.568407+0000","last_became_active":"2023-12-24T19:58:36.567857+0000","last_became_peered":"2023-12-24T19:58:36.567857+0000","last_unstale":"2023-12-24T19:58:36.568407+0000","last_undegraded":"2023-12-24T19:58:36.568407+0000","last_fullsized":"2023-12-24T19:58:36.568407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:54:01.331430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.556012+0000","last_change":"2023-12-24T19:58:35.552299+0000","last_active":"2023-12-24T19:58:36.556012+0000","last_peered":"2023-12-24T19:58:36.556012+0000","last_clean":"2023-12-24T19:58:36.556012+0000","last_became_active":"2023-12-24T19:58:35.552069+0000","last_became_peered":"2023-12-24T19:58:35.552069+0000","last_unstale":"2023-12-24T19:58:36.556012+0000","last_undegraded":"2023-12-24T19:58:36.556012+0000","last_fullsized":"2023-12-24T19:58:36.556012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:51.493061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570374+0000","last_change":"2023-12-24T19:58:36.570313+0000","last_active":"2023-12-24T19:58:36.570374+0000","last_peered":"2023-12-24T19:58:36.570374+0000","last_clean":"2023-12-24T19:58:36.570374+0000","last_became_active":"2023-12-24T19:58:36.569417+0000","last_became_peered":"2023-12-24T19:58:36.569417+0000","last_unstale":"2023-12-24T19:58:36.570374+0000","last_undegraded":"2023-12-24T19:58:36.570374+0000","last_fullsized":"2023-12-24T19:58:36.570374+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:39.254630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576427+0000","last_change":"2023-12-24T19:58:35.555205+0000","last_active":"2023-12-24T19:58:36.576427+0000","last_peered":"2023-12-24T19:58:36.576427+0000","last_clean":"2023-12-24T19:58:36.576427+0000","last_became_active":"2023-12-24T19:58:35.554965+0000","last_became_peered":"2023-12-24T19:58:35.554965+0000","last_unstale":"2023-12-24T19:58:36.576427+0000","last_undegraded":"2023-12-24T19:58:36.576427+0000","last_fullsized":"2023-12-24T19:58:36.576427+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:22:24.842431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.559948+0000","last_change":"2023-12-24T19:58:36.559864+0000","last_active":"2023-12-24T19:58:36.559948+0000","last_peered":"2023-12-24T19:58:36.559948+0000","last_clean":"2023-12-24T19:58:36.559948+0000","last_became_active":"2023-12-24T19:58:36.559617+0000","last_became_peered":"2023-12-24T19:58:36.559617+0000","last_unstale":"2023-12-24T19:58:36.559948+0000","last_undegraded":"2023-12-24T19:58:36.559948+0000","last_fullsized":"2023-12-24T19:58:36.559948+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:44.904761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.579335+0000","last_change":"2023-12-24T19:58:35.551300+0000","last_active":"2023-12-24T19:58:36.579335+0000","last_peered":"2023-12-24T19:58:36.579335+0000","last_clean":"2023-12-24T19:58:36.579335+0000","last_became_active":"2023-12-24T19:58:35.551082+0000","last_became_peered":"2023-12-24T19:58:35.551082+0000","last_unstale":"2023-12-24T19:58:36.579335+0000","last_undegraded":"2023-12-24T19:58:36.579335+0000","last_fullsized":"2023-12-24T19:58:36.579335+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:38.377320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566858+0000","last_change":"2023-12-24T19:58:36.566285+0000","last_active":"2023-12-24T19:58:36.566858+0000","last_peered":"2023-12-24T19:58:36.566858+0000","last_clean":"2023-12-24T19:58:36.566858+0000","last_became_active":"2023-12-24T19:58:36.565745+0000","last_became_peered":"2023-12-24T19:58:36.565745+0000","last_unstale":"2023-12-24T19:58:36.566858+0000","last_undegraded":"2023-12-24T19:58:36.566858+0000","last_fullsized":"2023-12-24T19:58:36.566858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:22:55.385014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.580619+0000","last_change":"2023-12-24T19:58:35.546848+0000","last_active":"2023-12-24T19:58:36.580619+0000","last_peered":"2023-12-24T19:58:36.580619+0000","last_clean":"2023-12-24T19:58:36.580619+0000","last_became_active":"2023-12-24T19:58:35.546601+0000","last_became_peered":"2023-12-24T19:58:35.546601+0000","last_unstale":"2023-12-24T19:58:36.580619+0000","last_undegraded":"2023-12-24T19:58:36.580619+0000","last_fullsized":"2023-12-24T19:58:36.580619+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:22:24.842431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560169+0000","last_change":"2023-12-24T19:58:36.560102+0000","last_active":"2023-12-24T19:58:36.560169+0000","last_peered":"2023-12-24T19:58:36.560169+0000","last_clean":"2023-12-24T19:58:36.560169+0000","last_became_active":"2023-12-24T19:58:36.559553+0000","last_became_peered":"2023-12-24T19:58:36.559553+0000","last_unstale":"2023-12-24T19:58:36.560169+0000","last_undegraded":"2023-12-24T19:58:36.560169+0000","last_fullsized":"2023-12-24T19:58:36.560169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:19:41.163852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560078+0000","last_change":"2023-12-24T19:58:35.552547+0000","last_active":"2023-12-24T19:58:36.560078+0000","last_peered":"2023-12-24T19:58:36.560078+0000","last_clean":"2023-12-24T19:58:36.560078+0000","last_became_active":"2023-12-24T19:58:35.551924+0000","last_became_peered":"2023-12-24T19:58:35.551924+0000","last_unstale":"2023-12-24T19:58:36.560078+0000","last_undegraded":"2023-12-24T19:58:36.560078+0000","last_fullsized":"2023-12-24T19:58:36.560078+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:53:03.968162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571870+0000","last_change":"2023-12-24T19:58:36.571783+0000","last_active":"2023-12-24T19:58:36.571870+0000","last_peered":"2023-12-24T19:58:36.571870+0000","last_clean":"2023-12-24T19:58:36.571870+0000","last_became_active":"2023-12-24T19:58:36.571313+0000","last_became_peered":"2023-12-24T19:58:36.571313+0000","last_unstale":"2023-12-24T19:58:36.571870+0000","last_undegraded":"2023-12-24T19:58:36.571870+0000","last_fullsized":"2023-12-24T19:58:36.571870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:25:58.641762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.561041+0000","last_change":"2023-12-24T19:58:35.545786+0000","last_active":"2023-12-24T19:58:36.561041+0000","last_peered":"2023-12-24T19:58:36.561041+0000","last_clean":"2023-12-24T19:58:36.561041+0000","last_became_active":"2023-12-24T19:58:35.545534+0000","last_became_peered":"2023-12-24T19:58:35.545534+0000","last_unstale":"2023-12-24T19:58:36.561041+0000","last_undegraded":"2023-12-24T19:58:36.561041+0000","last_fullsized":"2023-12-24T19:58:36.561041+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:35.756716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.564225+0000","last_change":"2023-12-24T19:58:36.564137+0000","last_active":"2023-12-24T19:58:36.564225+0000","last_peered":"2023-12-24T19:58:36.564225+0000","last_clean":"2023-12-24T19:58:36.564225+0000","last_became_active":"2023-12-24T19:58:36.563869+0000","last_became_peered":"2023-12-24T19:58:36.563869+0000","last_unstale":"2023-12-24T19:58:36.564225+0000","last_undegraded":"2023-12-24T19:58:36.564225+0000","last_fullsized":"2023-12-24T19:58:36.564225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:10:01.839291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.581309+0000","last_change":"2023-12-24T19:58:35.547230+0000","last_active":"2023-12-24T19:58:36.581309+0000","last_peered":"2023-12-24T19:58:36.581309+0000","last_clean":"2023-12-24T19:58:36.581309+0000","last_became_active":"2023-12-24T19:58:35.546970+0000","last_became_peered":"2023-12-24T19:58:35.546970+0000","last_unstale":"2023-12-24T19:58:36.581309+0000","last_undegraded":"2023-12-24T19:58:36.581309+0000","last_fullsized":"2023-12-24T19:58:36.581309+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:40:34.280419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566829+0000","last_change":"2023-12-24T19:58:36.565797+0000","last_active":"2023-12-24T19:58:36.566829+0000","last_peered":"2023-12-24T19:58:36.566829+0000","last_clean":"2023-12-24T19:58:36.566829+0000","last_became_active":"2023-12-24T19:58:36.565557+0000","last_became_peered":"2023-12-24T19:58:36.565557+0000","last_unstale":"2023-12-24T19:58:36.566829+0000","last_undegraded":"2023-12-24T19:58:36.566829+0000","last_fullsized":"2023-12-24T19:58:36.566829+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:10:22.783403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578429+0000","last_change":"2023-12-24T19:58:35.548530+0000","last_active":"2023-12-24T19:58:36.578429+0000","last_peered":"2023-12-24T19:58:36.578429+0000","last_clean":"2023-12-24T19:58:36.578429+0000","last_became_active":"2023-12-24T19:58:35.548293+0000","last_became_peered":"2023-12-24T19:58:35.548293+0000","last_unstale":"2023-12-24T19:58:36.578429+0000","last_undegraded":"2023-12-24T19:58:36.578429+0000","last_fullsized":"2023-12-24T19:58:36.578429+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:20.023885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.565924+0000","last_change":"2023-12-24T19:58:36.565839+0000","last_active":"2023-12-24T19:58:36.565924+0000","last_peered":"2023-12-24T19:58:36.565924+0000","last_clean":"2023-12-24T19:58:36.565924+0000","last_became_active":"2023-12-24T19:58:36.565604+0000","last_became_peered":"2023-12-24T19:58:36.565604+0000","last_unstale":"2023-12-24T19:58:36.565924+0000","last_undegraded":"2023-12-24T19:58:36.565924+0000","last_fullsized":"2023-12-24T19:58:36.565924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:10:52.962452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.577370+0000","last_change":"2023-12-24T19:58:35.549794+0000","last_active":"2023-12-24T19:58:36.577370+0000","last_peered":"2023-12-24T19:58:36.577370+0000","last_clean":"2023-12-24T19:58:36.577370+0000","last_became_active":"2023-12-24T19:58:35.549557+0000","last_became_peered":"2023-12-24T19:58:35.549557+0000","last_unstale":"2023-12-24T19:58:36.577370+0000","last_undegraded":"2023-12-24T19:58:36.577370+0000","last_fullsized":"2023-12-24T19:58:36.577370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:22:54.378491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570470+0000","last_change":"2023-12-24T19:58:36.570409+0000","last_active":"2023-12-24T19:58:36.570470+0000","last_peered":"2023-12-24T19:58:36.570470+0000","last_clean":"2023-12-24T19:58:36.570470+0000","last_became_active":"2023-12-24T19:58:36.570176+0000","last_became_peered":"2023-12-24T19:58:36.570176+0000","last_unstale":"2023-12-24T19:58:36.570470+0000","last_undegraded":"2023-12-24T19:58:36.570470+0000","last_fullsized":"2023-12-24T19:58:36.570470+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:00:46.525107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578158+0000","last_change":"2023-12-24T19:58:35.546709+0000","last_active":"2023-12-24T19:58:36.578158+0000","last_peered":"2023-12-24T19:58:36.578158+0000","last_clean":"2023-12-24T19:58:36.578158+0000","last_became_active":"2023-12-24T19:58:35.546420+0000","last_became_peered":"2023-12-24T19:58:35.546420+0000","last_unstale":"2023-12-24T19:58:36.578158+0000","last_undegraded":"2023-12-24T19:58:36.578158+0000","last_fullsized":"2023-12-24T19:58:36.578158+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:15:33.466347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566727+0000","last_change":"2023-12-24T19:58:36.564131+0000","last_active":"2023-12-24T19:58:36.566727+0000","last_peered":"2023-12-24T19:58:36.566727+0000","last_clean":"2023-12-24T19:58:36.566727+0000","last_became_active":"2023-12-24T19:58:36.563711+0000","last_became_peered":"2023-12-24T19:58:36.563711+0000","last_unstale":"2023-12-24T19:58:36.566727+0000","last_undegraded":"2023-12-24T19:58:36.566727+0000","last_fullsized":"2023-12-24T19:58:36.566727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:27.006567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.561140+0000","last_change":"2023-12-24T19:58:35.554696+0000","last_active":"2023-12-24T19:58:36.561140+0000","last_peered":"2023-12-24T19:58:36.561140+0000","last_clean":"2023-12-24T19:58:36.561140+0000","last_became_active":"2023-12-24T19:58:35.554460+0000","last_became_peered":"2023-12-24T19:58:35.554460+0000","last_unstale":"2023-12-24T19:58:36.561140+0000","last_undegraded":"2023-12-24T19:58:36.561140+0000","last_fullsized":"2023-12-24T19:58:36.561140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:37:40.312396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570241+0000","last_change":"2023-12-24T19:58:36.570163+0000","last_active":"2023-12-24T19:58:36.570241+0000","last_peered":"2023-12-24T19:58:36.570241+0000","last_clean":"2023-12-24T19:58:36.570241+0000","last_became_active":"2023-12-24T19:58:36.569128+0000","last_became_peered":"2023-12-24T19:58:36.569128+0000","last_unstale":"2023-12-24T19:58:36.570241+0000","last_undegraded":"2023-12-24T19:58:36.570241+0000","last_fullsized":"2023-12-24T19:58:36.570241+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:57:06.470773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578999+0000","last_change":"2023-12-24T19:58:35.548743+0000","last_active":"2023-12-24T19:58:36.578999+0000","last_peered":"2023-12-24T19:58:36.578999+0000","last_clean":"2023-12-24T19:58:36.578999+0000","last_became_active":"2023-12-24T19:58:35.548245+0000","last_became_peered":"2023-12-24T19:58:35.548245+0000","last_unstale":"2023-12-24T19:58:36.578999+0000","last_undegraded":"2023-12-24T19:58:36.578999+0000","last_fullsized":"2023-12-24T19:58:36.578999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:07:52.910637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.563342+0000","last_change":"2023-12-24T19:58:36.562883+0000","last_active":"2023-12-24T19:58:36.563342+0000","last_peered":"2023-12-24T19:58:36.563342+0000","last_clean":"2023-12-24T19:58:36.563342+0000","last_became_active":"2023-12-24T19:58:36.562644+0000","last_became_peered":"2023-12-24T19:58:36.562644+0000","last_unstale":"2023-12-24T19:58:36.563342+0000","last_undegraded":"2023-12-24T19:58:36.563342+0000","last_fullsized":"2023-12-24T19:58:36.563342+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:53:49.861298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.564310+0000","last_change":"2023-12-24T19:58:35.553978+0000","last_active":"2023-12-24T19:58:36.564310+0000","last_peered":"2023-12-24T19:58:36.564310+0000","last_clean":"2023-12-24T19:58:36.564310+0000","last_became_active":"2023-12-24T19:58:35.553750+0000","last_became_peered":"2023-12-24T19:58:35.553750+0000","last_unstale":"2023-12-24T19:58:36.564310+0000","last_undegraded":"2023-12-24T19:58:36.564310+0000","last_fullsized":"2023-12-24T19:58:36.564310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:26.000044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566850+0000","last_change":"2023-12-24T19:58:36.565947+0000","last_active":"2023-12-24T19:58:36.566850+0000","last_peered":"2023-12-24T19:58:36.566850+0000","last_clean":"2023-12-24T19:58:36.566850+0000","last_became_active":"2023-12-24T19:58:36.565362+0000","last_became_peered":"2023-12-24T19:58:36.565362+0000","last_unstale":"2023-12-24T19:58:36.566850+0000","last_undegraded":"2023-12-24T19:58:36.566850+0000","last_fullsized":"2023-12-24T19:58:36.566850+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:44:23.746078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.557117+0000","last_change":"2023-12-24T19:58:35.552506+0000","last_active":"2023-12-24T19:58:36.557117+0000","last_peered":"2023-12-24T19:58:36.557117+0000","last_clean":"2023-12-24T19:58:36.557117+0000","last_became_active":"2023-12-24T19:58:35.551998+0000","last_became_peered":"2023-12-24T19:58:35.551998+0000","last_unstale":"2023-12-24T19:58:36.557117+0000","last_undegraded":"2023-12-24T19:58:36.557117+0000","last_fullsized":"2023-12-24T19:58:36.557117+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:25.964218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560421+0000","last_change":"2023-12-24T19:58:36.560251+0000","last_active":"2023-12-24T19:58:36.560421+0000","last_peered":"2023-12-24T19:58:36.560421+0000","last_clean":"2023-12-24T19:58:36.560421+0000","last_became_active":"2023-12-24T19:58:36.559859+0000","last_became_peered":"2023-12-24T19:58:36.559859+0000","last_unstale":"2023-12-24T19:58:36.560421+0000","last_undegraded":"2023-12-24T19:58:36.560421+0000","last_fullsized":"2023-12-24T19:58:36.560421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:20.631799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560165+0000","last_change":"2023-12-24T19:58:35.552677+0000","last_active":"2023-12-24T19:58:36.560165+0000","last_peered":"2023-12-24T19:58:36.560165+0000","last_clean":"2023-12-24T19:58:36.560165+0000","last_became_active":"2023-12-24T19:58:35.552203+0000","last_became_peered":"2023-12-24T19:58:35.552203+0000","last_unstale":"2023-12-24T19:58:36.560165+0000","last_undegraded":"2023-12-24T19:58:36.560165+0000","last_fullsized":"2023-12-24T19:58:36.560165+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:35.756716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566837+0000","last_change":"2023-12-24T19:58:36.566110+0000","last_active":"2023-12-24T19:58:36.566837+0000","last_peered":"2023-12-24T19:58:36.566837+0000","last_clean":"2023-12-24T19:58:36.566837+0000","last_became_active":"2023-12-24T19:58:36.565673+0000","last_became_peered":"2023-12-24T19:58:36.565673+0000","last_unstale":"2023-12-24T19:58:36.566837+0000","last_undegraded":"2023-12-24T19:58:36.566837+0000","last_fullsized":"2023-12-24T19:58:36.566837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:52.499584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-24T19:58:37.559251+0000","last_change":"2023-12-24T19:58:35.553860+0000","last_active":"2023-12-24T19:58:37.559251+0000","last_peered":"2023-12-24T19:58:37.559251+0000","last_clean":"2023-12-24T19:58:37.559251+0000","last_became_active":"2023-12-24T19:58:35.553617+0000","last_became_peered":"2023-12-24T19:58:35.553617+0000","last_unstale":"2023-12-24T19:58:37.559251+0000","last_undegraded":"2023-12-24T19:58:37.559251+0000","last_fullsized":"2023-12-24T19:58:37.559251+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:04.657039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.580518+0000","last_change":"2023-12-24T19:58:36.580424+0000","last_active":"2023-12-24T19:58:36.580518+0000","last_peered":"2023-12-24T19:58:36.580518+0000","last_clean":"2023-12-24T19:58:36.580518+0000","last_became_active":"2023-12-24T19:58:36.579071+0000","last_became_peered":"2023-12-24T19:58:36.579071+0000","last_unstale":"2023-12-24T19:58:36.580518+0000","last_undegraded":"2023-12-24T19:58:36.580518+0000","last_fullsized":"2023-12-24T19:58:36.580518+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:08.437113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.558699+0000","last_change":"2023-12-24T19:58:35.555442+0000","last_active":"2023-12-24T19:58:36.558699+0000","last_peered":"2023-12-24T19:58:36.558699+0000","last_clean":"2023-12-24T19:58:36.558699+0000","last_became_active":"2023-12-24T19:58:35.555231+0000","last_became_peered":"2023-12-24T19:58:35.555231+0000","last_unstale":"2023-12-24T19:58:36.558699+0000","last_undegraded":"2023-12-24T19:58:36.558699+0000","last_fullsized":"2023-12-24T19:58:36.558699+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:37:40.312396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568001+0000","last_change":"2023-12-24T19:58:36.567940+0000","last_active":"2023-12-24T19:58:36.568001+0000","last_peered":"2023-12-24T19:58:36.568001+0000","last_clean":"2023-12-24T19:58:36.568001+0000","last_became_active":"2023-12-24T19:58:36.567702+0000","last_became_peered":"2023-12-24T19:58:36.567702+0000","last_unstale":"2023-12-24T19:58:36.568001+0000","last_undegraded":"2023-12-24T19:58:36.568001+0000","last_fullsized":"2023-12-24T19:58:36.568001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:17:10.405221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.559097+0000","last_change":"2023-12-24T19:58:35.551329+0000","last_active":"2023-12-24T19:58:36.559097+0000","last_peered":"2023-12-24T19:58:36.559097+0000","last_clean":"2023-12-24T19:58:36.559097+0000","last_became_active":"2023-12-24T19:58:35.550935+0000","last_became_peered":"2023-12-24T19:58:35.550935+0000","last_unstale":"2023-12-24T19:58:36.559097+0000","last_undegraded":"2023-12-24T19:58:36.559097+0000","last_fullsized":"2023-12-24T19:58:36.559097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:00:45.518584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570110+0000","last_change":"2023-12-24T19:58:36.569741+0000","last_active":"2023-12-24T19:58:36.570110+0000","last_peered":"2023-12-24T19:58:36.570110+0000","last_clean":"2023-12-24T19:58:36.570110+0000","last_became_active":"2023-12-24T19:58:36.569096+0000","last_became_peered":"2023-12-24T19:58:36.569096+0000","last_unstale":"2023-12-24T19:58:36.570110+0000","last_undegraded":"2023-12-24T19:58:36.570110+0000","last_fullsized":"2023-12-24T19:58:36.570110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:10:01.839291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560529+0000","last_change":"2023-12-24T19:58:35.554755+0000","last_active":"2023-12-24T19:58:36.560529+0000","last_peered":"2023-12-24T19:58:36.560529+0000","last_clean":"2023-12-24T19:58:36.560529+0000","last_became_active":"2023-12-24T19:58:35.554561+0000","last_became_peered":"2023-12-24T19:58:35.554561+0000","last_unstale":"2023-12-24T19:58:36.560529+0000","last_undegraded":"2023-12-24T19:58:36.560529+0000","last_fullsized":"2023-12-24T19:58:36.560529+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:53:48.854776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.574010+0000","last_change":"2023-12-24T19:58:36.573863+0000","last_active":"2023-12-24T19:58:36.574010+0000","last_peered":"2023-12-24T19:58:36.574010+0000","last_clean":"2023-12-24T19:58:36.574010+0000","last_became_active":"2023-12-24T19:58:36.568717+0000","last_became_peered":"2023-12-24T19:58:36.568717+0000","last_unstale":"2023-12-24T19:58:36.574010+0000","last_undegraded":"2023-12-24T19:58:36.574010+0000","last_fullsized":"2023-12-24T19:58:36.574010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:32.000359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560057+0000","last_change":"2023-12-24T19:58:35.550038+0000","last_active":"2023-12-24T19:58:36.560057+0000","last_peered":"2023-12-24T19:58:36.560057+0000","last_clean":"2023-12-24T19:58:36.560057+0000","last_became_active":"2023-12-24T19:58:35.549805+0000","last_became_peered":"2023-12-24T19:58:35.549805+0000","last_unstale":"2023-12-24T19:58:36.560057+0000","last_undegraded":"2023-12-24T19:58:36.560057+0000","last_fullsized":"2023-12-24T19:58:36.560057+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:25.964218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570070+0000","last_change":"2023-12-24T19:58:36.569047+0000","last_active":"2023-12-24T19:58:36.570070+0000","last_peered":"2023-12-24T19:58:36.570070+0000","last_clean":"2023-12-24T19:58:36.570070+0000","last_became_active":"2023-12-24T19:58:36.568839+0000","last_became_peered":"2023-12-24T19:58:36.568839+0000","last_unstale":"2023-12-24T19:58:36.570070+0000","last_undegraded":"2023-12-24T19:58:36.570070+0000","last_fullsized":"2023-12-24T19:58:36.570070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:08.437113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.559138+0000","last_change":"2023-12-24T19:58:35.554829+0000","last_active":"2023-12-24T19:58:36.559138+0000","last_peered":"2023-12-24T19:58:36.559138+0000","last_clean":"2023-12-24T19:58:36.559138+0000","last_became_active":"2023-12-24T19:58:35.554617+0000","last_became_peered":"2023-12-24T19:58:35.554617+0000","last_unstale":"2023-12-24T19:58:36.559138+0000","last_undegraded":"2023-12-24T19:58:36.559138+0000","last_fullsized":"2023-12-24T19:58:36.559138+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:01.171591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568794+0000","last_change":"2023-12-24T19:58:36.568577+0000","last_active":"2023-12-24T19:58:36.568794+0000","last_peered":"2023-12-24T19:58:36.568794+0000","last_clean":"2023-12-24T19:58:36.568794+0000","last_became_active":"2023-12-24T19:58:36.567611+0000","last_became_peered":"2023-12-24T19:58:36.567611+0000","last_unstale":"2023-12-24T19:58:36.568794+0000","last_undegraded":"2023-12-24T19:58:36.568794+0000","last_fullsized":"2023-12-24T19:58:36.568794+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:08.437113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.556018+0000","last_change":"2023-12-24T19:58:35.547161+0000","last_active":"2023-12-24T19:58:36.556018+0000","last_peered":"2023-12-24T19:58:36.556018+0000","last_clean":"2023-12-24T19:58:36.556018+0000","last_became_active":"2023-12-24T19:58:35.546903+0000","last_became_peered":"2023-12-24T19:58:35.546903+0000","last_unstale":"2023-12-24T19:58:36.556018+0000","last_undegraded":"2023-12-24T19:58:36.556018+0000","last_fullsized":"2023-12-24T19:58:36.556018+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:50:09.995115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.558784+0000","last_change":"2023-12-24T19:58:36.558718+0000","last_active":"2023-12-24T19:58:36.558784+0000","last_peered":"2023-12-24T19:58:36.558784+0000","last_clean":"2023-12-24T19:58:36.558784+0000","last_became_active":"2023-12-24T19:58:36.558466+0000","last_became_peered":"2023-12-24T19:58:36.558466+0000","last_unstale":"2023-12-24T19:58:36.558784+0000","last_undegraded":"2023-12-24T19:58:36.558784+0000","last_fullsized":"2023-12-24T19:58:36.558784+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:36.763239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578866+0000","last_change":"2023-12-24T19:58:35.550031+0000","last_active":"2023-12-24T19:58:36.578866+0000","last_peered":"2023-12-24T19:58:36.578866+0000","last_clean":"2023-12-24T19:58:36.578866+0000","last_became_active":"2023-12-24T19:58:35.549594+0000","last_became_peered":"2023-12-24T19:58:35.549594+0000","last_unstale":"2023-12-24T19:58:36.578866+0000","last_undegraded":"2023-12-24T19:58:36.578866+0000","last_fullsized":"2023-12-24T19:58:36.578866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:01.171591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":184,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.558792+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:58:36.558792+0000","last_peered":"2023-12-24T19:58:36.558792+0000","last_clean":"2023-12-24T19:58:36.558792+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:58:36.558792+0000","last_undegraded":"2023-12-24T19:58:36.558792+0000","last_fullsized":"2023-12-24T19:58:36.558792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195831,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55700000000000005}]},{"osd":2,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60699999999999998}]},{"osd":5,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785645,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.504}]},{"osd":1,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.432},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48799999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54200000000000004}]},{"osd":4,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45600000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.40000000000000002}]},{"osd":7,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.33700000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.35499999999999998}]},{"osd":3,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.28599999999999998}]},{"osd":4,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.64900000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.79600000000000004}]},{"osd":6,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.83599999999999997}]},{"osd":7,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195887,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.312}]},{"osd":2,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.36199999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.376},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.39400000000000002}]},{"osd":4,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.6859999999999999,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58599999999999997}]},{"osd":6,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.621}]},{"osd":7,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.504},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.47599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784731,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.35699999999999998}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.39400000000000002}]},{"osd":3,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.378},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53300000000000003}]},{"osd":5,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.51600000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.308},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.29599999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.35299999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53200000000000003}]},{"osd":5,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67000000000000004}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.70099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784753,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.434}]},{"osd":1,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.45200000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.49399999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":8.8200000000000003,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.39900000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.8279999999999998,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.57199999999999995}]},{"osd":6,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":14.039999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.505},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.435}]},{"osd":3,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40200000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57899999999999996}]}]}],"pool_statfs":[]}} 2023-12-24T19:58:40.691 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:58:40.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.847+0000 7f0be1d68700 1 Processor -- start 2023-12-24T19:58:40.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.847+0000 7f0be1d68700 1 -- start start 2023-12-24T19:58:40.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0be1d68700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0bdc159e60 0x7f0bdc0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0be1d68700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc070d50 0x7f0bdc0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0be1d68700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc06a090 con 0x7f0bdc159a90 2023-12-24T19:58:40.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0be1d68700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc06ac10 con 0x7f0bdc159e60 2023-12-24T19:58:40.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0be1d68700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0c9e40 con 0x7f0bdc070d50 2023-12-24T19:58:40.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0bdaffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0bdc159e60 0x7f0bdc0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0bdaffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0bdc159e60 0x7f0bdc0c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51534/0 (socket says 172.21.15.61:51534) 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0bdb7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0bdc159a90 0x7f0bdc070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44528/0 (socket says 172.21.15.61:44528) 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0bdaffd700 1 -- 172.21.15.61:0/271851967 learned_addr learned my addr 172.21.15.61:0/271851967 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0bdbfff700 1 --2- 172.21.15.61:0/271851967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc070d50 0x7f0bdc0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0bdaffd700 1 -- 172.21.15.61:0/271851967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc070d50 msgr2=0x7f0bdc0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0bdaffd700 1 --2- 172.21.15.61:0/271851967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc070d50 0x7f0bdc0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0bdaffd700 1 -- 172.21.15.61:0/271851967 >> v1:172.21.15.61:6789/0 conn(0x7f0bdc159a90 legacy=0x7f0bdc070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0bdaffd700 1 -- 172.21.15.61:0/271851967 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc06a2e0 con 0x7f0bdc159e60 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.848+0000 7f0bdbfff700 1 --2- 172.21.15.61:0/271851967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc070d50 0x7f0bdc0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0bdaffd700 1 --2- 172.21.15.61:0/271851967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc159e60 0x7f0bdc0c93c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40099b0 tx=0x7f0bc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d183f24495207cb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0bda7fc700 1 -- 172.21.15.61:0/271851967 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400b860 con 0x7f0bdc159e60 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0bda7fc700 1 -- 172.21.15.61:0/271851967 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc400b9c0 con 0x7f0bdc159e60 2023-12-24T19:58:40.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0bda7fc700 1 -- 172.21.15.61:0/271851967 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400bd60 con 0x7f0bdc159e60 2023-12-24T19:58:40.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0be1d68700 1 -- 172.21.15.61:0/271851967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc159e60 msgr2=0x7f0bdc0c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0be1d68700 1 --2- 172.21.15.61:0/271851967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc159e60 0x7f0bdc0c93c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40099b0 tx=0x7f0bc4009250 comp rx=0 tx=0).stop 2023-12-24T19:58:40.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0be1d68700 1 -- 172.21.15.61:0/271851967 shutdown_connections 2023-12-24T19:58:40.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0be1d68700 1 --2- 172.21.15.61:0/271851967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc070d50 0x7f0bdc0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0be1d68700 1 --2- 172.21.15.61:0/271851967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc159e60 0x7f0bdc0c93c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0be1d68700 1 -- 172.21.15.61:0/271851967 >> 172.21.15.61:0/271851967 conn(0x7f0bdc0cd6f0 msgr2=0x7f0bdc0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:40.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0be1d68700 1 -- 172.21.15.61:0/271851967 shutdown_connections 2023-12-24T19:58:40.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.849+0000 7f0be1d68700 1 -- 172.21.15.61:0/271851967 wait complete. 2023-12-24T19:58:40.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.851+0000 7f0be1d68700 1 Processor -- start 2023-12-24T19:58:40.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.851+0000 7f0be1d68700 1 -- start start 2023-12-24T19:58:40.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0be1d68700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc070d50 0x7f0bdc0c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0be1d68700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bdc159a90 0x7f0bdc0c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0be1d68700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc159e60 0x7f0bdc16a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0be1d68700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0c2320 con 0x7f0bdc070d50 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0be1d68700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0c54d0 con 0x7f0bdc159a90 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0be1d68700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0c57b0 con 0x7f0bdc159e60 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0bdb7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc070d50 0x7f0bdc0c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0bdb7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc070d50 0x7f0bdc0c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51544/0 (socket says 172.21.15.61:51544) 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0bdb7fe700 1 -- 172.21.15.61:0/2773516702 learned_addr learned my addr 172.21.15.61:0/2773516702 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0bdbfff700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc159e60 0x7f0bdc16a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.852+0000 7f0bdaffd700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bdc159a90 0x7f0bdc0c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bdb7fe700 1 -- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc159e60 msgr2=0x7f0bdc16a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bdb7fe700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc159e60 0x7f0bdc16a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bdb7fe700 1 -- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bdc159a90 msgr2=0x7f0bdc0c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:40.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bdb7fe700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bdc159a90 0x7f0bdc0c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bdb7fe700 1 -- 172.21.15.61:0/2773516702 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc40094f0 con 0x7f0bdc070d50 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bdaffd700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bdc159a90 0x7f0bdc0c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bdbfff700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc159e60 0x7f0bdc16a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bdb7fe700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc070d50 0x7f0bdc0c1d40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c7c0 tx=0x7f0bcc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bd37fe700 1 -- 172.21.15.61:0/2773516702 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc005a70 con 0x7f0bdc070d50 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bd37fe700 1 -- 172.21.15.61:0/2773516702 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc005bf0 con 0x7f0bdc070d50 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0be1d68700 1 -- 172.21.15.61:0/2773516702 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc0c5a90 con 0x7f0bdc070d50 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0bd37fe700 1 -- 172.21.15.61:0/2773516702 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0070f0 con 0x7f0bdc070d50 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.853+0000 7f0be1d68700 1 -- 172.21.15.61:0/2773516702 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc0c3e70 con 0x7f0bdc070d50 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.854+0000 7f0be1d68700 1 -- 172.21.15.61:0/2773516702 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc0c5f90 con 0x7f0bdc070d50 2023-12-24T19:58:40.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.854+0000 7f0bd37fe700 1 -- 172.21.15.61:0/2773516702 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0bcc007460 con 0x7f0bdc070d50 2023-12-24T19:58:40.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.855+0000 7f0bd37fe700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bbc066f30 0x7f0bbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:40.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.855+0000 7f0bd37fe700 1 -- 172.21.15.61:0/2773516702 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0bcc083f90 con 0x7f0bdc070d50 2023-12-24T19:58:40.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.855+0000 7f0bdaffd700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bbc066f30 0x7f0bbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:40.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.855+0000 7f0bdaffd700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bbc066f30 0x7f0bbc0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0c46b0 tx=0x7f0bc4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:40.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:40.859+0000 7f0bd37fe700 1 -- 172.21.15.61:0/2773516702 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bcc051280 con 0x7f0bdc070d50 2023-12-24T19:58:41.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.049+0000 7f0be1d68700 1 -- 172.21.15.61:0/2773516702 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bdc04c3c0 con 0x7f0bbc066f30 2023-12-24T19:58:41.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.057+0000 7f0bd37fe700 1 -- 172.21.15.61:0/2773516702 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284798 (secure 0 0 0) 0x7f0bdc04c3c0 con 0x7f0bbc066f30 2023-12-24T19:58:41.061 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:41.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.060+0000 7f0be1d68700 1 -- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bbc066f30 msgr2=0x7f0bbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.060+0000 7f0be1d68700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bbc066f30 0x7f0bbc0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0c46b0 tx=0x7f0bc4017000 comp rx=0 tx=0).stop 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.060+0000 7f0be1d68700 1 -- 172.21.15.61:0/2773516702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc070d50 msgr2=0x7f0bdc0c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.060+0000 7f0be1d68700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc070d50 0x7f0bdc0c1d40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c7c0 tx=0x7f0bcc007f70 comp rx=0 tx=0).stop 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.060+0000 7f0be1d68700 1 -- 172.21.15.61:0/2773516702 shutdown_connections 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.060+0000 7f0be1d68700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bdc159e60 0x7f0bdc16a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.060+0000 7f0be1d68700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bbc066f30 0x7f0bbc0693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.060+0000 7f0be1d68700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bdc070d50 0x7f0bdc0c1d40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.060+0000 7f0be1d68700 1 --2- 172.21.15.61:0/2773516702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bdc159a90 0x7f0bdc0c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.060+0000 7f0be1d68700 1 -- 172.21.15.61:0/2773516702 >> 172.21.15.61:0/2773516702 conn(0x7f0bdc0cd6f0 msgr2=0x7f0bdc0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.061+0000 7f0be1d68700 1 -- 172.21.15.61:0/2773516702 shutdown_connections 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.061+0000 7f0be1d68700 1 -- 172.21.15.61:0/2773516702 wait complete. 2023-12-24T19:58:41.064 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:58:41.073 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-12-24T19:58:40.329663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2827,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559672,"statfs":{"total":1600000000,"available":1597104964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.791921"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.562293+0000","last_change":"2023-12-24T19:58:36.562225+0000","last_active":"2023-12-24T19:58:36.562293+0000","last_peered":"2023-12-24T19:58:36.562293+0000","last_clean":"2023-12-24T19:58:36.562293+0000","last_became_active":"2023-12-24T19:58:36.561988+0000","last_became_peered":"2023-12-24T19:58:36.561988+0000","last_unstale":"2023-12-24T19:58:36.562293+0000","last_undegraded":"2023-12-24T19:58:36.562293+0000","last_fullsized":"2023-12-24T19:58:36.562293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:10:52.962452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568488+0000","last_change":"2023-12-24T19:58:36.567830+0000","last_active":"2023-12-24T19:58:36.568488+0000","last_peered":"2023-12-24T19:58:36.568488+0000","last_clean":"2023-12-24T19:58:36.568488+0000","last_became_active":"2023-12-24T19:58:36.567427+0000","last_became_peered":"2023-12-24T19:58:36.567427+0000","last_unstale":"2023-12-24T19:58:36.568488+0000","last_undegraded":"2023-12-24T19:58:36.568488+0000","last_fullsized":"2023-12-24T19:58:36.568488+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:20.631799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568827+0000","last_change":"2023-12-24T19:58:36.568717+0000","last_active":"2023-12-24T19:58:36.568827+0000","last_peered":"2023-12-24T19:58:36.568827+0000","last_clean":"2023-12-24T19:58:36.568827+0000","last_became_active":"2023-12-24T19:58:36.567924+0000","last_became_peered":"2023-12-24T19:58:36.567924+0000","last_unstale":"2023-12-24T19:58:36.568827+0000","last_undegraded":"2023-12-24T19:58:36.568827+0000","last_fullsized":"2023-12-24T19:58:36.568827+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:53:04.974685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568663+0000","last_change":"2023-12-24T19:58:36.568605+0000","last_active":"2023-12-24T19:58:36.568663+0000","last_peered":"2023-12-24T19:58:36.568663+0000","last_clean":"2023-12-24T19:58:36.568663+0000","last_became_active":"2023-12-24T19:58:36.568315+0000","last_became_peered":"2023-12-24T19:58:36.568315+0000","last_unstale":"2023-12-24T19:58:36.568663+0000","last_undegraded":"2023-12-24T19:58:36.568663+0000","last_fullsized":"2023-12-24T19:58:36.568663+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:10:01.839291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.565424+0000","last_change":"2023-12-24T19:58:36.565141+0000","last_active":"2023-12-24T19:58:36.565424+0000","last_peered":"2023-12-24T19:58:36.565424+0000","last_clean":"2023-12-24T19:58:36.565424+0000","last_became_active":"2023-12-24T19:58:36.564905+0000","last_became_peered":"2023-12-24T19:58:36.564905+0000","last_unstale":"2023-12-24T19:58:36.565424+0000","last_undegraded":"2023-12-24T19:58:36.565424+0000","last_fullsized":"2023-12-24T19:58:36.565424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:57:18.042155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576935+0000","last_change":"2023-12-24T19:58:36.576571+0000","last_active":"2023-12-24T19:58:36.576935+0000","last_peered":"2023-12-24T19:58:36.576935+0000","last_clean":"2023-12-24T19:58:36.576935+0000","last_became_active":"2023-12-24T19:58:36.574113+0000","last_became_peered":"2023-12-24T19:58:36.574113+0000","last_unstale":"2023-12-24T19:58:36.576935+0000","last_undegraded":"2023-12-24T19:58:36.576935+0000","last_fullsized":"2023-12-24T19:58:36.576935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:42:57.577940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560121+0000","last_change":"2023-12-24T19:58:36.560056+0000","last_active":"2023-12-24T19:58:36.560121+0000","last_peered":"2023-12-24T19:58:36.560121+0000","last_clean":"2023-12-24T19:58:36.560121+0000","last_became_active":"2023-12-24T19:58:36.559805+0000","last_became_peered":"2023-12-24T19:58:36.559805+0000","last_unstale":"2023-12-24T19:58:36.560121+0000","last_undegraded":"2023-12-24T19:58:36.560121+0000","last_fullsized":"2023-12-24T19:58:36.560121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:46:33.114148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571132+0000","last_change":"2023-12-24T19:58:36.571053+0000","last_active":"2023-12-24T19:58:36.571132+0000","last_peered":"2023-12-24T19:58:36.571132+0000","last_clean":"2023-12-24T19:58:36.571132+0000","last_became_active":"2023-12-24T19:58:36.570763+0000","last_became_peered":"2023-12-24T19:58:36.570763+0000","last_unstale":"2023-12-24T19:58:36.571132+0000","last_undegraded":"2023-12-24T19:58:36.571132+0000","last_fullsized":"2023-12-24T19:58:36.571132+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:36.796357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560398+0000","last_change":"2023-12-24T19:58:36.560203+0000","last_active":"2023-12-24T19:58:36.560398+0000","last_peered":"2023-12-24T19:58:36.560398+0000","last_clean":"2023-12-24T19:58:36.560398+0000","last_became_active":"2023-12-24T19:58:36.559651+0000","last_became_peered":"2023-12-24T19:58:36.559651+0000","last_unstale":"2023-12-24T19:58:36.560398+0000","last_undegraded":"2023-12-24T19:58:36.560398+0000","last_fullsized":"2023-12-24T19:58:36.560398+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:54:01.331430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.579595+0000","last_change":"2023-12-24T19:58:36.579533+0000","last_active":"2023-12-24T19:58:36.579595+0000","last_peered":"2023-12-24T19:58:36.579595+0000","last_clean":"2023-12-24T19:58:36.579595+0000","last_became_active":"2023-12-24T19:58:36.575414+0000","last_became_peered":"2023-12-24T19:58:36.575414+0000","last_unstale":"2023-12-24T19:58:36.579595+0000","last_undegraded":"2023-12-24T19:58:36.579595+0000","last_fullsized":"2023-12-24T19:58:36.579595+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:17:10.405221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.561212+0000","last_change":"2023-12-24T19:58:36.561151+0000","last_active":"2023-12-24T19:58:36.561212+0000","last_peered":"2023-12-24T19:58:36.561212+0000","last_clean":"2023-12-24T19:58:36.561212+0000","last_became_active":"2023-12-24T19:58:36.560996+0000","last_became_peered":"2023-12-24T19:58:36.560996+0000","last_unstale":"2023-12-24T19:58:36.561212+0000","last_undegraded":"2023-12-24T19:58:36.561212+0000","last_fullsized":"2023-12-24T19:58:36.561212+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:44.904761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568507+0000","last_change":"2023-12-24T19:58:36.568326+0000","last_active":"2023-12-24T19:58:36.568507+0000","last_peered":"2023-12-24T19:58:36.568507+0000","last_clean":"2023-12-24T19:58:36.568507+0000","last_became_active":"2023-12-24T19:58:36.568053+0000","last_became_peered":"2023-12-24T19:58:36.568053+0000","last_unstale":"2023-12-24T19:58:36.568507+0000","last_undegraded":"2023-12-24T19:58:36.568507+0000","last_fullsized":"2023-12-24T19:58:36.568507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:07:53.917159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.569934+0000","last_change":"2023-12-24T19:58:36.569619+0000","last_active":"2023-12-24T19:58:36.569934+0000","last_peered":"2023-12-24T19:58:36.569934+0000","last_clean":"2023-12-24T19:58:36.569934+0000","last_became_active":"2023-12-24T19:58:36.569165+0000","last_became_peered":"2023-12-24T19:58:36.569165+0000","last_unstale":"2023-12-24T19:58:36.569934+0000","last_undegraded":"2023-12-24T19:58:36.569934+0000","last_fullsized":"2023-12-24T19:58:36.569934+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:00:46.485876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560438+0000","last_change":"2023-12-24T19:58:36.560350+0000","last_active":"2023-12-24T19:58:36.560438+0000","last_peered":"2023-12-24T19:58:36.560438+0000","last_clean":"2023-12-24T19:58:36.560438+0000","last_became_active":"2023-12-24T19:58:36.559971+0000","last_became_peered":"2023-12-24T19:58:36.559971+0000","last_unstale":"2023-12-24T19:58:36.560438+0000","last_undegraded":"2023-12-24T19:58:36.560438+0000","last_fullsized":"2023-12-24T19:58:36.560438+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:46:33.114148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.564745+0000","last_change":"2023-12-24T19:58:36.564434+0000","last_active":"2023-12-24T19:58:36.564745+0000","last_peered":"2023-12-24T19:58:36.564745+0000","last_clean":"2023-12-24T19:58:36.564745+0000","last_became_active":"2023-12-24T19:58:36.564191+0000","last_became_peered":"2023-12-24T19:58:36.564191+0000","last_unstale":"2023-12-24T19:58:36.564745+0000","last_undegraded":"2023-12-24T19:58:36.564745+0000","last_fullsized":"2023-12-24T19:58:36.564745+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:36.796357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566883+0000","last_change":"2023-12-24T19:58:36.566423+0000","last_active":"2023-12-24T19:58:36.566883+0000","last_peered":"2023-12-24T19:58:36.566883+0000","last_clean":"2023-12-24T19:58:36.566883+0000","last_became_active":"2023-12-24T19:58:36.566034+0000","last_became_peered":"2023-12-24T19:58:36.566034+0000","last_unstale":"2023-12-24T19:58:36.566883+0000","last_undegraded":"2023-12-24T19:58:36.566883+0000","last_fullsized":"2023-12-24T19:58:36.566883+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:02.178113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.565086+0000","last_change":"2023-12-24T19:58:36.565021+0000","last_active":"2023-12-24T19:58:36.565086+0000","last_peered":"2023-12-24T19:58:36.565086+0000","last_clean":"2023-12-24T19:58:36.565086+0000","last_became_active":"2023-12-24T19:58:36.564800+0000","last_became_peered":"2023-12-24T19:58:36.564800+0000","last_unstale":"2023-12-24T19:58:36.565086+0000","last_undegraded":"2023-12-24T19:58:36.565086+0000","last_fullsized":"2023-12-24T19:58:36.565086+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:05.663561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571571+0000","last_change":"2023-12-24T19:58:36.571509+0000","last_active":"2023-12-24T19:58:36.571571+0000","last_peered":"2023-12-24T19:58:36.571571+0000","last_clean":"2023-12-24T19:58:36.571571+0000","last_became_active":"2023-12-24T19:58:36.571291+0000","last_became_peered":"2023-12-24T19:58:36.571291+0000","last_unstale":"2023-12-24T19:58:36.571571+0000","last_undegraded":"2023-12-24T19:58:36.571571+0000","last_fullsized":"2023-12-24T19:58:36.571571+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:20.631799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571424+0000","last_change":"2023-12-24T19:58:36.571366+0000","last_active":"2023-12-24T19:58:36.571424+0000","last_peered":"2023-12-24T19:58:36.571424+0000","last_clean":"2023-12-24T19:58:36.571424+0000","last_became_active":"2023-12-24T19:58:36.570361+0000","last_became_peered":"2023-12-24T19:58:36.570361+0000","last_unstale":"2023-12-24T19:58:36.571424+0000","last_undegraded":"2023-12-24T19:58:36.571424+0000","last_fullsized":"2023-12-24T19:58:36.571424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:02:28.745757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.577213+0000","last_change":"2023-12-24T19:58:36.577137+0000","last_active":"2023-12-24T19:58:36.577213+0000","last_peered":"2023-12-24T19:58:36.577213+0000","last_clean":"2023-12-24T19:58:36.577213+0000","last_became_active":"2023-12-24T19:58:36.576918+0000","last_became_peered":"2023-12-24T19:58:36.576918+0000","last_unstale":"2023-12-24T19:58:36.577213+0000","last_undegraded":"2023-12-24T19:58:36.577213+0000","last_fullsized":"2023-12-24T19:58:36.577213+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:02:02.399316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576917+0000","last_change":"2023-12-24T19:58:36.576394+0000","last_active":"2023-12-24T19:58:36.576917+0000","last_peered":"2023-12-24T19:58:36.576917+0000","last_clean":"2023-12-24T19:58:36.576917+0000","last_became_active":"2023-12-24T19:58:36.573595+0000","last_became_peered":"2023-12-24T19:58:36.573595+0000","last_unstale":"2023-12-24T19:58:36.576917+0000","last_undegraded":"2023-12-24T19:58:36.576917+0000","last_fullsized":"2023-12-24T19:58:36.576917+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:47:47.784774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.565117+0000","last_change":"2023-12-24T19:58:36.565057+0000","last_active":"2023-12-24T19:58:36.565117+0000","last_peered":"2023-12-24T19:58:36.565117+0000","last_clean":"2023-12-24T19:58:36.565117+0000","last_became_active":"2023-12-24T19:58:36.564784+0000","last_became_peered":"2023-12-24T19:58:36.564784+0000","last_unstale":"2023-12-24T19:58:36.565117+0000","last_undegraded":"2023-12-24T19:58:36.565117+0000","last_fullsized":"2023-12-24T19:58:36.565117+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:01:59.892624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568869+0000","last_change":"2023-12-24T19:58:36.568723+0000","last_active":"2023-12-24T19:58:36.568869+0000","last_peered":"2023-12-24T19:58:36.568869+0000","last_clean":"2023-12-24T19:58:36.568869+0000","last_became_active":"2023-12-24T19:58:36.568483+0000","last_became_peered":"2023-12-24T19:58:36.568483+0000","last_unstale":"2023-12-24T19:58:36.568869+0000","last_undegraded":"2023-12-24T19:58:36.568869+0000","last_fullsized":"2023-12-24T19:58:36.568869+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:58:04.367601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571993+0000","last_change":"2023-12-24T19:58:36.571906+0000","last_active":"2023-12-24T19:58:36.571993+0000","last_peered":"2023-12-24T19:58:36.571993+0000","last_clean":"2023-12-24T19:58:36.571993+0000","last_became_active":"2023-12-24T19:58:36.571132+0000","last_became_peered":"2023-12-24T19:58:36.571132+0000","last_unstale":"2023-12-24T19:58:36.571993+0000","last_undegraded":"2023-12-24T19:58:36.571993+0000","last_fullsized":"2023-12-24T19:58:36.571993+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:37.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566697+0000","last_change":"2023-12-24T19:58:36.564880+0000","last_active":"2023-12-24T19:58:36.566697+0000","last_peered":"2023-12-24T19:58:36.566697+0000","last_clean":"2023-12-24T19:58:36.566697+0000","last_became_active":"2023-12-24T19:58:36.564194+0000","last_became_peered":"2023-12-24T19:58:36.564194+0000","last_unstale":"2023-12-24T19:58:36.566697+0000","last_undegraded":"2023-12-24T19:58:36.566697+0000","last_fullsized":"2023-12-24T19:58:36.566697+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:14.574597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571613+0000","last_change":"2023-12-24T19:58:36.571539+0000","last_active":"2023-12-24T19:58:36.571613+0000","last_peered":"2023-12-24T19:58:36.571613+0000","last_clean":"2023-12-24T19:58:36.571613+0000","last_became_active":"2023-12-24T19:58:36.571164+0000","last_became_peered":"2023-12-24T19:58:36.571164+0000","last_unstale":"2023-12-24T19:58:36.571613+0000","last_undegraded":"2023-12-24T19:58:36.571613+0000","last_fullsized":"2023-12-24T19:58:36.571613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:14:05.027829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.567902+0000","last_change":"2023-12-24T19:58:36.567838+0000","last_active":"2023-12-24T19:58:36.567902+0000","last_peered":"2023-12-24T19:58:36.567902+0000","last_clean":"2023-12-24T19:58:36.567902+0000","last_became_active":"2023-12-24T19:58:36.567612+0000","last_became_peered":"2023-12-24T19:58:36.567612+0000","last_unstale":"2023-12-24T19:58:36.567902+0000","last_undegraded":"2023-12-24T19:58:36.567902+0000","last_fullsized":"2023-12-24T19:58:36.567902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:36.763239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566274+0000","last_change":"2023-12-24T19:58:36.565808+0000","last_active":"2023-12-24T19:58:36.566274+0000","last_peered":"2023-12-24T19:58:36.566274+0000","last_clean":"2023-12-24T19:58:36.566274+0000","last_became_active":"2023-12-24T19:58:36.565582+0000","last_became_peered":"2023-12-24T19:58:36.565582+0000","last_unstale":"2023-12-24T19:58:36.566274+0000","last_undegraded":"2023-12-24T19:58:36.566274+0000","last_fullsized":"2023-12-24T19:58:36.566274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:05.663561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571593+0000","last_change":"2023-12-24T19:58:36.571508+0000","last_active":"2023-12-24T19:58:36.571593+0000","last_peered":"2023-12-24T19:58:36.571593+0000","last_clean":"2023-12-24T19:58:36.571593+0000","last_became_active":"2023-12-24T19:58:36.570585+0000","last_became_peered":"2023-12-24T19:58:36.570585+0000","last_unstale":"2023-12-24T19:58:36.571593+0000","last_undegraded":"2023-12-24T19:58:36.571593+0000","last_fullsized":"2023-12-24T19:58:36.571593+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:50:11.001638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.562997+0000","last_change":"2023-12-24T19:58:36.561862+0000","last_active":"2023-12-24T19:58:36.562997+0000","last_peered":"2023-12-24T19:58:36.562997+0000","last_clean":"2023-12-24T19:58:36.562997+0000","last_became_active":"2023-12-24T19:58:36.561630+0000","last_became_peered":"2023-12-24T19:58:36.561630+0000","last_unstale":"2023-12-24T19:58:36.562997+0000","last_undegraded":"2023-12-24T19:58:36.562997+0000","last_fullsized":"2023-12-24T19:58:36.562997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:58:04.367601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576953+0000","last_change":"2023-12-24T19:58:36.576734+0000","last_active":"2023-12-24T19:58:36.576953+0000","last_peered":"2023-12-24T19:58:36.576953+0000","last_clean":"2023-12-24T19:58:36.576953+0000","last_became_active":"2023-12-24T19:58:36.574409+0000","last_became_peered":"2023-12-24T19:58:36.574409+0000","last_unstale":"2023-12-24T19:58:36.576953+0000","last_undegraded":"2023-12-24T19:58:36.576953+0000","last_fullsized":"2023-12-24T19:58:36.576953+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:42:18.802165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.567699+0000","last_change":"2023-12-24T19:58:36.567635+0000","last_active":"2023-12-24T19:58:36.567699+0000","last_peered":"2023-12-24T19:58:36.567699+0000","last_clean":"2023-12-24T19:58:36.567699+0000","last_became_active":"2023-12-24T19:58:36.567395+0000","last_became_peered":"2023-12-24T19:58:36.567395+0000","last_unstale":"2023-12-24T19:58:36.567699+0000","last_undegraded":"2023-12-24T19:58:36.567699+0000","last_fullsized":"2023-12-24T19:58:36.567699+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:53:03.848330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.564197+0000","last_change":"2023-12-24T19:58:36.564126+0000","last_active":"2023-12-24T19:58:36.564197+0000","last_peered":"2023-12-24T19:58:36.564197+0000","last_clean":"2023-12-24T19:58:36.564197+0000","last_became_active":"2023-12-24T19:58:36.563898+0000","last_became_peered":"2023-12-24T19:58:36.563898+0000","last_unstale":"2023-12-24T19:58:36.564197+0000","last_undegraded":"2023-12-24T19:58:36.564197+0000","last_fullsized":"2023-12-24T19:58:36.564197+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:37.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578768+0000","last_change":"2023-12-24T19:58:35.554738+0000","last_active":"2023-12-24T19:58:36.578768+0000","last_peered":"2023-12-24T19:58:36.578768+0000","last_clean":"2023-12-24T19:58:36.578768+0000","last_became_active":"2023-12-24T19:58:35.554509+0000","last_became_peered":"2023-12-24T19:58:35.554509+0000","last_unstale":"2023-12-24T19:58:36.578768+0000","last_undegraded":"2023-12-24T19:58:36.578768+0000","last_fullsized":"2023-12-24T19:58:36.578768+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:53:03.968162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.569809+0000","last_change":"2023-12-24T19:58:36.569543+0000","last_active":"2023-12-24T19:58:36.569809+0000","last_peered":"2023-12-24T19:58:36.569809+0000","last_clean":"2023-12-24T19:58:36.569809+0000","last_became_active":"2023-12-24T19:58:36.569275+0000","last_became_peered":"2023-12-24T19:58:36.569275+0000","last_unstale":"2023-12-24T19:58:36.569809+0000","last_undegraded":"2023-12-24T19:58:36.569809+0000","last_fullsized":"2023-12-24T19:58:36.569809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:15:34.472869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.575487+0000","last_change":"2023-12-24T19:58:35.554561+0000","last_active":"2023-12-24T19:58:36.575487+0000","last_peered":"2023-12-24T19:58:36.575487+0000","last_clean":"2023-12-24T19:58:36.575487+0000","last_became_active":"2023-12-24T19:58:35.554337+0000","last_became_peered":"2023-12-24T19:58:35.554337+0000","last_unstale":"2023-12-24T19:58:36.575487+0000","last_undegraded":"2023-12-24T19:58:36.575487+0000","last_fullsized":"2023-12-24T19:58:36.575487+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:51.493061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570083+0000","last_change":"2023-12-24T19:58:36.569270+0000","last_active":"2023-12-24T19:58:36.570083+0000","last_peered":"2023-12-24T19:58:36.570083+0000","last_clean":"2023-12-24T19:58:36.570083+0000","last_became_active":"2023-12-24T19:58:36.569045+0000","last_became_peered":"2023-12-24T19:58:36.569045+0000","last_unstale":"2023-12-24T19:58:36.570083+0000","last_undegraded":"2023-12-24T19:58:36.570083+0000","last_fullsized":"2023-12-24T19:58:36.570083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:53:04.974685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578281+0000","last_change":"2023-12-24T19:58:35.551183+0000","last_active":"2023-12-24T19:58:36.578281+0000","last_peered":"2023-12-24T19:58:36.578281+0000","last_clean":"2023-12-24T19:58:36.578281+0000","last_became_active":"2023-12-24T19:58:35.550648+0000","last_became_peered":"2023-12-24T19:58:35.550648+0000","last_unstale":"2023-12-24T19:58:36.578281+0000","last_undegraded":"2023-12-24T19:58:36.578281+0000","last_fullsized":"2023-12-24T19:58:36.578281+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:13:22.198776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.565931+0000","last_change":"2023-12-24T19:58:36.565767+0000","last_active":"2023-12-24T19:58:36.565931+0000","last_peered":"2023-12-24T19:58:36.565931+0000","last_clean":"2023-12-24T19:58:36.565931+0000","last_became_active":"2023-12-24T19:58:36.565435+0000","last_became_peered":"2023-12-24T19:58:36.565435+0000","last_unstale":"2023-12-24T19:58:36.565931+0000","last_undegraded":"2023-12-24T19:58:36.565931+0000","last_fullsized":"2023-12-24T19:58:36.565931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:37:41.318918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.577168+0000","last_change":"2023-12-24T19:58:35.552410+0000","last_active":"2023-12-24T19:58:36.577168+0000","last_peered":"2023-12-24T19:58:36.577168+0000","last_clean":"2023-12-24T19:58:36.577168+0000","last_became_active":"2023-12-24T19:58:35.551605+0000","last_became_peered":"2023-12-24T19:58:35.551605+0000","last_unstale":"2023-12-24T19:58:36.577168+0000","last_undegraded":"2023-12-24T19:58:36.577168+0000","last_fullsized":"2023-12-24T19:58:36.577168+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:04.657039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.569478+0000","last_change":"2023-12-24T19:58:36.569396+0000","last_active":"2023-12-24T19:58:36.569478+0000","last_peered":"2023-12-24T19:58:36.569478+0000","last_clean":"2023-12-24T19:58:36.569478+0000","last_became_active":"2023-12-24T19:58:36.569171+0000","last_became_peered":"2023-12-24T19:58:36.569171+0000","last_unstale":"2023-12-24T19:58:36.569478+0000","last_undegraded":"2023-12-24T19:58:36.569478+0000","last_fullsized":"2023-12-24T19:58:36.569478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:07:53.917159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576315+0000","last_change":"2023-12-24T19:58:35.549243+0000","last_active":"2023-12-24T19:58:36.576315+0000","last_peered":"2023-12-24T19:58:36.576315+0000","last_clean":"2023-12-24T19:58:36.576315+0000","last_became_active":"2023-12-24T19:58:35.548993+0000","last_became_peered":"2023-12-24T19:58:35.548993+0000","last_unstale":"2023-12-24T19:58:36.576315+0000","last_undegraded":"2023-12-24T19:58:36.576315+0000","last_fullsized":"2023-12-24T19:58:36.576315+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:07.430590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.573265+0000","last_change":"2023-12-24T19:58:36.573163+0000","last_active":"2023-12-24T19:58:36.573265+0000","last_peered":"2023-12-24T19:58:36.573265+0000","last_clean":"2023-12-24T19:58:36.573265+0000","last_became_active":"2023-12-24T19:58:36.572924+0000","last_became_peered":"2023-12-24T19:58:36.572924+0000","last_unstale":"2023-12-24T19:58:36.573265+0000","last_undegraded":"2023-12-24T19:58:36.573265+0000","last_fullsized":"2023-12-24T19:58:36.573265+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:07:53.917159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576482+0000","last_change":"2023-12-24T19:58:35.553617+0000","last_active":"2023-12-24T19:58:36.576482+0000","last_peered":"2023-12-24T19:58:36.576482+0000","last_clean":"2023-12-24T19:58:36.576482+0000","last_became_active":"2023-12-24T19:58:35.553388+0000","last_became_peered":"2023-12-24T19:58:35.553388+0000","last_unstale":"2023-12-24T19:58:36.576482+0000","last_undegraded":"2023-12-24T19:58:36.576482+0000","last_fullsized":"2023-12-24T19:58:36.576482+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:50:09.995115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.579743+0000","last_change":"2023-12-24T19:58:36.579682+0000","last_active":"2023-12-24T19:58:36.579743+0000","last_peered":"2023-12-24T19:58:36.579743+0000","last_clean":"2023-12-24T19:58:36.579743+0000","last_became_active":"2023-12-24T19:58:36.575742+0000","last_became_peered":"2023-12-24T19:58:36.575742+0000","last_unstale":"2023-12-24T19:58:36.579743+0000","last_undegraded":"2023-12-24T19:58:36.579743+0000","last_fullsized":"2023-12-24T19:58:36.579743+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:10.654990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.564219+0000","last_change":"2023-12-24T19:58:35.548864+0000","last_active":"2023-12-24T19:58:36.564219+0000","last_peered":"2023-12-24T19:58:36.564219+0000","last_clean":"2023-12-24T19:58:36.564219+0000","last_became_active":"2023-12-24T19:58:35.548635+0000","last_became_peered":"2023-12-24T19:58:35.548635+0000","last_unstale":"2023-12-24T19:58:36.564219+0000","last_undegraded":"2023-12-24T19:58:36.564219+0000","last_fullsized":"2023-12-24T19:58:36.564219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:13:22.198776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571746+0000","last_change":"2023-12-24T19:58:36.571687+0000","last_active":"2023-12-24T19:58:36.571746+0000","last_peered":"2023-12-24T19:58:36.571746+0000","last_clean":"2023-12-24T19:58:36.571746+0000","last_became_active":"2023-12-24T19:58:36.570820+0000","last_became_peered":"2023-12-24T19:58:36.570820+0000","last_unstale":"2023-12-24T19:58:36.571746+0000","last_undegraded":"2023-12-24T19:58:36.571746+0000","last_fullsized":"2023-12-24T19:58:36.571746+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:13:23.205298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.557208+0000","last_change":"2023-12-24T19:58:35.551064+0000","last_active":"2023-12-24T19:58:36.557208+0000","last_peered":"2023-12-24T19:58:36.557208+0000","last_clean":"2023-12-24T19:58:36.557208+0000","last_became_active":"2023-12-24T19:58:35.549218+0000","last_became_peered":"2023-12-24T19:58:35.549218+0000","last_unstale":"2023-12-24T19:58:36.557208+0000","last_undegraded":"2023-12-24T19:58:36.557208+0000","last_fullsized":"2023-12-24T19:58:36.557208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:13.568074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.579896+0000","last_change":"2023-12-24T19:58:36.579844+0000","last_active":"2023-12-24T19:58:36.579896+0000","last_peered":"2023-12-24T19:58:36.579896+0000","last_clean":"2023-12-24T19:58:36.579896+0000","last_became_active":"2023-12-24T19:58:36.579663+0000","last_became_peered":"2023-12-24T19:58:36.579663+0000","last_unstale":"2023-12-24T19:58:36.579896+0000","last_undegraded":"2023-12-24T19:58:36.579896+0000","last_fullsized":"2023-12-24T19:58:36.579896+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:20:37.471766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.558605+0000","last_change":"2023-12-24T19:58:35.553828+0000","last_active":"2023-12-24T19:58:36.558605+0000","last_peered":"2023-12-24T19:58:36.558605+0000","last_clean":"2023-12-24T19:58:36.558605+0000","last_became_active":"2023-12-24T19:58:35.553563+0000","last_became_peered":"2023-12-24T19:58:35.553563+0000","last_unstale":"2023-12-24T19:58:36.558605+0000","last_undegraded":"2023-12-24T19:58:36.558605+0000","last_fullsized":"2023-12-24T19:58:36.558605+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:13.568074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568407+0000","last_change":"2023-12-24T19:58:36.568190+0000","last_active":"2023-12-24T19:58:36.568407+0000","last_peered":"2023-12-24T19:58:36.568407+0000","last_clean":"2023-12-24T19:58:36.568407+0000","last_became_active":"2023-12-24T19:58:36.567857+0000","last_became_peered":"2023-12-24T19:58:36.567857+0000","last_unstale":"2023-12-24T19:58:36.568407+0000","last_undegraded":"2023-12-24T19:58:36.568407+0000","last_fullsized":"2023-12-24T19:58:36.568407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:54:01.331430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.556012+0000","last_change":"2023-12-24T19:58:35.552299+0000","last_active":"2023-12-24T19:58:36.556012+0000","last_peered":"2023-12-24T19:58:36.556012+0000","last_clean":"2023-12-24T19:58:36.556012+0000","last_became_active":"2023-12-24T19:58:35.552069+0000","last_became_peered":"2023-12-24T19:58:35.552069+0000","last_unstale":"2023-12-24T19:58:36.556012+0000","last_undegraded":"2023-12-24T19:58:36.556012+0000","last_fullsized":"2023-12-24T19:58:36.556012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:51.493061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570374+0000","last_change":"2023-12-24T19:58:36.570313+0000","last_active":"2023-12-24T19:58:36.570374+0000","last_peered":"2023-12-24T19:58:36.570374+0000","last_clean":"2023-12-24T19:58:36.570374+0000","last_became_active":"2023-12-24T19:58:36.569417+0000","last_became_peered":"2023-12-24T19:58:36.569417+0000","last_unstale":"2023-12-24T19:58:36.570374+0000","last_undegraded":"2023-12-24T19:58:36.570374+0000","last_fullsized":"2023-12-24T19:58:36.570374+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:55:39.254630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.576427+0000","last_change":"2023-12-24T19:58:35.555205+0000","last_active":"2023-12-24T19:58:36.576427+0000","last_peered":"2023-12-24T19:58:36.576427+0000","last_clean":"2023-12-24T19:58:36.576427+0000","last_became_active":"2023-12-24T19:58:35.554965+0000","last_became_peered":"2023-12-24T19:58:35.554965+0000","last_unstale":"2023-12-24T19:58:36.576427+0000","last_undegraded":"2023-12-24T19:58:36.576427+0000","last_fullsized":"2023-12-24T19:58:36.576427+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:22:24.842431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.559948+0000","last_change":"2023-12-24T19:58:36.559864+0000","last_active":"2023-12-24T19:58:36.559948+0000","last_peered":"2023-12-24T19:58:36.559948+0000","last_clean":"2023-12-24T19:58:36.559948+0000","last_became_active":"2023-12-24T19:58:36.559617+0000","last_became_peered":"2023-12-24T19:58:36.559617+0000","last_unstale":"2023-12-24T19:58:36.559948+0000","last_undegraded":"2023-12-24T19:58:36.559948+0000","last_fullsized":"2023-12-24T19:58:36.559948+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:44.904761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.579335+0000","last_change":"2023-12-24T19:58:35.551300+0000","last_active":"2023-12-24T19:58:36.579335+0000","last_peered":"2023-12-24T19:58:36.579335+0000","last_clean":"2023-12-24T19:58:36.579335+0000","last_became_active":"2023-12-24T19:58:35.551082+0000","last_became_peered":"2023-12-24T19:58:35.551082+0000","last_unstale":"2023-12-24T19:58:36.579335+0000","last_undegraded":"2023-12-24T19:58:36.579335+0000","last_fullsized":"2023-12-24T19:58:36.579335+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:38.377320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566858+0000","last_change":"2023-12-24T19:58:36.566285+0000","last_active":"2023-12-24T19:58:36.566858+0000","last_peered":"2023-12-24T19:58:36.566858+0000","last_clean":"2023-12-24T19:58:36.566858+0000","last_became_active":"2023-12-24T19:58:36.565745+0000","last_became_peered":"2023-12-24T19:58:36.565745+0000","last_unstale":"2023-12-24T19:58:36.566858+0000","last_undegraded":"2023-12-24T19:58:36.566858+0000","last_fullsized":"2023-12-24T19:58:36.566858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:22:55.385014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.580619+0000","last_change":"2023-12-24T19:58:35.546848+0000","last_active":"2023-12-24T19:58:36.580619+0000","last_peered":"2023-12-24T19:58:36.580619+0000","last_clean":"2023-12-24T19:58:36.580619+0000","last_became_active":"2023-12-24T19:58:35.546601+0000","last_became_peered":"2023-12-24T19:58:35.546601+0000","last_unstale":"2023-12-24T19:58:36.580619+0000","last_undegraded":"2023-12-24T19:58:36.580619+0000","last_fullsized":"2023-12-24T19:58:36.580619+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:22:24.842431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560169+0000","last_change":"2023-12-24T19:58:36.560102+0000","last_active":"2023-12-24T19:58:36.560169+0000","last_peered":"2023-12-24T19:58:36.560169+0000","last_clean":"2023-12-24T19:58:36.560169+0000","last_became_active":"2023-12-24T19:58:36.559553+0000","last_became_peered":"2023-12-24T19:58:36.559553+0000","last_unstale":"2023-12-24T19:58:36.560169+0000","last_undegraded":"2023-12-24T19:58:36.560169+0000","last_fullsized":"2023-12-24T19:58:36.560169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:19:41.163852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560078+0000","last_change":"2023-12-24T19:58:35.552547+0000","last_active":"2023-12-24T19:58:36.560078+0000","last_peered":"2023-12-24T19:58:36.560078+0000","last_clean":"2023-12-24T19:58:36.560078+0000","last_became_active":"2023-12-24T19:58:35.551924+0000","last_became_peered":"2023-12-24T19:58:35.551924+0000","last_unstale":"2023-12-24T19:58:36.560078+0000","last_undegraded":"2023-12-24T19:58:36.560078+0000","last_fullsized":"2023-12-24T19:58:36.560078+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:53:03.968162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.571870+0000","last_change":"2023-12-24T19:58:36.571783+0000","last_active":"2023-12-24T19:58:36.571870+0000","last_peered":"2023-12-24T19:58:36.571870+0000","last_clean":"2023-12-24T19:58:36.571870+0000","last_became_active":"2023-12-24T19:58:36.571313+0000","last_became_peered":"2023-12-24T19:58:36.571313+0000","last_unstale":"2023-12-24T19:58:36.571870+0000","last_undegraded":"2023-12-24T19:58:36.571870+0000","last_fullsized":"2023-12-24T19:58:36.571870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:25:58.641762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.561041+0000","last_change":"2023-12-24T19:58:35.545786+0000","last_active":"2023-12-24T19:58:36.561041+0000","last_peered":"2023-12-24T19:58:36.561041+0000","last_clean":"2023-12-24T19:58:36.561041+0000","last_became_active":"2023-12-24T19:58:35.545534+0000","last_became_peered":"2023-12-24T19:58:35.545534+0000","last_unstale":"2023-12-24T19:58:36.561041+0000","last_undegraded":"2023-12-24T19:58:36.561041+0000","last_fullsized":"2023-12-24T19:58:36.561041+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:35.756716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.564225+0000","last_change":"2023-12-24T19:58:36.564137+0000","last_active":"2023-12-24T19:58:36.564225+0000","last_peered":"2023-12-24T19:58:36.564225+0000","last_clean":"2023-12-24T19:58:36.564225+0000","last_became_active":"2023-12-24T19:58:36.563869+0000","last_became_peered":"2023-12-24T19:58:36.563869+0000","last_unstale":"2023-12-24T19:58:36.564225+0000","last_undegraded":"2023-12-24T19:58:36.564225+0000","last_fullsized":"2023-12-24T19:58:36.564225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:10:01.839291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.581309+0000","last_change":"2023-12-24T19:58:35.547230+0000","last_active":"2023-12-24T19:58:36.581309+0000","last_peered":"2023-12-24T19:58:36.581309+0000","last_clean":"2023-12-24T19:58:36.581309+0000","last_became_active":"2023-12-24T19:58:35.546970+0000","last_became_peered":"2023-12-24T19:58:35.546970+0000","last_unstale":"2023-12-24T19:58:36.581309+0000","last_undegraded":"2023-12-24T19:58:36.581309+0000","last_fullsized":"2023-12-24T19:58:36.581309+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:40:34.280419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566829+0000","last_change":"2023-12-24T19:58:36.565797+0000","last_active":"2023-12-24T19:58:36.566829+0000","last_peered":"2023-12-24T19:58:36.566829+0000","last_clean":"2023-12-24T19:58:36.566829+0000","last_became_active":"2023-12-24T19:58:36.565557+0000","last_became_peered":"2023-12-24T19:58:36.565557+0000","last_unstale":"2023-12-24T19:58:36.566829+0000","last_undegraded":"2023-12-24T19:58:36.566829+0000","last_fullsized":"2023-12-24T19:58:36.566829+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:10:22.783403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578429+0000","last_change":"2023-12-24T19:58:35.548530+0000","last_active":"2023-12-24T19:58:36.578429+0000","last_peered":"2023-12-24T19:58:36.578429+0000","last_clean":"2023-12-24T19:58:36.578429+0000","last_became_active":"2023-12-24T19:58:35.548293+0000","last_became_peered":"2023-12-24T19:58:35.548293+0000","last_unstale":"2023-12-24T19:58:36.578429+0000","last_undegraded":"2023-12-24T19:58:36.578429+0000","last_fullsized":"2023-12-24T19:58:36.578429+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:54:20.023885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.565924+0000","last_change":"2023-12-24T19:58:36.565839+0000","last_active":"2023-12-24T19:58:36.565924+0000","last_peered":"2023-12-24T19:58:36.565924+0000","last_clean":"2023-12-24T19:58:36.565924+0000","last_became_active":"2023-12-24T19:58:36.565604+0000","last_became_peered":"2023-12-24T19:58:36.565604+0000","last_unstale":"2023-12-24T19:58:36.565924+0000","last_undegraded":"2023-12-24T19:58:36.565924+0000","last_fullsized":"2023-12-24T19:58:36.565924+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:10:52.962452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.577370+0000","last_change":"2023-12-24T19:58:35.549794+0000","last_active":"2023-12-24T19:58:36.577370+0000","last_peered":"2023-12-24T19:58:36.577370+0000","last_clean":"2023-12-24T19:58:36.577370+0000","last_became_active":"2023-12-24T19:58:35.549557+0000","last_became_peered":"2023-12-24T19:58:35.549557+0000","last_unstale":"2023-12-24T19:58:36.577370+0000","last_undegraded":"2023-12-24T19:58:36.577370+0000","last_fullsized":"2023-12-24T19:58:36.577370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:22:54.378491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570470+0000","last_change":"2023-12-24T19:58:36.570409+0000","last_active":"2023-12-24T19:58:36.570470+0000","last_peered":"2023-12-24T19:58:36.570470+0000","last_clean":"2023-12-24T19:58:36.570470+0000","last_became_active":"2023-12-24T19:58:36.570176+0000","last_became_peered":"2023-12-24T19:58:36.570176+0000","last_unstale":"2023-12-24T19:58:36.570470+0000","last_undegraded":"2023-12-24T19:58:36.570470+0000","last_fullsized":"2023-12-24T19:58:36.570470+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:00:46.525107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578158+0000","last_change":"2023-12-24T19:58:35.546709+0000","last_active":"2023-12-24T19:58:36.578158+0000","last_peered":"2023-12-24T19:58:36.578158+0000","last_clean":"2023-12-24T19:58:36.578158+0000","last_became_active":"2023-12-24T19:58:35.546420+0000","last_became_peered":"2023-12-24T19:58:35.546420+0000","last_unstale":"2023-12-24T19:58:36.578158+0000","last_undegraded":"2023-12-24T19:58:36.578158+0000","last_fullsized":"2023-12-24T19:58:36.578158+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:15:33.466347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566727+0000","last_change":"2023-12-24T19:58:36.564131+0000","last_active":"2023-12-24T19:58:36.566727+0000","last_peered":"2023-12-24T19:58:36.566727+0000","last_clean":"2023-12-24T19:58:36.566727+0000","last_became_active":"2023-12-24T19:58:36.563711+0000","last_became_peered":"2023-12-24T19:58:36.563711+0000","last_unstale":"2023-12-24T19:58:36.566727+0000","last_undegraded":"2023-12-24T19:58:36.566727+0000","last_fullsized":"2023-12-24T19:58:36.566727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:27.006567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.561140+0000","last_change":"2023-12-24T19:58:35.554696+0000","last_active":"2023-12-24T19:58:36.561140+0000","last_peered":"2023-12-24T19:58:36.561140+0000","last_clean":"2023-12-24T19:58:36.561140+0000","last_became_active":"2023-12-24T19:58:35.554460+0000","last_became_peered":"2023-12-24T19:58:35.554460+0000","last_unstale":"2023-12-24T19:58:36.561140+0000","last_undegraded":"2023-12-24T19:58:36.561140+0000","last_fullsized":"2023-12-24T19:58:36.561140+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:37:40.312396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570241+0000","last_change":"2023-12-24T19:58:36.570163+0000","last_active":"2023-12-24T19:58:36.570241+0000","last_peered":"2023-12-24T19:58:36.570241+0000","last_clean":"2023-12-24T19:58:36.570241+0000","last_became_active":"2023-12-24T19:58:36.569128+0000","last_became_peered":"2023-12-24T19:58:36.569128+0000","last_unstale":"2023-12-24T19:58:36.570241+0000","last_undegraded":"2023-12-24T19:58:36.570241+0000","last_fullsized":"2023-12-24T19:58:36.570241+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:57:06.470773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578999+0000","last_change":"2023-12-24T19:58:35.548743+0000","last_active":"2023-12-24T19:58:36.578999+0000","last_peered":"2023-12-24T19:58:36.578999+0000","last_clean":"2023-12-24T19:58:36.578999+0000","last_became_active":"2023-12-24T19:58:35.548245+0000","last_became_peered":"2023-12-24T19:58:35.548245+0000","last_unstale":"2023-12-24T19:58:36.578999+0000","last_undegraded":"2023-12-24T19:58:36.578999+0000","last_fullsized":"2023-12-24T19:58:36.578999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:07:52.910637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.563342+0000","last_change":"2023-12-24T19:58:36.562883+0000","last_active":"2023-12-24T19:58:36.563342+0000","last_peered":"2023-12-24T19:58:36.563342+0000","last_clean":"2023-12-24T19:58:36.563342+0000","last_became_active":"2023-12-24T19:58:36.562644+0000","last_became_peered":"2023-12-24T19:58:36.562644+0000","last_unstale":"2023-12-24T19:58:36.563342+0000","last_undegraded":"2023-12-24T19:58:36.563342+0000","last_fullsized":"2023-12-24T19:58:36.563342+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:53:49.861298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.564310+0000","last_change":"2023-12-24T19:58:35.553978+0000","last_active":"2023-12-24T19:58:36.564310+0000","last_peered":"2023-12-24T19:58:36.564310+0000","last_clean":"2023-12-24T19:58:36.564310+0000","last_became_active":"2023-12-24T19:58:35.553750+0000","last_became_peered":"2023-12-24T19:58:35.553750+0000","last_unstale":"2023-12-24T19:58:36.564310+0000","last_undegraded":"2023-12-24T19:58:36.564310+0000","last_fullsized":"2023-12-24T19:58:36.564310+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:26.000044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566850+0000","last_change":"2023-12-24T19:58:36.565947+0000","last_active":"2023-12-24T19:58:36.566850+0000","last_peered":"2023-12-24T19:58:36.566850+0000","last_clean":"2023-12-24T19:58:36.566850+0000","last_became_active":"2023-12-24T19:58:36.565362+0000","last_became_peered":"2023-12-24T19:58:36.565362+0000","last_unstale":"2023-12-24T19:58:36.566850+0000","last_undegraded":"2023-12-24T19:58:36.566850+0000","last_fullsized":"2023-12-24T19:58:36.566850+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:44:23.746078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.557117+0000","last_change":"2023-12-24T19:58:35.552506+0000","last_active":"2023-12-24T19:58:36.557117+0000","last_peered":"2023-12-24T19:58:36.557117+0000","last_clean":"2023-12-24T19:58:36.557117+0000","last_became_active":"2023-12-24T19:58:35.551998+0000","last_became_peered":"2023-12-24T19:58:35.551998+0000","last_unstale":"2023-12-24T19:58:36.557117+0000","last_undegraded":"2023-12-24T19:58:36.557117+0000","last_fullsized":"2023-12-24T19:58:36.557117+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:25.964218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560421+0000","last_change":"2023-12-24T19:58:36.560251+0000","last_active":"2023-12-24T19:58:36.560421+0000","last_peered":"2023-12-24T19:58:36.560421+0000","last_clean":"2023-12-24T19:58:36.560421+0000","last_became_active":"2023-12-24T19:58:36.559859+0000","last_became_peered":"2023-12-24T19:58:36.559859+0000","last_unstale":"2023-12-24T19:58:36.560421+0000","last_undegraded":"2023-12-24T19:58:36.560421+0000","last_fullsized":"2023-12-24T19:58:36.560421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:20.631799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560165+0000","last_change":"2023-12-24T19:58:35.552677+0000","last_active":"2023-12-24T19:58:36.560165+0000","last_peered":"2023-12-24T19:58:36.560165+0000","last_clean":"2023-12-24T19:58:36.560165+0000","last_became_active":"2023-12-24T19:58:35.552203+0000","last_became_peered":"2023-12-24T19:58:35.552203+0000","last_unstale":"2023-12-24T19:58:36.560165+0000","last_undegraded":"2023-12-24T19:58:36.560165+0000","last_fullsized":"2023-12-24T19:58:36.560165+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:35.756716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.566837+0000","last_change":"2023-12-24T19:58:36.566110+0000","last_active":"2023-12-24T19:58:36.566837+0000","last_peered":"2023-12-24T19:58:36.566837+0000","last_clean":"2023-12-24T19:58:36.566837+0000","last_became_active":"2023-12-24T19:58:36.565673+0000","last_became_peered":"2023-12-24T19:58:36.565673+0000","last_unstale":"2023-12-24T19:58:36.566837+0000","last_undegraded":"2023-12-24T19:58:36.566837+0000","last_fullsized":"2023-12-24T19:58:36.566837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:52.499584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-12-24T19:58:37.559251+0000","last_change":"2023-12-24T19:58:35.553860+0000","last_active":"2023-12-24T19:58:37.559251+0000","last_peered":"2023-12-24T19:58:37.559251+0000","last_clean":"2023-12-24T19:58:37.559251+0000","last_became_active":"2023-12-24T19:58:35.553617+0000","last_became_peered":"2023-12-24T19:58:35.553617+0000","last_unstale":"2023-12-24T19:58:37.559251+0000","last_undegraded":"2023-12-24T19:58:37.559251+0000","last_fullsized":"2023-12-24T19:58:37.559251+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:28:04.657039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.580518+0000","last_change":"2023-12-24T19:58:36.580424+0000","last_active":"2023-12-24T19:58:36.580518+0000","last_peered":"2023-12-24T19:58:36.580518+0000","last_clean":"2023-12-24T19:58:36.580518+0000","last_became_active":"2023-12-24T19:58:36.579071+0000","last_became_peered":"2023-12-24T19:58:36.579071+0000","last_unstale":"2023-12-24T19:58:36.580518+0000","last_undegraded":"2023-12-24T19:58:36.580518+0000","last_fullsized":"2023-12-24T19:58:36.580518+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:08.437113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.558699+0000","last_change":"2023-12-24T19:58:35.555442+0000","last_active":"2023-12-24T19:58:36.558699+0000","last_peered":"2023-12-24T19:58:36.558699+0000","last_clean":"2023-12-24T19:58:36.558699+0000","last_became_active":"2023-12-24T19:58:35.555231+0000","last_became_peered":"2023-12-24T19:58:35.555231+0000","last_unstale":"2023-12-24T19:58:36.558699+0000","last_undegraded":"2023-12-24T19:58:36.558699+0000","last_fullsized":"2023-12-24T19:58:36.558699+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:37:40.312396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568001+0000","last_change":"2023-12-24T19:58:36.567940+0000","last_active":"2023-12-24T19:58:36.568001+0000","last_peered":"2023-12-24T19:58:36.568001+0000","last_clean":"2023-12-24T19:58:36.568001+0000","last_became_active":"2023-12-24T19:58:36.567702+0000","last_became_peered":"2023-12-24T19:58:36.567702+0000","last_unstale":"2023-12-24T19:58:36.568001+0000","last_undegraded":"2023-12-24T19:58:36.568001+0000","last_fullsized":"2023-12-24T19:58:36.568001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:17:10.405221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.559097+0000","last_change":"2023-12-24T19:58:35.551329+0000","last_active":"2023-12-24T19:58:36.559097+0000","last_peered":"2023-12-24T19:58:36.559097+0000","last_clean":"2023-12-24T19:58:36.559097+0000","last_became_active":"2023-12-24T19:58:35.550935+0000","last_became_peered":"2023-12-24T19:58:35.550935+0000","last_unstale":"2023-12-24T19:58:36.559097+0000","last_undegraded":"2023-12-24T19:58:36.559097+0000","last_fullsized":"2023-12-24T19:58:36.559097+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:00:45.518584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570110+0000","last_change":"2023-12-24T19:58:36.569741+0000","last_active":"2023-12-24T19:58:36.570110+0000","last_peered":"2023-12-24T19:58:36.570110+0000","last_clean":"2023-12-24T19:58:36.570110+0000","last_became_active":"2023-12-24T19:58:36.569096+0000","last_became_peered":"2023-12-24T19:58:36.569096+0000","last_unstale":"2023-12-24T19:58:36.570110+0000","last_undegraded":"2023-12-24T19:58:36.570110+0000","last_fullsized":"2023-12-24T19:58:36.570110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:10:01.839291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560529+0000","last_change":"2023-12-24T19:58:35.554755+0000","last_active":"2023-12-24T19:58:36.560529+0000","last_peered":"2023-12-24T19:58:36.560529+0000","last_clean":"2023-12-24T19:58:36.560529+0000","last_became_active":"2023-12-24T19:58:35.554561+0000","last_became_peered":"2023-12-24T19:58:35.554561+0000","last_unstale":"2023-12-24T19:58:36.560529+0000","last_undegraded":"2023-12-24T19:58:36.560529+0000","last_fullsized":"2023-12-24T19:58:36.560529+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:53:48.854776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.574010+0000","last_change":"2023-12-24T19:58:36.573863+0000","last_active":"2023-12-24T19:58:36.574010+0000","last_peered":"2023-12-24T19:58:36.574010+0000","last_clean":"2023-12-24T19:58:36.574010+0000","last_became_active":"2023-12-24T19:58:36.568717+0000","last_became_peered":"2023-12-24T19:58:36.568717+0000","last_unstale":"2023-12-24T19:58:36.574010+0000","last_undegraded":"2023-12-24T19:58:36.574010+0000","last_fullsized":"2023-12-24T19:58:36.574010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:33:32.000359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.560057+0000","last_change":"2023-12-24T19:58:35.550038+0000","last_active":"2023-12-24T19:58:36.560057+0000","last_peered":"2023-12-24T19:58:36.560057+0000","last_clean":"2023-12-24T19:58:36.560057+0000","last_became_active":"2023-12-24T19:58:35.549805+0000","last_became_peered":"2023-12-24T19:58:35.549805+0000","last_unstale":"2023-12-24T19:58:36.560057+0000","last_undegraded":"2023-12-24T19:58:36.560057+0000","last_fullsized":"2023-12-24T19:58:36.560057+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:51:25.964218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.570070+0000","last_change":"2023-12-24T19:58:36.569047+0000","last_active":"2023-12-24T19:58:36.570070+0000","last_peered":"2023-12-24T19:58:36.570070+0000","last_clean":"2023-12-24T19:58:36.570070+0000","last_became_active":"2023-12-24T19:58:36.568839+0000","last_became_peered":"2023-12-24T19:58:36.568839+0000","last_unstale":"2023-12-24T19:58:36.570070+0000","last_undegraded":"2023-12-24T19:58:36.570070+0000","last_fullsized":"2023-12-24T19:58:36.570070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:08.437113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.559138+0000","last_change":"2023-12-24T19:58:35.554829+0000","last_active":"2023-12-24T19:58:36.559138+0000","last_peered":"2023-12-24T19:58:36.559138+0000","last_clean":"2023-12-24T19:58:36.559138+0000","last_became_active":"2023-12-24T19:58:35.554617+0000","last_became_peered":"2023-12-24T19:58:35.554617+0000","last_unstale":"2023-12-24T19:58:36.559138+0000","last_undegraded":"2023-12-24T19:58:36.559138+0000","last_fullsized":"2023-12-24T19:58:36.559138+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:01.171591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.568794+0000","last_change":"2023-12-24T19:58:36.568577+0000","last_active":"2023-12-24T19:58:36.568794+0000","last_peered":"2023-12-24T19:58:36.568794+0000","last_clean":"2023-12-24T19:58:36.568794+0000","last_became_active":"2023-12-24T19:58:36.567611+0000","last_became_peered":"2023-12-24T19:58:36.567611+0000","last_unstale":"2023-12-24T19:58:36.568794+0000","last_undegraded":"2023-12-24T19:58:36.568794+0000","last_fullsized":"2023-12-24T19:58:36.568794+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:08.437113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.556018+0000","last_change":"2023-12-24T19:58:35.547161+0000","last_active":"2023-12-24T19:58:36.556018+0000","last_peered":"2023-12-24T19:58:36.556018+0000","last_clean":"2023-12-24T19:58:36.556018+0000","last_became_active":"2023-12-24T19:58:35.546903+0000","last_became_peered":"2023-12-24T19:58:35.546903+0000","last_unstale":"2023-12-24T19:58:36.556018+0000","last_undegraded":"2023-12-24T19:58:36.556018+0000","last_fullsized":"2023-12-24T19:58:36.556018+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:50:09.995115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.558784+0000","last_change":"2023-12-24T19:58:36.558718+0000","last_active":"2023-12-24T19:58:36.558784+0000","last_peered":"2023-12-24T19:58:36.558784+0000","last_clean":"2023-12-24T19:58:36.558784+0000","last_became_active":"2023-12-24T19:58:36.558466+0000","last_became_peered":"2023-12-24T19:58:36.558466+0000","last_unstale":"2023-12-24T19:58:36.558784+0000","last_undegraded":"2023-12-24T19:58:36.558784+0000","last_fullsized":"2023-12-24T19:58:36.558784+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:35.536690+0000","last_clean_scrub_stamp":"2023-12-24T19:58:35.536690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:36.763239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.578866+0000","last_change":"2023-12-24T19:58:35.550031+0000","last_active":"2023-12-24T19:58:36.578866+0000","last_peered":"2023-12-24T19:58:36.578866+0000","last_clean":"2023-12-24T19:58:36.578866+0000","last_became_active":"2023-12-24T19:58:35.549594+0000","last_became_peered":"2023-12-24T19:58:35.549594+0000","last_unstale":"2023-12-24T19:58:36.578866+0000","last_undegraded":"2023-12-24T19:58:36.578866+0000","last_fullsized":"2023-12-24T19:58:36.578866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:58:34.530168+0000","last_clean_scrub_stamp":"2023-12-24T19:58:34.530168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:01.171591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":184,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-24T19:58:36.558792+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:58:36.558792+0000","last_peered":"2023-12-24T19:58:36.558792+0000","last_clean":"2023-12-24T19:58:36.558792+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:58:36.558792+0000","last_undegraded":"2023-12-24T19:58:36.558792+0000","last_fullsized":"2023-12-24T19:58:36.558792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195831,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55700000000000005}]},{"osd":2,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60699999999999998}]},{"osd":5,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785645,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.504}]},{"osd":1,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.432},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48799999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54200000000000004}]},{"osd":4,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45600000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.40000000000000002}]},{"osd":7,"last update":"Sun Dec 24 19:57:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.33700000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.35499999999999998}]},{"osd":3,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.28599999999999998}]},{"osd":4,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.64900000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.79600000000000004}]},{"osd":6,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.83599999999999997}]},{"osd":7,"last update":"Sun Dec 24 19:57:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":785,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194527,"statfs":{"total":200000000,"available":199195887,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.312}]},{"osd":2,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.36199999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":0.376},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.39400000000000002}]},{"osd":4,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.6859999999999999,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58599999999999997}]},{"osd":6,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.621}]},{"osd":7,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.504},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.6579999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.47599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784731,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.35699999999999998}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.39400000000000002}]},{"osd":3,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.378},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32700000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53300000000000003}]},{"osd":5,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.51600000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57799999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.308},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.29599999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.35299999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53200000000000003}]},{"osd":5,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.67000000000000004}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.70099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":210,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195102,"statfs":{"total":200000000,"available":199784753,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.434}]},{"osd":1,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.45200000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.49399999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":8.8200000000000003,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.39900000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":3.8279999999999998,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.57199999999999995}]},{"osd":6,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Dec 24 19:57:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":14.039999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199786219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.505},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.435}]},{"osd":3,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40200000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:57:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57899999999999996}]}]}],"pool_statfs":[]}} 2023-12-24T19:58:41.078 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T19:58:41.078 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T19:58:41.087 INFO:tasks.ceph.mds.a.smithi061.stderr:2023-12-24T19:58:41.087+0000 7fcf7d18c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T19:58:41.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.214+0000 7fb154785700 1 Processor -- start 2023-12-24T19:58:41.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.215+0000 7fb154785700 1 -- start start 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.215+0000 7fb154785700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb14c1578d0 0x7fb14c0af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.215+0000 7fb154785700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06f6e0 0x7fb14c06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.215+0000 7fb154785700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb14c06b150 0x7fb14c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.215+0000 7fb154785700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c0caf30 con 0x7fb14c1578d0 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.215+0000 7fb154785700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c06b560 con 0x7fb14c06b150 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.215+0000 7fb154785700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0af9f0 con 0x7fb14c06f6e0 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152521700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb14c1578d0 0x7fb14c0af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152521700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb14c1578d0 0x7fb14c0af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51548/0 (socket says 172.21.15.61:51548) 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152521700 1 -- 172.21.15.61:0/2732842651 learned_addr learned my addr 172.21.15.61:0/2732842651 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb151d20700 1 --2- 172.21.15.61:0/2732842651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06f6e0 0x7fb14c06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152d22700 1 --2- 172.21.15.61:0/2732842651 >> v2:172.21.15.133:3300/0 conn(0x7fb14c06b150 0x7fb14c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152521700 1 -- 172.21.15.61:0/2732842651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06f6e0 msgr2=0x7fb14c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:41.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152521700 1 --2- 172.21.15.61:0/2732842651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06f6e0 0x7fb14c06ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152521700 1 -- 172.21.15.61:0/2732842651 >> v2:172.21.15.133:3300/0 conn(0x7fb14c06b150 msgr2=0x7fb14c06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152521700 1 --2- 172.21.15.61:0/2732842651 >> v2:172.21.15.133:3300/0 conn(0x7fb14c06b150 0x7fb14c06c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152521700 1 -- 172.21.15.61:0/2732842651 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0afcd0 con 0x7fb14c1578d0 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb151d20700 1 --2- 172.21.15.61:0/2732842651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06f6e0 0x7fb14c06ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152d22700 1 --2- 172.21.15.61:0/2732842651 >> v2:172.21.15.133:3300/0 conn(0x7fb14c06b150 0x7fb14c06c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb152521700 1 --2- 172.21.15.61:0/2732842651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 0x7fb14c0af330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0c21e0 tx=0x7fb13c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a8b26aa0135e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb15151f700 1 -- 172.21.15.61:0/2732842651 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00b860 con 0x7fb14c1578d0 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb15151f700 1 -- 172.21.15.61:0/2732842651 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c00b9c0 con 0x7fb14c1578d0 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.216+0000 7fb15151f700 1 -- 172.21.15.61:0/2732842651 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00bd60 con 0x7fb14c1578d0 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.217+0000 7fb154785700 1 -- 172.21.15.61:0/2732842651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 msgr2=0x7fb14c0af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.217+0000 7fb154785700 1 --2- 172.21.15.61:0/2732842651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 0x7fb14c0af330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0c21e0 tx=0x7fb13c009250 comp rx=0 tx=0).stop 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.217+0000 7fb154785700 1 -- 172.21.15.61:0/2732842651 shutdown_connections 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.217+0000 7fb154785700 1 --2- 172.21.15.61:0/2732842651 >> v2:172.21.15.133:3300/0 conn(0x7fb14c06b150 0x7fb14c06c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.217+0000 7fb154785700 1 --2- 172.21.15.61:0/2732842651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 0x7fb14c0af330 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.217+0000 7fb154785700 1 --2- 172.21.15.61:0/2732842651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06f6e0 0x7fb14c06ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.217+0000 7fb154785700 1 -- 172.21.15.61:0/2732842651 >> 172.21.15.61:0/2732842651 conn(0x7fb14c0ce800 msgr2=0x7fb14c0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:41.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.217+0000 7fb154785700 1 -- 172.21.15.61:0/2732842651 shutdown_connections 2023-12-24T19:58:41.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.217+0000 7fb154785700 1 -- 172.21.15.61:0/2732842651 wait complete. 2023-12-24T19:58:41.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.218+0000 7fb154785700 1 Processor -- start 2023-12-24T19:58:41.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.218+0000 7fb154785700 1 -- start start 2023-12-24T19:58:41.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb154785700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06b150 0x7fb14c1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb154785700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb14c06f6e0 0x7fb14c168670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb154785700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 0x7fb14c0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb154785700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0b2360 con 0x7fb14c1578d0 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb154785700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c168bb0 con 0x7fb14c06f6e0 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb154785700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0b1750 con 0x7fb14c06b150 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb152d22700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 0x7fb14c0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb152d22700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 0x7fb14c0b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51554/0 (socket says 172.21.15.61:51554) 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb152d22700 1 -- 172.21.15.61:0/1133756461 learned_addr learned my addr 172.21.15.61:0/1133756461 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb152521700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06b150 0x7fb14c1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb151d20700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb14c06f6e0 0x7fb14c168670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb152d22700 1 -- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06b150 msgr2=0x7fb14c1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb152d22700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06b150 0x7fb14c1570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb152d22700 1 -- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb14c06f6e0 msgr2=0x7fb14c168670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb152d22700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb14c06f6e0 0x7fb14c168670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb152d22700 1 -- 172.21.15.61:0/1133756461 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0094f0 con 0x7fb14c1578d0 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb152d22700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 0x7fb14c0b27f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb14400cf60 tx=0x7fb144007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb1427fc700 1 -- 172.21.15.61:0/1133756461 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14400ae40 con 0x7fb14c1578d0 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.219+0000 7fb1427fc700 1 -- 172.21.15.61:0/1133756461 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb144015440 con 0x7fb14c1578d0 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.220+0000 7fb154785700 1 -- 172.21.15.61:0/1133756461 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c0b1a30 con 0x7fb14c1578d0 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.220+0000 7fb1427fc700 1 -- 172.21.15.61:0/1133756461 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144015800 con 0x7fb14c1578d0 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.220+0000 7fb154785700 1 -- 172.21.15.61:0/1133756461 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c0b1ff0 con 0x7fb14c1578d0 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.220+0000 7fb154785700 1 -- 172.21.15.61:0/1133756461 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c0b2510 con 0x7fb14c1578d0 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.221+0000 7fb1427fc700 1 -- 172.21.15.61:0/1133756461 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb14400d440 con 0x7fb14c1578d0 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.221+0000 7fb1427fc700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb130066f30 0x7fb1300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.221+0000 7fb1427fc700 1 -- 172.21.15.61:0/1133756461 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb144085100 con 0x7fb14c1578d0 2023-12-24T19:58:41.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.222+0000 7fb152521700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb130066f30 0x7fb1300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.222+0000 7fb152521700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb130066f30 0x7fb1300693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0c21e0 tx=0x7fb13c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:41.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.226+0000 7fb1427fc700 1 -- 172.21.15.61:0/1133756461 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb14c0b2510 con 0x7fb14c1578d0 2023-12-24T19:58:41.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.501+0000 7fb154785700 1 -- 172.21.15.61:0/1133756461 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb14c04c3c0 con 0x7fb14c1578d0 2023-12-24T19:58:41.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.505+0000 7fb1427fc700 1 -- 172.21.15.61:0/1133756461 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb144055e00 con 0x7fb14c1578d0 2023-12-24T19:58:41.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 -- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb130066f30 msgr2=0x7fb1300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb130066f30 0x7fb1300693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0c21e0 tx=0x7fb13c017000 comp rx=0 tx=0).stop 2023-12-24T19:58:41.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 -- 172.21.15.61:0/1133756461 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 msgr2=0x7fb14c0b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 0x7fb14c0b27f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb14400cf60 tx=0x7fb144007870 comp rx=0 tx=0).stop 2023-12-24T19:58:41.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 -- 172.21.15.61:0/1133756461 shutdown_connections 2023-12-24T19:58:41.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb14c06b150 0x7fb14c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb130066f30 0x7fb1300693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb14c1578d0 0x7fb14c0b27f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 --2- 172.21.15.61:0/1133756461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb14c06f6e0 0x7fb14c168670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 -- 172.21.15.61:0/1133756461 >> 172.21.15.61:0/1133756461 conn(0x7fb14c0ce800 msgr2=0x7fb14c0cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:41.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 -- 172.21.15.61:0/1133756461 shutdown_connections 2023-12-24T19:58:41.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.507+0000 7fb154785700 1 -- 172.21.15.61:0/1133756461 wait complete. 2023-12-24T19:58:41.509 INFO:teuthology.orchestra.run.smithi061.stderr:updated caps for client.0 2023-12-24T19:58:41.520 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:41.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.642+0000 7f2d6c667700 1 Processor -- start 2023-12-24T19:58:41.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.643+0000 7f2d6c667700 1 -- start start 2023-12-24T19:58:41.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6c667700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 0x7f2d640cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6c667700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2d64159a60 0x7f2d64159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6c667700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d640b2890 con 0x7f2d64068510 2023-12-24T19:58:41.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6c667700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d640cf630 con 0x7f2d64159a60 2023-12-24T19:58:41.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6c667700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640b2240 con 0x7f2d64068140 2023-12-24T19:58:41.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d69c02700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2d64068510 0x7f2d640b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44530/0 (socket says 172.21.15.61:44530) 2023-12-24T19:58:41.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d69c02700 1 -- 172.21.15.61:0/2733632819 learned_addr learned my addr 172.21.15.61:0/2733632819 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:41.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6ac04700 1 --2- 172.21.15.61:0/2733632819 >> v2:172.21.15.61:3300/0 conn(0x7f2d64159a60 0x7f2d64159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6a403700 1 --2- 172.21.15.61:0/2733632819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 0x7f2d640cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6ac04700 1 -- 172.21.15.61:0/2733632819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 msgr2=0x7f2d640cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:41.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6ac04700 1 --2- 172.21.15.61:0/2733632819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 0x7f2d640cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6ac04700 1 -- 172.21.15.61:0/2733632819 >> v1:172.21.15.61:6789/0 conn(0x7f2d64068510 legacy=0x7f2d640b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6ac04700 1 -- 172.21.15.61:0/2733632819 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d640b2520 con 0x7f2d64159a60 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6a403700 1 --2- 172.21.15.61:0/2733632819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 0x7f2d640cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d69401700 1 -- 172.21.15.61:0/2733632819 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139178015 0 0) 0x7f2d640b2890 con 0x7f2d64068510 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.644+0000 7f2d6ac04700 1 --2- 172.21.15.61:0/2733632819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 0x7f2d64159f00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009e60 tx=0x7f2d5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320398d0cc3dd604 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.645+0000 7f2d69401700 1 -- 172.21.15.61:0/2733632819 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00e070 con 0x7f2d64159a60 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.645+0000 7f2d69401700 1 -- 172.21.15.61:0/2733632819 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c00bc30 con 0x7f2d64159a60 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.645+0000 7f2d69401700 1 -- 172.21.15.61:0/2733632819 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c012430 con 0x7f2d64159a60 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.645+0000 7f2d6c667700 1 -- 172.21.15.61:0/2733632819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 msgr2=0x7f2d64159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.645+0000 7f2d6c667700 1 --2- 172.21.15.61:0/2733632819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 0x7f2d64159f00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009e60 tx=0x7f2d5c009780 comp rx=0 tx=0).stop 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.645+0000 7f2d6c667700 1 -- 172.21.15.61:0/2733632819 shutdown_connections 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.645+0000 7f2d6c667700 1 --2- 172.21.15.61:0/2733632819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 0x7f2d640cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.645+0000 7f2d6c667700 1 --2- 172.21.15.61:0/2733632819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 0x7f2d64159f00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.645+0000 7f2d6c667700 1 -- 172.21.15.61:0/2733632819 >> 172.21.15.61:0/2733632819 conn(0x7f2d64097a10 msgr2=0x7f2d640ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:41.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.646+0000 7f2d6c667700 1 -- 172.21.15.61:0/2733632819 shutdown_connections 2023-12-24T19:58:41.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.646+0000 7f2d6c667700 1 -- 172.21.15.61:0/2733632819 wait complete. 2023-12-24T19:58:41.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.647+0000 7f2d6c667700 1 Processor -- start 2023-12-24T19:58:41.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.647+0000 7f2d6c667700 1 -- start start 2023-12-24T19:58:41.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.647+0000 7f2d6c667700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 0x7f2d6415c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.647+0000 7f2d6c667700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d64068510 0x7f2d6415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.647+0000 7f2d6c667700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 0x7f2d6415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.647+0000 7f2d6c667700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6415df70 con 0x7f2d64159a60 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.647+0000 7f2d6c667700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d641487c0 con 0x7f2d64068510 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.647+0000 7f2d6c667700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6415d360 con 0x7f2d64068140 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6ac04700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 0x7f2d6415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6ac04700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 0x7f2d6415aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51574/0 (socket says 172.21.15.61:51574) 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6ac04700 1 -- 172.21.15.61:0/3118578556 learned_addr learned my addr 172.21.15.61:0/3118578556 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6a403700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 0x7f2d6415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d69c02700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d64068510 0x7f2d6415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6ac04700 1 -- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 msgr2=0x7f2d6415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6ac04700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 0x7f2d6415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6ac04700 1 -- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d64068510 msgr2=0x7f2d6415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6ac04700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d64068510 0x7f2d6415a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6ac04700 1 -- 172.21.15.61:0/3118578556 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c009a20 con 0x7f2d64159a60 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d69c02700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d64068510 0x7f2d6415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:41.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6ac04700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 0x7f2d6415aba0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c013000 tx=0x7f2d5c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d5a7fc700 1 -- 172.21.15.61:0/3118578556 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c012e10 con 0x7f2d64159a60 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d5a7fc700 1 -- 172.21.15.61:0/3118578556 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c01d630 con 0x7f2d64159a60 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6c667700 1 -- 172.21.15.61:0/3118578556 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6415d640 con 0x7f2d64159a60 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d5a7fc700 1 -- 172.21.15.61:0/3118578556 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c01d9b0 con 0x7f2d64159a60 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.648+0000 7f2d6c667700 1 -- 172.21.15.61:0/3118578556 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6415dc00 con 0x7f2d64159a60 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.649+0000 7f2d6c667700 1 -- 172.21.15.61:0/3118578556 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6406d440 con 0x7f2d64159a60 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.650+0000 7f2d5a7fc700 1 -- 172.21.15.61:0/3118578556 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2d5c024070 con 0x7f2d64159a60 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.650+0000 7f2d5a7fc700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d48066f30 0x7f2d480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.650+0000 7f2d5a7fc700 1 -- 172.21.15.61:0/3118578556 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d5c086d60 con 0x7f2d64159a60 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.650+0000 7f2d6a403700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d48066f30 0x7f2d480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:41.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.651+0000 7f2d6a403700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d48066f30 0x7f2d480693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2d60006ea0 tx=0x7f2d60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:41.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.654+0000 7f2d5a7fc700 1 -- 172.21.15.61:0/3118578556 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d5c053fd0 con 0x7f2d64159a60 2023-12-24T19:58:41.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.893+0000 7f2d6c667700 1 -- 172.21.15.61:0/3118578556 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d6404c3c0 con 0x7f2d64159a60 2023-12-24T19:58:41.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.893+0000 7f2d5a7fc700 1 -- 172.21.15.61:0/3118578556 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f2d5c0575f0 con 0x7f2d64159a60 2023-12-24T19:58:41.894 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:41.894 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1254159834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1254159834},{"type":"v1","addr":"172.21.15.133:6835","nonce":1254159834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4078121613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4078121613},{"type":"v1","addr":"172.21.15.133:6837","nonce":4078121613}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/4252611526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":4252611526},{"type":"v1","addr":"172.21.15.61:6834","nonce":4252611526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:58:36.018348+0000","modified":"2023-12-24T19:58:39.583985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.61:6835/3976042512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3976042512},{"type":"v1","addr":"172.21.15.61:6835","nonce":3976042512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T19:58:41.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 -- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d48066f30 msgr2=0x7f2d480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d48066f30 0x7f2d480693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2d60006ea0 tx=0x7f2d60008040 comp rx=0 tx=0).stop 2023-12-24T19:58:41.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 -- 172.21.15.61:0/3118578556 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 msgr2=0x7f2d6415aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:41.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 0x7f2d6415aba0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c013000 tx=0x7f2d5c019000 comp rx=0 tx=0).stop 2023-12-24T19:58:41.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 -- 172.21.15.61:0/3118578556 shutdown_connections 2023-12-24T19:58:41.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d64068140 0x7f2d6415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d48066f30 0x7f2d480693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d64159a60 0x7f2d6415aba0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 --2- 172.21.15.61:0/3118578556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d64068510 0x7f2d6415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:41.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 -- 172.21.15.61:0/3118578556 >> 172.21.15.61:0/3118578556 conn(0x7f2d64097a10 msgr2=0x7f2d64157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:41.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 -- 172.21.15.61:0/3118578556 shutdown_connections 2023-12-24T19:58:41.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:41.895+0000 7f2d6c667700 1 -- 172.21.15.61:0/3118578556 wait complete. 2023-12-24T19:58:41.897 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 26 2023-12-24T19:58:42.310 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T19:58:36.018348+0000', 'modified': '2023-12-24T19:58:39.583985+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5274}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5274': {'gid': 5274, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.61:6835/3976042512', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.61:6833', 'nonce': 3976042512}, {'type': 'v1', 'addr': '172.21.15.61:6835', 'nonce': 3976042512}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T19:58:42.310 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T19:58:42.310 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-24T19:58:42.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.435+0000 7fedcfd4e700 1 Processor -- start 2023-12-24T19:58:42.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.435+0000 7fedcfd4e700 1 -- start start 2023-12-24T19:58:42.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.436+0000 7fedcfd4e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedc8159d10 0x7fedc80af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.436+0000 7fedcfd4e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fedc80aba00 0x7fedc80abea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.436+0000 7fedcfd4e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc8063ac0 con 0x7fedc8159940 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.436+0000 7fedcfd4e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc80af8e0 con 0x7fedc80aba00 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.436+0000 7fedcfd4e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc80ab290 con 0x7fedc8159d10 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.436+0000 7fedce2eb700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fedc80aba00 0x7fedc80abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.436+0000 7fedcdaea700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fedc8159940 0x7fedc80afc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44538/0 (socket says 172.21.15.61:44538) 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedcdaea700 1 -- 172.21.15.61:0/1148305651 learned_addr learned my addr 172.21.15.61:0/1148305651 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/1148305651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedc8159d10 0x7fedc80af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedce2eb700 1 -- 172.21.15.61:0/1148305651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedc8159d10 msgr2=0x7fedc80af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedce2eb700 1 --2- 172.21.15.61:0/1148305651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedc8159d10 0x7fedc80af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedce2eb700 1 -- 172.21.15.61:0/1148305651 >> v1:172.21.15.61:6789/0 conn(0x7fedc8159940 legacy=0x7fedc80afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedce2eb700 1 -- 172.21.15.61:0/1148305651 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc80ab570 con 0x7fedc80aba00 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedccae8700 1 -- 172.21.15.61:0/1148305651 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686869351 0 0) 0x7fedc8063ac0 con 0x7fedc8159940 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedce2eb700 1 --2- 172.21.15.61:0/1148305651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc80aba00 0x7fedc80abea0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009e60 tx=0x7fedc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc805f18adefd65 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:42.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedccae8700 1 -- 172.21.15.61:0/1148305651 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000e070 con 0x7fedc80aba00 2023-12-24T19:58:42.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedccae8700 1 -- 172.21.15.61:0/1148305651 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc000bc30 con 0x7fedc80aba00 2023-12-24T19:58:42.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.437+0000 7fedccae8700 1 -- 172.21.15.61:0/1148305651 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0012430 con 0x7fedc80aba00 2023-12-24T19:58:42.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.438+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1148305651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc80aba00 msgr2=0x7fedc80abea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.438+0000 7fedcfd4e700 1 --2- 172.21.15.61:0/1148305651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc80aba00 0x7fedc80abea0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009e60 tx=0x7fedc0009780 comp rx=0 tx=0).stop 2023-12-24T19:58:42.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.438+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1148305651 shutdown_connections 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.438+0000 7fedcfd4e700 1 --2- 172.21.15.61:0/1148305651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc80aba00 0x7fedc80abea0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.438+0000 7fedcfd4e700 1 --2- 172.21.15.61:0/1148305651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedc8159d10 0x7fedc80af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.438+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1148305651 >> 172.21.15.61:0/1148305651 conn(0x7fedc8068020 msgr2=0x7fedc80cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.438+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1148305651 shutdown_connections 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.438+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1148305651 wait complete. 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.439+0000 7fedcfd4e700 1 Processor -- start 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.439+0000 7fedcfd4e700 1 -- start start 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcfd4e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedc80aba00 0x7fedc816dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcfd4e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc8159940 0x7fedc806e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcfd4e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8159d10 0x7fedc806eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcfd4e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8156a20 con 0x7fedc8159940 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcfd4e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8169a30 con 0x7fedc8159d10 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcfd4e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc815d140 con 0x7fedc80aba00 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcd2e9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc8159940 0x7fedc806e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcd2e9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc8159940 0x7fedc806e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51594/0 (socket says 172.21.15.61:51594) 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcd2e9700 1 -- 172.21.15.61:0/1865305256 learned_addr learned my addr 172.21.15.61:0/1865305256 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcdaea700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedc80aba00 0x7fedc816dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedce2eb700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8159d10 0x7fedc806eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcd2e9700 1 -- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedc80aba00 msgr2=0x7fedc816dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedc80aba00 0x7fedc816dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcd2e9700 1 -- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8159d10 msgr2=0x7fedc806eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8159d10 0x7fedc806eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcd2e9700 1 -- 172.21.15.61:0/1865305256 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0009a20 con 0x7fedc8159940 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc8159940 0x7fedc806e5d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fedb800d860 tx=0x7fedb8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedbdffb700 1 -- 172.21.15.61:0/1865305256 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80125f0 con 0x7fedc8159940 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedbdffb700 1 -- 172.21.15.61:0/1865305256 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb8012770 con 0x7fedc8159940 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1865305256 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc816a530 con 0x7fedc8159940 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.440+0000 7fedbdffb700 1 -- 172.21.15.61:0/1865305256 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8012b30 con 0x7fedc8159940 2023-12-24T19:58:42.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.441+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1865305256 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc8169ee0 con 0x7fedc8159940 2023-12-24T19:58:42.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.442+0000 7fedbdffb700 1 -- 172.21.15.61:0/1865305256 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fedb801e460 con 0x7fedc8159940 2023-12-24T19:58:42.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.442+0000 7fedbdffb700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedac066f30 0x7fedac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.442+0000 7fedbdffb700 1 -- 172.21.15.61:0/1865305256 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fedb8084b50 con 0x7fedc8159940 2023-12-24T19:58:42.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.443+0000 7fedcdaea700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedac066f30 0x7fedac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.443+0000 7fedcdaea700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedac066f30 0x7fedac0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fedc4007fd0 tx=0x7fedc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:42.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.444+0000 7fedd904eb80 1 Processor -- start 2023-12-24T19:58:42.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.444+0000 7fedd904eb80 1 -- start start 2023-12-24T19:58:42.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.445+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108aa8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.445+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 0x564108aa3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.445+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 0x564108ac4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.445+0000 7fedd904eb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641089d63e0 con 0x564108aa7fa0 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.445+0000 7fedd904eb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641089d3be0 con 0x564108aa4170 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.445+0000 7fedd904eb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641089cf9d0 con 0x564108aa88b0 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.445+0000 7fedcdaea700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108aa8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.445+0000 7fedcdaea700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108aa8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51604/0 (socket says 172.21.15.61:51604) 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.445+0000 7fedcdaea700 1 -- 172.21.15.61:0/751127371 learned_addr learned my addr 172.21.15.61:0/751127371 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/751127371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 0x564108aa3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedce2eb700 1 --2- 172.21.15.61:0/751127371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 0x564108ac4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedcdaea700 1 -- 172.21.15.61:0/751127371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 msgr2=0x564108aa3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedcdaea700 1 --2- 172.21.15.61:0/751127371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 0x564108aa3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedcdaea700 1 -- 172.21.15.61:0/751127371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 msgr2=0x564108ac4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedcdaea700 1 --2- 172.21.15.61:0/751127371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 0x564108ac4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedcdaea700 1 -- 172.21.15.61:0/751127371 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564108863360 con 0x564108aa7fa0 2023-12-24T19:58:42.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedcdaea700 1 --2- 172.21.15.61:0/751127371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108aa8370 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fedc4005df0 tx=0x7fedc4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9eac7b0c24830b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedb2ffd700 1 -- 172.21.15.61:0/751127371 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4001d40 con 0x564108aa7fa0 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedb2ffd700 1 -- 172.21.15.61:0/751127371 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc400d8a0 con 0x564108aa7fa0 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.446+0000 7fedb2ffd700 1 -- 172.21.15.61:0/751127371 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc400dc40 con 0x564108aa7fa0 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 -- 172.21.15.61:0/751127371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 msgr2=0x564108aa8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 --2- 172.21.15.61:0/751127371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108aa8370 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fedc4005df0 tx=0x7fedc4012000 comp rx=0 tx=0).stop 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 -- 172.21.15.61:0/751127371 shutdown_connections 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 --2- 172.21.15.61:0/751127371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 0x564108ac4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 --2- 172.21.15.61:0/751127371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108aa8370 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 --2- 172.21.15.61:0/751127371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 0x564108aa3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 -- 172.21.15.61:0/751127371 >> 172.21.15.61:0/751127371 conn(0x564108a7e440 msgr2=0x564108ac9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 -- 172.21.15.61:0/751127371 shutdown_connections 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 -- 172.21.15.61:0/751127371 wait complete. 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 -- start start 2023-12-24T19:58:42.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.447+0000 7fedd904eb80 1 Processor -- start 2023-12-24T19:58:42.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.448+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 0x564108ac0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.448+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa7fa0 0x564108a81430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.448+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa88b0 0x564108a81970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.448+0000 7fedd904eb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410897c1b0 con 0x564108aa88b0 2023-12-24T19:58:42.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.448+0000 7fedd904eb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56410897be50 con 0x564108aa7fa0 2023-12-24T19:58:42.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.448+0000 7fedd904eb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641088c8e40 con 0x564108aa4170 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.448+0000 7fedd904eb80 10 client.0 _ll_register_callbacks cb 0x5641088cb7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.448+0000 7fedce2eb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa88b0 0x564108a81970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.448+0000 7fedce2eb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa88b0 0x564108a81970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51612/0 (socket says 172.21.15.61:51612) 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedce2eb700 1 -- 172.21.15.61:0/1423250408 learned_addr learned my addr 172.21.15.61:0/1423250408 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa7fa0 0x564108a81430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedcdaea700 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 0x564108ac0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedce2eb700 1 -- 172.21.15.61:0/1423250408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 msgr2=0x564108ac0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedce2eb700 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 0x564108ac0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedce2eb700 1 -- 172.21.15.61:0/1423250408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa7fa0 msgr2=0x564108a81430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedce2eb700 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa7fa0 0x564108a81430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedce2eb700 1 -- 172.21.15.61:0/1423250408 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc4005920 con 0x564108aa88b0 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedce2eb700 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa88b0 0x564108a81970 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fedc806f9a0 tx=0x7fedc0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1506922c71eeca server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7feda7fff700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7feda7fff700 1 -- 172.21.15.61:0/1423250408 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0012430 con 0x564108aa88b0 2023-12-24T19:58:42.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7feda7fff700 1 -- 172.21.15.61:0/1423250408 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fedc0026430 con 0x564108aa88b0 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedd904eb80 1 -- 172.21.15.61:0/1423250408 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564108a50eb0 con 0x564108aa88b0 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7feda7fff700 1 -- 172.21.15.61:0/1423250408 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedc0026800 con 0x564108aa88b0 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedd904eb80 10 client.5430 fetch_fsmap learned FSMap version 26 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7fedd904eb80 1 -- 172.21.15.61:0/1423250408 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x56410880fb10 con 0x564108aa88b0 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.449+0000 7feda7fff700 1 -- 172.21.15.61:0/1423250408 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564108a50eb0 con 0x564108aa88b0 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.450+0000 7feda7fff700 1 -- 172.21.15.61:0/1423250408 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 26) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fedc0026960 con 0x564108aa88b0 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.450+0000 7fedd904eb80 10 client.5430 fetch_fsmap finished waiting for FSMap version 26 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.450+0000 7fedd904eb80 10 client.5430 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.450+0000 7fedd904eb80 20 client.5430 populate_metadata read hostname 'smithi061' 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.450+0000 7fedd904eb80 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.61:6833/3976042512,v1:172.21.15.61:6835/3976042512] conn(0x564108ac0090 0x564108ac0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.450+0000 7fedd904eb80 4 client.5430 mds_command: new command op to 5274 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.450+0000 7fedd904eb80 1 -- 172.21.15.61:0/1423250408 --> [v2:172.21.15.61:6833/3976042512,v1:172.21.15.61:6835/3976042512] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641089a6880 con 0x564108ac0090 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.450+0000 7fedcdaea700 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.61:6833/3976042512,v1:172.21.15.61:6835/3976042512] conn(0x564108ac0090 0x564108ac0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.450+0000 7feda7fff700 10 client.5430 ms_handle_connect on v2:172.21.15.61:6833/3976042512 2023-12-24T19:58:42.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.450+0000 7fedcdaea700 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.61:6833/3976042512,v1:172.21.15.61:6835/3976042512] conn(0x564108ac0090 0x564108ac0460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=549dd30fb8a19005 server_cookie=ab40190e4d5c24e5 in_seq=0 out_seq=0 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7feda7fff700 1 -- 172.21.15.61:0/1423250408 <== mds.0 v2:172.21.15.61:6833/3976042512 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5641089a6880 con 0x564108ac0090 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7feda7fff700 10 client.5430 handle_command_reply: tid=0 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 client.5430 shutdown 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 -- 172.21.15.61:0/1423250408 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa88b0 msgr2=0x564108a81970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa88b0 0x564108a81970 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fedc806f9a0 tx=0x7fedc0019000 comp rx=0 tx=0).stop 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 -- 172.21.15.61:0/1423250408 shutdown_connections 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.61:6833/3976042512,v1:172.21.15.61:6835/3976042512] conn(0x564108ac0090 0x564108ac0460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 0x564108ac0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7feda7fff700 0 client.5430 ms_handle_reset on v2:172.21.15.61:6833/3976042512 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa88b0 0x564108a81970 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 --2- 172.21.15.61:0/1423250408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa7fa0 0x564108a81430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 -- 172.21.15.61:0/1423250408 >> 172.21.15.61:0/1423250408 conn(0x564108a7e440 msgr2=0x564108a7e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 -- 172.21.15.61:0/1423250408 shutdown_connections 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 1 -- 172.21.15.61:0/1423250408 wait complete. 2023-12-24T19:58:42.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.451+0000 7fedd904eb80 20 client.5430 trim_cache size 0 max 16384 2023-12-24T19:58:42.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.468+0000 7fedd904eb80 1 Processor -- start 2023-12-24T19:58:42.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.468+0000 7fedd904eb80 1 -- start start 2023-12-24T19:58:42.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 0x564108a75700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a81430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa88b0 0x564108a81970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedd904eb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x564108a825a0 con 0x564108aa7fa0 2023-12-24T19:58:42.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedd904eb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564108ad5dd0 con 0x564108aa88b0 2023-12-24T19:58:42.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedd904eb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564108ac9ba0 con 0x564108aa4170 2023-12-24T19:58:42.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcd2e9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a81430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcd2e9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a81430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51620/0 (socket says 172.21.15.61:51620) 2023-12-24T19:58:42.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcd2e9700 1 -- 172.21.15.61:0/1170377039 learned_addr learned my addr 172.21.15.61:0/1170377039 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcdaea700 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 0x564108a75700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedce2eb700 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa88b0 0x564108a81970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcd2e9700 1 -- 172.21.15.61:0/1170377039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 msgr2=0x564108a75700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 0x564108a75700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcd2e9700 1 -- 172.21.15.61:0/1170377039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa88b0 msgr2=0x564108a81970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa88b0 0x564108a81970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcd2e9700 1 -- 172.21.15.61:0/1170377039 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564108aca090 con 0x564108aa7fa0 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcdaea700 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 0x564108a75700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedce2eb700 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa88b0 0x564108a81970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a81430 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fedb80556e0 tx=0x7fedb8055650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df80d71b895a9c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedb37fe700 1 -- 172.21.15.61:0/1170377039 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8058c30 con 0x564108aa7fa0 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedb37fe700 1 -- 172.21.15.61:0/1170377039 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb805c980 con 0x564108aa7fa0 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.469+0000 7fedb37fe700 1 -- 172.21.15.61:0/1170377039 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8053d80 con 0x564108aa7fa0 2023-12-24T19:58:42.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.470+0000 7fedd904eb80 1 -- 172.21.15.61:0/1170377039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 msgr2=0x564108a81430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.470+0000 7fedd904eb80 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a81430 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fedb80556e0 tx=0x7fedb8055650 comp rx=0 tx=0).stop 2023-12-24T19:58:42.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.470+0000 7fedd904eb80 1 -- 172.21.15.61:0/1170377039 shutdown_connections 2023-12-24T19:58:42.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.470+0000 7fedd904eb80 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa4170 0x564108a75700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.470+0000 7fedd904eb80 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa88b0 0x564108a81970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.470+0000 7fedd904eb80 1 --2- 172.21.15.61:0/1170377039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a81430 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.470+0000 7fedd904eb80 1 -- 172.21.15.61:0/1170377039 >> 172.21.15.61:0/1170377039 conn(0x564108a7e440 msgr2=0x564108aaf530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:42.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.470+0000 7fedd904eb80 1 -- 172.21.15.61:0/1170377039 shutdown_connections 2023-12-24T19:58:42.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.470+0000 7fedd904eb80 1 -- 172.21.15.61:0/1170377039 wait complete. 2023-12-24T19:58:42.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.471+0000 7fedd904eb80 1 -- start start 2023-12-24T19:58:42.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.471+0000 7fedd904eb80 1 Processor -- start 2023-12-24T19:58:42.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 0x564108b21bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a75ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedd904eb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 0x564108a76420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedd904eb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x564108ac4d80 con 0x564108aa7fa0 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedd904eb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564108ac8ef0 con 0x564108aa4170 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedd904eb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564108aa6840 con 0x564108aa88b0 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedd904eb80 10 client.0 _ll_register_callbacks cb 0x7fedc0009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcd2e9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a75ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcd2e9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a75ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51634/0 (socket says 172.21.15.61:51634) 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcd2e9700 1 -- 172.21.15.61:0/187283655 learned_addr learned my addr 172.21.15.61:0/187283655 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcdaea700 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 0x564108b21bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedce2eb700 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 0x564108a76420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcd2e9700 1 -- 172.21.15.61:0/187283655 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 msgr2=0x564108a76420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 0x564108a76420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcd2e9700 1 -- 172.21.15.61:0/187283655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 msgr2=0x564108b21bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:42.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 0x564108b21bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcd2e9700 1 -- 172.21.15.61:0/187283655 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc8169ee0 con 0x564108aa7fa0 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcdaea700 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 0x564108b21bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedce2eb700 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 0x564108a76420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedcd2e9700 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a75ee0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fedb8056040 tx=0x7fedb806e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7237c87f8fbaf0c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7feda7fff700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7feda7fff700 1 -- 172.21.15.61:0/187283655 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8012c90 con 0x564108aa7fa0 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7feda7fff700 1 -- 172.21.15.61:0/187283655 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fedb8012df0 con 0x564108aa7fa0 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedd904eb80 1 -- 172.21.15.61:0/187283655 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564108a74490 con 0x564108aa7fa0 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7feda7fff700 1 -- 172.21.15.61:0/187283655 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedb805cde0 con 0x564108aa7fa0 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.472+0000 7fedd904eb80 10 client.5436 fetch_fsmap learned FSMap version 26 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7fedd904eb80 1 -- 172.21.15.61:0/187283655 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x56410899e290 con 0x564108aa7fa0 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7feda7fff700 1 -- 172.21.15.61:0/187283655 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564108a74490 con 0x564108aa7fa0 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7feda7fff700 1 -- 172.21.15.61:0/187283655 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 26) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fedb805c4f0 con 0x564108aa7fa0 2023-12-24T19:58:42.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7fedd904eb80 10 client.5436 fetch_fsmap finished waiting for FSMap version 26 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7fedd904eb80 10 client.5436 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7fedd904eb80 20 client.5436 populate_metadata read hostname 'smithi061' 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7fedd904eb80 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.61:6833/3976042512,v1:172.21.15.61:6835/3976042512] conn(0x564108a7c510 0x564108a7c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7fedd904eb80 4 client.5436 mds_command: new command op to 5274 tid=0[{"prefix": "status"}] 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7fedd904eb80 1 -- 172.21.15.61:0/187283655 --> [v2:172.21.15.61:6833/3976042512,v1:172.21.15.61:6835/3976042512] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564108972910 con 0x564108a7c510 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7fedcdaea700 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.61:6833/3976042512,v1:172.21.15.61:6835/3976042512] conn(0x564108a7c510 0x564108a7c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7fedcdaea700 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.61:6833/3976042512,v1:172.21.15.61:6835/3976042512] conn(0x564108a7c510 0x564108a7c8e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2565cc76670e25c4 server_cookie=e77127edce27d2b0 in_seq=0 out_seq=0 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7feda7fff700 10 client.5436 ms_handle_connect on v2:172.21.15.61:6833/3976042512 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7feda7fff700 1 -- 172.21.15.61:0/187283655 <== mds.0 v2:172.21.15.61:6833/3976042512 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564108972910 con 0x564108a7c510 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7feda7fff700 10 client.5436 handle_command_reply: tid=0 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.473+0000 7fedd904eb80 1 client.5436 shutdown 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 1 -- 172.21.15.61:0/187283655 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 msgr2=0x564108a75ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a75ee0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fedb8056040 tx=0x7fedb806e000 comp rx=0 tx=0).stop 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 1 -- 172.21.15.61:0/187283655 shutdown_connections 2023-12-24T19:58:42.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.61:6833/3976042512,v1:172.21.15.61:6835/3976042512] conn(0x564108a7c510 0x564108a7c8e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564108aa88b0 0x564108a76420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564108aa4170 0x564108b21bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7feda7fff700 0 client.5436 ms_handle_reset on v2:172.21.15.61:6833/3976042512 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 1 --2- 172.21.15.61:0/187283655 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564108aa7fa0 0x564108a75ee0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 1 -- 172.21.15.61:0/187283655 >> 172.21.15.61:0/187283655 conn(0x564108a7e440 msgr2=0x564108aaf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 1 -- 172.21.15.61:0/187283655 shutdown_connections 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 1 -- 172.21.15.61:0/187283655 wait complete. 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedd904eb80 20 client.5436 trim_cache size 0 max 16384 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T19:58:42.481 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5274, 2023-12-24T19:58:42.482 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T19:58:42.482 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T19:58:42.482 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T19:58:42.482 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 5.9071526089999997, 2023-12-24T19:58:42.482 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 26, 2023-12-24T19:58:42.482 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 45, 2023-12-24T19:58:42.482 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 45, 2023-12-24T19:58:42.482 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 17.290721546 2023-12-24T19:58:42.482 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:42.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedac066f30 msgr2=0x7fedac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedac066f30 0x7fedac0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fedc4007fd0 tx=0x7fedc4009040 comp rx=0 tx=0).stop 2023-12-24T19:58:42.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1865305256 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc8159940 msgr2=0x7fedc806e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc8159940 0x7fedc806e5d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fedb800d860 tx=0x7fedb8008040 comp rx=0 tx=0).stop 2023-12-24T19:58:42.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1865305256 shutdown_connections 2023-12-24T19:58:42.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedc80aba00 0x7fedc816dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedac066f30 0x7fedac0693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc8159d10 0x7fedc806eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 --2- 172.21.15.61:0/1865305256 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedc8159940 0x7fedc806e5d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1865305256 >> 172.21.15.61:0/1865305256 conn(0x7fedc8068020 msgr2=0x7fedc80ad250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:42.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1865305256 shutdown_connections 2023-12-24T19:58:42.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.474+0000 7fedcfd4e700 1 -- 172.21.15.61:0/1865305256 wait complete. 2023-12-24T19:58:42.486 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:58:42.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.607+0000 7f5edc8bf700 1 Processor -- start 2023-12-24T19:58:42.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.607+0000 7f5edc8bf700 1 -- start start 2023-12-24T19:58:42.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5edc8bf700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5ed806b630 0x7f5ed815c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5edc8bf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8070640 0x7f5ed8070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5edc8bf700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed815bcd0 con 0x7f5ed806b260 2023-12-24T19:58:42.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5edc8bf700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed8070fc0 con 0x7f5ed806b630 2023-12-24T19:58:42.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5edc8bf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80cafb0 con 0x7f5ed8070640 2023-12-24T19:58:42.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5ed5d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5ed806b630 0x7f5ed815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5ed659c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f5ed806b260 0x7f5ed8067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44552/0 (socket says 172.21.15.61:44552) 2023-12-24T19:58:42.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5ed659c700 1 -- 172.21.15.61:0/969315241 learned_addr learned my addr 172.21.15.61:0/969315241 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:42.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5ed6d9d700 1 --2- 172.21.15.61:0/969315241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8070640 0x7f5ed8070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5ed5d9b700 1 -- 172.21.15.61:0/969315241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8070640 msgr2=0x7f5ed8070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5ed5d9b700 1 --2- 172.21.15.61:0/969315241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8070640 0x7f5ed8070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5ed5d9b700 1 -- 172.21.15.61:0/969315241 >> v1:172.21.15.61:6789/0 conn(0x7f5ed806b260 legacy=0x7f5ed8067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5ed5d9b700 1 -- 172.21.15.61:0/969315241 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80683a0 con 0x7f5ed806b630 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.608+0000 7f5ed559a700 1 -- 172.21.15.61:0/969315241 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472704902 0 0) 0x7f5ed815bcd0 con 0x7f5ed806b260 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5ed5d9b700 1 --2- 172.21.15.61:0/969315241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 0x7f5ed815c160 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0098e0 tx=0x7f5ecc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bda0e9ac282ff08 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5ed559a700 1 -- 172.21.15.61:0/969315241 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc009e80 con 0x7f5ed806b630 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5ed559a700 1 -- 172.21.15.61:0/969315241 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc00b860 con 0x7f5ed806b630 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5ed559a700 1 -- 172.21.15.61:0/969315241 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00bbe0 con 0x7f5ed806b630 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5edc8bf700 1 -- 172.21.15.61:0/969315241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 msgr2=0x7f5ed815c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5edc8bf700 1 --2- 172.21.15.61:0/969315241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 0x7f5ed815c160 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0098e0 tx=0x7f5ecc0091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5edc8bf700 1 -- 172.21.15.61:0/969315241 shutdown_connections 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5edc8bf700 1 --2- 172.21.15.61:0/969315241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8070640 0x7f5ed8070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5edc8bf700 1 --2- 172.21.15.61:0/969315241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 0x7f5ed815c160 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5edc8bf700 1 -- 172.21.15.61:0/969315241 >> 172.21.15.61:0/969315241 conn(0x7f5ed80ca200 msgr2=0x7f5ed80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:42.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5edc8bf700 1 -- 172.21.15.61:0/969315241 shutdown_connections 2023-12-24T19:58:42.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.609+0000 7f5edc8bf700 1 -- 172.21.15.61:0/969315241 wait complete. 2023-12-24T19:58:42.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.611+0000 7f5edc8bf700 1 Processor -- start 2023-12-24T19:58:42.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.611+0000 7f5edc8bf700 1 -- start start 2023-12-24T19:58:42.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.611+0000 7f5edc8bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ed806b260 0x7f5ed81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.611+0000 7f5edc8bf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 0x7f5ed80ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.611+0000 7f5edc8bf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8070640 0x7f5ed81563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.611+0000 7f5edc8bf700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80ab4e0 con 0x7f5ed806b630 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.611+0000 7f5edc8bf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed81579a0 con 0x7f5ed806b260 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.611+0000 7f5edc8bf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80ab730 con 0x7f5ed8070640 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.611+0000 7f5ed5d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 0x7f5ed80ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.611+0000 7f5ed5d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 0x7f5ed80ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51642/0 (socket says 172.21.15.61:51642) 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ed5d9b700 1 -- 172.21.15.61:0/967933916 learned_addr learned my addr 172.21.15.61:0/967933916 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ed6d9d700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8070640 0x7f5ed81563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ed5d9b700 1 -- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8070640 msgr2=0x7f5ed81563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ed5d9b700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8070640 0x7f5ed81563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ed5d9b700 1 -- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ed806b260 msgr2=0x7f5ed81573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ed5d9b700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ed806b260 0x7f5ed81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ed5d9b700 1 -- 172.21.15.61:0/967933916 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc009420 con 0x7f5ed806b630 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ed5d9b700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 0x7f5ed80ac5a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5ed806c7f0 tx=0x7f5ecc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ec67fc700 1 -- 172.21.15.61:0/967933916 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00bbe0 con 0x7f5ed806b630 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ec67fc700 1 -- 172.21.15.61:0/967933916 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc011420 con 0x7f5ed806b630 2023-12-24T19:58:42.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5ec67fc700 1 -- 172.21.15.61:0/967933916 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0117c0 con 0x7f5ed806b630 2023-12-24T19:58:42.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5edc8bf700 1 -- 172.21.15.61:0/967933916 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed80aba10 con 0x7f5ed806b630 2023-12-24T19:58:42.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.612+0000 7f5edc8bf700 1 -- 172.21.15.61:0/967933916 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed80acae0 con 0x7f5ed806b630 2023-12-24T19:58:42.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.613+0000 7f5edc8bf700 1 -- 172.21.15.61:0/967933916 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed804c3c0 con 0x7f5ed806b630 2023-12-24T19:58:42.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.613+0000 7f5ec67fc700 1 -- 172.21.15.61:0/967933916 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5ecc011bb0 con 0x7f5ed806b630 2023-12-24T19:58:42.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.614+0000 7f5ec67fc700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5eb8066f30 0x7f5eb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:42.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.614+0000 7f5ec67fc700 1 -- 172.21.15.61:0/967933916 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ecc085f00 con 0x7f5ed806b630 2023-12-24T19:58:42.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.614+0000 7f5ed659c700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5eb8066f30 0x7f5eb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:42.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.615+0000 7f5ed659c700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5eb8066f30 0x7f5eb80693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8001660 tx=0x7f5ec8007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:42.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.618+0000 7f5ec67fc700 1 -- 172.21.15.61:0/967933916 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ecc053170 con 0x7f5ed806b630 2023-12-24T19:58:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.856+0000 7f5edc8bf700 1 -- 172.21.15.61:0/967933916 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5ed806f110 con 0x7f5ed806b630 2023-12-24T19:58:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.857+0000 7f5ec67fc700 1 -- 172.21.15.61:0/967933916 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5ecc011e60 con 0x7f5ed806b630 2023-12-24T19:58:42.857 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:58:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 -- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5eb8066f30 msgr2=0x7f5eb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5eb8066f30 0x7f5eb80693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8001660 tx=0x7f5ec8007bd0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 -- 172.21.15.61:0/967933916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 msgr2=0x7f5ed80ac5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 0x7f5ed80ac5a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5ed806c7f0 tx=0x7f5ecc017000 comp rx=0 tx=0).stop 2023-12-24T19:58:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 -- 172.21.15.61:0/967933916 shutdown_connections 2023-12-24T19:58:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ed8070640 0x7f5ed81563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5eb8066f30 0x7f5eb80693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ed806b260 0x7f5ed81573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 --2- 172.21.15.61:0/967933916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ed806b630 0x7f5ed80ac5a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 -- 172.21.15.61:0/967933916 >> 172.21.15.61:0/967933916 conn(0x7f5ed80ca200 msgr2=0x7f5ed8069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:42.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 -- 172.21.15.61:0/967933916 shutdown_connections 2023-12-24T19:58:42.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:42.859+0000 7f5edc8bf700 1 -- 172.21.15.61:0/967933916 wait complete. 2023-12-24T19:58:42.871 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T19:58:42.871 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:58:42.871 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T19:58:42.872 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T19:58:42.872 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:42.872 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T19:58:42.872 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T19:58:42.872 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:58:42.872 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:58:42.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:42.872 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T19:58:42.890 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:42.891 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42443sec preferred_lft 42443sec 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:42.892 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:58:42.893 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T19:58:42.893 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link 2023-12-24T19:58:42.893 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:42.893 INFO:teuthology.orchestra.run.smithi061.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:58:42.893 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 12:83:d1:9f:62:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T19:58:42.893 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1083:d1ff:fe9f:62aa/64 scope link 2023-12-24T19:58:42.893 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:42.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:42.893 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:58:42.957 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T19:58:42.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:42.959 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T19:58:43.018 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T19:58:43.018 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:58:43.018 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T19:58:43.019 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T19:58:43.019 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:58:43.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:43.019 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:58:43.019 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:58:43.019 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T19:58:43.019 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T19:58:43.019 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T19:58:43.019 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:58:43.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:43.126 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T19:58:43.143 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T19:58:43.144 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T19:58:43.144 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:58:43.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:43.144 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T19:58:43.211 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T19:58:43.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:58:43.211 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:43.268 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:58:43.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:58:43.269 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:43.325 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T19:58:43.394 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:58:43.394 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:58:43.461 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:58:43.462 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:58:43.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:43.462 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T19:58:43.520 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T19:58:43.520 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T19:58:43.562 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T19:58:43.589 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:58:43.590 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:58:43.649 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T19:58:43.648+0000 7f177b890540 -1 init, newargv = 0x56496d0393c0 newargc=15 2023-12-24T19:58:43.649 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[51612]: starting ceph client 2023-12-24T19:58:43.653 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[51612]: starting fuse 2023-12-24T19:58:43.659 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:58:43.660 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:58:43.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:43.661 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T19:58:43.718 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T19:58:43.718 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T19:58:43.718 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:43.718 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T19:58:43.718 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T19:58:43.718 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:58:43.718 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:58:43.719 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T19:58:43.720 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T19:58:43.720 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T19:58:43.720 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:58:43.720 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:58:43.720 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T19:58:43.720 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:58:43.843 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.51612.asok 2023-12-24T19:58:44.025 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51612.asok 2023-12-24T19:58:44.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:44.026 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51612.asok status 2023-12-24T19:58:44.182 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "51612", 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T19:58:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5454, 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 5454 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2816798631 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:44.184 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2816798631 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.5454 192.168.0.1:0/2816798631", 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2816798631", 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 26, 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 45, 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T19:58:44.185 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:44.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:44.193 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T19:58:44.193 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:44.210 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T19:58:44.210 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:44.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:44.211 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:58:44.278 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:58:44.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.440+0000 7f86995f9700 1 Processor -- start 2023-12-24T19:58:44.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.440+0000 7f86995f9700 1 -- start start 2023-12-24T19:58:44.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.440+0000 7f86995f9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8694159fe0 0x7f86940cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.440+0000 7f86995f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 0x7f86940cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.440+0000 7f86995f9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86940af880 con 0x7f8694159c10 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.440+0000 7f86995f9700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86940c6fc0 con 0x7f8694159fe0 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86995f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86940c63b0 con 0x7f86940c5ee0 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86927fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8694159fe0 0x7f86940cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86927fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8694159fe0 0x7f86940cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51652/0 (socket says 172.21.15.61:51652) 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86927fc700 1 -- 172.21.15.61:0/3199724794 learned_addr learned my addr 172.21.15.61:0/3199724794 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86937fe700 1 --2- 172.21.15.61:0/3199724794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 0x7f86940cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86927fc700 1 -- 172.21.15.61:0/3199724794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 msgr2=0x7f86940cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86927fc700 1 --2- 172.21.15.61:0/3199724794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 0x7f86940cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86927fc700 1 -- 172.21.15.61:0/3199724794 >> v1:172.21.15.133:6789/0 conn(0x7f8694159c10 legacy=0x7f86940c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86927fc700 1 -- 172.21.15.61:0/3199724794 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940c6690 con 0x7f8694159fe0 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86937fe700 1 --2- 172.21.15.61:0/3199724794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 0x7f86940cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f86927fc700 1 --2- 172.21.15.61:0/3199724794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159fe0 0x7f86940cba80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f86840099b0 tx=0x7f8684009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d403d42540f868 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:44.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f8691ffb700 1 -- 172.21.15.61:0/3199724794 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400b820 con 0x7f8694159fe0 2023-12-24T19:58:44.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f8691ffb700 1 -- 172.21.15.61:0/3199724794 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868400b980 con 0x7f8694159fe0 2023-12-24T19:58:44.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.441+0000 7f8691ffb700 1 -- 172.21.15.61:0/3199724794 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400bd20 con 0x7f8694159fe0 2023-12-24T19:58:44.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.442+0000 7f86995f9700 1 -- 172.21.15.61:0/3199724794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159fe0 msgr2=0x7f86940cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:44.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.442+0000 7f86995f9700 1 --2- 172.21.15.61:0/3199724794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159fe0 0x7f86940cba80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f86840099b0 tx=0x7f8684009250 comp rx=0 tx=0).stop 2023-12-24T19:58:44.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.442+0000 7f86995f9700 1 -- 172.21.15.61:0/3199724794 shutdown_connections 2023-12-24T19:58:44.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.442+0000 7f86995f9700 1 --2- 172.21.15.61:0/3199724794 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 0x7f86940cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:44.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.442+0000 7f86995f9700 1 --2- 172.21.15.61:0/3199724794 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159fe0 0x7f86940cba80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:44.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.442+0000 7f86995f9700 1 -- 172.21.15.61:0/3199724794 >> 172.21.15.61:0/3199724794 conn(0x7f869406e640 msgr2=0x7f8694067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:44.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.442+0000 7f86995f9700 1 -- 172.21.15.61:0/3199724794 shutdown_connections 2023-12-24T19:58:44.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.442+0000 7f86995f9700 1 -- 172.21.15.61:0/3199724794 wait complete. 2023-12-24T19:58:44.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.443+0000 7f86995f9700 1 Processor -- start 2023-12-24T19:58:44.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.443+0000 7f86995f9700 1 -- start start 2023-12-24T19:58:44.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86995f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 0x7f8694145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:44.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86995f9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159c10 0x7f86940cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:44.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86995f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8694159fe0 0x7f8694145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:44.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86995f9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869415c2d0 con 0x7f8694159c10 2023-12-24T19:58:44.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86995f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86940b4ff0 con 0x7f8694159fe0 2023-12-24T19:58:44.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86995f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86940b43e0 con 0x7f86940c5ee0 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86927fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159c10 0x7f86940cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86927fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159c10 0x7f86940cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51656/0 (socket says 172.21.15.61:51656) 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86927fc700 1 -- 172.21.15.61:0/3948239866 learned_addr learned my addr 172.21.15.61:0/3948239866 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f8692ffd700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 0x7f8694145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86937fe700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8694159fe0 0x7f8694145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86927fc700 1 -- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 msgr2=0x7f8694145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86927fc700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 0x7f8694145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86927fc700 1 -- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8694159fe0 msgr2=0x7f8694145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86927fc700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8694159fe0 0x7f8694145090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.444+0000 7f86927fc700 1 -- 172.21.15.61:0/3948239866 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840094f0 con 0x7f8694159c10 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.445+0000 7f86927fc700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159c10 0x7f86940cfec0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f86840099b0 tx=0x7f8684016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.445+0000 7f867affd700 1 -- 172.21.15.61:0/3948239866 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868401c460 con 0x7f8694159c10 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.445+0000 7f867affd700 1 -- 172.21.15.61:0/3948239866 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868401c5c0 con 0x7f8694159c10 2023-12-24T19:58:44.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.445+0000 7f86995f9700 1 -- 172.21.15.61:0/3948239866 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86940b46c0 con 0x7f8694159c10 2023-12-24T19:58:44.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.445+0000 7f867affd700 1 -- 172.21.15.61:0/3948239866 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868401c980 con 0x7f8694159c10 2023-12-24T19:58:44.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.445+0000 7f86995f9700 1 -- 172.21.15.61:0/3948239866 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86940b4c80 con 0x7f8694159c10 2023-12-24T19:58:44.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.446+0000 7f86995f9700 1 -- 172.21.15.61:0/3948239866 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86940890b0 con 0x7f8694159c10 2023-12-24T19:58:44.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.446+0000 7f867affd700 1 -- 172.21.15.61:0/3948239866 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f868401cd30 con 0x7f8694159c10 2023-12-24T19:58:44.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.447+0000 7f867affd700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8680066f30 0x7f86800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:44.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.447+0000 7f867affd700 1 -- 172.21.15.61:0/3948239866 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8684086ab0 con 0x7f8694159c10 2023-12-24T19:58:44.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.447+0000 7f8692ffd700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8680066f30 0x7f86800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:44.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.448+0000 7f8692ffd700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8680066f30 0x7f86800693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8688003870 tx=0x7f8688009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:44.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.451+0000 7f867affd700 1 -- 172.21.15.61:0/3948239866 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8684053c80 con 0x7f8694159c10 2023-12-24T19:58:44.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.693+0000 7f86995f9700 1 -- 172.21.15.61:0/3948239866 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f86940890b0 con 0x7f8694159c10 2023-12-24T19:58:44.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.693+0000 7f867affd700 1 -- 172.21.15.61:0/3948239866 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f86840572a0 con 0x7f8694159c10 2023-12-24T19:58:44.694 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:58:44.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 -- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8680066f30 msgr2=0x7f86800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:44.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8680066f30 0x7f86800693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8688003870 tx=0x7f8688009040 comp rx=0 tx=0).stop 2023-12-24T19:58:44.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 -- 172.21.15.61:0/3948239866 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159c10 msgr2=0x7f86940cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:44.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159c10 0x7f86940cfec0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f86840099b0 tx=0x7f8684016000 comp rx=0 tx=0).stop 2023-12-24T19:58:44.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 -- 172.21.15.61:0/3948239866 shutdown_connections 2023-12-24T19:58:44.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86940c5ee0 0x7f8694145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:44.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8680066f30 0x7f86800693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:44.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8694159fe0 0x7f8694145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:44.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 --2- 172.21.15.61:0/3948239866 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8694159c10 0x7f86940cfec0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:44.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 -- 172.21.15.61:0/3948239866 >> 172.21.15.61:0/3948239866 conn(0x7f869406e640 msgr2=0x7f8694156700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:44.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 -- 172.21.15.61:0/3948239866 shutdown_connections 2023-12-24T19:58:44.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:44.695+0000 7f86995f9700 1 -- 172.21.15.61:0/3948239866 wait complete. 2023-12-24T19:58:44.707 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T19:58:44.707 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:58:44.708 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T19:58:44.708 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T19:58:44.708 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:44.708 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T19:58:44.708 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T19:58:44.708 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:58:44.708 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:58:44.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:44.708 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T19:58:44.730 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:58:44.730 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:58:44.730 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T19:58:44.731 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42448sec preferred_lft 42448sec 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::accb:c5ff:feae:915/64 scope link 2023-12-24T19:58:44.732 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:58:44.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:44.733 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:58:44.801 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T19:58:44.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:44.803 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T19:58:44.864 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T19:58:44.864 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:58:44.864 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T19:58:44.864 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T19:58:44.864 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:58:44.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:44.864 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:58:44.864 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:58:44.864 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T19:58:44.864 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T19:58:44.865 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T19:58:44.865 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:58:44.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:44.977 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T19:58:44.995 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T19:58:44.995 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T19:58:44.995 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:58:44.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:58:44.995 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T19:58:45.063 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T19:58:45.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:58:45.063 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:45.121 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:58:45.121 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:58:45.121 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:45.177 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T19:58:45.244 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:58:45.245 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:58:45.310 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:58:45.311 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:58:45.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:45.312 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T19:58:45.368 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T19:58:45.368 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T19:58:45.411 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T19:58:45.437 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:58:45.438 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:58:45.493 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T19:58:45.492+0000 7f861ad2e540 -1 init, newargv = 0x55b8b4e93810 newargc=15 2023-12-24T19:58:45.493 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[43667]: starting ceph client 2023-12-24T19:58:45.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[43667]: starting fuse 2023-12-24T19:58:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:58:45.507 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:58:45.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:45.508 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T19:58:45.565 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T19:58:45.565 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T19:58:45.566 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T19:58:45.567 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T19:58:45.688 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.43667.asok 2023-12-24T19:58:45.871 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43667.asok 2023-12-24T19:58:45.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:45.871 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43667.asok status 2023-12-24T19:58:46.024 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T19:58:46.024 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T19:58:46.024 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:58:46.024 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "43667", 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5185, 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 5185 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:58:46.025 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3864680661 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3864680661 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.5185 192.168.0.1:0/3864680661", 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/3864680661", 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 26, 2023-12-24T19:58:46.026 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 45, 2023-12-24T19:58:46.027 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T19:58:46.027 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T19:58:46.027 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T19:58:46.027 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T19:58:46.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:46.034 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T19:58:46.034 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:46.051 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T19:58:46.051 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:46.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:46.051 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T19:58:46.119 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:46.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.254+0000 7f3971587700 1 Processor -- start 2023-12-24T19:58:46.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.254+0000 7f3971587700 1 -- start start 2023-12-24T19:58:46.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.255+0000 7f3971587700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f396c0c94b0 0x7f396c0af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:46.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.255+0000 7f3971587700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c063ac0 0x7f396c157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:46.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.255+0000 7f3971587700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c158b70 con 0x7f396c157730 2023-12-24T19:58:46.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.255+0000 7f3971587700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396c158040 con 0x7f396c0c94b0 2023-12-24T19:58:46.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.255+0000 7f3971587700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c158240 con 0x7f396c063ac0 2023-12-24T19:58:46.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f396b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c063ac0 0x7f396c157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f396a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f396c0c94b0 0x7f396c0af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f396b7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c063ac0 0x7f396c157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:56932/0 (socket says 172.21.15.61:56932) 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f396b7fe700 1 -- 172.21.15.61:0/2789783889 learned_addr learned my addr 172.21.15.61:0/2789783889 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f396affd700 1 --1- 172.21.15.61:0/2789783889 >> v1:172.21.15.133:6789/0 conn(0x7f396c157730 0x7f396c0c8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:57504/0 (socket says 172.21.15.61:57504) 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f396b7fe700 1 -- 172.21.15.61:0/2789783889 >> v2:172.21.15.133:3300/0 conn(0x7f396c0c94b0 msgr2=0x7f396c0af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f396b7fe700 1 --2- 172.21.15.61:0/2789783889 >> v2:172.21.15.133:3300/0 conn(0x7f396c0c94b0 0x7f396c0af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f396b7fe700 1 -- 172.21.15.61:0/2789783889 >> v1:172.21.15.133:6789/0 conn(0x7f396c157730 legacy=0x7f396c0c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f396b7fe700 1 -- 172.21.15.61:0/2789783889 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c158520 con 0x7f396c063ac0 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f396b7fe700 1 --2- 172.21.15.61:0/2789783889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c063ac0 0x7f396c157b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3964009f20 tx=0x7f3964009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8411b91abeda642c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f3969ffb700 1 -- 172.21.15.61:0/2789783889 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396400e070 con 0x7f396c063ac0 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f3969ffb700 1 -- 172.21.15.61:0/2789783889 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396400b9d0 con 0x7f396c063ac0 2023-12-24T19:58:46.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.256+0000 7f3969ffb700 1 -- 172.21.15.61:0/2789783889 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640092e0 con 0x7f396c063ac0 2023-12-24T19:58:46.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.257+0000 7f3971587700 1 -- 172.21.15.61:0/2789783889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c063ac0 msgr2=0x7f396c157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:46.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.257+0000 7f3971587700 1 --2- 172.21.15.61:0/2789783889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c063ac0 0x7f396c157b00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3964009f20 tx=0x7f3964009840 comp rx=0 tx=0).stop 2023-12-24T19:58:46.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.257+0000 7f3971587700 1 -- 172.21.15.61:0/2789783889 shutdown_connections 2023-12-24T19:58:46.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.257+0000 7f3971587700 1 --2- 172.21.15.61:0/2789783889 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c063ac0 0x7f396c157b00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:46.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.257+0000 7f3971587700 1 --2- 172.21.15.61:0/2789783889 >> v2:172.21.15.133:3300/0 conn(0x7f396c0c94b0 0x7f396c0af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:46.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.257+0000 7f3971587700 1 -- 172.21.15.61:0/2789783889 >> 172.21.15.61:0/2789783889 conn(0x7f396c0cceb0 msgr2=0x7f396c0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:46.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.257+0000 7f3971587700 1 -- 172.21.15.61:0/2789783889 shutdown_connections 2023-12-24T19:58:46.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.257+0000 7f3971587700 1 -- 172.21.15.61:0/2789783889 wait complete. 2023-12-24T19:58:46.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.258+0000 7f3971587700 1 Processor -- start 2023-12-24T19:58:46.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.258+0000 7f3971587700 1 -- start start 2023-12-24T19:58:46.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f3971587700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f396c063ac0 0x7f396c0c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:46.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f3971587700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c0c94b0 0x7f396c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:46.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f3971587700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396c157730 0x7f396c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:46.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f3971587700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0b27e0 con 0x7f396c063ac0 2023-12-24T19:58:46.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f3971587700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0b2a10 con 0x7f396c157730 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f3971587700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c4000 con 0x7f396c0c94b0 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f396affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f396c063ac0 0x7f396c0c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f396affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f396c063ac0 0x7f396c0c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51658/0 (socket says 172.21.15.61:51658) 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f396affd700 1 -- 172.21.15.61:0/2277978556 learned_addr learned my addr 172.21.15.61:0/2277978556 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f396b7fe700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396c157730 0x7f396c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.259+0000 7f396a7fc700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c0c94b0 0x7f396c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f396affd700 1 -- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c0c94b0 msgr2=0x7f396c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f396affd700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c0c94b0 0x7f396c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f396affd700 1 -- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396c157730 msgr2=0x7f396c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f396affd700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396c157730 0x7f396c0b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f396affd700 1 -- 172.21.15.61:0/2277978556 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3964009ae0 con 0x7f396c063ac0 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f396affd700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f396c063ac0 0x7f396c0c4dc0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f395400c560 tx=0x7f3954007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f3962ffd700 1 -- 172.21.15.61:0/2277978556 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3954005a70 con 0x7f396c063ac0 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f3962ffd700 1 -- 172.21.15.61:0/2277978556 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3954005bd0 con 0x7f396c063ac0 2023-12-24T19:58:46.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f3971587700 1 -- 172.21.15.61:0/2277978556 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c0c42e0 con 0x7f396c063ac0 2023-12-24T19:58:46.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f3962ffd700 1 -- 172.21.15.61:0/2277978556 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540070d0 con 0x7f396c063ac0 2023-12-24T19:58:46.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.260+0000 7f3971587700 1 -- 172.21.15.61:0/2277978556 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c0c48a0 con 0x7f396c063ac0 2023-12-24T19:58:46.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.261+0000 7f3971587700 1 -- 172.21.15.61:0/2277978556 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c04c3c0 con 0x7f396c063ac0 2023-12-24T19:58:46.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.262+0000 7f3962ffd700 1 -- 172.21.15.61:0/2277978556 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3954007480 con 0x7f396c063ac0 2023-12-24T19:58:46.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.262+0000 7f3962ffd700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f394c066f30 0x7f394c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:46.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.262+0000 7f3962ffd700 1 -- 172.21.15.61:0/2277978556 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3954083890 con 0x7f396c063ac0 2023-12-24T19:58:46.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.262+0000 7f396a7fc700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f394c066f30 0x7f394c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:46.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.263+0000 7f396a7fc700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f394c066f30 0x7f394c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f396c157030 tx=0x7f395c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:46.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.266+0000 7f3962ffd700 1 -- 172.21.15.61:0/2277978556 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3954050b00 con 0x7f396c063ac0 2023-12-24T19:58:46.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.510+0000 7f3971587700 1 -- 172.21.15.61:0/2277978556 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f396c0c4ac0 con 0x7f396c063ac0 2023-12-24T19:58:46.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.511+0000 7f3962ffd700 1 -- 172.21.15.61:0/2277978556 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f3954017020 con 0x7f396c063ac0 2023-12-24T19:58:46.511 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:46.511 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1254159834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1254159834},{"type":"v1","addr":"172.21.15.133:6835","nonce":1254159834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4078121613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4078121613},{"type":"v1","addr":"172.21.15.133:6837","nonce":4078121613}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/4252611526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":4252611526},{"type":"v1","addr":"172.21.15.61:6834","nonce":4252611526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:58:36.018348+0000","modified":"2023-12-24T19:58:39.583985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.61:6835/3976042512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3976042512},{"type":"v1","addr":"172.21.15.61:6835","nonce":3976042512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T19:58:46.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 -- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f394c066f30 msgr2=0x7f394c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:46.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f394c066f30 0x7f394c0693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f396c157030 tx=0x7f395c0091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:46.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 -- 172.21.15.61:0/2277978556 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f396c063ac0 msgr2=0x7f396c0c4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:46.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f396c063ac0 0x7f396c0c4dc0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f395400c560 tx=0x7f3954007f70 comp rx=0 tx=0).stop 2023-12-24T19:58:46.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 -- 172.21.15.61:0/2277978556 shutdown_connections 2023-12-24T19:58:46.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f394c066f30 0x7f394c0693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:46.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f396c157730 0x7f396c0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:46.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f396c063ac0 0x7f396c0c4dc0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:46.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 --2- 172.21.15.61:0/2277978556 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f396c0c94b0 0x7f396c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:46.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 -- 172.21.15.61:0/2277978556 >> 172.21.15.61:0/2277978556 conn(0x7f396c0cceb0 msgr2=0x7f396c156670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:46.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 -- 172.21.15.61:0/2277978556 shutdown_connections 2023-12-24T19:58:46.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:46.513+0000 7f3971587700 1 -- 172.21.15.61:0/2277978556 wait complete. 2023-12-24T19:58:46.514 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 26 2023-12-24T19:58:46.525 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-24T19:58:46.666 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":5274,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.089416878,"mdsmap_epoch":26,"osdmap_epoch":45,"osdmap_epoch_barrier":45,"uptime":21.472987034999999} 2023-12-24T19:58:46.666 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 5274, "mdsmap_epoch": 26, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "rank_uptime": 10.089416878, "state": "up:active", "uptime": 21.472987035, "want_state": "up:active", "whoami": 0 } 2023-12-24T19:58:46.667 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-24T19:58:46.803 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_mon_report_interval":"5"} 2023-12-24T19:58:46.803 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-24T19:58:46.804 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-12-24T19:58:46.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:46.804 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-12-24T19:58:48.357 INFO:teuthology.orchestra.run.smithi061.stderr:265+0 records in 2023-12-24T19:58:48.357 INFO:teuthology.orchestra.run.smithi061.stderr:265+0 records out 2023-12-24T19:58:48.357 INFO:teuthology.orchestra.run.smithi061.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.52877 s, 182 MB/s 2023-12-24T19:58:48.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:48.358 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-12-24T19:58:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:292+0 records in 2023-12-24T19:58:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:292+0 records out 2023-12-24T19:58:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.66528 s, 184 MB/s 2023-12-24T19:58:50.044 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-24T19:58:50.044 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T19:58:50.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.164+0000 7f151b871700 1 Processor -- start 2023-12-24T19:58:50.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.165+0000 7f151b871700 1 -- start start 2023-12-24T19:58:50.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.165+0000 7f151b871700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15140b2660 0x7f151415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:50.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.165+0000 7f151b871700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 0x7f15140b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.165+0000 7f151b871700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15140b2eb0 con 0x7f151415bb60 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.165+0000 7f151b871700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15140afc20 con 0x7f15140b2660 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.165+0000 7f151b871700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140b2bd0 con 0x7f151415c470 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1519e0e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 0x7f15140b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1518e0c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15140b2660 0x7f151415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f151960d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f151415bb60 0x7f1514098560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:51008/0 (socket says 172.21.15.61:51008) 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1519e0e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 0x7f15140b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:38348/0 (socket says 172.21.15.61:38348) 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f151960d700 1 -- 172.21.15.61:0/754816542 learned_addr learned my addr 172.21.15.61:0/754816542 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1507fff700 1 -- 172.21.15.61:0/754816542 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056527186 0 0) 0x7f15140b2eb0 con 0x7f151415bb60 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1507fff700 1 -- 172.21.15.61:0/754816542 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1500003570 con 0x7f151415bb60 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1519e0e700 1 -- 172.21.15.61:0/754816542 >> v2:172.21.15.133:3300/0 conn(0x7f15140b2660 msgr2=0x7f151415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1519e0e700 1 --2- 172.21.15.61:0/754816542 >> v2:172.21.15.133:3300/0 conn(0x7f15140b2660 0x7f151415bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1519e0e700 1 -- 172.21.15.61:0/754816542 >> v1:172.21.15.133:6789/0 conn(0x7f151415bb60 legacy=0x7f1514098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1519e0e700 1 -- 172.21.15.61:0/754816542 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140afe10 con 0x7f151415c470 2023-12-24T19:58:50.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1518e0c700 1 --2- 172.21.15.61:0/754816542 >> v2:172.21.15.133:3300/0 conn(0x7f15140b2660 0x7f151415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1519e0e700 1 --2- 172.21.15.61:0/754816542 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 0x7f15140b08f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f150c009e60 tx=0x7f150c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19d73d8d1cb78f90 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1507fff700 1 -- 172.21.15.61:0/754816542 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00e070 con 0x7f151415c470 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1507fff700 1 -- 172.21.15.61:0/754816542 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c00bab0 con 0x7f151415c470 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.166+0000 7f1507fff700 1 -- 172.21.15.61:0/754816542 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c00be70 con 0x7f151415c470 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.167+0000 7f151b871700 1 -- 172.21.15.61:0/754816542 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 msgr2=0x7f15140b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.167+0000 7f151b871700 1 --2- 172.21.15.61:0/754816542 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 0x7f15140b08f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f150c009e60 tx=0x7f150c009780 comp rx=0 tx=0).stop 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.167+0000 7f151b871700 1 -- 172.21.15.61:0/754816542 shutdown_connections 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.167+0000 7f151b871700 1 --2- 172.21.15.61:0/754816542 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 0x7f15140b08f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.167+0000 7f151b871700 1 --2- 172.21.15.61:0/754816542 >> v2:172.21.15.133:3300/0 conn(0x7f15140b2660 0x7f151415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.167+0000 7f151b871700 1 -- 172.21.15.61:0/754816542 >> 172.21.15.61:0/754816542 conn(0x7f1514097a10 msgr2=0x7f15140ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.167+0000 7f151b871700 1 -- 172.21.15.61:0/754816542 shutdown_connections 2023-12-24T19:58:50.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.167+0000 7f151b871700 1 -- 172.21.15.61:0/754816542 wait complete. 2023-12-24T19:58:50.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.168+0000 7f151b871700 1 Processor -- start 2023-12-24T19:58:50.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.168+0000 7f151b871700 1 -- start start 2023-12-24T19:58:50.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f151b871700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15140b2660 0x7f15141555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f151b871700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f151415bb60 0x7f15140ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f151b871700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 0x7f151406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f151b871700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1514155b20 con 0x7f151415bb60 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f151b871700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151416ae80 con 0x7f15140b2660 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f151b871700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140ce790 con 0x7f151415c470 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f1518e0c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f151415bb60 0x7f15140ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f1518e0c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f151415bb60 0x7f15140ce250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:56294/0 (socket says 172.21.15.61:56294) 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f1518e0c700 1 -- 172.21.15.61:0/2419813736 learned_addr learned my addr 172.21.15.61:0/2419813736 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f1519e0e700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 0x7f151406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.169+0000 7f151960d700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15140b2660 0x7f15141555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f1518e0c700 1 -- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 msgr2=0x7f151406bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f1518e0c700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 0x7f151406bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f1518e0c700 1 -- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15140b2660 msgr2=0x7f15141555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f1518e0c700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15140b2660 0x7f15141555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:50.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f1518e0c700 1 -- 172.21.15.61:0/2419813736 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508009420 con 0x7f151415bb60 2023-12-24T19:58:50.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f1518e0c700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f151415bb60 0x7f15140ce250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f150800ecb0 tx=0x7f15080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:50.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f15057fa700 1 -- 172.21.15.61:0/2419813736 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800c920 con 0x7f151415bb60 2023-12-24T19:58:50.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f15057fa700 1 -- 172.21.15.61:0/2419813736 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150800ca80 con 0x7f151415bb60 2023-12-24T19:58:50.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f151b871700 1 -- 172.21.15.61:0/2419813736 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c009a20 con 0x7f151415bb60 2023-12-24T19:58:50.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f15057fa700 1 -- 172.21.15.61:0/2419813736 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800ce00 con 0x7f151415bb60 2023-12-24T19:58:50.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.170+0000 7f151b871700 1 -- 172.21.15.61:0/2419813736 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151416a550 con 0x7f151415bb60 2023-12-24T19:58:50.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.171+0000 7f151b871700 1 -- 172.21.15.61:0/2419813736 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151406d440 con 0x7f151415bb60 2023-12-24T19:58:50.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.171+0000 7f15057fa700 1 -- 172.21.15.61:0/2419813736 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1508013680 con 0x7f151415bb60 2023-12-24T19:58:50.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.172+0000 7f15057fa700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f14f8066f30 0x7f14f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:50.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.172+0000 7f15057fa700 1 -- 172.21.15.61:0/2419813736 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1508084860 con 0x7f151415bb60 2023-12-24T19:58:50.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.172+0000 7f151960d700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f14f8066f30 0x7f14f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:50.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.172+0000 7f151960d700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f14f8066f30 0x7f14f80693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1510005920 tx=0x7f1510009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:50.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.176+0000 7f15057fa700 1 -- 172.21.15.61:0/2419813736 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1508051ad0 con 0x7f151415bb60 2023-12-24T19:58:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.374+0000 7f151b871700 1 -- 172.21.15.61:0/2419813736 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f151416b020 con 0x7f151415bb60 2023-12-24T19:58:50.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.375+0000 7f15057fa700 1 -- 172.21.15.61:0/2419813736 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) v1 ==== 81+0+32260 (secure 0 0 0) 0x7f1508017090 con 0x7f151415bb60 2023-12-24T19:58:50.375 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 45, 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T19:58:37.555045+0000", 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T19:58:50.376 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 7, 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T19:58:50.377 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:50.378 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "16", 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:50.379 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:50.380 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:50.381 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.382 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 6, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.362437+0000", 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:50.383 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.384 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "44", 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:50.385 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:50.386 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.387 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 7, 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.922413+0000", 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:50.388 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:50.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "45", 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:50.390 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:50.391 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:50.392 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.393 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.394 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.395 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:50.396 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.397 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.399 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.400 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T19:58:50.401 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.402 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:50.403 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:50.404 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.405 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.406 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.407 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:50.408 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:50.409 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:50.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.411 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.412 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:50.413 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:50.414 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:50.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:50.417 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T19:58:50.418 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:50.419 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.420 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.421 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.422 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T19:58:50.423 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:50.424 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:50.425 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.426 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.427 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.428 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:50.429 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.430 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:50.431 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.432 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T19:58:50.433 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T19:58:50.434 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:50.435 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T19:58:50.436 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:50.437 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:50.438 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T19:58:50.439 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T19:58:50.440 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T19:58:50.441 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T19:58:50.441 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T19:58:50.441 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T19:58:50.441 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T19:58:50.441 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T19:58:50.441 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:50.441 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 -- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f14f8066f30 msgr2=0x7f14f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f14f8066f30 0x7f14f80693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1510005920 tx=0x7f1510009040 comp rx=0 tx=0).stop 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 -- 172.21.15.61:0/2419813736 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f151415bb60 msgr2=0x7f15140ce250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f151415bb60 0x7f15140ce250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f150800ecb0 tx=0x7f15080091a0 comp rx=0 tx=0).stop 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 -- 172.21.15.61:0/2419813736 shutdown_connections 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f151415c470 0x7f151406bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f14f8066f30 0x7f14f80693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15140b2660 0x7f15141555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 --2- 172.21.15.61:0/2419813736 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f151415bb60 0x7f15140ce250 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 -- 172.21.15.61:0/2419813736 >> 172.21.15.61:0/2419813736 conn(0x7f1514097a10 msgr2=0x7f15140b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 -- 172.21.15.61:0/2419813736 shutdown_connections 2023-12-24T19:58:50.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:50.377+0000 7f151b871700 1 -- 172.21.15.61:0/2419813736 wait complete. 2023-12-24T19:58:50.444 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T19:58:50.615 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T19:58:50.615+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-24T19:58:55.445 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T19:58:55.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.580+0000 7f96b5a10700 1 Processor -- start 2023-12-24T19:58:55.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.580+0000 7f96b5a10700 1 -- start start 2023-12-24T19:58:55.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96b5a10700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f96b0159fe0 0x7f96b00cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:55.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96b5a10700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96b00c5ee0 0x7f96b00cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:55.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96b5a10700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b00af880 con 0x7f96b0159c10 2023-12-24T19:58:55.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96b5a10700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00c6fc0 con 0x7f96b0159fe0 2023-12-24T19:58:55.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96b5a10700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00c63b0 con 0x7f96b00c5ee0 2023-12-24T19:58:55.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96ae7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f96b0159fe0 0x7f96b00cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:55.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96ae7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f96b0159fe0 0x7f96b00cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:56306/0 (socket says 172.21.15.61:56306) 2023-12-24T19:58:55.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96ae7fc700 1 -- 172.21.15.61:0/4037177231 learned_addr learned my addr 172.21.15.61:0/4037177231 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:55.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96af7fe700 1 --2- 172.21.15.61:0/4037177231 >> v2:172.21.15.133:3300/0 conn(0x7f96b00c5ee0 0x7f96b00cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96ae7fc700 1 -- 172.21.15.61:0/4037177231 >> v2:172.21.15.133:3300/0 conn(0x7f96b00c5ee0 msgr2=0x7f96b00cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96ae7fc700 1 --2- 172.21.15.61:0/4037177231 >> v2:172.21.15.133:3300/0 conn(0x7f96b00c5ee0 0x7f96b00cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96ae7fc700 1 -- 172.21.15.61:0/4037177231 >> v1:172.21.15.133:6789/0 conn(0x7f96b0159c10 legacy=0x7f96b00c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96ae7fc700 1 -- 172.21.15.61:0/4037177231 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00c6690 con 0x7f96b0159fe0 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96af7fe700 1 --2- 172.21.15.61:0/4037177231 >> v2:172.21.15.133:3300/0 conn(0x7f96b00c5ee0 0x7f96b00cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.581+0000 7f96ae7fc700 1 --2- 172.21.15.61:0/4037177231 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b0159fe0 0x7f96b00cba80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f96b00cc590 tx=0x7f96a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1c7372654f613f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96adffb700 1 -- 172.21.15.61:0/4037177231 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000b820 con 0x7f96b0159fe0 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96adffb700 1 -- 172.21.15.61:0/4037177231 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a000b980 con 0x7f96b0159fe0 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96adffb700 1 -- 172.21.15.61:0/4037177231 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a000bd20 con 0x7f96b0159fe0 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96b5a10700 1 -- 172.21.15.61:0/4037177231 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b0159fe0 msgr2=0x7f96b00cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:55.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96b5a10700 1 --2- 172.21.15.61:0/4037177231 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b0159fe0 0x7f96b00cba80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f96b00cc590 tx=0x7f96a0009250 comp rx=0 tx=0).stop 2023-12-24T19:58:55.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96b5a10700 1 -- 172.21.15.61:0/4037177231 shutdown_connections 2023-12-24T19:58:55.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96b5a10700 1 --2- 172.21.15.61:0/4037177231 >> v2:172.21.15.133:3300/0 conn(0x7f96b00c5ee0 0x7f96b00cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:55.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96b5a10700 1 --2- 172.21.15.61:0/4037177231 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b0159fe0 0x7f96b00cba80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:55.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96b5a10700 1 -- 172.21.15.61:0/4037177231 >> 172.21.15.61:0/4037177231 conn(0x7f96b006e640 msgr2=0x7f96b0067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:55.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96b5a10700 1 -- 172.21.15.61:0/4037177231 shutdown_connections 2023-12-24T19:58:55.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.582+0000 7f96b5a10700 1 -- 172.21.15.61:0/4037177231 wait complete. 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.584+0000 7f96b5a10700 1 Processor -- start 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.584+0000 7f96b5a10700 1 -- start start 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.584+0000 7f96b5a10700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b00c5ee0 0x7f96b014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.584+0000 7f96b5a10700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b0159c10 0x7f96b00b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.584+0000 7f96b5a10700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96b0159fe0 0x7f96b015e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.584+0000 7f96b5a10700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00b41b0 con 0x7f96b00c5ee0 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.584+0000 7f96b5a10700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00b4490 con 0x7f96b0159c10 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.584+0000 7f96b5a10700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00b4770 con 0x7f96b0159fe0 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.584+0000 7f96aeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b00c5ee0 0x7f96b014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96aeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b00c5ee0 0x7f96b014f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:56312/0 (socket says 172.21.15.61:56312) 2023-12-24T19:58:55.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96aeffd700 1 -- 172.21.15.61:0/1835186172 learned_addr learned my addr 172.21.15.61:0/1835186172 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96ae7fc700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b0159c10 0x7f96b00b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96af7fe700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96b0159fe0 0x7f96b015e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96aeffd700 1 -- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96b0159fe0 msgr2=0x7f96b015e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96aeffd700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96b0159fe0 0x7f96b015e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96aeffd700 1 -- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b0159c10 msgr2=0x7f96b00b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96aeffd700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b0159c10 0x7f96b00b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96aeffd700 1 -- 172.21.15.61:0/1835186172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a00094f0 con 0x7f96b00c5ee0 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96ae7fc700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b0159c10 0x7f96b00b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96aeffd700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b00c5ee0 0x7f96b014f6e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f969800c5d0 tx=0x7f9698007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96a6ffd700 1 -- 172.21.15.61:0/1835186172 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698011590 con 0x7f96b00c5ee0 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96a6ffd700 1 -- 172.21.15.61:0/1835186172 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9698011710 con 0x7f96b00c5ee0 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96a6ffd700 1 -- 172.21.15.61:0/1835186172 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698011ad0 con 0x7f96b00c5ee0 2023-12-24T19:58:55.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96b5a10700 1 -- 172.21.15.61:0/1835186172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b00b4a50 con 0x7f96b00c5ee0 2023-12-24T19:58:55.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.585+0000 7f96b5a10700 1 -- 172.21.15.61:0/1835186172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b014fc20 con 0x7f96b00c5ee0 2023-12-24T19:58:55.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.586+0000 7f96b5a10700 1 -- 172.21.15.61:0/1835186172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b00890b0 con 0x7f96b00c5ee0 2023-12-24T19:58:55.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.587+0000 7f96a6ffd700 1 -- 172.21.15.61:0/1835186172 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f969801c460 con 0x7f96b00c5ee0 2023-12-24T19:58:55.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.587+0000 7f96a6ffd700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9690066f30 0x7f96900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:55.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.587+0000 7f96a6ffd700 1 -- 172.21.15.61:0/1835186172 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f9698084370 con 0x7f96b00c5ee0 2023-12-24T19:58:55.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.588+0000 7f96ae7fc700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9690066f30 0x7f96900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:55.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.588+0000 7f96a6ffd700 1 -- 172.21.15.61:0/1835186172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7f969006eb10 con 0x7f96b00c5ee0 2023-12-24T19:58:55.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.588+0000 7f96ae7fc700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9690066f30 0x7f96900693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f96b0089d80 tx=0x7f96a0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:55.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.592+0000 7f96a6ffd700 1 -- 172.21.15.61:0/1835186172 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96980515a0 con 0x7f96b00c5ee0 2023-12-24T19:58:55.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.637+0000 7f96a6ffd700 1 -- 172.21.15.61:0/1835186172 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(49..49 src has 1..49) v4 ==== 288+0+0 (secure 0 0 0) 0x7f9698055960 con 0x7f96b00c5ee0 2023-12-24T19:58:55.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.637+0000 7f96a6ffd700 1 -- 172.21.15.61:0/1835186172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7f969006f460 con 0x7f96b00c5ee0 2023-12-24T19:58:55.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.790+0000 7f96b5a10700 1 -- 172.21.15.61:0/1835186172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f96b004c3c0 con 0x7f96b00c5ee0 2023-12-24T19:58:55.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.791+0000 7f96a6ffd700 1 -- 172.21.15.61:0/1835186172 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32778 (secure 0 0 0) 0x7f9698054bc0 con 0x7f96b00c5ee0 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 49, 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T19:58:55.636804+0000", 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T19:58:55.792 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 7, 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "luminous", 2023-12-24T19:58:55.793 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:55.794 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:55.795 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:55.796 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:55.797 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T19:58:55.798 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 6, 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.362437+0000", 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:55.799 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.800 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:55.801 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:55.802 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:58:55.803 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 7, 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.922413+0000", 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:55.804 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:55.805 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:55.806 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:55.807 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:55.807 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:55.807 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:55.807 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:55.807 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:55.807 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:55.807 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:55.807 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:55.807 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:55.807 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:55.808 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:55.808 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:55.808 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:55.808 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:55.808 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:55.809 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:55.810 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.811 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.812 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.813 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.814 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:55.815 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.816 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.817 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:55.818 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T19:58:55.819 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:58:55.820 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.821 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.822 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T19:58:55.823 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:55.824 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:55.825 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:55.826 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.828 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:55.829 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T19:58:55.830 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull", 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:55.831 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 48, 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T19:58:55.832 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.833 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T19:58:55.834 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:55.835 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:58:55.836 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.837 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T19:58:55.838 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T19:58:55.839 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.840 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.841 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:55.842 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:55.843 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.844 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.845 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:55.846 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:55.847 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.848 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.849 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.850 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T19:58:55.851 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:55.852 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.853 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:55.854 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:58:55.855 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:55.856 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T19:58:55.857 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [ 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.16", 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 5 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.38", 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 4 2023-12-24T19:58:55.858 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T19:58:55.859 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:55.860 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:55.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 -- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9690066f30 msgr2=0x7f96900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:55.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9690066f30 0x7f96900693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f96b0089d80 tx=0x7f96a0016000 comp rx=0 tx=0).stop 2023-12-24T19:58:55.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 -- 172.21.15.61:0/1835186172 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b00c5ee0 msgr2=0x7f96b014f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:55.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b00c5ee0 0x7f96b014f6e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f969800c5d0 tx=0x7f9698007f60 comp rx=0 tx=0).stop 2023-12-24T19:58:55.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 -- 172.21.15.61:0/1835186172 shutdown_connections 2023-12-24T19:58:55.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96b0159fe0 0x7f96b015e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:55.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9690066f30 0x7f96900693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:55.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96b00c5ee0 0x7f96b014f6e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:55.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 --2- 172.21.15.61:0/1835186172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b0159c10 0x7f96b00b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:55.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 -- 172.21.15.61:0/1835186172 >> 172.21.15.61:0/1835186172 conn(0x7f96b006e640 msgr2=0x7f96b015bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:55.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 -- 172.21.15.61:0/1835186172 shutdown_connections 2023-12-24T19:58:55.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:55.793+0000 7f96b5a10700 1 -- 172.21.15.61:0/1835186172 wait complete. 2023-12-24T19:58:55.863 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-24T19:58:55.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:55.864 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-12-24T19:58:55.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:58:55.957 INFO:teuthology.orchestra.run.smithi061.stderr:dd: error writing 'large_file_b': No space left on device 2023-12-24T19:58:55.958 INFO:teuthology.orchestra.run.smithi061.stderr:dd: closing output file 'large_file_b': No space left on device 2023-12-24T19:58:55.958 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T19:58:56.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.079+0000 7ff95fd7c700 1 Processor -- start 2023-12-24T19:58:56.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.079+0000 7ff95fd7c700 1 -- start start 2023-12-24T19:58:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95fd7c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff95815bb60 0x7ff958098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95fd7c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff958098aa0 0x7ff95815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95fd7c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff95815c470 0x7ff9580b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95fd7c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9580afc20 con 0x7ff95815c470 2023-12-24T19:58:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95fd7c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9580b2eb0 con 0x7ff95815bb60 2023-12-24T19:58:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95fd7c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580b2bd0 con 0x7ff958098aa0 2023-12-24T19:58:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95e319700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff95815c470 0x7ff9580b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95e319700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff95815c470 0x7ff9580b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:56324/0 (socket says 172.21.15.61:56324) 2023-12-24T19:58:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95e319700 1 -- 172.21.15.61:0/3109276305 learned_addr learned my addr 172.21.15.61:0/3109276305 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95d317700 1 --2- 172.21.15.61:0/3109276305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff958098aa0 0x7ff95815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.080+0000 7ff95db18700 1 --2- 172.21.15.61:0/3109276305 >> v2:172.21.15.133:3300/0 conn(0x7ff95815bb60 0x7ff958098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95e319700 1 -- 172.21.15.61:0/3109276305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff958098aa0 msgr2=0x7ff95815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95e319700 1 --2- 172.21.15.61:0/3109276305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff958098aa0 0x7ff95815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95e319700 1 -- 172.21.15.61:0/3109276305 >> v2:172.21.15.133:3300/0 conn(0x7ff95815bb60 msgr2=0x7ff958098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95e319700 1 --2- 172.21.15.61:0/3109276305 >> v2:172.21.15.133:3300/0 conn(0x7ff95815bb60 0x7ff958098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95e319700 1 -- 172.21.15.61:0/3109276305 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9580afe10 con 0x7ff95815c470 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95d317700 1 --2- 172.21.15.61:0/3109276305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff958098aa0 0x7ff95815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95db18700 1 --2- 172.21.15.61:0/3109276305 >> v2:172.21.15.133:3300/0 conn(0x7ff95815bb60 0x7ff958098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95e319700 1 --2- 172.21.15.61:0/3109276305 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff95815c470 0x7ff9580b08f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff95806d9b0 tx=0x7ff950009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca216de58923cae server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95cb16700 1 -- 172.21.15.61:0/3109276305 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95000e070 con 0x7ff95815c470 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95cb16700 1 -- 172.21.15.61:0/3109276305 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95000ba50 con 0x7ff95815c470 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95cb16700 1 -- 172.21.15.61:0/3109276305 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500092e0 con 0x7ff95815c470 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3109276305 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff95815c470 msgr2=0x7ff9580b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95fd7c700 1 --2- 172.21.15.61:0/3109276305 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff95815c470 0x7ff9580b08f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff95806d9b0 tx=0x7ff950009840 comp rx=0 tx=0).stop 2023-12-24T19:58:56.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3109276305 shutdown_connections 2023-12-24T19:58:56.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95fd7c700 1 --2- 172.21.15.61:0/3109276305 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff95815c470 0x7ff9580b08f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95fd7c700 1 --2- 172.21.15.61:0/3109276305 >> v2:172.21.15.133:3300/0 conn(0x7ff95815bb60 0x7ff958098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95fd7c700 1 --2- 172.21.15.61:0/3109276305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff958098aa0 0x7ff95815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.081+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3109276305 >> 172.21.15.61:0/3109276305 conn(0x7ff958097a10 msgr2=0x7ff9580ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:56.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.082+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3109276305 shutdown_connections 2023-12-24T19:58:56.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.082+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3109276305 wait complete. 2023-12-24T19:58:56.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.083+0000 7ff95fd7c700 1 Processor -- start 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.083+0000 7ff95fd7c700 1 -- start start 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.083+0000 7ff95fd7c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff958098aa0 0x7ff9580abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.083+0000 7ff95fd7c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95815bb60 0x7ff958157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.083+0000 7ff95fd7c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff95815c470 0x7ff9580c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.083+0000 7ff95fd7c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff958167d50 con 0x7ff958098aa0 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.083+0000 7ff95fd7c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580a97c0 con 0x7ff95815bb60 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.083+0000 7ff95fd7c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580ad220 con 0x7ff95815c470 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95db18700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff958098aa0 0x7ff9580abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95db18700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff958098aa0 0x7ff9580abb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:56338/0 (socket says 172.21.15.61:56338) 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95db18700 1 -- 172.21.15.61:0/3649166296 learned_addr learned my addr 172.21.15.61:0/3649166296 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95d317700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95815bb60 0x7ff958157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95e319700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff95815c470 0x7ff9580c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95db18700 1 -- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff95815c470 msgr2=0x7ff9580c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95db18700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff95815c470 0x7ff9580c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95db18700 1 -- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95815bb60 msgr2=0x7ff958157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95db18700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95815bb60 0x7ff958157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95db18700 1 -- 172.21.15.61:0/3649166296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff950009ae0 con 0x7ff958098aa0 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95db18700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff958098aa0 0x7ff9580abb70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff94800c830 tx=0x7ff948008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff94dffb700 1 -- 172.21.15.61:0/3649166296 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948005a00 con 0x7ff958098aa0 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff94dffb700 1 -- 172.21.15.61:0/3649166296 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff948005b60 con 0x7ff958098aa0 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3649166296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9580ad500 con 0x7ff958098aa0 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff94dffb700 1 -- 172.21.15.61:0/3649166296 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948011600 con 0x7ff958098aa0 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.084+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3649166296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9580a9a10 con 0x7ff958098aa0 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.085+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3649166296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95806d440 con 0x7ff958098aa0 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.086+0000 7ff94dffb700 1 -- 172.21.15.61:0/3649166296 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff9480119f0 con 0x7ff958098aa0 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.086+0000 7ff94dffb700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff93c066f30 0x7ff93c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.086+0000 7ff94dffb700 1 -- 172.21.15.61:0/3649166296 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff948084540 con 0x7ff958098aa0 2023-12-24T19:58:56.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.086+0000 7ff94dffb700 1 -- 172.21.15.61:0/3649166296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7ff93c06eb10 con 0x7ff958098aa0 2023-12-24T19:58:56.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.086+0000 7ff95d317700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff93c066f30 0x7ff93c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.087+0000 7ff95d317700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff93c066f30 0x7ff93c0693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff9580c4bc0 tx=0x7ff954008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:56.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.090+0000 7ff94dffb700 1 -- 172.21.15.61:0/3649166296 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff948051770 con 0x7ff958098aa0 2023-12-24T19:58:56.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.287+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3649166296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff9580a9c00 con 0x7ff958098aa0 2023-12-24T19:58:56.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.288+0000 7ff94dffb700 1 -- 172.21.15.61:0/3649166296 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32778 (secure 0 0 0) 0x7ff948054d90 con 0x7ff958098aa0 2023-12-24T19:58:56.289 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:56.289 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:56.289 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 49, 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T19:58:55.636804+0000", 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:56.290 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 7, 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "luminous", 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T19:58:56.291 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T19:58:56.292 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:56.293 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:56.294 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:56.295 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 6, 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.362437+0000", 2023-12-24T19:58:56.296 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T19:58:56.297 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:56.298 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:56.299 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:56.300 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.301 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 7, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.922413+0000", 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:56.302 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:58:56.303 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:56.304 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:56.305 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:58:56.306 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:56.307 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:56.308 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:56.309 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.311 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:56.312 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:56.313 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.314 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.315 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T19:58:56.316 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:58:56.317 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.318 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.319 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:56.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:56.321 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:56.322 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:56.323 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:56.324 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:56.325 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.326 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T19:58:56.327 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull", 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:56.328 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 48, 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.329 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T19:58:56.330 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.331 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.332 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:56.333 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.334 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.335 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.336 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:56.337 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:56.338 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.339 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:56.340 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:56.341 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:56.342 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:56.343 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:56.344 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.345 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:56.346 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:56.347 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T19:58:56.348 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:56.349 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:56.350 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:56.350 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T19:58:56.350 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:56.350 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.350 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.350 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:58:56.350 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:56.350 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:56.352 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:56.352 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:56.352 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:56.352 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:58:56.353 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:56.354 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:58:56.355 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T19:58:56.356 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [ 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.16", 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 5 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.357 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.38", 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 4 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T19:58:56.358 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T19:58:56.359 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T19:58:56.360 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T19:58:56.360 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T19:58:56.360 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T19:58:56.360 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T19:58:56.360 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:56.360 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:56.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff93c066f30 msgr2=0x7ff93c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff93c066f30 0x7ff93c0693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff9580c4bc0 tx=0x7ff954008040 comp rx=0 tx=0).stop 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3649166296 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff958098aa0 msgr2=0x7ff9580abb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff958098aa0 0x7ff9580abb70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff94800c830 tx=0x7ff948008040 comp rx=0 tx=0).stop 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3649166296 shutdown_connections 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff95815c470 0x7ff9580c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff93c066f30 0x7ff93c0693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff958098aa0 0x7ff9580abb70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 --2- 172.21.15.61:0/3649166296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95815bb60 0x7ff958157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3649166296 >> 172.21.15.61:0/3649166296 conn(0x7ff958097a10 msgr2=0x7ff9580ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3649166296 shutdown_connections 2023-12-24T19:58:56.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.291+0000 7ff95fd7c700 1 -- 172.21.15.61:0/3649166296 wait complete. 2023-12-24T19:58:56.363 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:58:56.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.485+0000 7fac5e7ad700 1 Processor -- start 2023-12-24T19:58:56.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.485+0000 7fac5e7ad700 1 -- start start 2023-12-24T19:58:56.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.485+0000 7fac5e7ad700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fac58068510 0x7fac580cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.485+0000 7fac5e7ad700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac580b2890 con 0x7fac58068140 2023-12-24T19:58:56.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.485+0000 7fac5e7ad700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac580cf630 con 0x7fac58159a60 2023-12-24T19:58:56.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.485+0000 7fac5e7ad700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac580b2240 con 0x7fac58068510 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac577fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fac58068510 0x7fac580cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac577fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fac58068510 0x7fac580cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:39526/0 (socket says 172.21.15.61:39526) 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac57fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fac58068140 0x7fac580b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44708/0 (socket says 172.21.15.61:44708) 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac577fe700 1 -- 172.21.15.61:0/1629270873 learned_addr learned my addr 172.21.15.61:0/1629270873 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac577fe700 1 -- 172.21.15.61:0/1629270873 >> v1:172.21.15.133:6789/0 conn(0x7fac58159a60 legacy=0x7fac58159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac577fe700 1 -- 172.21.15.61:0/1629270873 >> v1:172.21.15.61:6789/0 conn(0x7fac58068140 legacy=0x7fac580b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac577fe700 1 -- 172.21.15.61:0/1629270873 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac580b2520 con 0x7fac58068510 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac577fe700 1 --2- 172.21.15.61:0/1629270873 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 0x7fac580cefa0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fac400099b0 tx=0x7fac40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8017de1540e060 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac56ffd700 1 -- 172.21.15.61:0/1629270873 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4000b860 con 0x7fac58068510 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac56ffd700 1 -- 172.21.15.61:0/1629270873 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4000b9c0 con 0x7fac58068510 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.486+0000 7fac56ffd700 1 -- 172.21.15.61:0/1629270873 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4000bd60 con 0x7fac58068510 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.487+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1629270873 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 msgr2=0x7fac580cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.487+0000 7fac5e7ad700 1 --2- 172.21.15.61:0/1629270873 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 0x7fac580cefa0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fac400099b0 tx=0x7fac40009250 comp rx=0 tx=0).stop 2023-12-24T19:58:56.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.487+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1629270873 shutdown_connections 2023-12-24T19:58:56.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.487+0000 7fac5e7ad700 1 --2- 172.21.15.61:0/1629270873 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 0x7fac580cefa0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.487+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1629270873 >> 172.21.15.61:0/1629270873 conn(0x7fac58097a10 msgr2=0x7fac580ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:56.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.487+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1629270873 shutdown_connections 2023-12-24T19:58:56.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.487+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1629270873 wait complete. 2023-12-24T19:58:56.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.488+0000 7fac5e7ad700 1 Processor -- start 2023-12-24T19:58:56.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.489+0000 7fac5e7ad700 1 -- start start 2023-12-24T19:58:56.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac5e7ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac58068140 0x7fac58099b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac5e7ad700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 0x7fac5815a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac5e7ad700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac58159a60 0x7fac58156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac5e7ad700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5815afb0 con 0x7fac58068510 2023-12-24T19:58:56.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac5e7ad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5815b290 con 0x7fac58068140 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac5e7ad700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5815b570 con 0x7fac58159a60 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac577fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 0x7fac5815a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac577fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 0x7fac5815a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:39538/0 (socket says 172.21.15.61:39538) 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac577fe700 1 -- 172.21.15.61:0/1292931684 learned_addr learned my addr 172.21.15.61:0/1292931684 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac57fff700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac58068140 0x7fac58099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac5cd4a700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac58159a60 0x7fac58156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac577fe700 1 -- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac58159a60 msgr2=0x7fac58156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac577fe700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac58159a60 0x7fac58156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac577fe700 1 -- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac58068140 msgr2=0x7fac58099b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac577fe700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac58068140 0x7fac58099b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac577fe700 1 -- 172.21.15.61:0/1292931684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac400094f0 con 0x7fac58068510 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac577fe700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 0x7fac5815a640 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fac5806d8b0 tx=0x7fac40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac4ffff700 1 -- 172.21.15.61:0/1292931684 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40024440 con 0x7fac58068510 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac4ffff700 1 -- 172.21.15.61:0/1292931684 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac400245a0 con 0x7fac58068510 2023-12-24T19:58:56.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1292931684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac58098460 con 0x7fac58068510 2023-12-24T19:58:56.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac4ffff700 1 -- 172.21.15.61:0/1292931684 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40024920 con 0x7fac58068510 2023-12-24T19:58:56.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.490+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1292931684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5809a0d0 con 0x7fac58068510 2023-12-24T19:58:56.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.491+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1292931684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5806d440 con 0x7fac58068510 2023-12-24T19:58:56.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.492+0000 7fac4ffff700 1 -- 172.21.15.61:0/1292931684 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fac40024d50 con 0x7fac58068510 2023-12-24T19:58:56.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.492+0000 7fac4ffff700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac38066f30 0x7fac380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:56.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.492+0000 7fac4ffff700 1 -- 172.21.15.61:0/1292931684 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fac40086100 con 0x7fac58068510 2023-12-24T19:58:56.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.492+0000 7fac57fff700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac38066f30 0x7fac380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:56.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.492+0000 7fac4ffff700 1 -- 172.21.15.61:0/1292931684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7fac3806eb10 con 0x7fac58068510 2023-12-24T19:58:56.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.493+0000 7fac57fff700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac38066f30 0x7fac380693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac5815a580 tx=0x7fac48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:56.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.496+0000 7fac4ffff700 1 -- 172.21.15.61:0/1292931684 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac40053330 con 0x7fac58068510 2023-12-24T19:58:56.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.740+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1292931684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac5804c3c0 con 0x7fac58068510 2023-12-24T19:58:56.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.740+0000 7fac4ffff700 1 -- 172.21.15.61:0/1292931684 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4603 (secure 0 0 0) 0x7fac40015090 con 0x7fac58068510 2023-12-24T19:58:56.741 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:56.741 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1254159834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1254159834},{"type":"v1","addr":"172.21.15.133:6835","nonce":1254159834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4078121613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4078121613},{"type":"v1","addr":"172.21.15.133:6837","nonce":4078121613}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/4252611526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":4252611526},{"type":"v1","addr":"172.21.15.61:6834","nonce":4252611526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:58:36.018348+0000","modified":"2023-12-24T19:58:39.583985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.61:6835/3976042512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3976042512},{"type":"v1","addr":"172.21.15.61:6835","nonce":3976042512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T19:58:56.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac38066f30 msgr2=0x7fac380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac38066f30 0x7fac380693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac5815a580 tx=0x7fac48009040 comp rx=0 tx=0).stop 2023-12-24T19:58:56.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1292931684 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 msgr2=0x7fac5815a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:56.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 0x7fac5815a640 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fac5806d8b0 tx=0x7fac40017000 comp rx=0 tx=0).stop 2023-12-24T19:58:56.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1292931684 shutdown_connections 2023-12-24T19:58:56.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac58159a60 0x7fac58156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac38066f30 0x7fac380693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac58068140 0x7fac58099b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 --2- 172.21.15.61:0/1292931684 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac58068510 0x7fac5815a640 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:56.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1292931684 >> 172.21.15.61:0/1292931684 conn(0x7fac58097a10 msgr2=0x7fac58157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:56.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1292931684 shutdown_connections 2023-12-24T19:58:56.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:56.743+0000 7fac5e7ad700 1 -- 172.21.15.61:0/1292931684 wait complete. 2023-12-24T19:58:56.744 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 26 2023-12-24T19:58:56.757 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-24T19:58:56.898 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":5274,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.321387776000002,"mdsmap_epoch":26,"osdmap_epoch":49,"osdmap_epoch_barrier":45,"uptime":31.704959681999998} 2023-12-24T19:58:56.898 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 5274, "mdsmap_epoch": 26, "osdmap_epoch": 49, "osdmap_epoch_barrier": 45, "rank_uptime": 20.321387776, "state": "up:active", "uptime": 31.704959682, "want_state": "up:active", "whoami": 0 } 2023-12-24T19:58:56.899 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-24T19:58:56.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:56.899 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-12-24T19:58:56.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T19:58:56.917+0000 7f1757fff700 -1 client.5454 handle_client_reply no pending request on tid 14 safe is:1 2023-12-24T19:58:56.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:58:56.918 INFO:teuthology.orchestra.run.smithi061.stderr:dd: failed to open 'small_file_1': Permission denied 2023-12-24T19:58:56.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:56.918 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-24T19:58:56.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:58:56.995 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-24T19:58:57.058 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T19:58:57.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.220+0000 7ffaaedab700 1 Processor -- start 2023-12-24T19:58:57.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.220+0000 7ffaaedab700 1 -- start start 2023-12-24T19:58:57.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaaedab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa8068140 0x7ffaa80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaaedab700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa80b2890 con 0x7ffaa8068510 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaaedab700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa80cf630 con 0x7ffaa8159a60 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaaedab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80b2240 con 0x7ffaa8068140 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa7fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ffaa8068510 0x7ffaa80b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44718/0 (socket says 172.21.15.61:44718) 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa7fff700 1 -- 172.21.15.61:0/1767929850 learned_addr learned my addr 172.21.15.61:0/1767929850 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaacb47700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa8068140 0x7ffaa80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253423610 0 0) 0x7ffaa80b2890 con 0x7ffaa8068510 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa98003570 con 0x7ffaa8068510 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3922810654 0 0) 0x7ffa98003570 con 0x7ffaa8068510 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa8068140 msgr2=0x7ffaa80cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa8068140 0x7ffaa80cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 >> v1:172.21.15.133:6789/0 conn(0x7ffaa8159a60 legacy=0x7ffaa8159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:57.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa80b2520 con 0x7ffaa8068510 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7ffa94001470 con 0x7ffaa8068510 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 >> v1:172.21.15.61:6789/0 conn(0x7ffaa8068510 legacy=0x7ffaa80b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa98003a90 0x7ffa98003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa98004810 0x7ffa98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa8068140 0x7ffa980051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.221+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80b2240 con 0x7ffa98004810 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9800bb60 con 0x7ffa98003a90 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9800bd20 con 0x7ffaa8068140 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa7fff700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa98004810 0x7ffa98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaacb47700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa98003a90 0x7ffa98003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaad348700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa8068140 0x7ffa980051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa7fff700 1 -- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa8068140 msgr2=0x7ffa980051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa7fff700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa8068140 0x7ffa980051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa7fff700 1 -- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa98003a90 msgr2=0x7ffa98003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:58:57.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa7fff700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa98003a90 0x7ffa98003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa7fff700 1 -- 172.21.15.61:0/1767929850 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98003570 con 0x7ffa98004810 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa7fff700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa98004810 0x7ffa98004c80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400c3c0 tx=0x7ffa94001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3d5e427cfbb07a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400cc90 con 0x7ffa98004810 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9400cdf0 con 0x7ffa98004810 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.222+0000 7ffaa77fe700 1 -- 172.21.15.61:0/1767929850 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94005b50 con 0x7ffa98004810 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.223+0000 7ffaaedab700 1 -- 172.21.15.61:0/1767929850 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa98004810 msgr2=0x7ffa98004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.223+0000 7ffaaedab700 1 --2- 172.21.15.61:0/1767929850 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa98004810 0x7ffa98004c80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400c3c0 tx=0x7ffa94001e50 comp rx=0 tx=0).stop 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.223+0000 7ffaad348700 1 -- 172.21.15.61:0/1767929850 reap_dead start 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.223+0000 7ffaaedab700 1 -- 172.21.15.61:0/1767929850 shutdown_connections 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.223+0000 7ffaaedab700 1 -- 172.21.15.61:0/1767929850 >> 172.21.15.61:0/1767929850 conn(0x7ffaa8097a10 msgr2=0x7ffaa80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.223+0000 7ffaaedab700 1 -- 172.21.15.61:0/1767929850 shutdown_connections 2023-12-24T19:58:57.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.223+0000 7ffaaedab700 1 -- 172.21.15.61:0/1767929850 wait complete. 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.224+0000 7ffaaedab700 1 Processor -- start 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.224+0000 7ffaaedab700 1 -- start start 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaaedab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa98004810 0x7ffaa8156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaaedab700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffaa815d360 0x7ffaa815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaaedab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa815b230 0x7ffaa815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaaedab700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa815ada0 con 0x7ffaa815d360 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaaedab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa8157490 con 0x7ffa98004810 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaaedab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa815a190 con 0x7ffaa815b230 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaa7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffaa815d360 0x7ffaa815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaa7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffaa815d360 0x7ffaa815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:39554/0 (socket says 172.21.15.61:39554) 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaa7fff700 1 -- 172.21.15.61:0/3421772388 learned_addr learned my addr 172.21.15.61:0/3421772388 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaacb47700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa98004810 0x7ffaa8156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:57.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaad348700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa815b230 0x7ffaa815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaa7fff700 1 -- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa815b230 msgr2=0x7ffaa815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaa7fff700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa815b230 0x7ffaa815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaa7fff700 1 -- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa98004810 msgr2=0x7ffaa8156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaa7fff700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa98004810 0x7ffaa8156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaa7fff700 1 -- 172.21.15.61:0/3421772388 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa815a470 con 0x7ffaa815d360 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.225+0000 7ffaa7fff700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffaa815d360 0x7ffaa815d7d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800bb30 tx=0x7ffa94015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.226+0000 7ffaa4ff9700 1 -- 172.21.15.61:0/3421772388 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940070d0 con 0x7ffaa815d360 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.226+0000 7ffaa4ff9700 1 -- 172.21.15.61:0/3421772388 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94007250 con 0x7ffaa815d360 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.226+0000 7ffaa4ff9700 1 -- 172.21.15.61:0/3421772388 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94007610 con 0x7ffaa815d360 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.226+0000 7ffaaedab700 1 -- 172.21.15.61:0/3421772388 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa815a750 con 0x7ffaa815d360 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.226+0000 7ffaaedab700 1 -- 172.21.15.61:0/3421772388 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa8159e60 con 0x7ffaa815d360 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.227+0000 7ffaaedab700 1 -- 172.21.15.61:0/3421772388 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa806d440 con 0x7ffaa815d360 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.227+0000 7ffaa4ff9700 1 -- 172.21.15.61:0/3421772388 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ffa94019030 con 0x7ffaa815d360 2023-12-24T19:58:57.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.227+0000 7ffaa4ff9700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffa8c066f60 0x7ffa8c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:58:57.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.227+0000 7ffaa4ff9700 1 -- 172.21.15.61:0/3421772388 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ffa94085770 con 0x7ffaa815d360 2023-12-24T19:58:57.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.228+0000 7ffaa4ff9700 1 -- 172.21.15.61:0/3421772388 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7ffa8c06eb40 con 0x7ffaa815d360 2023-12-24T19:58:57.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.228+0000 7ffaacb47700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffa8c066f60 0x7ffa8c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:58:57.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.228+0000 7ffaacb47700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffa8c066f60 0x7ffa8c069410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c006ea0 tx=0x7ffa9c009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:58:57.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.232+0000 7ffaa4ff9700 1 -- 172.21.15.61:0/3421772388 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa940529a0 con 0x7ffaa815d360 2023-12-24T19:58:57.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.427+0000 7ffaaedab700 1 -- 172.21.15.61:0/3421772388 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ffaa815b080 con 0x7ffaa815d360 2023-12-24T19:58:57.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.428+0000 7ffaa4ff9700 1 -- 172.21.15.61:0/3421772388 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+32778 (secure 0 0 0) 0x7ffa9402b090 con 0x7ffaa815d360 2023-12-24T19:58:57.429 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:58:57.429 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:58:57.429 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 49, 2023-12-24T19:58:57.429 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T19:58:55.636804+0000", 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T19:58:57.430 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 7, 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "luminous", 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:57.431 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:57.432 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:57.434 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:57.435 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 6, 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.362437+0000", 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:57.436 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:57.437 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:57.438 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:57.439 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:57.440 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 7, 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.922413+0000", 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:58:57.441 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T19:58:57.442 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:58:57.443 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:58:57.444 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:58:57.445 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:58:57.446 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T19:58:57.447 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.448 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.449 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.450 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.451 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.452 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.453 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:57.454 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.455 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.456 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:57.457 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.458 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.459 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.460 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T19:58:57.461 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:57.462 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:57.463 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.464 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.465 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.466 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull", 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:57.467 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 48, 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.468 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.469 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.470 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.471 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:58:57.472 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.473 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T19:58:57.474 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:57.475 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.476 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.477 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.478 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.479 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T19:58:57.480 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T19:58:57.481 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:57.482 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:58:57.483 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.484 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.485 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T19:58:57.486 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:58:57.487 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:57.488 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:57.489 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T19:58:57.490 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:57.491 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:57.492 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [ 2023-12-24T19:58:57.493 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.16", 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 5 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.38", 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 4 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.494 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:58:57.495 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:58:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:58:57.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.430+0000 7ffaaedab700 1 -- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffa8c066f60 msgr2=0x7ffa8c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:57.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.430+0000 7ffaaedab700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffa8c066f60 0x7ffa8c069410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c006ea0 tx=0x7ffa9c009120 comp rx=0 tx=0).stop 2023-12-24T19:58:57.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.430+0000 7ffaaedab700 1 -- 172.21.15.61:0/3421772388 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffaa815d360 msgr2=0x7ffaa815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:58:57.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.430+0000 7ffaaedab700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffaa815d360 0x7ffaa815d7d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800bb30 tx=0x7ffa94015000 comp rx=0 tx=0).stop 2023-12-24T19:58:57.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.430+0000 7ffaaedab700 1 -- 172.21.15.61:0/3421772388 shutdown_connections 2023-12-24T19:58:57.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.430+0000 7ffaaedab700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffaa815b230 0x7ffaa815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:57.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.430+0000 7ffaaedab700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffa8c066f60 0x7ffa8c069410 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:57.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.430+0000 7ffaaedab700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa98004810 0x7ffaa8156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:57.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.430+0000 7ffaaedab700 1 --2- 172.21.15.61:0/3421772388 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffaa815d360 0x7ffaa815d7d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:58:57.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.430+0000 7ffaaedab700 1 -- 172.21.15.61:0/3421772388 >> 172.21.15.61:0/3421772388 conn(0x7ffaa8097a10 msgr2=0x7ffaa80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:58:57.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.431+0000 7ffaaedab700 1 -- 172.21.15.61:0/3421772388 shutdown_connections 2023-12-24T19:58:57.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:58:57.431+0000 7ffaaedab700 1 -- 172.21.15.61:0/3421772388 wait complete. 2023-12-24T19:58:57.499 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T19:58:58.516 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T19:58:58.515+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-12-24T19:59:02.500 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T19:59:02.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.642+0000 7f6b2fd60700 1 Processor -- start 2023-12-24T19:59:02.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.642+0000 7f6b2fd60700 1 -- start start 2023-12-24T19:59:02.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.643+0000 7f6b2fd60700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 0x7f6b2815c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:02.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.643+0000 7f6b2fd60700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6b2806b630 0x7f6b28067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:02.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.643+0000 7f6b2fd60700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2815bcd0 con 0x7f6b28067a90 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.643+0000 7f6b2fd60700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b28067ed0 con 0x7f6b2806b630 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.643+0000 7f6b2fd60700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280cafb0 con 0x7f6b2806b260 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.643+0000 7f6b2d2fb700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6b2806b630 0x7f6b28067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.643+0000 7f6b2e2fd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f6b28067a90 0x7f6b28070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44734/0 (socket says 172.21.15.61:44734) 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.643+0000 7f6b2e2fd700 1 -- 172.21.15.61:0/31556657 learned_addr learned my addr 172.21.15.61:0/31556657 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.643+0000 7f6b2dafc700 1 --2- 172.21.15.61:0/31556657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 0x7f6b2815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.644+0000 7f6b2d2fb700 1 -- 172.21.15.61:0/31556657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 msgr2=0x7f6b2815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.644+0000 7f6b2d2fb700 1 --2- 172.21.15.61:0/31556657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 0x7f6b2815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.644+0000 7f6b2d2fb700 1 -- 172.21.15.61:0/31556657 >> v1:172.21.15.61:6789/0 conn(0x7f6b28067a90 legacy=0x7f6b28070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.644+0000 7f6b2d2fb700 1 -- 172.21.15.61:0/31556657 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280683a0 con 0x7f6b2806b630 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.644+0000 7f6b2cafa700 1 -- 172.21.15.61:0/31556657 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310253775 0 0) 0x7f6b2815bcd0 con 0x7f6b28067a90 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.644+0000 7f6b2d2fb700 1 --2- 172.21.15.61:0/31556657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 0x7f6b28067550 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6b240098e0 tx=0x7f6b240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2b405efc7195fb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.644+0000 7f6b2cafa700 1 -- 172.21.15.61:0/31556657 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b24009e80 con 0x7f6b2806b630 2023-12-24T19:59:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.644+0000 7f6b2cafa700 1 -- 172.21.15.61:0/31556657 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2400b860 con 0x7f6b2806b630 2023-12-24T19:59:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.644+0000 7f6b2cafa700 1 -- 172.21.15.61:0/31556657 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2400bbe0 con 0x7f6b2806b630 2023-12-24T19:59:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.645+0000 7f6b2fd60700 1 -- 172.21.15.61:0/31556657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 msgr2=0x7f6b28067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.645+0000 7f6b2fd60700 1 --2- 172.21.15.61:0/31556657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 0x7f6b28067550 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6b240098e0 tx=0x7f6b240091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.645+0000 7f6b2fd60700 1 -- 172.21.15.61:0/31556657 shutdown_connections 2023-12-24T19:59:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.645+0000 7f6b2fd60700 1 --2- 172.21.15.61:0/31556657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 0x7f6b2815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.645+0000 7f6b2fd60700 1 --2- 172.21.15.61:0/31556657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 0x7f6b28067550 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.645+0000 7f6b2fd60700 1 -- 172.21.15.61:0/31556657 >> 172.21.15.61:0/31556657 conn(0x7f6b280ca200 msgr2=0x7f6b280ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.645+0000 7f6b2fd60700 1 -- 172.21.15.61:0/31556657 shutdown_connections 2023-12-24T19:59:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.645+0000 7f6b2fd60700 1 -- 172.21.15.61:0/31556657 wait complete. 2023-12-24T19:59:02.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.646+0000 7f6b2fd60700 1 Processor -- start 2023-12-24T19:59:02.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.646+0000 7f6b2fd60700 1 -- start start 2023-12-24T19:59:02.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2fd60700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b28067a90 0x7f6b28158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:02.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2fd60700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 0x7f6b2816a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:02.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2fd60700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 0x7f6b280c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:02.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2fd60700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28159240 con 0x7f6b2806b630 2023-12-24T19:59:02.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2fd60700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2816acb0 con 0x7f6b28067a90 2023-12-24T19:59:02.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2fd60700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28158630 con 0x7f6b2806b260 2023-12-24T19:59:02.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2e2fd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 0x7f6b280c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:02.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2e2fd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 0x7f6b280c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:39558/0 (socket says 172.21.15.61:39558) 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2e2fd700 1 -- 172.21.15.61:0/3057651499 learned_addr learned my addr 172.21.15.61:0/3057651499 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2d2fb700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 0x7f6b2816a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2dafc700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b28067a90 0x7f6b28158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2e2fd700 1 -- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 msgr2=0x7f6b2816a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2e2fd700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 0x7f6b2816a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2e2fd700 1 -- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b28067a90 msgr2=0x7f6b28158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2e2fd700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b28067a90 0x7f6b28158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2e2fd700 1 -- 172.21.15.61:0/3057651499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b24009420 con 0x7f6b2806b630 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2dafc700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b28067a90 0x7f6b28158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2d2fb700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 0x7f6b2816a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2e2fd700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 0x7f6b280c8d40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000cbf0 tx=0x7f6b200019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b1dffb700 1 -- 172.21.15.61:0/3057651499 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000a9c0 con 0x7f6b2806b630 2023-12-24T19:59:02.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b1dffb700 1 -- 172.21.15.61:0/3057651499 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2000ab20 con 0x7f6b2806b630 2023-12-24T19:59:02.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.647+0000 7f6b2fd60700 1 -- 172.21.15.61:0/3057651499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b28158910 con 0x7f6b2806b630 2023-12-24T19:59:02.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.648+0000 7f6b1dffb700 1 -- 172.21.15.61:0/3057651499 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b200070f0 con 0x7f6b2806b630 2023-12-24T19:59:02.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.648+0000 7f6b2fd60700 1 -- 172.21.15.61:0/3057651499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b28158ed0 con 0x7f6b2806b630 2023-12-24T19:59:02.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.649+0000 7f6b2fd60700 1 -- 172.21.15.61:0/3057651499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b281593b0 con 0x7f6b2806b630 2023-12-24T19:59:02.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.649+0000 7f6b1dffb700 1 -- 172.21.15.61:0/3057651499 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6b20007520 con 0x7f6b2806b630 2023-12-24T19:59:02.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.649+0000 7f6b1dffb700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b0c066f30 0x7f6b0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:02.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.649+0000 7f6b1dffb700 1 -- 172.21.15.61:0/3057651499 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6b20084950 con 0x7f6b2806b630 2023-12-24T19:59:02.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.650+0000 7f6b1dffb700 1 -- 172.21.15.61:0/3057651499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=51}) v3 -- 0x7f6b0c06eb10 con 0x7f6b2806b630 2023-12-24T19:59:02.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.650+0000 7f6b2dafc700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b0c066f30 0x7f6b0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:02.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.650+0000 7f6b2dafc700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b0c066f30 0x7f6b0c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b18006fd0 tx=0x7f6b18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:02.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.654+0000 7f6b1dffb700 1 -- 172.21.15.61:0/3057651499 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b20051c00 con 0x7f6b2806b630 2023-12-24T19:59:02.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.849+0000 7f6b2fd60700 1 -- 172.21.15.61:0/3057651499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6b2804c3c0 con 0x7f6b2806b630 2023-12-24T19:59:02.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.850+0000 7f6b1dffb700 1 -- 172.21.15.61:0/3057651499 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) v1 ==== 81+0+32698 (secure 0 0 0) 0x7f6b20055220 con 0x7f6b2806b630 2023-12-24T19:59:02.851 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:02.851 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:59:02.851 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 50, 2023-12-24T19:59:02.851 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:59:02.851 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T19:59:02.851 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T19:59:01.657299+0000", 2023-12-24T19:59:02.851 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T19:59:02.851 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T19:59:02.852 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T19:59:02.853 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 7, 2023-12-24T19:59:02.853 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T19:59:02.853 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T19:59:02.853 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "luminous", 2023-12-24T19:59:02.853 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T19:59:02.853 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T19:59:02.853 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.853 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T19:59:02.853 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T19:59:02.853 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:59:02.854 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:59:02.855 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:59:02.856 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:59:02.856 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.856 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:59:02.856 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:59:02.856 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:59:02.856 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:59:02.856 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:59:02.856 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:59:02.857 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:59:02.857 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:59:02.857 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:59:02.857 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:59:02.857 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:59:02.857 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:59:02.857 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:59:02.857 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:59:02.857 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:59:02.858 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:59:02.858 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:59:02.858 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:59:02.858 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:59:02.858 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:59:02.858 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:59:02.858 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:59:02.858 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:59:02.859 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.860 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 6, 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.362437+0000", 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:59:02.861 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:59:02.862 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:59:02.863 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:59:02.864 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:59:02.865 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 7, 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T19:59:02.866 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.922413+0000", 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:59:02.867 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.868 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "46", 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:59:02.869 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:59:02.870 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:59:02.870 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:59:02.870 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:59:02.870 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:59:02.870 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:59:02.870 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:59:02.870 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:59:02.870 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:59:02.870 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:59:02.870 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:59:02.871 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.872 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.873 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:02.873 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T19:59:02.873 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.873 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:59:02.873 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:02.873 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:02.873 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:02.873 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:02.873 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:02.874 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:02.875 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.876 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.876 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.876 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T19:59:02.876 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:02.876 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.876 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.876 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.876 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:02.876 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.877 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T19:59:02.878 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:02.879 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.880 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.881 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.882 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.883 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:02.884 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:02.885 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:02.885 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.885 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.885 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.885 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:59:02.885 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:02.885 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:02.885 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:02.885 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:02.885 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:02.892 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T19:59:02.893 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:02.894 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.895 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.896 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.897 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:59:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 48, 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T19:59:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T19:59:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:02.903 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.904 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:02.905 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.906 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.907 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.908 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.909 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.919 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:02.920 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.921 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:59:02.922 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:02.923 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:59:02.924 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:02.925 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:02.926 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [ 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.16", 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 5 2023-12-24T19:59:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.38", 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 4 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T19:59:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T19:59:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T19:59:02.930 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T19:59:02.930 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T19:59:02.930 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T19:59:02.930 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T19:59:02.930 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T19:59:02.930 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:02.930 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:59:02.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 -- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b0c066f30 msgr2=0x7f6b0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b0c066f30 0x7f6b0c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b18006fd0 tx=0x7f6b18008040 comp rx=0 tx=0).stop 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 -- 172.21.15.61:0/3057651499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 msgr2=0x7f6b280c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 0x7f6b280c8d40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000cbf0 tx=0x7f6b200019b0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 -- 172.21.15.61:0/3057651499 shutdown_connections 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b0c066f30 0x7f6b0c0693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b2806b630 0x7f6b280c8d40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b28067a90 0x7f6b28158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 --2- 172.21.15.61:0/3057651499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b2806b260 0x7f6b2816a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 -- 172.21.15.61:0/3057651499 >> 172.21.15.61:0/3057651499 conn(0x7f6b280ca200 msgr2=0x7f6b280cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 -- 172.21.15.61:0/3057651499 shutdown_connections 2023-12-24T19:59:02.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:02.852+0000 7f6b2fd60700 1 -- 172.21.15.61:0/3057651499 wait complete. 2023-12-24T19:59:02.933 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T19:59:03.517 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T19:59:03.517+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-12-24T19:59:05.639 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:59:05.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:59:07.934 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T19:59:08.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.072+0000 7efd9d1b8700 1 Processor -- start 2023-12-24T19:59:08.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.072+0000 7efd9d1b8700 1 -- start start 2023-12-24T19:59:08.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9d1b8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd9806b260 0x7efd9815c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9d1b8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7efd98070640 0x7efd98070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9d1b8700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9815bcd0 con 0x7efd9806b630 2023-12-24T19:59:08.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9d1b8700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd980cafb0 con 0x7efd98070640 2023-12-24T19:59:08.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9d1b8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd98070f80 con 0x7efd9806b260 2023-12-24T19:59:08.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9759e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7efd98070640 0x7efd98070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9659c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7efd9806b630 0x7efd98067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45826/0 (socket says 172.21.15.61:45826) 2023-12-24T19:59:08.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9659c700 1 -- 172.21.15.61:0/3300471392 learned_addr learned my addr 172.21.15.61:0/3300471392 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:08.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd96d9d700 1 --2- 172.21.15.61:0/3300471392 >> v2:172.21.15.133:3300/0 conn(0x7efd9806b260 0x7efd9815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9759e700 1 -- 172.21.15.61:0/3300471392 >> v2:172.21.15.133:3300/0 conn(0x7efd9806b260 msgr2=0x7efd9815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9759e700 1 --2- 172.21.15.61:0/3300471392 >> v2:172.21.15.133:3300/0 conn(0x7efd9806b260 0x7efd9815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9759e700 1 -- 172.21.15.61:0/3300471392 >> v1:172.21.15.61:6789/0 conn(0x7efd9806b630 legacy=0x7efd98067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd9759e700 1 -- 172.21.15.61:0/3300471392 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd980683a0 con 0x7efd98070640 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd96d9d700 1 --2- 172.21.15.61:0/3300471392 >> v2:172.21.15.133:3300/0 conn(0x7efd9806b260 0x7efd9815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.073+0000 7efd95d9b700 1 -- 172.21.15.61:0/3300471392 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112141924 0 0) 0x7efd9815bcd0 con 0x7efd9806b630 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd9759e700 1 --2- 172.21.15.61:0/3300471392 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 0x7efd98070a40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efd9806d0e0 tx=0x7efd90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f274b22e4ced17c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd95d9b700 1 -- 172.21.15.61:0/3300471392 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9000e070 con 0x7efd98070640 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd95d9b700 1 -- 172.21.15.61:0/3300471392 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9000bc30 con 0x7efd98070640 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd95d9b700 1 -- 172.21.15.61:0/3300471392 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90012430 con 0x7efd98070640 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd9d1b8700 1 -- 172.21.15.61:0/3300471392 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 msgr2=0x7efd98070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd9d1b8700 1 --2- 172.21.15.61:0/3300471392 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 0x7efd98070a40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efd9806d0e0 tx=0x7efd90009780 comp rx=0 tx=0).stop 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd9d1b8700 1 -- 172.21.15.61:0/3300471392 shutdown_connections 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd9d1b8700 1 --2- 172.21.15.61:0/3300471392 >> v2:172.21.15.133:3300/0 conn(0x7efd9806b260 0x7efd9815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd9d1b8700 1 --2- 172.21.15.61:0/3300471392 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 0x7efd98070a40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd9d1b8700 1 -- 172.21.15.61:0/3300471392 >> 172.21.15.61:0/3300471392 conn(0x7efd980ca200 msgr2=0x7efd980ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:08.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd9d1b8700 1 -- 172.21.15.61:0/3300471392 shutdown_connections 2023-12-24T19:59:08.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.074+0000 7efd9d1b8700 1 -- 172.21.15.61:0/3300471392 wait complete. 2023-12-24T19:59:08.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.076+0000 7efd9d1b8700 1 Processor -- start 2023-12-24T19:59:08.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.076+0000 7efd9d1b8700 1 -- start start 2023-12-24T19:59:08.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.076+0000 7efd9d1b8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd9806b260 0x7efd9814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.076+0000 7efd9d1b8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd9806b630 0x7efd980a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.076+0000 7efd9d1b8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 0x7efd980b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.076+0000 7efd9d1b8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd980a84a0 con 0x7efd98070640 2023-12-24T19:59:08.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9d1b8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd981500a0 con 0x7efd9806b260 2023-12-24T19:59:08.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9d1b8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9815a580 con 0x7efd9806b630 2023-12-24T19:59:08.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9759e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 0x7efd980b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9759e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 0x7efd980b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57658/0 (socket says 172.21.15.61:57658) 2023-12-24T19:59:08.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9759e700 1 -- 172.21.15.61:0/2081288119 learned_addr learned my addr 172.21.15.61:0/2081288119 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:08.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd96d9d700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd9806b260 0x7efd9814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9759e700 1 -- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd9806b630 msgr2=0x7efd980a77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9759e700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd9806b630 0x7efd980a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9759e700 1 -- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd9806b260 msgr2=0x7efd9814fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9759e700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd9806b260 0x7efd9814fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9759e700 1 -- 172.21.15.61:0/2081288119 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90009a20 con 0x7efd98070640 2023-12-24T19:59:08.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd96d9d700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd9806b260 0x7efd9814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:08.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9759e700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 0x7efd980b2890 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efd9000b6c0 tx=0x7efd90019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:08.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd7effd700 1 -- 172.21.15.61:0/2081288119 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90012e60 con 0x7efd98070640 2023-12-24T19:59:08.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd7effd700 1 -- 172.21.15.61:0/2081288119 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9001d630 con 0x7efd98070640 2023-12-24T19:59:08.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9d1b8700 1 -- 172.21.15.61:0/2081288119 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd980a81c0 con 0x7efd98070640 2023-12-24T19:59:08.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd7effd700 1 -- 172.21.15.61:0/2081288119 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9001d9d0 con 0x7efd98070640 2023-12-24T19:59:08.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.077+0000 7efd9d1b8700 1 -- 172.21.15.61:0/2081288119 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd98159d80 con 0x7efd98070640 2023-12-24T19:59:08.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.078+0000 7efd9d1b8700 1 -- 172.21.15.61:0/2081288119 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9804c3c0 con 0x7efd98070640 2023-12-24T19:59:08.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.079+0000 7efd7effd700 1 -- 172.21.15.61:0/2081288119 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7efd90024070 con 0x7efd98070640 2023-12-24T19:59:08.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.079+0000 7efd7effd700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd84066f30 0x7efd840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.079+0000 7efd7effd700 1 -- 172.21.15.61:0/2081288119 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7efd90086e00 con 0x7efd98070640 2023-12-24T19:59:08.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.079+0000 7efd96d9d700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd84066f30 0x7efd840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.080+0000 7efd96d9d700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd84066f30 0x7efd840693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efd8c006f00 tx=0x7efd8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:08.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.084+0000 7efd7effd700 1 -- 172.21.15.61:0/2081288119 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd90053f90 con 0x7efd98070640 2023-12-24T19:59:08.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.281+0000 7efd9d1b8700 1 -- 172.21.15.61:0/2081288119 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7efd9806f110 con 0x7efd98070640 2023-12-24T19:59:08.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.282+0000 7efd7effd700 1 -- 172.21.15.61:0/2081288119 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+32635 (secure 0 0 0) 0x7efd900575b0 con 0x7efd98070640 2023-12-24T19:59:08.282 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 51, 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T19:59:04.664661+0000", 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T19:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 7, 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "luminous", 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "51", 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T19:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 6, 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.362437+0000", 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:59:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:59:08.291 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "51", 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:59:08.292 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:59:08.293 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:59:08.294 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 7, 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.922413+0000", 2023-12-24T19:59:08.295 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T19:59:08.296 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "51", 2023-12-24T19:59:08.297 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:59:08.298 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:59:08.299 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:59:08.300 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:59:08.300 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:59:08.300 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:59:08.300 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:59:08.300 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:59:08.300 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:59:08.300 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:59:08.300 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:59:08.300 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.301 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.302 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.303 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.304 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.305 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.311 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.312 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.313 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.314 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T19:59:08.315 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.316 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.317 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T19:59:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.322 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.323 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 48, 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.324 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.325 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T19:59:08.326 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.327 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.328 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.329 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T19:59:08.330 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.331 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.332 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.333 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.334 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T19:59:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T19:59:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:59:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.345 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:59:08.346 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.347 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:59:08.348 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.349 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [ 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.16", 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 5 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.350 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.38", 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 4 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T19:59:08.351 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T19:59:08.352 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T19:59:08.353 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T19:59:08.353 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T19:59:08.353 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.353 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:59:08.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 -- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd84066f30 msgr2=0x7efd840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd84066f30 0x7efd840693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efd8c006f00 tx=0x7efd8c008040 comp rx=0 tx=0).stop 2023-12-24T19:59:08.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 -- 172.21.15.61:0/2081288119 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 msgr2=0x7efd980b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 0x7efd980b2890 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7efd9000b6c0 tx=0x7efd90019000 comp rx=0 tx=0).stop 2023-12-24T19:59:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 -- 172.21.15.61:0/2081288119 shutdown_connections 2023-12-24T19:59:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd84066f30 0x7efd840693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd98070640 0x7efd980b2890 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd9806b260 0x7efd9814fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 --2- 172.21.15.61:0/2081288119 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd9806b630 0x7efd980a77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 -- 172.21.15.61:0/2081288119 >> 172.21.15.61:0/2081288119 conn(0x7efd980ca200 msgr2=0x7efd980cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 -- 172.21.15.61:0/2081288119 shutdown_connections 2023-12-24T19:59:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.284+0000 7efd9d1b8700 1 -- 172.21.15.61:0/2081288119 wait complete. 2023-12-24T19:59:08.356 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-24T19:59:08.356 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T19:59:08.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.478+0000 7f46aee1d700 1 Processor -- start 2023-12-24T19:59:08.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.478+0000 7f46aee1d700 1 -- start start 2023-12-24T19:59:08.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46aee1d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f46a815bb60 0x7f46a8098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46aee1d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a8098aa0 0x7f46a815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46aee1d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a80b2eb0 con 0x7f46a815c470 2023-12-24T19:59:08.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46aee1d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a80afc20 con 0x7f46a815bb60 2023-12-24T19:59:08.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46aee1d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80b2bd0 con 0x7f46a8098aa0 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46acbb9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f46a815bb60 0x7f46a8098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46ad3ba700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f46a815c470 0x7f46a80b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45836/0 (socket says 172.21.15.61:45836) 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46ad3ba700 1 -- 172.21.15.61:0/449266841 learned_addr learned my addr 172.21.15.61:0/449266841 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46a7fff700 1 --2- 172.21.15.61:0/449266841 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a8098aa0 0x7f46a815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46a77fe700 1 -- 172.21.15.61:0/449266841 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216612063 0 0) 0x7f46a80b2eb0 con 0x7f46a815c470 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.479+0000 7f46a77fe700 1 -- 172.21.15.61:0/449266841 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4698003570 con 0x7f46a815c470 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46acbb9700 1 -- 172.21.15.61:0/449266841 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a8098aa0 msgr2=0x7f46a815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46acbb9700 1 --2- 172.21.15.61:0/449266841 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a8098aa0 0x7f46a815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46acbb9700 1 -- 172.21.15.61:0/449266841 >> v1:172.21.15.61:6789/0 conn(0x7f46a815c470 legacy=0x7f46a80b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46acbb9700 1 -- 172.21.15.61:0/449266841 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80afe10 con 0x7f46a815bb60 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46a7fff700 1 --2- 172.21.15.61:0/449266841 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a8098aa0 0x7f46a815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46acbb9700 1 --2- 172.21.15.61:0/449266841 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a815bb60 0x7f46a8098560 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f469c0098d0 tx=0x7f469c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68893a9770a829c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:08.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46a77fe700 1 -- 172.21.15.61:0/449266841 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c005c10 con 0x7f46a815bb60 2023-12-24T19:59:08.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46a77fe700 1 -- 172.21.15.61:0/449266841 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c005d70 con 0x7f46a815bb60 2023-12-24T19:59:08.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46a77fe700 1 -- 172.21.15.61:0/449266841 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c006280 con 0x7f46a815bb60 2023-12-24T19:59:08.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46aee1d700 1 -- 172.21.15.61:0/449266841 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a815bb60 msgr2=0x7f46a8098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46aee1d700 1 --2- 172.21.15.61:0/449266841 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a815bb60 0x7f46a8098560 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f469c0098d0 tx=0x7f469c009120 comp rx=0 tx=0).stop 2023-12-24T19:59:08.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.480+0000 7f46aee1d700 1 -- 172.21.15.61:0/449266841 shutdown_connections 2023-12-24T19:59:08.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.481+0000 7f46aee1d700 1 --2- 172.21.15.61:0/449266841 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a815bb60 0x7f46a8098560 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.481+0000 7f46aee1d700 1 --2- 172.21.15.61:0/449266841 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a8098aa0 0x7f46a815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.481+0000 7f46aee1d700 1 -- 172.21.15.61:0/449266841 >> 172.21.15.61:0/449266841 conn(0x7f46a8097a10 msgr2=0x7f46a80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:08.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.481+0000 7f46aee1d700 1 -- 172.21.15.61:0/449266841 shutdown_connections 2023-12-24T19:59:08.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.481+0000 7f46aee1d700 1 -- 172.21.15.61:0/449266841 wait complete. 2023-12-24T19:59:08.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.482+0000 7f46aee1d700 1 Processor -- start 2023-12-24T19:59:08.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.482+0000 7f46aee1d700 1 -- start start 2023-12-24T19:59:08.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46aee1d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a8098aa0 0x7f46a8151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46aee1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46a815bb60 0x7f46a8099920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46aee1d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a815c470 0x7f46a809b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46aee1d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a809c540 con 0x7f46a8098aa0 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46aee1d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a8067f10 con 0x7f46a815bb60 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46aee1d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a8068a30 con 0x7f46a815c470 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46acbb9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a8098aa0 0x7f46a8151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46acbb9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a8098aa0 0x7f46a8151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57680/0 (socket says 172.21.15.61:57680) 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46acbb9700 1 -- 172.21.15.61:0/4034120621 learned_addr learned my addr 172.21.15.61:0/4034120621 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46ad3ba700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a815c470 0x7f46a809b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46a7fff700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46a815bb60 0x7f46a8099920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46acbb9700 1 -- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a815c470 msgr2=0x7f46a809b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46acbb9700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a815c470 0x7f46a809b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46acbb9700 1 -- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46a815bb60 msgr2=0x7f46a8099920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46acbb9700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46a815bb60 0x7f46a8099920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46acbb9700 1 -- 172.21.15.61:0/4034120621 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0093c0 con 0x7f46a8098aa0 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46ad3ba700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a815c470 0x7f46a809b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:08.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46a7fff700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46a815bb60 0x7f46a8099920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46acbb9700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a8098aa0 0x7f46a8151cd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f469c009f70 tx=0x7f469c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46a4ff9700 1 -- 172.21.15.61:0/4034120621 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c01d6b0 con 0x7f46a8098aa0 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46a4ff9700 1 -- 172.21.15.61:0/4034120621 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c01d810 con 0x7f46a8098aa0 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46aee1d700 1 -- 172.21.15.61:0/4034120621 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a8068ec0 con 0x7f46a8098aa0 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.483+0000 7f46a4ff9700 1 -- 172.21.15.61:0/4034120621 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c01dbd0 con 0x7f46a8098aa0 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.484+0000 7f46aee1d700 1 -- 172.21.15.61:0/4034120621 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a809a100 con 0x7f46a8098aa0 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.485+0000 7f46aee1d700 1 -- 172.21.15.61:0/4034120621 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a806d440 con 0x7f46a8098aa0 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.485+0000 7f46a4ff9700 1 -- 172.21.15.61:0/4034120621 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f469c01b480 con 0x7f46a8098aa0 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.485+0000 7f46a4ff9700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.485+0000 7f46a4ff9700 1 -- 172.21.15.61:0/4034120621 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f469c086590 con 0x7f46a8098aa0 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.486+0000 7f46a7fff700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.486+0000 7f46a7fff700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f468c066f30 0x7f468c0693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4694006f00 tx=0x7f4694008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:08.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.490+0000 7f46a4ff9700 1 -- 172.21.15.61:0/4034120621 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f469c0537c0 con 0x7f46a8098aa0 2023-12-24T19:59:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.690+0000 7f46aee1d700 1 -- 172.21.15.61:0/4034120621 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f46a804c3c0 con 0x7f46a8098aa0 2023-12-24T19:59:08.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.691+0000 7f46a4ff9700 1 -- 172.21.15.61:0/4034120621 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+32635 (secure 0 0 0) 0x7f469c056de0 con 0x7f46a8098aa0 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 51, 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T19:59:04.664661+0000", 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T19:59:08.692 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 7, 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "luminous", 2023-12-24T19:59:08.693 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:59:08.694 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:59:08.695 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "51", 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:59:08.696 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.697 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T19:59:08.698 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 6, 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.362437+0000", 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:59:08.699 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:59:08.700 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "51", 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:59:08.701 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:59:08.702 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:59:08.703 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 7, 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:58:34.922413+0000", 2023-12-24T19:59:08.704 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T19:59:08.705 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "51", 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T19:59:08.706 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T19:59:08.707 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T19:59:08.708 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.709 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.710 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.711 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.712 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.713 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T19:59:08.714 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.715 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.716 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.717 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.718 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.719 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.720 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.721 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.722 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.723 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.724 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.725 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.726 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.727 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.728 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.729 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 48, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.735 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.736 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.737 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.738 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.739 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T19:59:08.740 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.741 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T19:59:08.742 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.743 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.744 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.745 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T19:59:08.746 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 43, 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.747 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.748 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.749 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T19:59:08.750 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T19:59:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.755 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T19:59:08.756 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [ 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.16", 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 5 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "7.38", 2023-12-24T19:59:08.757 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 0, 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 4 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T19:59:08.758 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T19:59:08.759 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T19:59:08.760 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:08.760 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:59:08.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 -- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f468c066f30 msgr2=0x7f468c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f468c066f30 0x7f468c0693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4694006f00 tx=0x7f4694008040 comp rx=0 tx=0).stop 2023-12-24T19:59:08.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 -- 172.21.15.61:0/4034120621 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a8098aa0 msgr2=0x7f46a8151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a8098aa0 0x7f46a8151cd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f469c009f70 tx=0x7f469c016000 comp rx=0 tx=0).stop 2023-12-24T19:59:08.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 -- 172.21.15.61:0/4034120621 shutdown_connections 2023-12-24T19:59:08.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f46a815c470 0x7f46a809b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f46a8098aa0 0x7f46a8151cd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 --2- 172.21.15.61:0/4034120621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46a815bb60 0x7f46a8099920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 -- 172.21.15.61:0/4034120621 >> 172.21.15.61:0/4034120621 conn(0x7f46a8097a10 msgr2=0x7f46a80b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:08.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 -- 172.21.15.61:0/4034120621 shutdown_connections 2023-12-24T19:59:08.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.693+0000 7f46aee1d700 1 -- 172.21.15.61:0/4034120621 wait complete. 2023-12-24T19:59:08.763 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:59:08.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.885+0000 7f9e9f991700 1 Processor -- start 2023-12-24T19:59:08.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.885+0000 7f9e9f991700 1 -- start start 2023-12-24T19:59:08.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.886+0000 7f9e9f991700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e9815bb60 0x7f9e98098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.886+0000 7f9e9f991700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9e98098aa0 0x7f9e9815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.886+0000 7f9e9f991700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e980b2eb0 con 0x7f9e9815c470 2023-12-24T19:59:08.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.886+0000 7f9e9f991700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e980afc20 con 0x7f9e98098aa0 2023-12-24T19:59:08.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.886+0000 7f9e9f991700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980b2bd0 con 0x7f9e9815bb60 2023-12-24T19:59:08.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.886+0000 7f9e9cf2c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9e98098aa0 0x7f9e9815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.886+0000 7f9e9df2e700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9e9815c470 0x7f9e980b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45842/0 (socket says 172.21.15.61:45842) 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.886+0000 7f9e9df2e700 1 -- 172.21.15.61:0/951053274 learned_addr learned my addr 172.21.15.61:0/951053274 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.886+0000 7f9e9d72d700 1 --2- 172.21.15.61:0/951053274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e9815bb60 0x7f9e98098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.887+0000 7f9e8ffff700 1 -- 172.21.15.61:0/951053274 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007702309 0 0) 0x7f9e980b2eb0 con 0x7f9e9815c470 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.887+0000 7f9e8ffff700 1 -- 172.21.15.61:0/951053274 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e84003570 con 0x7f9e9815c470 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.887+0000 7f9e9cf2c700 1 -- 172.21.15.61:0/951053274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e9815bb60 msgr2=0x7f9e98098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.887+0000 7f9e9cf2c700 1 --2- 172.21.15.61:0/951053274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e9815bb60 0x7f9e98098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.887+0000 7f9e9cf2c700 1 -- 172.21.15.61:0/951053274 >> v1:172.21.15.61:6789/0 conn(0x7f9e9815c470 legacy=0x7f9e980b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.887+0000 7f9e9cf2c700 1 -- 172.21.15.61:0/951053274 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e980afe10 con 0x7f9e98098aa0 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.887+0000 7f9e9cf2c700 1 --2- 172.21.15.61:0/951053274 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e98098aa0 0x7f9e9815bf30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9e940098e0 tx=0x7f9e940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821fb526d6df61a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.887+0000 7f9e8ffff700 1 -- 172.21.15.61:0/951053274 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94011630 con 0x7f9e98098aa0 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.887+0000 7f9e8ffff700 1 -- 172.21.15.61:0/951053274 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e94011790 con 0x7f9e98098aa0 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.887+0000 7f9e8ffff700 1 -- 172.21.15.61:0/951053274 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94011b10 con 0x7f9e98098aa0 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.888+0000 7f9e9f991700 1 -- 172.21.15.61:0/951053274 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e98098aa0 msgr2=0x7f9e9815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.888+0000 7f9e9f991700 1 --2- 172.21.15.61:0/951053274 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e98098aa0 0x7f9e9815bf30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9e940098e0 tx=0x7f9e940091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.888+0000 7f9e9f991700 1 -- 172.21.15.61:0/951053274 shutdown_connections 2023-12-24T19:59:08.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.888+0000 7f9e9f991700 1 --2- 172.21.15.61:0/951053274 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e9815bb60 0x7f9e98098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.888+0000 7f9e9f991700 1 --2- 172.21.15.61:0/951053274 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e98098aa0 0x7f9e9815bf30 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.888+0000 7f9e9f991700 1 -- 172.21.15.61:0/951053274 >> 172.21.15.61:0/951053274 conn(0x7f9e98097a10 msgr2=0x7f9e980ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:08.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.888+0000 7f9e9f991700 1 -- 172.21.15.61:0/951053274 shutdown_connections 2023-12-24T19:59:08.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.888+0000 7f9e9f991700 1 -- 172.21.15.61:0/951053274 wait complete. 2023-12-24T19:59:08.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.889+0000 7f9e9f991700 1 Processor -- start 2023-12-24T19:59:08.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.889+0000 7f9e9f991700 1 -- start start 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9f991700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e98098aa0 0x7f9e98098f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9f991700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e9815bb60 0x7f9e98154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9f991700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e9815c470 0x7f9e98155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9f991700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9809a3e0 con 0x7f9e9815bb60 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9f991700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e980997d0 con 0x7f9e9815c470 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9f991700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e98099ab0 con 0x7f9e98098aa0 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9cf2c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e9815bb60 0x7f9e98154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9cf2c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e9815bb60 0x7f9e98154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57694/0 (socket says 172.21.15.61:57694) 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9cf2c700 1 -- 172.21.15.61:0/2702812723 learned_addr learned my addr 172.21.15.61:0/2702812723 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9d72d700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e98098aa0 0x7f9e98098f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9df2e700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e9815c470 0x7f9e98155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9cf2c700 1 -- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e98098aa0 msgr2=0x7f9e98098f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9cf2c700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e98098aa0 0x7f9e98098f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9cf2c700 1 -- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e9815c470 msgr2=0x7f9e98155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9cf2c700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e9815c470 0x7f9e98155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9cf2c700 1 -- 172.21.15.61:0/2702812723 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94009420 con 0x7f9e9815bb60 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9cf2c700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e9815bb60 0x7f9e98154af0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9e9806d8b0 tx=0x7f9e94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e8d7fa700 1 -- 172.21.15.61:0/2702812723 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94011b10 con 0x7f9e9815bb60 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e8d7fa700 1 -- 172.21.15.61:0/2702812723 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9401a430 con 0x7f9e9815bb60 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.890+0000 7f9e9f991700 1 -- 172.21.15.61:0/2702812723 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e98099d90 con 0x7f9e9815bb60 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.891+0000 7f9e8d7fa700 1 -- 172.21.15.61:0/2702812723 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9401a7f0 con 0x7f9e9815bb60 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.891+0000 7f9e9f991700 1 -- 172.21.15.61:0/2702812723 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e980994c0 con 0x7f9e9815bb60 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.891+0000 7f9e9f991700 1 -- 172.21.15.61:0/2702812723 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e980afa60 con 0x7f9e9815bb60 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.892+0000 7f9e8d7fa700 1 -- 172.21.15.61:0/2702812723 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9e9401aba0 con 0x7f9e9815bb60 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.892+0000 7f9e8d7fa700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e7c066f30 0x7f9e7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:08.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.892+0000 7f9e8d7fa700 1 -- 172.21.15.61:0/2702812723 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f9e94086300 con 0x7f9e9815bb60 2023-12-24T19:59:08.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.893+0000 7f9e9d72d700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e7c066f30 0x7f9e7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:08.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.893+0000 7f9e9d72d700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e7c066f30 0x7f9e7c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9e9809ad30 tx=0x7f9e88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:08.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:08.897+0000 7f9e8d7fa700 1 -- 172.21.15.61:0/2702812723 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e94053530 con 0x7f9e9815bb60 2023-12-24T19:59:09.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.134+0000 7f9e9f991700 1 -- 172.21.15.61:0/2702812723 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e9806d440 con 0x7f9e9815bb60 2023-12-24T19:59:09.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.134+0000 7f9e8d7fa700 1 -- 172.21.15.61:0/2702812723 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f9e94056b50 con 0x7f9e9815bb60 2023-12-24T19:59:09.135 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:09.135 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1254159834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1254159834},{"type":"v1","addr":"172.21.15.133:6835","nonce":1254159834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4078121613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4078121613},{"type":"v1","addr":"172.21.15.133:6837","nonce":4078121613}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/4252611526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":4252611526},{"type":"v1","addr":"172.21.15.61:6834","nonce":4252611526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:58:36.018348+0000","modified":"2023-12-24T19:58:39.583985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.61:6835/3976042512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3976042512},{"type":"v1","addr":"172.21.15.61:6835","nonce":3976042512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T19:59:09.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 -- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e7c066f30 msgr2=0x7f9e7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e7c066f30 0x7f9e7c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9e9809ad30 tx=0x7f9e88008040 comp rx=0 tx=0).stop 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 -- 172.21.15.61:0/2702812723 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e9815bb60 msgr2=0x7f9e98154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e9815bb60 0x7f9e98154af0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9e9806d8b0 tx=0x7f9e94017000 comp rx=0 tx=0).stop 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 -- 172.21.15.61:0/2702812723 shutdown_connections 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9e98098aa0 0x7f9e98098f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e7c066f30 0x7f9e7c0693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e9815c470 0x7f9e98155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 --2- 172.21.15.61:0/2702812723 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e9815bb60 0x7f9e98154af0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 -- 172.21.15.61:0/2702812723 >> 172.21.15.61:0/2702812723 conn(0x7f9e98097a10 msgr2=0x7f9e980a8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 -- 172.21.15.61:0/2702812723 shutdown_connections 2023-12-24T19:59:09.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:09.136+0000 7f9e9f991700 1 -- 172.21.15.61:0/2702812723 wait complete. 2023-12-24T19:59:09.138 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 26 2023-12-24T19:59:09.149 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-24T19:59:09.292 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":5274,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":32.714867667,"mdsmap_epoch":26,"osdmap_epoch":51,"osdmap_epoch_barrier":49,"uptime":44.098436870999997} 2023-12-24T19:59:09.292 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 5274, "mdsmap_epoch": 26, "osdmap_epoch": 51, "osdmap_epoch_barrier": 49, "rank_uptime": 32.714867667, "state": "up:active", "uptime": 44.098436871, "want_state": "up:active", "whoami": 0 } 2023-12-24T19:59:09.293 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-24T19:59:09.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:09.293 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-24T19:59:09.596 INFO:teuthology.orchestra.run.smithi061.stderr:50+0 records in 2023-12-24T19:59:09.596 INFO:teuthology.orchestra.run.smithi061.stderr:50+0 records out 2023-12-24T19:59:09.596 INFO:teuthology.orchestra.run.smithi061.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.283143 s, 185 MB/s 2023-12-24T19:59:09.596 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T19:59:09.597 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:59:09.641 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:59:09.696 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T19:59:09.696 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T19:59:09.696 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T19:59:09.696 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T19:59:09.739 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[51612]: fuse finished with error 0 and tester_r 0 2023-12-24T19:59:09.743 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:59:09.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:09.743 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T19:59:09.876 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T19:59:09.877 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T19:59:09.877 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T19:59:09.920 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[43667]: fuse finished with error 0 and tester_r 0 2023-12-24T19:59:09.922 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:59:09.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:09.922 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T19:59:10.090 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T19:59:10.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:10.090 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T19:59:10.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:59:10.108 INFO:teuthology.orchestra.run.smithi061.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-24T19:59:10.108 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T19:59:10.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:10.109 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T19:59:10.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T19:59:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-24T19:59:10.148 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:59:10.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.269+0000 7f624744d700 1 Processor -- start 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.269+0000 7f624744d700 1 -- start start 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.270+0000 7f624744d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f624015bb60 0x7f6240098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.270+0000 7f624744d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6240098aa0 0x7f624015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.270+0000 7f624744d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400b2eb0 con 0x7f624015c470 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.270+0000 7f624744d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62400afc20 con 0x7f6240098aa0 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.270+0000 7f624744d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400b2bd0 con 0x7f624015bb60 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.270+0000 7f62449e8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6240098aa0 0x7f624015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f62449e8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6240098aa0 0x7f624015bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57708/0 (socket says 172.21.15.61:57708) 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f62449e8700 1 -- 172.21.15.61:0/3378526597 learned_addr learned my addr 172.21.15.61:0/3378526597 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f62451e9700 1 --2- 172.21.15.61:0/3378526597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f624015bb60 0x7f6240098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f62449e8700 1 -- 172.21.15.61:0/3378526597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f624015bb60 msgr2=0x7f6240098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f62449e8700 1 --2- 172.21.15.61:0/3378526597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f624015bb60 0x7f6240098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f62449e8700 1 -- 172.21.15.61:0/3378526597 >> v1:172.21.15.133:6789/0 conn(0x7f624015c470 legacy=0x7f62400b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f62449e8700 1 -- 172.21.15.61:0/3378526597 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400afe10 con 0x7f6240098aa0 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f62449e8700 1 --2- 172.21.15.61:0/3378526597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6240098aa0 0x7f624015bf30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f62300099b0 tx=0x7f6230009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f04f35d9ff7e50e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f6237fff700 1 -- 172.21.15.61:0/3378526597 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230009ea0 con 0x7f6240098aa0 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f6237fff700 1 -- 172.21.15.61:0/3378526597 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623000b860 con 0x7f6240098aa0 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.271+0000 7f6237fff700 1 -- 172.21.15.61:0/3378526597 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623000bc00 con 0x7f6240098aa0 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.272+0000 7f624744d700 1 -- 172.21.15.61:0/3378526597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6240098aa0 msgr2=0x7f624015bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.272+0000 7f624744d700 1 --2- 172.21.15.61:0/3378526597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6240098aa0 0x7f624015bf30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f62300099b0 tx=0x7f6230009250 comp rx=0 tx=0).stop 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.272+0000 7f624744d700 1 -- 172.21.15.61:0/3378526597 shutdown_connections 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.272+0000 7f624744d700 1 --2- 172.21.15.61:0/3378526597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f624015bb60 0x7f6240098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.272+0000 7f624744d700 1 --2- 172.21.15.61:0/3378526597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6240098aa0 0x7f624015bf30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.272+0000 7f624744d700 1 -- 172.21.15.61:0/3378526597 >> 172.21.15.61:0/3378526597 conn(0x7f6240097a10 msgr2=0x7f62400ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.272+0000 7f624744d700 1 -- 172.21.15.61:0/3378526597 shutdown_connections 2023-12-24T19:59:10.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.272+0000 7f624744d700 1 -- 172.21.15.61:0/3378526597 wait complete. 2023-12-24T19:59:10.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.273+0000 7f624744d700 1 Processor -- start 2023-12-24T19:59:10.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.273+0000 7f624744d700 1 -- start start 2023-12-24T19:59:10.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f624744d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6240098aa0 0x7f6240154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f624744d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f624015bb60 0x7f6240153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f624744d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f624015c470 0x7f624016b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f624744d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62401504d0 con 0x7f624015bb60 2023-12-24T19:59:10.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f624744d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6240155610 con 0x7f6240098aa0 2023-12-24T19:59:10.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f624744d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62401558f0 con 0x7f624015c470 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f62449e8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f624015bb60 0x7f6240153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f62451e9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6240098aa0 0x7f6240154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f62449e8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f624015bb60 0x7f6240153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57710/0 (socket says 172.21.15.61:57710) 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f62459ea700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f624015c470 0x7f624016b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f62449e8700 1 -- 172.21.15.61:0/627494011 learned_addr learned my addr 172.21.15.61:0/627494011 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f62449e8700 1 -- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f624015c470 msgr2=0x7f624016b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f62449e8700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f624015c470 0x7f624016b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f62449e8700 1 -- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6240098aa0 msgr2=0x7f6240154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f62449e8700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6240098aa0 0x7f6240154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.274+0000 7f62449e8700 1 -- 172.21.15.61:0/627494011 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62300094f0 con 0x7f624015bb60 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.275+0000 7f62449e8700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f624015bb60 0x7f6240153bf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f624006d8b0 tx=0x7f6230017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.275+0000 7f62357fa700 1 -- 172.21.15.61:0/627494011 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230000d10 con 0x7f624015bb60 2023-12-24T19:59:10.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.275+0000 7f62357fa700 1 -- 172.21.15.61:0/627494011 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623000bbe0 con 0x7f624015bb60 2023-12-24T19:59:10.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.275+0000 7f62357fa700 1 -- 172.21.15.61:0/627494011 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230011670 con 0x7f624015bb60 2023-12-24T19:59:10.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.275+0000 7f624744d700 1 -- 172.21.15.61:0/627494011 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6240155bd0 con 0x7f624015bb60 2023-12-24T19:59:10.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.275+0000 7f624744d700 1 -- 172.21.15.61:0/627494011 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624009a3e0 con 0x7f624015bb60 2023-12-24T19:59:10.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.276+0000 7f624744d700 1 -- 172.21.15.61:0/627494011 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624009a8b0 con 0x7f624015bb60 2023-12-24T19:59:10.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.276+0000 7f62357fa700 1 -- 172.21.15.61:0/627494011 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6230011aa0 con 0x7f624015bb60 2023-12-24T19:59:10.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.277+0000 7f62357fa700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.277+0000 7f62357fa700 1 -- 172.21.15.61:0/627494011 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6230085dd0 con 0x7f624015bb60 2023-12-24T19:59:10.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.277+0000 7f62451e9700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.277+0000 7f62451e9700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6224066f30 0x7f62240693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f623c009da0 tx=0x7f623c009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:10.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.281+0000 7f62357fa700 1 -- 172.21.15.61:0/627494011 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6230053000 con 0x7f624015bb60 2023-12-24T19:59:10.523 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.523+0000 7f624744d700 1 -- 172.21.15.61:0/627494011 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f624006d440 con 0x7f624015bb60 2023-12-24T19:59:10.523 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.523+0000 7f62357fa700 1 -- 172.21.15.61:0/627494011 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f6230056620 con 0x7f624015bb60 2023-12-24T19:59:10.524 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:10.524 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1254159834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1254159834},{"type":"v1","addr":"172.21.15.133:6835","nonce":1254159834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4078121613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4078121613},{"type":"v1","addr":"172.21.15.133:6837","nonce":4078121613}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/4252611526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":4252611526},{"type":"v1","addr":"172.21.15.61:6834","nonce":4252611526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:58:36.018348+0000","modified":"2023-12-24T19:58:39.583985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.61:6835/3976042512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3976042512},{"type":"v1","addr":"172.21.15.61:6835","nonce":3976042512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 -- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6224066f30 msgr2=0x7f62240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6224066f30 0x7f62240693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f623c009da0 tx=0x7f623c009120 comp rx=0 tx=0).stop 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 -- 172.21.15.61:0/627494011 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f624015bb60 msgr2=0x7f6240153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f624015bb60 0x7f6240153bf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f624006d8b0 tx=0x7f6230017000 comp rx=0 tx=0).stop 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 -- 172.21.15.61:0/627494011 shutdown_connections 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f624015c470 0x7f624016b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6224066f30 0x7f62240693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6240098aa0 0x7f6240154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 --2- 172.21.15.61:0/627494011 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f624015bb60 0x7f6240153bf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 -- 172.21.15.61:0/627494011 >> 172.21.15.61:0/627494011 conn(0x7f6240097a10 msgr2=0x7f62400a8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 -- 172.21.15.61:0/627494011 shutdown_connections 2023-12-24T19:59:10.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.525+0000 7f624744d700 1 -- 172.21.15.61:0/627494011 wait complete. 2023-12-24T19:59:10.527 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 26 2023-12-24T19:59:10.538 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:59:10.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.661+0000 7f20141d9700 1 Processor -- start 2023-12-24T19:59:10.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.661+0000 7f20141d9700 1 -- start start 2023-12-24T19:59:10.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f20141d9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f200c0ca270 0x7f200c0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f20141d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200c158b60 0x7f200c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f20141d9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200c0ca6f0 con 0x7f200c157780 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f20141d9700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200c0ca9d0 con 0x7f200c0ca270 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f20141d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c0cacb0 con 0x7f200c158b60 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f2011774700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f200c0ca270 0x7f200c0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f2011774700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f200c0ca270 0x7f200c0cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57714/0 (socket says 172.21.15.61:57714) 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f2011774700 1 -- 172.21.15.61:0/32493098 learned_addr learned my addr 172.21.15.61:0/32493098 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f2012776700 1 --2- 172.21.15.61:0/32493098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200c158b60 0x7f200c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f2011774700 1 -- 172.21.15.61:0/32493098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200c158b60 msgr2=0x7f200c0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f2011774700 1 --2- 172.21.15.61:0/32493098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200c158b60 0x7f200c0ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f2010f73700 1 -- 172.21.15.61:0/32493098 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455731464 0 0) 0x7f200c0ca6f0 con 0x7f200c157780 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f2011774700 1 -- 172.21.15.61:0/32493098 >> v1:172.21.15.133:6789/0 conn(0x7f200c157780 legacy=0x7f200c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f2011774700 1 -- 172.21.15.61:0/32493098 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c0caf90 con 0x7f200c0ca270 2023-12-24T19:59:10.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.662+0000 7f2011774700 1 --2- 172.21.15.61:0/32493098 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c0ca270 0x7f200c0cdbb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0099b0 tx=0x7f1ffc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565bb6a1e4f91002 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f2010f73700 1 -- 172.21.15.61:0/32493098 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc009ea0 con 0x7f200c0ca270 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f2010f73700 1 -- 172.21.15.61:0/32493098 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc00b860 con 0x7f200c0ca270 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f2010f73700 1 -- 172.21.15.61:0/32493098 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00bc00 con 0x7f200c0ca270 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f20141d9700 1 -- 172.21.15.61:0/32493098 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c0ca270 msgr2=0x7f200c0cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f20141d9700 1 --2- 172.21.15.61:0/32493098 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c0ca270 0x7f200c0cdbb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0099b0 tx=0x7f1ffc009250 comp rx=0 tx=0).stop 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f20141d9700 1 -- 172.21.15.61:0/32493098 shutdown_connections 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f20141d9700 1 --2- 172.21.15.61:0/32493098 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200c158b60 0x7f200c0ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f20141d9700 1 --2- 172.21.15.61:0/32493098 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c0ca270 0x7f200c0cdbb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f20141d9700 1 -- 172.21.15.61:0/32493098 >> 172.21.15.61:0/32493098 conn(0x7f200c06b650 msgr2=0x7f200c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f20141d9700 1 -- 172.21.15.61:0/32493098 shutdown_connections 2023-12-24T19:59:10.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.663+0000 7f20141d9700 1 -- 172.21.15.61:0/32493098 wait complete. 2023-12-24T19:59:10.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.664+0000 7f20141d9700 1 Processor -- start 2023-12-24T19:59:10.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.664+0000 7f20141d9700 1 -- start start 2023-12-24T19:59:10.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f20141d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200c157780 0x7f200c151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f20141d9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c158b60 0x7f200c14a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f20141d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f200c0c5270 0x7f200c0c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f20141d9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c14e3e0 con 0x7f200c158b60 2023-12-24T19:59:10.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f20141d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c0c3f40 con 0x7f200c0c5270 2023-12-24T19:59:10.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f20141d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c0c4220 con 0x7f200c157780 2023-12-24T19:59:10.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f2011774700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c158b60 0x7f200c14a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f2011774700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c158b60 0x7f200c14a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57722/0 (socket says 172.21.15.61:57722) 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f2011774700 1 -- 172.21.15.61:0/2635717435 learned_addr learned my addr 172.21.15.61:0/2635717435 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f2011f75700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200c157780 0x7f200c151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f2011774700 1 -- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200c157780 msgr2=0x7f200c151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f2011774700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200c157780 0x7f200c151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f2011774700 1 -- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f200c0c5270 msgr2=0x7f200c0c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.665+0000 7f2011774700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f200c0c5270 0x7f200c0c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.666+0000 7f2011774700 1 -- 172.21.15.61:0/2635717435 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0094f0 con 0x7f200c158b60 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.666+0000 7f2011774700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c158b60 0x7f200c14a310 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f200c071f90 tx=0x7f1ffc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.666+0000 7f2001ffb700 1 -- 172.21.15.61:0/2635717435 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00bbe0 con 0x7f200c158b60 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.666+0000 7f2001ffb700 1 -- 172.21.15.61:0/2635717435 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc011420 con 0x7f200c158b60 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.666+0000 7f20141d9700 1 -- 172.21.15.61:0/2635717435 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200c0c4500 con 0x7f200c158b60 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.666+0000 7f2001ffb700 1 -- 172.21.15.61:0/2635717435 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0117e0 con 0x7f200c158b60 2023-12-24T19:59:10.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.666+0000 7f20141d9700 1 -- 172.21.15.61:0/2635717435 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c14a850 con 0x7f200c158b60 2023-12-24T19:59:10.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.667+0000 7f20141d9700 1 -- 172.21.15.61:0/2635717435 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c14e550 con 0x7f200c158b60 2023-12-24T19:59:10.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.667+0000 7f2001ffb700 1 -- 172.21.15.61:0/2635717435 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1ffc011c10 con 0x7f200c158b60 2023-12-24T19:59:10.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.668+0000 7f2001ffb700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ff0066f30 0x7f1ff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:10.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.668+0000 7f2001ffb700 1 -- 172.21.15.61:0/2635717435 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1ffc085ec0 con 0x7f200c158b60 2023-12-24T19:59:10.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.668+0000 7f2011f75700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ff0066f30 0x7f1ff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:10.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.669+0000 7f2011f75700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ff0066f30 0x7f1ff00693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20080011e0 tx=0x7f2008009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:10.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.672+0000 7f2001ffb700 1 -- 172.21.15.61:0/2635717435 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ffc0530f0 con 0x7f200c158b60 2023-12-24T19:59:10.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.870+0000 7f20141d9700 1 -- 172.21.15.61:0/2635717435 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f200c04c3c0 con 0x7f200c158b60 2023-12-24T19:59:10.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.870+0000 7f2001ffb700 1 -- 172.21.15.61:0/2635717435 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15446 (secure 0 0 0) 0x7f1ffc056710 con 0x7f200c158b60 2023-12-24T19:59:10.871 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:10.871 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":51,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:59:04.664661+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:58:34.362437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-24T19:58:34.922413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.38","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:59:10.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 -- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ff0066f30 msgr2=0x7f1ff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ff0066f30 0x7f1ff00693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20080011e0 tx=0x7f2008009040 comp rx=0 tx=0).stop 2023-12-24T19:59:10.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 -- 172.21.15.61:0/2635717435 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c158b60 msgr2=0x7f200c14a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:10.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c158b60 0x7f200c14a310 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f200c071f90 tx=0x7f1ffc017000 comp rx=0 tx=0).stop 2023-12-24T19:59:10.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 -- 172.21.15.61:0/2635717435 shutdown_connections 2023-12-24T19:59:10.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f200c157780 0x7f200c151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ff0066f30 0x7f1ff00693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f200c0c5270 0x7f200c0c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 --2- 172.21.15.61:0/2635717435 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f200c158b60 0x7f200c14a310 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:10.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 -- 172.21.15.61:0/2635717435 >> 172.21.15.61:0/2635717435 conn(0x7f200c06b650 msgr2=0x7f200c1540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:10.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 -- 172.21.15.61:0/2635717435 shutdown_connections 2023-12-24T19:59:10.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:10.873+0000 7f20141d9700 1 -- 172.21.15.61:0/2635717435 wait complete. 2023-12-24T19:59:10.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:58:34.362437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:58:34.922413+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T19:59:10.886 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:59:11.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.010+0000 7f8a8b356700 1 Processor -- start 2023-12-24T19:59:11.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.010+0000 7f8a8b356700 1 -- start start 2023-12-24T19:59:11.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.011+0000 7f8a8b356700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84159d00 0x7f8a84070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.011+0000 7f8a8b356700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a840c7d30 con 0x7f8a840711f0 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.011+0000 7f8a8b356700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a84067960 con 0x7f8a84159930 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.011+0000 7f8a8b356700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8406a290 con 0x7f8a84159d00 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.011+0000 7f8a898f3700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8a840711f0 0x7f8a841636e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45858/0 (socket says 172.21.15.61:45858) 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.011+0000 7f8a898f3700 1 -- 172.21.15.61:0/841178420 learned_addr learned my addr 172.21.15.61:0/841178420 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.011+0000 7f8a888f1700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84159d00 0x7f8a84070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905470917 0 0) 0x7f8a840c7d30 con 0x7f8a840711f0 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a70003570 con 0x7f8a840711f0 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3329528257 0 0) 0x7f8a70003570 con 0x7f8a840711f0 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84159d00 msgr2=0x7f8a84070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84159d00 0x7f8a84070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 >> v1:172.21.15.133:6789/0 conn(0x7f8a84159930 legacy=0x7f8a84069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8406a480 con 0x7f8a840711f0 2023-12-24T19:59:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f8a7c0017f0 con 0x7f8a840711f0 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 >> v1:172.21.15.61:6789/0 conn(0x7f8a840711f0 legacy=0x7f8a841636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84159d00 0x7f8a70003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a70003fd0 0x7f8a70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a70004d50 0x7f8a700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7000bb10 con 0x7f8a70004d50 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7000bc80 con 0x7f8a70003fd0 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7000be40 con 0x7f8a84159d00 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a898f3700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a70004d50 0x7f8a700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a890f2700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84159d00 0x7f8a70003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a888f1700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a70003fd0 0x7f8a70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a898f3700 1 -- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84159d00 msgr2=0x7f8a70003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a898f3700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84159d00 0x7f8a70003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a898f3700 1 -- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a70003fd0 msgr2=0x7f8a70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a898f3700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a70003fd0 0x7f8a70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.012+0000 7f8a898f3700 1 -- 172.21.15.61:0/841178420 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70003570 con 0x7f8a70004d50 2023-12-24T19:59:11.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a898f3700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a70004d50 0x7f8a700051c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00a8d0 tx=0x7f8a7c002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6023e82f2a32d572 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0070d0 con 0x7f8a70004d50 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c007230 con 0x7f8a70004d50 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a77fff700 1 -- 172.21.15.61:0/841178420 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0075f0 con 0x7f8a70004d50 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a8b356700 1 -- 172.21.15.61:0/841178420 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a70004d50 msgr2=0x7f8a700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a8b356700 1 --2- 172.21.15.61:0/841178420 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a70004d50 0x7f8a700051c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00a8d0 tx=0x7f8a7c002170 comp rx=0 tx=0).stop 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a898f3700 1 -- 172.21.15.61:0/841178420 reap_dead start 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a8b356700 1 -- 172.21.15.61:0/841178420 shutdown_connections 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a8b356700 1 -- 172.21.15.61:0/841178420 >> 172.21.15.61:0/841178420 conn(0x7f8a840ce170 msgr2=0x7f8a840ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a8b356700 1 -- 172.21.15.61:0/841178420 shutdown_connections 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.013+0000 7f8a8b356700 1 -- 172.21.15.61:0/841178420 wait complete. 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.014+0000 7f8a8b356700 1 Processor -- start 2023-12-24T19:59:11.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.014+0000 7f8a8b356700 1 -- start start 2023-12-24T19:59:11.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.015+0000 7f8a8b356700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84154e60 0x7f8a84155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.015+0000 7f8a8b356700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a840af140 0x7f8a841698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.015+0000 7f8a8b356700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a84155230 0x7f8a8415f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.015+0000 7f8a8b356700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8415f170 con 0x7f8a84155230 2023-12-24T19:59:11.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.015+0000 7f8a8b356700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8415f450 con 0x7f8a840af140 2023-12-24T19:59:11.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.015+0000 7f8a8b356700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a841563d0 con 0x7f8a84154e60 2023-12-24T19:59:11.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.015+0000 7f8a898f3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a84155230 0x7f8a8415f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.015+0000 7f8a898f3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a84155230 0x7f8a8415f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57746/0 (socket says 172.21.15.61:57746) 2023-12-24T19:59:11.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.015+0000 7f8a898f3700 1 -- 172.21.15.61:0/2721207716 learned_addr learned my addr 172.21.15.61:0/2721207716 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a890f2700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84154e60 0x7f8a84155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a888f1700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a840af140 0x7f8a841698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a898f3700 1 -- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84154e60 msgr2=0x7f8a84155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a898f3700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84154e60 0x7f8a84155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a898f3700 1 -- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a840af140 msgr2=0x7f8a841698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a898f3700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a840af140 0x7f8a841698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a898f3700 1 -- 172.21.15.61:0/2721207716 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a841566b0 con 0x7f8a84155230 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a888f1700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a840af140 0x7f8a841698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a898f3700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a84155230 0x7f8a8415f8e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000bc50 tx=0x7f8a7c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a757fa700 1 -- 172.21.15.61:0/2721207716 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c023070 con 0x7f8a84155230 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a757fa700 1 -- 172.21.15.61:0/2721207716 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c01e430 con 0x7f8a84155230 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a8b356700 1 -- 172.21.15.61:0/2721207716 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a84156990 con 0x7f8a84155230 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a757fa700 1 -- 172.21.15.61:0/2721207716 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c01e7d0 con 0x7f8a84155230 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.016+0000 7f8a8b356700 1 -- 172.21.15.61:0/2721207716 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a84169e20 con 0x7f8a84155230 2023-12-24T19:59:11.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.017+0000 7f8a8b356700 1 -- 172.21.15.61:0/2721207716 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8404c3c0 con 0x7f8a84155230 2023-12-24T19:59:11.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.017+0000 7f8a757fa700 1 -- 172.21.15.61:0/2721207716 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8a7c01eb80 con 0x7f8a84155230 2023-12-24T19:59:11.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.018+0000 7f8a757fa700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a68066f30 0x7f8a680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.018+0000 7f8a757fa700 1 -- 172.21.15.61:0/2721207716 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8a7c0867f0 con 0x7f8a84155230 2023-12-24T19:59:11.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.018+0000 7f8a890f2700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a68066f30 0x7f8a680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.019+0000 7f8a890f2700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a68066f30 0x7f8a680693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a78007e40 tx=0x7f8a78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:11.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.022+0000 7f8a757fa700 1 -- 172.21.15.61:0/2721207716 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a7c053a20 con 0x7f8a84155230 2023-12-24T19:59:11.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.216+0000 7f8a8b356700 1 -- 172.21.15.61:0/2721207716 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a8415f590 con 0x7f8a84155230 2023-12-24T19:59:11.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.216+0000 7f8a757fa700 1 -- 172.21.15.61:0/2721207716 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a7c057040 con 0x7f8a84155230 2023-12-24T19:59:11.217 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:59:11.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 -- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a68066f30 msgr2=0x7f8a680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a68066f30 0x7f8a680693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a78007e40 tx=0x7f8a78009040 comp rx=0 tx=0).stop 2023-12-24T19:59:11.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 -- 172.21.15.61:0/2721207716 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a84155230 msgr2=0x7f8a8415f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a84155230 0x7f8a8415f8e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000bc50 tx=0x7f8a7c016000 comp rx=0 tx=0).stop 2023-12-24T19:59:11.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 -- 172.21.15.61:0/2721207716 shutdown_connections 2023-12-24T19:59:11.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a84154e60 0x7f8a84155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a68066f30 0x7f8a680693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a84155230 0x7f8a8415f8e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 --2- 172.21.15.61:0/2721207716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a840af140 0x7f8a841698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 -- 172.21.15.61:0/2721207716 >> 172.21.15.61:0/2721207716 conn(0x7f8a840ce170 msgr2=0x7f8a840c3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:11.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 -- 172.21.15.61:0/2721207716 shutdown_connections 2023-12-24T19:59:11.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.218+0000 7f8a8b356700 1 -- 172.21.15.61:0/2721207716 wait complete. 2023-12-24T19:59:11.231 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T19:59:11.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.356+0000 7fad57fba700 1 Processor -- start 2023-12-24T19:59:11.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.357+0000 7fad57fba700 1 -- start start 2023-12-24T19:59:11.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.357+0000 7fad57fba700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fad5006b560 0x7fad50159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.357+0000 7fad57fba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad500ce400 0x7fad50159d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.357+0000 7fad57fba700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5015d900 con 0x7fad500ce030 2023-12-24T19:59:11.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.357+0000 7fad57fba700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5015e910 con 0x7fad5006b560 2023-12-24T19:59:11.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.357+0000 7fad57fba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5015e480 con 0x7fad500ce400 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad55555700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fad5006b560 0x7fad50159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad55555700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fad5006b560 0x7fad50159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57750/0 (socket says 172.21.15.61:57750) 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad55555700 1 -- 172.21.15.61:0/2172682372 learned_addr learned my addr 172.21.15.61:0/2172682372 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad55d56700 1 --1- 172.21.15.61:0/2172682372 >> v1:172.21.15.61:6789/0 conn(0x7fad500ce030 0x7fad50068df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45864/0 (socket says 172.21.15.61:45864) 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad56557700 1 --2- 172.21.15.61:0/2172682372 >> v2:172.21.15.133:3300/0 conn(0x7fad500ce400 0x7fad50159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad55555700 1 -- 172.21.15.61:0/2172682372 >> v2:172.21.15.133:3300/0 conn(0x7fad500ce400 msgr2=0x7fad50159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad55555700 1 --2- 172.21.15.61:0/2172682372 >> v2:172.21.15.133:3300/0 conn(0x7fad500ce400 0x7fad50159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad55555700 1 -- 172.21.15.61:0/2172682372 >> v1:172.21.15.61:6789/0 conn(0x7fad500ce030 legacy=0x7fad50068df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad55555700 1 -- 172.21.15.61:0/2172682372 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5015db50 con 0x7fad5006b560 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad54d54700 1 -- 172.21.15.61:0/2172682372 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468991307 0 0) 0x7fad5015d900 con 0x7fad500ce030 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad55555700 1 --2- 172.21.15.61:0/2172682372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad5006b560 0x7fad50159800 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fad5015d840 tx=0x7fad40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c127d6d938787c58 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad54d54700 1 -- 172.21.15.61:0/2172682372 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000b860 con 0x7fad5006b560 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad54d54700 1 -- 172.21.15.61:0/2172682372 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4000b9c0 con 0x7fad5006b560 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.358+0000 7fad54d54700 1 -- 172.21.15.61:0/2172682372 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000bd60 con 0x7fad5006b560 2023-12-24T19:59:11.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.359+0000 7fad57fba700 1 -- 172.21.15.61:0/2172682372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad5006b560 msgr2=0x7fad50159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.359+0000 7fad57fba700 1 --2- 172.21.15.61:0/2172682372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad5006b560 0x7fad50159800 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fad5015d840 tx=0x7fad40009250 comp rx=0 tx=0).stop 2023-12-24T19:59:11.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.359+0000 7fad57fba700 1 -- 172.21.15.61:0/2172682372 shutdown_connections 2023-12-24T19:59:11.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.359+0000 7fad57fba700 1 --2- 172.21.15.61:0/2172682372 >> v2:172.21.15.133:3300/0 conn(0x7fad500ce400 0x7fad50159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.359+0000 7fad57fba700 1 --2- 172.21.15.61:0/2172682372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad5006b560 0x7fad50159800 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.359+0000 7fad57fba700 1 -- 172.21.15.61:0/2172682372 >> 172.21.15.61:0/2172682372 conn(0x7fad5006f810 msgr2=0x7fad5006ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:11.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.359+0000 7fad57fba700 1 -- 172.21.15.61:0/2172682372 shutdown_connections 2023-12-24T19:59:11.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.359+0000 7fad57fba700 1 -- 172.21.15.61:0/2172682372 wait complete. 2023-12-24T19:59:11.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.360+0000 7fad57fba700 1 Processor -- start 2023-12-24T19:59:11.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.360+0000 7fad57fba700 1 -- start start 2023-12-24T19:59:11.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad57fba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad5006b560 0x7fad5015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad57fba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad500ce030 0x7fad50156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad57fba700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad500ce400 0x7fad5015c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad57fba700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad501574e0 con 0x7fad500ce400 2023-12-24T19:59:11.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad57fba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50155f40 con 0x7fad500ce030 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad57fba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5015c9a0 con 0x7fad5006b560 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad56557700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad500ce400 0x7fad5015c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad56557700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad500ce400 0x7fad5015c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57766/0 (socket says 172.21.15.61:57766) 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad56557700 1 -- 172.21.15.61:0/4097303332 learned_addr learned my addr 172.21.15.61:0/4097303332 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad55555700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad500ce030 0x7fad50156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad55d56700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad5006b560 0x7fad5015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad56557700 1 -- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad5006b560 msgr2=0x7fad5015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad56557700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad5006b560 0x7fad5015cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad56557700 1 -- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad500ce030 msgr2=0x7fad50156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad56557700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad500ce030 0x7fad50156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad56557700 1 -- 172.21.15.61:0/4097303332 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad400094f0 con 0x7fad500ce400 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad55d56700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad5006b560 0x7fad5015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.361+0000 7fad56557700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad500ce400 0x7fad5015c460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fad48007f20 tx=0x7fad48009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.362+0000 7fad45ffb700 1 -- 172.21.15.61:0/4097303332 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4800ebf0 con 0x7fad500ce400 2023-12-24T19:59:11.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.362+0000 7fad45ffb700 1 -- 172.21.15.61:0/4097303332 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4800ed70 con 0x7fad500ce400 2023-12-24T19:59:11.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.362+0000 7fad57fba700 1 -- 172.21.15.61:0/4097303332 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad501561e0 con 0x7fad500ce400 2023-12-24T19:59:11.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.362+0000 7fad45ffb700 1 -- 172.21.15.61:0/4097303332 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48014670 con 0x7fad500ce400 2023-12-24T19:59:11.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.362+0000 7fad57fba700 1 -- 172.21.15.61:0/4097303332 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad501567a0 con 0x7fad500ce400 2023-12-24T19:59:11.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.363+0000 7fad57fba700 1 -- 172.21.15.61:0/4097303332 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5004c3c0 con 0x7fad500ce400 2023-12-24T19:59:11.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.363+0000 7fad45ffb700 1 -- 172.21.15.61:0/4097303332 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fad480149e0 con 0x7fad500ce400 2023-12-24T19:59:11.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.363+0000 7fad45ffb700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad34066f30 0x7fad340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.364+0000 7fad45ffb700 1 -- 172.21.15.61:0/4097303332 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fad48084be0 con 0x7fad500ce400 2023-12-24T19:59:11.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.364+0000 7fad55d56700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad34066f30 0x7fad340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.364+0000 7fad55d56700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad34066f30 0x7fad340693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0011e0 tx=0x7fad4c007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:11.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.368+0000 7fad45ffb700 1 -- 172.21.15.61:0/4097303332 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad48051e10 con 0x7fad500ce400 2023-12-24T19:59:11.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.563+0000 7fad57fba700 1 -- 172.21.15.61:0/4097303332 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad500cc140 con 0x7fad500ce400 2023-12-24T19:59:11.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.563+0000 7fad45ffb700 1 -- 172.21.15.61:0/4097303332 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad48055430 con 0x7fad500ce400 2023-12-24T19:59:11.564 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T19:59:11.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 -- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad34066f30 msgr2=0x7fad340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad34066f30 0x7fad340693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0011e0 tx=0x7fad4c007c90 comp rx=0 tx=0).stop 2023-12-24T19:59:11.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 -- 172.21.15.61:0/4097303332 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad500ce400 msgr2=0x7fad5015c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad500ce400 0x7fad5015c460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fad48007f20 tx=0x7fad48009860 comp rx=0 tx=0).stop 2023-12-24T19:59:11.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 -- 172.21.15.61:0/4097303332 shutdown_connections 2023-12-24T19:59:11.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad5006b560 0x7fad5015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad34066f30 0x7fad340693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad500ce400 0x7fad5015c460 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 --2- 172.21.15.61:0/4097303332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad500ce030 0x7fad50156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 -- 172.21.15.61:0/4097303332 >> 172.21.15.61:0/4097303332 conn(0x7fad5006f810 msgr2=0x7fad500cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:11.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 -- 172.21.15.61:0/4097303332 shutdown_connections 2023-12-24T19:59:11.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.565+0000 7fad57fba700 1 -- 172.21.15.61:0/4097303332 wait complete. 2023-12-24T19:59:11.578 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T19:59:11.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.702+0000 7fdbdd39c700 1 Processor -- start 2023-12-24T19:59:11.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.702+0000 7fdbdd39c700 1 -- start start 2023-12-24T19:59:11.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbdd39c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 0x7fdbd8164a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbdd39c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd80cfe90 con 0x7fdbd80cbfa0 2023-12-24T19:59:11.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbdd39c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd8067fb0 con 0x7fdbd8159b70 2023-12-24T19:59:11.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbdd39c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd8159f40 con 0x7fdbd80ced40 2023-12-24T19:59:11.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd67fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fdbd80cbfa0 0x7fdbd80ce630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45866/0 (socket says 172.21.15.61:45866) 2023-12-24T19:59:11.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd67fc700 1 -- 172.21.15.61:0/1214455715 learned_addr learned my addr 172.21.15.61:0/1214455715 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd77fe700 1 --2- 172.21.15.61:0/1214455715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 0x7fdbd8164a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd5ffb700 1 -- 172.21.15.61:0/1214455715 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266587931 0 0) 0x7fdbd80cfe90 con 0x7fdbd80cbfa0 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd5ffb700 1 -- 172.21.15.61:0/1214455715 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc0003570 con 0x7fdbd80cbfa0 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd5ffb700 1 -- 172.21.15.61:0/1214455715 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607778301 0 0) 0x7fdbd8067fb0 con 0x7fdbd8159b70 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd5ffb700 1 -- 172.21.15.61:0/1214455715 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd80cfe90 con 0x7fdbd8159b70 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd77fe700 1 -- 172.21.15.61:0/1214455715 >> v1:172.21.15.133:6789/0 conn(0x7fdbd8159b70 legacy=0x7fdbd80cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd77fe700 1 -- 172.21.15.61:0/1214455715 >> v1:172.21.15.61:6789/0 conn(0x7fdbd80cbfa0 legacy=0x7fdbd80ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd5ffb700 1 -- 172.21.15.61:0/1214455715 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 842417313 0 0) 0x7fdbc0003570 con 0x7fdbd80cbfa0 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.703+0000 7fdbd77fe700 1 -- 172.21.15.61:0/1214455715 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd80cf280 con 0x7fdbd80ced40 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbd77fe700 1 --2- 172.21.15.61:0/1214455715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 0x7fdbd8164a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009e90 tx=0x7fdbd0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ff27fcb137ed838 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbd5ffb700 1 -- 172.21.15.61:0/1214455715 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000e070 con 0x7fdbd80ced40 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbd5ffb700 1 -- 172.21.15.61:0/1214455715 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd000b870 con 0x7fdbd80ced40 2023-12-24T19:59:11.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbd5ffb700 1 -- 172.21.15.61:0/1214455715 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8001470 con 0x7fdbd80ced40 2023-12-24T19:59:11.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbdd39c700 1 -- 172.21.15.61:0/1214455715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 msgr2=0x7fdbd8164a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbdd39c700 1 --2- 172.21.15.61:0/1214455715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 0x7fdbd8164a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009e90 tx=0x7fdbd0009780 comp rx=0 tx=0).stop 2023-12-24T19:59:11.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbdd39c700 1 -- 172.21.15.61:0/1214455715 shutdown_connections 2023-12-24T19:59:11.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbdd39c700 1 --2- 172.21.15.61:0/1214455715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 0x7fdbd8164a30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbdd39c700 1 -- 172.21.15.61:0/1214455715 >> 172.21.15.61:0/1214455715 conn(0x7fdbd806e5f0 msgr2=0x7fdbd8067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:11.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbdd39c700 1 -- 172.21.15.61:0/1214455715 shutdown_connections 2023-12-24T19:59:11.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.704+0000 7fdbdd39c700 1 -- 172.21.15.61:0/1214455715 wait complete. 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.706+0000 7fdbdd39c700 1 Processor -- start 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.706+0000 7fdbdd39c700 1 -- start start 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.706+0000 7fdbdd39c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80cbfa0 0x7fdbd80caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.706+0000 7fdbdd39c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 0x7fdbd80b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.706+0000 7fdbdd39c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdbd8159b70 0x7fdbd815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.706+0000 7fdbdd39c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd816a130 con 0x7fdbd8159b70 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.706+0000 7fdbdd39c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd80b49f0 con 0x7fdbd80cbfa0 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.706+0000 7fdbdd39c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd816ac50 con 0x7fdbd80ced40 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdbd8159b70 0x7fdbd815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdbd8159b70 0x7fdbd815c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57768/0 (socket says 172.21.15.61:57768) 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd77fe700 1 -- 172.21.15.61:0/527636606 learned_addr learned my addr 172.21.15.61:0/527636606 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd67fc700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 0x7fdbd80b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd77fe700 1 -- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 msgr2=0x7fdbd80b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd77fe700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 0x7fdbd80b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd77fe700 1 -- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80cbfa0 msgr2=0x7fdbd80caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd6ffd700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80cbfa0 0x7fdbd80caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd77fe700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80cbfa0 0x7fdbd80caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd77fe700 1 -- 172.21.15.61:0/527636606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd0009a20 con 0x7fdbd8159b70 2023-12-24T19:59:11.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbd77fe700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdbd8159b70 0x7fdbd815c8e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00097c0 tx=0x7fdbd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:11.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbbeffd700 1 -- 172.21.15.61:0/527636606 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0012d10 con 0x7fdbd8159b70 2023-12-24T19:59:11.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbbeffd700 1 -- 172.21.15.61:0/527636606 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd0012e70 con 0x7fdbd8159b70 2023-12-24T19:59:11.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbdd39c700 1 -- 172.21.15.61:0/527636606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd816b0e0 con 0x7fdbd8159b70 2023-12-24T19:59:11.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbbeffd700 1 -- 172.21.15.61:0/527636606 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0026690 con 0x7fdbd8159b70 2023-12-24T19:59:11.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.707+0000 7fdbdd39c700 1 -- 172.21.15.61:0/527636606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd816a3a0 con 0x7fdbd8159b70 2023-12-24T19:59:11.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.708+0000 7fdbdd39c700 1 -- 172.21.15.61:0/527636606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd816af30 con 0x7fdbd8159b70 2023-12-24T19:59:11.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.709+0000 7fdbbeffd700 1 -- 172.21.15.61:0/527636606 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdbd001d440 con 0x7fdbd8159b70 2023-12-24T19:59:11.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.709+0000 7fdbbeffd700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdbc4066f30 0x7fdbc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:11.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.709+0000 7fdbbeffd700 1 -- 172.21.15.61:0/527636606 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fdbd0086970 con 0x7fdbd8159b70 2023-12-24T19:59:11.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.709+0000 7fdbd6ffd700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdbc4066f30 0x7fdbc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:11.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.710+0000 7fdbd6ffd700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdbc4066f30 0x7fdbc40693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80ca9a0 tx=0x7fdbcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:11.714 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.713+0000 7fdbbeffd700 1 -- 172.21.15.61:0/527636606 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbd0053ba0 con 0x7fdbd8159b70 2023-12-24T19:59:11.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.910+0000 7fdbdd39c700 1 -- 172.21.15.61:0/527636606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbd804c3c0 con 0x7fdbd8159b70 2023-12-24T19:59:11.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.910+0000 7fdbbeffd700 1 -- 172.21.15.61:0/527636606 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbd00160a0 con 0x7fdbd8159b70 2023-12-24T19:59:11.911 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T19:59:11.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 -- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdbc4066f30 msgr2=0x7fdbc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdbc4066f30 0x7fdbc40693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80ca9a0 tx=0x7fdbcc009040 comp rx=0 tx=0).stop 2023-12-24T19:59:11.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 -- 172.21.15.61:0/527636606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdbd8159b70 msgr2=0x7fdbd815c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:11.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdbd8159b70 0x7fdbd815c8e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00097c0 tx=0x7fdbd0017000 comp rx=0 tx=0).stop 2023-12-24T19:59:11.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 -- 172.21.15.61:0/527636606 shutdown_connections 2023-12-24T19:59:11.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdbc4066f30 0x7fdbc40693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdbd8159b70 0x7fdbd815c8e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80cbfa0 0x7fdbd80caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 --2- 172.21.15.61:0/527636606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdbd80ced40 0x7fdbd80b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 -- 172.21.15.61:0/527636606 >> 172.21.15.61:0/527636606 conn(0x7fdbd806e5f0 msgr2=0x7fdbd81542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 -- 172.21.15.61:0/527636606 shutdown_connections 2023-12-24T19:59:11.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:11.913+0000 7fdbdd39c700 1 -- 172.21.15.61:0/527636606 wait complete. 2023-12-24T19:59:11.926 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:59:12.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.047+0000 7f37c9750700 1 Processor -- start 2023-12-24T19:59:12.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.047+0000 7f37c9750700 1 -- start start 2023-12-24T19:59:12.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c9750700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c4159fe0 0x7f37c40cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c9750700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f37c40c5ee0 0x7f37c40cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c9750700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c40af880 con 0x7f37c4159c10 2023-12-24T19:59:12.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c9750700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c40c6fc0 con 0x7f37c40c5ee0 2023-12-24T19:59:12.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c9750700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40c63b0 con 0x7f37c4159fe0 2023-12-24T19:59:12.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c37fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f37c40c5ee0 0x7f37c40cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c37fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f37c40c5ee0 0x7f37c40cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57772/0 (socket says 172.21.15.61:57772) 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c37fe700 1 -- 172.21.15.61:0/348368060 learned_addr learned my addr 172.21.15.61:0/348368060 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c27fc700 1 --2- 172.21.15.61:0/348368060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c4159fe0 0x7f37c40cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c37fe700 1 -- 172.21.15.61:0/348368060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c4159fe0 msgr2=0x7f37c40cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c37fe700 1 --2- 172.21.15.61:0/348368060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c4159fe0 0x7f37c40cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c37fe700 1 -- 172.21.15.61:0/348368060 >> v1:172.21.15.133:6789/0 conn(0x7f37c4159c10 legacy=0x7f37c40c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.048+0000 7f37c37fe700 1 -- 172.21.15.61:0/348368060 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c40c6690 con 0x7f37c40c5ee0 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c37fe700 1 --2- 172.21.15.61:0/348368060 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c40c5ee0 0x7f37c40cbfc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009f20 tx=0x7f37bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e808fc182b9ce715 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c1ffb700 1 -- 172.21.15.61:0/348368060 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00e070 con 0x7f37c40c5ee0 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c1ffb700 1 -- 172.21.15.61:0/348368060 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc00b9d0 con 0x7f37c40c5ee0 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c1ffb700 1 -- 172.21.15.61:0/348368060 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0092e0 con 0x7f37c40c5ee0 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c9750700 1 -- 172.21.15.61:0/348368060 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c40c5ee0 msgr2=0x7f37c40cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c9750700 1 --2- 172.21.15.61:0/348368060 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c40c5ee0 0x7f37c40cbfc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009f20 tx=0x7f37bc009840 comp rx=0 tx=0).stop 2023-12-24T19:59:12.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c9750700 1 -- 172.21.15.61:0/348368060 shutdown_connections 2023-12-24T19:59:12.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c9750700 1 --2- 172.21.15.61:0/348368060 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c40c5ee0 0x7f37c40cbfc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c9750700 1 --2- 172.21.15.61:0/348368060 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c4159fe0 0x7f37c40cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c9750700 1 -- 172.21.15.61:0/348368060 >> 172.21.15.61:0/348368060 conn(0x7f37c406e640 msgr2=0x7f37c4067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:12.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c9750700 1 -- 172.21.15.61:0/348368060 shutdown_connections 2023-12-24T19:59:12.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.049+0000 7f37c9750700 1 -- 172.21.15.61:0/348368060 wait complete. 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.051+0000 7f37c9750700 1 Processor -- start 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.051+0000 7f37c9750700 1 -- start start 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.051+0000 7f37c9750700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c40c5ee0 0x7f37c40b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.051+0000 7f37c9750700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c4159c10 0x7f37c4155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.051+0000 7f37c9750700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c4159fe0 0x7f37c40b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.051+0000 7f37c9750700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40caaf0 con 0x7f37c4159c10 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.051+0000 7f37c9750700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40ca660 con 0x7f37c4159fe0 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.051+0000 7f37c9750700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40c9240 con 0x7f37c40c5ee0 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.051+0000 7f37c27fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c4159c10 0x7f37c4155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.051+0000 7f37c27fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c4159c10 0x7f37c4155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57774/0 (socket says 172.21.15.61:57774) 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c27fc700 1 -- 172.21.15.61:0/3093948541 learned_addr learned my addr 172.21.15.61:0/3093948541 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c2ffd700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c40c5ee0 0x7f37c40b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c37fe700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c4159fe0 0x7f37c40b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c27fc700 1 -- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c40c5ee0 msgr2=0x7f37c40b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c27fc700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c40c5ee0 0x7f37c40b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c27fc700 1 -- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c4159fe0 msgr2=0x7f37c40b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c27fc700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c4159fe0 0x7f37c40b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c27fc700 1 -- 172.21.15.61:0/3093948541 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc009ae0 con 0x7f37c4159c10 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c37fe700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c4159fe0 0x7f37c40b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c27fc700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c4159c10 0x7f37c4155400 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f37b400ec80 tx=0x7f37b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37baffd700 1 -- 172.21.15.61:0/3093948541 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400c9d0 con 0x7f37c4159c10 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37baffd700 1 -- 172.21.15.61:0/3093948541 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400cb30 con 0x7f37c4159c10 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c9750700 1 -- 172.21.15.61:0/3093948541 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c40c9770 con 0x7f37c4159c10 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37baffd700 1 -- 172.21.15.61:0/3093948541 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4013470 con 0x7f37c4159c10 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.052+0000 7f37c9750700 1 -- 172.21.15.61:0/3093948541 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c40c9d30 con 0x7f37c4159c10 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.053+0000 7f37c9750700 1 -- 172.21.15.61:0/3093948541 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c40ca810 con 0x7f37c4159c10 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.054+0000 7f37baffd700 1 -- 172.21.15.61:0/3093948541 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f37b40137e0 con 0x7f37c4159c10 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.054+0000 7f37baffd700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37a4066f30 0x7f37a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.054+0000 7f37baffd700 1 -- 172.21.15.61:0/3093948541 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f37b40848a0 con 0x7f37c4159c10 2023-12-24T19:59:12.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.054+0000 7f37c2ffd700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37a4066f30 0x7f37a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.055+0000 7f37c2ffd700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37a4066f30 0x7f37a40693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0037c0 tx=0x7f37ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:12.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.058+0000 7f37baffd700 1 -- 172.21.15.61:0/3093948541 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37c40ca810 con 0x7f37c4159c10 2023-12-24T19:59:12.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.296+0000 7f37c9750700 1 -- 172.21.15.61:0/3093948541 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37c4068030 con 0x7f37c4159c10 2023-12-24T19:59:12.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.296+0000 7f37baffd700 1 -- 172.21.15.61:0/3093948541 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f37b4051ad0 con 0x7f37c4159c10 2023-12-24T19:59:12.297 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:12.297 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1254159834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1254159834},{"type":"v1","addr":"172.21.15.133:6835","nonce":1254159834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4078121613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4078121613},{"type":"v1","addr":"172.21.15.133:6837","nonce":4078121613}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/4252611526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":4252611526},{"type":"v1","addr":"172.21.15.61:6834","nonce":4252611526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:58:36.018348+0000","modified":"2023-12-24T19:58:39.583985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.61:6835/3976042512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3976042512},{"type":"v1","addr":"172.21.15.61:6835","nonce":3976042512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T19:59:12.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 -- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37a4066f30 msgr2=0x7f37a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37a4066f30 0x7f37a40693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0037c0 tx=0x7f37ac009040 comp rx=0 tx=0).stop 2023-12-24T19:59:12.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 -- 172.21.15.61:0/3093948541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c4159c10 msgr2=0x7f37c4155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c4159c10 0x7f37c4155400 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f37b400ec80 tx=0x7f37b40091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 -- 172.21.15.61:0/3093948541 shutdown_connections 2023-12-24T19:59:12.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37c40c5ee0 0x7f37c40b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37a4066f30 0x7f37a40693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37c4159fe0 0x7f37c40b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 --2- 172.21.15.61:0/3093948541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37c4159c10 0x7f37c4155400 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 -- 172.21.15.61:0/3093948541 >> 172.21.15.61:0/3093948541 conn(0x7f37c406e640 msgr2=0x7f37c40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:12.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 -- 172.21.15.61:0/3093948541 shutdown_connections 2023-12-24T19:59:12.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.299+0000 7f37c9750700 1 -- 172.21.15.61:0/3093948541 wait complete. 2023-12-24T19:59:12.300 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 26 2023-12-24T19:59:12.311 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:59:12.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.433+0000 7f7733246700 1 Processor -- start 2023-12-24T19:59:12.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.434+0000 7f7733246700 1 -- start start 2023-12-24T19:59:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.434+0000 7f7733246700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f772c068140 0x7f772c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.434+0000 7f7733246700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f772c068510 0x7f772c0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.434+0000 7f7733246700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772c0b2890 con 0x7f772c159a60 2023-12-24T19:59:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.434+0000 7f7733246700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c0b11e0 con 0x7f772c068140 2023-12-24T19:59:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.434+0000 7f7733246700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772c0cf630 con 0x7f772c068510 2023-12-24T19:59:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f7730fe2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f772c068140 0x7f772c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f7730fe2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f772c068140 0x7f772c0cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57778/0 (socket says 172.21.15.61:57778) 2023-12-24T19:59:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f7730fe2700 1 -- 172.21.15.61:0/2897995363 learned_addr learned my addr 172.21.15.61:0/2897995363 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f772bfff700 1 --2- 172.21.15.61:0/2897995363 >> v2:172.21.15.133:3300/0 conn(0x7f772c068510 0x7f772c0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f7730fe2700 1 -- 172.21.15.61:0/2897995363 >> v2:172.21.15.133:3300/0 conn(0x7f772c068510 msgr2=0x7f772c0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f7730fe2700 1 --2- 172.21.15.61:0/2897995363 >> v2:172.21.15.133:3300/0 conn(0x7f772c068510 0x7f772c0b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f7730fe2700 1 -- 172.21.15.61:0/2897995363 >> v1:172.21.15.133:6789/0 conn(0x7f772c159a60 legacy=0x7f772c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f7730fe2700 1 -- 172.21.15.61:0/2897995363 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c0b2240 con 0x7f772c068140 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f772bfff700 1 --2- 172.21.15.61:0/2897995363 >> v2:172.21.15.133:3300/0 conn(0x7f772c068510 0x7f772c0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f7730fe2700 1 --2- 172.21.15.61:0/2897995363 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c068140 0x7f772c0cefa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f772c06d800 tx=0x7f7720009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85f5328f31ebec0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f772b7fe700 1 -- 172.21.15.61:0/2897995363 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720005c10 con 0x7f772c068140 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f772b7fe700 1 -- 172.21.15.61:0/2897995363 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7720005d70 con 0x7f772c068140 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.435+0000 7f772b7fe700 1 -- 172.21.15.61:0/2897995363 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000b880 con 0x7f772c068140 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.436+0000 7f7733246700 1 -- 172.21.15.61:0/2897995363 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c068140 msgr2=0x7f772c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.436+0000 7f7733246700 1 --2- 172.21.15.61:0/2897995363 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c068140 0x7f772c0cefa0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f772c06d800 tx=0x7f7720009220 comp rx=0 tx=0).stop 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.436+0000 7f7733246700 1 -- 172.21.15.61:0/2897995363 shutdown_connections 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.436+0000 7f7733246700 1 --2- 172.21.15.61:0/2897995363 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c068140 0x7f772c0cefa0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.436+0000 7f7733246700 1 --2- 172.21.15.61:0/2897995363 >> v2:172.21.15.133:3300/0 conn(0x7f772c068510 0x7f772c0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.436+0000 7f7733246700 1 -- 172.21.15.61:0/2897995363 >> 172.21.15.61:0/2897995363 conn(0x7f772c097a10 msgr2=0x7f772c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:12.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.436+0000 7f7733246700 1 -- 172.21.15.61:0/2897995363 shutdown_connections 2023-12-24T19:59:12.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.436+0000 7f7733246700 1 -- 172.21.15.61:0/2897995363 wait complete. 2023-12-24T19:59:12.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.437+0000 7f7733246700 1 Processor -- start 2023-12-24T19:59:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.437+0000 7f7733246700 1 -- start start 2023-12-24T19:59:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f7733246700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c068140 0x7f772c09b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f7733246700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f772c068510 0x7f772c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f7733246700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c159a60 0x7f772c14dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f7733246700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c09c460 con 0x7f772c159a60 2023-12-24T19:59:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f7733246700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c09bbc0 con 0x7f772c068140 2023-12-24T19:59:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f7733246700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772c09bea0 con 0x7f772c068510 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f77317e3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c159a60 0x7f772c14dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f77317e3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c159a60 0x7f772c14dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57784/0 (socket says 172.21.15.61:57784) 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f7730fe2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c068140 0x7f772c09b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f77317e3700 1 -- 172.21.15.61:0/3629440684 learned_addr learned my addr 172.21.15.61:0/3629440684 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f772bfff700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f772c068510 0x7f772c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f77317e3700 1 -- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f772c068510 msgr2=0x7f772c156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f77317e3700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f772c068510 0x7f772c156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f77317e3700 1 -- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c068140 msgr2=0x7f772c09b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f77317e3700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c068140 0x7f772c09b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.438+0000 7f77317e3700 1 -- 172.21.15.61:0/3629440684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7720009480 con 0x7f772c159a60 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.439+0000 7f77317e3700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c159a60 0x7f772c14dc70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f772400c840 tx=0x7f7724001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.439+0000 7f7728ff9700 1 -- 172.21.15.61:0/3629440684 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724012630 con 0x7f772c159a60 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.439+0000 7f7728ff9700 1 -- 172.21.15.61:0/3629440684 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7724012790 con 0x7f772c159a60 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.439+0000 7f7728ff9700 1 -- 172.21.15.61:0/3629440684 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724012b50 con 0x7f772c159a60 2023-12-24T19:59:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.439+0000 7f7733246700 1 -- 172.21.15.61:0/3629440684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c09c180 con 0x7f772c159a60 2023-12-24T19:59:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.439+0000 7f7733246700 1 -- 172.21.15.61:0/3629440684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c09b800 con 0x7f772c159a60 2023-12-24T19:59:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.440+0000 7f7733246700 1 -- 172.21.15.61:0/3629440684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c098750 con 0x7f772c159a60 2023-12-24T19:59:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.440+0000 7f7728ff9700 1 -- 172.21.15.61:0/3629440684 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7724003030 con 0x7f772c159a60 2023-12-24T19:59:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.440+0000 7f7728ff9700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7710066f30 0x7f77100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.441+0000 7f7728ff9700 1 -- 172.21.15.61:0/3629440684 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f77240843d0 con 0x7f772c159a60 2023-12-24T19:59:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.441+0000 7f7730fe2700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7710066f30 0x7f77100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.441+0000 7f7730fe2700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7710066f30 0x7f77100693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7720009260 tx=0x7f7720016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:12.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.445+0000 7f7728ff9700 1 -- 172.21.15.61:0/3629440684 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7724051600 con 0x7f772c159a60 2023-12-24T19:59:12.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.641+0000 7f7733246700 1 -- 172.21.15.61:0/3629440684 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f772c06d440 con 0x7f772c159a60 2023-12-24T19:59:12.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.642+0000 7f7728ff9700 1 -- 172.21.15.61:0/3629440684 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15446 (secure 0 0 0) 0x7f7724054c20 con 0x7f772c159a60 2023-12-24T19:59:12.642 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:12.642 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":51,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:59:04.664661+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:58:34.362437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-24T19:58:34.922413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.38","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:59:12.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 -- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7710066f30 msgr2=0x7f77100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7710066f30 0x7f77100693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7720009260 tx=0x7f7720016000 comp rx=0 tx=0).stop 2023-12-24T19:59:12.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 -- 172.21.15.61:0/3629440684 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c159a60 msgr2=0x7f772c14dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c159a60 0x7f772c14dc70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f772400c840 tx=0x7f7724001670 comp rx=0 tx=0).stop 2023-12-24T19:59:12.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 -- 172.21.15.61:0/3629440684 shutdown_connections 2023-12-24T19:59:12.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7710066f30 0x7f77100693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f772c159a60 0x7f772c14dc70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f772c068140 0x7f772c09b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 --2- 172.21.15.61:0/3629440684 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f772c068510 0x7f772c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 -- 172.21.15.61:0/3629440684 >> 172.21.15.61:0/3629440684 conn(0x7f772c097a10 msgr2=0x7f772c154090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:12.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 -- 172.21.15.61:0/3629440684 shutdown_connections 2023-12-24T19:59:12.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.644+0000 7f7733246700 1 -- 172.21.15.61:0/3629440684 wait complete. 2023-12-24T19:59:12.657 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T19:59:12.657 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:59:12.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.780+0000 7f65fb1f5700 1 Processor -- start 2023-12-24T19:59:12.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.780+0000 7f65fb1f5700 1 -- start start 2023-12-24T19:59:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.781+0000 7f65fb1f5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f65f4068510 0x7f65f40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.781+0000 7f65fb1f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65f4159a60 0x7f65f4159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.781+0000 7f65fb1f5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f40b2890 con 0x7f65f4068140 2023-12-24T19:59:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.781+0000 7f65fb1f5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f40cf630 con 0x7f65f4068510 2023-12-24T19:59:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.781+0000 7f65fb1f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40b2240 con 0x7f65f4159a60 2023-12-24T19:59:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.781+0000 7f65f3fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f65f4068510 0x7f65f40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.781+0000 7f65f8f91700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f65f4068140 0x7f65f40b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45874/0 (socket says 172.21.15.61:45874) 2023-12-24T19:59:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.781+0000 7f65f8f91700 1 -- 172.21.15.61:0/1141287974 learned_addr learned my addr 172.21.15.61:0/1141287974 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.781+0000 7f65f3fff700 1 --2- 172.21.15.61:0/1141287974 >> v2:172.21.15.61:3300/0 conn(0x7f65f4068510 0x7f65f40cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57800/0 (socket says 172.21.15.61:57800) 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65f9792700 1 --2- 172.21.15.61:0/1141287974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65f4159a60 0x7f65f4159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65f3fff700 1 -- 172.21.15.61:0/1141287974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65f4159a60 msgr2=0x7f65f4159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65f3fff700 1 --2- 172.21.15.61:0/1141287974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65f4159a60 0x7f65f4159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65f3fff700 1 -- 172.21.15.61:0/1141287974 >> v1:172.21.15.61:6789/0 conn(0x7f65f4068140 legacy=0x7f65f40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65f3fff700 1 -- 172.21.15.61:0/1141287974 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f40b2520 con 0x7f65f4068510 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65f37fe700 1 -- 172.21.15.61:0/1141287974 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836679193 0 0) 0x7f65f40b2890 con 0x7f65f4068140 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65f3fff700 1 --2- 172.21.15.61:0/1141287974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068510 0x7f65f40cefa0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f65e00098e0 tx=0x7f65e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85860e3eb20c6e12 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65f37fe700 1 -- 172.21.15.61:0/1141287974 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0009e80 con 0x7f65f4068510 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65f37fe700 1 -- 172.21.15.61:0/1141287974 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e000b860 con 0x7f65f4068510 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65f37fe700 1 -- 172.21.15.61:0/1141287974 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000bbe0 con 0x7f65f4068510 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1141287974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068510 msgr2=0x7f65f40cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65fb1f5700 1 --2- 172.21.15.61:0/1141287974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068510 0x7f65f40cefa0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f65e00098e0 tx=0x7f65e00091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1141287974 shutdown_connections 2023-12-24T19:59:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65fb1f5700 1 --2- 172.21.15.61:0/1141287974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65f4159a60 0x7f65f4159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65fb1f5700 1 --2- 172.21.15.61:0/1141287974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068510 0x7f65f40cefa0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.782+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1141287974 >> 172.21.15.61:0/1141287974 conn(0x7f65f4097a10 msgr2=0x7f65f40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.783+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1141287974 shutdown_connections 2023-12-24T19:59:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.783+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1141287974 wait complete. 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.784+0000 7f65fb1f5700 1 Processor -- start 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.784+0000 7f65fb1f5700 1 -- start start 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.784+0000 7f65fb1f5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068140 0x7f65f4152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65fb1f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f4068510 0x7f65f416d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65fb1f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65f4159a60 0x7f65f416dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65fb1f5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f40997c0 con 0x7f65f4068140 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65fb1f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f409be30 con 0x7f65f4068510 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65fb1f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f409c110 con 0x7f65f4159a60 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f8f91700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068140 0x7f65f4152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f8f91700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068140 0x7f65f4152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57814/0 (socket says 172.21.15.61:57814) 2023-12-24T19:59:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f8f91700 1 -- 172.21.15.61:0/1718794511 learned_addr learned my addr 172.21.15.61:0/1718794511 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f9792700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65f4159a60 0x7f65f416dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f3fff700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f4068510 0x7f65f416d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f8f91700 1 -- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65f4159a60 msgr2=0x7f65f416dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f8f91700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65f4159a60 0x7f65f416dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f8f91700 1 -- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f4068510 msgr2=0x7f65f416d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f8f91700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f4068510 0x7f65f416d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f8f91700 1 -- 172.21.15.61:0/1718794511 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0009420 con 0x7f65f4068140 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f8f91700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068140 0x7f65f4152170 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f65e800c7e0 tx=0x7f65e8007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f0ff9700 1 -- 172.21.15.61:0/1718794511 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8007300 con 0x7f65f4068140 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f0ff9700 1 -- 172.21.15.61:0/1718794511 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8007460 con 0x7f65f4068140 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1718794511 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f4099450 con 0x7f65f4068140 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65f0ff9700 1 -- 172.21.15.61:0/1718794511 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e80057f0 con 0x7f65f4068140 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.785+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1718794511 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f416e100 con 0x7f65f4068140 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.786+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1718794511 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f416e350 con 0x7f65f4068140 2023-12-24T19:59:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.787+0000 7f65f0ff9700 1 -- 172.21.15.61:0/1718794511 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f65e8005c00 con 0x7f65f4068140 2023-12-24T19:59:12.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.787+0000 7f65f0ff9700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f65d8066f30 0x7f65d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:12.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.787+0000 7f65f0ff9700 1 -- 172.21.15.61:0/1718794511 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f65e80840b0 con 0x7f65f4068140 2023-12-24T19:59:12.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.787+0000 7f65f3fff700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f65d8066f30 0x7f65d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:12.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.788+0000 7f65f3fff700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f65d8066f30 0x7f65d80693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f65e00091e0 tx=0x7f65e0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:12.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:12.791+0000 7f65f0ff9700 1 -- 172.21.15.61:0/1718794511 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65e8051360 con 0x7f65f4068140 2023-12-24T19:59:13.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.033+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1718794511 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65f4099290 con 0x7f65f4068140 2023-12-24T19:59:13.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.034+0000 7f65f0ff9700 1 -- 172.21.15.61:0/1718794511 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f65e8054980 con 0x7f65f4068140 2023-12-24T19:59:13.034 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:13.034 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1254159834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1254159834},{"type":"v1","addr":"172.21.15.133:6835","nonce":1254159834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4078121613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4078121613},{"type":"v1","addr":"172.21.15.133:6837","nonce":4078121613}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/4252611526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":4252611526},{"type":"v1","addr":"172.21.15.61:6834","nonce":4252611526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:58:36.018348+0000","modified":"2023-12-24T19:58:39.583985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.61:6835/3976042512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3976042512},{"type":"v1","addr":"172.21.15.61:6835","nonce":3976042512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T19:59:13.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f65d8066f30 msgr2=0x7f65d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f65d8066f30 0x7f65d80693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f65e00091e0 tx=0x7f65e0017000 comp rx=0 tx=0).stop 2023-12-24T19:59:13.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1718794511 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068140 msgr2=0x7f65f4152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068140 0x7f65f4152170 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f65e800c7e0 tx=0x7f65e8007c80 comp rx=0 tx=0).stop 2023-12-24T19:59:13.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1718794511 shutdown_connections 2023-12-24T19:59:13.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65f4159a60 0x7f65f416dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f65d8066f30 0x7f65d80693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65f4068140 0x7f65f4152170 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 --2- 172.21.15.61:0/1718794511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65f4068510 0x7f65f416d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1718794511 >> 172.21.15.61:0/1718794511 conn(0x7f65f4097a10 msgr2=0x7f65f40b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:13.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1718794511 shutdown_connections 2023-12-24T19:59:13.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.036+0000 7f65fb1f5700 1 -- 172.21.15.61:0/1718794511 wait complete. 2023-12-24T19:59:13.039 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 26 2023-12-24T19:59:13.049 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:59:13.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.171+0000 7f37e503a700 1 Processor -- start 2023-12-24T19:59:13.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.172+0000 7f37e503a700 1 -- start start 2023-12-24T19:59:13.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.172+0000 7f37e503a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f37e00b2660 0x7f37e015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.172+0000 7f37e503a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 0x7f37e00b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.172+0000 7f37e503a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e00b2eb0 con 0x7f37e015bb60 2023-12-24T19:59:13.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.172+0000 7f37e503a700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e00afc20 con 0x7f37e00b2660 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.172+0000 7f37e503a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00b2bd0 con 0x7f37e015c470 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.172+0000 7f37de59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f37e00b2660 0x7f37e015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37de59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f37e00b2660 0x7f37e015bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57816/0 (socket says 172.21.15.61:57816) 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37de59c700 1 -- 172.21.15.61:0/3124513629 learned_addr learned my addr 172.21.15.61:0/3124513629 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37df59e700 1 --2- 172.21.15.61:0/3124513629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 0x7f37e00b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37de59c700 1 -- 172.21.15.61:0/3124513629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 msgr2=0x7f37e00b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37de59c700 1 --2- 172.21.15.61:0/3124513629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 0x7f37e00b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37de59c700 1 -- 172.21.15.61:0/3124513629 >> v1:172.21.15.133:6789/0 conn(0x7f37e015bb60 legacy=0x7f37e0098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37de59c700 1 -- 172.21.15.61:0/3124513629 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e00afe10 con 0x7f37e00b2660 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37de59c700 1 --2- 172.21.15.61:0/3124513629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 0x7f37e015bf30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f37d00099b0 tx=0x7f37d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4040a06124c1478b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37ddd9b700 1 -- 172.21.15.61:0/3124513629 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000b820 con 0x7f37e00b2660 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37ddd9b700 1 -- 172.21.15.61:0/3124513629 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000b980 con 0x7f37e00b2660 2023-12-24T19:59:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.173+0000 7f37ddd9b700 1 -- 172.21.15.61:0/3124513629 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000bd20 con 0x7f37e00b2660 2023-12-24T19:59:13.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.174+0000 7f37e503a700 1 -- 172.21.15.61:0/3124513629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 msgr2=0x7f37e015bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.174+0000 7f37e503a700 1 --2- 172.21.15.61:0/3124513629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 0x7f37e015bf30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f37d00099b0 tx=0x7f37d0009250 comp rx=0 tx=0).stop 2023-12-24T19:59:13.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.174+0000 7f37e503a700 1 -- 172.21.15.61:0/3124513629 shutdown_connections 2023-12-24T19:59:13.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.174+0000 7f37e503a700 1 --2- 172.21.15.61:0/3124513629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 0x7f37e00b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.174+0000 7f37e503a700 1 --2- 172.21.15.61:0/3124513629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 0x7f37e015bf30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.174+0000 7f37e503a700 1 -- 172.21.15.61:0/3124513629 >> 172.21.15.61:0/3124513629 conn(0x7f37e0097a10 msgr2=0x7f37e00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:13.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.174+0000 7f37e503a700 1 -- 172.21.15.61:0/3124513629 shutdown_connections 2023-12-24T19:59:13.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.174+0000 7f37e503a700 1 -- 172.21.15.61:0/3124513629 wait complete. 2023-12-24T19:59:13.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.175+0000 7f37e503a700 1 Processor -- start 2023-12-24T19:59:13.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.175+0000 7f37e503a700 1 -- start start 2023-12-24T19:59:13.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37e503a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 0x7f37e0152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37e503a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e015bb60 0x7f37e0167f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37e503a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 0x7f37e0168460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37e503a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e009a090 con 0x7f37e00b2660 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37e503a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e009aef0 con 0x7f37e015bb60 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37e503a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0152e90 con 0x7f37e015c470 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37ded9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 0x7f37e0152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37ded9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 0x7f37e0152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57830/0 (socket says 172.21.15.61:57830) 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37ded9d700 1 -- 172.21.15.61:0/67987130 learned_addr learned my addr 172.21.15.61:0/67987130 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37df59e700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 0x7f37e0168460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37de59c700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e015bb60 0x7f37e0167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37ded9d700 1 -- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 msgr2=0x7f37e0168460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37ded9d700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 0x7f37e0168460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37ded9d700 1 -- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e015bb60 msgr2=0x7f37e0167f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37ded9d700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e015bb60 0x7f37e0167f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37ded9d700 1 -- 172.21.15.61:0/67987130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00094f0 con 0x7f37e00b2660 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37df59e700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 0x7f37e0168460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37de59c700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e015bb60 0x7f37e0167f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.176+0000 7f37ded9d700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 0x7f37e0152950 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f37d400c5b0 tx=0x7f37d40020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:13.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.177+0000 7f37c6ffd700 1 -- 172.21.15.61:0/67987130 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4011590 con 0x7f37e00b2660 2023-12-24T19:59:13.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.177+0000 7f37c6ffd700 1 -- 172.21.15.61:0/67987130 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d40116f0 con 0x7f37e00b2660 2023-12-24T19:59:13.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.177+0000 7f37c6ffd700 1 -- 172.21.15.61:0/67987130 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4011a90 con 0x7f37e00b2660 2023-12-24T19:59:13.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.177+0000 7f37e503a700 1 -- 172.21.15.61:0/67987130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e009a2e0 con 0x7f37e00b2660 2023-12-24T19:59:13.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.177+0000 7f37e503a700 1 -- 172.21.15.61:0/67987130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e009a920 con 0x7f37e00b2660 2023-12-24T19:59:13.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.178+0000 7f37e503a700 1 -- 172.21.15.61:0/67987130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e009b1d0 con 0x7f37e00b2660 2023-12-24T19:59:13.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.178+0000 7f37c6ffd700 1 -- 172.21.15.61:0/67987130 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f37d4025430 con 0x7f37e00b2660 2023-12-24T19:59:13.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.179+0000 7f37c6ffd700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37cc066f30 0x7f37cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.179+0000 7f37c6ffd700 1 -- 172.21.15.61:0/67987130 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f37d4084b10 con 0x7f37e00b2660 2023-12-24T19:59:13.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.179+0000 7f37de59c700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37cc066f30 0x7f37cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.179+0000 7f37de59c700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37cc066f30 0x7f37cc0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f37d00099b0 tx=0x7f37d0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:13.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.183+0000 7f37c6ffd700 1 -- 172.21.15.61:0/67987130 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37d4051e70 con 0x7f37e00b2660 2023-12-24T19:59:13.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.424+0000 7f37e503a700 1 -- 172.21.15.61:0/67987130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37e006d440 con 0x7f37e00b2660 2023-12-24T19:59:13.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.425+0000 7f37c6ffd700 1 -- 172.21.15.61:0/67987130 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f37d4055490 con 0x7f37e00b2660 2023-12-24T19:59:13.425 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:13.425 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1254159834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1254159834},{"type":"v1","addr":"172.21.15.133:6835","nonce":1254159834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4078121613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4078121613},{"type":"v1","addr":"172.21.15.133:6837","nonce":4078121613}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/4252611526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":4252611526},{"type":"v1","addr":"172.21.15.61:6834","nonce":4252611526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:58:36.018348+0000","modified":"2023-12-24T19:58:39.583985+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.61:6835/3976042512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3976042512},{"type":"v1","addr":"172.21.15.61:6835","nonce":3976042512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-12-24T19:59:13.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.426+0000 7f37e503a700 1 -- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37cc066f30 msgr2=0x7f37cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.426+0000 7f37e503a700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37cc066f30 0x7f37cc0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f37d00099b0 tx=0x7f37d0016000 comp rx=0 tx=0).stop 2023-12-24T19:59:13.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.426+0000 7f37e503a700 1 -- 172.21.15.61:0/67987130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 msgr2=0x7f37e0152950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.426+0000 7f37e503a700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 0x7f37e0152950 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f37d400c5b0 tx=0x7f37d40020e0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.426+0000 7f37e503a700 1 -- 172.21.15.61:0/67987130 shutdown_connections 2023-12-24T19:59:13.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.426+0000 7f37e503a700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37e015c470 0x7f37e0168460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.426+0000 7f37e503a700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37cc066f30 0x7f37cc0693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.426+0000 7f37e503a700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37e00b2660 0x7f37e0152950 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.426+0000 7f37e503a700 1 --2- 172.21.15.61:0/67987130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e015bb60 0x7f37e0167f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.426+0000 7f37e503a700 1 -- 172.21.15.61:0/67987130 >> 172.21.15.61:0/67987130 conn(0x7f37e0097a10 msgr2=0x7f37e006c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:13.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.427+0000 7f37e503a700 1 -- 172.21.15.61:0/67987130 shutdown_connections 2023-12-24T19:59:13.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.427+0000 7f37e503a700 1 -- 172.21.15.61:0/67987130 wait complete. 2023-12-24T19:59:13.428 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 26 2023-12-24T19:59:13.439 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:59:13.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.561+0000 7fb8426ae700 1 Processor -- start 2023-12-24T19:59:13.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.561+0000 7fb8426ae700 1 -- start start 2023-12-24T19:59:13.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.561+0000 7fb8426ae700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb83c06b260 0x7fb83c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.561+0000 7fb8426ae700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c15bcd0 con 0x7fb83c06b630 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.561+0000 7fb8426ae700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c0cafb0 con 0x7fb83c070640 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.561+0000 7fb8426ae700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83c0683a0 con 0x7fb83c06b260 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb83c06b260 0x7fb83c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb83c06b260 0x7fb83c15c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57846/0 (socket says 172.21.15.61:57846) 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83b7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb83c06b630 0x7fb83c067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45886/0 (socket says 172.21.15.61:45886) 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83bfff700 1 -- 172.21.15.61:0/2726331232 learned_addr learned my addr 172.21.15.61:0/2726331232 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83bfff700 1 -- 172.21.15.61:0/2726331232 >> v1:172.21.15.133:6789/0 conn(0x7fb83c070640 legacy=0x7fb83c070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83bfff700 1 -- 172.21.15.61:0/2726331232 >> v1:172.21.15.61:6789/0 conn(0x7fb83c06b630 legacy=0x7fb83c067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83bfff700 1 -- 172.21.15.61:0/2726331232 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0680c0 con 0x7fb83c06b260 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83affd700 1 -- 172.21.15.61:0/2726331232 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233605943 0 0) 0x7fb83c15bcd0 con 0x7fb83c06b630 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83bfff700 1 --2- 172.21.15.61:0/2726331232 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c06b260 0x7fb83c15c160 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb8300099b0 tx=0x7fb830009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9b19918eeb3580 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83affd700 1 -- 172.21.15.61:0/2726331232 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000b820 con 0x7fb83c06b260 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83affd700 1 -- 172.21.15.61:0/2726331232 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83000b980 con 0x7fb83c06b260 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.562+0000 7fb83affd700 1 -- 172.21.15.61:0/2726331232 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000bd20 con 0x7fb83c06b260 2023-12-24T19:59:13.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.563+0000 7fb8426ae700 1 -- 172.21.15.61:0/2726331232 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c06b260 msgr2=0x7fb83c15c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.563+0000 7fb8426ae700 1 --2- 172.21.15.61:0/2726331232 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c06b260 0x7fb83c15c160 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb8300099b0 tx=0x7fb830009250 comp rx=0 tx=0).stop 2023-12-24T19:59:13.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.563+0000 7fb8426ae700 1 -- 172.21.15.61:0/2726331232 shutdown_connections 2023-12-24T19:59:13.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.563+0000 7fb8426ae700 1 --2- 172.21.15.61:0/2726331232 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c06b260 0x7fb83c15c160 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.563+0000 7fb8426ae700 1 -- 172.21.15.61:0/2726331232 >> 172.21.15.61:0/2726331232 conn(0x7fb83c0ca200 msgr2=0x7fb83c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:13.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.563+0000 7fb8426ae700 1 -- 172.21.15.61:0/2726331232 shutdown_connections 2023-12-24T19:59:13.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.563+0000 7fb8426ae700 1 -- 172.21.15.61:0/2726331232 wait complete. 2023-12-24T19:59:13.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.564+0000 7fb8426ae700 1 Processor -- start 2023-12-24T19:59:13.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.564+0000 7fb8426ae700 1 -- start start 2023-12-24T19:59:13.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb8426ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c06b260 0x7fb83c145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb8426ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb83c06b630 0x7fb83c0a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb8426ae700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c070640 0x7fb83c0aa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb8426ae700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c145fa0 con 0x7fb83c070640 2023-12-24T19:59:13.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb8426ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0aa890 con 0x7fb83c06b260 2023-12-24T19:59:13.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb8426ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0aab70 con 0x7fb83c06b630 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb840c4b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c070640 0x7fb83c0aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb840c4b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c070640 0x7fb83c0aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57862/0 (socket says 172.21.15.61:57862) 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb840c4b700 1 -- 172.21.15.61:0/3503967572 learned_addr learned my addr 172.21.15.61:0/3503967572 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb83b7fe700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb83c06b630 0x7fb83c0a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb83bfff700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c06b260 0x7fb83c145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb840c4b700 1 -- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb83c06b630 msgr2=0x7fb83c0a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb840c4b700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb83c06b630 0x7fb83c0a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb840c4b700 1 -- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c06b260 msgr2=0x7fb83c145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb840c4b700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c06b260 0x7fb83c145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb840c4b700 1 -- 172.21.15.61:0/3503967572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8300094f0 con 0x7fb83c070640 2023-12-24T19:59:13.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.565+0000 7fb83b7fe700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb83c06b630 0x7fb83c0a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:13.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.566+0000 7fb840c4b700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c070640 0x7fb83c0aa050 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb83400c890 tx=0x7fb8340026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:13.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.566+0000 7fb823fff700 1 -- 172.21.15.61:0/3503967572 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834012630 con 0x7fb83c070640 2023-12-24T19:59:13.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.566+0000 7fb823fff700 1 -- 172.21.15.61:0/3503967572 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb834012790 con 0x7fb83c070640 2023-12-24T19:59:13.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.566+0000 7fb8426ae700 1 -- 172.21.15.61:0/3503967572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c0aae50 con 0x7fb83c070640 2023-12-24T19:59:13.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.566+0000 7fb823fff700 1 -- 172.21.15.61:0/3503967572 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834012b50 con 0x7fb83c070640 2023-12-24T19:59:13.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.566+0000 7fb8426ae700 1 -- 172.21.15.61:0/3503967572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c0ab410 con 0x7fb83c070640 2023-12-24T19:59:13.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.567+0000 7fb8426ae700 1 -- 172.21.15.61:0/3503967572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c04c3c0 con 0x7fb83c070640 2023-12-24T19:59:13.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.567+0000 7fb823fff700 1 -- 172.21.15.61:0/3503967572 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb83400a420 con 0x7fb83c070640 2023-12-24T19:59:13.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.567+0000 7fb823fff700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb828066f30 0x7fb8280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.568+0000 7fb823fff700 1 -- 172.21.15.61:0/3503967572 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb834084950 con 0x7fb83c070640 2023-12-24T19:59:13.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.568+0000 7fb83bfff700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb828066f30 0x7fb8280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.568+0000 7fb83bfff700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb828066f30 0x7fb8280693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb8300099b0 tx=0x7fb830016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:13.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.572+0000 7fb823fff700 1 -- 172.21.15.61:0/3503967572 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb834051b80 con 0x7fb83c070640 2023-12-24T19:59:13.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.769+0000 7fb8426ae700 1 -- 172.21.15.61:0/3503967572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb83c06a8d0 con 0x7fb83c070640 2023-12-24T19:59:13.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.770+0000 7fb823fff700 1 -- 172.21.15.61:0/3503967572 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15446 (secure 0 0 0) 0x7fb83406be60 con 0x7fb83c070640 2023-12-24T19:59:13.770 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:13.770 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":51,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:59:04.664661+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:58:34.362437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-24T19:58:34.922413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.38","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:59:13.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.771+0000 7fb8426ae700 1 -- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb828066f30 msgr2=0x7fb8280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.771+0000 7fb8426ae700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb828066f30 0x7fb8280693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb8300099b0 tx=0x7fb830016000 comp rx=0 tx=0).stop 2023-12-24T19:59:13.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.772+0000 7fb8426ae700 1 -- 172.21.15.61:0/3503967572 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c070640 msgr2=0x7fb83c0aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.772+0000 7fb8426ae700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c070640 0x7fb83c0aa050 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb83400c890 tx=0x7fb8340026a0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.772+0000 7fb8426ae700 1 -- 172.21.15.61:0/3503967572 shutdown_connections 2023-12-24T19:59:13.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.772+0000 7fb8426ae700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb828066f30 0x7fb8280693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.772+0000 7fb8426ae700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83c070640 0x7fb83c0aa050 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.772+0000 7fb8426ae700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c06b260 0x7fb83c145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.772+0000 7fb8426ae700 1 --2- 172.21.15.61:0/3503967572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb83c06b630 0x7fb83c0a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.772+0000 7fb8426ae700 1 -- 172.21.15.61:0/3503967572 >> 172.21.15.61:0/3503967572 conn(0x7fb83c0ca200 msgr2=0x7fb83c1575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:13.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.772+0000 7fb8426ae700 1 -- 172.21.15.61:0/3503967572 shutdown_connections 2023-12-24T19:59:13.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.772+0000 7fb8426ae700 1 -- 172.21.15.61:0/3503967572 wait complete. 2023-12-24T19:59:13.786 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T19:59:13.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.909+0000 7f01411c3700 1 Processor -- start 2023-12-24T19:59:13.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.909+0000 7f01411c3700 1 -- start start 2023-12-24T19:59:13.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f01411c3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f013c0abfb0 0x7f013c0aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f01411c3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f013c159e10 0x7f013c0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f01411c3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f013c0c89f0 con 0x7f013c0cafd0 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f01411c3700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013c0abb90 con 0x7f013c0abfb0 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f01411c3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f013c0aaf10 con 0x7f013c159e10 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f013a59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f013c0abfb0 0x7f013c0aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f013a59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f013c0abfb0 0x7f013c0aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57876/0 (socket says 172.21.15.61:57876) 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f013a59c700 1 -- 172.21.15.61:0/3657475891 learned_addr learned my addr 172.21.15.61:0/3657475891 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f013b59e700 1 --2- 172.21.15.61:0/3657475891 >> v2:172.21.15.133:3300/0 conn(0x7f013c159e10 0x7f013c0c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f013a59c700 1 -- 172.21.15.61:0/3657475891 >> v2:172.21.15.133:3300/0 conn(0x7f013c159e10 msgr2=0x7f013c0c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f013a59c700 1 --2- 172.21.15.61:0/3657475891 >> v2:172.21.15.133:3300/0 conn(0x7f013c159e10 0x7f013c0c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f013a59c700 1 -- 172.21.15.61:0/3657475891 >> v1:172.21.15.133:6789/0 conn(0x7f013c0cafd0 legacy=0x7f013c159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f013a59c700 1 -- 172.21.15.61:0/3657475891 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f013c0ab1f0 con 0x7f013c0abfb0 2023-12-24T19:59:13.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.910+0000 7f013a59c700 1 --2- 172.21.15.61:0/3657475891 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0abfb0 0x7f013c0aa880 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f012c0099b0 tx=0x7f012c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbfb0f706f94431 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f0139d9b700 1 -- 172.21.15.61:0/3657475891 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c00b7e0 con 0x7f013c0abfb0 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f0139d9b700 1 -- 172.21.15.61:0/3657475891 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c00b940 con 0x7f013c0abfb0 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f0139d9b700 1 -- 172.21.15.61:0/3657475891 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c00bce0 con 0x7f013c0abfb0 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f01411c3700 1 -- 172.21.15.61:0/3657475891 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0abfb0 msgr2=0x7f013c0aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f01411c3700 1 --2- 172.21.15.61:0/3657475891 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0abfb0 0x7f013c0aa880 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f012c0099b0 tx=0x7f012c009250 comp rx=0 tx=0).stop 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f01411c3700 1 -- 172.21.15.61:0/3657475891 shutdown_connections 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f01411c3700 1 --2- 172.21.15.61:0/3657475891 >> v2:172.21.15.133:3300/0 conn(0x7f013c159e10 0x7f013c0c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f01411c3700 1 --2- 172.21.15.61:0/3657475891 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0abfb0 0x7f013c0aa880 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f01411c3700 1 -- 172.21.15.61:0/3657475891 >> 172.21.15.61:0/3657475891 conn(0x7f013c0cd090 msgr2=0x7f013c0cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f01411c3700 1 -- 172.21.15.61:0/3657475891 shutdown_connections 2023-12-24T19:59:13.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.911+0000 7f01411c3700 1 -- 172.21.15.61:0/3657475891 wait complete. 2023-12-24T19:59:13.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.912+0000 7f01411c3700 1 Processor -- start 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.913+0000 7f01411c3700 1 -- start start 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.913+0000 7f01411c3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f013c0abfb0 0x7f013c06b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.913+0000 7f01411c3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0cafd0 0x7f013c0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.913+0000 7f01411c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f013c159e10 0x7f013c0ac950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.913+0000 7f01411c3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c16d870 con 0x7f013c0cafd0 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.913+0000 7f01411c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013c16e0d0 con 0x7f013c159e10 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.913+0000 7f01411c3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013c06bbf0 con 0x7f013c0abfb0 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.913+0000 7f013a59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0cafd0 0x7f013c0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.913+0000 7f013a59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0cafd0 0x7f013c0b2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57882/0 (socket says 172.21.15.61:57882) 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.913+0000 7f013a59c700 1 -- 172.21.15.61:0/3234087387 learned_addr learned my addr 172.21.15.61:0/3234087387 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f013b59e700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f013c159e10 0x7f013c0ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f013ad9d700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f013c0abfb0 0x7f013c06b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f013a59c700 1 -- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f013c0abfb0 msgr2=0x7f013c06b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f013a59c700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f013c0abfb0 0x7f013c06b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f013a59c700 1 -- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f013c159e10 msgr2=0x7f013c0ac950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f013a59c700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f013c159e10 0x7f013c0ac950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f013a59c700 1 -- 172.21.15.61:0/3234087387 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c0094f0 con 0x7f013c0cafd0 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f013b59e700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f013c159e10 0x7f013c0ac950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f013a59c700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0cafd0 0x7f013c0b2230 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f013c0c4020 tx=0x7f012c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f0132ffd700 1 -- 172.21.15.61:0/3234087387 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c01b450 con 0x7f013c0cafd0 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f0132ffd700 1 -- 172.21.15.61:0/3234087387 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c020070 con 0x7f013c0cafd0 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f01411c3700 1 -- 172.21.15.61:0/3234087387 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013c16da80 con 0x7f013c0cafd0 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f0132ffd700 1 -- 172.21.15.61:0/3234087387 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c01b820 con 0x7f013c0cafd0 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.914+0000 7f01411c3700 1 -- 172.21.15.61:0/3234087387 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013c0af680 con 0x7f013c0cafd0 2023-12-24T19:59:13.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.915+0000 7f01411c3700 1 -- 172.21.15.61:0/3234087387 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013c16e260 con 0x7f013c0cafd0 2023-12-24T19:59:13.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.916+0000 7f0132ffd700 1 -- 172.21.15.61:0/3234087387 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f012c022030 con 0x7f013c0cafd0 2023-12-24T19:59:13.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.916+0000 7f0132ffd700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f011c066f30 0x7f011c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:13.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.916+0000 7f0132ffd700 1 -- 172.21.15.61:0/3234087387 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f012c086820 con 0x7f013c0cafd0 2023-12-24T19:59:13.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.917+0000 7f013ad9d700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f011c066f30 0x7f011c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:13.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.917+0000 7f013ad9d700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f011c066f30 0x7f011c0693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f01240099d0 tx=0x7f0124008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:13.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:13.920+0000 7f0132ffd700 1 -- 172.21.15.61:0/3234087387 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f012c053a30 con 0x7f013c0cafd0 2023-12-24T19:59:14.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.161+0000 7f01411c3700 1 -- 172.21.15.61:0/3234087387 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f013c0c89f0 con 0x7f013c0cafd0 2023-12-24T19:59:14.162 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T19:59:14.162+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T19:59:14.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.166+0000 7f0132ffd700 1 -- 172.21.15.61:0/3234087387 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f013c0c89f0 con 0x7f013c0cafd0 2023-12-24T19:59:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 -- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f011c066f30 msgr2=0x7f011c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f011c066f30 0x7f011c0693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f01240099d0 tx=0x7f0124008040 comp rx=0 tx=0).stop 2023-12-24T19:59:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 -- 172.21.15.61:0/3234087387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0cafd0 msgr2=0x7f013c0b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0cafd0 0x7f013c0b2230 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f013c0c4020 tx=0x7f012c016000 comp rx=0 tx=0).stop 2023-12-24T19:59:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 -- 172.21.15.61:0/3234087387 shutdown_connections 2023-12-24T19:59:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f013c0abfb0 0x7f013c06b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f011c066f30 0x7f011c0693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f013c159e10 0x7f013c0ac950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:14.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 --2- 172.21.15.61:0/3234087387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f013c0cafd0 0x7f013c0b2230 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:14.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 -- 172.21.15.61:0/3234087387 >> 172.21.15.61:0/3234087387 conn(0x7f013c0cd090 msgr2=0x7f013c0c33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:14.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 -- 172.21.15.61:0/3234087387 shutdown_connections 2023-12-24T19:59:14.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.169+0000 7f01411c3700 1 -- 172.21.15.61:0/3234087387 wait complete. 2023-12-24T19:59:14.171 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T19:59:14.171 INFO:tasks.ceph.mds.a.smithi061.stderr: -9325> 2023-12-24T19:58:41.087+0000 7fcf7d18c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T19:59:14.183 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T19:59:14.203 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T19:59:14.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.307+0000 7f607564f700 1 Processor -- start 2023-12-24T19:59:14.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.307+0000 7f607564f700 1 -- start start 2023-12-24T19:59:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.308+0000 7f607564f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f607015a030 0x7f6070070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.308+0000 7f607564f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60700c4710 con 0x7f6070068b10 2023-12-24T19:59:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.308+0000 7f607564f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607006b190 con 0x7f6070159c60 2023-12-24T19:59:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.308+0000 7f607564f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607006a5c0 con 0x7f607015a030 2023-12-24T19:59:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.308+0000 7f606e7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f607015a030 0x7f6070070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.308+0000 7f606f7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f6070068b10 0x7f60700c8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45900/0 (socket says 172.21.15.61:45900) 2023-12-24T19:59:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.308+0000 7f606f7fe700 1 -- 172.21.15.61:0/2524390726 learned_addr learned my addr 172.21.15.61:0/2524390726 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.308+0000 7f606e7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f607015a030 0x7f6070070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57902/0 (socket says 172.21.15.61:57902) 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.309+0000 7f606e7fc700 1 -- 172.21.15.61:0/2524390726 >> v1:172.21.15.133:6789/0 conn(0x7f6070159c60 legacy=0x7f60700c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.309+0000 7f606e7fc700 1 -- 172.21.15.61:0/2524390726 >> v1:172.21.15.61:6789/0 conn(0x7f6070068b10 legacy=0x7f60700c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.309+0000 7f606e7fc700 1 -- 172.21.15.61:0/2524390726 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607006a860 con 0x7f607015a030 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.309+0000 7f606dffb700 1 -- 172.21.15.61:0/2524390726 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209153057 0 0) 0x7f6068001490 con 0x7f6070068b10 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.309+0000 7f606e7fc700 1 --2- 172.21.15.61:0/2524390726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f607015a030 0x7f6070070640 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f60600098e0 tx=0x7f60600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc171375eda4745b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.309+0000 7f606dffb700 1 -- 172.21.15.61:0/2524390726 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6060009e80 con 0x7f607015a030 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.309+0000 7f606dffb700 1 -- 172.21.15.61:0/2524390726 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606000b820 con 0x7f607015a030 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.309+0000 7f606dffb700 1 -- 172.21.15.61:0/2524390726 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606000bba0 con 0x7f607015a030 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.310+0000 7f607564f700 1 -- 172.21.15.61:0/2524390726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f607015a030 msgr2=0x7f6070070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.310+0000 7f607564f700 1 --2- 172.21.15.61:0/2524390726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f607015a030 0x7f6070070640 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f60600098e0 tx=0x7f60600091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.310+0000 7f607564f700 1 -- 172.21.15.61:0/2524390726 shutdown_connections 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.310+0000 7f607564f700 1 --2- 172.21.15.61:0/2524390726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f607015a030 0x7f6070070640 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.310+0000 7f607564f700 1 -- 172.21.15.61:0/2524390726 >> 172.21.15.61:0/2524390726 conn(0x7f60700ce420 msgr2=0x7f60700ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.310+0000 7f607564f700 1 -- 172.21.15.61:0/2524390726 shutdown_connections 2023-12-24T19:59:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.310+0000 7f607564f700 1 -- 172.21.15.61:0/2524390726 wait complete. 2023-12-24T19:59:14.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.311+0000 7f607564f700 1 Processor -- start 2023-12-24T19:59:14.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.311+0000 7f607564f700 1 -- start start 2023-12-24T19:59:14.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f607564f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6070068b10 0x7f60700c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:14.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f607564f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6070159c60 0x7f6070158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:14.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f607564f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f607015a030 0x7f607015f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:14.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f607564f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607015aeb0 con 0x7f6070068b10 2023-12-24T19:59:14.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f607564f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607015a5a0 con 0x7f607015a030 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f607564f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607015a860 con 0x7f6070159c60 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6070068b10 0x7f60700c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6070068b10 0x7f60700c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57916/0 (socket says 172.21.15.61:57916) 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606effd700 1 -- 172.21.15.61:0/616133112 learned_addr learned my addr 172.21.15.61:0/616133112 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606f7fe700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f607015a030 0x7f607015f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606e7fc700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6070159c60 0x7f6070158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606effd700 1 -- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6070159c60 msgr2=0x7f6070158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606effd700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6070159c60 0x7f6070158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606effd700 1 -- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f607015a030 msgr2=0x7f607015f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606effd700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f607015a030 0x7f607015f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606effd700 1 -- 172.21.15.61:0/616133112 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6060009420 con 0x7f6070068b10 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606f7fe700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f607015a030 0x7f607015f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f606effd700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6070068b10 0x7f60700c84d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f605800c5d0 tx=0x7f6058007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f6066ffd700 1 -- 172.21.15.61:0/616133112 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058011590 con 0x7f6070068b10 2023-12-24T19:59:14.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.312+0000 7f6066ffd700 1 -- 172.21.15.61:0/616133112 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058011710 con 0x7f6070068b10 2023-12-24T19:59:14.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.313+0000 7f6066ffd700 1 -- 172.21.15.61:0/616133112 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058011ad0 con 0x7f6070068b10 2023-12-24T19:59:14.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.313+0000 7f607564f700 1 -- 172.21.15.61:0/616133112 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607015ab40 con 0x7f6070068b10 2023-12-24T19:59:14.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.313+0000 7f607564f700 1 -- 172.21.15.61:0/616133112 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60701593c0 con 0x7f6070068b10 2023-12-24T19:59:14.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.313+0000 7f607564f700 1 -- 172.21.15.61:0/616133112 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607015b190 con 0x7f6070068b10 2023-12-24T19:59:14.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.314+0000 7f6066ffd700 1 -- 172.21.15.61:0/616133112 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f605801c460 con 0x7f6070068b10 2023-12-24T19:59:14.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.314+0000 7f6066ffd700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6050066f30 0x7f60500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:14.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.314+0000 7f6066ffd700 1 -- 172.21.15.61:0/616133112 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f6058084320 con 0x7f6070068b10 2023-12-24T19:59:14.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.315+0000 7f606e7fc700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6050066f30 0x7f60500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:14.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.315+0000 7f606e7fc700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6050066f30 0x7f60500693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f60600030c0 tx=0x7f6060016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:14.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.318+0000 7f6066ffd700 1 -- 172.21.15.61:0/616133112 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6058051500 con 0x7f6070068b10 2023-12-24T19:59:14.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:14.565+0000 7f607564f700 1 -- 172.21.15.61:0/616133112 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f607004c3c0 con 0x7f6070068b10 2023-12-24T19:59:15.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.170+0000 7f6066ffd700 1 -- 172.21.15.61:0/616133112 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6058054b20 con 0x7f6070068b10 2023-12-24T19:59:15.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 -- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6050066f30 msgr2=0x7f60500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:15.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6050066f30 0x7f60500693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f60600030c0 tx=0x7f6060016000 comp rx=0 tx=0).stop 2023-12-24T19:59:15.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 -- 172.21.15.61:0/616133112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6070068b10 msgr2=0x7f60700c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:15.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6070068b10 0x7f60700c84d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f605800c5d0 tx=0x7f6058007f60 comp rx=0 tx=0).stop 2023-12-24T19:59:15.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 -- 172.21.15.61:0/616133112 shutdown_connections 2023-12-24T19:59:15.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6050066f30 0x7f60500693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:15.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f607015a030 0x7f607015f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:15.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6070068b10 0x7f60700c84d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:15.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 --2- 172.21.15.61:0/616133112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6070159c60 0x7f6070158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:15.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 -- 172.21.15.61:0/616133112 >> 172.21.15.61:0/616133112 conn(0x7f60700ce420 msgr2=0x7f60700c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:15.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 -- 172.21.15.61:0/616133112 shutdown_connections 2023-12-24T19:59:15.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.173+0000 7f607564f700 1 -- 172.21.15.61:0/616133112 wait complete. 2023-12-24T19:59:15.187 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T19:59:15.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.356+0000 7ff5d966e700 1 Processor -- start 2023-12-24T19:59:15.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.356+0000 7ff5d966e700 1 -- start start 2023-12-24T19:59:15.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.357+0000 7ff5d966e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5d4159bf0 0x7ff5d40ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:15.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.357+0000 7ff5d966e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d406b2c0 0x7ff5d40c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:15.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.357+0000 7ff5d966e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d40c8d70 con 0x7ff5d40ae8f0 2023-12-24T19:59:15.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.357+0000 7ff5d966e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d4159fc0 con 0x7ff5d4159bf0 2023-12-24T19:59:15.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.357+0000 7ff5d966e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40c9610 con 0x7ff5d406b2c0 2023-12-24T19:59:15.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d37fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d406b2c0 0x7ff5d40c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:15.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d27fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff5d40ae8f0 0x7ff5d406abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:59148/0 (socket says 172.21.15.61:59148) 2023-12-24T19:59:15.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d27fc700 1 -- 172.21.15.61:0/2360863860 learned_addr learned my addr 172.21.15.61:0/2360863860 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:15.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5d4159bf0 0x7ff5d40ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d2ffd700 1 -- 172.21.15.61:0/2360863860 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d406b2c0 msgr2=0x7ff5d40c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d2ffd700 1 --2- 172.21.15.61:0/2360863860 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d406b2c0 0x7ff5d40c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d2ffd700 1 -- 172.21.15.61:0/2360863860 >> v1:172.21.15.133:6789/0 conn(0x7ff5d40ae8f0 legacy=0x7ff5d406abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d1ffb700 1 -- 172.21.15.61:0/2360863860 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272220052 0 0) 0x7ff5d40c8d70 con 0x7ff5d40ae8f0 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d2ffd700 1 -- 172.21.15.61:0/2360863860 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40aee00 con 0x7ff5d4159bf0 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d37fe700 1 --2- 172.21.15.61:0/2360863860 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d406b2c0 0x7ff5d40c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.358+0000 7ff5d2ffd700 1 --2- 172.21.15.61:0/2360863860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d4159bf0 0x7ff5d40ae3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0098e0 tx=0x7ff5bc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e70b081d6e5b3028 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d1ffb700 1 -- 172.21.15.61:0/2360863860 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00b640 con 0x7ff5d4159bf0 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d1ffb700 1 -- 172.21.15.61:0/2360863860 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc00b7a0 con 0x7ff5d4159bf0 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d1ffb700 1 -- 172.21.15.61:0/2360863860 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00bb40 con 0x7ff5d4159bf0 2023-12-24T19:59:15.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d966e700 1 -- 172.21.15.61:0/2360863860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d4159bf0 msgr2=0x7ff5d40ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:15.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d966e700 1 --2- 172.21.15.61:0/2360863860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d4159bf0 0x7ff5d40ae3b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0098e0 tx=0x7ff5bc0091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:15.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d966e700 1 -- 172.21.15.61:0/2360863860 shutdown_connections 2023-12-24T19:59:15.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d966e700 1 --2- 172.21.15.61:0/2360863860 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d406b2c0 0x7ff5d40c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:15.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d966e700 1 --2- 172.21.15.61:0/2360863860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d4159bf0 0x7ff5d40ae3b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:15.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d966e700 1 -- 172.21.15.61:0/2360863860 >> 172.21.15.61:0/2360863860 conn(0x7ff5d40ce7d0 msgr2=0x7ff5d40cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:15.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d966e700 1 -- 172.21.15.61:0/2360863860 shutdown_connections 2023-12-24T19:59:15.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.359+0000 7ff5d966e700 1 -- 172.21.15.61:0/2360863860 wait complete. 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.360+0000 7ff5d966e700 1 Processor -- start 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.360+0000 7ff5d966e700 1 -- start start 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d966e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5d406b2c0 0x7ff5d4158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d966e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d40ae8f0 0x7ff5d4068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d966e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d4159bf0 0x7ff5d4069110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d966e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40b22a0 con 0x7ff5d406b2c0 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d966e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4159250 con 0x7ff5d40ae8f0 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d966e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40abcb0 con 0x7ff5d4159bf0 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5d406b2c0 0x7ff5d4158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5d406b2c0 0x7ff5d4158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57918/0 (socket says 172.21.15.61:57918) 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d2ffd700 1 -- 172.21.15.61:0/3010400171 learned_addr learned my addr 172.21.15.61:0/3010400171 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:15.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d27fc700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d40ae8f0 0x7ff5d4068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.361+0000 7ff5d37fe700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d4159bf0 0x7ff5d4069110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5d2ffd700 1 -- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d4159bf0 msgr2=0x7ff5d4069110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5d2ffd700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d4159bf0 0x7ff5d4069110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5d2ffd700 1 -- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d40ae8f0 msgr2=0x7ff5d4068bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5d2ffd700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d40ae8f0 0x7ff5d4068bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5d2ffd700 1 -- 172.21.15.61:0/3010400171 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc009a20 con 0x7ff5d406b2c0 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5d2ffd700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5d406b2c0 0x7ff5d4158d10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0093f0 tx=0x7ff5bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5caffd700 1 -- 172.21.15.61:0/3010400171 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00bb20 con 0x7ff5d406b2c0 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5caffd700 1 -- 172.21.15.61:0/3010400171 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc011420 con 0x7ff5d406b2c0 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5caffd700 1 -- 172.21.15.61:0/3010400171 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc011820 con 0x7ff5d406b2c0 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5d966e700 1 -- 172.21.15.61:0/3010400171 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc009420 con 0x7ff5d406b2c0 2023-12-24T19:59:15.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.362+0000 7ff5d966e700 1 -- 172.21.15.61:0/3010400171 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d40ac270 con 0x7ff5d406b2c0 2023-12-24T19:59:15.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.363+0000 7ff5d966e700 1 -- 172.21.15.61:0/3010400171 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d404c3c0 con 0x7ff5d406b2c0 2023-12-24T19:59:15.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.363+0000 7ff5caffd700 1 -- 172.21.15.61:0/3010400171 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff5bc011c50 con 0x7ff5d406b2c0 2023-12-24T19:59:15.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.364+0000 7ff5caffd700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff5b4066f30 0x7ff5b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:15.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.364+0000 7ff5caffd700 1 -- 172.21.15.61:0/3010400171 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5849+0+0 (secure 0 0 0) 0x7ff5bc085d40 con 0x7ff5d406b2c0 2023-12-24T19:59:15.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.364+0000 7ff5d27fc700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff5b4066f30 0x7ff5b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:15.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.364+0000 7ff5d27fc700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff5b4066f30 0x7ff5b40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40c86b0 tx=0x7ff5c4007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:15.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.368+0000 7ff5caffd700 1 -- 172.21.15.61:0/3010400171 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5bc052fe0 con 0x7ff5d406b2c0 2023-12-24T19:59:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:15.564+0000 7ff5d966e700 1 -- 172.21.15.61:0/3010400171 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff5d40709b0 con 0x7ff5d406b2c0 2023-12-24T19:59:16.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.173+0000 7ff5caffd700 1 -- 172.21.15.61:0/3010400171 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff5bc056600 con 0x7ff5d406b2c0 2023-12-24T19:59:16.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.175+0000 7ff5d966e700 1 -- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff5b4066f30 msgr2=0x7ff5b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:16.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.175+0000 7ff5d966e700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff5b4066f30 0x7ff5b40693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40c86b0 tx=0x7ff5c4007d30 comp rx=0 tx=0).stop 2023-12-24T19:59:16.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.176+0000 7ff5d966e700 1 -- 172.21.15.61:0/3010400171 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5d406b2c0 msgr2=0x7ff5d4158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:16.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.176+0000 7ff5d966e700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5d406b2c0 0x7ff5d4158d10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0093f0 tx=0x7ff5bc017000 comp rx=0 tx=0).stop 2023-12-24T19:59:16.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.176+0000 7ff5d966e700 1 -- 172.21.15.61:0/3010400171 shutdown_connections 2023-12-24T19:59:16.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.176+0000 7ff5d966e700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff5d4159bf0 0x7ff5d4069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:16.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.176+0000 7ff5d966e700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff5b4066f30 0x7ff5b40693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:16.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.176+0000 7ff5d966e700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5d406b2c0 0x7ff5d4158d10 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:16.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.176+0000 7ff5d966e700 1 --2- 172.21.15.61:0/3010400171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d40ae8f0 0x7ff5d4068bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:16.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.176+0000 7ff5d966e700 1 -- 172.21.15.61:0/3010400171 >> 172.21.15.61:0/3010400171 conn(0x7ff5d40ce7d0 msgr2=0x7ff5d415c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:16.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.176+0000 7ff5d966e700 1 -- 172.21.15.61:0/3010400171 shutdown_connections 2023-12-24T19:59:16.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.176+0000 7ff5d966e700 1 -- 172.21.15.61:0/3010400171 wait complete. 2023-12-24T19:59:16.178 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T19:59:16.190 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T19:59:16.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.318+0000 7f4100fe4700 1 Processor -- start 2023-12-24T19:59:16.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.318+0000 7f4100fe4700 1 -- start start 2023-12-24T19:59:16.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.319+0000 7f4100fe4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f40fc0cc350 0x7f40fc069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:16.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.319+0000 7f4100fe4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40fc06a9b0 0x7f40fc0c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:16.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.319+0000 7f4100fe4700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc0c81a0 con 0x7f40fc1567b0 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.319+0000 7f4100fe4700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc06a4f0 con 0x7f40fc0cc350 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.319+0000 7f4100fe4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc0c8a20 con 0x7f40fc06a9b0 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.319+0000 7f40f1d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f40fc0cc350 0x7f40fc069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.319+0000 7f40f1d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f40fc0cc350 0x7f40fc069aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57920/0 (socket says 172.21.15.61:57920) 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.319+0000 7f40fa59c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f40fc1567b0 0x7f40fc0cbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45908/0 (socket says 172.21.15.61:45908) 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.319+0000 7f40f1d9b700 1 -- 172.21.15.61:0/3580157446 learned_addr learned my addr 172.21.15.61:0/3580157446 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40f1d9b700 1 -- 172.21.15.61:0/3580157446 >> v2:172.21.15.133:3300/0 conn(0x7f40fc06a9b0 msgr2=0x7f40fc0c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40fad9d700 1 --2- 172.21.15.61:0/3580157446 >> v2:172.21.15.133:3300/0 conn(0x7f40fc06a9b0 0x7f40fc0c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40f9d9b700 1 -- 172.21.15.61:0/3580157446 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872515776 0 0) 0x7f40fc0c81a0 con 0x7f40fc1567b0 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40f1d9b700 1 --2- 172.21.15.61:0/3580157446 >> v2:172.21.15.133:3300/0 conn(0x7f40fc06a9b0 0x7f40fc0c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40f1d9b700 1 -- 172.21.15.61:0/3580157446 >> v1:172.21.15.61:6789/0 conn(0x7f40fc1567b0 legacy=0x7f40fc0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40f1d9b700 1 -- 172.21.15.61:0/3580157446 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc069fe0 con 0x7f40fc0cc350 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40fad9d700 1 --2- 172.21.15.61:0/3580157446 >> v2:172.21.15.133:3300/0 conn(0x7f40fc06a9b0 0x7f40fc0c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:16.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40f1d9b700 1 --2- 172.21.15.61:0/3580157446 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 0x7f40fc069aa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f40fc06da10 tx=0x7f40e400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfcd89663ed570b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40f9d9b700 1 -- 172.21.15.61:0/3580157446 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400dc50 con 0x7f40fc0cc350 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40f9d9b700 1 -- 172.21.15.61:0/3580157446 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e400ddb0 con 0x7f40fc0cc350 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f40f9d9b700 1 -- 172.21.15.61:0/3580157446 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40196d0 con 0x7f40fc0cc350 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.320+0000 7f4100fe4700 1 -- 172.21.15.61:0/3580157446 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 msgr2=0x7f40fc069aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.321+0000 7f4100fe4700 1 --2- 172.21.15.61:0/3580157446 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 0x7f40fc069aa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f40fc06da10 tx=0x7f40e400b4f0 comp rx=0 tx=0).stop 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.321+0000 7f4100fe4700 1 -- 172.21.15.61:0/3580157446 shutdown_connections 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.321+0000 7f4100fe4700 1 --2- 172.21.15.61:0/3580157446 >> v2:172.21.15.133:3300/0 conn(0x7f40fc06a9b0 0x7f40fc0c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.321+0000 7f4100fe4700 1 --2- 172.21.15.61:0/3580157446 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 0x7f40fc069aa0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.321+0000 7f4100fe4700 1 -- 172.21.15.61:0/3580157446 >> 172.21.15.61:0/3580157446 conn(0x7f40fc0ce1a0 msgr2=0x7f40fc0ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.321+0000 7f4100fe4700 1 -- 172.21.15.61:0/3580157446 shutdown_connections 2023-12-24T19:59:16.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.321+0000 7f4100fe4700 1 -- 172.21.15.61:0/3580157446 wait complete. 2023-12-24T19:59:16.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.322+0000 7f4100fe4700 1 Processor -- start 2023-12-24T19:59:16.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.322+0000 7f4100fe4700 1 -- start start 2023-12-24T19:59:16.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f4100fe4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40fc06a9b0 0x7f40fc15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:16.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f4100fe4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 0x7f40fc0b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:16.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f4100fe4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40fc1567b0 0x7f40fc0afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:16.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f4100fe4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0b2a10 con 0x7f40fc0cc350 2023-12-24T19:59:16.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f4100fe4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc157f00 con 0x7f40fc1567b0 2023-12-24T19:59:16.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f4100fe4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0b1e00 con 0x7f40fc06a9b0 2023-12-24T19:59:16.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f1d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 0x7f40fc0b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f1d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 0x7f40fc0b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57928/0 (socket says 172.21.15.61:57928) 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f1d9b700 1 -- 172.21.15.61:0/3111563567 learned_addr learned my addr 172.21.15.61:0/3111563567 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40fad9d700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40fc1567b0 0x7f40fc0afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40fa59c700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40fc06a9b0 0x7f40fc15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f1d9b700 1 -- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40fc06a9b0 msgr2=0x7f40fc15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f1d9b700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40fc06a9b0 0x7f40fc15a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f1d9b700 1 -- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40fc1567b0 msgr2=0x7f40fc0afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f1d9b700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40fc1567b0 0x7f40fc0afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f1d9b700 1 -- 172.21.15.61:0/3111563567 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e400b790 con 0x7f40fc0cc350 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f1d9b700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 0x7f40fc0b1770 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f40e4006fd0 tx=0x7f40e401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f2ffd700 1 -- 172.21.15.61:0/3111563567 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4010470 con 0x7f40fc0cc350 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f2ffd700 1 -- 172.21.15.61:0/3111563567 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40105d0 con 0x7f40fc0cc350 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f4100fe4700 1 -- 172.21.15.61:0/3111563567 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc0b20e0 con 0x7f40fc0cc350 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f40f2ffd700 1 -- 172.21.15.61:0/3111563567 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4010990 con 0x7f40fc0cc350 2023-12-24T19:59:16.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.323+0000 7f4100fe4700 1 -- 172.21.15.61:0/3111563567 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc0b26a0 con 0x7f40fc0cc350 2023-12-24T19:59:16.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.324+0000 7f4100fe4700 1 -- 172.21.15.61:0/3111563567 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc04c3c0 con 0x7f40fc0cc350 2023-12-24T19:59:16.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.325+0000 7f40f2ffd700 1 -- 172.21.15.61:0/3111563567 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f40e4022030 con 0x7f40fc0cc350 2023-12-24T19:59:16.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.325+0000 7f40f2ffd700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40dc066f30 0x7f40dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:16.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.325+0000 7f40f2ffd700 1 -- 172.21.15.61:0/3111563567 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f40e4014070 con 0x7f40fc0cc350 2023-12-24T19:59:16.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.325+0000 7f40fa59c700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40dc066f30 0x7f40dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:16.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.326+0000 7f40fa59c700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40dc066f30 0x7f40dc0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f40ec007fd0 tx=0x7f40ec007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:16.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.329+0000 7f40f2ffd700 1 -- 172.21.15.61:0/3111563567 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40e40559f0 con 0x7f40fc0cc350 2023-12-24T19:59:16.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:16.526+0000 7f4100fe4700 1 -- 172.21.15.61:0/3111563567 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f40fc0b2b50 con 0x7f40fc0cc350 2023-12-24T19:59:17.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.179+0000 7f40f2ffd700 1 -- 172.21.15.61:0/3111563567 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7f40e4059010 con 0x7f40fc0cc350 2023-12-24T19:59:17.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.181+0000 7f4100fe4700 1 -- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40dc066f30 msgr2=0x7f40dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:17.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.181+0000 7f4100fe4700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40dc066f30 0x7f40dc0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f40ec007fd0 tx=0x7f40ec007e10 comp rx=0 tx=0).stop 2023-12-24T19:59:17.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.181+0000 7f4100fe4700 1 -- 172.21.15.61:0/3111563567 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 msgr2=0x7f40fc0b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:17.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.181+0000 7f4100fe4700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 0x7f40fc0b1770 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f40e4006fd0 tx=0x7f40e401b000 comp rx=0 tx=0).stop 2023-12-24T19:59:17.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.181+0000 7f4100fe4700 1 -- 172.21.15.61:0/3111563567 shutdown_connections 2023-12-24T19:59:17.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.181+0000 7f4100fe4700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40fc06a9b0 0x7f40fc15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.181+0000 7f4100fe4700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40dc066f30 0x7f40dc0693e0 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f40ec007fd0 tx=0x7f40ec007e10 comp rx=0 tx=0).stop 2023-12-24T19:59:17.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.181+0000 7f4100fe4700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40fc1567b0 0x7f40fc0afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.181+0000 7f4100fe4700 1 --2- 172.21.15.61:0/3111563567 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40fc0cc350 0x7f40fc0b1770 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.181+0000 7f4100fe4700 1 -- 172.21.15.61:0/3111563567 >> 172.21.15.61:0/3111563567 conn(0x7f40fc0ce1a0 msgr2=0x7f40fc0c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:17.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.182+0000 7f4100fe4700 1 -- 172.21.15.61:0/3111563567 shutdown_connections 2023-12-24T19:59:17.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.182+0000 7f4100fe4700 1 -- 172.21.15.61:0/3111563567 wait complete. 2023-12-24T19:59:17.183 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T19:59:17.197 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T19:59:17.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.327+0000 7fb675aca700 1 Processor -- start 2023-12-24T19:59:17.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.327+0000 7fb675aca700 1 -- start start 2023-12-24T19:59:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.328+0000 7fb675aca700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb6700af330 0x7fb67006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.328+0000 7fb675aca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb67006b150 0x7fb6700c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.328+0000 7fb675aca700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6700caf30 con 0x7fb6701578d0 2023-12-24T19:59:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.328+0000 7fb675aca700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6700af7d0 con 0x7fb6700af330 2023-12-24T19:59:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.328+0000 7fb675aca700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67006b570 con 0x7fb67006b150 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.328+0000 7fb66effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb6700af330 0x7fb67006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.328+0000 7fb66effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb6700af330 0x7fb67006ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33070/0 (socket says 172.21.15.61:33070) 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.328+0000 7fb66effd700 1 -- 172.21.15.61:0/1040738496 learned_addr learned my addr 172.21.15.61:0/1040738496 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb66ffff700 1 --2- 172.21.15.61:0/1040738496 >> v2:172.21.15.133:3300/0 conn(0x7fb67006b150 0x7fb6700c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb66effd700 1 -- 172.21.15.61:0/1040738496 >> v2:172.21.15.133:3300/0 conn(0x7fb67006b150 msgr2=0x7fb6700c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb66effd700 1 --2- 172.21.15.61:0/1040738496 >> v2:172.21.15.133:3300/0 conn(0x7fb67006b150 0x7fb6700c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb66effd700 1 -- 172.21.15.61:0/1040738496 >> v1:172.21.15.133:6789/0 conn(0x7fb6701578d0 legacy=0x7fb67006f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb66effd700 1 -- 172.21.15.61:0/1040738496 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6700af9f0 con 0x7fb6700af330 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb66effd700 1 --2- 172.21.15.61:0/1040738496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6700af330 0x7fb67006ac10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb6700aeb90 tx=0x7fb658009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d3e491f3371f38 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb66e7fc700 1 -- 172.21.15.61:0/1040738496 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800b820 con 0x7fb6700af330 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb66e7fc700 1 -- 172.21.15.61:0/1040738496 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65800b980 con 0x7fb6700af330 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb66e7fc700 1 -- 172.21.15.61:0/1040738496 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800bd20 con 0x7fb6700af330 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb675aca700 1 -- 172.21.15.61:0/1040738496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6700af330 msgr2=0x7fb67006ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.329+0000 7fb675aca700 1 --2- 172.21.15.61:0/1040738496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6700af330 0x7fb67006ac10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb6700aeb90 tx=0x7fb658009250 comp rx=0 tx=0).stop 2023-12-24T19:59:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.330+0000 7fb675aca700 1 -- 172.21.15.61:0/1040738496 shutdown_connections 2023-12-24T19:59:17.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.330+0000 7fb675aca700 1 --2- 172.21.15.61:0/1040738496 >> v2:172.21.15.133:3300/0 conn(0x7fb67006b150 0x7fb6700c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.330+0000 7fb675aca700 1 --2- 172.21.15.61:0/1040738496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6700af330 0x7fb67006ac10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.330+0000 7fb675aca700 1 -- 172.21.15.61:0/1040738496 >> 172.21.15.61:0/1040738496 conn(0x7fb6700ce800 msgr2=0x7fb6700cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:17.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.330+0000 7fb675aca700 1 -- 172.21.15.61:0/1040738496 shutdown_connections 2023-12-24T19:59:17.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.330+0000 7fb675aca700 1 -- 172.21.15.61:0/1040738496 wait complete. 2023-12-24T19:59:17.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.331+0000 7fb675aca700 1 Processor -- start 2023-12-24T19:59:17.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.331+0000 7fb675aca700 1 -- start start 2023-12-24T19:59:17.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb675aca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb67006b150 0x7fb6700b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb675aca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700af330 0x7fb6700b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb675aca700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6701578d0 0x7fb670167b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb675aca700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6701555d0 con 0x7fb6701578d0 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb675aca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6700b1990 con 0x7fb6700af330 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb675aca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6700b1c70 con 0x7fb67006b150 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6701578d0 0x7fb670167b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6701578d0 0x7fb670167b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33078/0 (socket says 172.21.15.61:33078) 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66ffff700 1 -- 172.21.15.61:0/26585404 learned_addr learned my addr 172.21.15.61:0/26585404 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66effd700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700af330 0x7fb6700b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66f7fe700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb67006b150 0x7fb6700b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66ffff700 1 -- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb67006b150 msgr2=0x7fb6700b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66ffff700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb67006b150 0x7fb6700b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66ffff700 1 -- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700af330 msgr2=0x7fb6700b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66ffff700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700af330 0x7fb6700b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66ffff700 1 -- 172.21.15.61:0/26585404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6580094f0 con 0x7fb6701578d0 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb66ffff700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6701578d0 0x7fb670167b70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb668009fd0 tx=0x7fb668009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb6677fe700 1 -- 172.21.15.61:0/26585404 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66800eca0 con 0x7fb6701578d0 2023-12-24T19:59:17.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb6677fe700 1 -- 172.21.15.61:0/26585404 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66800ee00 con 0x7fb6701578d0 2023-12-24T19:59:17.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb675aca700 1 -- 172.21.15.61:0/26585404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb670168660 con 0x7fb6701578d0 2023-12-24T19:59:17.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.332+0000 7fb6677fe700 1 -- 172.21.15.61:0/26585404 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb668014670 con 0x7fb6701578d0 2023-12-24T19:59:17.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.333+0000 7fb675aca700 1 -- 172.21.15.61:0/26585404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb670168c20 con 0x7fb6701578d0 2023-12-24T19:59:17.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.333+0000 7fb675aca700 1 -- 172.21.15.61:0/26585404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67004c3c0 con 0x7fb6701578d0 2023-12-24T19:59:17.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.334+0000 7fb6677fe700 1 -- 172.21.15.61:0/26585404 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb6680149e0 con 0x7fb6701578d0 2023-12-24T19:59:17.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.334+0000 7fb6677fe700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb650066f30 0x7fb6500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.334+0000 7fb6677fe700 1 -- 172.21.15.61:0/26585404 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb6680849e0 con 0x7fb6701578d0 2023-12-24T19:59:17.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.334+0000 7fb66f7fe700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb650066f30 0x7fb6500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.335+0000 7fb66f7fe700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb650066f30 0x7fb6500693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb660006fd0 tx=0x7fb660008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:17.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.339+0000 7fb6677fe700 1 -- 172.21.15.61:0/26585404 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb668051f50 con 0x7fb6701578d0 2023-12-24T19:59:17.534 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.534+0000 7fb675aca700 1 -- 172.21.15.61:0/26585404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb6700afcd0 con 0x7fb6701578d0 2023-12-24T19:59:17.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.537+0000 7fb6677fe700 1 -- 172.21.15.61:0/26585404 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb668055570 con 0x7fb6701578d0 2023-12-24T19:59:17.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 -- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb650066f30 msgr2=0x7fb6500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:17.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb650066f30 0x7fb6500693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb660006fd0 tx=0x7fb660008040 comp rx=0 tx=0).stop 2023-12-24T19:59:17.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 -- 172.21.15.61:0/26585404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6701578d0 msgr2=0x7fb670167b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:17.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6701578d0 0x7fb670167b70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb668009fd0 tx=0x7fb668009900 comp rx=0 tx=0).stop 2023-12-24T19:59:17.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 -- 172.21.15.61:0/26585404 shutdown_connections 2023-12-24T19:59:17.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb67006b150 0x7fb6700b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb650066f30 0x7fb6500693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb6701578d0 0x7fb670167b70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 --2- 172.21.15.61:0/26585404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700af330 0x7fb6700b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 -- 172.21.15.61:0/26585404 >> 172.21.15.61:0/26585404 conn(0x7fb6700ce800 msgr2=0x7fb670155df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:17.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.539+0000 7fb675aca700 1 -- 172.21.15.61:0/26585404 shutdown_connections 2023-12-24T19:59:17.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.540+0000 7fb675aca700 1 -- 172.21.15.61:0/26585404 wait complete. 2023-12-24T19:59:17.552 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-12-24T19:59:17.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.673+0000 7f3804f4d700 1 Processor -- start 2023-12-24T19:59:17.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.674+0000 7f3804f4d700 1 -- start start 2023-12-24T19:59:17.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.674+0000 7f3804f4d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3800068c80 0x7f38000afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.674+0000 7f3804f4d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f380015acf0 0x7f3800067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.674+0000 7f3804f4d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38000687f0 con 0x7f38000af710 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f3804f4d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3800067be0 con 0x7f3800068c80 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f3804f4d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3800067ec0 con 0x7f380015acf0 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fdd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3800068c80 0x7f38000afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fdd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3800068c80 0x7f38000afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33094/0 (socket says 172.21.15.61:33094) 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fdd9b700 1 -- 172.21.15.61:0/243960468 learned_addr learned my addr 172.21.15.61:0/243960468 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fed9d700 1 --2- 172.21.15.61:0/243960468 >> v2:172.21.15.133:3300/0 conn(0x7f380015acf0 0x7f3800067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fdd9b700 1 -- 172.21.15.61:0/243960468 >> v2:172.21.15.133:3300/0 conn(0x7f380015acf0 msgr2=0x7f3800067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fdd9b700 1 --2- 172.21.15.61:0/243960468 >> v2:172.21.15.133:3300/0 conn(0x7f380015acf0 0x7f3800067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fdd9b700 1 -- 172.21.15.61:0/243960468 >> v1:172.21.15.133:6789/0 conn(0x7f38000af710 legacy=0x7f380015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fdd9b700 1 -- 172.21.15.61:0/243960468 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000681a0 con 0x7f3800068c80 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fdd9b700 1 --2- 172.21.15.61:0/243960468 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3800068c80 0x7f38000afae0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f380015a540 tx=0x7f37e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1e8d9acf4baca9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fd59a700 1 -- 172.21.15.61:0/243960468 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800b820 con 0x7f3800068c80 2023-12-24T19:59:17.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fd59a700 1 -- 172.21.15.61:0/243960468 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e800b980 con 0x7f3800068c80 2023-12-24T19:59:17.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.675+0000 7f37fd59a700 1 -- 172.21.15.61:0/243960468 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800bd20 con 0x7f3800068c80 2023-12-24T19:59:17.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.676+0000 7f3804f4d700 1 -- 172.21.15.61:0/243960468 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3800068c80 msgr2=0x7f38000afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:17.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.676+0000 7f3804f4d700 1 --2- 172.21.15.61:0/243960468 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3800068c80 0x7f38000afae0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f380015a540 tx=0x7f37e8009250 comp rx=0 tx=0).stop 2023-12-24T19:59:17.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.676+0000 7f3804f4d700 1 -- 172.21.15.61:0/243960468 shutdown_connections 2023-12-24T19:59:17.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.676+0000 7f3804f4d700 1 --2- 172.21.15.61:0/243960468 >> v2:172.21.15.133:3300/0 conn(0x7f380015acf0 0x7f3800067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.676+0000 7f3804f4d700 1 --2- 172.21.15.61:0/243960468 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3800068c80 0x7f38000afae0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.676+0000 7f3804f4d700 1 -- 172.21.15.61:0/243960468 >> 172.21.15.61:0/243960468 conn(0x7f38000ca200 msgr2=0x7f38000ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:17.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.676+0000 7f3804f4d700 1 -- 172.21.15.61:0/243960468 shutdown_connections 2023-12-24T19:59:17.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.676+0000 7f3804f4d700 1 -- 172.21.15.61:0/243960468 wait complete. 2023-12-24T19:59:17.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.677+0000 7f3804f4d700 1 Processor -- start 2023-12-24T19:59:17.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.677+0000 7f3804f4d700 1 -- start start 2023-12-24T19:59:17.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f3804f4d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3800068c80 0x7f38000b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f3804f4d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38000af710 0x7f380014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f3804f4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f380015acf0 0x7f38000adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f3804f4d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800158650 con 0x7f38000af710 2023-12-24T19:59:17.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f3804f4d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000b2140 con 0x7f380015acf0 2023-12-24T19:59:17.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f3804f4d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38000b2420 con 0x7f3800068c80 2023-12-24T19:59:17.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38000af710 0x7f380014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38000af710 0x7f380014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33098/0 (socket says 172.21.15.61:33098) 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fdd9b700 1 -- 172.21.15.61:0/3777799827 learned_addr learned my addr 172.21.15.61:0/3777799827 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fed9d700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f380015acf0 0x7f38000adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fe59c700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3800068c80 0x7f38000b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fdd9b700 1 -- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3800068c80 msgr2=0x7f38000b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fdd9b700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3800068c80 0x7f38000b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fdd9b700 1 -- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f380015acf0 msgr2=0x7f38000adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fdd9b700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f380015acf0 0x7f38000adc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fdd9b700 1 -- 172.21.15.61:0/3777799827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e80094f0 con 0x7f38000af710 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fed9d700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f380015acf0 0x7f38000adc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.678+0000 7f37fdd9b700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38000af710 0x7f380014f670 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009290 tx=0x7f37e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.679+0000 7f37f67fc700 1 -- 172.21.15.61:0/3777799827 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8011d70 con 0x7f38000af710 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.679+0000 7f37f67fc700 1 -- 172.21.15.61:0/3777799827 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e8020070 con 0x7f38000af710 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.679+0000 7f3804f4d700 1 -- 172.21.15.61:0/3777799827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38000b2700 con 0x7f38000af710 2023-12-24T19:59:17.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.679+0000 7f37f67fc700 1 -- 172.21.15.61:0/3777799827 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e801b6a0 con 0x7f38000af710 2023-12-24T19:59:17.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.679+0000 7f3804f4d700 1 -- 172.21.15.61:0/3777799827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38001543c0 con 0x7f38000af710 2023-12-24T19:59:17.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.680+0000 7f3804f4d700 1 -- 172.21.15.61:0/3777799827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3800158790 con 0x7f38000af710 2023-12-24T19:59:17.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.680+0000 7f37f67fc700 1 -- 172.21.15.61:0/3777799827 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f37e8022030 con 0x7f38000af710 2023-12-24T19:59:17.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.680+0000 7f37f67fc700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37e0066f30 0x7f37e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:17.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.680+0000 7f37f67fc700 1 -- 172.21.15.61:0/3777799827 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f37e80860a0 con 0x7f38000af710 2023-12-24T19:59:17.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.681+0000 7f37fe59c700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37e0066f30 0x7f37e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:17.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.681+0000 7f37fe59c700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37e0066f30 0x7f37e00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009af0 tx=0x7f37f0009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:17.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.685+0000 7f37f67fc700 1 -- 172.21.15.61:0/3777799827 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37e8053610 con 0x7f38000af710 2023-12-24T19:59:17.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:17.964+0000 7f3804f4d700 1 -- 172.21.15.61:0/3777799827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f3800158790 con 0x7f38000af710 2023-12-24T19:59:18.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.179+0000 7f37f67fc700 1 -- 172.21.15.61:0/3777799827 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v132) v1 ==== 142+0+0 (secure 0 0 0) 0x7f37e8056c30 con 0x7f38000af710 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 -- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37e0066f30 msgr2=0x7f37e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37e0066f30 0x7f37e00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009af0 tx=0x7f37f0009060 comp rx=0 tx=0).stop 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 -- 172.21.15.61:0/3777799827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38000af710 msgr2=0x7f380014f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38000af710 0x7f380014f670 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009290 tx=0x7f37e8016000 comp rx=0 tx=0).stop 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 -- 172.21.15.61:0/3777799827 shutdown_connections 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3800068c80 0x7f38000b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37e0066f30 0x7f37e00693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f380015acf0 0x7f38000adc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 --2- 172.21.15.61:0/3777799827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38000af710 0x7f380014f670 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 -- 172.21.15.61:0/3777799827 >> 172.21.15.61:0/3777799827 conn(0x7f38000ca200 msgr2=0x7f380006e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:18.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 -- 172.21.15.61:0/3777799827 shutdown_connections 2023-12-24T19:59:18.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.181+0000 7f3804f4d700 1 -- 172.21.15.61:0/3777799827 wait complete. 2023-12-24T19:59:18.194 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-24T19:59:18.194 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-12-24T19:59:18.195 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-12-24T19:59:18.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.318+0000 7fac3723a700 1 Processor -- start 2023-12-24T19:59:18.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.318+0000 7fac3723a700 1 -- start start 2023-12-24T19:59:18.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.319+0000 7fac3723a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac300b2660 0x7fac3015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:18.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.319+0000 7fac3723a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fac3015c470 0x7fac300b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:18.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.319+0000 7fac3723a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac300b2eb0 con 0x7fac3015bb60 2023-12-24T19:59:18.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.319+0000 7fac3723a700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300afc20 con 0x7fac3015c470 2023-12-24T19:59:18.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.319+0000 7fac3723a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300b2bd0 con 0x7fac300b2660 2023-12-24T19:59:18.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.319+0000 7fac357d7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fac3015c470 0x7fac300b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:18.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.319+0000 7fac357d7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fac3015c470 0x7fac300b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33106/0 (socket says 172.21.15.61:33106) 2023-12-24T19:59:18.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.319+0000 7fac357d7700 1 -- 172.21.15.61:0/1427261082 learned_addr learned my addr 172.21.15.61:0/1427261082 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:18.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.320+0000 7fac2ffff700 1 --2- 172.21.15.61:0/1427261082 >> v2:172.21.15.133:3300/0 conn(0x7fac300b2660 0x7fac3015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.320+0000 7fac357d7700 1 -- 172.21.15.61:0/1427261082 >> v2:172.21.15.133:3300/0 conn(0x7fac300b2660 msgr2=0x7fac3015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.320+0000 7fac357d7700 1 --2- 172.21.15.61:0/1427261082 >> v2:172.21.15.133:3300/0 conn(0x7fac300b2660 0x7fac3015bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.320+0000 7fac357d7700 1 -- 172.21.15.61:0/1427261082 >> v1:172.21.15.133:6789/0 conn(0x7fac3015bb60 legacy=0x7fac30098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.320+0000 7fac357d7700 1 -- 172.21.15.61:0/1427261082 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300afe10 con 0x7fac3015c470 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.320+0000 7fac357d7700 1 --2- 172.21.15.61:0/1427261082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 0x7fac300b08f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fac3006e250 tx=0x7fac28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cfd122261a45b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.320+0000 7fac2f7fe700 1 -- 172.21.15.61:0/1427261082 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2800e070 con 0x7fac3015c470 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.320+0000 7fac2f7fe700 1 -- 172.21.15.61:0/1427261082 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2800ba20 con 0x7fac3015c470 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.320+0000 7fac2f7fe700 1 -- 172.21.15.61:0/1427261082 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280092e0 con 0x7fac3015c470 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.321+0000 7fac3723a700 1 -- 172.21.15.61:0/1427261082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 msgr2=0x7fac300b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.321+0000 7fac3723a700 1 --2- 172.21.15.61:0/1427261082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 0x7fac300b08f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fac3006e250 tx=0x7fac28009840 comp rx=0 tx=0).stop 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.321+0000 7fac3723a700 1 -- 172.21.15.61:0/1427261082 shutdown_connections 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.321+0000 7fac3723a700 1 --2- 172.21.15.61:0/1427261082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 0x7fac300b08f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.321+0000 7fac3723a700 1 --2- 172.21.15.61:0/1427261082 >> v2:172.21.15.133:3300/0 conn(0x7fac300b2660 0x7fac3015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.321+0000 7fac3723a700 1 -- 172.21.15.61:0/1427261082 >> 172.21.15.61:0/1427261082 conn(0x7fac30097a10 msgr2=0x7fac300ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:18.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.321+0000 7fac3723a700 1 -- 172.21.15.61:0/1427261082 shutdown_connections 2023-12-24T19:59:18.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.321+0000 7fac3723a700 1 -- 172.21.15.61:0/1427261082 wait complete. 2023-12-24T19:59:18.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.322+0000 7fac3723a700 1 Processor -- start 2023-12-24T19:59:18.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.322+0000 7fac3723a700 1 -- start start 2023-12-24T19:59:18.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.323+0000 7fac3723a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac300b2660 0x7fac300ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:18.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.323+0000 7fac3723a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac3015bb60 0x7fac300aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:18.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.323+0000 7fac3723a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 0x7fac300ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:18.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.323+0000 7fac3723a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac301687a0 con 0x7fac3015c470 2023-12-24T19:59:18.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.323+0000 7fac3723a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3016c210 con 0x7fac3015bb60 2023-12-24T19:59:18.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.323+0000 7fac3723a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3016c4f0 con 0x7fac300b2660 2023-12-24T19:59:18.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.323+0000 7fac357d7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 0x7fac300ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:18.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac357d7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 0x7fac300ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33122/0 (socket says 172.21.15.61:33122) 2023-12-24T19:59:18.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac357d7700 1 -- 172.21.15.61:0/402459507 learned_addr learned my addr 172.21.15.61:0/402459507 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac34fd6700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac300b2660 0x7fac300ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac2ffff700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac3015bb60 0x7fac300aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac357d7700 1 -- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac300b2660 msgr2=0x7fac300ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac357d7700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac300b2660 0x7fac300ce8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac357d7700 1 -- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac3015bb60 msgr2=0x7fac300aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac357d7700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac3015bb60 0x7fac300aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac357d7700 1 -- 172.21.15.61:0/402459507 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28009ae0 con 0x7fac3015c470 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac357d7700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 0x7fac300ab450 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fac28009df0 tx=0x7fac28018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac2cff9700 1 -- 172.21.15.61:0/402459507 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28008be0 con 0x7fac3015c470 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac2cff9700 1 -- 172.21.15.61:0/402459507 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac28008d40 con 0x7fac3015c470 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac2cff9700 1 -- 172.21.15.61:0/402459507 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280256b0 con 0x7fac3015c470 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac3723a700 1 -- 172.21.15.61:0/402459507 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3016c7d0 con 0x7fac3015c470 2023-12-24T19:59:18.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.324+0000 7fac3723a700 1 -- 172.21.15.61:0/402459507 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac300ab070 con 0x7fac3015c470 2023-12-24T19:59:18.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.325+0000 7fac3723a700 1 -- 172.21.15.61:0/402459507 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3006d440 con 0x7fac3015c470 2023-12-24T19:59:18.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.326+0000 7fac2cff9700 1 -- 172.21.15.61:0/402459507 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fac28003040 con 0x7fac3015c470 2023-12-24T19:59:18.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.326+0000 7fac2cff9700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac14066f30 0x7fac140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:18.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.326+0000 7fac2cff9700 1 -- 172.21.15.61:0/402459507 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fac280858e0 con 0x7fac3015c470 2023-12-24T19:59:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.326+0000 7fac34fd6700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac14066f30 0x7fac140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:18.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.327+0000 7fac34fd6700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac14066f30 0x7fac140693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fac300a8f60 tx=0x7fac24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:18.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.330+0000 7fac2cff9700 1 -- 172.21.15.61:0/402459507 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac28052f00 con 0x7fac3015c470 2023-12-24T19:59:18.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:18.609+0000 7fac3723a700 1 -- 172.21.15.61:0/402459507 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fac3004c3c0 con 0x7fac3015c470 2023-12-24T19:59:19.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.185+0000 7fac2cff9700 1 -- 172.21.15.61:0/402459507 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v133) v1 ==== 137+0+0 (secure 0 0 0) 0x7fac28009940 con 0x7fac3015c470 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.187+0000 7fac3723a700 1 -- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac14066f30 msgr2=0x7fac140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.187+0000 7fac3723a700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac14066f30 0x7fac140693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fac300a8f60 tx=0x7fac24009040 comp rx=0 tx=0).stop 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.187+0000 7fac3723a700 1 -- 172.21.15.61:0/402459507 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 msgr2=0x7fac300ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.187+0000 7fac3723a700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 0x7fac300ab450 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fac28009df0 tx=0x7fac28018000 comp rx=0 tx=0).stop 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.187+0000 7fac3723a700 1 -- 172.21.15.61:0/402459507 shutdown_connections 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.187+0000 7fac3723a700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fac300b2660 0x7fac300ce8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.187+0000 7fac3723a700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fac14066f30 0x7fac140693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.187+0000 7fac3723a700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac3015c470 0x7fac300ab450 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.187+0000 7fac3723a700 1 --2- 172.21.15.61:0/402459507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac3015bb60 0x7fac300aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.187+0000 7fac3723a700 1 -- 172.21.15.61:0/402459507 >> 172.21.15.61:0/402459507 conn(0x7fac30097a10 msgr2=0x7fac30157810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.188+0000 7fac3723a700 1 -- 172.21.15.61:0/402459507 shutdown_connections 2023-12-24T19:59:19.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.188+0000 7fac3723a700 1 -- 172.21.15.61:0/402459507 wait complete. 2023-12-24T19:59:19.203 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-24T19:59:19.348 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_objectstore":"memstore"} 2023-12-24T19:59:19.348 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-24T19:59:19.349 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T19:59:19.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.473+0000 7f3ad3c72700 1 Processor -- start 2023-12-24T19:59:19.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.473+0000 7f3ad3c72700 1 -- start start 2023-12-24T19:59:19.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad3c72700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3acc1598d0 0x7f3acc0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad3c72700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3acc06e280 0x7f3acc0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad3c72700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3acc0cbf80 con 0x7f3acc159ca0 2023-12-24T19:59:19.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad3c72700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc15a110 con 0x7f3acc06e280 2023-12-24T19:59:19.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad3c72700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc0b11c0 con 0x7f3acc1598d0 2023-12-24T19:59:19.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad220f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3acc06e280 0x7f3acc0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad220f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3acc06e280 0x7f3acc0cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33134/0 (socket says 172.21.15.61:33134) 2023-12-24T19:59:19.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad220f700 1 -- 172.21.15.61:0/712592595 learned_addr learned my addr 172.21.15.61:0/712592595 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:19.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad1a0e700 1 --2- 172.21.15.61:0/712592595 >> v2:172.21.15.133:3300/0 conn(0x7f3acc1598d0 0x7f3acc0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad220f700 1 -- 172.21.15.61:0/712592595 >> v2:172.21.15.133:3300/0 conn(0x7f3acc1598d0 msgr2=0x7f3acc0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad220f700 1 --2- 172.21.15.61:0/712592595 >> v2:172.21.15.133:3300/0 conn(0x7f3acc1598d0 0x7f3acc0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad220f700 1 -- 172.21.15.61:0/712592595 >> v1:172.21.15.133:6789/0 conn(0x7f3acc159ca0 legacy=0x7f3acc06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.474+0000 7f3ad220f700 1 -- 172.21.15.61:0/712592595 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc0b14a0 con 0x7f3acc06e280 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad220f700 1 --2- 172.21.15.61:0/712592595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc06e280 0x7f3acc0cc410 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0c4480 tx=0x7f3ac4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e2810b4585ff34 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad0a0c700 1 -- 172.21.15.61:0/712592595 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400e070 con 0x7f3acc06e280 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad0a0c700 1 -- 172.21.15.61:0/712592595 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac400ba50 con 0x7f3acc06e280 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad0a0c700 1 -- 172.21.15.61:0/712592595 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac40092e0 con 0x7f3acc06e280 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad3c72700 1 -- 172.21.15.61:0/712592595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc06e280 msgr2=0x7f3acc0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad3c72700 1 --2- 172.21.15.61:0/712592595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc06e280 0x7f3acc0cc410 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0c4480 tx=0x7f3ac4009840 comp rx=0 tx=0).stop 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad3c72700 1 -- 172.21.15.61:0/712592595 shutdown_connections 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad3c72700 1 --2- 172.21.15.61:0/712592595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc06e280 0x7f3acc0cc410 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad3c72700 1 --2- 172.21.15.61:0/712592595 >> v2:172.21.15.133:3300/0 conn(0x7f3acc1598d0 0x7f3acc0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad3c72700 1 -- 172.21.15.61:0/712592595 >> 172.21.15.61:0/712592595 conn(0x7f3acc067550 msgr2=0x7f3acc067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:19.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad3c72700 1 -- 172.21.15.61:0/712592595 shutdown_connections 2023-12-24T19:59:19.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.475+0000 7f3ad3c72700 1 -- 172.21.15.61:0/712592595 wait complete. 2023-12-24T19:59:19.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.477+0000 7f3ad3c72700 1 Processor -- start 2023-12-24T19:59:19.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.477+0000 7f3ad3c72700 1 -- start start 2023-12-24T19:59:19.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad3c72700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3acc06e280 0x7f3acc15e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad3c72700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc1598d0 0x7f3acc0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad3c72700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3acc159ca0 0x7f3acc14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad3c72700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc0c9f20 con 0x7f3acc1598d0 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad3c72700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc15aa60 con 0x7f3acc159ca0 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad3c72700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc16a260 con 0x7f3acc06e280 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad120d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc1598d0 0x7f3acc0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad120d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc1598d0 0x7f3acc0c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33150/0 (socket says 172.21.15.61:33150) 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad120d700 1 -- 172.21.15.61:0/1777169819 learned_addr learned my addr 172.21.15.61:0/1777169819 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad220f700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3acc159ca0 0x7f3acc14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad1a0e700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3acc06e280 0x7f3acc15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad120d700 1 -- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3acc06e280 msgr2=0x7f3acc15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad120d700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3acc06e280 0x7f3acc15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad120d700 1 -- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3acc159ca0 msgr2=0x7f3acc14bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad120d700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3acc159ca0 0x7f3acc14bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.478+0000 7f3ad120d700 1 -- 172.21.15.61:0/1777169819 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac4009ae0 con 0x7f3acc1598d0 2023-12-24T19:59:19.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.479+0000 7f3ad120d700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc1598d0 0x7f3acc0c93f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800c590 tx=0x7f3ac800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:19.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.479+0000 7f3abdffb700 1 -- 172.21.15.61:0/1777169819 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8011590 con 0x7f3acc1598d0 2023-12-24T19:59:19.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.479+0000 7f3abdffb700 1 -- 172.21.15.61:0/1777169819 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac8011710 con 0x7f3acc1598d0 2023-12-24T19:59:19.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.479+0000 7f3ad3c72700 1 -- 172.21.15.61:0/1777169819 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc0c9c40 con 0x7f3acc1598d0 2023-12-24T19:59:19.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.479+0000 7f3abdffb700 1 -- 172.21.15.61:0/1777169819 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8011ad0 con 0x7f3acc1598d0 2023-12-24T19:59:19.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.479+0000 7f3ad3c72700 1 -- 172.21.15.61:0/1777169819 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc15a6f0 con 0x7f3acc1598d0 2023-12-24T19:59:19.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.480+0000 7f3ad3c72700 1 -- 172.21.15.61:0/1777169819 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc089120 con 0x7f3acc1598d0 2023-12-24T19:59:19.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.480+0000 7f3abdffb700 1 -- 172.21.15.61:0/1777169819 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3ac801b3b0 con 0x7f3acc1598d0 2023-12-24T19:59:19.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.481+0000 7f3abdffb700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ab0066f30 0x7f3ab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.481+0000 7f3abdffb700 1 -- 172.21.15.61:0/1777169819 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3ac8083640 con 0x7f3acc1598d0 2023-12-24T19:59:19.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.481+0000 7f3ad1a0e700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ab0066f30 0x7f3ab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.481+0000 7f3ad1a0e700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ab0066f30 0x7f3ab00693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0006fd0 tx=0x7f3ac0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:19.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.485+0000 7f3abdffb700 1 -- 172.21.15.61:0/1777169819 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ac8050bb0 con 0x7f3acc1598d0 2023-12-24T19:59:19.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.681+0000 7f3ad3c72700 1 -- 172.21.15.61:0/1777169819 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3acc15abd0 con 0x7f3acc1598d0 2023-12-24T19:59:19.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.685+0000 7f3abdffb700 1 -- 172.21.15.61:0/1777169819 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3ac8017020 con 0x7f3acc1598d0 2023-12-24T19:59:19.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 -- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ab0066f30 msgr2=0x7f3ab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ab0066f30 0x7f3ab00693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0006fd0 tx=0x7f3ac0008040 comp rx=0 tx=0).stop 2023-12-24T19:59:19.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 -- 172.21.15.61:0/1777169819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc1598d0 msgr2=0x7f3acc0c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc1598d0 0x7f3acc0c93f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800c590 tx=0x7f3ac800c8a0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 -- 172.21.15.61:0/1777169819 shutdown_connections 2023-12-24T19:59:19.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3acc06e280 0x7f3acc15e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ab0066f30 0x7f3ab00693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3acc159ca0 0x7f3acc14bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 --2- 172.21.15.61:0/1777169819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3acc1598d0 0x7f3acc0c93f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 -- 172.21.15.61:0/1777169819 >> 172.21.15.61:0/1777169819 conn(0x7f3acc067550 msgr2=0x7f3acc0cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:19.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 -- 172.21.15.61:0/1777169819 shutdown_connections 2023-12-24T19:59:19.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.687+0000 7f3ad3c72700 1 -- 172.21.15.61:0/1777169819 wait complete. 2023-12-24T19:59:19.700 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T19:59:19.700 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:59:19.744 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T19:59:19.788 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T19:59:19.788 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T19:59:19.789 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:59:19.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.910+0000 7faa92115700 1 Processor -- start 2023-12-24T19:59:19.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.910+0000 7faa92115700 1 -- start start 2023-12-24T19:59:19.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.911+0000 7faa92115700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faa8c068c80 0x7faa8c0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.911+0000 7faa92115700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c0687f0 con 0x7faa8c15acf0 2023-12-24T19:59:19.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.911+0000 7faa92115700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c067be0 con 0x7faa8c0af710 2023-12-24T19:59:19.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.911+0000 7faa92115700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c067ec0 con 0x7faa8c068c80 2023-12-24T19:59:19.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.911+0000 7faa8affd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faa8c068c80 0x7faa8c0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.911+0000 7faa8bfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7faa8c15acf0 0x7faa8c0ad290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59364/0 (socket says 172.21.15.61:59364) 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.911+0000 7faa8bfff700 1 -- 172.21.15.61:0/478121393 learned_addr learned my addr 172.21.15.61:0/478121393 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.912+0000 7faa8affd700 1 -- 172.21.15.61:0/478121393 >> v1:172.21.15.133:6789/0 conn(0x7faa8c0af710 legacy=0x7faa8c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.912+0000 7faa8affd700 1 -- 172.21.15.61:0/478121393 >> v1:172.21.15.61:6789/0 conn(0x7faa8c15acf0 legacy=0x7faa8c0ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.912+0000 7faa8a7fc700 1 -- 172.21.15.61:0/478121393 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927562925 0 0) 0x7faa8c0687f0 con 0x7faa8c15acf0 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.912+0000 7faa8affd700 1 -- 172.21.15.61:0/478121393 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c0681a0 con 0x7faa8c068c80 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.912+0000 7faa8affd700 1 --2- 172.21.15.61:0/478121393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c068c80 0x7faa8c0afae0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7faa740098e0 tx=0x7faa740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6211522eb61139c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.912+0000 7faa8a7fc700 1 -- 172.21.15.61:0/478121393 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74009e80 con 0x7faa8c068c80 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.912+0000 7faa8a7fc700 1 -- 172.21.15.61:0/478121393 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7400b860 con 0x7faa8c068c80 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.912+0000 7faa8a7fc700 1 -- 172.21.15.61:0/478121393 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400bbe0 con 0x7faa8c068c80 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.913+0000 7faa92115700 1 -- 172.21.15.61:0/478121393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c068c80 msgr2=0x7faa8c0afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.913+0000 7faa92115700 1 --2- 172.21.15.61:0/478121393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c068c80 0x7faa8c0afae0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7faa740098e0 tx=0x7faa740091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.913+0000 7faa92115700 1 -- 172.21.15.61:0/478121393 shutdown_connections 2023-12-24T19:59:19.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.913+0000 7faa92115700 1 --2- 172.21.15.61:0/478121393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c068c80 0x7faa8c0afae0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.913+0000 7faa92115700 1 -- 172.21.15.61:0/478121393 >> 172.21.15.61:0/478121393 conn(0x7faa8c0ca200 msgr2=0x7faa8c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:19.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.913+0000 7faa92115700 1 -- 172.21.15.61:0/478121393 shutdown_connections 2023-12-24T19:59:19.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.913+0000 7faa92115700 1 -- 172.21.15.61:0/478121393 wait complete. 2023-12-24T19:59:19.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.914+0000 7faa92115700 1 Processor -- start 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.914+0000 7faa92115700 1 -- start start 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa92115700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8c068c80 0x7faa8c0ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa92115700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c0af710 0x7faa8c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa92115700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c15acf0 0x7faa8c0cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa92115700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0ab550 con 0x7faa8c15acf0 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa92115700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0a91f0 con 0x7faa8c0af710 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa92115700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0a94d0 con 0x7faa8c068c80 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c15acf0 0x7faa8c0cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c15acf0 0x7faa8c0cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33160/0 (socket says 172.21.15.61:33160) 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8bfff700 1 -- 172.21.15.61:0/1347822144 learned_addr learned my addr 172.21.15.61:0/1347822144 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8affd700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c0af710 0x7faa8c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8b7fe700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8c068c80 0x7faa8c0ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8bfff700 1 -- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8c068c80 msgr2=0x7faa8c0ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8bfff700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8c068c80 0x7faa8c0ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8bfff700 1 -- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c0af710 msgr2=0x7faa8c1545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8bfff700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c0af710 0x7faa8c1545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8bfff700 1 -- 172.21.15.61:0/1347822144 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa74009420 con 0x7faa8c15acf0 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8b7fe700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8c068c80 0x7faa8c0ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa8bfff700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c15acf0 0x7faa8c0cb770 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faa8400cb90 tx=0x7faa84001910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.915+0000 7faa837fe700 1 -- 172.21.15.61:0/1347822144 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400a870 con 0x7faa8c15acf0 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.916+0000 7faa837fe700 1 -- 172.21.15.61:0/1347822144 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8400a9f0 con 0x7faa8c15acf0 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.916+0000 7faa92115700 1 -- 172.21.15.61:0/1347822144 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c0a97b0 con 0x7faa8c15acf0 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.916+0000 7faa837fe700 1 -- 172.21.15.61:0/1347822144 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400adb0 con 0x7faa8c15acf0 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.916+0000 7faa92115700 1 -- 172.21.15.61:0/1347822144 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c168490 con 0x7faa8c15acf0 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.916+0000 7faa92115700 1 -- 172.21.15.61:0/1347822144 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c168700 con 0x7faa8c15acf0 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.917+0000 7faa837fe700 1 -- 172.21.15.61:0/1347822144 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7faa84007300 con 0x7faa8c15acf0 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.917+0000 7faa837fe700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa6c066f30 0x7faa6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:19.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.918+0000 7faa837fe700 1 -- 172.21.15.61:0/1347822144 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7faa84084610 con 0x7faa8c15acf0 2023-12-24T19:59:19.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.918+0000 7faa8b7fe700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa6c066f30 0x7faa6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:19.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.919+0000 7faa8b7fe700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa6c066f30 0x7faa6c0693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa7c007fd0 tx=0x7faa7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:19.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:19.922+0000 7faa837fe700 1 -- 172.21.15.61:0/1347822144 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa8c168700 con 0x7faa8c15acf0 2023-12-24T19:59:20.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.161+0000 7faa92115700 1 -- 172.21.15.61:0/1347822144 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa8c0a9c50 con 0x7faa8c15acf0 2023-12-24T19:59:20.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.162+0000 7faa837fe700 1 -- 172.21.15.61:0/1347822144 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3532 (secure 0 0 0) 0x7faa8c0a9c50 con 0x7faa8c15acf0 2023-12-24T19:59:20.162 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:20.162 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1254159834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1254159834},{"type":"v1","addr":"172.21.15.133:6835","nonce":1254159834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4892,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4078121613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":4078121613},{"type":"v1","addr":"172.21.15.133:6837","nonce":4078121613}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/4252611526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":4252611526},{"type":"v1","addr":"172.21.15.61:6834","nonce":4252611526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/465802537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":465802537},{"type":"v1","addr":"172.21.15.61:6835","nonce":465802537}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[]} 2023-12-24T19:59:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 -- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa6c066f30 msgr2=0x7faa6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa6c066f30 0x7faa6c0693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa7c007fd0 tx=0x7faa7c009040 comp rx=0 tx=0).stop 2023-12-24T19:59:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 -- 172.21.15.61:0/1347822144 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c15acf0 msgr2=0x7faa8c0cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c15acf0 0x7faa8c0cb770 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faa8400cb90 tx=0x7faa84001910 comp rx=0 tx=0).stop 2023-12-24T19:59:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 -- 172.21.15.61:0/1347822144 shutdown_connections 2023-12-24T19:59:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa8c068c80 0x7faa8c0ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa6c066f30 0x7faa6c0693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa8c15acf0 0x7faa8c0cb770 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 --2- 172.21.15.61:0/1347822144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c0af710 0x7faa8c1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 -- 172.21.15.61:0/1347822144 >> 172.21.15.61:0/1347822144 conn(0x7faa8c0ca200 msgr2=0x7faa8c06b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 -- 172.21.15.61:0/1347822144 shutdown_connections 2023-12-24T19:59:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.164+0000 7faa92115700 1 -- 172.21.15.61:0/1347822144 wait complete. 2023-12-24T19:59:20.166 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 28 2023-12-24T19:59:20.177 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T19:59:20.177 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T19:59:20.177 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T19:59:20.177 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:59:20.178 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T19:59:20.178 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T19:59:20.178 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T19:59:20.178 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:59:20.178 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T19:59:20.178 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T19:59:20.179 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T19:59:20.179 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:59:20.179 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T19:59:20.179 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T19:59:20.179 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T19:59:20.179 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T19:59:20.187 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T19:59:20.187 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T19:59:20.188 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T19:59:20.188 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T19:59:20.190 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T19:59:20.190 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T19:59:20.191 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T19:59:20.191 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T19:59:20.229 INFO:tasks.ceph.mds.c:Started 2023-12-24T19:59:20.230 DEBUG:teuthology.parallel:result is None 2023-12-24T19:59:20.230 INFO:tasks.ceph.mds.a:Started 2023-12-24T19:59:20.230 DEBUG:teuthology.parallel:result is None 2023-12-24T19:59:20.233 INFO:tasks.ceph.mds.b:Started 2023-12-24T19:59:20.233 DEBUG:teuthology.parallel:result is None 2023-12-24T19:59:20.233 INFO:tasks.ceph.mds.d:Started 2023-12-24T19:59:20.234 DEBUG:teuthology.parallel:result is None 2023-12-24T19:59:20.234 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T19:59:20.308 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T19:59:20.309 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T19:59:20.319 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T19:59:20.319 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T19:59:20.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.363+0000 7fde2f20f700 1 Processor -- start 2023-12-24T19:59:20.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.364+0000 7fde2f20f700 1 -- start start 2023-12-24T19:59:20.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.364+0000 7fde2f20f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fde28159be0 0x7fde280b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:20.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.364+0000 7fde2f20f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde28159fb0 0x7fde280af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:20.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.364+0000 7fde2f20f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde280ad2f0 con 0x7fde280afdc0 2023-12-24T19:59:20.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.364+0000 7fde2f20f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280b13f0 con 0x7fde28159be0 2023-12-24T19:59:20.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.364+0000 7fde2f20f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280ac6e0 con 0x7fde28159fb0 2023-12-24T19:59:20.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.364+0000 7fde2cfab700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fde28159be0 0x7fde280b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:20.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde2d7ac700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fde280afdc0 0x7fde2815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59372/0 (socket says 172.21.15.61:59372) 2023-12-24T19:59:20.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde2d7ac700 1 -- 172.21.15.61:0/149600524 learned_addr learned my addr 172.21.15.61:0/149600524 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde27fff700 1 --2- 172.21.15.61:0/149600524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde28159fb0 0x7fde280af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde2cfab700 1 -- 172.21.15.61:0/149600524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde28159fb0 msgr2=0x7fde280af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde2cfab700 1 --2- 172.21.15.61:0/149600524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde28159fb0 0x7fde280af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde2cfab700 1 -- 172.21.15.61:0/149600524 >> v1:172.21.15.61:6789/0 conn(0x7fde280afdc0 legacy=0x7fde2815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde2cfab700 1 -- 172.21.15.61:0/149600524 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280ac9c0 con 0x7fde28159be0 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde277fe700 1 -- 172.21.15.61:0/149600524 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285868376 0 0) 0x7fde280ad2f0 con 0x7fde280afdc0 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde2cfab700 1 --2- 172.21.15.61:0/149600524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159be0 0x7fde280b1ea0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fde180098e0 tx=0x7fde180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c4883f3e88983b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde277fe700 1 -- 172.21.15.61:0/149600524 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800b640 con 0x7fde28159be0 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde277fe700 1 -- 172.21.15.61:0/149600524 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1800b7a0 con 0x7fde28159be0 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.365+0000 7fde277fe700 1 -- 172.21.15.61:0/149600524 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1800bb40 con 0x7fde28159be0 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.366+0000 7fde2f20f700 1 -- 172.21.15.61:0/149600524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159be0 msgr2=0x7fde280b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.366+0000 7fde2f20f700 1 --2- 172.21.15.61:0/149600524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159be0 0x7fde280b1ea0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fde180098e0 tx=0x7fde180091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.366+0000 7fde2f20f700 1 -- 172.21.15.61:0/149600524 shutdown_connections 2023-12-24T19:59:20.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.366+0000 7fde2f20f700 1 --2- 172.21.15.61:0/149600524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159be0 0x7fde280b1ea0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:20.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.366+0000 7fde2f20f700 1 --2- 172.21.15.61:0/149600524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde28159fb0 0x7fde280af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:20.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.366+0000 7fde2f20f700 1 -- 172.21.15.61:0/149600524 >> 172.21.15.61:0/149600524 conn(0x7fde28068020 msgr2=0x7fde280cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:20.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.366+0000 7fde2f20f700 1 -- 172.21.15.61:0/149600524 shutdown_connections 2023-12-24T19:59:20.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.366+0000 7fde2f20f700 1 -- 172.21.15.61:0/149600524 wait complete. 2023-12-24T19:59:20.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.367+0000 7fde2f20f700 1 Processor -- start 2023-12-24T19:59:20.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.367+0000 7fde2f20f700 1 -- start start 2023-12-24T19:59:20.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2f20f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde280afdc0 0x7fde28167f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:20.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2f20f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde28159be0 0x7fde2814e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:20.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2f20f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159fb0 0x7fde2815d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:20.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2f20f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde28151310 con 0x7fde28159fb0 2023-12-24T19:59:20.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2f20f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde28150700 con 0x7fde280afdc0 2023-12-24T19:59:20.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2f20f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde281509e0 con 0x7fde28159be0 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2d7ac700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159fb0 0x7fde2815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2d7ac700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159fb0 0x7fde2815d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33212/0 (socket says 172.21.15.61:33212) 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2d7ac700 1 -- 172.21.15.61:0/772104540 learned_addr learned my addr 172.21.15.61:0/772104540 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2cfab700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde280afdc0 0x7fde28167f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde27fff700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde28159be0 0x7fde2814e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2d7ac700 1 -- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde28159be0 msgr2=0x7fde2814e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2d7ac700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde28159be0 0x7fde2814e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2d7ac700 1 -- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde280afdc0 msgr2=0x7fde28167f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2d7ac700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde280afdc0 0x7fde28167f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2d7ac700 1 -- 172.21.15.61:0/772104540 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18009420 con 0x7fde28159fb0 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.368+0000 7fde2cfab700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde280afdc0 0x7fde28167f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.369+0000 7fde2d7ac700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159fb0 0x7fde2815d940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fde2000cc90 tx=0x7fde20001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:20.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.369+0000 7fde24ff9700 1 -- 172.21.15.61:0/772104540 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000a8b0 con 0x7fde28159fb0 2023-12-24T19:59:20.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.369+0000 7fde24ff9700 1 -- 172.21.15.61:0/772104540 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2000aa10 con 0x7fde28159fb0 2023-12-24T19:59:20.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.369+0000 7fde2f20f700 1 -- 172.21.15.61:0/772104540 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde28150cc0 con 0x7fde28159fb0 2023-12-24T19:59:20.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.369+0000 7fde24ff9700 1 -- 172.21.15.61:0/772104540 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2000add0 con 0x7fde28159fb0 2023-12-24T19:59:20.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.369+0000 7fde2f20f700 1 -- 172.21.15.61:0/772104540 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde28168480 con 0x7fde28159fb0 2023-12-24T19:59:20.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.370+0000 7fde2f20f700 1 -- 172.21.15.61:0/772104540 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde28151480 con 0x7fde28159fb0 2023-12-24T19:59:20.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.370+0000 7fde24ff9700 1 -- 172.21.15.61:0/772104540 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fde20007300 con 0x7fde28159fb0 2023-12-24T19:59:20.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.371+0000 7fde24ff9700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde08066f30 0x7fde080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:20.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.371+0000 7fde24ff9700 1 -- 172.21.15.61:0/772104540 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fde200845b0 con 0x7fde28159fb0 2023-12-24T19:59:20.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.371+0000 7fde2cfab700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde08066f30 0x7fde080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:20.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.372+0000 7fde2cfab700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde08066f30 0x7fde080693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fde180093f0 tx=0x7fde18017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:20.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.375+0000 7fde24ff9700 1 -- 172.21.15.61:0/772104540 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde20051b00 con 0x7fde28159fb0 2023-12-24T19:59:20.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:20.583+0000 7fde2f20f700 1 -- 172.21.15.61:0/772104540 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fde2804c3c0 con 0x7fde28159fb0 2023-12-24T19:59:21.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.196+0000 7fde24ff9700 1 -- 172.21.15.61:0/772104540 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7fde20055120 con 0x7fde28159fb0 2023-12-24T19:59:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 -- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde08066f30 msgr2=0x7fde080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde08066f30 0x7fde080693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fde180093f0 tx=0x7fde18017000 comp rx=0 tx=0).stop 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 -- 172.21.15.61:0/772104540 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159fb0 msgr2=0x7fde2815d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159fb0 0x7fde2815d940 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fde2000cc90 tx=0x7fde20001a80 comp rx=0 tx=0).stop 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 -- 172.21.15.61:0/772104540 shutdown_connections 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde08066f30 0x7fde080693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde28159fb0 0x7fde2815d940 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde280afdc0 0x7fde28167f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 --2- 172.21.15.61:0/772104540 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde28159be0 0x7fde2814e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 -- 172.21.15.61:0/772104540 >> 172.21.15.61:0/772104540 conn(0x7fde28068020 msgr2=0x7fde2814e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 -- 172.21.15.61:0/772104540 shutdown_connections 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.199+0000 7fde2f20f700 1 -- 172.21.15.61:0/772104540 wait complete. 2023-12-24T19:59:21.200 INFO:teuthology.orchestra.run.smithi061.stderr: removed all blocklist entries 2023-12-24T19:59:21.214 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T19:59:21.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.341+0000 7ff9978f3700 1 Processor -- start 2023-12-24T19:59:21.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.341+0000 7ff9978f3700 1 -- start start 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.342+0000 7ff9978f3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068140 0x7ff9900cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.342+0000 7ff9978f3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff990068510 0x7ff9900b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.342+0000 7ff9978f3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9900b2890 con 0x7ff990159a60 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.342+0000 7ff9978f3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9900b11e0 con 0x7ff990068510 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.342+0000 7ff9978f3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900cf630 con 0x7ff990068140 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff994e8e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff990068510 0x7ff9900b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff99568f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068140 0x7ff9900cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff995e90700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff990159a60 0x7ff990159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:43664/0 (socket says 172.21.15.61:43664) 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff995e90700 1 -- 172.21.15.61:0/2345010882 learned_addr learned my addr 172.21.15.61:0/2345010882 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff994e8e700 1 -- 172.21.15.61:0/2345010882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068140 msgr2=0x7ff9900cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff994e8e700 1 --2- 172.21.15.61:0/2345010882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068140 0x7ff9900cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff994e8e700 1 -- 172.21.15.61:0/2345010882 >> v1:172.21.15.133:6789/0 conn(0x7ff990159a60 legacy=0x7ff990159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff994e8e700 1 -- 172.21.15.61:0/2345010882 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9900b2240 con 0x7ff990068510 2023-12-24T19:59:21.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff99568f700 1 --2- 172.21.15.61:0/2345010882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068140 0x7ff9900cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:59:21.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff994e8e700 1 --2- 172.21.15.61:0/2345010882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff990068510 0x7ff9900b0ca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff9800098e0 tx=0x7ff9800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=131a396670f46060 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:21.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff987fff700 1 -- 172.21.15.61:0/2345010882 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000b640 con 0x7ff990068510 2023-12-24T19:59:21.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff987fff700 1 -- 172.21.15.61:0/2345010882 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98000b7a0 con 0x7ff990068510 2023-12-24T19:59:21.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.343+0000 7ff987fff700 1 -- 172.21.15.61:0/2345010882 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000bb40 con 0x7ff990068510 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.344+0000 7ff9978f3700 1 -- 172.21.15.61:0/2345010882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff990068510 msgr2=0x7ff9900b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.344+0000 7ff9978f3700 1 --2- 172.21.15.61:0/2345010882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff990068510 0x7ff9900b0ca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff9800098e0 tx=0x7ff9800091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.344+0000 7ff9978f3700 1 -- 172.21.15.61:0/2345010882 shutdown_connections 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.344+0000 7ff9978f3700 1 --2- 172.21.15.61:0/2345010882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068140 0x7ff9900cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.344+0000 7ff9978f3700 1 --2- 172.21.15.61:0/2345010882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff990068510 0x7ff9900b0ca0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.344+0000 7ff9978f3700 1 -- 172.21.15.61:0/2345010882 >> 172.21.15.61:0/2345010882 conn(0x7ff990097a10 msgr2=0x7ff9900ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.344+0000 7ff9978f3700 1 -- 172.21.15.61:0/2345010882 shutdown_connections 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.344+0000 7ff9978f3700 1 -- 172.21.15.61:0/2345010882 wait complete. 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.345+0000 7ff9978f3700 1 Processor -- start 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.345+0000 7ff9978f3700 1 -- start start 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff9978f3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff990068140 0x7ff99014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff9978f3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068510 0x7ff990156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff9978f3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff990159a60 0x7ff99009b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff9978f3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99014f830 con 0x7ff990068140 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff9978f3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff990157330 con 0x7ff990159a60 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff9978f3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99009b0a0 con 0x7ff990068510 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff99568f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff990068140 0x7ff99014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff99568f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff990068140 0x7ff99014f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33228/0 (socket says 172.21.15.61:33228) 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff99568f700 1 -- 172.21.15.61:0/3244497991 learned_addr learned my addr 172.21.15.61:0/3244497991 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff994e8e700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068510 0x7ff990156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.346+0000 7ff995e90700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff990159a60 0x7ff99009b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff99568f700 1 -- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068510 msgr2=0x7ff990156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff99568f700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068510 0x7ff990156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff99568f700 1 -- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff990159a60 msgr2=0x7ff99009b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff99568f700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff990159a60 0x7ff99009b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff99568f700 1 -- 172.21.15.61:0/3244497991 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c0093c0 con 0x7ff990068140 2023-12-24T19:59:21.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff99568f700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff990068140 0x7ff99014f9c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00ec80 tx=0x7ff98c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:21.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff9857fa700 1 -- 172.21.15.61:0/3244497991 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c005a00 con 0x7ff990068140 2023-12-24T19:59:21.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff9857fa700 1 -- 172.21.15.61:0/3244497991 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c005b60 con 0x7ff990068140 2023-12-24T19:59:21.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff9978f3700 1 -- 172.21.15.61:0/3244497991 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff980009420 con 0x7ff990068140 2023-12-24T19:59:21.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff9857fa700 1 -- 172.21.15.61:0/3244497991 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00c850 con 0x7ff990068140 2023-12-24T19:59:21.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.347+0000 7ff9978f3700 1 -- 172.21.15.61:0/3244497991 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99009a490 con 0x7ff990068140 2023-12-24T19:59:21.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.348+0000 7ff9857fa700 1 -- 172.21.15.61:0/3244497991 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff98c00cbc0 con 0x7ff990068140 2023-12-24T19:59:21.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.348+0000 7ff9978f3700 1 -- 172.21.15.61:0/3244497991 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99006d440 con 0x7ff990068140 2023-12-24T19:59:21.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.349+0000 7ff9857fa700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff974066f30 0x7ff9740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.349+0000 7ff9857fa700 1 -- 172.21.15.61:0/3244497991 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff98c0846f0 con 0x7ff990068140 2023-12-24T19:59:21.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.349+0000 7ff994e8e700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff974066f30 0x7ff9740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.349+0000 7ff994e8e700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff974066f30 0x7ff9740693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff9800093f0 tx=0x7ff980017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:21.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.353+0000 7ff9857fa700 1 -- 172.21.15.61:0/3244497991 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff98c0556a0 con 0x7ff990068140 2023-12-24T19:59:21.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.630+0000 7ff9978f3700 1 -- 172.21.15.61:0/3244497991 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff99004c3c0 con 0x7ff990068140 2023-12-24T19:59:21.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.631+0000 7ff9857fa700 1 -- 172.21.15.61:0/3244497991 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff98c055230 con 0x7ff990068140 2023-12-24T19:59:21.631 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:21.631 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:59:21.631 INFO:teuthology.orchestra.run.smithi061.stdout: "auth_dump": [ 2023-12-24T19:59:21.631 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.a", 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew==", 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.b", 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw==", 2023-12-24T19:59:21.632 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.c", 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g==", 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.633 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.d", 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg==", 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.0", 2023-12-24T19:59:21.634 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag==", 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.1", 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw==", 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.635 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.2", 2023-12-24T19:59:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ==", 2023-12-24T19:59:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:59:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:59:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.3", 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA==", 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.4", 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ==", 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:59:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.5", 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w==", 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.6", 2023-12-24T19:59:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw==", 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.7", 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw==", 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.0", 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA==", 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow r", 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.1", 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w==", 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.640 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.2", 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg==", 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T19:59:21.641 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.3", 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g==", 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.admin", 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlwF3pGRAA8h0Cld7lwZprlrgMAN7tSg==", 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.642 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.x", 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg==", 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:21.643 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:21.644 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.y", 2023-12-24T19:59:21.644 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A==", 2023-12-24T19:59:21.644 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T19:59:21.644 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T19:59:21.644 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T19:59:21.644 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T19:59:21.644 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.644 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:21.644 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T19:59:21.644 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 -- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff974066f30 msgr2=0x7ff9740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff974066f30 0x7ff9740693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff9800093f0 tx=0x7ff980017000 comp rx=0 tx=0).stop 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 -- 172.21.15.61:0/3244497991 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff990068140 msgr2=0x7ff99014f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff990068140 0x7ff99014f9c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00ec80 tx=0x7ff98c009120 comp rx=0 tx=0).stop 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 -- 172.21.15.61:0/3244497991 shutdown_connections 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff974066f30 0x7ff9740693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff990159a60 0x7ff99009b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff990068140 0x7ff99014f9c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 --2- 172.21.15.61:0/3244497991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff990068510 0x7ff990156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 -- 172.21.15.61:0/3244497991 >> 172.21.15.61:0/3244497991 conn(0x7ff990097a10 msgr2=0x7ff9900ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:21.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 -- 172.21.15.61:0/3244497991 shutdown_connections 2023-12-24T19:59:21.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.633+0000 7ff9978f3700 1 -- 172.21.15.61:0/3244497991 wait complete. 2023-12-24T19:59:21.647 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:59:21.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.769+0000 7f623ead5700 1 Processor -- start 2023-12-24T19:59:21.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.769+0000 7f623ead5700 1 -- start start 2023-12-24T19:59:21.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.770+0000 7f623ead5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 0x7f623815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.770+0000 7f623ead5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62380b2eb0 con 0x7f623815bb60 2023-12-24T19:59:21.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.770+0000 7f623ead5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62380b2bd0 con 0x7f623815c470 2023-12-24T19:59:21.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.770+0000 7f623ead5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62380afc20 con 0x7f62380b2660 2023-12-24T19:59:21.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.770+0000 7f623c871700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f623815bb60 0x7f6238098560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59380/0 (socket says 172.21.15.61:59380) 2023-12-24T19:59:21.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.770+0000 7f623c871700 1 -- 172.21.15.61:0/983471565 learned_addr learned my addr 172.21.15.61:0/983471565 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:21.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.770+0000 7f6237fff700 1 --2- 172.21.15.61:0/983471565 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 0x7f623815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.770+0000 7f62377fe700 1 -- 172.21.15.61:0/983471565 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20650393 0 0) 0x7f62380b2eb0 con 0x7f623815bb60 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.770+0000 7f62377fe700 1 -- 172.21.15.61:0/983471565 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6228003570 con 0x7f623815bb60 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.771+0000 7f62377fe700 1 -- 172.21.15.61:0/983471565 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017446961 0 0) 0x7f62380b2bd0 con 0x7f623815c470 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.771+0000 7f6237fff700 1 -- 172.21.15.61:0/983471565 >> v1:172.21.15.133:6789/0 conn(0x7f623815c470 legacy=0x7f62380b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.771+0000 7f6237fff700 1 -- 172.21.15.61:0/983471565 >> v1:172.21.15.61:6789/0 conn(0x7f623815bb60 legacy=0x7f6238098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.771+0000 7f6237fff700 1 -- 172.21.15.61:0/983471565 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62380afe10 con 0x7f62380b2660 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.771+0000 7f6237fff700 1 --2- 172.21.15.61:0/983471565 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 0x7f623815bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6224009910 tx=0x7f62240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cddce5198b19a986 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.771+0000 7f62377fe700 1 -- 172.21.15.61:0/983471565 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622400b680 con 0x7f62380b2660 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.771+0000 7f62377fe700 1 -- 172.21.15.61:0/983471565 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622400b7e0 con 0x7f62380b2660 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.771+0000 7f62377fe700 1 -- 172.21.15.61:0/983471565 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622400bb60 con 0x7f62380b2660 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.772+0000 7f623ead5700 1 -- 172.21.15.61:0/983471565 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 msgr2=0x7f623815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.772+0000 7f623ead5700 1 --2- 172.21.15.61:0/983471565 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 0x7f623815bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6224009910 tx=0x7f62240091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.772+0000 7f623ead5700 1 -- 172.21.15.61:0/983471565 shutdown_connections 2023-12-24T19:59:21.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.772+0000 7f623ead5700 1 --2- 172.21.15.61:0/983471565 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 0x7f623815bf30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.772+0000 7f623ead5700 1 -- 172.21.15.61:0/983471565 >> 172.21.15.61:0/983471565 conn(0x7f6238097a10 msgr2=0x7f62380ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:21.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.772+0000 7f623ead5700 1 -- 172.21.15.61:0/983471565 shutdown_connections 2023-12-24T19:59:21.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.772+0000 7f623ead5700 1 -- 172.21.15.61:0/983471565 wait complete. 2023-12-24T19:59:21.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.773+0000 7f623ead5700 1 Processor -- start 2023-12-24T19:59:21.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.773+0000 7f623ead5700 1 -- start start 2023-12-24T19:59:21.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623ead5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 0x7f6238156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623ead5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f623815bb60 0x7f62380a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623ead5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f623815c470 0x7f623816a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623ead5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6238169940 con 0x7f623815c470 2023-12-24T19:59:21.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623ead5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6238169c20 con 0x7f623815bb60 2023-12-24T19:59:21.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623ead5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6238169f00 con 0x7f62380b2660 2023-12-24T19:59:21.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623d072700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f623815c470 0x7f623816a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623d072700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f623815c470 0x7f623816a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33240/0 (socket says 172.21.15.61:33240) 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623d072700 1 -- 172.21.15.61:0/484698609 learned_addr learned my addr 172.21.15.61:0/484698609 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623c871700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 0x7f6238156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f6237fff700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f623815bb60 0x7f62380a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623d072700 1 -- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 msgr2=0x7f6238156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623d072700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 0x7f6238156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623d072700 1 -- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f623815bb60 msgr2=0x7f62380a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623d072700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f623815bb60 0x7f62380a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623d072700 1 -- 172.21.15.61:0/484698609 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6224009420 con 0x7f623815c470 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623d072700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f623815c470 0x7f623816a9e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f623000c890 tx=0x7f6230001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f6234ff9700 1 -- 172.21.15.61:0/484698609 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230012630 con 0x7f623815c470 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f6234ff9700 1 -- 172.21.15.61:0/484698609 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62300127b0 con 0x7f623815c470 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623ead5700 1 -- 172.21.15.61:0/484698609 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623816a1e0 con 0x7f623815c470 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f6234ff9700 1 -- 172.21.15.61:0/484698609 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230012b70 con 0x7f623815c470 2023-12-24T19:59:21.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.774+0000 7f623ead5700 1 -- 172.21.15.61:0/484698609 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6238157520 con 0x7f623815c470 2023-12-24T19:59:21.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.775+0000 7f623ead5700 1 -- 172.21.15.61:0/484698609 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623816a680 con 0x7f623815c470 2023-12-24T19:59:21.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.776+0000 7f6234ff9700 1 -- 172.21.15.61:0/484698609 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6230003030 con 0x7f623815c470 2023-12-24T19:59:21.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.776+0000 7f6234ff9700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f621c066f30 0x7f621c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:21.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.776+0000 7f6234ff9700 1 -- 172.21.15.61:0/484698609 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6230084140 con 0x7f623815c470 2023-12-24T19:59:21.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.776+0000 7f623c871700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f621c066f30 0x7f621c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:21.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.777+0000 7f623c871700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f621c066f30 0x7f621c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f622c000c00 tx=0x7f622c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:21.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.781+0000 7f6234ff9700 1 -- 172.21.15.61:0/484698609 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6230051700 con 0x7f623815c470 2023-12-24T19:59:21.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.976+0000 7f623ead5700 1 -- 172.21.15.61:0/484698609 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f623806d440 con 0x7f623815c470 2023-12-24T19:59:21.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.977+0000 7f6234ff9700 1 -- 172.21.15.61:0/484698609 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f6230054d20 con 0x7f623815c470 2023-12-24T19:59:21.977 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:21.978 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":58,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:59:21.201191+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:59:21.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 -- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f621c066f30 msgr2=0x7f621c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f621c066f30 0x7f621c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f622c000c00 tx=0x7f622c009040 comp rx=0 tx=0).stop 2023-12-24T19:59:21.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 -- 172.21.15.61:0/484698609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f623815c470 msgr2=0x7f623816a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:21.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f623815c470 0x7f623816a9e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f623000c890 tx=0x7f6230001630 comp rx=0 tx=0).stop 2023-12-24T19:59:21.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 -- 172.21.15.61:0/484698609 shutdown_connections 2023-12-24T19:59:21.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f62380b2660 0x7f6238156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f621c066f30 0x7f621c0693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f623815c470 0x7f623816a9e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 --2- 172.21.15.61:0/484698609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f623815bb60 0x7f62380a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:21.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 -- 172.21.15.61:0/484698609 >> 172.21.15.61:0/484698609 conn(0x7f6238097a10 msgr2=0x7f62381579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:21.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 -- 172.21.15.61:0/484698609 shutdown_connections 2023-12-24T19:59:21.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:21.979+0000 7f623ead5700 1 -- 172.21.15.61:0/484698609 wait complete. 2023-12-24T19:59:21.992 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T19:59:21.993 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T19:59:22.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.116+0000 7f0e29d62700 1 Processor -- start 2023-12-24T19:59:22.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.117+0000 7f0e29d62700 1 -- start start 2023-12-24T19:59:22.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.117+0000 7f0e29d62700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e240cdf90 0x7f0e2406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.117+0000 7f0e29d62700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0e24158c50 0x7f0e240cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.117+0000 7f0e29d62700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e24159090 con 0x7f0e240ce360 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.117+0000 7f0e29d62700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e2415bad0 con 0x7f0e24158c50 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.117+0000 7f0e29d62700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e2415bdb0 con 0x7f0e240cdf90 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.117+0000 7f0e23fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0e24158c50 0x7f0e240cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.117+0000 7f0e23fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0e24158c50 0x7f0e240cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33246/0 (socket says 172.21.15.61:33246) 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.117+0000 7f0e23fff700 1 -- 172.21.15.61:0/4041759073 learned_addr learned my addr 172.21.15.61:0/4041759073 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.118+0000 7f0e237fe700 1 --2- 172.21.15.61:0/4041759073 >> v2:172.21.15.133:3300/0 conn(0x7f0e240cdf90 0x7f0e2406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.118+0000 7f0e23fff700 1 -- 172.21.15.61:0/4041759073 >> v2:172.21.15.133:3300/0 conn(0x7f0e240cdf90 msgr2=0x7f0e2406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.118+0000 7f0e23fff700 1 --2- 172.21.15.61:0/4041759073 >> v2:172.21.15.133:3300/0 conn(0x7f0e240cdf90 0x7f0e2406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.118+0000 7f0e23fff700 1 -- 172.21.15.61:0/4041759073 >> v1:172.21.15.133:6789/0 conn(0x7f0e240ce360 legacy=0x7f0e24158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.118+0000 7f0e23fff700 1 -- 172.21.15.61:0/4041759073 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2415c090 con 0x7f0e24158c50 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.118+0000 7f0e23fff700 1 --2- 172.21.15.61:0/4041759073 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e24158c50 0x7f0e240cc990 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0e240ce9b0 tx=0x7f0e1c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c38168adbc210f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.118+0000 7f0e227fc700 1 -- 172.21.15.61:0/4041759073 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c00e070 con 0x7f0e24158c50 2023-12-24T19:59:22.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.118+0000 7f0e227fc700 1 -- 172.21.15.61:0/4041759073 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c00ba10 con 0x7f0e24158c50 2023-12-24T19:59:22.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.118+0000 7f0e227fc700 1 -- 172.21.15.61:0/4041759073 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0092e0 con 0x7f0e24158c50 2023-12-24T19:59:22.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.119+0000 7f0e29d62700 1 -- 172.21.15.61:0/4041759073 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e24158c50 msgr2=0x7f0e240cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.119+0000 7f0e29d62700 1 --2- 172.21.15.61:0/4041759073 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e24158c50 0x7f0e240cc990 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0e240ce9b0 tx=0x7f0e1c009840 comp rx=0 tx=0).stop 2023-12-24T19:59:22.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.119+0000 7f0e29d62700 1 -- 172.21.15.61:0/4041759073 shutdown_connections 2023-12-24T19:59:22.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.119+0000 7f0e29d62700 1 --2- 172.21.15.61:0/4041759073 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e24158c50 0x7f0e240cc990 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.119+0000 7f0e29d62700 1 --2- 172.21.15.61:0/4041759073 >> v2:172.21.15.133:3300/0 conn(0x7f0e240cdf90 0x7f0e2406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.119+0000 7f0e29d62700 1 -- 172.21.15.61:0/4041759073 >> 172.21.15.61:0/4041759073 conn(0x7f0e2406f810 msgr2=0x7f0e2406ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:22.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.119+0000 7f0e29d62700 1 -- 172.21.15.61:0/4041759073 shutdown_connections 2023-12-24T19:59:22.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.119+0000 7f0e29d62700 1 -- 172.21.15.61:0/4041759073 wait complete. 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.120+0000 7f0e29d62700 1 Processor -- start 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.120+0000 7f0e29d62700 1 -- start start 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e29d62700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e240cdf90 0x7f0e24169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e29d62700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e240ce360 0x7f0e240abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e29d62700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e24158c50 0x7f0e24068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e29d62700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e240687c0 con 0x7f0e240cdf90 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e29d62700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e24068490 con 0x7f0e24158c50 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e29d62700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2416a890 con 0x7f0e240ce360 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e237fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e240cdf90 0x7f0e24169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e237fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e240cdf90 0x7f0e24169ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33260/0 (socket says 172.21.15.61:33260) 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e237fe700 1 -- 172.21.15.61:0/2694628110 learned_addr learned my addr 172.21.15.61:0/2694628110 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e23fff700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e24158c50 0x7f0e24068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e22ffd700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e240ce360 0x7f0e240abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e237fe700 1 -- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e240ce360 msgr2=0x7f0e240abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e237fe700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e240ce360 0x7f0e240abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e237fe700 1 -- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e24158c50 msgr2=0x7f0e24068c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e237fe700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e24158c50 0x7f0e24068c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e237fe700 1 -- 172.21.15.61:0/2694628110 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c009ae0 con 0x7f0e240cdf90 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e237fe700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e240cdf90 0x7f0e24169ef0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c880 tx=0x7f0e14008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e0b7fe700 1 -- 172.21.15.61:0/2694628110 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14011600 con 0x7f0e240cdf90 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e0b7fe700 1 -- 172.21.15.61:0/2694628110 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e14011760 con 0x7f0e240cdf90 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e29d62700 1 -- 172.21.15.61:0/2694628110 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2416ab70 con 0x7f0e240cdf90 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.121+0000 7f0e0b7fe700 1 -- 172.21.15.61:0/2694628110 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14011b00 con 0x7f0e240cdf90 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.122+0000 7f0e29d62700 1 -- 172.21.15.61:0/2694628110 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2416a430 con 0x7f0e240cdf90 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.122+0000 7f0e29d62700 1 -- 172.21.15.61:0/2694628110 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2416a620 con 0x7f0e240cdf90 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.123+0000 7f0e0b7fe700 1 -- 172.21.15.61:0/2694628110 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0e14018360 con 0x7f0e240cdf90 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.123+0000 7f0e0b7fe700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e10066f30 0x7f0e100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.123+0000 7f0e0b7fe700 1 -- 172.21.15.61:0/2694628110 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0e14084090 con 0x7f0e240cdf90 2023-12-24T19:59:22.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.124+0000 7f0e22ffd700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e10066f30 0x7f0e100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.124+0000 7f0e22ffd700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e10066f30 0x7f0e100693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009ab0 tx=0x7f0e18009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:22.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.128+0000 7f0e0b7fe700 1 -- 172.21.15.61:0/2694628110 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e14051650 con 0x7f0e240cdf90 2023-12-24T19:59:22.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.324+0000 7f0e29d62700 1 -- 172.21.15.61:0/2694628110 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e2404c3c0 con 0x7f0e240cdf90 2023-12-24T19:59:22.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.325+0000 7f0e0b7fe700 1 -- 172.21.15.61:0/2694628110 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e14054c70 con 0x7f0e240cdf90 2023-12-24T19:59:22.325 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T19:59:22.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 -- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e10066f30 msgr2=0x7f0e100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e10066f30 0x7f0e100693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009ab0 tx=0x7f0e18009060 comp rx=0 tx=0).stop 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 -- 172.21.15.61:0/2694628110 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e240cdf90 msgr2=0x7f0e24169ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e240cdf90 0x7f0e24169ef0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c880 tx=0x7f0e14008040 comp rx=0 tx=0).stop 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 -- 172.21.15.61:0/2694628110 shutdown_connections 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e10066f30 0x7f0e100693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e24158c50 0x7f0e24068c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e240cdf90 0x7f0e24169ef0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 --2- 172.21.15.61:0/2694628110 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e240ce360 0x7f0e240abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 -- 172.21.15.61:0/2694628110 >> 172.21.15.61:0/2694628110 conn(0x7f0e2406f810 msgr2=0x7f0e24156740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 -- 172.21.15.61:0/2694628110 shutdown_connections 2023-12-24T19:59:22.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.327+0000 7f0e29d62700 1 -- 172.21.15.61:0/2694628110 wait complete. 2023-12-24T19:59:22.339 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T19:59:22.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.460+0000 7fd0f7b0c700 1 Processor -- start 2023-12-24T19:59:22.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.460+0000 7fd0f7b0c700 1 -- start start 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.461+0000 7fd0f7b0c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd0f00c9910 0x7fd0f0157040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.461+0000 7fd0f7b0c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f0156bb0 con 0x7fd0f00c9ce0 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.461+0000 7fd0f7b0c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f01565d0 con 0x7fd0f00adfd0 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.461+0000 7fd0f7b0c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f00afe10 con 0x7fd0f00c9910 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.461+0000 7fd0f58a8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd0f00c9910 0x7fd0f0157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.461+0000 7fd0f50a7700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd0f00c9ce0 0x7fd0f00af3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59390/0 (socket says 172.21.15.61:59390) 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.461+0000 7fd0f50a7700 1 -- 172.21.15.61:0/2787600949 learned_addr learned my addr 172.21.15.61:0/2787600949 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f58a8700 1 -- 172.21.15.61:0/2787600949 >> v1:172.21.15.133:6789/0 conn(0x7fd0f00adfd0 legacy=0x7fd0f00ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f58a8700 1 -- 172.21.15.61:0/2787600949 >> v1:172.21.15.61:6789/0 conn(0x7fd0f00c9ce0 legacy=0x7fd0f00af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f58a8700 1 -- 172.21.15.61:0/2787600949 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f00b00f0 con 0x7fd0f00c9910 2023-12-24T19:59:22.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f48a6700 1 -- 172.21.15.61:0/2787600949 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152272701 0 0) 0x7fd0f0156bb0 con 0x7fd0f00c9ce0 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f58a8700 1 --2- 172.21.15.61:0/2787600949 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00c9910 0x7fd0f0157040 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00098e0 tx=0x7fd0e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6a5324554a211 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f48a6700 1 -- 172.21.15.61:0/2787600949 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0009e20 con 0x7fd0f00c9910 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f48a6700 1 -- 172.21.15.61:0/2787600949 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e000b860 con 0x7fd0f00c9910 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f48a6700 1 -- 172.21.15.61:0/2787600949 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000bc00 con 0x7fd0f00c9910 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/2787600949 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00c9910 msgr2=0x7fd0f0157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f7b0c700 1 --2- 172.21.15.61:0/2787600949 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00c9910 0x7fd0f0157040 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00098e0 tx=0x7fd0e00091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/2787600949 shutdown_connections 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f7b0c700 1 --2- 172.21.15.61:0/2787600949 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00c9910 0x7fd0f0157040 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.462+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/2787600949 >> 172.21.15.61:0/2787600949 conn(0x7fd0f0067fe0 msgr2=0x7fd0f00cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.463+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/2787600949 shutdown_connections 2023-12-24T19:59:22.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.463+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/2787600949 wait complete. 2023-12-24T19:59:22.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.464+0000 7fd0f7b0c700 1 Processor -- start 2023-12-24T19:59:22.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.464+0000 7fd0f7b0c700 1 -- start start 2023-12-24T19:59:22.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.464+0000 7fd0f7b0c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00adfd0 0x7fd0f016ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f7b0c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f00c9910 0x7fd0f0169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f7b0c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f00c9ce0 0x7fd0f0146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f7b0c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f016abf0 con 0x7fd0f00adfd0 2023-12-24T19:59:22.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f7b0c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f006d9c0 con 0x7fd0f00c9ce0 2023-12-24T19:59:22.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f7b0c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f016a350 con 0x7fd0f00c9910 2023-12-24T19:59:22.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f58a8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00adfd0 0x7fd0f016ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f58a8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00adfd0 0x7fd0f016ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33276/0 (socket says 172.21.15.61:33276) 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f58a8700 1 -- 172.21.15.61:0/1522812327 learned_addr learned my addr 172.21.15.61:0/1522812327 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f60a9700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f00c9ce0 0x7fd0f0146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f50a7700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f00c9910 0x7fd0f0169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f58a8700 1 -- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f00c9910 msgr2=0x7fd0f0169c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f58a8700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f00c9910 0x7fd0f0169c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f58a8700 1 -- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f00c9ce0 msgr2=0x7fd0f0146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f58a8700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f00c9ce0 0x7fd0f0146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f58a8700 1 -- 172.21.15.61:0/1522812327 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e0009420 con 0x7fd0f00adfd0 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f58a8700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00adfd0 0x7fd0f016ae40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00093f0 tx=0x7fd0e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0e5ffb700 1 -- 172.21.15.61:0/1522812327 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000bbe0 con 0x7fd0f00adfd0 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0e5ffb700 1 -- 172.21.15.61:0/1522812327 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e0022400 con 0x7fd0f00adfd0 2023-12-24T19:59:22.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/1522812327 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f016a630 con 0x7fd0f00adfd0 2023-12-24T19:59:22.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.465+0000 7fd0e5ffb700 1 -- 172.21.15.61:0/1522812327 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00227a0 con 0x7fd0f00adfd0 2023-12-24T19:59:22.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.466+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/1522812327 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f00ab260 con 0x7fd0f00adfd0 2023-12-24T19:59:22.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.467+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/1522812327 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f004c3c0 con 0x7fd0f00adfd0 2023-12-24T19:59:22.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.467+0000 7fd0e5ffb700 1 -- 172.21.15.61:0/1522812327 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd0e0022b10 con 0x7fd0f00adfd0 2023-12-24T19:59:22.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.467+0000 7fd0e5ffb700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0d4066f30 0x7fd0d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.467+0000 7fd0e5ffb700 1 -- 172.21.15.61:0/1522812327 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd0e0013070 con 0x7fd0f00adfd0 2023-12-24T19:59:22.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.468+0000 7fd0f50a7700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0d4066f30 0x7fd0d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.468+0000 7fd0f50a7700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0d4066f30 0x7fd0d40693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00c8b30 tx=0x7fd0ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:22.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.472+0000 7fd0e5ffb700 1 -- 172.21.15.61:0/1522812327 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0e0053b10 con 0x7fd0f00adfd0 2023-12-24T19:59:22.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.670+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/1522812327 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd0f0156840 con 0x7fd0f00adfd0 2023-12-24T19:59:22.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.670+0000 7fd0e5ffb700 1 -- 172.21.15.61:0/1522812327 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd0e0057130 con 0x7fd0f00adfd0 2023-12-24T19:59:22.671 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:22.671 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T19:59:22.671 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T19:59:22.671 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T19:59:22.671 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T19:59:22.671 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:22.671 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T19:59:22.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0d4066f30 msgr2=0x7fd0d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0d4066f30 0x7fd0d40693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00c8b30 tx=0x7fd0ec009040 comp rx=0 tx=0).stop 2023-12-24T19:59:22.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/1522812327 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00adfd0 msgr2=0x7fd0f016ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00adfd0 0x7fd0f016ae40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00093f0 tx=0x7fd0e0019000 comp rx=0 tx=0).stop 2023-12-24T19:59:22.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/1522812327 shutdown_connections 2023-12-24T19:59:22.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0d4066f30 0x7fd0d40693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f00c9ce0 0x7fd0f0146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f00adfd0 0x7fd0f016ae40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 --2- 172.21.15.61:0/1522812327 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f00c9910 0x7fd0f0169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/1522812327 >> 172.21.15.61:0/1522812327 conn(0x7fd0f0067fe0 msgr2=0x7fd0f00cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:22.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/1522812327 shutdown_connections 2023-12-24T19:59:22.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.672+0000 7fd0f7b0c700 1 -- 172.21.15.61:0/1522812327 wait complete. 2023-12-24T19:59:22.685 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T19:59:22.685 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T19:59:22.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.812+0000 7f21c1cc2700 1 Processor -- start 2023-12-24T19:59:22.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.812+0000 7f21c1cc2700 1 -- start start 2023-12-24T19:59:22.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21c1cc2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc0b2f90 0x7f21bc158970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21c1cc2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21bc06f170 0x7f21bc0b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21c1cc2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc158eb0 con 0x7f21bc06eda0 2023-12-24T19:59:22.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21c1cc2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc0b0ee0 con 0x7f21bc06f170 2023-12-24T19:59:22.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21c1cc2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc06c710 con 0x7f21bc0b2f90 2023-12-24T19:59:22.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21baffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc0b2f90 0x7f21bc158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21bbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21bc06f170 0x7f21bc0b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21baffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc0b2f90 0x7f21bc158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:41352/0 (socket says 172.21.15.61:41352) 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21bbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21bc06f170 0x7f21bc0b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:48052/0 (socket says 172.21.15.61:48052) 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21baffd700 1 -- 172.21.15.61:0/3023751622 learned_addr learned my addr 172.21.15.61:0/3023751622 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21bb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f21bc06eda0 0x7f21bc06cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:43690/0 (socket says 172.21.15.61:43690) 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21baffd700 1 -- 172.21.15.61:0/3023751622 >> v2:172.21.15.133:3300/0 conn(0x7f21bc06f170 msgr2=0x7f21bc0b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21baffd700 1 --2- 172.21.15.61:0/3023751622 >> v2:172.21.15.133:3300/0 conn(0x7f21bc06f170 0x7f21bc0b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21baffd700 1 -- 172.21.15.61:0/3023751622 >> v1:172.21.15.133:6789/0 conn(0x7f21bc06eda0 legacy=0x7f21bc06cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21baffd700 1 -- 172.21.15.61:0/3023751622 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0b3450 con 0x7f21bc0b2f90 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.813+0000 7f21bbfff700 1 --2- 172.21.15.61:0/3023751622 >> v2:172.21.15.133:3300/0 conn(0x7f21bc06f170 0x7f21bc0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.814+0000 7f21baffd700 1 --2- 172.21.15.61:0/3023751622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc0b2f90 0x7f21bc158970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f21a40099b0 tx=0x7f21a4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63c3832c62a51d4b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.814+0000 7f21ba7fc700 1 -- 172.21.15.61:0/3023751622 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4009ea0 con 0x7f21bc0b2f90 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.814+0000 7f21ba7fc700 1 -- 172.21.15.61:0/3023751622 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a400b860 con 0x7f21bc0b2f90 2023-12-24T19:59:22.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.814+0000 7f21ba7fc700 1 -- 172.21.15.61:0/3023751622 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400bc00 con 0x7f21bc0b2f90 2023-12-24T19:59:22.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.814+0000 7f21c1cc2700 1 -- 172.21.15.61:0/3023751622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc0b2f90 msgr2=0x7f21bc158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.814+0000 7f21c1cc2700 1 --2- 172.21.15.61:0/3023751622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc0b2f90 0x7f21bc158970 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f21a40099b0 tx=0x7f21a4009250 comp rx=0 tx=0).stop 2023-12-24T19:59:22.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.814+0000 7f21c1cc2700 1 -- 172.21.15.61:0/3023751622 shutdown_connections 2023-12-24T19:59:22.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.814+0000 7f21c1cc2700 1 --2- 172.21.15.61:0/3023751622 >> v2:172.21.15.133:3300/0 conn(0x7f21bc06f170 0x7f21bc0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.814+0000 7f21c1cc2700 1 --2- 172.21.15.61:0/3023751622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc0b2f90 0x7f21bc158970 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.814+0000 7f21c1cc2700 1 -- 172.21.15.61:0/3023751622 >> 172.21.15.61:0/3023751622 conn(0x7f21bc06b690 msgr2=0x7f21bc0b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.815+0000 7f21c1cc2700 1 -- 172.21.15.61:0/3023751622 shutdown_connections 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.815+0000 7f21c1cc2700 1 -- 172.21.15.61:0/3023751622 wait complete. 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.816+0000 7f21c1cc2700 1 Processor -- start 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.816+0000 7f21c1cc2700 1 -- start start 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21c1cc2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc06eda0 0x7f21bc068fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21c1cc2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc06f170 0x7f21bc1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21c1cc2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21bc0b2f90 0x7f21bc067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21c1cc2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0694e0 con 0x7f21bc0b2f90 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21c1cc2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0aa920 con 0x7f21bc06eda0 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21c1cc2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0aac00 con 0x7f21bc06f170 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21bbfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21bc0b2f90 0x7f21bc067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21bbfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21bc0b2f90 0x7f21bc067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33282/0 (socket says 172.21.15.61:33282) 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21bbfff700 1 -- 172.21.15.61:0/622398890 learned_addr learned my addr 172.21.15.61:0/622398890 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:22.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21baffd700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc06f170 0x7f21bc1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21bb7fe700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc06eda0 0x7f21bc068fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21bbfff700 1 -- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc06f170 msgr2=0x7f21bc1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21bbfff700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc06f170 0x7f21bc1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21bbfff700 1 -- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc06eda0 msgr2=0x7f21bc068fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21bbfff700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc06eda0 0x7f21bc068fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21bbfff700 1 -- 172.21.15.61:0/622398890 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b4009a20 con 0x7f21bc0b2f90 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21bbfff700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21bc0b2f90 0x7f21bc067550 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009fc0 tx=0x7f21b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21b37fe700 1 -- 172.21.15.61:0/622398890 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b400cbd0 con 0x7f21bc0b2f90 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.817+0000 7f21b37fe700 1 -- 172.21.15.61:0/622398890 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b400f040 con 0x7f21bc0b2f90 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.818+0000 7f21c1cc2700 1 -- 172.21.15.61:0/622398890 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a40094f0 con 0x7f21bc0b2f90 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.818+0000 7f21b37fe700 1 -- 172.21.15.61:0/622398890 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b4014480 con 0x7f21bc0b2f90 2023-12-24T19:59:22.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.818+0000 7f21c1cc2700 1 -- 172.21.15.61:0/622398890 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc153430 con 0x7f21bc0b2f90 2023-12-24T19:59:22.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.818+0000 7f21c1cc2700 1 -- 172.21.15.61:0/622398890 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc153290 con 0x7f21bc0b2f90 2023-12-24T19:59:22.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.819+0000 7f21b37fe700 1 -- 172.21.15.61:0/622398890 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f21b4003020 con 0x7f21bc0b2f90 2023-12-24T19:59:22.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.819+0000 7f21b37fe700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f219c066f30 0x7f219c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:22.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.819+0000 7f21b37fe700 1 -- 172.21.15.61:0/622398890 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f21b4084b00 con 0x7f21bc0b2f90 2023-12-24T19:59:22.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.820+0000 7f21bb7fe700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f219c066f30 0x7f219c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:22.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.820+0000 7f21bb7fe700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f219c066f30 0x7f219c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0b0770 tx=0x7f21ac007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:22.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:22.824+0000 7f21b37fe700 1 -- 172.21.15.61:0/622398890 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21bc153290 con 0x7f21bc0b2f90 2023-12-24T19:59:23.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.020+0000 7f21c1cc2700 1 -- 172.21.15.61:0/622398890 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f21bc153290 con 0x7f21bc0b2f90 2023-12-24T19:59:23.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.209+0000 7f21b37fe700 1 -- 172.21.15.61:0/622398890 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f21bc153290 con 0x7f21bc0b2f90 2023-12-24T19:59:23.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 -- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f219c066f30 msgr2=0x7f219c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:23.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f219c066f30 0x7f219c0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0b0770 tx=0x7f21ac007eb0 comp rx=0 tx=0).stop 2023-12-24T19:59:23.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 -- 172.21.15.61:0/622398890 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21bc0b2f90 msgr2=0x7f21bc067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:23.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21bc0b2f90 0x7f21bc067550 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009fc0 tx=0x7f21b400b040 comp rx=0 tx=0).stop 2023-12-24T19:59:23.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 -- 172.21.15.61:0/622398890 shutdown_connections 2023-12-24T19:59:23.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f219c066f30 0x7f219c0693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:23.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21bc0b2f90 0x7f21bc067550 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:23.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc06eda0 0x7f21bc068fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:23.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 --2- 172.21.15.61:0/622398890 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21bc06f170 0x7f21bc1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:23.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 -- 172.21.15.61:0/622398890 >> 172.21.15.61:0/622398890 conn(0x7f21bc06b690 msgr2=0x7f21bc0ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:23.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 -- 172.21.15.61:0/622398890 shutdown_connections 2023-12-24T19:59:23.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.213+0000 7f21c1cc2700 1 -- 172.21.15.61:0/622398890 wait complete. 2023-12-24T19:59:23.215 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T19:59:23.226 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T19:59:23.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.355+0000 7fe5457e6700 1 Processor -- start 2023-12-24T19:59:23.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.355+0000 7fe5457e6700 1 -- start start 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.355+0000 7fe5457e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5400b2aa0 0x7fe540159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.355+0000 7fe5457e6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe54006e280 0x7fe5400cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.355+0000 7fe5457e6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5400cbf80 con 0x7fe5401598d0 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.355+0000 7fe5457e6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5400b2f10 con 0x7fe54006e280 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.355+0000 7fe5457e6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5400b11c0 con 0x7fe5400b2aa0 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53f7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe54006e280 0x7fe5400cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53f7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe54006e280 0x7fe5400cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33286/0 (socket says 172.21.15.61:33286) 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53f7fe700 1 -- 172.21.15.61:0/3555368211 learned_addr learned my addr 172.21.15.61:0/3555368211 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53e7fc700 1 --2- 172.21.15.61:0/3555368211 >> v2:172.21.15.133:3300/0 conn(0x7fe5400b2aa0 0x7fe540159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53f7fe700 1 -- 172.21.15.61:0/3555368211 >> v2:172.21.15.133:3300/0 conn(0x7fe5400b2aa0 msgr2=0x7fe540159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53f7fe700 1 --2- 172.21.15.61:0/3555368211 >> v2:172.21.15.133:3300/0 conn(0x7fe5400b2aa0 0x7fe540159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53f7fe700 1 -- 172.21.15.61:0/3555368211 >> v1:172.21.15.133:6789/0 conn(0x7fe5401598d0 legacy=0x7fe54006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:23.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53f7fe700 1 -- 172.21.15.61:0/3555368211 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400b14a0 con 0x7fe54006e280 2023-12-24T19:59:23.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53f7fe700 1 --2- 172.21.15.61:0/3555368211 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 0x7fe5400cc410 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe5400cdfd0 tx=0x7fe538009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d2c131afc97f21 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:23.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53dffb700 1 -- 172.21.15.61:0/3555368211 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53800e070 con 0x7fe54006e280 2023-12-24T19:59:23.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53dffb700 1 -- 172.21.15.61:0/3555368211 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53800ba10 con 0x7fe54006e280 2023-12-24T19:59:23.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.356+0000 7fe53dffb700 1 -- 172.21.15.61:0/3555368211 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5380092e0 con 0x7fe54006e280 2023-12-24T19:59:23.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.357+0000 7fe5457e6700 1 -- 172.21.15.61:0/3555368211 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 msgr2=0x7fe5400cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:23.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.357+0000 7fe5457e6700 1 --2- 172.21.15.61:0/3555368211 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 0x7fe5400cc410 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe5400cdfd0 tx=0x7fe538009840 comp rx=0 tx=0).stop 2023-12-24T19:59:23.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.357+0000 7fe5457e6700 1 -- 172.21.15.61:0/3555368211 shutdown_connections 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.357+0000 7fe5457e6700 1 --2- 172.21.15.61:0/3555368211 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 0x7fe5400cc410 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.357+0000 7fe5457e6700 1 --2- 172.21.15.61:0/3555368211 >> v2:172.21.15.133:3300/0 conn(0x7fe5400b2aa0 0x7fe540159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.357+0000 7fe5457e6700 1 -- 172.21.15.61:0/3555368211 >> 172.21.15.61:0/3555368211 conn(0x7fe540067550 msgr2=0x7fe540067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.357+0000 7fe5457e6700 1 -- 172.21.15.61:0/3555368211 shutdown_connections 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.357+0000 7fe5457e6700 1 -- 172.21.15.61:0/3555368211 wait complete. 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.358+0000 7fe5457e6700 1 Processor -- start 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.358+0000 7fe5457e6700 1 -- start start 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe5457e6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 0x7fe5401540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe5457e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400b2aa0 0x7fe54015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe5457e6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5401598d0 0x7fe5400cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe5457e6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400c44b0 con 0x7fe54006e280 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe5457e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400c4700 con 0x7fe5400b2aa0 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe5457e6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400c49e0 con 0x7fe5401598d0 2023-12-24T19:59:23.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe53effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 0x7fe5401540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe53effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 0x7fe5401540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33300/0 (socket says 172.21.15.61:33300) 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe53effd700 1 -- 172.21.15.61:0/2851467266 learned_addr learned my addr 172.21.15.61:0/2851467266 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe53e7fc700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400b2aa0 0x7fe54015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe53f7fe700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5401598d0 0x7fe5400cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe53effd700 1 -- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5401598d0 msgr2=0x7fe5400cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe53effd700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5401598d0 0x7fe5400cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe53effd700 1 -- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400b2aa0 msgr2=0x7fe54015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe53effd700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400b2aa0 0x7fe54015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.359+0000 7fe53effd700 1 -- 172.21.15.61:0/2851467266 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe538009ae0 con 0x7fe54006e280 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.360+0000 7fe53effd700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 0x7fe5401540c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe53000b600 tx=0x7fe5300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.360+0000 7fe526ffd700 1 -- 172.21.15.61:0/2851467266 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000f510 con 0x7fe54006e280 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.360+0000 7fe526ffd700 1 -- 172.21.15.61:0/2851467266 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53000f690 con 0x7fe54006e280 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.360+0000 7fe5457e6700 1 -- 172.21.15.61:0/2851467266 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5400c4cc0 con 0x7fe54006e280 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.360+0000 7fe526ffd700 1 -- 172.21.15.61:0/2851467266 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000fa50 con 0x7fe54006e280 2023-12-24T19:59:23.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.360+0000 7fe5457e6700 1 -- 172.21.15.61:0/2851467266 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe540154600 con 0x7fe54006e280 2023-12-24T19:59:23.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.361+0000 7fe5457e6700 1 -- 172.21.15.61:0/2851467266 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe540089120 con 0x7fe54006e280 2023-12-24T19:59:23.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.361+0000 7fe526ffd700 1 -- 172.21.15.61:0/2851467266 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe53001a400 con 0x7fe54006e280 2023-12-24T19:59:23.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.362+0000 7fe526ffd700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:23.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.362+0000 7fe526ffd700 1 -- 172.21.15.61:0/2851467266 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fe530083d30 con 0x7fe54006e280 2023-12-24T19:59:23.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.362+0000 7fe53e7fc700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:23.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.362+0000 7fe53e7fc700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe52c066f30 0x7fe52c0693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe5400b4300 tx=0x7fe534008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:23.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.366+0000 7fe526ffd700 1 -- 172.21.15.61:0/2851467266 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe530051200 con 0x7fe54006e280 2023-12-24T19:59:23.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:23.564+0000 7fe5457e6700 1 -- 172.21.15.61:0/2851467266 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe54004c3c0 con 0x7fe54006e280 2023-12-24T19:59:24.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.211+0000 7fe526ffd700 1 -- 172.21.15.61:0/2851467266 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe530054820 con 0x7fe54006e280 2023-12-24T19:59:24.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.218+0000 7fe5457e6700 1 -- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe52c066f30 msgr2=0x7fe52c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:24.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.218+0000 7fe5457e6700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe52c066f30 0x7fe52c0693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe5400b4300 tx=0x7fe534008040 comp rx=0 tx=0).stop 2023-12-24T19:59:24.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.218+0000 7fe5457e6700 1 -- 172.21.15.61:0/2851467266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 msgr2=0x7fe5401540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:24.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.218+0000 7fe5457e6700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 0x7fe5401540c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe53000b600 tx=0x7fe5300091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:24.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.218+0000 7fe5457e6700 1 -- 172.21.15.61:0/2851467266 shutdown_connections 2023-12-24T19:59:24.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.218+0000 7fe5457e6700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe5401598d0 0x7fe5400cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:24.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.218+0000 7fe5457e6700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:24.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.218+0000 7fe5457e6700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe54006e280 0x7fe5401540c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:24.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.218+0000 7fe5457e6700 1 --2- 172.21.15.61:0/2851467266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400b2aa0 0x7fe54015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:24.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.218+0000 7fe5457e6700 1 -- 172.21.15.61:0/2851467266 >> 172.21.15.61:0/2851467266 conn(0x7fe540067550 msgr2=0x7fe540157870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:24.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.219+0000 7fe5457e6700 1 -- 172.21.15.61:0/2851467266 shutdown_connections 2023-12-24T19:59:24.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.219+0000 7fe5457e6700 1 -- 172.21.15.61:0/2851467266 wait complete. 2023-12-24T19:59:24.221 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T19:59:24.235 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T19:59:24.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.363+0000 7f4fa566a700 1 Processor -- start 2023-12-24T19:59:24.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.363+0000 7f4fa566a700 1 -- start start 2023-12-24T19:59:24.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.364+0000 7f4fa566a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4fa006b730 0x7f4fa01596d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:24.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.364+0000 7f4fa566a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa00ce3f0 0x7f4fa0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:24.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.364+0000 7f4fa566a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa006d460 con 0x7f4fa00ce020 2023-12-24T19:59:24.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.364+0000 7f4fa566a700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa006c450 con 0x7f4fa006b730 2023-12-24T19:59:24.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.364+0000 7f4fa566a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa015a150 con 0x7f4fa00ce3f0 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.364+0000 7f4f9e7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4fa006b730 0x7f4fa01596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.364+0000 7f4f9e7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4fa006b730 0x7f4fa01596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33310/0 (socket says 172.21.15.61:33310) 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9e7fc700 1 -- 172.21.15.61:0/1362119703 learned_addr learned my addr 172.21.15.61:0/1362119703 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9f7fe700 1 --2- 172.21.15.61:0/1362119703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa00ce3f0 0x7f4fa0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9e7fc700 1 -- 172.21.15.61:0/1362119703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa00ce3f0 msgr2=0x7f4fa0159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9e7fc700 1 --2- 172.21.15.61:0/1362119703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa00ce3f0 0x7f4fa0159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9e7fc700 1 -- 172.21.15.61:0/1362119703 >> v1:172.21.15.133:6789/0 conn(0x7f4fa00ce020 legacy=0x7f4fa0068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9e7fc700 1 -- 172.21.15.61:0/1362119703 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa006c6a0 con 0x7f4fa006b730 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9f7fe700 1 --2- 172.21.15.61:0/1362119703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa00ce3f0 0x7f4fa0159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9e7fc700 1 --2- 172.21.15.61:0/1362119703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa006b730 0x7f4fa01596d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4f900099b0 tx=0x7f4f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393af05d340a1188 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9dffb700 1 -- 172.21.15.61:0/1362119703 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000b860 con 0x7f4fa006b730 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9dffb700 1 -- 172.21.15.61:0/1362119703 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9000b9c0 con 0x7f4fa006b730 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.365+0000 7f4f9dffb700 1 -- 172.21.15.61:0/1362119703 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000bd60 con 0x7f4fa006b730 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.366+0000 7f4fa566a700 1 -- 172.21.15.61:0/1362119703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa006b730 msgr2=0x7f4fa01596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:24.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.366+0000 7f4fa566a700 1 --2- 172.21.15.61:0/1362119703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa006b730 0x7f4fa01596d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4f900099b0 tx=0x7f4f90009250 comp rx=0 tx=0).stop 2023-12-24T19:59:24.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.366+0000 7f4fa566a700 1 -- 172.21.15.61:0/1362119703 shutdown_connections 2023-12-24T19:59:24.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.366+0000 7f4fa566a700 1 --2- 172.21.15.61:0/1362119703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa00ce3f0 0x7f4fa0159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:24.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.366+0000 7f4fa566a700 1 --2- 172.21.15.61:0/1362119703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa006b730 0x7f4fa01596d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:24.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.366+0000 7f4fa566a700 1 -- 172.21.15.61:0/1362119703 >> 172.21.15.61:0/1362119703 conn(0x7f4fa006f820 msgr2=0x7f4fa006ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:24.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.366+0000 7f4fa566a700 1 -- 172.21.15.61:0/1362119703 shutdown_connections 2023-12-24T19:59:24.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.366+0000 7f4fa566a700 1 -- 172.21.15.61:0/1362119703 wait complete. 2023-12-24T19:59:24.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.367+0000 7f4fa566a700 1 Processor -- start 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.367+0000 7f4fa566a700 1 -- start start 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4fa566a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa006b730 0x7f4fa00b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4fa566a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa00ce020 0x7f4fa0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4fa566a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fa00ce3f0 0x7f4fa015f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4fa566a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa01570f0 con 0x7f4fa00ce020 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4fa566a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa00c6cf0 con 0x7f4fa00ce3f0 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4fa566a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa015f6c0 con 0x7f4fa006b730 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9e7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa00ce020 0x7f4fa0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9e7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa00ce020 0x7f4fa0156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33324/0 (socket says 172.21.15.61:33324) 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9e7fc700 1 -- 172.21.15.61:0/1164596111 learned_addr learned my addr 172.21.15.61:0/1164596111 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9effd700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa006b730 0x7f4fa00b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9f7fe700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fa00ce3f0 0x7f4fa015f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9e7fc700 1 -- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa006b730 msgr2=0x7f4fa00b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:24.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9e7fc700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa006b730 0x7f4fa00b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9e7fc700 1 -- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fa00ce3f0 msgr2=0x7f4fa015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9e7fc700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fa00ce3f0 0x7f4fa015f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9e7fc700 1 -- 172.21.15.61:0/1164596111 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900094f0 con 0x7f4fa00ce020 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.368+0000 7f4f9e7fc700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa00ce020 0x7f4fa0156bb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009290 tx=0x7f4f90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.369+0000 7f4f96ffd700 1 -- 172.21.15.61:0/1164596111 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90011e00 con 0x7f4fa00ce020 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.369+0000 7f4f96ffd700 1 -- 172.21.15.61:0/1164596111 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9001f070 con 0x7f4fa00ce020 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.369+0000 7f4fa566a700 1 -- 172.21.15.61:0/1164596111 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa00b2980 con 0x7f4fa00ce020 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.369+0000 7f4f96ffd700 1 -- 172.21.15.61:0/1164596111 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900266d0 con 0x7f4fa00ce020 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.369+0000 7f4fa566a700 1 -- 172.21.15.61:0/1164596111 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa00b2f40 con 0x7f4fa00ce020 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.370+0000 7f4fa566a700 1 -- 172.21.15.61:0/1164596111 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa00c6ea0 con 0x7f4fa00ce020 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.370+0000 7f4f96ffd700 1 -- 172.21.15.61:0/1164596111 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4f90026a40 con 0x7f4fa00ce020 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.370+0000 7f4f96ffd700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4f80066f30 0x7f4f800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:24.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.371+0000 7f4f96ffd700 1 -- 172.21.15.61:0/1164596111 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f4f90021070 con 0x7f4fa00ce020 2023-12-24T19:59:24.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.371+0000 7f4f9effd700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4f80066f30 0x7f4f800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:24.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.371+0000 7f4f9effd700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4f80066f30 0x7f4f800693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4f88003a80 tx=0x7f4f88007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:24.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.375+0000 7f4f96ffd700 1 -- 172.21.15.61:0/1164596111 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fa00c6ea0 con 0x7f4fa00ce020 2023-12-24T19:59:24.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:24.617+0000 7f4fa566a700 1 -- 172.21.15.61:0/1164596111 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4fa00b3160 con 0x7f4fa00ce020 2023-12-24T19:59:25.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.250+0000 7f4f96ffd700 1 -- 172.21.15.61:0/1164596111 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v31) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4f900534d0 con 0x7f4fa00ce020 2023-12-24T19:59:25.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 -- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4f80066f30 msgr2=0x7f4f800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4f80066f30 0x7f4f800693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4f88003a80 tx=0x7f4f88007ec0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 -- 172.21.15.61:0/1164596111 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa00ce020 msgr2=0x7f4fa0156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa00ce020 0x7f4fa0156bb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009290 tx=0x7f4f90017000 comp rx=0 tx=0).stop 2023-12-24T19:59:25.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 -- 172.21.15.61:0/1164596111 shutdown_connections 2023-12-24T19:59:25.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4fa006b730 0x7f4fa00b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4f80066f30 0x7f4f800693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fa00ce3f0 0x7f4fa015f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 --2- 172.21.15.61:0/1164596111 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4fa00ce020 0x7f4fa0156bb0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 -- 172.21.15.61:0/1164596111 >> 172.21.15.61:0/1164596111 conn(0x7f4fa006f820 msgr2=0x7f4fa00c9060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:25.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 -- 172.21.15.61:0/1164596111 shutdown_connections 2023-12-24T19:59:25.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.255+0000 7f4fa566a700 1 -- 172.21.15.61:0/1164596111 wait complete. 2023-12-24T19:59:25.256 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 8 and data pool 9 2023-12-24T19:59:25.269 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:59:25.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.391+0000 7f72813fe700 1 Processor -- start 2023-12-24T19:59:25.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.392+0000 7f72813fe700 1 -- start start 2023-12-24T19:59:25.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.392+0000 7f72813fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f727c159fe0 0x7f727c0cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.392+0000 7f72813fe700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c0af880 con 0x7f727c0c5ee0 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.392+0000 7f72813fe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c0c6fc0 con 0x7f727c159c10 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.392+0000 7f72813fe700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c0c63b0 con 0x7f727c159fe0 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.392+0000 7f727a7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f727c159fe0 0x7f727c0cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.393+0000 7f727b7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f727c0c5ee0 0x7f727c0b09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59404/0 (socket says 172.21.15.61:59404) 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.393+0000 7f727b7fe700 1 -- 172.21.15.61:0/1127882914 learned_addr learned my addr 172.21.15.61:0/1127882914 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.393+0000 7f727a7fc700 1 -- 172.21.15.61:0/1127882914 >> v1:172.21.15.133:6789/0 conn(0x7f727c159c10 legacy=0x7f727c0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.393+0000 7f727a7fc700 1 -- 172.21.15.61:0/1127882914 >> v1:172.21.15.61:6789/0 conn(0x7f727c0c5ee0 legacy=0x7f727c0b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.393+0000 7f727a7fc700 1 -- 172.21.15.61:0/1127882914 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c0c6690 con 0x7f727c159fe0 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.393+0000 7f727a7fc700 1 --2- 172.21.15.61:0/1127882914 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159fe0 0x7f727c0cba80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7264009910 tx=0x7f72640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb98ec631b2e5ef2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.393+0000 7f7279ffb700 1 -- 172.21.15.61:0/1127882914 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400b820 con 0x7f727c159fe0 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.393+0000 7f7279ffb700 1 -- 172.21.15.61:0/1127882914 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726400b980 con 0x7f727c159fe0 2023-12-24T19:59:25.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.393+0000 7f7279ffb700 1 -- 172.21.15.61:0/1127882914 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400bd20 con 0x7f727c159fe0 2023-12-24T19:59:25.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.394+0000 7f72813fe700 1 -- 172.21.15.61:0/1127882914 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159fe0 msgr2=0x7f727c0cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.394+0000 7f72813fe700 1 --2- 172.21.15.61:0/1127882914 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159fe0 0x7f727c0cba80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7264009910 tx=0x7f72640091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.394+0000 7f72813fe700 1 -- 172.21.15.61:0/1127882914 shutdown_connections 2023-12-24T19:59:25.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.394+0000 7f72813fe700 1 --2- 172.21.15.61:0/1127882914 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159fe0 0x7f727c0cba80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.394+0000 7f72813fe700 1 -- 172.21.15.61:0/1127882914 >> 172.21.15.61:0/1127882914 conn(0x7f727c06e640 msgr2=0x7f727c067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:25.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.394+0000 7f72813fe700 1 -- 172.21.15.61:0/1127882914 shutdown_connections 2023-12-24T19:59:25.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.394+0000 7f72813fe700 1 -- 172.21.15.61:0/1127882914 wait complete. 2023-12-24T19:59:25.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.395+0000 7f72813fe700 1 Processor -- start 2023-12-24T19:59:25.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.395+0000 7f72813fe700 1 -- start start 2023-12-24T19:59:25.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f72813fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f727c0c5ee0 0x7f727c0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f72813fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159c10 0x7f727c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f72813fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f727c159fe0 0x7f727c158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f72813fe700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0b4540 con 0x7f727c159c10 2023-12-24T19:59:25.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f72813fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0b3950 con 0x7f727c0c5ee0 2023-12-24T19:59:25.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f72813fe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0b3c10 con 0x7f727c159fe0 2023-12-24T19:59:25.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727a7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159c10 0x7f727c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727a7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159c10 0x7f727c1584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33344/0 (socket says 172.21.15.61:33344) 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727a7fc700 1 -- 172.21.15.61:0/782600995 learned_addr learned my addr 172.21.15.61:0/782600995 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727affd700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f727c0c5ee0 0x7f727c0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727a7fc700 1 -- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f727c159fe0 msgr2=0x7f727c158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727a7fc700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f727c159fe0 0x7f727c158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727a7fc700 1 -- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f727c0c5ee0 msgr2=0x7f727c0b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727a7fc700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f727c0c5ee0 0x7f727c0b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727a7fc700 1 -- 172.21.15.61:0/782600995 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009420 con 0x7f727c159c10 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727affd700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f727c0c5ee0 0x7f727c0b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.396+0000 7f727a7fc700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159c10 0x7f727c1584f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7264013000 tx=0x7f7264017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.397+0000 7f7272ffd700 1 -- 172.21.15.61:0/782600995 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264024440 con 0x7f727c159c10 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.397+0000 7f7272ffd700 1 -- 172.21.15.61:0/782600995 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72640245c0 con 0x7f727c159c10 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.397+0000 7f72813fe700 1 -- 172.21.15.61:0/782600995 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c0b3ef0 con 0x7f727c159c10 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.397+0000 7f7272ffd700 1 -- 172.21.15.61:0/782600995 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264024980 con 0x7f727c159c10 2023-12-24T19:59:25.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.397+0000 7f72813fe700 1 -- 172.21.15.61:0/782600995 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c0b5c30 con 0x7f727c159c10 2023-12-24T19:59:25.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.398+0000 7f72813fe700 1 -- 172.21.15.61:0/782600995 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c0890b0 con 0x7f727c159c10 2023-12-24T19:59:25.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.398+0000 7f7272ffd700 1 -- 172.21.15.61:0/782600995 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f726401a420 con 0x7f727c159c10 2023-12-24T19:59:25.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.398+0000 7f7272ffd700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f725c066f30 0x7f725c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.399+0000 7f7272ffd700 1 -- 172.21.15.61:0/782600995 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7264086560 con 0x7f727c159c10 2023-12-24T19:59:25.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.399+0000 7f727affd700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f725c066f30 0x7f725c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:25.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.399+0000 7f727affd700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f725c066f30 0x7f725c0693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f726c001840 tx=0x7f726c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:25.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.403+0000 7f7272ffd700 1 -- 172.21.15.61:0/782600995 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72640537d0 con 0x7f727c159c10 2023-12-24T19:59:25.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.599+0000 7f72813fe700 1 -- 172.21.15.61:0/782600995 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f727c04c3c0 con 0x7f727c159c10 2023-12-24T19:59:25.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.599+0000 7f7272ffd700 1 -- 172.21.15.61:0/782600995 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f726402b340 con 0x7f727c159c10 2023-12-24T19:59:25.600 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:25.600 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":61,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:59:24.618771+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:59:23.050869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-24T19:59:23.594703+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:59:25.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.601+0000 7f72813fe700 1 -- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f725c066f30 msgr2=0x7f725c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.601+0000 7f72813fe700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f725c066f30 0x7f725c0693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f726c001840 tx=0x7f726c009040 comp rx=0 tx=0).stop 2023-12-24T19:59:25.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.601+0000 7f72813fe700 1 -- 172.21.15.61:0/782600995 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159c10 msgr2=0x7f727c1584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.601+0000 7f72813fe700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159c10 0x7f727c1584f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7264013000 tx=0x7f7264017000 comp rx=0 tx=0).stop 2023-12-24T19:59:25.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.601+0000 7f72813fe700 1 -- 172.21.15.61:0/782600995 shutdown_connections 2023-12-24T19:59:25.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.601+0000 7f72813fe700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f727c159fe0 0x7f727c158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.601+0000 7f72813fe700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f725c066f30 0x7f725c0693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.601+0000 7f72813fe700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f727c0c5ee0 0x7f727c0b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.601+0000 7f72813fe700 1 --2- 172.21.15.61:0/782600995 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f727c159c10 0x7f727c1584f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.601+0000 7f72813fe700 1 -- 172.21.15.61:0/782600995 >> 172.21.15.61:0/782600995 conn(0x7f727c06e640 msgr2=0x7f727c157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:25.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.602+0000 7f72813fe700 1 -- 172.21.15.61:0/782600995 shutdown_connections 2023-12-24T19:59:25.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.602+0000 7f72813fe700 1 -- 172.21.15.61:0/782600995 wait complete. 2023-12-24T19:59:25.614 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:59:25.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.735+0000 7fe813c11700 1 Processor -- start 2023-12-24T19:59:25.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.735+0000 7fe813c11700 1 -- start start 2023-12-24T19:59:25.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.736+0000 7fe813c11700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe80c0b2660 0x7fe80c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.736+0000 7fe813c11700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe80c15c470 0x7fe80c0b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.736+0000 7fe813c11700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0b2eb0 con 0x7fe80c15bb60 2023-12-24T19:59:25.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.736+0000 7fe813c11700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0afc20 con 0x7fe80c15c470 2023-12-24T19:59:25.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.736+0000 7fe813c11700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0b2bd0 con 0x7fe80c0b2660 2023-12-24T19:59:25.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.736+0000 7fe8121ae700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe80c15c470 0x7fe80c0b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:25.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.736+0000 7fe8119ad700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe80c15bb60 0x7fe80c098560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59408/0 (socket says 172.21.15.61:59408) 2023-12-24T19:59:25.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.736+0000 7fe8119ad700 1 -- 172.21.15.61:0/2231809008 learned_addr learned my addr 172.21.15.61:0/2231809008 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:25.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.736+0000 7fe8111ac700 1 --2- 172.21.15.61:0/2231809008 >> v2:172.21.15.133:3300/0 conn(0x7fe80c0b2660 0x7fe80c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:25.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.736+0000 7fe8109ab700 1 -- 172.21.15.61:0/2231809008 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281008148 0 0) 0x7fe80c0b2eb0 con 0x7fe80c15bb60 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe8109ab700 1 -- 172.21.15.61:0/2231809008 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f8003570 con 0x7fe80c15bb60 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe8121ae700 1 -- 172.21.15.61:0/2231809008 >> v2:172.21.15.133:3300/0 conn(0x7fe80c0b2660 msgr2=0x7fe80c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe8121ae700 1 --2- 172.21.15.61:0/2231809008 >> v2:172.21.15.133:3300/0 conn(0x7fe80c0b2660 0x7fe80c15bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe8121ae700 1 -- 172.21.15.61:0/2231809008 >> v1:172.21.15.61:6789/0 conn(0x7fe80c15bb60 legacy=0x7fe80c098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe8121ae700 1 -- 172.21.15.61:0/2231809008 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0afe10 con 0x7fe80c15c470 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe8121ae700 1 --2- 172.21.15.61:0/2231809008 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 0x7fe80c0b08f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06e250 tx=0x7fe804009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f8953d243cb52a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe8109ab700 1 -- 172.21.15.61:0/2231809008 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400e070 con 0x7fe80c15c470 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe8109ab700 1 -- 172.21.15.61:0/2231809008 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80400bab0 con 0x7fe80c15c470 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe8109ab700 1 -- 172.21.15.61:0/2231809008 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400be70 con 0x7fe80c15c470 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe813c11700 1 -- 172.21.15.61:0/2231809008 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 msgr2=0x7fe80c0b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.737+0000 7fe813c11700 1 --2- 172.21.15.61:0/2231809008 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 0x7fe80c0b08f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06e250 tx=0x7fe804009780 comp rx=0 tx=0).stop 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.738+0000 7fe813c11700 1 -- 172.21.15.61:0/2231809008 shutdown_connections 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.738+0000 7fe813c11700 1 --2- 172.21.15.61:0/2231809008 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 0x7fe80c0b08f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.738+0000 7fe813c11700 1 --2- 172.21.15.61:0/2231809008 >> v2:172.21.15.133:3300/0 conn(0x7fe80c0b2660 0x7fe80c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.738+0000 7fe813c11700 1 -- 172.21.15.61:0/2231809008 >> 172.21.15.61:0/2231809008 conn(0x7fe80c097a10 msgr2=0x7fe80c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:25.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.738+0000 7fe813c11700 1 -- 172.21.15.61:0/2231809008 shutdown_connections 2023-12-24T19:59:25.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.738+0000 7fe813c11700 1 -- 172.21.15.61:0/2231809008 wait complete. 2023-12-24T19:59:25.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.739+0000 7fe813c11700 1 Processor -- start 2023-12-24T19:59:25.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.739+0000 7fe813c11700 1 -- start start 2023-12-24T19:59:25.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.739+0000 7fe813c11700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c0b2660 0x7fe80c0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe813c11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c15bb60 0x7fe80c0c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe813c11700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 0x7fe80c14bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe813c11700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0ad690 con 0x7fe80c15c470 2023-12-24T19:59:25.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe813c11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0ac0b0 con 0x7fe80c15bb60 2023-12-24T19:59:25.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe813c11700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0ac390 con 0x7fe80c0b2660 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8121ae700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 0x7fe80c14bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8121ae700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 0x7fe80c14bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33362/0 (socket says 172.21.15.61:33362) 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8121ae700 1 -- 172.21.15.61:0/72983436 learned_addr learned my addr 172.21.15.61:0/72983436 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8119ad700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c0b2660 0x7fe80c0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8111ac700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c15bb60 0x7fe80c0c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8121ae700 1 -- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c0b2660 msgr2=0x7fe80c0ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8121ae700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c0b2660 0x7fe80c0ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8121ae700 1 -- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c15bb60 msgr2=0x7fe80c0c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8121ae700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c15bb60 0x7fe80c0c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8121ae700 1 -- 172.21.15.61:0/72983436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804009a20 con 0x7fe80c15c470 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe8121ae700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 0x7fe80c14bbd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06d8b0 tx=0x7fe804019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe7fdffb700 1 -- 172.21.15.61:0/72983436 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804027470 con 0x7fe80c15c470 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe7fdffb700 1 -- 172.21.15.61:0/72983436 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8040275d0 con 0x7fe80c15c470 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe813c11700 1 -- 172.21.15.61:0/72983436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c0ac670 con 0x7fe80c15c470 2023-12-24T19:59:25.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.740+0000 7fe7fdffb700 1 -- 172.21.15.61:0/72983436 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804027990 con 0x7fe80c15c470 2023-12-24T19:59:25.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.741+0000 7fe813c11700 1 -- 172.21.15.61:0/72983436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c0acc30 con 0x7fe80c15c470 2023-12-24T19:59:25.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.742+0000 7fe813c11700 1 -- 172.21.15.61:0/72983436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c0acdf0 con 0x7fe80c15c470 2023-12-24T19:59:25.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.742+0000 7fe7fdffb700 1 -- 172.21.15.61:0/72983436 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe804024070 con 0x7fe80c15c470 2023-12-24T19:59:25.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.743+0000 7fe7fdffb700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7f0066f30 0x7fe7f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:25.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.743+0000 7fe7fdffb700 1 -- 172.21.15.61:0/72983436 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe804086f30 con 0x7fe80c15c470 2023-12-24T19:59:25.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.743+0000 7fe8119ad700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7f0066f30 0x7fe7f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:25.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.743+0000 7fe8119ad700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7f0066f30 0x7fe7f00693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe800001360 tx=0x7fe800009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:25.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.747+0000 7fe7fdffb700 1 -- 172.21.15.61:0/72983436 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8040541a0 con 0x7fe80c15c470 2023-12-24T19:59:25.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.945+0000 7fe813c11700 1 -- 172.21.15.61:0/72983436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe80c06d440 con 0x7fe80c15c470 2023-12-24T19:59:25.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.946+0000 7fe7fdffb700 1 -- 172.21.15.61:0/72983436 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fe80402c090 con 0x7fe80c15c470 2023-12-24T19:59:25.947 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:25.947 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":61,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:59:24.618771+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:59:23.050869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-24T19:59:23.594703+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:59:25.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 -- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7f0066f30 msgr2=0x7fe7f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7f0066f30 0x7fe7f00693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe800001360 tx=0x7fe800009040 comp rx=0 tx=0).stop 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 -- 172.21.15.61:0/72983436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 msgr2=0x7fe80c14bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 0x7fe80c14bbd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06d8b0 tx=0x7fe804019000 comp rx=0 tx=0).stop 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 -- 172.21.15.61:0/72983436 shutdown_connections 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe80c0b2660 0x7fe80c0ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7f0066f30 0x7fe7f00693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe80c15c470 0x7fe80c14bbd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 --2- 172.21.15.61:0/72983436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe80c15bb60 0x7fe80c0c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 -- 172.21.15.61:0/72983436 >> 172.21.15.61:0/72983436 conn(0x7fe80c097a10 msgr2=0x7fe80c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 -- 172.21.15.61:0/72983436 shutdown_connections 2023-12-24T19:59:25.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:25.949+0000 7fe813c11700 1 -- 172.21.15.61:0/72983436 wait complete. 2023-12-24T19:59:25.962 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T19:59:26.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.086+0000 7fcb349d0700 1 Processor -- start 2023-12-24T19:59:26.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.086+0000 7fcb349d0700 1 -- start start 2023-12-24T19:59:26.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb349d0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcb301578d0 0x7fcb300af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:26.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb349d0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3006b320 0x7fcb300c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:26.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb349d0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb300caf30 con 0x7fcb3006f6e0 2023-12-24T19:59:26.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb349d0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb300af9f0 con 0x7fcb301578d0 2023-12-24T19:59:26.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb349d0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300afcd0 con 0x7fcb3006b320 2023-12-24T19:59:26.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb2e59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcb301578d0 0x7fcb300af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:26.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb2e59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcb301578d0 0x7fcb300af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33366/0 (socket says 172.21.15.61:33366) 2023-12-24T19:59:26.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb2e59c700 1 -- 172.21.15.61:0/2478590541 learned_addr learned my addr 172.21.15.61:0/2478590541 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb2ed9d700 1 --2- 172.21.15.61:0/2478590541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3006b320 0x7fcb300c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb2e59c700 1 -- 172.21.15.61:0/2478590541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3006b320 msgr2=0x7fcb300c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb2e59c700 1 --2- 172.21.15.61:0/2478590541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3006b320 0x7fcb300c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb2e59c700 1 -- 172.21.15.61:0/2478590541 >> v1:172.21.15.133:6789/0 conn(0x7fcb3006f6e0 legacy=0x7fcb3006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb2e59c700 1 -- 172.21.15.61:0/2478590541 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb300affb0 con 0x7fcb301578d0 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.087+0000 7fcb2e59c700 1 --2- 172.21.15.61:0/2478590541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 0x7fcb300af330 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcb200099b0 tx=0x7fcb20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbfaca06ebeca88 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb2d59a700 1 -- 172.21.15.61:0/2478590541 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000b860 con 0x7fcb301578d0 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb2d59a700 1 -- 172.21.15.61:0/2478590541 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2000b9c0 con 0x7fcb301578d0 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb2d59a700 1 -- 172.21.15.61:0/2478590541 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000bd60 con 0x7fcb301578d0 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb349d0700 1 -- 172.21.15.61:0/2478590541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 msgr2=0x7fcb300af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb349d0700 1 --2- 172.21.15.61:0/2478590541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 0x7fcb300af330 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcb200099b0 tx=0x7fcb20009250 comp rx=0 tx=0).stop 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb349d0700 1 -- 172.21.15.61:0/2478590541 shutdown_connections 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb349d0700 1 --2- 172.21.15.61:0/2478590541 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3006b320 0x7fcb300c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:26.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb349d0700 1 --2- 172.21.15.61:0/2478590541 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 0x7fcb300af330 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:26.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb349d0700 1 -- 172.21.15.61:0/2478590541 >> 172.21.15.61:0/2478590541 conn(0x7fcb300ce800 msgr2=0x7fcb300cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:26.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb349d0700 1 -- 172.21.15.61:0/2478590541 shutdown_connections 2023-12-24T19:59:26.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.088+0000 7fcb349d0700 1 -- 172.21.15.61:0/2478590541 wait complete. 2023-12-24T19:59:26.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.089+0000 7fcb349d0700 1 Processor -- start 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.089+0000 7fcb349d0700 1 -- start start 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb349d0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3006b320 0x7fcb30156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb349d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb3006f6e0 0x7fcb300a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb349d0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 0x7fcb3016dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb349d0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb30158530 con 0x7fcb301578d0 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb349d0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb301599d0 con 0x7fcb3006f6e0 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb349d0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300a69c0 con 0x7fcb3006b320 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb2ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 0x7fcb3016dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb2ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 0x7fcb3016dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33370/0 (socket says 172.21.15.61:33370) 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb2ed9d700 1 -- 172.21.15.61:0/118220581 learned_addr learned my addr 172.21.15.61:0/118220581 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb2e59c700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3006b320 0x7fcb30156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.090+0000 7fcb2dd9b700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb3006f6e0 0x7fcb300a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb2ed9d700 1 -- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3006b320 msgr2=0x7fcb30156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:26.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb2ed9d700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3006b320 0x7fcb30156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb2ed9d700 1 -- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb3006f6e0 msgr2=0x7fcb300a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb2ed9d700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb3006f6e0 0x7fcb300a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb2ed9d700 1 -- 172.21.15.61:0/118220581 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb200094f0 con 0x7fcb301578d0 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb2dd9b700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb3006f6e0 0x7fcb300a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb2ed9d700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 0x7fcb3016dae0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcb28007f30 tx=0x7fcb280098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb1e7fc700 1 -- 172.21.15.61:0/118220581 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800ec40 con 0x7fcb301578d0 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb1e7fc700 1 -- 172.21.15.61:0/118220581 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2800eda0 con 0x7fcb301578d0 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb349d0700 1 -- 172.21.15.61:0/118220581 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb30158250 con 0x7fcb301578d0 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb1e7fc700 1 -- 172.21.15.61:0/118220581 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb28014670 con 0x7fcb301578d0 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.091+0000 7fcb349d0700 1 -- 172.21.15.61:0/118220581 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb30159660 con 0x7fcb301578d0 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.092+0000 7fcb349d0700 1 -- 172.21.15.61:0/118220581 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb301574c0 con 0x7fcb301578d0 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.092+0000 7fcb1e7fc700 1 -- 172.21.15.61:0/118220581 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcb28014a20 con 0x7fcb301578d0 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.093+0000 7fcb1e7fc700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcb10066f30 0x7fcb100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.093+0000 7fcb1e7fc700 1 -- 172.21.15.61:0/118220581 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb28084c20 con 0x7fcb301578d0 2023-12-24T19:59:26.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.093+0000 7fcb2e59c700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcb10066f30 0x7fcb100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:26.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.093+0000 7fcb2e59c700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcb10066f30 0x7fcb100693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcb200099b0 tx=0x7fcb20017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:26.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.097+0000 7fcb1e7fc700 1 -- 172.21.15.61:0/118220581 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb28051e90 con 0x7fcb301578d0 2023-12-24T19:59:26.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:26.342+0000 7fcb349d0700 1 -- 172.21.15.61:0/118220581 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcb300cf6d0 con 0x7fcb301578d0 2023-12-24T19:59:27.201 INFO:tasks.ceph.mds.a.smithi061.stderr:2023-12-24T19:59:27.201+0000 7f01d2b8e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T19:59:27.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.256+0000 7fcb1e7fc700 1 -- 172.21.15.61:0/118220581 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcb28009a20 con 0x7fcb301578d0 2023-12-24T19:59:27.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 -- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcb10066f30 msgr2=0x7fcb100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:27.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcb10066f30 0x7fcb100693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcb200099b0 tx=0x7fcb20017000 comp rx=0 tx=0).stop 2023-12-24T19:59:27.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 -- 172.21.15.61:0/118220581 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 msgr2=0x7fcb3016dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:27.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 0x7fcb3016dae0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcb28007f30 tx=0x7fcb280098e0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 -- 172.21.15.61:0/118220581 shutdown_connections 2023-12-24T19:59:27.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcb3006b320 0x7fcb30156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcb10066f30 0x7fcb100693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcb301578d0 0x7fcb3016dae0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 --2- 172.21.15.61:0/118220581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb3006f6e0 0x7fcb300a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 -- 172.21.15.61:0/118220581 >> 172.21.15.61:0/118220581 conn(0x7fcb300ce800 msgr2=0x7fcb300cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:27.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 -- 172.21.15.61:0/118220581 shutdown_connections 2023-12-24T19:59:27.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.259+0000 7fcb349d0700 1 -- 172.21.15.61:0/118220581 wait complete. 2023-12-24T19:59:27.276 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T19:59:27.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.410+0000 7fa59fe74700 1 Processor -- start 2023-12-24T19:59:27.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.411+0000 7fa59fe74700 1 -- start start 2023-12-24T19:59:27.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.411+0000 7fa59fe74700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815afd0 0x7fa5980cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:27.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.411+0000 7fa59fe74700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5980cb3d0 0x7fa5980aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:27.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.411+0000 7fa59fe74700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5980cb7e0 con 0x7fa59815ac00 2023-12-24T19:59:27.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.411+0000 7fa59fe74700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5980c8c30 con 0x7fa5980cb3d0 2023-12-24T19:59:27.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.411+0000 7fa59fe74700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5980c7e00 con 0x7fa59815afd0 2023-12-24T19:59:27.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59e411700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5980cb3d0 0x7fa5980aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:27.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59d40f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815afd0 0x7fa5980cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:27.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59e411700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5980cb3d0 0x7fa5980aabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:53292/0 (socket says 172.21.15.61:53292) 2023-12-24T19:59:27.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59e411700 1 -- 172.21.15.61:0/52763939 learned_addr learned my addr 172.21.15.61:0/52763939 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:27.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59dc10700 1 --1- 172.21.15.61:0/52763939 >> v1:172.21.15.133:6789/0 conn(0x7fa59815ac00 0x7fa5980c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:43228/0 (socket says 172.21.15.61:43228) 2023-12-24T19:59:27.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59d40f700 1 -- 172.21.15.61:0/52763939 >> v2:172.21.15.133:3300/0 conn(0x7fa5980cb3d0 msgr2=0x7fa5980aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:27.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59d40f700 1 --2- 172.21.15.61:0/52763939 >> v2:172.21.15.133:3300/0 conn(0x7fa5980cb3d0 0x7fa5980aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59d40f700 1 -- 172.21.15.61:0/52763939 >> v1:172.21.15.133:6789/0 conn(0x7fa59815ac00 legacy=0x7fa5980c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:27.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59d40f700 1 -- 172.21.15.61:0/52763939 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5980c80b0 con 0x7fa59815afd0 2023-12-24T19:59:27.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59cc0e700 1 -- 172.21.15.61:0/52763939 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109029072 0 0) 0x7fa5980cb7e0 con 0x7fa59815ac00 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.412+0000 7fa59e411700 1 --2- 172.21.15.61:0/52763939 >> v2:172.21.15.133:3300/0 conn(0x7fa5980cb3d0 0x7fa5980aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59d40f700 1 --2- 172.21.15.61:0/52763939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815afd0 0x7fa5980cae90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5940098e0 tx=0x7fa5940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa3d5b6f9b89388b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59cc0e700 1 -- 172.21.15.61:0/52763939 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400b640 con 0x7fa59815afd0 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59cc0e700 1 -- 172.21.15.61:0/52763939 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59400b7a0 con 0x7fa59815afd0 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59cc0e700 1 -- 172.21.15.61:0/52763939 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400bb40 con 0x7fa59815afd0 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59fe74700 1 -- 172.21.15.61:0/52763939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815afd0 msgr2=0x7fa5980cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59fe74700 1 --2- 172.21.15.61:0/52763939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815afd0 0x7fa5980cae90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa5940098e0 tx=0x7fa5940091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59fe74700 1 -- 172.21.15.61:0/52763939 shutdown_connections 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59fe74700 1 --2- 172.21.15.61:0/52763939 >> v2:172.21.15.133:3300/0 conn(0x7fa5980cb3d0 0x7fa5980aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59fe74700 1 --2- 172.21.15.61:0/52763939 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815afd0 0x7fa5980cae90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59fe74700 1 -- 172.21.15.61:0/52763939 >> 172.21.15.61:0/52763939 conn(0x7fa5980cd0b0 msgr2=0x7fa5980cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.413+0000 7fa59fe74700 1 -- 172.21.15.61:0/52763939 shutdown_connections 2023-12-24T19:59:27.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.414+0000 7fa59fe74700 1 -- 172.21.15.61:0/52763939 wait complete. 2023-12-24T19:59:27.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.415+0000 7fa59fe74700 1 Processor -- start 2023-12-24T19:59:27.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.415+0000 7fa59fe74700 1 -- start start 2023-12-24T19:59:27.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.415+0000 7fa59fe74700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5980cb3d0 0x7fa59813f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.415+0000 7fa59fe74700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815ac00 0x7fa59816a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.415+0000 7fa59fe74700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa59815afd0 0x7fa59816a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.415+0000 7fa59fe74700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5980add90 con 0x7fa5980cb3d0 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.415+0000 7fa59fe74700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5980c71a0 con 0x7fa59815afd0 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.415+0000 7fa59fe74700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59813f9b0 con 0x7fa59815ac00 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59dc10700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5980cb3d0 0x7fa59813f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59dc10700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5980cb3d0 0x7fa59813f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41426/0 (socket says 172.21.15.61:41426) 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59dc10700 1 -- 172.21.15.61:0/3424682688 learned_addr learned my addr 172.21.15.61:0/3424682688 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59d40f700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815ac00 0x7fa59816a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59e411700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa59815afd0 0x7fa59816a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59dc10700 1 -- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815ac00 msgr2=0x7fa59816a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59dc10700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815ac00 0x7fa59816a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59dc10700 1 -- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa59815afd0 msgr2=0x7fa59816a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59dc10700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa59815afd0 0x7fa59816a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59dc10700 1 -- 172.21.15.61:0/3424682688 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590009ae0 con 0x7fa5980cb3d0 2023-12-24T19:59:27.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59dc10700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5980cb3d0 0x7fa59813f470 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c870 tx=0x7fa588007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:27.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa58dffb700 1 -- 172.21.15.61:0/3424682688 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588005b90 con 0x7fa5980cb3d0 2023-12-24T19:59:27.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa59fe74700 1 -- 172.21.15.61:0/3424682688 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa594009420 con 0x7fa5980cb3d0 2023-12-24T19:59:27.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa58dffb700 1 -- 172.21.15.61:0/3424682688 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa588005d10 con 0x7fa5980cb3d0 2023-12-24T19:59:27.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.416+0000 7fa58dffb700 1 -- 172.21.15.61:0/3424682688 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588007340 con 0x7fa5980cb3d0 2023-12-24T19:59:27.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.417+0000 7fa59fe74700 1 -- 172.21.15.61:0/3424682688 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5980c6ec0 con 0x7fa5980cb3d0 2023-12-24T19:59:27.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.417+0000 7fa59fe74700 1 -- 172.21.15.61:0/3424682688 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5980ae070 con 0x7fa5980cb3d0 2023-12-24T19:59:27.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.418+0000 7fa58dffb700 1 -- 172.21.15.61:0/3424682688 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa58801b400 con 0x7fa5980cb3d0 2023-12-24T19:59:27.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.418+0000 7fa58dffb700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa57c066f30 0x7fa57c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:27.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.418+0000 7fa58dffb700 1 -- 172.21.15.61:0/3424682688 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5880840b0 con 0x7fa5980cb3d0 2023-12-24T19:59:27.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.418+0000 7fa59d40f700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa57c066f30 0x7fa57c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:27.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.419+0000 7fa59d40f700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa57c066f30 0x7fa57c0693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa5940093f0 tx=0x7fa594017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:27.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.422+0000 7fa58dffb700 1 -- 172.21.15.61:0/3424682688 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa588051320 con 0x7fa5980cb3d0 2023-12-24T19:59:27.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:27.664+0000 7fa59fe74700 1 -- 172.21.15.61:0/3424682688 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa59804c3c0 con 0x7fa5980cb3d0 2023-12-24T19:59:28.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.262+0000 7fa58dffb700 1 -- 172.21.15.61:0/3424682688 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa588054940 con 0x7fa5980cb3d0 2023-12-24T19:59:28.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.264+0000 7fa59fe74700 1 -- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa57c066f30 msgr2=0x7fa57c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.264+0000 7fa59fe74700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa57c066f30 0x7fa57c0693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa5940093f0 tx=0x7fa594017000 comp rx=0 tx=0).stop 2023-12-24T19:59:28.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.264+0000 7fa59fe74700 1 -- 172.21.15.61:0/3424682688 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5980cb3d0 msgr2=0x7fa59813f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.264+0000 7fa59fe74700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5980cb3d0 0x7fa59813f470 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c870 tx=0x7fa588007de0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.264+0000 7fa59fe74700 1 -- 172.21.15.61:0/3424682688 shutdown_connections 2023-12-24T19:59:28.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.264+0000 7fa59fe74700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa57c066f30 0x7fa57c0693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.264+0000 7fa59fe74700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa59815afd0 0x7fa59816a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.264+0000 7fa59fe74700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5980cb3d0 0x7fa59813f470 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.264+0000 7fa59fe74700 1 --2- 172.21.15.61:0/3424682688 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa59815ac00 0x7fa59816a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.265+0000 7fa59fe74700 1 -- 172.21.15.61:0/3424682688 >> 172.21.15.61:0/3424682688 conn(0x7fa5980cd0b0 msgr2=0x7fa59806d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:28.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.265+0000 7fa59fe74700 1 -- 172.21.15.61:0/3424682688 shutdown_connections 2023-12-24T19:59:28.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.265+0000 7fa59fe74700 1 -- 172.21.15.61:0/3424682688 wait complete. 2023-12-24T19:59:28.280 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:59:28.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.409+0000 7f6968f2b700 1 Processor -- start 2023-12-24T19:59:28.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.409+0000 7f6968f2b700 1 -- start start 2023-12-24T19:59:28.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.410+0000 7f6968f2b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696415bb60 0x7f6964098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.410+0000 7f6968f2b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640b2eb0 con 0x7f6964098aa0 2023-12-24T19:59:28.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.410+0000 7f6968f2b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640b2bd0 con 0x7f69640b2660 2023-12-24T19:59:28.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.410+0000 7f6968f2b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640afc20 con 0x7f696415bb60 2023-12-24T19:59:28.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.410+0000 7f6961d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f6964098aa0 0x7f696415bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:52900/0 (socket says 172.21.15.61:52900) 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.410+0000 7f6961d9b700 1 -- 172.21.15.61:0/1514786767 learned_addr learned my addr 172.21.15.61:0/1514786767 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.410+0000 7f696259c700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696415bb60 0x7f6964098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.410+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171248962 0 0) 0x7f69640b2eb0 con 0x7f6964098aa0 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.410+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f694c003570 con 0x7f6964098aa0 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3353322762 0 0) 0x7f694c003570 con 0x7f6964098aa0 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696415bb60 msgr2=0x7f6964098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696415bb60 0x7f6964098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 >> v1:172.21.15.133:6789/0 conn(0x7f69640b2660 legacy=0x7f69640b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640afe10 con 0x7f6964098aa0 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f6954001470 con 0x7f6964098aa0 2023-12-24T19:59:28.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696259c700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696415bb60 0x7f6964098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 >> v1:172.21.15.61:6789/0 conn(0x7f6964098aa0 legacy=0x7f696415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696415bb60 0x7f694c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c003fd0 0x7f694c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f694c004d50 0x7f694c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c00bb10 con 0x7f694c004d50 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c00bc80 con 0x7f694c003fd0 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c00be40 con 0x7f696415bb60 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f6962d9d700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f694c004d50 0x7f694c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696259c700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696415bb60 0x7f694c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f6961d9b700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c003fd0 0x7f694c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f6962d9d700 1 -- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696415bb60 msgr2=0x7f694c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f6962d9d700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f696415bb60 0x7f694c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f6962d9d700 1 -- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c003fd0 msgr2=0x7f694c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f6962d9d700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c003fd0 0x7f694c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f6962d9d700 1 -- 172.21.15.61:0/1514786767 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580093c0 con 0x7f694c004d50 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f6962d9d700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f694c004d50 0x7f694c0051c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f695c002170 tx=0x7f695c0017d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d549d5ffefdd4745 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.411+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c001ae0 con 0x7f694c004d50 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.412+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c00c940 con 0x7f694c004d50 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.412+0000 7f696159a700 1 -- 172.21.15.61:0/1514786767 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00cce0 con 0x7f694c004d50 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.412+0000 7f6968f2b700 1 -- 172.21.15.61:0/1514786767 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f694c004d50 msgr2=0x7f694c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.412+0000 7f6968f2b700 1 --2- 172.21.15.61:0/1514786767 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f694c004d50 0x7f694c0051c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f695c002170 tx=0x7f695c0017d0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.412+0000 7f6962d9d700 1 -- 172.21.15.61:0/1514786767 reap_dead start 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.412+0000 7f6968f2b700 1 -- 172.21.15.61:0/1514786767 shutdown_connections 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.412+0000 7f6968f2b700 1 -- 172.21.15.61:0/1514786767 >> 172.21.15.61:0/1514786767 conn(0x7f6964097a10 msgr2=0x7f69640ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.412+0000 7f6968f2b700 1 -- 172.21.15.61:0/1514786767 shutdown_connections 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.412+0000 7f6968f2b700 1 -- 172.21.15.61:0/1514786767 wait complete. 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.413+0000 7f6968f2b700 1 Processor -- start 2023-12-24T19:59:28.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.413+0000 7f6968f2b700 1 -- start start 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6968f2b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f694c004d50 0x7f69641578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6968f2b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f696415aa20 0x7f696415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6968f2b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6964068910 0x7f6964068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6968f2b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696415b3d0 con 0x7f696415aa20 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6968f2b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640aa750 con 0x7f6964068910 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6968f2b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640aa9a0 con 0x7f694c004d50 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6961d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f696415aa20 0x7f696415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6961d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f696415aa20 0x7f696415ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41454/0 (socket says 172.21.15.61:41454) 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6961d9b700 1 -- 172.21.15.61:0/1426702105 learned_addr learned my addr 172.21.15.61:0/1426702105 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f696259c700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f694c004d50 0x7f69641578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6962d9d700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6964068910 0x7f6964068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6961d9b700 1 -- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f694c004d50 msgr2=0x7f69641578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6961d9b700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f694c004d50 0x7f69641578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6961d9b700 1 -- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6964068910 msgr2=0x7f6964068d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6961d9b700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6964068910 0x7f6964068d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f6961d9b700 1 -- 172.21.15.61:0/1426702105 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640aac80 con 0x7f696415aa20 2023-12-24T19:59:28.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.414+0000 7f696259c700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f694c004d50 0x7f69641578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:28.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.415+0000 7f6961d9b700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f696415aa20 0x7f696415ae90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f69540073c0 tx=0x7f6954001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:28.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.415+0000 7f69527fc700 1 -- 172.21.15.61:0/1426702105 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954018030 con 0x7f696415aa20 2023-12-24T19:59:28.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.415+0000 7f69527fc700 1 -- 172.21.15.61:0/1426702105 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6954007830 con 0x7f696415aa20 2023-12-24T19:59:28.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.415+0000 7f6968f2b700 1 -- 172.21.15.61:0/1426702105 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69640aaf60 con 0x7f696415aa20 2023-12-24T19:59:28.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.415+0000 7f69527fc700 1 -- 172.21.15.61:0/1426702105 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954001b50 con 0x7f696415aa20 2023-12-24T19:59:28.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.415+0000 7f6968f2b700 1 -- 172.21.15.61:0/1426702105 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69640692c0 con 0x7f696415aa20 2023-12-24T19:59:28.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.416+0000 7f6968f2b700 1 -- 172.21.15.61:0/1426702105 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696406d440 con 0x7f696415aa20 2023-12-24T19:59:28.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.416+0000 7f69527fc700 1 -- 172.21.15.61:0/1426702105 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f695401b070 con 0x7f696415aa20 2023-12-24T19:59:28.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.417+0000 7f69527fc700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6944066f30 0x7f69440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.417+0000 7f69527fc700 1 -- 172.21.15.61:0/1426702105 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6954019070 con 0x7f696415aa20 2023-12-24T19:59:28.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.417+0000 7f696259c700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6944066f30 0x7f69440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.417+0000 7f696259c700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6944066f30 0x7f69440693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6958006ea0 tx=0x7f6958008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:28.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.421+0000 7f69527fc700 1 -- 172.21.15.61:0/1426702105 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6954051520 con 0x7f696415aa20 2023-12-24T19:59:28.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.659+0000 7f6968f2b700 1 -- 172.21.15.61:0/1426702105 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69640ab480 con 0x7f696415aa20 2023-12-24T19:59:28.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.659+0000 7f69527fc700 1 -- 172.21.15.61:0/1426702105 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f69640ab480 con 0x7f696415aa20 2023-12-24T19:59:28.660 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:28.660 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2177201507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2177201507},{"type":"v1","addr":"172.21.15.61:6835","nonce":2177201507}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1435257239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1435257239},{"type":"v1","addr":"172.21.15.133:6837","nonce":1435257239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/696274590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":696274590},{"type":"v1","addr":"172.21.15.133:6836","nonce":696274590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:59:24.619081+0000","modified":"2023-12-24T19:59:28.258285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/3751369981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3751369981},{"type":"v1","addr":"172.21.15.61:6834","nonce":3751369981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T19:59:28.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 -- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6944066f30 msgr2=0x7f69440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6944066f30 0x7f69440693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6958006ea0 tx=0x7f6958008040 comp rx=0 tx=0).stop 2023-12-24T19:59:28.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 -- 172.21.15.61:0/1426702105 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f696415aa20 msgr2=0x7f696415ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f696415aa20 0x7f696415ae90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f69540073c0 tx=0x7f6954001df0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 -- 172.21.15.61:0/1426702105 shutdown_connections 2023-12-24T19:59:28.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f694c004d50 0x7f69641578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6944066f30 0x7f69440693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6964068910 0x7f6964068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 --2- 172.21.15.61:0/1426702105 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f696415aa20 0x7f696415ae90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 -- 172.21.15.61:0/1426702105 >> 172.21.15.61:0/1426702105 conn(0x7f6964097a10 msgr2=0x7f696406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:28.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 -- 172.21.15.61:0/1426702105 shutdown_connections 2023-12-24T19:59:28.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.662+0000 7f6968f2b700 1 -- 172.21.15.61:0/1426702105 wait complete. 2023-12-24T19:59:28.664 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 35 2023-12-24T19:59:28.674 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T19:59:28.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.796+0000 7fd6e659b700 1 Processor -- start 2023-12-24T19:59:28.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.796+0000 7fd6e659b700 1 -- start start 2023-12-24T19:59:28.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6e659b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd6e015bb60 0x7fd6e0098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6e659b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd6e00b2660 0x7fd6e00b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6e659b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e00b2eb0 con 0x7fd6e0098aa0 2023-12-24T19:59:28.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6e659b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e00afc20 con 0x7fd6e00b2660 2023-12-24T19:59:28.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6e659b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e00b2bd0 con 0x7fd6e015bb60 2023-12-24T19:59:28.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6e4b38700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd6e00b2660 0x7fd6e00b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6df7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd6e0098aa0 0x7fd6e015bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:52906/0 (socket says 172.21.15.61:52906) 2023-12-24T19:59:28.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6df7fe700 1 -- 172.21.15.61:0/4284135753 learned_addr learned my addr 172.21.15.61:0/4284135753 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:28.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6dffff700 1 --2- 172.21.15.61:0/4284135753 >> v2:172.21.15.133:3300/0 conn(0x7fd6e015bb60 0x7fd6e0098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6e4b38700 1 -- 172.21.15.61:0/4284135753 >> v2:172.21.15.133:3300/0 conn(0x7fd6e015bb60 msgr2=0x7fd6e0098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6e4b38700 1 --2- 172.21.15.61:0/4284135753 >> v2:172.21.15.133:3300/0 conn(0x7fd6e015bb60 0x7fd6e0098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6e4b38700 1 -- 172.21.15.61:0/4284135753 >> v1:172.21.15.61:6789/0 conn(0x7fd6e0098aa0 legacy=0x7fd6e015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6e4b38700 1 -- 172.21.15.61:0/4284135753 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e00afe10 con 0x7fd6e00b2660 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.797+0000 7fd6deffd700 1 -- 172.21.15.61:0/4284135753 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767325932 0 0) 0x7fd6e00b2eb0 con 0x7fd6e0098aa0 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6e4b38700 1 --2- 172.21.15.61:0/4284135753 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e00b2660 0x7fd6e00b08f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd6e006d9b0 tx=0x7fd6d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6145854ab150dd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6deffd700 1 -- 172.21.15.61:0/4284135753 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800e070 con 0x7fd6e00b2660 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6deffd700 1 -- 172.21.15.61:0/4284135753 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d800bc30 con 0x7fd6e00b2660 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6deffd700 1 -- 172.21.15.61:0/4284135753 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8012430 con 0x7fd6e00b2660 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6e659b700 1 -- 172.21.15.61:0/4284135753 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e00b2660 msgr2=0x7fd6e00b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6e659b700 1 --2- 172.21.15.61:0/4284135753 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e00b2660 0x7fd6e00b08f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd6e006d9b0 tx=0x7fd6d8009780 comp rx=0 tx=0).stop 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6e659b700 1 -- 172.21.15.61:0/4284135753 shutdown_connections 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6e659b700 1 --2- 172.21.15.61:0/4284135753 >> v2:172.21.15.133:3300/0 conn(0x7fd6e015bb60 0x7fd6e0098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6e659b700 1 --2- 172.21.15.61:0/4284135753 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e00b2660 0x7fd6e00b08f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6e659b700 1 -- 172.21.15.61:0/4284135753 >> 172.21.15.61:0/4284135753 conn(0x7fd6e0097a10 msgr2=0x7fd6e00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:28.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6e659b700 1 -- 172.21.15.61:0/4284135753 shutdown_connections 2023-12-24T19:59:28.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.798+0000 7fd6e659b700 1 -- 172.21.15.61:0/4284135753 wait complete. 2023-12-24T19:59:28.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.799+0000 7fd6e659b700 1 Processor -- start 2023-12-24T19:59:28.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.800+0000 7fd6e659b700 1 -- start start 2023-12-24T19:59:28.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.800+0000 7fd6e659b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e0098aa0 0x7fd6e00a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.800+0000 7fd6e659b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00b2660 0x7fd6e015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.800+0000 7fd6e659b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6e015bb60 0x7fd6e00ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.800+0000 7fd6e659b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00a9ef0 con 0x7fd6e0098aa0 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.800+0000 7fd6e659b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00aad30 con 0x7fd6e00b2660 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.800+0000 7fd6e659b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00ab1c0 con 0x7fd6e015bb60 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.800+0000 7fd6dffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e0098aa0 0x7fd6e00a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.800+0000 7fd6dffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e0098aa0 0x7fd6e00a99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41472/0 (socket says 172.21.15.61:41472) 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.800+0000 7fd6dffff700 1 -- 172.21.15.61:0/1419846923 learned_addr learned my addr 172.21.15.61:0/1419846923 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6df7fe700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00b2660 0x7fd6e015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6dffff700 1 -- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6e015bb60 msgr2=0x7fd6e00ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6e4b38700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6e015bb60 0x7fd6e00ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6dffff700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6e015bb60 0x7fd6e00ac610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6dffff700 1 -- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00b2660 msgr2=0x7fd6e015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6dffff700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00b2660 0x7fd6e015e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6dffff700 1 -- 172.21.15.61:0/1419846923 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8009a20 con 0x7fd6e0098aa0 2023-12-24T19:59:28.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6df7fe700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00b2660 0x7fd6e015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6dffff700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e0098aa0 0x7fd6e00a99b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000d840 tx=0x7fd6d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6d7fff700 1 -- 172.21.15.61:0/1419846923 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0014620 con 0x7fd6e0098aa0 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6d7fff700 1 -- 172.21.15.61:0/1419846923 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d0014780 con 0x7fd6e0098aa0 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6e659b700 1 -- 172.21.15.61:0/1419846923 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e00aa120 con 0x7fd6e0098aa0 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6d7fff700 1 -- 172.21.15.61:0/1419846923 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0014b20 con 0x7fd6e0098aa0 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.801+0000 7fd6e659b700 1 -- 172.21.15.61:0/1419846923 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e00aa6e0 con 0x7fd6e0098aa0 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.802+0000 7fd6e659b700 1 -- 172.21.15.61:0/1419846923 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e006d440 con 0x7fd6e0098aa0 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.803+0000 7fd6d7fff700 1 -- 172.21.15.61:0/1419846923 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd6d001d400 con 0x7fd6e0098aa0 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.803+0000 7fd6d7fff700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd6c0066f30 0x7fd6c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.803+0000 7fd6d7fff700 1 -- 172.21.15.61:0/1419846923 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6d0084cd0 con 0x7fd6e0098aa0 2023-12-24T19:59:28.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.803+0000 7fd6df7fe700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd6c0066f30 0x7fd6c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:28.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.804+0000 7fd6df7fe700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd6c0066f30 0x7fd6c00693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0069140 tx=0x7fd6c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:28.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:28.807+0000 7fd6d7fff700 1 -- 172.21.15.61:0/1419846923 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6d0051f40 con 0x7fd6e0098aa0 2023-12-24T19:59:29.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.003+0000 7fd6e659b700 1 -- 172.21.15.61:0/1419846923 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6e004c3c0 con 0x7fd6e0098aa0 2023-12-24T19:59:29.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.004+0000 7fd6d7fff700 1 -- 172.21.15.61:0/1419846923 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fd6d0055560 con 0x7fd6e0098aa0 2023-12-24T19:59:29.004 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:29.004 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":62,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:59:26.234624+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:59:23.050869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-24T19:59:23.594703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T19:59:29.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 -- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd6c0066f30 msgr2=0x7fd6c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd6c0066f30 0x7fd6c00693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0069140 tx=0x7fd6c8009040 comp rx=0 tx=0).stop 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 -- 172.21.15.61:0/1419846923 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e0098aa0 msgr2=0x7fd6e00a99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e0098aa0 0x7fd6e00a99b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000d840 tx=0x7fd6d0008040 comp rx=0 tx=0).stop 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 -- 172.21.15.61:0/1419846923 shutdown_connections 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd6e015bb60 0x7fd6e00ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd6c0066f30 0x7fd6c00693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6e0098aa0 0x7fd6e00a99b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 --2- 172.21.15.61:0/1419846923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6e00b2660 0x7fd6e015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 -- 172.21.15.61:0/1419846923 >> 172.21.15.61:0/1419846923 conn(0x7fd6e0097a10 msgr2=0x7fd6e00b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 -- 172.21.15.61:0/1419846923 shutdown_connections 2023-12-24T19:59:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.006+0000 7fd6e659b700 1 -- 172.21.15.61:0/1419846923 wait complete. 2023-12-24T19:59:29.018 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T19:59:29.019 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:59:29.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.140+0000 7f1a5c33a700 1 Processor -- start 2023-12-24T19:59:29.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.140+0000 7f1a5c33a700 1 -- start start 2023-12-24T19:59:29.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.141+0000 7f1a5c33a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a54159c10 0x7f1a540c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.141+0000 7f1a5c33a700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540af880 con 0x7f1a54159fe0 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.141+0000 7f1a5c33a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540c6fc0 con 0x7f1a540cc190 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.141+0000 7f1a5c33a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a540c63b0 con 0x7f1a54159c10 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.141+0000 7f1a598d5700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1a54159fe0 0x7f1a540cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:52916/0 (socket says 172.21.15.61:52916) 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.141+0000 7f1a598d5700 1 -- 172.21.15.61:0/994186791 learned_addr learned my addr 172.21.15.61:0/994186791 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.141+0000 7f1a5a0d6700 1 --2- 172.21.15.61:0/994186791 >> v2:172.21.15.133:3300/0 conn(0x7f1a54159c10 0x7f1a540c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a590d4700 1 -- 172.21.15.61:0/994186791 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256006067 0 0) 0x7f1a540af880 con 0x7f1a54159fe0 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a590d4700 1 -- 172.21.15.61:0/994186791 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a40003570 con 0x7f1a54159fe0 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a590d4700 1 -- 172.21.15.61:0/994186791 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719775915 0 0) 0x7f1a540c6fc0 con 0x7f1a540cc190 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a590d4700 1 -- 172.21.15.61:0/994186791 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a540af880 con 0x7f1a540cc190 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a5a0d6700 1 -- 172.21.15.61:0/994186791 >> v1:172.21.15.133:6789/0 conn(0x7f1a540cc190 legacy=0x7f1a540b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a5a0d6700 1 -- 172.21.15.61:0/994186791 >> v1:172.21.15.61:6789/0 conn(0x7f1a54159fe0 legacy=0x7f1a540cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a5a0d6700 1 -- 172.21.15.61:0/994186791 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540c6690 con 0x7f1a54159c10 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a5a0d6700 1 --2- 172.21.15.61:0/994186791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54159c10 0x7f1a540c57d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009910 tx=0x7f1a440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bf3e33361c46c4e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a590d4700 1 -- 172.21.15.61:0/994186791 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44011630 con 0x7f1a54159c10 2023-12-24T19:59:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a590d4700 1 -- 172.21.15.61:0/994186791 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a44011790 con 0x7f1a54159c10 2023-12-24T19:59:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.142+0000 7f1a590d4700 1 -- 172.21.15.61:0/994186791 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44011b30 con 0x7f1a54159c10 2023-12-24T19:59:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.143+0000 7f1a5c33a700 1 -- 172.21.15.61:0/994186791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54159c10 msgr2=0x7f1a540c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.143+0000 7f1a5c33a700 1 --2- 172.21.15.61:0/994186791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54159c10 0x7f1a540c57d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009910 tx=0x7f1a440091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.143+0000 7f1a5c33a700 1 -- 172.21.15.61:0/994186791 shutdown_connections 2023-12-24T19:59:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.143+0000 7f1a5c33a700 1 --2- 172.21.15.61:0/994186791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54159c10 0x7f1a540c57d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.143+0000 7f1a5c33a700 1 -- 172.21.15.61:0/994186791 >> 172.21.15.61:0/994186791 conn(0x7f1a5406e640 msgr2=0x7f1a54067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.143+0000 7f1a5c33a700 1 -- 172.21.15.61:0/994186791 shutdown_connections 2023-12-24T19:59:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.143+0000 7f1a5c33a700 1 -- 172.21.15.61:0/994186791 wait complete. 2023-12-24T19:59:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.144+0000 7f1a5c33a700 1 Processor -- start 2023-12-24T19:59:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.144+0000 7f1a5c33a700 1 -- start start 2023-12-24T19:59:29.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5c33a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a540cc190 0x7f1a540ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5c33a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54159c10 0x7f1a540b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5c33a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a54159fe0 0x7f1a540b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5c33a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540c7e60 con 0x7f1a540cc190 2023-12-24T19:59:29.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5c33a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540c8700 con 0x7f1a54159c10 2023-12-24T19:59:29.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5c33a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540caac0 con 0x7f1a54159fe0 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5a0d6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a540cc190 0x7f1a540ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5a0d6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a540cc190 0x7f1a540ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41482/0 (socket says 172.21.15.61:41482) 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5a0d6700 1 -- 172.21.15.61:0/964012876 learned_addr learned my addr 172.21.15.61:0/964012876 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a598d5700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54159c10 0x7f1a540b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5a8d7700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a54159fe0 0x7f1a540b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5a0d6700 1 -- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a54159fe0 msgr2=0x7f1a540b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5a0d6700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a54159fe0 0x7f1a540b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5a0d6700 1 -- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54159c10 msgr2=0x7f1a540b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5a0d6700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54159c10 0x7f1a540b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5a0d6700 1 -- 172.21.15.61:0/964012876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44009420 con 0x7f1a540cc190 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.145+0000 7f1a5a0d6700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a540cc190 0x7f1a540ca580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009f00 tx=0x7f1a44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.146+0000 7f1a4a7fc700 1 -- 172.21.15.61:0/964012876 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4401f070 con 0x7f1a540cc190 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.146+0000 7f1a4a7fc700 1 -- 172.21.15.61:0/964012876 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a44006b10 con 0x7f1a540cc190 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.146+0000 7f1a5c33a700 1 -- 172.21.15.61:0/964012876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a54153480 con 0x7f1a540cc190 2023-12-24T19:59:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.146+0000 7f1a4a7fc700 1 -- 172.21.15.61:0/964012876 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44023430 con 0x7f1a540cc190 2023-12-24T19:59:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.146+0000 7f1a5c33a700 1 -- 172.21.15.61:0/964012876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a540c8390 con 0x7f1a540cc190 2023-12-24T19:59:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.147+0000 7f1a5c33a700 1 -- 172.21.15.61:0/964012876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a540890b0 con 0x7f1a540cc190 2023-12-24T19:59:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.147+0000 7f1a4a7fc700 1 -- 172.21.15.61:0/964012876 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1a4402c3b0 con 0x7f1a540cc190 2023-12-24T19:59:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.147+0000 7f1a4a7fc700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1a38066f30 0x7f1a380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.148+0000 7f1a4a7fc700 1 -- 172.21.15.61:0/964012876 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a440856b0 con 0x7f1a540cc190 2023-12-24T19:59:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.148+0000 7f1a598d5700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1a38066f30 0x7f1a380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.148+0000 7f1a598d5700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1a38066f30 0x7f1a380693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1a540b62e0 tx=0x7f1a50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:29.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.152+0000 7f1a4a7fc700 1 -- 172.21.15.61:0/964012876 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a44052920 con 0x7f1a540cc190 2023-12-24T19:59:29.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.341+0000 7f1a5c33a700 1 -- 172.21.15.61:0/964012876 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a540c8840 con 0x7f1a38066f30 2023-12-24T19:59:29.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.350+0000 7f1a4a7fc700 1 -- 172.21.15.61:0/964012876 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284679 (secure 0 0 0) 0x7f1a5000f680 con 0x7f1a38066f30 2023-12-24T19:59:29.354 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:29.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 -- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1a38066f30 msgr2=0x7f1a380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1a38066f30 0x7f1a380693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1a540b62e0 tx=0x7f1a50009040 comp rx=0 tx=0).stop 2023-12-24T19:59:29.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 -- 172.21.15.61:0/964012876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a540cc190 msgr2=0x7f1a540ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a540cc190 0x7f1a540ca580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009f00 tx=0x7f1a44017000 comp rx=0 tx=0).stop 2023-12-24T19:59:29.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 -- 172.21.15.61:0/964012876 shutdown_connections 2023-12-24T19:59:29.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a54159fe0 0x7f1a540b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1a38066f30 0x7f1a380693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a540cc190 0x7f1a540ca580 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 --2- 172.21.15.61:0/964012876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a54159c10 0x7f1a540b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 -- 172.21.15.61:0/964012876 >> 172.21.15.61:0/964012876 conn(0x7f1a5406e640 msgr2=0x7f1a540d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:29.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 -- 172.21.15.61:0/964012876 shutdown_connections 2023-12-24T19:59:29.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.353+0000 7f1a5c33a700 1 -- 172.21.15.61:0/964012876 wait complete. 2023-12-24T19:59:29.358 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:59:29.365 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-12-24T19:59:28.341280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3512,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558987,"statfs":{"total":1600000000,"available":1596403408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.136460"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.240444+0000","last_change":"2023-12-24T19:59:25.240444+0000","last_active":"2023-12-24T19:59:25.240444+0000","last_peered":"2023-12-24T19:59:25.240444+0000","last_clean":"2023-12-24T19:59:25.240444+0000","last_became_active":"2023-12-24T19:59:25.240013+0000","last_became_peered":"2023-12-24T19:59:25.240013+0000","last_unstale":"2023-12-24T19:59:25.240444+0000","last_undegraded":"2023-12-24T19:59:25.240444+0000","last_fullsized":"2023-12-24T19:59:25.240444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:37:34.117277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.242588+0000","last_change":"2023-12-24T19:59:25.242588+0000","last_active":"2023-12-24T19:59:25.242588+0000","last_peered":"2023-12-24T19:59:25.242588+0000","last_clean":"2023-12-24T19:59:25.242588+0000","last_became_active":"2023-12-24T19:59:25.241777+0000","last_became_peered":"2023-12-24T19:59:25.241777+0000","last_unstale":"2023-12-24T19:59:25.242588+0000","last_undegraded":"2023-12-24T19:59:25.242588+0000","last_fullsized":"2023-12-24T19:59:25.242588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:46.383063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.256587+0000","last_change":"2023-12-24T19:59:25.256587+0000","last_active":"2023-12-24T19:59:25.256587+0000","last_peered":"2023-12-24T19:59:25.256587+0000","last_clean":"2023-12-24T19:59:25.256587+0000","last_became_active":"2023-12-24T19:59:25.256317+0000","last_became_peered":"2023-12-24T19:59:25.256317+0000","last_unstale":"2023-12-24T19:59:25.256587+0000","last_undegraded":"2023-12-24T19:59:25.256587+0000","last_fullsized":"2023-12-24T19:59:25.256587+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:44.857928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245090+0000","last_change":"2023-12-24T19:59:25.245090+0000","last_active":"2023-12-24T19:59:25.245090+0000","last_peered":"2023-12-24T19:59:25.245090+0000","last_clean":"2023-12-24T19:59:25.245090+0000","last_became_active":"2023-12-24T19:59:25.244677+0000","last_became_peered":"2023-12-24T19:59:25.244677+0000","last_unstale":"2023-12-24T19:59:25.245090+0000","last_undegraded":"2023-12-24T19:59:25.245090+0000","last_fullsized":"2023-12-24T19:59:25.245090+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:09.053052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243857+0000","last_change":"2023-12-24T19:59:25.243857+0000","last_active":"2023-12-24T19:59:25.243857+0000","last_peered":"2023-12-24T19:59:25.243857+0000","last_clean":"2023-12-24T19:59:25.243857+0000","last_became_active":"2023-12-24T19:59:25.243631+0000","last_became_peered":"2023-12-24T19:59:25.243631+0000","last_unstale":"2023-12-24T19:59:25.243857+0000","last_undegraded":"2023-12-24T19:59:25.243857+0000","last_fullsized":"2023-12-24T19:59:25.243857+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:10.735758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.239633+0000","last_change":"2023-12-24T19:59:25.239633+0000","last_active":"2023-12-24T19:59:25.239633+0000","last_peered":"2023-12-24T19:59:25.239633+0000","last_clean":"2023-12-24T19:59:25.239633+0000","last_became_active":"2023-12-24T19:59:25.239399+0000","last_became_peered":"2023-12-24T19:59:25.239399+0000","last_unstale":"2023-12-24T19:59:25.239633+0000","last_undegraded":"2023-12-24T19:59:25.239633+0000","last_fullsized":"2023-12-24T19:59:25.239633+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:00.314994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245111+0000","last_change":"2023-12-24T19:59:25.245111+0000","last_active":"2023-12-24T19:59:25.245111+0000","last_peered":"2023-12-24T19:59:25.245111+0000","last_clean":"2023-12-24T19:59:25.245111+0000","last_became_active":"2023-12-24T19:59:25.244857+0000","last_became_peered":"2023-12-24T19:59:25.244857+0000","last_unstale":"2023-12-24T19:59:25.245111+0000","last_undegraded":"2023-12-24T19:59:25.245111+0000","last_fullsized":"2023-12-24T19:59:25.245111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:01.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246412+0000","last_change":"2023-12-24T19:59:25.246412+0000","last_active":"2023-12-24T19:59:25.246412+0000","last_peered":"2023-12-24T19:59:25.246412+0000","last_clean":"2023-12-24T19:59:25.246412+0000","last_became_active":"2023-12-24T19:59:25.245650+0000","last_became_peered":"2023-12-24T19:59:25.245650+0000","last_unstale":"2023-12-24T19:59:25.246412+0000","last_undegraded":"2023-12-24T19:59:25.246412+0000","last_fullsized":"2023-12-24T19:59:25.246412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:02:13.246839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247841+0000","last_change":"2023-12-24T19:59:25.247841+0000","last_active":"2023-12-24T19:59:25.247841+0000","last_peered":"2023-12-24T19:59:25.247841+0000","last_clean":"2023-12-24T19:59:25.247841+0000","last_became_active":"2023-12-24T19:59:25.247581+0000","last_became_peered":"2023-12-24T19:59:25.247581+0000","last_unstale":"2023-12-24T19:59:25.247841+0000","last_undegraded":"2023-12-24T19:59:25.247841+0000","last_fullsized":"2023-12-24T19:59:25.247841+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:50.339249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245586+0000","last_change":"2023-12-24T19:59:25.245586+0000","last_active":"2023-12-24T19:59:25.245586+0000","last_peered":"2023-12-24T19:59:25.245586+0000","last_clean":"2023-12-24T19:59:25.245586+0000","last_became_active":"2023-12-24T19:59:25.245023+0000","last_became_peered":"2023-12-24T19:59:25.245023+0000","last_unstale":"2023-12-24T19:59:25.245586+0000","last_undegraded":"2023-12-24T19:59:25.245586+0000","last_fullsized":"2023-12-24T19:59:25.245586+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:47.349361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247624+0000","last_change":"2023-12-24T19:59:25.247624+0000","last_active":"2023-12-24T19:59:25.247624+0000","last_peered":"2023-12-24T19:59:25.247624+0000","last_clean":"2023-12-24T19:59:25.247624+0000","last_became_active":"2023-12-24T19:59:25.247185+0000","last_became_peered":"2023-12-24T19:59:25.247185+0000","last_unstale":"2023-12-24T19:59:25.247624+0000","last_undegraded":"2023-12-24T19:59:25.247624+0000","last_fullsized":"2023-12-24T19:59:25.247624+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:12.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.250988+0000","last_change":"2023-12-24T19:59:25.250988+0000","last_active":"2023-12-24T19:59:25.250988+0000","last_peered":"2023-12-24T19:59:25.250988+0000","last_clean":"2023-12-24T19:59:25.250988+0000","last_became_active":"2023-12-24T19:59:25.250663+0000","last_became_peered":"2023-12-24T19:59:25.250663+0000","last_unstale":"2023-12-24T19:59:25.250988+0000","last_undegraded":"2023-12-24T19:59:25.250988+0000","last_fullsized":"2023-12-24T19:59:25.250988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:18:43.323430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.248073+0000","last_change":"2023-12-24T19:59:25.248073+0000","last_active":"2023-12-24T19:59:25.248073+0000","last_peered":"2023-12-24T19:59:25.248073+0000","last_clean":"2023-12-24T19:59:25.248073+0000","last_became_active":"2023-12-24T19:59:25.245105+0000","last_became_peered":"2023-12-24T19:59:25.245105+0000","last_unstale":"2023-12-24T19:59:25.248073+0000","last_undegraded":"2023-12-24T19:59:25.248073+0000","last_fullsized":"2023-12-24T19:59:25.248073+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:05.490185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245168+0000","last_change":"2023-12-24T19:59:25.245168+0000","last_active":"2023-12-24T19:59:25.245168+0000","last_peered":"2023-12-24T19:59:25.245168+0000","last_clean":"2023-12-24T19:59:25.245168+0000","last_became_active":"2023-12-24T19:59:25.244795+0000","last_became_peered":"2023-12-24T19:59:25.244795+0000","last_unstale":"2023-12-24T19:59:25.245168+0000","last_undegraded":"2023-12-24T19:59:25.245168+0000","last_fullsized":"2023-12-24T19:59:25.245168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:09.053052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247716+0000","last_change":"2023-12-24T19:59:25.247716+0000","last_active":"2023-12-24T19:59:25.247716+0000","last_peered":"2023-12-24T19:59:25.247716+0000","last_clean":"2023-12-24T19:59:25.247716+0000","last_became_active":"2023-12-24T19:59:25.246863+0000","last_became_peered":"2023-12-24T19:59:25.246863+0000","last_unstale":"2023-12-24T19:59:25.247716+0000","last_undegraded":"2023-12-24T19:59:25.247716+0000","last_fullsized":"2023-12-24T19:59:25.247716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:44.857928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243555+0000","last_change":"2023-12-24T19:59:25.243555+0000","last_active":"2023-12-24T19:59:25.243555+0000","last_peered":"2023-12-24T19:59:25.243555+0000","last_clean":"2023-12-24T19:59:25.243555+0000","last_became_active":"2023-12-24T19:59:25.243128+0000","last_became_peered":"2023-12-24T19:59:25.243128+0000","last_unstale":"2023-12-24T19:59:25.243555+0000","last_undegraded":"2023-12-24T19:59:25.243555+0000","last_fullsized":"2023-12-24T19:59:25.243555+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:50:58.694951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247651+0000","last_change":"2023-12-24T19:59:25.247651+0000","last_active":"2023-12-24T19:59:25.247651+0000","last_peered":"2023-12-24T19:59:25.247651+0000","last_clean":"2023-12-24T19:59:25.247651+0000","last_became_active":"2023-12-24T19:59:25.242815+0000","last_became_peered":"2023-12-24T19:59:25.242815+0000","last_unstale":"2023-12-24T19:59:25.247651+0000","last_undegraded":"2023-12-24T19:59:25.247651+0000","last_fullsized":"2023-12-24T19:59:25.247651+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:30.144048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.253924+0000","last_change":"2023-12-24T19:59:25.253924+0000","last_active":"2023-12-24T19:59:25.253924+0000","last_peered":"2023-12-24T19:59:25.253924+0000","last_clean":"2023-12-24T19:59:25.253924+0000","last_became_active":"2023-12-24T19:59:25.253369+0000","last_became_peered":"2023-12-24T19:59:25.253369+0000","last_unstale":"2023-12-24T19:59:25.253924+0000","last_undegraded":"2023-12-24T19:59:25.253924+0000","last_fullsized":"2023-12-24T19:59:25.253924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:08.830839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.240720+0000","last_change":"2023-12-24T19:59:25.240720+0000","last_active":"2023-12-24T19:59:25.240720+0000","last_peered":"2023-12-24T19:59:25.240720+0000","last_clean":"2023-12-24T19:59:25.240720+0000","last_became_active":"2023-12-24T19:59:25.240127+0000","last_became_peered":"2023-12-24T19:59:25.240127+0000","last_unstale":"2023-12-24T19:59:25.240720+0000","last_undegraded":"2023-12-24T19:59:25.240720+0000","last_fullsized":"2023-12-24T19:59:25.240720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:03:22.171001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244334+0000","last_change":"2023-12-24T19:59:25.244334+0000","last_active":"2023-12-24T19:59:25.244334+0000","last_peered":"2023-12-24T19:59:25.244334+0000","last_clean":"2023-12-24T19:59:25.244334+0000","last_became_active":"2023-12-24T19:59:25.244097+0000","last_became_peered":"2023-12-24T19:59:25.244097+0000","last_unstale":"2023-12-24T19:59:25.244334+0000","last_undegraded":"2023-12-24T19:59:25.244334+0000","last_fullsized":"2023-12-24T19:59:25.244334+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:16.301634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247485+0000","last_change":"2023-12-24T19:59:25.247485+0000","last_active":"2023-12-24T19:59:25.247485+0000","last_peered":"2023-12-24T19:59:25.247485+0000","last_clean":"2023-12-24T19:59:25.247485+0000","last_became_active":"2023-12-24T19:59:25.247237+0000","last_became_peered":"2023-12-24T19:59:25.247237+0000","last_unstale":"2023-12-24T19:59:25.247485+0000","last_undegraded":"2023-12-24T19:59:25.247485+0000","last_fullsized":"2023-12-24T19:59:25.247485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:19:03.296305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247499+0000","last_change":"2023-12-24T19:59:25.247499+0000","last_active":"2023-12-24T19:59:25.247499+0000","last_peered":"2023-12-24T19:59:25.247499+0000","last_clean":"2023-12-24T19:59:25.247499+0000","last_became_active":"2023-12-24T19:59:25.242367+0000","last_became_peered":"2023-12-24T19:59:25.242367+0000","last_unstale":"2023-12-24T19:59:25.247499+0000","last_undegraded":"2023-12-24T19:59:25.247499+0000","last_fullsized":"2023-12-24T19:59:25.247499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:16:00.337861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.253603+0000","last_change":"2023-12-24T19:59:25.253603+0000","last_active":"2023-12-24T19:59:25.253603+0000","last_peered":"2023-12-24T19:59:25.253603+0000","last_clean":"2023-12-24T19:59:25.253603+0000","last_became_active":"2023-12-24T19:59:25.252399+0000","last_became_peered":"2023-12-24T19:59:25.252399+0000","last_unstale":"2023-12-24T19:59:25.253603+0000","last_undegraded":"2023-12-24T19:59:25.253603+0000","last_fullsized":"2023-12-24T19:59:25.253603+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:50.339249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.248433+0000","last_change":"2023-12-24T19:59:25.248433+0000","last_active":"2023-12-24T19:59:25.248433+0000","last_peered":"2023-12-24T19:59:25.248433+0000","last_clean":"2023-12-24T19:59:25.248433+0000","last_became_active":"2023-12-24T19:59:25.245601+0000","last_became_peered":"2023-12-24T19:59:25.245601+0000","last_unstale":"2023-12-24T19:59:25.248433+0000","last_undegraded":"2023-12-24T19:59:25.248433+0000","last_fullsized":"2023-12-24T19:59:25.248433+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:26.129410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244778+0000","last_change":"2023-12-24T19:59:25.244778+0000","last_active":"2023-12-24T19:59:25.244778+0000","last_peered":"2023-12-24T19:59:25.244778+0000","last_clean":"2023-12-24T19:59:25.244778+0000","last_became_active":"2023-12-24T19:59:25.244548+0000","last_became_peered":"2023-12-24T19:59:25.244548+0000","last_unstale":"2023-12-24T19:59:25.244778+0000","last_undegraded":"2023-12-24T19:59:25.244778+0000","last_fullsized":"2023-12-24T19:59:25.244778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:39:00.907224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245344+0000","last_change":"2023-12-24T19:59:25.245344+0000","last_active":"2023-12-24T19:59:25.245344+0000","last_peered":"2023-12-24T19:59:25.245344+0000","last_clean":"2023-12-24T19:59:25.245344+0000","last_became_active":"2023-12-24T19:59:25.244672+0000","last_became_peered":"2023-12-24T19:59:25.244672+0000","last_unstale":"2023-12-24T19:59:25.245344+0000","last_undegraded":"2023-12-24T19:59:25.245344+0000","last_fullsized":"2023-12-24T19:59:25.245344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:11:52.945057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247932+0000","last_change":"2023-12-24T19:59:25.247932+0000","last_active":"2023-12-24T19:59:25.247932+0000","last_peered":"2023-12-24T19:59:25.247932+0000","last_clean":"2023-12-24T19:59:25.247932+0000","last_became_active":"2023-12-24T19:59:25.247622+0000","last_became_peered":"2023-12-24T19:59:25.247622+0000","last_unstale":"2023-12-24T19:59:25.247932+0000","last_undegraded":"2023-12-24T19:59:25.247932+0000","last_fullsized":"2023-12-24T19:59:25.247932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:42:01.754649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246024+0000","last_change":"2023-12-24T19:59:25.246024+0000","last_active":"2023-12-24T19:59:25.246024+0000","last_peered":"2023-12-24T19:59:25.246024+0000","last_clean":"2023-12-24T19:59:25.246024+0000","last_became_active":"2023-12-24T19:59:25.245757+0000","last_became_peered":"2023-12-24T19:59:25.245757+0000","last_unstale":"2023-12-24T19:59:25.246024+0000","last_undegraded":"2023-12-24T19:59:25.246024+0000","last_fullsized":"2023-12-24T19:59:25.246024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:27:16.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245742+0000","last_change":"2023-12-24T19:59:25.245742+0000","last_active":"2023-12-24T19:59:25.245742+0000","last_peered":"2023-12-24T19:59:25.245742+0000","last_clean":"2023-12-24T19:59:25.245742+0000","last_became_active":"2023-12-24T19:59:25.245444+0000","last_became_peered":"2023-12-24T19:59:25.245444+0000","last_unstale":"2023-12-24T19:59:25.245742+0000","last_undegraded":"2023-12-24T19:59:25.245742+0000","last_fullsized":"2023-12-24T19:59:25.245742+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:03.963419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247176+0000","last_change":"2023-12-24T19:59:25.247176+0000","last_active":"2023-12-24T19:59:25.247176+0000","last_peered":"2023-12-24T19:59:25.247176+0000","last_clean":"2023-12-24T19:59:25.247176+0000","last_became_active":"2023-12-24T19:59:25.246845+0000","last_became_peered":"2023-12-24T19:59:25.246845+0000","last_unstale":"2023-12-24T19:59:25.247176+0000","last_undegraded":"2023-12-24T19:59:25.247176+0000","last_fullsized":"2023-12-24T19:59:25.247176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:37.112966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.249382+0000","last_change":"2023-12-24T19:59:25.249382+0000","last_active":"2023-12-24T19:59:25.249382+0000","last_peered":"2023-12-24T19:59:25.249382+0000","last_clean":"2023-12-24T19:59:25.249382+0000","last_became_active":"2023-12-24T19:59:25.249153+0000","last_became_peered":"2023-12-24T19:59:25.249153+0000","last_unstale":"2023-12-24T19:59:25.249382+0000","last_undegraded":"2023-12-24T19:59:25.249382+0000","last_fullsized":"2023-12-24T19:59:25.249382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:20.027695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.241616+0000","last_change":"2023-12-24T19:59:25.241616+0000","last_active":"2023-12-24T19:59:25.241616+0000","last_peered":"2023-12-24T19:59:25.241616+0000","last_clean":"2023-12-24T19:59:25.241616+0000","last_became_active":"2023-12-24T19:59:25.241312+0000","last_became_peered":"2023-12-24T19:59:25.241312+0000","last_unstale":"2023-12-24T19:59:25.241616+0000","last_undegraded":"2023-12-24T19:59:25.241616+0000","last_fullsized":"2023-12-24T19:59:25.241616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:13:29.273111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.248681+0000","last_change":"2023-12-24T19:59:25.248681+0000","last_active":"2023-12-24T19:59:25.248681+0000","last_peered":"2023-12-24T19:59:25.248681+0000","last_clean":"2023-12-24T19:59:25.248681+0000","last_became_active":"2023-12-24T19:59:25.248454+0000","last_became_peered":"2023-12-24T19:59:25.248454+0000","last_unstale":"2023-12-24T19:59:25.248681+0000","last_undegraded":"2023-12-24T19:59:25.248681+0000","last_fullsized":"2023-12-24T19:59:25.248681+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:46:48.890599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.256839+0000","last_change":"2023-12-24T19:59:24.222674+0000","last_active":"2023-12-24T19:59:25.256839+0000","last_peered":"2023-12-24T19:59:25.256839+0000","last_clean":"2023-12-24T19:59:25.256839+0000","last_became_active":"2023-12-24T19:59:24.221867+0000","last_became_peered":"2023-12-24T19:59:24.221867+0000","last_unstale":"2023-12-24T19:59:25.256839+0000","last_undegraded":"2023-12-24T19:59:25.256839+0000","last_fullsized":"2023-12-24T19:59:25.256839+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:38.492589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.250710+0000","last_change":"2023-12-24T19:59:25.250710+0000","last_active":"2023-12-24T19:59:25.250710+0000","last_peered":"2023-12-24T19:59:25.250710+0000","last_clean":"2023-12-24T19:59:25.250710+0000","last_became_active":"2023-12-24T19:59:25.250490+0000","last_became_peered":"2023-12-24T19:59:25.250490+0000","last_unstale":"2023-12-24T19:59:25.250710+0000","last_undegraded":"2023-12-24T19:59:25.250710+0000","last_fullsized":"2023-12-24T19:59:25.250710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:35:13.903433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.236847+0000","last_change":"2023-12-24T19:59:24.220187+0000","last_active":"2023-12-24T19:59:25.236847+0000","last_peered":"2023-12-24T19:59:25.236847+0000","last_clean":"2023-12-24T19:59:25.236847+0000","last_became_active":"2023-12-24T19:59:24.219954+0000","last_became_peered":"2023-12-24T19:59:24.219954+0000","last_unstale":"2023-12-24T19:59:25.236847+0000","last_undegraded":"2023-12-24T19:59:25.236847+0000","last_fullsized":"2023-12-24T19:59:25.236847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:00.364328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246297+0000","last_change":"2023-12-24T19:59:25.246297+0000","last_active":"2023-12-24T19:59:25.246297+0000","last_peered":"2023-12-24T19:59:25.246297+0000","last_clean":"2023-12-24T19:59:25.246297+0000","last_became_active":"2023-12-24T19:59:25.246075+0000","last_became_peered":"2023-12-24T19:59:25.246075+0000","last_unstale":"2023-12-24T19:59:25.246297+0000","last_undegraded":"2023-12-24T19:59:25.246297+0000","last_fullsized":"2023-12-24T19:59:25.246297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:08.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.256137+0000","last_change":"2023-12-24T19:59:24.220100+0000","last_active":"2023-12-24T19:59:25.256137+0000","last_peered":"2023-12-24T19:59:25.256137+0000","last_clean":"2023-12-24T19:59:25.256137+0000","last_became_active":"2023-12-24T19:59:24.219544+0000","last_became_peered":"2023-12-24T19:59:24.219544+0000","last_unstale":"2023-12-24T19:59:25.256137+0000","last_undegraded":"2023-12-24T19:59:25.256137+0000","last_fullsized":"2023-12-24T19:59:25.256137+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:13.263190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244916+0000","last_change":"2023-12-24T19:59:25.244916+0000","last_active":"2023-12-24T19:59:25.244916+0000","last_peered":"2023-12-24T19:59:25.244916+0000","last_clean":"2023-12-24T19:59:25.244916+0000","last_became_active":"2023-12-24T19:59:25.244564+0000","last_became_peered":"2023-12-24T19:59:25.244564+0000","last_unstale":"2023-12-24T19:59:25.244916+0000","last_undegraded":"2023-12-24T19:59:25.244916+0000","last_fullsized":"2023-12-24T19:59:25.244916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:46.083409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.256874+0000","last_change":"2023-12-24T19:59:24.221142+0000","last_active":"2023-12-24T19:59:25.256874+0000","last_peered":"2023-12-24T19:59:25.256874+0000","last_clean":"2023-12-24T19:59:25.256874+0000","last_became_active":"2023-12-24T19:59:24.220752+0000","last_became_peered":"2023-12-24T19:59:24.220752+0000","last_unstale":"2023-12-24T19:59:25.256874+0000","last_undegraded":"2023-12-24T19:59:25.256874+0000","last_fullsized":"2023-12-24T19:59:25.256874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:53.775613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246266+0000","last_change":"2023-12-24T19:59:25.246266+0000","last_active":"2023-12-24T19:59:25.246266+0000","last_peered":"2023-12-24T19:59:25.246266+0000","last_clean":"2023-12-24T19:59:25.246266+0000","last_became_active":"2023-12-24T19:59:25.245306+0000","last_became_peered":"2023-12-24T19:59:25.245306+0000","last_unstale":"2023-12-24T19:59:25.246266+0000","last_undegraded":"2023-12-24T19:59:25.246266+0000","last_fullsized":"2023-12-24T19:59:25.246266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:33.373874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243753+0000","last_change":"2023-12-24T19:59:24.219395+0000","last_active":"2023-12-24T19:59:25.243753+0000","last_peered":"2023-12-24T19:59:25.243753+0000","last_clean":"2023-12-24T19:59:25.243753+0000","last_became_active":"2023-12-24T19:59:24.219175+0000","last_became_peered":"2023-12-24T19:59:24.219175+0000","last_unstale":"2023-12-24T19:59:25.243753+0000","last_undegraded":"2023-12-24T19:59:25.243753+0000","last_fullsized":"2023-12-24T19:59:25.243753+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:09:52.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247819+0000","last_change":"2023-12-24T19:59:25.247819+0000","last_active":"2023-12-24T19:59:25.247819+0000","last_peered":"2023-12-24T19:59:25.247819+0000","last_clean":"2023-12-24T19:59:25.247819+0000","last_became_active":"2023-12-24T19:59:25.243331+0000","last_became_peered":"2023-12-24T19:59:25.243331+0000","last_unstale":"2023-12-24T19:59:25.247819+0000","last_undegraded":"2023-12-24T19:59:25.247819+0000","last_fullsized":"2023-12-24T19:59:25.247819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:14:01.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.236122+0000","last_change":"2023-12-24T19:59:24.222257+0000","last_active":"2023-12-24T19:59:25.236122+0000","last_peered":"2023-12-24T19:59:25.236122+0000","last_clean":"2023-12-24T19:59:25.236122+0000","last_became_active":"2023-12-24T19:59:24.220964+0000","last_became_peered":"2023-12-24T19:59:24.220964+0000","last_unstale":"2023-12-24T19:59:25.236122+0000","last_undegraded":"2023-12-24T19:59:25.236122+0000","last_fullsized":"2023-12-24T19:59:25.236122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:03:17.803566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247308+0000","last_change":"2023-12-24T19:59:25.247308+0000","last_active":"2023-12-24T19:59:25.247308+0000","last_peered":"2023-12-24T19:59:25.247308+0000","last_clean":"2023-12-24T19:59:25.247308+0000","last_became_active":"2023-12-24T19:59:25.246808+0000","last_became_peered":"2023-12-24T19:59:25.246808+0000","last_unstale":"2023-12-24T19:59:25.247308+0000","last_undegraded":"2023-12-24T19:59:25.247308+0000","last_fullsized":"2023-12-24T19:59:25.247308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:31:48.176918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.220794+0000","last_change":"2023-12-24T19:59:24.220726+0000","last_active":"2023-12-24T19:59:24.220794+0000","last_peered":"2023-12-24T19:59:24.220794+0000","last_clean":"2023-12-24T19:59:24.220794+0000","last_became_active":"2023-12-24T19:59:24.219818+0000","last_became_peered":"2023-12-24T19:59:24.219818+0000","last_unstale":"2023-12-24T19:59:24.220794+0000","last_undegraded":"2023-12-24T19:59:24.220794+0000","last_fullsized":"2023-12-24T19:59:24.220794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:35:12.896878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243251+0000","last_change":"2023-12-24T19:59:25.243251+0000","last_active":"2023-12-24T19:59:25.243251+0000","last_peered":"2023-12-24T19:59:25.243251+0000","last_clean":"2023-12-24T19:59:25.243251+0000","last_became_active":"2023-12-24T19:59:25.243028+0000","last_became_peered":"2023-12-24T19:59:25.243028+0000","last_unstale":"2023-12-24T19:59:25.243251+0000","last_undegraded":"2023-12-24T19:59:25.243251+0000","last_fullsized":"2023-12-24T19:59:25.243251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:56.066142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.221056+0000","last_change":"2023-12-24T19:59:24.220511+0000","last_active":"2023-12-24T19:59:24.221056+0000","last_peered":"2023-12-24T19:59:24.221056+0000","last_clean":"2023-12-24T19:59:24.221056+0000","last_became_active":"2023-12-24T19:59:24.220259+0000","last_became_peered":"2023-12-24T19:59:24.220259+0000","last_unstale":"2023-12-24T19:59:24.221056+0000","last_undegraded":"2023-12-24T19:59:24.221056+0000","last_fullsized":"2023-12-24T19:59:24.221056+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:55.091814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.248145+0000","last_change":"2023-12-24T19:59:25.248145+0000","last_active":"2023-12-24T19:59:25.248145+0000","last_peered":"2023-12-24T19:59:25.248145+0000","last_clean":"2023-12-24T19:59:25.248145+0000","last_became_active":"2023-12-24T19:59:25.247892+0000","last_became_peered":"2023-12-24T19:59:25.247892+0000","last_unstale":"2023-12-24T19:59:25.248145+0000","last_undegraded":"2023-12-24T19:59:25.248145+0000","last_fullsized":"2023-12-24T19:59:25.248145+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:08.830839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.221860+0000","last_change":"2023-12-24T19:59:24.221668+0000","last_active":"2023-12-24T19:59:24.221860+0000","last_peered":"2023-12-24T19:59:24.221860+0000","last_clean":"2023-12-24T19:59:24.221860+0000","last_became_active":"2023-12-24T19:59:24.221339+0000","last_became_peered":"2023-12-24T19:59:24.221339+0000","last_unstale":"2023-12-24T19:59:24.221860+0000","last_undegraded":"2023-12-24T19:59:24.221860+0000","last_fullsized":"2023-12-24T19:59:24.221860+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:11.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.249458+0000","last_change":"2023-12-24T19:59:25.249458+0000","last_active":"2023-12-24T19:59:25.249458+0000","last_peered":"2023-12-24T19:59:25.249458+0000","last_clean":"2023-12-24T19:59:25.249458+0000","last_became_active":"2023-12-24T19:59:25.249190+0000","last_became_peered":"2023-12-24T19:59:25.249190+0000","last_unstale":"2023-12-24T19:59:25.249458+0000","last_undegraded":"2023-12-24T19:59:25.249458+0000","last_fullsized":"2023-12-24T19:59:25.249458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:01.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.216737+0000","last_change":"2023-12-24T19:59:24.216659+0000","last_active":"2023-12-24T19:59:24.216737+0000","last_peered":"2023-12-24T19:59:24.216737+0000","last_clean":"2023-12-24T19:59:24.216737+0000","last_became_active":"2023-12-24T19:59:24.216374+0000","last_became_peered":"2023-12-24T19:59:24.216374+0000","last_unstale":"2023-12-24T19:59:24.216737+0000","last_undegraded":"2023-12-24T19:59:24.216737+0000","last_fullsized":"2023-12-24T19:59:24.216737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:17.736729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244878+0000","last_change":"2023-12-24T19:59:25.244878+0000","last_active":"2023-12-24T19:59:25.244878+0000","last_peered":"2023-12-24T19:59:25.244878+0000","last_clean":"2023-12-24T19:59:25.244878+0000","last_became_active":"2023-12-24T19:59:25.244316+0000","last_became_peered":"2023-12-24T19:59:25.244316+0000","last_unstale":"2023-12-24T19:59:25.244878+0000","last_undegraded":"2023-12-24T19:59:25.244878+0000","last_fullsized":"2023-12-24T19:59:25.244878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:36.742677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.259274+0000","last_change":"2023-12-24T19:59:24.221136+0000","last_active":"2023-12-24T19:59:25.259274+0000","last_peered":"2023-12-24T19:59:25.259274+0000","last_clean":"2023-12-24T19:59:25.259274+0000","last_became_active":"2023-12-24T19:59:24.220909+0000","last_became_peered":"2023-12-24T19:59:24.220909+0000","last_unstale":"2023-12-24T19:59:25.259274+0000","last_undegraded":"2023-12-24T19:59:25.259274+0000","last_fullsized":"2023-12-24T19:59:25.259274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:35:12.896878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.253745+0000","last_change":"2023-12-24T19:59:25.253745+0000","last_active":"2023-12-24T19:59:25.253745+0000","last_peered":"2023-12-24T19:59:25.253745+0000","last_clean":"2023-12-24T19:59:25.253745+0000","last_became_active":"2023-12-24T19:59:25.252686+0000","last_became_peered":"2023-12-24T19:59:25.252686+0000","last_unstale":"2023-12-24T19:59:25.253745+0000","last_undegraded":"2023-12-24T19:59:25.253745+0000","last_fullsized":"2023-12-24T19:59:25.253745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:56.456816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.258508+0000","last_change":"2023-12-24T19:59:24.222332+0000","last_active":"2023-12-24T19:59:25.258508+0000","last_peered":"2023-12-24T19:59:25.258508+0000","last_clean":"2023-12-24T19:59:25.258508+0000","last_became_active":"2023-12-24T19:59:24.221910+0000","last_became_peered":"2023-12-24T19:59:24.221910+0000","last_unstale":"2023-12-24T19:59:25.258508+0000","last_undegraded":"2023-12-24T19:59:25.258508+0000","last_fullsized":"2023-12-24T19:59:25.258508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:31:38.274398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.252287+0000","last_change":"2023-12-24T19:59:25.252287+0000","last_active":"2023-12-24T19:59:25.252287+0000","last_peered":"2023-12-24T19:59:25.252287+0000","last_clean":"2023-12-24T19:59:25.252287+0000","last_became_active":"2023-12-24T19:59:25.251993+0000","last_became_peered":"2023-12-24T19:59:25.251993+0000","last_unstale":"2023-12-24T19:59:25.252287+0000","last_undegraded":"2023-12-24T19:59:25.252287+0000","last_fullsized":"2023-12-24T19:59:25.252287+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:44.857928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.254669+0000","last_change":"2023-12-24T19:59:24.222620+0000","last_active":"2023-12-24T19:59:25.254669+0000","last_peered":"2023-12-24T19:59:25.254669+0000","last_clean":"2023-12-24T19:59:25.254669+0000","last_became_active":"2023-12-24T19:59:24.222218+0000","last_became_peered":"2023-12-24T19:59:24.222218+0000","last_unstale":"2023-12-24T19:59:25.254669+0000","last_undegraded":"2023-12-24T19:59:25.254669+0000","last_fullsized":"2023-12-24T19:59:25.254669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:11:51.938502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246601+0000","last_change":"2023-12-24T19:59:25.246601+0000","last_active":"2023-12-24T19:59:25.246601+0000","last_peered":"2023-12-24T19:59:25.246601+0000","last_clean":"2023-12-24T19:59:25.246601+0000","last_became_active":"2023-12-24T19:59:25.246361+0000","last_became_peered":"2023-12-24T19:59:25.246361+0000","last_unstale":"2023-12-24T19:59:25.246601+0000","last_undegraded":"2023-12-24T19:59:25.246601+0000","last_fullsized":"2023-12-24T19:59:25.246601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:58.281893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.217811+0000","last_change":"2023-12-24T19:59:24.217747+0000","last_active":"2023-12-24T19:59:24.217811+0000","last_peered":"2023-12-24T19:59:24.217811+0000","last_clean":"2023-12-24T19:59:24.217811+0000","last_became_active":"2023-12-24T19:59:24.217495+0000","last_became_peered":"2023-12-24T19:59:24.217495+0000","last_unstale":"2023-12-24T19:59:24.217811+0000","last_undegraded":"2023-12-24T19:59:24.217811+0000","last_fullsized":"2023-12-24T19:59:24.217811+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:02.669204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.251127+0000","last_change":"2023-12-24T19:59:25.251127+0000","last_active":"2023-12-24T19:59:25.251127+0000","last_peered":"2023-12-24T19:59:25.251127+0000","last_clean":"2023-12-24T19:59:25.251127+0000","last_became_active":"2023-12-24T19:59:25.250907+0000","last_became_peered":"2023-12-24T19:59:25.250907+0000","last_unstale":"2023-12-24T19:59:25.251127+0000","last_undegraded":"2023-12-24T19:59:25.251127+0000","last_fullsized":"2023-12-24T19:59:25.251127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:19:03.296305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.217891+0000","last_change":"2023-12-24T19:59:24.217810+0000","last_active":"2023-12-24T19:59:24.217891+0000","last_peered":"2023-12-24T19:59:24.217891+0000","last_clean":"2023-12-24T19:59:24.217891+0000","last_became_active":"2023-12-24T19:59:24.217565+0000","last_became_peered":"2023-12-24T19:59:24.217565+0000","last_unstale":"2023-12-24T19:59:24.217891+0000","last_undegraded":"2023-12-24T19:59:24.217891+0000","last_fullsized":"2023-12-24T19:59:24.217891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:11.467478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.251271+0000","last_change":"2023-12-24T19:59:25.251271+0000","last_active":"2023-12-24T19:59:25.251271+0000","last_peered":"2023-12-24T19:59:25.251271+0000","last_clean":"2023-12-24T19:59:25.251271+0000","last_became_active":"2023-12-24T19:59:25.251045+0000","last_became_peered":"2023-12-24T19:59:25.251045+0000","last_unstale":"2023-12-24T19:59:25.251271+0000","last_undegraded":"2023-12-24T19:59:25.251271+0000","last_fullsized":"2023-12-24T19:59:25.251271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:09.053052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.258503+0000","last_change":"2023-12-24T19:59:24.223184+0000","last_active":"2023-12-24T19:59:25.258503+0000","last_peered":"2023-12-24T19:59:25.258503+0000","last_clean":"2023-12-24T19:59:25.258503+0000","last_became_active":"2023-12-24T19:59:24.222948+0000","last_became_peered":"2023-12-24T19:59:24.222948+0000","last_unstale":"2023-12-24T19:59:25.258503+0000","last_undegraded":"2023-12-24T19:59:25.258503+0000","last_fullsized":"2023-12-24T19:59:25.258503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:11.467478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.249633+0000","last_change":"2023-12-24T19:59:25.249633+0000","last_active":"2023-12-24T19:59:25.249633+0000","last_peered":"2023-12-24T19:59:25.249633+0000","last_clean":"2023-12-24T19:59:25.249633+0000","last_became_active":"2023-12-24T19:59:25.249367+0000","last_became_peered":"2023-12-24T19:59:25.249367+0000","last_unstale":"2023-12-24T19:59:25.249633+0000","last_undegraded":"2023-12-24T19:59:25.249633+0000","last_fullsized":"2023-12-24T19:59:25.249633+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:18.743284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.236954+0000","last_change":"2023-12-24T19:59:24.217134+0000","last_active":"2023-12-24T19:59:25.236954+0000","last_peered":"2023-12-24T19:59:25.236954+0000","last_clean":"2023-12-24T19:59:25.236954+0000","last_became_active":"2023-12-24T19:59:24.216476+0000","last_became_peered":"2023-12-24T19:59:24.216476+0000","last_unstale":"2023-12-24T19:59:25.236954+0000","last_undegraded":"2023-12-24T19:59:25.236954+0000","last_fullsized":"2023-12-24T19:59:25.236954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:43.851373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244433+0000","last_change":"2023-12-24T19:59:25.244433+0000","last_active":"2023-12-24T19:59:25.244433+0000","last_peered":"2023-12-24T19:59:25.244433+0000","last_clean":"2023-12-24T19:59:25.244433+0000","last_became_active":"2023-12-24T19:59:25.243343+0000","last_became_peered":"2023-12-24T19:59:25.243343+0000","last_unstale":"2023-12-24T19:59:25.244433+0000","last_undegraded":"2023-12-24T19:59:25.244433+0000","last_fullsized":"2023-12-24T19:59:25.244433+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:58.281893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.256301+0000","last_change":"2023-12-24T19:59:24.220264+0000","last_active":"2023-12-24T19:59:25.256301+0000","last_peered":"2023-12-24T19:59:25.256301+0000","last_clean":"2023-12-24T19:59:25.256301+0000","last_became_active":"2023-12-24T19:59:24.219863+0000","last_became_peered":"2023-12-24T19:59:24.219863+0000","last_unstale":"2023-12-24T19:59:25.256301+0000","last_undegraded":"2023-12-24T19:59:25.256301+0000","last_fullsized":"2023-12-24T19:59:25.256301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:55.091814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.248824+0000","last_change":"2023-12-24T19:59:25.248824+0000","last_active":"2023-12-24T19:59:25.248824+0000","last_peered":"2023-12-24T19:59:25.248824+0000","last_clean":"2023-12-24T19:59:25.248824+0000","last_became_active":"2023-12-24T19:59:25.248138+0000","last_became_peered":"2023-12-24T19:59:25.248138+0000","last_unstale":"2023-12-24T19:59:25.248824+0000","last_undegraded":"2023-12-24T19:59:25.248824+0000","last_fullsized":"2023-12-24T19:59:25.248824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:47:29.840234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.239853+0000","last_change":"2023-12-24T19:59:24.220983+0000","last_active":"2023-12-24T19:59:25.239853+0000","last_peered":"2023-12-24T19:59:25.239853+0000","last_clean":"2023-12-24T19:59:25.239853+0000","last_became_active":"2023-12-24T19:59:24.219740+0000","last_became_peered":"2023-12-24T19:59:24.219740+0000","last_unstale":"2023-12-24T19:59:25.239853+0000","last_undegraded":"2023-12-24T19:59:25.239853+0000","last_fullsized":"2023-12-24T19:59:25.239853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:22:26.435044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.250735+0000","last_change":"2023-12-24T19:59:25.250735+0000","last_active":"2023-12-24T19:59:25.250735+0000","last_peered":"2023-12-24T19:59:25.250735+0000","last_clean":"2023-12-24T19:59:25.250735+0000","last_became_active":"2023-12-24T19:59:25.250394+0000","last_became_peered":"2023-12-24T19:59:25.250394+0000","last_unstale":"2023-12-24T19:59:25.250735+0000","last_undegraded":"2023-12-24T19:59:25.250735+0000","last_fullsized":"2023-12-24T19:59:25.250735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:18:43.323430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.220420+0000","last_change":"2023-12-24T19:59:24.219437+0000","last_active":"2023-12-24T19:59:24.220420+0000","last_peered":"2023-12-24T19:59:24.220420+0000","last_clean":"2023-12-24T19:59:24.220420+0000","last_became_active":"2023-12-24T19:59:24.219193+0000","last_became_peered":"2023-12-24T19:59:24.219193+0000","last_unstale":"2023-12-24T19:59:24.220420+0000","last_undegraded":"2023-12-24T19:59:24.220420+0000","last_fullsized":"2023-12-24T19:59:24.220420+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:59:03.349900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244947+0000","last_change":"2023-12-24T19:59:25.244947+0000","last_active":"2023-12-24T19:59:25.244947+0000","last_peered":"2023-12-24T19:59:25.244947+0000","last_clean":"2023-12-24T19:59:25.244947+0000","last_became_active":"2023-12-24T19:59:25.243717+0000","last_became_peered":"2023-12-24T19:59:25.243717+0000","last_unstale":"2023-12-24T19:59:25.244947+0000","last_undegraded":"2023-12-24T19:59:25.244947+0000","last_fullsized":"2023-12-24T19:59:25.244947+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:18.743284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.255804+0000","last_change":"2023-12-24T19:59:24.221800+0000","last_active":"2023-12-24T19:59:25.255804+0000","last_peered":"2023-12-24T19:59:25.255804+0000","last_clean":"2023-12-24T19:59:25.255804+0000","last_became_active":"2023-12-24T19:59:24.221559+0000","last_became_peered":"2023-12-24T19:59:24.221559+0000","last_unstale":"2023-12-24T19:59:25.255804+0000","last_undegraded":"2023-12-24T19:59:25.255804+0000","last_fullsized":"2023-12-24T19:59:25.255804+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:18:42.316875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243639+0000","last_change":"2023-12-24T19:59:25.243639+0000","last_active":"2023-12-24T19:59:25.243639+0000","last_peered":"2023-12-24T19:59:25.243639+0000","last_clean":"2023-12-24T19:59:25.243639+0000","last_became_active":"2023-12-24T19:59:25.243410+0000","last_became_peered":"2023-12-24T19:59:25.243410+0000","last_unstale":"2023-12-24T19:59:25.243639+0000","last_undegraded":"2023-12-24T19:59:25.243639+0000","last_fullsized":"2023-12-24T19:59:25.243639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:09:52.128190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.211178+0000","last_change":"2023-12-24T19:59:24.211107+0000","last_active":"2023-12-24T19:59:24.211178+0000","last_peered":"2023-12-24T19:59:24.211178+0000","last_clean":"2023-12-24T19:59:24.211178+0000","last_became_active":"2023-12-24T19:59:24.210841+0000","last_became_peered":"2023-12-24T19:59:24.210841+0000","last_unstale":"2023-12-24T19:59:24.211178+0000","last_undegraded":"2023-12-24T19:59:24.211178+0000","last_fullsized":"2023-12-24T19:59:24.211178+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:42:36.643365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247144+0000","last_change":"2023-12-24T19:59:25.247144+0000","last_active":"2023-12-24T19:59:25.247144+0000","last_peered":"2023-12-24T19:59:25.247144+0000","last_clean":"2023-12-24T19:59:25.247144+0000","last_became_active":"2023-12-24T19:59:25.246932+0000","last_became_peered":"2023-12-24T19:59:25.246932+0000","last_unstale":"2023-12-24T19:59:25.247144+0000","last_undegraded":"2023-12-24T19:59:25.247144+0000","last_fullsized":"2023-12-24T19:59:25.247144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:14:13.484623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.217137+0000","last_change":"2023-12-24T19:59:24.217058+0000","last_active":"2023-12-24T19:59:24.217137+0000","last_peered":"2023-12-24T19:59:24.217137+0000","last_clean":"2023-12-24T19:59:24.217137+0000","last_became_active":"2023-12-24T19:59:24.216834+0000","last_became_peered":"2023-12-24T19:59:24.216834+0000","last_unstale":"2023-12-24T19:59:24.217137+0000","last_undegraded":"2023-12-24T19:59:24.217137+0000","last_fullsized":"2023-12-24T19:59:24.217137+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:11.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.251970+0000","last_change":"2023-12-24T19:59:25.251970+0000","last_active":"2023-12-24T19:59:25.251970+0000","last_peered":"2023-12-24T19:59:25.251970+0000","last_clean":"2023-12-24T19:59:25.251970+0000","last_became_active":"2023-12-24T19:59:25.251724+0000","last_became_peered":"2023-12-24T19:59:25.251724+0000","last_unstale":"2023-12-24T19:59:25.251970+0000","last_undegraded":"2023-12-24T19:59:25.251970+0000","last_fullsized":"2023-12-24T19:59:25.251970+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:01.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.255363+0000","last_change":"2023-12-24T19:59:24.214696+0000","last_active":"2023-12-24T19:59:25.255363+0000","last_peered":"2023-12-24T19:59:25.255363+0000","last_clean":"2023-12-24T19:59:25.255363+0000","last_became_active":"2023-12-24T19:59:24.214424+0000","last_became_peered":"2023-12-24T19:59:24.214424+0000","last_unstale":"2023-12-24T19:59:25.255363+0000","last_undegraded":"2023-12-24T19:59:25.255363+0000","last_fullsized":"2023-12-24T19:59:25.255363+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:33:07.365321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.250859+0000","last_change":"2023-12-24T19:59:25.250859+0000","last_active":"2023-12-24T19:59:25.250859+0000","last_peered":"2023-12-24T19:59:25.250859+0000","last_clean":"2023-12-24T19:59:25.250859+0000","last_became_active":"2023-12-24T19:59:25.250385+0000","last_became_peered":"2023-12-24T19:59:25.250385+0000","last_unstale":"2023-12-24T19:59:25.250859+0000","last_undegraded":"2023-12-24T19:59:25.250859+0000","last_fullsized":"2023-12-24T19:59:25.250859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:37.112966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.222540+0000","last_change":"2023-12-24T19:59:24.222400+0000","last_active":"2023-12-24T19:59:24.222540+0000","last_peered":"2023-12-24T19:59:24.222540+0000","last_clean":"2023-12-24T19:59:24.222540+0000","last_became_active":"2023-12-24T19:59:24.221201+0000","last_became_peered":"2023-12-24T19:59:24.221201+0000","last_unstale":"2023-12-24T19:59:24.222540+0000","last_undegraded":"2023-12-24T19:59:24.222540+0000","last_fullsized":"2023-12-24T19:59:24.222540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:09:52.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245720+0000","last_change":"2023-12-24T19:59:25.245720+0000","last_active":"2023-12-24T19:59:25.245720+0000","last_peered":"2023-12-24T19:59:25.245720+0000","last_clean":"2023-12-24T19:59:25.245720+0000","last_became_active":"2023-12-24T19:59:25.245329+0000","last_became_peered":"2023-12-24T19:59:25.245329+0000","last_unstale":"2023-12-24T19:59:25.245720+0000","last_undegraded":"2023-12-24T19:59:25.245720+0000","last_fullsized":"2023-12-24T19:59:25.245720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.779612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.221226+0000","last_change":"2023-12-24T19:59:24.221160+0000","last_active":"2023-12-24T19:59:24.221226+0000","last_peered":"2023-12-24T19:59:24.221226+0000","last_clean":"2023-12-24T19:59:24.221226+0000","last_became_active":"2023-12-24T19:59:24.220928+0000","last_became_peered":"2023-12-24T19:59:24.220928+0000","last_unstale":"2023-12-24T19:59:24.221226+0000","last_undegraded":"2023-12-24T19:59:24.221226+0000","last_fullsized":"2023-12-24T19:59:24.221226+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:33:07.365321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.241892+0000","last_change":"2023-12-24T19:59:25.241892+0000","last_active":"2023-12-24T19:59:25.241892+0000","last_peered":"2023-12-24T19:59:25.241892+0000","last_clean":"2023-12-24T19:59:25.241892+0000","last_became_active":"2023-12-24T19:59:25.241673+0000","last_became_peered":"2023-12-24T19:59:25.241673+0000","last_unstale":"2023-12-24T19:59:25.241892+0000","last_undegraded":"2023-12-24T19:59:25.241892+0000","last_fullsized":"2023-12-24T19:59:25.241892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:50.339249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.221853+0000","last_change":"2023-12-24T19:59:24.221750+0000","last_active":"2023-12-24T19:59:24.221853+0000","last_peered":"2023-12-24T19:59:24.221853+0000","last_clean":"2023-12-24T19:59:24.221853+0000","last_became_active":"2023-12-24T19:59:24.221288+0000","last_became_peered":"2023-12-24T19:59:24.221288+0000","last_unstale":"2023-12-24T19:59:24.221853+0000","last_undegraded":"2023-12-24T19:59:24.221853+0000","last_fullsized":"2023-12-24T19:59:24.221853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:14:07.526192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243057+0000","last_change":"2023-12-24T19:59:25.243057+0000","last_active":"2023-12-24T19:59:25.243057+0000","last_peered":"2023-12-24T19:59:25.243057+0000","last_clean":"2023-12-24T19:59:25.243057+0000","last_became_active":"2023-12-24T19:59:25.242079+0000","last_became_peered":"2023-12-24T19:59:25.242079+0000","last_unstale":"2023-12-24T19:59:25.243057+0000","last_undegraded":"2023-12-24T19:59:25.243057+0000","last_fullsized":"2023-12-24T19:59:25.243057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:26.235877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.218491+0000","last_change":"2023-12-24T19:59:24.218341+0000","last_active":"2023-12-24T19:59:24.218491+0000","last_peered":"2023-12-24T19:59:24.218491+0000","last_clean":"2023-12-24T19:59:24.218491+0000","last_became_active":"2023-12-24T19:59:24.218011+0000","last_became_peered":"2023-12-24T19:59:24.218011+0000","last_unstale":"2023-12-24T19:59:24.218491+0000","last_undegraded":"2023-12-24T19:59:24.218491+0000","last_fullsized":"2023-12-24T19:59:24.218491+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:02.726601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.250596+0000","last_change":"2023-12-24T19:59:25.250596+0000","last_active":"2023-12-24T19:59:25.250596+0000","last_peered":"2023-12-24T19:59:25.250596+0000","last_clean":"2023-12-24T19:59:25.250596+0000","last_became_active":"2023-12-24T19:59:25.250077+0000","last_became_peered":"2023-12-24T19:59:25.250077+0000","last_unstale":"2023-12-24T19:59:25.250596+0000","last_undegraded":"2023-12-24T19:59:25.250596+0000","last_fullsized":"2023-12-24T19:59:25.250596+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:11:52.945057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.221077+0000","last_change":"2023-12-24T19:59:24.220815+0000","last_active":"2023-12-24T19:59:24.221077+0000","last_peered":"2023-12-24T19:59:24.221077+0000","last_clean":"2023-12-24T19:59:24.221077+0000","last_became_active":"2023-12-24T19:59:24.220377+0000","last_became_peered":"2023-12-24T19:59:24.220377+0000","last_unstale":"2023-12-24T19:59:24.221077+0000","last_undegraded":"2023-12-24T19:59:24.221077+0000","last_fullsized":"2023-12-24T19:59:24.221077+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:13.263190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244711+0000","last_change":"2023-12-24T19:59:25.244711+0000","last_active":"2023-12-24T19:59:25.244711+0000","last_peered":"2023-12-24T19:59:25.244711+0000","last_clean":"2023-12-24T19:59:25.244711+0000","last_became_active":"2023-12-24T19:59:25.243983+0000","last_became_peered":"2023-12-24T19:59:25.243983+0000","last_unstale":"2023-12-24T19:59:25.244711+0000","last_undegraded":"2023-12-24T19:59:25.244711+0000","last_fullsized":"2023-12-24T19:59:25.244711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:05.490185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.219294+0000","last_change":"2023-12-24T19:59:24.219232+0000","last_active":"2023-12-24T19:59:24.219294+0000","last_peered":"2023-12-24T19:59:24.219294+0000","last_clean":"2023-12-24T19:59:24.219294+0000","last_became_active":"2023-12-24T19:59:24.219004+0000","last_became_peered":"2023-12-24T19:59:24.219004+0000","last_unstale":"2023-12-24T19:59:24.219294+0000","last_undegraded":"2023-12-24T19:59:24.219294+0000","last_fullsized":"2023-12-24T19:59:24.219294+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:02.669204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246549+0000","last_change":"2023-12-24T19:59:25.246549+0000","last_active":"2023-12-24T19:59:25.246549+0000","last_peered":"2023-12-24T19:59:25.246549+0000","last_clean":"2023-12-24T19:59:25.246549+0000","last_became_active":"2023-12-24T19:59:25.246030+0000","last_became_peered":"2023-12-24T19:59:25.246030+0000","last_unstale":"2023-12-24T19:59:25.246549+0000","last_undegraded":"2023-12-24T19:59:25.246549+0000","last_fullsized":"2023-12-24T19:59:25.246549+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:03:31.596771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.217194+0000","last_change":"2023-12-24T19:59:24.216741+0000","last_active":"2023-12-24T19:59:24.217194+0000","last_peered":"2023-12-24T19:59:24.217194+0000","last_clean":"2023-12-24T19:59:24.217194+0000","last_became_active":"2023-12-24T19:59:24.216091+0000","last_became_peered":"2023-12-24T19:59:24.216091+0000","last_unstale":"2023-12-24T19:59:24.217194+0000","last_undegraded":"2023-12-24T19:59:24.217194+0000","last_fullsized":"2023-12-24T19:59:24.217194+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:36.106411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.241077+0000","last_change":"2023-12-24T19:59:25.241077+0000","last_active":"2023-12-24T19:59:25.241077+0000","last_peered":"2023-12-24T19:59:25.241077+0000","last_clean":"2023-12-24T19:59:25.241077+0000","last_became_active":"2023-12-24T19:59:25.240849+0000","last_became_peered":"2023-12-24T19:59:25.240849+0000","last_unstale":"2023-12-24T19:59:25.241077+0000","last_undegraded":"2023-12-24T19:59:25.241077+0000","last_fullsized":"2023-12-24T19:59:25.241077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:50:35.300918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.219685+0000","last_change":"2023-12-24T19:59:24.219623+0000","last_active":"2023-12-24T19:59:24.219685+0000","last_peered":"2023-12-24T19:59:24.219685+0000","last_clean":"2023-12-24T19:59:24.219685+0000","last_became_active":"2023-12-24T19:59:24.219387+0000","last_became_peered":"2023-12-24T19:59:24.219387+0000","last_unstale":"2023-12-24T19:59:24.219685+0000","last_undegraded":"2023-12-24T19:59:24.219685+0000","last_fullsized":"2023-12-24T19:59:24.219685+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:15.809685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.216356+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:59:24.216356+0000","last_peered":"2023-12-24T19:59:24.216356+0000","last_clean":"2023-12-24T19:59:24.216356+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:59:24.216356+0000","last_undegraded":"2023-12-24T19:59:24.216356+0000","last_fullsized":"2023-12-24T19:59:24.216356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":871,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194441,"statfs":{"total":200000000,"available":199107650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.67900000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.41699999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.56000000000000005}]},{"osd":1,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71199999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.432,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.73799999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79300000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.626,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.82199999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61699999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77100000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.72999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73399999999999999,"5min":0.753,"15min":0.753},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51700000000000002,"15min":0.51100000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.65000000000000002}]},{"osd":4,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.46500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.751,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.629}]},{"osd":5,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.502},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.215,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56499999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.316}]},{"osd":2,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.25900000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36299999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28799999999999998}]},{"osd":3,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.39100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63900000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.626},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.439,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.65300000000000002}]},{"osd":7,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":871,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194441,"statfs":{"total":200000000,"available":199107650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.42599999999999999,"15min":0.44700000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.41999999999999998,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.254},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35999999999999999,"15min":0.36499999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.50900000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.27900000000000003}]},{"osd":2,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.35599999999999998,"15min":0.36499999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41899999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.49299999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.32000000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55300000000000005,"5min":2.573,"15min":2.573},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41599999999999998,"15min":0.41999999999999998},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56200000000000006,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.307}]},{"osd":4,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.68000000000000005,"15min":0.69799999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.4810000000000001,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.67300000000000004}]},{"osd":6,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84099999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64400000000000002}]},{"osd":7,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.556,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.66100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.59699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.45000000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.371}]},{"osd":1,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.625,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.5},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.504,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29999999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90000000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58199999999999996}]},{"osd":5,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.64300000000000002,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":3.577,"5min":3.577,"15min":3.577},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.69199999999999995,"15min":0.66300000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.64200000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84199999999999997,"5min":1.04,"15min":1.04},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.65300000000000002,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.63200000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":7.0599999999999996,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.31900000000000001},"min":{"1min":0.20100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.253,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52200000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.23699999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.33900000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.504,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.26600000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57399999999999995,"5min":0.626,"15min":0.626},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.378}]},{"osd":4,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.39100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.59199999999999997}]},{"osd":5,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92800000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.47999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.46400000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77500000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.627}]},{"osd":1,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.39400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.76000000000000001,"5min":4.883,"15min":4.883},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":1.544,"15min":1.544},"last":0.47199999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78400000000000003,"5min":0.88,"15min":0.88},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70399999999999996,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.56499999999999995}]},{"osd":3,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.92200000000000004,"15min":0.97999999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73199999999999998,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.314,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72499999999999998,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77400000000000002,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.55100000000000005}]},{"osd":6,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.36099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":1.1200000000000001,"15min":1.2150000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80500000000000005,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.71999999999999997,"5min":0.751,"15min":0.751},"last":0.57799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.502,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.56899999999999995,"15min":0.54200000000000004},"min":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.6059999999999999,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.47799999999999998}]},{"osd":1,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.501},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.57999999999999996,"15min":0.55600000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.8559999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.66000000000000003}]},{"osd":3,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.58099999999999996,"15min":0.56200000000000006},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.38},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73399999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.499,"15min":0.495},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.54800000000000004,"15min":0.52300000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.52700000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.626},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.57599999999999996,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.766,"5min":3.766,"15min":3.766},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.70299999999999996}]}]}],"pool_statfs":[]}} 2023-12-24T19:59:29.372 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T19:59:29.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.527+0000 7f039bc07700 1 Processor -- start 2023-12-24T19:59:29.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.528+0000 7f039bc07700 1 -- start start 2023-12-24T19:59:29.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.528+0000 7f039bc07700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039415bb60 0x7f0394098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.528+0000 7f039bc07700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03940b2eb0 con 0x7f0394098aa0 2023-12-24T19:59:29.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.528+0000 7f039bc07700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03940b2bd0 con 0x7f03940b2660 2023-12-24T19:59:29.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.528+0000 7f039bc07700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03940afc20 con 0x7f039415bb60 2023-12-24T19:59:29.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.528+0000 7f03991a2700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0394098aa0 0x7f039415bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:52928/0 (socket says 172.21.15.61:52928) 2023-12-24T19:59:29.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.528+0000 7f03991a2700 1 -- 172.21.15.61:0/1136820436 learned_addr learned my addr 172.21.15.61:0/1136820436 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:29.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03999a3700 1 --2- 172.21.15.61:0/1136820436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039415bb60 0x7f0394098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03989a1700 1 -- 172.21.15.61:0/1136820436 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585985018 0 0) 0x7f03940b2eb0 con 0x7f0394098aa0 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03989a1700 1 -- 172.21.15.61:0/1136820436 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0380003570 con 0x7f0394098aa0 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03989a1700 1 -- 172.21.15.61:0/1136820436 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065060664 0 0) 0x7f03940b2bd0 con 0x7f03940b2660 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03989a1700 1 -- 172.21.15.61:0/1136820436 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03940b2eb0 con 0x7f03940b2660 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03999a3700 1 -- 172.21.15.61:0/1136820436 >> v1:172.21.15.133:6789/0 conn(0x7f03940b2660 legacy=0x7f03940b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03999a3700 1 -- 172.21.15.61:0/1136820436 >> v1:172.21.15.61:6789/0 conn(0x7f0394098aa0 legacy=0x7f039415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03989a1700 1 -- 172.21.15.61:0/1136820436 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2286920445 0 0) 0x7f0380003570 con 0x7f0394098aa0 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03999a3700 1 -- 172.21.15.61:0/1136820436 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940afe10 con 0x7f039415bb60 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03999a3700 1 --2- 172.21.15.61:0/1136820436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039415bb60 0x7f0394098560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0390009900 tx=0x7f0390009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec261f1dc4f8728 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.529+0000 7f03989a1700 1 -- 172.21.15.61:0/1136820436 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384001470 con 0x7f039415bb60 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.530+0000 7f03989a1700 1 -- 172.21.15.61:0/1136820436 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0390011420 con 0x7f039415bb60 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.530+0000 7f03989a1700 1 -- 172.21.15.61:0/1136820436 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900117c0 con 0x7f039415bb60 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.530+0000 7f039bc07700 1 -- 172.21.15.61:0/1136820436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039415bb60 msgr2=0x7f0394098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.530+0000 7f039bc07700 1 --2- 172.21.15.61:0/1136820436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039415bb60 0x7f0394098560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0390009900 tx=0x7f0390009120 comp rx=0 tx=0).stop 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.530+0000 7f039bc07700 1 -- 172.21.15.61:0/1136820436 shutdown_connections 2023-12-24T19:59:29.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.530+0000 7f039bc07700 1 --2- 172.21.15.61:0/1136820436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f039415bb60 0x7f0394098560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.530+0000 7f039bc07700 1 -- 172.21.15.61:0/1136820436 >> 172.21.15.61:0/1136820436 conn(0x7f0394097a10 msgr2=0x7f03940ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:29.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.530+0000 7f039bc07700 1 -- 172.21.15.61:0/1136820436 shutdown_connections 2023-12-24T19:59:29.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.530+0000 7f039bc07700 1 -- 172.21.15.61:0/1136820436 wait complete. 2023-12-24T19:59:29.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.531+0000 7f039bc07700 1 Processor -- start 2023-12-24T19:59:29.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.531+0000 7f039bc07700 1 -- start start 2023-12-24T19:59:29.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f039bc07700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0394098aa0 0x7f039414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f039bc07700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03940b2660 0x7f03940ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f039bc07700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f039415bb60 0x7f03940ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f039bc07700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039415e900 con 0x7f03940b2660 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f039bc07700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0394168470 con 0x7f039415bb60 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f039bc07700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03940ab060 con 0x7f0394098aa0 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f03991a2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03940b2660 0x7f03940ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f03991a2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03940b2660 0x7f03940ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41492/0 (socket says 172.21.15.61:41492) 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f03991a2700 1 -- 172.21.15.61:0/3411600954 learned_addr learned my addr 172.21.15.61:0/3411600954 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f03999a3700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0394098aa0 0x7f039414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f039a1a4700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f039415bb60 0x7f03940ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f03991a2700 1 -- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0394098aa0 msgr2=0x7f039414ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f03991a2700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0394098aa0 0x7f039414ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f03991a2700 1 -- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f039415bb60 msgr2=0x7f03940ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f03991a2700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f039415bb60 0x7f03940ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.532+0000 7f03991a2700 1 -- 172.21.15.61:0/3411600954 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03900093c0 con 0x7f03940b2660 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.533+0000 7f03991a2700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03940b2660 0x7f03940ac8d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f038400cb70 tx=0x7f0384001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:29.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.533+0000 7f0389ffb700 1 -- 172.21.15.61:0/3411600954 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400ce80 con 0x7f03940b2660 2023-12-24T19:59:29.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.533+0000 7f0389ffb700 1 -- 172.21.15.61:0/3411600954 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0384007360 con 0x7f03940b2660 2023-12-24T19:59:29.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.533+0000 7f039bc07700 1 -- 172.21.15.61:0/3411600954 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039415e620 con 0x7f03940b2660 2023-12-24T19:59:29.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.533+0000 7f0389ffb700 1 -- 172.21.15.61:0/3411600954 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384007700 con 0x7f03940b2660 2023-12-24T19:59:29.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.533+0000 7f039bc07700 1 -- 172.21.15.61:0/3411600954 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03940aacf0 con 0x7f03940b2660 2023-12-24T19:59:29.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.534+0000 7f039bc07700 1 -- 172.21.15.61:0/3411600954 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0394098f80 con 0x7f03940b2660 2023-12-24T19:59:29.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.534+0000 7f0389ffb700 1 -- 172.21.15.61:0/3411600954 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0384004a40 con 0x7f03940b2660 2023-12-24T19:59:29.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.535+0000 7f0389ffb700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0378066f30 0x7f03780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.535+0000 7f0389ffb700 1 -- 172.21.15.61:0/3411600954 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03840839a0 con 0x7f03940b2660 2023-12-24T19:59:29.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.535+0000 7f03999a3700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0378066f30 0x7f03780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.535+0000 7f03999a3700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0378066f30 0x7f03780693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0390009160 tx=0x7f0390016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:29.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.539+0000 7f0389ffb700 1 -- 172.21.15.61:0/3411600954 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0384050c10 con 0x7f03940b2660 2023-12-24T19:59:29.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.733+0000 7f039bc07700 1 -- 172.21.15.61:0/3411600954 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f039406d440 con 0x7f0378066f30 2023-12-24T19:59:29.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.741+0000 7f0389ffb700 1 -- 172.21.15.61:0/3411600954 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284679 (secure 0 0 0) 0x7f039406d440 con 0x7f0378066f30 2023-12-24T19:59:29.745 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:29.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 -- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0378066f30 msgr2=0x7f03780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0378066f30 0x7f03780693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0390009160 tx=0x7f0390016000 comp rx=0 tx=0).stop 2023-12-24T19:59:29.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 -- 172.21.15.61:0/3411600954 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03940b2660 msgr2=0x7f03940ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03940b2660 0x7f03940ac8d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f038400cb70 tx=0x7f0384001b50 comp rx=0 tx=0).stop 2023-12-24T19:59:29.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 -- 172.21.15.61:0/3411600954 shutdown_connections 2023-12-24T19:59:29.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0394098aa0 0x7f039414ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0378066f30 0x7f03780693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f039415bb60 0x7f03940ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 --2- 172.21.15.61:0/3411600954 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03940b2660 0x7f03940ac8d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 -- 172.21.15.61:0/3411600954 >> 172.21.15.61:0/3411600954 conn(0x7f0394097a10 msgr2=0x7f039406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:29.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 -- 172.21.15.61:0/3411600954 shutdown_connections 2023-12-24T19:59:29.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.744+0000 7f039bc07700 1 -- 172.21.15.61:0/3411600954 wait complete. 2023-12-24T19:59:29.749 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T19:59:29.757 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-12-24T19:59:28.341280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3512,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558987,"statfs":{"total":1600000000,"available":1596403408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.136460"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.240444+0000","last_change":"2023-12-24T19:59:25.240444+0000","last_active":"2023-12-24T19:59:25.240444+0000","last_peered":"2023-12-24T19:59:25.240444+0000","last_clean":"2023-12-24T19:59:25.240444+0000","last_became_active":"2023-12-24T19:59:25.240013+0000","last_became_peered":"2023-12-24T19:59:25.240013+0000","last_unstale":"2023-12-24T19:59:25.240444+0000","last_undegraded":"2023-12-24T19:59:25.240444+0000","last_fullsized":"2023-12-24T19:59:25.240444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:37:34.117277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.242588+0000","last_change":"2023-12-24T19:59:25.242588+0000","last_active":"2023-12-24T19:59:25.242588+0000","last_peered":"2023-12-24T19:59:25.242588+0000","last_clean":"2023-12-24T19:59:25.242588+0000","last_became_active":"2023-12-24T19:59:25.241777+0000","last_became_peered":"2023-12-24T19:59:25.241777+0000","last_unstale":"2023-12-24T19:59:25.242588+0000","last_undegraded":"2023-12-24T19:59:25.242588+0000","last_fullsized":"2023-12-24T19:59:25.242588+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:46.383063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.256587+0000","last_change":"2023-12-24T19:59:25.256587+0000","last_active":"2023-12-24T19:59:25.256587+0000","last_peered":"2023-12-24T19:59:25.256587+0000","last_clean":"2023-12-24T19:59:25.256587+0000","last_became_active":"2023-12-24T19:59:25.256317+0000","last_became_peered":"2023-12-24T19:59:25.256317+0000","last_unstale":"2023-12-24T19:59:25.256587+0000","last_undegraded":"2023-12-24T19:59:25.256587+0000","last_fullsized":"2023-12-24T19:59:25.256587+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:44.857928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245090+0000","last_change":"2023-12-24T19:59:25.245090+0000","last_active":"2023-12-24T19:59:25.245090+0000","last_peered":"2023-12-24T19:59:25.245090+0000","last_clean":"2023-12-24T19:59:25.245090+0000","last_became_active":"2023-12-24T19:59:25.244677+0000","last_became_peered":"2023-12-24T19:59:25.244677+0000","last_unstale":"2023-12-24T19:59:25.245090+0000","last_undegraded":"2023-12-24T19:59:25.245090+0000","last_fullsized":"2023-12-24T19:59:25.245090+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:09.053052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243857+0000","last_change":"2023-12-24T19:59:25.243857+0000","last_active":"2023-12-24T19:59:25.243857+0000","last_peered":"2023-12-24T19:59:25.243857+0000","last_clean":"2023-12-24T19:59:25.243857+0000","last_became_active":"2023-12-24T19:59:25.243631+0000","last_became_peered":"2023-12-24T19:59:25.243631+0000","last_unstale":"2023-12-24T19:59:25.243857+0000","last_undegraded":"2023-12-24T19:59:25.243857+0000","last_fullsized":"2023-12-24T19:59:25.243857+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:10.735758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.239633+0000","last_change":"2023-12-24T19:59:25.239633+0000","last_active":"2023-12-24T19:59:25.239633+0000","last_peered":"2023-12-24T19:59:25.239633+0000","last_clean":"2023-12-24T19:59:25.239633+0000","last_became_active":"2023-12-24T19:59:25.239399+0000","last_became_peered":"2023-12-24T19:59:25.239399+0000","last_unstale":"2023-12-24T19:59:25.239633+0000","last_undegraded":"2023-12-24T19:59:25.239633+0000","last_fullsized":"2023-12-24T19:59:25.239633+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:00.314994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245111+0000","last_change":"2023-12-24T19:59:25.245111+0000","last_active":"2023-12-24T19:59:25.245111+0000","last_peered":"2023-12-24T19:59:25.245111+0000","last_clean":"2023-12-24T19:59:25.245111+0000","last_became_active":"2023-12-24T19:59:25.244857+0000","last_became_peered":"2023-12-24T19:59:25.244857+0000","last_unstale":"2023-12-24T19:59:25.245111+0000","last_undegraded":"2023-12-24T19:59:25.245111+0000","last_fullsized":"2023-12-24T19:59:25.245111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:01.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246412+0000","last_change":"2023-12-24T19:59:25.246412+0000","last_active":"2023-12-24T19:59:25.246412+0000","last_peered":"2023-12-24T19:59:25.246412+0000","last_clean":"2023-12-24T19:59:25.246412+0000","last_became_active":"2023-12-24T19:59:25.245650+0000","last_became_peered":"2023-12-24T19:59:25.245650+0000","last_unstale":"2023-12-24T19:59:25.246412+0000","last_undegraded":"2023-12-24T19:59:25.246412+0000","last_fullsized":"2023-12-24T19:59:25.246412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:02:13.246839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247841+0000","last_change":"2023-12-24T19:59:25.247841+0000","last_active":"2023-12-24T19:59:25.247841+0000","last_peered":"2023-12-24T19:59:25.247841+0000","last_clean":"2023-12-24T19:59:25.247841+0000","last_became_active":"2023-12-24T19:59:25.247581+0000","last_became_peered":"2023-12-24T19:59:25.247581+0000","last_unstale":"2023-12-24T19:59:25.247841+0000","last_undegraded":"2023-12-24T19:59:25.247841+0000","last_fullsized":"2023-12-24T19:59:25.247841+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:50.339249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245586+0000","last_change":"2023-12-24T19:59:25.245586+0000","last_active":"2023-12-24T19:59:25.245586+0000","last_peered":"2023-12-24T19:59:25.245586+0000","last_clean":"2023-12-24T19:59:25.245586+0000","last_became_active":"2023-12-24T19:59:25.245023+0000","last_became_peered":"2023-12-24T19:59:25.245023+0000","last_unstale":"2023-12-24T19:59:25.245586+0000","last_undegraded":"2023-12-24T19:59:25.245586+0000","last_fullsized":"2023-12-24T19:59:25.245586+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:38:47.349361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247624+0000","last_change":"2023-12-24T19:59:25.247624+0000","last_active":"2023-12-24T19:59:25.247624+0000","last_peered":"2023-12-24T19:59:25.247624+0000","last_clean":"2023-12-24T19:59:25.247624+0000","last_became_active":"2023-12-24T19:59:25.247185+0000","last_became_peered":"2023-12-24T19:59:25.247185+0000","last_unstale":"2023-12-24T19:59:25.247624+0000","last_undegraded":"2023-12-24T19:59:25.247624+0000","last_fullsized":"2023-12-24T19:59:25.247624+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:12.474033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.250988+0000","last_change":"2023-12-24T19:59:25.250988+0000","last_active":"2023-12-24T19:59:25.250988+0000","last_peered":"2023-12-24T19:59:25.250988+0000","last_clean":"2023-12-24T19:59:25.250988+0000","last_became_active":"2023-12-24T19:59:25.250663+0000","last_became_peered":"2023-12-24T19:59:25.250663+0000","last_unstale":"2023-12-24T19:59:25.250988+0000","last_undegraded":"2023-12-24T19:59:25.250988+0000","last_fullsized":"2023-12-24T19:59:25.250988+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:18:43.323430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.248073+0000","last_change":"2023-12-24T19:59:25.248073+0000","last_active":"2023-12-24T19:59:25.248073+0000","last_peered":"2023-12-24T19:59:25.248073+0000","last_clean":"2023-12-24T19:59:25.248073+0000","last_became_active":"2023-12-24T19:59:25.245105+0000","last_became_peered":"2023-12-24T19:59:25.245105+0000","last_unstale":"2023-12-24T19:59:25.248073+0000","last_undegraded":"2023-12-24T19:59:25.248073+0000","last_fullsized":"2023-12-24T19:59:25.248073+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:05.490185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245168+0000","last_change":"2023-12-24T19:59:25.245168+0000","last_active":"2023-12-24T19:59:25.245168+0000","last_peered":"2023-12-24T19:59:25.245168+0000","last_clean":"2023-12-24T19:59:25.245168+0000","last_became_active":"2023-12-24T19:59:25.244795+0000","last_became_peered":"2023-12-24T19:59:25.244795+0000","last_unstale":"2023-12-24T19:59:25.245168+0000","last_undegraded":"2023-12-24T19:59:25.245168+0000","last_fullsized":"2023-12-24T19:59:25.245168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:09.053052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247716+0000","last_change":"2023-12-24T19:59:25.247716+0000","last_active":"2023-12-24T19:59:25.247716+0000","last_peered":"2023-12-24T19:59:25.247716+0000","last_clean":"2023-12-24T19:59:25.247716+0000","last_became_active":"2023-12-24T19:59:25.246863+0000","last_became_peered":"2023-12-24T19:59:25.246863+0000","last_unstale":"2023-12-24T19:59:25.247716+0000","last_undegraded":"2023-12-24T19:59:25.247716+0000","last_fullsized":"2023-12-24T19:59:25.247716+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:44.857928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243555+0000","last_change":"2023-12-24T19:59:25.243555+0000","last_active":"2023-12-24T19:59:25.243555+0000","last_peered":"2023-12-24T19:59:25.243555+0000","last_clean":"2023-12-24T19:59:25.243555+0000","last_became_active":"2023-12-24T19:59:25.243128+0000","last_became_peered":"2023-12-24T19:59:25.243128+0000","last_unstale":"2023-12-24T19:59:25.243555+0000","last_undegraded":"2023-12-24T19:59:25.243555+0000","last_fullsized":"2023-12-24T19:59:25.243555+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:50:58.694951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247651+0000","last_change":"2023-12-24T19:59:25.247651+0000","last_active":"2023-12-24T19:59:25.247651+0000","last_peered":"2023-12-24T19:59:25.247651+0000","last_clean":"2023-12-24T19:59:25.247651+0000","last_became_active":"2023-12-24T19:59:25.242815+0000","last_became_peered":"2023-12-24T19:59:25.242815+0000","last_unstale":"2023-12-24T19:59:25.247651+0000","last_undegraded":"2023-12-24T19:59:25.247651+0000","last_fullsized":"2023-12-24T19:59:25.247651+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:30.144048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.253924+0000","last_change":"2023-12-24T19:59:25.253924+0000","last_active":"2023-12-24T19:59:25.253924+0000","last_peered":"2023-12-24T19:59:25.253924+0000","last_clean":"2023-12-24T19:59:25.253924+0000","last_became_active":"2023-12-24T19:59:25.253369+0000","last_became_peered":"2023-12-24T19:59:25.253369+0000","last_unstale":"2023-12-24T19:59:25.253924+0000","last_undegraded":"2023-12-24T19:59:25.253924+0000","last_fullsized":"2023-12-24T19:59:25.253924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:08.830839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.240720+0000","last_change":"2023-12-24T19:59:25.240720+0000","last_active":"2023-12-24T19:59:25.240720+0000","last_peered":"2023-12-24T19:59:25.240720+0000","last_clean":"2023-12-24T19:59:25.240720+0000","last_became_active":"2023-12-24T19:59:25.240127+0000","last_became_peered":"2023-12-24T19:59:25.240127+0000","last_unstale":"2023-12-24T19:59:25.240720+0000","last_undegraded":"2023-12-24T19:59:25.240720+0000","last_fullsized":"2023-12-24T19:59:25.240720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:03:22.171001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244334+0000","last_change":"2023-12-24T19:59:25.244334+0000","last_active":"2023-12-24T19:59:25.244334+0000","last_peered":"2023-12-24T19:59:25.244334+0000","last_clean":"2023-12-24T19:59:25.244334+0000","last_became_active":"2023-12-24T19:59:25.244097+0000","last_became_peered":"2023-12-24T19:59:25.244097+0000","last_unstale":"2023-12-24T19:59:25.244334+0000","last_undegraded":"2023-12-24T19:59:25.244334+0000","last_fullsized":"2023-12-24T19:59:25.244334+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:16.301634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247485+0000","last_change":"2023-12-24T19:59:25.247485+0000","last_active":"2023-12-24T19:59:25.247485+0000","last_peered":"2023-12-24T19:59:25.247485+0000","last_clean":"2023-12-24T19:59:25.247485+0000","last_became_active":"2023-12-24T19:59:25.247237+0000","last_became_peered":"2023-12-24T19:59:25.247237+0000","last_unstale":"2023-12-24T19:59:25.247485+0000","last_undegraded":"2023-12-24T19:59:25.247485+0000","last_fullsized":"2023-12-24T19:59:25.247485+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:19:03.296305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247499+0000","last_change":"2023-12-24T19:59:25.247499+0000","last_active":"2023-12-24T19:59:25.247499+0000","last_peered":"2023-12-24T19:59:25.247499+0000","last_clean":"2023-12-24T19:59:25.247499+0000","last_became_active":"2023-12-24T19:59:25.242367+0000","last_became_peered":"2023-12-24T19:59:25.242367+0000","last_unstale":"2023-12-24T19:59:25.247499+0000","last_undegraded":"2023-12-24T19:59:25.247499+0000","last_fullsized":"2023-12-24T19:59:25.247499+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:16:00.337861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.253603+0000","last_change":"2023-12-24T19:59:25.253603+0000","last_active":"2023-12-24T19:59:25.253603+0000","last_peered":"2023-12-24T19:59:25.253603+0000","last_clean":"2023-12-24T19:59:25.253603+0000","last_became_active":"2023-12-24T19:59:25.252399+0000","last_became_peered":"2023-12-24T19:59:25.252399+0000","last_unstale":"2023-12-24T19:59:25.253603+0000","last_undegraded":"2023-12-24T19:59:25.253603+0000","last_fullsized":"2023-12-24T19:59:25.253603+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:50.339249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.248433+0000","last_change":"2023-12-24T19:59:25.248433+0000","last_active":"2023-12-24T19:59:25.248433+0000","last_peered":"2023-12-24T19:59:25.248433+0000","last_clean":"2023-12-24T19:59:25.248433+0000","last_became_active":"2023-12-24T19:59:25.245601+0000","last_became_peered":"2023-12-24T19:59:25.245601+0000","last_unstale":"2023-12-24T19:59:25.248433+0000","last_undegraded":"2023-12-24T19:59:25.248433+0000","last_fullsized":"2023-12-24T19:59:25.248433+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:26.129410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244778+0000","last_change":"2023-12-24T19:59:25.244778+0000","last_active":"2023-12-24T19:59:25.244778+0000","last_peered":"2023-12-24T19:59:25.244778+0000","last_clean":"2023-12-24T19:59:25.244778+0000","last_became_active":"2023-12-24T19:59:25.244548+0000","last_became_peered":"2023-12-24T19:59:25.244548+0000","last_unstale":"2023-12-24T19:59:25.244778+0000","last_undegraded":"2023-12-24T19:59:25.244778+0000","last_fullsized":"2023-12-24T19:59:25.244778+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:39:00.907224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245344+0000","last_change":"2023-12-24T19:59:25.245344+0000","last_active":"2023-12-24T19:59:25.245344+0000","last_peered":"2023-12-24T19:59:25.245344+0000","last_clean":"2023-12-24T19:59:25.245344+0000","last_became_active":"2023-12-24T19:59:25.244672+0000","last_became_peered":"2023-12-24T19:59:25.244672+0000","last_unstale":"2023-12-24T19:59:25.245344+0000","last_undegraded":"2023-12-24T19:59:25.245344+0000","last_fullsized":"2023-12-24T19:59:25.245344+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:11:52.945057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247932+0000","last_change":"2023-12-24T19:59:25.247932+0000","last_active":"2023-12-24T19:59:25.247932+0000","last_peered":"2023-12-24T19:59:25.247932+0000","last_clean":"2023-12-24T19:59:25.247932+0000","last_became_active":"2023-12-24T19:59:25.247622+0000","last_became_peered":"2023-12-24T19:59:25.247622+0000","last_unstale":"2023-12-24T19:59:25.247932+0000","last_undegraded":"2023-12-24T19:59:25.247932+0000","last_fullsized":"2023-12-24T19:59:25.247932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:42:01.754649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246024+0000","last_change":"2023-12-24T19:59:25.246024+0000","last_active":"2023-12-24T19:59:25.246024+0000","last_peered":"2023-12-24T19:59:25.246024+0000","last_clean":"2023-12-24T19:59:25.246024+0000","last_became_active":"2023-12-24T19:59:25.245757+0000","last_became_peered":"2023-12-24T19:59:25.245757+0000","last_unstale":"2023-12-24T19:59:25.246024+0000","last_undegraded":"2023-12-24T19:59:25.246024+0000","last_fullsized":"2023-12-24T19:59:25.246024+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:27:16.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245742+0000","last_change":"2023-12-24T19:59:25.245742+0000","last_active":"2023-12-24T19:59:25.245742+0000","last_peered":"2023-12-24T19:59:25.245742+0000","last_clean":"2023-12-24T19:59:25.245742+0000","last_became_active":"2023-12-24T19:59:25.245444+0000","last_became_peered":"2023-12-24T19:59:25.245444+0000","last_unstale":"2023-12-24T19:59:25.245742+0000","last_undegraded":"2023-12-24T19:59:25.245742+0000","last_fullsized":"2023-12-24T19:59:25.245742+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:03.963419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247176+0000","last_change":"2023-12-24T19:59:25.247176+0000","last_active":"2023-12-24T19:59:25.247176+0000","last_peered":"2023-12-24T19:59:25.247176+0000","last_clean":"2023-12-24T19:59:25.247176+0000","last_became_active":"2023-12-24T19:59:25.246845+0000","last_became_peered":"2023-12-24T19:59:25.246845+0000","last_unstale":"2023-12-24T19:59:25.247176+0000","last_undegraded":"2023-12-24T19:59:25.247176+0000","last_fullsized":"2023-12-24T19:59:25.247176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:37.112966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.249382+0000","last_change":"2023-12-24T19:59:25.249382+0000","last_active":"2023-12-24T19:59:25.249382+0000","last_peered":"2023-12-24T19:59:25.249382+0000","last_clean":"2023-12-24T19:59:25.249382+0000","last_became_active":"2023-12-24T19:59:25.249153+0000","last_became_peered":"2023-12-24T19:59:25.249153+0000","last_unstale":"2023-12-24T19:59:25.249382+0000","last_undegraded":"2023-12-24T19:59:25.249382+0000","last_fullsized":"2023-12-24T19:59:25.249382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:20.027695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.241616+0000","last_change":"2023-12-24T19:59:25.241616+0000","last_active":"2023-12-24T19:59:25.241616+0000","last_peered":"2023-12-24T19:59:25.241616+0000","last_clean":"2023-12-24T19:59:25.241616+0000","last_became_active":"2023-12-24T19:59:25.241312+0000","last_became_peered":"2023-12-24T19:59:25.241312+0000","last_unstale":"2023-12-24T19:59:25.241616+0000","last_undegraded":"2023-12-24T19:59:25.241616+0000","last_fullsized":"2023-12-24T19:59:25.241616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:13:29.273111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.248681+0000","last_change":"2023-12-24T19:59:25.248681+0000","last_active":"2023-12-24T19:59:25.248681+0000","last_peered":"2023-12-24T19:59:25.248681+0000","last_clean":"2023-12-24T19:59:25.248681+0000","last_became_active":"2023-12-24T19:59:25.248454+0000","last_became_peered":"2023-12-24T19:59:25.248454+0000","last_unstale":"2023-12-24T19:59:25.248681+0000","last_undegraded":"2023-12-24T19:59:25.248681+0000","last_fullsized":"2023-12-24T19:59:25.248681+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:46:48.890599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"61'4","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.256839+0000","last_change":"2023-12-24T19:59:24.222674+0000","last_active":"2023-12-24T19:59:25.256839+0000","last_peered":"2023-12-24T19:59:25.256839+0000","last_clean":"2023-12-24T19:59:25.256839+0000","last_became_active":"2023-12-24T19:59:24.221867+0000","last_became_peered":"2023-12-24T19:59:24.221867+0000","last_unstale":"2023-12-24T19:59:25.256839+0000","last_undegraded":"2023-12-24T19:59:25.256839+0000","last_fullsized":"2023-12-24T19:59:25.256839+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:38.492589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.250710+0000","last_change":"2023-12-24T19:59:25.250710+0000","last_active":"2023-12-24T19:59:25.250710+0000","last_peered":"2023-12-24T19:59:25.250710+0000","last_clean":"2023-12-24T19:59:25.250710+0000","last_became_active":"2023-12-24T19:59:25.250490+0000","last_became_peered":"2023-12-24T19:59:25.250490+0000","last_unstale":"2023-12-24T19:59:25.250710+0000","last_undegraded":"2023-12-24T19:59:25.250710+0000","last_fullsized":"2023-12-24T19:59:25.250710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:35:13.903433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.236847+0000","last_change":"2023-12-24T19:59:24.220187+0000","last_active":"2023-12-24T19:59:25.236847+0000","last_peered":"2023-12-24T19:59:25.236847+0000","last_clean":"2023-12-24T19:59:25.236847+0000","last_became_active":"2023-12-24T19:59:24.219954+0000","last_became_peered":"2023-12-24T19:59:24.219954+0000","last_unstale":"2023-12-24T19:59:25.236847+0000","last_undegraded":"2023-12-24T19:59:25.236847+0000","last_fullsized":"2023-12-24T19:59:25.236847+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:00.364328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246297+0000","last_change":"2023-12-24T19:59:25.246297+0000","last_active":"2023-12-24T19:59:25.246297+0000","last_peered":"2023-12-24T19:59:25.246297+0000","last_clean":"2023-12-24T19:59:25.246297+0000","last_became_active":"2023-12-24T19:59:25.246075+0000","last_became_peered":"2023-12-24T19:59:25.246075+0000","last_unstale":"2023-12-24T19:59:25.246297+0000","last_undegraded":"2023-12-24T19:59:25.246297+0000","last_fullsized":"2023-12-24T19:59:25.246297+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:08.995485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.256137+0000","last_change":"2023-12-24T19:59:24.220100+0000","last_active":"2023-12-24T19:59:25.256137+0000","last_peered":"2023-12-24T19:59:25.256137+0000","last_clean":"2023-12-24T19:59:25.256137+0000","last_became_active":"2023-12-24T19:59:24.219544+0000","last_became_peered":"2023-12-24T19:59:24.219544+0000","last_unstale":"2023-12-24T19:59:25.256137+0000","last_undegraded":"2023-12-24T19:59:25.256137+0000","last_fullsized":"2023-12-24T19:59:25.256137+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:13.263190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244916+0000","last_change":"2023-12-24T19:59:25.244916+0000","last_active":"2023-12-24T19:59:25.244916+0000","last_peered":"2023-12-24T19:59:25.244916+0000","last_clean":"2023-12-24T19:59:25.244916+0000","last_became_active":"2023-12-24T19:59:25.244564+0000","last_became_peered":"2023-12-24T19:59:25.244564+0000","last_unstale":"2023-12-24T19:59:25.244916+0000","last_undegraded":"2023-12-24T19:59:25.244916+0000","last_fullsized":"2023-12-24T19:59:25.244916+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:46.083409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.256874+0000","last_change":"2023-12-24T19:59:24.221142+0000","last_active":"2023-12-24T19:59:25.256874+0000","last_peered":"2023-12-24T19:59:25.256874+0000","last_clean":"2023-12-24T19:59:25.256874+0000","last_became_active":"2023-12-24T19:59:24.220752+0000","last_became_peered":"2023-12-24T19:59:24.220752+0000","last_unstale":"2023-12-24T19:59:25.256874+0000","last_undegraded":"2023-12-24T19:59:25.256874+0000","last_fullsized":"2023-12-24T19:59:25.256874+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:53.775613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246266+0000","last_change":"2023-12-24T19:59:25.246266+0000","last_active":"2023-12-24T19:59:25.246266+0000","last_peered":"2023-12-24T19:59:25.246266+0000","last_clean":"2023-12-24T19:59:25.246266+0000","last_became_active":"2023-12-24T19:59:25.245306+0000","last_became_peered":"2023-12-24T19:59:25.245306+0000","last_unstale":"2023-12-24T19:59:25.246266+0000","last_undegraded":"2023-12-24T19:59:25.246266+0000","last_fullsized":"2023-12-24T19:59:25.246266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:33.373874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243753+0000","last_change":"2023-12-24T19:59:24.219395+0000","last_active":"2023-12-24T19:59:25.243753+0000","last_peered":"2023-12-24T19:59:25.243753+0000","last_clean":"2023-12-24T19:59:25.243753+0000","last_became_active":"2023-12-24T19:59:24.219175+0000","last_became_peered":"2023-12-24T19:59:24.219175+0000","last_unstale":"2023-12-24T19:59:25.243753+0000","last_undegraded":"2023-12-24T19:59:25.243753+0000","last_fullsized":"2023-12-24T19:59:25.243753+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:09:52.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247819+0000","last_change":"2023-12-24T19:59:25.247819+0000","last_active":"2023-12-24T19:59:25.247819+0000","last_peered":"2023-12-24T19:59:25.247819+0000","last_clean":"2023-12-24T19:59:25.247819+0000","last_became_active":"2023-12-24T19:59:25.243331+0000","last_became_peered":"2023-12-24T19:59:25.243331+0000","last_unstale":"2023-12-24T19:59:25.247819+0000","last_undegraded":"2023-12-24T19:59:25.247819+0000","last_fullsized":"2023-12-24T19:59:25.247819+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:14:01.460029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.236122+0000","last_change":"2023-12-24T19:59:24.222257+0000","last_active":"2023-12-24T19:59:25.236122+0000","last_peered":"2023-12-24T19:59:25.236122+0000","last_clean":"2023-12-24T19:59:25.236122+0000","last_became_active":"2023-12-24T19:59:24.220964+0000","last_became_peered":"2023-12-24T19:59:24.220964+0000","last_unstale":"2023-12-24T19:59:25.236122+0000","last_undegraded":"2023-12-24T19:59:25.236122+0000","last_fullsized":"2023-12-24T19:59:25.236122+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:03:17.803566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247308+0000","last_change":"2023-12-24T19:59:25.247308+0000","last_active":"2023-12-24T19:59:25.247308+0000","last_peered":"2023-12-24T19:59:25.247308+0000","last_clean":"2023-12-24T19:59:25.247308+0000","last_became_active":"2023-12-24T19:59:25.246808+0000","last_became_peered":"2023-12-24T19:59:25.246808+0000","last_unstale":"2023-12-24T19:59:25.247308+0000","last_undegraded":"2023-12-24T19:59:25.247308+0000","last_fullsized":"2023-12-24T19:59:25.247308+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:31:48.176918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.220794+0000","last_change":"2023-12-24T19:59:24.220726+0000","last_active":"2023-12-24T19:59:24.220794+0000","last_peered":"2023-12-24T19:59:24.220794+0000","last_clean":"2023-12-24T19:59:24.220794+0000","last_became_active":"2023-12-24T19:59:24.219818+0000","last_became_peered":"2023-12-24T19:59:24.219818+0000","last_unstale":"2023-12-24T19:59:24.220794+0000","last_undegraded":"2023-12-24T19:59:24.220794+0000","last_fullsized":"2023-12-24T19:59:24.220794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:35:12.896878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243251+0000","last_change":"2023-12-24T19:59:25.243251+0000","last_active":"2023-12-24T19:59:25.243251+0000","last_peered":"2023-12-24T19:59:25.243251+0000","last_clean":"2023-12-24T19:59:25.243251+0000","last_became_active":"2023-12-24T19:59:25.243028+0000","last_became_peered":"2023-12-24T19:59:25.243028+0000","last_unstale":"2023-12-24T19:59:25.243251+0000","last_undegraded":"2023-12-24T19:59:25.243251+0000","last_fullsized":"2023-12-24T19:59:25.243251+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:56.066142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.221056+0000","last_change":"2023-12-24T19:59:24.220511+0000","last_active":"2023-12-24T19:59:24.221056+0000","last_peered":"2023-12-24T19:59:24.221056+0000","last_clean":"2023-12-24T19:59:24.221056+0000","last_became_active":"2023-12-24T19:59:24.220259+0000","last_became_peered":"2023-12-24T19:59:24.220259+0000","last_unstale":"2023-12-24T19:59:24.221056+0000","last_undegraded":"2023-12-24T19:59:24.221056+0000","last_fullsized":"2023-12-24T19:59:24.221056+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:55.091814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.248145+0000","last_change":"2023-12-24T19:59:25.248145+0000","last_active":"2023-12-24T19:59:25.248145+0000","last_peered":"2023-12-24T19:59:25.248145+0000","last_clean":"2023-12-24T19:59:25.248145+0000","last_became_active":"2023-12-24T19:59:25.247892+0000","last_became_peered":"2023-12-24T19:59:25.247892+0000","last_unstale":"2023-12-24T19:59:25.248145+0000","last_undegraded":"2023-12-24T19:59:25.248145+0000","last_fullsized":"2023-12-24T19:59:25.248145+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:43:08.830839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.221860+0000","last_change":"2023-12-24T19:59:24.221668+0000","last_active":"2023-12-24T19:59:24.221860+0000","last_peered":"2023-12-24T19:59:24.221860+0000","last_clean":"2023-12-24T19:59:24.221860+0000","last_became_active":"2023-12-24T19:59:24.221339+0000","last_became_peered":"2023-12-24T19:59:24.221339+0000","last_unstale":"2023-12-24T19:59:24.221860+0000","last_undegraded":"2023-12-24T19:59:24.221860+0000","last_fullsized":"2023-12-24T19:59:24.221860+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:11.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.249458+0000","last_change":"2023-12-24T19:59:25.249458+0000","last_active":"2023-12-24T19:59:25.249458+0000","last_peered":"2023-12-24T19:59:25.249458+0000","last_clean":"2023-12-24T19:59:25.249458+0000","last_became_active":"2023-12-24T19:59:25.249190+0000","last_became_peered":"2023-12-24T19:59:25.249190+0000","last_unstale":"2023-12-24T19:59:25.249458+0000","last_undegraded":"2023-12-24T19:59:25.249458+0000","last_fullsized":"2023-12-24T19:59:25.249458+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:01.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.216737+0000","last_change":"2023-12-24T19:59:24.216659+0000","last_active":"2023-12-24T19:59:24.216737+0000","last_peered":"2023-12-24T19:59:24.216737+0000","last_clean":"2023-12-24T19:59:24.216737+0000","last_became_active":"2023-12-24T19:59:24.216374+0000","last_became_peered":"2023-12-24T19:59:24.216374+0000","last_unstale":"2023-12-24T19:59:24.216737+0000","last_undegraded":"2023-12-24T19:59:24.216737+0000","last_fullsized":"2023-12-24T19:59:24.216737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:17.736729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244878+0000","last_change":"2023-12-24T19:59:25.244878+0000","last_active":"2023-12-24T19:59:25.244878+0000","last_peered":"2023-12-24T19:59:25.244878+0000","last_clean":"2023-12-24T19:59:25.244878+0000","last_became_active":"2023-12-24T19:59:25.244316+0000","last_became_peered":"2023-12-24T19:59:25.244316+0000","last_unstale":"2023-12-24T19:59:25.244878+0000","last_undegraded":"2023-12-24T19:59:25.244878+0000","last_fullsized":"2023-12-24T19:59:25.244878+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:36.742677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"61'3","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.259274+0000","last_change":"2023-12-24T19:59:24.221136+0000","last_active":"2023-12-24T19:59:25.259274+0000","last_peered":"2023-12-24T19:59:25.259274+0000","last_clean":"2023-12-24T19:59:25.259274+0000","last_became_active":"2023-12-24T19:59:24.220909+0000","last_became_peered":"2023-12-24T19:59:24.220909+0000","last_unstale":"2023-12-24T19:59:25.259274+0000","last_undegraded":"2023-12-24T19:59:25.259274+0000","last_fullsized":"2023-12-24T19:59:25.259274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:35:12.896878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.253745+0000","last_change":"2023-12-24T19:59:25.253745+0000","last_active":"2023-12-24T19:59:25.253745+0000","last_peered":"2023-12-24T19:59:25.253745+0000","last_clean":"2023-12-24T19:59:25.253745+0000","last_became_active":"2023-12-24T19:59:25.252686+0000","last_became_peered":"2023-12-24T19:59:25.252686+0000","last_unstale":"2023-12-24T19:59:25.253745+0000","last_undegraded":"2023-12-24T19:59:25.253745+0000","last_fullsized":"2023-12-24T19:59:25.253745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:56.456816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"61'6","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.258508+0000","last_change":"2023-12-24T19:59:24.222332+0000","last_active":"2023-12-24T19:59:25.258508+0000","last_peered":"2023-12-24T19:59:25.258508+0000","last_clean":"2023-12-24T19:59:25.258508+0000","last_became_active":"2023-12-24T19:59:24.221910+0000","last_became_peered":"2023-12-24T19:59:24.221910+0000","last_unstale":"2023-12-24T19:59:25.258508+0000","last_undegraded":"2023-12-24T19:59:25.258508+0000","last_fullsized":"2023-12-24T19:59:25.258508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:31:38.274398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.252287+0000","last_change":"2023-12-24T19:59:25.252287+0000","last_active":"2023-12-24T19:59:25.252287+0000","last_peered":"2023-12-24T19:59:25.252287+0000","last_clean":"2023-12-24T19:59:25.252287+0000","last_became_active":"2023-12-24T19:59:25.251993+0000","last_became_peered":"2023-12-24T19:59:25.251993+0000","last_unstale":"2023-12-24T19:59:25.252287+0000","last_undegraded":"2023-12-24T19:59:25.252287+0000","last_fullsized":"2023-12-24T19:59:25.252287+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:44.857928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.254669+0000","last_change":"2023-12-24T19:59:24.222620+0000","last_active":"2023-12-24T19:59:25.254669+0000","last_peered":"2023-12-24T19:59:25.254669+0000","last_clean":"2023-12-24T19:59:25.254669+0000","last_became_active":"2023-12-24T19:59:24.222218+0000","last_became_peered":"2023-12-24T19:59:24.222218+0000","last_unstale":"2023-12-24T19:59:25.254669+0000","last_undegraded":"2023-12-24T19:59:25.254669+0000","last_fullsized":"2023-12-24T19:59:25.254669+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:11:51.938502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246601+0000","last_change":"2023-12-24T19:59:25.246601+0000","last_active":"2023-12-24T19:59:25.246601+0000","last_peered":"2023-12-24T19:59:25.246601+0000","last_clean":"2023-12-24T19:59:25.246601+0000","last_became_active":"2023-12-24T19:59:25.246361+0000","last_became_peered":"2023-12-24T19:59:25.246361+0000","last_unstale":"2023-12-24T19:59:25.246601+0000","last_undegraded":"2023-12-24T19:59:25.246601+0000","last_fullsized":"2023-12-24T19:59:25.246601+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:58.281893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.217811+0000","last_change":"2023-12-24T19:59:24.217747+0000","last_active":"2023-12-24T19:59:24.217811+0000","last_peered":"2023-12-24T19:59:24.217811+0000","last_clean":"2023-12-24T19:59:24.217811+0000","last_became_active":"2023-12-24T19:59:24.217495+0000","last_became_peered":"2023-12-24T19:59:24.217495+0000","last_unstale":"2023-12-24T19:59:24.217811+0000","last_undegraded":"2023-12-24T19:59:24.217811+0000","last_fullsized":"2023-12-24T19:59:24.217811+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:02.669204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.251127+0000","last_change":"2023-12-24T19:59:25.251127+0000","last_active":"2023-12-24T19:59:25.251127+0000","last_peered":"2023-12-24T19:59:25.251127+0000","last_clean":"2023-12-24T19:59:25.251127+0000","last_became_active":"2023-12-24T19:59:25.250907+0000","last_became_peered":"2023-12-24T19:59:25.250907+0000","last_unstale":"2023-12-24T19:59:25.251127+0000","last_undegraded":"2023-12-24T19:59:25.251127+0000","last_fullsized":"2023-12-24T19:59:25.251127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:19:03.296305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.217891+0000","last_change":"2023-12-24T19:59:24.217810+0000","last_active":"2023-12-24T19:59:24.217891+0000","last_peered":"2023-12-24T19:59:24.217891+0000","last_clean":"2023-12-24T19:59:24.217891+0000","last_became_active":"2023-12-24T19:59:24.217565+0000","last_became_peered":"2023-12-24T19:59:24.217565+0000","last_unstale":"2023-12-24T19:59:24.217891+0000","last_undegraded":"2023-12-24T19:59:24.217891+0000","last_fullsized":"2023-12-24T19:59:24.217891+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:11.467478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.251271+0000","last_change":"2023-12-24T19:59:25.251271+0000","last_active":"2023-12-24T19:59:25.251271+0000","last_peered":"2023-12-24T19:59:25.251271+0000","last_clean":"2023-12-24T19:59:25.251271+0000","last_became_active":"2023-12-24T19:59:25.251045+0000","last_became_peered":"2023-12-24T19:59:25.251045+0000","last_unstale":"2023-12-24T19:59:25.251271+0000","last_undegraded":"2023-12-24T19:59:25.251271+0000","last_fullsized":"2023-12-24T19:59:25.251271+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:09.053052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"61'8","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.258503+0000","last_change":"2023-12-24T19:59:24.223184+0000","last_active":"2023-12-24T19:59:25.258503+0000","last_peered":"2023-12-24T19:59:25.258503+0000","last_clean":"2023-12-24T19:59:25.258503+0000","last_became_active":"2023-12-24T19:59:24.222948+0000","last_became_peered":"2023-12-24T19:59:24.222948+0000","last_unstale":"2023-12-24T19:59:25.258503+0000","last_undegraded":"2023-12-24T19:59:25.258503+0000","last_fullsized":"2023-12-24T19:59:25.258503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:27:11.467478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.249633+0000","last_change":"2023-12-24T19:59:25.249633+0000","last_active":"2023-12-24T19:59:25.249633+0000","last_peered":"2023-12-24T19:59:25.249633+0000","last_clean":"2023-12-24T19:59:25.249633+0000","last_became_active":"2023-12-24T19:59:25.249367+0000","last_became_peered":"2023-12-24T19:59:25.249367+0000","last_unstale":"2023-12-24T19:59:25.249633+0000","last_undegraded":"2023-12-24T19:59:25.249633+0000","last_fullsized":"2023-12-24T19:59:25.249633+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:18.743284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.236954+0000","last_change":"2023-12-24T19:59:24.217134+0000","last_active":"2023-12-24T19:59:25.236954+0000","last_peered":"2023-12-24T19:59:25.236954+0000","last_clean":"2023-12-24T19:59:25.236954+0000","last_became_active":"2023-12-24T19:59:24.216476+0000","last_became_peered":"2023-12-24T19:59:24.216476+0000","last_unstale":"2023-12-24T19:59:25.236954+0000","last_undegraded":"2023-12-24T19:59:25.236954+0000","last_fullsized":"2023-12-24T19:59:25.236954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:43.851373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244433+0000","last_change":"2023-12-24T19:59:25.244433+0000","last_active":"2023-12-24T19:59:25.244433+0000","last_peered":"2023-12-24T19:59:25.244433+0000","last_clean":"2023-12-24T19:59:25.244433+0000","last_became_active":"2023-12-24T19:59:25.243343+0000","last_became_peered":"2023-12-24T19:59:25.243343+0000","last_unstale":"2023-12-24T19:59:25.244433+0000","last_undegraded":"2023-12-24T19:59:25.244433+0000","last_fullsized":"2023-12-24T19:59:25.244433+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:58.281893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.256301+0000","last_change":"2023-12-24T19:59:24.220264+0000","last_active":"2023-12-24T19:59:25.256301+0000","last_peered":"2023-12-24T19:59:25.256301+0000","last_clean":"2023-12-24T19:59:25.256301+0000","last_became_active":"2023-12-24T19:59:24.219863+0000","last_became_peered":"2023-12-24T19:59:24.219863+0000","last_unstale":"2023-12-24T19:59:25.256301+0000","last_undegraded":"2023-12-24T19:59:25.256301+0000","last_fullsized":"2023-12-24T19:59:25.256301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:55.091814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.248824+0000","last_change":"2023-12-24T19:59:25.248824+0000","last_active":"2023-12-24T19:59:25.248824+0000","last_peered":"2023-12-24T19:59:25.248824+0000","last_clean":"2023-12-24T19:59:25.248824+0000","last_became_active":"2023-12-24T19:59:25.248138+0000","last_became_peered":"2023-12-24T19:59:25.248138+0000","last_unstale":"2023-12-24T19:59:25.248824+0000","last_undegraded":"2023-12-24T19:59:25.248824+0000","last_fullsized":"2023-12-24T19:59:25.248824+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:47:29.840234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"61'1","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.239853+0000","last_change":"2023-12-24T19:59:24.220983+0000","last_active":"2023-12-24T19:59:25.239853+0000","last_peered":"2023-12-24T19:59:25.239853+0000","last_clean":"2023-12-24T19:59:25.239853+0000","last_became_active":"2023-12-24T19:59:24.219740+0000","last_became_peered":"2023-12-24T19:59:24.219740+0000","last_unstale":"2023-12-24T19:59:25.239853+0000","last_undegraded":"2023-12-24T19:59:25.239853+0000","last_fullsized":"2023-12-24T19:59:25.239853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:22:26.435044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.250735+0000","last_change":"2023-12-24T19:59:25.250735+0000","last_active":"2023-12-24T19:59:25.250735+0000","last_peered":"2023-12-24T19:59:25.250735+0000","last_clean":"2023-12-24T19:59:25.250735+0000","last_became_active":"2023-12-24T19:59:25.250394+0000","last_became_peered":"2023-12-24T19:59:25.250394+0000","last_unstale":"2023-12-24T19:59:25.250735+0000","last_undegraded":"2023-12-24T19:59:25.250735+0000","last_fullsized":"2023-12-24T19:59:25.250735+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:18:43.323430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.220420+0000","last_change":"2023-12-24T19:59:24.219437+0000","last_active":"2023-12-24T19:59:24.220420+0000","last_peered":"2023-12-24T19:59:24.220420+0000","last_clean":"2023-12-24T19:59:24.220420+0000","last_became_active":"2023-12-24T19:59:24.219193+0000","last_became_peered":"2023-12-24T19:59:24.219193+0000","last_unstale":"2023-12-24T19:59:24.220420+0000","last_undegraded":"2023-12-24T19:59:24.220420+0000","last_fullsized":"2023-12-24T19:59:24.220420+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:59:03.349900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244947+0000","last_change":"2023-12-24T19:59:25.244947+0000","last_active":"2023-12-24T19:59:25.244947+0000","last_peered":"2023-12-24T19:59:25.244947+0000","last_clean":"2023-12-24T19:59:25.244947+0000","last_became_active":"2023-12-24T19:59:25.243717+0000","last_became_peered":"2023-12-24T19:59:25.243717+0000","last_unstale":"2023-12-24T19:59:25.244947+0000","last_undegraded":"2023-12-24T19:59:25.244947+0000","last_fullsized":"2023-12-24T19:59:25.244947+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:18.743284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.255804+0000","last_change":"2023-12-24T19:59:24.221800+0000","last_active":"2023-12-24T19:59:25.255804+0000","last_peered":"2023-12-24T19:59:25.255804+0000","last_clean":"2023-12-24T19:59:25.255804+0000","last_became_active":"2023-12-24T19:59:24.221559+0000","last_became_peered":"2023-12-24T19:59:24.221559+0000","last_unstale":"2023-12-24T19:59:25.255804+0000","last_undegraded":"2023-12-24T19:59:25.255804+0000","last_fullsized":"2023-12-24T19:59:25.255804+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:18:42.316875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243639+0000","last_change":"2023-12-24T19:59:25.243639+0000","last_active":"2023-12-24T19:59:25.243639+0000","last_peered":"2023-12-24T19:59:25.243639+0000","last_clean":"2023-12-24T19:59:25.243639+0000","last_became_active":"2023-12-24T19:59:25.243410+0000","last_became_peered":"2023-12-24T19:59:25.243410+0000","last_unstale":"2023-12-24T19:59:25.243639+0000","last_undegraded":"2023-12-24T19:59:25.243639+0000","last_fullsized":"2023-12-24T19:59:25.243639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:09:52.128190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.211178+0000","last_change":"2023-12-24T19:59:24.211107+0000","last_active":"2023-12-24T19:59:24.211178+0000","last_peered":"2023-12-24T19:59:24.211178+0000","last_clean":"2023-12-24T19:59:24.211178+0000","last_became_active":"2023-12-24T19:59:24.210841+0000","last_became_peered":"2023-12-24T19:59:24.210841+0000","last_unstale":"2023-12-24T19:59:24.211178+0000","last_undegraded":"2023-12-24T19:59:24.211178+0000","last_fullsized":"2023-12-24T19:59:24.211178+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:42:36.643365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.247144+0000","last_change":"2023-12-24T19:59:25.247144+0000","last_active":"2023-12-24T19:59:25.247144+0000","last_peered":"2023-12-24T19:59:25.247144+0000","last_clean":"2023-12-24T19:59:25.247144+0000","last_became_active":"2023-12-24T19:59:25.246932+0000","last_became_peered":"2023-12-24T19:59:25.246932+0000","last_unstale":"2023-12-24T19:59:25.247144+0000","last_undegraded":"2023-12-24T19:59:25.247144+0000","last_fullsized":"2023-12-24T19:59:25.247144+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:14:13.484623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.217137+0000","last_change":"2023-12-24T19:59:24.217058+0000","last_active":"2023-12-24T19:59:24.217137+0000","last_peered":"2023-12-24T19:59:24.217137+0000","last_clean":"2023-12-24T19:59:24.217137+0000","last_became_active":"2023-12-24T19:59:24.216834+0000","last_became_peered":"2023-12-24T19:59:24.216834+0000","last_unstale":"2023-12-24T19:59:24.217137+0000","last_undegraded":"2023-12-24T19:59:24.217137+0000","last_fullsized":"2023-12-24T19:59:24.217137+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:11.773057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.251970+0000","last_change":"2023-12-24T19:59:25.251970+0000","last_active":"2023-12-24T19:59:25.251970+0000","last_peered":"2023-12-24T19:59:25.251970+0000","last_clean":"2023-12-24T19:59:25.251970+0000","last_became_active":"2023-12-24T19:59:25.251724+0000","last_became_peered":"2023-12-24T19:59:25.251724+0000","last_unstale":"2023-12-24T19:59:25.251970+0000","last_undegraded":"2023-12-24T19:59:25.251970+0000","last_fullsized":"2023-12-24T19:59:25.251970+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:12:01.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"61'2","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.255363+0000","last_change":"2023-12-24T19:59:24.214696+0000","last_active":"2023-12-24T19:59:25.255363+0000","last_peered":"2023-12-24T19:59:25.255363+0000","last_clean":"2023-12-24T19:59:25.255363+0000","last_became_active":"2023-12-24T19:59:24.214424+0000","last_became_peered":"2023-12-24T19:59:24.214424+0000","last_unstale":"2023-12-24T19:59:25.255363+0000","last_undegraded":"2023-12-24T19:59:25.255363+0000","last_fullsized":"2023-12-24T19:59:25.255363+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:33:07.365321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.250859+0000","last_change":"2023-12-24T19:59:25.250859+0000","last_active":"2023-12-24T19:59:25.250859+0000","last_peered":"2023-12-24T19:59:25.250859+0000","last_clean":"2023-12-24T19:59:25.250859+0000","last_became_active":"2023-12-24T19:59:25.250385+0000","last_became_peered":"2023-12-24T19:59:25.250385+0000","last_unstale":"2023-12-24T19:59:25.250859+0000","last_undegraded":"2023-12-24T19:59:25.250859+0000","last_fullsized":"2023-12-24T19:59:25.250859+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:37.112966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.222540+0000","last_change":"2023-12-24T19:59:24.222400+0000","last_active":"2023-12-24T19:59:24.222540+0000","last_peered":"2023-12-24T19:59:24.222540+0000","last_clean":"2023-12-24T19:59:24.222540+0000","last_became_active":"2023-12-24T19:59:24.221201+0000","last_became_peered":"2023-12-24T19:59:24.221201+0000","last_unstale":"2023-12-24T19:59:24.222540+0000","last_undegraded":"2023-12-24T19:59:24.222540+0000","last_fullsized":"2023-12-24T19:59:24.222540+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:09:52.607887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.245720+0000","last_change":"2023-12-24T19:59:25.245720+0000","last_active":"2023-12-24T19:59:25.245720+0000","last_peered":"2023-12-24T19:59:25.245720+0000","last_clean":"2023-12-24T19:59:25.245720+0000","last_became_active":"2023-12-24T19:59:25.245329+0000","last_became_peered":"2023-12-24T19:59:25.245329+0000","last_unstale":"2023-12-24T19:59:25.245720+0000","last_undegraded":"2023-12-24T19:59:25.245720+0000","last_fullsized":"2023-12-24T19:59:25.245720+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:27:12.779612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.221226+0000","last_change":"2023-12-24T19:59:24.221160+0000","last_active":"2023-12-24T19:59:24.221226+0000","last_peered":"2023-12-24T19:59:24.221226+0000","last_clean":"2023-12-24T19:59:24.221226+0000","last_became_active":"2023-12-24T19:59:24.220928+0000","last_became_peered":"2023-12-24T19:59:24.220928+0000","last_unstale":"2023-12-24T19:59:24.221226+0000","last_undegraded":"2023-12-24T19:59:24.221226+0000","last_fullsized":"2023-12-24T19:59:24.221226+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:33:07.365321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.241892+0000","last_change":"2023-12-24T19:59:25.241892+0000","last_active":"2023-12-24T19:59:25.241892+0000","last_peered":"2023-12-24T19:59:25.241892+0000","last_clean":"2023-12-24T19:59:25.241892+0000","last_became_active":"2023-12-24T19:59:25.241673+0000","last_became_peered":"2023-12-24T19:59:25.241673+0000","last_unstale":"2023-12-24T19:59:25.241892+0000","last_undegraded":"2023-12-24T19:59:25.241892+0000","last_fullsized":"2023-12-24T19:59:25.241892+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:50.339249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.221853+0000","last_change":"2023-12-24T19:59:24.221750+0000","last_active":"2023-12-24T19:59:24.221853+0000","last_peered":"2023-12-24T19:59:24.221853+0000","last_clean":"2023-12-24T19:59:24.221853+0000","last_became_active":"2023-12-24T19:59:24.221288+0000","last_became_peered":"2023-12-24T19:59:24.221288+0000","last_unstale":"2023-12-24T19:59:24.221853+0000","last_undegraded":"2023-12-24T19:59:24.221853+0000","last_fullsized":"2023-12-24T19:59:24.221853+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:14:07.526192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.243057+0000","last_change":"2023-12-24T19:59:25.243057+0000","last_active":"2023-12-24T19:59:25.243057+0000","last_peered":"2023-12-24T19:59:25.243057+0000","last_clean":"2023-12-24T19:59:25.243057+0000","last_became_active":"2023-12-24T19:59:25.242079+0000","last_became_peered":"2023-12-24T19:59:25.242079+0000","last_unstale":"2023-12-24T19:59:25.243057+0000","last_undegraded":"2023-12-24T19:59:25.243057+0000","last_fullsized":"2023-12-24T19:59:25.243057+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:26.235877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.218491+0000","last_change":"2023-12-24T19:59:24.218341+0000","last_active":"2023-12-24T19:59:24.218491+0000","last_peered":"2023-12-24T19:59:24.218491+0000","last_clean":"2023-12-24T19:59:24.218491+0000","last_became_active":"2023-12-24T19:59:24.218011+0000","last_became_peered":"2023-12-24T19:59:24.218011+0000","last_unstale":"2023-12-24T19:59:24.218491+0000","last_undegraded":"2023-12-24T19:59:24.218491+0000","last_fullsized":"2023-12-24T19:59:24.218491+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:31:02.726601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.250596+0000","last_change":"2023-12-24T19:59:25.250596+0000","last_active":"2023-12-24T19:59:25.250596+0000","last_peered":"2023-12-24T19:59:25.250596+0000","last_clean":"2023-12-24T19:59:25.250596+0000","last_became_active":"2023-12-24T19:59:25.250077+0000","last_became_peered":"2023-12-24T19:59:25.250077+0000","last_unstale":"2023-12-24T19:59:25.250596+0000","last_undegraded":"2023-12-24T19:59:25.250596+0000","last_fullsized":"2023-12-24T19:59:25.250596+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:11:52.945057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.221077+0000","last_change":"2023-12-24T19:59:24.220815+0000","last_active":"2023-12-24T19:59:24.221077+0000","last_peered":"2023-12-24T19:59:24.221077+0000","last_clean":"2023-12-24T19:59:24.221077+0000","last_became_active":"2023-12-24T19:59:24.220377+0000","last_became_peered":"2023-12-24T19:59:24.220377+0000","last_unstale":"2023-12-24T19:59:24.221077+0000","last_undegraded":"2023-12-24T19:59:24.221077+0000","last_fullsized":"2023-12-24T19:59:24.221077+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:13.263190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.244711+0000","last_change":"2023-12-24T19:59:25.244711+0000","last_active":"2023-12-24T19:59:25.244711+0000","last_peered":"2023-12-24T19:59:25.244711+0000","last_clean":"2023-12-24T19:59:25.244711+0000","last_became_active":"2023-12-24T19:59:25.243983+0000","last_became_peered":"2023-12-24T19:59:25.243983+0000","last_unstale":"2023-12-24T19:59:25.244711+0000","last_undegraded":"2023-12-24T19:59:25.244711+0000","last_fullsized":"2023-12-24T19:59:25.244711+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:34:05.490185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.219294+0000","last_change":"2023-12-24T19:59:24.219232+0000","last_active":"2023-12-24T19:59:24.219294+0000","last_peered":"2023-12-24T19:59:24.219294+0000","last_clean":"2023-12-24T19:59:24.219294+0000","last_became_active":"2023-12-24T19:59:24.219004+0000","last_became_peered":"2023-12-24T19:59:24.219004+0000","last_unstale":"2023-12-24T19:59:24.219294+0000","last_undegraded":"2023-12-24T19:59:24.219294+0000","last_fullsized":"2023-12-24T19:59:24.219294+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:02.669204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.246549+0000","last_change":"2023-12-24T19:59:25.246549+0000","last_active":"2023-12-24T19:59:25.246549+0000","last_peered":"2023-12-24T19:59:25.246549+0000","last_clean":"2023-12-24T19:59:25.246549+0000","last_became_active":"2023-12-24T19:59:25.246030+0000","last_became_peered":"2023-12-24T19:59:25.246030+0000","last_unstale":"2023-12-24T19:59:25.246549+0000","last_undegraded":"2023-12-24T19:59:25.246549+0000","last_fullsized":"2023-12-24T19:59:25.246549+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:03:31.596771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.217194+0000","last_change":"2023-12-24T19:59:24.216741+0000","last_active":"2023-12-24T19:59:24.217194+0000","last_peered":"2023-12-24T19:59:24.217194+0000","last_clean":"2023-12-24T19:59:24.217194+0000","last_became_active":"2023-12-24T19:59:24.216091+0000","last_became_peered":"2023-12-24T19:59:24.216091+0000","last_unstale":"2023-12-24T19:59:24.217194+0000","last_undegraded":"2023-12-24T19:59:24.217194+0000","last_fullsized":"2023-12-24T19:59:24.217194+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:45:36.106411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-24T19:59:25.241077+0000","last_change":"2023-12-24T19:59:25.241077+0000","last_active":"2023-12-24T19:59:25.241077+0000","last_peered":"2023-12-24T19:59:25.241077+0000","last_clean":"2023-12-24T19:59:25.241077+0000","last_became_active":"2023-12-24T19:59:25.240849+0000","last_became_peered":"2023-12-24T19:59:25.240849+0000","last_unstale":"2023-12-24T19:59:25.241077+0000","last_undegraded":"2023-12-24T19:59:25.241077+0000","last_fullsized":"2023-12-24T19:59:25.241077+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:24.203987+0000","last_clean_scrub_stamp":"2023-12-24T19:59:24.203987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:50:35.300918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.219685+0000","last_change":"2023-12-24T19:59:24.219623+0000","last_active":"2023-12-24T19:59:24.219685+0000","last_peered":"2023-12-24T19:59:24.219685+0000","last_clean":"2023-12-24T19:59:24.219685+0000","last_became_active":"2023-12-24T19:59:24.219387+0000","last_became_peered":"2023-12-24T19:59:24.219387+0000","last_unstale":"2023-12-24T19:59:24.219685+0000","last_undegraded":"2023-12-24T19:59:24.219685+0000","last_fullsized":"2023-12-24T19:59:24.219685+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:59:23.197432+0000","last_clean_scrub_stamp":"2023-12-24T19:59:23.197432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:15.809685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-24T19:59:24.216356+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T19:59:24.216356+0000","last_peered":"2023-12-24T19:59:24.216356+0000","last_clean":"2023-12-24T19:59:24.216356+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T19:59:24.216356+0000","last_undegraded":"2023-12-24T19:59:24.216356+0000","last_fullsized":"2023-12-24T19:59:24.216356+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":871,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194441,"statfs":{"total":200000000,"available":199107650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.67900000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.41699999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.56000000000000005}]},{"osd":1,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.71199999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.432,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.73799999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79300000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.626,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.82199999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61699999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53400000000000003,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.33100000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77100000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56000000000000005,"15min":0.56100000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Dec 24 19:58:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.871,"5min":0.873,"15min":0.873},"last":0.72999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.73399999999999999,"5min":0.753,"15min":0.753},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51700000000000002,"15min":0.51100000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69899999999999995,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51300000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.65000000000000002}]},{"osd":4,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.46500000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.751,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.629}]},{"osd":5,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.39400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.502},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79200000000000004,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.215,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.49399999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56499999999999995,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.316}]},{"osd":2,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.25900000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36599999999999999,"15min":0.36299999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28799999999999998}]},{"osd":3,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.39100000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.42899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63900000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.626},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59499999999999997,"15min":0.59199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.439,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.65300000000000002}]},{"osd":7,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63400000000000001,"15min":0.63300000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":871,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194441,"statfs":{"total":200000000,"available":199107650,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.42599999999999999,"15min":0.44700000000000001},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.41999999999999998,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.254},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.35999999999999999,"15min":0.36499999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.50900000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.27900000000000003}]},{"osd":2,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.35599999999999998,"15min":0.36499999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.41899999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.49299999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.32000000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55300000000000005,"5min":2.573,"15min":2.573},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41599999999999998,"15min":0.41999999999999998},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.56200000000000006,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.307}]},{"osd":4,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.68000000000000005,"15min":0.69799999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.4810000000000001,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.621},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.67300000000000004}]},{"osd":6,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84099999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64400000000000002}]},{"osd":7,"last update":"Sun Dec 24 19:58:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.556,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.66100000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.373,"15min":0.375},"min":{"1min":0.23799999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.59699999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.45000000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.371}]},{"osd":1,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.625,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.5},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.504,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.41599999999999998,"15min":0.41799999999999998},"min":{"1min":0.29999999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90000000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58199999999999996}]},{"osd":5,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.64300000000000002,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":3.577,"5min":3.577,"15min":3.577},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.69199999999999995,"15min":0.66300000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.0220000000000002,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.64200000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.84199999999999997,"5min":1.04,"15min":1.04},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.65300000000000002,"15min":0.63300000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.637,"5min":3.637,"15min":3.637},"last":0.63200000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:58:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":7.0599999999999996,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68700000000000006,"15min":0.68600000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.31900000000000001},"min":{"1min":0.20100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.253,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.52200000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.23699999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34100000000000003,"15min":0.33900000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.504,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.373,"15min":0.376},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.26600000000000001}]},{"osd":2,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57399999999999995,"5min":0.626,"15min":0.626},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.378}]},{"osd":4,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.39100000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.59199999999999997}]},{"osd":5,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92800000000000005,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.439,"5min":0.434,"15min":0.434},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60799999999999998,"15min":0.60699999999999998},"min":{"1min":0.47999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83399999999999996,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.627,"15min":0.63100000000000001},"min":{"1min":0.46400000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84599999999999997,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77500000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.627}]},{"osd":1,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.39400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.76000000000000001,"5min":4.883,"15min":4.883},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":1.544,"15min":1.544},"last":0.47199999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78400000000000003,"5min":0.88,"15min":0.88},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70399999999999996,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.56499999999999995}]},{"osd":3,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.92200000000000004,"15min":0.97999999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73199999999999998,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.314,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72499999999999998,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.66300000000000003,"15min":0.68500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77400000000000002,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.55100000000000005}]},{"osd":6,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.64100000000000001,"15min":0.65300000000000002},"min":{"1min":0.36099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":1.1200000000000001,"15min":1.2150000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80500000000000005,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.71999999999999997,"5min":0.751,"15min":0.751},"last":0.57799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":294,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195017,"statfs":{"total":200000000,"available":199698018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.502,"15min":0.5},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.56899999999999995,"15min":0.54200000000000004},"min":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.6059999999999999,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.47799999999999998}]},{"osd":1,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.501},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.57999999999999996,"15min":0.55600000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":3.8559999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.53400000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.66000000000000003}]},{"osd":3,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.58099999999999996,"15min":0.56200000000000006},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.38},"max":{"1min":3.2850000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73399999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.499,"15min":0.495},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.54800000000000004,"15min":0.52300000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":4.5330000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.52700000000000002}]},{"osd":6,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.626},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Dec 24 19:58:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.57599999999999996,"15min":0.55300000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.766,"5min":3.766,"15min":3.766},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.70299999999999996}]}]}],"pool_statfs":[]}} 2023-12-24T19:59:29.762 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T19:59:29.762 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T19:59:29.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.927+0000 7f9a0f831700 1 Processor -- start 2023-12-24T19:59:29.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.927+0000 7f9a0f831700 1 -- start start 2023-12-24T19:59:29.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f9a0f831700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a0806af80 0x7f9a080c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f9a0f831700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a080c3460 0x7f9a080c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f9a0f831700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0806aaf0 con 0x7f9a08156b60 2023-12-24T19:59:29.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f9a0f831700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a080c38e0 con 0x7f9a0806af80 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f9a0f831700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08069c00 con 0x7f9a080c3460 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f9a0d5cd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9a08156b60 0x7f9a08067f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:52934/0 (socket says 172.21.15.61:52934) 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f9a0d5cd700 1 -- 172.21.15.61:0/3858950147 learned_addr learned my addr 172.21.15.61:0/3858950147 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f9a0ddce700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a080c3460 0x7f9a080c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f9a0cdcc700 1 --2- 172.21.15.61:0/3858950147 >> v2:172.21.15.133:3300/0 conn(0x7f9a0806af80 0x7f9a080c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633414044 0 0) 0x7f9a0806aaf0 con 0x7f9a08156b60 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.928+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f4003570 con 0x7f9a08156b60 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1902050627 0 0) 0x7f99f4003570 con 0x7f9a08156b60 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a080c3460 msgr2=0x7f9a080c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a080c3460 0x7f9a080c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 >> v2:172.21.15.133:3300/0 conn(0x7f9a0806af80 msgr2=0x7f9a080c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 --2- 172.21.15.61:0/3858950147 >> v2:172.21.15.133:3300/0 conn(0x7f9a0806af80 0x7f9a080c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08069ee0 con 0x7f9a08156b60 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f99f8001470 con 0x7f9a08156b60 2023-12-24T19:59:29.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 >> v1:172.21.15.61:6789/0 conn(0x7f9a08156b60 legacy=0x7f9a08067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a080c3460 0x7f99f4003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99f40040b0 0x7f99f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f4004d50 0x7f99f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080c38e0 con 0x7f99f40040b0 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08069c00 con 0x7f99f4004d50 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f400dd70 con 0x7f9a080c3460 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f9a0cdcc700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99f40040b0 0x7f99f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f9a0d5cd700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a080c3460 0x7f99f4003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f9a0ddce700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f4004d50 0x7f99f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f9a0cdcc700 1 -- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a080c3460 msgr2=0x7f99f4003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f9a0cdcc700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9a080c3460 0x7f99f4003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f9a0cdcc700 1 -- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f4004d50 msgr2=0x7f99f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f9a0cdcc700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f4004d50 0x7f99f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f9a0cdcc700 1 -- 172.21.15.61:0/3858950147 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4003570 con 0x7f99f40040b0 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f9a0ddce700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f4004d50 0x7f99f40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f9a0cdcc700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99f40040b0 0x7f99f4004810 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9a04006f00 tx=0x7f9a040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c79e8007d09e26 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400e710 con 0x7f99f40040b0 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0400e870 con 0x7f99f40040b0 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.929+0000 7f99fffff700 1 -- 172.21.15.61:0/3858950147 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400ec30 con 0x7f99f40040b0 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.930+0000 7f9a0f831700 1 -- 172.21.15.61:0/3858950147 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99f40040b0 msgr2=0x7f99f4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.930+0000 7f9a0f831700 1 --2- 172.21.15.61:0/3858950147 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99f40040b0 0x7f99f4004810 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9a04006f00 tx=0x7f9a040091a0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.930+0000 7f9a0ddce700 1 -- 172.21.15.61:0/3858950147 reap_dead start 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.930+0000 7f9a0f831700 1 -- 172.21.15.61:0/3858950147 shutdown_connections 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.930+0000 7f9a0f831700 1 -- 172.21.15.61:0/3858950147 >> 172.21.15.61:0/3858950147 conn(0x7f9a080ce420 msgr2=0x7f9a080ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.930+0000 7f9a0f831700 1 -- 172.21.15.61:0/3858950147 shutdown_connections 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.930+0000 7f9a0f831700 1 -- 172.21.15.61:0/3858950147 wait complete. 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.931+0000 7f9a0f831700 1 Processor -- start 2023-12-24T19:59:29.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.931+0000 7f9a0f831700 1 -- start start 2023-12-24T19:59:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0f831700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f40040b0 0x7f9a08147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0f831700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08165d20 0x7f9a080c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0f831700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9a080c59c0 0x7f9a080cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0f831700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08158420 con 0x7f9a080c59c0 2023-12-24T19:59:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0f831700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08158700 con 0x7f9a08165d20 2023-12-24T19:59:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0f831700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a081589e0 con 0x7f99f40040b0 2023-12-24T19:59:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0ddce700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9a080c59c0 0x7f9a080cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0ddce700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9a080c59c0 0x7f9a080cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41510/0 (socket says 172.21.15.61:41510) 2023-12-24T19:59:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0ddce700 1 -- 172.21.15.61:0/3441240792 learned_addr learned my addr 172.21.15.61:0/3441240792 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0d5cd700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f40040b0 0x7f9a08147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0ddce700 1 -- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f40040b0 msgr2=0x7f9a08147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0ddce700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f40040b0 0x7f9a08147270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0ddce700 1 -- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08165d20 msgr2=0x7f9a080c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0ddce700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08165d20 0x7f9a080c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.932+0000 7f9a0ddce700 1 -- 172.21.15.61:0/3441240792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08158cc0 con 0x7f9a080c59c0 2023-12-24T19:59:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.933+0000 7f9a0ddce700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9a080c59c0 0x7f9a080cbb10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9a0806cef0 tx=0x7f9a0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.933+0000 7f99fd7fa700 1 -- 172.21.15.61:0/3441240792 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0001b070 con 0x7f9a080c59c0 2023-12-24T19:59:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.933+0000 7f99fd7fa700 1 -- 172.21.15.61:0/3441240792 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0000f040 con 0x7f9a080c59c0 2023-12-24T19:59:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.933+0000 7f9a0f831700 1 -- 172.21.15.61:0/3441240792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a08158fa0 con 0x7f9a080c59c0 2023-12-24T19:59:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.933+0000 7f99fd7fa700 1 -- 172.21.15.61:0/3441240792 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0000e050 con 0x7f9a080c59c0 2023-12-24T19:59:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.933+0000 7f9a0f831700 1 -- 172.21.15.61:0/3441240792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a08166170 con 0x7f9a080c59c0 2023-12-24T19:59:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.934+0000 7f9a0f831700 1 -- 172.21.15.61:0/3441240792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0804c3c0 con 0x7f9a080c59c0 2023-12-24T19:59:29.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.934+0000 7f99fd7fa700 1 -- 172.21.15.61:0/3441240792 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9a00003020 con 0x7f9a080c59c0 2023-12-24T19:59:29.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.935+0000 7f99fd7fa700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f99ec066f30 0x7f99ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:29.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.935+0000 7f99fd7fa700 1 -- 172.21.15.61:0/3441240792 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a000849e0 con 0x7f9a080c59c0 2023-12-24T19:59:29.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.935+0000 7f9a0d5cd700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f99ec066f30 0x7f99ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:29.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.935+0000 7f9a0d5cd700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f99ec066f30 0x7f99ec0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99f8001660 tx=0x7f99f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:29.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:29.939+0000 7f99fd7fa700 1 -- 172.21.15.61:0/3441240792 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a00051c50 con 0x7f9a080c59c0 2023-12-24T19:59:30.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.218+0000 7f9a0f831700 1 -- 172.21.15.61:0/3441240792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9a08159190 con 0x7f9a080c59c0 2023-12-24T19:59:30.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.222+0000 7f99fd7fa700 1 -- 172.21.15.61:0/3441240792 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9a00010ea0 con 0x7f9a080c59c0 2023-12-24T19:59:30.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.224+0000 7f9a0f831700 1 -- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f99ec066f30 msgr2=0x7f99ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:30.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.224+0000 7f9a0f831700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f99ec066f30 0x7f99ec0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99f8001660 tx=0x7f99f8009040 comp rx=0 tx=0).stop 2023-12-24T19:59:30.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.224+0000 7f9a0f831700 1 -- 172.21.15.61:0/3441240792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9a080c59c0 msgr2=0x7f9a080cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:30.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.224+0000 7f9a0f831700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9a080c59c0 0x7f9a080cbb10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9a0806cef0 tx=0x7f9a0000b040 comp rx=0 tx=0).stop 2023-12-24T19:59:30.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.224+0000 7f9a0f831700 1 -- 172.21.15.61:0/3441240792 shutdown_connections 2023-12-24T19:59:30.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.224+0000 7f9a0f831700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99f40040b0 0x7f9a08147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.224+0000 7f9a0f831700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f99ec066f30 0x7f99ec0693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.224+0000 7f9a0f831700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9a080c59c0 0x7f9a080cbb10 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.225+0000 7f9a0f831700 1 --2- 172.21.15.61:0/3441240792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a08165d20 0x7f9a080c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.225+0000 7f9a0f831700 1 -- 172.21.15.61:0/3441240792 >> 172.21.15.61:0/3441240792 conn(0x7f9a080ce420 msgr2=0x7f9a080c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:30.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.225+0000 7f9a0f831700 1 -- 172.21.15.61:0/3441240792 shutdown_connections 2023-12-24T19:59:30.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.225+0000 7f9a0f831700 1 -- 172.21.15.61:0/3441240792 wait complete. 2023-12-24T19:59:30.226 INFO:teuthology.orchestra.run.smithi061.stderr:updated caps for client.0 2023-12-24T19:59:30.238 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:59:30.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.360+0000 7f71758e0700 1 Processor -- start 2023-12-24T19:59:30.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.360+0000 7f71758e0700 1 -- start start 2023-12-24T19:59:30.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.361+0000 7f71758e0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7170068140 0x7f71700cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:30.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.361+0000 7f71758e0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7170068510 0x7f71700b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:30.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.361+0000 7f71758e0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71700b2890 con 0x7f7170159a60 2023-12-24T19:59:30.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.361+0000 7f71758e0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71700b11e0 con 0x7f7170068510 2023-12-24T19:59:30.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.361+0000 7f71758e0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71700cf630 con 0x7f7170068140 2023-12-24T19:59:30.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.361+0000 7f716e7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7170068510 0x7f71700b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:30.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.361+0000 7f716e7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7170068510 0x7f71700b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41522/0 (socket says 172.21.15.61:41522) 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.361+0000 7f716e7fc700 1 -- 172.21.15.61:0/1861693724 learned_addr learned my addr 172.21.15.61:0/1861693724 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f716effd700 1 --2- 172.21.15.61:0/1861693724 >> v2:172.21.15.133:3300/0 conn(0x7f7170068140 0x7f71700cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f716e7fc700 1 -- 172.21.15.61:0/1861693724 >> v2:172.21.15.133:3300/0 conn(0x7f7170068140 msgr2=0x7f71700cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f716e7fc700 1 --2- 172.21.15.61:0/1861693724 >> v2:172.21.15.133:3300/0 conn(0x7f7170068140 0x7f71700cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f716e7fc700 1 -- 172.21.15.61:0/1861693724 >> v1:172.21.15.133:6789/0 conn(0x7f7170159a60 legacy=0x7f7170159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f716e7fc700 1 -- 172.21.15.61:0/1861693724 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700b2240 con 0x7f7170068510 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f716effd700 1 --2- 172.21.15.61:0/1861693724 >> v2:172.21.15.133:3300/0 conn(0x7f7170068140 0x7f71700cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f716e7fc700 1 --2- 172.21.15.61:0/1861693724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170068510 0x7f71700b0ca0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f717006e290 tx=0x7f7160009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500b81ad06b05bb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f716dffb700 1 -- 172.21.15.61:0/1861693724 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716000b820 con 0x7f7170068510 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f716dffb700 1 -- 172.21.15.61:0/1861693724 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716000b980 con 0x7f7170068510 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f716dffb700 1 -- 172.21.15.61:0/1861693724 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716000bd20 con 0x7f7170068510 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f71758e0700 1 -- 172.21.15.61:0/1861693724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170068510 msgr2=0x7f71700b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.362+0000 7f71758e0700 1 --2- 172.21.15.61:0/1861693724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170068510 0x7f71700b0ca0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f717006e290 tx=0x7f7160009250 comp rx=0 tx=0).stop 2023-12-24T19:59:30.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.363+0000 7f71758e0700 1 -- 172.21.15.61:0/1861693724 shutdown_connections 2023-12-24T19:59:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.363+0000 7f71758e0700 1 --2- 172.21.15.61:0/1861693724 >> v2:172.21.15.133:3300/0 conn(0x7f7170068140 0x7f71700cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.363+0000 7f71758e0700 1 --2- 172.21.15.61:0/1861693724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170068510 0x7f71700b0ca0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.363+0000 7f71758e0700 1 -- 172.21.15.61:0/1861693724 >> 172.21.15.61:0/1861693724 conn(0x7f7170097a10 msgr2=0x7f71700ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.363+0000 7f71758e0700 1 -- 172.21.15.61:0/1861693724 shutdown_connections 2023-12-24T19:59:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.363+0000 7f71758e0700 1 -- 172.21.15.61:0/1861693724 wait complete. 2023-12-24T19:59:30.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.364+0000 7f71758e0700 1 Processor -- start 2023-12-24T19:59:30.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.364+0000 7f71758e0700 1 -- start start 2023-12-24T19:59:30.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.365+0000 7f71758e0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7170068140 0x7f717009af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:30.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.365+0000 7f71758e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7170068510 0x7f717015c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:30.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.365+0000 7f71758e0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170159a60 0x7f717009bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:30.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.365+0000 7f71758e0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717009c4e0 con 0x7f7170159a60 2023-12-24T19:59:30.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.365+0000 7f71758e0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717009aac0 con 0x7f7170068510 2023-12-24T19:59:30.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.365+0000 7f71758e0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717015cfd0 con 0x7f7170068140 2023-12-24T19:59:30.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.365+0000 7f716f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170159a60 0x7f717009bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.365+0000 7f716f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170159a60 0x7f717009bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41536/0 (socket says 172.21.15.61:41536) 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f716f7fe700 1 -- 172.21.15.61:0/1230544116 learned_addr learned my addr 172.21.15.61:0/1230544116 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f716e7fc700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7170068510 0x7f717015c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f716effd700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7170068140 0x7f717009af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f716f7fe700 1 -- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7170068140 msgr2=0x7f717009af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f716f7fe700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7170068140 0x7f717009af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f716f7fe700 1 -- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7170068510 msgr2=0x7f717015c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f716f7fe700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7170068510 0x7f717015c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f716f7fe700 1 -- 172.21.15.61:0/1230544116 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600094f0 con 0x7f7170159a60 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f716f7fe700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170159a60 0x7f717009bfa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f716800bc30 tx=0x7f7168009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f7166ffd700 1 -- 172.21.15.61:0/1230544116 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716800c9b0 con 0x7f7170159a60 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f7166ffd700 1 -- 172.21.15.61:0/1230544116 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716800cb50 con 0x7f7170159a60 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f71758e0700 1 -- 172.21.15.61:0/1230544116 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717015d2b0 con 0x7f7170159a60 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f7166ffd700 1 -- 172.21.15.61:0/1230544116 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7168014410 con 0x7f7170159a60 2023-12-24T19:59:30.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.366+0000 7f71758e0700 1 -- 172.21.15.61:0/1230544116 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717009a750 con 0x7f7170159a60 2023-12-24T19:59:30.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.367+0000 7f71758e0700 1 -- 172.21.15.61:0/1230544116 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717006d440 con 0x7f7170159a60 2023-12-24T19:59:30.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.368+0000 7f7166ffd700 1 -- 172.21.15.61:0/1230544116 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f71680147c0 con 0x7f7170159a60 2023-12-24T19:59:30.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.368+0000 7f7166ffd700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7150066f30 0x7f71500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.368+0000 7f7166ffd700 1 -- 172.21.15.61:0/1230544116 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71680845d0 con 0x7f7170159a60 2023-12-24T19:59:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.368+0000 7f716effd700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7150066f30 0x7f71500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.369+0000 7f716effd700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7150066f30 0x7f71500693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f715800ab80 tx=0x7f7158008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:30.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.372+0000 7f7166ffd700 1 -- 172.21.15.61:0/1230544116 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f716804c5a0 con 0x7f7170159a60 2023-12-24T19:59:30.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.613+0000 7f71758e0700 1 -- 172.21.15.61:0/1230544116 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f717004c3c0 con 0x7f7170159a60 2023-12-24T19:59:30.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.613+0000 7f7166ffd700 1 -- 172.21.15.61:0/1230544116 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f7168051840 con 0x7f7170159a60 2023-12-24T19:59:30.614 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:30.615 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2177201507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2177201507},{"type":"v1","addr":"172.21.15.61:6835","nonce":2177201507}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1435257239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1435257239},{"type":"v1","addr":"172.21.15.133:6837","nonce":1435257239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/696274590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":696274590},{"type":"v1","addr":"172.21.15.133:6836","nonce":696274590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:59:24.619081+0000","modified":"2023-12-24T19:59:28.258285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/3751369981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3751369981},{"type":"v1","addr":"172.21.15.61:6834","nonce":3751369981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T19:59:30.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 -- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7150066f30 msgr2=0x7f71500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:30.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7150066f30 0x7f71500693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f715800ab80 tx=0x7f7158008040 comp rx=0 tx=0).stop 2023-12-24T19:59:30.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 -- 172.21.15.61:0/1230544116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170159a60 msgr2=0x7f717009bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:30.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170159a60 0x7f717009bfa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f716800bc30 tx=0x7f7168009820 comp rx=0 tx=0).stop 2023-12-24T19:59:30.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 -- 172.21.15.61:0/1230544116 shutdown_connections 2023-12-24T19:59:30.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7170068140 0x7f717009af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7150066f30 0x7f71500693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7170159a60 0x7f717009bfa0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 --2- 172.21.15.61:0/1230544116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7170068510 0x7f717015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:30.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 -- 172.21.15.61:0/1230544116 >> 172.21.15.61:0/1230544116 conn(0x7f7170097a10 msgr2=0x7f7170157950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:30.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 -- 172.21.15.61:0/1230544116 shutdown_connections 2023-12-24T19:59:30.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:30.615+0000 7f71758e0700 1 -- 172.21.15.61:0/1230544116 wait complete. 2023-12-24T19:59:30.617 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 35 2023-12-24T19:59:31.031 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T19:59:24.619081+0000', 'modified': '2023-12-24T19:59:28.258285+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5667': {'gid': 5667, 'name': 'a', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.61:6834/3751369981', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.61:6833', 'nonce': 3751369981}, {'type': 'v1', 'addr': '172.21.15.61:6834', 'nonce': 3751369981}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T19:59:31.031 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T19:59:31.031 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-24T19:59:31.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.157+0000 7f3564ca4700 1 Processor -- start 2023-12-24T19:59:31.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.157+0000 7f3564ca4700 1 -- start start 2023-12-24T19:59:31.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f3564ca4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f35600afe20 0x7f35601629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f3564ca4700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3560069b40 con 0x7f3560071230 2023-12-24T19:59:31.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f3564ca4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356006a3e0 con 0x7f3560157890 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f3564ca4700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35600c9e00 con 0x7f35600afe20 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f355ed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f35600afe20 0x7f35601629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f355dd9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3560071230 0x7f35600af710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:52944/0 (socket says 172.21.15.61:52944) 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f355dd9b700 1 -- 172.21.15.61:0/1983728169 learned_addr learned my addr 172.21.15.61:0/1983728169 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f355ed9d700 1 -- 172.21.15.61:0/1983728169 >> v1:172.21.15.133:6789/0 conn(0x7f3560157890 legacy=0x7f35600c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f355ed9d700 1 -- 172.21.15.61:0/1983728169 >> v1:172.21.15.61:6789/0 conn(0x7f3560071230 legacy=0x7f35600af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f355ed9d700 1 -- 172.21.15.61:0/1983728169 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3560069d90 con 0x7f35600afe20 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f355d59a700 1 -- 172.21.15.61:0/1983728169 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823763097 0 0) 0x7f3560069b40 con 0x7f3560071230 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f355ed9d700 1 --2- 172.21.15.61:0/1983728169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35600afe20 0x7f35601629b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3558009e60 tx=0x7f3558009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1cdfcf7ae04105 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.158+0000 7f355d59a700 1 -- 172.21.15.61:0/1983728169 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355800e070 con 0x7f35600afe20 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.159+0000 7f355d59a700 1 -- 172.21.15.61:0/1983728169 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355800bc30 con 0x7f35600afe20 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.159+0000 7f355d59a700 1 -- 172.21.15.61:0/1983728169 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558012430 con 0x7f35600afe20 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.159+0000 7f3564ca4700 1 -- 172.21.15.61:0/1983728169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35600afe20 msgr2=0x7f35601629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.159+0000 7f3564ca4700 1 --2- 172.21.15.61:0/1983728169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35600afe20 0x7f35601629b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3558009e60 tx=0x7f3558009780 comp rx=0 tx=0).stop 2023-12-24T19:59:31.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.159+0000 7f3564ca4700 1 -- 172.21.15.61:0/1983728169 shutdown_connections 2023-12-24T19:59:31.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.159+0000 7f3564ca4700 1 --2- 172.21.15.61:0/1983728169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35600afe20 0x7f35601629b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.159+0000 7f3564ca4700 1 -- 172.21.15.61:0/1983728169 >> 172.21.15.61:0/1983728169 conn(0x7f35600ce190 msgr2=0x7f35600ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:31.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.159+0000 7f3564ca4700 1 -- 172.21.15.61:0/1983728169 shutdown_connections 2023-12-24T19:59:31.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.159+0000 7f3564ca4700 1 -- 172.21.15.61:0/1983728169 wait complete. 2023-12-24T19:59:31.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.160+0000 7f3564ca4700 1 Processor -- start 2023-12-24T19:59:31.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.160+0000 7f3564ca4700 1 -- start start 2023-12-24T19:59:31.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f3564ca4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3560071230 0x7f3560146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f3564ca4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35600afe20 0x7f35600c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f3564ca4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3560157890 0x7f35600c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f3564ca4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560152ac0 con 0x7f3560071230 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f3564ca4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560146780 con 0x7f35600afe20 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f3564ca4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356016d7f0 con 0x7f3560157890 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f355e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3560071230 0x7f3560146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f355e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3560071230 0x7f3560146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41546/0 (socket says 172.21.15.61:41546) 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f355e59c700 1 -- 172.21.15.61:0/4188728051 learned_addr learned my addr 172.21.15.61:0/4188728051 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f355dd9b700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35600afe20 0x7f35600c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f355ed9d700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3560157890 0x7f35600c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f355e59c700 1 -- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3560157890 msgr2=0x7f35600c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f355e59c700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3560157890 0x7f35600c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f355e59c700 1 -- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35600afe20 msgr2=0x7f35600c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.161+0000 7f355e59c700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35600afe20 0x7f35600c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.162+0000 7f355e59c700 1 -- 172.21.15.61:0/4188728051 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558009a20 con 0x7f3560071230 2023-12-24T19:59:31.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.162+0000 7f355dd9b700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35600afe20 0x7f35600c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:31.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.162+0000 7f355e59c700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3560071230 0x7f3560146240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f355000c4e0 tx=0x7f355000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:31.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.162+0000 7f354e7fc700 1 -- 172.21.15.61:0/4188728051 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550011590 con 0x7f3560071230 2023-12-24T19:59:31.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.162+0000 7f354e7fc700 1 -- 172.21.15.61:0/4188728051 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3550011710 con 0x7f3560071230 2023-12-24T19:59:31.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.162+0000 7f3564ca4700 1 -- 172.21.15.61:0/4188728051 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356016dad0 con 0x7f3560071230 2023-12-24T19:59:31.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.162+0000 7f354e7fc700 1 -- 172.21.15.61:0/4188728051 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550011ad0 con 0x7f3560071230 2023-12-24T19:59:31.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.162+0000 7f3564ca4700 1 -- 172.21.15.61:0/4188728051 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356016e090 con 0x7f3560071230 2023-12-24T19:59:31.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.163+0000 7f354e7fc700 1 -- 172.21.15.61:0/4188728051 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f355001b3b0 con 0x7f3560071230 2023-12-24T19:59:31.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.164+0000 7f354e7fc700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3540066fb0 0x7f3540069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.164+0000 7f354e7fc700 1 -- 172.21.15.61:0/4188728051 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3550083b10 con 0x7f3560071230 2023-12-24T19:59:31.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.164+0000 7f355dd9b700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3540066fb0 0x7f3540069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.164+0000 7f355dd9b700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3540066fb0 0x7f3540069460 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f35601555c0 tx=0x7f3554009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:31.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f356dfa4b80 1 Processor -- start 2023-12-24T19:59:31.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f356dfa4b80 1 -- start start 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a69fa0 0x55f889a6a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a6a8b0 0x55f889a65c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889a86360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8899983e0 con 0x55f889a6a8b0 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889995be0 con 0x55f889a66170 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8899919d0 con 0x55f889a69fa0 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f355dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a6a8b0 0x55f889a65c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f355dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a6a8b0 0x55f889a65c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41562/0 (socket says 172.21.15.61:41562) 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f355dd9b700 1 -- 172.21.15.61:0/731428182 learned_addr learned my addr 172.21.15.61:0/731428182 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.166+0000 7f355e59c700 1 --2- 172.21.15.61:0/731428182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a69fa0 0x55f889a6a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.167+0000 7f355ed9d700 1 --2- 172.21.15.61:0/731428182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889a86360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.167+0000 7f355dd9b700 1 -- 172.21.15.61:0/731428182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a69fa0 msgr2=0x55f889a6a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.167+0000 7f355dd9b700 1 --2- 172.21.15.61:0/731428182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a69fa0 0x55f889a6a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.167+0000 7f355dd9b700 1 -- 172.21.15.61:0/731428182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 msgr2=0x55f889a86360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.167+0000 7f355dd9b700 1 --2- 172.21.15.61:0/731428182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889a86360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.167+0000 7f355dd9b700 1 -- 172.21.15.61:0/731428182 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f889825360 con 0x55f889a6a8b0 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.167+0000 7f355dd9b700 1 --2- 172.21.15.61:0/731428182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a6a8b0 0x55f889a65c30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3554005dc0 tx=0x7f3554012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ca1de663baa5b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.167+0000 7f353f7fe700 1 -- 172.21.15.61:0/731428182 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540077c0 con 0x55f889a6a8b0 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.167+0000 7f353f7fe700 1 -- 172.21.15.61:0/731428182 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355400d660 con 0x55f889a6a8b0 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.167+0000 7f353f7fe700 1 -- 172.21.15.61:0/731428182 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355400d9e0 con 0x55f889a6a8b0 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.168+0000 7f356dfa4b80 1 -- 172.21.15.61:0/731428182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a6a8b0 msgr2=0x55f889a65c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.168+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/731428182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a6a8b0 0x55f889a65c30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3554005dc0 tx=0x7f3554012000 comp rx=0 tx=0).stop 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.168+0000 7f356dfa4b80 1 -- 172.21.15.61:0/731428182 shutdown_connections 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.168+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/731428182 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a69fa0 0x55f889a6a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.168+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/731428182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889a86360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.168+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/731428182 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a6a8b0 0x55f889a65c30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.168+0000 7f356dfa4b80 1 -- 172.21.15.61:0/731428182 >> 172.21.15.61:0/731428182 conn(0x55f889a40440 msgr2=0x55f889a8bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:31.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.168+0000 7f356dfa4b80 1 -- 172.21.15.61:0/731428182 shutdown_connections 2023-12-24T19:59:31.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.168+0000 7f356dfa4b80 1 -- 172.21.15.61:0/731428182 wait complete. 2023-12-24T19:59:31.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.168+0000 7f356dfa4b80 1 -- start start 2023-12-24T19:59:31.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.169+0000 7f356dfa4b80 1 Processor -- start 2023-12-24T19:59:31.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.169+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a66170 0x55f889a69680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.169+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a69fa0 0x55f889a82dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.169+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a433e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.169+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88993e1b0 con 0x55f889a66170 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.169+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f88993de50 con 0x55f889a69fa0 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.169+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f88988ae40 con 0x55f889a6a8b0 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f356dfa4b80 10 client.0 _ll_register_callbacks cb 0x55f88988d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a66170 0x55f889a69680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a66170 0x55f889a69680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41564/0 (socket says 172.21.15.61:41564) 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355e59c700 1 -- 172.21.15.61:0/3937196851 learned_addr learned my addr 172.21.15.61:0/3937196851 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355ed9d700 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355dd9b700 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a69fa0 0x55f889a82dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355e59c700 1 -- 172.21.15.61:0/3937196851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 msgr2=0x55f889a433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355e59c700 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355e59c700 1 -- 172.21.15.61:0/3937196851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a69fa0 msgr2=0x55f889a82dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355e59c700 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a69fa0 0x55f889a82dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355e59c700 1 -- 172.21.15.61:0/3937196851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3554005920 con 0x55f889a66170 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355dd9b700 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a69fa0 0x55f889a82dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f355e59c700 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a66170 0x55f889a69680 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3550054930 tx=0x7f355000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e0d805638a4ba4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f353cff9700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f353cff9700 1 -- 172.21.15.61:0/3937196851 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355005b940 con 0x55f889a66170 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f353cff9700 1 -- 172.21.15.61:0/3937196851 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3550011e80 con 0x55f889a66170 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f356dfa4b80 1 -- 172.21.15.61:0/3937196851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f889a12eb0 con 0x55f889a66170 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f353cff9700 1 -- 172.21.15.61:0/3937196851 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35500540a0 con 0x55f889a66170 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f356dfa4b80 10 client.5805 fetch_fsmap learned FSMap version 35 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f356dfa4b80 1 -- 172.21.15.61:0/3937196851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55f8897d1b10 con 0x55f889a66170 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.170+0000 7f353cff9700 1 -- 172.21.15.61:0/3937196851 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355005f070 con 0x55f889a66170 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.171+0000 7f353cff9700 1 -- 172.21.15.61:0/3937196851 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f355005b4b0 con 0x55f889a66170 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.171+0000 7f356dfa4b80 10 client.5805 fetch_fsmap finished waiting for FSMap version 35 2023-12-24T19:59:31.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.171+0000 7f356dfa4b80 10 client.5805 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.171+0000 7f356dfa4b80 20 client.5805 populate_metadata read hostname 'smithi061' 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.171+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.61:6833/3751369981,v1:172.21.15.61:6834/3751369981] conn(0x55f889a81f20 0x55f889a822f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.171+0000 7f356dfa4b80 4 client.5805 mds_command: new command op to 5667 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.171+0000 7f356dfa4b80 1 -- 172.21.15.61:0/3937196851 --> [v2:172.21.15.61:6833/3751369981,v1:172.21.15.61:6834/3751369981] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f889968880 con 0x55f889a81f20 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.171+0000 7f355dd9b700 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.61:6833/3751369981,v1:172.21.15.61:6834/3751369981] conn(0x55f889a81f20 0x55f889a822f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.171+0000 7f353cff9700 10 client.5805 ms_handle_connect on v2:172.21.15.61:6833/3751369981 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.171+0000 7f355dd9b700 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.61:6833/3751369981,v1:172.21.15.61:6834/3751369981] conn(0x55f889a81f20 0x55f889a822f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed22e68868124256 server_cookie=46831466f555e9b3 in_seq=0 out_seq=0 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f353cff9700 1 -- 172.21.15.61:0/3937196851 <== mds.0 v2:172.21.15.61:6833/3751369981 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f889968880 con 0x55f889a81f20 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f353cff9700 10 client.5805 handle_command_reply: tid=0 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 client.5805 shutdown 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 -- 172.21.15.61:0/3937196851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a66170 msgr2=0x55f889a69680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a66170 0x55f889a69680 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3550054930 tx=0x7f355000a000 comp rx=0 tx=0).stop 2023-12-24T19:59:31.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 -- 172.21.15.61:0/3937196851 shutdown_connections 2023-12-24T19:59:31.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.61:6833/3751369981,v1:172.21.15.61:6834/3751369981] conn(0x55f889a81f20 0x55f889a822f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a66170 0x55f889a69680 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f353cff9700 0 client.5805 ms_handle_reset on v2:172.21.15.61:6833/3751369981 2023-12-24T19:59:31.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/3937196851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a69fa0 0x55f889a82dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 -- 172.21.15.61:0/3937196851 >> 172.21.15.61:0/3937196851 conn(0x55f889a40440 msgr2=0x55f889a40810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:31.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 -- 172.21.15.61:0/3937196851 shutdown_connections 2023-12-24T19:59:31.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 1 -- 172.21.15.61:0/3937196851 wait complete. 2023-12-24T19:59:31.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.172+0000 7f356dfa4b80 20 client.5805 trim_cache size 0 max 16384 2023-12-24T19:59:31.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.189+0000 7f356dfa4b80 1 Processor -- start 2023-12-24T19:59:31.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.189+0000 7f356dfa4b80 1 -- start start 2023-12-24T19:59:31.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889a3eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a387d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a41dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889a84650 con 0x55f889a69fa0 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889a445a0 con 0x55f889a66170 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f889a6acc0 con 0x55f889a6a8b0 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f355dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f355dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41578/0 (socket says 172.21.15.61:41578) 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f355dd9b700 1 -- 172.21.15.61:0/119056660 learned_addr learned my addr 172.21.15.61:0/119056660 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f355dd9b700 1 -- 172.21.15.61:0/119056660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 msgr2=0x55f889a41dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f355ed9d700 1 --2- 172.21.15.61:0/119056660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a41dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f355dd9b700 1 --2- 172.21.15.61:0/119056660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a41dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f355dd9b700 1 -- 172.21.15.61:0/119056660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 msgr2=0x55f889a3eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f355e59c700 1 --2- 172.21.15.61:0/119056660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889a3eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f355dd9b700 1 --2- 172.21.15.61:0/119056660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889a3eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.190+0000 7f355dd9b700 1 -- 172.21.15.61:0/119056660 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f889a7f5a0 con 0x55f889a69fa0 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f355dd9b700 1 --2- 172.21.15.61:0/119056660 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a387d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3554019000 tx=0x7f3554025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bd84bd79b6b4cc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f353ffff700 1 -- 172.21.15.61:0/119056660 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540015a0 con 0x55f889a69fa0 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f353ffff700 1 -- 172.21.15.61:0/119056660 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3554032070 con 0x55f889a69fa0 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f353ffff700 1 -- 172.21.15.61:0/119056660 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355400dd90 con 0x55f889a69fa0 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f356dfa4b80 1 -- 172.21.15.61:0/119056660 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 msgr2=0x55f889a387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/119056660 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a387d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3554019000 tx=0x7f3554025040 comp rx=0 tx=0).stop 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f356dfa4b80 1 -- 172.21.15.61:0/119056660 shutdown_connections 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/119056660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a41dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/119056660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889a3eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/119056660 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a387d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f356dfa4b80 1 -- 172.21.15.61:0/119056660 >> 172.21.15.61:0/119056660 conn(0x55f889a40440 msgr2=0x55f889a37700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f356dfa4b80 1 -- 172.21.15.61:0/119056660 shutdown_connections 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.191+0000 7f356dfa4b80 1 -- 172.21.15.61:0/119056660 wait complete. 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.192+0000 7f356dfa4b80 1 -- start start 2023-12-24T19:59:31.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.192+0000 7f356dfa4b80 1 Processor -- start 2023-12-24T19:59:31.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889ae7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a8c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f356dfa4b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a41dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889a3e970 con 0x55f889a69fa0 2023-12-24T19:59:31.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889a6f180 con 0x55f889a66170 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f356dfa4b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f889a987e0 con 0x55f889a6a8b0 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f356dfa4b80 10 client.0 _ll_register_callbacks cb 0x7f35500550a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f355dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a8c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f355dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a8c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41586/0 (socket says 172.21.15.61:41586) 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f355dd9b700 1 -- 172.21.15.61:0/870015629 learned_addr learned my addr 172.21.15.61:0/870015629 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f355e59c700 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889ae7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f355ed9d700 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a41dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f355dd9b700 1 -- 172.21.15.61:0/870015629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 msgr2=0x55f889a41dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f355dd9b700 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a41dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f355dd9b700 1 -- 172.21.15.61:0/870015629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 msgr2=0x55f889ae7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f355dd9b700 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889ae7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.193+0000 7f355dd9b700 1 -- 172.21.15.61:0/870015629 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f889825360 con 0x55f889a69fa0 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f355dd9b700 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a8c780 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x55f889a8bd90 tx=0x7f3554030070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1176b2ae49bf4582 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f353cff9700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f353cff9700 1 -- 172.21.15.61:0/870015629 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554007790 con 0x55f889a69fa0 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f353cff9700 1 -- 172.21.15.61:0/870015629 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f355400d660 con 0x55f889a69fa0 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f356dfa4b80 1 -- 172.21.15.61:0/870015629 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f889a36490 con 0x55f889a69fa0 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f353cff9700 1 -- 172.21.15.61:0/870015629 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3554021460 con 0x55f889a69fa0 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f356dfa4b80 10 client.5811 fetch_fsmap learned FSMap version 35 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f356dfa4b80 1 -- 172.21.15.61:0/870015629 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55f889960290 con 0x55f889a69fa0 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f353cff9700 1 -- 172.21.15.61:0/870015629 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f889a36490 con 0x55f889a69fa0 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f353cff9700 1 -- 172.21.15.61:0/870015629 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f35540215c0 con 0x55f889a69fa0 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f356dfa4b80 10 client.5811 fetch_fsmap finished waiting for FSMap version 35 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f356dfa4b80 10 client.5811 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f356dfa4b80 20 client.5811 populate_metadata read hostname 'smithi061' 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.61:6833/3751369981,v1:172.21.15.61:6834/3751369981] conn(0x55f889aed950 0x55f889aedd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f356dfa4b80 4 client.5811 mds_command: new command op to 5667 tid=0[{"prefix": "status"}] 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f356dfa4b80 1 -- 172.21.15.61:0/870015629 --> [v2:172.21.15.61:6833/3751369981,v1:172.21.15.61:6834/3751369981] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f889934910 con 0x55f889aed950 2023-12-24T19:59:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.194+0000 7f355e59c700 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.61:6833/3751369981,v1:172.21.15.61:6834/3751369981] conn(0x55f889aed950 0x55f889aedd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f353cff9700 10 client.5811 ms_handle_connect on v2:172.21.15.61:6833/3751369981 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f355e59c700 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.61:6833/3751369981,v1:172.21.15.61:6834/3751369981] conn(0x55f889aed950 0x55f889aedd20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84ffd141da095566 server_cookie=73d1726ba819d49e in_seq=0 out_seq=0 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f353cff9700 1 -- 172.21.15.61:0/870015629 <== mds.0 v2:172.21.15.61:6833/3751369981 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f889934910 con 0x55f889aed950 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f353cff9700 10 client.5811 handle_command_reply: tid=0 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 client.5811 shutdown 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 -- 172.21.15.61:0/870015629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 msgr2=0x55f889a8c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a8c780 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x55f889a8bd90 tx=0x7f3554030070 comp rx=0 tx=0).stop 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 -- 172.21.15.61:0/870015629 shutdown_connections 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.61:6833/3751369981,v1:172.21.15.61:6834/3751369981] conn(0x55f889aed950 0x55f889aedd20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55f889a6a8b0 0x55f889a41dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55f889a66170 0x55f889ae7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f353cff9700 0 client.5811 ms_handle_reset on v2:172.21.15.61:6833/3751369981 2023-12-24T19:59:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 --2- 172.21.15.61:0/870015629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55f889a69fa0 0x55f889a8c780 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 -- 172.21.15.61:0/870015629 >> 172.21.15.61:0/870015629 conn(0x55f889a40440 msgr2=0x55f889a87b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 -- 172.21.15.61:0/870015629 shutdown_connections 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 1 -- 172.21.15.61:0/870015629 wait complete. 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.195+0000 7f356dfa4b80 20 client.5811 trim_cache size 0 max 16384 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5667, 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T19:59:31.202 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T19:59:31.203 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 5.9494966089999997, 2023-12-24T19:59:31.203 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 35, 2023-12-24T19:59:31.203 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 62, 2023-12-24T19:59:31.203 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 62, 2023-12-24T19:59:31.203 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 10.884942339 2023-12-24T19:59:31.203 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 -- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3540066fb0 msgr2=0x7f3540069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3540066fb0 0x7f3540069460 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f35601555c0 tx=0x7f3554009040 comp rx=0 tx=0).stop 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 -- 172.21.15.61:0/4188728051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3560071230 msgr2=0x7f3560146240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3560071230 0x7f3560146240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f355000c4e0 tx=0x7f355000c8a0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 -- 172.21.15.61:0/4188728051 shutdown_connections 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3560157890 0x7f35600c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3540066fb0 0x7f3540069460 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3560071230 0x7f3560146240 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 --2- 172.21.15.61:0/4188728051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35600afe20 0x7f35600c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 -- 172.21.15.61:0/4188728051 >> 172.21.15.61:0/4188728051 conn(0x7f35600ce190 msgr2=0x7f3560153030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 -- 172.21.15.61:0/4188728051 shutdown_connections 2023-12-24T19:59:31.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.196+0000 7f3564ca4700 1 -- 172.21.15.61:0/4188728051 wait complete. 2023-12-24T19:59:31.208 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:59:31.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.329+0000 7f0937b4e700 1 Processor -- start 2023-12-24T19:59:31.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.330+0000 7f0937b4e700 1 -- start start 2023-12-24T19:59:31.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.330+0000 7f0937b4e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0930068140 0x7f09300cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.330+0000 7f0937b4e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 0x7f09300b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.330+0000 7f0937b4e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09300b2890 con 0x7f0930159a60 2023-12-24T19:59:31.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f0937b4e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09300b11e0 con 0x7f0930068140 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f0937b4e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09300cf630 con 0x7f0930068510 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09358ea700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0930068140 0x7f09300cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09358ea700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0930068140 0x7f09300cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41588/0 (socket says 172.21.15.61:41588) 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09358ea700 1 -- 172.21.15.61:0/2687878792 learned_addr learned my addr 172.21.15.61:0/2687878792 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09350e9700 1 --2- 172.21.15.61:0/2687878792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 0x7f09300b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09358ea700 1 -- 172.21.15.61:0/2687878792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 msgr2=0x7f09300b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09358ea700 1 --2- 172.21.15.61:0/2687878792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 0x7f09300b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09358ea700 1 -- 172.21.15.61:0/2687878792 >> v1:172.21.15.133:6789/0 conn(0x7f0930159a60 legacy=0x7f0930159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09358ea700 1 -- 172.21.15.61:0/2687878792 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300b2240 con 0x7f0930068140 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09350e9700 1 --2- 172.21.15.61:0/2687878792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 0x7f09300b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09358ea700 1 --2- 172.21.15.61:0/2687878792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 0x7f09300cefa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0920009990 tx=0x7f0920009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7158e0974249ba server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09348e8700 1 -- 172.21.15.61:0/2687878792 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920005c10 con 0x7f0930068140 2023-12-24T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09348e8700 1 -- 172.21.15.61:0/2687878792 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0920005d70 con 0x7f0930068140 2023-12-24T19:59:31.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.331+0000 7f09348e8700 1 -- 172.21.15.61:0/2687878792 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092000b860 con 0x7f0930068140 2023-12-24T19:59:31.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.332+0000 7f0937b4e700 1 -- 172.21.15.61:0/2687878792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 msgr2=0x7f09300cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.332+0000 7f0937b4e700 1 --2- 172.21.15.61:0/2687878792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 0x7f09300cefa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0920009990 tx=0x7f0920009220 comp rx=0 tx=0).stop 2023-12-24T19:59:31.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.332+0000 7f0937b4e700 1 -- 172.21.15.61:0/2687878792 shutdown_connections 2023-12-24T19:59:31.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.332+0000 7f0937b4e700 1 --2- 172.21.15.61:0/2687878792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 0x7f09300cefa0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.332+0000 7f0937b4e700 1 --2- 172.21.15.61:0/2687878792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 0x7f09300b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.332+0000 7f0937b4e700 1 -- 172.21.15.61:0/2687878792 >> 172.21.15.61:0/2687878792 conn(0x7f0930097a10 msgr2=0x7f09300ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:31.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.332+0000 7f0937b4e700 1 -- 172.21.15.61:0/2687878792 shutdown_connections 2023-12-24T19:59:31.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.332+0000 7f0937b4e700 1 -- 172.21.15.61:0/2687878792 wait complete. 2023-12-24T19:59:31.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.333+0000 7f0937b4e700 1 Processor -- start 2023-12-24T19:59:31.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.333+0000 7f0937b4e700 1 -- start start 2023-12-24T19:59:31.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f0937b4e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 0x7f093015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f0937b4e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 0x7f0930169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f0937b4e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0930159a60 0x7f093009b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f0937b4e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093009a470 con 0x7f0930068140 2023-12-24T19:59:31.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f0937b4e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093009a750 con 0x7f0930159a60 2023-12-24T19:59:31.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f0937b4e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093009aa30 con 0x7f0930068510 2023-12-24T19:59:31.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09358ea700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 0x7f093015b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09358ea700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 0x7f093015b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41602/0 (socket says 172.21.15.61:41602) 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09358ea700 1 -- 172.21.15.61:0/298813882 learned_addr learned my addr 172.21.15.61:0/298813882 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09360eb700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0930159a60 0x7f093009b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09350e9700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 0x7f0930169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09358ea700 1 -- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 msgr2=0x7f0930169e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09358ea700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 0x7f0930169e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09358ea700 1 -- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0930159a60 msgr2=0x7f093009b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09358ea700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0930159a60 0x7f093009b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09358ea700 1 -- 172.21.15.61:0/298813882 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0920009480 con 0x7f0930068140 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09350e9700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 0x7f0930169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.334+0000 7f09358ea700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 0x7f093015b8d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0920003080 tx=0x7f0920015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.335+0000 7f0925ffb700 1 -- 172.21.15.61:0/298813882 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920011920 con 0x7f0930068140 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.335+0000 7f0925ffb700 1 -- 172.21.15.61:0/298813882 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0920011aa0 con 0x7f0930068140 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.335+0000 7f0937b4e700 1 -- 172.21.15.61:0/298813882 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093009ad10 con 0x7f0930068140 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.335+0000 7f0925ffb700 1 -- 172.21.15.61:0/298813882 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920011e60 con 0x7f0930068140 2023-12-24T19:59:31.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.335+0000 7f0937b4e700 1 -- 172.21.15.61:0/298813882 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093015be10 con 0x7f0930068140 2023-12-24T19:59:31.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.336+0000 7f0937b4e700 1 -- 172.21.15.61:0/298813882 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093009b1b0 con 0x7f0930068140 2023-12-24T19:59:31.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.336+0000 7f0925ffb700 1 -- 172.21.15.61:0/298813882 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f092001d640 con 0x7f0930068140 2023-12-24T19:59:31.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.336+0000 7f0925ffb700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0914066f30 0x7f09140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:31.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.337+0000 7f0925ffb700 1 -- 172.21.15.61:0/298813882 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0920086770 con 0x7f0930068140 2023-12-24T19:59:31.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.337+0000 7f09350e9700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0914066f30 0x7f09140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:31.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.337+0000 7f09350e9700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0914066f30 0x7f09140693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f09300b1060 tx=0x7f092c006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.341+0000 7f0925ffb700 1 -- 172.21.15.61:0/298813882 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0920053940 con 0x7f0930068140 2023-12-24T19:59:31.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.584+0000 7f0937b4e700 1 -- 172.21.15.61:0/298813882 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f093006d440 con 0x7f0930068140 2023-12-24T19:59:31.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.584+0000 7f0925ffb700 1 -- 172.21.15.61:0/298813882 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0920056f60 con 0x7f0930068140 2023-12-24T19:59:31.585 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 -- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0914066f30 msgr2=0x7f09140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0914066f30 0x7f09140693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f09300b1060 tx=0x7f092c006f90 comp rx=0 tx=0).stop 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 -- 172.21.15.61:0/298813882 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 msgr2=0x7f093015b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 0x7f093015b8d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0920003080 tx=0x7f0920015000 comp rx=0 tx=0).stop 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 -- 172.21.15.61:0/298813882 shutdown_connections 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0914066f30 0x7f09140693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0930159a60 0x7f093009b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0930068140 0x7f093015b8d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 --2- 172.21.15.61:0/298813882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0930068510 0x7f0930169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 -- 172.21.15.61:0/298813882 >> 172.21.15.61:0/298813882 conn(0x7f0930097a10 msgr2=0x7f0930157950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 -- 172.21.15.61:0/298813882 shutdown_connections 2023-12-24T19:59:31.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:31.586+0000 7f0937b4e700 1 -- 172.21.15.61:0/298813882 wait complete. 2023-12-24T19:59:31.599 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T19:59:31.599 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:59:31.599 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T19:59:31.599 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T19:59:31.599 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T19:59:31.599 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T19:59:31.599 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T19:59:31.599 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:59:31.599 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:59:31.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:31.599 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T19:59:31.617 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:59:31.617 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:59:31.618 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42394sec preferred_lft 42394sec 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 12:83:d1:9f:62:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T19:59:31.619 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1083:d1ff:fe9f:62aa/64 scope link 2023-12-24T19:59:31.620 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:31.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:31.620 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:59:31.684 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T19:59:31.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:31.686 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T19:59:31.745 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T19:59:31.745 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:59:31.745 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T19:59:31.745 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T19:59:31.745 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:59:31.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:31.745 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T19:59:31.746 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T19:59:31.746 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T19:59:31.746 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T19:59:31.746 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T19:59:31.746 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T19:59:31.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:31.853 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T19:59:31.871 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T19:59:31.871 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T19:59:31.871 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:59:31.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:31.871 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T19:59:31.939 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T19:59:31.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:59:31.939 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T19:59:31.996 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T19:59:31.996 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:59:31.996 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:59:32.053 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T19:59:32.121 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:59:32.122 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:59:32.188 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:59:32.189 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:59:32.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:32.190 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T19:59:32.247 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T19:59:32.247 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T19:59:32.289 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T19:59:32.317 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:59:32.317 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:59:32.376 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T19:59:32.374+0000 7fbddbede540 -1 init, newargv = 0x56468889c880 newargc=15 2023-12-24T19:59:32.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[54903]: starting ceph client 2023-12-24T19:59:32.380 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[54903]: starting fuse 2023-12-24T19:59:32.386 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:59:32.387 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:59:32.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:32.388 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T19:59:32.445 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T19:59:32.445 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T19:59:32.446 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T19:59:32.447 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:59:32.571 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.54903.asok 2023-12-24T19:59:32.753 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54903.asok 2023-12-24T19:59:32.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:32.754 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54903.asok status 2023-12-24T19:59:32.910 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "54903", 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5823, 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T19:59:32.911 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 5823 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2964344210 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2964344210 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T19:59:32.912 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.5823 192.168.0.1:0/2964344210", 2023-12-24T19:59:32.913 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2964344210", 2023-12-24T19:59:32.913 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T19:59:32.913 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 35, 2023-12-24T19:59:32.913 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 62, 2023-12-24T19:59:32.913 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T19:59:32.913 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T19:59:32.913 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T19:59:32.913 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T19:59:32.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:32.921 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T19:59:32.921 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T19:59:32.939 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T19:59:32.939 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T19:59:32.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:32.939 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T19:59:33.009 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T19:59:33.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.169+0000 7f5ec25ad700 1 Processor -- start 2023-12-24T19:59:33.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.169+0000 7f5ec25ad700 1 -- start start 2023-12-24T19:59:33.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec25ad700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ebc15bb60 0x7f5ebc098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:33.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec25ad700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5ebc0b2660 0x7f5ebc0b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:33.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec25ad700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc0b2eb0 con 0x7f5ebc098aa0 2023-12-24T19:59:33.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec25ad700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ebc0afc20 con 0x7f5ebc0b2660 2023-12-24T19:59:33.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec25ad700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0b2bd0 con 0x7f5ebc15bb60 2023-12-24T19:59:33.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec0b4a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5ebc0b2660 0x7f5ebc0b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:33.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec0b4a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5ebc0b2660 0x7f5ebc0b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41604/0 (socket says 172.21.15.61:41604) 2023-12-24T19:59:33.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec0b4a700 1 -- 172.21.15.61:0/1528249580 learned_addr learned my addr 172.21.15.61:0/1528249580 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:33.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ebbfff700 1 --2- 172.21.15.61:0/1528249580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ebc15bb60 0x7f5ebc098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec0b4a700 1 -- 172.21.15.61:0/1528249580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ebc15bb60 msgr2=0x7f5ebc098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec0b4a700 1 --2- 172.21.15.61:0/1528249580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ebc15bb60 0x7f5ebc098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec0b4a700 1 -- 172.21.15.61:0/1528249580 >> v1:172.21.15.133:6789/0 conn(0x7f5ebc098aa0 legacy=0x7f5ebc15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.170+0000 7f5ec0b4a700 1 -- 172.21.15.61:0/1528249580 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc0afe10 con 0x7f5ebc0b2660 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ec0b4a700 1 --2- 172.21.15.61:0/1528249580 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc0b2660 0x7f5ebc0b08f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009f20 tx=0x7f5eb4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265e7092eae86e26 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ebaffd700 1 -- 172.21.15.61:0/1528249580 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400e070 con 0x7f5ebc0b2660 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ebaffd700 1 -- 172.21.15.61:0/1528249580 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb400b9d0 con 0x7f5ebc0b2660 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ebaffd700 1 -- 172.21.15.61:0/1528249580 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40092e0 con 0x7f5ebc0b2660 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1528249580 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc0b2660 msgr2=0x7f5ebc0b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ec25ad700 1 --2- 172.21.15.61:0/1528249580 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc0b2660 0x7f5ebc0b08f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009f20 tx=0x7f5eb4009840 comp rx=0 tx=0).stop 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1528249580 shutdown_connections 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ec25ad700 1 --2- 172.21.15.61:0/1528249580 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc0b2660 0x7f5ebc0b08f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ec25ad700 1 --2- 172.21.15.61:0/1528249580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ebc15bb60 0x7f5ebc098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1528249580 >> 172.21.15.61:0/1528249580 conn(0x7f5ebc097a10 msgr2=0x7f5ebc0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:33.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1528249580 shutdown_connections 2023-12-24T19:59:33.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.171+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1528249580 wait complete. 2023-12-24T19:59:33.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.172+0000 7f5ec25ad700 1 Processor -- start 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.173+0000 7f5ec25ad700 1 -- start start 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.173+0000 7f5ec25ad700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ebc098aa0 0x7f5ebc0c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.173+0000 7f5ec25ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ebc0b2660 0x7f5ebc155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.173+0000 7f5ec25ad700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc15bb60 0x7f5ebc16a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.173+0000 7f5ec25ad700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0ce210 con 0x7f5ebc15bb60 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.173+0000 7f5ec25ad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc169d10 con 0x7f5ebc0b2660 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.173+0000 7f5ec25ad700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc169ff0 con 0x7f5ebc098aa0 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec0b4a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc15bb60 0x7f5ebc16a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec0b4a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc15bb60 0x7f5ebc16a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41612/0 (socket says 172.21.15.61:41612) 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec0b4a700 1 -- 172.21.15.61:0/1148300064 learned_addr learned my addr 172.21.15.61:0/1148300064 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ebbfff700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ebc098aa0 0x7f5ebc0c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ebb7fe700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ebc0b2660 0x7f5ebc155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:33.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec0b4a700 1 -- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ebc098aa0 msgr2=0x7f5ebc0c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec0b4a700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ebc098aa0 0x7f5ebc0c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec0b4a700 1 -- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ebc0b2660 msgr2=0x7f5ebc155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec0b4a700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ebc0b2660 0x7f5ebc155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec0b4a700 1 -- 172.21.15.61:0/1148300064 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb4009ae0 con 0x7f5ebc15bb60 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec0b4a700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc15bb60 0x7f5ebc16a480 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400b610 tx=0x7f5eb4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5eb3fff700 1 -- 172.21.15.61:0/1148300064 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4008c30 con 0x7f5ebc15bb60 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5eb3fff700 1 -- 172.21.15.61:0/1148300064 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb4008d90 con 0x7f5ebc15bb60 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1148300064 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc0c4d40 con 0x7f5ebc15bb60 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5eb3fff700 1 -- 172.21.15.61:0/1148300064 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4026690 con 0x7f5ebc15bb60 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.174+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1148300064 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc0c4a60 con 0x7f5ebc15bb60 2023-12-24T19:59:33.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.175+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1148300064 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc06d440 con 0x7f5ebc15bb60 2023-12-24T19:59:33.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.176+0000 7f5eb3fff700 1 -- 172.21.15.61:0/1148300064 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5eb4003040 con 0x7f5ebc15bb60 2023-12-24T19:59:33.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.177+0000 7f5eb3fff700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5e9c066f60 0x7f5e9c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:33.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.177+0000 7f5eb3fff700 1 -- 172.21.15.61:0/1148300064 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5eb4086920 con 0x7f5ebc15bb60 2023-12-24T19:59:33.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.177+0000 7f5ebbfff700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5e9c066f60 0x7f5e9c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:33.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.177+0000 7f5ebbfff700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5e9c066f60 0x7f5e9c069410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009c90 tx=0x7f5ea4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:33.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.181+0000 7f5eb3fff700 1 -- 172.21.15.61:0/1148300064 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5eb4053af0 con 0x7f5ebc15bb60 2023-12-24T19:59:33.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.429+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1148300064 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5ebc04c3c0 con 0x7f5ebc15bb60 2023-12-24T19:59:33.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.429+0000 7f5eb3fff700 1 -- 172.21.15.61:0/1148300064 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5eb4021060 con 0x7f5ebc15bb60 2023-12-24T19:59:33.431 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T19:59:33.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5e9c066f60 msgr2=0x7f5e9c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:33.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5e9c066f60 0x7f5e9c069410 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009c90 tx=0x7f5ea4008040 comp rx=0 tx=0).stop 2023-12-24T19:59:33.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1148300064 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc15bb60 msgr2=0x7f5ebc16a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:33.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc15bb60 0x7f5ebc16a480 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400b610 tx=0x7f5eb4018000 comp rx=0 tx=0).stop 2023-12-24T19:59:33.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1148300064 shutdown_connections 2023-12-24T19:59:33.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ebc098aa0 0x7f5ebc0c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:33.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5e9c066f60 0x7f5e9c069410 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:33.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ebc15bb60 0x7f5ebc16a480 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:33.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 --2- 172.21.15.61:0/1148300064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ebc0b2660 0x7f5ebc155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:33.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1148300064 >> 172.21.15.61:0/1148300064 conn(0x7f5ebc097a10 msgr2=0x7f5ebc158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:33.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1148300064 shutdown_connections 2023-12-24T19:59:33.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:33.431+0000 7f5ec25ad700 1 -- 172.21.15.61:0/1148300064 wait complete. 2023-12-24T19:59:33.444 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T19:59:33.445 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T19:59:33.445 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T19:59:33.445 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T19:59:33.445 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T19:59:33.445 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T19:59:33.445 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T19:59:33.445 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T19:59:33.445 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:59:33.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:33.445 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T19:59:33.467 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T19:59:33.467 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T19:59:33.467 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T19:59:33.467 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42399sec preferred_lft 42399sec 2023-12-24T19:59:33.468 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T19:59:33.469 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T19:59:33.470 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::accb:c5ff:feae:915/64 scope link 2023-12-24T19:59:33.470 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T19:59:33.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:33.470 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T19:59:33.538 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T19:59:33.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:33.539 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T19:59:33.600 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T19:59:33.601 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T19:59:33.601 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T19:59:33.601 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T19:59:33.601 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T19:59:33.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:33.601 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T19:59:33.601 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T19:59:33.601 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T19:59:33.601 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T19:59:33.602 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T19:59:33.602 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T19:59:33.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:33.711 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T19:59:33.729 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T19:59:33.729 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T19:59:33.729 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:59:33.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T19:59:33.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T19:59:33.797 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T19:59:33.798 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:59:33.798 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T19:59:33.856 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T19:59:33.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T19:59:33.856 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T19:59:33.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T19:59:33.979 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:59:33.979 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:59:34.045 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:59:34.046 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:59:34.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:34.047 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T19:59:34.103 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T19:59:34.103 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T19:59:34.146 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T19:59:34.171 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T19:59:34.171 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T19:59:34.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T19:59:34.229+0000 7f4a67bf1540 -1 init, newargv = 0x55eeb7f33200 newargc=15 2023-12-24T19:59:34.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[44343]: starting ceph client 2023-12-24T19:59:34.234 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[44343]: starting fuse 2023-12-24T19:59:34.240 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T19:59:34.241 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T19:59:34.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:34.242 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T19:59:34.299 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T19:59:34.299 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T19:59:34.300 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T19:59:34.301 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T19:59:34.423 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.44343.asok 2023-12-24T19:59:34.605 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44343.asok 2023-12-24T19:59:34.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:34.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44343.asok status 2023-12-24T19:59:34.757 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T19:59:34.757 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "44343", 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5491, 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T19:59:34.758 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 5491 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3592803456 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3592803456 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.5491 192.168.0.1:0/3592803456", 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/3592803456", 2023-12-24T19:59:34.759 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T19:59:34.760 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 35, 2023-12-24T19:59:34.760 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 62, 2023-12-24T19:59:34.760 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T19:59:34.760 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T19:59:34.760 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T19:59:34.760 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T19:59:34.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:34.767 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T19:59:34.767 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T19:59:34.784 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T19:59:34.784 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T19:59:34.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T19:59:34.784 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T19:59:34.851 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T19:59:34.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.986+0000 7f3ed7178700 1 Processor -- start 2023-12-24T19:59:34.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.986+0000 7f3ed7178700 1 -- start start 2023-12-24T19:59:34.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ed7178700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3ed00af710 0x7f3ed00afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:34.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ed7178700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3ed0068c80 0x7f3ed0067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:34.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ed7178700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00687f0 con 0x7f3ed00a6c80 2023-12-24T19:59:34.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ed7178700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed0067be0 con 0x7f3ed0068c80 2023-12-24T19:59:34.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ed7178700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed0067ec0 con 0x7f3ed00af710 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ecffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3ed0068c80 0x7f3ed0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ecffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3ed0068c80 0x7f3ed0067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41622/0 (socket says 172.21.15.61:41622) 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ecffff700 1 -- 172.21.15.61:0/707560961 learned_addr learned my addr 172.21.15.61:0/707560961 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ed4f14700 1 --2- 172.21.15.61:0/707560961 >> v2:172.21.15.133:3300/0 conn(0x7f3ed00af710 0x7f3ed00afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ecffff700 1 -- 172.21.15.61:0/707560961 >> v2:172.21.15.133:3300/0 conn(0x7f3ed00af710 msgr2=0x7f3ed00afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ecffff700 1 --2- 172.21.15.61:0/707560961 >> v2:172.21.15.133:3300/0 conn(0x7f3ed00af710 0x7f3ed00afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ecffff700 1 -- 172.21.15.61:0/707560961 >> v1:172.21.15.133:6789/0 conn(0x7f3ed00a6c80 legacy=0x7f3ed015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ecffff700 1 -- 172.21.15.61:0/707560961 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00681a0 con 0x7f3ed0068c80 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.987+0000 7f3ed4f14700 1 --2- 172.21.15.61:0/707560961 >> v2:172.21.15.133:3300/0 conn(0x7f3ed00af710 0x7f3ed00afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ecffff700 1 --2- 172.21.15.61:0/707560961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed0068c80 0x7f3ed0067550 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00cb560 tx=0x7f3ebc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21aa7d77797d10e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ecf7fe700 1 -- 172.21.15.61:0/707560961 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00b860 con 0x7f3ed0068c80 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ecf7fe700 1 -- 172.21.15.61:0/707560961 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc00b9c0 con 0x7f3ed0068c80 2023-12-24T19:59:34.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ecf7fe700 1 -- 172.21.15.61:0/707560961 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc00bd60 con 0x7f3ed0068c80 2023-12-24T19:59:34.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ed7178700 1 -- 172.21.15.61:0/707560961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed0068c80 msgr2=0x7f3ed0067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:34.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ed7178700 1 --2- 172.21.15.61:0/707560961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed0068c80 0x7f3ed0067550 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00cb560 tx=0x7f3ebc009250 comp rx=0 tx=0).stop 2023-12-24T19:59:34.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ed7178700 1 -- 172.21.15.61:0/707560961 shutdown_connections 2023-12-24T19:59:34.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ed7178700 1 --2- 172.21.15.61:0/707560961 >> v2:172.21.15.133:3300/0 conn(0x7f3ed00af710 0x7f3ed00afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:34.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ed7178700 1 --2- 172.21.15.61:0/707560961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed0068c80 0x7f3ed0067550 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:34.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ed7178700 1 -- 172.21.15.61:0/707560961 >> 172.21.15.61:0/707560961 conn(0x7f3ed00ca200 msgr2=0x7f3ed00ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:34.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ed7178700 1 -- 172.21.15.61:0/707560961 shutdown_connections 2023-12-24T19:59:34.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.988+0000 7f3ed7178700 1 -- 172.21.15.61:0/707560961 wait complete. 2023-12-24T19:59:34.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.990+0000 7f3ed7178700 1 Processor -- start 2023-12-24T19:59:34.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.990+0000 7f3ed7178700 1 -- start start 2023-12-24T19:59:34.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed7178700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ed0068c80 0x7f3ed01452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:34.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed7178700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ed00a6c80 0x7f3ed00a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:34.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed7178700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed00af710 0x7f3ed0154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:34.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed7178700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01457e0 con 0x7f3ed00af710 2023-12-24T19:59:34.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed7178700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00ab840 con 0x7f3ed00a6c80 2023-12-24T19:59:34.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed7178700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00abb20 con 0x7f3ed0068c80 2023-12-24T19:59:34.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed5715700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed00af710 0x7f3ed0154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:34.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed5715700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed00af710 0x7f3ed0154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41626/0 (socket says 172.21.15.61:41626) 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed5715700 1 -- 172.21.15.61:0/758016886 learned_addr learned my addr 172.21.15.61:0/758016886 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ecffff700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ed00a6c80 0x7f3ed00a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed4f14700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ed0068c80 0x7f3ed01452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed5715700 1 -- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ed0068c80 msgr2=0x7f3ed01452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed5715700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ed0068c80 0x7f3ed01452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed5715700 1 -- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ed00a6c80 msgr2=0x7f3ed00a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed5715700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ed00a6c80 0x7f3ed00a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed5715700 1 -- 172.21.15.61:0/758016886 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc0094f0 con 0x7f3ed00af710 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed4f14700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ed0068c80 0x7f3ed01452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed5715700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed00af710 0x7f3ed0154b50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800ed50 tx=0x7f3ec800c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3eccff9700 1 -- 172.21.15.61:0/758016886 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800ee50 con 0x7f3ed00af710 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3eccff9700 1 -- 172.21.15.61:0/758016886 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec8001eb0 con 0x7f3ed00af710 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3ed7178700 1 -- 172.21.15.61:0/758016886 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed00abe00 con 0x7f3ed00af710 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.991+0000 7f3eccff9700 1 -- 172.21.15.61:0/758016886 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8011470 con 0x7f3ed00af710 2023-12-24T19:59:34.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.992+0000 7f3ed7178700 1 -- 172.21.15.61:0/758016886 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed00ac3c0 con 0x7f3ed00af710 2023-12-24T19:59:34.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.992+0000 7f3ed7178700 1 -- 172.21.15.61:0/758016886 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed004c3c0 con 0x7f3ed00af710 2023-12-24T19:59:34.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.993+0000 7f3eccff9700 1 -- 172.21.15.61:0/758016886 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3ec8003030 con 0x7f3ed00af710 2023-12-24T19:59:34.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.993+0000 7f3eccff9700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3eb4066f30 0x7f3eb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T19:59:34.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.994+0000 7f3eccff9700 1 -- 172.21.15.61:0/758016886 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ec8015070 con 0x7f3ed00af710 2023-12-24T19:59:34.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.994+0000 7f3ed4f14700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3eb4066f30 0x7f3eb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T19:59:34.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.994+0000 7f3ed4f14700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3eb4066f30 0x7f3eb40693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4006f00 tx=0x7f3ec4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T19:59:34.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:34.998+0000 7f3eccff9700 1 -- 172.21.15.61:0/758016886 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ec8053f80 con 0x7f3ed00af710 2023-12-24T19:59:35.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.239+0000 7f3ed7178700 1 -- 172.21.15.61:0/758016886 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ed00ac5b0 con 0x7f3ed00af710 2023-12-24T19:59:35.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.240+0000 7f3eccff9700 1 -- 172.21.15.61:0/758016886 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f3ec80575a0 con 0x7f3ed00af710 2023-12-24T19:59:35.241 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T19:59:35.241 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2177201507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2177201507},{"type":"v1","addr":"172.21.15.61:6835","nonce":2177201507}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1435257239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1435257239},{"type":"v1","addr":"172.21.15.133:6837","nonce":1435257239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/696274590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":696274590},{"type":"v1","addr":"172.21.15.133:6836","nonce":696274590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:59:24.619081+0000","modified":"2023-12-24T19:59:28.258285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/3751369981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3751369981},{"type":"v1","addr":"172.21.15.61:6834","nonce":3751369981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T19:59:35.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.241+0000 7f3ed7178700 1 -- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3eb4066f30 msgr2=0x7f3eb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:35.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.241+0000 7f3ed7178700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3eb4066f30 0x7f3eb40693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4006f00 tx=0x7f3ec4008040 comp rx=0 tx=0).stop 2023-12-24T19:59:35.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.241+0000 7f3ed7178700 1 -- 172.21.15.61:0/758016886 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed00af710 msgr2=0x7f3ed0154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T19:59:35.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.241+0000 7f3ed7178700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed00af710 0x7f3ed0154b50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3ec800ed50 tx=0x7f3ec800c5d0 comp rx=0 tx=0).stop 2023-12-24T19:59:35.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.242+0000 7f3ed7178700 1 -- 172.21.15.61:0/758016886 shutdown_connections 2023-12-24T19:59:35.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.242+0000 7f3ed7178700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ed0068c80 0x7f3ed01452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:35.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.242+0000 7f3ed7178700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3eb4066f30 0x7f3eb40693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:35.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.242+0000 7f3ed7178700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ed00af710 0x7f3ed0154b50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:35.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.242+0000 7f3ed7178700 1 --2- 172.21.15.61:0/758016886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ed00a6c80 0x7f3ed00a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T19:59:35.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.242+0000 7f3ed7178700 1 -- 172.21.15.61:0/758016886 >> 172.21.15.61:0/758016886 conn(0x7f3ed00ca200 msgr2=0x7f3ed00ad9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T19:59:35.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.242+0000 7f3ed7178700 1 -- 172.21.15.61:0/758016886 shutdown_connections 2023-12-24T19:59:35.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T19:59:35.242+0000 7f3ed7178700 1 -- 172.21.15.61:0/758016886 wait complete. 2023-12-24T19:59:35.244 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 35 2023-12-24T19:59:35.255 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-24T19:59:35.397 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":5667,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.140976608000001,"mdsmap_epoch":35,"osdmap_epoch":62,"osdmap_epoch_barrier":62,"uptime":15.076424597999999} 2023-12-24T19:59:35.397 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 5667, "mdsmap_epoch": 35, "osdmap_epoch": 62, "osdmap_epoch_barrier": 62, "rank_uptime": 10.140976608, "state": "up:active", "uptime": 15.076424598, "want_state": "up:active", "whoami": 0 } 2023-12-24T19:59:35.398 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-24T19:59:35.534 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_mon_report_interval":"5"} 2023-12-24T19:59:35.535 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-24T19:59:35.535 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-24T19:59:35.665 INFO:teuthology.orchestra.run.smithi061.stdout:{"mon_tick_interval":"5"} 2023-12-24T19:59:35.666 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-24T19:59:35.666 INFO:tasks.cephfs.test_full:pool capacity 557102656, 531MB should be enough to fill it 2023-12-24T19:59:35.666 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T19:59:35.666 DEBUG:teuthology.orchestra.run.smithi061:> import time 2023-12-24T19:59:35.666 DEBUG:teuthology.orchestra.run.smithi061:> import datetime 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> # Write some buffered data through before going full, all should be well 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> print("writing some data through which we expect to succeed") 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> bytes = 0 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(f) 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-24T19:59:35.667 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> # buffered IO, the error should always only appear from fsync and not 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> # from write 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> full = False 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> for n in range(0, int(531 * 0.9)): 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> print("done writing {0} bytes".format(bytes)) 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> # OK, now we should sneak in under the full condition 2023-12-24T19:59:35.668 DEBUG:teuthology.orchestra.run.smithi061:> # due to the time it takes the OSDs to report to the 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> # mons, and get a successful fsync on our full-making data 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(f) 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> # buffered write, add more dirty data to the buffer 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> print("starting buffered write") 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> try: 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> for n in range(0, int(531 * 0.2)): 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> time.sleep(15.0) 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> except OSError: 2023-12-24T19:59:35.669 DEBUG:teuthology.orchestra.run.smithi061:> pass; 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> # Wait long enough for a background flush that should fail 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> time.sleep(30) 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> if True: 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> # ...and check that the failed background flush is reflected in fclose 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> try: 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> os.close(f) 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> except OSError: 2023-12-24T19:59:35.670 DEBUG:teuthology.orchestra.run.smithi061:> print("close() returned an error as expected") 2023-12-24T19:59:35.671 DEBUG:teuthology.orchestra.run.smithi061:> else: 2023-12-24T19:59:35.671 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("close() failed to raise error") 2023-12-24T19:59:35.671 DEBUG:teuthology.orchestra.run.smithi061:> else: 2023-12-24T19:59:35.671 DEBUG:teuthology.orchestra.run.smithi061:> # The kernel cephfs client does not raise errors on fclose 2023-12-24T19:59:35.671 DEBUG:teuthology.orchestra.run.smithi061:> os.close(f) 2023-12-24T19:59:35.671 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T19:59:35.671 DEBUG:teuthology.orchestra.run.smithi061:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-24T19:59:35.671 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T19:59:35.728 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:59:35.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:writing some data through which we expect to succeed 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-12-24T19:59:40.638 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-12-24T19:59:40.639 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-12-24T19:59:40.640 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-12-24T19:59:40.641 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-12-24T19:59:40.642 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-12-24T19:59:40.643 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-12-24T19:59:40.644 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-12-24T19:59:40.645 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-12-24T19:59:40.646 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-12-24T19:59:40.646 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-12-24T19:59:40.646 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-12-24T19:59:40.646 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-12-24T19:59:40.646 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-12-24T19:59:40.646 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-12-24T19:59:40.646 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-12-24T19:59:40.646 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-12-24T19:59:40.646 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-12-24T19:59:40.647 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-12-24T19:59:40.647 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-12-24T19:59:40.647 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-12-24T19:59:40.647 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-12-24T19:59:40.648 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-12-24T19:59:40.648 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-12-24T19:59:40.648 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-12-24T19:59:40.648 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-12-24T19:59:40.649 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-12-24T19:59:40.649 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-12-24T19:59:40.649 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-12-24T19:59:40.649 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-12-24T19:59:40.649 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-12-24T19:59:40.649 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-12-24T19:59:40.649 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-12-24T19:59:40.649 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-12-24T19:59:40.650 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-12-24T19:59:40.651 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-12-24T19:59:40.898 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-12-24T19:59:40.899 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-12-24T19:59:40.899 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-12-24T19:59:40.899 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-12-24T19:59:40.899 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-12-24T19:59:40.899 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-12-24T19:59:40.899 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-12-24T19:59:40.899 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-12-24T19:59:40.899 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-12-24T19:59:40.899 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-12-24T19:59:40.899 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-12-24T19:59:40.900 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-12-24T19:59:40.901 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-12-24T19:59:40.902 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-12-24T19:59:40.903 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-12-24T19:59:40.904 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-12-24T19:59:40.905 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-12-24T19:59:40.906 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-12-24T19:59:40.907 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-12-24T19:59:40.908 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-12-24T19:59:40.909 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-12-24T19:59:40.909 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-12-24T19:59:40.909 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-12-24T19:59:40.909 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-12-24T19:59:40.909 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-12-24T19:59:40.909 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-12-24T19:59:40.909 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-12-24T19:59:41.146 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-12-24T19:59:41.146 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-12-24T19:59:41.146 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-12-24T19:59:41.146 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-12-24T19:59:41.146 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-12-24T19:59:41.146 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-12-24T19:59:41.146 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-12-24T19:59:41.146 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-12-24T19:59:41.147 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-12-24T19:59:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-12-24T19:59:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-12-24T19:59:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-12-24T19:59:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-12-24T19:59:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-12-24T19:59:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-12-24T19:59:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-12-24T19:59:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-12-24T19:59:41.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-12-24T19:59:42.529 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T19:59:42.529+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-24T19:59:48.525 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T19:59:48.525+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-12-24T19:59:59.999 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T19:59:59.999+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 backfillfull osd(s); 4 full osd(s); 3 pool(s) full 2023-12-24T20:00:05.817 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:00:05.820 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:00:26.251 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-12-24T20:00:26.251 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-12-24T20:00:26.251 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-12-24T20:00:26.251 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:done writing 500695040 bytes 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:successfully fsync'ed prior to getting full state reported 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:starting buffered write 2023-12-24T20:00:26.252 INFO:teuthology.orchestra.run.smithi061.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-24T20:00:26.253 INFO:teuthology.orchestra.run.smithi061.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-12-24T20:00:26.253 INFO:teuthology.orchestra.run.smithi061.stdout:close() returned an error as expected 2023-12-24T20:00:26.403 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:00:26.404 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:00:26.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:00:26.497 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:00:26.497 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T20:00:26.498 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:00:26.498 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T20:00:26.539 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:00:26.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:26.539 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:00:26.540 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[54903]: fuse finished with error 0 and tester_r 0 2023-12-24T20:00:26.646 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T20:00:26.646 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:00:26.646 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T20:00:26.695 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[44343]: fuse finished with error 0 and tester_r 0 2023-12-24T20:00:26.697 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:00:26.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:26.697 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T20:00:26.826 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:00:26.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:26.827 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T20:00:26.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:00:26.848 INFO:teuthology.orchestra.run.smithi061.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-24T20:00:26.848 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:00:26.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:26.849 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T20:00:26.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:00:26.886 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-24T20:00:26.886 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:00:27.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.019+0000 7fde6d46c700 1 Processor -- start 2023-12-24T20:00:27.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.020+0000 7fde6d46c700 1 -- start start 2023-12-24T20:00:27.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.020+0000 7fde6d46c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fde680cbac0 0x7fde680cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.020+0000 7fde6d46c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fde680cd9b0 0x7fde680cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.020+0000 7fde6d46c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde680cc2a0 con 0x7fde681599e0 2023-12-24T20:00:27.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.020+0000 7fde6d46c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde680cedc0 con 0x7fde680cd9b0 2023-12-24T20:00:27.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.020+0000 7fde6d46c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde68067f60 con 0x7fde680cbac0 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde677fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fde680cd9b0 0x7fde680cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde66ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fde681599e0 0x7fde6815ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51586/0 (socket says 172.21.15.61:51586) 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde66ffd700 1 -- 172.21.15.61:0/916689935 learned_addr learned my addr 172.21.15.61:0/916689935 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde667fc700 1 --2- 172.21.15.61:0/916689935 >> v2:172.21.15.133:3300/0 conn(0x7fde680cbac0 0x7fde680cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde677fe700 1 -- 172.21.15.61:0/916689935 >> v2:172.21.15.133:3300/0 conn(0x7fde680cbac0 msgr2=0x7fde680cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde677fe700 1 --2- 172.21.15.61:0/916689935 >> v2:172.21.15.133:3300/0 conn(0x7fde680cbac0 0x7fde680cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde677fe700 1 -- 172.21.15.61:0/916689935 >> v1:172.21.15.61:6789/0 conn(0x7fde681599e0 legacy=0x7fde6815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde677fe700 1 -- 172.21.15.61:0/916689935 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680cddb0 con 0x7fde680cd9b0 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde65ffb700 1 -- 172.21.15.61:0/916689935 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748562487 0 0) 0x7fde680cc2a0 con 0x7fde681599e0 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde677fe700 1 --2- 172.21.15.61:0/916689935 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde680cd9b0 0x7fde680cf250 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fde6815d640 tx=0x7fde60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76b170031bd6583 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde65ffb700 1 -- 172.21.15.61:0/916689935 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000e070 con 0x7fde680cd9b0 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde65ffb700 1 -- 172.21.15.61:0/916689935 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6000bc30 con 0x7fde680cd9b0 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.021+0000 7fde65ffb700 1 -- 172.21.15.61:0/916689935 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60012430 con 0x7fde680cd9b0 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.022+0000 7fde6d46c700 1 -- 172.21.15.61:0/916689935 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde680cd9b0 msgr2=0x7fde680cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.022+0000 7fde6d46c700 1 --2- 172.21.15.61:0/916689935 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde680cd9b0 0x7fde680cf250 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fde6815d640 tx=0x7fde60009780 comp rx=0 tx=0).stop 2023-12-24T20:00:27.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.022+0000 7fde6d46c700 1 -- 172.21.15.61:0/916689935 shutdown_connections 2023-12-24T20:00:27.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.022+0000 7fde6d46c700 1 --2- 172.21.15.61:0/916689935 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde680cd9b0 0x7fde680cf250 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.022+0000 7fde6d46c700 1 --2- 172.21.15.61:0/916689935 >> v2:172.21.15.133:3300/0 conn(0x7fde680cbac0 0x7fde680cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.022+0000 7fde6d46c700 1 -- 172.21.15.61:0/916689935 >> 172.21.15.61:0/916689935 conn(0x7fde6806e640 msgr2=0x7fde68067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:27.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.022+0000 7fde6d46c700 1 -- 172.21.15.61:0/916689935 shutdown_connections 2023-12-24T20:00:27.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.022+0000 7fde6d46c700 1 -- 172.21.15.61:0/916689935 wait complete. 2023-12-24T20:00:27.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.023+0000 7fde6d46c700 1 Processor -- start 2023-12-24T20:00:27.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.023+0000 7fde6d46c700 1 -- start start 2023-12-24T20:00:27.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde6d46c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde680cbac0 0x7fde68158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde6d46c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde680cd9b0 0x7fde680c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde6d46c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde681599e0 0x7fde6815b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde6d46c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde68159280 con 0x7fde681599e0 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde6d46c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680c9970 con 0x7fde680cbac0 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde6d46c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6816b8b0 con 0x7fde680cd9b0 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde677fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde681599e0 0x7fde6815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde677fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde681599e0 0x7fde6815b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48122/0 (socket says 172.21.15.61:48122) 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde677fe700 1 -- 172.21.15.61:0/1364058548 learned_addr learned my addr 172.21.15.61:0/1364058548 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde66ffd700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde680cbac0 0x7fde68158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde667fc700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde680cd9b0 0x7fde680c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde677fe700 1 -- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde680cd9b0 msgr2=0x7fde680c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde677fe700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde680cd9b0 0x7fde680c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde677fe700 1 -- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde680cbac0 msgr2=0x7fde68158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde677fe700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde680cbac0 0x7fde68158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde677fe700 1 -- 172.21.15.61:0/1364058548 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde60009a20 con 0x7fde681599e0 2023-12-24T20:00:27.027 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.024+0000 7fde667fc700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde680cd9b0 0x7fde680c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:27.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.025+0000 7fde677fe700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde681599e0 0x7fde6815b340 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fde68071db0 tx=0x7fde60019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:27.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.025+0000 7fde5effd700 1 -- 172.21.15.61:0/1364058548 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60012e60 con 0x7fde681599e0 2023-12-24T20:00:27.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.025+0000 7fde5effd700 1 -- 172.21.15.61:0/1364058548 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6001d630 con 0x7fde681599e0 2023-12-24T20:00:27.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.025+0000 7fde6d46c700 1 -- 172.21.15.61:0/1364058548 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde680c8d60 con 0x7fde681599e0 2023-12-24T20:00:27.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.025+0000 7fde5effd700 1 -- 172.21.15.61:0/1364058548 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6001d9f0 con 0x7fde681599e0 2023-12-24T20:00:27.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.025+0000 7fde6d46c700 1 -- 172.21.15.61:0/1364058548 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde680c9320 con 0x7fde681599e0 2023-12-24T20:00:27.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.026+0000 7fde6d46c700 1 -- 172.21.15.61:0/1364058548 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6815cb20 con 0x7fde681599e0 2023-12-24T20:00:27.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.026+0000 7fde5effd700 1 -- 172.21.15.61:0/1364058548 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fde60024070 con 0x7fde681599e0 2023-12-24T20:00:27.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.027+0000 7fde5effd700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.027+0000 7fde5effd700 1 -- 172.21.15.61:0/1364058548 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde60086d30 con 0x7fde681599e0 2023-12-24T20:00:27.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.027+0000 7fde5effd700 1 -- 172.21.15.61:0/1364058548 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7fde4806ea50 con 0x7fde681599e0 2023-12-24T20:00:27.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.027+0000 7fde66ffd700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.027+0000 7fde66ffd700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde48066f30 0x7fde480693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c8f0 tx=0x7fde50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:27.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.031+0000 7fde5effd700 1 -- 172.21.15.61:0/1364058548 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde60053fa0 con 0x7fde681599e0 2023-12-24T20:00:27.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.269+0000 7fde6d46c700 1 -- 172.21.15.61:0/1364058548 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde6804c3c0 con 0x7fde681599e0 2023-12-24T20:00:27.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.270+0000 7fde5effd700 1 -- 172.21.15.61:0/1364058548 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fde6002c020 con 0x7fde681599e0 2023-12-24T20:00:27.270 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:27.270 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2177201507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2177201507},{"type":"v1","addr":"172.21.15.61:6835","nonce":2177201507}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1435257239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1435257239},{"type":"v1","addr":"172.21.15.133:6837","nonce":1435257239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/696274590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":696274590},{"type":"v1","addr":"172.21.15.133:6836","nonce":696274590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:59:24.619081+0000","modified":"2023-12-24T19:59:28.258285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/3751369981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3751369981},{"type":"v1","addr":"172.21.15.61:6834","nonce":3751369981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T20:00:27.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.271+0000 7fde6d46c700 1 -- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde48066f30 msgr2=0x7fde480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.271+0000 7fde6d46c700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde48066f30 0x7fde480693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c8f0 tx=0x7fde50009040 comp rx=0 tx=0).stop 2023-12-24T20:00:27.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.271+0000 7fde6d46c700 1 -- 172.21.15.61:0/1364058548 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde681599e0 msgr2=0x7fde6815b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.271+0000 7fde6d46c700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde681599e0 0x7fde6815b340 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fde68071db0 tx=0x7fde60019000 comp rx=0 tx=0).stop 2023-12-24T20:00:27.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.271+0000 7fde6d46c700 1 -- 172.21.15.61:0/1364058548 shutdown_connections 2023-12-24T20:00:27.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.271+0000 7fde6d46c700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fde48066f30 0x7fde480693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.271+0000 7fde6d46c700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde681599e0 0x7fde6815b340 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.271+0000 7fde6d46c700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde680cbac0 0x7fde68158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.271+0000 7fde6d46c700 1 --2- 172.21.15.61:0/1364058548 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fde680cd9b0 0x7fde680c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.272+0000 7fde6d46c700 1 -- 172.21.15.61:0/1364058548 >> 172.21.15.61:0/1364058548 conn(0x7fde6806e640 msgr2=0x7fde6815c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:27.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.272+0000 7fde6d46c700 1 -- 172.21.15.61:0/1364058548 shutdown_connections 2023-12-24T20:00:27.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.272+0000 7fde6d46c700 1 -- 172.21.15.61:0/1364058548 wait complete. 2023-12-24T20:00:27.276 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 35 2023-12-24T20:00:27.289 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:00:27.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.433+0000 7fe57cc96700 1 Processor -- start 2023-12-24T20:00:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.433+0000 7fe57cc96700 1 -- start start 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe57cc96700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe578159c10 0x7fe5780c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe57cc96700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe578159fe0 0x7fe5780c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe57cc96700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5780af880 con 0x7fe5780cba80 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe57cc96700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5780c6fc0 con 0x7fe578159fe0 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe57cc96700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5780c63b0 con 0x7fe578159c10 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe575d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe578159fe0 0x7fe5780c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe576d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe5780cba80 0x7fe5780cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51600/0 (socket says 172.21.15.61:51600) 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe576d9d700 1 -- 172.21.15.61:0/3189558092 learned_addr learned my addr 172.21.15.61:0/3189558092 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe57659c700 1 --2- 172.21.15.61:0/3189558092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe578159c10 0x7fe5780c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe575d9b700 1 -- 172.21.15.61:0/3189558092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe578159c10 msgr2=0x7fe5780c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe575d9b700 1 --2- 172.21.15.61:0/3189558092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe578159c10 0x7fe5780c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe575d9b700 1 -- 172.21.15.61:0/3189558092 >> v1:172.21.15.61:6789/0 conn(0x7fe5780cba80 legacy=0x7fe5780cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.434+0000 7fe575d9b700 1 -- 172.21.15.61:0/3189558092 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5780c6690 con 0x7fe578159fe0 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe575d9b700 1 --2- 172.21.15.61:0/3189558092 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe578159fe0 0x7fe5780c5d10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe5600098e0 tx=0x7fe5600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575dd1854357414e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57559a700 1 -- 172.21.15.61:0/3189558092 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560009e80 con 0x7fe578159fe0 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57559a700 1 -- 172.21.15.61:0/3189558092 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56000b860 con 0x7fe578159fe0 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57559a700 1 -- 172.21.15.61:0/3189558092 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000bbe0 con 0x7fe578159fe0 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57cc96700 1 -- 172.21.15.61:0/3189558092 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe578159fe0 msgr2=0x7fe5780c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57cc96700 1 --2- 172.21.15.61:0/3189558092 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe578159fe0 0x7fe5780c5d10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe5600098e0 tx=0x7fe5600091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57cc96700 1 -- 172.21.15.61:0/3189558092 shutdown_connections 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57cc96700 1 --2- 172.21.15.61:0/3189558092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe578159c10 0x7fe5780c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57cc96700 1 --2- 172.21.15.61:0/3189558092 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe578159fe0 0x7fe5780c5d10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57cc96700 1 -- 172.21.15.61:0/3189558092 >> 172.21.15.61:0/3189558092 conn(0x7fe57806e640 msgr2=0x7fe578067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57cc96700 1 -- 172.21.15.61:0/3189558092 shutdown_connections 2023-12-24T20:00:27.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.435+0000 7fe57cc96700 1 -- 172.21.15.61:0/3189558092 wait complete. 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.436+0000 7fe57cc96700 1 Processor -- start 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe57cc96700 1 -- start start 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe57cc96700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5780cba80 0x7fe578141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe57cc96700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe578159c10 0x7fe5780c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe57cc96700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe578159fe0 0x7fe5780c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe57cc96700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57816e540 con 0x7fe5780cba80 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe57cc96700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57816d970 con 0x7fe578159fe0 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe57cc96700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57816dc10 con 0x7fe578159c10 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe57659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5780cba80 0x7fe578141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe57659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5780cba80 0x7fe578141dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48134/0 (socket says 172.21.15.61:48134) 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe57659c700 1 -- 172.21.15.61:0/2963591572 learned_addr learned my addr 172.21.15.61:0/2963591572 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:27.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.437+0000 7fe575d9b700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe578159c10 0x7fe5780c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe576d9d700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe578159fe0 0x7fe5780c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe57659c700 1 -- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe578159c10 msgr2=0x7fe5780c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe57659c700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe578159c10 0x7fe5780c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe57659c700 1 -- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe578159fe0 msgr2=0x7fe5780c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe57659c700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe578159fe0 0x7fe5780c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe57659c700 1 -- 172.21.15.61:0/2963591572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe560009420 con 0x7fe5780cba80 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe576d9d700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe578159fe0 0x7fe5780c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe57659c700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5780cba80 0x7fe578141dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe57000d890 tx=0x7fe570008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe56e7fc700 1 -- 172.21.15.61:0/2963591572 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5700125f0 con 0x7fe5780cba80 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe56e7fc700 1 -- 172.21.15.61:0/2963591572 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe570012750 con 0x7fe5780cba80 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe57cc96700 1 -- 172.21.15.61:0/2963591572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57816def0 con 0x7fe5780cba80 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe56e7fc700 1 -- 172.21.15.61:0/2963591572 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570012ad0 con 0x7fe5780cba80 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.438+0000 7fe57cc96700 1 -- 172.21.15.61:0/2963591572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe578142300 con 0x7fe5780cba80 2023-12-24T20:00:27.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.439+0000 7fe57cc96700 1 -- 172.21.15.61:0/2963591572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57816e820 con 0x7fe5780cba80 2023-12-24T20:00:27.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.439+0000 7fe56e7fc700 1 -- 172.21.15.61:0/2963591572 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe57001e460 con 0x7fe5780cba80 2023-12-24T20:00:27.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.440+0000 7fe56e7fc700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe558066f30 0x7fe5580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.440+0000 7fe56e7fc700 1 -- 172.21.15.61:0/2963591572 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe570084b50 con 0x7fe5780cba80 2023-12-24T20:00:27.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.440+0000 7fe575d9b700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe558066f30 0x7fe5580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.440+0000 7fe56e7fc700 1 -- 172.21.15.61:0/2963591572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7fe55806ea50 con 0x7fe5780cba80 2023-12-24T20:00:27.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.441+0000 7fe575d9b700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe558066f30 0x7fe5580693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe5600091e0 tx=0x7fe560017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:27.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.444+0000 7fe56e7fc700 1 -- 172.21.15.61:0/2963591572 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe570051dc0 con 0x7fe5780cba80 2023-12-24T20:00:27.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.642+0000 7fe57cc96700 1 -- 172.21.15.61:0/2963591572 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5780890b0 con 0x7fe5780cba80 2023-12-24T20:00:27.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.643+0000 7fe56e7fc700 1 -- 172.21.15.61:0/2963591572 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15408 (secure 0 0 0) 0x7fe5700553e0 con 0x7fe5780cba80 2023-12-24T20:00:27.644 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:27.644 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":66,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:59:46.594692+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:59:23.050869+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-24T19:59:23.594703+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:00:27.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.645+0000 7fe57cc96700 1 -- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe558066f30 msgr2=0x7fe5580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.645+0000 7fe57cc96700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe558066f30 0x7fe5580693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe5600091e0 tx=0x7fe560017000 comp rx=0 tx=0).stop 2023-12-24T20:00:27.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.645+0000 7fe57cc96700 1 -- 172.21.15.61:0/2963591572 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5780cba80 msgr2=0x7fe578141dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.645+0000 7fe57cc96700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5780cba80 0x7fe578141dc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe57000d890 tx=0x7fe570008040 comp rx=0 tx=0).stop 2023-12-24T20:00:27.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.646+0000 7fe57cc96700 1 -- 172.21.15.61:0/2963591572 shutdown_connections 2023-12-24T20:00:27.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.646+0000 7fe57cc96700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe558066f30 0x7fe5580693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.646+0000 7fe57cc96700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe578159fe0 0x7fe5780c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.646+0000 7fe57cc96700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5780cba80 0x7fe578141dc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.646+0000 7fe57cc96700 1 --2- 172.21.15.61:0/2963591572 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe578159c10 0x7fe5780c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.646+0000 7fe57cc96700 1 -- 172.21.15.61:0/2963591572 >> 172.21.15.61:0/2963591572 conn(0x7fe57806e640 msgr2=0x7fe578156560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:27.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.646+0000 7fe57cc96700 1 -- 172.21.15.61:0/2963591572 shutdown_connections 2023-12-24T20:00:27.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.646+0000 7fe57cc96700 1 -- 172.21.15.61:0/2963591572 wait complete. 2023-12-24T20:00:27.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T19:59:23.050869+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T19:59:23.594703+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:00:27.659 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:00:27.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.784+0000 7fc1c7685700 1 Processor -- start 2023-12-24T20:00:27.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.784+0000 7fc1c7685700 1 -- start start 2023-12-24T20:00:27.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1c7685700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1c015afd0 0x7fc1c00cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1c7685700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00cb3d0 0x7fc1c00aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1c7685700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c00c8c30 con 0x7fc1c015ac00 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1c7685700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c00c7e00 con 0x7fc1c015afd0 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1c7685700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00cb7c0 con 0x7fc1c00cb3d0 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1c5421700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fc1c015ac00 0x7fc1c00c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51610/0 (socket says 172.21.15.61:51610) 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1c5421700 1 -- 172.21.15.61:0/4235759337 learned_addr learned my addr 172.21.15.61:0/4235759337 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391162275 0 0) 0x7fc1c00c8c30 con 0x7fc1c015ac00 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1c5c22700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00cb3d0 0x7fc1c00aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1ac003570 con 0x7fc1c015ac00 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.785+0000 7fc1c4c20700 1 --2- 172.21.15.61:0/4235759337 >> v2:172.21.15.133:3300/0 conn(0x7fc1c015afd0 0x7fc1c00cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 773544199 0 0) 0x7fc1ac003570 con 0x7fc1c015ac00 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00cb3d0 msgr2=0x7fc1c00aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00cb3d0 0x7fc1c00aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 >> v2:172.21.15.133:3300/0 conn(0x7fc1c015afd0 msgr2=0x7fc1c00cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 --2- 172.21.15.61:0/4235759337 >> v2:172.21.15.133:3300/0 conn(0x7fc1c015afd0 0x7fc1c00cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c00c80b0 con 0x7fc1c015ac00 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fc1b00015f0 con 0x7fc1c015ac00 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 >> v1:172.21.15.61:6789/0 conn(0x7fc1c015ac00 legacy=0x7fc1c00c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1ac003a60 0x7fc1ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1ac004810 0x7fc1ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00cb3d0 0x7fc1ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00c7e00 con 0x7fc1ac003a60 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00cb7c0 con 0x7fc1ac004810 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac00ba60 con 0x7fc1c00cb3d0 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1c5421700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1ac003a60 0x7fc1ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1c4c20700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1ac004810 0x7fc1ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1c5c22700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00cb3d0 0x7fc1ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1c5421700 1 -- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00cb3d0 msgr2=0x7fc1ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1c5421700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00cb3d0 0x7fc1ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1c5421700 1 -- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1ac004810 msgr2=0x7fc1ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1c5421700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1ac004810 0x7fc1ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1c5421700 1 -- 172.21.15.61:0/4235759337 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac003570 con 0x7fc1ac003a60 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1c5c22700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00cb3d0 0x7fc1ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1c5421700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1ac003a60 0x7fc1ac003e70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000c3f0 tx=0x7fc1c015a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a14c1fb4945389c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b000cc80 con 0x7fc1ac003a60 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b000cde0 con 0x7fc1ac003a60 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.786+0000 7fc1b7fff700 1 -- 172.21.15.61:0/4235759337 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0007320 con 0x7fc1ac003a60 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.787+0000 7fc1c7685700 1 -- 172.21.15.61:0/4235759337 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1ac003a60 msgr2=0x7fc1ac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.787+0000 7fc1c7685700 1 --2- 172.21.15.61:0/4235759337 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1ac003a60 0x7fc1ac003e70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000c3f0 tx=0x7fc1c015a2f0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.787+0000 7fc1c5c22700 1 -- 172.21.15.61:0/4235759337 reap_dead start 2023-12-24T20:00:27.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.787+0000 7fc1c7685700 1 -- 172.21.15.61:0/4235759337 shutdown_connections 2023-12-24T20:00:27.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.787+0000 7fc1c7685700 1 -- 172.21.15.61:0/4235759337 >> 172.21.15.61:0/4235759337 conn(0x7fc1c00cd0b0 msgr2=0x7fc1c00cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:27.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.787+0000 7fc1c7685700 1 -- 172.21.15.61:0/4235759337 shutdown_connections 2023-12-24T20:00:27.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.787+0000 7fc1c7685700 1 -- 172.21.15.61:0/4235759337 wait complete. 2023-12-24T20:00:27.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.788+0000 7fc1c7685700 1 Processor -- start 2023-12-24T20:00:27.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.788+0000 7fc1c7685700 1 -- start start 2023-12-24T20:00:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c7685700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1ac003a60 0x7fc1c0149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c7685700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00b12e0 0x7fc1c00ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c7685700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1c00adad0 0x7fc1c00c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c7685700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00b1870 con 0x7fc1c00adad0 2023-12-24T20:00:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c7685700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00b1b50 con 0x7fc1ac003a60 2023-12-24T20:00:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c7685700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c00b1e30 con 0x7fc1c00b12e0 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c5c22700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1c00adad0 0x7fc1c00c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c5c22700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1c00adad0 0x7fc1c00c3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48144/0 (socket says 172.21.15.61:48144) 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c5c22700 1 -- 172.21.15.61:0/2711942825 learned_addr learned my addr 172.21.15.61:0/2711942825 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c5421700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1ac003a60 0x7fc1c0149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c4c20700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00b12e0 0x7fc1c00ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c5c22700 1 -- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00b12e0 msgr2=0x7fc1c00ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c5c22700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00b12e0 0x7fc1c00ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c5c22700 1 -- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1ac003a60 msgr2=0x7fc1c0149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c5c22700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1ac003a60 0x7fc1c0149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.789+0000 7fc1c5c22700 1 -- 172.21.15.61:0/2711942825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c00b2110 con 0x7fc1c00adad0 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.790+0000 7fc1c5421700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1ac003a60 0x7fc1c0149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.790+0000 7fc1c5c22700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1c00adad0 0x7fc1c00c3090 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc1c015b450 tx=0x7fc1b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.790+0000 7fc1b57fa700 1 -- 172.21.15.61:0/2711942825 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b801b070 con 0x7fc1c00adad0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.790+0000 7fc1b57fa700 1 -- 172.21.15.61:0/2711942825 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b800f040 con 0x7fc1c00adad0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.790+0000 7fc1c7685700 1 -- 172.21.15.61:0/2711942825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c00b23f0 con 0x7fc1c00adad0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.790+0000 7fc1b57fa700 1 -- 172.21.15.61:0/2711942825 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800e050 con 0x7fc1c00adad0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.790+0000 7fc1c7685700 1 -- 172.21.15.61:0/2711942825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c00c35d0 con 0x7fc1c00adad0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.791+0000 7fc1c7685700 1 -- 172.21.15.61:0/2711942825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c004c3c0 con 0x7fc1c00adad0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.791+0000 7fc1b57fa700 1 -- 172.21.15.61:0/2711942825 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc1b8003020 con 0x7fc1c00adad0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.792+0000 7fc1b57fa700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc1a4066f30 0x7fc1a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.792+0000 7fc1b57fa700 1 -- 172.21.15.61:0/2711942825 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc1b8084a80 con 0x7fc1c00adad0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.792+0000 7fc1b57fa700 1 -- 172.21.15.61:0/2711942825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7fc1a406ea50 con 0x7fc1c00adad0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.792+0000 7fc1c5421700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc1a4066f30 0x7fc1a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:27.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.793+0000 7fc1c5421700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc1a4066f30 0x7fc1a40693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0000ef0 tx=0x7fc1b0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:27.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.796+0000 7fc1b57fa700 1 -- 172.21.15.61:0/2711942825 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1b8051cf0 con 0x7fc1c00adad0 2023-12-24T20:00:27.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.991+0000 7fc1c7685700 1 -- 172.21.15.61:0/2711942825 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1c00b25e0 con 0x7fc1c00adad0 2023-12-24T20:00:27.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.992+0000 7fc1b57fa700 1 -- 172.21.15.61:0/2711942825 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1b8010ea0 con 0x7fc1c00adad0 2023-12-24T20:00:27.992 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:00:27.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 -- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc1a4066f30 msgr2=0x7fc1a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc1a4066f30 0x7fc1a40693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0000ef0 tx=0x7fc1b0015000 comp rx=0 tx=0).stop 2023-12-24T20:00:27.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 -- 172.21.15.61:0/2711942825 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1c00adad0 msgr2=0x7fc1c00c3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:27.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1c00adad0 0x7fc1c00c3090 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc1c015b450 tx=0x7fc1b800b040 comp rx=0 tx=0).stop 2023-12-24T20:00:27.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 -- 172.21.15.61:0/2711942825 shutdown_connections 2023-12-24T20:00:27.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc1a4066f30 0x7fc1a40693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc1c00adad0 0x7fc1c00c3090 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1ac003a60 0x7fc1c0149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 --2- 172.21.15.61:0/2711942825 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc1c00b12e0 0x7fc1c00ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:27.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 -- 172.21.15.61:0/2711942825 >> 172.21.15.61:0/2711942825 conn(0x7fc1c00cd0b0 msgr2=0x7fc1c006d960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:27.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 -- 172.21.15.61:0/2711942825 shutdown_connections 2023-12-24T20:00:27.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:27.994+0000 7fc1c7685700 1 -- 172.21.15.61:0/2711942825 wait complete. 2023-12-24T20:00:28.006 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:00:28.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.130+0000 7ff78afc5700 1 Processor -- start 2023-12-24T20:00:28.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.130+0000 7ff78afc5700 1 -- start start 2023-12-24T20:00:28.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.131+0000 7ff78afc5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406b320 0x7ff78415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.131+0000 7ff78afc5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78415aa10 con 0x7ff784159bb0 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.131+0000 7ff78afc5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78406fa30 con 0x7ff78406ed20 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.131+0000 7ff78afc5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78415b3e0 con 0x7ff78406b320 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.131+0000 7ff788d61700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff784159bb0 0x7ff78406ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51618/0 (socket says 172.21.15.61:51618) 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.131+0000 7ff788d61700 1 -- 172.21.15.61:0/232074604 learned_addr learned my addr 172.21.15.61:0/232074604 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff783fff700 1 --2- 172.21.15.61:0/232074604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406b320 0x7ff78415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff7837fe700 1 -- 172.21.15.61:0/232074604 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003528554 0 0) 0x7ff78415aa10 con 0x7ff784159bb0 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff7837fe700 1 -- 172.21.15.61:0/232074604 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff774003570 con 0x7ff784159bb0 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff7837fe700 1 -- 172.21.15.61:0/232074604 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431163891 0 0) 0x7ff78406fa30 con 0x7ff78406ed20 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff7837fe700 1 -- 172.21.15.61:0/232074604 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff78415aa10 con 0x7ff78406ed20 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff7837fe700 1 -- 172.21.15.61:0/232074604 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3700046358 0 0) 0x7ff774003570 con 0x7ff784159bb0 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff783fff700 1 -- 172.21.15.61:0/232074604 >> v1:172.21.15.133:6789/0 conn(0x7ff78406ed20 legacy=0x7ff78406f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff783fff700 1 -- 172.21.15.61:0/232074604 >> v1:172.21.15.61:6789/0 conn(0x7ff784159bb0 legacy=0x7ff78406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff783fff700 1 -- 172.21.15.61:0/232074604 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78415a3c0 con 0x7ff78406b320 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff783fff700 1 --2- 172.21.15.61:0/232074604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406b320 0x7ff78415aea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff770009910 tx=0x7ff7700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=104d903ce73b3b02 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff7837fe700 1 -- 172.21.15.61:0/232074604 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778001470 con 0x7ff78406b320 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff7837fe700 1 -- 172.21.15.61:0/232074604 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770011420 con 0x7ff78406b320 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.132+0000 7ff7837fe700 1 -- 172.21.15.61:0/232074604 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7700117c0 con 0x7ff78406b320 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.133+0000 7ff78afc5700 1 -- 172.21.15.61:0/232074604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406b320 msgr2=0x7ff78415aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.133+0000 7ff78afc5700 1 --2- 172.21.15.61:0/232074604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406b320 0x7ff78415aea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff770009910 tx=0x7ff7700091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.133+0000 7ff78afc5700 1 -- 172.21.15.61:0/232074604 shutdown_connections 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.133+0000 7ff78afc5700 1 --2- 172.21.15.61:0/232074604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406b320 0x7ff78415aea0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.133+0000 7ff78afc5700 1 -- 172.21.15.61:0/232074604 >> 172.21.15.61:0/232074604 conn(0x7ff7840ce800 msgr2=0x7ff7840cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.133+0000 7ff78afc5700 1 -- 172.21.15.61:0/232074604 shutdown_connections 2023-12-24T20:00:28.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.133+0000 7ff78afc5700 1 -- 172.21.15.61:0/232074604 wait complete. 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.134+0000 7ff78afc5700 1 Processor -- start 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.134+0000 7ff78afc5700 1 -- start start 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff78afc5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff78406b320 0x7ff78415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff78afc5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406ed20 0x7ff78415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff78afc5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff784159bb0 0x7ff7840b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff78afc5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78415f540 con 0x7ff784159bb0 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff78afc5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840b1650 con 0x7ff78406b320 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff78afc5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840b1930 con 0x7ff78406ed20 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff789562700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff784159bb0 0x7ff7840b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff789562700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff784159bb0 0x7ff7840b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48150/0 (socket says 172.21.15.61:48150) 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff789562700 1 -- 172.21.15.61:0/2391944429 learned_addr learned my addr 172.21.15.61:0/2391944429 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff783fff700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406ed20 0x7ff78415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff788d61700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff78406b320 0x7ff78415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff789562700 1 -- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406ed20 msgr2=0x7ff78415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff789562700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406ed20 0x7ff78415cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff789562700 1 -- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff78406b320 msgr2=0x7ff78415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff789562700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff78406b320 0x7ff78415c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.135+0000 7ff789562700 1 -- 172.21.15.61:0/2391944429 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff770009420 con 0x7ff784159bb0 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.136+0000 7ff789562700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff784159bb0 0x7ff7840b3960 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00c910 tx=0x7ff77c0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.136+0000 7ff780ff9700 1 -- 172.21.15.61:0/2391944429 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c012630 con 0x7ff784159bb0 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.136+0000 7ff780ff9700 1 -- 172.21.15.61:0/2391944429 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c0127b0 con 0x7ff784159bb0 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.136+0000 7ff78afc5700 1 -- 172.21.15.61:0/2391944429 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7840b1c10 con 0x7ff784159bb0 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.136+0000 7ff780ff9700 1 -- 172.21.15.61:0/2391944429 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c012b70 con 0x7ff784159bb0 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.136+0000 7ff78afc5700 1 -- 172.21.15.61:0/2391944429 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7840b21d0 con 0x7ff784159bb0 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.137+0000 7ff78afc5700 1 -- 172.21.15.61:0/2391944429 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7840b2360 con 0x7ff784159bb0 2023-12-24T20:00:28.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.137+0000 7ff780ff9700 1 -- 172.21.15.61:0/2391944429 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff77c01b400 con 0x7ff784159bb0 2023-12-24T20:00:28.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.138+0000 7ff780ff9700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff768066f30 0x7ff7680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.138+0000 7ff780ff9700 1 -- 172.21.15.61:0/2391944429 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff77c084930 con 0x7ff784159bb0 2023-12-24T20:00:28.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.138+0000 7ff780ff9700 1 -- 172.21.15.61:0/2391944429 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7ff76806ea50 con 0x7ff784159bb0 2023-12-24T20:00:28.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.138+0000 7ff788d61700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff768066f30 0x7ff7680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.138+0000 7ff788d61700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff768066f30 0x7ff7680693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff7780011e0 tx=0x7ff778000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:28.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.142+0000 7ff780ff9700 1 -- 172.21.15.61:0/2391944429 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff77c016020 con 0x7ff784159bb0 2023-12-24T20:00:28.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.337+0000 7ff78afc5700 1 -- 172.21.15.61:0/2391944429 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff78404c3c0 con 0x7ff784159bb0 2023-12-24T20:00:28.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.337+0000 7ff780ff9700 1 -- 172.21.15.61:0/2391944429 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff77c051b00 con 0x7ff784159bb0 2023-12-24T20:00:28.338 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T20:00:28.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 -- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff768066f30 msgr2=0x7ff7680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff768066f30 0x7ff7680693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff7780011e0 tx=0x7ff778000bc0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 -- 172.21.15.61:0/2391944429 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff784159bb0 msgr2=0x7ff7840b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff784159bb0 0x7ff7840b3960 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00c910 tx=0x7ff77c0027a0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 -- 172.21.15.61:0/2391944429 shutdown_connections 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff768066f30 0x7ff7680693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff784159bb0 0x7ff7840b3960 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff78406b320 0x7ff78415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 --2- 172.21.15.61:0/2391944429 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff78406ed20 0x7ff78415cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 -- 172.21.15.61:0/2391944429 >> 172.21.15.61:0/2391944429 conn(0x7ff7840ce800 msgr2=0x7ff78406f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 -- 172.21.15.61:0/2391944429 shutdown_connections 2023-12-24T20:00:28.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.339+0000 7ff78afc5700 1 -- 172.21.15.61:0/2391944429 wait complete. 2023-12-24T20:00:28.351 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:00:28.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.476+0000 7f23c1698700 1 Processor -- start 2023-12-24T20:00:28.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.476+0000 7f23c1698700 1 -- start start 2023-12-24T20:00:28.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.477+0000 7f23c1698700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f23bc0cd500 0x7f23bc0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.477+0000 7f23c1698700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23bc0d0620 0x7f23bc0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.477+0000 7f23c1698700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23bc0d0190 con 0x7f23bc0cbfe0 2023-12-24T20:00:28.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.477+0000 7f23c1698700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0cf580 con 0x7f23bc0cd500 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.477+0000 7f23c1698700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0cf860 con 0x7f23bc0d0620 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.477+0000 7f23baffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f23bc0cd500 0x7f23bc0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.477+0000 7f23ba7fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f23bc0cbfe0 0x7f23bc159750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51624/0 (socket says 172.21.15.61:51624) 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.477+0000 7f23ba7fc700 1 -- 172.21.15.61:0/552343290 learned_addr learned my addr 172.21.15.61:0/552343290 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23bb7fe700 1 --2- 172.21.15.61:0/552343290 >> v2:172.21.15.133:3300/0 conn(0x7f23bc0d0620 0x7f23bc0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23baffd700 1 -- 172.21.15.61:0/552343290 >> v2:172.21.15.133:3300/0 conn(0x7f23bc0d0620 msgr2=0x7f23bc0b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23baffd700 1 --2- 172.21.15.61:0/552343290 >> v2:172.21.15.133:3300/0 conn(0x7f23bc0d0620 0x7f23bc0b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23baffd700 1 -- 172.21.15.61:0/552343290 >> v1:172.21.15.61:6789/0 conn(0x7f23bc0cbfe0 legacy=0x7f23bc159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23baffd700 1 -- 172.21.15.61:0/552343290 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0cfb40 con 0x7f23bc0cd500 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23b9ffb700 1 -- 172.21.15.61:0/552343290 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756767947 0 0) 0x7f23bc0d0190 con 0x7f23bc0cbfe0 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23bb7fe700 1 --2- 172.21.15.61:0/552343290 >> v2:172.21.15.133:3300/0 conn(0x7f23bc0d0620 0x7f23bc0b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23baffd700 1 --2- 172.21.15.61:0/552343290 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0cd500 0x7f23bc0cbaa0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0ccb90 tx=0x7f23a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3998215f7f6f74 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23b9ffb700 1 -- 172.21.15.61:0/552343290 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a400b6b0 con 0x7f23bc0cd500 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23b9ffb700 1 -- 172.21.15.61:0/552343290 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a400b810 con 0x7f23bc0cd500 2023-12-24T20:00:28.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.478+0000 7f23b9ffb700 1 -- 172.21.15.61:0/552343290 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a400bbb0 con 0x7f23bc0cd500 2023-12-24T20:00:28.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.479+0000 7f23c1698700 1 -- 172.21.15.61:0/552343290 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0cd500 msgr2=0x7f23bc0cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.479+0000 7f23c1698700 1 --2- 172.21.15.61:0/552343290 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0cd500 0x7f23bc0cbaa0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0ccb90 tx=0x7f23a40091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.479+0000 7f23c1698700 1 -- 172.21.15.61:0/552343290 shutdown_connections 2023-12-24T20:00:28.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.479+0000 7f23c1698700 1 --2- 172.21.15.61:0/552343290 >> v2:172.21.15.133:3300/0 conn(0x7f23bc0d0620 0x7f23bc0b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.479+0000 7f23c1698700 1 --2- 172.21.15.61:0/552343290 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0cd500 0x7f23bc0cbaa0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.479+0000 7f23c1698700 1 -- 172.21.15.61:0/552343290 >> 172.21.15.61:0/552343290 conn(0x7f23bc06e600 msgr2=0x7f23bc067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:28.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.479+0000 7f23c1698700 1 -- 172.21.15.61:0/552343290 shutdown_connections 2023-12-24T20:00:28.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.479+0000 7f23c1698700 1 -- 172.21.15.61:0/552343290 wait complete. 2023-12-24T20:00:28.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.480+0000 7f23c1698700 1 Processor -- start 2023-12-24T20:00:28.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.480+0000 7f23c1698700 1 -- start start 2023-12-24T20:00:28.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23c1698700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23bc0cd500 0x7f23bc14b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23c1698700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0d0620 0x7f23bc0c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23c1698700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23bc13bfb0 0x7f23bc14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23c1698700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc14c960 con 0x7f23bc0d0620 2023-12-24T20:00:28.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23c1698700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc14bd50 con 0x7f23bc13bfb0 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23c1698700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc14c030 con 0x7f23bc0cd500 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23ba7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0d0620 0x7f23bc0c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23ba7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0d0620 0x7f23bc0c7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48166/0 (socket says 172.21.15.61:48166) 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23ba7fc700 1 -- 172.21.15.61:0/2199539016 learned_addr learned my addr 172.21.15.61:0/2199539016 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23baffd700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23bc0cd500 0x7f23bc14b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23bb7fe700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23bc13bfb0 0x7f23bc14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23ba7fc700 1 -- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23bc0cd500 msgr2=0x7f23bc14b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23ba7fc700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23bc0cd500 0x7f23bc14b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23ba7fc700 1 -- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23bc13bfb0 msgr2=0x7f23bc14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23ba7fc700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23bc13bfb0 0x7f23bc14cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23ba7fc700 1 -- 172.21.15.61:0/2199539016 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4009420 con 0x7f23bc0d0620 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.481+0000 7f23ba7fc700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0d0620 0x7f23bc0c7ae0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00c810 tx=0x7f23ac007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.482+0000 7f23b2ffd700 1 -- 172.21.15.61:0/2199539016 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac005c00 con 0x7f23bc0d0620 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.482+0000 7f23b2ffd700 1 -- 172.21.15.61:0/2199539016 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac005d60 con 0x7f23bc0d0620 2023-12-24T20:00:28.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.482+0000 7f23b2ffd700 1 -- 172.21.15.61:0/2199539016 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac007300 con 0x7f23bc0d0620 2023-12-24T20:00:28.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.482+0000 7f23c1698700 1 -- 172.21.15.61:0/2199539016 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc14c310 con 0x7f23bc0d0620 2023-12-24T20:00:28.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.482+0000 7f23c1698700 1 -- 172.21.15.61:0/2199539016 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc0b6580 con 0x7f23bc0d0620 2023-12-24T20:00:28.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.482+0000 7f23c1698700 1 -- 172.21.15.61:0/2199539016 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23bc14cad0 con 0x7f23bc0d0620 2023-12-24T20:00:28.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.483+0000 7f23b2ffd700 1 -- 172.21.15.61:0/2199539016 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f23ac01b3b0 con 0x7f23bc0d0620 2023-12-24T20:00:28.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.483+0000 7f23b2ffd700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f239c066f30 0x7f239c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.483+0000 7f23b2ffd700 1 -- 172.21.15.61:0/2199539016 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23ac0839f0 con 0x7f23bc0d0620 2023-12-24T20:00:28.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.484+0000 7f23b2ffd700 1 -- 172.21.15.61:0/2199539016 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7f239c06ea50 con 0x7f23bc0d0620 2023-12-24T20:00:28.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.484+0000 7f23baffd700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f239c066f30 0x7f239c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.484+0000 7f23baffd700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f239c066f30 0x7f239c0693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f23a40093f0 tx=0x7f23a4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:28.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.488+0000 7f23b2ffd700 1 -- 172.21.15.61:0/2199539016 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23ac017020 con 0x7f23bc0d0620 2023-12-24T20:00:28.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.681+0000 7f23c1698700 1 -- 172.21.15.61:0/2199539016 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23bc04c3c0 con 0x7f23bc0d0620 2023-12-24T20:00:28.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.682+0000 7f23b2ffd700 1 -- 172.21.15.61:0/2199539016 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f23ac050c60 con 0x7f23bc0d0620 2023-12-24T20:00:28.682 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T20:00:28.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 -- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f239c066f30 msgr2=0x7f239c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f239c066f30 0x7f239c0693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f23a40093f0 tx=0x7f23a4017000 comp rx=0 tx=0).stop 2023-12-24T20:00:28.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 -- 172.21.15.61:0/2199539016 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0d0620 msgr2=0x7f23bc0c7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0d0620 0x7f23bc0c7ae0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00c810 tx=0x7f23ac007db0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 -- 172.21.15.61:0/2199539016 shutdown_connections 2023-12-24T20:00:28.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23bc0cd500 0x7f23bc14b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f239c066f30 0x7f239c0693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23bc13bfb0 0x7f23bc14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 --2- 172.21.15.61:0/2199539016 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23bc0d0620 0x7f23bc0c7ae0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 -- 172.21.15.61:0/2199539016 >> 172.21.15.61:0/2199539016 conn(0x7f23bc06e600 msgr2=0x7f23bc154940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:28.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 -- 172.21.15.61:0/2199539016 shutdown_connections 2023-12-24T20:00:28.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.684+0000 7f23c1698700 1 -- 172.21.15.61:0/2199539016 wait complete. 2023-12-24T20:00:28.697 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:00:28.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.818+0000 7f29c34df700 1 Processor -- start 2023-12-24T20:00:28.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.819+0000 7f29c34df700 1 -- start start 2023-12-24T20:00:28.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.819+0000 7f29c34df700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29bc068510 0x7f29bc0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29c34df700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc0b2890 con 0x7f29bc159a60 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29c34df700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc0cf630 con 0x7f29bc068140 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29c34df700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc0b2240 con 0x7f29bc068510 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29c1a7c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f29bc159a60 0x7f29bc159ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51634/0 (socket says 172.21.15.61:51634) 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29c1a7c700 1 -- 172.21.15.61:0/649855044 learned_addr learned my addr 172.21.15.61:0/649855044 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29c0a7a700 1 --2- 172.21.15.61:0/649855044 >> v2:172.21.15.133:3300/0 conn(0x7f29bc068510 0x7f29bc0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29b3fff700 1 -- 172.21.15.61:0/649855044 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126488033 0 0) 0x7f29bc0b2890 con 0x7f29bc159a60 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29b3fff700 1 -- 172.21.15.61:0/649855044 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a8003570 con 0x7f29bc159a60 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29b3fff700 1 -- 172.21.15.61:0/649855044 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278804552 0 0) 0x7f29bc0cf630 con 0x7f29bc068140 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29b3fff700 1 -- 172.21.15.61:0/649855044 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29bc0b2890 con 0x7f29bc068140 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29b3fff700 1 -- 172.21.15.61:0/649855044 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 237159032 0 0) 0x7f29a8003570 con 0x7f29bc159a60 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29c0a7a700 1 -- 172.21.15.61:0/649855044 >> v1:172.21.15.133:6789/0 conn(0x7f29bc068140 legacy=0x7f29bc0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29c0a7a700 1 -- 172.21.15.61:0/649855044 >> v1:172.21.15.61:6789/0 conn(0x7f29bc159a60 legacy=0x7f29bc159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.820+0000 7f29c0a7a700 1 -- 172.21.15.61:0/649855044 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0b2520 con 0x7f29bc068510 2023-12-24T20:00:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29c0a7a700 1 --2- 172.21.15.61:0/649855044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29bc068510 0x7f29bc0cefa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0098e0 tx=0x7f29ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55bd4b60a64e5c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29b3fff700 1 -- 172.21.15.61:0/649855044 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40017f0 con 0x7f29bc068510 2023-12-24T20:00:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29b3fff700 1 -- 172.21.15.61:0/649855044 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac011420 con 0x7f29bc068510 2023-12-24T20:00:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29b3fff700 1 -- 172.21.15.61:0/649855044 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac0117a0 con 0x7f29bc068510 2023-12-24T20:00:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29c34df700 1 -- 172.21.15.61:0/649855044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29bc068510 msgr2=0x7f29bc0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29c34df700 1 --2- 172.21.15.61:0/649855044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29bc068510 0x7f29bc0cefa0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0098e0 tx=0x7f29ac0091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29c34df700 1 -- 172.21.15.61:0/649855044 shutdown_connections 2023-12-24T20:00:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29c34df700 1 --2- 172.21.15.61:0/649855044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29bc068510 0x7f29bc0cefa0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29c34df700 1 -- 172.21.15.61:0/649855044 >> 172.21.15.61:0/649855044 conn(0x7f29bc097a10 msgr2=0x7f29bc0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29c34df700 1 -- 172.21.15.61:0/649855044 shutdown_connections 2023-12-24T20:00:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.821+0000 7f29c34df700 1 -- 172.21.15.61:0/649855044 wait complete. 2023-12-24T20:00:28.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.822+0000 7f29c34df700 1 Processor -- start 2023-12-24T20:00:28.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.823+0000 7f29c34df700 1 -- start start 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.823+0000 7f29c34df700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29bc068140 0x7f29bc151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.823+0000 7f29c34df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29bc068510 0x7f29bc150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.823+0000 7f29c34df700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29bc159a60 0x7f29bc09b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.823+0000 7f29c34df700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc153200 con 0x7f29bc159a60 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.823+0000 7f29c34df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc09ba00 con 0x7f29bc068510 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.823+0000 7f29c34df700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc09bcd0 con 0x7f29bc068140 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c1a7c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29bc159a60 0x7f29bc09b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c1a7c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29bc159a60 0x7f29bc09b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48168/0 (socket says 172.21.15.61:48168) 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c1a7c700 1 -- 172.21.15.61:0/2937876961 learned_addr learned my addr 172.21.15.61:0/2937876961 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c127b700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29bc068140 0x7f29bc151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c1a7c700 1 -- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29bc068140 msgr2=0x7f29bc151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c0a7a700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29bc068510 0x7f29bc150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c1a7c700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29bc068140 0x7f29bc151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c1a7c700 1 -- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29bc068510 msgr2=0x7f29bc150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c1a7c700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29bc068510 0x7f29bc150310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c1a7c700 1 -- 172.21.15.61:0/2937876961 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac009420 con 0x7f29bc159a60 2023-12-24T20:00:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c127b700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29bc068140 0x7f29bc151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c1a7c700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29bc159a60 0x7f29bc09b4c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f29b4001560 tx=0x7f29b4007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29b17fa700 1 -- 172.21.15.61:0/2937876961 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4004dc0 con 0x7f29bc159a60 2023-12-24T20:00:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29b17fa700 1 -- 172.21.15.61:0/2937876961 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b400a710 con 0x7f29bc159a60 2023-12-24T20:00:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c34df700 1 -- 172.21.15.61:0/2937876961 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc09bfb0 con 0x7f29bc159a60 2023-12-24T20:00:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29b17fa700 1 -- 172.21.15.61:0/2937876961 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b400aad0 con 0x7f29bc159a60 2023-12-24T20:00:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.824+0000 7f29c34df700 1 -- 172.21.15.61:0/2937876961 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc152e20 con 0x7f29bc159a60 2023-12-24T20:00:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.825+0000 7f29c34df700 1 -- 172.21.15.61:0/2937876961 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc1533b0 con 0x7f29bc159a60 2023-12-24T20:00:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.826+0000 7f29b17fa700 1 -- 172.21.15.61:0/2937876961 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f29b4007150 con 0x7f29bc159a60 2023-12-24T20:00:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.826+0000 7f29b17fa700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29a0066f30 0x7f29a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.826+0000 7f29b17fa700 1 -- 172.21.15.61:0/2937876961 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29b40840a0 con 0x7f29bc159a60 2023-12-24T20:00:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.826+0000 7f29b17fa700 1 -- 172.21.15.61:0/2937876961 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7f29a006ea50 con 0x7f29bc159a60 2023-12-24T20:00:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.826+0000 7f29c127b700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29a0066f30 0x7f29a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.827+0000 7f29c127b700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29a0066f30 0x7f29a00693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000c00 tx=0x7f29b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:28.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:28.831+0000 7f29b17fa700 1 -- 172.21.15.61:0/2937876961 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29b4018020 con 0x7f29bc159a60 2023-12-24T20:00:29.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.071+0000 7f29c34df700 1 -- 172.21.15.61:0/2937876961 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29bc06d440 con 0x7f29bc159a60 2023-12-24T20:00:29.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.071+0000 7f29b17fa700 1 -- 172.21.15.61:0/2937876961 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f29bc1533b0 con 0x7f29bc159a60 2023-12-24T20:00:29.072 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:29.072 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2177201507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2177201507},{"type":"v1","addr":"172.21.15.61:6835","nonce":2177201507}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1435257239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1435257239},{"type":"v1","addr":"172.21.15.133:6837","nonce":1435257239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/696274590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":696274590},{"type":"v1","addr":"172.21.15.133:6836","nonce":696274590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:59:24.619081+0000","modified":"2023-12-24T19:59:28.258285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/3751369981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3751369981},{"type":"v1","addr":"172.21.15.61:6834","nonce":3751369981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 -- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29a0066f30 msgr2=0x7f29a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29a0066f30 0x7f29a00693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000c00 tx=0x7f29b8009040 comp rx=0 tx=0).stop 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 -- 172.21.15.61:0/2937876961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29bc159a60 msgr2=0x7f29bc09b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29bc159a60 0x7f29bc09b4c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f29b4001560 tx=0x7f29b4007d20 comp rx=0 tx=0).stop 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 -- 172.21.15.61:0/2937876961 shutdown_connections 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29bc068140 0x7f29bc151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29a0066f30 0x7f29a00693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29bc159a60 0x7f29bc09b4c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 --2- 172.21.15.61:0/2937876961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29bc068510 0x7f29bc150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 -- 172.21.15.61:0/2937876961 >> 172.21.15.61:0/2937876961 conn(0x7f29bc097a10 msgr2=0x7f29bc157610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 -- 172.21.15.61:0/2937876961 shutdown_connections 2023-12-24T20:00:29.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.073+0000 7f29c34df700 1 -- 172.21.15.61:0/2937876961 wait complete. 2023-12-24T20:00:29.075 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 35 2023-12-24T20:00:29.086 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:00:29.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.207+0000 7f2bfcec9700 1 Processor -- start 2023-12-24T20:00:29.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.207+0000 7f2bfcec9700 1 -- start start 2023-12-24T20:00:29.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.208+0000 7f2bfcec9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf80b3d30 0x7f2bf80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.208+0000 7f2bfcec9700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf80b2890 con 0x7f2bf8068510 2023-12-24T20:00:29.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.208+0000 7f2bfcec9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf80cf630 con 0x7f2bf8068140 2023-12-24T20:00:29.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.208+0000 7f2bfcec9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80b2240 con 0x7f2bf80b3d30 2023-12-24T20:00:29.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf5d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2bf8068510 0x7f2bf8159a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51640/0 (socket says 172.21.15.61:51640) 2023-12-24T20:00:29.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf5d9b700 1 -- 172.21.15.61:0/751293931 learned_addr learned my addr 172.21.15.61:0/751293931 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:29.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf6d9d700 1 --2- 172.21.15.61:0/751293931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf80b3d30 0x7f2bf80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf559a700 1 -- 172.21.15.61:0/751293931 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325518954 0 0) 0x7f2bf80b2890 con 0x7f2bf8068510 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf559a700 1 -- 172.21.15.61:0/751293931 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2be0003570 con 0x7f2bf8068510 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf559a700 1 -- 172.21.15.61:0/751293931 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910491428 0 0) 0x7f2bf80cf630 con 0x7f2bf8068140 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf559a700 1 -- 172.21.15.61:0/751293931 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf80b2890 con 0x7f2bf8068140 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf559a700 1 -- 172.21.15.61:0/751293931 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 631261804 0 0) 0x7f2be0003570 con 0x7f2bf8068510 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf6d9d700 1 -- 172.21.15.61:0/751293931 >> v1:172.21.15.133:6789/0 conn(0x7f2bf8068140 legacy=0x7f2bf80b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf6d9d700 1 -- 172.21.15.61:0/751293931 >> v1:172.21.15.61:6789/0 conn(0x7f2bf8068510 legacy=0x7f2bf8159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf6d9d700 1 -- 172.21.15.61:0/751293931 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf80b2520 con 0x7f2bf80b3d30 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf6d9d700 1 --2- 172.21.15.61:0/751293931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf80b3d30 0x7f2bf80cefa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009e90 tx=0x7f2bf0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de7c9f8295a99993 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf559a700 1 -- 172.21.15.61:0/751293931 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf000e070 con 0x7f2bf80b3d30 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.209+0000 7f2bf559a700 1 -- 172.21.15.61:0/751293931 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf000b870 con 0x7f2bf80b3d30 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.210+0000 7f2bf559a700 1 -- 172.21.15.61:0/751293931 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec001470 con 0x7f2bf80b3d30 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.210+0000 7f2bfcec9700 1 -- 172.21.15.61:0/751293931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf80b3d30 msgr2=0x7f2bf80cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.210+0000 7f2bfcec9700 1 --2- 172.21.15.61:0/751293931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf80b3d30 0x7f2bf80cefa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009e90 tx=0x7f2bf0009780 comp rx=0 tx=0).stop 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.210+0000 7f2bfcec9700 1 -- 172.21.15.61:0/751293931 shutdown_connections 2023-12-24T20:00:29.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.210+0000 7f2bfcec9700 1 --2- 172.21.15.61:0/751293931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf80b3d30 0x7f2bf80cefa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.210+0000 7f2bfcec9700 1 -- 172.21.15.61:0/751293931 >> 172.21.15.61:0/751293931 conn(0x7f2bf8097a10 msgr2=0x7f2bf80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:29.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.210+0000 7f2bfcec9700 1 -- 172.21.15.61:0/751293931 shutdown_connections 2023-12-24T20:00:29.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.210+0000 7f2bfcec9700 1 -- 172.21.15.61:0/751293931 wait complete. 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.211+0000 7f2bfcec9700 1 Processor -- start 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.211+0000 7f2bfcec9700 1 -- start start 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bfcec9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf8068140 0x7f2bf81598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bfcec9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2bf8068510 0x7f2bf815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bfcec9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf80b3d30 0x7f2bf816d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bfcec9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf815b280 con 0x7f2bf8068510 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bfcec9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf815a1e0 con 0x7f2bf80b3d30 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bfcec9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf815a4c0 con 0x7f2bf8068140 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bf5d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2bf8068510 0x7f2bf815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bf5d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2bf8068510 0x7f2bf815c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48172/0 (socket says 172.21.15.61:48172) 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bf5d9b700 1 -- 172.21.15.61:0/39516829 learned_addr learned my addr 172.21.15.61:0/39516829 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:29.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bf659c700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf8068140 0x7f2bf81598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.212+0000 7f2bf6d9d700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf80b3d30 0x7f2bf816d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2bf5d9b700 1 -- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf8068140 msgr2=0x7f2bf81598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2bf5d9b700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf8068140 0x7f2bf81598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2bf5d9b700 1 -- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf80b3d30 msgr2=0x7f2bf816d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2bf5d9b700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf80b3d30 0x7f2bf816d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2bf5d9b700 1 -- 172.21.15.61:0/39516829 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0009a20 con 0x7f2bf8068510 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2bf5d9b700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2bf8068510 0x7f2bf815c770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00cb70 tx=0x7f2bec001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2be67fc700 1 -- 172.21.15.61:0/39516829 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec007360 con 0x7f2bf8068510 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2be67fc700 1 -- 172.21.15.61:0/39516829 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec0074e0 con 0x7f2bf8068510 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2bfcec9700 1 -- 172.21.15.61:0/39516829 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf815a7a0 con 0x7f2bf8068510 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2be67fc700 1 -- 172.21.15.61:0/39516829 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec004830 con 0x7f2bf8068510 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.213+0000 7f2bfcec9700 1 -- 172.21.15.61:0/39516829 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf815ade0 con 0x7f2bf8068510 2023-12-24T20:00:29.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.214+0000 7f2bfcec9700 1 -- 172.21.15.61:0/39516829 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf806d440 con 0x7f2bf8068510 2023-12-24T20:00:29.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.214+0000 7f2be67fc700 1 -- 172.21.15.61:0/39516829 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2bec004ba0 con 0x7f2bf8068510 2023-12-24T20:00:29.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.215+0000 7f2be67fc700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2bd8066f30 0x7f2bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.215+0000 7f2be67fc700 1 -- 172.21.15.61:0/39516829 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2bec083d00 con 0x7f2bf8068510 2023-12-24T20:00:29.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.215+0000 7f2bf659c700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2bd8066f30 0x7f2bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.215+0000 7f2be67fc700 1 -- 172.21.15.61:0/39516829 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7f2bd806ea50 con 0x7f2bf8068510 2023-12-24T20:00:29.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.216+0000 7f2bf659c700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2bd8066f30 0x7f2bd80693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2be8001170 tx=0x7f2be8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:29.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.219+0000 7f2be67fc700 1 -- 172.21.15.61:0/39516829 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2bec018060 con 0x7f2bf8068510 2023-12-24T20:00:29.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.418+0000 7f2bfcec9700 1 -- 172.21.15.61:0/39516829 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bf815af70 con 0x7f2bf8068510 2023-12-24T20:00:29.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.419+0000 7f2be67fc700 1 -- 172.21.15.61:0/39516829 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15408 (secure 0 0 0) 0x7f2bec050ff0 con 0x7f2bf8068510 2023-12-24T20:00:29.419 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:29.419 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":66,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T19:59:46.594692+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:59:23.050869+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-24T19:59:23.594703+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:00:29.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 -- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2bd8066f30 msgr2=0x7f2bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2bd8066f30 0x7f2bd80693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2be8001170 tx=0x7f2be8009040 comp rx=0 tx=0).stop 2023-12-24T20:00:29.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 -- 172.21.15.61:0/39516829 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2bf8068510 msgr2=0x7f2bf815c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2bf8068510 0x7f2bf815c770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00cb70 tx=0x7f2bec001b50 comp rx=0 tx=0).stop 2023-12-24T20:00:29.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 -- 172.21.15.61:0/39516829 shutdown_connections 2023-12-24T20:00:29.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2bf8068140 0x7f2bf81598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2bd8066f30 0x7f2bd80693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf80b3d30 0x7f2bf816d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 --2- 172.21.15.61:0/39516829 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2bf8068510 0x7f2bf815c770 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 -- 172.21.15.61:0/39516829 >> 172.21.15.61:0/39516829 conn(0x7f2bf8097a10 msgr2=0x7f2bf80af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:29.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 -- 172.21.15.61:0/39516829 shutdown_connections 2023-12-24T20:00:29.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.421+0000 7f2bfcec9700 1 -- 172.21.15.61:0/39516829 wait complete. 2023-12-24T20:00:29.434 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:00:29.434 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:00:29.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.556+0000 7f2ae3f38700 1 Processor -- start 2023-12-24T20:00:29.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.556+0000 7f2ae3f38700 1 -- start start 2023-12-24T20:00:29.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.557+0000 7f2ae3f38700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2adc159c10 0x7f2adc0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.557+0000 7f2ae3f38700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2adc0cc190 0x7f2adc0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.557+0000 7f2ae3f38700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0af880 con 0x7f2adc159fe0 2023-12-24T20:00:29.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.557+0000 7f2ae3f38700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0c6fc0 con 0x7f2adc159c10 2023-12-24T20:00:29.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.557+0000 7f2ae3f38700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0c63b0 con 0x7f2adc0cc190 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.557+0000 7f2ae1cd4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2adc159c10 0x7f2adc0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae1cd4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2adc159c10 0x7f2adc0c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48180/0 (socket says 172.21.15.61:48180) 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae1cd4700 1 -- 172.21.15.61:0/1919645026 learned_addr learned my addr 172.21.15.61:0/1919645026 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae24d5700 1 --2- 172.21.15.61:0/1919645026 >> v2:172.21.15.133:3300/0 conn(0x7f2adc0cc190 0x7f2adc0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae1cd4700 1 -- 172.21.15.61:0/1919645026 >> v2:172.21.15.133:3300/0 conn(0x7f2adc0cc190 msgr2=0x7f2adc0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae1cd4700 1 --2- 172.21.15.61:0/1919645026 >> v2:172.21.15.133:3300/0 conn(0x7f2adc0cc190 0x7f2adc0c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae1cd4700 1 -- 172.21.15.61:0/1919645026 >> v1:172.21.15.133:6789/0 conn(0x7f2adc159fe0 legacy=0x7f2adc0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae1cd4700 1 -- 172.21.15.61:0/1919645026 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0c6690 con 0x7f2adc159c10 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae1cd4700 1 --2- 172.21.15.61:0/1919645026 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159c10 0x7f2adc0c57d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0c62e0 tx=0x7f2ad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0c9fefcf7f630f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae0cd2700 1 -- 172.21.15.61:0/1919645026 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8009e70 con 0x7f2adc159c10 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae0cd2700 1 -- 172.21.15.61:0/1919645026 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad800b860 con 0x7f2adc159c10 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.558+0000 7f2ae0cd2700 1 -- 172.21.15.61:0/1919645026 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad800bc00 con 0x7f2adc159c10 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.559+0000 7f2ae3f38700 1 -- 172.21.15.61:0/1919645026 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159c10 msgr2=0x7f2adc0c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.559+0000 7f2ae3f38700 1 --2- 172.21.15.61:0/1919645026 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159c10 0x7f2adc0c57d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0c62e0 tx=0x7f2ad8009250 comp rx=0 tx=0).stop 2023-12-24T20:00:29.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.559+0000 7f2ae3f38700 1 -- 172.21.15.61:0/1919645026 shutdown_connections 2023-12-24T20:00:29.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.559+0000 7f2ae3f38700 1 --2- 172.21.15.61:0/1919645026 >> v2:172.21.15.133:3300/0 conn(0x7f2adc0cc190 0x7f2adc0c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.559+0000 7f2ae3f38700 1 --2- 172.21.15.61:0/1919645026 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159c10 0x7f2adc0c57d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.559+0000 7f2ae3f38700 1 -- 172.21.15.61:0/1919645026 >> 172.21.15.61:0/1919645026 conn(0x7f2adc06e640 msgr2=0x7f2adc067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:29.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.559+0000 7f2ae3f38700 1 -- 172.21.15.61:0/1919645026 shutdown_connections 2023-12-24T20:00:29.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.559+0000 7f2ae3f38700 1 -- 172.21.15.61:0/1919645026 wait complete. 2023-12-24T20:00:29.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.560+0000 7f2ae3f38700 1 Processor -- start 2023-12-24T20:00:29.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.560+0000 7f2ae3f38700 1 -- start start 2023-12-24T20:00:29.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae3f38700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2adc0cc190 0x7f2adc13e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae3f38700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc159c10 0x7f2adc0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae3f38700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159fe0 0x7f2adc0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae3f38700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b11c0 con 0x7f2adc159fe0 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae3f38700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc13ea50 con 0x7f2adc159c10 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae3f38700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b4140 con 0x7f2adc0cc190 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae24d5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159fe0 0x7f2adc0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae24d5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159fe0 0x7f2adc0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48190/0 (socket says 172.21.15.61:48190) 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae24d5700 1 -- 172.21.15.61:0/2226388867 learned_addr learned my addr 172.21.15.61:0/2226388867 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae14d3700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc159c10 0x7f2adc0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae1cd4700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2adc0cc190 0x7f2adc13e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae24d5700 1 -- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2adc0cc190 msgr2=0x7f2adc13e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae24d5700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2adc0cc190 0x7f2adc13e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae24d5700 1 -- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc159c10 msgr2=0x7f2adc0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae24d5700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc159c10 0x7f2adc0b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae24d5700 1 -- 172.21.15.61:0/2226388867 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80094f0 con 0x7f2adc159fe0 2023-12-24T20:00:29.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae24d5700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159fe0 0x7f2adc0d0a10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009d70 tx=0x7f2ad400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:29.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ad1ffb700 1 -- 172.21.15.61:0/2226388867 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400caa0 con 0x7f2adc159fe0 2023-12-24T20:00:29.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ad1ffb700 1 -- 172.21.15.61:0/2226388867 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad400f040 con 0x7f2adc159fe0 2023-12-24T20:00:29.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.561+0000 7f2ae3f38700 1 -- 172.21.15.61:0/2226388867 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc0b0b70 con 0x7f2adc159fe0 2023-12-24T20:00:29.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.562+0000 7f2ad1ffb700 1 -- 172.21.15.61:0/2226388867 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400ce50 con 0x7f2adc159fe0 2023-12-24T20:00:29.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.562+0000 7f2ae3f38700 1 -- 172.21.15.61:0/2226388867 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc0b3d10 con 0x7f2adc159fe0 2023-12-24T20:00:29.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.563+0000 7f2ae3f38700 1 -- 172.21.15.61:0/2226388867 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc0890b0 con 0x7f2adc159fe0 2023-12-24T20:00:29.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.563+0000 7f2ad1ffb700 1 -- 172.21.15.61:0/2226388867 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2ad4014690 con 0x7f2adc159fe0 2023-12-24T20:00:29.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.563+0000 7f2ad1ffb700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac0066f30 0x7f2ac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.564+0000 7f2ad1ffb700 1 -- 172.21.15.61:0/2226388867 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ad40850a0 con 0x7f2adc159fe0 2023-12-24T20:00:29.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.564+0000 7f2ae1cd4700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac0066f30 0x7f2ac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.564+0000 7f2ad1ffb700 1 -- 172.21.15.61:0/2226388867 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7f2ac006ea50 con 0x7f2adc159fe0 2023-12-24T20:00:29.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.564+0000 7f2ae1cd4700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac0066f30 0x7f2ac00693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0c62e0 tx=0x7f2ad8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:29.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.568+0000 7f2ad1ffb700 1 -- 172.21.15.61:0/2226388867 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ad4052310 con 0x7f2adc159fe0 2023-12-24T20:00:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.676+0000 7f2ad1ffb700 1 -- 172.21.15.61:0/2226388867 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(67..67 src has 1..67) v4 ==== 288+0+0 (secure 0 0 0) 0x7f2ad40566d0 con 0x7f2adc159fe0 2023-12-24T20:00:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.676+0000 7f2ad1ffb700 1 -- 172.21.15.61:0/2226388867 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7f2ac006f3a0 con 0x7f2adc159fe0 2023-12-24T20:00:29.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.811+0000 7f2ae3f38700 1 -- 172.21.15.61:0/2226388867 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2adc04c3c0 con 0x7f2adc159fe0 2023-12-24T20:00:29.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.812+0000 7f2ad1ffb700 1 -- 172.21.15.61:0/2226388867 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f2ad4018020 con 0x7f2adc159fe0 2023-12-24T20:00:29.812 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:29.812 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2177201507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2177201507},{"type":"v1","addr":"172.21.15.61:6835","nonce":2177201507}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1435257239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1435257239},{"type":"v1","addr":"172.21.15.133:6837","nonce":1435257239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/696274590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":696274590},{"type":"v1","addr":"172.21.15.133:6836","nonce":696274590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:59:24.619081+0000","modified":"2023-12-24T19:59:28.258285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/3751369981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3751369981},{"type":"v1","addr":"172.21.15.61:6834","nonce":3751369981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T20:00:29.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 -- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac0066f30 msgr2=0x7f2ac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac0066f30 0x7f2ac00693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0c62e0 tx=0x7f2ad8017000 comp rx=0 tx=0).stop 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 -- 172.21.15.61:0/2226388867 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159fe0 msgr2=0x7f2adc0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159fe0 0x7f2adc0d0a10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009d70 tx=0x7f2ad400b040 comp rx=0 tx=0).stop 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 -- 172.21.15.61:0/2226388867 shutdown_connections 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2adc0cc190 0x7f2adc13e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ac0066f30 0x7f2ac00693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2adc159fe0 0x7f2adc0d0a10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 --2- 172.21.15.61:0/2226388867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc159c10 0x7f2adc0b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 -- 172.21.15.61:0/2226388867 >> 172.21.15.61:0/2226388867 conn(0x7f2adc06e640 msgr2=0x7f2adc15ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 -- 172.21.15.61:0/2226388867 shutdown_connections 2023-12-24T20:00:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.814+0000 7f2ae3f38700 1 -- 172.21.15.61:0/2226388867 wait complete. 2023-12-24T20:00:29.816 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 35 2023-12-24T20:00:29.826 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:00:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.948+0000 7fe4d7af5700 1 Processor -- start 2023-12-24T20:00:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.948+0000 7fe4d7af5700 1 -- start start 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d7af5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4d006aac0 0x7fe4d0159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d7af5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe4d00caa80 0x7fe4d00aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d7af5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d006a630 con 0x7fe4d0159850 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d7af5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d00cccf0 con 0x7fe4d00caa80 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d7af5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0069d00 con 0x7fe4d006aac0 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d6092700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe4d00caa80 0x7fe4d00aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d5891700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe4d0159850 0x7fe4d00cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51646/0 (socket says 172.21.15.61:51646) 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d5891700 1 -- 172.21.15.61:0/1107844067 learned_addr learned my addr 172.21.15.61:0/1107844067 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d5090700 1 --2- 172.21.15.61:0/1107844067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4d006aac0 0x7fe4d0159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d6092700 1 -- 172.21.15.61:0/1107844067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4d006aac0 msgr2=0x7fe4d0159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d6092700 1 --2- 172.21.15.61:0/1107844067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4d006aac0 0x7fe4d0159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d6092700 1 -- 172.21.15.61:0/1107844067 >> v1:172.21.15.61:6789/0 conn(0x7fe4d0159850 legacy=0x7fe4d00cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d488f700 1 -- 172.21.15.61:0/1107844067 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304984693 0 0) 0x7fe4d006a630 con 0x7fe4d0159850 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d6092700 1 -- 172.21.15.61:0/1107844067 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0069fe0 con 0x7fe4d00caa80 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.949+0000 7fe4d6092700 1 --2- 172.21.15.61:0/1107844067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d00caa80 0x7fe4d00aa880 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009e60 tx=0x7fe4c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd692cb8326ed55 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d488f700 1 -- 172.21.15.61:0/1107844067 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800e070 con 0x7fe4d00caa80 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d488f700 1 -- 172.21.15.61:0/1107844067 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c800bc30 con 0x7fe4d00caa80 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d488f700 1 -- 172.21.15.61:0/1107844067 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8012430 con 0x7fe4d00caa80 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d7af5700 1 -- 172.21.15.61:0/1107844067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d00caa80 msgr2=0x7fe4d00aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d7af5700 1 --2- 172.21.15.61:0/1107844067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d00caa80 0x7fe4d00aa880 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009e60 tx=0x7fe4c8009780 comp rx=0 tx=0).stop 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d7af5700 1 -- 172.21.15.61:0/1107844067 shutdown_connections 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d7af5700 1 --2- 172.21.15.61:0/1107844067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d00caa80 0x7fe4d00aa880 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d7af5700 1 --2- 172.21.15.61:0/1107844067 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4d006aac0 0x7fe4d0159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d7af5700 1 -- 172.21.15.61:0/1107844067 >> 172.21.15.61:0/1107844067 conn(0x7fe4d00cceb0 msgr2=0x7fe4d00cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d7af5700 1 -- 172.21.15.61:0/1107844067 shutdown_connections 2023-12-24T20:00:29.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.950+0000 7fe4d7af5700 1 -- 172.21.15.61:0/1107844067 wait complete. 2023-12-24T20:00:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.951+0000 7fe4d7af5700 1 Processor -- start 2023-12-24T20:00:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.951+0000 7fe4d7af5700 1 -- start start 2023-12-24T20:00:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.952+0000 7fe4d7af5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d006aac0 0x7fe4d014db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.952+0000 7fe4d7af5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4d00caa80 0x7fe4d014eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.952+0000 7fe4d7af5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d0159850 0x7fe4d00b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.952+0000 7fe4d7af5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00b0980 con 0x7fe4d006aac0 2023-12-24T20:00:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.952+0000 7fe4d7af5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00afd70 con 0x7fe4d0159850 2023-12-24T20:00:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.952+0000 7fe4d7af5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00b0050 con 0x7fe4d00caa80 2023-12-24T20:00:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.952+0000 7fe4d5891700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d006aac0 0x7fe4d014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.952+0000 7fe4d5891700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d006aac0 0x7fe4d014db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48200/0 (socket says 172.21.15.61:48200) 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.952+0000 7fe4d5891700 1 -- 172.21.15.61:0/3503271165 learned_addr learned my addr 172.21.15.61:0/3503271165 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4d5891700 1 -- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4d00caa80 msgr2=0x7fe4d014eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4d5891700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4d00caa80 0x7fe4d014eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4d5891700 1 -- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d0159850 msgr2=0x7fe4d00b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4d5891700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d0159850 0x7fe4d00b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4d5891700 1 -- 172.21.15.61:0/3503271165 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c8009a20 con 0x7fe4d006aac0 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4d5891700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d006aac0 0x7fe4d014db70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00c5b0 tx=0x7fe4cc001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4c5ffb700 1 -- 172.21.15.61:0/3503271165 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc005b30 con 0x7fe4d006aac0 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4c5ffb700 1 -- 172.21.15.61:0/3503271165 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc005c90 con 0x7fe4d006aac0 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4c5ffb700 1 -- 172.21.15.61:0/3503271165 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc007300 con 0x7fe4d006aac0 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4d7af5700 1 -- 172.21.15.61:0/3503271165 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d00b0330 con 0x7fe4d006aac0 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.953+0000 7fe4d7af5700 1 -- 172.21.15.61:0/3503271165 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d014f0a0 con 0x7fe4d006aac0 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.954+0000 7fe4d7af5700 1 -- 172.21.15.61:0/3503271165 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d004c3c0 con 0x7fe4d006aac0 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.954+0000 7fe4c5ffb700 1 -- 172.21.15.61:0/3503271165 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe4cc01b3b0 con 0x7fe4d006aac0 2023-12-24T20:00:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.955+0000 7fe4c5ffb700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe4b4066f30 0x7fe4b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:29.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.955+0000 7fe4c5ffb700 1 -- 172.21.15.61:0/3503271165 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4cc083a60 con 0x7fe4d006aac0 2023-12-24T20:00:29.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.955+0000 7fe4c5ffb700 1 -- 172.21.15.61:0/3503271165 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7fe4b406ea50 con 0x7fe4d006aac0 2023-12-24T20:00:29.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.955+0000 7fe4d5090700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe4b4066f30 0x7fe4b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:29.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.956+0000 7fe4d5090700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe4b4066f30 0x7fe4b40693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe4d006efb0 tx=0x7fe4c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:29.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:29.959+0000 7fe4c5ffb700 1 -- 172.21.15.61:0/3503271165 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4cc017060 con 0x7fe4d006aac0 2023-12-24T20:00:30.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.197+0000 7fe4d7af5700 1 -- 172.21.15.61:0/3503271165 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4d006a2c0 con 0x7fe4d006aac0 2023-12-24T20:00:30.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.197+0000 7fe4c5ffb700 1 -- 172.21.15.61:0/3503271165 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fe4cc050cd0 con 0x7fe4d006aac0 2023-12-24T20:00:30.198 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:30.198 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2177201507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2177201507},{"type":"v1","addr":"172.21.15.61:6835","nonce":2177201507}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1435257239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1435257239},{"type":"v1","addr":"172.21.15.133:6837","nonce":1435257239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/696274590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":696274590},{"type":"v1","addr":"172.21.15.133:6836","nonce":696274590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T19:59:24.619081+0000","modified":"2023-12-24T19:59:28.258285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/3751369981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3751369981},{"type":"v1","addr":"172.21.15.61:6834","nonce":3751369981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-12-24T20:00:30.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.199+0000 7fe4d7af5700 1 -- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe4b4066f30 msgr2=0x7fe4b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.199+0000 7fe4d7af5700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe4b4066f30 0x7fe4b40693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe4d006efb0 tx=0x7fe4c0008040 comp rx=0 tx=0).stop 2023-12-24T20:00:30.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.200+0000 7fe4d7af5700 1 -- 172.21.15.61:0/3503271165 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d006aac0 msgr2=0x7fe4d014db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.200+0000 7fe4d7af5700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d006aac0 0x7fe4d014db70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00c5b0 tx=0x7fe4cc001070 comp rx=0 tx=0).stop 2023-12-24T20:00:30.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.200+0000 7fe4d7af5700 1 -- 172.21.15.61:0/3503271165 shutdown_connections 2023-12-24T20:00:30.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.200+0000 7fe4d7af5700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe4b4066f30 0x7fe4b40693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.200+0000 7fe4d7af5700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4d0159850 0x7fe4d00b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.200+0000 7fe4d7af5700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe4d006aac0 0x7fe4d014db70 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.200+0000 7fe4d7af5700 1 --2- 172.21.15.61:0/3503271165 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe4d00caa80 0x7fe4d014eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.200+0000 7fe4d7af5700 1 -- 172.21.15.61:0/3503271165 >> 172.21.15.61:0/3503271165 conn(0x7fe4d00cceb0 msgr2=0x7fe4d006de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:30.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.200+0000 7fe4d7af5700 1 -- 172.21.15.61:0/3503271165 shutdown_connections 2023-12-24T20:00:30.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.200+0000 7fe4d7af5700 1 -- 172.21.15.61:0/3503271165 wait complete. 2023-12-24T20:00:30.201 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 35 2023-12-24T20:00:30.213 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:00:30.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.334+0000 7f340f3d9700 1 Processor -- start 2023-12-24T20:00:30.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.335+0000 7f340f3d9700 1 -- start start 2023-12-24T20:00:30.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.335+0000 7f340f3d9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3408070d50 0x7f3408067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.335+0000 7f340f3d9700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34080a84d0 con 0x7f34080afee0 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.335+0000 7f340f3d9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34080a7620 con 0x7f3408159b00 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.335+0000 7f340f3d9700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34080a78c0 con 0x7f3408070d50 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f340c974700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f34080afee0 0x7f3408070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51658/0 (socket says 172.21.15.61:51658) 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f340c974700 1 -- 172.21.15.61:0/2010168678 learned_addr learned my addr 172.21.15.61:0/2010168678 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f340d976700 1 --2- 172.21.15.61:0/2010168678 >> v2:172.21.15.61:3300/0 conn(0x7f3408070d50 0x7f3408067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f33fffff700 1 -- 172.21.15.61:0/2010168678 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215601935 0 0) 0x7f34080a84d0 con 0x7f34080afee0 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f33fffff700 1 -- 172.21.15.61:0/2010168678 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33f4003570 con 0x7f34080afee0 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f340d976700 1 -- 172.21.15.61:0/2010168678 >> v1:172.21.15.133:6789/0 conn(0x7f3408159b00 legacy=0x7f34080af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f340d976700 1 -- 172.21.15.61:0/2010168678 >> v1:172.21.15.61:6789/0 conn(0x7f34080afee0 legacy=0x7f3408070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f340d976700 1 -- 172.21.15.61:0/2010168678 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080a7ba0 con 0x7f3408070d50 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f340d976700 1 --2- 172.21.15.61:0/2010168678 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3408070d50 0x7f3408067550 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3400009e60 tx=0x7f3400009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88dcc70889e083a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:30.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f33fffff700 1 -- 172.21.15.61:0/2010168678 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000e070 con 0x7f3408070d50 2023-12-24T20:00:30.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f33fffff700 1 -- 172.21.15.61:0/2010168678 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000bb60 con 0x7f3408070d50 2023-12-24T20:00:30.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.336+0000 7f33fffff700 1 -- 172.21.15.61:0/2010168678 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400012430 con 0x7f3408070d50 2023-12-24T20:00:30.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.337+0000 7f340f3d9700 1 -- 172.21.15.61:0/2010168678 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3408070d50 msgr2=0x7f3408067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.337+0000 7f340f3d9700 1 --2- 172.21.15.61:0/2010168678 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3408070d50 0x7f3408067550 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3400009e60 tx=0x7f3400009780 comp rx=0 tx=0).stop 2023-12-24T20:00:30.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.337+0000 7f340f3d9700 1 -- 172.21.15.61:0/2010168678 shutdown_connections 2023-12-24T20:00:30.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.337+0000 7f340f3d9700 1 --2- 172.21.15.61:0/2010168678 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3408070d50 0x7f3408067550 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.337+0000 7f340f3d9700 1 -- 172.21.15.61:0/2010168678 >> 172.21.15.61:0/2010168678 conn(0x7f34080ca200 msgr2=0x7f34080ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:30.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.337+0000 7f340f3d9700 1 -- 172.21.15.61:0/2010168678 shutdown_connections 2023-12-24T20:00:30.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.337+0000 7f340f3d9700 1 -- 172.21.15.61:0/2010168678 wait complete. 2023-12-24T20:00:30.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.338+0000 7f340f3d9700 1 Processor -- start 2023-12-24T20:00:30.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.338+0000 7f340f3d9700 1 -- start start 2023-12-24T20:00:30.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340f3d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408070d50 0x7f34081499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340f3d9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34080afee0 0x7f340815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340f3d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3408159b00 0x7f340806ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340f3d9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340816adc0 con 0x7f34080afee0 2023-12-24T20:00:30.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340f3d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340816a240 con 0x7f3408070d50 2023-12-24T20:00:30.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340f3d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340816a520 con 0x7f3408159b00 2023-12-24T20:00:30.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340c974700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34080afee0 0x7f340815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340c974700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34080afee0 0x7f340815c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48226/0 (socket says 172.21.15.61:48226) 2023-12-24T20:00:30.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340c974700 1 -- 172.21.15.61:0/2304082601 learned_addr learned my addr 172.21.15.61:0/2304082601 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:30.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340d976700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3408159b00 0x7f340806ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340d175700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408070d50 0x7f34081499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340c974700 1 -- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3408159b00 msgr2=0x7f340806ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340c974700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3408159b00 0x7f340806ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340c974700 1 -- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408070d50 msgr2=0x7f34081499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340c974700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408070d50 0x7f34081499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340c974700 1 -- 172.21.15.61:0/2304082601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3400009a20 con 0x7f34080afee0 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340d976700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3408159b00 0x7f340806ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.339+0000 7f340d175700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408070d50 0x7f34081499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.340+0000 7f340c974700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34080afee0 0x7f340815c9c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f340400c790 tx=0x7f3404007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.340+0000 7f33fd7fa700 1 -- 172.21.15.61:0/2304082601 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404005c00 con 0x7f34080afee0 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.340+0000 7f33fd7fa700 1 -- 172.21.15.61:0/2304082601 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3404005d60 con 0x7f34080afee0 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.340+0000 7f340f3d9700 1 -- 172.21.15.61:0/2304082601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340816a800 con 0x7f34080afee0 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.340+0000 7f33fd7fa700 1 -- 172.21.15.61:0/2304082601 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34040072e0 con 0x7f34080afee0 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.340+0000 7f340f3d9700 1 -- 172.21.15.61:0/2304082601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3408169e70 con 0x7f34080afee0 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.341+0000 7f340f3d9700 1 -- 172.21.15.61:0/2304082601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340804c3c0 con 0x7f34080afee0 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.341+0000 7f33fd7fa700 1 -- 172.21.15.61:0/2304082601 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f340401b3b0 con 0x7f34080afee0 2023-12-24T20:00:30.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.342+0000 7f33fd7fa700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33ec066f30 0x7f33ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.342+0000 7f33fd7fa700 1 -- 172.21.15.61:0/2304082601 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3404083930 con 0x7f34080afee0 2023-12-24T20:00:30.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.342+0000 7f33fd7fa700 1 -- 172.21.15.61:0/2304082601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7f33ec06ea50 con 0x7f34080afee0 2023-12-24T20:00:30.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.342+0000 7f340d175700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33ec066f30 0x7f33ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.342+0000 7f340d175700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33ec066f30 0x7f33ec0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f33f8001840 tx=0x7f33f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:30.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.346+0000 7f33fd7fa700 1 -- 172.21.15.61:0/2304082601 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f340404b5a0 con 0x7f34080afee0 2023-12-24T20:00:30.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.540+0000 7f340f3d9700 1 -- 172.21.15.61:0/2304082601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34080af3a0 con 0x7f34080afee0 2023-12-24T20:00:30.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.541+0000 7f33fd7fa700 1 -- 172.21.15.61:0/2304082601 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+15393 (secure 0 0 0) 0x7f3404017020 con 0x7f34080afee0 2023-12-24T20:00:30.542 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:30.542 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":67,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:00:29.671355+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-24T19:59:23.050869+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-24T19:59:23.594703+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 -- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33ec066f30 msgr2=0x7f33ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33ec066f30 0x7f33ec0693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f33f8001840 tx=0x7f33f8009040 comp rx=0 tx=0).stop 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 -- 172.21.15.61:0/2304082601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34080afee0 msgr2=0x7f340815c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34080afee0 0x7f340815c9c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f340400c790 tx=0x7f3404007db0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 -- 172.21.15.61:0/2304082601 shutdown_connections 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3408159b00 0x7f340806ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33ec066f30 0x7f33ec0693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3408070d50 0x7f34081499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 --2- 172.21.15.61:0/2304082601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34080afee0 0x7f340815c9c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 -- 172.21.15.61:0/2304082601 >> 172.21.15.61:0/2304082601 conn(0x7f34080ca200 msgr2=0x7f3408156460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:30.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 -- 172.21.15.61:0/2304082601 shutdown_connections 2023-12-24T20:00:30.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.543+0000 7f340f3d9700 1 -- 172.21.15.61:0/2304082601 wait complete. 2023-12-24T20:00:30.556 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:00:30.676 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:00:30.676+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-24T20:00:30.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.680+0000 7f84981ca700 1 Processor -- start 2023-12-24T20:00:30.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.680+0000 7f84981ca700 1 -- start start 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f84981ca700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f849015ab40 0x7f8490068030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f84981ca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8490156af0 0x7f84900cba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f84981ca700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84900c7eb0 con 0x7f8490156720 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f84981ca700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8490068570 con 0x7f849015ab40 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f84981ca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900c8740 con 0x7f8490156af0 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f8495765700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f849015ab40 0x7f8490068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f8495765700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f849015ab40 0x7f8490068030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48232/0 (socket says 172.21.15.61:48232) 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f8495765700 1 -- 172.21.15.61:0/2494384703 learned_addr learned my addr 172.21.15.61:0/2494384703 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f8496767700 1 --2- 172.21.15.61:0/2494384703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8490156af0 0x7f84900cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f8495765700 1 -- 172.21.15.61:0/2494384703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8490156af0 msgr2=0x7f84900cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f8495765700 1 --2- 172.21.15.61:0/2494384703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8490156af0 0x7f84900cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f8495765700 1 -- 172.21.15.61:0/2494384703 >> v1:172.21.15.133:6789/0 conn(0x7f8490156720 legacy=0x7f849015a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f8495765700 1 -- 172.21.15.61:0/2494384703 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490063d60 con 0x7f849015ab40 2023-12-24T20:00:30.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f8495765700 1 --2- 172.21.15.61:0/2494384703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f849015ab40 0x7f8490068030 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f848c0099b0 tx=0x7f848c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749276ba25193f95 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:30.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.682+0000 7f8494f64700 1 -- 172.21.15.61:0/2494384703 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c00b860 con 0x7f849015ab40 2023-12-24T20:00:30.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.683+0000 7f8494f64700 1 -- 172.21.15.61:0/2494384703 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c00b9c0 con 0x7f849015ab40 2023-12-24T20:00:30.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.683+0000 7f8494f64700 1 -- 172.21.15.61:0/2494384703 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c00bd60 con 0x7f849015ab40 2023-12-24T20:00:30.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.683+0000 7f84981ca700 1 -- 172.21.15.61:0/2494384703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f849015ab40 msgr2=0x7f8490068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.683+0000 7f84981ca700 1 --2- 172.21.15.61:0/2494384703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f849015ab40 0x7f8490068030 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f848c0099b0 tx=0x7f848c009250 comp rx=0 tx=0).stop 2023-12-24T20:00:30.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.683+0000 7f84981ca700 1 -- 172.21.15.61:0/2494384703 shutdown_connections 2023-12-24T20:00:30.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.683+0000 7f84981ca700 1 --2- 172.21.15.61:0/2494384703 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8490156af0 0x7f84900cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.683+0000 7f84981ca700 1 --2- 172.21.15.61:0/2494384703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f849015ab40 0x7f8490068030 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.683+0000 7f84981ca700 1 -- 172.21.15.61:0/2494384703 >> 172.21.15.61:0/2494384703 conn(0x7f84900ca3c0 msgr2=0x7f8490067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:30.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.683+0000 7f84981ca700 1 -- 172.21.15.61:0/2494384703 shutdown_connections 2023-12-24T20:00:30.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.683+0000 7f84981ca700 1 -- 172.21.15.61:0/2494384703 wait complete. 2023-12-24T20:00:30.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f84981ca700 1 Processor -- start 2023-12-24T20:00:30.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f84981ca700 1 -- start start 2023-12-24T20:00:30.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f84981ca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8490156720 0x7f849014b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f84981ca700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8490156af0 0x7f8490158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f84981ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849015ab40 0x7f84900c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f84981ca700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8490157ea0 con 0x7f8490156af0 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f84981ca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8490157290 con 0x7f849015ab40 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f84981ca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8490157570 con 0x7f8490156720 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f8495765700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8490156af0 0x7f8490158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f8495765700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8490156af0 0x7f8490158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48234/0 (socket says 172.21.15.61:48234) 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.685+0000 7f8495765700 1 -- 172.21.15.61:0/1406699138 learned_addr learned my addr 172.21.15.61:0/1406699138 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8495f66700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8490156720 0x7f849014b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8496767700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849015ab40 0x7f84900c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8495765700 1 -- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8490156720 msgr2=0x7f849014b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8495765700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8490156720 0x7f849014b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8495765700 1 -- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849015ab40 msgr2=0x7f84900c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8495765700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849015ab40 0x7f84900c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8495765700 1 -- 172.21.15.61:0/1406699138 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0094f0 con 0x7f8490156af0 2023-12-24T20:00:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8496767700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849015ab40 0x7f84900c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8495765700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8490156af0 0x7f8490158330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f849006c1c0 tx=0x7f848c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8485ffb700 1 -- 172.21.15.61:0/1406699138 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c024440 con 0x7f8490156af0 2023-12-24T20:00:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8485ffb700 1 -- 172.21.15.61:0/1406699138 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c0245a0 con 0x7f8490156af0 2023-12-24T20:00:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f8485ffb700 1 -- 172.21.15.61:0/1406699138 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c024940 con 0x7f8490156af0 2023-12-24T20:00:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f84981ca700 1 -- 172.21.15.61:0/1406699138 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8490157850 con 0x7f8490156af0 2023-12-24T20:00:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.686+0000 7f84981ca700 1 -- 172.21.15.61:0/1406699138 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8490156f20 con 0x7f8490156af0 2023-12-24T20:00:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.687+0000 7f84981ca700 1 -- 172.21.15.61:0/1406699138 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8490158010 con 0x7f8490156af0 2023-12-24T20:00:30.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.688+0000 7f8485ffb700 1 -- 172.21.15.61:0/1406699138 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f848c01a420 con 0x7f8490156af0 2023-12-24T20:00:30.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.688+0000 7f8485ffb700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8474066f30 0x7f84740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:30.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.688+0000 7f8485ffb700 1 -- 172.21.15.61:0/1406699138 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f848c086220 con 0x7f8490156af0 2023-12-24T20:00:30.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.689+0000 7f8485ffb700 1 -- 172.21.15.61:0/1406699138 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=69}) v3 -- 0x7f847406ea50 con 0x7f8490156af0 2023-12-24T20:00:30.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.689+0000 7f8495f66700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8474066f30 0x7f84740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:30.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.689+0000 7f8495f66700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8474066f30 0x7f84740693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8488007fd0 tx=0x7f84880016f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:30.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.693+0000 7f8485ffb700 1 -- 172.21.15.61:0/1406699138 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f848c053510 con 0x7f8490156af0 2023-12-24T20:00:30.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.935+0000 7f84981ca700 1 -- 172.21.15.61:0/1406699138 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f849004c3c0 con 0x7f8490156af0 2023-12-24T20:00:30.935 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:00:30.935+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:00:30.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.937+0000 7f8485ffb700 1 -- 172.21.15.61:0/1406699138 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(69..69 src has 1..69) v4 ==== 374+0+0 (secure 0 0 0) 0x7f848c0578d0 con 0x7f8490156af0 2023-12-24T20:00:30.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.937+0000 7f8485ffb700 1 -- 172.21.15.61:0/1406699138 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f847406f230 con 0x7f8490156af0 2023-12-24T20:00:30.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.939+0000 7f8485ffb700 1 -- 172.21.15.61:0/1406699138 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f848c015020 con 0x7f8490156af0 2023-12-24T20:00:30.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.941+0000 7f84981ca700 1 -- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8474066f30 msgr2=0x7f84740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8474066f30 0x7f84740693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8488007fd0 tx=0x7f84880016f0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 -- 172.21.15.61:0/1406699138 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8490156af0 msgr2=0x7f8490158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:30.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8490156af0 0x7f8490158330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f849006c1c0 tx=0x7f848c017000 comp rx=0 tx=0).stop 2023-12-24T20:00:30.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 -- 172.21.15.61:0/1406699138 shutdown_connections 2023-12-24T20:00:30.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8490156720 0x7f849014b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8474066f30 0x7f84740693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849015ab40 0x7f84900c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 --2- 172.21.15.61:0/1406699138 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8490156af0 0x7f8490158330 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:30.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 -- 172.21.15.61:0/1406699138 >> 172.21.15.61:0/1406699138 conn(0x7f84900ca3c0 msgr2=0x7f849006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:30.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 -- 172.21.15.61:0/1406699138 shutdown_connections 2023-12-24T20:00:30.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:30.942+0000 7f84981ca700 1 -- 172.21.15.61:0/1406699138 wait complete. 2023-12-24T20:00:30.943 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:00:30.944 INFO:tasks.ceph.mds.a.smithi061.stderr: -7155> 2023-12-24T19:59:27.201+0000 7f01d2b8e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:00:30.955 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:00:30.974 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T20:00:31.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.079+0000 7f89974cb700 1 Processor -- start 2023-12-24T20:00:31.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.080+0000 7f89974cb700 1 -- start start 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f89974cb700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f89901578d0 0x7f89900af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f89974cb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006b320 0x7f89900c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f89974cb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89900caf30 con 0x7f899006f6e0 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f89974cb700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89900af9f0 con 0x7f89901578d0 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f89974cb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89900afcd0 con 0x7f899006b320 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f8995267700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f89901578d0 0x7f89900af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f8995267700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f89901578d0 0x7f89900af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48256/0 (socket says 172.21.15.61:48256) 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f8995267700 1 -- 172.21.15.61:0/2829904462 learned_addr learned my addr 172.21.15.61:0/2829904462 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f8995a68700 1 --2- 172.21.15.61:0/2829904462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006b320 0x7f89900c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f8995267700 1 -- 172.21.15.61:0/2829904462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006b320 msgr2=0x7f89900c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f8995267700 1 --2- 172.21.15.61:0/2829904462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006b320 0x7f89900c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f8995267700 1 -- 172.21.15.61:0/2829904462 >> v1:172.21.15.133:6789/0 conn(0x7f899006f6e0 legacy=0x7f899006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:31.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.081+0000 7f8995267700 1 -- 172.21.15.61:0/2829904462 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89900affb0 con 0x7f89901578d0 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f8995267700 1 --2- 172.21.15.61:0/2829904462 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89901578d0 0x7f89900af330 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f898c0099b0 tx=0x7f898c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8d7271ac742d64 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f8983fff700 1 -- 172.21.15.61:0/2829904462 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00b860 con 0x7f89901578d0 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f8983fff700 1 -- 172.21.15.61:0/2829904462 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00b9c0 con 0x7f89901578d0 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f8983fff700 1 -- 172.21.15.61:0/2829904462 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00bd60 con 0x7f89901578d0 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f89974cb700 1 -- 172.21.15.61:0/2829904462 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89901578d0 msgr2=0x7f89900af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f89974cb700 1 --2- 172.21.15.61:0/2829904462 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89901578d0 0x7f89900af330 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f898c0099b0 tx=0x7f898c009250 comp rx=0 tx=0).stop 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f89974cb700 1 -- 172.21.15.61:0/2829904462 shutdown_connections 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f89974cb700 1 --2- 172.21.15.61:0/2829904462 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006b320 0x7f89900c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f89974cb700 1 --2- 172.21.15.61:0/2829904462 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89901578d0 0x7f89900af330 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f89974cb700 1 -- 172.21.15.61:0/2829904462 >> 172.21.15.61:0/2829904462 conn(0x7f89900ce800 msgr2=0x7f89900cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f89974cb700 1 -- 172.21.15.61:0/2829904462 shutdown_connections 2023-12-24T20:00:31.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.082+0000 7f89974cb700 1 -- 172.21.15.61:0/2829904462 wait complete. 2023-12-24T20:00:31.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.084+0000 7f89974cb700 1 Processor -- start 2023-12-24T20:00:31.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.084+0000 7f89974cb700 1 -- start start 2023-12-24T20:00:31.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f89974cb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f899006b320 0x7f89900b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:31.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f89974cb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006f6e0 0x7f8990154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:31.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f89974cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89901578d0 0x7f89900c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:31.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f89974cb700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89900b2ea0 con 0x7f899006b320 2023-12-24T20:00:31.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f89974cb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8990154560 con 0x7f89901578d0 2023-12-24T20:00:31.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f89974cb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89900c58d0 con 0x7f899006f6e0 2023-12-24T20:00:31.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f8995267700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f899006b320 0x7f89900b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f8995267700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f899006b320 0x7f89900b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48262/0 (socket says 172.21.15.61:48262) 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f8995267700 1 -- 172.21.15.61:0/2747622693 learned_addr learned my addr 172.21.15.61:0/2747622693 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f8994a66700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006f6e0 0x7f8990154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.085+0000 7f8995a68700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89901578d0 0x7f89900c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f8995267700 1 -- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006f6e0 msgr2=0x7f8990154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f8995267700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006f6e0 0x7f8990154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f8995267700 1 -- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89901578d0 msgr2=0x7f89900c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f8995267700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89901578d0 0x7f89900c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f8995267700 1 -- 172.21.15.61:0/2747622693 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0094f0 con 0x7f899006b320 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f8994a66700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006f6e0 0x7f8990154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f8995a68700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89901578d0 0x7f89900c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f8995267700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f899006b320 0x7f89900b2960 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f899006e660 tx=0x7f898c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f89817fa700 1 -- 172.21.15.61:0/2747622693 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c024440 con 0x7f899006b320 2023-12-24T20:00:31.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f89817fa700 1 -- 172.21.15.61:0/2747622693 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c0245a0 con 0x7f899006b320 2023-12-24T20:00:31.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f89974cb700 1 -- 172.21.15.61:0/2747622693 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89900c7cf0 con 0x7f899006b320 2023-12-24T20:00:31.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f89817fa700 1 -- 172.21.15.61:0/2747622693 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c024940 con 0x7f899006b320 2023-12-24T20:00:31.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.086+0000 7f89974cb700 1 -- 172.21.15.61:0/2747622693 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89900c82b0 con 0x7f899006b320 2023-12-24T20:00:31.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.087+0000 7f89974cb700 1 -- 172.21.15.61:0/2747622693 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899004c3c0 con 0x7f899006b320 2023-12-24T20:00:31.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.087+0000 7f89817fa700 1 -- 172.21.15.61:0/2747622693 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f898c01a420 con 0x7f899006b320 2023-12-24T20:00:31.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.088+0000 7f89817fa700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8974066f30 0x7f89740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:31.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.088+0000 7f89817fa700 1 -- 172.21.15.61:0/2747622693 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f898c086320 con 0x7f899006b320 2023-12-24T20:00:31.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.088+0000 7f89817fa700 1 -- 172.21.15.61:0/2747622693 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f897406eaf0 con 0x7f899006b320 2023-12-24T20:00:31.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.088+0000 7f8994a66700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8974066f30 0x7f89740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:31.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.089+0000 7f8994a66700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8974066f30 0x7f89740693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8984007fd0 tx=0x7f8984009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:31.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.092+0000 7f89817fa700 1 -- 172.21.15.61:0/2747622693 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f898c0535c0 con 0x7f899006b320 2023-12-24T20:00:31.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.329+0000 7f89974cb700 1 -- 172.21.15.61:0/2747622693 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f89900b0290 con 0x7f899006b320 2023-12-24T20:00:31.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.941+0000 7f89817fa700 1 -- 172.21.15.61:0/2747622693 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f898c0150a0 con 0x7f899006b320 2023-12-24T20:00:31.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.943+0000 7f89974cb700 1 -- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8974066f30 msgr2=0x7f89740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:31.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.943+0000 7f89974cb700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8974066f30 0x7f89740693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8984007fd0 tx=0x7f8984009040 comp rx=0 tx=0).stop 2023-12-24T20:00:31.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.943+0000 7f89974cb700 1 -- 172.21.15.61:0/2747622693 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f899006b320 msgr2=0x7f89900b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:31.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.943+0000 7f89974cb700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f899006b320 0x7f89900b2960 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f899006e660 tx=0x7f898c017000 comp rx=0 tx=0).stop 2023-12-24T20:00:31.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.943+0000 7f89974cb700 1 -- 172.21.15.61:0/2747622693 shutdown_connections 2023-12-24T20:00:31.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.943+0000 7f89974cb700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8974066f30 0x7f89740693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:31.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.943+0000 7f89974cb700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89901578d0 0x7f89900c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:31.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.943+0000 7f89974cb700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f899006b320 0x7f89900b2960 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:31.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.943+0000 7f89974cb700 1 --2- 172.21.15.61:0/2747622693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f899006f6e0 0x7f8990154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:31.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.943+0000 7f89974cb700 1 -- 172.21.15.61:0/2747622693 >> 172.21.15.61:0/2747622693 conn(0x7f89900ce800 msgr2=0x7f89900ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:31.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.944+0000 7f89974cb700 1 -- 172.21.15.61:0/2747622693 shutdown_connections 2023-12-24T20:00:31.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:31.944+0000 7f89974cb700 1 -- 172.21.15.61:0/2747622693 wait complete. 2023-12-24T20:00:31.962 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:00:32.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.130+0000 7fae04979700 1 Processor -- start 2023-12-24T20:00:32.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.130+0000 7fae04979700 1 -- start start 2023-12-24T20:00:32.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.131+0000 7fae04979700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fae000cc350 0x7fae00069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:32.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.131+0000 7fae04979700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae000c81a0 con 0x7fae001567b0 2023-12-24T20:00:32.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.131+0000 7fae04979700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae00069fe0 con 0x7fae0006a9b0 2023-12-24T20:00:32.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.131+0000 7fae04979700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0006a4f0 con 0x7fae000cc350 2023-12-24T20:00:32.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.131+0000 7fadfdd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fae000cc350 0x7fae00069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:32.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.131+0000 7fadfe59c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fae001567b0 0x7fae000cbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51686/0 (socket says 172.21.15.61:51686) 2023-12-24T20:00:32.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.131+0000 7fadfe59c700 1 -- 172.21.15.61:0/2153746972 learned_addr learned my addr 172.21.15.61:0/2153746972 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:32.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.132+0000 7fadfdd9b700 1 -- 172.21.15.61:0/2153746972 >> v1:172.21.15.133:6789/0 conn(0x7fae0006a9b0 legacy=0x7fae000c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:32.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.132+0000 7fadfdd9b700 1 -- 172.21.15.61:0/2153746972 >> v1:172.21.15.61:6789/0 conn(0x7fae001567b0 legacy=0x7fae000cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:32.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.132+0000 7fadfdd9b700 1 -- 172.21.15.61:0/2153746972 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae000c8a20 con 0x7fae000cc350 2023-12-24T20:00:32.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.132+0000 7fadfd59a700 1 -- 172.21.15.61:0/2153746972 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035851381 0 0) 0x7fae000c81a0 con 0x7fae001567b0 2023-12-24T20:00:32.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.132+0000 7fadfdd9b700 1 --2- 172.21.15.61:0/2153746972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae000cc350 0x7fae00069aa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fadf00098e0 tx=0x7fadf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fc64aa767bb669 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:32.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.132+0000 7fadfd59a700 1 -- 172.21.15.61:0/2153746972 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0009e80 con 0x7fae000cc350 2023-12-24T20:00:32.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.132+0000 7fadfd59a700 1 -- 172.21.15.61:0/2153746972 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000b860 con 0x7fae000cc350 2023-12-24T20:00:32.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.132+0000 7fadfd59a700 1 -- 172.21.15.61:0/2153746972 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000bbe0 con 0x7fae000cc350 2023-12-24T20:00:32.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.132+0000 7fae04979700 1 -- 172.21.15.61:0/2153746972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae000cc350 msgr2=0x7fae00069aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:32.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.132+0000 7fae04979700 1 --2- 172.21.15.61:0/2153746972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae000cc350 0x7fae00069aa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fadf00098e0 tx=0x7fadf00091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:32.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.133+0000 7fae04979700 1 -- 172.21.15.61:0/2153746972 shutdown_connections 2023-12-24T20:00:32.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.133+0000 7fae04979700 1 --2- 172.21.15.61:0/2153746972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae000cc350 0x7fae00069aa0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:32.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.133+0000 7fae04979700 1 -- 172.21.15.61:0/2153746972 >> 172.21.15.61:0/2153746972 conn(0x7fae000ce1a0 msgr2=0x7fae000ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:32.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.133+0000 7fae04979700 1 -- 172.21.15.61:0/2153746972 shutdown_connections 2023-12-24T20:00:32.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.133+0000 7fae04979700 1 -- 172.21.15.61:0/2153746972 wait complete. 2023-12-24T20:00:32.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.134+0000 7fae04979700 1 Processor -- start 2023-12-24T20:00:32.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.134+0000 7fae04979700 1 -- start start 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fae04979700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae0006a9b0 0x7fae0016a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fae04979700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae000cc350 0x7fae00166b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fae04979700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae001567b0 0x7fae0016a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fae04979700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae00158190 con 0x7fae001567b0 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fae04979700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0016acc0 con 0x7fae0006a9b0 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fae04979700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae00157e60 con 0x7fae000cc350 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae001567b0 0x7fae0016a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae001567b0 0x7fae0016a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48288/0 (socket says 172.21.15.61:48288) 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfed9d700 1 -- 172.21.15.61:0/2492500842 learned_addr learned my addr 172.21.15.61:0/2492500842 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfdd9b700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae000cc350 0x7fae00166b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfe59c700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae0006a9b0 0x7fae0016a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfed9d700 1 -- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae000cc350 msgr2=0x7fae00166b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:32.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfed9d700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae000cc350 0x7fae00166b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfed9d700 1 -- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae0006a9b0 msgr2=0x7fae0016a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfed9d700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae0006a9b0 0x7fae0016a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfed9d700 1 -- 172.21.15.61:0/2492500842 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf0009420 con 0x7fae001567b0 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadfed9d700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae001567b0 0x7fae0016a780 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c840 tx=0x7fadf8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadee7fc700 1 -- 172.21.15.61:0/2492500842 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8012630 con 0x7fae001567b0 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadee7fc700 1 -- 172.21.15.61:0/2492500842 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf80127b0 con 0x7fae001567b0 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fae04979700 1 -- 172.21.15.61:0/2492500842 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae00154440 con 0x7fae001567b0 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fadee7fc700 1 -- 172.21.15.61:0/2492500842 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8012b70 con 0x7fae001567b0 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.135+0000 7fae04979700 1 -- 172.21.15.61:0/2492500842 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae00154a00 con 0x7fae001567b0 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.136+0000 7fae04979700 1 -- 172.21.15.61:0/2492500842 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae00154bf0 con 0x7fae001567b0 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.137+0000 7fadee7fc700 1 -- 172.21.15.61:0/2492500842 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fadf8003030 con 0x7fae001567b0 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.137+0000 7fadee7fc700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fade0066f30 0x7fade00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.137+0000 7fadee7fc700 1 -- 172.21.15.61:0/2492500842 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fadf8084540 con 0x7fae001567b0 2023-12-24T20:00:32.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.137+0000 7fadfe59c700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fade0066f30 0x7fade00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:32.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.138+0000 7fadfe59c700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fade0066f30 0x7fade00693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fadf40011e0 tx=0x7fadf4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:32.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.141+0000 7fadee7fc700 1 -- 172.21.15.61:0/2492500842 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadf8051760 con 0x7fae001567b0 2023-12-24T20:00:32.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.338+0000 7fae04979700 1 -- 172.21.15.61:0/2492500842 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae0004c3c0 con 0x7fae001567b0 2023-12-24T20:00:32.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.954+0000 7fadee7fc700 1 -- 172.21.15.61:0/2492500842 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) v1 ==== 181+0+0 (secure 0 0 0) 0x7fadf8054d80 con 0x7fae001567b0 2023-12-24T20:00:32.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 -- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fade0066f30 msgr2=0x7fade00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:32.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fade0066f30 0x7fade00693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fadf40011e0 tx=0x7fadf4009040 comp rx=0 tx=0).stop 2023-12-24T20:00:32.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 -- 172.21.15.61:0/2492500842 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae001567b0 msgr2=0x7fae0016a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:32.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae001567b0 0x7fae0016a780 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c840 tx=0x7fadf8001670 comp rx=0 tx=0).stop 2023-12-24T20:00:32.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 -- 172.21.15.61:0/2492500842 shutdown_connections 2023-12-24T20:00:32.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fade0066f30 0x7fade00693e0 secure :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fadf40011e0 tx=0x7fadf4009040 comp rx=0 tx=0).stop 2023-12-24T20:00:32.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae001567b0 0x7fae0016a780 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:32.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae0006a9b0 0x7fae0016a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:32.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 --2- 172.21.15.61:0/2492500842 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fae000cc350 0x7fae00166b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:32.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 -- 172.21.15.61:0/2492500842 >> 172.21.15.61:0/2492500842 conn(0x7fae000ce1a0 msgr2=0x7fae000ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:32.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.960+0000 7fae04979700 1 -- 172.21.15.61:0/2492500842 shutdown_connections 2023-12-24T20:00:32.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:32.961+0000 7fae04979700 1 -- 172.21.15.61:0/2492500842 wait complete. 2023-12-24T20:00:32.964 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:00:32.977 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:00:33.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.105+0000 7f5cc859e700 1 Processor -- start 2023-12-24T20:00:33.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.105+0000 7f5cc859e700 1 -- start start 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.106+0000 7f5cc859e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5cc00c9850 0x7f5cc0157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.106+0000 7f5cc859e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc0158d40 con 0x7f5cc015c3a0 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.106+0000 7f5cc859e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc00caf90 con 0x7f5cc01579f0 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.106+0000 7f5cc859e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc0067550 con 0x7f5cc00c9850 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.106+0000 7f5cc6b3b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5cc00c9850 0x7f5cc0157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.106+0000 7f5cc5b39700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f5cc015c3a0 0x7f5cc00c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51696/0 (socket says 172.21.15.61:51696) 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.106+0000 7f5cc5b39700 1 -- 172.21.15.61:0/696893124 learned_addr learned my addr 172.21.15.61:0/696893124 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.106+0000 7f5cc6b3b700 1 -- 172.21.15.61:0/696893124 >> v1:172.21.15.133:6789/0 conn(0x7f5cc01579f0 legacy=0x7f5cc00ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc6b3b700 1 -- 172.21.15.61:0/696893124 >> v1:172.21.15.61:6789/0 conn(0x7f5cc015c3a0 legacy=0x7f5cc00c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc6b3b700 1 -- 172.21.15.61:0/696893124 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc006aa90 con 0x7f5cc00c9850 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc5338700 1 -- 172.21.15.61:0/696893124 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393496523 0 0) 0x7f5cc0158d40 con 0x7f5cc015c3a0 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc6b3b700 1 --2- 172.21.15.61:0/696893124 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc00c9850 0x7f5cc0157dc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009e60 tx=0x7f5cb8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f07a0c67f7ac06b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:33.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc5338700 1 -- 172.21.15.61:0/696893124 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb800e070 con 0x7f5cc00c9850 2023-12-24T20:00:33.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc5338700 1 -- 172.21.15.61:0/696893124 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb800bbf0 con 0x7f5cc00c9850 2023-12-24T20:00:33.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc5338700 1 -- 172.21.15.61:0/696893124 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8012430 con 0x7f5cc00c9850 2023-12-24T20:00:33.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc859e700 1 -- 172.21.15.61:0/696893124 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc00c9850 msgr2=0x7f5cc0157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:33.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc859e700 1 --2- 172.21.15.61:0/696893124 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc00c9850 0x7f5cc0157dc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009e60 tx=0x7f5cb8009780 comp rx=0 tx=0).stop 2023-12-24T20:00:33.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc859e700 1 -- 172.21.15.61:0/696893124 shutdown_connections 2023-12-24T20:00:33.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc859e700 1 --2- 172.21.15.61:0/696893124 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc00c9850 0x7f5cc0157dc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:33.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.107+0000 7f5cc859e700 1 -- 172.21.15.61:0/696893124 >> 172.21.15.61:0/696893124 conn(0x7f5cc00ce1d0 msgr2=0x7f5cc00ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:33.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.108+0000 7f5cc859e700 1 -- 172.21.15.61:0/696893124 shutdown_connections 2023-12-24T20:00:33.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.108+0000 7f5cc859e700 1 -- 172.21.15.61:0/696893124 wait complete. 2023-12-24T20:00:33.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc859e700 1 Processor -- start 2023-12-24T20:00:33.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc859e700 1 -- start start 2023-12-24T20:00:33.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc859e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cc00c9850 0x7f5cc00c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:33.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc859e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5cc01579f0 0x7f5cc00b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:33.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc859e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc015c3a0 0x7f5cc00c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc859e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc015bb00 con 0x7f5cc015c3a0 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc859e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00c5460 con 0x7f5cc00c9850 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc859e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00c4850 con 0x7f5cc01579f0 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc6b3b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc015c3a0 0x7f5cc00c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc6b3b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc015c3a0 0x7f5cc00c2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48312/0 (socket says 172.21.15.61:48312) 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.109+0000 7f5cc6b3b700 1 -- 172.21.15.61:0/4106523559 learned_addr learned my addr 172.21.15.61:0/4106523559 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cc6b3b700 1 -- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5cc01579f0 msgr2=0x7f5cc00b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cc6b3b700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5cc01579f0 0x7f5cc00b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cc6b3b700 1 -- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cc00c9850 msgr2=0x7f5cc00c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cc633a700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cc00c9850 0x7f5cc00c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cc6b3b700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cc00c9850 0x7f5cc00c7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cc6b3b700 1 -- 172.21.15.61:0/4106523559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8009a20 con 0x7f5cc015c3a0 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cc6b3b700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc015c3a0 0x7f5cc00c2ae0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5cc006d770 tx=0x7f5cb8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cb67fc700 1 -- 172.21.15.61:0/4106523559 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb801e640 con 0x7f5cc015c3a0 2023-12-24T20:00:33.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cb67fc700 1 -- 172.21.15.61:0/4106523559 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb801e7a0 con 0x7f5cc015c3a0 2023-12-24T20:00:33.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cc859e700 1 -- 172.21.15.61:0/4106523559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc00c4b30 con 0x7f5cc015c3a0 2023-12-24T20:00:33.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cb67fc700 1 -- 172.21.15.61:0/4106523559 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb801eb40 con 0x7f5cc015c3a0 2023-12-24T20:00:33.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.110+0000 7f5cc859e700 1 -- 172.21.15.61:0/4106523559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc00c50f0 con 0x7f5cc015c3a0 2023-12-24T20:00:33.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.111+0000 7f5cc859e700 1 -- 172.21.15.61:0/4106523559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc00c55d0 con 0x7f5cc015c3a0 2023-12-24T20:00:33.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.111+0000 7f5cb67fc700 1 -- 172.21.15.61:0/4106523559 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5cb8024070 con 0x7f5cc015c3a0 2023-12-24T20:00:33.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.112+0000 7f5cb67fc700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ca4066f30 0x7f5ca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:33.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.112+0000 7f5cb67fc700 1 -- 172.21.15.61:0/4106523559 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f5cb8086e40 con 0x7f5cc015c3a0 2023-12-24T20:00:33.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.112+0000 7f5cc633a700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ca4066f30 0x7f5ca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:33.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.113+0000 7f5cc633a700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ca4066f30 0x7f5ca40693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00027e0 tx=0x7f5cb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:33.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.116+0000 7f5cb67fc700 1 -- 172.21.15.61:0/4106523559 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cb8054210 con 0x7f5cc015c3a0 2023-12-24T20:00:33.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.312+0000 7f5cc859e700 1 -- 172.21.15.61:0/4106523559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5cc004c3c0 con 0x7f5cc015c3a0 2023-12-24T20:00:33.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.958+0000 7f5cb67fc700 1 -- 172.21.15.61:0/4106523559 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5cb805be60 con 0x7f5cc015c3a0 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.964+0000 7f5cc859e700 1 -- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ca4066f30 msgr2=0x7f5ca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.964+0000 7f5cc859e700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ca4066f30 0x7f5ca40693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00027e0 tx=0x7f5cb0009040 comp rx=0 tx=0).stop 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.964+0000 7f5cc859e700 1 -- 172.21.15.61:0/4106523559 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc015c3a0 msgr2=0x7f5cc00c2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.964+0000 7f5cc859e700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc015c3a0 0x7f5cc00c2ae0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5cc006d770 tx=0x7f5cb8018000 comp rx=0 tx=0).stop 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.964+0000 7f5cc859e700 1 -- 172.21.15.61:0/4106523559 shutdown_connections 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.964+0000 7f5cc859e700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ca4066f30 0x7f5ca40693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.964+0000 7f5cc859e700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5cc015c3a0 0x7f5cc00c2ae0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.964+0000 7f5cc859e700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cc00c9850 0x7f5cc00c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.964+0000 7f5cc859e700 1 --2- 172.21.15.61:0/4106523559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5cc01579f0 0x7f5cc00b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.964+0000 7f5cc859e700 1 -- 172.21.15.61:0/4106523559 >> 172.21.15.61:0/4106523559 conn(0x7f5cc00ce1d0 msgr2=0x7f5cc0155e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:33.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.965+0000 7f5cc859e700 1 -- 172.21.15.61:0/4106523559 shutdown_connections 2023-12-24T20:00:33.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:33.965+0000 7f5cc859e700 1 -- 172.21.15.61:0/4106523559 wait complete. 2023-12-24T20:00:33.967 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T20:00:33.979 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:00:34.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.104+0000 7fdba7ad6700 1 Processor -- start 2023-12-24T20:00:34.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.104+0000 7fdba7ad6700 1 -- start start 2023-12-24T20:00:34.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.105+0000 7fdba7ad6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdba0157680 0x7fdba0157a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.105+0000 7fdba7ad6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba006f380 0x7fdba006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.105+0000 7fdba7ad6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba015c3f0 con 0x7fdba006ac10 2023-12-24T20:00:34.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.105+0000 7fdba7ad6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba015b500 con 0x7fdba0157680 2023-12-24T20:00:34.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.105+0000 7fdba7ad6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba015b7e0 con 0x7fdba006f380 2023-12-24T20:00:34.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.105+0000 7fdba5071700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba006f380 0x7fdba006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.105+0000 7fdba5872700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdba0157680 0x7fdba0157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.105+0000 7fdba5071700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba006f380 0x7fdba006f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:52452/0 (socket says 172.21.15.61:52452) 2023-12-24T20:00:34.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.105+0000 7fdba5071700 1 -- 172.21.15.61:0/3243629672 learned_addr learned my addr 172.21.15.61:0/3243629672 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:34.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.106+0000 7fdba5071700 1 -- 172.21.15.61:0/3243629672 >> v2:172.21.15.133:3300/0 conn(0x7fdba0157680 msgr2=0x7fdba0157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:34.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.106+0000 7fdba5071700 1 --2- 172.21.15.61:0/3243629672 >> v2:172.21.15.133:3300/0 conn(0x7fdba0157680 0x7fdba0157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.106+0000 7fdba5071700 1 -- 172.21.15.61:0/3243629672 >> v1:172.21.15.133:6789/0 conn(0x7fdba006ac10 legacy=0x7fdba00c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.106+0000 7fdba5071700 1 -- 172.21.15.61:0/3243629672 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba015bac0 con 0x7fdba006f380 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.106+0000 7fdba5872700 1 --2- 172.21.15.61:0/3243629672 >> v2:172.21.15.133:3300/0 conn(0x7fdba0157680 0x7fdba0157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.106+0000 7fdba4870700 1 -- 172.21.15.61:0/3243629672 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878829254 0 0) 0x7fdba015c3f0 con 0x7fdba006ac10 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.106+0000 7fdba5071700 1 --2- 172.21.15.61:0/3243629672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba006f380 0x7fdba006f7d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0099b0 tx=0x7fdb9c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36716885c54583e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.106+0000 7fdba4870700 1 -- 172.21.15.61:0/3243629672 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c009ea0 con 0x7fdba006f380 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.106+0000 7fdba4870700 1 -- 172.21.15.61:0/3243629672 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c00b860 con 0x7fdba006f380 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.106+0000 7fdba4870700 1 -- 172.21.15.61:0/3243629672 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00bc00 con 0x7fdba006f380 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.107+0000 7fdba7ad6700 1 -- 172.21.15.61:0/3243629672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba006f380 msgr2=0x7fdba006f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.107+0000 7fdba7ad6700 1 --2- 172.21.15.61:0/3243629672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba006f380 0x7fdba006f7d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0099b0 tx=0x7fdb9c009250 comp rx=0 tx=0).stop 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.107+0000 7fdba7ad6700 1 -- 172.21.15.61:0/3243629672 shutdown_connections 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.107+0000 7fdba7ad6700 1 --2- 172.21.15.61:0/3243629672 >> v2:172.21.15.133:3300/0 conn(0x7fdba0157680 0x7fdba0157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.107+0000 7fdba7ad6700 1 --2- 172.21.15.61:0/3243629672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba006f380 0x7fdba006f7d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.107+0000 7fdba7ad6700 1 -- 172.21.15.61:0/3243629672 >> 172.21.15.61:0/3243629672 conn(0x7fdba00ce800 msgr2=0x7fdba00cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:34.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.107+0000 7fdba7ad6700 1 -- 172.21.15.61:0/3243629672 shutdown_connections 2023-12-24T20:00:34.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.107+0000 7fdba7ad6700 1 -- 172.21.15.61:0/3243629672 wait complete. 2023-12-24T20:00:34.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.108+0000 7fdba7ad6700 1 Processor -- start 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.108+0000 7fdba7ad6700 1 -- start start 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba7ad6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdba006ac10 0x7fdba00c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba7ad6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba006f380 0x7fdba00ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba7ad6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba0157680 0x7fdba00b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba7ad6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00b41b0 con 0x7fdba006f380 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba7ad6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba00c8180 con 0x7fdba006ac10 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba7ad6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0068060 con 0x7fdba0157680 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba5071700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba006f380 0x7fdba00ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba5071700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba006f380 0x7fdba00ab9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48314/0 (socket says 172.21.15.61:48314) 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba5071700 1 -- 172.21.15.61:0/2322012657 learned_addr learned my addr 172.21.15.61:0/2322012657 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba6073700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba0157680 0x7fdba00b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba5872700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdba006ac10 0x7fdba00c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba5071700 1 -- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba0157680 msgr2=0x7fdba00b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba5071700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba0157680 0x7fdba00b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba5071700 1 -- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdba006ac10 msgr2=0x7fdba00c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba5071700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdba006ac10 0x7fdba00c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba5071700 1 -- 172.21.15.61:0/2322012657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90009420 con 0x7fdba006f380 2023-12-24T20:00:34.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdba5071700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba006f380 0x7fdba00ab9c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c006fd0 tx=0x7fdb9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:34.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdb95ffb700 1 -- 172.21.15.61:0/2322012657 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c000d10 con 0x7fdba006f380 2023-12-24T20:00:34.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.109+0000 7fdb95ffb700 1 -- 172.21.15.61:0/2322012657 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c00bbe0 con 0x7fdba006f380 2023-12-24T20:00:34.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.110+0000 7fdba7ad6700 1 -- 172.21.15.61:0/2322012657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c0094f0 con 0x7fdba006f380 2023-12-24T20:00:34.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.110+0000 7fdb95ffb700 1 -- 172.21.15.61:0/2322012657 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c011690 con 0x7fdba006f380 2023-12-24T20:00:34.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.110+0000 7fdba7ad6700 1 -- 172.21.15.61:0/2322012657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba00c7160 con 0x7fdba006f380 2023-12-24T20:00:34.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.111+0000 7fdba7ad6700 1 -- 172.21.15.61:0/2322012657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba004c3c0 con 0x7fdba006f380 2023-12-24T20:00:34.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.111+0000 7fdb95ffb700 1 -- 172.21.15.61:0/2322012657 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdb9c011a40 con 0x7fdba006f380 2023-12-24T20:00:34.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.112+0000 7fdb95ffb700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb84066f30 0x7fdb840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.112+0000 7fdb95ffb700 1 -- 172.21.15.61:0/2322012657 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdb9c0859f0 con 0x7fdba006f380 2023-12-24T20:00:34.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.112+0000 7fdba5872700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb84066f30 0x7fdb840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.112+0000 7fdba5872700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb84066f30 0x7fdb840693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009f40 tx=0x7fdb900091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:34.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.116+0000 7fdb95ffb700 1 -- 172.21.15.61:0/2322012657 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb9c052f60 con 0x7fdba006f380 2023-12-24T20:00:34.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.310+0000 7fdba7ad6700 1 -- 172.21.15.61:0/2322012657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdba015bda0 con 0x7fdba006f380 2023-12-24T20:00:34.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.314+0000 7fdb95ffb700 1 -- 172.21.15.61:0/2322012657 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdb9c056580 con 0x7fdba006f380 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 -- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb84066f30 msgr2=0x7fdb840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb84066f30 0x7fdb840693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009f40 tx=0x7fdb900091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 -- 172.21.15.61:0/2322012657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba006f380 msgr2=0x7fdba00ab9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba006f380 0x7fdba00ab9c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c006fd0 tx=0x7fdb9c017000 comp rx=0 tx=0).stop 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 -- 172.21.15.61:0/2322012657 shutdown_connections 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdba0157680 0x7fdba00b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdb84066f30 0x7fdb840693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdba006ac10 0x7fdba00c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 --2- 172.21.15.61:0/2322012657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdba006f380 0x7fdba00ab9c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 -- 172.21.15.61:0/2322012657 >> 172.21.15.61:0/2322012657 conn(0x7fdba00ce800 msgr2=0x7fdba00ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:34.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 -- 172.21.15.61:0/2322012657 shutdown_connections 2023-12-24T20:00:34.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.316+0000 7fdba7ad6700 1 -- 172.21.15.61:0/2322012657 wait complete. 2023-12-24T20:00:34.331 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-12-24T20:00:34.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.451+0000 7efde6d12700 1 Processor -- start 2023-12-24T20:00:34.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.451+0000 7efde6d12700 1 -- start start 2023-12-24T20:00:34.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.452+0000 7efde6d12700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efde015bb60 0x7efde0098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.452+0000 7efde6d12700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7efde0098aa0 0x7efde015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.452+0000 7efde6d12700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde00b2eb0 con 0x7efde015c470 2023-12-24T20:00:34.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.452+0000 7efde6d12700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00afc20 con 0x7efde0098aa0 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.452+0000 7efde6d12700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00b2bd0 con 0x7efde015bb60 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.452+0000 7efddffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7efde0098aa0 0x7efde015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.452+0000 7efddffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7efde0098aa0 0x7efde015bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48316/0 (socket says 172.21.15.61:48316) 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.452+0000 7efddffff700 1 -- 172.21.15.61:0/1507075241 learned_addr learned my addr 172.21.15.61:0/1507075241 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.453+0000 7efde4aae700 1 --2- 172.21.15.61:0/1507075241 >> v2:172.21.15.133:3300/0 conn(0x7efde015bb60 0x7efde0098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.453+0000 7efddffff700 1 -- 172.21.15.61:0/1507075241 >> v2:172.21.15.133:3300/0 conn(0x7efde015bb60 msgr2=0x7efde0098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.453+0000 7efddffff700 1 --2- 172.21.15.61:0/1507075241 >> v2:172.21.15.133:3300/0 conn(0x7efde015bb60 0x7efde0098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.453+0000 7efddffff700 1 -- 172.21.15.61:0/1507075241 >> v1:172.21.15.133:6789/0 conn(0x7efde015c470 legacy=0x7efde00b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.453+0000 7efddffff700 1 -- 172.21.15.61:0/1507075241 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00afe10 con 0x7efde0098aa0 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.453+0000 7efddffff700 1 --2- 172.21.15.61:0/1507075241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde0098aa0 0x7efde015bf30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efde006d9b0 tx=0x7efdcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea637209241d5429 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.453+0000 7efddf7fe700 1 -- 172.21.15.61:0/1507075241 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00b860 con 0x7efde0098aa0 2023-12-24T20:00:34.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.453+0000 7efddf7fe700 1 -- 172.21.15.61:0/1507075241 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc00b9c0 con 0x7efde0098aa0 2023-12-24T20:00:34.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.453+0000 7efddf7fe700 1 -- 172.21.15.61:0/1507075241 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc00bd60 con 0x7efde0098aa0 2023-12-24T20:00:34.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.454+0000 7efde6d12700 1 -- 172.21.15.61:0/1507075241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde0098aa0 msgr2=0x7efde015bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.454+0000 7efde6d12700 1 --2- 172.21.15.61:0/1507075241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde0098aa0 0x7efde015bf30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7efde006d9b0 tx=0x7efdcc009250 comp rx=0 tx=0).stop 2023-12-24T20:00:34.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.454+0000 7efde6d12700 1 -- 172.21.15.61:0/1507075241 shutdown_connections 2023-12-24T20:00:34.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.454+0000 7efde6d12700 1 --2- 172.21.15.61:0/1507075241 >> v2:172.21.15.133:3300/0 conn(0x7efde015bb60 0x7efde0098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.454+0000 7efde6d12700 1 --2- 172.21.15.61:0/1507075241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde0098aa0 0x7efde015bf30 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.454+0000 7efde6d12700 1 -- 172.21.15.61:0/1507075241 >> 172.21.15.61:0/1507075241 conn(0x7efde0097a10 msgr2=0x7efde00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:34.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.454+0000 7efde6d12700 1 -- 172.21.15.61:0/1507075241 shutdown_connections 2023-12-24T20:00:34.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.454+0000 7efde6d12700 1 -- 172.21.15.61:0/1507075241 wait complete. 2023-12-24T20:00:34.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.455+0000 7efde6d12700 1 Processor -- start 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.455+0000 7efde6d12700 1 -- start start 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efde6d12700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efde0098aa0 0x7efde016b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efde6d12700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde015bb60 0x7efde016a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efde6d12700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efde015c470 0x7efde00b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efde6d12700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0068440 con 0x7efde015bb60 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efde6d12700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde016b890 con 0x7efde015c470 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efde6d12700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde0067550 con 0x7efde0098aa0 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde015bb60 0x7efde016a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde015bb60 0x7efde016a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48318/0 (socket says 172.21.15.61:48318) 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddffff700 1 -- 172.21.15.61:0/1152665525 learned_addr learned my addr 172.21.15.61:0/1152665525 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:34.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efde4aae700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efde0098aa0 0x7efde016b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efde52af700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efde015c470 0x7efde00b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddffff700 1 -- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efde0098aa0 msgr2=0x7efde016b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddffff700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efde0098aa0 0x7efde016b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddffff700 1 -- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efde015c470 msgr2=0x7efde00b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddffff700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efde015c470 0x7efde00b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddffff700 1 -- 172.21.15.61:0/1152665525 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc0094f0 con 0x7efde015bb60 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efde4aae700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efde0098aa0 0x7efde016b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddffff700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde015bb60 0x7efde016a070 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7efde006d8b0 tx=0x7efdcc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddcff9700 1 -- 172.21.15.61:0/1152665525 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc011e60 con 0x7efde015bb60 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddcff9700 1 -- 172.21.15.61:0/1152665525 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc01a630 con 0x7efde015bb60 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efddcff9700 1 -- 172.21.15.61:0/1152665525 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc01a9f0 con 0x7efde015bb60 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.456+0000 7efde6d12700 1 -- 172.21.15.61:0/1152665525 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde0067830 con 0x7efde015bb60 2023-12-24T20:00:34.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.457+0000 7efde6d12700 1 -- 172.21.15.61:0/1152665525 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde0067df0 con 0x7efde015bb60 2023-12-24T20:00:34.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.457+0000 7efde6d12700 1 -- 172.21.15.61:0/1152665525 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde0098770 con 0x7efde015bb60 2023-12-24T20:00:34.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.458+0000 7efddcff9700 1 -- 172.21.15.61:0/1152665525 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7efdcc02d440 con 0x7efde015bb60 2023-12-24T20:00:34.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.458+0000 7efddcff9700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efdc4066f30 0x7efdc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:34.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.458+0000 7efddcff9700 1 -- 172.21.15.61:0/1152665525 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efdcc085de0 con 0x7efde015bb60 2023-12-24T20:00:34.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.458+0000 7efde4aae700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efdc4066f30 0x7efdc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:34.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.459+0000 7efde4aae700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efdc4066f30 0x7efdc40693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efdd4006aa0 tx=0x7efdd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:34.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.463+0000 7efddcff9700 1 -- 172.21.15.61:0/1152665525 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdcc053350 con 0x7efde015bb60 2023-12-24T20:00:34.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.740+0000 7efde6d12700 1 -- 172.21.15.61:0/1152665525 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7efde006d440 con 0x7efde015bb60 2023-12-24T20:00:34.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.957+0000 7efddcff9700 1 -- 172.21.15.61:0/1152665525 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v186) v1 ==== 134+0+0 (secure 0 0 0) 0x7efdcc056970 con 0x7efde015bb60 2023-12-24T20:00:34.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 -- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efdc4066f30 msgr2=0x7efdc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efdc4066f30 0x7efdc40693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efdd4006aa0 tx=0x7efdd4008040 comp rx=0 tx=0).stop 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 -- 172.21.15.61:0/1152665525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde015bb60 msgr2=0x7efde016a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde015bb60 0x7efde016a070 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7efde006d8b0 tx=0x7efdcc017000 comp rx=0 tx=0).stop 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 -- 172.21.15.61:0/1152665525 shutdown_connections 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efde0098aa0 0x7efde016b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efdc4066f30 0x7efdc40693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efde015c470 0x7efde00b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 --2- 172.21.15.61:0/1152665525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efde015bb60 0x7efde016a070 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 -- 172.21.15.61:0/1152665525 >> 172.21.15.61:0/1152665525 conn(0x7efde0097a10 msgr2=0x7efde01557f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 -- 172.21.15.61:0/1152665525 shutdown_connections 2023-12-24T20:00:34.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:34.959+0000 7efde6d12700 1 -- 172.21.15.61:0/1152665525 wait complete. 2023-12-24T20:00:34.973 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-24T20:00:34.973 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-12-24T20:00:34.974 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-12-24T20:00:34.974 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-12-24T20:00:35.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.096+0000 7f54ea214700 1 Processor -- start 2023-12-24T20:00:35.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.096+0000 7f54ea214700 1 -- start start 2023-12-24T20:00:35.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.096+0000 7f54ea214700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54e4159a90 0x7f54e4070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:35.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.096+0000 7f54ea214700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f54e40b04c0 0x7f54e40c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:35.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54ea214700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e406a090 con 0x7f54e4159e60 2023-12-24T20:00:35.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54ea214700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e406ac10 con 0x7f54e40b04c0 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54ea214700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e406a2e0 con 0x7f54e4159a90 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e3fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f54e40b04c0 0x7f54e40c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e2ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f54e4159e60 0x7f54e40c93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51702/0 (socket says 172.21.15.61:51702) 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e2ffd700 1 -- 172.21.15.61:0/3065347393 learned_addr learned my addr 172.21.15.61:0/3065347393 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e3fff700 1 -- 172.21.15.61:0/3065347393 >> v2:172.21.15.133:3300/0 conn(0x7f54e4159a90 msgr2=0x7f54e4070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e3fff700 1 --2- 172.21.15.61:0/3065347393 >> v2:172.21.15.133:3300/0 conn(0x7f54e4159a90 0x7f54e4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e3fff700 1 -- 172.21.15.61:0/3065347393 >> v1:172.21.15.61:6789/0 conn(0x7f54e4159e60 legacy=0x7f54e40c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e27fc700 1 -- 172.21.15.61:0/3065347393 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563931680 0 0) 0x7f54e406a090 con 0x7f54e4159e60 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e3fff700 1 -- 172.21.15.61:0/3065347393 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e406a5c0 con 0x7f54e40b04c0 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e3fff700 1 --2- 172.21.15.61:0/3065347393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e40b04c0 0x7f54e40c9ad0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f54e406d110 tx=0x7f54dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e3b15645939b34 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e27fc700 1 -- 172.21.15.61:0/3065347393 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00b6b0 con 0x7f54e40b04c0 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e27fc700 1 -- 172.21.15.61:0/3065347393 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc00b810 con 0x7f54e40b04c0 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.097+0000 7f54e27fc700 1 -- 172.21.15.61:0/3065347393 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00bbb0 con 0x7f54e40b04c0 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.098+0000 7f54ea214700 1 -- 172.21.15.61:0/3065347393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e40b04c0 msgr2=0x7f54e40c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:35.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.098+0000 7f54ea214700 1 --2- 172.21.15.61:0/3065347393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e40b04c0 0x7f54e40c9ad0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f54e406d110 tx=0x7f54dc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:35.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.098+0000 7f54ea214700 1 -- 172.21.15.61:0/3065347393 shutdown_connections 2023-12-24T20:00:35.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.098+0000 7f54ea214700 1 --2- 172.21.15.61:0/3065347393 >> v2:172.21.15.133:3300/0 conn(0x7f54e4159a90 0x7f54e4070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:35.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.098+0000 7f54ea214700 1 --2- 172.21.15.61:0/3065347393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e40b04c0 0x7f54e40c9ad0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:35.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.098+0000 7f54ea214700 1 -- 172.21.15.61:0/3065347393 >> 172.21.15.61:0/3065347393 conn(0x7f54e40cd6f0 msgr2=0x7f54e40cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:35.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.098+0000 7f54ea214700 1 -- 172.21.15.61:0/3065347393 shutdown_connections 2023-12-24T20:00:35.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.098+0000 7f54ea214700 1 -- 172.21.15.61:0/3065347393 wait complete. 2023-12-24T20:00:35.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.099+0000 7f54ea214700 1 Processor -- start 2023-12-24T20:00:35.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.099+0000 7f54ea214700 1 -- start start 2023-12-24T20:00:35.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54ea214700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e40b04c0 0x7f54e416d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:35.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54ea214700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e4159a90 0x7f54e40c1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:35.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54ea214700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e4159e60 0x7f54e41587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:35.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54ea214700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40c3b90 con 0x7f54e4159e60 2023-12-24T20:00:35.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54ea214700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e416daf0 con 0x7f54e40b04c0 2023-12-24T20:00:35.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54ea214700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40c2f80 con 0x7f54e4159a90 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54e3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e4159e60 0x7f54e41587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54e3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e4159e60 0x7f54e41587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48336/0 (socket says 172.21.15.61:48336) 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54e3fff700 1 -- 172.21.15.61:0/1457933681 learned_addr learned my addr 172.21.15.61:0/1457933681 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54e37fe700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e40b04c0 0x7f54e416d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54e2ffd700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e4159a90 0x7f54e40c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54e3fff700 1 -- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e4159a90 msgr2=0x7f54e40c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54e3fff700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e4159a90 0x7f54e40c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54e3fff700 1 -- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e40b04c0 msgr2=0x7f54e416d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54e3fff700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e40b04c0 0x7f54e416d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.100+0000 7f54e3fff700 1 -- 172.21.15.61:0/1457933681 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc009420 con 0x7f54e4159e60 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.101+0000 7f54e3fff700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e4159e60 0x7f54e41587c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f54e40cd230 tx=0x7f54dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.101+0000 7f54db7fe700 1 -- 172.21.15.61:0/1457933681 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc01f070 con 0x7f54e4159e60 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.101+0000 7f54db7fe700 1 -- 172.21.15.61:0/1457933681 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc00ba50 con 0x7f54e4159e60 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.101+0000 7f54db7fe700 1 -- 172.21.15.61:0/1457933681 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc025670 con 0x7f54e4159e60 2023-12-24T20:00:35.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.101+0000 7f54ea214700 1 -- 172.21.15.61:0/1457933681 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e40c3260 con 0x7f54e4159e60 2023-12-24T20:00:35.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.101+0000 7f54ea214700 1 -- 172.21.15.61:0/1457933681 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e40c3820 con 0x7f54e4159e60 2023-12-24T20:00:35.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.102+0000 7f54ea214700 1 -- 172.21.15.61:0/1457933681 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e404c3c0 con 0x7f54e4159e60 2023-12-24T20:00:35.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.102+0000 7f54db7fe700 1 -- 172.21.15.61:0/1457933681 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f54dc023070 con 0x7f54e4159e60 2023-12-24T20:00:35.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.103+0000 7f54db7fe700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f54c4066f30 0x7f54c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:35.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.103+0000 7f54db7fe700 1 -- 172.21.15.61:0/1457933681 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f54dc085b30 con 0x7f54e4159e60 2023-12-24T20:00:35.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.103+0000 7f54e37fe700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f54c4066f30 0x7f54c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:35.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.103+0000 7f54e37fe700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f54c4066f30 0x7f54c40693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f54d4001250 tx=0x7f54d4009620 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:35.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.107+0000 7f54db7fe700 1 -- 172.21.15.61:0/1457933681 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54dc053040 con 0x7f54e4159e60 2023-12-24T20:00:35.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.387+0000 7f54ea214700 1 -- 172.21.15.61:0/1457933681 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f54e406a8a0 con 0x7f54e4159e60 2023-12-24T20:00:35.888 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:00:35.891 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:00:35.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.958+0000 7f54db7fe700 1 -- 172.21.15.61:0/1457933681 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v187) v1 ==== 136+0+0 (secure 0 0 0) 0x7f54dc056620 con 0x7f54e4159e60 2023-12-24T20:00:35.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 -- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f54c4066f30 msgr2=0x7f54c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:35.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f54c4066f30 0x7f54c40693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f54d4001250 tx=0x7f54d4009620 comp rx=0 tx=0).stop 2023-12-24T20:00:35.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 -- 172.21.15.61:0/1457933681 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e4159e60 msgr2=0x7f54e41587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:35.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e4159e60 0x7f54e41587c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f54e40cd230 tx=0x7f54dc017000 comp rx=0 tx=0).stop 2023-12-24T20:00:35.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 -- 172.21.15.61:0/1457933681 shutdown_connections 2023-12-24T20:00:35.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f54c4066f30 0x7f54c40693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:35.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54e4159e60 0x7f54e41587c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:35.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e40b04c0 0x7f54e416d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:35.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 --2- 172.21.15.61:0/1457933681 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54e4159a90 0x7f54e40c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:35.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 -- 172.21.15.61:0/1457933681 >> 172.21.15.61:0/1457933681 conn(0x7f54e40cd6f0 msgr2=0x7f54e406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:35.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 -- 172.21.15.61:0/1457933681 shutdown_connections 2023-12-24T20:00:35.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:35.960+0000 7f54ea214700 1 -- 172.21.15.61:0/1457933681 wait complete. 2023-12-24T20:00:35.975 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-24T20:00:36.153 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_objectstore":"memstore"} 2023-12-24T20:00:36.153 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-24T20:00:36.154 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T20:00:36.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.278+0000 7fd3b8c02700 1 Processor -- start 2023-12-24T20:00:36.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.278+0000 7fd3b8c02700 1 -- start start 2023-12-24T20:00:36.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.279+0000 7fd3b8c02700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3b4156b60 0x7fd3b406af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.279+0000 7fd3b8c02700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3b40c3630 0x7fd3b40c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.279+0000 7fd3b8c02700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b406aaf0 con 0x7fd3b4067f10 2023-12-24T20:00:36.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.279+0000 7fd3b8c02700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b4069c00 con 0x7fd3b4156b60 2023-12-24T20:00:36.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.279+0000 7fd3b8c02700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4069ee0 con 0x7fd3b40c3630 2023-12-24T20:00:36.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.279+0000 7fd3b1d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd3b4067f10 0x7fd3b40c2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51706/0 (socket says 172.21.15.61:51706) 2023-12-24T20:00:36.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.279+0000 7fd3b1d9b700 1 -- 172.21.15.61:0/2331600022 learned_addr learned my addr 172.21.15.61:0/2331600022 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:36.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625311862 0 0) 0x7fd3b406aaf0 con 0x7fd3b4067f10 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b2d9d700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3b40c3630 0x7fd3b40c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a0003570 con 0x7fd3b4067f10 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b259c700 1 --2- 172.21.15.61:0/2331600022 >> v2:172.21.15.133:3300/0 conn(0x7fd3b4156b60 0x7fd3b406af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2050243850 0 0) 0x7fd3a0003570 con 0x7fd3b4067f10 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3b40c3630 msgr2=0x7fd3b40c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3b40c3630 0x7fd3b40c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 >> v2:172.21.15.133:3300/0 conn(0x7fd3b4156b60 msgr2=0x7fd3b406af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 --2- 172.21.15.61:0/2331600022 >> v2:172.21.15.133:3300/0 conn(0x7fd3b4156b60 0x7fd3b406af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b406a1c0 con 0x7fd3b4067f10 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fd39c001470 con 0x7fd3b4067f10 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 >> v1:172.21.15.61:6789/0 conn(0x7fd3b4067f10 legacy=0x7fd3b40c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3a0003a60 0x7fd3a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a0004810 0x7fd3a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3b40c3630 0x7fd3a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4069c00 con 0x7fd3a0003a60 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4069ee0 con 0x7fd3a0004810 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a000dc70 con 0x7fd3b40c3630 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b259c700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3a0003a60 0x7fd3a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b1d9b700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a0004810 0x7fd3a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b2d9d700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3b40c3630 0x7fd3a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b259c700 1 -- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3b40c3630 msgr2=0x7fd3a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b259c700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3b40c3630 0x7fd3a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b259c700 1 -- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a0004810 msgr2=0x7fd3a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b259c700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a0004810 0x7fd3a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.280+0000 7fd3b259c700 1 -- 172.21.15.61:0/2331600022 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0003570 con 0x7fd3a0003a60 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b259c700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3a0003a60 0x7fd3a0003e70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009c30 tx=0x7fd3a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e635ddb61e9387 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400e710 con 0x7fd3a0003a60 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a400e870 con 0x7fd3a0003a60 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b159a700 1 -- 172.21.15.61:0/2331600022 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400ec30 con 0x7fd3a0003a60 2023-12-24T20:00:36.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b8c02700 1 -- 172.21.15.61:0/2331600022 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3a0003a60 msgr2=0x7fd3a0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b8c02700 1 --2- 172.21.15.61:0/2331600022 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3a0003a60 0x7fd3a0003e70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009c30 tx=0x7fd3a40091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b2d9d700 1 -- 172.21.15.61:0/2331600022 reap_dead start 2023-12-24T20:00:36.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b8c02700 1 -- 172.21.15.61:0/2331600022 shutdown_connections 2023-12-24T20:00:36.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b8c02700 1 -- 172.21.15.61:0/2331600022 >> 172.21.15.61:0/2331600022 conn(0x7fd3b40ce420 msgr2=0x7fd3b40ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:36.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b8c02700 1 -- 172.21.15.61:0/2331600022 shutdown_connections 2023-12-24T20:00:36.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.281+0000 7fd3b8c02700 1 -- 172.21.15.61:0/2331600022 wait complete. 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b8c02700 1 Processor -- start 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b8c02700 1 -- start start 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b8c02700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3a0003a60 0x7fd3b4166980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b8c02700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3b4166ec0 0x7fd3b4155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b8c02700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b4156090 0x7fd3b40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b8c02700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4149e90 con 0x7fd3b4166ec0 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b8c02700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4149030 con 0x7fd3b4156090 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b8c02700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4149280 con 0x7fd3a0003a60 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b1d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3b4166ec0 0x7fd3b4155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b1d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3b4166ec0 0x7fd3b4155b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48352/0 (socket says 172.21.15.61:48352) 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.283+0000 7fd3b1d9b700 1 -- 172.21.15.61:0/590089968 learned_addr learned my addr 172.21.15.61:0/590089968 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b259c700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3a0003a60 0x7fd3b4166980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b2d9d700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b4156090 0x7fd3b40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b1d9b700 1 -- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3a0003a60 msgr2=0x7fd3b4166980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b1d9b700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3a0003a60 0x7fd3b4166980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b1d9b700 1 -- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b4156090 msgr2=0x7fd3b40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b1d9b700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b4156090 0x7fd3b40ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b1d9b700 1 -- 172.21.15.61:0/590089968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b4149560 con 0x7fd3b4166ec0 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b259c700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3a0003a60 0x7fd3b4166980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b2d9d700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b4156090 0x7fd3b40ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b1d9b700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3b4166ec0 0x7fd3b4155b50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0073c0 tx=0x7fd39c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3aa7fc700 1 -- 172.21.15.61:0/590089968 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c018030 con 0x7fd3b4166ec0 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3aa7fc700 1 -- 172.21.15.61:0/590089968 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c00f9a0 con 0x7fd3b4166ec0 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3aa7fc700 1 -- 172.21.15.61:0/590089968 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c00fd40 con 0x7fd3b4166ec0 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b8c02700 1 -- 172.21.15.61:0/590089968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b4149840 con 0x7fd3b4166ec0 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.284+0000 7fd3b8c02700 1 -- 172.21.15.61:0/590089968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b40cd150 con 0x7fd3b4166ec0 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.285+0000 7fd3b8c02700 1 -- 172.21.15.61:0/590089968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b414a040 con 0x7fd3b4166ec0 2023-12-24T20:00:36.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.286+0000 7fd3aa7fc700 1 -- 172.21.15.61:0/590089968 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd39c01b070 con 0x7fd3b4166ec0 2023-12-24T20:00:36.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.286+0000 7fd3aa7fc700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd394066f30 0x7fd3940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.286+0000 7fd3aa7fc700 1 -- 172.21.15.61:0/590089968 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd39c019070 con 0x7fd3b4166ec0 2023-12-24T20:00:36.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.286+0000 7fd3b259c700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd394066f30 0x7fd3940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.287+0000 7fd3b259c700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd394066f30 0x7fd3940693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40091e0 tx=0x7fd3a401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:36.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.290+0000 7fd3aa7fc700 1 -- 172.21.15.61:0/590089968 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3b414a040 con 0x7fd3b4166ec0 2023-12-24T20:00:36.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.486+0000 7fd3b8c02700 1 -- 172.21.15.61:0/590089968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd3b414a040 con 0x7fd3b4166ec0 2023-12-24T20:00:36.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.489+0000 7fd3aa7fc700 1 -- 172.21.15.61:0/590089968 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd3b414a040 con 0x7fd3b4166ec0 2023-12-24T20:00:36.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 -- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd394066f30 msgr2=0x7fd3940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd394066f30 0x7fd3940693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40091e0 tx=0x7fd3a401a000 comp rx=0 tx=0).stop 2023-12-24T20:00:36.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 -- 172.21.15.61:0/590089968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3b4166ec0 msgr2=0x7fd3b4155b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3b4166ec0 0x7fd3b4155b50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0073c0 tx=0x7fd39c001e90 comp rx=0 tx=0).stop 2023-12-24T20:00:36.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 -- 172.21.15.61:0/590089968 shutdown_connections 2023-12-24T20:00:36.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd3a0003a60 0x7fd3b4166980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd394066f30 0x7fd3940693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3b4156090 0x7fd3b40ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 --2- 172.21.15.61:0/590089968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd3b4166ec0 0x7fd3b4155b50 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 -- 172.21.15.61:0/590089968 >> 172.21.15.61:0/590089968 conn(0x7fd3b40ce420 msgr2=0x7fd3b406e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:36.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 -- 172.21.15.61:0/590089968 shutdown_connections 2023-12-24T20:00:36.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.491+0000 7fd3b8c02700 1 -- 172.21.15.61:0/590089968 wait complete. 2023-12-24T20:00:36.505 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:00:36.505 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:00:36.554 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:00:36.598 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:00:36.598 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T20:00:36.598 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:00:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.719+0000 7effc1fe0700 1 Processor -- start 2023-12-24T20:00:36.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.719+0000 7effc1fe0700 1 -- start start 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effc1fe0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7effbc068710 0x7effbc1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effc1fe0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc06ae40 con 0x7effbc156b30 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effc1fe0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc0b06d0 con 0x7effbc15a8d0 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effc1fe0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc06a880 con 0x7effbc068710 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effbaffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7effbc068710 0x7effbc1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effbbfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7effbc156b30 0x7effbc0b0e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57230/0 (socket says 172.21.15.61:57230) 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effbbfff700 1 -- 172.21.15.61:0/969479916 learned_addr learned my addr 172.21.15.61:0/969479916 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effbaffd700 1 -- 172.21.15.61:0/969479916 >> v1:172.21.15.133:6789/0 conn(0x7effbc15a8d0 legacy=0x7effbc15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effbaffd700 1 -- 172.21.15.61:0/969479916 >> v1:172.21.15.61:6789/0 conn(0x7effbc156b30 legacy=0x7effbc0b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effbaffd700 1 -- 172.21.15.61:0/969479916 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc06ab60 con 0x7effbc068710 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.720+0000 7effba7fc700 1 -- 172.21.15.61:0/969479916 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238528310 0 0) 0x7effbc06ae40 con 0x7effbc156b30 2023-12-24T20:00:36.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effbaffd700 1 --2- 172.21.15.61:0/969479916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 0x7effbc1565f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7effa40098e0 tx=0x7effa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafd4212660801f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effba7fc700 1 -- 172.21.15.61:0/969479916 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4009e80 con 0x7effbc068710 2023-12-24T20:00:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effba7fc700 1 -- 172.21.15.61:0/969479916 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa400b820 con 0x7effbc068710 2023-12-24T20:00:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effba7fc700 1 -- 172.21.15.61:0/969479916 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa400bba0 con 0x7effbc068710 2023-12-24T20:00:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effc1fe0700 1 -- 172.21.15.61:0/969479916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 msgr2=0x7effbc1565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effc1fe0700 1 --2- 172.21.15.61:0/969479916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 0x7effbc1565f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7effa40098e0 tx=0x7effa40091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effc1fe0700 1 -- 172.21.15.61:0/969479916 shutdown_connections 2023-12-24T20:00:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effc1fe0700 1 --2- 172.21.15.61:0/969479916 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 0x7effbc1565f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effc1fe0700 1 -- 172.21.15.61:0/969479916 >> 172.21.15.61:0/969479916 conn(0x7effbc0ce200 msgr2=0x7effbc0af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effc1fe0700 1 -- 172.21.15.61:0/969479916 shutdown_connections 2023-12-24T20:00:36.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.721+0000 7effc1fe0700 1 -- 172.21.15.61:0/969479916 wait complete. 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.723+0000 7effc1fe0700 1 Processor -- start 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.723+0000 7effc1fe0700 1 -- start start 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.723+0000 7effc1fe0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 0x7effbc148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.723+0000 7effc1fe0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effbc156b30 0x7effbc0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.723+0000 7effc1fe0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effbc15a8d0 0x7effbc1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.723+0000 7effc1fe0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc148740 con 0x7effbc068710 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.723+0000 7effc1fe0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0a78d0 con 0x7effbc15a8d0 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.723+0000 7effc1fe0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0a7bb0 con 0x7effbc156b30 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 0x7effbc148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 0x7effbc148200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44466/0 (socket says 172.21.15.61:44466) 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbb7fe700 1 -- 172.21.15.61:0/3677177577 learned_addr learned my addr 172.21.15.61:0/3677177577 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:36.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbbfff700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effbc15a8d0 0x7effbc1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbb7fe700 1 -- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effbc156b30 msgr2=0x7effbc0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbb7fe700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effbc156b30 0x7effbc0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbb7fe700 1 -- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effbc15a8d0 msgr2=0x7effbc1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbb7fe700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effbc15a8d0 0x7effbc1556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbb7fe700 1 -- 172.21.15.61:0/3677177577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4009420 con 0x7effbc068710 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbbfff700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effbc15a8d0 0x7effbc1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effbb7fe700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 0x7effbc148200 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7effac00c5d0 tx=0x7effac007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effb37fe700 1 -- 172.21.15.61:0/3677177577 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac011590 con 0x7effbc068710 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effb37fe700 1 -- 172.21.15.61:0/3677177577 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac011710 con 0x7effbc068710 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effc1fe0700 1 -- 172.21.15.61:0/3677177577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc0a7e90 con 0x7effbc068710 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effb37fe700 1 -- 172.21.15.61:0/3677177577 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac011ad0 con 0x7effbc068710 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.724+0000 7effc1fe0700 1 -- 172.21.15.61:0/3677177577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc0cbe90 con 0x7effbc068710 2023-12-24T20:00:36.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.725+0000 7effc1fe0700 1 -- 172.21.15.61:0/3677177577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc04c3c0 con 0x7effbc068710 2023-12-24T20:00:36.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.726+0000 7effb37fe700 1 -- 172.21.15.61:0/3677177577 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7effac01c460 con 0x7effbc068710 2023-12-24T20:00:36.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.726+0000 7effb37fe700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7eff9c066f30 0x7eff9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:36.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.726+0000 7effb37fe700 1 -- 172.21.15.61:0/3677177577 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7effac084030 con 0x7effbc068710 2023-12-24T20:00:36.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.726+0000 7effbaffd700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7eff9c066f30 0x7eff9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:36.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.727+0000 7effbaffd700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7eff9c066f30 0x7eff9c0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7effbc0cd080 tx=0x7effa4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:36.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.730+0000 7effb37fe700 1 -- 172.21.15.61:0/3677177577 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effac0515a0 con 0x7effbc068710 2023-12-24T20:00:36.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.972+0000 7effc1fe0700 1 -- 172.21.15.61:0/3677177577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effbc15a1a0 con 0x7effbc068710 2023-12-24T20:00:36.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.972+0000 7effb37fe700 1 -- 172.21.15.61:0/3677177577 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+3532 (secure 0 0 0) 0x7effac054bc0 con 0x7effbc068710 2023-12-24T20:00:36.974 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:36.974 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2177201507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2177201507},{"type":"v1","addr":"172.21.15.61:6835","nonce":2177201507}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1435257239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1435257239},{"type":"v1","addr":"172.21.15.133:6837","nonce":1435257239}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":5353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/696274590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":696274590},{"type":"v1","addr":"172.21.15.133:6836","nonce":696274590}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1276323232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":1276323232},{"type":"v1","addr":"172.21.15.61:6834","nonce":1276323232}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[]} 2023-12-24T20:00:36.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 -- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7eff9c066f30 msgr2=0x7eff9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7eff9c066f30 0x7eff9c0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7effbc0cd080 tx=0x7effa4016000 comp rx=0 tx=0).stop 2023-12-24T20:00:36.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 -- 172.21.15.61:0/3677177577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 msgr2=0x7effbc148200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:36.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 0x7effbc148200 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7effac00c5d0 tx=0x7effac007f60 comp rx=0 tx=0).stop 2023-12-24T20:00:36.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 -- 172.21.15.61:0/3677177577 shutdown_connections 2023-12-24T20:00:36.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7eff9c066f30 0x7eff9c0693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effbc15a8d0 0x7effbc1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7effbc068710 0x7effbc148200 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 --2- 172.21.15.61:0/3677177577 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7effbc156b30 0x7effbc0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:36.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 -- 172.21.15.61:0/3677177577 >> 172.21.15.61:0/3677177577 conn(0x7effbc0ce200 msgr2=0x7effbc0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:36.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 -- 172.21.15.61:0/3677177577 shutdown_connections 2023-12-24T20:00:36.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:36.975+0000 7effc1fe0700 1 -- 172.21.15.61:0/3677177577 wait complete. 2023-12-24T20:00:36.977 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 37 2023-12-24T20:00:36.989 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T20:00:36.989 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T20:00:36.989 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:00:36.989 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:00:36.989 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T20:00:36.989 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T20:00:36.990 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:00:36.990 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:00:36.990 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T20:00:36.990 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T20:00:36.990 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:00:36.990 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:00:36.991 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T20:00:36.991 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T20:00:36.991 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:00:36.991 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:00:36.998 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:00:36.999 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T20:00:37.000 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:00:37.001 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T20:00:37.002 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:00:37.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T20:00:37.003 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:00:37.003 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T20:00:37.041 INFO:tasks.ceph.mds.c:Started 2023-12-24T20:00:37.042 DEBUG:teuthology.parallel:result is None 2023-12-24T20:00:37.042 INFO:tasks.ceph.mds.a:Started 2023-12-24T20:00:37.042 DEBUG:teuthology.parallel:result is None 2023-12-24T20:00:37.044 INFO:tasks.ceph.mds.b:Started 2023-12-24T20:00:37.045 DEBUG:teuthology.parallel:result is None 2023-12-24T20:00:37.045 INFO:tasks.ceph.mds.d:Started 2023-12-24T20:00:37.045 DEBUG:teuthology.parallel:result is None 2023-12-24T20:00:37.046 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T20:00:37.121 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T20:00:37.121 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T20:00:37.129 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T20:00:37.129 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T20:00:37.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.172+0000 7fcc4b25d700 1 Processor -- start 2023-12-24T20:00:37.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.172+0000 7fcc4b25d700 1 -- start start 2023-12-24T20:00:37.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.173+0000 7fcc4b25d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc441433e0 0x7fcc4415d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:37.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.173+0000 7fcc4b25d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcc441437b0 0x7fcc4415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:37.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.173+0000 7fcc4b25d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc440d0960 con 0x7fcc440cfe50 2023-12-24T20:00:37.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.173+0000 7fcc4b25d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4415b550 con 0x7fcc441437b0 2023-12-24T20:00:37.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.173+0000 7fcc4b25d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc440d0bb0 con 0x7fcc441433e0 2023-12-24T20:00:37.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.173+0000 7fcc43fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcc441437b0 0x7fcc4415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:37.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.173+0000 7fcc497fa700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fcc440cfe50 0x7fcc440d0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57232/0 (socket says 172.21.15.61:57232) 2023-12-24T20:00:37.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.173+0000 7fcc497fa700 1 -- 172.21.15.61:0/3451279963 learned_addr learned my addr 172.21.15.61:0/3451279963 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.173+0000 7fcc48ff9700 1 --2- 172.21.15.61:0/3451279963 >> v2:172.21.15.133:3300/0 conn(0x7fcc441433e0 0x7fcc4415d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc43fff700 1 -- 172.21.15.61:0/3451279963 >> v2:172.21.15.133:3300/0 conn(0x7fcc441433e0 msgr2=0x7fcc4415d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc43fff700 1 --2- 172.21.15.61:0/3451279963 >> v2:172.21.15.133:3300/0 conn(0x7fcc441433e0 0x7fcc4415d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc43fff700 1 -- 172.21.15.61:0/3451279963 >> v1:172.21.15.61:6789/0 conn(0x7fcc440cfe50 legacy=0x7fcc440d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc43fff700 1 -- 172.21.15.61:0/3451279963 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440d0e90 con 0x7fcc441437b0 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc437fe700 1 -- 172.21.15.61:0/3451279963 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142129035 0 0) 0x7fcc440d0960 con 0x7fcc440cfe50 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc43fff700 1 --2- 172.21.15.61:0/3451279963 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441437b0 0x7fcc4415dd90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcc440890c0 tx=0x7fcc300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f34bad100eb141 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc437fe700 1 -- 172.21.15.61:0/3451279963 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30011630 con 0x7fcc441437b0 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc437fe700 1 -- 172.21.15.61:0/3451279963 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc30011790 con 0x7fcc441437b0 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc437fe700 1 -- 172.21.15.61:0/3451279963 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30011b30 con 0x7fcc441437b0 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc4b25d700 1 -- 172.21.15.61:0/3451279963 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441437b0 msgr2=0x7fcc4415dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:37.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc4b25d700 1 --2- 172.21.15.61:0/3451279963 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441437b0 0x7fcc4415dd90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcc440890c0 tx=0x7fcc300091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:37.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc4b25d700 1 -- 172.21.15.61:0/3451279963 shutdown_connections 2023-12-24T20:00:37.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc4b25d700 1 --2- 172.21.15.61:0/3451279963 >> v2:172.21.15.133:3300/0 conn(0x7fcc441433e0 0x7fcc4415d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:37.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.174+0000 7fcc4b25d700 1 --2- 172.21.15.61:0/3451279963 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441437b0 0x7fcc4415dd90 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:37.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.175+0000 7fcc4b25d700 1 -- 172.21.15.61:0/3451279963 >> 172.21.15.61:0/3451279963 conn(0x7fcc4406e640 msgr2=0x7fcc44067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:37.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.175+0000 7fcc4b25d700 1 -- 172.21.15.61:0/3451279963 shutdown_connections 2023-12-24T20:00:37.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.175+0000 7fcc4b25d700 1 -- 172.21.15.61:0/3451279963 wait complete. 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.176+0000 7fcc4b25d700 1 Processor -- start 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.176+0000 7fcc4b25d700 1 -- start start 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc4b25d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc440cfe50 0x7fcc4416af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc4b25d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441433e0 0x7fcc44159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc4b25d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc441437b0 0x7fcc440b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc4b25d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4416b4c0 con 0x7fcc441433e0 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc4b25d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440c6220 con 0x7fcc441437b0 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc4b25d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4416e010 con 0x7fcc440cfe50 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc43fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441433e0 0x7fcc44159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc43fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441433e0 0x7fcc44159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44518/0 (socket says 172.21.15.61:44518) 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc43fff700 1 -- 172.21.15.61:0/2493360360 learned_addr learned my addr 172.21.15.61:0/2493360360 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc497fa700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc441437b0 0x7fcc440b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:37.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc48ff9700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc440cfe50 0x7fcc4416af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc43fff700 1 -- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc440cfe50 msgr2=0x7fcc4416af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc43fff700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc440cfe50 0x7fcc4416af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc43fff700 1 -- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc441437b0 msgr2=0x7fcc440b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc43fff700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc441437b0 0x7fcc440b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc43fff700 1 -- 172.21.15.61:0/2493360360 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc30009420 con 0x7fcc441433e0 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc48ff9700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc440cfe50 0x7fcc4416af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc43fff700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441433e0 0x7fcc44159f30 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcc44064b10 tx=0x7fcc30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc40ff9700 1 -- 172.21.15.61:0/2493360360 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30011b10 con 0x7fcc441433e0 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.177+0000 7fcc40ff9700 1 -- 172.21.15.61:0/2493360360 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc300233f0 con 0x7fcc441433e0 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.178+0000 7fcc4b25d700 1 -- 172.21.15.61:0/2493360360 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4416e2f0 con 0x7fcc441433e0 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.178+0000 7fcc40ff9700 1 -- 172.21.15.61:0/2493360360 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc300237b0 con 0x7fcc441433e0 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.178+0000 7fcc4b25d700 1 -- 172.21.15.61:0/2493360360 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4416e8b0 con 0x7fcc441433e0 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.178+0000 7fcc4b25d700 1 -- 172.21.15.61:0/2493360360 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc44089190 con 0x7fcc441433e0 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.179+0000 7fcc40ff9700 1 -- 172.21.15.61:0/2493360360 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcc300193b0 con 0x7fcc441433e0 2023-12-24T20:00:37.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.179+0000 7fcc40ff9700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc28066f30 0x7fcc280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:37.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.179+0000 7fcc40ff9700 1 -- 172.21.15.61:0/2493360360 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcc300856e0 con 0x7fcc441433e0 2023-12-24T20:00:37.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.179+0000 7fcc48ff9700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc28066f30 0x7fcc280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:37.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.180+0000 7fcc48ff9700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc28066f30 0x7fcc280693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc38006f00 tx=0x7fcc38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:37.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.183+0000 7fcc40ff9700 1 -- 172.21.15.61:0/2493360360 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc30052cd0 con 0x7fcc441433e0 2023-12-24T20:00:37.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.393+0000 7fcc4b25d700 1 -- 172.21.15.61:0/2493360360 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcc4404c3c0 con 0x7fcc441433e0 2023-12-24T20:00:37.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.984+0000 7fcc40ff9700 1 -- 172.21.15.61:0/2493360360 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcc30015080 con 0x7fcc441433e0 2023-12-24T20:00:37.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 -- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc28066f30 msgr2=0x7fcc280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc28066f30 0x7fcc280693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcc38006f00 tx=0x7fcc38008040 comp rx=0 tx=0).stop 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 -- 172.21.15.61:0/2493360360 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441433e0 msgr2=0x7fcc44159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441433e0 0x7fcc44159f30 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcc44064b10 tx=0x7fcc30017000 comp rx=0 tx=0).stop 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 -- 172.21.15.61:0/2493360360 shutdown_connections 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc440cfe50 0x7fcc4416af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc28066f30 0x7fcc280693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc441437b0 0x7fcc440b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 --2- 172.21.15.61:0/2493360360 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc441433e0 0x7fcc44159f30 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 -- 172.21.15.61:0/2493360360 >> 172.21.15.61:0/2493360360 conn(0x7fcc4406e640 msgr2=0x7fcc44142620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 -- 172.21.15.61:0/2493360360 shutdown_connections 2023-12-24T20:00:37.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:37.986+0000 7fcc4b25d700 1 -- 172.21.15.61:0/2493360360 wait complete. 2023-12-24T20:00:37.989 INFO:teuthology.orchestra.run.smithi061.stderr: removed all blocklist entries 2023-12-24T20:00:38.001 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T20:00:38.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.123+0000 7ff319220700 1 Processor -- start 2023-12-24T20:00:38.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.123+0000 7ff319220700 1 -- start start 2023-12-24T20:00:38.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.123+0000 7ff319220700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3140afee0 0x7ff314067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.123+0000 7ff319220700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff314070640 0x7ff314070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.123+0000 7ff319220700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3140a84d0 con 0x7ff314159b00 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.123+0000 7ff319220700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff314070fe0 con 0x7ff314070640 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.123+0000 7ff319220700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140a7620 con 0x7ff3140afee0 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff31359e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff314070640 0x7ff314070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff31359e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff314070640 0x7ff314070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44530/0 (socket says 172.21.15.61:44530) 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff31359e700 1 -- 172.21.15.61:0/1957870398 learned_addr learned my addr 172.21.15.61:0/1957870398 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff31259c700 1 --2- 172.21.15.61:0/1957870398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3140afee0 0x7ff314067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff31359e700 1 -- 172.21.15.61:0/1957870398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3140afee0 msgr2=0x7ff314067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff31359e700 1 --2- 172.21.15.61:0/1957870398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3140afee0 0x7ff314067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff31359e700 1 -- 172.21.15.61:0/1957870398 >> v1:172.21.15.133:6789/0 conn(0x7ff314159b00 legacy=0x7ff3140af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff31359e700 1 -- 172.21.15.61:0/1957870398 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140a78c0 con 0x7ff314070640 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff31359e700 1 --2- 172.21.15.61:0/1957870398 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314070640 0x7ff314070aa0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009f20 tx=0x7ff30c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653a4fae19a2c260 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff311d9b700 1 -- 172.21.15.61:0/1957870398 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c00e070 con 0x7ff314070640 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff311d9b700 1 -- 172.21.15.61:0/1957870398 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c00ba40 con 0x7ff314070640 2023-12-24T20:00:38.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.124+0000 7ff311d9b700 1 -- 172.21.15.61:0/1957870398 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c0092e0 con 0x7ff314070640 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.125+0000 7ff319220700 1 -- 172.21.15.61:0/1957870398 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314070640 msgr2=0x7ff314070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.125+0000 7ff319220700 1 --2- 172.21.15.61:0/1957870398 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314070640 0x7ff314070aa0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009f20 tx=0x7ff30c009840 comp rx=0 tx=0).stop 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.125+0000 7ff319220700 1 -- 172.21.15.61:0/1957870398 shutdown_connections 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.125+0000 7ff319220700 1 --2- 172.21.15.61:0/1957870398 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314070640 0x7ff314070aa0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.125+0000 7ff319220700 1 --2- 172.21.15.61:0/1957870398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3140afee0 0x7ff314067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.125+0000 7ff319220700 1 -- 172.21.15.61:0/1957870398 >> 172.21.15.61:0/1957870398 conn(0x7ff3140ca200 msgr2=0x7ff3140ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.125+0000 7ff319220700 1 -- 172.21.15.61:0/1957870398 shutdown_connections 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.125+0000 7ff319220700 1 -- 172.21.15.61:0/1957870398 wait complete. 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.126+0000 7ff319220700 1 Processor -- start 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.126+0000 7ff319220700 1 -- start start 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff319220700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff314070640 0x7ff3140aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff319220700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3140afee0 0x7ff314152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff319220700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314159b00 0x7ff3140ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff319220700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140ae760 con 0x7ff314159b00 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff319220700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140adb50 con 0x7ff314070640 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff319220700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140ade30 con 0x7ff3140afee0 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff31359e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314159b00 0x7ff3140ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff31359e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314159b00 0x7ff3140ad020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44538/0 (socket says 172.21.15.61:44538) 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff31359e700 1 -- 172.21.15.61:0/2054971813 learned_addr learned my addr 172.21.15.61:0/2054971813 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff31259c700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3140afee0 0x7ff314152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff312d9d700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff314070640 0x7ff3140aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff31359e700 1 -- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3140afee0 msgr2=0x7ff314152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff31359e700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3140afee0 0x7ff314152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff31359e700 1 -- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff314070640 msgr2=0x7ff3140aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff31359e700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff314070640 0x7ff3140aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.127+0000 7ff31359e700 1 -- 172.21.15.61:0/2054971813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c009ae0 con 0x7ff314159b00 2023-12-24T20:00:38.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.128+0000 7ff31359e700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314159b00 0x7ff3140ad020 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff31406c750 tx=0x7ff30c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.128+0000 7ff30affd700 1 -- 172.21.15.61:0/2054971813 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c0092e0 con 0x7ff314159b00 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.128+0000 7ff30affd700 1 -- 172.21.15.61:0/2054971813 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c012d00 con 0x7ff314159b00 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.128+0000 7ff319220700 1 -- 172.21.15.61:0/2054971813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3140ae110 con 0x7ff314159b00 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.128+0000 7ff30affd700 1 -- 172.21.15.61:0/2054971813 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c01d670 con 0x7ff314159b00 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.128+0000 7ff319220700 1 -- 172.21.15.61:0/2054971813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3140cd1e0 con 0x7ff314159b00 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.129+0000 7ff319220700 1 -- 172.21.15.61:0/2054971813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3140ae910 con 0x7ff314159b00 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.129+0000 7ff30affd700 1 -- 172.21.15.61:0/2054971813 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff30c01d9e0 con 0x7ff314159b00 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.130+0000 7ff30affd700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f4066f30 0x7ff2f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.130+0000 7ff30affd700 1 -- 172.21.15.61:0/2054971813 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff30c0859e0 con 0x7ff314159b00 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.130+0000 7ff312d9d700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f4066f30 0x7ff2f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.130+0000 7ff312d9d700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f4066f30 0x7ff2f40693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff304009af0 tx=0x7ff304009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:38.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.135+0000 7ff30affd700 1 -- 172.21.15.61:0/2054971813 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3140ae910 con 0x7ff314159b00 2023-12-24T20:00:38.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.408+0000 7ff319220700 1 -- 172.21.15.61:0/2054971813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff3140cae60 con 0x7ff314159b00 2023-12-24T20:00:38.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.409+0000 7ff30affd700 1 -- 172.21.15.61:0/2054971813 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff30c052f00 con 0x7ff314159b00 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout: "auth_dump": [ 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.a", 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew==", 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:00:38.411 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.b", 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw==", 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.c", 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g==", 2023-12-24T20:00:38.412 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.d", 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg==", 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:00:38.413 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.0", 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag==", 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.1", 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw==", 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.414 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.2", 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ==", 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.415 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.3", 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA==", 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.4", 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ==", 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.416 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.5", 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w==", 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.6", 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw==", 2023-12-24T20:00:38.417 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.7", 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw==", 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.418 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.419 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.0", 2023-12-24T20:00:38.419 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA==", 2023-12-24T20:00:38.419 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.419 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:00:38.419 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow r", 2023-12-24T20:00:38.419 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T20:00:38.419 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.419 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.419 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.419 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.1", 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w==", 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.2", 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg==", 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:00:38.420 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.3", 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g==", 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.421 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.admin", 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlwF3pGRAA8h0Cld7lwZprlrgMAN7tSg==", 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.x", 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg==", 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:00:38.422 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.y", 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A==", 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:00:38.423 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:00:38.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 -- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f4066f30 msgr2=0x7ff2f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f4066f30 0x7ff2f40693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff304009af0 tx=0x7ff304009060 comp rx=0 tx=0).stop 2023-12-24T20:00:38.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 -- 172.21.15.61:0/2054971813 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314159b00 msgr2=0x7ff3140ad020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314159b00 0x7ff3140ad020 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff31406c750 tx=0x7ff30c017000 comp rx=0 tx=0).stop 2023-12-24T20:00:38.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 -- 172.21.15.61:0/2054971813 shutdown_connections 2023-12-24T20:00:38.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f4066f30 0x7ff2f40693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff314159b00 0x7ff3140ad020 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff314070640 0x7ff3140aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 --2- 172.21.15.61:0/2054971813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3140afee0 0x7ff314152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 -- 172.21.15.61:0/2054971813 >> 172.21.15.61:0/2054971813 conn(0x7ff3140ca200 msgr2=0x7ff314156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:38.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 -- 172.21.15.61:0/2054971813 shutdown_connections 2023-12-24T20:00:38.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.411+0000 7ff319220700 1 -- 172.21.15.61:0/2054971813 wait complete. 2023-12-24T20:00:38.426 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:00:38.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.547+0000 7fd5efd01700 1 Processor -- start 2023-12-24T20:00:38.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.547+0000 7fd5efd01700 1 -- start start 2023-12-24T20:00:38.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.547+0000 7fd5efd01700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5e80b2660 0x7fd5e815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.547+0000 7fd5efd01700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e80b2eb0 con 0x7fd5e815c470 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.547+0000 7fd5efd01700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e80b2bd0 con 0x7fd5e815bb60 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.547+0000 7fd5efd01700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e80afc20 con 0x7fd5e80b2660 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5ee29e700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd5e815c470 0x7fd5e80b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57248/0 (socket says 172.21.15.61:57248) 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5ee29e700 1 -- 172.21.15.61:0/1652006639 learned_addr learned my addr 172.21.15.61:0/1652006639 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5ed29c700 1 --2- 172.21.15.61:0/1652006639 >> v2:172.21.15.133:3300/0 conn(0x7fd5e80b2660 0x7fd5e815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5eca9b700 1 -- 172.21.15.61:0/1652006639 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769631434 0 0) 0x7fd5e80b2eb0 con 0x7fd5e815c470 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5eca9b700 1 -- 172.21.15.61:0/1652006639 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d4003570 con 0x7fd5e815c470 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5ed29c700 1 -- 172.21.15.61:0/1652006639 >> v1:172.21.15.133:6789/0 conn(0x7fd5e815bb60 legacy=0x7fd5e8098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5ed29c700 1 -- 172.21.15.61:0/1652006639 >> v1:172.21.15.61:6789/0 conn(0x7fd5e815c470 legacy=0x7fd5e80b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5ed29c700 1 -- 172.21.15.61:0/1652006639 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e80afe10 con 0x7fd5e80b2660 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5ed29c700 1 --2- 172.21.15.61:0/1652006639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e80b2660 0x7fd5e815bf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80098e0 tx=0x7fd5d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ca009d34b8954f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5eca9b700 1 -- 172.21.15.61:0/1652006639 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800b640 con 0x7fd5e80b2660 2023-12-24T20:00:38.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5eca9b700 1 -- 172.21.15.61:0/1652006639 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d800b7a0 con 0x7fd5e80b2660 2023-12-24T20:00:38.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.548+0000 7fd5eca9b700 1 -- 172.21.15.61:0/1652006639 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800bb40 con 0x7fd5e80b2660 2023-12-24T20:00:38.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.549+0000 7fd5efd01700 1 -- 172.21.15.61:0/1652006639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e80b2660 msgr2=0x7fd5e815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.549+0000 7fd5efd01700 1 --2- 172.21.15.61:0/1652006639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e80b2660 0x7fd5e815bf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80098e0 tx=0x7fd5d80091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.549+0000 7fd5efd01700 1 -- 172.21.15.61:0/1652006639 shutdown_connections 2023-12-24T20:00:38.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.549+0000 7fd5efd01700 1 --2- 172.21.15.61:0/1652006639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e80b2660 0x7fd5e815bf30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.549+0000 7fd5efd01700 1 -- 172.21.15.61:0/1652006639 >> 172.21.15.61:0/1652006639 conn(0x7fd5e8097a10 msgr2=0x7fd5e80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:38.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.549+0000 7fd5efd01700 1 -- 172.21.15.61:0/1652006639 shutdown_connections 2023-12-24T20:00:38.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.549+0000 7fd5efd01700 1 -- 172.21.15.61:0/1652006639 wait complete. 2023-12-24T20:00:38.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.550+0000 7fd5efd01700 1 Processor -- start 2023-12-24T20:00:38.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.550+0000 7fd5efd01700 1 -- start start 2023-12-24T20:00:38.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5efd01700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5e80b2660 0x7fd5e80a9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5efd01700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e815bb60 0x7fd5e816bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5efd01700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5e815c470 0x7fd5e8156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5efd01700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80a9580 con 0x7fd5e80b2660 2023-12-24T20:00:38.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5efd01700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80abdb0 con 0x7fd5e815bb60 2023-12-24T20:00:38.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5efd01700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80aae90 con 0x7fd5e815c470 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5eda9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5e80b2660 0x7fd5e80a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5eda9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5e80b2660 0x7fd5e80a9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44548/0 (socket says 172.21.15.61:44548) 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5eda9d700 1 -- 172.21.15.61:0/325245928 learned_addr learned my addr 172.21.15.61:0/325245928 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5ed29c700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e815bb60 0x7fd5e816bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5ee29e700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5e815c470 0x7fd5e8156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5eda9d700 1 -- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5e815c470 msgr2=0x7fd5e8156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5eda9d700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5e815c470 0x7fd5e8156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5eda9d700 1 -- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e815bb60 msgr2=0x7fd5e816bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5eda9d700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e815bb60 0x7fd5e816bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5eda9d700 1 -- 172.21.15.61:0/325245928 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d8009420 con 0x7fd5e80b2660 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.551+0000 7fd5ee29e700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5e815c470 0x7fd5e8156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.552+0000 7fd5eda9d700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5e80b2660 0x7fd5e80a9040 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400c7f0 tx=0x7fd5e4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.552+0000 7fd5ddffb700 1 -- 172.21.15.61:0/325245928 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011590 con 0x7fd5e80b2660 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.552+0000 7fd5ddffb700 1 -- 172.21.15.61:0/325245928 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e4011710 con 0x7fd5e80b2660 2023-12-24T20:00:38.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.552+0000 7fd5ddffb700 1 -- 172.21.15.61:0/325245928 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011ad0 con 0x7fd5e80b2660 2023-12-24T20:00:38.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.552+0000 7fd5efd01700 1 -- 172.21.15.61:0/325245928 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e80ab170 con 0x7fd5e80b2660 2023-12-24T20:00:38.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.552+0000 7fd5efd01700 1 -- 172.21.15.61:0/325245928 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e80aba40 con 0x7fd5e80b2660 2023-12-24T20:00:38.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.553+0000 7fd5efd01700 1 -- 172.21.15.61:0/325245928 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e806d440 con 0x7fd5e80b2660 2023-12-24T20:00:38.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.553+0000 7fd5ddffb700 1 -- 172.21.15.61:0/325245928 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd5e401b3b0 con 0x7fd5e80b2660 2023-12-24T20:00:38.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.554+0000 7fd5ddffb700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5cc066f30 0x7fd5cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.554+0000 7fd5ddffb700 1 -- 172.21.15.61:0/325245928 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd5e40836b0 con 0x7fd5e80b2660 2023-12-24T20:00:38.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.554+0000 7fd5ed29c700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5cc066f30 0x7fd5cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.554+0000 7fd5ed29c700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5cc066f30 0x7fd5cc0693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80093f0 tx=0x7fd5d8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:38.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.559+0000 7fd5ddffb700 1 -- 172.21.15.61:0/325245928 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5e4050d20 con 0x7fd5e80b2660 2023-12-24T20:00:38.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.754+0000 7fd5efd01700 1 -- 172.21.15.61:0/325245928 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5e804c3c0 con 0x7fd5e80b2660 2023-12-24T20:00:38.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.755+0000 7fd5ddffb700 1 -- 172.21.15.61:0/325245928 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+12134 (secure 0 0 0) 0x7fd5e4017020 con 0x7fd5e80b2660 2023-12-24T20:00:38.756 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:38.756 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":76,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:00:37.993019+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:00:38.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 -- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5cc066f30 msgr2=0x7fd5cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5cc066f30 0x7fd5cc0693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80093f0 tx=0x7fd5d8017000 comp rx=0 tx=0).stop 2023-12-24T20:00:38.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 -- 172.21.15.61:0/325245928 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5e80b2660 msgr2=0x7fd5e80a9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5e80b2660 0x7fd5e80a9040 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400c7f0 tx=0x7fd5e4007f70 comp rx=0 tx=0).stop 2023-12-24T20:00:38.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 -- 172.21.15.61:0/325245928 shutdown_connections 2023-12-24T20:00:38.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5e815c470 0x7fd5e8156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5cc066f30 0x7fd5cc0693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5e80b2660 0x7fd5e80a9040 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 --2- 172.21.15.61:0/325245928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e815bb60 0x7fd5e816bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 -- 172.21.15.61:0/325245928 >> 172.21.15.61:0/325245928 conn(0x7fd5e8097a10 msgr2=0x7fd5e8159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:38.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 -- 172.21.15.61:0/325245928 shutdown_connections 2023-12-24T20:00:38.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.757+0000 7fd5efd01700 1 -- 172.21.15.61:0/325245928 wait complete. 2023-12-24T20:00:38.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T20:00:38.770 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:00:38.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.894+0000 7f8f36b8e700 1 Processor -- start 2023-12-24T20:00:38.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.894+0000 7f8f36b8e700 1 -- start start 2023-12-24T20:00:38.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f36b8e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8f300cb5a0 0x7f8f30164c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f36b8e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f300c8c30 con 0x7f8f3015ac00 2023-12-24T20:00:38.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f36b8e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f300c7e00 con 0x7f8f3015afd0 2023-12-24T20:00:38.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f36b8e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f300c80b0 con 0x7f8f300cb5a0 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f3512b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8f300cb5a0 0x7f8f30164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f3492a700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8f3015ac00 0x7f8f300c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57262/0 (socket says 172.21.15.61:57262) 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f3492a700 1 -- 172.21.15.61:0/2170115688 learned_addr learned my addr 172.21.15.61:0/2170115688 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f2f7fe700 1 -- 172.21.15.61:0/2170115688 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667973551 0 0) 0x7f8f300c8c30 con 0x7f8f3015ac00 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f2f7fe700 1 -- 172.21.15.61:0/2170115688 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f20003570 con 0x7f8f3015ac00 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f3512b700 1 -- 172.21.15.61:0/2170115688 >> v1:172.21.15.133:6789/0 conn(0x7f8f3015afd0 legacy=0x7f8f300cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f3512b700 1 -- 172.21.15.61:0/2170115688 >> v1:172.21.15.61:6789/0 conn(0x7f8f3015ac00 legacy=0x7f8f300c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f3512b700 1 -- 172.21.15.61:0/2170115688 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f300c8390 con 0x7f8f300cb5a0 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f3512b700 1 --2- 172.21.15.61:0/2170115688 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f300cb5a0 0x7f8f30164c90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009e60 tx=0x7f8f28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97eb585bd84105f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f2f7fe700 1 -- 172.21.15.61:0/2170115688 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800e070 con 0x7f8f300cb5a0 2023-12-24T20:00:38.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f2f7fe700 1 -- 172.21.15.61:0/2170115688 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2800bb60 con 0x7f8f300cb5a0 2023-12-24T20:00:38.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.895+0000 7f8f2f7fe700 1 -- 172.21.15.61:0/2170115688 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28012430 con 0x7f8f300cb5a0 2023-12-24T20:00:38.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.896+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2170115688 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f300cb5a0 msgr2=0x7f8f30164c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.896+0000 7f8f36b8e700 1 --2- 172.21.15.61:0/2170115688 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f300cb5a0 0x7f8f30164c90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009e60 tx=0x7f8f28009780 comp rx=0 tx=0).stop 2023-12-24T20:00:38.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.896+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2170115688 shutdown_connections 2023-12-24T20:00:38.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.896+0000 7f8f36b8e700 1 --2- 172.21.15.61:0/2170115688 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f300cb5a0 0x7f8f30164c90 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.896+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2170115688 >> 172.21.15.61:0/2170115688 conn(0x7f8f300cd0b0 msgr2=0x7f8f300cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:38.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.896+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2170115688 shutdown_connections 2023-12-24T20:00:38.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.896+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2170115688 wait complete. 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.897+0000 7f8f36b8e700 1 Processor -- start 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.897+0000 7f8f36b8e700 1 -- start start 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f36b8e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f300cb5a0 0x7f8f30153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f36b8e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f3015ac00 0x7f8f3015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f36b8e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f3015afd0 0x7f8f300aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f36b8e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f30153660 con 0x7f8f3015ac00 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f36b8e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300b0d00 con 0x7f8f300cb5a0 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f36b8e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300c4ce0 con 0x7f8f3015afd0 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f2ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f3015ac00 0x7f8f3015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f2ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f3015ac00 0x7f8f3015ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44568/0 (socket says 172.21.15.61:44568) 2023-12-24T20:00:38.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f2ffff700 1 -- 172.21.15.61:0/2786695839 learned_addr learned my addr 172.21.15.61:0/2786695839 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f3492a700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f300cb5a0 0x7f8f30153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f2ffff700 1 -- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f3015afd0 msgr2=0x7f8f300aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f3512b700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f3015afd0 0x7f8f300aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f2ffff700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f3015afd0 0x7f8f300aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f2ffff700 1 -- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f300cb5a0 msgr2=0x7f8f30153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f2ffff700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f300cb5a0 0x7f8f30153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f2ffff700 1 -- 172.21.15.61:0/2786695839 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f28009a20 con 0x7f8f3015ac00 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.898+0000 7f8f3492a700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f300cb5a0 0x7f8f30153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.899+0000 7f8f2ffff700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f3015ac00 0x7f8f3015ecb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00c5c0 tx=0x7f8f1c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.899+0000 7f8f2cff9700 1 -- 172.21.15.61:0/2786695839 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c011590 con 0x7f8f3015ac00 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.899+0000 7f8f2cff9700 1 -- 172.21.15.61:0/2786695839 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c011710 con 0x7f8f3015ac00 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.899+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2786695839 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f300c4fc0 con 0x7f8f3015ac00 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.899+0000 7f8f2cff9700 1 -- 172.21.15.61:0/2786695839 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c011ad0 con 0x7f8f3015ac00 2023-12-24T20:00:38.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.899+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2786695839 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f300c52a0 con 0x7f8f3015ac00 2023-12-24T20:00:38.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.900+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2786695839 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3004c3c0 con 0x7f8f3015ac00 2023-12-24T20:00:38.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.900+0000 7f8f2cff9700 1 -- 172.21.15.61:0/2786695839 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8f1c01b3b0 con 0x7f8f3015ac00 2023-12-24T20:00:38.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.901+0000 7f8f2cff9700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f14066f30 0x7f8f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:38.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.901+0000 7f8f2cff9700 1 -- 172.21.15.61:0/2786695839 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8f1c083770 con 0x7f8f3015ac00 2023-12-24T20:00:38.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.901+0000 7f8f3492a700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f14066f30 0x7f8f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:38.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.901+0000 7f8f3492a700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f14066f30 0x7f8f140693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8f24001360 tx=0x7f8f24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:38.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:38.905+0000 7f8f2cff9700 1 -- 172.21.15.61:0/2786695839 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f1c050d30 con 0x7f8f3015ac00 2023-12-24T20:00:39.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.100+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2786695839 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f300c8670 con 0x7f8f3015ac00 2023-12-24T20:00:39.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.100+0000 7f8f2cff9700 1 -- 172.21.15.61:0/2786695839 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f1c017020 con 0x7f8f3015ac00 2023-12-24T20:00:39.101 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:00:39.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f14066f30 msgr2=0x7f8f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f14066f30 0x7f8f140693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8f24001360 tx=0x7f8f24009040 comp rx=0 tx=0).stop 2023-12-24T20:00:39.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2786695839 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f3015ac00 msgr2=0x7f8f3015ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f3015ac00 0x7f8f3015ecb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00c5c0 tx=0x7f8f1c00c980 comp rx=0 tx=0).stop 2023-12-24T20:00:39.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2786695839 shutdown_connections 2023-12-24T20:00:39.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f3015afd0 0x7f8f300aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f14066f30 0x7f8f140693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f300cb5a0 0x7f8f30153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 --2- 172.21.15.61:0/2786695839 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f3015ac00 0x7f8f3015ecb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2786695839 >> 172.21.15.61:0/2786695839 conn(0x7f8f300cd0b0 msgr2=0x7f8f300c3730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:39.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2786695839 shutdown_connections 2023-12-24T20:00:39.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.102+0000 7f8f36b8e700 1 -- 172.21.15.61:0/2786695839 wait complete. 2023-12-24T20:00:39.115 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T20:00:39.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.236+0000 7f2e6482e700 1 Processor -- start 2023-12-24T20:00:39.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.236+0000 7f2e6482e700 1 -- start start 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e6482e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e600b3d30 0x7f2e600cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e6482e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600b2890 con 0x7f2e60068140 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e6482e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e600cf630 con 0x7f2e60068510 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e6482e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600b2240 con 0x7f2e600b3d30 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5e59c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2e60068140 0x7f2e600b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57268/0 (socket says 172.21.15.61:57268) 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5e59c700 1 -- 172.21.15.61:0/774499780 learned_addr learned my addr 172.21.15.61:0/774499780 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619716442 0 0) 0x7f2e600b2890 con 0x7f2e60068140 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5ed9d700 1 --2- 172.21.15.61:0/774499780 >> v2:172.21.15.133:3300/0 conn(0x7f2e600b3d30 0x7f2e600cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e48003570 con 0x7f2e60068140 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 45605077 0 0) 0x7f2e48003570 con 0x7f2e60068140 2023-12-24T20:00:39.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 >> v2:172.21.15.133:3300/0 conn(0x7f2e600b3d30 msgr2=0x7f2e600cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5d59a700 1 --2- 172.21.15.61:0/774499780 >> v2:172.21.15.133:3300/0 conn(0x7f2e600b3d30 0x7f2e600cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 >> v1:172.21.15.133:6789/0 conn(0x7f2e60068510 legacy=0x7f2e60159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600b2520 con 0x7f2e60068140 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.237+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f2e500015f0 con 0x7f2e60068140 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 >> v1:172.21.15.61:6789/0 conn(0x7f2e60068140 legacy=0x7f2e600b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5d59a700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e48003a60 0x7f2e48003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5d59a700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e48004810 0x7f2e48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5d59a700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600b2240 con 0x7f2e480051c0 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4800c160 con 0x7f2e48004810 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4800c320 con 0x7f2e48003a60 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5ed9d700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5e59c700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e48003a60 0x7f2e48003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5dd9b700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e48004810 0x7f2e48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5ed9d700 1 -- 172.21.15.61:0/774499780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e48003a60 msgr2=0x7f2e48003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5ed9d700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e48003a60 0x7f2e48003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5ed9d700 1 -- 172.21.15.61:0/774499780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e48004810 msgr2=0x7f2e48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5ed9d700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e48004810 0x7f2e48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5ed9d700 1 -- 172.21.15.61:0/774499780 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e48003570 con 0x7f2e480051c0 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5ed9d700 1 -- 172.21.15.61:0/774499780 reap_dead start 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5ed9d700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e4800ba60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800e210 tx=0x7f2e5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc66de42397b673b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800eac0 con 0x7f2e480051c0 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5800f040 con 0x7f2e480051c0 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.238+0000 7f2e5d59a700 1 -- 172.21.15.61:0/774499780 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800ee70 con 0x7f2e480051c0 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.239+0000 7f2e6482e700 1 -- 172.21.15.61:0/774499780 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 msgr2=0x7f2e4800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.239+0000 7f2e6482e700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e4800ba60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800e210 tx=0x7f2e5800b040 comp rx=0 tx=0).stop 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.239+0000 7f2e6482e700 1 -- 172.21.15.61:0/774499780 shutdown_connections 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.239+0000 7f2e6482e700 1 --2- 172.21.15.61:0/774499780 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e4800ba60 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.239+0000 7f2e6482e700 1 -- 172.21.15.61:0/774499780 >> 172.21.15.61:0/774499780 conn(0x7f2e60097a10 msgr2=0x7f2e600ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:39.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.239+0000 7f2e6482e700 1 -- 172.21.15.61:0/774499780 shutdown_connections 2023-12-24T20:00:39.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.239+0000 7f2e6482e700 1 -- 172.21.15.61:0/774499780 wait complete. 2023-12-24T20:00:39.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.240+0000 7f2e6482e700 1 Processor -- start 2023-12-24T20:00:39.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.240+0000 7f2e6482e700 1 -- start start 2023-12-24T20:00:39.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e6482e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e60148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e6482e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e60157e70 0x7f2e6014bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e6482e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e6014a6f0 0x7f2e6014ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e6482e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6014c050 con 0x7f2e480051c0 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e6482e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e60145820 con 0x7f2e60157e70 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e6482e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e601582e0 con 0x7f2e6014a6f0 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e5e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e60148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e5e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e60148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44578/0 (socket says 172.21.15.61:44578) 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e5e59c700 1 -- 172.21.15.61:0/3307267381 learned_addr learned my addr 172.21.15.61:0/3307267381 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e5dd9b700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e60157e70 0x7f2e6014bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e5ed9d700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e6014a6f0 0x7f2e6014ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e5e59c700 1 -- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e6014a6f0 msgr2=0x7f2e6014ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e5e59c700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e6014a6f0 0x7f2e6014ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e5e59c700 1 -- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e60157e70 msgr2=0x7f2e6014bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e5e59c700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e60157e70 0x7f2e6014bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.241+0000 7f2e5e59c700 1 -- 172.21.15.61:0/3307267381 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e60149650 con 0x7f2e480051c0 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.242+0000 7f2e5e59c700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e60148fc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2e50007a30 tx=0x7f2e50009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:39.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.242+0000 7f2e4e7fc700 1 -- 172.21.15.61:0/3307267381 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500072e0 con 0x7f2e480051c0 2023-12-24T20:00:39.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.242+0000 7f2e4e7fc700 1 -- 172.21.15.61:0/3307267381 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e50007440 con 0x7f2e480051c0 2023-12-24T20:00:39.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.242+0000 7f2e6482e700 1 -- 172.21.15.61:0/3307267381 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e60149930 con 0x7f2e480051c0 2023-12-24T20:00:39.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.242+0000 7f2e4e7fc700 1 -- 172.21.15.61:0/3307267381 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500057f0 con 0x7f2e480051c0 2023-12-24T20:00:39.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.242+0000 7f2e6482e700 1 -- 172.21.15.61:0/3307267381 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e60149ef0 con 0x7f2e480051c0 2023-12-24T20:00:39.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.243+0000 7f2e6482e700 1 -- 172.21.15.61:0/3307267381 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6006d440 con 0x7f2e480051c0 2023-12-24T20:00:39.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.243+0000 7f2e4e7fc700 1 -- 172.21.15.61:0/3307267381 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2e50005b80 con 0x7f2e480051c0 2023-12-24T20:00:39.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.243+0000 7f2e4e7fc700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2e40066f30 0x7f2e400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.244+0000 7f2e4e7fc700 1 -- 172.21.15.61:0/3307267381 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2e500842b0 con 0x7f2e480051c0 2023-12-24T20:00:39.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.244+0000 7f2e5dd9b700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2e40066f30 0x7f2e400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.244+0000 7f2e5dd9b700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2e40066f30 0x7f2e400693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e600a8fd0 tx=0x7f2e54007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:39.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.248+0000 7f2e4e7fc700 1 -- 172.21.15.61:0/3307267381 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e50051930 con 0x7f2e480051c0 2023-12-24T20:00:39.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.442+0000 7f2e6482e700 1 -- 172.21.15.61:0/3307267381 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2e6004c3c0 con 0x7f2e480051c0 2023-12-24T20:00:39.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.442+0000 7f2e4e7fc700 1 -- 172.21.15.61:0/3307267381 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2e50054f50 con 0x7f2e480051c0 2023-12-24T20:00:39.443 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:39.443 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T20:00:39.443 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:00:39.443 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T20:00:39.443 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T20:00:39.443 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:39.443 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T20:00:39.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 -- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2e40066f30 msgr2=0x7f2e400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2e40066f30 0x7f2e400693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e600a8fd0 tx=0x7f2e54007d30 comp rx=0 tx=0).stop 2023-12-24T20:00:39.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 -- 172.21.15.61:0/3307267381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 msgr2=0x7f2e60148fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e60148fc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2e50007a30 tx=0x7f2e50009040 comp rx=0 tx=0).stop 2023-12-24T20:00:39.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 -- 172.21.15.61:0/3307267381 shutdown_connections 2023-12-24T20:00:39.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e6014a6f0 0x7f2e6014ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2e40066f30 0x7f2e400693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e480051c0 0x7f2e60148fc0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 --2- 172.21.15.61:0/3307267381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e60157e70 0x7f2e6014bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 -- 172.21.15.61:0/3307267381 >> 172.21.15.61:0/3307267381 conn(0x7f2e60097a10 msgr2=0x7f2e600b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:39.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 -- 172.21.15.61:0/3307267381 shutdown_connections 2023-12-24T20:00:39.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.444+0000 7f2e6482e700 1 -- 172.21.15.61:0/3307267381 wait complete. 2023-12-24T20:00:39.457 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T20:00:39.457 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T20:00:39.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.582+0000 7f9f080f8700 1 Processor -- start 2023-12-24T20:00:39.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.582+0000 7f9f080f8700 1 -- start start 2023-12-24T20:00:39.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f080f8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f0006f850 0x7f9f0015b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f080f8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9f000c9500 0x7f9f000c9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f080f8700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0006fcc0 con 0x7f9f000ce750 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f080f8700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f000c8d90 con 0x7f9f000c9500 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f080f8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0015bd00 con 0x7f9f0006f850 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f06695700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9f000c9500 0x7f9f000c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f05e94700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9f000ce750 0x7f9f000ceb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57278/0 (socket says 172.21.15.61:57278) 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f05e94700 1 -- 172.21.15.61:0/603201622 learned_addr learned my addr 172.21.15.61:0/603201622 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f05693700 1 --2- 172.21.15.61:0/603201622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f0006f850 0x7f9f0015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f06695700 1 -- 172.21.15.61:0/603201622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f0006f850 msgr2=0x7f9f0015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f06695700 1 --2- 172.21.15.61:0/603201622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f0006f850 0x7f9f0015b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f06695700 1 -- 172.21.15.61:0/603201622 >> v1:172.21.15.61:6789/0 conn(0x7f9f000ce750 legacy=0x7f9f000ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.583+0000 7f9f06695700 1 -- 172.21.15.61:0/603201622 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0015bad0 con 0x7f9f000c9500 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f06695700 1 --2- 172.21.15.61:0/603201622 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f000c9500 0x7f9f000c9980 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009e60 tx=0x7f9ef8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152e471bcdc43979 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:39.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f04e92700 1 -- 172.21.15.61:0/603201622 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800e070 con 0x7f9f000c9500 2023-12-24T20:00:39.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f04e92700 1 -- 172.21.15.61:0/603201622 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef800bc30 con 0x7f9f000c9500 2023-12-24T20:00:39.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f04e92700 1 -- 172.21.15.61:0/603201622 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8012430 con 0x7f9f000c9500 2023-12-24T20:00:39.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f080f8700 1 -- 172.21.15.61:0/603201622 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f000c9500 msgr2=0x7f9f000c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f080f8700 1 --2- 172.21.15.61:0/603201622 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f000c9500 0x7f9f000c9980 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009e60 tx=0x7f9ef8009780 comp rx=0 tx=0).stop 2023-12-24T20:00:39.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f080f8700 1 -- 172.21.15.61:0/603201622 shutdown_connections 2023-12-24T20:00:39.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f080f8700 1 --2- 172.21.15.61:0/603201622 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f000c9500 0x7f9f000c9980 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f080f8700 1 --2- 172.21.15.61:0/603201622 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f0006f850 0x7f9f0015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f080f8700 1 -- 172.21.15.61:0/603201622 >> 172.21.15.61:0/603201622 conn(0x7f9f00069760 msgr2=0x7f9f00069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:39.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f080f8700 1 -- 172.21.15.61:0/603201622 shutdown_connections 2023-12-24T20:00:39.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.584+0000 7f9f080f8700 1 -- 172.21.15.61:0/603201622 wait complete. 2023-12-24T20:00:39.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.585+0000 7f9f080f8700 1 Processor -- start 2023-12-24T20:00:39.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.586+0000 7f9f080f8700 1 -- start start 2023-12-24T20:00:39.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.586+0000 7f9f080f8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f0006f850 0x7f9f000ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.586+0000 7f9f080f8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f000c9500 0x7f9f00068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.586+0000 7f9f080f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f000ce750 0x7f9f000c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.586+0000 7f9f080f8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00068950 con 0x7f9f0006f850 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.586+0000 7f9f080f8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00069320 con 0x7f9f000ce750 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.586+0000 7f9f080f8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00067d40 con 0x7f9f000c9500 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.586+0000 7f9f05e94700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f0006f850 0x7f9f000ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.586+0000 7f9f05e94700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f0006f850 0x7f9f000ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44600/0 (socket says 172.21.15.61:44600) 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.586+0000 7f9f05e94700 1 -- 172.21.15.61:0/3629129438 learned_addr learned my addr 172.21.15.61:0/3629129438 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f05693700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f000c9500 0x7f9f00068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f06695700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f000ce750 0x7f9f000c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f05e94700 1 -- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f000c9500 msgr2=0x7f9f00068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f05e94700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f000c9500 0x7f9f00068de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f05e94700 1 -- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f000ce750 msgr2=0x7f9f000c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f05e94700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f000ce750 0x7f9f000c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:39.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f05e94700 1 -- 172.21.15.61:0/3629129438 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8009a20 con 0x7f9f0006f850 2023-12-24T20:00:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f05693700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f000c9500 0x7f9f00068de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f06695700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f000ce750 0x7f9f000c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f05e94700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f0006f850 0x7f9f000ae110 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c560 tx=0x7f9efc001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9ef5ffb700 1 -- 172.21.15.61:0/3629129438 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc005b30 con 0x7f9f0006f850 2023-12-24T20:00:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9ef5ffb700 1 -- 172.21.15.61:0/3629129438 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc005cb0 con 0x7f9f0006f850 2023-12-24T20:00:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f080f8700 1 -- 172.21.15.61:0/3629129438 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f00068020 con 0x7f9f0006f850 2023-12-24T20:00:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9ef5ffb700 1 -- 172.21.15.61:0/3629129438 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc007320 con 0x7f9f0006f850 2023-12-24T20:00:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.587+0000 7f9f080f8700 1 -- 172.21.15.61:0/3629129438 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f000685e0 con 0x7f9f0006f850 2023-12-24T20:00:39.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.588+0000 7f9f080f8700 1 -- 172.21.15.61:0/3629129438 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f000cdeb0 con 0x7f9f0006f850 2023-12-24T20:00:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.589+0000 7f9ef5ffb700 1 -- 172.21.15.61:0/3629129438 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9efc01b3b0 con 0x7f9f0006f850 2023-12-24T20:00:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.589+0000 7f9ef5ffb700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ee4066f30 0x7f9ee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.589+0000 7f9ef5ffb700 1 -- 172.21.15.61:0/3629129438 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9efc083700 con 0x7f9f0006f850 2023-12-24T20:00:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.589+0000 7f9f05693700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ee4066f30 0x7f9ee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:39.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.590+0000 7f9f05693700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ee4066f30 0x7f9ee40693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f000b4120 tx=0x7f9ef0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:39.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.594+0000 7f9ef5ffb700 1 -- 172.21.15.61:0/3629129438 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9efc050cc0 con 0x7f9f0006f850 2023-12-24T20:00:39.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:39.787+0000 7f9f080f8700 1 -- 172.21.15.61:0/3629129438 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9f0004c3c0 con 0x7f9f0006f850 2023-12-24T20:00:40.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.001+0000 7f9ef5ffb700 1 -- 172.21.15.61:0/3629129438 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9efc0170b0 con 0x7f9f0006f850 2023-12-24T20:00:40.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.004+0000 7f9f080f8700 1 -- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ee4066f30 msgr2=0x7f9ee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:40.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.004+0000 7f9f080f8700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ee4066f30 0x7f9ee40693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f000b4120 tx=0x7f9ef0008040 comp rx=0 tx=0).stop 2023-12-24T20:00:40.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.004+0000 7f9f080f8700 1 -- 172.21.15.61:0/3629129438 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f0006f850 msgr2=0x7f9f000ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:40.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.004+0000 7f9f080f8700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f0006f850 0x7f9f000ae110 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c560 tx=0x7f9efc001020 comp rx=0 tx=0).stop 2023-12-24T20:00:40.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.004+0000 7f9f080f8700 1 -- 172.21.15.61:0/3629129438 shutdown_connections 2023-12-24T20:00:40.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.004+0000 7f9f080f8700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9ee4066f30 0x7f9ee40693e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:40.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.004+0000 7f9f080f8700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f000ce750 0x7f9f000c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:40.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.004+0000 7f9f080f8700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f0006f850 0x7f9f000ae110 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:40.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.004+0000 7f9f080f8700 1 --2- 172.21.15.61:0/3629129438 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f000c9500 0x7f9f00068de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:40.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.004+0000 7f9f080f8700 1 -- 172.21.15.61:0/3629129438 >> 172.21.15.61:0/3629129438 conn(0x7f9f00069760 msgr2=0x7f9f0015b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:40.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.005+0000 7f9f080f8700 1 -- 172.21.15.61:0/3629129438 shutdown_connections 2023-12-24T20:00:40.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.005+0000 7f9f080f8700 1 -- 172.21.15.61:0/3629129438 wait complete. 2023-12-24T20:00:40.006 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T20:00:40.018 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T20:00:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.148+0000 7f0710439700 1 Processor -- start 2023-12-24T20:00:40.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.148+0000 7f0710439700 1 -- start start 2023-12-24T20:00:40.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f0710439700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0708070d50 0x7f070815e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:40.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f0710439700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 0x7f0708067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:40.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f0710439700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070815e750 con 0x7f0708159a30 2023-12-24T20:00:40.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f0710439700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0708067550 con 0x7f0708070d50 2023-12-24T20:00:40.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f0710439700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0708067b10 con 0x7f07080c3b80 2023-12-24T20:00:40.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070d9d4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0708070d50 0x7f070815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070d9d4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0708070d50 0x7f070815e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:54920/0 (socket says 172.21.15.61:54920) 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070d9d4700 1 -- 172.21.15.61:0/2813455781 learned_addr learned my addr 172.21.15.61:0/2813455781 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070e9d6700 1 --2- 172.21.15.61:0/2813455781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 0x7f0708067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070e1d5700 1 --1- 172.21.15.61:0/2813455781 >> v1:172.21.15.133:6789/0 conn(0x7f0708159a30 0x7f0708070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:46130/0 (socket says 172.21.15.61:46130) 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070d9d4700 1 -- 172.21.15.61:0/2813455781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 msgr2=0x7f0708067fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070d9d4700 1 --2- 172.21.15.61:0/2813455781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 0x7f0708067fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070d9d4700 1 -- 172.21.15.61:0/2813455781 >> v1:172.21.15.133:6789/0 conn(0x7f0708159a30 legacy=0x7f0708070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070d1d3700 1 -- 172.21.15.61:0/2813455781 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210053511 0 0) 0x7f0704001110 con 0x7f0708159a30 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070d9d4700 1 -- 172.21.15.61:0/2813455781 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708071550 con 0x7f0708070d50 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.149+0000 7f070e9d6700 1 --2- 172.21.15.61:0/2813455781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 0x7f0708067fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.150+0000 7f070d9d4700 1 --2- 172.21.15.61:0/2813455781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0708070d50 0x7f070815e210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009990 tx=0x7f06f8009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1f033ddf9fcef98 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.150+0000 7f070d1d3700 1 -- 172.21.15.61:0/2813455781 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8009e80 con 0x7f0708070d50 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.150+0000 7f070d1d3700 1 -- 172.21.15.61:0/2813455781 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f8005c10 con 0x7f0708070d50 2023-12-24T20:00:40.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.150+0000 7f070d1d3700 1 -- 172.21.15.61:0/2813455781 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f800b650 con 0x7f0708070d50 2023-12-24T20:00:40.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.150+0000 7f0710439700 1 -- 172.21.15.61:0/2813455781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0708070d50 msgr2=0x7f070815e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:40.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.150+0000 7f0710439700 1 --2- 172.21.15.61:0/2813455781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0708070d50 0x7f070815e210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009990 tx=0x7f06f8009220 comp rx=0 tx=0).stop 2023-12-24T20:00:40.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.150+0000 7f0710439700 1 -- 172.21.15.61:0/2813455781 shutdown_connections 2023-12-24T20:00:40.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.151+0000 7f0710439700 1 --2- 172.21.15.61:0/2813455781 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 0x7f0708067fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:40.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.151+0000 7f0710439700 1 --2- 172.21.15.61:0/2813455781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0708070d50 0x7f070815e210 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:40.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.151+0000 7f0710439700 1 -- 172.21.15.61:0/2813455781 >> 172.21.15.61:0/2813455781 conn(0x7f07080ce1f0 msgr2=0x7f07080ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:40.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.151+0000 7f0710439700 1 -- 172.21.15.61:0/2813455781 shutdown_connections 2023-12-24T20:00:40.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.151+0000 7f0710439700 1 -- 172.21.15.61:0/2813455781 wait complete. 2023-12-24T20:00:40.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.152+0000 7f0710439700 1 Processor -- start 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.152+0000 7f0710439700 1 -- start start 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.152+0000 7f0710439700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0708070d50 0x7f07080c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.152+0000 7f0710439700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 0x7f070815d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.152+0000 7f0710439700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0708159a30 0x7f07080c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.152+0000 7f0710439700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07080c8f10 con 0x7f0708070d50 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.152+0000 7f0710439700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07080c56d0 con 0x7f0708159a30 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.152+0000 7f0710439700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07080c8300 con 0x7f07080c3b80 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e1d5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0708070d50 0x7f07080c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e1d5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0708070d50 0x7f07080c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44614/0 (socket says 172.21.15.61:44614) 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e1d5700 1 -- 172.21.15.61:0/1778252932 learned_addr learned my addr 172.21.15.61:0/1778252932 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e9d6700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0708159a30 0x7f07080c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070d9d4700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 0x7f070815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e1d5700 1 -- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 msgr2=0x7f070815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e1d5700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 0x7f070815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:40.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e1d5700 1 -- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0708159a30 msgr2=0x7f07080c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:40.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e1d5700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0708159a30 0x7f07080c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:40.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e1d5700 1 -- 172.21.15.61:0/1778252932 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700009a20 con 0x7f0708070d50 2023-12-24T20:00:40.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e9d6700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0708159a30 0x7f07080c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:40.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f070e1d5700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0708070d50 0x7f07080c93a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f070400c810 tx=0x7f0704007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:40.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f06fe7fc700 1 -- 172.21.15.61:0/1778252932 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704007300 con 0x7f0708070d50 2023-12-24T20:00:40.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f06fe7fc700 1 -- 172.21.15.61:0/1778252932 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704007480 con 0x7f0708070d50 2023-12-24T20:00:40.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f0710439700 1 -- 172.21.15.61:0/1778252932 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f8009480 con 0x7f0708070d50 2023-12-24T20:00:40.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f06fe7fc700 1 -- 172.21.15.61:0/1778252932 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704004830 con 0x7f0708070d50 2023-12-24T20:00:40.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.153+0000 7f0710439700 1 -- 172.21.15.61:0/1778252932 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07080c88c0 con 0x7f0708070d50 2023-12-24T20:00:40.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.154+0000 7f0710439700 1 -- 172.21.15.61:0/1778252932 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07080c91f0 con 0x7f0708070d50 2023-12-24T20:00:40.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.155+0000 7f06fe7fc700 1 -- 172.21.15.61:0/1778252932 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0704004be0 con 0x7f0708070d50 2023-12-24T20:00:40.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.155+0000 7f06fe7fc700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06ec066f30 0x7f06ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:40.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.156+0000 7f06fe7fc700 1 -- 172.21.15.61:0/1778252932 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f0704083680 con 0x7f0708070d50 2023-12-24T20:00:40.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.156+0000 7f070d9d4700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06ec066f30 0x7f06ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:40.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.156+0000 7f070d9d4700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06ec066f30 0x7f06ec0693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009260 tx=0x7f06f8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:40.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.160+0000 7f06fe7fc700 1 -- 172.21.15.61:0/1778252932 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0704050ad0 con 0x7f0708070d50 2023-12-24T20:00:40.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:40.357+0000 7f0710439700 1 -- 172.21.15.61:0/1778252932 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f070815e750 con 0x7f0708070d50 2023-12-24T20:00:41.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.006+0000 7f06fe7fc700 1 -- 172.21.15.61:0/1778252932 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) v1 ==== 170+0+0 (secure 0 0 0) 0x7f070815e750 con 0x7f0708070d50 2023-12-24T20:00:41.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.011+0000 7f0710439700 1 -- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06ec066f30 msgr2=0x7f06ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:41.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.011+0000 7f0710439700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06ec066f30 0x7f06ec0693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009260 tx=0x7f06f8016000 comp rx=0 tx=0).stop 2023-12-24T20:00:41.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.011+0000 7f0710439700 1 -- 172.21.15.61:0/1778252932 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0708070d50 msgr2=0x7f07080c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:41.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.011+0000 7f0710439700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0708070d50 0x7f07080c93a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f070400c810 tx=0x7f0704007c50 comp rx=0 tx=0).stop 2023-12-24T20:00:41.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.011+0000 7f0710439700 1 -- 172.21.15.61:0/1778252932 shutdown_connections 2023-12-24T20:00:41.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.011+0000 7f0710439700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06ec066f30 0x7f06ec0693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.011+0000 7f0710439700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0708159a30 0x7f07080c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.011+0000 7f0710439700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0708070d50 0x7f07080c93a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.011+0000 7f0710439700 1 --2- 172.21.15.61:0/1778252932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f07080c3b80 0x7f070815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.011+0000 7f0710439700 1 -- 172.21.15.61:0/1778252932 >> 172.21.15.61:0/1778252932 conn(0x7f07080ce1f0 msgr2=0x7f07080b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:41.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.012+0000 7f0710439700 1 -- 172.21.15.61:0/1778252932 shutdown_connections 2023-12-24T20:00:41.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.012+0000 7f0710439700 1 -- 172.21.15.61:0/1778252932 wait complete. 2023-12-24T20:00:41.014 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T20:00:41.030 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T20:00:41.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.157+0000 7f32ff749700 1 Processor -- start 2023-12-24T20:00:41.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.158+0000 7f32ff749700 1 -- start start 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.158+0000 7f32ff749700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32f8156830 0x7f32f80c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.158+0000 7f32ff749700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f80c8690 con 0x7f32f8156c00 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.158+0000 7f32ff749700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f8068370 con 0x7f32f80c9b30 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.158+0000 7f32ff749700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f8069f00 con 0x7f32f8156830 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.158+0000 7f32fcce4700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f32f8156c00 0x7f32f8067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57292/0 (socket says 172.21.15.61:57292) 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.158+0000 7f32fcce4700 1 -- 172.21.15.61:0/1857227947 learned_addr learned my addr 172.21.15.61:0/1857227947 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942810408 0 0) 0x7f32f80c8690 con 0x7f32f8156c00 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32fd4e5700 1 --2- 172.21.15.61:0/1857227947 >> v2:172.21.15.133:3300/0 conn(0x7f32f8156830 0x7f32f80c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e4003570 con 0x7f32f8156c00 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1738930672 0 0) 0x7f32e4003570 con 0x7f32f8156c00 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 >> v2:172.21.15.133:3300/0 conn(0x7f32f8156830 msgr2=0x7f32f80c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 --2- 172.21.15.61:0/1857227947 >> v2:172.21.15.133:3300/0 conn(0x7f32f8156830 0x7f32f80c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 >> v1:172.21.15.133:6789/0 conn(0x7f32f80c9b30 legacy=0x7f32f8067c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f806a1e0 con 0x7f32f8156c00 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f32f40015f0 con 0x7f32f8156c00 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 >> v1:172.21.15.61:6789/0 conn(0x7f32f8156c00 legacy=0x7f32f8067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32e4003a60 0x7f32e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4004810 0x7f32e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32e40052e0 0x7f32e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f8069f00 con 0x7f32e4003a60 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e400c2a0 con 0x7f32e4004810 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e400c460 con 0x7f32e40052e0 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32fd4e5700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32e4003a60 0x7f32e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32fcce4700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4004810 0x7f32e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.159+0000 7f32fdce6700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32e40052e0 0x7f32e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32fd4e5700 1 -- 172.21.15.61:0/1857227947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32e40052e0 msgr2=0x7f32e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32fd4e5700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32e40052e0 0x7f32e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32fd4e5700 1 -- 172.21.15.61:0/1857227947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4004810 msgr2=0x7f32e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32fd4e5700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4004810 0x7f32e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32fd4e5700 1 -- 172.21.15.61:0/1857227947 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4003570 con 0x7f32e4003a60 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32fdce6700 1 -- 172.21.15.61:0/1857227947 reap_dead start 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32fcce4700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4004810 0x7f32e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32fd4e5700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32e4003a60 0x7f32e4003e70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009c00 tx=0x7f32e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3c487d1688a13a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800e710 con 0x7f32e4003a60 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e800e870 con 0x7f32e4003a60 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32effff700 1 -- 172.21.15.61:0/1857227947 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800ec30 con 0x7f32e4003a60 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32ff749700 1 -- 172.21.15.61:0/1857227947 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32e4003a60 msgr2=0x7f32e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32ff749700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32e4003a60 0x7f32e4003e70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009c00 tx=0x7f32e80091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32ff749700 1 -- 172.21.15.61:0/1857227947 shutdown_connections 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32ff749700 1 --2- 172.21.15.61:0/1857227947 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32e4003a60 0x7f32e4003e70 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.160+0000 7f32ff749700 1 -- 172.21.15.61:0/1857227947 >> 172.21.15.61:0/1857227947 conn(0x7f32f80ce1f0 msgr2=0x7f32f80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.161+0000 7f32ff749700 1 -- 172.21.15.61:0/1857227947 shutdown_connections 2023-12-24T20:00:41.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.161+0000 7f32ff749700 1 -- 172.21.15.61:0/1857227947 wait complete. 2023-12-24T20:00:41.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.162+0000 7f32ff749700 1 Processor -- start 2023-12-24T20:00:41.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.162+0000 7f32ff749700 1 -- start start 2023-12-24T20:00:41.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.162+0000 7f32ff749700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4003a60 0x7f32f815bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:41.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.162+0000 7f32ff749700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32f815a560 0x7f32f8157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:41.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.162+0000 7f32ff749700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32f81511f0 0x7f32f806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:41.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.162+0000 7f32ff749700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f81580c0 con 0x7f32f815a560 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.162+0000 7f32ff749700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f815a9d0 con 0x7f32e4003a60 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.162+0000 7f32ff749700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f815ac60 con 0x7f32f81511f0 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fcce4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32f815a560 0x7f32f8157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fcce4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32f815a560 0x7f32f8157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44642/0 (socket says 172.21.15.61:44642) 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fcce4700 1 -- 172.21.15.61:0/4280617478 learned_addr learned my addr 172.21.15.61:0/4280617478 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fd4e5700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4003a60 0x7f32f815bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fdce6700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32f81511f0 0x7f32f806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fcce4700 1 -- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32f81511f0 msgr2=0x7f32f806da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fcce4700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32f81511f0 0x7f32f806da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fcce4700 1 -- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4003a60 msgr2=0x7f32f815bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fcce4700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4003a60 0x7f32f815bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fcce4700 1 -- 172.21.15.61:0/4280617478 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f815af40 con 0x7f32f815a560 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fdce6700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32f81511f0 0x7f32f806da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:41.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fd4e5700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4003a60 0x7f32f815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32fcce4700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32f815a560 0x7f32f8157b80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f32f4002d90 tx=0x7f32f4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32ed7fa700 1 -- 172.21.15.61:0/4280617478 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40072e0 con 0x7f32f815a560 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32ed7fa700 1 -- 172.21.15.61:0/4280617478 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f4007440 con 0x7f32f815a560 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32ff749700 1 -- 172.21.15.61:0/4280617478 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f815b220 con 0x7f32f815a560 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32ed7fa700 1 -- 172.21.15.61:0/4280617478 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40057f0 con 0x7f32f815a560 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.163+0000 7f32ff749700 1 -- 172.21.15.61:0/4280617478 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f815b7e0 con 0x7f32f815a560 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.164+0000 7f32ff749700 1 -- 172.21.15.61:0/4280617478 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f804c3c0 con 0x7f32f815a560 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.165+0000 7f32ed7fa700 1 -- 172.21.15.61:0/4280617478 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f32f4005b60 con 0x7f32f815a560 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.165+0000 7f32ed7fa700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f32dc066f30 0x7f32dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.165+0000 7f32ed7fa700 1 -- 172.21.15.61:0/4280617478 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f32f4084f00 con 0x7f32f815a560 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.166+0000 7f32fd4e5700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f32dc066f30 0x7f32dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:41.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.166+0000 7f32fd4e5700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f32dc066f30 0x7f32dc0693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f32e80091e0 tx=0x7f32e801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:41.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.169+0000 7f32ed7fa700 1 -- 172.21.15.61:0/4280617478 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32f4055c40 con 0x7f32f815a560 2023-12-24T20:00:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:41.408+0000 7f32ff749700 1 -- 172.21.15.61:0/4280617478 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f32f80cb9a0 con 0x7f32f815a560 2023-12-24T20:00:42.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.009+0000 7f32ed7fa700 1 -- 172.21.15.61:0/4280617478 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v40) v1 ==== 174+0+0 (secure 0 0 0) 0x7f32f40557d0 con 0x7f32f815a560 2023-12-24T20:00:42.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.017+0000 7f32ff749700 1 -- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f32dc066f30 msgr2=0x7f32dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.017+0000 7f32ff749700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f32dc066f30 0x7f32dc0693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f32e80091e0 tx=0x7f32e801a000 comp rx=0 tx=0).stop 2023-12-24T20:00:42.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.017+0000 7f32ff749700 1 -- 172.21.15.61:0/4280617478 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32f815a560 msgr2=0x7f32f8157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.017+0000 7f32ff749700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32f815a560 0x7f32f8157b80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f32f4002d90 tx=0x7f32f4009040 comp rx=0 tx=0).stop 2023-12-24T20:00:42.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.024+0000 7f32ff749700 1 -- 172.21.15.61:0/4280617478 shutdown_connections 2023-12-24T20:00:42.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.024+0000 7f32ff749700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32f81511f0 0x7f32f806da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.024+0000 7f32ff749700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f32dc066f30 0x7f32dc0693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.024+0000 7f32ff749700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e4003a60 0x7f32f815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.024+0000 7f32ff749700 1 --2- 172.21.15.61:0/4280617478 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32f815a560 0x7f32f8157b80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.024+0000 7f32ff749700 1 -- 172.21.15.61:0/4280617478 >> 172.21.15.61:0/4280617478 conn(0x7f32f80ce1f0 msgr2=0x7f32f8068560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:42.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.025+0000 7f32ff749700 1 -- 172.21.15.61:0/4280617478 shutdown_connections 2023-12-24T20:00:42.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.025+0000 7f32ff749700 1 -- 172.21.15.61:0/4280617478 wait complete. 2023-12-24T20:00:42.028 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 10 and data pool 11 2023-12-24T20:00:42.042 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:00:42.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.166+0000 7fecc014b700 1 Processor -- start 2023-12-24T20:00:42.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.167+0000 7fecc014b700 1 -- start start 2023-12-24T20:00:42.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.167+0000 7fecc014b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecb80af710 0x7fecb80afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.167+0000 7fecc014b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fecb8068c80 0x7fecb8067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.167+0000 7fecc014b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb80687f0 con 0x7fecb80a6c80 2023-12-24T20:00:42.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.167+0000 7fecc014b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb80a7100 con 0x7fecb8068c80 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.167+0000 7fecc014b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8067be0 con 0x7fecb80af710 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbe6e8700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fecb80a6c80 0x7fecb815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57308/0 (socket says 172.21.15.61:57308) 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbe6e8700 1 -- 172.21.15.61:0/1178542715 learned_addr learned my addr 172.21.15.61:0/1178542715 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbdee7700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecb80af710 0x7fecb80afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbd6e6700 1 --2- 172.21.15.61:0/1178542715 >> v2:172.21.15.133:3300/0 conn(0x7fecb8068c80 0x7fecb8067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214444672 0 0) 0x7fecb80687f0 con 0x7fecb80a6c80 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca4003570 con 0x7fecb80a6c80 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261590217 0 0) 0x7feca4003570 con 0x7fecb80a6c80 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecb80af710 msgr2=0x7fecb80afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecb80af710 0x7fecb80afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 >> v2:172.21.15.133:3300/0 conn(0x7fecb8068c80 msgr2=0x7fecb8067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 --2- 172.21.15.61:0/1178542715 >> v2:172.21.15.133:3300/0 conn(0x7fecb8068c80 0x7fecb8067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb8067ec0 con 0x7fecb80a6c80 2023-12-24T20:00:42.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fecb00017f0 con 0x7fecb80a6c80 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 >> v1:172.21.15.61:6789/0 conn(0x7fecb80a6c80 legacy=0x7fecb815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca4003ae0 0x7feca4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7feca4004810 0x7feca4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecb80af710 0x7feca40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80a7100 con 0x7feca4004810 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8067be0 con 0x7feca4003ae0 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca400bb10 con 0x7fecb80af710 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbd6e6700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7feca4004810 0x7feca4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.168+0000 7fecbdee7700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca4003ae0 0x7feca4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbe6e8700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecb80af710 0x7feca40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbd6e6700 1 -- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecb80af710 msgr2=0x7feca40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbd6e6700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecb80af710 0x7feca40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbd6e6700 1 -- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca4003ae0 msgr2=0x7feca4003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbd6e6700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feca4003ae0 0x7feca4003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbd6e6700 1 -- 172.21.15.61:0/1178542715 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4003570 con 0x7feca4004810 2023-12-24T20:00:42.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbe6e8700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fecb80af710 0x7feca40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbd6e6700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7feca4004810 0x7feca4004c80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fecb8069070 tx=0x7feca80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb572b31625031e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca800e710 con 0x7feca4004810 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca800e870 con 0x7feca4004810 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbcee5700 1 -- 172.21.15.61:0/1178542715 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca800ec30 con 0x7feca4004810 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecc014b700 1 -- 172.21.15.61:0/1178542715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7feca4004810 msgr2=0x7feca4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecc014b700 1 --2- 172.21.15.61:0/1178542715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7feca4004810 0x7feca4004c80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fecb8069070 tx=0x7feca80091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.169+0000 7fecbe6e8700 1 -- 172.21.15.61:0/1178542715 reap_dead start 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.170+0000 7fecc014b700 1 -- 172.21.15.61:0/1178542715 shutdown_connections 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.170+0000 7fecc014b700 1 -- 172.21.15.61:0/1178542715 >> 172.21.15.61:0/1178542715 conn(0x7fecb80ca200 msgr2=0x7fecb80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.170+0000 7fecc014b700 1 -- 172.21.15.61:0/1178542715 shutdown_connections 2023-12-24T20:00:42.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.170+0000 7fecc014b700 1 -- 172.21.15.61:0/1178542715 wait complete. 2023-12-24T20:00:42.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.171+0000 7fecc014b700 1 Processor -- start 2023-12-24T20:00:42.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.171+0000 7fecc014b700 1 -- start start 2023-12-24T20:00:42.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecc014b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feca4004810 0x7fecb814c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecc014b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecb814a540 0x7fecb80b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecc014b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb806da30 0x7fecb806de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecc014b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80b23a0 con 0x7fecb814a540 2023-12-24T20:00:42.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecc014b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb806e3c0 con 0x7fecb806da30 2023-12-24T20:00:42.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecc014b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80b1790 con 0x7feca4004810 2023-12-24T20:00:42.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecbd6e6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecb814a540 0x7fecb80b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecbd6e6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecb814a540 0x7fecb80b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44662/0 (socket says 172.21.15.61:44662) 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecbd6e6700 1 -- 172.21.15.61:0/665096535 learned_addr learned my addr 172.21.15.61:0/665096535 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecbdee7700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feca4004810 0x7fecb814c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.172+0000 7fecbe6e8700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb806da30 0x7fecb806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecbd6e6700 1 -- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feca4004810 msgr2=0x7fecb814c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecbd6e6700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feca4004810 0x7fecb814c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecbd6e6700 1 -- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb806da30 msgr2=0x7fecb806de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecbd6e6700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb806da30 0x7fecb806de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecbd6e6700 1 -- 172.21.15.61:0/665096535 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80b1a70 con 0x7fecb814a540 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecbe6e8700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb806da30 0x7fecb806de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecbd6e6700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecb814a540 0x7fecb80b0ef0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7feca400ba60 tx=0x7feca801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecadffb700 1 -- 172.21.15.61:0/665096535 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8022070 con 0x7fecb814a540 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecadffb700 1 -- 172.21.15.61:0/665096535 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca800e9e0 con 0x7fecb814a540 2023-12-24T20:00:42.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecc014b700 1 -- 172.21.15.61:0/665096535 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb80b1d50 con 0x7fecb814a540 2023-12-24T20:00:42.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecadffb700 1 -- 172.21.15.61:0/665096535 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca801c450 con 0x7fecb814a540 2023-12-24T20:00:42.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.173+0000 7fecc014b700 1 -- 172.21.15.61:0/665096535 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb814a9b0 con 0x7fecb814a540 2023-12-24T20:00:42.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.174+0000 7fecc014b700 1 -- 172.21.15.61:0/665096535 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb804c3c0 con 0x7fecb814a540 2023-12-24T20:00:42.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.175+0000 7fecadffb700 1 -- 172.21.15.61:0/665096535 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7feca801c8a0 con 0x7fecb814a540 2023-12-24T20:00:42.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.175+0000 7fecadffb700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec9c066f30 0x7fec9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.175+0000 7fecadffb700 1 -- 172.21.15.61:0/665096535 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feca8085d70 con 0x7fecb814a540 2023-12-24T20:00:42.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.176+0000 7fecbdee7700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec9c066f30 0x7fec9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.176+0000 7fecbdee7700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec9c066f30 0x7fec9c0693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fecb4006f00 tx=0x7fecb40091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:42.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.180+0000 7fecadffb700 1 -- 172.21.15.61:0/665096535 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feca8052fe0 con 0x7fecb814a540 2023-12-24T20:00:42.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.374+0000 7fecc014b700 1 -- 172.21.15.61:0/665096535 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecb806e890 con 0x7fecb814a540 2023-12-24T20:00:42.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.375+0000 7fecadffb700 1 -- 172.21.15.61:0/665096535 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+15366 (secure 0 0 0) 0x7feca8056600 con 0x7fecb814a540 2023-12-24T20:00:42.375 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:42.375 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":79,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:00:41.409579+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:00:39.818793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-24T20:00:40.387692+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 -- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec9c066f30 msgr2=0x7fec9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec9c066f30 0x7fec9c0693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fecb4006f00 tx=0x7fecb40091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 -- 172.21.15.61:0/665096535 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecb814a540 msgr2=0x7fecb80b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecb814a540 0x7fecb80b0ef0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7feca400ba60 tx=0x7feca801a000 comp rx=0 tx=0).stop 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 -- 172.21.15.61:0/665096535 shutdown_connections 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7feca4004810 0x7fecb814c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec9c066f30 0x7fec9c0693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecb806da30 0x7fecb806de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 --2- 172.21.15.61:0/665096535 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fecb814a540 0x7fecb80b0ef0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 -- 172.21.15.61:0/665096535 >> 172.21.15.61:0/665096535 conn(0x7fecb80ca200 msgr2=0x7fecb80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 -- 172.21.15.61:0/665096535 shutdown_connections 2023-12-24T20:00:42.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.377+0000 7fecc014b700 1 -- 172.21.15.61:0/665096535 wait complete. 2023-12-24T20:00:42.390 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:00:42.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.511+0000 7f35d3caa700 1 Processor -- start 2023-12-24T20:00:42.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.511+0000 7f35d3caa700 1 -- start start 2023-12-24T20:00:42.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d3caa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc159b00 0x7f35cc067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d3caa700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f35cc070d50 0x7f35cc0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d3caa700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc0a84d0 con 0x7f35cc0af7d0 2023-12-24T20:00:42.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d3caa700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35cc0b0180 con 0x7f35cc070d50 2023-12-24T20:00:42.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d3caa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0a7620 con 0x7f35cc159b00 2023-12-24T20:00:42.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d1245700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f35cc0af7d0 0x7f35cc070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57312/0 (socket says 172.21.15.61:57312) 2023-12-24T20:00:42.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d1245700 1 -- 172.21.15.61:0/235278589 learned_addr learned my addr 172.21.15.61:0/235278589 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:42.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d2247700 1 --2- 172.21.15.61:0/235278589 >> v2:172.21.15.61:3300/0 conn(0x7f35cc070d50 0x7f35cc0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d1a46700 1 --2- 172.21.15.61:0/235278589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc159b00 0x7f35cc067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d0a44700 1 -- 172.21.15.61:0/235278589 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938947957 0 0) 0x7f35cc0a84d0 con 0x7f35cc0af7d0 2023-12-24T20:00:42.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d0a44700 1 -- 172.21.15.61:0/235278589 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35b8003570 con 0x7f35cc0af7d0 2023-12-24T20:00:42.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d2247700 1 -- 172.21.15.61:0/235278589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc159b00 msgr2=0x7f35cc067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:42.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d2247700 1 --2- 172.21.15.61:0/235278589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc159b00 0x7f35cc067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d2247700 1 -- 172.21.15.61:0/235278589 >> v1:172.21.15.61:6789/0 conn(0x7f35cc0af7d0 legacy=0x7f35cc070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d2247700 1 -- 172.21.15.61:0/235278589 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0a78c0 con 0x7f35cc070d50 2023-12-24T20:00:42.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d1a46700 1 --2- 172.21.15.61:0/235278589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc159b00 0x7f35cc067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.512+0000 7f35d2247700 1 --2- 172.21.15.61:0/235278589 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc070d50 0x7f35cc0afc40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009e60 tx=0x7f35c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498eba794cb1b49 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d0a44700 1 -- 172.21.15.61:0/235278589 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c400e070 con 0x7f35cc070d50 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d0a44700 1 -- 172.21.15.61:0/235278589 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c400bb60 con 0x7f35cc070d50 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d0a44700 1 -- 172.21.15.61:0/235278589 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4012430 con 0x7f35cc070d50 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d3caa700 1 -- 172.21.15.61:0/235278589 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc070d50 msgr2=0x7f35cc0afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d3caa700 1 --2- 172.21.15.61:0/235278589 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc070d50 0x7f35cc0afc40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009e60 tx=0x7f35c4009780 comp rx=0 tx=0).stop 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d3caa700 1 -- 172.21.15.61:0/235278589 shutdown_connections 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d3caa700 1 --2- 172.21.15.61:0/235278589 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc159b00 0x7f35cc067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d3caa700 1 --2- 172.21.15.61:0/235278589 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc070d50 0x7f35cc0afc40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d3caa700 1 -- 172.21.15.61:0/235278589 >> 172.21.15.61:0/235278589 conn(0x7f35cc0ca200 msgr2=0x7f35cc0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d3caa700 1 -- 172.21.15.61:0/235278589 shutdown_connections 2023-12-24T20:00:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.513+0000 7f35d3caa700 1 -- 172.21.15.61:0/235278589 wait complete. 2023-12-24T20:00:42.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.514+0000 7f35d3caa700 1 Processor -- start 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.514+0000 7f35d3caa700 1 -- start start 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d3caa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc070d50 0x7f35cc15c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d3caa700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc0af7d0 0x7f35cc0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d3caa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35cc159b00 0x7f35cc16ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d3caa700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc15d2c0 con 0x7f35cc0af7d0 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d3caa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc15cb10 con 0x7f35cc159b00 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d3caa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0ad6f0 con 0x7f35cc070d50 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d1245700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc0af7d0 0x7f35cc0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d1245700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc0af7d0 0x7f35cc0ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44680/0 (socket says 172.21.15.61:44680) 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d1245700 1 -- 172.21.15.61:0/1102315970 learned_addr learned my addr 172.21.15.61:0/1102315970 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d1a46700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc070d50 0x7f35cc15c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d2247700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35cc159b00 0x7f35cc16ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d1245700 1 -- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc070d50 msgr2=0x7f35cc15c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d1245700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc070d50 0x7f35cc15c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d1245700 1 -- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35cc159b00 msgr2=0x7f35cc16ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d1245700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35cc159b00 0x7f35cc16ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d1245700 1 -- 172.21.15.61:0/1102315970 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4009a20 con 0x7f35cc0af7d0 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.515+0000 7f35d2247700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35cc159b00 0x7f35cc16ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.516+0000 7f35d1245700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc0af7d0 0x7f35cc0ad1b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c7c0 tx=0x7f35bc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.516+0000 7f35c1ffb700 1 -- 172.21.15.61:0/1102315970 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc005b30 con 0x7f35cc0af7d0 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.516+0000 7f35c1ffb700 1 -- 172.21.15.61:0/1102315970 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc005cb0 con 0x7f35cc0af7d0 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.516+0000 7f35d3caa700 1 -- 172.21.15.61:0/1102315970 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc16a6e0 con 0x7f35cc0af7d0 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.516+0000 7f35c1ffb700 1 -- 172.21.15.61:0/1102315970 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc007320 con 0x7f35cc0af7d0 2023-12-24T20:00:42.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.516+0000 7f35d3caa700 1 -- 172.21.15.61:0/1102315970 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc15cfe0 con 0x7f35cc0af7d0 2023-12-24T20:00:42.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.517+0000 7f35d3caa700 1 -- 172.21.15.61:0/1102315970 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35cc16a870 con 0x7f35cc0af7d0 2023-12-24T20:00:42.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.517+0000 7f35c1ffb700 1 -- 172.21.15.61:0/1102315970 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f35bc01b3b0 con 0x7f35cc0af7d0 2023-12-24T20:00:42.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.518+0000 7f35c1ffb700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f35b0066f30 0x7f35b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.518+0000 7f35c1ffb700 1 -- 172.21.15.61:0/1102315970 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f35bc083a00 con 0x7f35cc0af7d0 2023-12-24T20:00:42.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.518+0000 7f35d1a46700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f35b0066f30 0x7f35b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.519+0000 7f35d1a46700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f35b0066f30 0x7f35b00693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35c8006f00 tx=0x7f35c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:42.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.522+0000 7f35c1ffb700 1 -- 172.21.15.61:0/1102315970 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35bc050c70 con 0x7f35cc0af7d0 2023-12-24T20:00:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.719+0000 7f35d3caa700 1 -- 172.21.15.61:0/1102315970 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35cc04c3c0 con 0x7f35cc0af7d0 2023-12-24T20:00:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.719+0000 7f35c1ffb700 1 -- 172.21.15.61:0/1102315970 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f35bc017020 con 0x7f35cc0af7d0 2023-12-24T20:00:42.720 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:42.720 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":79,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:00:41.409579+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:00:39.818793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-24T20:00:40.387692+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:00:42.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 -- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f35b0066f30 msgr2=0x7f35b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f35b0066f30 0x7f35b00693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35c8006f00 tx=0x7f35c8008040 comp rx=0 tx=0).stop 2023-12-24T20:00:42.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 -- 172.21.15.61:0/1102315970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc0af7d0 msgr2=0x7f35cc0ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc0af7d0 0x7f35cc0ad1b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c7c0 tx=0x7f35bc007e00 comp rx=0 tx=0).stop 2023-12-24T20:00:42.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 -- 172.21.15.61:0/1102315970 shutdown_connections 2023-12-24T20:00:42.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f35cc070d50 0x7f35cc15c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f35b0066f30 0x7f35b00693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35cc159b00 0x7f35cc16ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 --2- 172.21.15.61:0/1102315970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f35cc0af7d0 0x7f35cc0ad1b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 -- 172.21.15.61:0/1102315970 >> 172.21.15.61:0/1102315970 conn(0x7f35cc0ca200 msgr2=0x7f35cc155ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.721+0000 7f35d3caa700 1 -- 172.21.15.61:0/1102315970 shutdown_connections 2023-12-24T20:00:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.722+0000 7f35d3caa700 1 -- 172.21.15.61:0/1102315970 wait complete. 2023-12-24T20:00:42.735 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T20:00:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.859+0000 7f14844f7700 1 Processor -- start 2023-12-24T20:00:42.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.859+0000 7f14844f7700 1 -- start start 2023-12-24T20:00:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.860+0000 7f14844f7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 0x7f147c0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.860+0000 7f14844f7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f147c15a030 0x7f147c070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.860+0000 7f14844f7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f147c068b10 0x7f147c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.860+0000 7f14844f7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c06b190 con 0x7f147c15a030 2023-12-24T20:00:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.860+0000 7f14844f7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c06a5c0 con 0x7f147c068b10 2023-12-24T20:00:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.860+0000 7f14844f7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c06a860 con 0x7f147c159c60 2023-12-24T20:00:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.860+0000 7f1481a92700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f147c15a030 0x7f147c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.860+0000 7f1481a92700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f147c15a030 0x7f147c070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44694/0 (socket says 172.21.15.61:44694) 2023-12-24T20:00:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.860+0000 7f1481a92700 1 -- 172.21.15.61:0/2959024370 learned_addr learned my addr 172.21.15.61:0/2959024370 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1482293700 1 --2- 172.21.15.61:0/2959024370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 0x7f147c0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1482a94700 1 --2- 172.21.15.61:0/2959024370 >> v2:172.21.15.133:3300/0 conn(0x7f147c068b10 0x7f147c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1481a92700 1 -- 172.21.15.61:0/2959024370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 msgr2=0x7f147c0c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1481a92700 1 --2- 172.21.15.61:0/2959024370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 0x7f147c0c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1481a92700 1 -- 172.21.15.61:0/2959024370 >> v2:172.21.15.133:3300/0 conn(0x7f147c068b10 msgr2=0x7f147c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1481a92700 1 --2- 172.21.15.61:0/2959024370 >> v2:172.21.15.133:3300/0 conn(0x7f147c068b10 0x7f147c070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1481a92700 1 -- 172.21.15.61:0/2959024370 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c06ab40 con 0x7f147c15a030 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1481a92700 1 --2- 172.21.15.61:0/2959024370 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 0x7f147c070640 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f147c0c7ae0 tx=0x7f146c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4275f3bb9200154 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1481291700 1 -- 172.21.15.61:0/2959024370 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00b860 con 0x7f147c15a030 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1481291700 1 -- 172.21.15.61:0/2959024370 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c00b9c0 con 0x7f147c15a030 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.861+0000 7f1481291700 1 -- 172.21.15.61:0/2959024370 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00bd60 con 0x7f147c15a030 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.862+0000 7f14844f7700 1 -- 172.21.15.61:0/2959024370 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 msgr2=0x7f147c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.862+0000 7f14844f7700 1 --2- 172.21.15.61:0/2959024370 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 0x7f147c070640 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f147c0c7ae0 tx=0x7f146c009250 comp rx=0 tx=0).stop 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.862+0000 7f14844f7700 1 -- 172.21.15.61:0/2959024370 shutdown_connections 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.862+0000 7f14844f7700 1 --2- 172.21.15.61:0/2959024370 >> v2:172.21.15.133:3300/0 conn(0x7f147c068b10 0x7f147c070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.862+0000 7f14844f7700 1 --2- 172.21.15.61:0/2959024370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 0x7f147c0c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.862+0000 7f14844f7700 1 --2- 172.21.15.61:0/2959024370 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 0x7f147c070640 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.862+0000 7f14844f7700 1 -- 172.21.15.61:0/2959024370 >> 172.21.15.61:0/2959024370 conn(0x7f147c0ce420 msgr2=0x7f147c0ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:42.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.862+0000 7f14844f7700 1 -- 172.21.15.61:0/2959024370 shutdown_connections 2023-12-24T20:00:42.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.862+0000 7f14844f7700 1 -- 172.21.15.61:0/2959024370 wait complete. 2023-12-24T20:00:42.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.863+0000 7f14844f7700 1 Processor -- start 2023-12-24T20:00:42.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.863+0000 7f14844f7700 1 -- start start 2023-12-24T20:00:42.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f14844f7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f147c068b10 0x7f147c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f14844f7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 0x7f147c15dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f14844f7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 0x7f147c14c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f14844f7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c15f3a0 con 0x7f147c15a030 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f14844f7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c15e300 con 0x7f147c068b10 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f14844f7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c15e5e0 con 0x7f147c159c60 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1482a94700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 0x7f147c14c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1482a94700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 0x7f147c14c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44708/0 (socket says 172.21.15.61:44708) 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1482a94700 1 -- 172.21.15.61:0/1952310694 learned_addr learned my addr 172.21.15.61:0/1952310694 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1482293700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f147c068b10 0x7f147c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1481a92700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 0x7f147c15dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1482a94700 1 -- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 msgr2=0x7f147c15dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1482a94700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 0x7f147c15dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1482a94700 1 -- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f147c068b10 msgr2=0x7f147c0b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1482a94700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f147c068b10 0x7f147c0b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1482a94700 1 -- 172.21.15.61:0/1952310694 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c0094f0 con 0x7f147c15a030 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1481a92700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 0x7f147c15dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f1482a94700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 0x7f147c14c3b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1474007f20 tx=0x7f1474009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f14727fc700 1 -- 172.21.15.61:0/1952310694 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147400ebf0 con 0x7f147c15a030 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f14727fc700 1 -- 172.21.15.61:0/1952310694 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147400ed70 con 0x7f147c15a030 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f14727fc700 1 -- 172.21.15.61:0/1952310694 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474014670 con 0x7f147c15a030 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.864+0000 7f14844f7700 1 -- 172.21.15.61:0/1952310694 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c15e8c0 con 0x7f147c15a030 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.865+0000 7f14844f7700 1 -- 172.21.15.61:0/1952310694 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c15ee80 con 0x7f147c15a030 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.866+0000 7f14844f7700 1 -- 172.21.15.61:0/1952310694 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c04c3c0 con 0x7f147c15a030 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.866+0000 7f14727fc700 1 -- 172.21.15.61:0/1952310694 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f14740149e0 con 0x7f147c15a030 2023-12-24T20:00:42.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.866+0000 7f14727fc700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:42.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.866+0000 7f14727fc700 1 -- 172.21.15.61:0/1952310694 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1474084b70 con 0x7f147c15a030 2023-12-24T20:00:42.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.866+0000 7f1482293700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:42.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.867+0000 7f1482293700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1460066f30 0x7f14600693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1478006fd0 tx=0x7f1478008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:42.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:42.870+0000 7f14727fc700 1 -- 172.21.15.61:0/1952310694 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1474051de0 con 0x7f147c15a030 2023-12-24T20:00:43.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:43.118+0000 7f14844f7700 1 -- 172.21.15.61:0/1952310694 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f147c15f070 con 0x7f147c15a030 2023-12-24T20:00:43.984 INFO:tasks.ceph.mds.a.smithi061.stderr:2023-12-24T20:00:43.984+0000 7ff1a5178700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:00:44.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.043+0000 7f14727fc700 1 -- 172.21.15.61:0/1952310694 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1474055400 con 0x7f147c15a030 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 -- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1460066f30 msgr2=0x7f14600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1460066f30 0x7f14600693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1478006fd0 tx=0x7f1478008040 comp rx=0 tx=0).stop 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 -- 172.21.15.61:0/1952310694 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 msgr2=0x7f147c14c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 0x7f147c14c3b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1474007f20 tx=0x7f1474009860 comp rx=0 tx=0).stop 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 -- 172.21.15.61:0/1952310694 shutdown_connections 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1460066f30 0x7f14600693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f147c15a030 0x7f147c14c3b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f147c068b10 0x7f147c0b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 --2- 172.21.15.61:0/1952310694 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f147c159c60 0x7f147c15dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 -- 172.21.15.61:0/1952310694 >> 172.21.15.61:0/1952310694 conn(0x7f147c0ce420 msgr2=0x7f147c06db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 -- 172.21.15.61:0/1952310694 shutdown_connections 2023-12-24T20:00:44.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.046+0000 7f14844f7700 1 -- 172.21.15.61:0/1952310694 wait complete. 2023-12-24T20:00:44.062 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T20:00:44.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.195+0000 7efed7176700 1 Processor -- start 2023-12-24T20:00:44.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.196+0000 7efed7176700 1 -- start start 2023-12-24T20:00:44.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efed7176700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efed015a510 0x7efed00c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:44.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efed7176700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 0x7efed0156960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:44.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efed7176700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed00c6960 con 0x7efed00ad6f0 2023-12-24T20:00:44.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efed7176700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed0156ea0 con 0x7efed015a510 2023-12-24T20:00:44.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efed7176700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed00c9720 con 0x7efed00adac0 2023-12-24T20:00:44.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efecffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efed015a510 0x7efed00c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:44.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efed5713700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 0x7efed0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:44.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efecffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efed015a510 0x7efed00c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:55016/0 (socket says 172.21.15.61:55016) 2023-12-24T20:00:44.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efed4f12700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efed00ad6f0 0x7efed0156250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:46152/0 (socket says 172.21.15.61:46152) 2023-12-24T20:00:44.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efecffff700 1 -- 172.21.15.61:0/1755517905 learned_addr learned my addr 172.21.15.61:0/1755517905 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.197+0000 7efecf7fe700 1 -- 172.21.15.61:0/1755517905 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207010775 0 0) 0x7efed00c6960 con 0x7efed00ad6f0 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.198+0000 7efecf7fe700 1 -- 172.21.15.61:0/1755517905 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efebc003570 con 0x7efed00ad6f0 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.198+0000 7efed5713700 1 -- 172.21.15.61:0/1755517905 >> v2:172.21.15.133:3300/0 conn(0x7efed015a510 msgr2=0x7efed00c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.198+0000 7efed5713700 1 --2- 172.21.15.61:0/1755517905 >> v2:172.21.15.133:3300/0 conn(0x7efed015a510 0x7efed00c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.198+0000 7efed5713700 1 -- 172.21.15.61:0/1755517905 >> v1:172.21.15.133:6789/0 conn(0x7efed00ad6f0 legacy=0x7efed0156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.198+0000 7efed5713700 1 -- 172.21.15.61:0/1755517905 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed00c8b10 con 0x7efed00adac0 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.198+0000 7efecffff700 1 --2- 172.21.15.61:0/1755517905 >> v2:172.21.15.133:3300/0 conn(0x7efed015a510 0x7efed00c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.198+0000 7efed5713700 1 --2- 172.21.15.61:0/1755517905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 0x7efed0156960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efec8009e60 tx=0x7efec8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9468c49682e43ac7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.198+0000 7efecf7fe700 1 -- 172.21.15.61:0/1755517905 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800e070 con 0x7efed00adac0 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.198+0000 7efecf7fe700 1 -- 172.21.15.61:0/1755517905 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec800bab0 con 0x7efed00adac0 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.198+0000 7efecf7fe700 1 -- 172.21.15.61:0/1755517905 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800be70 con 0x7efed00adac0 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.199+0000 7efed7176700 1 -- 172.21.15.61:0/1755517905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 msgr2=0x7efed0156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.199+0000 7efed7176700 1 --2- 172.21.15.61:0/1755517905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 0x7efed0156960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efec8009e60 tx=0x7efec8009780 comp rx=0 tx=0).stop 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.199+0000 7efed7176700 1 -- 172.21.15.61:0/1755517905 shutdown_connections 2023-12-24T20:00:44.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.199+0000 7efed7176700 1 --2- 172.21.15.61:0/1755517905 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 0x7efed0156960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:44.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.199+0000 7efed7176700 1 --2- 172.21.15.61:0/1755517905 >> v2:172.21.15.133:3300/0 conn(0x7efed015a510 0x7efed00c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:44.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.199+0000 7efed7176700 1 -- 172.21.15.61:0/1755517905 >> 172.21.15.61:0/1755517905 conn(0x7efed0067550 msgr2=0x7efed0067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:44.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.199+0000 7efed7176700 1 -- 172.21.15.61:0/1755517905 shutdown_connections 2023-12-24T20:00:44.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.199+0000 7efed7176700 1 -- 172.21.15.61:0/1755517905 wait complete. 2023-12-24T20:00:44.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.200+0000 7efed7176700 1 Processor -- start 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.200+0000 7efed7176700 1 -- start start 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed7176700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed00ad6f0 0x7efed016e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed7176700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 0x7efed0170fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed7176700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efed015a510 0x7efed006e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed7176700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed01727a0 con 0x7efed015a510 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed7176700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed016e6c0 con 0x7efed00ad6f0 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed7176700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed00c40d0 con 0x7efed00adac0 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed5713700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efed015a510 0x7efed006e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed5713700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efed015a510 0x7efed006e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44724/0 (socket says 172.21.15.61:44724) 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed5713700 1 -- 172.21.15.61:0/1391999386 learned_addr learned my addr 172.21.15.61:0/1391999386 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efecffff700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 0x7efed0170fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed4f12700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed00ad6f0 0x7efed016e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed5713700 1 -- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 msgr2=0x7efed0170fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:44.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed5713700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 0x7efed0170fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed5713700 1 -- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed00ad6f0 msgr2=0x7efed016e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed5713700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed00ad6f0 0x7efed016e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed5713700 1 -- 172.21.15.61:0/1391999386 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80094f0 con 0x7efed015a510 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.201+0000 7efed5713700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efed015a510 0x7efed006e790 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7efed00c9860 tx=0x7efec8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.202+0000 7efeccff9700 1 -- 172.21.15.61:0/1391999386 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec8027470 con 0x7efed015a510 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.202+0000 7efeccff9700 1 -- 172.21.15.61:0/1391999386 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec80275f0 con 0x7efed015a510 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.202+0000 7efed7176700 1 -- 172.21.15.61:0/1391999386 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec8009a20 con 0x7efed015a510 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.202+0000 7efeccff9700 1 -- 172.21.15.61:0/1391999386 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80279b0 con 0x7efed015a510 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.202+0000 7efed7176700 1 -- 172.21.15.61:0/1391999386 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed00c3a80 con 0x7efed015a510 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.203+0000 7efed7176700 1 -- 172.21.15.61:0/1391999386 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed00c4240 con 0x7efed015a510 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.203+0000 7efeccff9700 1 -- 172.21.15.61:0/1391999386 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7efec8024070 con 0x7efed015a510 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.203+0000 7efeccff9700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efeb0066f30 0x7efeb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.203+0000 7efeccff9700 1 -- 172.21.15.61:0/1391999386 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efec8086f70 con 0x7efed015a510 2023-12-24T20:00:44.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.204+0000 7efed4f12700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efeb0066f30 0x7efeb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:44.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.204+0000 7efed4f12700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efeb0066f30 0x7efeb00693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efec0005e50 tx=0x7efec0007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:44.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.208+0000 7efeccff9700 1 -- 172.21.15.61:0/1391999386 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efec80b85a0 con 0x7efed015a510 2023-12-24T20:00:44.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:44.447+0000 7efed7176700 1 -- 172.21.15.61:0/1391999386 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efed004c3c0 con 0x7efed015a510 2023-12-24T20:00:45.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.045+0000 7efeccff9700 1 -- 172.21.15.61:0/1391999386 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7efec80541e0 con 0x7efed015a510 2023-12-24T20:00:45.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.047+0000 7efed7176700 1 -- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efeb0066f30 msgr2=0x7efeb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.047+0000 7efed7176700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efeb0066f30 0x7efeb00693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efec0005e50 tx=0x7efec0007ba0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.047+0000 7efed7176700 1 -- 172.21.15.61:0/1391999386 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efed015a510 msgr2=0x7efed006e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.047+0000 7efed7176700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efed015a510 0x7efed006e790 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7efed00c9860 tx=0x7efec8019000 comp rx=0 tx=0).stop 2023-12-24T20:00:45.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.048+0000 7efed7176700 1 -- 172.21.15.61:0/1391999386 shutdown_connections 2023-12-24T20:00:45.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.048+0000 7efed7176700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efeb0066f30 0x7efeb00693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.048+0000 7efed7176700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efed015a510 0x7efed006e790 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.048+0000 7efed7176700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed00ad6f0 0x7efed016e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.048+0000 7efed7176700 1 --2- 172.21.15.61:0/1391999386 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efed00adac0 0x7efed0170fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.048+0000 7efed7176700 1 -- 172.21.15.61:0/1391999386 >> 172.21.15.61:0/1391999386 conn(0x7efed0067550 msgr2=0x7efed00af9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:45.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.048+0000 7efed7176700 1 -- 172.21.15.61:0/1391999386 shutdown_connections 2023-12-24T20:00:45.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.048+0000 7efed7176700 1 -- 172.21.15.61:0/1391999386 wait complete. 2023-12-24T20:00:45.063 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:00:45.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.192+0000 7fbb7ece0700 1 Processor -- start 2023-12-24T20:00:45.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.192+0000 7fbb7ece0700 1 -- start start 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.193+0000 7fbb7ece0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbb78157730 0x7fbb780af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.193+0000 7fbb7ece0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb78158b70 con 0x7fbb78063ac0 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.193+0000 7fbb7ece0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb78158240 con 0x7fbb780c94b0 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.193+0000 7fbb7ece0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb78158520 con 0x7fbb78157730 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.193+0000 7fbb7ca7c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbb78157730 0x7fbb780af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.193+0000 7fbb77fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fbb78063ac0 0x7fbb780c8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57314/0 (socket says 172.21.15.61:57314) 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.193+0000 7fbb77fff700 1 -- 172.21.15.61:0/1981132308 learned_addr learned my addr 172.21.15.61:0/1981132308 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb7ca7c700 1 -- 172.21.15.61:0/1981132308 >> v1:172.21.15.133:6789/0 conn(0x7fbb780c94b0 legacy=0x7fbb78161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb7ca7c700 1 -- 172.21.15.61:0/1981132308 >> v1:172.21.15.61:6789/0 conn(0x7fbb78063ac0 legacy=0x7fbb780c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb7ca7c700 1 -- 172.21.15.61:0/1981132308 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb78158800 con 0x7fbb78157730 2023-12-24T20:00:45.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb777fe700 1 -- 172.21.15.61:0/1981132308 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021282336 0 0) 0x7fbb78158b70 con 0x7fbb78063ac0 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb7ca7c700 1 --2- 172.21.15.61:0/1981132308 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78157730 0x7fbb780af3f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0098e0 tx=0x7fbb6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bb2dd94693f17a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb777fe700 1 -- 172.21.15.61:0/1981132308 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c009e80 con 0x7fbb78157730 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb777fe700 1 -- 172.21.15.61:0/1981132308 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c00b820 con 0x7fbb78157730 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb777fe700 1 -- 172.21.15.61:0/1981132308 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c00bba0 con 0x7fbb78157730 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb7ece0700 1 -- 172.21.15.61:0/1981132308 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78157730 msgr2=0x7fbb780af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb7ece0700 1 --2- 172.21.15.61:0/1981132308 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78157730 0x7fbb780af3f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0098e0 tx=0x7fbb6c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb7ece0700 1 -- 172.21.15.61:0/1981132308 shutdown_connections 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb7ece0700 1 --2- 172.21.15.61:0/1981132308 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78157730 0x7fbb780af3f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.194+0000 7fbb7ece0700 1 -- 172.21.15.61:0/1981132308 >> 172.21.15.61:0/1981132308 conn(0x7fbb780cceb0 msgr2=0x7fbb780cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.195+0000 7fbb7ece0700 1 -- 172.21.15.61:0/1981132308 shutdown_connections 2023-12-24T20:00:45.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.195+0000 7fbb7ece0700 1 -- 172.21.15.61:0/1981132308 wait complete. 2023-12-24T20:00:45.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.196+0000 7fbb7ece0700 1 Processor -- start 2023-12-24T20:00:45.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.196+0000 7fbb7ece0700 1 -- start start 2023-12-24T20:00:45.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ece0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78063ac0 0x7fbb7816b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ece0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb780c94b0 0x7fbb78151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ece0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb78157730 0x7fbb7816d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ece0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb781533d0 con 0x7fbb78063ac0 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ece0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78152750 con 0x7fbb78157730 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ece0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78152aa0 con 0x7fbb780c94b0 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ca7c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78063ac0 0x7fbb7816b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ca7c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78063ac0 0x7fbb7816b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44746/0 (socket says 172.21.15.61:44746) 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ca7c700 1 -- 172.21.15.61:0/781035230 learned_addr learned my addr 172.21.15.61:0/781035230 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7d27d700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb78157730 0x7fbb7816d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb77fff700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb780c94b0 0x7fbb78151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ca7c700 1 -- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb780c94b0 msgr2=0x7fbb78151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ca7c700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb780c94b0 0x7fbb78151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ca7c700 1 -- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb78157730 msgr2=0x7fbb7816d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ca7c700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb78157730 0x7fbb7816d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ca7c700 1 -- 172.21.15.61:0/781035230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c009420 con 0x7fbb78063ac0 2023-12-24T20:00:45.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7d27d700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb78157730 0x7fbb7816d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:45.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ca7c700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78063ac0 0x7fbb7816b490 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0030c0 tx=0x7fbb6c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:45.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb74ff9700 1 -- 172.21.15.61:0/781035230 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c00ba10 con 0x7fbb78063ac0 2023-12-24T20:00:45.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb74ff9700 1 -- 172.21.15.61:0/781035230 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c020070 con 0x7fbb78063ac0 2023-12-24T20:00:45.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ece0700 1 -- 172.21.15.61:0/781035230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb78152d80 con 0x7fbb78063ac0 2023-12-24T20:00:45.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb74ff9700 1 -- 172.21.15.61:0/781035230 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c01b6a0 con 0x7fbb78063ac0 2023-12-24T20:00:45.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.197+0000 7fbb7ece0700 1 -- 172.21.15.61:0/781035230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb780b01f0 con 0x7fbb78063ac0 2023-12-24T20:00:45.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.198+0000 7fbb7ece0700 1 -- 172.21.15.61:0/781035230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7804c3c0 con 0x7fbb78063ac0 2023-12-24T20:00:45.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.199+0000 7fbb74ff9700 1 -- 172.21.15.61:0/781035230 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbb6c022030 con 0x7fbb78063ac0 2023-12-24T20:00:45.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.199+0000 7fbb74ff9700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb5c066f30 0x7fbb5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.199+0000 7fbb74ff9700 1 -- 172.21.15.61:0/781035230 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb6c0864b0 con 0x7fbb78063ac0 2023-12-24T20:00:45.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.199+0000 7fbb77fff700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb5c066f30 0x7fbb5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.200+0000 7fbb77fff700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb5c066f30 0x7fbb5c0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbb7816b440 tx=0x7fbb64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:45.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.203+0000 7fbb74ff9700 1 -- 172.21.15.61:0/781035230 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb6c053720 con 0x7fbb78063ac0 2023-12-24T20:00:45.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.449+0000 7fbb7ece0700 1 -- 172.21.15.61:0/781035230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb7804c3c0 con 0x7fbb78063ac0 2023-12-24T20:00:45.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.449+0000 7fbb74ff9700 1 -- 172.21.15.61:0/781035230 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fbb6c056d40 con 0x7fbb78063ac0 2023-12-24T20:00:45.450 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:45.450 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/3462396702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3462396702},{"type":"v1","addr":"172.21.15.61:6835","nonce":3462396702}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2539986874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2539986874},{"type":"v1","addr":"172.21.15.133:6836","nonce":2539986874}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":5611,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/118195153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":118195153},{"type":"v1","addr":"172.21.15.133:6837","nonce":118195153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:00:41.409889+0000","modified":"2023-12-24T20:00:45.042959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5994":{"gid":5994,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/761559894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":761559894},{"type":"v1","addr":"172.21.15.61:6834","nonce":761559894}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T20:00:45.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.451+0000 7fbb7ece0700 1 -- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb5c066f30 msgr2=0x7fbb5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.451+0000 7fbb7ece0700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb5c066f30 0x7fbb5c0693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbb7816b440 tx=0x7fbb64009040 comp rx=0 tx=0).stop 2023-12-24T20:00:45.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.451+0000 7fbb7ece0700 1 -- 172.21.15.61:0/781035230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78063ac0 msgr2=0x7fbb7816b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.451+0000 7fbb7ece0700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78063ac0 0x7fbb7816b490 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0030c0 tx=0x7fbb6c016000 comp rx=0 tx=0).stop 2023-12-24T20:00:45.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.451+0000 7fbb7ece0700 1 -- 172.21.15.61:0/781035230 shutdown_connections 2023-12-24T20:00:45.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.451+0000 7fbb7ece0700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbb5c066f30 0x7fbb5c0693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.451+0000 7fbb7ece0700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb78157730 0x7fbb7816d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.451+0000 7fbb7ece0700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbb78063ac0 0x7fbb7816b490 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.452+0000 7fbb7ece0700 1 --2- 172.21.15.61:0/781035230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbb780c94b0 0x7fbb78151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.452+0000 7fbb7ece0700 1 -- 172.21.15.61:0/781035230 >> 172.21.15.61:0/781035230 conn(0x7fbb780cceb0 msgr2=0x7fbb78159190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:45.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.452+0000 7fbb7ece0700 1 -- 172.21.15.61:0/781035230 shutdown_connections 2023-12-24T20:00:45.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.452+0000 7fbb7ece0700 1 -- 172.21.15.61:0/781035230 wait complete. 2023-12-24T20:00:45.453 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 44 2023-12-24T20:00:45.464 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:00:45.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.586+0000 7fdcfa554700 1 Processor -- start 2023-12-24T20:00:45.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.586+0000 7fdcfa554700 1 -- start start 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcfa554700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdcf4150cb0 0x7fdcf406ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcfa554700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcf406aa70 0x7fdcf406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcfa554700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf406f440 con 0x7fdcf4151080 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcfa554700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf4064000 con 0x7fdcf4150cb0 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcfa554700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf41573b0 con 0x7fdcf406aa70 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcf3fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdcf4150cb0 0x7fdcf406ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcf37fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fdcf4151080 0x7fdcf406a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57324/0 (socket says 172.21.15.61:57324) 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcf37fe700 1 -- 172.21.15.61:0/3439417288 learned_addr learned my addr 172.21.15.61:0/3439417288 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcf8af1700 1 --2- 172.21.15.61:0/3439417288 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcf406aa70 0x7fdcf406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcf3fff700 1 -- 172.21.15.61:0/3439417288 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcf406aa70 msgr2=0x7fdcf406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcf3fff700 1 --2- 172.21.15.61:0/3439417288 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcf406aa70 0x7fdcf406db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcf3fff700 1 -- 172.21.15.61:0/3439417288 >> v1:172.21.15.61:6789/0 conn(0x7fdcf4151080 legacy=0x7fdcf406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcf3fff700 1 -- 172.21.15.61:0/3439417288 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4157690 con 0x7fdcf4150cb0 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcf2ffd700 1 -- 172.21.15.61:0/3439417288 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736135469 0 0) 0x7fdce4001110 con 0x7fdcf4151080 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.587+0000 7fdcf3fff700 1 --2- 172.21.15.61:0/3439417288 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4150cb0 0x7fdcf406ef00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0098e0 tx=0x7fdcdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352456ed74fd62f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcf2ffd700 1 -- 172.21.15.61:0/3439417288 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc009e80 con 0x7fdcf4150cb0 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcf2ffd700 1 -- 172.21.15.61:0/3439417288 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc00b860 con 0x7fdcf4150cb0 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcf2ffd700 1 -- 172.21.15.61:0/3439417288 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00bbe0 con 0x7fdcf4150cb0 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcfa554700 1 -- 172.21.15.61:0/3439417288 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4150cb0 msgr2=0x7fdcf406ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcfa554700 1 --2- 172.21.15.61:0/3439417288 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4150cb0 0x7fdcf406ef00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0098e0 tx=0x7fdcdc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcfa554700 1 -- 172.21.15.61:0/3439417288 shutdown_connections 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcfa554700 1 --2- 172.21.15.61:0/3439417288 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcf406aa70 0x7fdcf406db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcfa554700 1 --2- 172.21.15.61:0/3439417288 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4150cb0 0x7fdcf406ef00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcfa554700 1 -- 172.21.15.61:0/3439417288 >> 172.21.15.61:0/3439417288 conn(0x7fdcf40cceb0 msgr2=0x7fdcf40cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcfa554700 1 -- 172.21.15.61:0/3439417288 shutdown_connections 2023-12-24T20:00:45.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.588+0000 7fdcfa554700 1 -- 172.21.15.61:0/3439417288 wait complete. 2023-12-24T20:00:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.589+0000 7fdcfa554700 1 Processor -- start 2023-12-24T20:00:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.590+0000 7fdcfa554700 1 -- start start 2023-12-24T20:00:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.590+0000 7fdcfa554700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcf406aa70 0x7fdcf4158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.590+0000 7fdcfa554700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcf4150cb0 0x7fdcf415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.590+0000 7fdcfa554700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4151080 0x7fdcf415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.590+0000 7fdcfa554700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf414cfa0 con 0x7fdcf4151080 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.590+0000 7fdcfa554700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf41462c0 con 0x7fdcf406aa70 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.590+0000 7fdcfa554700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4152d40 con 0x7fdcf4150cb0 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.590+0000 7fdcf8af1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4151080 0x7fdcf415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.590+0000 7fdcf8af1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4151080 0x7fdcf415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44752/0 (socket says 172.21.15.61:44752) 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.590+0000 7fdcf8af1700 1 -- 172.21.15.61:0/3807853877 learned_addr learned my addr 172.21.15.61:0/3807853877 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcf3fff700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcf406aa70 0x7fdcf4158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcf37fe700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcf4150cb0 0x7fdcf415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcf8af1700 1 -- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcf4150cb0 msgr2=0x7fdcf415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcf8af1700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcf4150cb0 0x7fdcf415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcf8af1700 1 -- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcf406aa70 msgr2=0x7fdcf4158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcf8af1700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcf406aa70 0x7fdcf4158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcf8af1700 1 -- 172.21.15.61:0/3807853877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc009420 con 0x7fdcf4151080 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcf3fff700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcf406aa70 0x7fdcf4158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcf8af1700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4151080 0x7fdcf415c680 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdcec007ed0 tx=0x7fdcec009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcebfff700 1 -- 172.21.15.61:0/3807853877 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec00eca0 con 0x7fdcf4151080 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcebfff700 1 -- 172.21.15.61:0/3807853877 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec00ee20 con 0x7fdcf4151080 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcebfff700 1 -- 172.21.15.61:0/3807853877 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec014670 con 0x7fdcf4151080 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcfa554700 1 -- 172.21.15.61:0/3807853877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf4158c90 con 0x7fdcf4151080 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.591+0000 7fdcfa554700 1 -- 172.21.15.61:0/3807853877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf4152410 con 0x7fdcf4151080 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.592+0000 7fdcfa554700 1 -- 172.21.15.61:0/3807853877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf4153020 con 0x7fdcf4151080 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.592+0000 7fdcebfff700 1 -- 172.21.15.61:0/3807853877 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdcec014a60 con 0x7fdcf4151080 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.593+0000 7fdcebfff700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcd4066f30 0x7fdcd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.593+0000 7fdcebfff700 1 -- 172.21.15.61:0/3807853877 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdcec084bf0 con 0x7fdcf4151080 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.593+0000 7fdcf3fff700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcd4066f30 0x7fdcd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.594+0000 7fdcf3fff700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcd4066f30 0x7fdcd40693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc003080 tx=0x7fdcdc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:45.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.597+0000 7fdcebfff700 1 -- 172.21.15.61:0/3807853877 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcec051e60 con 0x7fdcf4151080 2023-12-24T20:00:45.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.793+0000 7fdcfa554700 1 -- 172.21.15.61:0/3807853877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcf404c3c0 con 0x7fdcf4151080 2023-12-24T20:00:45.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.793+0000 7fdcebfff700 1 -- 172.21.15.61:0/3807853877 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+15353 (secure 0 0 0) 0x7fdcec055480 con 0x7fdcf4151080 2023-12-24T20:00:45.794 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:45.794 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":80,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:00:43.006704+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:00:39.818793+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-24T20:00:40.387692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:00:45.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 -- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcd4066f30 msgr2=0x7fdcd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcd4066f30 0x7fdcd40693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc003080 tx=0x7fdcdc017000 comp rx=0 tx=0).stop 2023-12-24T20:00:45.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 -- 172.21.15.61:0/3807853877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4151080 msgr2=0x7fdcf415c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4151080 0x7fdcf415c680 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdcec007ed0 tx=0x7fdcec009880 comp rx=0 tx=0).stop 2023-12-24T20:00:45.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 -- 172.21.15.61:0/3807853877 shutdown_connections 2023-12-24T20:00:45.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcd4066f30 0x7fdcd40693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdcf4151080 0x7fdcf415c680 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcf406aa70 0x7fdcf4158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 --2- 172.21.15.61:0/3807853877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdcf4150cb0 0x7fdcf415a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 -- 172.21.15.61:0/3807853877 >> 172.21.15.61:0/3807853877 conn(0x7fdcf40cceb0 msgr2=0x7fdcf40caa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:45.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 -- 172.21.15.61:0/3807853877 shutdown_connections 2023-12-24T20:00:45.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.796+0000 7fdcfa554700 1 -- 172.21.15.61:0/3807853877 wait complete. 2023-12-24T20:00:45.809 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T20:00:45.809 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:00:45.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.931+0000 7f77e1a4d700 1 Processor -- start 2023-12-24T20:00:45.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.931+0000 7f77e1a4d700 1 -- start start 2023-12-24T20:00:45.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77e1a4d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc159c10 0x7f77dc0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77e1a4d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77dc159fe0 0x7f77dc0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77e1a4d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77dc0af880 con 0x7f77dc0cba80 2023-12-24T20:00:45.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77e1a4d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77dc0c6fc0 con 0x7f77dc159fe0 2023-12-24T20:00:45.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77e1a4d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0c63b0 con 0x7f77dc159c10 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77db7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f77dc0cba80 0x7f77dc0cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57340/0 (socket says 172.21.15.61:57340) 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77db7fe700 1 -- 172.21.15.61:0/3625147766 learned_addr learned my addr 172.21.15.61:0/3625147766 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77daffd700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc159c10 0x7f77dc0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77da7fc700 1 --2- 172.21.15.61:0/3625147766 >> v2:172.21.15.133:3300/0 conn(0x7f77dc159fe0 0x7f77dc0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339719683 0 0) 0x7f77dc0af880 con 0x7f77dc0cba80 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77c4003570 con 0x7f77dc0cba80 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 202483987 0 0) 0x7f77c4003570 con 0x7f77dc0cba80 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc159c10 msgr2=0x7f77dc0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77d9ffb700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc159c10 0x7f77dc0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 >> v2:172.21.15.133:3300/0 conn(0x7f77dc159fe0 msgr2=0x7f77dc0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77d9ffb700 1 --2- 172.21.15.61:0/3625147766 >> v2:172.21.15.133:3300/0 conn(0x7f77dc159fe0 0x7f77dc0c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc0c6690 con 0x7f77dc0cba80 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.932+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f77d40017f0 con 0x7f77dc0cba80 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 >> v1:172.21.15.61:6789/0 conn(0x7f77dc0cba80 legacy=0x7f77dc0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77d9ffb700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77c4003a60 0x7f77c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77d9ffb700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc159c10 0x7f77c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77d9ffb700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77c4004d50 0x7f77c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0c6fc0 con 0x7f77c4004d50 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0c63b0 con 0x7f77c4003a60 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c400ba60 con 0x7f77dc159c10 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77da7fc700 1 --2- 172.21.15.61:0/3625147766 >> v2:172.21.15.133:3300/0 conn(0x7f77dc159fe0 0x7f77dc0c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77db7fe700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77c4004d50 0x7f77c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77daffd700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77c4003a60 0x7f77c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77da7fc700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc159c10 0x7f77c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77db7fe700 1 -- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc159c10 msgr2=0x7f77c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77db7fe700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc159c10 0x7f77c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77db7fe700 1 -- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77c4003a60 msgr2=0x7f77c4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77db7fe700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77c4003a60 0x7f77c4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77db7fe700 1 -- 172.21.15.61:0/3625147766 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4003570 con 0x7f77c4004d50 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77daffd700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77c4003a60 0x7f77c4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77db7fe700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77c4004d50 0x7f77c40051c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f77d400a970 tx=0x7f77dc0cca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1406a80932243d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40070d0 con 0x7f77c4004d50 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d4007230 con 0x7f77c4004d50 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.933+0000 7f77d9ffb700 1 -- 172.21.15.61:0/3625147766 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40075f0 con 0x7f77c4004d50 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.934+0000 7f77e1a4d700 1 -- 172.21.15.61:0/3625147766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77c4004d50 msgr2=0x7f77c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.934+0000 7f77e1a4d700 1 --2- 172.21.15.61:0/3625147766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77c4004d50 0x7f77c40051c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f77d400a970 tx=0x7f77dc0cca20 comp rx=0 tx=0).stop 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.934+0000 7f77db7fe700 1 -- 172.21.15.61:0/3625147766 reap_dead start 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.934+0000 7f77e1a4d700 1 -- 172.21.15.61:0/3625147766 shutdown_connections 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.934+0000 7f77e1a4d700 1 -- 172.21.15.61:0/3625147766 >> 172.21.15.61:0/3625147766 conn(0x7f77dc06e640 msgr2=0x7f77dc067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.934+0000 7f77e1a4d700 1 -- 172.21.15.61:0/3625147766 shutdown_connections 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.934+0000 7f77e1a4d700 1 -- 172.21.15.61:0/3625147766 wait complete. 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.935+0000 7f77e1a4d700 1 Processor -- start 2023-12-24T20:00:45.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.935+0000 7f77e1a4d700 1 -- start start 2023-12-24T20:00:45.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77e1a4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77c4004d50 0x7f77dc0b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77e1a4d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc14d600 0x7f77dc14ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77e1a4d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77dc0ccfe0 0x7f77dc0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77e1a4d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0cd9c0 con 0x7f77dc0ccfe0 2023-12-24T20:00:45.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77e1a4d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0c84b0 con 0x7f77c4004d50 2023-12-24T20:00:45.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77e1a4d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc14d3d0 con 0x7f77dc14d600 2023-12-24T20:00:45.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77db7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77dc0ccfe0 0x7f77dc0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77db7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77dc0ccfe0 0x7f77dc0cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44770/0 (socket says 172.21.15.61:44770) 2023-12-24T20:00:45.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77db7fe700 1 -- 172.21.15.61:0/953048241 learned_addr learned my addr 172.21.15.61:0/953048241 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:45.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77daffd700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77c4004d50 0x7f77dc0b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77da7fc700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc14d600 0x7f77dc14ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77db7fe700 1 -- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc14d600 msgr2=0x7f77dc14ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77db7fe700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc14d600 0x7f77dc14ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77db7fe700 1 -- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77c4004d50 msgr2=0x7f77dc0b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77db7fe700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77c4004d50 0x7f77dc0b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77db7fe700 1 -- 172.21.15.61:0/953048241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc0c7b80 con 0x7f77dc0ccfe0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.936+0000 7f77db7fe700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77dc0ccfe0 0x7f77dc0cd480 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f77d4012000 tx=0x7f77d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.937+0000 7f77c2ffd700 1 -- 172.21.15.61:0/953048241 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40070d0 con 0x7f77dc0ccfe0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.937+0000 7f77c2ffd700 1 -- 172.21.15.61:0/953048241 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d4022070 con 0x7f77dc0ccfe0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.937+0000 7f77c2ffd700 1 -- 172.21.15.61:0/953048241 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40017b0 con 0x7f77dc0ccfe0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.937+0000 7f77e1a4d700 1 -- 172.21.15.61:0/953048241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc0c7e60 con 0x7f77dc0ccfe0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.937+0000 7f77e1a4d700 1 -- 172.21.15.61:0/953048241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77dc0b5ce0 con 0x7f77dc0ccfe0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.938+0000 7f77e1a4d700 1 -- 172.21.15.61:0/953048241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77dc0890b0 con 0x7f77dc0ccfe0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.938+0000 7f77c2ffd700 1 -- 172.21.15.61:0/953048241 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f77d40073a0 con 0x7f77dc0ccfe0 2023-12-24T20:00:45.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.939+0000 7f77c2ffd700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f77c8066f30 0x7f77c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:45.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.939+0000 7f77c2ffd700 1 -- 172.21.15.61:0/953048241 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77d4086730 con 0x7f77dc0ccfe0 2023-12-24T20:00:45.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.939+0000 7f77daffd700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f77c8066f30 0x7f77c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:45.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.939+0000 7f77daffd700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f77c8066f30 0x7f77c80693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009db0 tx=0x7f77cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:45.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:45.943+0000 7f77c2ffd700 1 -- 172.21.15.61:0/953048241 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77d40539a0 con 0x7f77dc0ccfe0 2023-12-24T20:00:46.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.135+0000 7f77e1a4d700 1 -- 172.21.15.61:0/953048241 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77dc04c3c0 con 0x7f77c8066f30 2023-12-24T20:00:46.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.143+0000 7f77c2ffd700 1 -- 172.21.15.61:0/953048241 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276028 (secure 0 0 0) 0x7f77dc04c3c0 con 0x7f77c8066f30 2023-12-24T20:00:46.147 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 -- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f77c8066f30 msgr2=0x7f77c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f77c8066f30 0x7f77c80693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009db0 tx=0x7f77cc008040 comp rx=0 tx=0).stop 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 -- 172.21.15.61:0/953048241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77dc0ccfe0 msgr2=0x7f77dc0cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77dc0ccfe0 0x7f77dc0cd480 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f77d4012000 tx=0x7f77d4016000 comp rx=0 tx=0).stop 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 -- 172.21.15.61:0/953048241 shutdown_connections 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f77c8066f30 0x7f77c80693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77dc0ccfe0 0x7f77dc0cd480 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77c4004d50 0x7f77dc0b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 --2- 172.21.15.61:0/953048241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77dc14d600 0x7f77dc14ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 -- 172.21.15.61:0/953048241 >> 172.21.15.61:0/953048241 conn(0x7f77dc06e640 msgr2=0x7f77dc0c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 -- 172.21.15.61:0/953048241 shutdown_connections 2023-12-24T20:00:46.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.147+0000 7f77e1a4d700 1 -- 172.21.15.61:0/953048241 wait complete. 2023-12-24T20:00:46.151 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:00:46.159 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2023-12-24T20:00:44.360449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4264,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558235,"statfs":{"total":1600000000,"available":1595633486,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.359091"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.004109+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:02:25.202330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.005025+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:40.468656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.005443+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:14.946563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.004757+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:40.771010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002183+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:10:51.590402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.004178+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:18:41.337759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.003297+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:40.670495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.003628+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:32:57.661734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.005489+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:06:36.477600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.003026+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:58.855843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002110+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:35.950925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002916+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:58.855843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002866+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:29:02.519053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002944+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:29:02.519053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.003206+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:06:36.477600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.004766+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:14.521713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.003168+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:40.670495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.005027+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:02:25.202330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002224+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:14:55.509580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.004357+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:14.946563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002746+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:08:14.393645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.003808+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:14.521713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.004691+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:48:18.863502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002498+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:43:06.389278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.003584+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:29.082982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.003679+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:02:59.725270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.004295+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:58:48.581705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.003642+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:22:53.840014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002844+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:08:14.393645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.004315+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:29.082982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002383+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:32:28.037607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-24T20:00:41.000351+0000","last_change":"2023-12-24T20:00:41.000351+0000","last_active":"2023-12-24T20:00:41.000351+0000","last_peered":"2023-12-24T20:00:41.000351+0000","last_clean":"2023-12-24T20:00:41.000351+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:41.000351+0000","last_undegraded":"2023-12-24T20:00:41.000351+0000","last_fullsized":"2023-12-24T20:00:41.000351+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:00:39.998432+0000","last_change":"2023-12-24T20:00:40.002331+0000","last_active":"2023-12-24T20:00:39.998432+0000","last_peered":"2023-12-24T20:00:39.998432+0000","last_clean":"2023-12-24T20:00:39.998432+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:00:39.998432+0000","last_undegraded":"2023-12-24T20:00:39.998432+0000","last_fullsized":"2023-12-24T20:00:39.998432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:57:55.562522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-12-24T20:00:38.233616+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:00:38.233616+0000","last_peered":"2023-12-24T20:00:38.233616+0000","last_clean":"2023-12-24T20:00:38.233616+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:00:38.233616+0000","last_undegraded":"2023-12-24T20:00:38.233616+0000","last_fullsized":"2023-12-24T20:00:38.233616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":964,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194348,"statfs":{"total":200000000,"available":199012861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.505,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.66700000000000004,"5min":0.754,"15min":0.754},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.433,"5min":0.314,"15min":0.314},"max":{"1min":0.70899999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.433,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.496}]},{"osd":2,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70099999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.748,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72299999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.628},"min":{"1min":0.48699999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.79800000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53800000000000003}]},{"osd":4,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81899999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.64200000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.752},"last":0.627}]},{"osd":6,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.623,"15min":0.628},"min":{"1min":0.497,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":0.873,"15min":0.873},"last":0.68100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194925,"statfs":{"total":200000000,"available":199603229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53700000000000003,"15min":0.51300000000000001},"min":{"1min":0.42599999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.46600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72399999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.40100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.435},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80900000000000005,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.077,"15min":1.077},"last":0.622},{"interface":"front","average":{"1min":0.627,"5min":0.58599999999999997,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.80100000000000005,"5min":1.048,"15min":1.048},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.745,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.41999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.76000000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.503,"15min":0.498},"min":{"1min":0.374,"5min":0.254,"15min":0.254},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.40400000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78700000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83199999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194925,"statfs":{"total":200000000,"available":199603229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.23499999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61299999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.34699999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.37,"15min":0.36399999999999999},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.58599999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.36899999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.39400000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.57799999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.39400000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.47699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73899999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.50700000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.77800000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.78700000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.46100000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82499999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.53700000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84599999999999997,"5min":0.878,"15min":0.878},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.60499999999999998},"min":{"1min":0.432,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86299999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82299999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.72699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":969,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194342,"statfs":{"total":200000000,"available":199007056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.40500000000000003,"15min":0.44},"min":{"1min":0.254,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.54600000000000004,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35699999999999998,"15min":0.36399999999999999},"min":{"1min":0.25600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.52800000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.248}]},{"osd":2,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35599999999999998,"15min":0.36499999999999999},"min":{"1min":0.24099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56999999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45200000000000001,"15min":0.47199999999999998},"min":{"1min":0.27900000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78900000000000003,"5min":2.573,"15min":2.573},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33700000000000002}]},{"osd":4,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.60099999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.996,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.42999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.871,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.52100000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.372,"15min":0.372},"max":{"1min":0.94799999999999995,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.50900000000000001}]},{"osd":6,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":1.655,"15min":1.655},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.036,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0660000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70999999999999996,"15min":0.74199999999999999},"min":{"1min":0.47999999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88500000000000001,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.46899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":393,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194919,"statfs":{"total":200000000,"available":199597424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.373,"15min":0.375},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.64500000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.35999999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.23899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.254},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.27600000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60099999999999998,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.32000000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.30499999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.37},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.33700000000000002}]},{"osd":4,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.754,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.45800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60299999999999998}]},{"osd":5,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64700000000000002,"15min":0.623},"min":{"1min":0.47099999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.83399999999999996,"5min":3.577,"15min":3.577},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.68799999999999994,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84799999999999998,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.52400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.04},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.501,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94999999999999996,"5min":3.637,"15min":3.637},"last":0.67200000000000004}]},{"osd":7,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.65800000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88500000000000001,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96699999999999997,"5min":1.331,"15min":1.331},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194925,"statfs":{"total":200000000,"available":199603229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32000000000000001},"min":{"1min":0.22500000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.502},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23599999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58199999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33900000000000002}]},{"osd":1,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34799999999999998,"15min":0.34200000000000003},"min":{"1min":0.246,"5min":0.223,"15min":0.223},"max":{"1min":0.52600000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.38100000000000001,"15min":0.379},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.46000000000000002}]},{"osd":2,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.60799999999999998,"5min":0.626,"15min":0.626},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63200000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.35899999999999999}]},{"osd":4,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.375,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88700000000000001,"5min":1.337,"15min":1.337},"last":0.52700000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.625,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60699999999999998}]},{"osd":6,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.96899999999999997,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.55000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194925,"statfs":{"total":200000000,"available":199603229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.37},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47599999999999998}]},{"osd":1,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.70099999999999996,"15min":0.755},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":4.883,"15min":4.883},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58299999999999996,"15min":0.60099999999999998},"min":{"1min":0.439,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73199999999999998,"5min":1.544,"15min":1.544},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75900000000000001,"5min":0.88,"15min":0.88},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76600000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.48299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.83799999999999997,"15min":0.95199999999999996},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.74299999999999999,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.51800000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51700000000000002,"15min":0.53500000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79600000000000004,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.498},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.621,"15min":0.67100000000000004},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.76400000000000001,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53300000000000003,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.628,"15min":0.64800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88700000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.60599999999999998}]},{"osd":7,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.97899999999999998,"15min":1.1679999999999999},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86499999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.627},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.39200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194925,"statfs":{"total":200000000,"available":199603229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.375,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66300000000000003,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":1.847,"15min":1.847},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.45900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68600000000000005,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.57599999999999996}]},{"osd":2,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.51500000000000001},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.497},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.752,"5min":1.97,"15min":1.97},"last":0.45500000000000002}]},{"osd":3,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.56299999999999994},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.71099999999999997,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76300000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.746,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72399999999999998,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77200000000000002,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56899999999999995,"15min":0.55100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75800000000000001,"5min":3.766,"15min":3.766},"last":0.623},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73999999999999999}]}]}],"pool_statfs":[]}} 2023-12-24T20:00:46.165 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:00:46.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.322+0000 7f53f4aa7700 1 Processor -- start 2023-12-24T20:00:46.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.322+0000 7f53f4aa7700 1 -- start start 2023-12-24T20:00:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53f4aa7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f53f00afee0 0x7f53f0067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53f4aa7700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f00a84d0 con 0x7f53f0159b00 2023-12-24T20:00:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53f4aa7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f00a7620 con 0x7f53f0070640 2023-12-24T20:00:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53f4aa7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f00a78c0 con 0x7f53f00afee0 2023-12-24T20:00:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53edd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f53f00afee0 0x7f53f0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53ee59c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f53f0159b00 0x7f53f00af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:57350/0 (socket says 172.21.15.61:57350) 2023-12-24T20:00:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53ee59c700 1 -- 172.21.15.61:0/3949932225 learned_addr learned my addr 172.21.15.61:0/3949932225 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53edd9b700 1 -- 172.21.15.61:0/3949932225 >> v1:172.21.15.133:6789/0 conn(0x7f53f0070640 legacy=0x7f53f015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53edd9b700 1 -- 172.21.15.61:0/3949932225 >> v1:172.21.15.61:6789/0 conn(0x7f53f0159b00 legacy=0x7f53f00af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53edd9b700 1 -- 172.21.15.61:0/3949932225 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f00a7ba0 con 0x7f53f00afee0 2023-12-24T20:00:46.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53ed59a700 1 -- 172.21.15.61:0/3949932225 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6061154 0 0) 0x7f53f00a84d0 con 0x7f53f0159b00 2023-12-24T20:00:46.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.323+0000 7f53edd9b700 1 --2- 172.21.15.61:0/3949932225 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f00afee0 0x7f53f0067550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f53e00098e0 tx=0x7f53e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb37e18656cd1ed server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:46.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.324+0000 7f53ed59a700 1 -- 172.21.15.61:0/3949932225 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e0009e80 con 0x7f53f00afee0 2023-12-24T20:00:46.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.324+0000 7f53ed59a700 1 -- 172.21.15.61:0/3949932225 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e000b860 con 0x7f53f00afee0 2023-12-24T20:00:46.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.324+0000 7f53ed59a700 1 -- 172.21.15.61:0/3949932225 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e000bbe0 con 0x7f53f00afee0 2023-12-24T20:00:46.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.324+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3949932225 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f00afee0 msgr2=0x7f53f0067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.324+0000 7f53f4aa7700 1 --2- 172.21.15.61:0/3949932225 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f00afee0 0x7f53f0067550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f53e00098e0 tx=0x7f53e00091a0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.324+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3949932225 shutdown_connections 2023-12-24T20:00:46.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.324+0000 7f53f4aa7700 1 --2- 172.21.15.61:0/3949932225 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f00afee0 0x7f53f0067550 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.324+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3949932225 >> 172.21.15.61:0/3949932225 conn(0x7f53f00ca200 msgr2=0x7f53f00ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:46.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.324+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3949932225 shutdown_connections 2023-12-24T20:00:46.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.324+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3949932225 wait complete. 2023-12-24T20:00:46.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.325+0000 7f53f4aa7700 1 Processor -- start 2023-12-24T20:00:46.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.325+0000 7f53f4aa7700 1 -- start start 2023-12-24T20:00:46.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53f4aa7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 0x7f53f0068050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53f4aa7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53f00afee0 0x7f53f015d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53f4aa7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53f0159b00 0x7f53f0144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53f4aa7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f015ece0 con 0x7f53f0070640 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53f4aa7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f015e0d0 con 0x7f53f0159b00 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53f4aa7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f015e3b0 con 0x7f53f00afee0 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53ee59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 0x7f53f0068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53ee59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 0x7f53f0068050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:44786/0 (socket says 172.21.15.61:44786) 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53ee59c700 1 -- 172.21.15.61:0/3070867958 learned_addr learned my addr 172.21.15.61:0/3070867958 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53edd9b700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53f00afee0 0x7f53f015d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.326+0000 7f53eed9d700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53f0159b00 0x7f53f0144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53ee59c700 1 -- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53f00afee0 msgr2=0x7f53f015d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53ee59c700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53f00afee0 0x7f53f015d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53ee59c700 1 -- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53f0159b00 msgr2=0x7f53f0144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53ee59c700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53f0159b00 0x7f53f0144f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53ee59c700 1 -- 172.21.15.61:0/3070867958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e0009420 con 0x7f53f0070640 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53ee59c700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 0x7f53f0068050 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f53d800c560 tx=0x7f53d8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:46.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53e67fc700 1 -- 172.21.15.61:0/3070867958 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8005b30 con 0x7f53f0070640 2023-12-24T20:00:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53e67fc700 1 -- 172.21.15.61:0/3070867958 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d8005c90 con 0x7f53f0070640 2023-12-24T20:00:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3070867958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f015e690 con 0x7f53f0070640 2023-12-24T20:00:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53e67fc700 1 -- 172.21.15.61:0/3070867958 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8007320 con 0x7f53f0070640 2023-12-24T20:00:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.327+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3070867958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f00cd3a0 con 0x7f53f0070640 2023-12-24T20:00:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.328+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3070867958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f004c3c0 con 0x7f53f0070640 2023-12-24T20:00:46.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.328+0000 7f53e67fc700 1 -- 172.21.15.61:0/3070867958 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f53d801b3b0 con 0x7f53f0070640 2023-12-24T20:00:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.329+0000 7f53e67fc700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d0066f30 0x7f53d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.329+0000 7f53e67fc700 1 -- 172.21.15.61:0/3070867958 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f53d8083b80 con 0x7f53f0070640 2023-12-24T20:00:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.329+0000 7f53edd9b700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d0066f30 0x7f53d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.329+0000 7f53edd9b700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d0066f30 0x7f53d00693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f53e00098e0 tx=0x7f53e0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:46.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.333+0000 7f53e67fc700 1 -- 172.21.15.61:0/3070867958 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53d8050d50 con 0x7f53f0070640 2023-12-24T20:00:46.523 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.523+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3070867958 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53f015ee20 con 0x7f53d0066f30 2023-12-24T20:00:46.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.531+0000 7f53e67fc700 1 -- 172.21.15.61:0/3070867958 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284843 (secure 0 0 0) 0x7f53e0002f70 con 0x7f53d0066f30 2023-12-24T20:00:46.535 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:46.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d0066f30 msgr2=0x7f53d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d0066f30 0x7f53d00693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f53e00098e0 tx=0x7f53e0017000 comp rx=0 tx=0).stop 2023-12-24T20:00:46.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3070867958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 msgr2=0x7f53f0068050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 0x7f53f0068050 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f53d800c560 tx=0x7f53d8000fe0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3070867958 shutdown_connections 2023-12-24T20:00:46.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d0066f30 0x7f53d00693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53f0159b00 0x7f53f0144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 0x7f53f0068050 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 --2- 172.21.15.61:0/3070867958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53f00afee0 0x7f53f015d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3070867958 >> 172.21.15.61:0/3070867958 conn(0x7f53f00ca200 msgr2=0x7f53f015f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:46.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3070867958 shutdown_connections 2023-12-24T20:00:46.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.534+0000 7f53f4aa7700 1 -- 172.21.15.61:0/3070867958 wait complete. 2023-12-24T20:00:46.538 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:00:46.547 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2023-12-24T20:00:46.360942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4447,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558052,"statfs":{"total":1600000000,"available":1595445820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001431"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.016685+0000","last_change":"2023-12-24T20:00:42.016378+0000","last_active":"2023-12-24T20:00:42.016685+0000","last_peered":"2023-12-24T20:00:42.016685+0000","last_clean":"2023-12-24T20:00:42.016685+0000","last_became_active":"2023-12-24T20:00:42.015828+0000","last_became_peered":"2023-12-24T20:00:42.015828+0000","last_unstale":"2023-12-24T20:00:42.016685+0000","last_undegraded":"2023-12-24T20:00:42.016685+0000","last_fullsized":"2023-12-24T20:00:42.016685+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:06.997269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.021136+0000","last_change":"2023-12-24T20:00:42.021075+0000","last_active":"2023-12-24T20:00:42.021136+0000","last_peered":"2023-12-24T20:00:42.021136+0000","last_clean":"2023-12-24T20:00:42.021136+0000","last_became_active":"2023-12-24T20:00:42.020835+0000","last_became_peered":"2023-12-24T20:00:42.020835+0000","last_unstale":"2023-12-24T20:00:42.021136+0000","last_undegraded":"2023-12-24T20:00:42.021136+0000","last_fullsized":"2023-12-24T20:00:42.021136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:21:41.914459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.021689+0000","last_change":"2023-12-24T20:00:42.020711+0000","last_active":"2023-12-24T20:00:42.021689+0000","last_peered":"2023-12-24T20:00:42.021689+0000","last_clean":"2023-12-24T20:00:42.021689+0000","last_became_active":"2023-12-24T20:00:42.017530+0000","last_became_peered":"2023-12-24T20:00:42.017530+0000","last_unstale":"2023-12-24T20:00:42.021689+0000","last_undegraded":"2023-12-24T20:00:42.021689+0000","last_fullsized":"2023-12-24T20:00:42.021689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:34:09.108574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.027162+0000","last_change":"2023-12-24T20:00:42.026647+0000","last_active":"2023-12-24T20:00:42.027162+0000","last_peered":"2023-12-24T20:00:42.027162+0000","last_clean":"2023-12-24T20:00:42.027162+0000","last_became_active":"2023-12-24T20:00:42.026245+0000","last_became_peered":"2023-12-24T20:00:42.026245+0000","last_unstale":"2023-12-24T20:00:42.027162+0000","last_undegraded":"2023-12-24T20:00:42.027162+0000","last_fullsized":"2023-12-24T20:00:42.027162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:21:52.414184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.019992+0000","last_change":"2023-12-24T20:00:42.019939+0000","last_active":"2023-12-24T20:00:42.019992+0000","last_peered":"2023-12-24T20:00:42.019992+0000","last_clean":"2023-12-24T20:00:42.019992+0000","last_became_active":"2023-12-24T20:00:42.019788+0000","last_became_peered":"2023-12-24T20:00:42.019788+0000","last_unstale":"2023-12-24T20:00:42.019992+0000","last_undegraded":"2023-12-24T20:00:42.019992+0000","last_fullsized":"2023-12-24T20:00:42.019992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:15:59.857762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.023369+0000","last_change":"2023-12-24T20:00:42.022681+0000","last_active":"2023-12-24T20:00:42.023369+0000","last_peered":"2023-12-24T20:00:42.023369+0000","last_clean":"2023-12-24T20:00:42.023369+0000","last_became_active":"2023-12-24T20:00:42.021267+0000","last_became_peered":"2023-12-24T20:00:42.021267+0000","last_unstale":"2023-12-24T20:00:42.023369+0000","last_undegraded":"2023-12-24T20:00:42.023369+0000","last_fullsized":"2023-12-24T20:00:42.023369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:30:31.512552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.020011+0000","last_change":"2023-12-24T20:00:42.019937+0000","last_active":"2023-12-24T20:00:42.020011+0000","last_peered":"2023-12-24T20:00:42.020011+0000","last_clean":"2023-12-24T20:00:42.020011+0000","last_became_active":"2023-12-24T20:00:42.019694+0000","last_became_peered":"2023-12-24T20:00:42.019694+0000","last_unstale":"2023-12-24T20:00:42.020011+0000","last_undegraded":"2023-12-24T20:00:42.020011+0000","last_fullsized":"2023-12-24T20:00:42.020011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:46:40.073132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.019383+0000","last_change":"2023-12-24T20:00:42.019315+0000","last_active":"2023-12-24T20:00:42.019383+0000","last_peered":"2023-12-24T20:00:42.019383+0000","last_clean":"2023-12-24T20:00:42.019383+0000","last_became_active":"2023-12-24T20:00:42.018906+0000","last_became_peered":"2023-12-24T20:00:42.018906+0000","last_unstale":"2023-12-24T20:00:42.019383+0000","last_undegraded":"2023-12-24T20:00:42.019383+0000","last_fullsized":"2023-12-24T20:00:42.019383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:29.953654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018264+0000","last_change":"2023-12-24T20:00:42.018187+0000","last_active":"2023-12-24T20:00:42.018264+0000","last_peered":"2023-12-24T20:00:42.018264+0000","last_clean":"2023-12-24T20:00:42.018264+0000","last_became_active":"2023-12-24T20:00:42.017965+0000","last_became_peered":"2023-12-24T20:00:42.017965+0000","last_unstale":"2023-12-24T20:00:42.018264+0000","last_undegraded":"2023-12-24T20:00:42.018264+0000","last_fullsized":"2023-12-24T20:00:42.018264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:14:56.511499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.023349+0000","last_change":"2023-12-24T20:00:42.023262+0000","last_active":"2023-12-24T20:00:42.023349+0000","last_peered":"2023-12-24T20:00:42.023349+0000","last_clean":"2023-12-24T20:00:42.023349+0000","last_became_active":"2023-12-24T20:00:42.022800+0000","last_became_peered":"2023-12-24T20:00:42.022800+0000","last_unstale":"2023-12-24T20:00:42.023349+0000","last_undegraded":"2023-12-24T20:00:42.023349+0000","last_fullsized":"2023-12-24T20:00:42.023349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:53.030084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.016636+0000","last_change":"2023-12-24T20:00:42.015304+0000","last_active":"2023-12-24T20:00:42.016636+0000","last_peered":"2023-12-24T20:00:42.016636+0000","last_clean":"2023-12-24T20:00:42.016636+0000","last_became_active":"2023-12-24T20:00:42.015064+0000","last_became_peered":"2023-12-24T20:00:42.015064+0000","last_unstale":"2023-12-24T20:00:42.016636+0000","last_undegraded":"2023-12-24T20:00:42.016636+0000","last_fullsized":"2023-12-24T20:00:42.016636+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:36.952845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.017424+0000","last_change":"2023-12-24T20:00:42.017191+0000","last_active":"2023-12-24T20:00:42.017424+0000","last_peered":"2023-12-24T20:00:42.017424+0000","last_clean":"2023-12-24T20:00:42.017424+0000","last_became_active":"2023-12-24T20:00:42.016447+0000","last_became_peered":"2023-12-24T20:00:42.016447+0000","last_unstale":"2023-12-24T20:00:42.017424+0000","last_undegraded":"2023-12-24T20:00:42.017424+0000","last_fullsized":"2023-12-24T20:00:42.017424+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:20.543681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018864+0000","last_change":"2023-12-24T20:00:42.018542+0000","last_active":"2023-12-24T20:00:42.018864+0000","last_peered":"2023-12-24T20:00:42.018864+0000","last_clean":"2023-12-24T20:00:42.018864+0000","last_became_active":"2023-12-24T20:00:42.018146+0000","last_became_peered":"2023-12-24T20:00:42.018146+0000","last_unstale":"2023-12-24T20:00:42.018864+0000","last_undegraded":"2023-12-24T20:00:42.018864+0000","last_fullsized":"2023-12-24T20:00:42.018864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:36:33.431993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.019737+0000","last_change":"2023-12-24T20:00:42.019533+0000","last_active":"2023-12-24T20:00:42.019737+0000","last_peered":"2023-12-24T20:00:42.019737+0000","last_clean":"2023-12-24T20:00:42.019737+0000","last_became_active":"2023-12-24T20:00:42.019278+0000","last_became_peered":"2023-12-24T20:00:42.019278+0000","last_unstale":"2023-12-24T20:00:42.019737+0000","last_undegraded":"2023-12-24T20:00:42.019737+0000","last_fullsized":"2023-12-24T20:00:42.019737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:41:26.863911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018249+0000","last_change":"2023-12-24T20:00:42.017822+0000","last_active":"2023-12-24T20:00:42.018249+0000","last_peered":"2023-12-24T20:00:42.018249+0000","last_clean":"2023-12-24T20:00:42.018249+0000","last_became_active":"2023-12-24T20:00:42.017254+0000","last_became_peered":"2023-12-24T20:00:42.017254+0000","last_unstale":"2023-12-24T20:00:42.018249+0000","last_undegraded":"2023-12-24T20:00:42.018249+0000","last_fullsized":"2023-12-24T20:00:42.018249+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:31.330979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018425+0000","last_change":"2023-12-24T20:00:42.018351+0000","last_active":"2023-12-24T20:00:42.018425+0000","last_peered":"2023-12-24T20:00:42.018425+0000","last_clean":"2023-12-24T20:00:42.018425+0000","last_became_active":"2023-12-24T20:00:42.017765+0000","last_became_peered":"2023-12-24T20:00:42.017765+0000","last_unstale":"2023-12-24T20:00:42.018425+0000","last_undegraded":"2023-12-24T20:00:42.018425+0000","last_fullsized":"2023-12-24T20:00:42.018425+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:48:01.766277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.024032+0000","last_change":"2023-12-24T20:00:42.023975+0000","last_active":"2023-12-24T20:00:42.024032+0000","last_peered":"2023-12-24T20:00:42.024032+0000","last_clean":"2023-12-24T20:00:42.024032+0000","last_became_active":"2023-12-24T20:00:42.023543+0000","last_became_peered":"2023-12-24T20:00:42.023543+0000","last_unstale":"2023-12-24T20:00:42.024032+0000","last_undegraded":"2023-12-24T20:00:42.024032+0000","last_fullsized":"2023-12-24T20:00:42.024032+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:41.772929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018106+0000","last_change":"2023-12-24T20:00:42.018044+0000","last_active":"2023-12-24T20:00:42.018106+0000","last_peered":"2023-12-24T20:00:42.018106+0000","last_clean":"2023-12-24T20:00:42.018106+0000","last_became_active":"2023-12-24T20:00:42.017808+0000","last_became_peered":"2023-12-24T20:00:42.017808+0000","last_unstale":"2023-12-24T20:00:42.018106+0000","last_undegraded":"2023-12-24T20:00:42.018106+0000","last_fullsized":"2023-12-24T20:00:42.018106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:16:16.165281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.023966+0000","last_change":"2023-12-24T20:00:42.023906+0000","last_active":"2023-12-24T20:00:42.023966+0000","last_peered":"2023-12-24T20:00:42.023966+0000","last_clean":"2023-12-24T20:00:42.023966+0000","last_became_active":"2023-12-24T20:00:42.023306+0000","last_became_peered":"2023-12-24T20:00:42.023306+0000","last_unstale":"2023-12-24T20:00:42.023966+0000","last_undegraded":"2023-12-24T20:00:42.023966+0000","last_fullsized":"2023-12-24T20:00:42.023966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:15.948482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018268+0000","last_change":"2023-12-24T20:00:42.017977+0000","last_active":"2023-12-24T20:00:42.018268+0000","last_peered":"2023-12-24T20:00:42.018268+0000","last_clean":"2023-12-24T20:00:42.018268+0000","last_became_active":"2023-12-24T20:00:42.017557+0000","last_became_peered":"2023-12-24T20:00:42.017557+0000","last_unstale":"2023-12-24T20:00:42.018268+0000","last_undegraded":"2023-12-24T20:00:42.018268+0000","last_fullsized":"2023-12-24T20:00:42.018268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:25:41.849897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018752+0000","last_change":"2023-12-24T20:00:42.018711+0000","last_active":"2023-12-24T20:00:42.018752+0000","last_peered":"2023-12-24T20:00:42.018752+0000","last_clean":"2023-12-24T20:00:42.018752+0000","last_became_active":"2023-12-24T20:00:42.018102+0000","last_became_peered":"2023-12-24T20:00:42.018102+0000","last_unstale":"2023-12-24T20:00:42.018752+0000","last_undegraded":"2023-12-24T20:00:42.018752+0000","last_fullsized":"2023-12-24T20:00:42.018752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:59:04.443917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.020623+0000","last_change":"2023-12-24T20:00:42.020531+0000","last_active":"2023-12-24T20:00:42.020623+0000","last_peered":"2023-12-24T20:00:42.020623+0000","last_clean":"2023-12-24T20:00:42.020623+0000","last_became_active":"2023-12-24T20:00:42.020288+0000","last_became_peered":"2023-12-24T20:00:42.020288+0000","last_unstale":"2023-12-24T20:00:42.020623+0000","last_undegraded":"2023-12-24T20:00:42.020623+0000","last_fullsized":"2023-12-24T20:00:42.020623+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:41.309607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.016659+0000","last_change":"2023-12-24T20:00:42.015367+0000","last_active":"2023-12-24T20:00:42.016659+0000","last_peered":"2023-12-24T20:00:42.016659+0000","last_clean":"2023-12-24T20:00:42.016659+0000","last_became_active":"2023-12-24T20:00:42.015136+0000","last_became_peered":"2023-12-24T20:00:42.015136+0000","last_unstale":"2023-12-24T20:00:42.016659+0000","last_undegraded":"2023-12-24T20:00:42.016659+0000","last_fullsized":"2023-12-24T20:00:42.016659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:41.309607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.025540+0000","last_change":"2023-12-24T20:00:42.025479+0000","last_active":"2023-12-24T20:00:42.025540+0000","last_peered":"2023-12-24T20:00:42.025540+0000","last_clean":"2023-12-24T20:00:42.025540+0000","last_became_active":"2023-12-24T20:00:42.025133+0000","last_became_peered":"2023-12-24T20:00:42.025133+0000","last_unstale":"2023-12-24T20:00:42.025540+0000","last_undegraded":"2023-12-24T20:00:42.025540+0000","last_fullsized":"2023-12-24T20:00:42.025540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:31.330979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.023121+0000","last_change":"2023-12-24T20:00:42.023058+0000","last_active":"2023-12-24T20:00:42.023121+0000","last_peered":"2023-12-24T20:00:42.023121+0000","last_clean":"2023-12-24T20:00:42.023121+0000","last_became_active":"2023-12-24T20:00:42.022009+0000","last_became_peered":"2023-12-24T20:00:42.022009+0000","last_unstale":"2023-12-24T20:00:42.023121+0000","last_undegraded":"2023-12-24T20:00:42.023121+0000","last_fullsized":"2023-12-24T20:00:42.023121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:06.997269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.024827+0000","last_change":"2023-12-24T20:00:42.024766+0000","last_active":"2023-12-24T20:00:42.024827+0000","last_peered":"2023-12-24T20:00:42.024827+0000","last_clean":"2023-12-24T20:00:42.024827+0000","last_became_active":"2023-12-24T20:00:42.024515+0000","last_became_peered":"2023-12-24T20:00:42.024515+0000","last_unstale":"2023-12-24T20:00:42.024827+0000","last_undegraded":"2023-12-24T20:00:42.024827+0000","last_fullsized":"2023-12-24T20:00:42.024827+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:16:55.372500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.015995+0000","last_change":"2023-12-24T20:00:42.015659+0000","last_active":"2023-12-24T20:00:42.015995+0000","last_peered":"2023-12-24T20:00:42.015995+0000","last_clean":"2023-12-24T20:00:42.015995+0000","last_became_active":"2023-12-24T20:00:42.015375+0000","last_became_peered":"2023-12-24T20:00:42.015375+0000","last_unstale":"2023-12-24T20:00:42.015995+0000","last_undegraded":"2023-12-24T20:00:42.015995+0000","last_fullsized":"2023-12-24T20:00:42.015995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:06:12.115621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.020917+0000","last_change":"2023-12-24T20:00:42.020856+0000","last_active":"2023-12-24T20:00:42.020917+0000","last_peered":"2023-12-24T20:00:42.020917+0000","last_clean":"2023-12-24T20:00:42.020917+0000","last_became_active":"2023-12-24T20:00:42.020655+0000","last_became_peered":"2023-12-24T20:00:42.020655+0000","last_unstale":"2023-12-24T20:00:42.020917+0000","last_undegraded":"2023-12-24T20:00:42.020917+0000","last_fullsized":"2023-12-24T20:00:42.020917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:46:40.073132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.013176+0000","last_change":"2023-12-24T20:00:42.012903+0000","last_active":"2023-12-24T20:00:42.013176+0000","last_peered":"2023-12-24T20:00:42.013176+0000","last_clean":"2023-12-24T20:00:42.013176+0000","last_became_active":"2023-12-24T20:00:42.012668+0000","last_became_peered":"2023-12-24T20:00:42.012668+0000","last_unstale":"2023-12-24T20:00:42.013176+0000","last_undegraded":"2023-12-24T20:00:42.013176+0000","last_fullsized":"2023-12-24T20:00:42.013176+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:03:20.170027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.023358+0000","last_change":"2023-12-24T20:00:42.023167+0000","last_active":"2023-12-24T20:00:42.023358+0000","last_peered":"2023-12-24T20:00:42.023358+0000","last_clean":"2023-12-24T20:00:42.023358+0000","last_became_active":"2023-12-24T20:00:42.022652+0000","last_became_peered":"2023-12-24T20:00:42.022652+0000","last_unstale":"2023-12-24T20:00:42.023358+0000","last_undegraded":"2023-12-24T20:00:42.023358+0000","last_fullsized":"2023-12-24T20:00:42.023358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:29:16.782655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.022440+0000","last_change":"2023-12-24T20:00:42.022241+0000","last_active":"2023-12-24T20:00:42.022440+0000","last_peered":"2023-12-24T20:00:42.022440+0000","last_clean":"2023-12-24T20:00:42.022440+0000","last_became_active":"2023-12-24T20:00:42.022012+0000","last_became_peered":"2023-12-24T20:00:42.022012+0000","last_unstale":"2023-12-24T20:00:42.022440+0000","last_undegraded":"2023-12-24T20:00:42.022440+0000","last_fullsized":"2023-12-24T20:00:42.022440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:53.030084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.023847+0000","last_change":"2023-12-24T20:00:42.023803+0000","last_active":"2023-12-24T20:00:42.023847+0000","last_peered":"2023-12-24T20:00:42.023847+0000","last_clean":"2023-12-24T20:00:42.023847+0000","last_became_active":"2023-12-24T20:00:42.023611+0000","last_became_peered":"2023-12-24T20:00:42.023611+0000","last_unstale":"2023-12-24T20:00:42.023847+0000","last_undegraded":"2023-12-24T20:00:42.023847+0000","last_fullsized":"2023-12-24T20:00:42.023847+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:54.033193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.025422+0000","last_change":"2023-12-24T20:00:42.025359+0000","last_active":"2023-12-24T20:00:42.025422+0000","last_peered":"2023-12-24T20:00:42.025422+0000","last_clean":"2023-12-24T20:00:42.025422+0000","last_became_active":"2023-12-24T20:00:42.024827+0000","last_became_peered":"2023-12-24T20:00:42.024827+0000","last_unstale":"2023-12-24T20:00:42.025422+0000","last_undegraded":"2023-12-24T20:00:42.025422+0000","last_fullsized":"2023-12-24T20:00:42.025422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:10:52.592321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"79'4","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.031637+0000","last_change":"2023-12-24T20:00:41.010045+0000","last_active":"2023-12-24T20:00:42.031637+0000","last_peered":"2023-12-24T20:00:42.031637+0000","last_clean":"2023-12-24T20:00:42.031637+0000","last_became_active":"2023-12-24T20:00:41.009799+0000","last_became_peered":"2023-12-24T20:00:41.009799+0000","last_unstale":"2023-12-24T20:00:42.031637+0000","last_undegraded":"2023-12-24T20:00:42.031637+0000","last_fullsized":"2023-12-24T20:00:42.031637+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:21:40.912539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.022530+0000","last_change":"2023-12-24T20:00:42.022453+0000","last_active":"2023-12-24T20:00:42.022530+0000","last_peered":"2023-12-24T20:00:42.022530+0000","last_clean":"2023-12-24T20:00:42.022530+0000","last_became_active":"2023-12-24T20:00:42.022225+0000","last_became_peered":"2023-12-24T20:00:42.022225+0000","last_unstale":"2023-12-24T20:00:42.022530+0000","last_undegraded":"2023-12-24T20:00:42.022530+0000","last_fullsized":"2023-12-24T20:00:42.022530+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:43:07.391197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.024468+0000","last_change":"2023-12-24T20:00:41.019544+0000","last_active":"2023-12-24T20:00:42.024468+0000","last_peered":"2023-12-24T20:00:42.024468+0000","last_clean":"2023-12-24T20:00:42.024468+0000","last_became_active":"2023-12-24T20:00:41.019173+0000","last_became_peered":"2023-12-24T20:00:41.019173+0000","last_unstale":"2023-12-24T20:00:42.024468+0000","last_undegraded":"2023-12-24T20:00:42.024468+0000","last_fullsized":"2023-12-24T20:00:42.024468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:36.385001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018097+0000","last_change":"2023-12-24T20:00:42.018029+0000","last_active":"2023-12-24T20:00:42.018097+0000","last_peered":"2023-12-24T20:00:42.018097+0000","last_clean":"2023-12-24T20:00:42.018097+0000","last_became_active":"2023-12-24T20:00:42.017756+0000","last_became_peered":"2023-12-24T20:00:42.017756+0000","last_unstale":"2023-12-24T20:00:42.018097+0000","last_undegraded":"2023-12-24T20:00:42.018097+0000","last_fullsized":"2023-12-24T20:00:42.018097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:29:16.782655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.029649+0000","last_change":"2023-12-24T20:00:41.019057+0000","last_active":"2023-12-24T20:00:42.029649+0000","last_peered":"2023-12-24T20:00:42.029649+0000","last_clean":"2023-12-24T20:00:42.029649+0000","last_became_active":"2023-12-24T20:00:41.017981+0000","last_became_peered":"2023-12-24T20:00:41.017981+0000","last_unstale":"2023-12-24T20:00:42.029649+0000","last_undegraded":"2023-12-24T20:00:42.029649+0000","last_fullsized":"2023-12-24T20:00:42.029649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:30:30.510633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.022993+0000","last_change":"2023-12-24T20:00:42.022368+0000","last_active":"2023-12-24T20:00:42.022993+0000","last_peered":"2023-12-24T20:00:42.022993+0000","last_clean":"2023-12-24T20:00:42.022993+0000","last_became_active":"2023-12-24T20:00:42.022157+0000","last_became_peered":"2023-12-24T20:00:42.022157+0000","last_unstale":"2023-12-24T20:00:42.022993+0000","last_undegraded":"2023-12-24T20:00:42.022993+0000","last_fullsized":"2023-12-24T20:00:42.022993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:48:19.865421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.028547+0000","last_change":"2023-12-24T20:00:41.012530+0000","last_active":"2023-12-24T20:00:42.028547+0000","last_peered":"2023-12-24T20:00:42.028547+0000","last_clean":"2023-12-24T20:00:42.028547+0000","last_became_active":"2023-12-24T20:00:41.012317+0000","last_became_peered":"2023-12-24T20:00:41.012317+0000","last_unstale":"2023-12-24T20:00:42.028547+0000","last_undegraded":"2023-12-24T20:00:42.028547+0000","last_fullsized":"2023-12-24T20:00:42.028547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:42.163987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018716+0000","last_change":"2023-12-24T20:00:42.017930+0000","last_active":"2023-12-24T20:00:42.018716+0000","last_peered":"2023-12-24T20:00:42.018716+0000","last_clean":"2023-12-24T20:00:42.018716+0000","last_became_active":"2023-12-24T20:00:42.017683+0000","last_became_peered":"2023-12-24T20:00:42.017683+0000","last_unstale":"2023-12-24T20:00:42.018716+0000","last_undegraded":"2023-12-24T20:00:42.018716+0000","last_fullsized":"2023-12-24T20:00:42.018716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:26.601346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.029364+0000","last_change":"2023-12-24T20:00:41.015320+0000","last_active":"2023-12-24T20:00:42.029364+0000","last_peered":"2023-12-24T20:00:42.029364+0000","last_clean":"2023-12-24T20:00:42.029364+0000","last_became_active":"2023-12-24T20:00:41.015056+0000","last_became_peered":"2023-12-24T20:00:41.015056+0000","last_unstale":"2023-12-24T20:00:42.029364+0000","last_undegraded":"2023-12-24T20:00:42.029364+0000","last_fullsized":"2023-12-24T20:00:42.029364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:36:32.430074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018723+0000","last_change":"2023-12-24T20:00:42.018627+0000","last_active":"2023-12-24T20:00:42.018723+0000","last_peered":"2023-12-24T20:00:42.018723+0000","last_clean":"2023-12-24T20:00:42.018723+0000","last_became_active":"2023-12-24T20:00:42.018372+0000","last_became_peered":"2023-12-24T20:00:42.018372+0000","last_unstale":"2023-12-24T20:00:42.018723+0000","last_undegraded":"2023-12-24T20:00:42.018723+0000","last_fullsized":"2023-12-24T20:00:42.018723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:25:41.849897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.029372+0000","last_change":"2023-12-24T20:00:41.015675+0000","last_active":"2023-12-24T20:00:42.029372+0000","last_peered":"2023-12-24T20:00:42.029372+0000","last_clean":"2023-12-24T20:00:42.029372+0000","last_became_active":"2023-12-24T20:00:41.015033+0000","last_became_peered":"2023-12-24T20:00:41.015033+0000","last_unstale":"2023-12-24T20:00:42.029372+0000","last_undegraded":"2023-12-24T20:00:42.029372+0000","last_fullsized":"2023-12-24T20:00:42.029372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:36:34.534753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.024003+0000","last_change":"2023-12-24T20:00:42.023938+0000","last_active":"2023-12-24T20:00:42.024003+0000","last_peered":"2023-12-24T20:00:42.024003+0000","last_clean":"2023-12-24T20:00:42.024003+0000","last_became_active":"2023-12-24T20:00:42.023618+0000","last_became_peered":"2023-12-24T20:00:42.023618+0000","last_unstale":"2023-12-24T20:00:42.024003+0000","last_undegraded":"2023-12-24T20:00:42.024003+0000","last_fullsized":"2023-12-24T20:00:42.024003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:19:44.083117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.008731+0000","last_change":"2023-12-24T20:00:41.022764+0000","last_active":"2023-12-24T20:00:42.008731+0000","last_peered":"2023-12-24T20:00:42.008731+0000","last_clean":"2023-12-24T20:00:42.008731+0000","last_became_active":"2023-12-24T20:00:41.022137+0000","last_became_peered":"2023-12-24T20:00:41.022137+0000","last_unstale":"2023-12-24T20:00:42.008731+0000","last_undegraded":"2023-12-24T20:00:42.008731+0000","last_fullsized":"2023-12-24T20:00:42.008731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:40.771010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018887+0000","last_change":"2023-12-24T20:00:42.018732+0000","last_active":"2023-12-24T20:00:42.018887+0000","last_peered":"2023-12-24T20:00:42.018887+0000","last_clean":"2023-12-24T20:00:42.018887+0000","last_became_active":"2023-12-24T20:00:42.018505+0000","last_became_peered":"2023-12-24T20:00:42.018505+0000","last_unstale":"2023-12-24T20:00:42.018887+0000","last_undegraded":"2023-12-24T20:00:42.018887+0000","last_fullsized":"2023-12-24T20:00:42.018887+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:02:41.676872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.015728+0000","last_change":"2023-12-24T20:00:41.017802+0000","last_active":"2023-12-24T20:00:42.015728+0000","last_peered":"2023-12-24T20:00:42.015728+0000","last_clean":"2023-12-24T20:00:42.015728+0000","last_became_active":"2023-12-24T20:00:41.017520+0000","last_became_peered":"2023-12-24T20:00:41.017520+0000","last_unstale":"2023-12-24T20:00:42.015728+0000","last_undegraded":"2023-12-24T20:00:42.015728+0000","last_fullsized":"2023-12-24T20:00:42.015728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:06:04.757034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.016033+0000","last_change":"2023-12-24T20:00:42.015700+0000","last_active":"2023-12-24T20:00:42.016033+0000","last_peered":"2023-12-24T20:00:42.016033+0000","last_clean":"2023-12-24T20:00:42.016033+0000","last_became_active":"2023-12-24T20:00:42.015449+0000","last_became_peered":"2023-12-24T20:00:42.015449+0000","last_unstale":"2023-12-24T20:00:42.016033+0000","last_undegraded":"2023-12-24T20:00:42.016033+0000","last_fullsized":"2023-12-24T20:00:42.016033+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:06.997269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.011333+0000","last_change":"2023-12-24T20:00:41.014477+0000","last_active":"2023-12-24T20:00:42.011333+0000","last_peered":"2023-12-24T20:00:42.011333+0000","last_clean":"2023-12-24T20:00:42.011333+0000","last_became_active":"2023-12-24T20:00:41.014258+0000","last_became_peered":"2023-12-24T20:00:41.014258+0000","last_unstale":"2023-12-24T20:00:42.011333+0000","last_undegraded":"2023-12-24T20:00:42.011333+0000","last_fullsized":"2023-12-24T20:00:42.011333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:21:40.912539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.020433+0000","last_change":"2023-12-24T20:00:42.020110+0000","last_active":"2023-12-24T20:00:42.020433+0000","last_peered":"2023-12-24T20:00:42.020433+0000","last_clean":"2023-12-24T20:00:42.020433+0000","last_became_active":"2023-12-24T20:00:42.019830+0000","last_became_peered":"2023-12-24T20:00:42.019830+0000","last_unstale":"2023-12-24T20:00:42.020433+0000","last_undegraded":"2023-12-24T20:00:42.020433+0000","last_fullsized":"2023-12-24T20:00:42.020433+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:26.601346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.014949+0000","last_change":"2023-12-24T20:00:41.016189+0000","last_active":"2023-12-24T20:00:42.014949+0000","last_peered":"2023-12-24T20:00:42.014949+0000","last_clean":"2023-12-24T20:00:42.014949+0000","last_became_active":"2023-12-24T20:00:41.015956+0000","last_became_peered":"2023-12-24T20:00:41.015956+0000","last_unstale":"2023-12-24T20:00:42.014949+0000","last_undegraded":"2023-12-24T20:00:42.014949+0000","last_fullsized":"2023-12-24T20:00:42.014949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:19:43.081198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.024299+0000","last_change":"2023-12-24T20:00:42.024095+0000","last_active":"2023-12-24T20:00:42.024299+0000","last_peered":"2023-12-24T20:00:42.024299+0000","last_clean":"2023-12-24T20:00:42.024299+0000","last_became_active":"2023-12-24T20:00:42.023651+0000","last_became_peered":"2023-12-24T20:00:42.023651+0000","last_unstale":"2023-12-24T20:00:42.024299+0000","last_undegraded":"2023-12-24T20:00:42.024299+0000","last_fullsized":"2023-12-24T20:00:42.024299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:16:41.715398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"79'3","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.030956+0000","last_change":"2023-12-24T20:00:41.018916+0000","last_active":"2023-12-24T20:00:42.030956+0000","last_peered":"2023-12-24T20:00:42.030956+0000","last_clean":"2023-12-24T20:00:42.030956+0000","last_became_active":"2023-12-24T20:00:41.018697+0000","last_became_peered":"2023-12-24T20:00:41.018697+0000","last_unstale":"2023-12-24T20:00:42.030956+0000","last_undegraded":"2023-12-24T20:00:42.030956+0000","last_fullsized":"2023-12-24T20:00:42.030956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:30.329060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.016284+0000","last_change":"2023-12-24T20:00:42.016041+0000","last_active":"2023-12-24T20:00:42.016284+0000","last_peered":"2023-12-24T20:00:42.016284+0000","last_clean":"2023-12-24T20:00:42.016284+0000","last_became_active":"2023-12-24T20:00:42.015738+0000","last_became_peered":"2023-12-24T20:00:42.015738+0000","last_unstale":"2023-12-24T20:00:42.016284+0000","last_undegraded":"2023-12-24T20:00:42.016284+0000","last_fullsized":"2023-12-24T20:00:42.016284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:37:25.502260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"79'6","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.030731+0000","last_change":"2023-12-24T20:00:41.023015+0000","last_active":"2023-12-24T20:00:42.030731+0000","last_peered":"2023-12-24T20:00:42.030731+0000","last_clean":"2023-12-24T20:00:42.030731+0000","last_became_active":"2023-12-24T20:00:41.022514+0000","last_became_peered":"2023-12-24T20:00:41.022514+0000","last_unstale":"2023-12-24T20:00:42.030731+0000","last_undegraded":"2023-12-24T20:00:42.030731+0000","last_fullsized":"2023-12-24T20:00:42.030731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:18:41.337759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.016704+0000","last_change":"2023-12-24T20:00:42.016531+0000","last_active":"2023-12-24T20:00:42.016704+0000","last_peered":"2023-12-24T20:00:42.016704+0000","last_clean":"2023-12-24T20:00:42.016704+0000","last_became_active":"2023-12-24T20:00:42.016116+0000","last_became_peered":"2023-12-24T20:00:42.016116+0000","last_unstale":"2023-12-24T20:00:42.016704+0000","last_undegraded":"2023-12-24T20:00:42.016704+0000","last_fullsized":"2023-12-24T20:00:42.016704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:46:40.073132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.026683+0000","last_change":"2023-12-24T20:00:41.009565+0000","last_active":"2023-12-24T20:00:42.026683+0000","last_peered":"2023-12-24T20:00:42.026683+0000","last_clean":"2023-12-24T20:00:42.026683+0000","last_became_active":"2023-12-24T20:00:41.009333+0000","last_became_peered":"2023-12-24T20:00:41.009333+0000","last_unstale":"2023-12-24T20:00:42.026683+0000","last_undegraded":"2023-12-24T20:00:42.026683+0000","last_fullsized":"2023-12-24T20:00:42.026683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:19:43.081198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.023372+0000","last_change":"2023-12-24T20:00:42.023304+0000","last_active":"2023-12-24T20:00:42.023372+0000","last_peered":"2023-12-24T20:00:42.023372+0000","last_clean":"2023-12-24T20:00:42.023372+0000","last_became_active":"2023-12-24T20:00:42.022937+0000","last_became_peered":"2023-12-24T20:00:42.022937+0000","last_unstale":"2023-12-24T20:00:42.023372+0000","last_undegraded":"2023-12-24T20:00:42.023372+0000","last_fullsized":"2023-12-24T20:00:42.023372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:24:14.401743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.014210+0000","last_change":"2023-12-24T20:00:41.019048+0000","last_active":"2023-12-24T20:00:42.014210+0000","last_peered":"2023-12-24T20:00:42.014210+0000","last_clean":"2023-12-24T20:00:42.014210+0000","last_became_active":"2023-12-24T20:00:41.018802+0000","last_became_peered":"2023-12-24T20:00:41.018802+0000","last_unstale":"2023-12-24T20:00:42.014210+0000","last_undegraded":"2023-12-24T20:00:42.014210+0000","last_fullsized":"2023-12-24T20:00:42.014210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:50:35.914777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018846+0000","last_change":"2023-12-24T20:00:42.018424+0000","last_active":"2023-12-24T20:00:42.018846+0000","last_peered":"2023-12-24T20:00:42.018846+0000","last_clean":"2023-12-24T20:00:42.018846+0000","last_became_active":"2023-12-24T20:00:42.017833+0000","last_became_peered":"2023-12-24T20:00:42.017833+0000","last_unstale":"2023-12-24T20:00:42.018846+0000","last_undegraded":"2023-12-24T20:00:42.018846+0000","last_fullsized":"2023-12-24T20:00:42.018846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:36.952845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.013768+0000","last_change":"2023-12-24T20:00:41.017292+0000","last_active":"2023-12-24T20:00:42.013768+0000","last_peered":"2023-12-24T20:00:42.013768+0000","last_clean":"2023-12-24T20:00:42.013768+0000","last_became_active":"2023-12-24T20:00:41.017025+0000","last_became_peered":"2023-12-24T20:00:41.017025+0000","last_unstale":"2023-12-24T20:00:42.013768+0000","last_undegraded":"2023-12-24T20:00:42.013768+0000","last_fullsized":"2023-12-24T20:00:42.013768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:14.946563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.023899+0000","last_change":"2023-12-24T20:00:42.023822+0000","last_active":"2023-12-24T20:00:42.023899+0000","last_peered":"2023-12-24T20:00:42.023899+0000","last_clean":"2023-12-24T20:00:42.023899+0000","last_became_active":"2023-12-24T20:00:42.023224+0000","last_became_peered":"2023-12-24T20:00:42.023224+0000","last_unstale":"2023-12-24T20:00:42.023899+0000","last_undegraded":"2023-12-24T20:00:42.023899+0000","last_fullsized":"2023-12-24T20:00:42.023899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:18:42.339678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"79'8","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.031822+0000","last_change":"2023-12-24T20:00:41.021378+0000","last_active":"2023-12-24T20:00:42.031822+0000","last_peered":"2023-12-24T20:00:42.031822+0000","last_clean":"2023-12-24T20:00:42.031822+0000","last_became_active":"2023-12-24T20:00:41.020993+0000","last_became_peered":"2023-12-24T20:00:41.020993+0000","last_unstale":"2023-12-24T20:00:42.031822+0000","last_undegraded":"2023-12-24T20:00:42.031822+0000","last_fullsized":"2023-12-24T20:00:42.031822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:24:15.108692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.017844+0000","last_change":"2023-12-24T20:00:42.015117+0000","last_active":"2023-12-24T20:00:42.017844+0000","last_peered":"2023-12-24T20:00:42.017844+0000","last_clean":"2023-12-24T20:00:42.017844+0000","last_became_active":"2023-12-24T20:00:42.014897+0000","last_became_peered":"2023-12-24T20:00:42.014897+0000","last_unstale":"2023-12-24T20:00:42.017844+0000","last_undegraded":"2023-12-24T20:00:42.017844+0000","last_fullsized":"2023-12-24T20:00:42.017844+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:26.601346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.028918+0000","last_change":"2023-12-24T20:00:41.014832+0000","last_active":"2023-12-24T20:00:42.028918+0000","last_peered":"2023-12-24T20:00:42.028918+0000","last_clean":"2023-12-24T20:00:42.028918+0000","last_became_active":"2023-12-24T20:00:41.014595+0000","last_became_peered":"2023-12-24T20:00:41.014595+0000","last_unstale":"2023-12-24T20:00:42.028918+0000","last_undegraded":"2023-12-24T20:00:42.028918+0000","last_fullsized":"2023-12-24T20:00:42.028918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:08:52.198035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.016981+0000","last_change":"2023-12-24T20:00:42.016919+0000","last_active":"2023-12-24T20:00:42.016981+0000","last_peered":"2023-12-24T20:00:42.016981+0000","last_clean":"2023-12-24T20:00:42.016981+0000","last_became_active":"2023-12-24T20:00:42.016610+0000","last_became_peered":"2023-12-24T20:00:42.016610+0000","last_unstale":"2023-12-24T20:00:42.016981+0000","last_undegraded":"2023-12-24T20:00:42.016981+0000","last_fullsized":"2023-12-24T20:00:42.016981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:48:01.766277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.029748+0000","last_change":"2023-12-24T20:00:41.018914+0000","last_active":"2023-12-24T20:00:42.029748+0000","last_peered":"2023-12-24T20:00:42.029748+0000","last_clean":"2023-12-24T20:00:42.029748+0000","last_became_active":"2023-12-24T20:00:41.017681+0000","last_became_peered":"2023-12-24T20:00:41.017681+0000","last_unstale":"2023-12-24T20:00:42.029748+0000","last_undegraded":"2023-12-24T20:00:42.029748+0000","last_fullsized":"2023-12-24T20:00:42.029748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:16:40.713479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.017441+0000","last_change":"2023-12-24T20:00:42.017340+0000","last_active":"2023-12-24T20:00:42.017441+0000","last_peered":"2023-12-24T20:00:42.017441+0000","last_clean":"2023-12-24T20:00:42.017441+0000","last_became_active":"2023-12-24T20:00:42.016765+0000","last_became_peered":"2023-12-24T20:00:42.016765+0000","last_unstale":"2023-12-24T20:00:42.017441+0000","last_undegraded":"2023-12-24T20:00:42.017441+0000","last_fullsized":"2023-12-24T20:00:42.017441+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:59:15.852978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"79'1","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.029868+0000","last_change":"2023-12-24T20:00:41.016020+0000","last_active":"2023-12-24T20:00:42.029868+0000","last_peered":"2023-12-24T20:00:42.029868+0000","last_clean":"2023-12-24T20:00:42.029868+0000","last_became_active":"2023-12-24T20:00:41.014578+0000","last_became_peered":"2023-12-24T20:00:41.014578+0000","last_unstale":"2023-12-24T20:00:42.029868+0000","last_undegraded":"2023-12-24T20:00:42.029868+0000","last_fullsized":"2023-12-24T20:00:42.029868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:06.922589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.021484+0000","last_change":"2023-12-24T20:00:42.021414+0000","last_active":"2023-12-24T20:00:42.021484+0000","last_peered":"2023-12-24T20:00:42.021484+0000","last_clean":"2023-12-24T20:00:42.021484+0000","last_became_active":"2023-12-24T20:00:42.021173+0000","last_became_peered":"2023-12-24T20:00:42.021173+0000","last_unstale":"2023-12-24T20:00:42.021484+0000","last_undegraded":"2023-12-24T20:00:42.021484+0000","last_fullsized":"2023-12-24T20:00:42.021484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:39:27.098425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.013762+0000","last_change":"2023-12-24T20:00:41.018227+0000","last_active":"2023-12-24T20:00:42.013762+0000","last_peered":"2023-12-24T20:00:42.013762+0000","last_clean":"2023-12-24T20:00:42.013762+0000","last_became_active":"2023-12-24T20:00:41.017930+0000","last_became_peered":"2023-12-24T20:00:41.017930+0000","last_unstale":"2023-12-24T20:00:42.013762+0000","last_undegraded":"2023-12-24T20:00:42.013762+0000","last_fullsized":"2023-12-24T20:00:42.013762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:16:40.713479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.016597+0000","last_change":"2023-12-24T20:00:42.016531+0000","last_active":"2023-12-24T20:00:42.016597+0000","last_peered":"2023-12-24T20:00:42.016597+0000","last_clean":"2023-12-24T20:00:42.016597+0000","last_became_active":"2023-12-24T20:00:42.016224+0000","last_became_peered":"2023-12-24T20:00:42.016224+0000","last_unstale":"2023-12-24T20:00:42.016597+0000","last_undegraded":"2023-12-24T20:00:42.016597+0000","last_fullsized":"2023-12-24T20:00:42.016597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:19:34.542176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.021954+0000","last_change":"2023-12-24T20:00:41.013913+0000","last_active":"2023-12-24T20:00:42.021954+0000","last_peered":"2023-12-24T20:00:42.021954+0000","last_clean":"2023-12-24T20:00:42.021954+0000","last_became_active":"2023-12-24T20:00:41.013684+0000","last_became_peered":"2023-12-24T20:00:41.013684+0000","last_unstale":"2023-12-24T20:00:42.021954+0000","last_undegraded":"2023-12-24T20:00:42.021954+0000","last_fullsized":"2023-12-24T20:00:42.021954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:16:15.163362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.024376+0000","last_change":"2023-12-24T20:00:42.023849+0000","last_active":"2023-12-24T20:00:42.024376+0000","last_peered":"2023-12-24T20:00:42.024376+0000","last_clean":"2023-12-24T20:00:42.024376+0000","last_became_active":"2023-12-24T20:00:42.023628+0000","last_became_peered":"2023-12-24T20:00:42.023628+0000","last_unstale":"2023-12-24T20:00:42.024376+0000","last_undegraded":"2023-12-24T20:00:42.024376+0000","last_fullsized":"2023-12-24T20:00:42.024376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:17:54.461179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.013832+0000","last_change":"2023-12-24T20:00:41.018600+0000","last_active":"2023-12-24T20:00:42.013832+0000","last_peered":"2023-12-24T20:00:42.013832+0000","last_clean":"2023-12-24T20:00:42.013832+0000","last_became_active":"2023-12-24T20:00:41.018401+0000","last_became_peered":"2023-12-24T20:00:41.018401+0000","last_unstale":"2023-12-24T20:00:42.013832+0000","last_undegraded":"2023-12-24T20:00:42.013832+0000","last_fullsized":"2023-12-24T20:00:42.013832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:21:40.912539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.021709+0000","last_change":"2023-12-24T20:00:42.020914+0000","last_active":"2023-12-24T20:00:42.021709+0000","last_peered":"2023-12-24T20:00:42.021709+0000","last_clean":"2023-12-24T20:00:42.021709+0000","last_became_active":"2023-12-24T20:00:42.017473+0000","last_became_peered":"2023-12-24T20:00:42.017473+0000","last_unstale":"2023-12-24T20:00:42.021709+0000","last_undegraded":"2023-12-24T20:00:42.021709+0000","last_fullsized":"2023-12-24T20:00:42.021709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:03.532347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.011585+0000","last_change":"2023-12-24T20:00:41.018320+0000","last_active":"2023-12-24T20:00:42.011585+0000","last_peered":"2023-12-24T20:00:42.011585+0000","last_clean":"2023-12-24T20:00:42.011585+0000","last_became_active":"2023-12-24T20:00:41.018072+0000","last_became_peered":"2023-12-24T20:00:41.018072+0000","last_unstale":"2023-12-24T20:00:42.011585+0000","last_undegraded":"2023-12-24T20:00:42.011585+0000","last_fullsized":"2023-12-24T20:00:42.011585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:24:13.399823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.017053+0000","last_change":"2023-12-24T20:00:42.016979+0000","last_active":"2023-12-24T20:00:42.017053+0000","last_peered":"2023-12-24T20:00:42.017053+0000","last_clean":"2023-12-24T20:00:42.017053+0000","last_became_active":"2023-12-24T20:00:42.016728+0000","last_became_peered":"2023-12-24T20:00:42.016728+0000","last_unstale":"2023-12-24T20:00:42.017053+0000","last_undegraded":"2023-12-24T20:00:42.017053+0000","last_fullsized":"2023-12-24T20:00:42.017053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:10:52.592321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.029044+0000","last_change":"2023-12-24T20:00:41.015712+0000","last_active":"2023-12-24T20:00:42.029044+0000","last_peered":"2023-12-24T20:00:42.029044+0000","last_clean":"2023-12-24T20:00:42.029044+0000","last_became_active":"2023-12-24T20:00:41.015214+0000","last_became_peered":"2023-12-24T20:00:41.015214+0000","last_unstale":"2023-12-24T20:00:42.029044+0000","last_undegraded":"2023-12-24T20:00:42.029044+0000","last_fullsized":"2023-12-24T20:00:42.029044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:13:28.322404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.018743+0000","last_change":"2023-12-24T20:00:42.018498+0000","last_active":"2023-12-24T20:00:42.018743+0000","last_peered":"2023-12-24T20:00:42.018743+0000","last_clean":"2023-12-24T20:00:42.018743+0000","last_became_active":"2023-12-24T20:00:42.018272+0000","last_became_peered":"2023-12-24T20:00:42.018272+0000","last_unstale":"2023-12-24T20:00:42.018743+0000","last_undegraded":"2023-12-24T20:00:42.018743+0000","last_fullsized":"2023-12-24T20:00:42.018743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:11:37.907597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.013047+0000","last_change":"2023-12-24T20:00:41.018009+0000","last_active":"2023-12-24T20:00:42.013047+0000","last_peered":"2023-12-24T20:00:42.013047+0000","last_clean":"2023-12-24T20:00:42.013047+0000","last_became_active":"2023-12-24T20:00:41.017581+0000","last_became_peered":"2023-12-24T20:00:41.017581+0000","last_unstale":"2023-12-24T20:00:42.013047+0000","last_undegraded":"2023-12-24T20:00:42.013047+0000","last_fullsized":"2023-12-24T20:00:42.013047+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:02:25.202330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.020109+0000","last_change":"2023-12-24T20:00:42.019941+0000","last_active":"2023-12-24T20:00:42.020109+0000","last_peered":"2023-12-24T20:00:42.020109+0000","last_clean":"2023-12-24T20:00:42.020109+0000","last_became_active":"2023-12-24T20:00:42.019723+0000","last_became_peered":"2023-12-24T20:00:42.019723+0000","last_unstale":"2023-12-24T20:00:42.020109+0000","last_undegraded":"2023-12-24T20:00:42.020109+0000","last_fullsized":"2023-12-24T20:00:42.020109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:53.030084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.012745+0000","last_change":"2023-12-24T20:00:41.018881+0000","last_active":"2023-12-24T20:00:42.012745+0000","last_peered":"2023-12-24T20:00:42.012745+0000","last_clean":"2023-12-24T20:00:42.012745+0000","last_became_active":"2023-12-24T20:00:41.018611+0000","last_became_peered":"2023-12-24T20:00:41.018611+0000","last_unstale":"2023-12-24T20:00:42.012745+0000","last_undegraded":"2023-12-24T20:00:42.012745+0000","last_fullsized":"2023-12-24T20:00:42.012745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:29:35.769100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.020089+0000","last_change":"2023-12-24T20:00:42.019790+0000","last_active":"2023-12-24T20:00:42.020089+0000","last_peered":"2023-12-24T20:00:42.020089+0000","last_clean":"2023-12-24T20:00:42.020089+0000","last_became_active":"2023-12-24T20:00:42.019430+0000","last_became_peered":"2023-12-24T20:00:42.019430+0000","last_unstale":"2023-12-24T20:00:42.020089+0000","last_undegraded":"2023-12-24T20:00:42.020089+0000","last_fullsized":"2023-12-24T20:00:42.020089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:55:41.470575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.012241+0000","last_change":"2023-12-24T20:00:41.017707+0000","last_active":"2023-12-24T20:00:42.012241+0000","last_peered":"2023-12-24T20:00:42.012241+0000","last_clean":"2023-12-24T20:00:42.012241+0000","last_became_active":"2023-12-24T20:00:41.017473+0000","last_became_peered":"2023-12-24T20:00:41.017473+0000","last_unstale":"2023-12-24T20:00:42.012241+0000","last_undegraded":"2023-12-24T20:00:42.012241+0000","last_fullsized":"2023-12-24T20:00:42.012241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:11:36.905678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.019756+0000","last_change":"2023-12-24T20:00:42.019592+0000","last_active":"2023-12-24T20:00:42.019756+0000","last_peered":"2023-12-24T20:00:42.019756+0000","last_clean":"2023-12-24T20:00:42.019756+0000","last_became_active":"2023-12-24T20:00:42.018882+0000","last_became_peered":"2023-12-24T20:00:42.018882+0000","last_unstale":"2023-12-24T20:00:42.019756+0000","last_undegraded":"2023-12-24T20:00:42.019756+0000","last_fullsized":"2023-12-24T20:00:42.019756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:41.672414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.012181+0000","last_change":"2023-12-24T20:00:41.017887+0000","last_active":"2023-12-24T20:00:42.012181+0000","last_peered":"2023-12-24T20:00:42.012181+0000","last_clean":"2023-12-24T20:00:42.012181+0000","last_became_active":"2023-12-24T20:00:41.017547+0000","last_became_peered":"2023-12-24T20:00:41.017547+0000","last_unstale":"2023-12-24T20:00:42.012181+0000","last_undegraded":"2023-12-24T20:00:42.012181+0000","last_fullsized":"2023-12-24T20:00:42.012181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:08:02.963759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.023388+0000","last_change":"2023-12-24T20:00:42.022800+0000","last_active":"2023-12-24T20:00:42.023388+0000","last_peered":"2023-12-24T20:00:42.023388+0000","last_clean":"2023-12-24T20:00:42.023388+0000","last_became_active":"2023-12-24T20:00:42.022148+0000","last_became_peered":"2023-12-24T20:00:42.022148+0000","last_unstale":"2023-12-24T20:00:42.023388+0000","last_undegraded":"2023-12-24T20:00:42.023388+0000","last_fullsized":"2023-12-24T20:00:42.023388+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:08:48.811066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.009375+0000","last_change":"2023-12-24T20:00:41.023557+0000","last_active":"2023-12-24T20:00:42.009375+0000","last_peered":"2023-12-24T20:00:42.009375+0000","last_clean":"2023-12-24T20:00:42.009375+0000","last_became_active":"2023-12-24T20:00:41.023355+0000","last_became_peered":"2023-12-24T20:00:41.023355+0000","last_unstale":"2023-12-24T20:00:42.009375+0000","last_undegraded":"2023-12-24T20:00:42.009375+0000","last_fullsized":"2023-12-24T20:00:42.009375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:39:26.096506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.016123+0000","last_change":"2023-12-24T20:00:42.015575+0000","last_active":"2023-12-24T20:00:42.016123+0000","last_peered":"2023-12-24T20:00:42.016123+0000","last_clean":"2023-12-24T20:00:42.016123+0000","last_became_active":"2023-12-24T20:00:42.014948+0000","last_became_peered":"2023-12-24T20:00:42.014948+0000","last_unstale":"2023-12-24T20:00:42.016123+0000","last_undegraded":"2023-12-24T20:00:42.016123+0000","last_fullsized":"2023-12-24T20:00:42.016123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:41:07.924508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.009560+0000","last_change":"2023-12-24T20:00:41.021211+0000","last_active":"2023-12-24T20:00:42.009560+0000","last_peered":"2023-12-24T20:00:42.009560+0000","last_clean":"2023-12-24T20:00:42.009560+0000","last_became_active":"2023-12-24T20:00:41.020716+0000","last_became_peered":"2023-12-24T20:00:41.020716+0000","last_unstale":"2023-12-24T20:00:42.009560+0000","last_undegraded":"2023-12-24T20:00:42.009560+0000","last_fullsized":"2023-12-24T20:00:42.009560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:53:28.951735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.025571+0000","last_change":"2023-12-24T20:00:42.025002+0000","last_active":"2023-12-24T20:00:42.025571+0000","last_peered":"2023-12-24T20:00:42.025571+0000","last_clean":"2023-12-24T20:00:42.025571+0000","last_became_active":"2023-12-24T20:00:42.024775+0000","last_became_peered":"2023-12-24T20:00:42.024775+0000","last_unstale":"2023-12-24T20:00:42.025571+0000","last_undegraded":"2023-12-24T20:00:42.025571+0000","last_fullsized":"2023-12-24T20:00:42.025571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:24:16.110611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.022044+0000","last_change":"2023-12-24T20:00:41.013392+0000","last_active":"2023-12-24T20:00:42.022044+0000","last_peered":"2023-12-24T20:00:42.022044+0000","last_clean":"2023-12-24T20:00:42.022044+0000","last_became_active":"2023-12-24T20:00:41.012936+0000","last_became_peered":"2023-12-24T20:00:41.012936+0000","last_unstale":"2023-12-24T20:00:42.022044+0000","last_undegraded":"2023-12-24T20:00:42.022044+0000","last_fullsized":"2023-12-24T20:00:42.022044+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:55.641616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.025058+0000","last_change":"2023-12-24T20:00:42.024500+0000","last_active":"2023-12-24T20:00:42.025058+0000","last_peered":"2023-12-24T20:00:42.025058+0000","last_clean":"2023-12-24T20:00:42.025058+0000","last_became_active":"2023-12-24T20:00:42.024262+0000","last_became_peered":"2023-12-24T20:00:42.024262+0000","last_unstale":"2023-12-24T20:00:42.025058+0000","last_undegraded":"2023-12-24T20:00:42.025058+0000","last_fullsized":"2023-12-24T20:00:42.025058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:41.000351+0000","last_clean_scrub_stamp":"2023-12-24T20:00:41.000351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:30.243503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"79'2","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.029238+0000","last_change":"2023-12-24T20:00:41.012613+0000","last_active":"2023-12-24T20:00:42.029238+0000","last_peered":"2023-12-24T20:00:42.029238+0000","last_clean":"2023-12-24T20:00:42.029238+0000","last_became_active":"2023-12-24T20:00:41.012339+0000","last_became_peered":"2023-12-24T20:00:41.012339+0000","last_unstale":"2023-12-24T20:00:42.029238+0000","last_undegraded":"2023-12-24T20:00:42.029238+0000","last_fullsized":"2023-12-24T20:00:42.029238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:00:39.998432+0000","last_clean_scrub_stamp":"2023-12-24T20:00:39.998432+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:39:26.096506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-24T20:00:42.014859+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:00:42.014859+0000","last_peered":"2023-12-24T20:00:42.014859+0000","last_clean":"2023-12-24T20:00:42.014859+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:00:42.014859+0000","last_undegraded":"2023-12-24T20:00:42.014859+0000","last_fullsized":"2023-12-24T20:00:42.014859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":989,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194323,"statfs":{"total":200000000,"available":198987154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.34399999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.505,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.66700000000000004,"5min":0.754,"15min":0.754},"last":0.65400000000000003}]},{"osd":1,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.433,"5min":0.314,"15min":0.314},"max":{"1min":0.70899999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53700000000000003},"min":{"1min":0.433,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.70099999999999996,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.748},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.748,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.75900000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72299999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.628},"min":{"1min":0.48699999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.79800000000000004,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.622}]},{"osd":4,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81899999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.39400000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.52900000000000003}]},{"osd":5,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.39600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.41599999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.752},"last":0.72899999999999998}]},{"osd":6,"last update":"Sun Dec 24 19:59:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.432,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.623,"15min":0.628},"min":{"1min":0.497,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":0.873,"15min":0.873},"last":0.64400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":405,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194906,"statfs":{"total":200000000,"available":199584306,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53700000000000003,"15min":0.51300000000000001},"min":{"1min":0.42599999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.77500000000000002,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.46600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.50700000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72399999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.40100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.38300000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80900000000000005,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.077,"15min":1.077},"last":0.496},{"interface":"front","average":{"1min":0.627,"5min":0.58599999999999997,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.80100000000000005,"5min":1.048,"15min":1.048},"last":0.58899999999999997}]},{"osd":4,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.35099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.745,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.41999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.76000000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46300000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54800000000000004,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.503,"15min":0.498},"min":{"1min":0.374,"5min":0.254,"15min":0.254},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.48399999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:00:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.40400000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78700000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83199999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194898,"statfs":{"total":200000000,"available":199575986,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.23499999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.24299999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61299999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.37,"15min":0.36399999999999999},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.59299999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.58599999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.35699999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.40999999999999998},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.39400000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.57799999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.30599999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59399999999999997,"15min":0.59099999999999997},"min":{"1min":0.434,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.47699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.81699999999999995}]},{"osd":5,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.50700000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.77800000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.78700000000000003,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.68600000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.46100000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82499999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.621,"15min":0.60599999999999998},"min":{"1min":0.53700000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84599999999999997,"5min":0.878,"15min":0.878},"last":0.76300000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:00:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.60499999999999998},"min":{"1min":0.432,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.86299999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82299999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.88200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":988,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194323,"statfs":{"total":200000000,"available":198987742,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.40500000000000003,"15min":0.44},"min":{"1min":0.254,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.54600000000000004,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35699999999999998,"15min":0.36399999999999999},"min":{"1min":0.25600000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.52800000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.35499999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.35599999999999998,"15min":0.36499999999999999},"min":{"1min":0.24099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56999999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.246},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.40300000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56899999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.31}]},{"osd":3,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45200000000000001,"15min":0.47199999999999998},"min":{"1min":0.27900000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78900000000000003,"5min":2.573,"15min":2.573},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.307,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33800000000000002}]},{"osd":4,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.60099999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.996,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.66700000000000004,"15min":0.69299999999999995},"min":{"1min":0.42999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.871,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.372,"15min":0.372},"max":{"1min":0.94799999999999995,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.621},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56899999999999995}]},{"osd":6,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84099999999999997,"5min":1.655,"15min":1.655},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.036,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Dec 24 19:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63400000000000001,"15min":0.64200000000000002},"min":{"1min":0.41899999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0660000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.625},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70999999999999996,"15min":0.74199999999999999},"min":{"1min":0.47999999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.88500000000000001,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":413,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194898,"statfs":{"total":200000000,"available":199576574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.373,"15min":0.375},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.64500000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.36899999999999999,"15min":0.372},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.35999999999999999}]},{"osd":1,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.23899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.254},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.27600000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60099999999999998,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.32000000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.30499999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.37},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.33700000000000002}]},{"osd":4,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.61599999999999999,"15min":0.628},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.754,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.45800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.60299999999999998}]},{"osd":5,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64700000000000002,"15min":0.623},"min":{"1min":0.47099999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.83399999999999996,"5min":3.577,"15min":3.577},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.68799999999999994,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84799999999999998,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.64200000000000002},"min":{"1min":0.52400000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.04},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.501,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.94999999999999996,"5min":3.637,"15min":3.637},"last":0.67200000000000004}]},{"osd":7,"last update":"Sun Dec 24 19:59:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.65800000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88500000000000001,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96699999999999997,"5min":1.331,"15min":1.331},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":412,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199577998,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32000000000000001},"min":{"1min":0.22500000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23599999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58199999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.25900000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34799999999999998,"15min":0.34200000000000003},"min":{"1min":0.246,"5min":0.223,"15min":0.223},"max":{"1min":0.52600000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.38100000000000001,"15min":0.379},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.60799999999999998,"5min":0.626,"15min":0.626},"last":0.316},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.63200000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84899999999999998,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.60699999999999998,"15min":0.59699999999999998},"min":{"1min":0.375,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.88700000000000001,"5min":1.337,"15min":1.337},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.94599999999999995,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.625,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47699999999999998}]},{"osd":6,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91800000000000004,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.439},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.626,"15min":0.61299999999999999},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.46600000000000003}]},{"osd":7,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.96899999999999997,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.41699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":412,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199578040,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.39400000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.37},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.371,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.47599999999999998}]},{"osd":1,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.70099999999999996,"15min":0.755},"min":{"1min":0.42699999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":4.883,"15min":4.883},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58299999999999996,"15min":0.60099999999999998},"min":{"1min":0.439,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73199999999999998,"5min":1.544,"15min":1.544},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.42299999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75900000000000001,"5min":0.88,"15min":0.88},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59399999999999997,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76600000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56799999999999995,"15min":0.55900000000000005},"min":{"1min":0.48299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.83799999999999997,"15min":0.95199999999999996},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.74299999999999999,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.51800000000000002}]},{"osd":5,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51700000000000002,"15min":0.53500000000000003},"min":{"1min":0.32400000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79600000000000004,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.498},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.621,"15min":0.67100000000000004},"min":{"1min":0.32400000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.76400000000000001,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53300000000000003,"15min":0.54000000000000004},"min":{"1min":0.34599999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70399999999999996,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.628,"15min":0.64800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88700000000000001,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.60599999999999998}]},{"osd":7,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.97899999999999998,"15min":1.1679999999999999},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.86499999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.627},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55200000000000005,"15min":0.55100000000000005},"min":{"1min":0.39200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":412,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194900,"statfs":{"total":200000000,"available":199578020,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.50900000000000001,"15min":0.502},"min":{"1min":0.375,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66300000000000003,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56999999999999995,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.74199999999999999,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":1.847,"15min":1.847},"last":0.746},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58299999999999996,"15min":0.55700000000000005},"min":{"1min":0.45900000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68600000000000005,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.69999999999999996}]},{"osd":2,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53900000000000003,"15min":0.51500000000000001},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.41499999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.752,"5min":1.97,"15min":1.97},"last":0.54500000000000004}]},{"osd":3,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58499999999999996,"15min":0.56299999999999994},"min":{"1min":0.44500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.71099999999999997,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.76300000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68700000000000006}]},{"osd":4,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.746,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72399999999999998,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.46700000000000003}]},{"osd":6,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47599999999999998,"15min":0.47199999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.77200000000000002,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.48699999999999999}]},{"osd":7,"last update":"Sun Dec 24 19:59:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56899999999999995,"15min":0.55100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75800000000000001,"5min":3.766,"15min":3.766},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51600000000000001}]}]}],"pool_statfs":[]}} 2023-12-24T20:00:46.552 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T20:00:46.552 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T20:00:46.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.715+0000 7f924340f700 1 Processor -- start 2023-12-24T20:00:46.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.716+0000 7f924340f700 1 -- start start 2023-12-24T20:00:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.716+0000 7f924340f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c15afd0 0x7f923c0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.716+0000 7f924340f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f923c0cb3d0 0x7f923c0aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.716+0000 7f924340f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c0cb7e0 con 0x7f923c15ac00 2023-12-24T20:00:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.716+0000 7f924340f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c0c8c30 con 0x7f923c0cb3d0 2023-12-24T20:00:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.716+0000 7f924340f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0c7e00 con 0x7f923c15afd0 2023-12-24T20:00:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.716+0000 7f92411ab700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f923c15ac00 0x7f923c0c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44838/0 (socket says 172.21.15.61:44838) 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f92411ab700 1 -- 172.21.15.61:0/4271916666 learned_addr learned my addr 172.21.15.61:0/4271916666 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f92409aa700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c15afd0 0x7f923c0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f92419ac700 1 --2- 172.21.15.61:0/4271916666 >> v2:172.21.15.133:3300/0 conn(0x7f923c0cb3d0 0x7f923c0aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266057579 0 0) 0x7f923c0cb7e0 con 0x7f923c15ac00 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9228003570 con 0x7f923c15ac00 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4170908895 0 0) 0x7f9228003570 con 0x7f923c15ac00 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c15afd0 msgr2=0x7f923c0cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c15afd0 0x7f923c0cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 >> v2:172.21.15.133:3300/0 conn(0x7f923c0cb3d0 msgr2=0x7f923c0aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 --2- 172.21.15.61:0/4271916666 >> v2:172.21.15.133:3300/0 conn(0x7f923c0cb3d0 0x7f923c0aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c0c80b0 con 0x7f923c15ac00 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f922c0015f0 con 0x7f923c15ac00 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 >> v1:172.21.15.61:6789/0 conn(0x7f923c15ac00 legacy=0x7f923c0c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9228003a60 0x7f9228003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228004810 0x7f9228004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c15afd0 0x7f92280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0c8c30 con 0x7f9228003a60 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0c7e00 con 0x7f9228004810 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922800ba60 con 0x7f923c15afd0 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f92411ab700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9228003a60 0x7f9228003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f92419ac700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c15afd0 0x7f92280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.717+0000 7f92409aa700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228004810 0x7f9228004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f92411ab700 1 -- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c15afd0 msgr2=0x7f92280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f92411ab700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c15afd0 0x7f92280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f92411ab700 1 -- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228004810 msgr2=0x7f9228004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f92411ab700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228004810 0x7f9228004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f92411ab700 1 -- 172.21.15.61:0/4271916666 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9228003570 con 0x7f9228003a60 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f92409aa700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228004810 0x7f9228004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:46.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f92419ac700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c15afd0 0x7f92280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f92411ab700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9228003a60 0x7f9228003e70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f922c00c3f0 tx=0x7f923c15a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b071f9f4d3dd6200 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c00cc80 con 0x7f9228003a60 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922c00cde0 con 0x7f9228003a60 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f9233fff700 1 -- 172.21.15.61:0/4271916666 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922c007320 con 0x7f9228003a60 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f924340f700 1 -- 172.21.15.61:0/4271916666 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9228003a60 msgr2=0x7f9228003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f924340f700 1 --2- 172.21.15.61:0/4271916666 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9228003a60 0x7f9228003e70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f922c00c3f0 tx=0x7f923c15a2f0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f92419ac700 1 -- 172.21.15.61:0/4271916666 reap_dead start 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f924340f700 1 -- 172.21.15.61:0/4271916666 shutdown_connections 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.718+0000 7f924340f700 1 -- 172.21.15.61:0/4271916666 >> 172.21.15.61:0/4271916666 conn(0x7f923c0cd0b0 msgr2=0x7f923c0cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.719+0000 7f924340f700 1 -- 172.21.15.61:0/4271916666 shutdown_connections 2023-12-24T20:00:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.719+0000 7f924340f700 1 -- 172.21.15.61:0/4271916666 wait complete. 2023-12-24T20:00:46.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.720+0000 7f924340f700 1 Processor -- start 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.720+0000 7f924340f700 1 -- start start 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f924340f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228003a60 0x7f923c0c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f924340f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c0ad490 0x7f923c0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f924340f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f923c0ad900 0x7f923c0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f924340f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0aff00 con 0x7f923c0ad900 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f924340f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0ade10 con 0x7f9228003a60 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f924340f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0ae0f0 con 0x7f923c0ad490 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92419ac700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f923c0ad900 0x7f923c0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92419ac700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f923c0ad900 0x7f923c0c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50482/0 (socket says 172.21.15.61:50482) 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92419ac700 1 -- 172.21.15.61:0/1007561346 learned_addr learned my addr 172.21.15.61:0/1007561346 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92409aa700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c0ad490 0x7f923c0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92411ab700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228003a60 0x7f923c0c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92419ac700 1 -- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c0ad490 msgr2=0x7f923c0c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92419ac700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c0ad490 0x7f923c0c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92419ac700 1 -- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228003a60 msgr2=0x7f923c0c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92419ac700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228003a60 0x7f923c0c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92419ac700 1 -- 172.21.15.61:0/1007561346 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c0ae3d0 con 0x7f923c0ad900 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92411ab700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228003a60 0x7f923c0c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92419ac700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f923c0ad900 0x7f923c0c6120 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f923c0cab30 tx=0x7f923400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92317fa700 1 -- 172.21.15.61:0/1007561346 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923401b070 con 0x7f923c0ad900 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92317fa700 1 -- 172.21.15.61:0/1007561346 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923400f040 con 0x7f923c0ad900 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f92317fa700 1 -- 172.21.15.61:0/1007561346 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923400e050 con 0x7f923c0ad900 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f924340f700 1 -- 172.21.15.61:0/1007561346 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c0ae6b0 con 0x7f923c0ad900 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.721+0000 7f924340f700 1 -- 172.21.15.61:0/1007561346 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c0c6820 con 0x7f923c0ad900 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.722+0000 7f924340f700 1 -- 172.21.15.61:0/1007561346 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c04c3c0 con 0x7f923c0ad900 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.723+0000 7f92317fa700 1 -- 172.21.15.61:0/1007561346 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9234003020 con 0x7f923c0ad900 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.723+0000 7f92317fa700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9220066f30 0x7f92200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.723+0000 7f92317fa700 1 -- 172.21.15.61:0/1007561346 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92340849d0 con 0x7f923c0ad900 2023-12-24T20:00:46.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.724+0000 7f92411ab700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9220066f30 0x7f92200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:46.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.724+0000 7f92411ab700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9220066f30 0x7f92200693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f922c00c390 tx=0x7f922c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:46.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:46.728+0000 7f92317fa700 1 -- 172.21.15.61:0/1007561346 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9234051ba0 con 0x7f923c0ad900 2023-12-24T20:00:47.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.004+0000 7f924340f700 1 -- 172.21.15.61:0/1007561346 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f923c0c8390 con 0x7f923c0ad900 2023-12-24T20:00:47.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.008+0000 7f92317fa700 1 -- 172.21.15.61:0/1007561346 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9234010ea0 con 0x7f923c0ad900 2023-12-24T20:00:47.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 -- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9220066f30 msgr2=0x7f92200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9220066f30 0x7f92200693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f922c00c390 tx=0x7f922c015000 comp rx=0 tx=0).stop 2023-12-24T20:00:47.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 -- 172.21.15.61:0/1007561346 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f923c0ad900 msgr2=0x7f923c0c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f923c0ad900 0x7f923c0c6120 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f923c0cab30 tx=0x7f923400b040 comp rx=0 tx=0).stop 2023-12-24T20:00:47.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 -- 172.21.15.61:0/1007561346 shutdown_connections 2023-12-24T20:00:47.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9220066f30 0x7f92200693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f923c0ad900 0x7f923c0c6120 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9228003a60 0x7f923c0c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 --2- 172.21.15.61:0/1007561346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f923c0ad490 0x7f923c0c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 -- 172.21.15.61:0/1007561346 >> 172.21.15.61:0/1007561346 conn(0x7f923c0cd0b0 msgr2=0x7f923c06d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:47.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 -- 172.21.15.61:0/1007561346 shutdown_connections 2023-12-24T20:00:47.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.010+0000 7f924340f700 1 -- 172.21.15.61:0/1007561346 wait complete. 2023-12-24T20:00:47.012 INFO:teuthology.orchestra.run.smithi061.stderr:updated caps for client.0 2023-12-24T20:00:47.022 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:00:47.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.147+0000 7f4c4a521700 1 Processor -- start 2023-12-24T20:00:47.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.147+0000 7f4c4a521700 1 -- start start 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c4a521700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c44159e60 0x7f4c440c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c4a521700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4406a090 con 0x7f4c44070d50 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c4a521700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4406ac10 con 0x7f4c44159a90 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c4a521700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4406a2e0 con 0x7f4c44159e60 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c48abe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4c44070d50 0x7f4c440c9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44846/0 (socket says 172.21.15.61:44846) 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c48abe700 1 -- 172.21.15.61:0/1452556238 learned_addr learned my addr 172.21.15.61:0/1452556238 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c437fe700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c44159e60 0x7f4c440c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413675950 0 0) 0x7f4c4406a090 con 0x7f4c44070d50 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c2c003570 con 0x7f4c44070d50 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063311798 0 0) 0x7f4c4406ac10 con 0x7f4c44159a90 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c4406a090 con 0x7f4c44159a90 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4013713603 0 0) 0x7f4c2c003570 con 0x7f4c44070d50 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c44159e60 msgr2=0x7f4c440c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c44159e60 0x7f4c440c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 >> v1:172.21.15.133:6789/0 conn(0x7f4c44159a90 legacy=0x7f4c44070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4406a5c0 con 0x7f4c44070d50 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f4c3c0017f0 con 0x7f4c44070d50 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 >> v1:172.21.15.61:6789/0 conn(0x7f4c44070d50 legacy=0x7f4c440c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c2c003c20 0x7f4c2c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c2c004810 0x7f4c2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.148+0000 7f4c42ffd700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c2c0051c0 0x7f4c2c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4406a2e0 con 0x7f4c2c003c20 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c00c020 con 0x7f4c2c004810 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c00c1e0 con 0x7f4c2c0051c0 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c437fe700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c44159e60 0x7f4c440c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c43fff700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c2c003c20 0x7f4c2c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c48abe700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c2c0051c0 0x7f4c2c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c437fe700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c2c004810 0x7f4c2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c43fff700 1 -- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c2c0051c0 msgr2=0x7f4c2c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c43fff700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c2c0051c0 0x7f4c2c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c43fff700 1 -- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c2c004810 msgr2=0x7f4c2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c43fff700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c2c004810 0x7f4c2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c43fff700 1 -- 172.21.15.61:0/1452556238 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c003570 con 0x7f4c2c003c20 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c437fe700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c2c004810 0x7f4c2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c43fff700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c2c003c20 0x7f4c2c004010 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4c34001a20 tx=0x7f4c34007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cf8fc5a49249ac server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c340013b0 con 0x7f4c2c003c20 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3400c5d0 con 0x7f4c2c003c20 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.149+0000 7f4c42ffd700 1 -- 172.21.15.61:0/1452556238 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3400c990 con 0x7f4c2c003c20 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.150+0000 7f4c4a521700 1 -- 172.21.15.61:0/1452556238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c2c003c20 msgr2=0x7f4c2c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.150+0000 7f4c4a521700 1 --2- 172.21.15.61:0/1452556238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c2c003c20 0x7f4c2c004010 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4c34001a20 tx=0x7f4c34007cf0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.150+0000 7f4c48abe700 1 -- 172.21.15.61:0/1452556238 reap_dead start 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.150+0000 7f4c4a521700 1 -- 172.21.15.61:0/1452556238 shutdown_connections 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.150+0000 7f4c4a521700 1 -- 172.21.15.61:0/1452556238 >> 172.21.15.61:0/1452556238 conn(0x7f4c440cd6f0 msgr2=0x7f4c440cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:47.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.150+0000 7f4c4a521700 1 -- 172.21.15.61:0/1452556238 shutdown_connections 2023-12-24T20:00:47.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.150+0000 7f4c4a521700 1 -- 172.21.15.61:0/1452556238 wait complete. 2023-12-24T20:00:47.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.151+0000 7f4c4a521700 1 Processor -- start 2023-12-24T20:00:47.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.151+0000 7f4c4a521700 1 -- start start 2023-12-24T20:00:47.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c4a521700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c2c003c20 0x7f4c4415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c4a521700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c4415bf10 0x7f4c44154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c4a521700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c440b1470 0x7f4c440b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c4a521700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440b1e10 con 0x7f4c4415bf10 2023-12-24T20:00:47.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c4a521700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4415b180 con 0x7f4c440b1470 2023-12-24T20:00:47.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c4a521700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4415c380 con 0x7f4c2c003c20 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c437fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c4415bf10 0x7f4c44154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c437fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c4415bf10 0x7f4c44154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50490/0 (socket says 172.21.15.61:50490) 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c437fe700 1 -- 172.21.15.61:0/2954299094 learned_addr learned my addr 172.21.15.61:0/2954299094 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c43fff700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c2c003c20 0x7f4c4415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c48abe700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c440b1470 0x7f4c440b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c437fe700 1 -- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c2c003c20 msgr2=0x7f4c4415ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c437fe700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c2c003c20 0x7f4c4415ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c437fe700 1 -- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c440b1470 msgr2=0x7f4c440b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c437fe700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c440b1470 0x7f4c440b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c437fe700 1 -- 172.21.15.61:0/2954299094 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4415c660 con 0x7f4c4415bf10 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.152+0000 7f4c437fe700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c4415bf10 0x7f4c44154f30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4c38010c50 tx=0x7f4c38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.153+0000 7f4c2bfff700 1 -- 172.21.15.61:0/2954299094 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800e900 con 0x7f4c4415bf10 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.153+0000 7f4c2bfff700 1 -- 172.21.15.61:0/2954299094 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3800ea60 con 0x7f4c4415bf10 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.153+0000 7f4c4a521700 1 -- 172.21.15.61:0/2954299094 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4415c940 con 0x7f4c4415bf10 2023-12-24T20:00:47.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.153+0000 7f4c2bfff700 1 -- 172.21.15.61:0/2954299094 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800ee20 con 0x7f4c4415bf10 2023-12-24T20:00:47.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.153+0000 7f4c4a521700 1 -- 172.21.15.61:0/2954299094 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4415cf00 con 0x7f4c4415bf10 2023-12-24T20:00:47.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.154+0000 7f4c4a521700 1 -- 172.21.15.61:0/2954299094 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4404c3c0 con 0x7f4c4415bf10 2023-12-24T20:00:47.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.154+0000 7f4c2bfff700 1 -- 172.21.15.61:0/2954299094 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4c3801c610 con 0x7f4c4415bf10 2023-12-24T20:00:47.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.154+0000 7f4c2bfff700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c30066f30 0x7f4c300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.155+0000 7f4c2bfff700 1 -- 172.21.15.61:0/2954299094 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c38084990 con 0x7f4c4415bf10 2023-12-24T20:00:47.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.155+0000 7f4c43fff700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c30066f30 0x7f4c300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.155+0000 7f4c43fff700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c30066f30 0x7f4c300693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4c34001a20 tx=0x7f4c34015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:47.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.159+0000 7f4c2bfff700 1 -- 172.21.15.61:0/2954299094 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c38051c00 con 0x7f4c4415bf10 2023-12-24T20:00:47.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.399+0000 7f4c4a521700 1 -- 172.21.15.61:0/2954299094 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c4406a8a0 con 0x7f4c4415bf10 2023-12-24T20:00:47.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.400+0000 7f4c2bfff700 1 -- 172.21.15.61:0/2954299094 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f4c38055220 con 0x7f4c4415bf10 2023-12-24T20:00:47.400 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:47.400 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/3462396702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3462396702},{"type":"v1","addr":"172.21.15.61:6835","nonce":3462396702}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2539986874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2539986874},{"type":"v1","addr":"172.21.15.133:6836","nonce":2539986874}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":5611,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/118195153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":118195153},{"type":"v1","addr":"172.21.15.133:6837","nonce":118195153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:00:41.409889+0000","modified":"2023-12-24T20:00:45.042959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5994":{"gid":5994,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/761559894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":761559894},{"type":"v1","addr":"172.21.15.61:6834","nonce":761559894}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T20:00:47.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 -- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c30066f30 msgr2=0x7f4c300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c30066f30 0x7f4c300693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4c34001a20 tx=0x7f4c34015000 comp rx=0 tx=0).stop 2023-12-24T20:00:47.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 -- 172.21.15.61:0/2954299094 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c4415bf10 msgr2=0x7f4c44154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c4415bf10 0x7f4c44154f30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4c38010c50 tx=0x7f4c38008040 comp rx=0 tx=0).stop 2023-12-24T20:00:47.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 -- 172.21.15.61:0/2954299094 shutdown_connections 2023-12-24T20:00:47.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c2c003c20 0x7f4c4415ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c30066f30 0x7f4c300693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c440b1470 0x7f4c440b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 --2- 172.21.15.61:0/2954299094 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c4415bf10 0x7f4c44154f30 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 -- 172.21.15.61:0/2954299094 >> 172.21.15.61:0/2954299094 conn(0x7f4c440cd6f0 msgr2=0x7f4c44157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:47.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 -- 172.21.15.61:0/2954299094 shutdown_connections 2023-12-24T20:00:47.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.402+0000 7f4c4a521700 1 -- 172.21.15.61:0/2954299094 wait complete. 2023-12-24T20:00:47.403 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 44 2023-12-24T20:00:47.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T20:00:41.409889+0000', 'modified': '2023-12-24T20:00:45.042959+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5994}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5994': {'gid': 5994, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.61:6834/761559894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.61:6832', 'nonce': 761559894}, {'type': 'v1', 'addr': '172.21.15.61:6834', 'nonce': 761559894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T20:00:47.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T20:00:47.817 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-24T20:00:47.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.941+0000 7f3e547ec700 1 Processor -- start 2023-12-24T20:00:47.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.941+0000 7f3e547ec700 1 -- start start 2023-12-24T20:00:47.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.942+0000 7f3e547ec700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3e4c0cb640 0x7f3e4c068d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.942+0000 7f3e547ec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3e4c0b17c0 0x7f3e4c159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.942+0000 7f3e547ec700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c15e970 con 0x7f3e4c0692b0 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.942+0000 7f3e547ec700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c15da80 con 0x7f3e4c0cb640 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.942+0000 7f3e547ec700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c15dd60 con 0x7f3e4c0b17c0 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.942+0000 7f3e52588700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3e4c0cb640 0x7f3e4c068d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.942+0000 7f3e52588700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3e4c0cb640 0x7f3e4c068d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50496/0 (socket says 172.21.15.61:50496) 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.942+0000 7f3e52588700 1 -- 172.21.15.61:0/3494447583 learned_addr learned my addr 172.21.15.61:0/3494447583 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.943+0000 7f3e51d87700 1 --2- 172.21.15.61:0/3494447583 >> v2:172.21.15.133:3300/0 conn(0x7f3e4c0b17c0 0x7f3e4c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.943+0000 7f3e52588700 1 -- 172.21.15.61:0/3494447583 >> v2:172.21.15.133:3300/0 conn(0x7f3e4c0b17c0 msgr2=0x7f3e4c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.943+0000 7f3e52588700 1 --2- 172.21.15.61:0/3494447583 >> v2:172.21.15.133:3300/0 conn(0x7f3e4c0b17c0 0x7f3e4c159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.943+0000 7f3e52588700 1 -- 172.21.15.61:0/3494447583 >> v1:172.21.15.133:6789/0 conn(0x7f3e4c0692b0 legacy=0x7f3e4c159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.943+0000 7f3e52588700 1 -- 172.21.15.61:0/3494447583 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c15e040 con 0x7f3e4c0cb640 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.943+0000 7f3e52588700 1 --2- 172.21.15.61:0/3494447583 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 0x7f3e4c068d70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0c23f0 tx=0x7f3e3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a89b5af83f8dc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.943+0000 7f3e51586700 1 -- 172.21.15.61:0/3494447583 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00b820 con 0x7f3e4c0cb640 2023-12-24T20:00:47.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.943+0000 7f3e51586700 1 -- 172.21.15.61:0/3494447583 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c00b980 con 0x7f3e4c0cb640 2023-12-24T20:00:47.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.943+0000 7f3e51586700 1 -- 172.21.15.61:0/3494447583 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00bd20 con 0x7f3e4c0cb640 2023-12-24T20:00:47.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.944+0000 7f3e547ec700 1 -- 172.21.15.61:0/3494447583 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 msgr2=0x7f3e4c068d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.944+0000 7f3e547ec700 1 --2- 172.21.15.61:0/3494447583 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 0x7f3e4c068d70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0c23f0 tx=0x7f3e3c009250 comp rx=0 tx=0).stop 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.944+0000 7f3e547ec700 1 -- 172.21.15.61:0/3494447583 shutdown_connections 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.944+0000 7f3e547ec700 1 --2- 172.21.15.61:0/3494447583 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 0x7f3e4c068d70 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.944+0000 7f3e547ec700 1 --2- 172.21.15.61:0/3494447583 >> v2:172.21.15.133:3300/0 conn(0x7f3e4c0b17c0 0x7f3e4c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.944+0000 7f3e547ec700 1 -- 172.21.15.61:0/3494447583 >> 172.21.15.61:0/3494447583 conn(0x7f3e4c069760 msgr2=0x7f3e4c069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.944+0000 7f3e547ec700 1 -- 172.21.15.61:0/3494447583 shutdown_connections 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.944+0000 7f3e547ec700 1 -- 172.21.15.61:0/3494447583 wait complete. 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.945+0000 7f3e547ec700 1 Processor -- start 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.945+0000 7f3e547ec700 1 -- start start 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e547ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c0692b0 0x7f3e4c0c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e547ec700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c0b17c0 0x7f3e4c14d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e547ec700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 0x7f3e4c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e547ec700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c16b400 con 0x7f3e4c0cb640 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e547ec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c16ac40 con 0x7f3e4c0692b0 2023-12-24T20:00:47.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e547ec700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c16b8d0 con 0x7f3e4c0b17c0 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52d89700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 0x7f3e4c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52d89700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 0x7f3e4c067830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50510/0 (socket says 172.21.15.61:50510) 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52d89700 1 -- 172.21.15.61:0/1100135013 learned_addr learned my addr 172.21.15.61:0/1100135013 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e51d87700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c0b17c0 0x7f3e4c14d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52588700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c0692b0 0x7f3e4c0c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52d89700 1 -- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c0b17c0 msgr2=0x7f3e4c14d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52d89700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c0b17c0 0x7f3e4c14d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52d89700 1 -- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c0692b0 msgr2=0x7f3e4c0c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52d89700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c0692b0 0x7f3e4c0c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52d89700 1 -- 172.21.15.61:0/1100135013 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0094f0 con 0x7f3e4c0cb640 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52588700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c0692b0 0x7f3e4c0c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e52d89700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 0x7f3e4c067830 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400bb80 tx=0x7f3e44009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e427fc700 1 -- 172.21.15.61:0/1100135013 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400c8c0 con 0x7f3e4c0cb640 2023-12-24T20:00:47.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e427fc700 1 -- 172.21.15.61:0/1100135013 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400ca20 con 0x7f3e4c0cb640 2023-12-24T20:00:47.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e547ec700 1 -- 172.21.15.61:0/1100135013 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0c6980 con 0x7f3e4c0cb640 2023-12-24T20:00:47.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e427fc700 1 -- 172.21.15.61:0/1100135013 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400cde0 con 0x7f3e4c0cb640 2023-12-24T20:00:47.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.946+0000 7f3e547ec700 1 -- 172.21.15.61:0/1100135013 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c16b1a0 con 0x7f3e4c0cb640 2023-12-24T20:00:47.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.948+0000 7f3e427fc700 1 -- 172.21.15.61:0/1100135013 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3e44014620 con 0x7f3e4c0cb640 2023-12-24T20:00:47.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.948+0000 7f3e427fc700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3e30066f30 0x7f3e300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.949+0000 7f3e427fc700 1 -- 172.21.15.61:0/1100135013 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e440845f0 con 0x7f3e4c0cb640 2023-12-24T20:00:47.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.949+0000 7f3e52588700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3e30066f30 0x7f3e300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.949+0000 7f3e52588700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3e30066f30 0x7f3e300693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0c23f0 tx=0x7f3e3c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:47.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.950+0000 7f3e5daecb80 1 Processor -- start 2023-12-24T20:00:47.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.950+0000 7f3e5daecb80 1 -- start start 2023-12-24T20:00:47.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba887c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba887e3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba886f53e0 con 0x55ba887c6fa0 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba886f2be0 con 0x55ba887c3170 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba886ee9d0 con 0x55ba887c78b0 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e52588700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e52588700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50516/0 (socket says 172.21.15.61:50516) 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e52588700 1 -- 172.21.15.61:0/2778231018 learned_addr learned my addr 172.21.15.61:0/2778231018 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e52d89700 1 --2- 172.21.15.61:0/2778231018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba887e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.951+0000 7f3e51d87700 1 --2- 172.21.15.61:0/2778231018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba887c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.952+0000 7f3e52588700 1 -- 172.21.15.61:0/2778231018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 msgr2=0x55ba887c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.952+0000 7f3e52588700 1 --2- 172.21.15.61:0/2778231018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba887c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.952+0000 7f3e52588700 1 -- 172.21.15.61:0/2778231018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 msgr2=0x55ba887e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.952+0000 7f3e52588700 1 --2- 172.21.15.61:0/2778231018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba887e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.952+0000 7f3e52588700 1 -- 172.21.15.61:0/2778231018 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba88582360 con 0x55ba887c6fa0 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.952+0000 7f3e52588700 1 --2- 172.21.15.61:0/2778231018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c7370 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00b3c0 tx=0x7f3e3c01f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9874e8c7e4ec09bd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:47.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.952+0000 7f3e2f7fe700 1 -- 172.21.15.61:0/2778231018 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00bc80 con 0x55ba887c6fa0 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.952+0000 7f3e2f7fe700 1 -- 172.21.15.61:0/2778231018 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c011ac0 con 0x55ba887c6fa0 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.952+0000 7f3e2f7fe700 1 -- 172.21.15.61:0/2778231018 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c011e40 con 0x55ba887c6fa0 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2778231018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 msgr2=0x55ba887c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/2778231018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c7370 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00b3c0 tx=0x7f3e3c01f040 comp rx=0 tx=0).stop 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2778231018 shutdown_connections 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/2778231018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba887e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/2778231018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c7370 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/2778231018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba887c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2778231018 >> 172.21.15.61:0/2778231018 conn(0x55ba8879d440 msgr2=0x55ba887e8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2778231018 shutdown_connections 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2778231018 wait complete. 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 -- start start 2023-12-24T20:00:47.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.953+0000 7f3e5daecb80 1 Processor -- start 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.954+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba887f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.954+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.954+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba887c6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.954+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8869b1b0 con 0x55ba887c6fa0 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.954+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8869ae50 con 0x55ba887c3170 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.954+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba885e7e40 con 0x55ba887c78b0 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.954+0000 7f3e5daecb80 10 client.0 _ll_register_callbacks cb 0x55ba885ea7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.954+0000 7f3e51d87700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e51d87700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50528/0 (socket says 172.21.15.61:50528) 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e51d87700 1 -- 172.21.15.61:0/2097907952 learned_addr learned my addr 172.21.15.61:0/2097907952 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:47.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e52d89700 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba887c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e52588700 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba887f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e51d87700 1 -- 172.21.15.61:0/2097907952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 msgr2=0x55ba887c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e51d87700 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba887c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e51d87700 1 -- 172.21.15.61:0/2097907952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 msgr2=0x55ba887f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e51d87700 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba887f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e51d87700 1 -- 172.21.15.61:0/2097907952 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c023070 con 0x55ba887c6fa0 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e52d89700 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba887c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e51d87700 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c6100 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3e480129b0 tx=0x7f3e48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4cef3f2aab6b16 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e2cff9700 1 -- 172.21.15.61:0/2097907952 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e480146f0 con 0x55ba887c6fa0 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e2cff9700 1 -- 172.21.15.61:0/2097907952 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e48018070 con 0x55ba887c6fa0 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2097907952 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba8876feb0 con 0x55ba887c6fa0 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e2cff9700 1 -- 172.21.15.61:0/2097907952 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e48014a60 con 0x55ba887c6fa0 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e5daecb80 10 client.6138 fetch_fsmap learned FSMap version 44 2023-12-24T20:00:47.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2097907952 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55ba8852eb10 con 0x55ba887c6fa0 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e2cff9700 1 -- 172.21.15.61:0/2097907952 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ba8876feb0 con 0x55ba887c6fa0 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.955+0000 7f3e2cff9700 1 -- 172.21.15.61:0/2097907952 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3e48014bc0 con 0x55ba887c6fa0 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.956+0000 7f3e5daecb80 10 client.6138 fetch_fsmap finished waiting for FSMap version 44 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.956+0000 7f3e5daecb80 10 client.6138 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.956+0000 7f3e5daecb80 20 client.6138 populate_metadata read hostname 'smithi061' 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.956+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.61:6832/761559894,v1:172.21.15.61:6834/761559894] conn(0x55ba887dee90 0x55ba887c4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.956+0000 7f3e5daecb80 4 client.6138 mds_command: new command op to 5994 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.956+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2097907952 --> [v2:172.21.15.61:6832/761559894,v1:172.21.15.61:6834/761559894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba886c5880 con 0x55ba887dee90 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.956+0000 7f3e52588700 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.61:6832/761559894,v1:172.21.15.61:6834/761559894] conn(0x55ba887dee90 0x55ba887c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.956+0000 7f3e2cff9700 10 client.6138 ms_handle_connect on v2:172.21.15.61:6832/761559894 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.956+0000 7f3e52588700 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.61:6832/761559894,v1:172.21.15.61:6834/761559894] conn(0x55ba887dee90 0x55ba887c4940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f42d02161d17a8f5 server_cookie=7c3456d8af93ed60 in_seq=0 out_seq=0 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e2cff9700 1 -- 172.21.15.61:0/2097907952 <== mds.0 v2:172.21.15.61:6832/761559894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ba886c5880 con 0x55ba887dee90 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e2cff9700 10 client.6138 handle_command_reply: tid=0 2023-12-24T20:00:47.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 client.6138 shutdown 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2097907952 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 msgr2=0x55ba887c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c6100 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3e480129b0 tx=0x7f3e48008040 comp rx=0 tx=0).stop 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2097907952 shutdown_connections 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.61:6832/761559894,v1:172.21.15.61:6834/761559894] conn(0x55ba887dee90 0x55ba887c4940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba887c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba887f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e2cff9700 0 client.6138 ms_handle_reset on v2:172.21.15.61:6832/761559894 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/2097907952 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba887c6100 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2097907952 >> 172.21.15.61:0/2097907952 conn(0x55ba8879d440 msgr2=0x55ba887c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2097907952 shutdown_connections 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 1 -- 172.21.15.61:0/2097907952 wait complete. 2023-12-24T20:00:47.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.957+0000 7f3e5daecb80 20 client.6138 trim_cache size 0 max 16384 2023-12-24T20:00:47.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.974+0000 7f3e5daecb80 1 Processor -- start 2023-12-24T20:00:47.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.974+0000 7f3e5daecb80 1 -- start start 2023-12-24T20:00:47.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c3170 0x55ba8879b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c6fa0 0x55ba8879bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c78b0 0x55ba887a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba887dfc50 con 0x55ba887c78b0 2023-12-24T20:00:47.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8879e0a0 con 0x55ba887c6fa0 2023-12-24T20:00:47.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba887e0670 con 0x55ba887c3170 2023-12-24T20:00:47.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e52d89700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c78b0 0x55ba887a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e52d89700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c78b0 0x55ba887a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50538/0 (socket says 172.21.15.61:50538) 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e52d89700 1 -- 172.21.15.61:0/153807293 learned_addr learned my addr 172.21.15.61:0/153807293 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e52588700 1 --2- 172.21.15.61:0/153807293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c3170 0x55ba8879b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e51d87700 1 --2- 172.21.15.61:0/153807293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c6fa0 0x55ba8879bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e52d89700 1 -- 172.21.15.61:0/153807293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c3170 msgr2=0x55ba8879b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e52d89700 1 --2- 172.21.15.61:0/153807293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c3170 0x55ba8879b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e52d89700 1 -- 172.21.15.61:0/153807293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c6fa0 msgr2=0x55ba8879bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e52d89700 1 --2- 172.21.15.61:0/153807293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c6fa0 0x55ba8879bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e52d89700 1 -- 172.21.15.61:0/153807293 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba8879c990 con 0x55ba887c78b0 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e51d87700 1 --2- 172.21.15.61:0/153807293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c6fa0 0x55ba8879bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.975+0000 7f3e52d89700 1 --2- 172.21.15.61:0/153807293 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c78b0 0x55ba887a03c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3e44082bc0 tx=0x7f3e4400e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d41abee4ff8872b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e2ffff700 1 -- 172.21.15.61:0/153807293 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4405c4c0 con 0x55ba887c78b0 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e2ffff700 1 -- 172.21.15.61:0/153807293 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e44053660 con 0x55ba887c78b0 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e2ffff700 1 -- 172.21.15.61:0/153807293 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44054a10 con 0x55ba887c78b0 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e5daecb80 1 -- 172.21.15.61:0/153807293 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c78b0 msgr2=0x55ba887a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/153807293 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c78b0 0x55ba887a03c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3e44082bc0 tx=0x7f3e4400e040 comp rx=0 tx=0).stop 2023-12-24T20:00:47.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e5daecb80 1 -- 172.21.15.61:0/153807293 shutdown_connections 2023-12-24T20:00:47.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/153807293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c3170 0x55ba8879b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/153807293 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c78b0 0x55ba887a03c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/153807293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c6fa0 0x55ba8879bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e5daecb80 1 -- 172.21.15.61:0/153807293 >> 172.21.15.61:0/153807293 conn(0x55ba8879d440 msgr2=0x55ba887c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:47.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e5daecb80 1 -- 172.21.15.61:0/153807293 shutdown_connections 2023-12-24T20:00:47.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.976+0000 7f3e5daecb80 1 -- 172.21.15.61:0/153807293 wait complete. 2023-12-24T20:00:47.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.977+0000 7f3e5daecb80 1 -- start start 2023-12-24T20:00:47.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.977+0000 7f3e5daecb80 1 Processor -- start 2023-12-24T20:00:47.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba8884e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba88833680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e5daecb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba8879b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba88833bc0 con 0x55ba887c6fa0 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8879fd60 con 0x55ba887c3170 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e5daecb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba887a01c0 con 0x55ba887c78b0 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e5daecb80 10 client.0 _ll_register_callbacks cb 0x7f3e4800ae50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e51d87700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba88833680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e51d87700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba88833680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50544/0 (socket says 172.21.15.61:50544) 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e51d87700 1 -- 172.21.15.61:0/821977244 learned_addr learned my addr 172.21.15.61:0/821977244 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e52d89700 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba8879b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e52588700 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba8884e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e51d87700 1 -- 172.21.15.61:0/821977244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 msgr2=0x55ba8879b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e51d87700 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba8879b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e51d87700 1 -- 172.21.15.61:0/821977244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 msgr2=0x55ba8884e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e51d87700 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba8884e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e51d87700 1 -- 172.21.15.61:0/821977244 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c16b1a0 con 0x55ba887c6fa0 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e52588700 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba8884e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e51d87700 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba88833680 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3e480129b0 tx=0x7f3e48023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef370f7fd2dcc283 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.978+0000 7f3e2cff9700 1 -- 172.21.15.61:0/821977244 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48014c70 con 0x55ba887c6fa0 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e2cff9700 1 -- 172.21.15.61:0/821977244 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3e4801d570 con 0x55ba887c6fa0 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e5daecb80 1 -- 172.21.15.61:0/821977244 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba887c6c00 con 0x55ba887c6fa0 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e2cff9700 1 -- 172.21.15.61:0/821977244 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e4801d960 con 0x55ba887c6fa0 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e5daecb80 10 client.6144 fetch_fsmap learned FSMap version 44 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e5daecb80 1 -- 172.21.15.61:0/821977244 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x55ba886bd290 con 0x55ba887c6fa0 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e2cff9700 1 -- 172.21.15.61:0/821977244 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ba887c6c00 con 0x55ba887c6fa0 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e2cff9700 1 -- 172.21.15.61:0/821977244 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 44) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3e4801dac0 con 0x55ba887c6fa0 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e5daecb80 10 client.6144 fetch_fsmap finished waiting for FSMap version 44 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e5daecb80 10 client.6144 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e5daecb80 20 client.6144 populate_metadata read hostname 'smithi061' 2023-12-24T20:00:47.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.61:6832/761559894,v1:172.21.15.61:6834/761559894] conn(0x55ba887db6f0 0x55ba887dbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e5daecb80 4 client.6144 mds_command: new command op to 5994 tid=0[{"prefix": "status"}] 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e5daecb80 1 -- 172.21.15.61:0/821977244 --> [v2:172.21.15.61:6832/761559894,v1:172.21.15.61:6834/761559894] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ba88793490 con 0x55ba887db6f0 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e52588700 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.61:6832/761559894,v1:172.21.15.61:6834/761559894] conn(0x55ba887db6f0 0x55ba887dbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e52588700 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.61:6832/761559894,v1:172.21.15.61:6834/761559894] conn(0x55ba887db6f0 0x55ba887dbac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1b9e6f2a0ee30cd server_cookie=f77b15ba85b68766 in_seq=0 out_seq=0 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.979+0000 7f3e2cff9700 10 client.6144 ms_handle_connect on v2:172.21.15.61:6832/761559894 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e2cff9700 1 -- 172.21.15.61:0/821977244 <== mds.0 v2:172.21.15.61:6832/761559894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55ba88793490 con 0x55ba887db6f0 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e2cff9700 10 client.6144 handle_command_reply: tid=0 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 client.6144 shutdown 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 -- 172.21.15.61:0/821977244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 msgr2=0x55ba88833680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba88833680 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3e480129b0 tx=0x7f3e48023000 comp rx=0 tx=0).stop 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 -- 172.21.15.61:0/821977244 shutdown_connections 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.61:6832/761559894,v1:172.21.15.61:6834/761559894] conn(0x55ba887db6f0 0x55ba887dbac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55ba887c78b0 0x55ba8879b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55ba887c3170 0x55ba8884e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e2cff9700 0 client.6144 ms_handle_reset on v2:172.21.15.61:6832/761559894 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 --2- 172.21.15.61:0/821977244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55ba887c6fa0 0x55ba88833680 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 -- 172.21.15.61:0/821977244 >> 172.21.15.61:0/821977244 conn(0x55ba8879d440 msgr2=0x55ba88794700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 -- 172.21.15.61:0/821977244 shutdown_connections 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 1 -- 172.21.15.61:0/821977244 wait complete. 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e5daecb80 20 client.6144 trim_cache size 0 max 16384 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 5994, 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T20:00:47.986 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T20:00:47.987 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 5.9736818359999999, 2023-12-24T20:00:47.987 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 44, 2023-12-24T20:00:47.987 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 80, 2023-12-24T20:00:47.987 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 80, 2023-12-24T20:00:47.987 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 10.857528686 2023-12-24T20:00:47.987 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e547ec700 1 -- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3e30066f30 msgr2=0x7f3e300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e547ec700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3e30066f30 0x7f3e300693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0c23f0 tx=0x7f3e3c016000 comp rx=0 tx=0).stop 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e547ec700 1 -- 172.21.15.61:0/1100135013 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 msgr2=0x7f3e4c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e547ec700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 0x7f3e4c067830 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400bb80 tx=0x7f3e44009810 comp rx=0 tx=0).stop 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e547ec700 1 -- 172.21.15.61:0/1100135013 shutdown_connections 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e547ec700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3e30066f30 0x7f3e300693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.980+0000 7f3e547ec700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3e4c0cb640 0x7f3e4c067830 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.981+0000 7f3e547ec700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e4c0692b0 0x7f3e4c0c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.981+0000 7f3e547ec700 1 --2- 172.21.15.61:0/1100135013 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e4c0b17c0 0x7f3e4c14d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.981+0000 7f3e547ec700 1 -- 172.21.15.61:0/1100135013 >> 172.21.15.61:0/1100135013 conn(0x7f3e4c069760 msgr2=0x7f3e4c069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.981+0000 7f3e547ec700 1 -- 172.21.15.61:0/1100135013 shutdown_connections 2023-12-24T20:00:47.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:47.981+0000 7f3e547ec700 1 -- 172.21.15.61:0/1100135013 wait complete. 2023-12-24T20:00:47.993 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:00:48.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.114+0000 7f68c7f33700 1 Processor -- start 2023-12-24T20:00:48.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.114+0000 7f68c7f33700 1 -- start start 2023-12-24T20:00:48.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c7f33700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68c00b2660 0x7f68c015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:48.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c7f33700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f68c015c470 0x7f68c00b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:48.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c7f33700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c00b2eb0 con 0x7f68c015bb60 2023-12-24T20:00:48.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c7f33700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c00afc20 con 0x7f68c015c470 2023-12-24T20:00:48.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c7f33700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00b2bd0 con 0x7f68c00b2660 2023-12-24T20:00:48.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c64d0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f68c015c470 0x7f68c00b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:48.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c64d0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f68c015c470 0x7f68c00b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50558/0 (socket says 172.21.15.61:50558) 2023-12-24T20:00:48.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c64d0700 1 -- 172.21.15.61:0/140093697 learned_addr learned my addr 172.21.15.61:0/140093697 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:48.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c54ce700 1 --2- 172.21.15.61:0/140093697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68c00b2660 0x7f68c015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:48.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c64d0700 1 -- 172.21.15.61:0/140093697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68c00b2660 msgr2=0x7f68c015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:48.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.115+0000 7f68c64d0700 1 --2- 172.21.15.61:0/140093697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68c00b2660 0x7f68c015bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:48.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c64d0700 1 -- 172.21.15.61:0/140093697 >> v1:172.21.15.133:6789/0 conn(0x7f68c015bb60 legacy=0x7f68c0098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:48.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c64d0700 1 -- 172.21.15.61:0/140093697 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00afe10 con 0x7f68c015c470 2023-12-24T20:00:48.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c64d0700 1 --2- 172.21.15.61:0/140093697 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c015c470 0x7f68c00b08f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009f20 tx=0x7f68b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4ad35903cb6530 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:48.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c4ccd700 1 -- 172.21.15.61:0/140093697 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800e070 con 0x7f68c015c470 2023-12-24T20:00:48.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c4ccd700 1 -- 172.21.15.61:0/140093697 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b800ba40 con 0x7f68c015c470 2023-12-24T20:00:48.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c4ccd700 1 -- 172.21.15.61:0/140093697 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b80092e0 con 0x7f68c015c470 2023-12-24T20:00:48.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c7f33700 1 -- 172.21.15.61:0/140093697 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c015c470 msgr2=0x7f68c00b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:48.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c7f33700 1 --2- 172.21.15.61:0/140093697 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c015c470 0x7f68c00b08f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009f20 tx=0x7f68b8009840 comp rx=0 tx=0).stop 2023-12-24T20:00:48.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c7f33700 1 -- 172.21.15.61:0/140093697 shutdown_connections 2023-12-24T20:00:48.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c7f33700 1 --2- 172.21.15.61:0/140093697 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c015c470 0x7f68c00b08f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:48.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c7f33700 1 --2- 172.21.15.61:0/140093697 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68c00b2660 0x7f68c015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:48.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.116+0000 7f68c7f33700 1 -- 172.21.15.61:0/140093697 >> 172.21.15.61:0/140093697 conn(0x7f68c0097a10 msgr2=0x7f68c00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:48.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.117+0000 7f68c7f33700 1 -- 172.21.15.61:0/140093697 shutdown_connections 2023-12-24T20:00:48.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.117+0000 7f68c7f33700 1 -- 172.21.15.61:0/140093697 wait complete. 2023-12-24T20:00:48.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.118+0000 7f68c7f33700 1 Processor -- start 2023-12-24T20:00:48.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.118+0000 7f68c7f33700 1 -- start start 2023-12-24T20:00:48.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.118+0000 7f68c7f33700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c00b2660 0x7f68c016dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:48.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.118+0000 7f68c7f33700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68c015bb60 0x7f68c016a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:48.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.118+0000 7f68c7f33700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c015c470 0x7f68c0068560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:48.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.118+0000 7f68c7f33700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0067550 con 0x7f68c00b2660 2023-12-24T20:00:48.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.118+0000 7f68c7f33700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00680d0 con 0x7f68c015c470 2023-12-24T20:00:48.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.118+0000 7f68c7f33700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00677a0 con 0x7f68c015bb60 2023-12-24T20:00:48.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c5ccf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c00b2660 0x7f68c016dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:48.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c5ccf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c00b2660 0x7f68c016dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50570/0 (socket says 172.21.15.61:50570) 2023-12-24T20:00:48.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c5ccf700 1 -- 172.21.15.61:0/1032303657 learned_addr learned my addr 172.21.15.61:0/1032303657 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:48.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c64d0700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c015c470 0x7f68c0068560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c54ce700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68c015bb60 0x7f68c016a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c5ccf700 1 -- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68c015bb60 msgr2=0x7f68c016a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c5ccf700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68c015bb60 0x7f68c016a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c5ccf700 1 -- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c015c470 msgr2=0x7f68c0068560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c5ccf700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c015c470 0x7f68c0068560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c5ccf700 1 -- 172.21.15.61:0/1032303657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8009ae0 con 0x7f68c00b2660 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c64d0700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c015c470 0x7f68c0068560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c5ccf700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c00b2660 0x7f68c016dbe0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f68b000c5b0 tx=0x7f68b00020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68b5ffb700 1 -- 172.21.15.61:0/1032303657 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011590 con 0x7f68c00b2660 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68b5ffb700 1 -- 172.21.15.61:0/1032303657 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b00116f0 con 0x7f68c00b2660 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68c7f33700 1 -- 172.21.15.61:0/1032303657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c0067a80 con 0x7f68c00b2660 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.119+0000 7f68b5ffb700 1 -- 172.21.15.61:0/1032303657 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0011a90 con 0x7f68c00b2660 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.120+0000 7f68c7f33700 1 -- 172.21.15.61:0/1032303657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c016e120 con 0x7f68c00b2660 2023-12-24T20:00:48.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.120+0000 7f68c7f33700 1 -- 172.21.15.61:0/1032303657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c016e340 con 0x7f68c00b2660 2023-12-24T20:00:48.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.121+0000 7f68b5ffb700 1 -- 172.21.15.61:0/1032303657 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f68b0012420 con 0x7f68c00b2660 2023-12-24T20:00:48.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.121+0000 7f68b5ffb700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f68a4066f30 0x7f68a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:48.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.121+0000 7f68b5ffb700 1 -- 172.21.15.61:0/1032303657 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68b0084050 con 0x7f68c00b2660 2023-12-24T20:00:48.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.122+0000 7f68c54ce700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f68a4066f30 0x7f68a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:48.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.122+0000 7f68c54ce700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f68a4066f30 0x7f68a40693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f68c00692a0 tx=0x7f68bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:48.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.125+0000 7f68b5ffb700 1 -- 172.21.15.61:0/1032303657 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68b0051220 con 0x7f68c00b2660 2023-12-24T20:00:48.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.365+0000 7f68c7f33700 1 -- 172.21.15.61:0/1032303657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f68c006d440 con 0x7f68c00b2660 2023-12-24T20:00:48.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.366+0000 7f68b5ffb700 1 -- 172.21.15.61:0/1032303657 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f68b0054840 con 0x7f68c00b2660 2023-12-24T20:00:48.366 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:00:48.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 -- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f68a4066f30 msgr2=0x7f68a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:48.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f68a4066f30 0x7f68a40693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f68c00692a0 tx=0x7f68bc008040 comp rx=0 tx=0).stop 2023-12-24T20:00:48.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 -- 172.21.15.61:0/1032303657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c00b2660 msgr2=0x7f68c016dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:48.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c00b2660 0x7f68c016dbe0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f68b000c5b0 tx=0x7f68b00020e0 comp rx=0 tx=0).stop 2023-12-24T20:00:48.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 -- 172.21.15.61:0/1032303657 shutdown_connections 2023-12-24T20:00:48.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f68a4066f30 0x7f68a40693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:48.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68c015c470 0x7f68c0068560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:48.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68c00b2660 0x7f68c016dbe0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:48.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 --2- 172.21.15.61:0/1032303657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f68c015bb60 0x7f68c016a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:48.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 -- 172.21.15.61:0/1032303657 >> 172.21.15.61:0/1032303657 conn(0x7f68c0097a10 msgr2=0x7f68c0157a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:48.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 -- 172.21.15.61:0/1032303657 shutdown_connections 2023-12-24T20:00:48.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:48.368+0000 7f68c7f33700 1 -- 172.21.15.61:0/1032303657 wait complete. 2023-12-24T20:00:48.380 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:00:48.380 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:00:48.380 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T20:00:48.380 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T20:00:48.380 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T20:00:48.381 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:00:48.381 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:00:48.381 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:00:48.381 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:00:48.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:48.381 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T20:00:48.399 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:00:48.399 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:00:48.399 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:00:48.399 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:48.399 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T20:00:48.399 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:48.399 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:00:48.399 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T20:00:48.399 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42317sec preferred_lft 42317sec 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:48.400 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T20:00:48.401 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:48.401 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:00:48.401 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:00:48.401 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link 2023-12-24T20:00:48.401 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:48.401 INFO:teuthology.orchestra.run.smithi061.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:00:48.401 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 12:83:d1:9f:62:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:00:48.401 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1083:d1ff:fe9f:62aa/64 scope link 2023-12-24T20:00:48.401 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:48.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:48.401 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:00:48.465 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T20:00:48.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:48.467 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T20:00:48.526 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T20:00:48.527 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:00:48.527 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:00:48.527 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:00:48.527 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:00:48.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:48.527 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T20:00:48.527 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T20:00:48.527 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:00:48.527 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:00:48.527 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:00:48.527 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T20:00:48.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:48.635 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T20:00:48.653 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:00:48.653 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:00:48.653 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:00:48.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:48.653 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T20:00:48.721 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T20:00:48.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:00:48.721 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T20:00:48.778 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:00:48.778 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:00:48.779 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:00:48.836 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:00:48.904 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:00:48.904 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:00:48.972 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:00:48.973 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:00:48.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:00:48.977 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:00:49.031 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:00:49.032 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T20:00:49.074 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:00:49.102 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:00:49.102 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:00:49.162 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T20:00:49.161+0000 7f71879b4540 -1 init, newargv = 0x55b65c353d50 newargc=15 2023-12-24T20:00:49.162 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[57686]: starting ceph client 2023-12-24T20:00:49.166 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[57686]: starting fuse 2023-12-24T20:00:49.172 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:00:49.173 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:00:49.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:00:49.174 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:00:49.232 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T20:00:49.232 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T20:00:49.232 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:00:49.232 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:00:49.233 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:00:49.234 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:00:49.357 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.57686.asok 2023-12-24T20:00:49.539 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57686.asok 2023-12-24T20:00:49.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:00:49.539 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57686.asok status 2023-12-24T20:00:49.697 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "57686", 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 6156, 2023-12-24T20:00:49.698 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 6156 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 3067008016 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 3067008016 2023-12-24T20:00:49.699 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:00:49.700 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.6156 192.168.0.1:0/3067008016", 2023-12-24T20:00:49.700 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/3067008016", 2023-12-24T20:00:49.700 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T20:00:49.700 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 44, 2023-12-24T20:00:49.700 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 80, 2023-12-24T20:00:49.700 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:00:49.700 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:00:49.700 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:00:49.700 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:00:49.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:00:49.708 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T20:00:49.708 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T20:00:49.726 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T20:00:49.726 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T20:00:49.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:00:49.726 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:00:49.794 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:00:49.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.955+0000 7f578a6da700 1 Processor -- start 2023-12-24T20:00:49.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.955+0000 7f578a6da700 1 -- start start 2023-12-24T20:00:49.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.956+0000 7f578a6da700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5784159c10 0x7f57840c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:49.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.956+0000 7f578a6da700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5784159fe0 0x7f57840c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:49.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.956+0000 7f578a6da700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57840af880 con 0x7f57840cba80 2023-12-24T20:00:49.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.956+0000 7f578a6da700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57840c6fc0 con 0x7f5784159fe0 2023-12-24T20:00:49.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.956+0000 7f578a6da700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57840c63b0 con 0x7f5784159c10 2023-12-24T20:00:49.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.956+0000 7f57837fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5784159fe0 0x7f57840c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:49.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.956+0000 7f57837fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5784159fe0 0x7f57840c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50576/0 (socket says 172.21.15.61:50576) 2023-12-24T20:00:49.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.956+0000 7f57837fe700 1 -- 172.21.15.61:0/327234511 learned_addr learned my addr 172.21.15.61:0/327234511 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:49.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f5783fff700 1 --2- 172.21.15.61:0/327234511 >> v2:172.21.15.133:3300/0 conn(0x7f5784159c10 0x7f57840c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:49.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f57837fe700 1 -- 172.21.15.61:0/327234511 >> v2:172.21.15.133:3300/0 conn(0x7f5784159c10 msgr2=0x7f57840c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:49.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f57837fe700 1 --2- 172.21.15.61:0/327234511 >> v2:172.21.15.133:3300/0 conn(0x7f5784159c10 0x7f57840c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:49.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f57837fe700 1 -- 172.21.15.61:0/327234511 >> v1:172.21.15.133:6789/0 conn(0x7f57840cba80 legacy=0x7f57840cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:00:49.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f57837fe700 1 -- 172.21.15.61:0/327234511 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57840c6690 con 0x7f5784159fe0 2023-12-24T20:00:49.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f57837fe700 1 --2- 172.21.15.61:0/327234511 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159fe0 0x7f57840c5d10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f57840d0990 tx=0x7f576c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdfc078762e1e56 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:49.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f5782ffd700 1 -- 172.21.15.61:0/327234511 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00b820 con 0x7f5784159fe0 2023-12-24T20:00:49.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f5782ffd700 1 -- 172.21.15.61:0/327234511 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c00b980 con 0x7f5784159fe0 2023-12-24T20:00:49.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f5782ffd700 1 -- 172.21.15.61:0/327234511 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c00bd20 con 0x7f5784159fe0 2023-12-24T20:00:49.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f578a6da700 1 -- 172.21.15.61:0/327234511 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159fe0 msgr2=0x7f57840c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.957+0000 7f578a6da700 1 --2- 172.21.15.61:0/327234511 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159fe0 0x7f57840c5d10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f57840d0990 tx=0x7f576c009250 comp rx=0 tx=0).stop 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.958+0000 7f578a6da700 1 -- 172.21.15.61:0/327234511 shutdown_connections 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.958+0000 7f578a6da700 1 --2- 172.21.15.61:0/327234511 >> v2:172.21.15.133:3300/0 conn(0x7f5784159c10 0x7f57840c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.958+0000 7f578a6da700 1 --2- 172.21.15.61:0/327234511 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159fe0 0x7f57840c5d10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.958+0000 7f578a6da700 1 -- 172.21.15.61:0/327234511 >> 172.21.15.61:0/327234511 conn(0x7f578406e640 msgr2=0x7f5784067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.958+0000 7f578a6da700 1 -- 172.21.15.61:0/327234511 shutdown_connections 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.958+0000 7f578a6da700 1 -- 172.21.15.61:0/327234511 wait complete. 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.959+0000 7f578a6da700 1 Processor -- start 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.959+0000 7f578a6da700 1 -- start start 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f578a6da700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57840cba80 0x7f5784155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f578a6da700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159c10 0x7f5784160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f578a6da700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5784159fe0 0x7f5784160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f578a6da700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57840c8ab0 con 0x7f5784159c10 2023-12-24T20:00:49.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f578a6da700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57840c8d50 con 0x7f5784159fe0 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f578a6da700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57840c9030 con 0x7f57840cba80 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f57837fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159c10 0x7f5784160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f57837fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159c10 0x7f5784160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50586/0 (socket says 172.21.15.61:50586) 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f57837fe700 1 -- 172.21.15.61:0/777139601 learned_addr learned my addr 172.21.15.61:0/777139601 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f5783fff700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57840cba80 0x7f5784155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f5788c77700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5784159fe0 0x7f5784160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f57837fe700 1 -- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57840cba80 msgr2=0x7f5784155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f57837fe700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57840cba80 0x7f5784155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f57837fe700 1 -- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5784159fe0 msgr2=0x7f5784160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f57837fe700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5784159fe0 0x7f5784160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:49.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f57837fe700 1 -- 172.21.15.61:0/777139601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c0094f0 con 0x7f5784159c10 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f5788c77700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5784159fe0 0x7f5784160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f5783fff700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57840cba80 0x7f5784155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f57837fe700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159c10 0x7f5784160040 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f576c0030c0 tx=0x7f576c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f577bfff700 1 -- 172.21.15.61:0/777139601 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c011e60 con 0x7f5784159c10 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f577bfff700 1 -- 172.21.15.61:0/777139601 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c020070 con 0x7f5784159c10 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f578a6da700 1 -- 172.21.15.61:0/777139601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57840c9310 con 0x7f5784159c10 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.960+0000 7f577bfff700 1 -- 172.21.15.61:0/777139601 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c01b6a0 con 0x7f5784159c10 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.961+0000 7f578a6da700 1 -- 172.21.15.61:0/777139601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5784155c80 con 0x7f5784159c10 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.961+0000 7f578a6da700 1 -- 172.21.15.61:0/777139601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57840c9960 con 0x7f5784159c10 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.962+0000 7f577bfff700 1 -- 172.21.15.61:0/777139601 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f576c022030 con 0x7f5784159c10 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.962+0000 7f577bfff700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5764066f30 0x7f57640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.962+0000 7f577bfff700 1 -- 172.21.15.61:0/777139601 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f576c0864b0 con 0x7f5784159c10 2023-12-24T20:00:49.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.963+0000 7f5783fff700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5764066f30 0x7f57640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:49.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.963+0000 7f5783fff700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5764066f30 0x7f57640693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5774006fd0 tx=0x7f5774008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:49.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:49.967+0000 7f577bfff700 1 -- 172.21.15.61:0/777139601 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f576c053720 con 0x7f5784159c10 2023-12-24T20:00:50.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.210+0000 7f578a6da700 1 -- 172.21.15.61:0/777139601 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f57840c9960 con 0x7f5784159c10 2023-12-24T20:00:50.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.210+0000 7f577bfff700 1 -- 172.21.15.61:0/777139601 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f576c056d40 con 0x7f5784159c10 2023-12-24T20:00:50.211 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:00:50.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.212+0000 7f578a6da700 1 -- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5764066f30 msgr2=0x7f57640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:50.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.212+0000 7f578a6da700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5764066f30 0x7f57640693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5774006fd0 tx=0x7f5774008040 comp rx=0 tx=0).stop 2023-12-24T20:00:50.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.212+0000 7f578a6da700 1 -- 172.21.15.61:0/777139601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159c10 msgr2=0x7f5784160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:50.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.212+0000 7f578a6da700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159c10 0x7f5784160040 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f576c0030c0 tx=0x7f576c016000 comp rx=0 tx=0).stop 2023-12-24T20:00:50.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.212+0000 7f578a6da700 1 -- 172.21.15.61:0/777139601 shutdown_connections 2023-12-24T20:00:50.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.212+0000 7f578a6da700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57840cba80 0x7f5784155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:50.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.212+0000 7f578a6da700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5764066f30 0x7f57640693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:50.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.212+0000 7f578a6da700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5784159fe0 0x7f5784160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:50.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.212+0000 7f578a6da700 1 --2- 172.21.15.61:0/777139601 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784159c10 0x7f5784160040 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:50.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.212+0000 7f578a6da700 1 -- 172.21.15.61:0/777139601 >> 172.21.15.61:0/777139601 conn(0x7f578406e640 msgr2=0x7f57840cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:50.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.213+0000 7f578a6da700 1 -- 172.21.15.61:0/777139601 shutdown_connections 2023-12-24T20:00:50.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:50.213+0000 7f578a6da700 1 -- 172.21.15.61:0/777139601 wait complete. 2023-12-24T20:00:50.225 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:00:50.225 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:00:50.225 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T20:00:50.225 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T20:00:50.225 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T20:00:50.225 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:00:50.225 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:00:50.225 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:00:50.225 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:00:50.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:50.226 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T20:00:50.247 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:00:50.248 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42322sec preferred_lft 42322sec 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:00:50.249 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T20:00:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link 2023-12-24T20:00:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:50.250 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:00:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T20:00:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::accb:c5ff:feae:915/64 scope link 2023-12-24T20:00:50.250 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:00:50.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:50.250 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:00:50.320 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T20:00:50.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:50.322 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T20:00:50.384 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T20:00:50.385 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:00:50.385 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:00:50.385 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:00:50.385 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:00:50.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:50.385 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T20:00:50.385 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T20:00:50.385 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:00:50.385 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:00:50.385 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:00:50.386 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T20:00:50.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:50.498 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T20:00:50.515 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T20:00:50.515 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T20:00:50.515 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:00:50.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:00:50.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T20:00:50.583 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T20:00:50.584 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:00:50.584 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T20:00:50.640 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:00:50.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:00:50.641 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:00:50.697 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:00:50.764 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:00:50.764 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:00:50.830 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:00:50.831 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:00:50.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:00:50.832 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:00:50.889 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:00:50.890 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T20:00:50.931 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:00:50.958 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:00:50.958 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:00:51.016 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T20:00:51.015+0000 7f2ae60ca540 -1 init, newargv = 0x5610e57005c0 newargc=15 2023-12-24T20:00:51.016 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[45064]: starting ceph client 2023-12-24T20:00:51.020 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[45064]: starting fuse 2023-12-24T20:00:51.027 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:00:51.028 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:00:51.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:00:51.030 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:00:51.086 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T20:00:51.087 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T20:00:51.087 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:00:51.088 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T20:00:51.089 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T20:00:51.209 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.45064.asok 2023-12-24T20:00:51.392 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45064.asok 2023-12-24T20:00:51.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:00:51.392 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45064.asok status 2023-12-24T20:00:51.544 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T20:00:51.544 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T20:00:51.544 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "45064", 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5734, 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T20:00:51.545 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 5734 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 172330350 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 172330350 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.5734 192.168.0.1:0/172330350", 2023-12-24T20:00:51.546 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/172330350", 2023-12-24T20:00:51.547 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T20:00:51.547 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 44, 2023-12-24T20:00:51.547 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 80, 2023-12-24T20:00:51.547 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:00:51.547 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T20:00:51.547 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T20:00:51.547 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T20:00:51.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:00:51.554 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T20:00:51.554 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T20:00:51.572 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T20:00:51.572 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T20:00:51.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:00:51.572 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:00:51.639 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:00:51.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.775+0000 7fab04b1b700 1 Processor -- start 2023-12-24T20:00:51.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.775+0000 7fab04b1b700 1 -- start start 2023-12-24T20:00:51.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.776+0000 7fab04b1b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fab00070d50 0x7fab000c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:51.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.776+0000 7fab04b1b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0006a090 con 0x7fab00159e60 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.776+0000 7fab04b1b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0006ac10 con 0x7fab00159a90 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.776+0000 7fab04b1b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0006a2e0 con 0x7fab00070d50 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.776+0000 7faafdd9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fab00159e60 0x7fab000c93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44850/0 (socket says 172.21.15.61:44850) 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.776+0000 7faafdd9b700 1 -- 172.21.15.61:0/4224595565 learned_addr learned my addr 172.21.15.61:0/4224595565 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafed9d700 1 --2- 172.21.15.61:0/4224595565 >> v2:172.21.15.133:3300/0 conn(0x7fab00070d50 0x7fab000c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafd59a700 1 -- 172.21.15.61:0/4224595565 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193868927 0 0) 0x7fab0006a090 con 0x7fab00159e60 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafd59a700 1 -- 172.21.15.61:0/4224595565 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaec003570 con 0x7fab00159e60 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafd59a700 1 -- 172.21.15.61:0/4224595565 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430904151 0 0) 0x7fab0006ac10 con 0x7fab00159a90 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafd59a700 1 -- 172.21.15.61:0/4224595565 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab0006a090 con 0x7fab00159a90 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafed9d700 1 -- 172.21.15.61:0/4224595565 >> v1:172.21.15.133:6789/0 conn(0x7fab00159a90 legacy=0x7fab00070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafed9d700 1 -- 172.21.15.61:0/4224595565 >> v1:172.21.15.61:6789/0 conn(0x7fab00159e60 legacy=0x7fab000c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:51.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafed9d700 1 -- 172.21.15.61:0/4224595565 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0006a5c0 con 0x7fab00070d50 2023-12-24T20:00:51.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafed9d700 1 --2- 172.21.15.61:0/4224595565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab00070d50 0x7fab000c9ad0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009e60 tx=0x7faaf8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92fb5b7d1c7bcb71 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:51.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafd59a700 1 -- 172.21.15.61:0/4224595565 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800e070 con 0x7fab00070d50 2023-12-24T20:00:51.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafd59a700 1 -- 172.21.15.61:0/4224595565 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf800bab0 con 0x7fab00070d50 2023-12-24T20:00:51.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.777+0000 7faafd59a700 1 -- 172.21.15.61:0/4224595565 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800be70 con 0x7fab00070d50 2023-12-24T20:00:51.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.778+0000 7fab04b1b700 1 -- 172.21.15.61:0/4224595565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab00070d50 msgr2=0x7fab000c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:51.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.778+0000 7fab04b1b700 1 --2- 172.21.15.61:0/4224595565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab00070d50 0x7fab000c9ad0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaf8009e60 tx=0x7faaf8009780 comp rx=0 tx=0).stop 2023-12-24T20:00:51.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.778+0000 7fab04b1b700 1 -- 172.21.15.61:0/4224595565 shutdown_connections 2023-12-24T20:00:51.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.778+0000 7fab04b1b700 1 --2- 172.21.15.61:0/4224595565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab00070d50 0x7fab000c9ad0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:51.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.778+0000 7fab04b1b700 1 -- 172.21.15.61:0/4224595565 >> 172.21.15.61:0/4224595565 conn(0x7fab000cd6f0 msgr2=0x7fab000cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:51.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.778+0000 7fab04b1b700 1 -- 172.21.15.61:0/4224595565 shutdown_connections 2023-12-24T20:00:51.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.778+0000 7fab04b1b700 1 -- 172.21.15.61:0/4224595565 wait complete. 2023-12-24T20:00:51.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.779+0000 7fab04b1b700 1 Processor -- start 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.779+0000 7fab04b1b700 1 -- start start 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7fab04b1b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab00070d50 0x7fab00157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7fab04b1b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab00159a90 0x7fab0015b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7fab04b1b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab00159e60 0x7fab000c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7fab04b1b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00157740 con 0x7fab00159a90 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7fab04b1b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab000b0ef0 con 0x7fab00159e60 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7fab04b1b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab000c4120 con 0x7fab00070d50 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7faafdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab00159a90 0x7fab0015b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7faafdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab00159a90 0x7fab0015b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50588/0 (socket says 172.21.15.61:50588) 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7faafdd9b700 1 -- 172.21.15.61:0/2031193724 learned_addr learned my addr 172.21.15.61:0/2031193724 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:00:51.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7faafed9d700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab00159e60 0x7fab000c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7faafe59c700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab00070d50 0x7fab00157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7faafdd9b700 1 -- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab00070d50 msgr2=0x7fab00157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7faafdd9b700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab00070d50 0x7fab00157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7faafdd9b700 1 -- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab00159e60 msgr2=0x7fab000c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7faafdd9b700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab00159e60 0x7fab000c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.780+0000 7faafdd9b700 1 -- 172.21.15.61:0/2031193724 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf8009a20 con 0x7fab00159a90 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.781+0000 7faafdd9b700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab00159a90 0x7fab0015b210 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c560 tx=0x7faaf0007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.781+0000 7faaf67fc700 1 -- 172.21.15.61:0/2031193724 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0005b30 con 0x7fab00159a90 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.781+0000 7faaf67fc700 1 -- 172.21.15.61:0/2031193724 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0005cb0 con 0x7fab00159a90 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.781+0000 7faaf67fc700 1 -- 172.21.15.61:0/2031193724 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0007320 con 0x7fab00159a90 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.781+0000 7fab04b1b700 1 -- 172.21.15.61:0/2031193724 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab000c4400 con 0x7fab00159a90 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.781+0000 7fab04b1b700 1 -- 172.21.15.61:0/2031193724 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab000b0b80 con 0x7fab00159a90 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.782+0000 7fab04b1b700 1 -- 172.21.15.61:0/2031193724 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab000b1060 con 0x7fab00159a90 2023-12-24T20:00:51.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.782+0000 7faaf67fc700 1 -- 172.21.15.61:0/2031193724 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7faaf001b3b0 con 0x7fab00159a90 2023-12-24T20:00:51.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.783+0000 7faaf67fc700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faae0066f30 0x7faae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:00:51.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.783+0000 7faaf67fc700 1 -- 172.21.15.61:0/2031193724 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faaf00838e0 con 0x7fab00159a90 2023-12-24T20:00:51.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.783+0000 7faafe59c700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faae0066f30 0x7faae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:00:51.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.784+0000 7faafe59c700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faae0066f30 0x7faae00693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faae8007fd0 tx=0x7faae8007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:00:51.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:51.787+0000 7faaf67fc700 1 -- 172.21.15.61:0/2031193724 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faaf0050b50 con 0x7fab00159a90 2023-12-24T20:00:52.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.029+0000 7fab04b1b700 1 -- 172.21.15.61:0/2031193724 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab0004c3c0 con 0x7fab00159a90 2023-12-24T20:00:52.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.029+0000 7faaf67fc700 1 -- 172.21.15.61:0/2031193724 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4599 (secure 0 0 0) 0x7faaf0017020 con 0x7fab00159a90 2023-12-24T20:00:52.030 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:00:52.030 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/3462396702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3462396702},{"type":"v1","addr":"172.21.15.61:6835","nonce":3462396702}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2539986874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2539986874},{"type":"v1","addr":"172.21.15.133:6836","nonce":2539986874}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":5611,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/118195153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":118195153},{"type":"v1","addr":"172.21.15.133:6837","nonce":118195153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:00:41.409889+0000","modified":"2023-12-24T20:00:45.042959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5994":{"gid":5994,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/761559894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":761559894},{"type":"v1","addr":"172.21.15.61:6834","nonce":761559894}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T20:00:52.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 -- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faae0066f30 msgr2=0x7faae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:52.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faae0066f30 0x7faae00693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7faae8007fd0 tx=0x7faae8007d50 comp rx=0 tx=0).stop 2023-12-24T20:00:52.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 -- 172.21.15.61:0/2031193724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab00159a90 msgr2=0x7fab0015b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:00:52.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab00159a90 0x7fab0015b210 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7faaf000c560 tx=0x7faaf0007db0 comp rx=0 tx=0).stop 2023-12-24T20:00:52.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 -- 172.21.15.61:0/2031193724 shutdown_connections 2023-12-24T20:00:52.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab00070d50 0x7fab00157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:52.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faae0066f30 0x7faae00693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:52.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab00159e60 0x7fab000c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:52.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 --2- 172.21.15.61:0/2031193724 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab00159a90 0x7fab0015b210 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:00:52.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 -- 172.21.15.61:0/2031193724 >> 172.21.15.61:0/2031193724 conn(0x7fab000cd6f0 msgr2=0x7fab000cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:00:52.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 -- 172.21.15.61:0/2031193724 shutdown_connections 2023-12-24T20:00:52.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:00:52.031+0000 7fab04b1b700 1 -- 172.21.15.61:0/2031193724 wait complete. 2023-12-24T20:00:52.033 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 44 2023-12-24T20:00:52.044 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-24T20:00:52.185 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":5994,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.168742065,"mdsmap_epoch":44,"osdmap_epoch":80,"osdmap_epoch_barrier":80,"uptime":15.052588096999999} 2023-12-24T20:00:52.186 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 5994, "mdsmap_epoch": 44, "osdmap_epoch": 80, "osdmap_epoch_barrier": 80, "rank_uptime": 10.168742065, "state": "up:active", "uptime": 15.052588097, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:00:52.186 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-24T20:00:52.324 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_mon_report_interval":"5"} 2023-12-24T20:00:52.324 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-24T20:00:52.324 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-24T20:00:52.454 INFO:teuthology.orchestra.run.smithi061.stdout:{"mon_tick_interval":"5"} 2023-12-24T20:00:52.455 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-24T20:00:52.455 INFO:tasks.cephfs.test_full:pool capacity 557102656, 531MB should be enough to fill it 2023-12-24T20:00:52.455 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:00:52.455 DEBUG:teuthology.orchestra.run.smithi061:> import time 2023-12-24T20:00:52.455 DEBUG:teuthology.orchestra.run.smithi061:> import datetime 2023-12-24T20:00:52.455 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:00:52.455 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:00:52.455 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:52.455 DEBUG:teuthology.orchestra.run.smithi061:> # Write some buffered data through before going full, all should be well 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> print("writing some data through which we expect to succeed") 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> bytes = 0 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(f) 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> # buffered IO, the error should always only appear from fsync and not 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> # from write 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> full = False 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> for n in range(0, int(531 * 1.1)): 2023-12-24T20:00:52.456 DEBUG:teuthology.orchestra.run.smithi061:> try: 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> print("wrote bytes via buffered write, moving on to fsync") 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> except OSError as e: 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> if True: 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> raise 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> else: 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> full = True 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> break 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> try: 2023-12-24T20:00:52.457 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(f) 2023-12-24T20:00:52.458 DEBUG:teuthology.orchestra.run.smithi061:> print("fsync'"'"'ed successfully") 2023-12-24T20:00:52.458 DEBUG:teuthology.orchestra.run.smithi061:> except OSError as e: 2023-12-24T20:00:52.460 DEBUG:teuthology.orchestra.run.smithi061:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-24T20:00:52.460 DEBUG:teuthology.orchestra.run.smithi061:> full = True 2023-12-24T20:00:52.460 DEBUG:teuthology.orchestra.run.smithi061:> break 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> else: 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> if n > 531 * 0.9: 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> # Be cautious in the last region where we expect to hit 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> time.sleep(15.0) 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> if not full: 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> # close() should not raise an error because we already caught it in 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> # since then because all IOs got cancelled on the full flag. 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> print("calling close") 2023-12-24T20:00:52.461 DEBUG:teuthology.orchestra.run.smithi061:> os.close(f) 2023-12-24T20:00:52.462 DEBUG:teuthology.orchestra.run.smithi061:> print("close() did not raise error") 2023-12-24T20:00:52.462 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:00:52.462 DEBUG:teuthology.orchestra.run.smithi061:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-24T20:00:52.462 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:00:57.486 INFO:teuthology.orchestra.run.smithi061.stdout:writing some data through which we expect to succeed 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 1.00 MB 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 2.00 MB 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 3.00 MB 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 4.00 MB 2023-12-24T20:00:57.487 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 5.00 MB 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 6.00 MB 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 7.00 MB 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 8.00 MB 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 9.00 MB 2023-12-24T20:00:57.488 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 10.00 MB 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 11.00 MB 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 12.00 MB 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 13.00 MB 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 14.00 MB 2023-12-24T20:00:57.489 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 15.00 MB 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 16.00 MB 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 17.00 MB 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 18.00 MB 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 19.00 MB 2023-12-24T20:00:57.490 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 20.00 MB 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 21.00 MB 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 22.00 MB 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 23.00 MB 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 24.00 MB 2023-12-24T20:00:57.491 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 25.00 MB 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 26.00 MB 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 27.00 MB 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 28.00 MB 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 29.00 MB 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.492 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 30.00 MB 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 31.00 MB 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 32.00 MB 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 33.00 MB 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 34.00 MB 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.493 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 35.00 MB 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 36.00 MB 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 37.00 MB 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 38.00 MB 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 39.00 MB 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.494 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 40.00 MB 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 41.00 MB 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 42.00 MB 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 43.00 MB 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 44.00 MB 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.495 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 45.00 MB 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 46.00 MB 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 47.00 MB 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 48.00 MB 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 49.00 MB 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 50.00 MB 2023-12-24T20:00:57.496 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 51.00 MB 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 52.00 MB 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 53.00 MB 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 54.00 MB 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 55.00 MB 2023-12-24T20:00:57.497 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 56.00 MB 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 57.00 MB 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 58.00 MB 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 59.00 MB 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 60.00 MB 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.498 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 61.00 MB 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 62.00 MB 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 63.00 MB 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 64.00 MB 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 65.00 MB 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.499 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 66.00 MB 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 67.00 MB 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 68.00 MB 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 69.00 MB 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 70.00 MB 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.500 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 71.00 MB 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 72.00 MB 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 73.00 MB 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 74.00 MB 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 75.00 MB 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.501 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 76.00 MB 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 77.00 MB 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 78.00 MB 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 79.00 MB 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.502 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 80.00 MB 2023-12-24T20:00:57.825 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.825 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.825 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 81.00 MB 2023-12-24T20:00:57.825 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.825 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.825 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 82.00 MB 2023-12-24T20:00:57.825 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.825 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 83.00 MB 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 84.00 MB 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 85.00 MB 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 86.00 MB 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.826 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 87.00 MB 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 88.00 MB 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 89.00 MB 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 90.00 MB 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 91.00 MB 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.827 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 92.00 MB 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 93.00 MB 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 94.00 MB 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 95.00 MB 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 96.00 MB 2023-12-24T20:00:57.828 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 97.00 MB 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 98.00 MB 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 99.00 MB 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 100.00 MB 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.829 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 101.00 MB 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 102.00 MB 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 103.00 MB 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 104.00 MB 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 105.00 MB 2023-12-24T20:00:57.830 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 106.00 MB 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 107.00 MB 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 108.00 MB 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 109.00 MB 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.831 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 110.00 MB 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 111.00 MB 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 112.00 MB 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 113.00 MB 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 114.00 MB 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.832 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 115.00 MB 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 116.00 MB 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 117.00 MB 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 118.00 MB 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 119.00 MB 2023-12-24T20:00:57.833 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 120.00 MB 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 121.00 MB 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 122.00 MB 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 123.00 MB 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.834 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 124.00 MB 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 125.00 MB 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 126.00 MB 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 127.00 MB 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 128.00 MB 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.835 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 129.00 MB 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 130.00 MB 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 131.00 MB 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 132.00 MB 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 133.00 MB 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.836 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 134.00 MB 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 135.00 MB 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 136.00 MB 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 137.00 MB 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 138.00 MB 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.837 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 139.00 MB 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 140.00 MB 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 141.00 MB 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 142.00 MB 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 143.00 MB 2023-12-24T20:00:57.838 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 144.00 MB 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 145.00 MB 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 146.00 MB 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 147.00 MB 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 148.00 MB 2023-12-24T20:00:57.839 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 149.00 MB 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 150.00 MB 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 151.00 MB 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 152.00 MB 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 153.00 MB 2023-12-24T20:00:57.840 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 154.00 MB 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 155.00 MB 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 156.00 MB 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 157.00 MB 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.841 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 158.00 MB 2023-12-24T20:00:57.842 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.842 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.842 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 159.00 MB 2023-12-24T20:00:57.842 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.842 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.842 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 160.00 MB 2023-12-24T20:00:57.842 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:57.842 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:57.842 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 161.00 MB 2023-12-24T20:00:58.148 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 162.00 MB 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 163.00 MB 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 164.00 MB 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 165.00 MB 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.149 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 166.00 MB 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 167.00 MB 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 168.00 MB 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 169.00 MB 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 170.00 MB 2023-12-24T20:00:58.150 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 171.00 MB 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 172.00 MB 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 173.00 MB 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 174.00 MB 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.151 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 175.00 MB 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 176.00 MB 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 177.00 MB 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 178.00 MB 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 179.00 MB 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.152 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 180.00 MB 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 181.00 MB 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 182.00 MB 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 183.00 MB 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 184.00 MB 2023-12-24T20:00:58.153 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 185.00 MB 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 186.00 MB 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 187.00 MB 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 188.00 MB 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 189.00 MB 2023-12-24T20:00:58.154 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 190.00 MB 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 191.00 MB 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 192.00 MB 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 193.00 MB 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.155 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 194.00 MB 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 195.00 MB 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 196.00 MB 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 197.00 MB 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 198.00 MB 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.156 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 199.00 MB 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 200.00 MB 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 201.00 MB 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 202.00 MB 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 203.00 MB 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.157 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 204.00 MB 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 205.00 MB 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 206.00 MB 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 207.00 MB 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 208.00 MB 2023-12-24T20:00:58.158 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 209.00 MB 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 210.00 MB 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 211.00 MB 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 212.00 MB 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 213.00 MB 2023-12-24T20:00:58.159 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 214.00 MB 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 215.00 MB 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 216.00 MB 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 217.00 MB 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 218.00 MB 2023-12-24T20:00:58.160 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 219.00 MB 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 220.00 MB 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 221.00 MB 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 222.00 MB 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 223.00 MB 2023-12-24T20:00:58.162 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.162 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.162 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 224.00 MB 2023-12-24T20:00:58.162 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.166 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.166 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 225.00 MB 2023-12-24T20:00:58.166 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.166 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.166 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 226.00 MB 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 227.00 MB 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 228.00 MB 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 229.00 MB 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 230.00 MB 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.167 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 231.00 MB 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 232.00 MB 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 233.00 MB 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 234.00 MB 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 235.00 MB 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.168 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 236.00 MB 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 237.00 MB 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 238.00 MB 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 239.00 MB 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 240.00 MB 2023-12-24T20:00:58.169 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.170 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.170 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 241.00 MB 2023-12-24T20:00:58.448 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.448 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.448 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 242.00 MB 2023-12-24T20:00:58.448 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.448 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.448 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 243.00 MB 2023-12-24T20:00:58.448 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 244.00 MB 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 245.00 MB 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 246.00 MB 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 247.00 MB 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.449 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 248.00 MB 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 249.00 MB 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 250.00 MB 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 251.00 MB 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 252.00 MB 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 253.00 MB 2023-12-24T20:00:58.450 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 254.00 MB 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 255.00 MB 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 256.00 MB 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 257.00 MB 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.451 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 258.00 MB 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 259.00 MB 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 260.00 MB 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 261.00 MB 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 262.00 MB 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 263.00 MB 2023-12-24T20:00:58.452 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 264.00 MB 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 265.00 MB 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 266.00 MB 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 267.00 MB 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 268.00 MB 2023-12-24T20:00:58.453 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 269.00 MB 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 270.00 MB 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 271.00 MB 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 272.00 MB 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 273.00 MB 2023-12-24T20:00:58.454 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.455 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.455 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 274.00 MB 2023-12-24T20:00:58.455 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.455 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.455 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 275.00 MB 2023-12-24T20:00:58.455 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.455 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.455 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 276.00 MB 2023-12-24T20:00:58.455 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 277.00 MB 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 278.00 MB 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 279.00 MB 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 280.00 MB 2023-12-24T20:00:58.456 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 281.00 MB 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 282.00 MB 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 283.00 MB 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 284.00 MB 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.457 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 285.00 MB 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 286.00 MB 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 287.00 MB 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 288.00 MB 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 289.00 MB 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 290.00 MB 2023-12-24T20:00:58.458 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 291.00 MB 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 292.00 MB 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 293.00 MB 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 294.00 MB 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 295.00 MB 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.459 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 296.00 MB 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 297.00 MB 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 298.00 MB 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 299.00 MB 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 300.00 MB 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.460 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 301.00 MB 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 302.00 MB 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 303.00 MB 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 304.00 MB 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 305.00 MB 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.461 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 306.00 MB 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 307.00 MB 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 308.00 MB 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 309.00 MB 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 310.00 MB 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.462 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 311.00 MB 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 312.00 MB 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 313.00 MB 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 314.00 MB 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 315.00 MB 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.463 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 316.00 MB 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 317.00 MB 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 318.00 MB 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 319.00 MB 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 320.00 MB 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 321.00 MB 2023-12-24T20:00:58.464 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.465 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 322.00 MB 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 323.00 MB 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 324.00 MB 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 325.00 MB 2023-12-24T20:00:58.752 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 326.00 MB 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 327.00 MB 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 328.00 MB 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 329.00 MB 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 330.00 MB 2023-12-24T20:00:58.753 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 331.00 MB 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 332.00 MB 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 333.00 MB 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 334.00 MB 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.754 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 335.00 MB 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 336.00 MB 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 337.00 MB 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 338.00 MB 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 339.00 MB 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 340.00 MB 2023-12-24T20:00:58.755 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 341.00 MB 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 342.00 MB 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 343.00 MB 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 344.00 MB 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.756 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 345.00 MB 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 346.00 MB 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 347.00 MB 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 348.00 MB 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 349.00 MB 2023-12-24T20:00:58.757 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 350.00 MB 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 351.00 MB 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 352.00 MB 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 353.00 MB 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 354.00 MB 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.758 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.759 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 355.00 MB 2023-12-24T20:00:58.759 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.759 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.759 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 356.00 MB 2023-12-24T20:00:58.759 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.759 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.759 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 357.00 MB 2023-12-24T20:00:58.759 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 358.00 MB 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 359.00 MB 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 360.00 MB 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 361.00 MB 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 362.00 MB 2023-12-24T20:00:58.760 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 363.00 MB 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 364.00 MB 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 365.00 MB 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 366.00 MB 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 367.00 MB 2023-12-24T20:00:58.761 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 368.00 MB 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 369.00 MB 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 370.00 MB 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 371.00 MB 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 372.00 MB 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.762 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 373.00 MB 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 374.00 MB 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 375.00 MB 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 376.00 MB 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 377.00 MB 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.763 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 378.00 MB 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 379.00 MB 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 380.00 MB 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 381.00 MB 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 382.00 MB 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.764 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 383.00 MB 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 384.00 MB 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 385.00 MB 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 386.00 MB 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.765 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 387.00 MB 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 388.00 MB 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 389.00 MB 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 390.00 MB 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 391.00 MB 2023-12-24T20:00:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 392.00 MB 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 393.00 MB 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 394.00 MB 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 395.00 MB 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.767 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 396.00 MB 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 397.00 MB 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 398.00 MB 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 399.00 MB 2023-12-24T20:00:58.768 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.769 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.769 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 400.00 MB 2023-12-24T20:00:58.769 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.769 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.769 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 401.00 MB 2023-12-24T20:00:58.769 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:00:58.769 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:00:58.769 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 402.00 MB 2023-12-24T20:01:01.563 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:01:01.563+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-12-24T20:01:05.959 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:01:05.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:01:08.540 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:01:08.540+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 403.00 MB 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 404.00 MB 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 405.00 MB 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 406.00 MB 2023-12-24T20:01:14.092 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 407.00 MB 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 408.00 MB 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 409.00 MB 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 410.00 MB 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.093 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 411.00 MB 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 412.00 MB 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 413.00 MB 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 414.00 MB 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 415.00 MB 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.094 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 416.00 MB 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 417.00 MB 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 418.00 MB 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 419.00 MB 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 420.00 MB 2023-12-24T20:01:14.095 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 421.00 MB 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 422.00 MB 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 423.00 MB 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 424.00 MB 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.096 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 425.00 MB 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 426.00 MB 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 427.00 MB 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 428.00 MB 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 429.00 MB 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.097 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 430.00 MB 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 431.00 MB 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 432.00 MB 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 433.00 MB 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 434.00 MB 2023-12-24T20:01:14.098 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 435.00 MB 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 436.00 MB 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 437.00 MB 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 438.00 MB 2023-12-24T20:01:14.099 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 439.00 MB 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 440.00 MB 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 441.00 MB 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 442.00 MB 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 443.00 MB 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 444.00 MB 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 445.00 MB 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 446.00 MB 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 447.00 MB 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 448.00 MB 2023-12-24T20:01:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 449.00 MB 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 450.00 MB 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 451.00 MB 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 452.00 MB 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 453.00 MB 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 454.00 MB 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 455.00 MB 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 456.00 MB 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 457.00 MB 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 458.00 MB 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 459.00 MB 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 460.00 MB 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 461.00 MB 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 462.00 MB 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 463.00 MB 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 464.00 MB 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 465.00 MB 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 466.00 MB 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 467.00 MB 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 468.00 MB 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 469.00 MB 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 470.00 MB 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 471.00 MB 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 472.00 MB 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 473.00 MB 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 474.00 MB 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 475.00 MB 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 476.00 MB 2023-12-24T20:01:14.107 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 477.00 MB 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 478.00 MB 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 479.00 MB 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:Reached fullness after 480.00 MB 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:calling close 2023-12-24T20:01:14.108 INFO:teuthology.orchestra.run.smithi061.stdout:close() did not raise error 2023-12-24T20:01:14.151 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:01:14.151 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:01:14.203 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:01:14.250 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:01:14.250 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T20:01:14.251 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:01:14.251 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T20:01:14.301 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[57686]: fuse finished with error 0 and tester_r 0 2023-12-24T20:01:14.302 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:01:14.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:14.303 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:01:14.389 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T20:01:14.389 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:01:14.389 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T20:01:14.430 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[45064]: fuse finished with error 0 and tester_r 0 2023-12-24T20:01:14.432 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:01:14.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:14.433 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T20:01:14.604 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:01:14.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:14.604 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T20:01:14.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:01:14.623 INFO:teuthology.orchestra.run.smithi061.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-24T20:01:14.624 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:01:14.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:14.624 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T20:01:14.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:01:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-24T20:01:14.665 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:01:14.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.791+0000 7f50327b4700 1 Processor -- start 2023-12-24T20:01:14.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.791+0000 7f50327b4700 1 -- start start 2023-12-24T20:01:14.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f50327b4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f502c0c9910 0x7f502c157040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:14.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f50327b4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f502c0c9ce0 0x7f502c0af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:14.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f50327b4700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502c156bb0 con 0x7f502c0af900 2023-12-24T20:01:14.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f50327b4700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502c1565d0 con 0x7f502c0c9ce0 2023-12-24T20:01:14.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f50327b4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0afe10 con 0x7f502c0c9910 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f502b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f502c0c9ce0 0x7f502c0af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f5030d51700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f502c0af900 0x7f502c0adfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56930/0 (socket says 172.21.15.61:56930) 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f5030d51700 1 -- 172.21.15.61:0/1855374167 learned_addr learned my addr 172.21.15.61:0/1855374167 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f502b7fe700 1 --2- 172.21.15.61:0/1855374167 >> v2:172.21.15.61:3300/0 conn(0x7f502c0c9ce0 0x7f502c0af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35868/0 (socket says 172.21.15.61:35868) 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f502bfff700 1 --2- 172.21.15.61:0/1855374167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f502c0c9910 0x7f502c157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f502b7fe700 1 -- 172.21.15.61:0/1855374167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f502c0c9910 msgr2=0x7f502c157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f502b7fe700 1 --2- 172.21.15.61:0/1855374167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f502c0c9910 0x7f502c157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f502b7fe700 1 -- 172.21.15.61:0/1855374167 >> v1:172.21.15.61:6789/0 conn(0x7f502c0af900 legacy=0x7f502c0adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f502affd700 1 -- 172.21.15.61:0/1855374167 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883824562 0 0) 0x7f502c156bb0 con 0x7f502c0af900 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.792+0000 7f502b7fe700 1 -- 172.21.15.61:0/1855374167 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c0b00f0 con 0x7f502c0c9ce0 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f502b7fe700 1 --2- 172.21.15.61:0/1855374167 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9ce0 0x7f502c0af3c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f501400aa90 tx=0x7f501400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9399b44451af8c3f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f502affd700 1 -- 172.21.15.61:0/1855374167 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501400ca40 con 0x7f502c0c9ce0 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f502affd700 1 -- 172.21.15.61:0/1855374167 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501400cba0 con 0x7f502c0c9ce0 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f502affd700 1 -- 172.21.15.61:0/1855374167 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014018400 con 0x7f502c0c9ce0 2023-12-24T20:01:14.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f50327b4700 1 -- 172.21.15.61:0/1855374167 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9ce0 msgr2=0x7f502c0af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:14.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f50327b4700 1 --2- 172.21.15.61:0/1855374167 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9ce0 0x7f502c0af3c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f501400aa90 tx=0x7f501400a330 comp rx=0 tx=0).stop 2023-12-24T20:01:14.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f50327b4700 1 -- 172.21.15.61:0/1855374167 shutdown_connections 2023-12-24T20:01:14.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f50327b4700 1 --2- 172.21.15.61:0/1855374167 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f502c0c9910 0x7f502c157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:14.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f50327b4700 1 --2- 172.21.15.61:0/1855374167 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9ce0 0x7f502c0af3c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:14.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f50327b4700 1 -- 172.21.15.61:0/1855374167 >> 172.21.15.61:0/1855374167 conn(0x7f502c067fe0 msgr2=0x7f502c0cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:14.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f50327b4700 1 -- 172.21.15.61:0/1855374167 shutdown_connections 2023-12-24T20:01:14.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.793+0000 7f50327b4700 1 -- 172.21.15.61:0/1855374167 wait complete. 2023-12-24T20:01:14.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.794+0000 7f50327b4700 1 Processor -- start 2023-12-24T20:01:14.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.795+0000 7f50327b4700 1 -- start start 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.795+0000 7f50327b4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f502c0af900 0x7f502c167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.795+0000 7f50327b4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9910 0x7f502c14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.795+0000 7f50327b4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f502c0c9ce0 0x7f502c15ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.795+0000 7f50327b4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0a9e00 con 0x7f502c0c9910 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.795+0000 7f50327b4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c15bb00 con 0x7f502c0af900 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.795+0000 7f50327b4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0a97b0 con 0x7f502c0c9ce0 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.795+0000 7f502b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9910 0x7f502c14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f502b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9910 0x7f502c14fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35874/0 (socket says 172.21.15.61:35874) 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f502b7fe700 1 -- 172.21.15.61:0/4112683834 learned_addr learned my addr 172.21.15.61:0/4112683834 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f5030d51700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f502c0c9ce0 0x7f502c15ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f502bfff700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f502c0af900 0x7f502c167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f502b7fe700 1 -- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f502c0c9ce0 msgr2=0x7f502c15ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:14.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f502b7fe700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f502c0c9ce0 0x7f502c15ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f502b7fe700 1 -- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f502c0af900 msgr2=0x7f502c167dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f502b7fe700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f502c0af900 0x7f502c167dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f502b7fe700 1 -- 172.21.15.61:0/4112683834 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501400a5d0 con 0x7f502c0c9910 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f502b7fe700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9910 0x7f502c14fad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f501400a5a0 tx=0x7f501401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f5023fff700 1 -- 172.21.15.61:0/4112683834 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014010600 con 0x7f502c0c9910 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f5023fff700 1 -- 172.21.15.61:0/4112683834 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5014010760 con 0x7f502c0c9910 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f50327b4700 1 -- 172.21.15.61:0/4112683834 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502c0a9a90 con 0x7f502c0c9910 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f5023fff700 1 -- 172.21.15.61:0/4112683834 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014010b00 con 0x7f502c0c9910 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.796+0000 7f50327b4700 1 -- 172.21.15.61:0/4112683834 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502c150010 con 0x7f502c0c9910 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.797+0000 7f50327b4700 1 -- 172.21.15.61:0/4112683834 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502c0a9c20 con 0x7f502c0c9910 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.798+0000 7f5023fff700 1 -- 172.21.15.61:0/4112683834 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f501402a3b0 con 0x7f502c0c9910 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.798+0000 7f5023fff700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f500c066f30 0x7f500c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.798+0000 7f5023fff700 1 -- 172.21.15.61:0/4112683834 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f5014085c60 con 0x7f502c0c9910 2023-12-24T20:01:14.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.798+0000 7f5023fff700 1 -- 172.21.15.61:0/4112683834 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7f500c06eb10 con 0x7f502c0c9910 2023-12-24T20:01:14.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.798+0000 7f502bfff700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f500c066f30 0x7f500c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:14.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.799+0000 7f502bfff700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f500c066f30 0x7f500c0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f501c006fd0 tx=0x7f501c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:14.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:14.802+0000 7f5023fff700 1 -- 172.21.15.61:0/4112683834 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5014052f40 con 0x7f502c0c9910 2023-12-24T20:01:15.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.064+0000 7f50327b4700 1 -- 172.21.15.61:0/4112683834 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f502c04c3c0 con 0x7f502c0c9910 2023-12-24T20:01:15.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.065+0000 7f5023fff700 1 -- 172.21.15.61:0/4112683834 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f5014026030 con 0x7f502c0c9910 2023-12-24T20:01:15.068 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:15.068 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/3462396702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3462396702},{"type":"v1","addr":"172.21.15.61:6835","nonce":3462396702}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2539986874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2539986874},{"type":"v1","addr":"172.21.15.133:6836","nonce":2539986874}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":5611,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/118195153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":118195153},{"type":"v1","addr":"172.21.15.133:6837","nonce":118195153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:00:41.409889+0000","modified":"2023-12-24T20:00:45.042959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5994":{"gid":5994,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/761559894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":761559894},{"type":"v1","addr":"172.21.15.61:6834","nonce":761559894}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T20:01:15.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.068+0000 7f50327b4700 1 -- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f500c066f30 msgr2=0x7f500c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.068+0000 7f50327b4700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f500c066f30 0x7f500c0693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f501c006fd0 tx=0x7f501c008040 comp rx=0 tx=0).stop 2023-12-24T20:01:15.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.068+0000 7f50327b4700 1 -- 172.21.15.61:0/4112683834 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9910 msgr2=0x7f502c14fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.068+0000 7f50327b4700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9910 0x7f502c14fad0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f501400a5a0 tx=0x7f501401a000 comp rx=0 tx=0).stop 2023-12-24T20:01:15.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.068+0000 7f50327b4700 1 -- 172.21.15.61:0/4112683834 shutdown_connections 2023-12-24T20:01:15.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.068+0000 7f50327b4700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f502c0c9ce0 0x7f502c15ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.068+0000 7f50327b4700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f500c066f30 0x7f500c0693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.068+0000 7f50327b4700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f502c0af900 0x7f502c167dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.068+0000 7f50327b4700 1 --2- 172.21.15.61:0/4112683834 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f502c0c9910 0x7f502c14fad0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.068+0000 7f50327b4700 1 -- 172.21.15.61:0/4112683834 >> 172.21.15.61:0/4112683834 conn(0x7f502c067fe0 msgr2=0x7f502c0b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:15.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.069+0000 7f50327b4700 1 -- 172.21.15.61:0/4112683834 shutdown_connections 2023-12-24T20:01:15.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.069+0000 7f50327b4700 1 -- 172.21.15.61:0/4112683834 wait complete. 2023-12-24T20:01:15.070 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 44 2023-12-24T20:01:15.087 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:01:15.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.210+0000 7fb209347700 1 Processor -- start 2023-12-24T20:01:15.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.210+0000 7fb209347700 1 -- start start 2023-12-24T20:01:15.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.210+0000 7fb209347700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb204159c10 0x7fb2040c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb209347700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040af880 con 0x7fb2040cc190 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb209347700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040c6fc0 con 0x7fb204159fe0 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb209347700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2040c63b0 con 0x7fb204159c10 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb202ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb204159c10 0x7fb2040c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb2037fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb2040cc190 0x7fb2040b09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56936/0 (socket says 172.21.15.61:56936) 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb2037fe700 1 -- 172.21.15.61:0/4140990856 learned_addr learned my addr 172.21.15.61:0/4140990856 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb202ffd700 1 -- 172.21.15.61:0/4140990856 >> v1:172.21.15.133:6789/0 conn(0x7fb204159fe0 legacy=0x7fb2040cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb202ffd700 1 -- 172.21.15.61:0/4140990856 >> v1:172.21.15.61:6789/0 conn(0x7fb2040cc190 legacy=0x7fb2040b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb202ffd700 1 -- 172.21.15.61:0/4140990856 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2040c6690 con 0x7fb204159c10 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb201ffb700 1 -- 172.21.15.61:0/4140990856 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043059193 0 0) 0x7fb2040af880 con 0x7fb2040cc190 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb202ffd700 1 --2- 172.21.15.61:0/4140990856 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 0x7fb2040c57d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009910 tx=0x7fb1f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9795821f52d022a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb201ffb700 1 -- 172.21.15.61:0/4140990856 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400b7e0 con 0x7fb204159c10 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb201ffb700 1 -- 172.21.15.61:0/4140990856 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f400b940 con 0x7fb204159c10 2023-12-24T20:01:15.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.211+0000 7fb201ffb700 1 -- 172.21.15.61:0/4140990856 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400bce0 con 0x7fb204159c10 2023-12-24T20:01:15.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.212+0000 7fb209347700 1 -- 172.21.15.61:0/4140990856 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 msgr2=0x7fb2040c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.212+0000 7fb209347700 1 --2- 172.21.15.61:0/4140990856 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 0x7fb2040c57d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009910 tx=0x7fb1f40091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.212+0000 7fb209347700 1 -- 172.21.15.61:0/4140990856 shutdown_connections 2023-12-24T20:01:15.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.212+0000 7fb209347700 1 --2- 172.21.15.61:0/4140990856 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 0x7fb2040c57d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.212+0000 7fb209347700 1 -- 172.21.15.61:0/4140990856 >> 172.21.15.61:0/4140990856 conn(0x7fb20406e640 msgr2=0x7fb204067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:15.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.212+0000 7fb209347700 1 -- 172.21.15.61:0/4140990856 shutdown_connections 2023-12-24T20:01:15.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.212+0000 7fb209347700 1 -- 172.21.15.61:0/4140990856 wait complete. 2023-12-24T20:01:15.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.213+0000 7fb209347700 1 Processor -- start 2023-12-24T20:01:15.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.213+0000 7fb209347700 1 -- start start 2023-12-24T20:01:15.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb209347700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2040cc190 0x7fb20416ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb209347700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 0x7fb2040b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb209347700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb204159fe0 0x7fb2041533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb209347700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb204155220 con 0x7fb204159c10 2023-12-24T20:01:15.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb209347700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040b3d10 con 0x7fb204159fe0 2023-12-24T20:01:15.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb209347700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041538f0 con 0x7fb2040cc190 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb2027fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 0x7fb2040b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb2027fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 0x7fb2040b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35882/0 (socket says 172.21.15.61:35882) 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb2027fc700 1 -- 172.21.15.61:0/209959951 learned_addr learned my addr 172.21.15.61:0/209959951 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb2037fe700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb204159fe0 0x7fb2041533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb202ffd700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2040cc190 0x7fb20416ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb2027fc700 1 -- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2040cc190 msgr2=0x7fb20416ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb2027fc700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2040cc190 0x7fb20416ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb2027fc700 1 -- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb204159fe0 msgr2=0x7fb2041533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb2027fc700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb204159fe0 0x7fb2041533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.214+0000 7fb2027fc700 1 -- 172.21.15.61:0/209959951 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f4009420 con 0x7fb204159c10 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.215+0000 7fb2027fc700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 0x7fb2040b37d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800c590 tx=0x7fb1f8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.215+0000 7fb1eaffd700 1 -- 172.21.15.61:0/209959951 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8011590 con 0x7fb204159c10 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.215+0000 7fb1eaffd700 1 -- 172.21.15.61:0/209959951 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f8011730 con 0x7fb204159c10 2023-12-24T20:01:15.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.215+0000 7fb209347700 1 -- 172.21.15.61:0/209959951 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2040b3fb0 con 0x7fb204159c10 2023-12-24T20:01:15.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.215+0000 7fb1eaffd700 1 -- 172.21.15.61:0/209959951 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8011af0 con 0x7fb204159c10 2023-12-24T20:01:15.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.215+0000 7fb209347700 1 -- 172.21.15.61:0/209959951 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2040b4570 con 0x7fb204159c10 2023-12-24T20:01:15.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.216+0000 7fb209347700 1 -- 172.21.15.61:0/209959951 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2040890b0 con 0x7fb204159c10 2023-12-24T20:01:15.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.216+0000 7fb1eaffd700 1 -- 172.21.15.61:0/209959951 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb1f801c460 con 0x7fb204159c10 2023-12-24T20:01:15.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.217+0000 7fb1eaffd700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb1f0066f30 0x7fb1f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.217+0000 7fb1eaffd700 1 -- 172.21.15.61:0/209959951 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb1f80843c0 con 0x7fb204159c10 2023-12-24T20:01:15.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.217+0000 7fb1eaffd700 1 -- 172.21.15.61:0/209959951 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7fb1f006eb10 con 0x7fb204159c10 2023-12-24T20:01:15.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.217+0000 7fb202ffd700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb1f0066f30 0x7fb1f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.218+0000 7fb202ffd700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb1f0066f30 0x7fb1f00693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40030c0 tx=0x7fb1f4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:15.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.221+0000 7fb1eaffd700 1 -- 172.21.15.61:0/209959951 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1f8051550 con 0x7fb204159c10 2023-12-24T20:01:15.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.418+0000 7fb209347700 1 -- 172.21.15.61:0/209959951 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb20404c3c0 con 0x7fb204159c10 2023-12-24T20:01:15.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.419+0000 7fb1eaffd700 1 -- 172.21.15.61:0/209959951 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+15494 (secure 0 0 0) 0x7fb1f8054b70 con 0x7fb204159c10 2023-12-24T20:01:15.419 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:15.419 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":85,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:01:03.573115+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:00:39.818793+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-24T20:00:40.387692+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.38","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:01:15.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 -- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb1f0066f30 msgr2=0x7fb1f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb1f0066f30 0x7fb1f00693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40030c0 tx=0x7fb1f4016000 comp rx=0 tx=0).stop 2023-12-24T20:01:15.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 -- 172.21.15.61:0/209959951 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 msgr2=0x7fb2040b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 0x7fb2040b37d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800c590 tx=0x7fb1f8007f30 comp rx=0 tx=0).stop 2023-12-24T20:01:15.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 -- 172.21.15.61:0/209959951 shutdown_connections 2023-12-24T20:01:15.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2040cc190 0x7fb20416ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb1f0066f30 0x7fb1f00693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb204159fe0 0x7fb2041533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 --2- 172.21.15.61:0/209959951 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb204159c10 0x7fb2040b37d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 -- 172.21.15.61:0/209959951 >> 172.21.15.61:0/209959951 conn(0x7fb20406e640 msgr2=0x7fb2040ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:15.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 -- 172.21.15.61:0/209959951 shutdown_connections 2023-12-24T20:01:15.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.421+0000 7fb209347700 1 -- 172.21.15.61:0/209959951 wait complete. 2023-12-24T20:01:15.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T20:00:39.818793+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T20:00:40.387692+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:01:15.434 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:01:15.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.558+0000 7fb4b3f7e700 1 Processor -- start 2023-12-24T20:01:15.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.558+0000 7fb4b3f7e700 1 -- start start 2023-12-24T20:01:15.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.559+0000 7fb4b3f7e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4ac0ce030 0x7fb4ac068df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.559+0000 7fb4b3f7e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac15d900 con 0x7fb4ac06b560 2023-12-24T20:01:15.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.559+0000 7fb4b3f7e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac15e480 con 0x7fb4ac159f10 2023-12-24T20:01:15.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.559+0000 7fb4b3f7e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac15e910 con 0x7fb4ac0ce030 2023-12-24T20:01:15.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.559+0000 7fb4b1519700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb4ac06b560 0x7fb4ac159800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56948/0 (socket says 172.21.15.61:56948) 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.559+0000 7fb4b1519700 1 -- 172.21.15.61:0/4134778390 learned_addr learned my addr 172.21.15.61:0/4134778390 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b1d1a700 1 --2- 172.21.15.61:0/4134778390 >> v2:172.21.15.133:3300/0 conn(0x7fb4ac0ce030 0x7fb4ac068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334505553 0 0) 0x7fb4ac15d900 con 0x7fb4ac06b560 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb498003570 con 0x7fb4ac06b560 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4021594534 0 0) 0x7fb498003570 con 0x7fb4ac06b560 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 >> v2:172.21.15.133:3300/0 conn(0x7fb4ac0ce030 msgr2=0x7fb4ac068df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 --2- 172.21.15.61:0/4134778390 >> v2:172.21.15.133:3300/0 conn(0x7fb4ac0ce030 0x7fb4ac068df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 >> v1:172.21.15.133:6789/0 conn(0x7fb4ac159f10 legacy=0x7fb4ac067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac15db50 con 0x7fb4ac06b560 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fb4a8001470 con 0x7fb4ac06b560 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b1d1a700 1 --2- 172.21.15.61:0/4134778390 >> v2:172.21.15.133:3300/0 conn(0x7fb4ac0ce030 0x7fb4ac068df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 >> v1:172.21.15.61:6789/0 conn(0x7fb4ac06b560 legacy=0x7fb4ac159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb498003a60 0x7fb498003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb498004810 0x7fb498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb49800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49800c0b0 con 0x7fb4980051c0 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49800c220 con 0x7fb498004810 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49800c3e0 con 0x7fb498003a60 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b251b700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb49800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b1519700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb498004810 0x7fb498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.560+0000 7fb4b1d1a700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb498003a60 0x7fb498003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b251b700 1 -- 172.21.15.61:0/4134778390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb498003a60 msgr2=0x7fb498003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b251b700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb498003a60 0x7fb498003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b251b700 1 -- 172.21.15.61:0/4134778390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb498004810 msgr2=0x7fb498004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b251b700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb498004810 0x7fb498004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b251b700 1 -- 172.21.15.61:0/4134778390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb498003570 con 0x7fb4980051c0 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b251b700 1 -- 172.21.15.61:0/4134778390 reap_dead start 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b251b700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb49800ba60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40020a0 tx=0x7fb4a40016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628e63bb5a333264 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:15.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a40019e0 con 0x7fb4980051c0 2023-12-24T20:01:15.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a400c8b0 con 0x7fb4980051c0 2023-12-24T20:01:15.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b0d18700 1 -- 172.21.15.61:0/4134778390 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a400cc70 con 0x7fb4980051c0 2023-12-24T20:01:15.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/4134778390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 msgr2=0x7fb49800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b3f7e700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb49800ba60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb4a40020a0 tx=0x7fb4a40016d0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/4134778390 shutdown_connections 2023-12-24T20:01:15.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b3f7e700 1 --2- 172.21.15.61:0/4134778390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb49800ba60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.561+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/4134778390 >> 172.21.15.61:0/4134778390 conn(0x7fb4ac06f810 msgr2=0x7fb4ac06ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:15.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.562+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/4134778390 shutdown_connections 2023-12-24T20:01:15.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.562+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/4134778390 wait complete. 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.563+0000 7fb4b3f7e700 1 Processor -- start 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.563+0000 7fb4b3f7e700 1 -- start start 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.563+0000 7fb4b3f7e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb4ac14d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.563+0000 7fb4b3f7e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4ac14ec10 0x7fb4ac14f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.563+0000 7fb4b3f7e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac1527e0 0x7fb4ac152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.563+0000 7fb4b3f7e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b3980 con 0x7fb4980051c0 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.563+0000 7fb4b3f7e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac1531c0 con 0x7fb4ac1527e0 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.563+0000 7fb4b3f7e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac14f5c0 con 0x7fb4ac14ec10 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b1d1a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb4ac14d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b1d1a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb4ac14d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35904/0 (socket says 172.21.15.61:35904) 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b1d1a700 1 -- 172.21.15.61:0/2491785967 learned_addr learned my addr 172.21.15.61:0/2491785967 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b1d1a700 1 -- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4ac14ec10 msgr2=0x7fb4ac14f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b1d1a700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4ac14ec10 0x7fb4ac14f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b1d1a700 1 -- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac1527e0 msgr2=0x7fb4ac152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b1d1a700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac1527e0 0x7fb4ac152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b1d1a700 1 -- 172.21.15.61:0/2491785967 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0b44b0 con 0x7fb4980051c0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b1d1a700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb4ac14d5d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb49c011d70 tx=0x7fb49c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4a1ffb700 1 -- 172.21.15.61:0/2491785967 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00fc70 con 0x7fb4980051c0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4a1ffb700 1 -- 172.21.15.61:0/2491785967 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00fdd0 con 0x7fb4980051c0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4a1ffb700 1 -- 172.21.15.61:0/2491785967 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c01d6d0 con 0x7fb4980051c0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/2491785967 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac150fa0 con 0x7fb4980051c0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.564+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/2491785967 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac0b3b80 con 0x7fb4980051c0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.565+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/2491785967 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac04c3c0 con 0x7fb4980051c0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.566+0000 7fb4a1ffb700 1 -- 172.21.15.61:0/2491785967 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb49c01da80 con 0x7fb4980051c0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.566+0000 7fb4a1ffb700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb490066f30 0x7fb4900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.566+0000 7fb4a1ffb700 1 -- 172.21.15.61:0/2491785967 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb49c018070 con 0x7fb4980051c0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.566+0000 7fb4a1ffb700 1 -- 172.21.15.61:0/2491785967 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7fb49006eb10 con 0x7fb4980051c0 2023-12-24T20:01:15.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.567+0000 7fb4b1519700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb490066f30 0x7fb4900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.567+0000 7fb4b1519700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb490066f30 0x7fb4900693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8000e10 tx=0x7fb4a8001e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:15.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.570+0000 7fb4a1ffb700 1 -- 172.21.15.61:0/2491785967 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb49c0525f0 con 0x7fb4980051c0 2023-12-24T20:01:15.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.763+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/2491785967 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4ac15de30 con 0x7fb4980051c0 2023-12-24T20:01:15.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.764+0000 7fb4a1ffb700 1 -- 172.21.15.61:0/2491785967 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb49c022070 con 0x7fb4980051c0 2023-12-24T20:01:15.764 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:01:15.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb490066f30 msgr2=0x7fb4900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb490066f30 0x7fb4900693e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8000e10 tx=0x7fb4a8001e70 comp rx=0 tx=0).stop 2023-12-24T20:01:15.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/2491785967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 msgr2=0x7fb4ac14d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb4ac14d5d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb49c011d70 tx=0x7fb49c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/2491785967 shutdown_connections 2023-12-24T20:01:15.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb490066f30 0x7fb4900693e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac1527e0 0x7fb4ac152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb4980051c0 0x7fb4ac14d5d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 --2- 172.21.15.61:0/2491785967 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb4ac14ec10 0x7fb4ac14f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/2491785967 >> 172.21.15.61:0/2491785967 conn(0x7fb4ac06f810 msgr2=0x7fb4ac0c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:15.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/2491785967 shutdown_connections 2023-12-24T20:01:15.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.766+0000 7fb4b3f7e700 1 -- 172.21.15.61:0/2491785967 wait complete. 2023-12-24T20:01:15.778 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:01:15.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.902+0000 7f0f5fc5f700 1 Processor -- start 2023-12-24T20:01:15.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.903+0000 7f0f5fc5f700 1 -- start start 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.903+0000 7f0f5fc5f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0f5815a1c0 0x7f0f580cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.903+0000 7f0f5fc5f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f580cf150 con 0x7f0f580cd9b0 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.903+0000 7f0f5fc5f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f580cc5f0 con 0x7f0f58159df0 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.903+0000 7f0f5fc5f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f580ce820 con 0x7f0f5815a1c0 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5d1fa700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0f5815a1c0 0x7f0f580cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5e1fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0f580cd9b0 0x7f0f580cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56964/0 (socket says 172.21.15.61:56964) 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5e1fc700 1 -- 172.21.15.61:0/4294580694 learned_addr learned my addr 172.21.15.61:0/4294580694 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5d1fa700 1 -- 172.21.15.61:0/4294580694 >> v1:172.21.15.133:6789/0 conn(0x7f0f58159df0 legacy=0x7f0f580cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5d1fa700 1 -- 172.21.15.61:0/4294580694 >> v1:172.21.15.61:6789/0 conn(0x7f0f580cd9b0 legacy=0x7f0f580cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5d1fa700 1 -- 172.21.15.61:0/4294580694 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f580ceb00 con 0x7f0f5815a1c0 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5c9f9700 1 -- 172.21.15.61:0/4294580694 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174150587 0 0) 0x7f0f580cf150 con 0x7f0f580cd9b0 2023-12-24T20:01:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5d1fa700 1 --2- 172.21.15.61:0/4294580694 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f5815a1c0 0x7f0f580cd470 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0f480098e0 tx=0x7f0f480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0248bf61e6dd91 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5c9f9700 1 -- 172.21.15.61:0/4294580694 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48009e80 con 0x7f0f5815a1c0 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5c9f9700 1 -- 172.21.15.61:0/4294580694 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4800b820 con 0x7f0f5815a1c0 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.904+0000 7f0f5c9f9700 1 -- 172.21.15.61:0/4294580694 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800bba0 con 0x7f0f5815a1c0 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.905+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4294580694 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f5815a1c0 msgr2=0x7f0f580cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.905+0000 7f0f5fc5f700 1 --2- 172.21.15.61:0/4294580694 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f5815a1c0 0x7f0f580cd470 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0f480098e0 tx=0x7f0f480091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.905+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4294580694 shutdown_connections 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.905+0000 7f0f5fc5f700 1 --2- 172.21.15.61:0/4294580694 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f5815a1c0 0x7f0f580cd470 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.905+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4294580694 >> 172.21.15.61:0/4294580694 conn(0x7f0f5806e600 msgr2=0x7f0f58067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.905+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4294580694 shutdown_connections 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.905+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4294580694 wait complete. 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.906+0000 7f0f5fc5f700 1 Processor -- start 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.906+0000 7f0f5fc5f700 1 -- start start 2023-12-24T20:01:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5fc5f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f580cd9b0 0x7f0f580b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5fc5f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f58159df0 0x7f0f580b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5fc5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f5815a1c0 0x7f0f580b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5fc5f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580b3d40 con 0x7f0f580cd9b0 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5fc5f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5815b770 con 0x7f0f5815a1c0 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5fc5f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580b2e50 con 0x7f0f58159df0 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5d9fb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f580cd9b0 0x7f0f580b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5d9fb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f580cd9b0 0x7f0f580b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35924/0 (socket says 172.21.15.61:35924) 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5d9fb700 1 -- 172.21.15.61:0/4112808148 learned_addr learned my addr 172.21.15.61:0/4112808148 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5d9fb700 1 -- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f58159df0 msgr2=0x7f0f580b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5d9fb700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f58159df0 0x7f0f580b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5d9fb700 1 -- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f5815a1c0 msgr2=0x7f0f580b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5d9fb700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f5815a1c0 0x7f0f580b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5d9fb700 1 -- 172.21.15.61:0/4112808148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f48009420 con 0x7f0f580cd9b0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f5d9fb700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f580cd9b0 0x7f0f580b43b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c950 tx=0x7f0f50002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f4dffb700 1 -- 172.21.15.61:0/4112808148 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000a7e0 con 0x7f0f580cd9b0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.907+0000 7f0f4dffb700 1 -- 172.21.15.61:0/4112808148 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5000a940 con 0x7f0f580cd9b0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.908+0000 7f0f4dffb700 1 -- 172.21.15.61:0/4112808148 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000ad00 con 0x7f0f580cd9b0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.908+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4112808148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f580b3130 con 0x7f0f580cd9b0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.908+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4112808148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5815b400 con 0x7f0f580cd9b0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.909+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4112808148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f58089040 con 0x7f0f580cd9b0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.909+0000 7f0f4dffb700 1 -- 172.21.15.61:0/4112808148 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0f50012630 con 0x7f0f580cd9b0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.909+0000 7f0f4dffb700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f3c066f30 0x7f0f3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.909+0000 7f0f4dffb700 1 -- 172.21.15.61:0/4112808148 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0f500849e0 con 0x7f0f580cd9b0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.910+0000 7f0f5d1fa700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f3c066f30 0x7f0f3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:15.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.910+0000 7f0f4dffb700 1 -- 172.21.15.61:0/4112808148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7f0f3c06eb10 con 0x7f0f580cd9b0 2023-12-24T20:01:15.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.910+0000 7f0f5d1fa700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f3c066f30 0x7f0f3c0693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0f5815a5f0 tx=0x7f0f48016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:15.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:15.914+0000 7f0f4dffb700 1 -- 172.21.15.61:0/4112808148 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f50016020 con 0x7f0f580cd9b0 2023-12-24T20:01:16.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.108+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4112808148 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f5815ba50 con 0x7f0f580cd9b0 2023-12-24T20:01:16.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.108+0000 7f0f4dffb700 1 -- 172.21.15.61:0/4112808148 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f50051c10 con 0x7f0f580cd9b0 2023-12-24T20:01:16.108 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f3c066f30 msgr2=0x7f0f3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f3c066f30 0x7f0f3c0693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0f5815a5f0 tx=0x7f0f48016000 comp rx=0 tx=0).stop 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4112808148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f580cd9b0 msgr2=0x7f0f580b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f580cd9b0 0x7f0f580b43b0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c950 tx=0x7f0f50002760 comp rx=0 tx=0).stop 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4112808148 shutdown_connections 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f3c066f30 0x7f0f3c0693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f5815a1c0 0x7f0f580b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f580cd9b0 0x7f0f580b43b0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 --2- 172.21.15.61:0/4112808148 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f58159df0 0x7f0f580b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4112808148 >> 172.21.15.61:0/4112808148 conn(0x7f0f5806e600 msgr2=0x7f0f58067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4112808148 shutdown_connections 2023-12-24T20:01:16.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.110+0000 7f0f5fc5f700 1 -- 172.21.15.61:0/4112808148 wait complete. 2023-12-24T20:01:16.122 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:01:16.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.246+0000 7fb35871e700 1 Processor -- start 2023-12-24T20:01:16.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.247+0000 7fb35871e700 1 -- start start 2023-12-24T20:01:16.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb35871e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb350156b60 0x7fb35006af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb35871e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb350067f10 0x7fb3500c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb35871e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35006aaf0 con 0x7fb3500c3460 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb35871e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3500c38a0 con 0x7fb350067f10 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb35871e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb350069c00 con 0x7fb350156b60 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb355cb9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb350067f10 0x7fb3500c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb355cb9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb350067f10 0x7fb3500c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35926/0 (socket says 172.21.15.61:35926) 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb355cb9700 1 -- 172.21.15.61:0/1288331461 learned_addr learned my addr 172.21.15.61:0/1288331461 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb3564ba700 1 --2- 172.21.15.61:0/1288331461 >> v2:172.21.15.133:3300/0 conn(0x7fb350156b60 0x7fb35006af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb355cb9700 1 -- 172.21.15.61:0/1288331461 >> v2:172.21.15.133:3300/0 conn(0x7fb350156b60 msgr2=0x7fb35006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb355cb9700 1 --2- 172.21.15.61:0/1288331461 >> v2:172.21.15.133:3300/0 conn(0x7fb350156b60 0x7fb35006af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb355cb9700 1 -- 172.21.15.61:0/1288331461 >> v1:172.21.15.133:6789/0 conn(0x7fb3500c3460 legacy=0x7fb3500c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb355cb9700 1 -- 172.21.15.61:0/1288331461 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb350069ee0 con 0x7fb350067f10 2023-12-24T20:01:16.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb355cb9700 1 --2- 172.21.15.61:0/1288331461 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350067f10 0x7fb3500c2f20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb35006cf20 tx=0x7fb34c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3eadb343011bec5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb3554b8700 1 -- 172.21.15.61:0/1288331461 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00b820 con 0x7fb350067f10 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb3554b8700 1 -- 172.21.15.61:0/1288331461 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c00b980 con 0x7fb350067f10 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.248+0000 7fb3554b8700 1 -- 172.21.15.61:0/1288331461 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00bd20 con 0x7fb350067f10 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.249+0000 7fb35871e700 1 -- 172.21.15.61:0/1288331461 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350067f10 msgr2=0x7fb3500c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.249+0000 7fb35871e700 1 --2- 172.21.15.61:0/1288331461 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350067f10 0x7fb3500c2f20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb35006cf20 tx=0x7fb34c009250 comp rx=0 tx=0).stop 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.249+0000 7fb35871e700 1 -- 172.21.15.61:0/1288331461 shutdown_connections 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.249+0000 7fb35871e700 1 --2- 172.21.15.61:0/1288331461 >> v2:172.21.15.133:3300/0 conn(0x7fb350156b60 0x7fb35006af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.249+0000 7fb35871e700 1 --2- 172.21.15.61:0/1288331461 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350067f10 0x7fb3500c2f20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.249+0000 7fb35871e700 1 -- 172.21.15.61:0/1288331461 >> 172.21.15.61:0/1288331461 conn(0x7fb3500ce420 msgr2=0x7fb3500ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.249+0000 7fb35871e700 1 -- 172.21.15.61:0/1288331461 shutdown_connections 2023-12-24T20:01:16.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.249+0000 7fb35871e700 1 -- 172.21.15.61:0/1288331461 wait complete. 2023-12-24T20:01:16.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.250+0000 7fb35871e700 1 Processor -- start 2023-12-24T20:01:16.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.250+0000 7fb35871e700 1 -- start start 2023-12-24T20:01:16.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb35871e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb350067f10 0x7fb350147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb35871e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3500c3460 0x7fb3500b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb35871e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350156b60 0x7fb3500c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb35871e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500b20e0 con 0x7fb350156b60 2023-12-24T20:01:16.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb35871e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35013d070 con 0x7fb350067f10 2023-12-24T20:01:16.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb35871e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c7630 con 0x7fb3500c3460 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb356cbb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350156b60 0x7fb3500c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb356cbb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350156b60 0x7fb3500c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35942/0 (socket says 172.21.15.61:35942) 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb356cbb700 1 -- 172.21.15.61:0/2944724800 learned_addr learned my addr 172.21.15.61:0/2944724800 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb3564ba700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb350067f10 0x7fb350147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb355cb9700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3500c3460 0x7fb3500b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb356cbb700 1 -- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3500c3460 msgr2=0x7fb3500b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb356cbb700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3500c3460 0x7fb3500b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb356cbb700 1 -- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb350067f10 msgr2=0x7fb350147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb356cbb700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb350067f10 0x7fb350147010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.251+0000 7fb356cbb700 1 -- 172.21.15.61:0/2944724800 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c0094f0 con 0x7fb350156b60 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.252+0000 7fb356cbb700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350156b60 0x7fb3500c9f70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb34800c960 tx=0x7fb3480026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.252+0000 7fb3467fc700 1 -- 172.21.15.61:0/2944724800 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348012630 con 0x7fb350156b60 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.252+0000 7fb3467fc700 1 -- 172.21.15.61:0/2944724800 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348012790 con 0x7fb350156b60 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.252+0000 7fb35871e700 1 -- 172.21.15.61:0/2944724800 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb350146530 con 0x7fb350156b60 2023-12-24T20:01:16.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.252+0000 7fb3467fc700 1 -- 172.21.15.61:0/2944724800 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348012b50 con 0x7fb350156b60 2023-12-24T20:01:16.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.252+0000 7fb35871e700 1 -- 172.21.15.61:0/2944724800 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb350146af0 con 0x7fb350156b60 2023-12-24T20:01:16.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.253+0000 7fb35871e700 1 -- 172.21.15.61:0/2944724800 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3500b3580 con 0x7fb350156b60 2023-12-24T20:01:16.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.253+0000 7fb3467fc700 1 -- 172.21.15.61:0/2944724800 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb34801b400 con 0x7fb350156b60 2023-12-24T20:01:16.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.253+0000 7fb3467fc700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb334066f60 0x7fb334069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.254+0000 7fb3467fc700 1 -- 172.21.15.61:0/2944724800 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb3480848b0 con 0x7fb350156b60 2023-12-24T20:01:16.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.254+0000 7fb3467fc700 1 -- 172.21.15.61:0/2944724800 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7fb33406eb40 con 0x7fb350156b60 2023-12-24T20:01:16.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.254+0000 7fb3564ba700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb334066f60 0x7fb334069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.254+0000 7fb3564ba700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb334066f60 0x7fb334069410 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb340006fd0 tx=0x7fb340008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:16.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.258+0000 7fb3467fc700 1 -- 172.21.15.61:0/2944724800 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb348016060 con 0x7fb350156b60 2023-12-24T20:01:16.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.452+0000 7fb35871e700 1 -- 172.21.15.61:0/2944724800 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb350146ce0 con 0x7fb350156b60 2023-12-24T20:01:16.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.453+0000 7fb3467fc700 1 -- 172.21.15.61:0/2944724800 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb348051ae0 con 0x7fb350156b60 2023-12-24T20:01:16.453 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T20:01:16.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.454+0000 7fb35871e700 1 -- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb334066f60 msgr2=0x7fb334069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.454+0000 7fb35871e700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb334066f60 0x7fb334069410 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb340006fd0 tx=0x7fb340008040 comp rx=0 tx=0).stop 2023-12-24T20:01:16.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.454+0000 7fb35871e700 1 -- 172.21.15.61:0/2944724800 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350156b60 msgr2=0x7fb3500c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.454+0000 7fb35871e700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350156b60 0x7fb3500c9f70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb34800c960 tx=0x7fb3480026e0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.455+0000 7fb35871e700 1 -- 172.21.15.61:0/2944724800 shutdown_connections 2023-12-24T20:01:16.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.455+0000 7fb35871e700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb334066f60 0x7fb334069410 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.455+0000 7fb35871e700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb350156b60 0x7fb3500c9f70 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.455+0000 7fb35871e700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb350067f10 0x7fb350147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.455+0000 7fb35871e700 1 --2- 172.21.15.61:0/2944724800 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb3500c3460 0x7fb3500b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.455+0000 7fb35871e700 1 -- 172.21.15.61:0/2944724800 >> 172.21.15.61:0/2944724800 conn(0x7fb3500ce420 msgr2=0x7fb35014bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:16.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.455+0000 7fb35871e700 1 -- 172.21.15.61:0/2944724800 shutdown_connections 2023-12-24T20:01:16.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.455+0000 7fb35871e700 1 -- 172.21.15.61:0/2944724800 wait complete. 2023-12-24T20:01:16.467 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:01:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.589+0000 7f67f0064700 1 Processor -- start 2023-12-24T20:01:16.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.589+0000 7f67f0064700 1 -- start start 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67f0064700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67e80af710 0x7f67e80afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67f0064700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f67e8068c80 0x7f67e8067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67f0064700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e80687f0 con 0x7f67e80a6c80 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67f0064700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e8067be0 con 0x7f67e8068c80 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67f0064700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e8067ec0 con 0x7f67e80af710 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67ed5ff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f67e8068c80 0x7f67e8067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67ed5ff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f67e8068c80 0x7f67e8067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48470/0 (socket says 172.21.15.61:48470) 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67ed5ff700 1 -- 172.21.15.61:0/3051184425 learned_addr learned my addr 172.21.15.61:0/3051184425 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67ede00700 1 --2- 172.21.15.61:0/3051184425 >> v2:172.21.15.133:3300/0 conn(0x7f67e80af710 0x7f67e80afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67ed5ff700 1 -- 172.21.15.61:0/3051184425 >> v2:172.21.15.133:3300/0 conn(0x7f67e80af710 msgr2=0x7f67e80afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67ed5ff700 1 --2- 172.21.15.61:0/3051184425 >> v2:172.21.15.133:3300/0 conn(0x7f67e80af710 0x7f67e80afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67ed5ff700 1 -- 172.21.15.61:0/3051184425 >> v1:172.21.15.133:6789/0 conn(0x7f67e80a6c80 legacy=0x7f67e815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:16.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67ed5ff700 1 -- 172.21.15.61:0/3051184425 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80681a0 con 0x7f67e8068c80 2023-12-24T20:01:16.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.590+0000 7f67ed5ff700 1 --2- 172.21.15.61:0/3051184425 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 0x7f67e8067550 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f67e80cb560 tx=0x7f67d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b627f88e1bc14b15 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:16.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67ecdfe700 1 -- 172.21.15.61:0/3051184425 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d800b820 con 0x7f67e8068c80 2023-12-24T20:01:16.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67ecdfe700 1 -- 172.21.15.61:0/3051184425 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d800b980 con 0x7f67e8068c80 2023-12-24T20:01:16.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67ecdfe700 1 -- 172.21.15.61:0/3051184425 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d800bd20 con 0x7f67e8068c80 2023-12-24T20:01:16.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67f0064700 1 -- 172.21.15.61:0/3051184425 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 msgr2=0x7f67e8067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67f0064700 1 --2- 172.21.15.61:0/3051184425 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 0x7f67e8067550 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f67e80cb560 tx=0x7f67d8009250 comp rx=0 tx=0).stop 2023-12-24T20:01:16.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67f0064700 1 -- 172.21.15.61:0/3051184425 shutdown_connections 2023-12-24T20:01:16.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67f0064700 1 --2- 172.21.15.61:0/3051184425 >> v2:172.21.15.133:3300/0 conn(0x7f67e80af710 0x7f67e80afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67f0064700 1 --2- 172.21.15.61:0/3051184425 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 0x7f67e8067550 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67f0064700 1 -- 172.21.15.61:0/3051184425 >> 172.21.15.61:0/3051184425 conn(0x7f67e80ca200 msgr2=0x7f67e80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:16.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67f0064700 1 -- 172.21.15.61:0/3051184425 shutdown_connections 2023-12-24T20:01:16.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.591+0000 7f67f0064700 1 -- 172.21.15.61:0/3051184425 wait complete. 2023-12-24T20:01:16.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.592+0000 7f67f0064700 1 Processor -- start 2023-12-24T20:01:16.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.593+0000 7f67f0064700 1 -- start start 2023-12-24T20:01:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.593+0000 7f67f0064700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 0x7f67e8167ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.593+0000 7f67f0064700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e80a6c80 0x7f67e8154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.593+0000 7f67f0064700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67e80af710 0x7f67e8159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.593+0000 7f67f0064700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80aa980 con 0x7f67e8068c80 2023-12-24T20:01:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.593+0000 7f67f0064700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e81684d0 con 0x7f67e80a6c80 2023-12-24T20:01:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.593+0000 7f67f0064700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e81687b0 con 0x7f67e80af710 2023-12-24T20:01:16.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.593+0000 7f67ede00700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 0x7f67e8167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.593+0000 7f67ede00700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 0x7f67e8167ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48478/0 (socket says 172.21.15.61:48478) 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.593+0000 7f67ede00700 1 -- 172.21.15.61:0/2565195775 learned_addr learned my addr 172.21.15.61:0/2565195775 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ed5ff700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e80a6c80 0x7f67e8154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ee601700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67e80af710 0x7f67e8159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ede00700 1 -- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67e80af710 msgr2=0x7f67e8159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ede00700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67e80af710 0x7f67e8159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ede00700 1 -- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e80a6c80 msgr2=0x7f67e8154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ede00700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e80a6c80 0x7f67e8154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ede00700 1 -- 172.21.15.61:0/2565195775 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d80094f0 con 0x7f67e8068c80 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ee601700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67e80af710 0x7f67e8159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ede00700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 0x7f67e8167ea0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f67e400d890 tx=0x7f67e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ddffb700 1 -- 172.21.15.61:0/2565195775 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e40125f0 con 0x7f67e8068c80 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ddffb700 1 -- 172.21.15.61:0/2565195775 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e4012750 con 0x7f67e8068c80 2023-12-24T20:01:16.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67f0064700 1 -- 172.21.15.61:0/2565195775 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e8168a90 con 0x7f67e8068c80 2023-12-24T20:01:16.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67ddffb700 1 -- 172.21.15.61:0/2565195775 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e4012ad0 con 0x7f67e8068c80 2023-12-24T20:01:16.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.594+0000 7f67f0064700 1 -- 172.21.15.61:0/2565195775 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e8168e20 con 0x7f67e8068c80 2023-12-24T20:01:16.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.595+0000 7f67f0064700 1 -- 172.21.15.61:0/2565195775 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e8157ca0 con 0x7f67e8068c80 2023-12-24T20:01:16.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.596+0000 7f67ddffb700 1 -- 172.21.15.61:0/2565195775 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f67e401e460 con 0x7f67e8068c80 2023-12-24T20:01:16.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.596+0000 7f67ddffb700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f67cc066f30 0x7f67cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.596+0000 7f67ddffb700 1 -- 172.21.15.61:0/2565195775 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f67e4084b90 con 0x7f67e8068c80 2023-12-24T20:01:16.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.596+0000 7f67ddffb700 1 -- 172.21.15.61:0/2565195775 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7f67cc06eb10 con 0x7f67e8068c80 2023-12-24T20:01:16.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.596+0000 7f67ed5ff700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f67cc066f30 0x7f67cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.597+0000 7f67ed5ff700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f67cc066f30 0x7f67cc0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f67e80cb560 tx=0x7f67d8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:16.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.600+0000 7f67ddffb700 1 -- 172.21.15.61:0/2565195775 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67e4051dc0 con 0x7f67e8068c80 2023-12-24T20:01:16.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.841+0000 7f67f0064700 1 -- 172.21.15.61:0/2565195775 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67e804c3c0 con 0x7f67e8068c80 2023-12-24T20:01:16.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.841+0000 7f67ddffb700 1 -- 172.21.15.61:0/2565195775 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f67e40553e0 con 0x7f67e8068c80 2023-12-24T20:01:16.842 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:16.842 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/3462396702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3462396702},{"type":"v1","addr":"172.21.15.61:6835","nonce":3462396702}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2539986874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2539986874},{"type":"v1","addr":"172.21.15.133:6836","nonce":2539986874}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":5611,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/118195153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":118195153},{"type":"v1","addr":"172.21.15.133:6837","nonce":118195153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:00:41.409889+0000","modified":"2023-12-24T20:00:45.042959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5994":{"gid":5994,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/761559894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":761559894},{"type":"v1","addr":"172.21.15.61:6834","nonce":761559894}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T20:01:16.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.843+0000 7f67f0064700 1 -- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f67cc066f30 msgr2=0x7f67cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.843+0000 7f67f0064700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f67cc066f30 0x7f67cc0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f67e80cb560 tx=0x7f67d8016000 comp rx=0 tx=0).stop 2023-12-24T20:01:16.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.843+0000 7f67f0064700 1 -- 172.21.15.61:0/2565195775 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 msgr2=0x7f67e8167ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.843+0000 7f67f0064700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 0x7f67e8167ea0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f67e400d890 tx=0x7f67e4008040 comp rx=0 tx=0).stop 2023-12-24T20:01:16.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.843+0000 7f67f0064700 1 -- 172.21.15.61:0/2565195775 shutdown_connections 2023-12-24T20:01:16.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.843+0000 7f67f0064700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f67e80af710 0x7f67e8159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.843+0000 7f67f0064700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f67cc066f30 0x7f67cc0693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.843+0000 7f67f0064700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f67e8068c80 0x7f67e8167ea0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.843+0000 7f67f0064700 1 --2- 172.21.15.61:0/2565195775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e80a6c80 0x7f67e8154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.843+0000 7f67f0064700 1 -- 172.21.15.61:0/2565195775 >> 172.21.15.61:0/2565195775 conn(0x7f67e80ca200 msgr2=0x7f67e806a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:16.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.844+0000 7f67f0064700 1 -- 172.21.15.61:0/2565195775 shutdown_connections 2023-12-24T20:01:16.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.844+0000 7f67f0064700 1 -- 172.21.15.61:0/2565195775 wait complete. 2023-12-24T20:01:16.845 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 44 2023-12-24T20:01:16.856 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:01:16.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.977+0000 7f60e4882700 1 Processor -- start 2023-12-24T20:01:16.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.977+0000 7f60e4882700 1 -- start start 2023-12-24T20:01:16.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.978+0000 7f60e4882700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f60e0156730 0x7f60e0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.978+0000 7f60e4882700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60e006dff0 0x7f60e00c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.978+0000 7f60e4882700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e0067a60 con 0x7f60e00b0830 2023-12-24T20:01:16.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.978+0000 7f60e4882700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e00c88e0 con 0x7f60e0156730 2023-12-24T20:01:16.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.978+0000 7f60e4882700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e00c8bc0 con 0x7f60e006dff0 2023-12-24T20:01:16.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.978+0000 7f60de59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f60e0156730 0x7f60e0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.978+0000 7f60ddd9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f60e00b0830 0x7f60e006d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:37510/0 (socket says 172.21.15.61:37510) 2023-12-24T20:01:16.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.978+0000 7f60ddd9b700 1 -- 172.21.15.61:0/2712691996 learned_addr learned my addr 172.21.15.61:0/2712691996 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:16.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60ded9d700 1 --2- 172.21.15.61:0/2712691996 >> v2:172.21.15.133:3300/0 conn(0x7f60e006dff0 0x7f60e00c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60de59c700 1 -- 172.21.15.61:0/2712691996 >> v2:172.21.15.133:3300/0 conn(0x7f60e006dff0 msgr2=0x7f60e00c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60de59c700 1 --2- 172.21.15.61:0/2712691996 >> v2:172.21.15.133:3300/0 conn(0x7f60e006dff0 0x7f60e00c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60de59c700 1 -- 172.21.15.61:0/2712691996 >> v1:172.21.15.61:6789/0 conn(0x7f60e00b0830 legacy=0x7f60e006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60de59c700 1 -- 172.21.15.61:0/2712691996 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00676f0 con 0x7f60e0156730 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60ded9d700 1 --2- 172.21.15.61:0/2712691996 >> v2:172.21.15.133:3300/0 conn(0x7f60e006dff0 0x7f60e00c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60dd59a700 1 -- 172.21.15.61:0/2712691996 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141489971 0 0) 0x7f60e0067a60 con 0x7f60e00b0830 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60de59c700 1 --2- 172.21.15.61:0/2712691996 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e0156730 0x7f60e0156b00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f60e00c7c00 tx=0x7f60d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1c6aa85eced496 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60dd59a700 1 -- 172.21.15.61:0/2712691996 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400b6b0 con 0x7f60e0156730 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60dd59a700 1 -- 172.21.15.61:0/2712691996 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d400b810 con 0x7f60e0156730 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.979+0000 7f60dd59a700 1 -- 172.21.15.61:0/2712691996 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400bbb0 con 0x7f60e0156730 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.980+0000 7f60e4882700 1 -- 172.21.15.61:0/2712691996 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e0156730 msgr2=0x7f60e0156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.980+0000 7f60e4882700 1 --2- 172.21.15.61:0/2712691996 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e0156730 0x7f60e0156b00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f60e00c7c00 tx=0x7f60d40091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.980+0000 7f60e4882700 1 -- 172.21.15.61:0/2712691996 shutdown_connections 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.980+0000 7f60e4882700 1 --2- 172.21.15.61:0/2712691996 >> v2:172.21.15.133:3300/0 conn(0x7f60e006dff0 0x7f60e00c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.980+0000 7f60e4882700 1 --2- 172.21.15.61:0/2712691996 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e0156730 0x7f60e0156b00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.980+0000 7f60e4882700 1 -- 172.21.15.61:0/2712691996 >> 172.21.15.61:0/2712691996 conn(0x7f60e00cd6f0 msgr2=0x7f60e00cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.980+0000 7f60e4882700 1 -- 172.21.15.61:0/2712691996 shutdown_connections 2023-12-24T20:01:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.980+0000 7f60e4882700 1 -- 172.21.15.61:0/2712691996 wait complete. 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.981+0000 7f60e4882700 1 Processor -- start 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.981+0000 7f60e4882700 1 -- start start 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60e4882700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60e006dff0 0x7f60e01574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60e4882700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e00b0830 0x7f60e0155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60e4882700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e0156730 0x7f60e0159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60e4882700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01561e0 con 0x7f60e00b0830 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60e4882700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0167b60 con 0x7f60e0156730 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60e4882700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0157af0 con 0x7f60e006dff0 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ddd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e00b0830 0x7f60e0155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ddd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e00b0830 0x7f60e0155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48494/0 (socket says 172.21.15.61:48494) 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ddd9b700 1 -- 172.21.15.61:0/1139489239 learned_addr learned my addr 172.21.15.61:0/1139489239 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ded9d700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e0156730 0x7f60e0159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60de59c700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60e006dff0 0x7f60e01574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ddd9b700 1 -- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60e006dff0 msgr2=0x7f60e01574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ddd9b700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60e006dff0 0x7f60e01574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ddd9b700 1 -- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e0156730 msgr2=0x7f60e0159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ddd9b700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e0156730 0x7f60e0159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ddd9b700 1 -- 172.21.15.61:0/1139489239 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4009420 con 0x7f60e00b0830 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ded9d700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e0156730 0x7f60e0159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60de59c700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60e006dff0 0x7f60e01574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ddd9b700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e00b0830 0x7f60e0155ca0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c810 tx=0x7f60d0007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ce7fc700 1 -- 172.21.15.61:0/1139489239 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0005c00 con 0x7f60e00b0830 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ce7fc700 1 -- 172.21.15.61:0/1139489239 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d0005d60 con 0x7f60e00b0830 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60e4882700 1 -- 172.21.15.61:0/1139489239 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e0157dd0 con 0x7f60e00b0830 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60ce7fc700 1 -- 172.21.15.61:0/1139489239 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0007320 con 0x7f60e00b0830 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.982+0000 7f60e4882700 1 -- 172.21.15.61:0/1139489239 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e0158390 con 0x7f60e00b0830 2023-12-24T20:01:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.983+0000 7f60e4882700 1 -- 172.21.15.61:0/1139489239 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e01585b0 con 0x7f60e00b0830 2023-12-24T20:01:16.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.984+0000 7f60ce7fc700 1 -- 172.21.15.61:0/1139489239 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f60d001b400 con 0x7f60e00b0830 2023-12-24T20:01:16.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.984+0000 7f60ce7fc700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60c0066f30 0x7f60c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:16.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.984+0000 7f60ce7fc700 1 -- 172.21.15.61:0/1139489239 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f60d00840c0 con 0x7f60e00b0830 2023-12-24T20:01:16.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.984+0000 7f60ce7fc700 1 -- 172.21.15.61:0/1139489239 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7f60c006eb10 con 0x7f60e00b0830 2023-12-24T20:01:16.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.985+0000 7f60de59c700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60c0066f30 0x7f60c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:16.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.985+0000 7f60de59c700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60c0066f30 0x7f60c00693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f60d4003080 tx=0x7f60d4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:16.989 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:16.989+0000 7f60ce7fc700 1 -- 172.21.15.61:0/1139489239 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60d00512f0 con 0x7f60e00b0830 2023-12-24T20:01:17.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.184+0000 7f60e4882700 1 -- 172.21.15.61:0/1139489239 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60e0167cd0 con 0x7f60e00b0830 2023-12-24T20:01:17.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.184+0000 7f60ce7fc700 1 -- 172.21.15.61:0/1139489239 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+15494 (secure 0 0 0) 0x7f60e0167cd0 con 0x7f60e00b0830 2023-12-24T20:01:17.185 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:17.185 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":85,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:01:03.573115+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:00:39.818793+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-24T20:00:40.387692+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.38","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:01:17.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.186+0000 7f60e4882700 1 -- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60c0066f30 msgr2=0x7f60c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.186+0000 7f60e4882700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60c0066f30 0x7f60c00693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f60d4003080 tx=0x7f60d4017000 comp rx=0 tx=0).stop 2023-12-24T20:01:17.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.186+0000 7f60e4882700 1 -- 172.21.15.61:0/1139489239 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e00b0830 msgr2=0x7f60e0155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.186+0000 7f60e4882700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e00b0830 0x7f60e0155ca0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c810 tx=0x7f60d0007db0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.187+0000 7f60e4882700 1 -- 172.21.15.61:0/1139489239 shutdown_connections 2023-12-24T20:01:17.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.187+0000 7f60e4882700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f60e006dff0 0x7f60e01574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.187+0000 7f60e4882700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f60c0066f30 0x7f60c00693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.187+0000 7f60e4882700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60e0156730 0x7f60e0159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.187+0000 7f60e4882700 1 --2- 172.21.15.61:0/1139489239 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60e00b0830 0x7f60e0155ca0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.187+0000 7f60e4882700 1 -- 172.21.15.61:0/1139489239 >> 172.21.15.61:0/1139489239 conn(0x7f60e00cd6f0 msgr2=0x7f60e00ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:17.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.187+0000 7f60e4882700 1 -- 172.21.15.61:0/1139489239 shutdown_connections 2023-12-24T20:01:17.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.187+0000 7f60e4882700 1 -- 172.21.15.61:0/1139489239 wait complete. 2023-12-24T20:01:17.199 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:01:17.200 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:01:17.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.321+0000 7f6069d9b700 1 Processor -- start 2023-12-24T20:01:17.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.321+0000 7f6069d9b700 1 -- start start 2023-12-24T20:01:17.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.322+0000 7f6069d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f606415bb60 0x7f6064098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.322+0000 7f6069d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f60640b2660 0x7f60640b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.322+0000 7f6069d9b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60640b2eb0 con 0x7f6064098aa0 2023-12-24T20:01:17.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.322+0000 7f6069d9b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60640afc20 con 0x7f60640b2660 2023-12-24T20:01:17.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.322+0000 7f6069d9b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60640b2bd0 con 0x7f606415bb60 2023-12-24T20:01:17.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.322+0000 7f6063fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f60640b2660 0x7f60640b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.322+0000 7f6062ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f6064098aa0 0x7f606415bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:37524/0 (socket says 172.21.15.61:37524) 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.322+0000 7f6062ffd700 1 -- 172.21.15.61:0/1234239019 learned_addr learned my addr 172.21.15.61:0/1234239019 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.323+0000 7f60637fe700 1 --2- 172.21.15.61:0/1234239019 >> v2:172.21.15.133:3300/0 conn(0x7f606415bb60 0x7f6064098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.323+0000 7f6063fff700 1 -- 172.21.15.61:0/1234239019 >> v2:172.21.15.133:3300/0 conn(0x7f606415bb60 msgr2=0x7f6064098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.323+0000 7f6063fff700 1 --2- 172.21.15.61:0/1234239019 >> v2:172.21.15.133:3300/0 conn(0x7f606415bb60 0x7f6064098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.323+0000 7f6063fff700 1 -- 172.21.15.61:0/1234239019 >> v1:172.21.15.61:6789/0 conn(0x7f6064098aa0 legacy=0x7f606415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.323+0000 7f6063fff700 1 -- 172.21.15.61:0/1234239019 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60640afe10 con 0x7f60640b2660 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.323+0000 7f60627fc700 1 -- 172.21.15.61:0/1234239019 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044827536 0 0) 0x7f60640b2eb0 con 0x7f6064098aa0 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.323+0000 7f6063fff700 1 --2- 172.21.15.61:0/1234239019 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 0x7f60640b08f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f606406d9b0 tx=0x7f605c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4d0a751a9f8526 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.323+0000 7f60627fc700 1 -- 172.21.15.61:0/1234239019 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c00e070 con 0x7f60640b2660 2023-12-24T20:01:17.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.323+0000 7f60627fc700 1 -- 172.21.15.61:0/1234239019 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c00bb60 con 0x7f60640b2660 2023-12-24T20:01:17.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.323+0000 7f60627fc700 1 -- 172.21.15.61:0/1234239019 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c012430 con 0x7f60640b2660 2023-12-24T20:01:17.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.324+0000 7f6069d9b700 1 -- 172.21.15.61:0/1234239019 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 msgr2=0x7f60640b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.324+0000 7f6069d9b700 1 --2- 172.21.15.61:0/1234239019 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 0x7f60640b08f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f606406d9b0 tx=0x7f605c009780 comp rx=0 tx=0).stop 2023-12-24T20:01:17.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.324+0000 7f6069d9b700 1 -- 172.21.15.61:0/1234239019 shutdown_connections 2023-12-24T20:01:17.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.324+0000 7f6069d9b700 1 --2- 172.21.15.61:0/1234239019 >> v2:172.21.15.133:3300/0 conn(0x7f606415bb60 0x7f6064098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.324+0000 7f6069d9b700 1 --2- 172.21.15.61:0/1234239019 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 0x7f60640b08f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.324+0000 7f6069d9b700 1 -- 172.21.15.61:0/1234239019 >> 172.21.15.61:0/1234239019 conn(0x7f6064097a10 msgr2=0x7f60640ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:17.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.324+0000 7f6069d9b700 1 -- 172.21.15.61:0/1234239019 shutdown_connections 2023-12-24T20:01:17.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.324+0000 7f6069d9b700 1 -- 172.21.15.61:0/1234239019 wait complete. 2023-12-24T20:01:17.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.325+0000 7f6069d9b700 1 Processor -- start 2023-12-24T20:01:17.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.325+0000 7f6069d9b700 1 -- start start 2023-12-24T20:01:17.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6069d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064098aa0 0x7f60640ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6069d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 0x7f606416c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6069d9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f606415bb60 0x7f6064158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6069d9b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60640684d0 con 0x7f60640b2660 2023-12-24T20:01:17.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6069d9b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60640678c0 con 0x7f6064098aa0 2023-12-24T20:01:17.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6069d9b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6064067ba0 con 0x7f606415bb60 2023-12-24T20:01:17.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6062ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 0x7f606416c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6062ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 0x7f606416c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48506/0 (socket says 172.21.15.61:48506) 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6062ffd700 1 -- 172.21.15.61:0/4136415578 learned_addr learned my addr 172.21.15.61:0/4136415578 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f60637fe700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064098aa0 0x7f60640ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6063fff700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f606415bb60 0x7f6064158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6062ffd700 1 -- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f606415bb60 msgr2=0x7f6064158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6062ffd700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f606415bb60 0x7f6064158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6062ffd700 1 -- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064098aa0 msgr2=0x7f60640ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6062ffd700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064098aa0 0x7f60640ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6062ffd700 1 -- 172.21.15.61:0/4136415578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c009a20 con 0x7f60640b2660 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f6062ffd700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 0x7f606416c980 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f604c00c7e0 tx=0x7f604c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.326+0000 7f605b7fe700 1 -- 172.21.15.61:0/4136415578 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c005b30 con 0x7f60640b2660 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.327+0000 7f605b7fe700 1 -- 172.21.15.61:0/4136415578 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c005c90 con 0x7f60640b2660 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.327+0000 7f6069d9b700 1 -- 172.21.15.61:0/4136415578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6064067e80 con 0x7f60640b2660 2023-12-24T20:01:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.327+0000 7f605b7fe700 1 -- 172.21.15.61:0/4136415578 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c007300 con 0x7f60640b2660 2023-12-24T20:01:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.327+0000 7f6069d9b700 1 -- 172.21.15.61:0/4136415578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60640ace10 con 0x7f60640b2660 2023-12-24T20:01:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.328+0000 7f6069d9b700 1 -- 172.21.15.61:0/4136415578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606406d440 con 0x7f60640b2660 2023-12-24T20:01:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.328+0000 7f605b7fe700 1 -- 172.21.15.61:0/4136415578 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f604c01b3b0 con 0x7f60640b2660 2023-12-24T20:01:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.328+0000 7f605b7fe700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6044066f30 0x7f60440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.329+0000 7f605b7fe700 1 -- 172.21.15.61:0/4136415578 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f604c083a90 con 0x7f60640b2660 2023-12-24T20:01:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.329+0000 7f605b7fe700 1 -- 172.21.15.61:0/4136415578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=86}) v3 -- 0x7f604406eb10 con 0x7f60640b2660 2023-12-24T20:01:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.329+0000 7f60637fe700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6044066f30 0x7f60440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.329+0000 7f60637fe700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6044066f30 0x7f60440693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6054009d00 tx=0x7f6054009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:17.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.333+0000 7f605b7fe700 1 -- 172.21.15.61:0/4136415578 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f604c017020 con 0x7f60640b2660 2023-12-24T20:01:17.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.576+0000 7f6069d9b700 1 -- 172.21.15.61:0/4136415578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f606404c3c0 con 0x7f60640b2660 2023-12-24T20:01:17.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.577+0000 7f605b7fe700 1 -- 172.21.15.61:0/4136415578 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f604c050cc0 con 0x7f60640b2660 2023-12-24T20:01:17.577 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:17.577 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/3462396702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3462396702},{"type":"v1","addr":"172.21.15.61:6835","nonce":3462396702}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2539986874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2539986874},{"type":"v1","addr":"172.21.15.133:6836","nonce":2539986874}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":5611,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/118195153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":118195153},{"type":"v1","addr":"172.21.15.133:6837","nonce":118195153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:00:41.409889+0000","modified":"2023-12-24T20:00:45.042959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5994":{"gid":5994,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/761559894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":761559894},{"type":"v1","addr":"172.21.15.61:6834","nonce":761559894}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T20:01:17.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 -- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6044066f30 msgr2=0x7f60440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6044066f30 0x7f60440693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6054009d00 tx=0x7f6054009120 comp rx=0 tx=0).stop 2023-12-24T20:01:17.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 -- 172.21.15.61:0/4136415578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 msgr2=0x7f606416c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 0x7f606416c980 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f604c00c7e0 tx=0x7f604c007df0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 -- 172.21.15.61:0/4136415578 shutdown_connections 2023-12-24T20:01:17.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f606415bb60 0x7f6064158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6044066f30 0x7f60440693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6064098aa0 0x7f60640ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 --2- 172.21.15.61:0/4136415578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60640b2660 0x7f606416c980 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 -- 172.21.15.61:0/4136415578 >> 172.21.15.61:0/4136415578 conn(0x7f6064097a10 msgr2=0x7f60640a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:17.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 -- 172.21.15.61:0/4136415578 shutdown_connections 2023-12-24T20:01:17.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.579+0000 7f6069d9b700 1 -- 172.21.15.61:0/4136415578 wait complete. 2023-12-24T20:01:17.580 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 44 2023-12-24T20:01:17.592 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:01:17.614 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:01:17.614+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2023-12-24T20:01:17.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.715+0000 7f6002dc5700 1 Processor -- start 2023-12-24T20:01:17.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.715+0000 7f6002dc5700 1 -- start start 2023-12-24T20:01:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.716+0000 7f6002dc5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ffc070d50 0x7f5ffc15c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.716+0000 7f6002dc5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc15bcd0 con 0x7f5ffc06b260 2023-12-24T20:01:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.716+0000 7f6002dc5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc0cafb0 con 0x7f5ffc06b630 2023-12-24T20:01:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.716+0000 7f6002dc5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc0683a0 con 0x7f5ffc070d50 2023-12-24T20:01:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.716+0000 7f6000b61700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f5ffc06b260 0x7f5ffc067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:37532/0 (socket says 172.21.15.61:37532) 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.716+0000 7f6000b61700 1 -- 172.21.15.61:0/4270424715 learned_addr learned my addr 172.21.15.61:0/4270424715 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.716+0000 7f6001362700 1 --2- 172.21.15.61:0/4270424715 >> v2:172.21.15.133:3300/0 conn(0x7f5ffc070d50 0x7f5ffc15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.716+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677977219 0 0) 0x7f5ffc15bcd0 con 0x7f5ffc06b260 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.716+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fec003570 con 0x7f5ffc06b260 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469732845 0 0) 0x7f5fec003570 con 0x7f5ffc06b260 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 >> v2:172.21.15.133:3300/0 conn(0x7f5ffc070d50 msgr2=0x7f5ffc15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 --2- 172.21.15.61:0/4270424715 >> v2:172.21.15.133:3300/0 conn(0x7f5ffc070d50 0x7f5ffc15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 >> v1:172.21.15.133:6789/0 conn(0x7f5ffc06b630 legacy=0x7f5ffc070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc0680c0 con 0x7f5ffc06b260 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f5ff0001470 con 0x7f5ffc06b260 2023-12-24T20:01:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 >> v1:172.21.15.61:6789/0 conn(0x7f5ffc06b260 legacy=0x7f5ffc067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5fec003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fec004810 0x7f5fec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec005210 0x7f5fec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0683a0 con 0x7f5fec003ab0 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec00c130 con 0x7f5fec004810 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec00c2f0 con 0x7f5fec005210 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f6000b61700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5fec003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffbfff700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fec004810 0x7f5fec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f6001362700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec005210 0x7f5fec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f6000b61700 1 -- 172.21.15.61:0/4270424715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec005210 msgr2=0x7f5fec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f6000b61700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5fec005210 0x7f5fec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f6000b61700 1 -- 172.21.15.61:0/4270424715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fec004810 msgr2=0x7f5fec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f6000b61700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fec004810 0x7f5fec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f6000b61700 1 -- 172.21.15.61:0/4270424715 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec003570 con 0x7f5fec003ab0 2023-12-24T20:01:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f6001362700 1 -- 172.21.15.61:0/4270424715 reap_dead start 2023-12-24T20:01:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f6000b61700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5fec003ec0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c2a0 tx=0x7f5ffc06bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e20da23a520f1f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.717+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000cb70 con 0x7f5fec003ab0 2023-12-24T20:01:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.718+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff000ccd0 con 0x7f5fec003ab0 2023-12-24T20:01:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.718+0000 7f5ffb7fe700 1 -- 172.21.15.61:0/4270424715 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0005b70 con 0x7f5fec003ab0 2023-12-24T20:01:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.718+0000 7f6002dc5700 1 -- 172.21.15.61:0/4270424715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 msgr2=0x7f5fec003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.718+0000 7f6002dc5700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5fec003ec0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c2a0 tx=0x7f5ffc06bad0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.718+0000 7f6002dc5700 1 -- 172.21.15.61:0/4270424715 shutdown_connections 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.718+0000 7f6002dc5700 1 --2- 172.21.15.61:0/4270424715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5fec003ec0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.718+0000 7f6002dc5700 1 -- 172.21.15.61:0/4270424715 >> 172.21.15.61:0/4270424715 conn(0x7f5ffc0ca200 msgr2=0x7f5ffc0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.718+0000 7f6002dc5700 1 -- 172.21.15.61:0/4270424715 shutdown_connections 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.718+0000 7f6002dc5700 1 -- 172.21.15.61:0/4270424715 wait complete. 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.719+0000 7f6002dc5700 1 Processor -- start 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.719+0000 7f6002dc5700 1 -- start start 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6002dc5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5ffc0a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6002dc5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ffc1559c0 0x7f5ffc14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6002dc5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ffc155e30 0x7f5ffc14d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6002dc5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0a7440 con 0x7f5fec003ab0 2023-12-24T20:01:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6002dc5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc158bf0 con 0x7f5ffc1559c0 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6002dc5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc0a84a0 con 0x7f5ffc155e30 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6000b61700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5ffc0a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6000b61700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5ffc0a7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48510/0 (socket says 172.21.15.61:48510) 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6000b61700 1 -- 172.21.15.61:0/3050268546 learned_addr learned my addr 172.21.15.61:0/3050268546 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6000b61700 1 -- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ffc155e30 msgr2=0x7f5ffc14d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.720+0000 7f6000b61700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ffc155e30 0x7f5ffc14d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.721+0000 7f6000b61700 1 -- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ffc1559c0 msgr2=0x7f5ffc14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.721+0000 7f6000b61700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ffc1559c0 0x7f5ffc14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.721+0000 7f6000b61700 1 -- 172.21.15.61:0/3050268546 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc0a6830 con 0x7f5fec003ab0 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.721+0000 7f6000b61700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5ffc0a7f60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c890 tx=0x7f5ff0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.721+0000 7f5ff8ff9700 1 -- 172.21.15.61:0/3050268546 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0001370 con 0x7f5fec003ab0 2023-12-24T20:01:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.721+0000 7f5ff8ff9700 1 -- 172.21.15.61:0/3050268546 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff00070d0 con 0x7f5fec003ab0 2023-12-24T20:01:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.721+0000 7f6002dc5700 1 -- 172.21.15.61:0/3050268546 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc0a6b10 con 0x7f5fec003ab0 2023-12-24T20:01:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.721+0000 7f5ff8ff9700 1 -- 172.21.15.61:0/3050268546 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00014f0 con 0x7f5fec003ab0 2023-12-24T20:01:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.721+0000 7f6002dc5700 1 -- 172.21.15.61:0/3050268546 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc0a70d0 con 0x7f5fec003ab0 2023-12-24T20:01:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.722+0000 7f6002dc5700 1 -- 172.21.15.61:0/3050268546 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc04c3c0 con 0x7f5fec003ab0 2023-12-24T20:01:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.722+0000 7f5ff8ff9700 1 -- 172.21.15.61:0/3050268546 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5ff001e430 con 0x7f5fec003ab0 2023-12-24T20:01:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.723+0000 7f5ff8ff9700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.723+0000 7f5ff8ff9700 1 -- 172.21.15.61:0/3050268546 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f5ff0085070 con 0x7f5fec003ab0 2023-12-24T20:01:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.723+0000 7f5ff8ff9700 1 -- 172.21.15.61:0/3050268546 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f5fe006eb10 con 0x7f5fec003ab0 2023-12-24T20:01:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.723+0000 7f5ffbfff700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:17.730 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.724+0000 7f5ffbfff700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5fe0066f30 0x7f5fe00693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0acd00 tx=0x7f5fe8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:17.730 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.727+0000 7f5ff8ff9700 1 -- 172.21.15.61:0/3050268546 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ff0017060 con 0x7f5fec003ab0 2023-12-24T20:01:17.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.969+0000 7f6002dc5700 1 -- 172.21.15.61:0/3050268546 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ffc06f110 con 0x7f5fec003ab0 2023-12-24T20:01:17.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.969+0000 7f5ff8ff9700 1 -- 172.21.15.61:0/3050268546 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f5ff00522a0 con 0x7f5fec003ab0 2023-12-24T20:01:17.970 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:17.970 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/3462396702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3462396702},{"type":"v1","addr":"172.21.15.61:6835","nonce":3462396702}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2539986874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2539986874},{"type":"v1","addr":"172.21.15.133:6836","nonce":2539986874}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":5611,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/118195153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":118195153},{"type":"v1","addr":"172.21.15.133:6837","nonce":118195153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:00:41.409889+0000","modified":"2023-12-24T20:00:45.042959+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5994":{"gid":5994,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/761559894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":761559894},{"type":"v1","addr":"172.21.15.61:6834","nonce":761559894}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-12-24T20:01:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 -- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5fe0066f30 msgr2=0x7f5fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5fe0066f30 0x7f5fe00693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0acd00 tx=0x7f5fe8009040 comp rx=0 tx=0).stop 2023-12-24T20:01:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 -- 172.21.15.61:0/3050268546 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 msgr2=0x7f5ffc0a7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5ffc0a7f60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c890 tx=0x7f5ff0015000 comp rx=0 tx=0).stop 2023-12-24T20:01:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 -- 172.21.15.61:0/3050268546 shutdown_connections 2023-12-24T20:01:17.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ffc155e30 0x7f5ffc14d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5fe0066f30 0x7f5fe00693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5fec003ab0 0x7f5ffc0a7f60 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 --2- 172.21.15.61:0/3050268546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ffc1559c0 0x7f5ffc14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 -- 172.21.15.61:0/3050268546 >> 172.21.15.61:0/3050268546 conn(0x7f5ffc0ca200 msgr2=0x7f5ffc0cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 -- 172.21.15.61:0/3050268546 shutdown_connections 2023-12-24T20:01:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:17.971+0000 7f6002dc5700 1 -- 172.21.15.61:0/3050268546 wait complete. 2023-12-24T20:01:17.973 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 44 2023-12-24T20:01:17.984 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:01:18.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.145+0000 7f986d01b700 1 Processor -- start 2023-12-24T20:01:18.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.145+0000 7f986d01b700 1 -- start start 2023-12-24T20:01:18.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.146+0000 7f986d01b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98680b2660 0x7f986815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.146+0000 7f986d01b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 0x7f98680b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986d01b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98680b2eb0 con 0x7f986815bb60 2023-12-24T20:01:18.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986d01b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98680afc20 con 0x7f98680b2660 2023-12-24T20:01:18.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986d01b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98680b2bd0 con 0x7f986815c470 2023-12-24T20:01:18.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 0x7f98680b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98680b2660 0x7f986815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986759e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 0x7f98680b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:39544/0 (socket says 172.21.15.61:39544) 2023-12-24T20:01:18.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986759e700 1 -- 172.21.15.61:0/2973915901 learned_addr learned my addr 172.21.15.61:0/2973915901 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:18.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986659c700 1 -- 172.21.15.61:0/2973915901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 msgr2=0x7f98680b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:18.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986659c700 1 --2- 172.21.15.61:0/2973915901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 0x7f98680b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986659c700 1 -- 172.21.15.61:0/2973915901 >> v1:172.21.15.133:6789/0 conn(0x7f986815bb60 legacy=0x7f9868098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986659c700 1 -- 172.21.15.61:0/2973915901 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98680afe10 con 0x7f98680b2660 2023-12-24T20:01:18.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986759e700 1 --2- 172.21.15.61:0/2973915901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 0x7f98680b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:01:18.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.147+0000 7f986659c700 1 --2- 172.21.15.61:0/2973915901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98680b2660 0x7f986815bf30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f98580098e0 tx=0x7f98580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5f929351a1fd6c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:18.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f9865d9b700 1 -- 172.21.15.61:0/2973915901 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985800b640 con 0x7f98680b2660 2023-12-24T20:01:18.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f9865d9b700 1 -- 172.21.15.61:0/2973915901 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985800b7a0 con 0x7f98680b2660 2023-12-24T20:01:18.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f9865d9b700 1 -- 172.21.15.61:0/2973915901 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985800bb40 con 0x7f98680b2660 2023-12-24T20:01:18.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f986d01b700 1 -- 172.21.15.61:0/2973915901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98680b2660 msgr2=0x7f986815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f986d01b700 1 --2- 172.21.15.61:0/2973915901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98680b2660 0x7f986815bf30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f98580098e0 tx=0x7f98580091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f986d01b700 1 -- 172.21.15.61:0/2973915901 shutdown_connections 2023-12-24T20:01:18.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f986d01b700 1 --2- 172.21.15.61:0/2973915901 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 0x7f98680b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f986d01b700 1 --2- 172.21.15.61:0/2973915901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98680b2660 0x7f986815bf30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f986d01b700 1 -- 172.21.15.61:0/2973915901 >> 172.21.15.61:0/2973915901 conn(0x7f9868097a10 msgr2=0x7f98680ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:18.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f986d01b700 1 -- 172.21.15.61:0/2973915901 shutdown_connections 2023-12-24T20:01:18.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.148+0000 7f986d01b700 1 -- 172.21.15.61:0/2973915901 wait complete. 2023-12-24T20:01:18.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.150+0000 7f986d01b700 1 Processor -- start 2023-12-24T20:01:18.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.150+0000 7f986d01b700 1 -- start start 2023-12-24T20:01:18.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986d01b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98680b2660 0x7f986816b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986d01b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f986815bb60 0x7f9868168f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986d01b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 0x7f9868151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986d01b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986816c950 con 0x7f986815bb60 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986d01b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9868151c80 con 0x7f98680b2660 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986d01b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986816c0b0 con 0x7f986815c470 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f986815bb60 0x7f9868168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f986815bb60 0x7f9868168f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48516/0 (socket says 172.21.15.61:48516) 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986659c700 1 -- 172.21.15.61:0/4246784264 learned_addr learned my addr 172.21.15.61:0/4246784264 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f9866d9d700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98680b2660 0x7f986816b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986759e700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 0x7f9868151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986659c700 1 -- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 msgr2=0x7f9868151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986659c700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 0x7f9868151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986659c700 1 -- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98680b2660 msgr2=0x7f986816b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986659c700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98680b2660 0x7f986816b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.151+0000 7f986659c700 1 -- 172.21.15.61:0/4246784264 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9860009ae0 con 0x7f986815bb60 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.152+0000 7f986659c700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f986815bb60 0x7f9868168f00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f986806d8b0 tx=0x7f9858017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:18.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.152+0000 7f985effd700 1 -- 172.21.15.61:0/4246784264 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985801bc40 con 0x7f986815bb60 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.152+0000 7f985effd700 1 -- 172.21.15.61:0/4246784264 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985801bde0 con 0x7f986815bb60 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.152+0000 7f986d01b700 1 -- 172.21.15.61:0/4246784264 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9858009420 con 0x7f986815bb60 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.152+0000 7f985effd700 1 -- 172.21.15.61:0/4246784264 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858011670 con 0x7f986815bb60 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.152+0000 7f986d01b700 1 -- 172.21.15.61:0/4246784264 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986816c670 con 0x7f986815bb60 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.153+0000 7f986d01b700 1 -- 172.21.15.61:0/4246784264 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986806d440 con 0x7f986815bb60 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.153+0000 7f985effd700 1 -- 172.21.15.61:0/4246784264 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f98580119e0 con 0x7f986815bb60 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.153+0000 7f985effd700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9848066f30 0x7f98480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.154+0000 7f985effd700 1 -- 172.21.15.61:0/4246784264 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f9858085b00 con 0x7f986815bb60 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.154+0000 7f985effd700 1 -- 172.21.15.61:0/4246784264 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f984806eb10 con 0x7f986815bb60 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.154+0000 7f9866d9d700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9848066f30 0x7f98480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.154+0000 7f9866d9d700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9848066f30 0x7f98480693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9850007fd0 tx=0x7f9850007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:18.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.158+0000 7f985effd700 1 -- 172.21.15.61:0/4246784264 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9858052d30 con 0x7f986815bb60 2023-12-24T20:01:18.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.356+0000 7f986d01b700 1 -- 172.21.15.61:0/4246784264 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f986804c3c0 con 0x7f986815bb60 2023-12-24T20:01:18.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.357+0000 7f985effd700 1 -- 172.21.15.61:0/4246784264 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+15480 (secure 0 0 0) 0x7f9858029070 con 0x7f986815bb60 2023-12-24T20:01:18.357 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:18.357 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":86,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:01:17.615533+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:00:39.818793+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-24T20:00:40.387692+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.38","mappings":[{"from":6,"to":0}]},{"pgid":"11.3a","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:01:18.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 -- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9848066f30 msgr2=0x7f98480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9848066f30 0x7f98480693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9850007fd0 tx=0x7f9850007eb0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 -- 172.21.15.61:0/4246784264 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f986815bb60 msgr2=0x7f9868168f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f986815bb60 0x7f9868168f00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f986806d8b0 tx=0x7f9858017000 comp rx=0 tx=0).stop 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 -- 172.21.15.61:0/4246784264 shutdown_connections 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f986815c470 0x7f9868151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9848066f30 0x7f98480693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98680b2660 0x7f986816b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 --2- 172.21.15.61:0/4246784264 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f986815bb60 0x7f9868168f00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 -- 172.21.15.61:0/4246784264 >> 172.21.15.61:0/4246784264 conn(0x7f9868097a10 msgr2=0x7f98680ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 -- 172.21.15.61:0/4246784264 shutdown_connections 2023-12-24T20:01:18.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.359+0000 7f986d01b700 1 -- 172.21.15.61:0/4246784264 wait complete. 2023-12-24T20:01:18.372 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:01:18.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.494+0000 7f32b67d9700 1 Processor -- start 2023-12-24T20:01:18.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.494+0000 7f32b67d9700 1 -- start start 2023-12-24T20:01:18.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.495+0000 7f32b67d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32b0159920 0x7f32b0068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.495+0000 7f32b67d9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f32b006b7b0 0x7f32b0070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.495+0000 7f32b67d9700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b006b320 con 0x7f32b0159cf0 2023-12-24T20:01:18.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.495+0000 7f32b67d9700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b006aff0 con 0x7f32b006b7b0 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.495+0000 7f32b67d9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b0067d10 con 0x7f32b0159920 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.495+0000 7f32b4d76700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f32b006b7b0 0x7f32b0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.495+0000 7f32af7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f32b0159cf0 0x7f32b0067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:37536/0 (socket says 172.21.15.61:37536) 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.495+0000 7f32af7fe700 1 -- 172.21.15.61:0/4024273903 learned_addr learned my addr 172.21.15.61:0/4024273903 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.496+0000 7f32affff700 1 --2- 172.21.15.61:0/4024273903 >> v2:172.21.15.133:3300/0 conn(0x7f32b0159920 0x7f32b0068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.496+0000 7f32b4d76700 1 -- 172.21.15.61:0/4024273903 >> v2:172.21.15.133:3300/0 conn(0x7f32b0159920 msgr2=0x7f32b0068ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.496+0000 7f32b4d76700 1 --2- 172.21.15.61:0/4024273903 >> v2:172.21.15.133:3300/0 conn(0x7f32b0159920 0x7f32b0068ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.496+0000 7f32b4d76700 1 -- 172.21.15.61:0/4024273903 >> v1:172.21.15.61:6789/0 conn(0x7f32b0159cf0 legacy=0x7f32b0067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.496+0000 7f32b4d76700 1 -- 172.21.15.61:0/4024273903 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0067ff0 con 0x7f32b006b7b0 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.496+0000 7f32aeffd700 1 -- 172.21.15.61:0/4024273903 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1037748158 0 0) 0x7f32b006b320 con 0x7f32b0159cf0 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.496+0000 7f32b4d76700 1 --2- 172.21.15.61:0/4024273903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 0x7f32b0070640 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f32b006d710 tx=0x7f32a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad38d789a8bc691e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.496+0000 7f32aeffd700 1 -- 172.21.15.61:0/4024273903 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800e070 con 0x7f32b006b7b0 2023-12-24T20:01:18.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.496+0000 7f32aeffd700 1 -- 172.21.15.61:0/4024273903 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a800bc30 con 0x7f32b006b7b0 2023-12-24T20:01:18.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.496+0000 7f32aeffd700 1 -- 172.21.15.61:0/4024273903 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8012430 con 0x7f32b006b7b0 2023-12-24T20:01:18.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.497+0000 7f32b67d9700 1 -- 172.21.15.61:0/4024273903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 msgr2=0x7f32b0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.497+0000 7f32b67d9700 1 --2- 172.21.15.61:0/4024273903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 0x7f32b0070640 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f32b006d710 tx=0x7f32a8009780 comp rx=0 tx=0).stop 2023-12-24T20:01:18.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.497+0000 7f32b67d9700 1 -- 172.21.15.61:0/4024273903 shutdown_connections 2023-12-24T20:01:18.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.497+0000 7f32b67d9700 1 --2- 172.21.15.61:0/4024273903 >> v2:172.21.15.133:3300/0 conn(0x7f32b0159920 0x7f32b0068ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.497+0000 7f32b67d9700 1 --2- 172.21.15.61:0/4024273903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 0x7f32b0070640 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.497+0000 7f32b67d9700 1 -- 172.21.15.61:0/4024273903 >> 172.21.15.61:0/4024273903 conn(0x7f32b00ce220 msgr2=0x7f32b00af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:18.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.497+0000 7f32b67d9700 1 -- 172.21.15.61:0/4024273903 shutdown_connections 2023-12-24T20:01:18.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.497+0000 7f32b67d9700 1 -- 172.21.15.61:0/4024273903 wait complete. 2023-12-24T20:01:18.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.498+0000 7f32b67d9700 1 Processor -- start 2023-12-24T20:01:18.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.498+0000 7f32b67d9700 1 -- start start 2023-12-24T20:01:18.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32b67d9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 0x7f32b015a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32b67d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b0159920 0x7f32b00afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32b67d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b0159cf0 0x7f32b00b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32b67d9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00affb0 con 0x7f32b006b7b0 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32b67d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b015aed0 con 0x7f32b0159cf0 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32b67d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b015b1b0 con 0x7f32b0159920 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32affff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 0x7f32b015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32affff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 0x7f32b015a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48536/0 (socket says 172.21.15.61:48536) 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32affff700 1 -- 172.21.15.61:0/3779848032 learned_addr learned my addr 172.21.15.61:0/3779848032 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32affff700 1 -- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b0159920 msgr2=0x7f32b00afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32affff700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b0159920 0x7f32b00afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32b4d76700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b0159cf0 0x7f32b00b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32affff700 1 -- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b0159cf0 msgr2=0x7f32b00b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32affff700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b0159cf0 0x7f32b00b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32affff700 1 -- 172.21.15.61:0/3779848032 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a8009a20 con 0x7f32b006b7b0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f32affff700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 0x7f32b015a840 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f32a000d890 tx=0x7f32a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f3297fff700 1 -- 172.21.15.61:0/3779848032 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000b690 con 0x7f32b006b7b0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.499+0000 7f3297fff700 1 -- 172.21.15.61:0/3779848032 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a000b7f0 con 0x7f32b006b7b0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.500+0000 7f32b67d9700 1 -- 172.21.15.61:0/3779848032 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b015b490 con 0x7f32b006b7b0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.500+0000 7f3297fff700 1 -- 172.21.15.61:0/3779848032 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000bb70 con 0x7f32b006b7b0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.500+0000 7f32b67d9700 1 -- 172.21.15.61:0/3779848032 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b015ba50 con 0x7f32b006b7b0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.500+0000 7f32b67d9700 1 -- 172.21.15.61:0/3779848032 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b015bc10 con 0x7f32b006b7b0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.501+0000 7f3297fff700 1 -- 172.21.15.61:0/3779848032 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f32a001e460 con 0x7f32b006b7b0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.501+0000 7f3297fff700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f329c066f30 0x7f329c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.501+0000 7f3297fff700 1 -- 172.21.15.61:0/3779848032 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f32a0084d90 con 0x7f32b006b7b0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.501+0000 7f32af7fe700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f329c066f30 0x7f329c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.501+0000 7f3297fff700 1 -- 172.21.15.61:0/3779848032 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f329c06eb10 con 0x7f32b006b7b0 2023-12-24T20:01:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.502+0000 7f32af7fe700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f329c066f30 0x7f329c0693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f32a40011e0 tx=0x7f32a40079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:18.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.505+0000 7f3297fff700 1 -- 172.21.15.61:0/3779848032 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32a0051f20 con 0x7f32b006b7b0 2023-12-24T20:01:18.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.746+0000 7f32b67d9700 1 -- 172.21.15.61:0/3779848032 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f32b004c3c0 con 0x7f32b006b7b0 2023-12-24T20:01:18.747 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:01:18.747+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:01:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.749+0000 7f3297fff700 1 -- 172.21.15.61:0/3779848032 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(87..87 src has 1..87) v4 ==== 366+0+0 (secure 0 0 0) 0x7f32a0055be0 con 0x7f32b006b7b0 2023-12-24T20:01:18.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.749+0000 7f3297fff700 1 -- 172.21.15.61:0/3779848032 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7f329c06f400 con 0x7f32b006b7b0 2023-12-24T20:01:18.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.752+0000 7f3297fff700 1 -- 172.21.15.61:0/3779848032 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7f32a0055540 con 0x7f32b006b7b0 2023-12-24T20:01:18.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 -- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f329c066f30 msgr2=0x7f329c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f329c066f30 0x7f329c0693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f32a40011e0 tx=0x7f32a40079d0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 -- 172.21.15.61:0/3779848032 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 msgr2=0x7f32b015a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 0x7f32b015a840 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f32a000d890 tx=0x7f32a0008040 comp rx=0 tx=0).stop 2023-12-24T20:01:18.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 -- 172.21.15.61:0/3779848032 shutdown_connections 2023-12-24T20:01:18.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f329c066f30 0x7f329c0693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32b0159cf0 0x7f32b00b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f32b006b7b0 0x7f32b015a840 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 --2- 172.21.15.61:0/3779848032 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f32b0159920 0x7f32b00afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 -- 172.21.15.61:0/3779848032 >> 172.21.15.61:0/3779848032 conn(0x7f32b00ce220 msgr2=0x7f32b0070640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:18.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 -- 172.21.15.61:0/3779848032 shutdown_connections 2023-12-24T20:01:18.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.754+0000 7f32b67d9700 1 -- 172.21.15.61:0/3779848032 wait complete. 2023-12-24T20:01:18.756 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:01:18.768 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:01:18.786 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T20:01:18.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.891+0000 7f33fea6d700 1 Processor -- start 2023-12-24T20:01:18.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.892+0000 7f33fea6d700 1 -- start start 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.892+0000 7f33fea6d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f33f8157840 0x7f33f8069b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.892+0000 7f33fea6d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33f80706b0 0x7f33f80c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.892+0000 7f33fea6d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f8157c10 0x7f33f80c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.892+0000 7f33fea6d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f8067550 con 0x7f33f8157840 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.892+0000 7f33fea6d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f80c9dc0 con 0x7f33f80706b0 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.892+0000 7f33fea6d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f806a460 con 0x7f33f8157c10 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33fc809700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f33f8157840 0x7f33f8069b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33fc809700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f33f8157840 0x7f33f8069b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48574/0 (socket says 172.21.15.61:48574) 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33fc809700 1 -- 172.21.15.61:0/1552657375 learned_addr learned my addr 172.21.15.61:0/1552657375 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33f7fff700 1 --2- 172.21.15.61:0/1552657375 >> v2:172.21.15.133:3300/0 conn(0x7f33f80706b0 0x7f33f80c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33fd00a700 1 --2- 172.21.15.61:0/1552657375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f8157c10 0x7f33f80c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33fc809700 1 -- 172.21.15.61:0/1552657375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f8157c10 msgr2=0x7f33f80c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:18.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33fc809700 1 --2- 172.21.15.61:0/1552657375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f8157c10 0x7f33f80c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33fc809700 1 -- 172.21.15.61:0/1552657375 >> v2:172.21.15.133:3300/0 conn(0x7f33f80706b0 msgr2=0x7f33f80c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33fc809700 1 --2- 172.21.15.61:0/1552657375 >> v2:172.21.15.133:3300/0 conn(0x7f33f80706b0 0x7f33f80c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33fc809700 1 -- 172.21.15.61:0/1552657375 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f806a740 con 0x7f33f8157840 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33f7fff700 1 --2- 172.21.15.61:0/1552657375 >> v2:172.21.15.133:3300/0 conn(0x7f33f80706b0 0x7f33f80c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33fc809700 1 --2- 172.21.15.61:0/1552657375 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157840 0x7f33f8069b60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f33f80ca160 tx=0x7f33ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fb94b86bd4238e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33f77fe700 1 -- 172.21.15.61:0/1552657375 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00b860 con 0x7f33f8157840 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33f77fe700 1 -- 172.21.15.61:0/1552657375 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec00b9c0 con 0x7f33f8157840 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.893+0000 7f33f77fe700 1 -- 172.21.15.61:0/1552657375 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00bd60 con 0x7f33f8157840 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.894+0000 7f33fea6d700 1 -- 172.21.15.61:0/1552657375 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157840 msgr2=0x7f33f8069b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.894+0000 7f33fea6d700 1 --2- 172.21.15.61:0/1552657375 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157840 0x7f33f8069b60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f33f80ca160 tx=0x7f33ec009250 comp rx=0 tx=0).stop 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.894+0000 7f33fea6d700 1 -- 172.21.15.61:0/1552657375 shutdown_connections 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.894+0000 7f33fea6d700 1 --2- 172.21.15.61:0/1552657375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f8157c10 0x7f33f80c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.894+0000 7f33fea6d700 1 --2- 172.21.15.61:0/1552657375 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157840 0x7f33f8069b60 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.894+0000 7f33fea6d700 1 --2- 172.21.15.61:0/1552657375 >> v2:172.21.15.133:3300/0 conn(0x7f33f80706b0 0x7f33f80c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.894+0000 7f33fea6d700 1 -- 172.21.15.61:0/1552657375 >> 172.21.15.61:0/1552657375 conn(0x7f33f80ce1f0 msgr2=0x7f33f80ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:18.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.894+0000 7f33fea6d700 1 -- 172.21.15.61:0/1552657375 shutdown_connections 2023-12-24T20:01:18.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.894+0000 7f33fea6d700 1 -- 172.21.15.61:0/1552657375 wait complete. 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.895+0000 7f33fea6d700 1 Processor -- start 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.895+0000 7f33fea6d700 1 -- start start 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fea6d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33f80706b0 0x7f33f81590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fea6d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f8157840 0x7f33f8169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fea6d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157c10 0x7f33f816a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fea6d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f815a730 con 0x7f33f8157c10 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fea6d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f8159b20 con 0x7f33f80706b0 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fea6d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f8159e00 con 0x7f33f8157840 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fd00a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157c10 0x7f33f816a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fd00a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157c10 0x7f33f816a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48590/0 (socket says 172.21.15.61:48590) 2023-12-24T20:01:18.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fd00a700 1 -- 172.21.15.61:0/3353805950 learned_addr learned my addr 172.21.15.61:0/3353805950 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33f7fff700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f8157840 0x7f33f8169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fc809700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33f80706b0 0x7f33f81590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fd00a700 1 -- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f8157840 msgr2=0x7f33f8169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fd00a700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f8157840 0x7f33f8169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fd00a700 1 -- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33f80706b0 msgr2=0x7f33f81590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fd00a700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33f80706b0 0x7f33f81590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fd00a700 1 -- 172.21.15.61:0/3353805950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0094f0 con 0x7f33f8157c10 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.896+0000 7f33fd00a700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157c10 0x7f33f816a410 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f33f0007f20 tx=0x7f33f0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.897+0000 7f33f4ff9700 1 -- 172.21.15.61:0/3353805950 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f000eca0 con 0x7f33f8157c10 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.897+0000 7f33f4ff9700 1 -- 172.21.15.61:0/3353805950 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f000ee20 con 0x7f33f8157c10 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.897+0000 7f33fea6d700 1 -- 172.21.15.61:0/3353805950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f815a0e0 con 0x7f33f8157c10 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.897+0000 7f33f4ff9700 1 -- 172.21.15.61:0/3353805950 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0014670 con 0x7f33f8157c10 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.897+0000 7f33fea6d700 1 -- 172.21.15.61:0/3353805950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f80c3280 con 0x7f33f8157c10 2023-12-24T20:01:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.898+0000 7f33fea6d700 1 -- 172.21.15.61:0/3353805950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f815aa10 con 0x7f33f8157c10 2023-12-24T20:01:18.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.898+0000 7f33f4ff9700 1 -- 172.21.15.61:0/3353805950 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f33f00149e0 con 0x7f33f8157c10 2023-12-24T20:01:18.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.899+0000 7f33f4ff9700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33dc066f30 0x7f33dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:18.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.899+0000 7f33f4ff9700 1 -- 172.21.15.61:0/3353805950 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f33f0084cd0 con 0x7f33f8157c10 2023-12-24T20:01:18.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.899+0000 7f33fc809700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33dc066f30 0x7f33dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:18.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.899+0000 7f33f4ff9700 1 -- 172.21.15.61:0/3353805950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7f33dc06ebb0 con 0x7f33f8157c10 2023-12-24T20:01:18.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.899+0000 7f33fc809700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33dc066f30 0x7f33dc0693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33f80ca160 tx=0x7f33ec017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:18.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:18.903+0000 7f33f4ff9700 1 -- 172.21.15.61:0/3353805950 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33f0051eb0 con 0x7f33f8157c10 2023-12-24T20:01:19.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.147+0000 7f33fea6d700 1 -- 172.21.15.61:0/3353805950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33f806b420 con 0x7f33f8157c10 2023-12-24T20:01:19.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.753+0000 7f33f4ff9700 1 -- 172.21.15.61:0/3353805950 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(88..88 src has 1..88) v4 ==== 288+0+0 (secure 0 0 0) 0x7f33f0056270 con 0x7f33f8157c10 2023-12-24T20:01:19.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.753+0000 7f33f4ff9700 1 -- 172.21.15.61:0/3353805950 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f33dc06f500 con 0x7f33f8157c10 2023-12-24T20:01:19.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.760+0000 7f33f4ff9700 1 -- 172.21.15.61:0/3353805950 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33f00554d0 con 0x7f33f8157c10 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 -- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33dc066f30 msgr2=0x7f33dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33dc066f30 0x7f33dc0693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33f80ca160 tx=0x7f33ec017000 comp rx=0 tx=0).stop 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 -- 172.21.15.61:0/3353805950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157c10 msgr2=0x7f33f816a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157c10 0x7f33f816a410 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f33f0007f20 tx=0x7f33f0009860 comp rx=0 tx=0).stop 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 -- 172.21.15.61:0/3353805950 shutdown_connections 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f33dc066f30 0x7f33dc0693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33f8157c10 0x7f33f816a410 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33f80706b0 0x7f33f81590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 --2- 172.21.15.61:0/3353805950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f33f8157840 0x7f33f8169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 -- 172.21.15.61:0/3353805950 >> 172.21.15.61:0/3353805950 conn(0x7f33f80ce1f0 msgr2=0x7f33f8069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:19.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.763+0000 7f33fea6d700 1 -- 172.21.15.61:0/3353805950 shutdown_connections 2023-12-24T20:01:19.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.764+0000 7f33fea6d700 1 -- 172.21.15.61:0/3353805950 wait complete. 2023-12-24T20:01:19.779 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:01:19.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.958+0000 7fbcf5f7f700 1 Processor -- start 2023-12-24T20:01:19.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.958+0000 7fbcf5f7f700 1 -- start start 2023-12-24T20:01:19.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbcf5f7f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcf0157730 0x7fbcf00aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:19.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbcf5f7f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbcf0157b00 0x7fbcf00ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:19.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbcf5f7f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbcf0063ac0 0x7fbcf00b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:19.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbcf5f7f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf00adb50 con 0x7fbcf0063ac0 2023-12-24T20:01:19.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbcf5f7f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf00adda0 con 0x7fbcf0157b00 2023-12-24T20:01:19.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbcf5f7f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00ae080 con 0x7fbcf0157730 2023-12-24T20:01:19.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbcf0063ac0 0x7fbcf00b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:19.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbcf0063ac0 0x7fbcf00b1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48604/0 (socket says 172.21.15.61:48604) 2023-12-24T20:01:19.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceffff700 1 -- 172.21.15.61:0/1640930473 learned_addr learned my addr 172.21.15.61:0/1640930473 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbcef7fe700 1 --2- 172.21.15.61:0/1640930473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcf0157730 0x7fbcf00aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceeffd700 1 --2- 172.21.15.61:0/1640930473 >> v2:172.21.15.133:3300/0 conn(0x7fbcf0157b00 0x7fbcf00ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceffff700 1 -- 172.21.15.61:0/1640930473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcf0157730 msgr2=0x7fbcf00aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceffff700 1 --2- 172.21.15.61:0/1640930473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcf0157730 0x7fbcf00aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceffff700 1 -- 172.21.15.61:0/1640930473 >> v2:172.21.15.133:3300/0 conn(0x7fbcf0157b00 msgr2=0x7fbcf00ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceffff700 1 --2- 172.21.15.61:0/1640930473 >> v2:172.21.15.133:3300/0 conn(0x7fbcf0157b00 0x7fbcf00ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceffff700 1 -- 172.21.15.61:0/1640930473 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00ae360 con 0x7fbcf0063ac0 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceeffd700 1 --2- 172.21.15.61:0/1640930473 >> v2:172.21.15.133:3300/0 conn(0x7fbcf0157b00 0x7fbcf00ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbceffff700 1 --2- 172.21.15.61:0/1640930473 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0063ac0 0x7fbcf00b1fe0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0064b30 tx=0x7fbce8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b157342ae2fac56 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbcee7fc700 1 -- 172.21.15.61:0/1640930473 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce800e070 con 0x7fbcf0063ac0 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbcee7fc700 1 -- 172.21.15.61:0/1640930473 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce800ba50 con 0x7fbcf0063ac0 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.959+0000 7fbcee7fc700 1 -- 172.21.15.61:0/1640930473 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce80092e0 con 0x7fbcf0063ac0 2023-12-24T20:01:19.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.960+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/1640930473 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0063ac0 msgr2=0x7fbcf00b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:19.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.960+0000 7fbcf5f7f700 1 --2- 172.21.15.61:0/1640930473 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0063ac0 0x7fbcf00b1fe0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0064b30 tx=0x7fbce8009840 comp rx=0 tx=0).stop 2023-12-24T20:01:19.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.960+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/1640930473 shutdown_connections 2023-12-24T20:01:19.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.960+0000 7fbcf5f7f700 1 --2- 172.21.15.61:0/1640930473 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0063ac0 0x7fbcf00b1fe0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.960+0000 7fbcf5f7f700 1 --2- 172.21.15.61:0/1640930473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcf0157730 0x7fbcf00aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.960+0000 7fbcf5f7f700 1 --2- 172.21.15.61:0/1640930473 >> v2:172.21.15.133:3300/0 conn(0x7fbcf0157b00 0x7fbcf00ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.960+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/1640930473 >> 172.21.15.61:0/1640930473 conn(0x7fbcf0067fd0 msgr2=0x7fbcf00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:19.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.960+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/1640930473 shutdown_connections 2023-12-24T20:01:19.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.960+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/1640930473 wait complete. 2023-12-24T20:01:19.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.961+0000 7fbcf5f7f700 1 Processor -- start 2023-12-24T20:01:19.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.962+0000 7fbcf5f7f700 1 -- start start 2023-12-24T20:01:19.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.962+0000 7fbcf5f7f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcf0063ac0 0x7fbcf016c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:19.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.962+0000 7fbcf5f7f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0157730 0x7fbcf016a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:19.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.962+0000 7fbcf5f7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0157b00 0x7fbcf016a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:19.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.962+0000 7fbcf5f7f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0151370 con 0x7fbcf0157730 2023-12-24T20:01:19.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.962+0000 7fbcf5f7f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf016a580 con 0x7fbcf0157b00 2023-12-24T20:01:19.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.962+0000 7fbcf5f7f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00a7140 con 0x7fbcf0063ac0 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.962+0000 7fbceeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0157730 0x7fbcf016a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.962+0000 7fbceeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0157730 0x7fbcf016a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48606/0 (socket says 172.21.15.61:48606) 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.962+0000 7fbceeffd700 1 -- 172.21.15.61:0/418244027 learned_addr learned my addr 172.21.15.61:0/418244027 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbcef7fe700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcf0063ac0 0x7fbcf016c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbceffff700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0157b00 0x7fbcf016a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbceeffd700 1 -- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcf0063ac0 msgr2=0x7fbcf016c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbceeffd700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcf0063ac0 0x7fbcf016c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbceeffd700 1 -- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0157b00 msgr2=0x7fbcf016a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbceeffd700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0157b00 0x7fbcf016a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbceeffd700 1 -- 172.21.15.61:0/418244027 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce8009ae0 con 0x7fbcf0157730 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbceffff700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0157b00 0x7fbcf016a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbceeffd700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0157730 0x7fbcf016a040 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbce400c850 tx=0x7fbce4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbcd77fe700 1 -- 172.21.15.61:0/418244027 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4011600 con 0x7fbcf0157730 2023-12-24T20:01:19.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbcd77fe700 1 -- 172.21.15.61:0/418244027 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce4011760 con 0x7fbcf0157730 2023-12-24T20:01:19.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/418244027 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf00b0240 con 0x7fbcf0157730 2023-12-24T20:01:19.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbcd77fe700 1 -- 172.21.15.61:0/418244027 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4011b20 con 0x7fbcf0157730 2023-12-24T20:01:19.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.963+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/418244027 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf00b0800 con 0x7fbcf0157730 2023-12-24T20:01:19.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.964+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/418244027 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf004c3c0 con 0x7fbcf0157730 2023-12-24T20:01:19.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.965+0000 7fbcd77fe700 1 -- 172.21.15.61:0/418244027 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbce4018350 con 0x7fbcf0157730 2023-12-24T20:01:19.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.965+0000 7fbcd77fe700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbcdc066f30 0x7fbcdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:19.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.965+0000 7fbcd77fe700 1 -- 172.21.15.61:0/418244027 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fbce4084540 con 0x7fbcf0157730 2023-12-24T20:01:19.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.965+0000 7fbcd77fe700 1 -- 172.21.15.61:0/418244027 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7fbcdc06ebb0 con 0x7fbcf0157730 2023-12-24T20:01:19.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.965+0000 7fbcef7fe700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbcdc066f30 0x7fbcdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:19.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.966+0000 7fbcef7fe700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbcdc066f30 0x7fbcdc0693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbce0006fd0 tx=0x7fbce0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:19.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:19.969+0000 7fbcd77fe700 1 -- 172.21.15.61:0/418244027 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbce40551b0 con 0x7fbcf0157730 2023-12-24T20:01:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.164+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/418244027 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbcf006f420 con 0x7fbcf0157730 2023-12-24T20:01:20.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.771+0000 7fbcd77fe700 1 -- 172.21.15.61:0/418244027 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(89..89 src has 1..89) v4 ==== 288+0+0 (secure 0 0 0) 0x7fbce4055ae0 con 0x7fbcf0157730 2023-12-24T20:01:20.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.771+0000 7fbcd77fe700 1 -- 172.21.15.61:0/418244027 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7fbcdc06cfe0 con 0x7fbcf0157730 2023-12-24T20:01:20.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.775+0000 7fbcd77fe700 1 -- 172.21.15.61:0/418244027 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbce401e0d0 con 0x7fbcf0157730 2023-12-24T20:01:20.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.780+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbcdc066f30 msgr2=0x7fbcdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:20.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.780+0000 7fbcf5f7f700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbcdc066f30 0x7fbcdc0693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbce0006fd0 tx=0x7fbce0008040 comp rx=0 tx=0).stop 2023-12-24T20:01:20.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.780+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/418244027 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0157730 msgr2=0x7fbcf016a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:20.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.780+0000 7fbcf5f7f700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0157730 0x7fbcf016a040 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbce400c850 tx=0x7fbce4008040 comp rx=0 tx=0).stop 2023-12-24T20:01:20.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.780+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/418244027 shutdown_connections 2023-12-24T20:01:20.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.780+0000 7fbcf5f7f700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbcf0063ac0 0x7fbcf016c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:20.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.780+0000 7fbcf5f7f700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbcdc066f30 0x7fbcdc0693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:20.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.780+0000 7fbcf5f7f700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbcf0157b00 0x7fbcf016a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:20.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.780+0000 7fbcf5f7f700 1 --2- 172.21.15.61:0/418244027 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbcf0157730 0x7fbcf016a040 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:20.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.780+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/418244027 >> 172.21.15.61:0/418244027 conn(0x7fbcf0067fd0 msgr2=0x7fbcf00ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:20.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.781+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/418244027 shutdown_connections 2023-12-24T20:01:20.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.781+0000 7fbcf5f7f700 1 -- 172.21.15.61:0/418244027 wait complete. 2023-12-24T20:01:20.783 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:01:20.796 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:01:20.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.928+0000 7f970df8e700 1 Processor -- start 2023-12-24T20:01:20.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.929+0000 7f970df8e700 1 -- start start 2023-12-24T20:01:20.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.929+0000 7f970df8e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9708159980 0x7f9708159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:20.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.929+0000 7f970df8e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f970806f940 0x7f9708067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:20.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.929+0000 7f970df8e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97080ca4e0 con 0x7f9708068b30 2023-12-24T20:01:20.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.929+0000 7f970df8e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9708068620 con 0x7f9708159980 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.929+0000 7f970df8e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97080ca1b0 con 0x7f970806f940 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f97077fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9708159980 0x7f9708159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f9707fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9708068b30 0x7f9708068f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:37542/0 (socket says 172.21.15.61:37542) 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f9707fff700 1 -- 172.21.15.61:0/2239824097 learned_addr learned my addr 172.21.15.61:0/2239824097 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f9706ffd700 1 --2- 172.21.15.61:0/2239824097 >> v2:172.21.15.133:3300/0 conn(0x7f970806f940 0x7f9708067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f97077fe700 1 -- 172.21.15.61:0/2239824097 >> v2:172.21.15.133:3300/0 conn(0x7f970806f940 msgr2=0x7f9708067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f97077fe700 1 --2- 172.21.15.61:0/2239824097 >> v2:172.21.15.133:3300/0 conn(0x7f970806f940 0x7f9708067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f97077fe700 1 -- 172.21.15.61:0/2239824097 >> v1:172.21.15.61:6789/0 conn(0x7f9708068b30 legacy=0x7f9708068f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f97077fe700 1 -- 172.21.15.61:0/2239824097 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9708067d80 con 0x7f9708159980 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f97067fc700 1 -- 172.21.15.61:0/2239824097 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564278565 0 0) 0x7f97080ca4e0 con 0x7f9708068b30 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f9706ffd700 1 --2- 172.21.15.61:0/2239824097 >> v2:172.21.15.133:3300/0 conn(0x7f970806f940 0x7f9708067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f97077fe700 1 --2- 172.21.15.61:0/2239824097 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 0x7f9708159d50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f97080ce750 tx=0x7f96f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e527da6da40466 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f97067fc700 1 -- 172.21.15.61:0/2239824097 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f800b6b0 con 0x7f9708159980 2023-12-24T20:01:20.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f97067fc700 1 -- 172.21.15.61:0/2239824097 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f800b810 con 0x7f9708159980 2023-12-24T20:01:20.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.930+0000 7f97067fc700 1 -- 172.21.15.61:0/2239824097 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f800bbb0 con 0x7f9708159980 2023-12-24T20:01:20.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.931+0000 7f970df8e700 1 -- 172.21.15.61:0/2239824097 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 msgr2=0x7f9708159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:20.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.931+0000 7f970df8e700 1 --2- 172.21.15.61:0/2239824097 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 0x7f9708159d50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f97080ce750 tx=0x7f96f80091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:20.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.931+0000 7f970df8e700 1 -- 172.21.15.61:0/2239824097 shutdown_connections 2023-12-24T20:01:20.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.931+0000 7f970df8e700 1 --2- 172.21.15.61:0/2239824097 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 0x7f9708159d50 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:20.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.931+0000 7f970df8e700 1 --2- 172.21.15.61:0/2239824097 >> v2:172.21.15.133:3300/0 conn(0x7f970806f940 0x7f9708067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:20.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.931+0000 7f970df8e700 1 -- 172.21.15.61:0/2239824097 >> 172.21.15.61:0/2239824097 conn(0x7f9708069760 msgr2=0x7f9708069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:20.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.931+0000 7f970df8e700 1 -- 172.21.15.61:0/2239824097 shutdown_connections 2023-12-24T20:01:20.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.931+0000 7f970df8e700 1 -- 172.21.15.61:0/2239824097 wait complete. 2023-12-24T20:01:20.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.932+0000 7f970df8e700 1 Processor -- start 2023-12-24T20:01:20.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.932+0000 7f970df8e700 1 -- start start 2023-12-24T20:01:20.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f970df8e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9708068b30 0x7f97080b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f970df8e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970806f940 0x7f97080c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f970df8e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 0x7f9708157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f970df8e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97080b4450 con 0x7f9708159980 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f970df8e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97080af160 con 0x7f970806f940 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f970df8e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97080af440 con 0x7f9708068b30 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f9707fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 0x7f9708157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f9707fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 0x7f9708157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48622/0 (socket says 172.21.15.61:48622) 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f9707fff700 1 -- 172.21.15.61:0/4118511014 learned_addr learned my addr 172.21.15.61:0/4118511014 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f97077fe700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9708068b30 0x7f97080b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f9707fff700 1 -- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9708068b30 msgr2=0x7f97080b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f9707fff700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9708068b30 0x7f97080b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f9707fff700 1 -- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970806f940 msgr2=0x7f97080c3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f9706ffd700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970806f940 0x7f97080c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:20.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f9707fff700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970806f940 0x7f97080c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:20.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f9707fff700 1 -- 172.21.15.61:0/4118511014 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f8009420 con 0x7f9708159980 2023-12-24T20:01:20.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.933+0000 7f9707fff700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 0x7f9708157710 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f970000cc90 tx=0x7f9700001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:20.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.934+0000 7f96ef7fe700 1 -- 172.21.15.61:0/4118511014 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970000cea0 con 0x7f9708159980 2023-12-24T20:01:20.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.934+0000 7f96ef7fe700 1 -- 172.21.15.61:0/4118511014 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970000ab70 con 0x7f9708159980 2023-12-24T20:01:20.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.934+0000 7f970df8e700 1 -- 172.21.15.61:0/4118511014 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97080af720 con 0x7f9708159980 2023-12-24T20:01:20.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.934+0000 7f96ef7fe700 1 -- 172.21.15.61:0/4118511014 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000070f0 con 0x7f9708159980 2023-12-24T20:01:20.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.934+0000 7f970df8e700 1 -- 172.21.15.61:0/4118511014 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97080afce0 con 0x7f9708159980 2023-12-24T20:01:20.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.935+0000 7f970df8e700 1 -- 172.21.15.61:0/4118511014 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970804c3c0 con 0x7f9708159980 2023-12-24T20:01:20.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.935+0000 7f96ef7fe700 1 -- 172.21.15.61:0/4118511014 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f97000074a0 con 0x7f9708159980 2023-12-24T20:01:20.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.935+0000 7f96ef7fe700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96f4066f30 0x7f96f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:20.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.936+0000 7f96ef7fe700 1 -- 172.21.15.61:0/4118511014 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f97000848f0 con 0x7f9708159980 2023-12-24T20:01:20.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.936+0000 7f96ef7fe700 1 -- 172.21.15.61:0/4118511014 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f96f406ddb0 con 0x7f9708159980 2023-12-24T20:01:20.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.936+0000 7f97077fe700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96f4066f30 0x7f96f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:20.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.936+0000 7f97077fe700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96f4066f30 0x7f96f40693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f96f8003080 tx=0x7f96f8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:20.940+0000 7f96ef7fe700 1 -- 172.21.15.61:0/4118511014 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9700051d00 con 0x7f9708159980 2023-12-24T20:01:21.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.135+0000 7f970df8e700 1 -- 172.21.15.61:0/4118511014 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9708068060 con 0x7f9708159980 2023-12-24T20:01:21.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.780+0000 7f96ef7fe700 1 -- 172.21.15.61:0/4118511014 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(90..90 src has 1..90) v4 ==== 700+0+0 (secure 0 0 0) 0x7f97000560c0 con 0x7f9708159980 2023-12-24T20:01:21.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.780+0000 7f96ef7fe700 1 -- 172.21.15.61:0/4118511014 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7f96f406cb40 con 0x7f9708159980 2023-12-24T20:01:21.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.784+0000 7f96ef7fe700 1 -- 172.21.15.61:0/4118511014 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9700055320 con 0x7f9708159980 2023-12-24T20:01:21.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.787+0000 7f970df8e700 1 -- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96f4066f30 msgr2=0x7f96f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.787+0000 7f970df8e700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96f4066f30 0x7f96f40693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f96f8003080 tx=0x7f96f8017000 comp rx=0 tx=0).stop 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.787+0000 7f970df8e700 1 -- 172.21.15.61:0/4118511014 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 msgr2=0x7f9708157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.787+0000 7f970df8e700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 0x7f9708157710 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f970000cc90 tx=0x7f9700001a80 comp rx=0 tx=0).stop 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.788+0000 7f970df8e700 1 -- 172.21.15.61:0/4118511014 shutdown_connections 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.788+0000 7f970df8e700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9708068b30 0x7f97080b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.788+0000 7f970df8e700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96f4066f30 0x7f96f40693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.788+0000 7f970df8e700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9708159980 0x7f9708157710 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.788+0000 7f970df8e700 1 --2- 172.21.15.61:0/4118511014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970806f940 0x7f97080c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.788+0000 7f970df8e700 1 -- 172.21.15.61:0/4118511014 >> 172.21.15.61:0/4118511014 conn(0x7f9708069760 msgr2=0x7f9708063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.788+0000 7f970df8e700 1 -- 172.21.15.61:0/4118511014 shutdown_connections 2023-12-24T20:01:21.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.788+0000 7f970df8e700 1 -- 172.21.15.61:0/4118511014 wait complete. 2023-12-24T20:01:21.790 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T20:01:21.802 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:01:21.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.929+0000 7f65b96de700 1 Processor -- start 2023-12-24T20:01:21.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.929+0000 7f65b96de700 1 -- start start 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b96de700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65b40b2aa0 0x7f65b4159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b96de700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f65b406e280 0x7f65b40cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b96de700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b40cbf80 con 0x7f65b41598d0 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b96de700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b40b2f10 con 0x7f65b406e280 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b96de700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40b11c0 con 0x7f65b40b2aa0 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b37fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f65b406e280 0x7f65b40cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b37fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f65b406e280 0x7f65b40cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48626/0 (socket says 172.21.15.61:48626) 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b37fe700 1 -- 172.21.15.61:0/4024855267 learned_addr learned my addr 172.21.15.61:0/4024855267 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b27fc700 1 --2- 172.21.15.61:0/4024855267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65b40b2aa0 0x7f65b4159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b37fe700 1 -- 172.21.15.61:0/4024855267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65b40b2aa0 msgr2=0x7f65b4159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b37fe700 1 --2- 172.21.15.61:0/4024855267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65b40b2aa0 0x7f65b4159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:21.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.930+0000 7f65b37fe700 1 -- 172.21.15.61:0/4024855267 >> v1:172.21.15.133:6789/0 conn(0x7f65b41598d0 legacy=0x7f65b406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b37fe700 1 -- 172.21.15.61:0/4024855267 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40b14a0 con 0x7f65b406e280 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b37fe700 1 --2- 172.21.15.61:0/4024855267 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 0x7f65b40cc410 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009f20 tx=0x7f65ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874d30d91c51800e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b1ffb700 1 -- 172.21.15.61:0/4024855267 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00e070 con 0x7f65b406e280 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b1ffb700 1 -- 172.21.15.61:0/4024855267 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac00ba80 con 0x7f65b406e280 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b1ffb700 1 -- 172.21.15.61:0/4024855267 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0092e0 con 0x7f65b406e280 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b96de700 1 -- 172.21.15.61:0/4024855267 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 msgr2=0x7f65b40cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b96de700 1 --2- 172.21.15.61:0/4024855267 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 0x7f65b40cc410 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009f20 tx=0x7f65ac009840 comp rx=0 tx=0).stop 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b96de700 1 -- 172.21.15.61:0/4024855267 shutdown_connections 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b96de700 1 --2- 172.21.15.61:0/4024855267 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 0x7f65b40cc410 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b96de700 1 --2- 172.21.15.61:0/4024855267 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65b40b2aa0 0x7f65b4159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b96de700 1 -- 172.21.15.61:0/4024855267 >> 172.21.15.61:0/4024855267 conn(0x7f65b4067550 msgr2=0x7f65b4067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b96de700 1 -- 172.21.15.61:0/4024855267 shutdown_connections 2023-12-24T20:01:21.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.931+0000 7f65b96de700 1 -- 172.21.15.61:0/4024855267 wait complete. 2023-12-24T20:01:21.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.933+0000 7f65b96de700 1 Processor -- start 2023-12-24T20:01:21.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.933+0000 7f65b96de700 1 -- start start 2023-12-24T20:01:21.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.933+0000 7f65b96de700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 0x7f65b415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:21.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.933+0000 7f65b96de700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65b40b2aa0 0x7f65b41560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:21.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.933+0000 7f65b96de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b41598d0 0x7f65b40ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:21.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.933+0000 7f65b96de700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b415b590 con 0x7f65b406e280 2023-12-24T20:01:21.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.933+0000 7f65b96de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40c9070 con 0x7f65b41598d0 2023-12-24T20:01:21.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.933+0000 7f65b96de700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40c9350 con 0x7f65b40b2aa0 2023-12-24T20:01:21.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 0x7f65b415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 0x7f65b415b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48640/0 (socket says 172.21.15.61:48640) 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b2ffd700 1 -- 172.21.15.61:0/3790456632 learned_addr learned my addr 172.21.15.61:0/3790456632 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b27fc700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65b40b2aa0 0x7f65b41560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b37fe700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b41598d0 0x7f65b40ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b2ffd700 1 -- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65b40b2aa0 msgr2=0x7f65b41560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b2ffd700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65b40b2aa0 0x7f65b41560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b2ffd700 1 -- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b41598d0 msgr2=0x7f65b40ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b2ffd700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b41598d0 0x7f65b40ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b2ffd700 1 -- 172.21.15.61:0/3790456632 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac009ae0 con 0x7f65b406e280 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b37fe700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b41598d0 0x7f65b40ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:21.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b2ffd700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 0x7f65b415b050 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f659c00c590 tx=0x7f659c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:21.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65aaffd700 1 -- 172.21.15.61:0/3790456632 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c011590 con 0x7f65b406e280 2023-12-24T20:01:21.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65aaffd700 1 -- 172.21.15.61:0/3790456632 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c011710 con 0x7f65b406e280 2023-12-24T20:01:21.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b96de700 1 -- 172.21.15.61:0/3790456632 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b40c9630 con 0x7f65b406e280 2023-12-24T20:01:21.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65aaffd700 1 -- 172.21.15.61:0/3790456632 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c011ad0 con 0x7f65b406e280 2023-12-24T20:01:21.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.934+0000 7f65b96de700 1 -- 172.21.15.61:0/3790456632 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b40c9bf0 con 0x7f65b406e280 2023-12-24T20:01:21.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.935+0000 7f65b96de700 1 -- 172.21.15.61:0/3790456632 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b4089120 con 0x7f65b406e280 2023-12-24T20:01:21.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.936+0000 7f65aaffd700 1 -- 172.21.15.61:0/3790456632 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f659c01b3b0 con 0x7f65b406e280 2023-12-24T20:01:21.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.936+0000 7f65aaffd700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6594066f30 0x7f65940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:21.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.936+0000 7f65aaffd700 1 -- 172.21.15.61:0/3790456632 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f659c083760 con 0x7f65b406e280 2023-12-24T20:01:21.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.936+0000 7f65b27fc700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6594066f30 0x7f65940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:21.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.937+0000 7f65b27fc700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6594066f30 0x7f65940693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f65b415e760 tx=0x7f65a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:21.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:21.941+0000 7f65aaffd700 1 -- 172.21.15.61:0/3790456632 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f659c050cd0 con 0x7f65b406e280 2023-12-24T20:01:22.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.139+0000 7f65b96de700 1 -- 172.21.15.61:0/3790456632 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f65b40c9e10 con 0x7f65b406e280 2023-12-24T20:01:22.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.145+0000 7f65aaffd700 1 -- 172.21.15.61:0/3790456632 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f659c0170a0 con 0x7f65b406e280 2023-12-24T20:01:22.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 -- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6594066f30 msgr2=0x7f65940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6594066f30 0x7f65940693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f65b415e760 tx=0x7f65a4008040 comp rx=0 tx=0).stop 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 -- 172.21.15.61:0/3790456632 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 msgr2=0x7f65b415b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 0x7f65b415b050 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f659c00c590 tx=0x7f659c00c8a0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 -- 172.21.15.61:0/3790456632 shutdown_connections 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6594066f30 0x7f65940693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b41598d0 0x7f65b40ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65b406e280 0x7f65b415b050 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 --2- 172.21.15.61:0/3790456632 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65b40b2aa0 0x7f65b41560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 -- 172.21.15.61:0/3790456632 >> 172.21.15.61:0/3790456632 conn(0x7f65b4067550 msgr2=0x7f65b40b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 -- 172.21.15.61:0/3790456632 shutdown_connections 2023-12-24T20:01:22.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.147+0000 7f65b96de700 1 -- 172.21.15.61:0/3790456632 wait complete. 2023-12-24T20:01:22.160 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-12-24T20:01:22.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.282+0000 7ff73f17b700 1 Processor -- start 2023-12-24T20:01:22.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.282+0000 7ff73f17b700 1 -- start start 2023-12-24T20:01:22.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73f17b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff73806b260 0x7ff73815c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73f17b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff73806b630 0x7ff738067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73f17b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff738067a90 0x7ff738070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73f17b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff738067ed0 con 0x7ff73806b260 2023-12-24T20:01:22.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73f17b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73815bcd0 con 0x7ff73806b630 2023-12-24T20:01:22.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73f17b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380cafb0 con 0x7ff738067a90 2023-12-24T20:01:22.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73cf17700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff73806b260 0x7ff73815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73cf17700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff73806b260 0x7ff73815c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48654/0 (socket says 172.21.15.61:48654) 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73cf17700 1 -- 172.21.15.61:0/944145077 learned_addr learned my addr 172.21.15.61:0/944145077 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff737fff700 1 --2- 172.21.15.61:0/944145077 >> v2:172.21.15.133:3300/0 conn(0x7ff73806b630 0x7ff738067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73d718700 1 --2- 172.21.15.61:0/944145077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff738067a90 0x7ff738070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73cf17700 1 -- 172.21.15.61:0/944145077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff738067a90 msgr2=0x7ff738070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73cf17700 1 --2- 172.21.15.61:0/944145077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff738067a90 0x7ff738070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73cf17700 1 -- 172.21.15.61:0/944145077 >> v2:172.21.15.133:3300/0 conn(0x7ff73806b630 msgr2=0x7ff738067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73cf17700 1 --2- 172.21.15.61:0/944145077 >> v2:172.21.15.133:3300/0 conn(0x7ff73806b630 0x7ff738067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73cf17700 1 -- 172.21.15.61:0/944145077 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380683a0 con 0x7ff73806b260 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.283+0000 7ff73cf17700 1 --2- 172.21.15.61:0/944145077 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 0x7ff73815c160 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff73806d9e0 tx=0x7ff72c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522379a0657fa4bf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff7377fe700 1 -- 172.21.15.61:0/944145077 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00b640 con 0x7ff73806b260 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff7377fe700 1 -- 172.21.15.61:0/944145077 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c00b7a0 con 0x7ff73806b260 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff7377fe700 1 -- 172.21.15.61:0/944145077 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00bb60 con 0x7ff73806b260 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff73f17b700 1 -- 172.21.15.61:0/944145077 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 msgr2=0x7ff73815c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff73f17b700 1 --2- 172.21.15.61:0/944145077 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 0x7ff73815c160 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff73806d9e0 tx=0x7ff72c009250 comp rx=0 tx=0).stop 2023-12-24T20:01:22.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff73f17b700 1 -- 172.21.15.61:0/944145077 shutdown_connections 2023-12-24T20:01:22.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff73f17b700 1 --2- 172.21.15.61:0/944145077 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff738067a90 0x7ff738070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff73f17b700 1 --2- 172.21.15.61:0/944145077 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 0x7ff73815c160 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff73f17b700 1 --2- 172.21.15.61:0/944145077 >> v2:172.21.15.133:3300/0 conn(0x7ff73806b630 0x7ff738067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff73f17b700 1 -- 172.21.15.61:0/944145077 >> 172.21.15.61:0/944145077 conn(0x7ff7380ca200 msgr2=0x7ff7380ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:22.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff73f17b700 1 -- 172.21.15.61:0/944145077 shutdown_connections 2023-12-24T20:01:22.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.284+0000 7ff73f17b700 1 -- 172.21.15.61:0/944145077 wait complete. 2023-12-24T20:01:22.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.285+0000 7ff73f17b700 1 Processor -- start 2023-12-24T20:01:22.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.286+0000 7ff73f17b700 1 -- start start 2023-12-24T20:01:22.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.286+0000 7ff73f17b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff738067a90 0x7ff738154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.286+0000 7ff73f17b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 0x7ff7380b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.286+0000 7ff73f17b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff73806b630 0x7ff7380b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.286+0000 7ff73f17b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380b33e0 con 0x7ff73806b260 2023-12-24T20:01:22.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.286+0000 7ff73f17b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73815f030 con 0x7ff738067a90 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.286+0000 7ff73f17b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380b2e90 con 0x7ff73806b630 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.286+0000 7ff737fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 0x7ff7380b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.286+0000 7ff737fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 0x7ff7380b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48656/0 (socket says 172.21.15.61:48656) 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.286+0000 7ff737fff700 1 -- 172.21.15.61:0/1417809791 learned_addr learned my addr 172.21.15.61:0/1417809791 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff73cf17700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff738067a90 0x7ff738154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff73d718700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff73806b630 0x7ff7380b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff737fff700 1 -- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff73806b630 msgr2=0x7ff7380b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff737fff700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff73806b630 0x7ff7380b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff737fff700 1 -- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff738067a90 msgr2=0x7ff738154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff737fff700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff738067a90 0x7ff738154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff737fff700 1 -- 172.21.15.61:0/1417809791 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c0094f0 con 0x7ff73806b260 2023-12-24T20:01:22.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff73cf17700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff738067a90 0x7ff738154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:22.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff737fff700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 0x7ff7380b0530 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff72400ecb0 tx=0x7ff7240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:22.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff734ff9700 1 -- 172.21.15.61:0/1417809791 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72400c9d0 con 0x7ff73806b260 2023-12-24T20:01:22.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff734ff9700 1 -- 172.21.15.61:0/1417809791 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72400cb30 con 0x7ff73806b260 2023-12-24T20:01:22.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff73f17b700 1 -- 172.21.15.61:0/1417809791 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7380b0a70 con 0x7ff73806b260 2023-12-24T20:01:22.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff734ff9700 1 -- 172.21.15.61:0/1417809791 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72400ced0 con 0x7ff73806b260 2023-12-24T20:01:22.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.287+0000 7ff73f17b700 1 -- 172.21.15.61:0/1417809791 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73815ecc0 con 0x7ff73806b260 2023-12-24T20:01:22.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.288+0000 7ff73f17b700 1 -- 172.21.15.61:0/1417809791 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73815eb20 con 0x7ff73806b260 2023-12-24T20:01:22.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.289+0000 7ff734ff9700 1 -- 172.21.15.61:0/1417809791 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff724013680 con 0x7ff73806b260 2023-12-24T20:01:22.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.290+0000 7ff734ff9700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff71c066f30 0x7ff71c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.290+0000 7ff734ff9700 1 -- 172.21.15.61:0/1417809791 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff724084c70 con 0x7ff73806b260 2023-12-24T20:01:22.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.290+0000 7ff73cf17700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff71c066f30 0x7ff71c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.291+0000 7ff73cf17700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff71c066f30 0x7ff71c0693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff73806d9e0 tx=0x7ff72c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:22.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.294+0000 7ff734ff9700 1 -- 172.21.15.61:0/1417809791 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff724052140 con 0x7ff73806b260 2023-12-24T20:01:22.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.569+0000 7ff73f17b700 1 -- 172.21.15.61:0/1417809791 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7ff73815eb20 con 0x7ff73806b260 2023-12-24T20:01:22.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.635+0000 7ff734ff9700 1 -- 172.21.15.61:0/1417809791 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v226) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff73815eb20 con 0x7ff73806b260 2023-12-24T20:01:22.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.637+0000 7ff73f17b700 1 -- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff71c066f30 msgr2=0x7ff71c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.637+0000 7ff73f17b700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff71c066f30 0x7ff71c0693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff73806d9e0 tx=0x7ff72c017000 comp rx=0 tx=0).stop 2023-12-24T20:01:22.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.637+0000 7ff73f17b700 1 -- 172.21.15.61:0/1417809791 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 msgr2=0x7ff7380b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.637+0000 7ff73f17b700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 0x7ff7380b0530 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff72400ecb0 tx=0x7ff7240091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.637+0000 7ff73f17b700 1 -- 172.21.15.61:0/1417809791 shutdown_connections 2023-12-24T20:01:22.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.637+0000 7ff73f17b700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff73806b630 0x7ff7380b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.637+0000 7ff73f17b700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff71c066f30 0x7ff71c0693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.637+0000 7ff73f17b700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff738067a90 0x7ff738154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.637+0000 7ff73f17b700 1 --2- 172.21.15.61:0/1417809791 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff73806b260 0x7ff7380b0530 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.637+0000 7ff73f17b700 1 -- 172.21.15.61:0/1417809791 >> 172.21.15.61:0/1417809791 conn(0x7ff7380ca200 msgr2=0x7ff7380aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:22.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.638+0000 7ff73f17b700 1 -- 172.21.15.61:0/1417809791 shutdown_connections 2023-12-24T20:01:22.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.638+0000 7ff73f17b700 1 -- 172.21.15.61:0/1417809791 wait complete. 2023-12-24T20:01:22.650 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-12-24T20:01:22.650 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-12-24T20:01:22.651 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-12-24T20:01:22.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.772+0000 7f527d9f6700 1 Processor -- start 2023-12-24T20:01:22.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.772+0000 7f527d9f6700 1 -- start start 2023-12-24T20:01:22.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f527d9f6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5278159c10 0x7f52780c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f527d9f6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f52780cc190 0x7f52780c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f527d9f6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52780af880 con 0x7f5278159fe0 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f527d9f6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52780c6fc0 con 0x7f52780cc190 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f527d9f6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52780c63b0 con 0x7f5278159c10 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f52777fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f52780cc190 0x7f52780c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f52777fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f52780cc190 0x7f52780c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48664/0 (socket says 172.21.15.61:48664) 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f52777fe700 1 -- 172.21.15.61:0/2019939084 learned_addr learned my addr 172.21.15.61:0/2019939084 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f5276ffd700 1 --2- 172.21.15.61:0/2019939084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5278159c10 0x7f52780c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f52777fe700 1 -- 172.21.15.61:0/2019939084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5278159c10 msgr2=0x7f52780c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f52777fe700 1 --2- 172.21.15.61:0/2019939084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5278159c10 0x7f52780c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f52777fe700 1 -- 172.21.15.61:0/2019939084 >> v1:172.21.15.133:6789/0 conn(0x7f5278159fe0 legacy=0x7f52780cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.773+0000 7f52777fe700 1 -- 172.21.15.61:0/2019939084 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52780c6690 con 0x7f52780cc190 2023-12-24T20:01:22.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f52777fe700 1 --2- 172.21.15.61:0/2019939084 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 0x7f52780c5d10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5270009f20 tx=0x7f5270009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aae85ea84fc1f7e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f5275ffb700 1 -- 172.21.15.61:0/2019939084 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527000e070 con 0x7f52780cc190 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f5275ffb700 1 -- 172.21.15.61:0/2019939084 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527000ba80 con 0x7f52780cc190 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f5275ffb700 1 -- 172.21.15.61:0/2019939084 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52700092e0 con 0x7f52780cc190 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f527d9f6700 1 -- 172.21.15.61:0/2019939084 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 msgr2=0x7f52780c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f527d9f6700 1 --2- 172.21.15.61:0/2019939084 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 0x7f52780c5d10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5270009f20 tx=0x7f5270009840 comp rx=0 tx=0).stop 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f527d9f6700 1 -- 172.21.15.61:0/2019939084 shutdown_connections 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f527d9f6700 1 --2- 172.21.15.61:0/2019939084 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 0x7f52780c5d10 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f527d9f6700 1 --2- 172.21.15.61:0/2019939084 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5278159c10 0x7f52780c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f527d9f6700 1 -- 172.21.15.61:0/2019939084 >> 172.21.15.61:0/2019939084 conn(0x7f527806e640 msgr2=0x7f5278067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f527d9f6700 1 -- 172.21.15.61:0/2019939084 shutdown_connections 2023-12-24T20:01:22.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.774+0000 7f527d9f6700 1 -- 172.21.15.61:0/2019939084 wait complete. 2023-12-24T20:01:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f527d9f6700 1 Processor -- start 2023-12-24T20:01:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f527d9f6700 1 -- start start 2023-12-24T20:01:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f527d9f6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 0x7f52780b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f527d9f6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5278159c10 0x7f5278156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f527d9f6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5278159fe0 0x7f5278157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f527d9f6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52781508c0 con 0x7f52780cc190 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f527d9f6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52780b5110 con 0x7f5278159c10 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f527d9f6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52780b53f0 con 0x7f5278159fe0 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f5276ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 0x7f52780b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f5276ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 0x7f52780b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48678/0 (socket says 172.21.15.61:48678) 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.776+0000 7f5276ffd700 1 -- 172.21.15.61:0/2286654128 learned_addr learned my addr 172.21.15.61:0/2286654128 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f52777fe700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5278159fe0 0x7f5278157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f52767fc700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5278159c10 0x7f5278156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f5276ffd700 1 -- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5278159fe0 msgr2=0x7f5278157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f5276ffd700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5278159fe0 0x7f5278157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f5276ffd700 1 -- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5278159c10 msgr2=0x7f5278156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f5276ffd700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5278159c10 0x7f5278156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f5276ffd700 1 -- 172.21.15.61:0/2286654128 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270009ae0 con 0x7f52780cc190 2023-12-24T20:01:22.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f5276ffd700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 0x7f52780b47a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f526000d860 tx=0x7f5260008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f526effd700 1 -- 172.21.15.61:0/2286654128 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260009610 con 0x7f52780cc190 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f526effd700 1 -- 172.21.15.61:0/2286654128 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5260009770 con 0x7f52780cc190 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f527d9f6700 1 -- 172.21.15.61:0/2286654128 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52780b56d0 con 0x7f52780cc190 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f526effd700 1 -- 172.21.15.61:0/2286654128 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260009b30 con 0x7f52780cc190 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.777+0000 7f527d9f6700 1 -- 172.21.15.61:0/2286654128 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52780b4ce0 con 0x7f52780cc190 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.778+0000 7f527d9f6700 1 -- 172.21.15.61:0/2286654128 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52780b4ed0 con 0x7f52780cc190 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.779+0000 7f526effd700 1 -- 172.21.15.61:0/2286654128 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f526001e460 con 0x7f52780cc190 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.779+0000 7f526effd700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5258066f30 0x7f52580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.779+0000 7f526effd700 1 -- 172.21.15.61:0/2286654128 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5260084850 con 0x7f52780cc190 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.779+0000 7f52767fc700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5258066f30 0x7f52580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:22.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.780+0000 7f52767fc700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5258066f30 0x7f52580693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f52780b6500 tx=0x7f5268009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:22.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:22.784+0000 7f526effd700 1 -- 172.21.15.61:0/2286654128 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52780b4ed0 con 0x7f52780cc190 2023-12-24T20:01:23.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.063+0000 7f527d9f6700 1 -- 172.21.15.61:0/2286654128 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f52780b4ed0 con 0x7f52780cc190 2023-12-24T20:01:23.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.638+0000 7f526effd700 1 -- 172.21.15.61:0/2286654128 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v227) v1 ==== 140+0+0 (secure 0 0 0) 0x7f52780b4ed0 con 0x7f52780cc190 2023-12-24T20:01:23.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 -- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5258066f30 msgr2=0x7f52580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:23.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5258066f30 0x7f52580693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f52780b6500 tx=0x7f5268009040 comp rx=0 tx=0).stop 2023-12-24T20:01:23.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 -- 172.21.15.61:0/2286654128 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 msgr2=0x7f52780b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:23.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 0x7f52780b47a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f526000d860 tx=0x7f5260008040 comp rx=0 tx=0).stop 2023-12-24T20:01:23.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 -- 172.21.15.61:0/2286654128 shutdown_connections 2023-12-24T20:01:23.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5278159fe0 0x7f5278157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:23.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5258066f30 0x7f52580693e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:23.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52780cc190 0x7f52780b47a0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:23.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 --2- 172.21.15.61:0/2286654128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5278159c10 0x7f5278156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:23.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 -- 172.21.15.61:0/2286654128 >> 172.21.15.61:0/2286654128 conn(0x7f527806e640 msgr2=0x7f52780ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:23.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 -- 172.21.15.61:0/2286654128 shutdown_connections 2023-12-24T20:01:23.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.641+0000 7f527d9f6700 1 -- 172.21.15.61:0/2286654128 wait complete. 2023-12-24T20:01:23.656 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-24T20:01:23.801 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_objectstore":"memstore"} 2023-12-24T20:01:23.801 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-24T20:01:23.802 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T20:01:23.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.927+0000 7f2f71f4f700 1 Processor -- start 2023-12-24T20:01:23.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.927+0000 7f2f71f4f700 1 -- start start 2023-12-24T20:01:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.928+0000 7f2f71f4f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c06b320 0x7f2f6c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.928+0000 7f2f71f4f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c15c3f0 con 0x7f2f6c157680 2023-12-24T20:01:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.928+0000 7f2f71f4f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c15b500 con 0x7f2f6c157a50 2023-12-24T20:01:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.928+0000 7f2f71f4f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c157ea0 con 0x7f2f6c06b320 2023-12-24T20:01:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.928+0000 7f2f6b7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2f6c157680 0x7f2f6c06f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:37548/0 (socket says 172.21.15.61:37548) 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.928+0000 7f2f6b7fe700 1 -- 172.21.15.61:0/3712882153 learned_addr learned my addr 172.21.15.61:0/3712882153 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.928+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935470417 0 0) 0x7f2f6c15c3f0 con 0x7f2f6c157680 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.928+0000 7f2f6bfff700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c06b320 0x7f2f6c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.928+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f54003570 con 0x7f2f6c157680 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3985486884 0 0) 0x7f2f54003570 con 0x7f2f6c157680 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c06b320 msgr2=0x7f2f6c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c06b320 0x7f2f6c0b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 >> v1:172.21.15.133:6789/0 conn(0x7f2f6c157a50 legacy=0x7f2f6c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c15b7e0 con 0x7f2f6c157680 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f2f5c001470 con 0x7f2f6c157680 2023-12-24T20:01:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6bfff700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c06b320 0x7f2f6c0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 >> v1:172.21.15.61:6789/0 conn(0x7f2f6c157680 legacy=0x7f2f6c06f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f54003a90 0x7f2f54003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 0x7f2f54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c06b320 0x7f2f54005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5400bbf0 con 0x7f2f54004810 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5400bd60 con 0x7f2f54003a90 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5400bf20 con 0x7f2f6c06b320 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6affd700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 0x7f2f54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6b7fe700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f54003a90 0x7f2f54003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6bfff700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c06b320 0x7f2f54005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6affd700 1 -- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c06b320 msgr2=0x7f2f54005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6affd700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c06b320 0x7f2f54005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6affd700 1 -- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f54003a90 msgr2=0x7f2f54003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6affd700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f54003a90 0x7f2f54003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6affd700 1 -- 172.21.15.61:0/3712882153 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54003570 con 0x7f2f54004810 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6bfff700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c06b320 0x7f2f54005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6affd700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 0x7f2f54004c80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2f600018b0 tx=0x7f2f60007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff273cb8d59af0d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60012420 con 0x7f2f54004810 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f60012580 con 0x7f2f54004810 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.929+0000 7f2f6a7fc700 1 -- 172.21.15.61:0/3712882153 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60012920 con 0x7f2f54004810 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.930+0000 7f2f71f4f700 1 -- 172.21.15.61:0/3712882153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 msgr2=0x7f2f54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.930+0000 7f2f71f4f700 1 --2- 172.21.15.61:0/3712882153 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 0x7f2f54004c80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2f600018b0 tx=0x7f2f60007d30 comp rx=0 tx=0).stop 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.930+0000 7f2f6bfff700 1 -- 172.21.15.61:0/3712882153 reap_dead start 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.930+0000 7f2f71f4f700 1 -- 172.21.15.61:0/3712882153 shutdown_connections 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.930+0000 7f2f71f4f700 1 -- 172.21.15.61:0/3712882153 >> 172.21.15.61:0/3712882153 conn(0x7f2f6c0ce800 msgr2=0x7f2f6c0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.930+0000 7f2f71f4f700 1 -- 172.21.15.61:0/3712882153 shutdown_connections 2023-12-24T20:01:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.930+0000 7f2f71f4f700 1 -- 172.21.15.61:0/3712882153 wait complete. 2023-12-24T20:01:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.931+0000 7f2f71f4f700 1 Processor -- start 2023-12-24T20:01:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.931+0000 7f2f71f4f700 1 -- start start 2023-12-24T20:01:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.932+0000 7f2f71f4f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 0x7f2f6c0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.932+0000 7f2f71f4f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f6c0b03b0 0x7f2f6c0b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.932+0000 7f2f71f4f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c0b1af0 0x7f2f6c153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.932+0000 7f2f71f4f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c16bcd0 con 0x7f2f54004810 2023-12-24T20:01:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.932+0000 7f2f71f4f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0b2030 con 0x7f2f6c0b03b0 2023-12-24T20:01:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.932+0000 7f2f71f4f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c16b680 con 0x7f2f6c0b1af0 2023-12-24T20:01:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.932+0000 7f2f6b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 0x7f2f6c0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.932+0000 7f2f6b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 0x7f2f6c0afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48702/0 (socket says 172.21.15.61:48702) 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.932+0000 7f2f6b7fe700 1 -- 172.21.15.61:0/907289921 learned_addr learned my addr 172.21.15.61:0/907289921 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.932+0000 7f2f6affd700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f6c0b03b0 0x7f2f6c0b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f6b7fe700 1 -- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c0b1af0 msgr2=0x7f2f6c153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f6bfff700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c0b1af0 0x7f2f6c153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f6b7fe700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c0b1af0 0x7f2f6c153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f6b7fe700 1 -- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f6c0b03b0 msgr2=0x7f2f6c0b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f6b7fe700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f6c0b03b0 0x7f2f6c0b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f6b7fe700 1 -- 172.21.15.61:0/907289921 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c16b960 con 0x7f2f54004810 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f6affd700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f6c0b03b0 0x7f2f6c0b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f6b7fe700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 0x7f2f6c0afe70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c007390 tx=0x7f2f5c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f537fe700 1 -- 172.21.15.61:0/907289921 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c018030 con 0x7f2f54004810 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f537fe700 1 -- 172.21.15.61:0/907289921 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c00f9a0 con 0x7f2f54004810 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f71f4f700 1 -- 172.21.15.61:0/907289921 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c0b2310 con 0x7f2f54004810 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f537fe700 1 -- 172.21.15.61:0/907289921 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00fd40 con 0x7f2f54004810 2023-12-24T20:01:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.933+0000 7f2f71f4f700 1 -- 172.21.15.61:0/907289921 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c16c160 con 0x7f2f54004810 2023-12-24T20:01:23.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.934+0000 7f2f71f4f700 1 -- 172.21.15.61:0/907289921 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c04c3c0 con 0x7f2f54004810 2023-12-24T20:01:23.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.934+0000 7f2f537fe700 1 -- 172.21.15.61:0/907289921 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2f5c01b070 con 0x7f2f54004810 2023-12-24T20:01:23.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.935+0000 7f2f537fe700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f58066f30 0x7f2f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:23.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.935+0000 7f2f537fe700 1 -- 172.21.15.61:0/907289921 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2f5c019070 con 0x7f2f54004810 2023-12-24T20:01:23.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.935+0000 7f2f6affd700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f58066f30 0x7f2f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:23.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.935+0000 7f2f6affd700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f58066f30 0x7f2f580693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0b0c20 tx=0x7f2f60015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:23.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:23.939+0000 7f2f537fe700 1 -- 172.21.15.61:0/907289921 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f5c051740 con 0x7f2f54004810 2023-12-24T20:01:24.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.136+0000 7f2f71f4f700 1 -- 172.21.15.61:0/907289921 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2f6c15bac0 con 0x7f2f54004810 2023-12-24T20:01:24.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.142+0000 7f2f537fe700 1 -- 172.21.15.61:0/907289921 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2f5c00fea0 con 0x7f2f54004810 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 -- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f58066f30 msgr2=0x7f2f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f58066f30 0x7f2f580693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0b0c20 tx=0x7f2f60015000 comp rx=0 tx=0).stop 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 -- 172.21.15.61:0/907289921 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 msgr2=0x7f2f6c0afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 0x7f2f6c0afe70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c007390 tx=0x7f2f5c001e50 comp rx=0 tx=0).stop 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 -- 172.21.15.61:0/907289921 shutdown_connections 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f6c0b1af0 0x7f2f6c153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f58066f30 0x7f2f580693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f54004810 0x7f2f6c0afe70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 --2- 172.21.15.61:0/907289921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f6c0b03b0 0x7f2f6c0b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 -- 172.21.15.61:0/907289921 >> 172.21.15.61:0/907289921 conn(0x7f2f6c0ce800 msgr2=0x7f2f6c0cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 -- 172.21.15.61:0/907289921 shutdown_connections 2023-12-24T20:01:24.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.144+0000 7f2f71f4f700 1 -- 172.21.15.61:0/907289921 wait complete. 2023-12-24T20:01:24.157 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:01:24.157 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:01:24.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:01:24.251 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:01:24.251 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T20:01:24.251 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:01:24.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.373+0000 7f704232f700 1 Processor -- start 2023-12-24T20:01:24.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.373+0000 7f704232f700 1 -- start start 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f704232f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f703c068140 0x7f703c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f704232f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f703c068510 0x7f703c0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f704232f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c159a60 0x7f703c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f704232f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c0b2890 con 0x7f703c068510 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f704232f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c0b11e0 con 0x7f703c068140 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f704232f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0cf630 con 0x7f703c159a60 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f703c068510 0x7f703c0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f703c068510 0x7f703c0b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48718/0 (socket says 172.21.15.61:48718) 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703b7fe700 1 -- 172.21.15.61:0/2035331270 learned_addr learned my addr 172.21.15.61:0/2035331270 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703b7fe700 1 -- 172.21.15.61:0/2035331270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c159a60 msgr2=0x7f703c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703bfff700 1 --2- 172.21.15.61:0/2035331270 >> v2:172.21.15.133:3300/0 conn(0x7f703c068140 0x7f703c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f70408cc700 1 --2- 172.21.15.61:0/2035331270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c159a60 0x7f703c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703b7fe700 1 --2- 172.21.15.61:0/2035331270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c159a60 0x7f703c159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703b7fe700 1 -- 172.21.15.61:0/2035331270 >> v2:172.21.15.133:3300/0 conn(0x7f703c068140 msgr2=0x7f703c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703b7fe700 1 --2- 172.21.15.61:0/2035331270 >> v2:172.21.15.133:3300/0 conn(0x7f703c068140 0x7f703c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703b7fe700 1 -- 172.21.15.61:0/2035331270 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0b2240 con 0x7f703c068510 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703bfff700 1 --2- 172.21.15.61:0/2035331270 >> v2:172.21.15.133:3300/0 conn(0x7f703c068140 0x7f703c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f70408cc700 1 --2- 172.21.15.61:0/2035331270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c159a60 0x7f703c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.374+0000 7f703b7fe700 1 --2- 172.21.15.61:0/2035331270 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 0x7f703c0b0ca0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f703c06e290 tx=0x7f7024009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c2d8e40b52132 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f703affd700 1 -- 172.21.15.61:0/2035331270 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400b860 con 0x7f703c068510 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f703affd700 1 -- 172.21.15.61:0/2035331270 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702400b9c0 con 0x7f703c068510 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f703affd700 1 -- 172.21.15.61:0/2035331270 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400bd60 con 0x7f703c068510 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f704232f700 1 -- 172.21.15.61:0/2035331270 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 msgr2=0x7f703c0b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f704232f700 1 --2- 172.21.15.61:0/2035331270 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 0x7f703c0b0ca0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f703c06e290 tx=0x7f7024009250 comp rx=0 tx=0).stop 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f704232f700 1 -- 172.21.15.61:0/2035331270 shutdown_connections 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f704232f700 1 --2- 172.21.15.61:0/2035331270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c159a60 0x7f703c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f704232f700 1 --2- 172.21.15.61:0/2035331270 >> v2:172.21.15.133:3300/0 conn(0x7f703c068140 0x7f703c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f704232f700 1 --2- 172.21.15.61:0/2035331270 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 0x7f703c0b0ca0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f704232f700 1 -- 172.21.15.61:0/2035331270 >> 172.21.15.61:0/2035331270 conn(0x7f703c097a10 msgr2=0x7f703c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:24.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f704232f700 1 -- 172.21.15.61:0/2035331270 shutdown_connections 2023-12-24T20:01:24.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.375+0000 7f704232f700 1 -- 172.21.15.61:0/2035331270 wait complete. 2023-12-24T20:01:24.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.377+0000 7f704232f700 1 Processor -- start 2023-12-24T20:01:24.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.377+0000 7f704232f700 1 -- start start 2023-12-24T20:01:24.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f704232f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c068140 0x7f703c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f704232f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 0x7f703c0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f704232f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c159a60 0x7f703c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f704232f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0c7390 con 0x7f703c068510 2023-12-24T20:01:24.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f704232f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0c9000 con 0x7f703c159a60 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f704232f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0c6780 con 0x7f703c068140 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 0x7f703c0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 0x7f703c0c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48730/0 (socket says 172.21.15.61:48730) 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703b7fe700 1 -- 172.21.15.61:0/1043511578 learned_addr learned my addr 172.21.15.61:0/1043511578 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703bfff700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c068140 0x7f703c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f70408cc700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c159a60 0x7f703c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703b7fe700 1 -- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c068140 msgr2=0x7f703c156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703b7fe700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c068140 0x7f703c156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703b7fe700 1 -- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c159a60 msgr2=0x7f703c0c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703b7fe700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c159a60 0x7f703c0c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703b7fe700 1 -- 172.21.15.61:0/1043511578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70240094f0 con 0x7f703c068510 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703bfff700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c068140 0x7f703c156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.378+0000 7f703b7fe700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 0x7f703c0c5c30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f703c06d8b0 tx=0x7f7024017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:24.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.379+0000 7f7033fff700 1 -- 172.21.15.61:0/1043511578 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024024440 con 0x7f703c068510 2023-12-24T20:01:24.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.379+0000 7f7033fff700 1 -- 172.21.15.61:0/1043511578 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70240245a0 con 0x7f703c068510 2023-12-24T20:01:24.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.379+0000 7f704232f700 1 -- 172.21.15.61:0/1043511578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c0c6a60 con 0x7f703c068510 2023-12-24T20:01:24.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.379+0000 7f7033fff700 1 -- 172.21.15.61:0/1043511578 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024024960 con 0x7f703c068510 2023-12-24T20:01:24.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.379+0000 7f704232f700 1 -- 172.21.15.61:0/1043511578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c0c7020 con 0x7f703c068510 2023-12-24T20:01:24.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.380+0000 7f704232f700 1 -- 172.21.15.61:0/1043511578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c06d440 con 0x7f703c068510 2023-12-24T20:01:24.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.380+0000 7f7033fff700 1 -- 172.21.15.61:0/1043511578 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f702401a420 con 0x7f703c068510 2023-12-24T20:01:24.383 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.380+0000 7f7033fff700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f701c066f30 0x7f701c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.383 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.381+0000 7f7033fff700 1 -- 172.21.15.61:0/1043511578 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f70240860e0 con 0x7f703c068510 2023-12-24T20:01:24.383 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.381+0000 7f703bfff700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f701c066f30 0x7f701c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.383 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.381+0000 7f703bfff700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f701c066f30 0x7f701c0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f702c006fd0 tx=0x7f702c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:24.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.385+0000 7f7033fff700 1 -- 172.21.15.61:0/1043511578 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7024053650 con 0x7f703c068510 2023-12-24T20:01:24.624 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.623+0000 7f704232f700 1 -- 172.21.15.61:0/1043511578 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f703c04c3c0 con 0x7f703c068510 2023-12-24T20:01:24.624 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.623+0000 7f7033fff700 1 -- 172.21.15.61:0/1043511578 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f7024015de0 con 0x7f703c068510 2023-12-24T20:01:24.624 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:24.625 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/3462396702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3462396702},{"type":"v1","addr":"172.21.15.61:6835","nonce":3462396702}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2539986874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2539986874},{"type":"v1","addr":"172.21.15.133:6836","nonce":2539986874}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":5611,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/118195153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":118195153},{"type":"v1","addr":"172.21.15.133:6837","nonce":118195153}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/487849682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":487849682},{"type":"v1","addr":"172.21.15.61:6834","nonce":487849682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[]} 2023-12-24T20:01:24.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 -- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f701c066f30 msgr2=0x7f701c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f701c066f30 0x7f701c0693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f702c006fd0 tx=0x7f702c008040 comp rx=0 tx=0).stop 2023-12-24T20:01:24.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 -- 172.21.15.61:0/1043511578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 msgr2=0x7f703c0c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 0x7f703c0c5c30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f703c06d8b0 tx=0x7f7024017000 comp rx=0 tx=0).stop 2023-12-24T20:01:24.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 -- 172.21.15.61:0/1043511578 shutdown_connections 2023-12-24T20:01:24.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f703c068140 0x7f703c156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f701c066f30 0x7f701c0693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c159a60 0x7f703c0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 --2- 172.21.15.61:0/1043511578 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f703c068510 0x7f703c0c5c30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 -- 172.21.15.61:0/1043511578 >> 172.21.15.61:0/1043511578 conn(0x7f703c097a10 msgr2=0x7f703c0b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:24.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 -- 172.21.15.61:0/1043511578 shutdown_connections 2023-12-24T20:01:24.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.625+0000 7f704232f700 1 -- 172.21.15.61:0/1043511578 wait complete. 2023-12-24T20:01:24.628 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 46 2023-12-24T20:01:24.638 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T20:01:24.639 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T20:01:24.639 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:01:24.639 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:01:24.639 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T20:01:24.639 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T20:01:24.639 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:01:24.640 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:01:24.640 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T20:01:24.640 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T20:01:24.640 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:01:24.640 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:01:24.640 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T20:01:24.640 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T20:01:24.640 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:01:24.641 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:01:24.648 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:01:24.648 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T20:01:24.649 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:01:24.649 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T20:01:24.651 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:01:24.651 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T20:01:24.652 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:01:24.652 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T20:01:24.690 INFO:tasks.ceph.mds.a:Started 2023-12-24T20:01:24.691 DEBUG:teuthology.parallel:result is None 2023-12-24T20:01:24.691 INFO:tasks.ceph.mds.c:Started 2023-12-24T20:01:24.691 DEBUG:teuthology.parallel:result is None 2023-12-24T20:01:24.693 INFO:tasks.ceph.mds.b:Started 2023-12-24T20:01:24.694 DEBUG:teuthology.parallel:result is None 2023-12-24T20:01:24.694 INFO:tasks.ceph.mds.d:Started 2023-12-24T20:01:24.695 DEBUG:teuthology.parallel:result is None 2023-12-24T20:01:24.695 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T20:01:24.770 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T20:01:24.770 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T20:01:24.778 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T20:01:24.778 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T20:01:24.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.821+0000 7fe11f695700 1 Processor -- start 2023-12-24T20:01:24.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.822+0000 7fe11f695700 1 -- start start 2023-12-24T20:01:24.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.822+0000 7fe11f695700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe1180cb920 0x7fe1180ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe11f695700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe118158350 con 0x7fe1180ce010 2023-12-24T20:01:24.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe11f695700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1180ca740 con 0x7fe1180ce3e0 2023-12-24T20:01:24.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe11f695700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe118158ef0 con 0x7fe1180cb920 2023-12-24T20:01:24.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe11d431700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe1180ce010 0x7fe1181587e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:37562/0 (socket says 172.21.15.61:37562) 2023-12-24T20:01:24.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe11d431700 1 -- 172.21.15.61:0/4089791471 learned_addr learned my addr 172.21.15.61:0/4089791471 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:24.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe11dc32700 1 --2- 172.21.15.61:0/4089791471 >> v2:172.21.15.133:3300/0 conn(0x7fe1180cb920 0x7fe1180ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe117fff700 1 -- 172.21.15.61:0/4089791471 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565074327 0 0) 0x7fe118158350 con 0x7fe1180ce010 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe117fff700 1 -- 172.21.15.61:0/4089791471 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe100003570 con 0x7fe1180ce010 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe11dc32700 1 -- 172.21.15.61:0/4089791471 >> v1:172.21.15.133:6789/0 conn(0x7fe1180ce3e0 legacy=0x7fe1180cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe117fff700 1 -- 172.21.15.61:0/4089791471 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483785486 0 0) 0x7fe1180ca740 con 0x7fe1180ce3e0 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe11dc32700 1 -- 172.21.15.61:0/4089791471 >> v1:172.21.15.61:6789/0 conn(0x7fe1180ce010 legacy=0x7fe1181587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe11dc32700 1 -- 172.21.15.61:0/4089791471 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1180b1120 con 0x7fe1180cb920 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe11dc32700 1 --2- 172.21.15.61:0/4089791471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180cb920 0x7fe1180ca200 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe1080098e0 tx=0x7fe1080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88680fa4ae180a83 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe117fff700 1 -- 172.21.15.61:0/4089791471 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800b640 con 0x7fe1180cb920 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe117fff700 1 -- 172.21.15.61:0/4089791471 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10800b7a0 con 0x7fe1180cb920 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.823+0000 7fe117fff700 1 -- 172.21.15.61:0/4089791471 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10800bb40 con 0x7fe1180cb920 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.824+0000 7fe11f695700 1 -- 172.21.15.61:0/4089791471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180cb920 msgr2=0x7fe1180ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.824+0000 7fe11f695700 1 --2- 172.21.15.61:0/4089791471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180cb920 0x7fe1180ca200 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe1080098e0 tx=0x7fe1080091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.824+0000 7fe11f695700 1 -- 172.21.15.61:0/4089791471 shutdown_connections 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.824+0000 7fe11f695700 1 --2- 172.21.15.61:0/4089791471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180cb920 0x7fe1180ca200 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.824+0000 7fe11f695700 1 -- 172.21.15.61:0/4089791471 >> 172.21.15.61:0/4089791471 conn(0x7fe11806b790 msgr2=0x7fe118069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:24.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.824+0000 7fe11f695700 1 -- 172.21.15.61:0/4089791471 shutdown_connections 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.824+0000 7fe11f695700 1 -- 172.21.15.61:0/4089791471 wait complete. 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.825+0000 7fe11f695700 1 Processor -- start 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.825+0000 7fe11f695700 1 -- start start 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11f695700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe1180cb920 0x7fe1181473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11f695700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe1180ce010 0x7fe118167c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11f695700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180ce3e0 0x7fe118168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11f695700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe118169470 con 0x7fe1180ce010 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11f695700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180b3a10 con 0x7fe1180ce3e0 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11f695700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe118168830 con 0x7fe1180cb920 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11cc30700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe1180ce010 0x7fe118167c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11cc30700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe1180ce010 0x7fe118167c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48770/0 (socket says 172.21.15.61:48770) 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11cc30700 1 -- 172.21.15.61:0/3386537434 learned_addr learned my addr 172.21.15.61:0/3386537434 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11d431700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe1180cb920 0x7fe1181473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11dc32700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180ce3e0 0x7fe118168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11cc30700 1 -- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe1180cb920 msgr2=0x7fe1181473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11cc30700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe1180cb920 0x7fe1181473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11cc30700 1 -- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180ce3e0 msgr2=0x7fe118168190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.826+0000 7fe11cc30700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180ce3e0 0x7fe118168190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.827+0000 7fe11cc30700 1 -- 172.21.15.61:0/3386537434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe108009420 con 0x7fe1180ce010 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.827+0000 7fe11cc30700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe1180ce010 0x7fe118167c50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c530 tx=0x7fe10c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.827+0000 7fe1157fa700 1 -- 172.21.15.61:0/3386537434 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c011590 con 0x7fe1180ce010 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.827+0000 7fe1157fa700 1 -- 172.21.15.61:0/3386537434 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c011710 con 0x7fe1180ce010 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.827+0000 7fe11f695700 1 -- 172.21.15.61:0/3386537434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe118168b10 con 0x7fe1180ce010 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.827+0000 7fe1157fa700 1 -- 172.21.15.61:0/3386537434 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c011ad0 con 0x7fe1180ce010 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.827+0000 7fe11f695700 1 -- 172.21.15.61:0/3386537434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe118169100 con 0x7fe1180ce010 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.828+0000 7fe11f695700 1 -- 172.21.15.61:0/3386537434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1180cbf50 con 0x7fe1180ce010 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.828+0000 7fe1157fa700 1 -- 172.21.15.61:0/3386537434 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe10c01b3b0 con 0x7fe1180ce010 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.829+0000 7fe1157fa700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe104066f30 0x7fe1040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:24.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.829+0000 7fe1157fa700 1 -- 172.21.15.61:0/3386537434 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe10c0836c0 con 0x7fe1180ce010 2023-12-24T20:01:24.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.829+0000 7fe11d431700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe104066f30 0x7fe1040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:24.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.829+0000 7fe11d431700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe104066f30 0x7fe1040693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe110005c50 tx=0x7fe110009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:24.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:24.833+0000 7fe1157fa700 1 -- 172.21.15.61:0/3386537434 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe10c050c30 con 0x7fe1180ce010 2023-12-24T20:01:25.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:25.041+0000 7fe11f695700 1 -- 172.21.15.61:0/3386537434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe11804c3c0 con 0x7fe1180ce010 2023-12-24T20:01:26.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.159+0000 7fe1157fa700 1 -- 172.21.15.61:0/3386537434 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v95) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe10c017020 con 0x7fe1180ce010 2023-12-24T20:01:26.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 -- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe104066f30 msgr2=0x7fe1040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe104066f30 0x7fe1040693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe110005c50 tx=0x7fe110009040 comp rx=0 tx=0).stop 2023-12-24T20:01:26.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 -- 172.21.15.61:0/3386537434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe1180ce010 msgr2=0x7fe118167c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe1180ce010 0x7fe118167c50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c530 tx=0x7fe10c00c840 comp rx=0 tx=0).stop 2023-12-24T20:01:26.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 -- 172.21.15.61:0/3386537434 shutdown_connections 2023-12-24T20:01:26.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe1180cb920 0x7fe1181473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe104066f30 0x7fe1040693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1180ce3e0 0x7fe118168190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 --2- 172.21.15.61:0/3386537434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe1180ce010 0x7fe118167c50 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 -- 172.21.15.61:0/3386537434 >> 172.21.15.61:0/3386537434 conn(0x7fe11806b790 msgr2=0x7fe1181570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:26.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 -- 172.21.15.61:0/3386537434 shutdown_connections 2023-12-24T20:01:26.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.162+0000 7fe11f695700 1 -- 172.21.15.61:0/3386537434 wait complete. 2023-12-24T20:01:26.163 INFO:teuthology.orchestra.run.smithi061.stderr: removed all blocklist entries 2023-12-24T20:01:26.177 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T20:01:26.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.305+0000 7fe88d5dc700 1 Processor -- start 2023-12-24T20:01:26.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.305+0000 7fe88d5dc700 1 -- start start 2023-12-24T20:01:26.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe88d5dc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe888159fe0 0x7fe8880cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe88d5dc700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8880af880 con 0x7fe8880c5ee0 2023-12-24T20:01:26.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe88d5dc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8880c6fc0 con 0x7fe888159c10 2023-12-24T20:01:26.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe88d5dc700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8880c63b0 con 0x7fe888159fe0 2023-12-24T20:01:26.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe8867fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe888159fe0 0x7fe8880cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe8877fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe8880c5ee0 0x7fe8880b09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:37572/0 (socket says 172.21.15.61:37572) 2023-12-24T20:01:26.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe8877fe700 1 -- 172.21.15.61:0/1420693260 learned_addr learned my addr 172.21.15.61:0/1420693260 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:26.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe8867fc700 1 -- 172.21.15.61:0/1420693260 >> v1:172.21.15.133:6789/0 conn(0x7fe888159c10 legacy=0x7fe8880c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe8867fc700 1 -- 172.21.15.61:0/1420693260 >> v1:172.21.15.61:6789/0 conn(0x7fe8880c5ee0 legacy=0x7fe8880b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe885ffb700 1 -- 172.21.15.61:0/1420693260 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685790661 0 0) 0x7fe8880af880 con 0x7fe8880c5ee0 2023-12-24T20:01:26.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.306+0000 7fe8867fc700 1 -- 172.21.15.61:0/1420693260 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8880c6690 con 0x7fe888159fe0 2023-12-24T20:01:26.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe8867fc700 1 --2- 172.21.15.61:0/1420693260 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 0x7fe8880cba80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe878009910 tx=0x7fe8780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64167bf8eff1efe3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:26.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe885ffb700 1 -- 172.21.15.61:0/1420693260 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800b820 con 0x7fe888159fe0 2023-12-24T20:01:26.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe885ffb700 1 -- 172.21.15.61:0/1420693260 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87800b980 con 0x7fe888159fe0 2023-12-24T20:01:26.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe885ffb700 1 -- 172.21.15.61:0/1420693260 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800bd20 con 0x7fe888159fe0 2023-12-24T20:01:26.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1420693260 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 msgr2=0x7fe8880cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe88d5dc700 1 --2- 172.21.15.61:0/1420693260 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 0x7fe8880cba80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe878009910 tx=0x7fe8780091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1420693260 shutdown_connections 2023-12-24T20:01:26.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe88d5dc700 1 --2- 172.21.15.61:0/1420693260 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 0x7fe8880cba80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1420693260 >> 172.21.15.61:0/1420693260 conn(0x7fe88806e640 msgr2=0x7fe888067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:26.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1420693260 shutdown_connections 2023-12-24T20:01:26.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.307+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1420693260 wait complete. 2023-12-24T20:01:26.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.309+0000 7fe88d5dc700 1 Processor -- start 2023-12-24T20:01:26.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.309+0000 7fe88d5dc700 1 -- start start 2023-12-24T20:01:26.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.309+0000 7fe88d5dc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8880c5ee0 0x7fe88815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe88d5dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe888159c10 0x7fe88815ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe88d5dc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 0x7fe8881604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe88d5dc700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88816b5b0 con 0x7fe888159fe0 2023-12-24T20:01:26.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe88d5dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8880b52e0 con 0x7fe888159c10 2023-12-24T20:01:26.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe88d5dc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8880b4940 con 0x7fe8880c5ee0 2023-12-24T20:01:26.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe8877fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 0x7fe8881604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe8877fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 0x7fe8881604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48794/0 (socket says 172.21.15.61:48794) 2023-12-24T20:01:26.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe8877fe700 1 -- 172.21.15.61:0/1898671053 learned_addr learned my addr 172.21.15.61:0/1898671053 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:26.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe886ffd700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8880c5ee0 0x7fe88815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe8867fc700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe888159c10 0x7fe88815ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe8877fe700 1 -- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8880c5ee0 msgr2=0x7fe88815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe8877fe700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8880c5ee0 0x7fe88815ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe8877fe700 1 -- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe888159c10 msgr2=0x7fe88815ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe8877fe700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe888159c10 0x7fe88815ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe8877fe700 1 -- 172.21.15.61:0/1898671053 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878009420 con 0x7fe888159fe0 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe8877fe700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 0x7fe8881604a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe88000cbc0 tx=0x7fe880001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe86effd700 1 -- 172.21.15.61:0/1898671053 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88000a940 con 0x7fe888159fe0 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe86effd700 1 -- 172.21.15.61:0/1898671053 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88000aaa0 con 0x7fe888159fe0 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1898671053 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8880b4c20 con 0x7fe888159fe0 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe86effd700 1 -- 172.21.15.61:0/1898671053 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88000ae60 con 0x7fe888159fe0 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.310+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1898671053 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88815f4b0 con 0x7fe888159fe0 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.311+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1898671053 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8880b5420 con 0x7fe888159fe0 2023-12-24T20:01:26.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.312+0000 7fe86effd700 1 -- 172.21.15.61:0/1898671053 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe880007300 con 0x7fe888159fe0 2023-12-24T20:01:26.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.312+0000 7fe86effd700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe874066f30 0x7fe8740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.312+0000 7fe86effd700 1 -- 172.21.15.61:0/1898671053 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe8800845c0 con 0x7fe888159fe0 2023-12-24T20:01:26.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.312+0000 7fe886ffd700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe874066f30 0x7fe8740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.313+0000 7fe886ffd700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe874066f30 0x7fe8740693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe87c003860 tx=0x7fe87c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:26.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.316+0000 7fe86effd700 1 -- 172.21.15.61:0/1898671053 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8880b5420 con 0x7fe888159fe0 2023-12-24T20:01:26.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.591+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1898671053 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe8880b5420 con 0x7fe888159fe0 2023-12-24T20:01:26.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.592+0000 7fe86effd700 1 -- 172.21.15.61:0/1898671053 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe8880b5420 con 0x7fe888159fe0 2023-12-24T20:01:26.592 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:26.592 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:01:26.592 INFO:teuthology.orchestra.run.smithi061.stdout: "auth_dump": [ 2023-12-24T20:01:26.592 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.592 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.a", 2023-12-24T20:01:26.592 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew==", 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.b", 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw==", 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:01:26.593 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.c", 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g==", 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.594 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.d", 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg==", 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.0", 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag==", 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:01:26.595 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.1", 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw==", 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.2", 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ==", 2023-12-24T20:01:26.596 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.3", 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA==", 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.597 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.4", 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ==", 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.5", 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w==", 2023-12-24T20:01:26.598 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.6", 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw==", 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.599 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.7", 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw==", 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.0", 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA==", 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:01:26.600 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow r", 2023-12-24T20:01:26.601 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T20:01:26.601 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.601 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.601 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.1", 2023-12-24T20:01:26.601 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w==", 2023-12-24T20:01:26.601 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.601 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:01:26.601 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:01:26.601 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.2", 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg==", 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:01:26.602 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.3", 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g==", 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.admin", 2023-12-24T20:01:26.603 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlwF3pGRAA8h0Cld7lwZprlrgMAN7tSg==", 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.x", 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg==", 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.604 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.y", 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A==", 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:26.605 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe874066f30 msgr2=0x7fe8740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe874066f30 0x7fe8740693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe87c003860 tx=0x7fe87c009040 comp rx=0 tx=0).stop 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1898671053 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 msgr2=0x7fe8881604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 0x7fe8881604a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe88000cbc0 tx=0x7fe880001980 comp rx=0 tx=0).stop 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1898671053 shutdown_connections 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8880c5ee0 0x7fe88815ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe874066f30 0x7fe8740693e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe888159fe0 0x7fe8881604a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 --2- 172.21.15.61:0/1898671053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe888159c10 0x7fe88815ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1898671053 >> 172.21.15.61:0/1898671053 conn(0x7fe88806e640 msgr2=0x7fe88815ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.593+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1898671053 shutdown_connections 2023-12-24T20:01:26.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.594+0000 7fe88d5dc700 1 -- 172.21.15.61:0/1898671053 wait complete. 2023-12-24T20:01:26.608 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:01:26.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.730+0000 7f39db427700 1 Processor -- start 2023-12-24T20:01:26.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.730+0000 7f39db427700 1 -- start start 2023-12-24T20:01:26.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.731+0000 7f39db427700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f39d4068140 0x7f39d40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.731+0000 7f39db427700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 0x7f39d4159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.731+0000 7f39db427700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d40b2890 con 0x7f39d4068510 2023-12-24T20:01:26.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.731+0000 7f39db427700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d40cf630 con 0x7f39d4068140 2023-12-24T20:01:26.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.731+0000 7f39db427700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d40b2240 con 0x7f39d4159a60 2023-12-24T20:01:26.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.731+0000 7f39d91c3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f39d4068140 0x7f39d40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.731+0000 7f39d89c2700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f39d4068510 0x7f39d40b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42030/0 (socket says 172.21.15.61:42030) 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.731+0000 7f39d89c2700 1 -- 172.21.15.61:0/3745969477 learned_addr learned my addr 172.21.15.61:0/3745969477 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39d99c4700 1 --2- 172.21.15.61:0/3745969477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 0x7f39d4159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39d91c3700 1 -- 172.21.15.61:0/3745969477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 msgr2=0x7f39d4159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39d91c3700 1 --2- 172.21.15.61:0/3745969477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 0x7f39d4159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39d91c3700 1 -- 172.21.15.61:0/3745969477 >> v1:172.21.15.61:6789/0 conn(0x7f39d4068510 legacy=0x7f39d40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39d91c3700 1 -- 172.21.15.61:0/3745969477 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d40b2520 con 0x7f39d4068140 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39cbfff700 1 -- 172.21.15.61:0/3745969477 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471603356 0 0) 0x7f39d40b2890 con 0x7f39d4068510 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39d91c3700 1 --2- 172.21.15.61:0/3745969477 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068140 0x7f39d40cefa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f39c40098d0 tx=0x7f39c4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbac1b0e719b9f19 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39cbfff700 1 -- 172.21.15.61:0/3745969477 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4009e70 con 0x7f39d4068140 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39cbfff700 1 -- 172.21.15.61:0/3745969477 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c4005c10 con 0x7f39d4068140 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39cbfff700 1 -- 172.21.15.61:0/3745969477 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400b650 con 0x7f39d4068140 2023-12-24T20:01:26.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.732+0000 7f39db427700 1 -- 172.21.15.61:0/3745969477 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068140 msgr2=0x7f39d40cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.733+0000 7f39db427700 1 --2- 172.21.15.61:0/3745969477 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068140 0x7f39d40cefa0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f39c40098d0 tx=0x7f39c4009120 comp rx=0 tx=0).stop 2023-12-24T20:01:26.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.733+0000 7f39db427700 1 -- 172.21.15.61:0/3745969477 shutdown_connections 2023-12-24T20:01:26.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.733+0000 7f39db427700 1 --2- 172.21.15.61:0/3745969477 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 0x7f39d4159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.733+0000 7f39db427700 1 --2- 172.21.15.61:0/3745969477 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068140 0x7f39d40cefa0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.733+0000 7f39db427700 1 -- 172.21.15.61:0/3745969477 >> 172.21.15.61:0/3745969477 conn(0x7f39d4097a10 msgr2=0x7f39d40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:26.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.733+0000 7f39db427700 1 -- 172.21.15.61:0/3745969477 shutdown_connections 2023-12-24T20:01:26.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.733+0000 7f39db427700 1 -- 172.21.15.61:0/3745969477 wait complete. 2023-12-24T20:01:26.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.734+0000 7f39db427700 1 Processor -- start 2023-12-24T20:01:26.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.734+0000 7f39db427700 1 -- start start 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39db427700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d4068140 0x7f39d416aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39db427700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068510 0x7f39d4156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39db427700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 0x7f39d4151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39db427700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d409b4a0 con 0x7f39d4068510 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39db427700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d406b980 con 0x7f39d4068140 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39db427700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d406bc60 con 0x7f39d4159a60 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d89c2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068510 0x7f39d4156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d89c2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068510 0x7f39d4156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50018/0 (socket says 172.21.15.61:50018) 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d89c2700 1 -- 172.21.15.61:0/193562297 learned_addr learned my addr 172.21.15.61:0/193562297 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d99c4700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 0x7f39d4151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d91c3700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d4068140 0x7f39d416aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d89c2700 1 -- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 msgr2=0x7f39d4151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d89c2700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 0x7f39d4151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d89c2700 1 -- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d4068140 msgr2=0x7f39d416aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d89c2700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d4068140 0x7f39d416aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d89c2700 1 -- 172.21.15.61:0/193562297 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c40093c0 con 0x7f39d4068510 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d99c4700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 0x7f39d4151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d91c3700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d4068140 0x7f39d416aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.735+0000 7f39d89c2700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068510 0x7f39d4156db0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c7e0 tx=0x7f39d0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.736+0000 7f39c97fa700 1 -- 172.21.15.61:0/193562297 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0005b30 con 0x7f39d4068510 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.736+0000 7f39c97fa700 1 -- 172.21.15.61:0/193562297 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d0005c90 con 0x7f39d4068510 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.736+0000 7f39db427700 1 -- 172.21.15.61:0/193562297 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d406bf40 con 0x7f39d4068510 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.736+0000 7f39c97fa700 1 -- 172.21.15.61:0/193562297 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0007300 con 0x7f39d4068510 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.736+0000 7f39db427700 1 -- 172.21.15.61:0/193562297 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d416b020 con 0x7f39d4068510 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.737+0000 7f39db427700 1 -- 172.21.15.61:0/193562297 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d416b380 con 0x7f39d4068510 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.737+0000 7f39c97fa700 1 -- 172.21.15.61:0/193562297 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f39d001b400 con 0x7f39d4068510 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.737+0000 7f39c97fa700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b8066f30 0x7f39b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:26.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.738+0000 7f39c97fa700 1 -- 172.21.15.61:0/193562297 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f39d0083ce0 con 0x7f39d4068510 2023-12-24T20:01:26.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.738+0000 7f39d91c3700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b8066f30 0x7f39b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:26.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.738+0000 7f39d91c3700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b8066f30 0x7f39b80693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009160 tx=0x7f39c4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:26.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.742+0000 7f39c97fa700 1 -- 172.21.15.61:0/193562297 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39d416b380 con 0x7f39d4068510 2023-12-24T20:01:26.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.939+0000 7f39db427700 1 -- 172.21.15.61:0/193562297 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39d416b380 con 0x7f39d4068510 2023-12-24T20:01:26.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.940+0000 7f39c97fa700 1 -- 172.21.15.61:0/193562297 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+12135 (secure 0 0 0) 0x7f39d416b380 con 0x7f39d4068510 2023-12-24T20:01:26.941 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:26.941 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":95,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:01:26.156150+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 -- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b8066f30 msgr2=0x7f39b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b8066f30 0x7f39b80693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f39c4009160 tx=0x7f39c4016000 comp rx=0 tx=0).stop 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 -- 172.21.15.61:0/193562297 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068510 msgr2=0x7f39d4156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068510 0x7f39d4156db0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c7e0 tx=0x7f39d0007df0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 -- 172.21.15.61:0/193562297 shutdown_connections 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39d4159a60 0x7f39d4151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b8066f30 0x7f39b80693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39d4068140 0x7f39d416aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 --2- 172.21.15.61:0/193562297 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39d4068510 0x7f39d4156db0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 -- 172.21.15.61:0/193562297 >> 172.21.15.61:0/193562297 conn(0x7f39d4097a10 msgr2=0x7f39d406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 -- 172.21.15.61:0/193562297 shutdown_connections 2023-12-24T20:01:26.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:26.942+0000 7f39db427700 1 -- 172.21.15.61:0/193562297 wait complete. 2023-12-24T20:01:26.955 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T20:01:26.955 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:01:27.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.080+0000 7f3abc977700 1 Processor -- start 2023-12-24T20:01:27.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.080+0000 7f3abc977700 1 -- start start 2023-12-24T20:01:27.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3abc977700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3ab81578d0 0x7f3ab80af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3abc977700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3ab806f6e0 0x7f3ab806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3abc977700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab80caf30 con 0x7f3ab806b150 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3abc977700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab806b590 con 0x7f3ab81578d0 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3abc977700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab80af9f0 con 0x7f3ab806f6e0 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3ab6d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3ab806b150 0x7f3ab806c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42038/0 (socket says 172.21.15.61:42038) 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3ab6d9d700 1 -- 172.21.15.61:0/3696197496 learned_addr learned my addr 172.21.15.61:0/3696197496 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3ab659c700 1 --2- 172.21.15.61:0/3696197496 >> v2:172.21.15.61:3300/0 conn(0x7f3ab81578d0 0x7f3ab80af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3ab5d9b700 1 --2- 172.21.15.61:0/3696197496 >> v2:172.21.15.133:3300/0 conn(0x7f3ab806f6e0 0x7f3ab806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3ab559a700 1 -- 172.21.15.61:0/3696197496 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596252888 0 0) 0x7f3ab80caf30 con 0x7f3ab806b150 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3ab559a700 1 -- 172.21.15.61:0/3696197496 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa0003570 con 0x7f3ab806b150 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3ab659c700 1 -- 172.21.15.61:0/3696197496 >> v2:172.21.15.133:3300/0 conn(0x7f3ab806f6e0 msgr2=0x7f3ab806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3ab659c700 1 --2- 172.21.15.61:0/3696197496 >> v2:172.21.15.133:3300/0 conn(0x7f3ab806f6e0 0x7f3ab806ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3ab659c700 1 -- 172.21.15.61:0/3696197496 >> v1:172.21.15.61:6789/0 conn(0x7f3ab806b150 legacy=0x7f3ab806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.081+0000 7f3ab659c700 1 -- 172.21.15.61:0/3696197496 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab80afcd0 con 0x7f3ab81578d0 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3ab659c700 1 --2- 172.21.15.61:0/3696197496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab81578d0 0x7f3ab80af330 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80c2210 tx=0x7f3aac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187914a888928cf6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3ab559a700 1 -- 172.21.15.61:0/3696197496 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011630 con 0x7f3ab81578d0 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3ab559a700 1 -- 172.21.15.61:0/3696197496 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac0117b0 con 0x7f3ab81578d0 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3ab559a700 1 -- 172.21.15.61:0/3696197496 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011b70 con 0x7f3ab81578d0 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3abc977700 1 -- 172.21.15.61:0/3696197496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab81578d0 msgr2=0x7f3ab80af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3abc977700 1 --2- 172.21.15.61:0/3696197496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab81578d0 0x7f3ab80af330 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80c2210 tx=0x7f3aac0091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3abc977700 1 -- 172.21.15.61:0/3696197496 shutdown_connections 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3abc977700 1 --2- 172.21.15.61:0/3696197496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab81578d0 0x7f3ab80af330 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3abc977700 1 --2- 172.21.15.61:0/3696197496 >> v2:172.21.15.133:3300/0 conn(0x7f3ab806f6e0 0x7f3ab806ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3abc977700 1 -- 172.21.15.61:0/3696197496 >> 172.21.15.61:0/3696197496 conn(0x7f3ab80ce800 msgr2=0x7f3ab80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3abc977700 1 -- 172.21.15.61:0/3696197496 shutdown_connections 2023-12-24T20:01:27.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.082+0000 7f3abc977700 1 -- 172.21.15.61:0/3696197496 wait complete. 2023-12-24T20:01:27.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.083+0000 7f3abc977700 1 Processor -- start 2023-12-24T20:01:27.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.083+0000 7f3abc977700 1 -- start start 2023-12-24T20:01:27.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3abc977700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ab806b150 0x7f3ab8154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3abc977700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab806f6e0 0x7f3ab815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3abc977700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab81578d0 0x7f3ab815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3abc977700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80c2ef0 con 0x7f3ab806f6e0 2023-12-24T20:01:27.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3abc977700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80c22e0 con 0x7f3ab81578d0 2023-12-24T20:01:27.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3abc977700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80c25c0 con 0x7f3ab806b150 2023-12-24T20:01:27.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3ab5d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab806f6e0 0x7f3ab815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3ab5d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab806f6e0 0x7f3ab815bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50048/0 (socket says 172.21.15.61:50048) 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3ab5d9b700 1 -- 172.21.15.61:0/3280228035 learned_addr learned my addr 172.21.15.61:0/3280228035 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3ab6d9d700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab81578d0 0x7f3ab815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.084+0000 7f3ab659c700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ab806b150 0x7f3ab8154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3ab5d9b700 1 -- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ab806b150 msgr2=0x7f3ab8154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3ab5d9b700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ab806b150 0x7f3ab8154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3ab5d9b700 1 -- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab81578d0 msgr2=0x7f3ab815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3ab5d9b700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab81578d0 0x7f3ab815c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3ab5d9b700 1 -- 172.21.15.61:0/3280228035 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac009420 con 0x7f3ab806f6e0 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3ab5d9b700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab806f6e0 0x7f3ab815bdc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800ec80 tx=0x7f3aa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3aa67fc700 1 -- 172.21.15.61:0/3280228035 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800c9d0 con 0x7f3ab806f6e0 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3aa67fc700 1 -- 172.21.15.61:0/3280228035 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800cb30 con 0x7f3ab806f6e0 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3abc977700 1 -- 172.21.15.61:0/3280228035 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab80c28a0 con 0x7f3ab806f6e0 2023-12-24T20:01:27.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3aa67fc700 1 -- 172.21.15.61:0/3280228035 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8013470 con 0x7f3ab806f6e0 2023-12-24T20:01:27.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.085+0000 7f3abc977700 1 -- 172.21.15.61:0/3280228035 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab8155420 con 0x7f3ab806f6e0 2023-12-24T20:01:27.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.086+0000 7f3abc977700 1 -- 172.21.15.61:0/3280228035 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab804c3c0 con 0x7f3ab806f6e0 2023-12-24T20:01:27.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.086+0000 7f3aa67fc700 1 -- 172.21.15.61:0/3280228035 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3aa8013820 con 0x7f3ab806f6e0 2023-12-24T20:01:27.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.087+0000 7f3aa67fc700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a98066f30 0x7f3a980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.087+0000 7f3aa67fc700 1 -- 172.21.15.61:0/3280228035 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3aa80845d0 con 0x7f3ab806f6e0 2023-12-24T20:01:27.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.087+0000 7f3ab659c700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a98066f30 0x7f3a980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.087+0000 7f3ab659c700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a98066f30 0x7f3a980693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80c2210 tx=0x7f3aac017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:27.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.091+0000 7f3aa67fc700 1 -- 172.21.15.61:0/3280228035 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3aa8051b90 con 0x7f3ab806f6e0 2023-12-24T20:01:27.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.289+0000 7f3abc977700 1 -- 172.21.15.61:0/3280228035 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ab80affb0 con 0x7f3ab806f6e0 2023-12-24T20:01:27.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.290+0000 7f3aa67fc700 1 -- 172.21.15.61:0/3280228035 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3aa80551b0 con 0x7f3ab806f6e0 2023-12-24T20:01:27.290 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:01:27.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 -- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a98066f30 msgr2=0x7f3a980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a98066f30 0x7f3a980693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80c2210 tx=0x7f3aac017000 comp rx=0 tx=0).stop 2023-12-24T20:01:27.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 -- 172.21.15.61:0/3280228035 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab806f6e0 msgr2=0x7f3ab815bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab806f6e0 0x7f3ab815bdc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800ec80 tx=0x7f3aa80091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 -- 172.21.15.61:0/3280228035 shutdown_connections 2023-12-24T20:01:27.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ab806b150 0x7f3ab8154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a98066f30 0x7f3a980693e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ab81578d0 0x7f3ab815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 --2- 172.21.15.61:0/3280228035 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ab806f6e0 0x7f3ab815bdc0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 -- 172.21.15.61:0/3280228035 >> 172.21.15.61:0/3280228035 conn(0x7f3ab80ce800 msgr2=0x7f3ab8156e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:27.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 -- 172.21.15.61:0/3280228035 shutdown_connections 2023-12-24T20:01:27.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.292+0000 7f3abc977700 1 -- 172.21.15.61:0/3280228035 wait complete. 2023-12-24T20:01:27.304 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T20:01:27.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.425+0000 7fe0131b7700 1 Processor -- start 2023-12-24T20:01:27.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.425+0000 7fe0131b7700 1 -- start start 2023-12-24T20:01:27.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.426+0000 7fe0131b7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c159b00 0x7fe00c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.426+0000 7fe0131b7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe00c0af7d0 0x7fe00c0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.426+0000 7fe0131b7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00c0a84d0 con 0x7fe00c070640 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.426+0000 7fe0131b7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c0b0180 con 0x7fe00c0af7d0 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.426+0000 7fe0131b7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0a7620 con 0x7fe00c159b00 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.426+0000 7fe00bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe00c0af7d0 0x7fe00c0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.426+0000 7fe00bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe00c0af7d0 0x7fe00c0afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50050/0 (socket says 172.21.15.61:50050) 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.426+0000 7fe00bfff700 1 -- 172.21.15.61:0/1481001343 learned_addr learned my addr 172.21.15.61:0/1481001343 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe010f53700 1 --2- 172.21.15.61:0/1481001343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c159b00 0x7fe00c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe00bfff700 1 -- 172.21.15.61:0/1481001343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c159b00 msgr2=0x7fe00c067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe00bfff700 1 --2- 172.21.15.61:0/1481001343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c159b00 0x7fe00c067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe00bfff700 1 -- 172.21.15.61:0/1481001343 >> v1:172.21.15.133:6789/0 conn(0x7fe00c070640 legacy=0x7fe00c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe00bfff700 1 -- 172.21.15.61:0/1481001343 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c0a78c0 con 0x7fe00c0af7d0 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe010f53700 1 --2- 172.21.15.61:0/1481001343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c159b00 0x7fe00c067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe00bfff700 1 --2- 172.21.15.61:0/1481001343 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c0af7d0 0x7fe00c0afc40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fdff80099b0 tx=0x7fdff8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae57340f84dbbb00 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe00b7fe700 1 -- 172.21.15.61:0/1481001343 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800b820 con 0x7fe00c0af7d0 2023-12-24T20:01:27.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe00b7fe700 1 -- 172.21.15.61:0/1481001343 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff800b980 con 0x7fe00c0af7d0 2023-12-24T20:01:27.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe00b7fe700 1 -- 172.21.15.61:0/1481001343 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800bd20 con 0x7fe00c0af7d0 2023-12-24T20:01:27.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe0131b7700 1 -- 172.21.15.61:0/1481001343 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c0af7d0 msgr2=0x7fe00c0afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.427+0000 7fe0131b7700 1 --2- 172.21.15.61:0/1481001343 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c0af7d0 0x7fe00c0afc40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fdff80099b0 tx=0x7fdff8009250 comp rx=0 tx=0).stop 2023-12-24T20:01:27.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.428+0000 7fe0131b7700 1 -- 172.21.15.61:0/1481001343 shutdown_connections 2023-12-24T20:01:27.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.428+0000 7fe0131b7700 1 --2- 172.21.15.61:0/1481001343 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c159b00 0x7fe00c067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.428+0000 7fe0131b7700 1 --2- 172.21.15.61:0/1481001343 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c0af7d0 0x7fe00c0afc40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.428+0000 7fe0131b7700 1 -- 172.21.15.61:0/1481001343 >> 172.21.15.61:0/1481001343 conn(0x7fe00c0ca200 msgr2=0x7fe00c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:27.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.428+0000 7fe0131b7700 1 -- 172.21.15.61:0/1481001343 shutdown_connections 2023-12-24T20:01:27.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.428+0000 7fe0131b7700 1 -- 172.21.15.61:0/1481001343 wait complete. 2023-12-24T20:01:27.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.429+0000 7fe0131b7700 1 Processor -- start 2023-12-24T20:01:27.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.429+0000 7fe0131b7700 1 -- start start 2023-12-24T20:01:27.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.429+0000 7fe0131b7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c070640 0x7fe00c148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe0131b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe00c0af7d0 0x7fe00c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe0131b7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c159b00 0x7fe00c0ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe0131b7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0cba70 con 0x7fe00c159b00 2023-12-24T20:01:27.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe0131b7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c149360 con 0x7fe00c0af7d0 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe0131b7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c15ca60 con 0x7fe00c070640 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe011754700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c159b00 0x7fe00c0ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe011754700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c159b00 0x7fe00c0ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50062/0 (socket says 172.21.15.61:50062) 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe011754700 1 -- 172.21.15.61:0/1107072385 learned_addr learned my addr 172.21.15.61:0/1107072385 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe00bfff700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe00c0af7d0 0x7fe00c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe010f53700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c070640 0x7fe00c148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe011754700 1 -- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c070640 msgr2=0x7fe00c148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe011754700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c070640 0x7fe00c148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe011754700 1 -- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe00c0af7d0 msgr2=0x7fe00c15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe011754700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe00c0af7d0 0x7fe00c15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe011754700 1 -- 172.21.15.61:0/1107072385 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff80094f0 con 0x7fe00c159b00 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe011754700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c159b00 0x7fe00c0ae1a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe00400c960 tx=0x7fe0040026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe008ff9700 1 -- 172.21.15.61:0/1107072385 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00400cea0 con 0x7fe00c159b00 2023-12-24T20:01:27.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe008ff9700 1 -- 172.21.15.61:0/1107072385 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00400a7a0 con 0x7fe00c159b00 2023-12-24T20:01:27.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe0131b7700 1 -- 172.21.15.61:0/1107072385 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c15c1c0 con 0x7fe00c159b00 2023-12-24T20:01:27.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe008ff9700 1 -- 172.21.15.61:0/1107072385 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00400ab60 con 0x7fe00c159b00 2023-12-24T20:01:27.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.430+0000 7fe0131b7700 1 -- 172.21.15.61:0/1107072385 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c15c780 con 0x7fe00c159b00 2023-12-24T20:01:27.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.431+0000 7fe0131b7700 1 -- 172.21.15.61:0/1107072385 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c0cbbe0 con 0x7fe00c159b00 2023-12-24T20:01:27.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.432+0000 7fe008ff9700 1 -- 172.21.15.61:0/1107072385 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe004012420 con 0x7fe00c159b00 2023-12-24T20:01:27.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.432+0000 7fe008ff9700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdff0066f30 0x7fdff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.432+0000 7fe008ff9700 1 -- 172.21.15.61:0/1107072385 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe0040846a0 con 0x7fe00c159b00 2023-12-24T20:01:27.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.432+0000 7fe010f53700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdff0066f30 0x7fdff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.433+0000 7fe010f53700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdff0066f30 0x7fdff00693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe000006fd0 tx=0x7fe000008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:27.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.437+0000 7fe008ff9700 1 -- 172.21.15.61:0/1107072385 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe004051bc0 con 0x7fe00c159b00 2023-12-24T20:01:27.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.634+0000 7fe0131b7700 1 -- 172.21.15.61:0/1107072385 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe00c04c3c0 con 0x7fe00c159b00 2023-12-24T20:01:27.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.634+0000 7fe008ff9700 1 -- 172.21.15.61:0/1107072385 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v95) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe0040551e0 con 0x7fe00c159b00 2023-12-24T20:01:27.635 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T20:01:27.635 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:27.635 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T20:01:27.635 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T20:01:27.635 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T20:01:27.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 -- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdff0066f30 msgr2=0x7fdff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdff0066f30 0x7fdff00693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe000006fd0 tx=0x7fe000008040 comp rx=0 tx=0).stop 2023-12-24T20:01:27.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 -- 172.21.15.61:0/1107072385 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c159b00 msgr2=0x7fe00c0ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c159b00 0x7fe00c0ae1a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe00400c960 tx=0x7fe0040026e0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 -- 172.21.15.61:0/1107072385 shutdown_connections 2023-12-24T20:01:27.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe00c070640 0x7fe00c148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdff0066f30 0x7fdff00693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe00c159b00 0x7fe00c0ae1a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 --2- 172.21.15.61:0/1107072385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe00c0af7d0 0x7fe00c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 -- 172.21.15.61:0/1107072385 >> 172.21.15.61:0/1107072385 conn(0x7fe00c0ca200 msgr2=0x7fe00c06e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:27.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 -- 172.21.15.61:0/1107072385 shutdown_connections 2023-12-24T20:01:27.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.636+0000 7fe0131b7700 1 -- 172.21.15.61:0/1107072385 wait complete. 2023-12-24T20:01:27.649 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T20:01:27.649 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T20:01:27.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.775+0000 7f1e2c8ad700 1 Processor -- start 2023-12-24T20:01:27.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.775+0000 7f1e2c8ad700 1 -- start start 2023-12-24T20:01:27.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.776+0000 7f1e2c8ad700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1e2806f940 0x7f1e28159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.776+0000 7f1e2c8ad700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e28068b30 0x7f1e28068f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.776+0000 7f1e2c8ad700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e280694d0 con 0x7f1e28159980 2023-12-24T20:01:27.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.776+0000 7f1e2c8ad700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e28068620 con 0x7f1e2806f940 2023-12-24T20:01:27.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.776+0000 7f1e2c8ad700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280ca4e0 con 0x7f1e28068b30 2023-12-24T20:01:27.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.776+0000 7f1e25d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1e2806f940 0x7f1e28159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.776+0000 7f1e25d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1e2806f940 0x7f1e28159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50072/0 (socket says 172.21.15.61:50072) 2023-12-24T20:01:27.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.776+0000 7f1e25d9b700 1 -- 172.21.15.61:0/615176169 learned_addr learned my addr 172.21.15.61:0/615176169 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:27.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.777+0000 7f1e26d9d700 1 --2- 172.21.15.61:0/615176169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e28068b30 0x7f1e28068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.777+0000 7f1e25d9b700 1 -- 172.21.15.61:0/615176169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e28068b30 msgr2=0x7f1e28068f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.777+0000 7f1e25d9b700 1 --2- 172.21.15.61:0/615176169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e28068b30 0x7f1e28068f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.777+0000 7f1e25d9b700 1 -- 172.21.15.61:0/615176169 >> v1:172.21.15.133:6789/0 conn(0x7f1e28159980 legacy=0x7f1e28067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.777+0000 7f1e25d9b700 1 -- 172.21.15.61:0/615176169 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e280ca1b0 con 0x7f1e2806f940 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.777+0000 7f1e25d9b700 1 --2- 172.21.15.61:0/615176169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e2806f940 0x7f1e28159d50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1e100099b0 tx=0x7f1e10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1697b3e728e9d03f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.777+0000 7f1e2559a700 1 -- 172.21.15.61:0/615176169 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1000b820 con 0x7f1e2806f940 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.777+0000 7f1e2559a700 1 -- 172.21.15.61:0/615176169 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1000b980 con 0x7f1e2806f940 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.777+0000 7f1e2559a700 1 -- 172.21.15.61:0/615176169 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1000bd20 con 0x7f1e2806f940 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.778+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/615176169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e2806f940 msgr2=0x7f1e28159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.778+0000 7f1e2c8ad700 1 --2- 172.21.15.61:0/615176169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e2806f940 0x7f1e28159d50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1e100099b0 tx=0x7f1e10009250 comp rx=0 tx=0).stop 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.778+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/615176169 shutdown_connections 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.778+0000 7f1e2c8ad700 1 --2- 172.21.15.61:0/615176169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e28068b30 0x7f1e28068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.778+0000 7f1e2c8ad700 1 --2- 172.21.15.61:0/615176169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e2806f940 0x7f1e28159d50 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.778+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/615176169 >> 172.21.15.61:0/615176169 conn(0x7f1e28069760 msgr2=0x7f1e28069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:27.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.778+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/615176169 shutdown_connections 2023-12-24T20:01:27.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.778+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/615176169 wait complete. 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.779+0000 7f1e2c8ad700 1 Processor -- start 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.779+0000 7f1e2c8ad700 1 -- start start 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2c8ad700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e28068b30 0x7f1e280b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2c8ad700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e2806f940 0x7f1e281580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2c8ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e28159980 0x7f1e280ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2c8ad700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280aaef0 con 0x7f1e28068b30 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2c8ad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e28158600 con 0x7f1e28159980 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2c8ad700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e280b1ad0 con 0x7f1e2806f940 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e28068b30 0x7f1e280b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e28068b30 0x7f1e280b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50088/0 (socket says 172.21.15.61:50088) 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2659c700 1 -- 172.21.15.61:0/4021679759 learned_addr learned my addr 172.21.15.61:0/4021679759 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e25d9b700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e2806f940 0x7f1e281580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e26d9d700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e28159980 0x7f1e280ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2659c700 1 -- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e2806f940 msgr2=0x7f1e281580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2659c700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e2806f940 0x7f1e281580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2659c700 1 -- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e28159980 msgr2=0x7f1e280ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2659c700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e28159980 0x7f1e280ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2659c700 1 -- 172.21.15.61:0/4021679759 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e100094f0 con 0x7f1e28068b30 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2659c700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e28068b30 0x7f1e280b4130 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800b610 tx=0x7f1e18009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e1e7fc700 1 -- 172.21.15.61:0/4021679759 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1800f510 con 0x7f1e28068b30 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e1e7fc700 1 -- 172.21.15.61:0/4021679759 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1800f670 con 0x7f1e28068b30 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e1e7fc700 1 -- 172.21.15.61:0/4021679759 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1800fa30 con 0x7f1e28068b30 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/4021679759 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e280ab7b0 con 0x7f1e28068b30 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.780+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/4021679759 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e280aac10 con 0x7f1e28068b30 2023-12-24T20:01:27.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.781+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/4021679759 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2804c3c0 con 0x7f1e28068b30 2023-12-24T20:01:27.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.782+0000 7f1e1e7fc700 1 -- 172.21.15.61:0/4021679759 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1e1801a400 con 0x7f1e28068b30 2023-12-24T20:01:27.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.782+0000 7f1e1e7fc700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e08066f30 0x7f1e080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:27.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.782+0000 7f1e1e7fc700 1 -- 172.21.15.61:0/4021679759 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1e18083c20 con 0x7f1e28068b30 2023-12-24T20:01:27.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.782+0000 7f1e25d9b700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e08066f30 0x7f1e080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:27.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.783+0000 7f1e25d9b700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e08066f30 0x7f1e080693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1e100099b0 tx=0x7f1e10016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:27.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.786+0000 7f1e1e7fc700 1 -- 172.21.15.61:0/4021679759 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e180511c0 con 0x7f1e28068b30 2023-12-24T20:01:27.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:27.983+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/4021679759 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1e28067d80 con 0x7f1e28068b30 2023-12-24T20:01:28.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.661+0000 7f1e1e7fc700 1 -- 172.21.15.61:0/4021679759 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v96) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1e180547e0 con 0x7f1e28068b30 2023-12-24T20:01:28.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.666+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e08066f30 msgr2=0x7f1e080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:28.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.666+0000 7f1e2c8ad700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e08066f30 0x7f1e080693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1e100099b0 tx=0x7f1e10016000 comp rx=0 tx=0).stop 2023-12-24T20:01:28.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.666+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/4021679759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e28068b30 msgr2=0x7f1e280b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:28.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.666+0000 7f1e2c8ad700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e28068b30 0x7f1e280b4130 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800b610 tx=0x7f1e18009120 comp rx=0 tx=0).stop 2023-12-24T20:01:28.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.667+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/4021679759 shutdown_connections 2023-12-24T20:01:28.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.667+0000 7f1e2c8ad700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e08066f30 0x7f1e080693e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:28.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.667+0000 7f1e2c8ad700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e28159980 0x7f1e280ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:28.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.667+0000 7f1e2c8ad700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e28068b30 0x7f1e280b4130 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:28.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.667+0000 7f1e2c8ad700 1 --2- 172.21.15.61:0/4021679759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e2806f940 0x7f1e281580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:28.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.667+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/4021679759 >> 172.21.15.61:0/4021679759 conn(0x7f1e28069760 msgr2=0x7f1e2815d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:28.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.667+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/4021679759 shutdown_connections 2023-12-24T20:01:28.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.667+0000 7f1e2c8ad700 1 -- 172.21.15.61:0/4021679759 wait complete. 2023-12-24T20:01:28.668 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T20:01:28.682 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T20:01:28.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.819+0000 7fb2649f7700 1 Processor -- start 2023-12-24T20:01:28.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.819+0000 7fb2649f7700 1 -- start start 2023-12-24T20:01:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.820+0000 7fb2649f7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb260159c60 0x7fb2600c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.820+0000 7fb2649f7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb26015a030 0x7fb260070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.820+0000 7fb2649f7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26006b190 con 0x7fb260068b10 2023-12-24T20:01:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.820+0000 7fb2649f7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26006a5c0 con 0x7fb260159c60 2023-12-24T20:01:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.820+0000 7fb2649f7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26006a860 con 0x7fb26015a030 2023-12-24T20:01:28.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.820+0000 7fb25e59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb260159c60 0x7fb2600c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.820+0000 7fb25e59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb260159c60 0x7fb2600c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50092/0 (socket says 172.21.15.61:50092) 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.820+0000 7fb25e59c700 1 -- 172.21.15.61:0/3747854608 learned_addr learned my addr 172.21.15.61:0/3747854608 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.821+0000 7fb25dd9b700 1 --2- 172.21.15.61:0/3747854608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb26015a030 0x7fb260070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.821+0000 7fb25e59c700 1 -- 172.21.15.61:0/3747854608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb26015a030 msgr2=0x7fb260070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.821+0000 7fb25e59c700 1 --2- 172.21.15.61:0/3747854608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb26015a030 0x7fb260070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.821+0000 7fb25e59c700 1 -- 172.21.15.61:0/3747854608 >> v1:172.21.15.133:6789/0 conn(0x7fb260068b10 legacy=0x7fb260067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.821+0000 7fb25e59c700 1 -- 172.21.15.61:0/3747854608 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26006ab40 con 0x7fb260159c60 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.821+0000 7fb25dd9b700 1 --2- 172.21.15.61:0/3747854608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb26015a030 0x7fb260070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.821+0000 7fb25e59c700 1 --2- 172.21.15.61:0/3747854608 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 0x7fb2600c4000 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb2540099b0 tx=0x7fb254009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a1bf8783c5673d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.821+0000 7fb25d59a700 1 -- 172.21.15.61:0/3747854608 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400b820 con 0x7fb260159c60 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.821+0000 7fb25d59a700 1 -- 172.21.15.61:0/3747854608 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25400b980 con 0x7fb260159c60 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.821+0000 7fb25d59a700 1 -- 172.21.15.61:0/3747854608 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400bd20 con 0x7fb260159c60 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.822+0000 7fb2649f7700 1 -- 172.21.15.61:0/3747854608 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 msgr2=0x7fb2600c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.822+0000 7fb2649f7700 1 --2- 172.21.15.61:0/3747854608 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 0x7fb2600c4000 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb2540099b0 tx=0x7fb254009250 comp rx=0 tx=0).stop 2023-12-24T20:01:28.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.822+0000 7fb2649f7700 1 -- 172.21.15.61:0/3747854608 shutdown_connections 2023-12-24T20:01:28.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.822+0000 7fb2649f7700 1 --2- 172.21.15.61:0/3747854608 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 0x7fb2600c4000 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:28.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.822+0000 7fb2649f7700 1 --2- 172.21.15.61:0/3747854608 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb26015a030 0x7fb260070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:28.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.822+0000 7fb2649f7700 1 -- 172.21.15.61:0/3747854608 >> 172.21.15.61:0/3747854608 conn(0x7fb2600ce420 msgr2=0x7fb2600ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:28.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.822+0000 7fb2649f7700 1 -- 172.21.15.61:0/3747854608 shutdown_connections 2023-12-24T20:01:28.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.822+0000 7fb2649f7700 1 -- 172.21.15.61:0/3747854608 wait complete. 2023-12-24T20:01:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.823+0000 7fb2649f7700 1 Processor -- start 2023-12-24T20:01:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.823+0000 7fb2649f7700 1 -- start start 2023-12-24T20:01:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb2649f7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb260068b10 0x7fb260158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb2649f7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 0x7fb26015fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb2649f7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26015a030 0x7fb260067bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb2649f7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26015a650 con 0x7fb260159c60 2023-12-24T20:01:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb2649f7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26015f370 con 0x7fb26015a030 2023-12-24T20:01:28.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb2649f7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26015ead0 con 0x7fb260068b10 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 0x7fb26015fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 0x7fb26015fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50102/0 (socket says 172.21.15.61:50102) 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25dd9b700 1 -- 172.21.15.61:0/3281988094 learned_addr learned my addr 172.21.15.61:0/3281988094 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25ed9d700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26015a030 0x7fb260067bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25e59c700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb260068b10 0x7fb260158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25dd9b700 1 -- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb260068b10 msgr2=0x7fb260158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25dd9b700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb260068b10 0x7fb260158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25dd9b700 1 -- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26015a030 msgr2=0x7fb260067bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25dd9b700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26015a030 0x7fb260067bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25dd9b700 1 -- 172.21.15.61:0/3281988094 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2540094f0 con 0x7fb260159c60 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25ed9d700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26015a030 0x7fb260067bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb25dd9b700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 0x7fb26015fd30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c860 tx=0x7fb250008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb24e7fc700 1 -- 172.21.15.61:0/3281988094 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb250011600 con 0x7fb260159c60 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.824+0000 7fb24e7fc700 1 -- 172.21.15.61:0/3281988094 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb250011760 con 0x7fb260159c60 2023-12-24T20:01:28.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.825+0000 7fb2649f7700 1 -- 172.21.15.61:0/3281988094 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26015edb0 con 0x7fb260159c60 2023-12-24T20:01:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.825+0000 7fb24e7fc700 1 -- 172.21.15.61:0/3281988094 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb250011b20 con 0x7fb260159c60 2023-12-24T20:01:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.825+0000 7fb2649f7700 1 -- 172.21.15.61:0/3281988094 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb260159280 con 0x7fb260159c60 2023-12-24T20:01:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.825+0000 7fb2649f7700 1 -- 172.21.15.61:0/3281988094 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26015a420 con 0x7fb260159c60 2023-12-24T20:01:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.826+0000 7fb24e7fc700 1 -- 172.21.15.61:0/3281988094 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb2500193b0 con 0x7fb260159c60 2023-12-24T20:01:28.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.826+0000 7fb24e7fc700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb240066f30 0x7fb2400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:28.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.826+0000 7fb24e7fc700 1 -- 172.21.15.61:0/3281988094 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fb250084330 con 0x7fb260159c60 2023-12-24T20:01:28.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.827+0000 7fb25e59c700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb240066f30 0x7fb2400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:28.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.827+0000 7fb25e59c700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb240066f30 0x7fb2400693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb2540099b0 tx=0x7fb254016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:28.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:28.831+0000 7fb24e7fc700 1 -- 172.21.15.61:0/3281988094 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb26015a420 con 0x7fb260159c60 2023-12-24T20:01:29.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.031+0000 7fb2649f7700 1 -- 172.21.15.61:0/3281988094 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb26015a420 con 0x7fb260159c60 2023-12-24T20:01:29.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.665+0000 7fb24e7fc700 1 -- 172.21.15.61:0/3281988094 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v97) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb250055210 con 0x7fb260159c60 2023-12-24T20:01:29.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.671+0000 7fb2649f7700 1 -- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb240066f30 msgr2=0x7fb2400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:29.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.671+0000 7fb2649f7700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb240066f30 0x7fb2400693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb2540099b0 tx=0x7fb254016000 comp rx=0 tx=0).stop 2023-12-24T20:01:29.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.671+0000 7fb2649f7700 1 -- 172.21.15.61:0/3281988094 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 msgr2=0x7fb26015fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:29.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.671+0000 7fb2649f7700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 0x7fb26015fd30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c860 tx=0x7fb250008040 comp rx=0 tx=0).stop 2023-12-24T20:01:29.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.674+0000 7fb2649f7700 1 -- 172.21.15.61:0/3281988094 shutdown_connections 2023-12-24T20:01:29.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.674+0000 7fb2649f7700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb260068b10 0x7fb260158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:29.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.674+0000 7fb2649f7700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb240066f30 0x7fb2400693e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:29.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.674+0000 7fb2649f7700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb26015a030 0x7fb260067bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:29.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.674+0000 7fb2649f7700 1 --2- 172.21.15.61:0/3281988094 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb260159c60 0x7fb26015fd30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:29.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.674+0000 7fb2649f7700 1 -- 172.21.15.61:0/3281988094 >> 172.21.15.61:0/3281988094 conn(0x7fb2600ce420 msgr2=0x7fb2600c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.676+0000 7fb2649f7700 1 -- 172.21.15.61:0/3281988094 shutdown_connections 2023-12-24T20:01:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.676+0000 7fb2649f7700 1 -- 172.21.15.61:0/3281988094 wait complete. 2023-12-24T20:01:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T20:01:29.692 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T20:01:29.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.819+0000 7fb83a910700 1 Processor -- start 2023-12-24T20:01:29.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.819+0000 7fb83a910700 1 -- start start 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb83a910700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 0x7fb8340af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb83a910700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb8340c9050 0x7fb834067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb83a910700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83406b080 con 0x7fb83415a940 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb83a910700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8340b00f0 con 0x7fb8340c9050 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb83a910700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83415b4c0 con 0x7fb8341580a0 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb838ead700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb8340c9050 0x7fb834067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb838ead700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb8340c9050 0x7fb834067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50116/0 (socket says 172.21.15.61:50116) 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb838ead700 1 -- 172.21.15.61:0/2668515900 learned_addr learned my addr 172.21.15.61:0/2668515900 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb833fff700 1 --2- 172.21.15.61:0/2668515900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 0x7fb8340af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb838ead700 1 -- 172.21.15.61:0/2668515900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 msgr2=0x7fb8340af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb838ead700 1 --2- 172.21.15.61:0/2668515900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 0x7fb8340af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb838ead700 1 -- 172.21.15.61:0/2668515900 >> v1:172.21.15.133:6789/0 conn(0x7fb83415a940 legacy=0x7fb83415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:29.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb838ead700 1 -- 172.21.15.61:0/2668515900 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83415b720 con 0x7fb8340c9050 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.820+0000 7fb833fff700 1 --2- 172.21.15.61:0/2668515900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 0x7fb8340af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb838ead700 1 --2- 172.21.15.61:0/2668515900 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 0x7fb834067550 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009f20 tx=0x7fb82c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba195bc0454ad33a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb832ffd700 1 -- 172.21.15.61:0/2668515900 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c00e070 con 0x7fb8340c9050 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb832ffd700 1 -- 172.21.15.61:0/2668515900 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c00ba80 con 0x7fb8340c9050 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb832ffd700 1 -- 172.21.15.61:0/2668515900 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c0092e0 con 0x7fb8340c9050 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb83a910700 1 -- 172.21.15.61:0/2668515900 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 msgr2=0x7fb834067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb83a910700 1 --2- 172.21.15.61:0/2668515900 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 0x7fb834067550 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009f20 tx=0x7fb82c009840 comp rx=0 tx=0).stop 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb83a910700 1 -- 172.21.15.61:0/2668515900 shutdown_connections 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb83a910700 1 --2- 172.21.15.61:0/2668515900 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 0x7fb834067550 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb83a910700 1 --2- 172.21.15.61:0/2668515900 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 0x7fb8340af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb83a910700 1 -- 172.21.15.61:0/2668515900 >> 172.21.15.61:0/2668515900 conn(0x7fb8340ce400 msgr2=0x7fb8340ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb83a910700 1 -- 172.21.15.61:0/2668515900 shutdown_connections 2023-12-24T20:01:29.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.821+0000 7fb83a910700 1 -- 172.21.15.61:0/2668515900 wait complete. 2023-12-24T20:01:29.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.823+0000 7fb83a910700 1 Processor -- start 2023-12-24T20:01:29.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.823+0000 7fb83a910700 1 -- start start 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb83a910700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 0x7fb8340c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb83a910700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 0x7fb8340a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb83a910700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83415a940 0x7fb8340c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb83a910700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340a6ad0 con 0x7fb8340c9050 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb83a910700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340c7880 con 0x7fb83415a940 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb83a910700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340c71a0 con 0x7fb8341580a0 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb833fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 0x7fb8340c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb833fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 0x7fb8340c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50132/0 (socket says 172.21.15.61:50132) 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb833fff700 1 -- 172.21.15.61:0/146005776 learned_addr learned my addr 172.21.15.61:0/146005776 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb838ead700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83415a940 0x7fb8340c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.824+0000 7fb8337fe700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 0x7fb8340a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb833fff700 1 -- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 msgr2=0x7fb8340a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb833fff700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 0x7fb8340a6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:29.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb833fff700 1 -- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83415a940 msgr2=0x7fb8340c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:29.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb833fff700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83415a940 0x7fb8340c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:29.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb833fff700 1 -- 172.21.15.61:0/146005776 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c009ae0 con 0x7fb8340c9050 2023-12-24T20:01:29.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb833fff700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 0x7fb8340c6c60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00e900 tx=0x7fb81c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:29.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb82bfff700 1 -- 172.21.15.61:0/146005776 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c013410 con 0x7fb8340c9050 2023-12-24T20:01:29.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb82bfff700 1 -- 172.21.15.61:0/146005776 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c013570 con 0x7fb8340c9050 2023-12-24T20:01:29.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb83a910700 1 -- 172.21.15.61:0/146005776 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb834155000 con 0x7fb8340c9050 2023-12-24T20:01:29.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb82bfff700 1 -- 172.21.15.61:0/146005776 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c013910 con 0x7fb8340c9050 2023-12-24T20:01:29.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.825+0000 7fb83a910700 1 -- 172.21.15.61:0/146005776 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8341555c0 con 0x7fb8340c9050 2023-12-24T20:01:29.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.826+0000 7fb83a910700 1 -- 172.21.15.61:0/146005776 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83404c3c0 con 0x7fb8340c9050 2023-12-24T20:01:29.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.827+0000 7fb82bfff700 1 -- 172.21.15.61:0/146005776 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb81c013d00 con 0x7fb8340c9050 2023-12-24T20:01:29.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.827+0000 7fb82bfff700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb814066f30 0x7fb8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:29.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.827+0000 7fb82bfff700 1 -- 172.21.15.61:0/146005776 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fb81c084210 con 0x7fb8340c9050 2023-12-24T20:01:29.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.827+0000 7fb8337fe700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb814066f30 0x7fb8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:29.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.828+0000 7fb8337fe700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb814066f30 0x7fb8140693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb8340b3410 tx=0x7fb824009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:29.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:29.832+0000 7fb82bfff700 1 -- 172.21.15.61:0/146005776 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb81c054f70 con 0x7fb8340c9050 2023-12-24T20:01:30.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.070+0000 7fb83a910700 1 -- 172.21.15.61:0/146005776 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb8340b37a0 con 0x7fb8340c9050 2023-12-24T20:01:30.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.695+0000 7fb82bfff700 1 -- 172.21.15.61:0/146005776 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v48) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb81c054b00 con 0x7fb8340c9050 2023-12-24T20:01:30.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.700+0000 7fb83a910700 1 -- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb814066f30 msgr2=0x7fb8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:30.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.700+0000 7fb83a910700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb814066f30 0x7fb8140693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb8340b3410 tx=0x7fb824009040 comp rx=0 tx=0).stop 2023-12-24T20:01:30.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.700+0000 7fb83a910700 1 -- 172.21.15.61:0/146005776 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 msgr2=0x7fb8340c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:30.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.700+0000 7fb83a910700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 0x7fb8340c6c60 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00e900 tx=0x7fb81c008040 comp rx=0 tx=0).stop 2023-12-24T20:01:30.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.700+0000 7fb83a910700 1 -- 172.21.15.61:0/146005776 shutdown_connections 2023-12-24T20:01:30.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.700+0000 7fb83a910700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb814066f30 0x7fb8140693e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:30.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.700+0000 7fb83a910700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83415a940 0x7fb8340c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:30.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.700+0000 7fb83a910700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb8340c9050 0x7fb8340c6c60 secure :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb81c00e900 tx=0x7fb81c008040 comp rx=0 tx=0).stop 2023-12-24T20:01:30.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.700+0000 7fb83a910700 1 --2- 172.21.15.61:0/146005776 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb8341580a0 0x7fb8340a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:30.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.700+0000 7fb83a910700 1 -- 172.21.15.61:0/146005776 >> 172.21.15.61:0/146005776 conn(0x7fb8340ce400 msgr2=0x7fb8340cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:30.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.702+0000 7fb83a910700 1 -- 172.21.15.61:0/146005776 shutdown_connections 2023-12-24T20:01:30.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.702+0000 7fb83a910700 1 -- 172.21.15.61:0/146005776 wait complete. 2023-12-24T20:01:30.705 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 12 and data pool 13 2023-12-24T20:01:30.718 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:01:30.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.844+0000 7fd5d62ed700 1 Processor -- start 2023-12-24T20:01:30.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.844+0000 7fd5d62ed700 1 -- start start 2023-12-24T20:01:30.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.845+0000 7fd5d62ed700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd5d00aaf90 0x7fd5d0159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:30.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.845+0000 7fd5d62ed700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d006a630 con 0x7fd5d006aac0 2023-12-24T20:01:30.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.845+0000 7fd5d62ed700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d0069d00 con 0x7fd5d0159850 2023-12-24T20:01:30.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.845+0000 7fd5d62ed700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d00cccf0 con 0x7fd5d00aaf90 2023-12-24T20:01:30.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.846+0000 7fd5d488a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd5d00aaf90 0x7fd5d0159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:30.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.846+0000 7fd5cf7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd5d006aac0 0x7fd5d00aa880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42052/0 (socket says 172.21.15.61:42052) 2023-12-24T20:01:30.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.846+0000 7fd5cf7fe700 1 -- 172.21.15.61:0/2445059257 learned_addr learned my addr 172.21.15.61:0/2445059257 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:30.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.846+0000 7fd5d488a700 1 -- 172.21.15.61:0/2445059257 >> v1:172.21.15.133:6789/0 conn(0x7fd5d0159850 legacy=0x7fd5d00cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:30.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.846+0000 7fd5d488a700 1 -- 172.21.15.61:0/2445059257 >> v1:172.21.15.61:6789/0 conn(0x7fd5d006aac0 legacy=0x7fd5d00aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:30.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.846+0000 7fd5d488a700 1 -- 172.21.15.61:0/2445059257 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0069fe0 con 0x7fd5d00aaf90 2023-12-24T20:01:30.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.846+0000 7fd5d488a700 1 --2- 172.21.15.61:0/2445059257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d00aaf90 0x7fd5d0159c20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009e60 tx=0x7fd5c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511410513427842d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:30.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.846+0000 7fd5ceffd700 1 -- 172.21.15.61:0/2445059257 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c800e070 con 0x7fd5d00aaf90 2023-12-24T20:01:30.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.846+0000 7fd5ceffd700 1 -- 172.21.15.61:0/2445059257 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c800bbf0 con 0x7fd5d00aaf90 2023-12-24T20:01:30.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.846+0000 7fd5ceffd700 1 -- 172.21.15.61:0/2445059257 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8012430 con 0x7fd5d00aaf90 2023-12-24T20:01:30.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.847+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2445059257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d00aaf90 msgr2=0x7fd5d0159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:30.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.847+0000 7fd5d62ed700 1 --2- 172.21.15.61:0/2445059257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d00aaf90 0x7fd5d0159c20 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009e60 tx=0x7fd5c8009780 comp rx=0 tx=0).stop 2023-12-24T20:01:30.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.847+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2445059257 shutdown_connections 2023-12-24T20:01:30.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.847+0000 7fd5d62ed700 1 --2- 172.21.15.61:0/2445059257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d00aaf90 0x7fd5d0159c20 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:30.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.847+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2445059257 >> 172.21.15.61:0/2445059257 conn(0x7fd5d00cceb0 msgr2=0x7fd5d00cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:30.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.847+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2445059257 shutdown_connections 2023-12-24T20:01:30.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.847+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2445059257 wait complete. 2023-12-24T20:01:30.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.848+0000 7fd5d62ed700 1 Processor -- start 2023-12-24T20:01:30.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.849+0000 7fd5d62ed700 1 -- start start 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.849+0000 7fd5d62ed700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d006aac0 0x7fd5d0155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.849+0000 7fd5d62ed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5d00aaf90 0x7fd5d00b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.849+0000 7fd5d62ed700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5d0159850 0x7fd5d015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5d62ed700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d015c450 con 0x7fd5d006aac0 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5d62ed700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d015a300 con 0x7fd5d00aaf90 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5d62ed700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d015a5e0 con 0x7fd5d0159850 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d006aac0 0x7fd5d0155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d006aac0 0x7fd5d0155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50146/0 (socket says 172.21.15.61:50146) 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cffff700 1 -- 172.21.15.61:0/2347111673 learned_addr learned my addr 172.21.15.61:0/2347111673 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cf7fe700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5d00aaf90 0x7fd5d00b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:30.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5d488a700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5d0159850 0x7fd5d015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cffff700 1 -- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5d0159850 msgr2=0x7fd5d015cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cffff700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5d0159850 0x7fd5d015cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cffff700 1 -- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5d00aaf90 msgr2=0x7fd5d00b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cffff700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5d00aaf90 0x7fd5d00b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cffff700 1 -- 172.21.15.61:0/2347111673 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c8009a20 con 0x7fd5d006aac0 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cf7fe700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5d00aaf90 0x7fd5d00b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5d488a700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5d0159850 0x7fd5d015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5cffff700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d006aac0 0x7fd5d0155ad0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000b5e0 tx=0x7fd5c0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5c7fff700 1 -- 172.21.15.61:0/2347111673 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000f510 con 0x7fd5d006aac0 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5c7fff700 1 -- 172.21.15.61:0/2347111673 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000f670 con 0x7fd5d006aac0 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2347111673 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d015c710 con 0x7fd5d006aac0 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5c7fff700 1 -- 172.21.15.61:0/2347111673 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000fa30 con 0x7fd5d006aac0 2023-12-24T20:01:30.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.850+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2347111673 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d015b680 con 0x7fd5d006aac0 2023-12-24T20:01:30.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.851+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2347111673 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d015ca80 con 0x7fd5d006aac0 2023-12-24T20:01:30.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.852+0000 7fd5c7fff700 1 -- 172.21.15.61:0/2347111673 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd5c001a400 con 0x7fd5d006aac0 2023-12-24T20:01:30.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.852+0000 7fd5c7fff700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5b0066f30 0x7fd5b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:30.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.852+0000 7fd5c7fff700 1 -- 172.21.15.61:0/2347111673 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5c0084100 con 0x7fd5d006aac0 2023-12-24T20:01:30.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.852+0000 7fd5cf7fe700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5b0066f30 0x7fd5b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:30.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.853+0000 7fd5cf7fe700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5b0066f30 0x7fd5b00693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd5d006edf0 tx=0x7fd5b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:30.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:30.856+0000 7fd5c7fff700 1 -- 172.21.15.61:0/2347111673 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5c00513f0 con 0x7fd5d006aac0 2023-12-24T20:01:31.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.054+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2347111673 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5d004c3c0 con 0x7fd5d006aac0 2023-12-24T20:01:31.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.055+0000 7fd5c7fff700 1 -- 172.21.15.61:0/2347111673 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+15366 (secure 0 0 0) 0x7fd5c0054a10 con 0x7fd5d006aac0 2023-12-24T20:01:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:31.056 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":98,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:01:30.071892+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:01:28.014512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-24T20:01:29.062088+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:01:31.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5b0066f30 msgr2=0x7fd5b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5b0066f30 0x7fd5b00693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd5d006edf0 tx=0x7fd5b8009040 comp rx=0 tx=0).stop 2023-12-24T20:01:31.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2347111673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d006aac0 msgr2=0x7fd5d0155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d006aac0 0x7fd5d0155ad0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000b5e0 tx=0x7fd5c0009120 comp rx=0 tx=0).stop 2023-12-24T20:01:31.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2347111673 shutdown_connections 2023-12-24T20:01:31.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd5d0159850 0x7fd5d015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd5b0066f30 0x7fd5b00693e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5d006aac0 0x7fd5d0155ad0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 --2- 172.21.15.61:0/2347111673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5d00aaf90 0x7fd5d00b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2347111673 >> 172.21.15.61:0/2347111673 conn(0x7fd5d00cceb0 msgr2=0x7fd5d00c1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:31.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2347111673 shutdown_connections 2023-12-24T20:01:31.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.057+0000 7fd5d62ed700 1 -- 172.21.15.61:0/2347111673 wait complete. 2023-12-24T20:01:31.071 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:01:31.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.191+0000 7f4ac6464700 1 Processor -- start 2023-12-24T20:01:31.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.191+0000 7f4ac6464700 1 -- start start 2023-12-24T20:01:31.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4ac6464700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ac006b260 0x7f4ac015c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4ac6464700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4ac0070640 0x7f4ac0070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4ac6464700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac015bcd0 con 0x7f4ac006b630 2023-12-24T20:01:31.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4ac6464700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac00cafb0 con 0x7f4ac0070640 2023-12-24T20:01:31.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4ac6464700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac0070f80 con 0x7f4ac006b260 2023-12-24T20:01:31.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4abf7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4ac006b630 0x7f4ac0067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42054/0 (socket says 172.21.15.61:42054) 2023-12-24T20:01:31.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4abf7fe700 1 -- 172.21.15.61:0/2310983562 learned_addr learned my addr 172.21.15.61:0/2310983562 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:31.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4ac4a01700 1 --2- 172.21.15.61:0/2310983562 >> v2:172.21.15.61:3300/0 conn(0x7f4ac0070640 0x7f4ac0070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4abffff700 1 --2- 172.21.15.61:0/2310983562 >> v2:172.21.15.133:3300/0 conn(0x7f4ac006b260 0x7f4ac015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4abeffd700 1 -- 172.21.15.61:0/2310983562 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627179590 0 0) 0x7f4ac015bcd0 con 0x7f4ac006b630 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4abeffd700 1 -- 172.21.15.61:0/2310983562 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aac003570 con 0x7f4ac006b630 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4ac4a01700 1 -- 172.21.15.61:0/2310983562 >> v2:172.21.15.133:3300/0 conn(0x7f4ac006b260 msgr2=0x7f4ac015c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4ac4a01700 1 --2- 172.21.15.61:0/2310983562 >> v2:172.21.15.133:3300/0 conn(0x7f4ac006b260 0x7f4ac015c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4ac4a01700 1 -- 172.21.15.61:0/2310983562 >> v1:172.21.15.61:6789/0 conn(0x7f4ac006b630 legacy=0x7f4ac0067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.192+0000 7f4ac4a01700 1 -- 172.21.15.61:0/2310983562 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac00683a0 con 0x7f4ac0070640 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4ac4a01700 1 --2- 172.21.15.61:0/2310983562 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 0x7f4ac0070a40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4ac006d0e0 tx=0x7f4ab8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831cb0749498f135 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4abeffd700 1 -- 172.21.15.61:0/2310983562 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab800e070 con 0x7f4ac0070640 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4abeffd700 1 -- 172.21.15.61:0/2310983562 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab800bab0 con 0x7f4ac0070640 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4abeffd700 1 -- 172.21.15.61:0/2310983562 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab800be30 con 0x7f4ac0070640 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4ac6464700 1 -- 172.21.15.61:0/2310983562 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 msgr2=0x7f4ac0070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4ac6464700 1 --2- 172.21.15.61:0/2310983562 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 0x7f4ac0070a40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f4ac006d0e0 tx=0x7f4ab8009780 comp rx=0 tx=0).stop 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4ac6464700 1 -- 172.21.15.61:0/2310983562 shutdown_connections 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4ac6464700 1 --2- 172.21.15.61:0/2310983562 >> v2:172.21.15.133:3300/0 conn(0x7f4ac006b260 0x7f4ac015c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4ac6464700 1 --2- 172.21.15.61:0/2310983562 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 0x7f4ac0070a40 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4ac6464700 1 -- 172.21.15.61:0/2310983562 >> 172.21.15.61:0/2310983562 conn(0x7f4ac00ca200 msgr2=0x7f4ac00ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:31.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4ac6464700 1 -- 172.21.15.61:0/2310983562 shutdown_connections 2023-12-24T20:01:31.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.193+0000 7f4ac6464700 1 -- 172.21.15.61:0/2310983562 wait complete. 2023-12-24T20:01:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.195+0000 7f4ac6464700 1 Processor -- start 2023-12-24T20:01:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.195+0000 7f4ac6464700 1 -- start start 2023-12-24T20:01:31.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.195+0000 7f4ac6464700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac006b260 0x7f4ac016a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.195+0000 7f4ac6464700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac006b630 0x7f4ac00a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.195+0000 7f4ac6464700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 0x7f4ac0159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac6464700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00b0dc0 con 0x7f4ac0070640 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac6464700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00b10a0 con 0x7f4ac006b630 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac6464700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac00b1380 con 0x7f4ac006b260 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac4a01700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 0x7f4ac0159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac4a01700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 0x7f4ac0159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50156/0 (socket says 172.21.15.61:50156) 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac4a01700 1 -- 172.21.15.61:0/1327908792 learned_addr learned my addr 172.21.15.61:0/1327908792 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac4a01700 1 -- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac006b260 msgr2=0x7f4ac016a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4abffff700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac006b260 0x7f4ac016a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4abf7fe700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac006b630 0x7f4ac00a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac4a01700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac006b260 0x7f4ac016a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac4a01700 1 -- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac006b630 msgr2=0x7f4ac00a74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac4a01700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac006b630 0x7f4ac00a74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac4a01700 1 -- 172.21.15.61:0/1327908792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8009a20 con 0x7f4ac0070640 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac4a01700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 0x7f4ac0159550 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80099f0 tx=0x7f4ab8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ab7fff700 1 -- 172.21.15.61:0/1327908792 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8012e60 con 0x7f4ac0070640 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ab7fff700 1 -- 172.21.15.61:0/1327908792 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab8027470 con 0x7f4ac0070640 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac6464700 1 -- 172.21.15.61:0/1327908792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac00b1660 con 0x7f4ac0070640 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ab7fff700 1 -- 172.21.15.61:0/1327908792 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8027830 con 0x7f4ac0070640 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.196+0000 7f4ac6464700 1 -- 172.21.15.61:0/1327908792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac00a7a20 con 0x7f4ac0070640 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.197+0000 7f4ac6464700 1 -- 172.21.15.61:0/1327908792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac00a7c10 con 0x7f4ac0070640 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.198+0000 7f4ab7fff700 1 -- 172.21.15.61:0/1327908792 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4ab8024070 con 0x7f4ac0070640 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.198+0000 7f4ab7fff700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4aa0066f30 0x7f4aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.198+0000 7f4ab7fff700 1 -- 172.21.15.61:0/1327908792 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ab8086cd0 con 0x7f4ac0070640 2023-12-24T20:01:31.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.199+0000 7f4abffff700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4aa0066f30 0x7f4aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.199+0000 7f4abffff700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4aa0066f30 0x7f4aa00693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8006f00 tx=0x7f4aa8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:31.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.203+0000 7f4ab7fff700 1 -- 172.21.15.61:0/1327908792 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ac00a7c10 con 0x7f4ac0070640 2023-12-24T20:01:31.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.397+0000 7f4ac6464700 1 -- 172.21.15.61:0/1327908792 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ac00a7c10 con 0x7f4ac0070640 2023-12-24T20:01:31.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.398+0000 7f4ab7fff700 1 -- 172.21.15.61:0/1327908792 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f4ac00a7c10 con 0x7f4ac0070640 2023-12-24T20:01:31.400 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:31.400 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":98,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:01:30.071892+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:01:28.014512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-24T20:01:29.062088+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:01:31.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 -- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4aa0066f30 msgr2=0x7f4aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4aa0066f30 0x7f4aa00693e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8006f00 tx=0x7f4aa8008040 comp rx=0 tx=0).stop 2023-12-24T20:01:31.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 -- 172.21.15.61:0/1327908792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 msgr2=0x7f4ac0159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 0x7f4ac0159550 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80099f0 tx=0x7f4ab8019000 comp rx=0 tx=0).stop 2023-12-24T20:01:31.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 -- 172.21.15.61:0/1327908792 shutdown_connections 2023-12-24T20:01:31.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ac006b260 0x7f4ac016a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4aa0066f30 0x7f4aa00693e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ac0070640 0x7f4ac0159550 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 --2- 172.21.15.61:0/1327908792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac006b630 0x7f4ac00a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 -- 172.21.15.61:0/1327908792 >> 172.21.15.61:0/1327908792 conn(0x7f4ac00ca200 msgr2=0x7f4ac00cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:31.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 -- 172.21.15.61:0/1327908792 shutdown_connections 2023-12-24T20:01:31.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.400+0000 7f4ac6464700 1 -- 172.21.15.61:0/1327908792 wait complete. 2023-12-24T20:01:31.414 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T20:01:31.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.537+0000 7f2e0c3f7700 1 Processor -- start 2023-12-24T20:01:31.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.538+0000 7f2e0c3f7700 1 -- start start 2023-12-24T20:01:31.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.538+0000 7f2e0c3f7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2e040b2aa0 0x7f2e04159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.538+0000 7f2e0c3f7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e0406e280 0x7f2e040cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e0c3f7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e040cbf80 con 0x7f2e041598d0 2023-12-24T20:01:31.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e0c3f7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e040b2f10 con 0x7f2e040b2aa0 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e0c3f7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e040b11c0 con 0x7f2e0406e280 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09992700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2e040b2aa0 0x7f2e04159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09992700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2e040b2aa0 0x7f2e04159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50158/0 (socket says 172.21.15.61:50158) 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09992700 1 -- 172.21.15.61:0/2892467669 learned_addr learned my addr 172.21.15.61:0/2892467669 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e0a994700 1 --2- 172.21.15.61:0/2892467669 >> v2:172.21.15.133:3300/0 conn(0x7f2e0406e280 0x7f2e040cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09992700 1 -- 172.21.15.61:0/2892467669 >> v2:172.21.15.133:3300/0 conn(0x7f2e0406e280 msgr2=0x7f2e040cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09992700 1 --2- 172.21.15.61:0/2892467669 >> v2:172.21.15.133:3300/0 conn(0x7f2e0406e280 0x7f2e040cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09992700 1 -- 172.21.15.61:0/2892467669 >> v1:172.21.15.133:6789/0 conn(0x7f2e041598d0 legacy=0x7f2e0406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09992700 1 -- 172.21.15.61:0/2892467669 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040b14a0 con 0x7f2e040b2aa0 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09992700 1 --2- 172.21.15.61:0/2892467669 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 0x7f2e04159ca0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2e040b34a0 tx=0x7f2e00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fca9d735f2506be server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09191700 1 -- 172.21.15.61:0/2892467669 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0000b820 con 0x7f2e040b2aa0 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09191700 1 -- 172.21.15.61:0/2892467669 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0000b980 con 0x7f2e040b2aa0 2023-12-24T20:01:31.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.539+0000 7f2e09191700 1 -- 172.21.15.61:0/2892467669 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0000bd20 con 0x7f2e040b2aa0 2023-12-24T20:01:31.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.540+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/2892467669 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 msgr2=0x7f2e04159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.540+0000 7f2e0c3f7700 1 --2- 172.21.15.61:0/2892467669 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 0x7f2e04159ca0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2e040b34a0 tx=0x7f2e00009250 comp rx=0 tx=0).stop 2023-12-24T20:01:31.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.540+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/2892467669 shutdown_connections 2023-12-24T20:01:31.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.540+0000 7f2e0c3f7700 1 --2- 172.21.15.61:0/2892467669 >> v2:172.21.15.133:3300/0 conn(0x7f2e0406e280 0x7f2e040cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.540+0000 7f2e0c3f7700 1 --2- 172.21.15.61:0/2892467669 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 0x7f2e04159ca0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.540+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/2892467669 >> 172.21.15.61:0/2892467669 conn(0x7f2e04067550 msgr2=0x7f2e04067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:31.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.540+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/2892467669 shutdown_connections 2023-12-24T20:01:31.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.540+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/2892467669 wait complete. 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.541+0000 7f2e0c3f7700 1 Processor -- start 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.541+0000 7f2e0c3f7700 1 -- start start 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e0c3f7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e0406e280 0x7f2e0416dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e0c3f7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 0x7f2e040cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e0c3f7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e041598d0 0x7f2e04158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e0c3f7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e040cfc40 con 0x7f2e040b2aa0 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e0c3f7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0415a4a0 con 0x7f2e041598d0 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e0c3f7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0415a780 con 0x7f2e0406e280 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e09992700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 0x7f2e040cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e09992700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 0x7f2e040cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50160/0 (socket says 172.21.15.61:50160) 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e09992700 1 -- 172.21.15.61:0/3520545814 learned_addr learned my addr 172.21.15.61:0/3520545814 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e0a994700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e041598d0 0x7f2e04158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e0a193700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e0406e280 0x7f2e0416dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e09992700 1 -- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e0406e280 msgr2=0x7f2e0416dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e09992700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e0406e280 0x7f2e0416dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e09992700 1 -- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e041598d0 msgr2=0x7f2e04158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e09992700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e041598d0 0x7f2e04158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e09992700 1 -- 172.21.15.61:0/3520545814 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000094f0 con 0x7f2e040b2aa0 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e0a994700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e041598d0 0x7f2e04158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e0a193700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e0406e280 0x7f2e0416dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.542+0000 7f2e09992700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 0x7f2e040cf700 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2e000030c0 tx=0x7f2e00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.543+0000 7f2df67fc700 1 -- 172.21.15.61:0/3520545814 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011e60 con 0x7f2e040b2aa0 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.543+0000 7f2df67fc700 1 -- 172.21.15.61:0/3520545814 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00020070 con 0x7f2e040b2aa0 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.543+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/3520545814 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0415aa60 con 0x7f2e040b2aa0 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.543+0000 7f2df67fc700 1 -- 172.21.15.61:0/3520545814 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0001b6a0 con 0x7f2e040b2aa0 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.543+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/3520545814 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e04158580 con 0x7f2e040b2aa0 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.544+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/3520545814 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0415af00 con 0x7f2e040b2aa0 2023-12-24T20:01:31.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.544+0000 7f2df67fc700 1 -- 172.21.15.61:0/3520545814 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2e00022030 con 0x7f2e040b2aa0 2023-12-24T20:01:31.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.544+0000 7f2df67fc700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2de8066f30 0x7f2de80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:31.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.545+0000 7f2df67fc700 1 -- 172.21.15.61:0/3520545814 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e00086550 con 0x7f2e040b2aa0 2023-12-24T20:01:31.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.545+0000 7f2e0a193700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2de8066f30 0x7f2de80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:31.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.545+0000 7f2e0a193700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2de8066f30 0x7f2de80693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2df8002880 tx=0x7f2df8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:31.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.549+0000 7f2df67fc700 1 -- 172.21.15.61:0/3520545814 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e000537c0 con 0x7f2e040b2aa0 2023-12-24T20:01:31.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:31.798+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/3520545814 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2e04089120 con 0x7f2e040b2aa0 2023-12-24T20:01:32.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.718+0000 7f2df67fc700 1 -- 172.21.15.61:0/3520545814 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2e00056de0 con 0x7f2e040b2aa0 2023-12-24T20:01:32.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2de8066f30 msgr2=0x7f2de80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2de8066f30 0x7f2de80693e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2df8002880 tx=0x7f2df8009040 comp rx=0 tx=0).stop 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/3520545814 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 msgr2=0x7f2e040cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 0x7f2e040cf700 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f2e000030c0 tx=0x7f2e00016000 comp rx=0 tx=0).stop 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/3520545814 shutdown_connections 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2e0406e280 0x7f2e0416dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2de8066f30 0x7f2de80693e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e041598d0 0x7f2e04158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 --2- 172.21.15.61:0/3520545814 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2e040b2aa0 0x7f2e040cf700 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/3520545814 >> 172.21.15.61:0/3520545814 conn(0x7f2e04067550 msgr2=0x7f2e040b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/3520545814 shutdown_connections 2023-12-24T20:01:32.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.721+0000 7f2e0c3f7700 1 -- 172.21.15.61:0/3520545814 wait complete. 2023-12-24T20:01:32.738 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T20:01:32.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.869+0000 7fef68a97700 1 Processor -- start 2023-12-24T20:01:32.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.869+0000 7fef68a97700 1 -- start start 2023-12-24T20:01:32.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef68a97700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef6415a030 0x7fef64070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:32.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef68a97700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef640c4710 con 0x7fef64068b10 2023-12-24T20:01:32.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef68a97700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6406b190 con 0x7fef64159c60 2023-12-24T20:01:32.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef68a97700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6406a5c0 con 0x7fef6415a030 2023-12-24T20:01:32.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef62d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fef64068b10 0x7fef640c8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42056/0 (socket says 172.21.15.61:42056) 2023-12-24T20:01:32.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef62d9d700 1 -- 172.21.15.61:0/66327983 learned_addr learned my addr 172.21.15.61:0/66327983 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef61d9b700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef6415a030 0x7fef64070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851902734 0 0) 0x7fef5c001490 con 0x7fef64068b10 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef4c003570 con 0x7fef64068b10 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069223390 0 0) 0x7fef6406b190 con 0x7fef64159c60 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef5c001490 con 0x7fef64159c60 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2888078756 0 0) 0x7fef4c003570 con 0x7fef64068b10 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef6415a030 msgr2=0x7fef64070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef6159a700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef6415a030 0x7fef64070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 >> v1:172.21.15.133:6789/0 conn(0x7fef64159c60 legacy=0x7fef640c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.870+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6406a860 con 0x7fef64068b10 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fef5c001980 con 0x7fef64068b10 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 >> v1:172.21.15.61:6789/0 conn(0x7fef64068b10 legacy=0x7fef640c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef4c003c20 0x7fef4c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef6415a030 0x7fef4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:32.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef4c004d50 0x7fef4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6406a5c0 con 0x7fef4c003c20 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c00bb40 con 0x7fef4c004d50 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c00bd00 con 0x7fef6415a030 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6259c700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef4c003c20 0x7fef4c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef61d9b700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef6415a030 0x7fef4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef62d9d700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef4c004d50 0x7fef4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6259c700 1 -- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef6415a030 msgr2=0x7fef4c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6259c700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef6415a030 0x7fef4c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6259c700 1 -- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef4c004d50 msgr2=0x7fef4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6259c700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef4c004d50 0x7fef4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6259c700 1 -- 172.21.15.61:0/66327983 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c003570 con 0x7fef4c003c20 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef62d9d700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef4c004d50 0x7fef4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6259c700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef4c003c20 0x7fef4c004010 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fef54001a10 tx=0x7fef54007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c0cafd9b9cbb8b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400c5d0 con 0x7fef4c003c20 2023-12-24T20:01:32.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5400c730 con 0x7fef4c003c20 2023-12-24T20:01:32.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.871+0000 7fef6159a700 1 -- 172.21.15.61:0/66327983 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400cad0 con 0x7fef4c003c20 2023-12-24T20:01:32.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.872+0000 7fef68a97700 1 -- 172.21.15.61:0/66327983 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef4c003c20 msgr2=0x7fef4c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:32.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.872+0000 7fef68a97700 1 --2- 172.21.15.61:0/66327983 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef4c003c20 0x7fef4c004010 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fef54001a10 tx=0x7fef54007d30 comp rx=0 tx=0).stop 2023-12-24T20:01:32.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.872+0000 7fef62d9d700 1 -- 172.21.15.61:0/66327983 reap_dead start 2023-12-24T20:01:32.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.872+0000 7fef68a97700 1 -- 172.21.15.61:0/66327983 shutdown_connections 2023-12-24T20:01:32.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.872+0000 7fef68a97700 1 -- 172.21.15.61:0/66327983 >> 172.21.15.61:0/66327983 conn(0x7fef640ce420 msgr2=0x7fef640ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:32.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.872+0000 7fef68a97700 1 -- 172.21.15.61:0/66327983 shutdown_connections 2023-12-24T20:01:32.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.872+0000 7fef68a97700 1 -- 172.21.15.61:0/66327983 wait complete. 2023-12-24T20:01:32.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.873+0000 7fef68a97700 1 Processor -- start 2023-12-24T20:01:32.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.873+0000 7fef68a97700 1 -- start start 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef68a97700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef4c003c20 0x7fef64144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef68a97700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef640b2f40 0x7fef640c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef68a97700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef640c6f50 0x7fef640b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef68a97700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef640c73f0 con 0x7fef640c6f50 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef68a97700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef640b2ab0 con 0x7fef4c003c20 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef68a97700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef640b1610 con 0x7fef640b2f40 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef62d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef640c6f50 0x7fef640b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef62d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef640c6f50 0x7fef640b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50184/0 (socket says 172.21.15.61:50184) 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef62d9d700 1 -- 172.21.15.61:0/305785566 learned_addr learned my addr 172.21.15.61:0/305785566 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef6259c700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef4c003c20 0x7fef64144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef61d9b700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef640b2f40 0x7fef640c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef62d9d700 1 -- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef640b2f40 msgr2=0x7fef640c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:32.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef62d9d700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef640b2f40 0x7fef640c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef62d9d700 1 -- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef4c003c20 msgr2=0x7fef64144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef62d9d700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef4c003c20 0x7fef64144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef62d9d700 1 -- 172.21.15.61:0/305785566 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef640b2180 con 0x7fef640c6f50 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.874+0000 7fef62d9d700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef640c6f50 0x7fef640b08e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fef5c000f80 tx=0x7fef5c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.875+0000 7fef527fc700 1 -- 172.21.15.61:0/305785566 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c004e90 con 0x7fef640c6f50 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.875+0000 7fef527fc700 1 -- 172.21.15.61:0/305785566 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c00ea30 con 0x7fef640c6f50 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.875+0000 7fef68a97700 1 -- 172.21.15.61:0/305785566 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef640b2460 con 0x7fef640c6f50 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.875+0000 7fef527fc700 1 -- 172.21.15.61:0/305785566 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00edf0 con 0x7fef640c6f50 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.875+0000 7fef68a97700 1 -- 172.21.15.61:0/305785566 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef640b33b0 con 0x7fef640c6f50 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.875+0000 7fef68a97700 1 -- 172.21.15.61:0/305785566 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef640b2c60 con 0x7fef640c6f50 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.876+0000 7fef527fc700 1 -- 172.21.15.61:0/305785566 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fef5c014640 con 0x7fef640c6f50 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.876+0000 7fef527fc700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef44066f60 0x7fef44069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.876+0000 7fef527fc700 1 -- 172.21.15.61:0/305785566 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef5c0843c0 con 0x7fef640c6f50 2023-12-24T20:01:32.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.877+0000 7fef6259c700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef44066f60 0x7fef44069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:32.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.877+0000 7fef6259c700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef44066f60 0x7fef44069410 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fef54001ed0 tx=0x7fef54015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:32.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:32.881+0000 7fef527fc700 1 -- 172.21.15.61:0/305785566 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef5c04c5a0 con 0x7fef640c6f50 2023-12-24T20:01:33.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.121+0000 7fef68a97700 1 -- 172.21.15.61:0/305785566 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fef640c4710 con 0x7fef640c6f50 2023-12-24T20:01:33.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.721+0000 7fef527fc700 1 -- 172.21.15.61:0/305785566 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7fef640c4710 con 0x7fef640c6f50 2023-12-24T20:01:33.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 -- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef44066f60 msgr2=0x7fef44069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:33.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef44066f60 0x7fef44069410 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fef54001ed0 tx=0x7fef54015000 comp rx=0 tx=0).stop 2023-12-24T20:01:33.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 -- 172.21.15.61:0/305785566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef640c6f50 msgr2=0x7fef640b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:33.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef640c6f50 0x7fef640b08e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fef5c000f80 tx=0x7fef5c001250 comp rx=0 tx=0).stop 2023-12-24T20:01:33.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 -- 172.21.15.61:0/305785566 shutdown_connections 2023-12-24T20:01:33.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef44066f60 0x7fef44069410 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:33.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef640c6f50 0x7fef640b08e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:33.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef4c003c20 0x7fef64144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:33.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 --2- 172.21.15.61:0/305785566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef640b2f40 0x7fef640c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:33.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 -- 172.21.15.61:0/305785566 >> 172.21.15.61:0/305785566 conn(0x7fef640ce420 msgr2=0x7fef64159030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:33.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 -- 172.21.15.61:0/305785566 shutdown_connections 2023-12-24T20:01:33.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.723+0000 7fef68a97700 1 -- 172.21.15.61:0/305785566 wait complete. 2023-12-24T20:01:33.739 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:01:33.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.866+0000 7f22351a6700 1 Processor -- start 2023-12-24T20:01:33.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.866+0000 7f22351a6700 1 -- start start 2023-12-24T20:01:33.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.866+0000 7f22351a6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f223013faa0 0x7f22300c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.866+0000 7f22351a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f22300c7a30 0x7f2230069c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.866+0000 7f22351a6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223013fe70 con 0x7f223006a140 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.866+0000 7f22351a6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22300cbdc0 con 0x7f223013faa0 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f22351a6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223006d640 con 0x7f22300c7a30 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222ed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f223013faa0 0x7f22300c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222f59e700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f223006a140 0x7f22300caa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42064/0 (socket says 172.21.15.61:42064) 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222f59e700 1 -- 172.21.15.61:0/917824857 learned_addr learned my addr 172.21.15.61:0/917824857 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222e59c700 1 --2- 172.21.15.61:0/917824857 >> v2:172.21.15.133:3300/0 conn(0x7f22300c7a30 0x7f2230069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222ed9d700 1 -- 172.21.15.61:0/917824857 >> v2:172.21.15.133:3300/0 conn(0x7f22300c7a30 msgr2=0x7f2230069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222ed9d700 1 --2- 172.21.15.61:0/917824857 >> v2:172.21.15.133:3300/0 conn(0x7f22300c7a30 0x7f2230069c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222ed9d700 1 -- 172.21.15.61:0/917824857 >> v1:172.21.15.61:6789/0 conn(0x7f223006a140 legacy=0x7f22300caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222ed9d700 1 -- 172.21.15.61:0/917824857 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300c7e80 con 0x7f223013faa0 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222dd9b700 1 -- 172.21.15.61:0/917824857 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523213631 0 0) 0x7f2228001490 con 0x7f223006a140 2023-12-24T20:01:33.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222ed9d700 1 --2- 172.21.15.61:0/917824857 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f223013faa0 0x7f22300c74f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f223006d0e0 tx=0x7f22200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75e59a8a929dd13 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222dd9b700 1 -- 172.21.15.61:0/917824857 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000b6b0 con 0x7f223013faa0 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222dd9b700 1 -- 172.21.15.61:0/917824857 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222000b810 con 0x7f223013faa0 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.867+0000 7f222dd9b700 1 -- 172.21.15.61:0/917824857 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000bbb0 con 0x7f223013faa0 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.868+0000 7f22351a6700 1 -- 172.21.15.61:0/917824857 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f223013faa0 msgr2=0x7f22300c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.868+0000 7f22351a6700 1 --2- 172.21.15.61:0/917824857 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f223013faa0 0x7f22300c74f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f223006d0e0 tx=0x7f22200091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.868+0000 7f22351a6700 1 -- 172.21.15.61:0/917824857 shutdown_connections 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.868+0000 7f22351a6700 1 --2- 172.21.15.61:0/917824857 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f223013faa0 0x7f22300c74f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.868+0000 7f22351a6700 1 --2- 172.21.15.61:0/917824857 >> v2:172.21.15.133:3300/0 conn(0x7f22300c7a30 0x7f2230069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.868+0000 7f22351a6700 1 -- 172.21.15.61:0/917824857 >> 172.21.15.61:0/917824857 conn(0x7f22300cceb0 msgr2=0x7f22300cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.868+0000 7f22351a6700 1 -- 172.21.15.61:0/917824857 shutdown_connections 2023-12-24T20:01:33.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.868+0000 7f22351a6700 1 -- 172.21.15.61:0/917824857 wait complete. 2023-12-24T20:01:33.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.869+0000 7f22351a6700 1 Processor -- start 2023-12-24T20:01:33.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.869+0000 7f22351a6700 1 -- start start 2023-12-24T20:01:33.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f22351a6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f223006a140 0x7f2230159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:33.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f22351a6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22300c7a30 0x7f2230158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:33.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f22351a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f223013faa0 0x7f223012d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f22351a6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300c64c0 con 0x7f22300c7a30 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f22351a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300c58b0 con 0x7f223013faa0 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f22351a6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22300c5b90 con 0x7f223006a140 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f222e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22300c7a30 0x7f2230158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f222e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22300c7a30 0x7f2230158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50192/0 (socket says 172.21.15.61:50192) 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f222e59c700 1 -- 172.21.15.61:0/1778702897 learned_addr learned my addr 172.21.15.61:0/1778702897 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f222ed9d700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f223006a140 0x7f2230159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f222f59e700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f223013faa0 0x7f223012d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f222e59c700 1 -- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f223006a140 msgr2=0x7f2230159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f222e59c700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f223006a140 0x7f2230159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f222e59c700 1 -- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f223013faa0 msgr2=0x7f223012d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f222e59c700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f223013faa0 0x7f223012d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.870+0000 7f222e59c700 1 -- 172.21.15.61:0/1778702897 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220009420 con 0x7f22300c7a30 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.871+0000 7f222e59c700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22300c7a30 0x7f2230158ad0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f222400d890 tx=0x7f2224008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.871+0000 7f2216ffd700 1 -- 172.21.15.61:0/1778702897 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222400b600 con 0x7f22300c7a30 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.871+0000 7f2216ffd700 1 -- 172.21.15.61:0/1778702897 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222400b760 con 0x7f22300c7a30 2023-12-24T20:01:33.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.871+0000 7f2216ffd700 1 -- 172.21.15.61:0/1778702897 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222400bae0 con 0x7f22300c7a30 2023-12-24T20:01:33.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.871+0000 7f22351a6700 1 -- 172.21.15.61:0/1778702897 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22300c5e70 con 0x7f22300c7a30 2023-12-24T20:01:33.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.871+0000 7f22351a6700 1 -- 172.21.15.61:0/1778702897 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223013d490 con 0x7f22300c7a30 2023-12-24T20:01:33.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.872+0000 7f22351a6700 1 -- 172.21.15.61:0/1778702897 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22300c6630 con 0x7f22300c7a30 2023-12-24T20:01:33.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.872+0000 7f2216ffd700 1 -- 172.21.15.61:0/1778702897 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f222401e460 con 0x7f22300c7a30 2023-12-24T20:01:33.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.873+0000 7f2216ffd700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f221c066f30 0x7f221c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:33.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.873+0000 7f2216ffd700 1 -- 172.21.15.61:0/1778702897 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2224084be0 con 0x7f22300c7a30 2023-12-24T20:01:33.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.873+0000 7f222ed9d700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f221c066f30 0x7f221c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:33.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.873+0000 7f222ed9d700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f221c066f30 0x7f221c0693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f22200093f0 tx=0x7f2220017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:33.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:33.877+0000 7f2216ffd700 1 -- 172.21.15.61:0/1778702897 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2224051e50 con 0x7f22300c7a30 2023-12-24T20:01:34.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.115+0000 7f22351a6700 1 -- 172.21.15.61:0/1778702897 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f223004c3c0 con 0x7f22300c7a30 2023-12-24T20:01:34.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.116+0000 7f2216ffd700 1 -- 172.21.15.61:0/1778702897 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f2224055470 con 0x7f22300c7a30 2023-12-24T20:01:34.117 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:34.118 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2634636374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2634636374},{"type":"v1","addr":"172.21.15.61:6835","nonce":2634636374}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/856986572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":856986572},{"type":"v1","addr":"172.21.15.133:6836","nonce":856986572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1475170652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1475170652},{"type":"v1","addr":"172.21.15.133:6837","nonce":1475170652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:01:30.072202+0000","modified":"2023-12-24T20:01:33.718490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2512648595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2512648595},{"type":"v1","addr":"172.21.15.61:6834","nonce":2512648595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T20:01:34.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 -- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f221c066f30 msgr2=0x7f221c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f221c066f30 0x7f221c0693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f22200093f0 tx=0x7f2220017000 comp rx=0 tx=0).stop 2023-12-24T20:01:34.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 -- 172.21.15.61:0/1778702897 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22300c7a30 msgr2=0x7f2230158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22300c7a30 0x7f2230158ad0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f222400d890 tx=0x7f2224008040 comp rx=0 tx=0).stop 2023-12-24T20:01:34.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 -- 172.21.15.61:0/1778702897 shutdown_connections 2023-12-24T20:01:34.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f223006a140 0x7f2230159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f221c066f30 0x7f221c0693e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f223013faa0 0x7f223012d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 --2- 172.21.15.61:0/1778702897 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22300c7a30 0x7f2230158ad0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 -- 172.21.15.61:0/1778702897 >> 172.21.15.61:0/1778702897 conn(0x7f22300cceb0 msgr2=0x7f223006e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:34.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 -- 172.21.15.61:0/1778702897 shutdown_connections 2023-12-24T20:01:34.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.118+0000 7f22351a6700 1 -- 172.21.15.61:0/1778702897 wait complete. 2023-12-24T20:01:34.121 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 52 2023-12-24T20:01:34.132 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:01:34.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.265+0000 7ff3f21ca700 1 Processor -- start 2023-12-24T20:01:34.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.265+0000 7ff3f21ca700 1 -- start start 2023-12-24T20:01:34.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3f21ca700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff3ec068140 0x7ff3ec0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3f21ca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068510 0x7ff3ec0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3f21ca700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ec0b2890 con 0x7ff3ec159a60 2023-12-24T20:01:34.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3f21ca700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ec0b11e0 con 0x7ff3ec068140 2023-12-24T20:01:34.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3f21ca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0cf630 con 0x7ff3ec068510 2023-12-24T20:01:34.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3eb7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff3ec068140 0x7ff3ec0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3ebfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff3ec159a60 0x7ff3ec159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42066/0 (socket says 172.21.15.61:42066) 2023-12-24T20:01:34.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3ebfff700 1 -- 172.21.15.61:0/229435163 learned_addr learned my addr 172.21.15.61:0/229435163 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:34.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3eaffd700 1 --2- 172.21.15.61:0/229435163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068510 0x7ff3ec0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3eb7fe700 1 -- 172.21.15.61:0/229435163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068510 msgr2=0x7ff3ec0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3eb7fe700 1 --2- 172.21.15.61:0/229435163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068510 0x7ff3ec0b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3eb7fe700 1 -- 172.21.15.61:0/229435163 >> v1:172.21.15.61:6789/0 conn(0x7ff3ec159a60 legacy=0x7ff3ec159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3eb7fe700 1 -- 172.21.15.61:0/229435163 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec0b2240 con 0x7ff3ec068140 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3ea7fc700 1 -- 172.21.15.61:0/229435163 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672856244 0 0) 0x7ff3ec0b2890 con 0x7ff3ec159a60 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3eaffd700 1 --2- 172.21.15.61:0/229435163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068510 0x7ff3ec0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.266+0000 7ff3eb7fe700 1 --2- 172.21.15.61:0/229435163 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec068140 0x7ff3ec0cefa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40098d0 tx=0x7ff3d4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19a4cd3ebedc6b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3ea7fc700 1 -- 172.21.15.61:0/229435163 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4009e70 con 0x7ff3ec068140 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3ea7fc700 1 -- 172.21.15.61:0/229435163 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d4005c10 con 0x7ff3ec068140 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3ea7fc700 1 -- 172.21.15.61:0/229435163 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400b650 con 0x7ff3ec068140 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3f21ca700 1 -- 172.21.15.61:0/229435163 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec068140 msgr2=0x7ff3ec0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3f21ca700 1 --2- 172.21.15.61:0/229435163 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec068140 0x7ff3ec0cefa0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40098d0 tx=0x7ff3d4009120 comp rx=0 tx=0).stop 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3f21ca700 1 -- 172.21.15.61:0/229435163 shutdown_connections 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3f21ca700 1 --2- 172.21.15.61:0/229435163 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec068140 0x7ff3ec0cefa0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3f21ca700 1 --2- 172.21.15.61:0/229435163 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068510 0x7ff3ec0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3f21ca700 1 -- 172.21.15.61:0/229435163 >> 172.21.15.61:0/229435163 conn(0x7ff3ec097a10 msgr2=0x7ff3ec0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:34.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3f21ca700 1 -- 172.21.15.61:0/229435163 shutdown_connections 2023-12-24T20:01:34.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.267+0000 7ff3f21ca700 1 -- 172.21.15.61:0/229435163 wait complete. 2023-12-24T20:01:34.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.268+0000 7ff3f21ca700 1 Processor -- start 2023-12-24T20:01:34.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.268+0000 7ff3f21ca700 1 -- start start 2023-12-24T20:01:34.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.269+0000 7ff3f21ca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068140 0x7ff3ec15f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.269+0000 7ff3f21ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec068510 0x7ff3ec098460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.269+0000 7ff3f21ca700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec159a60 0x7ff3ec0b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.269+0000 7ff3f21ca700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0994e0 con 0x7ff3ec159a60 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.269+0000 7ff3f21ca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec15f6b0 con 0x7ff3ec068510 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.269+0000 7ff3f21ca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0989a0 con 0x7ff3ec068140 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.269+0000 7ff3ebfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec159a60 0x7ff3ec0b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.269+0000 7ff3ebfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec159a60 0x7ff3ec0b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50210/0 (socket says 172.21.15.61:50210) 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.269+0000 7ff3ebfff700 1 -- 172.21.15.61:0/1466753795 learned_addr learned my addr 172.21.15.61:0/1466753795 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3eb7fe700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068140 0x7ff3ec15f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3eaffd700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec068510 0x7ff3ec098460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3ebfff700 1 -- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068140 msgr2=0x7ff3ec15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3ebfff700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068140 0x7ff3ec15f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3ebfff700 1 -- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec068510 msgr2=0x7ff3ec098460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3ebfff700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec068510 0x7ff3ec098460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3ebfff700 1 -- 172.21.15.61:0/1466753795 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40093c0 con 0x7ff3ec159a60 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3eb7fe700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068140 0x7ff3ec15f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:34.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3eaffd700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec068510 0x7ff3ec098460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3ebfff700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec159a60 0x7ff3ec0b3cf0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400cc10 tx=0x7ff3e4001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3e37fe700 1 -- 172.21.15.61:0/1466753795 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400a930 con 0x7ff3ec159a60 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3e37fe700 1 -- 172.21.15.61:0/1466753795 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e400aab0 con 0x7ff3ec159a60 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3f21ca700 1 -- 172.21.15.61:0/1466753795 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ec098c40 con 0x7ff3ec159a60 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3e37fe700 1 -- 172.21.15.61:0/1466753795 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400ae70 con 0x7ff3ec159a60 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.270+0000 7ff3f21ca700 1 -- 172.21.15.61:0/1466753795 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ec099200 con 0x7ff3ec159a60 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.271+0000 7ff3f21ca700 1 -- 172.21.15.61:0/1466753795 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ec09a460 con 0x7ff3ec159a60 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.271+0000 7ff3e37fe700 1 -- 172.21.15.61:0/1466753795 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff3e4007300 con 0x7ff3ec159a60 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.272+0000 7ff3e37fe700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff3cc066f30 0x7ff3cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.272+0000 7ff3e37fe700 1 -- 172.21.15.61:0/1466753795 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff3e40848c0 con 0x7ff3ec159a60 2023-12-24T20:01:34.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.272+0000 7ff3eb7fe700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff3cc066f30 0x7ff3cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.273+0000 7ff3eb7fe700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff3cc066f30 0x7ff3cc0693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009fd0 tx=0x7ff3d4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:34.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.276+0000 7ff3e37fe700 1 -- 172.21.15.61:0/1466753795 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3e4051bb0 con 0x7ff3ec159a60 2023-12-24T20:01:34.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.473+0000 7ff3f21ca700 1 -- 172.21.15.61:0/1466753795 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3ec06d440 con 0x7ff3ec159a60 2023-12-24T20:01:34.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.474+0000 7ff3e37fe700 1 -- 172.21.15.61:0/1466753795 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+15353 (secure 0 0 0) 0x7ff3e40551d0 con 0x7ff3ec159a60 2023-12-24T20:01:34.475 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:34.475 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":99,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:01:31.676823+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:01:28.014512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-24T20:01:29.062088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:01:34.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.475+0000 7ff3f21ca700 1 -- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff3cc066f30 msgr2=0x7ff3cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.475+0000 7ff3f21ca700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff3cc066f30 0x7ff3cc0693e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009fd0 tx=0x7ff3d4016000 comp rx=0 tx=0).stop 2023-12-24T20:01:34.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.476+0000 7ff3f21ca700 1 -- 172.21.15.61:0/1466753795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec159a60 msgr2=0x7ff3ec0b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.476+0000 7ff3f21ca700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec159a60 0x7ff3ec0b3cf0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400cc10 tx=0x7ff3e4001970 comp rx=0 tx=0).stop 2023-12-24T20:01:34.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.476+0000 7ff3f21ca700 1 -- 172.21.15.61:0/1466753795 shutdown_connections 2023-12-24T20:01:34.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.476+0000 7ff3f21ca700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3ec068140 0x7ff3ec15f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.476+0000 7ff3f21ca700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff3cc066f30 0x7ff3cc0693e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.476+0000 7ff3f21ca700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3ec159a60 0x7ff3ec0b3cf0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.476+0000 7ff3f21ca700 1 --2- 172.21.15.61:0/1466753795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3ec068510 0x7ff3ec098460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.476+0000 7ff3f21ca700 1 -- 172.21.15.61:0/1466753795 >> 172.21.15.61:0/1466753795 conn(0x7ff3ec097a10 msgr2=0x7ff3ec0aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:34.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.476+0000 7ff3f21ca700 1 -- 172.21.15.61:0/1466753795 shutdown_connections 2023-12-24T20:01:34.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.476+0000 7ff3f21ca700 1 -- 172.21.15.61:0/1466753795 wait complete. 2023-12-24T20:01:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T20:01:34.490 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:01:34.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.610+0000 7fadcdac2700 1 Processor -- start 2023-12-24T20:01:34.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.611+0000 7fadcdac2700 1 -- start start 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.611+0000 7fadcdac2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fadc8159850 0x7fadc8159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.611+0000 7fadcdac2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fadc80caa80 0x7fadc80aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.611+0000 7fadcdac2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc806a630 con 0x7fadc806aac0 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.611+0000 7fadcdac2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc80cccf0 con 0x7fadc80caa80 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.611+0000 7fadcdac2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc8069d00 con 0x7fadc8159850 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.612+0000 7fadc7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fadc80caa80 0x7fadc80aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.612+0000 7fadc77fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fadc8159850 0x7fadc8159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.612+0000 7fadc6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fadc806aac0 0x7fadc80cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:52128/0 (socket says 172.21.15.61:52128) 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.612+0000 7fadc6ffd700 1 -- 172.21.15.61:0/351841887 learned_addr learned my addr 172.21.15.61:0/351841887 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.612+0000 7fadc7fff700 1 -- 172.21.15.61:0/351841887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fadc8159850 msgr2=0x7fadc8159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:34.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.612+0000 7fadc7fff700 1 --2- 172.21.15.61:0/351841887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fadc8159850 0x7fadc8159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.612+0000 7fadc7fff700 1 -- 172.21.15.61:0/351841887 >> v1:172.21.15.133:6789/0 conn(0x7fadc806aac0 legacy=0x7fadc80cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.612+0000 7fadc7fff700 1 -- 172.21.15.61:0/351841887 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc8069fe0 con 0x7fadc80caa80 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.612+0000 7fadc7fff700 1 --2- 172.21.15.61:0/351841887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadc80caa80 0x7fadc80aa880 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009e60 tx=0x7fadc0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2473ad673b2c7d76 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.612+0000 7fadc67fc700 1 -- 172.21.15.61:0/351841887 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc000e070 con 0x7fadc80caa80 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.613+0000 7fadc67fc700 1 -- 172.21.15.61:0/351841887 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc000bb60 con 0x7fadc80caa80 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.613+0000 7fadc67fc700 1 -- 172.21.15.61:0/351841887 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0012430 con 0x7fadc80caa80 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.613+0000 7fadcdac2700 1 -- 172.21.15.61:0/351841887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadc80caa80 msgr2=0x7fadc80aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.613+0000 7fadcdac2700 1 --2- 172.21.15.61:0/351841887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadc80caa80 0x7fadc80aa880 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009e60 tx=0x7fadc0009780 comp rx=0 tx=0).stop 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.613+0000 7fadcdac2700 1 -- 172.21.15.61:0/351841887 shutdown_connections 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.613+0000 7fadcdac2700 1 --2- 172.21.15.61:0/351841887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadc80caa80 0x7fadc80aa880 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.613+0000 7fadcdac2700 1 --2- 172.21.15.61:0/351841887 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fadc8159850 0x7fadc8159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.613+0000 7fadcdac2700 1 -- 172.21.15.61:0/351841887 >> 172.21.15.61:0/351841887 conn(0x7fadc80cceb0 msgr2=0x7fadc80cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:34.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.613+0000 7fadcdac2700 1 -- 172.21.15.61:0/351841887 shutdown_connections 2023-12-24T20:01:34.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.613+0000 7fadcdac2700 1 -- 172.21.15.61:0/351841887 wait complete. 2023-12-24T20:01:34.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.614+0000 7fadcdac2700 1 Processor -- start 2023-12-24T20:01:34.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.614+0000 7fadcdac2700 1 -- start start 2023-12-24T20:01:34.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadcdac2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fadc806aac0 0x7fadc814f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadcdac2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fadc80caa80 0x7fadc806d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadcdac2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadc8159850 0x7fadc806d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadcdac2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc814fba0 con 0x7fadc80caa80 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadcdac2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc814fe80 con 0x7fadc8159850 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadcdac2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc8150160 con 0x7fadc806aac0 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadc6ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fadc80caa80 0x7fadc806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadc6ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fadc80caa80 0x7fadc806d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50212/0 (socket says 172.21.15.61:50212) 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadc6ffd700 1 -- 172.21.15.61:0/3458129134 learned_addr learned my addr 172.21.15.61:0/3458129134 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadc77fe700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fadc806aac0 0x7fadc814f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.615+0000 7fadc7fff700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadc8159850 0x7fadc806d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadc6ffd700 1 -- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fadc806aac0 msgr2=0x7fadc814f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadc6ffd700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fadc806aac0 0x7fadc814f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadc6ffd700 1 -- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadc8159850 msgr2=0x7fadc806d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadc6ffd700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadc8159850 0x7fadc806d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadc6ffd700 1 -- 172.21.15.61:0/3458129134 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc0009a20 con 0x7fadc80caa80 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadc7fff700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadc8159850 0x7fadc806d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadc6ffd700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fadc80caa80 0x7fadc806d130 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00c7c0 tx=0x7fadbc007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:34.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadaf7fe700 1 -- 172.21.15.61:0/3458129134 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc005b30 con 0x7fadc80caa80 2023-12-24T20:01:34.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadaf7fe700 1 -- 172.21.15.61:0/3458129134 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc005cb0 con 0x7fadc80caa80 2023-12-24T20:01:34.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadaf7fe700 1 -- 172.21.15.61:0/3458129134 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc007320 con 0x7fadc80caa80 2023-12-24T20:01:34.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadcdac2700 1 -- 172.21.15.61:0/3458129134 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc8150440 con 0x7fadc80caa80 2023-12-24T20:01:34.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.616+0000 7fadcdac2700 1 -- 172.21.15.61:0/3458129134 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc814f890 con 0x7fadc80caa80 2023-12-24T20:01:34.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.617+0000 7fadcdac2700 1 -- 172.21.15.61:0/3458129134 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc8151d40 con 0x7fadc80caa80 2023-12-24T20:01:34.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.617+0000 7fadaf7fe700 1 -- 172.21.15.61:0/3458129134 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fadbc007690 con 0x7fadc80caa80 2023-12-24T20:01:34.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.618+0000 7fadaf7fe700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fadb4066f30 0x7fadb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:34.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.618+0000 7fadaf7fe700 1 -- 172.21.15.61:0/3458129134 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadbc0838e0 con 0x7fadc80caa80 2023-12-24T20:01:34.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.618+0000 7fadc77fe700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fadb4066f30 0x7fadb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:34.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.619+0000 7fadc77fe700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fadb4066f30 0x7fadb40693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009d10 tx=0x7fadb80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:34.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.622+0000 7fadaf7fe700 1 -- 172.21.15.61:0/3458129134 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadbc050b50 con 0x7fadc80caa80 2023-12-24T20:01:34.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.817+0000 7fadcdac2700 1 -- 172.21.15.61:0/3458129134 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fadc8169ad0 con 0x7fadb4066f30 2023-12-24T20:01:34.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.826+0000 7fadaf7fe700 1 -- 172.21.15.61:0/3458129134 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282129 (secure 0 0 0) 0x7fadc8169ad0 con 0x7fadb4066f30 2023-12-24T20:01:34.831 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 -- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fadb4066f30 msgr2=0x7fadb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fadb4066f30 0x7fadb40693e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009d10 tx=0x7fadb80091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 -- 172.21.15.61:0/3458129134 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fadc80caa80 msgr2=0x7fadc806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fadc80caa80 0x7fadc806d130 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00c7c0 tx=0x7fadbc007f30 comp rx=0 tx=0).stop 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 -- 172.21.15.61:0/3458129134 shutdown_connections 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fadc806aac0 0x7fadc814f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fadb4066f30 0x7fadb40693e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fadc8159850 0x7fadc806d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 --2- 172.21.15.61:0/3458129134 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fadc80caa80 0x7fadc806d130 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 -- 172.21.15.61:0/3458129134 >> 172.21.15.61:0/3458129134 conn(0x7fadc80cceb0 msgr2=0x7fadc80690d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 -- 172.21.15.61:0/3458129134 shutdown_connections 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:34.829+0000 7fadcdac2700 1 -- 172.21.15.61:0/3458129134 wait complete. 2023-12-24T20:01:34.834 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:01:34.843 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2023-12-24T20:01:34.373308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557296,"statfs":{"total":1600000000,"available":1594671629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709831"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671972+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671574+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:30.714451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666425+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.677573+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:59.902267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671243+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:14.179654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668937+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.673741+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:35.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.667355+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:33.913246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.667527+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:59.134553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671494+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670973+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:08:10.343325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671717+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665981+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.677233+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:18.798391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.664511+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:45:28.761106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671077+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:38.693665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671675+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:16:38.971680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.672960+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:22:37.845875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671804+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:14.617306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.673107+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:51.484516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674400+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:28.176483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670456+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:16:02.606248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674809+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:13.388896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.675831+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:21.551679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671138+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:27.166938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666057+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670646+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:37.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674436+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:38.693665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668742+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:20:33.519692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.667870+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:18.798391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669990+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671262+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669876+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679071+0000","last_change":"2023-12-24T20:01:29.679071+0000","last_active":"2023-12-24T20:01:29.679071+0000","last_peered":"2023-12-24T20:01:29.679071+0000","last_clean":"2023-12-24T20:01:29.679071+0000","last_became_active":"2023-12-24T20:01:29.678350+0000","last_became_peered":"2023-12-24T20:01:29.678350+0000","last_unstale":"2023-12-24T20:01:29.679071+0000","last_undegraded":"2023-12-24T20:01:29.679071+0000","last_fullsized":"2023-12-24T20:01:29.679071+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:43.873476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674001+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.675805+0000","last_change":"2023-12-24T20:01:29.675805+0000","last_active":"2023-12-24T20:01:29.675805+0000","last_peered":"2023-12-24T20:01:29.675805+0000","last_clean":"2023-12-24T20:01:29.675805+0000","last_became_active":"2023-12-24T20:01:29.675510+0000","last_became_peered":"2023-12-24T20:01:29.675510+0000","last_unstale":"2023-12-24T20:01:29.675805+0000","last_undegraded":"2023-12-24T20:01:29.675805+0000","last_fullsized":"2023-12-24T20:01:29.675805+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:56.278435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669539+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:59.134553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.669643+0000","last_change":"2023-12-24T20:01:29.669643+0000","last_active":"2023-12-24T20:01:29.669643+0000","last_peered":"2023-12-24T20:01:29.669643+0000","last_clean":"2023-12-24T20:01:29.669643+0000","last_became_active":"2023-12-24T20:01:29.669404+0000","last_became_peered":"2023-12-24T20:01:29.669404+0000","last_unstale":"2023-12-24T20:01:29.669643+0000","last_undegraded":"2023-12-24T20:01:29.669643+0000","last_fullsized":"2023-12-24T20:01:29.669643+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:30.205035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666283+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.669603+0000","last_change":"2023-12-24T20:01:29.669603+0000","last_active":"2023-12-24T20:01:29.669603+0000","last_peered":"2023-12-24T20:01:29.669603+0000","last_clean":"2023-12-24T20:01:29.669603+0000","last_became_active":"2023-12-24T20:01:29.669369+0000","last_became_peered":"2023-12-24T20:01:29.669369+0000","last_unstale":"2023-12-24T20:01:29.669603+0000","last_undegraded":"2023-12-24T20:01:29.669603+0000","last_fullsized":"2023-12-24T20:01:29.669603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:31.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669723+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:49:16.801499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.676516+0000","last_change":"2023-12-24T20:01:29.676516+0000","last_active":"2023-12-24T20:01:29.676516+0000","last_peered":"2023-12-24T20:01:29.676516+0000","last_clean":"2023-12-24T20:01:29.676516+0000","last_became_active":"2023-12-24T20:01:29.676280+0000","last_became_peered":"2023-12-24T20:01:29.676280+0000","last_unstale":"2023-12-24T20:01:29.676516+0000","last_undegraded":"2023-12-24T20:01:29.676516+0000","last_fullsized":"2023-12-24T20:01:29.676516+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:32.908184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670220+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.673265+0000","last_change":"2023-12-24T20:01:29.673265+0000","last_active":"2023-12-24T20:01:29.673265+0000","last_peered":"2023-12-24T20:01:29.673265+0000","last_clean":"2023-12-24T20:01:29.673265+0000","last_became_active":"2023-12-24T20:01:29.672837+0000","last_became_peered":"2023-12-24T20:01:29.672837+0000","last_unstale":"2023-12-24T20:01:29.673265+0000","last_undegraded":"2023-12-24T20:01:29.673265+0000","last_fullsized":"2023-12-24T20:01:29.673265+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:20.057436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666717+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672787+0000","last_change":"2023-12-24T20:01:29.672787+0000","last_active":"2023-12-24T20:01:29.672787+0000","last_peered":"2023-12-24T20:01:29.672787+0000","last_clean":"2023-12-24T20:01:29.672787+0000","last_became_active":"2023-12-24T20:01:29.672509+0000","last_became_peered":"2023-12-24T20:01:29.672509+0000","last_unstale":"2023-12-24T20:01:29.672787+0000","last_undegraded":"2023-12-24T20:01:29.672787+0000","last_fullsized":"2023-12-24T20:01:29.672787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:38.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.664676+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:50:59.398891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672298+0000","last_change":"2023-12-24T20:01:29.672298+0000","last_active":"2023-12-24T20:01:29.672298+0000","last_peered":"2023-12-24T20:01:29.672298+0000","last_clean":"2023-12-24T20:01:29.672298+0000","last_became_active":"2023-12-24T20:01:29.671951+0000","last_became_peered":"2023-12-24T20:01:29.671951+0000","last_unstale":"2023-12-24T20:01:29.672298+0000","last_undegraded":"2023-12-24T20:01:29.672298+0000","last_fullsized":"2023-12-24T20:01:29.672298+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:07:34.865275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.664315+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:18.050260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674193+0000","last_change":"2023-12-24T20:01:29.674193+0000","last_active":"2023-12-24T20:01:29.674193+0000","last_peered":"2023-12-24T20:01:29.674193+0000","last_clean":"2023-12-24T20:01:29.674193+0000","last_became_active":"2023-12-24T20:01:29.673869+0000","last_became_peered":"2023-12-24T20:01:29.673869+0000","last_unstale":"2023-12-24T20:01:29.674193+0000","last_undegraded":"2023-12-24T20:01:29.674193+0000","last_fullsized":"2023-12-24T20:01:29.674193+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:34.391823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668523+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:21.062498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679139+0000","last_change":"2023-12-24T20:01:29.679139+0000","last_active":"2023-12-24T20:01:29.679139+0000","last_peered":"2023-12-24T20:01:29.679139+0000","last_clean":"2023-12-24T20:01:29.679139+0000","last_became_active":"2023-12-24T20:01:29.678908+0000","last_became_peered":"2023-12-24T20:01:29.678908+0000","last_unstale":"2023-12-24T20:01:29.679139+0000","last_undegraded":"2023-12-24T20:01:29.679139+0000","last_fullsized":"2023-12-24T20:01:29.679139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:53.748891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671386+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:36:34.497869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.680251+0000","last_change":"2023-12-24T20:01:29.680251+0000","last_active":"2023-12-24T20:01:29.680251+0000","last_peered":"2023-12-24T20:01:29.680251+0000","last_clean":"2023-12-24T20:01:29.680251+0000","last_became_active":"2023-12-24T20:01:29.678811+0000","last_became_peered":"2023-12-24T20:01:29.678811+0000","last_unstale":"2023-12-24T20:01:29.680251+0000","last_undegraded":"2023-12-24T20:01:29.680251+0000","last_fullsized":"2023-12-24T20:01:29.680251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:22.049103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670020+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.677427+0000","last_change":"2023-12-24T20:01:29.677427+0000","last_active":"2023-12-24T20:01:29.677427+0000","last_peered":"2023-12-24T20:01:29.677427+0000","last_clean":"2023-12-24T20:01:29.677427+0000","last_became_active":"2023-12-24T20:01:29.677236+0000","last_became_peered":"2023-12-24T20:01:29.677236+0000","last_unstale":"2023-12-24T20:01:29.677427+0000","last_undegraded":"2023-12-24T20:01:29.677427+0000","last_fullsized":"2023-12-24T20:01:29.677427+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:15:08.313529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668711+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:23:57.708727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.667181+0000","last_change":"2023-12-24T20:01:29.667181+0000","last_active":"2023-12-24T20:01:29.667181+0000","last_peered":"2023-12-24T20:01:29.667181+0000","last_clean":"2023-12-24T20:01:29.667181+0000","last_became_active":"2023-12-24T20:01:29.666928+0000","last_became_peered":"2023-12-24T20:01:29.666928+0000","last_unstale":"2023-12-24T20:01:29.667181+0000","last_undegraded":"2023-12-24T20:01:29.667181+0000","last_fullsized":"2023-12-24T20:01:29.667181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:52.025332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665911+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.666145+0000","last_change":"2023-12-24T20:01:29.666145+0000","last_active":"2023-12-24T20:01:29.666145+0000","last_peered":"2023-12-24T20:01:29.666145+0000","last_clean":"2023-12-24T20:01:29.666145+0000","last_became_active":"2023-12-24T20:01:29.665940+0000","last_became_peered":"2023-12-24T20:01:29.665940+0000","last_unstale":"2023-12-24T20:01:29.666145+0000","last_undegraded":"2023-12-24T20:01:29.666145+0000","last_fullsized":"2023-12-24T20:01:29.666145+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:30.205035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669339+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:13.363115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.673342+0000","last_change":"2023-12-24T20:01:29.673342+0000","last_active":"2023-12-24T20:01:29.673342+0000","last_peered":"2023-12-24T20:01:29.673342+0000","last_clean":"2023-12-24T20:01:29.673342+0000","last_became_active":"2023-12-24T20:01:29.672893+0000","last_became_peered":"2023-12-24T20:01:29.672893+0000","last_unstale":"2023-12-24T20:01:29.673342+0000","last_undegraded":"2023-12-24T20:01:29.673342+0000","last_fullsized":"2023-12-24T20:01:29.673342+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:34.391823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668444+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:37.631843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.676797+0000","last_change":"2023-12-24T20:01:29.676797+0000","last_active":"2023-12-24T20:01:29.676797+0000","last_peered":"2023-12-24T20:01:29.676797+0000","last_clean":"2023-12-24T20:01:29.676797+0000","last_became_active":"2023-12-24T20:01:29.676392+0000","last_became_peered":"2023-12-24T20:01:29.676392+0000","last_unstale":"2023-12-24T20:01:29.676797+0000","last_undegraded":"2023-12-24T20:01:29.676797+0000","last_fullsized":"2023-12-24T20:01:29.676797+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:40.530541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665468+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.678929+0000","last_change":"2023-12-24T20:01:29.678929+0000","last_active":"2023-12-24T20:01:29.678929+0000","last_peered":"2023-12-24T20:01:29.678929+0000","last_clean":"2023-12-24T20:01:29.678929+0000","last_became_active":"2023-12-24T20:01:29.675007+0000","last_became_peered":"2023-12-24T20:01:29.675007+0000","last_unstale":"2023-12-24T20:01:29.678929+0000","last_undegraded":"2023-12-24T20:01:29.678929+0000","last_fullsized":"2023-12-24T20:01:29.678929+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:15:08.313529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670204+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:21.062498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674859+0000","last_change":"2023-12-24T20:01:29.674859+0000","last_active":"2023-12-24T20:01:29.674859+0000","last_peered":"2023-12-24T20:01:29.674859+0000","last_clean":"2023-12-24T20:01:29.674859+0000","last_became_active":"2023-12-24T20:01:29.674584+0000","last_became_peered":"2023-12-24T20:01:29.674584+0000","last_unstale":"2023-12-24T20:01:29.674859+0000","last_undegraded":"2023-12-24T20:01:29.674859+0000","last_fullsized":"2023-12-24T20:01:29.674859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:12.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669449+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.671113+0000","last_change":"2023-12-24T20:01:29.671113+0000","last_active":"2023-12-24T20:01:29.671113+0000","last_peered":"2023-12-24T20:01:29.671113+0000","last_clean":"2023-12-24T20:01:29.671113+0000","last_became_active":"2023-12-24T20:01:29.670833+0000","last_became_peered":"2023-12-24T20:01:29.670833+0000","last_unstale":"2023-12-24T20:01:29.671113+0000","last_undegraded":"2023-12-24T20:01:29.671113+0000","last_fullsized":"2023-12-24T20:01:29.671113+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:17.045198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.672433+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:55:23.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674484+0000","last_change":"2023-12-24T20:01:29.674484+0000","last_active":"2023-12-24T20:01:29.674484+0000","last_peered":"2023-12-24T20:01:29.674484+0000","last_clean":"2023-12-24T20:01:29.674484+0000","last_became_active":"2023-12-24T20:01:29.673766+0000","last_became_peered":"2023-12-24T20:01:29.673766+0000","last_unstale":"2023-12-24T20:01:29.674484+0000","last_undegraded":"2023-12-24T20:01:29.674484+0000","last_fullsized":"2023-12-24T20:01:29.674484+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:37.477665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666897+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:19:14.852304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679308+0000","last_change":"2023-12-24T20:01:29.679308+0000","last_active":"2023-12-24T20:01:29.679308+0000","last_peered":"2023-12-24T20:01:29.679308+0000","last_clean":"2023-12-24T20:01:29.679308+0000","last_became_active":"2023-12-24T20:01:29.678200+0000","last_became_peered":"2023-12-24T20:01:29.678200+0000","last_unstale":"2023-12-24T20:01:29.679308+0000","last_undegraded":"2023-12-24T20:01:29.679308+0000","last_fullsized":"2023-12-24T20:01:29.679308+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:37:31.083373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671983+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:35:55.532002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.678815+0000","last_change":"2023-12-24T20:01:29.678815+0000","last_active":"2023-12-24T20:01:29.678815+0000","last_peered":"2023-12-24T20:01:29.678815+0000","last_clean":"2023-12-24T20:01:29.678815+0000","last_became_active":"2023-12-24T20:01:29.678629+0000","last_became_peered":"2023-12-24T20:01:29.678629+0000","last_unstale":"2023-12-24T20:01:29.678815+0000","last_undegraded":"2023-12-24T20:01:29.678815+0000","last_fullsized":"2023-12-24T20:01:29.678815+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:30:21.747257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668662+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674009+0000","last_change":"2023-12-24T20:01:29.674009+0000","last_active":"2023-12-24T20:01:29.674009+0000","last_peered":"2023-12-24T20:01:29.674009+0000","last_clean":"2023-12-24T20:01:29.674009+0000","last_became_active":"2023-12-24T20:01:29.673781+0000","last_became_peered":"2023-12-24T20:01:29.673781+0000","last_unstale":"2023-12-24T20:01:29.674009+0000","last_undegraded":"2023-12-24T20:01:29.674009+0000","last_fullsized":"2023-12-24T20:01:29.674009+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:31.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669646+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672645+0000","last_change":"2023-12-24T20:01:29.672645+0000","last_active":"2023-12-24T20:01:29.672645+0000","last_peered":"2023-12-24T20:01:29.672645+0000","last_clean":"2023-12-24T20:01:29.672645+0000","last_became_active":"2023-12-24T20:01:29.671896+0000","last_became_peered":"2023-12-24T20:01:29.671896+0000","last_unstale":"2023-12-24T20:01:29.672645+0000","last_undegraded":"2023-12-24T20:01:29.672645+0000","last_fullsized":"2023-12-24T20:01:29.672645+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:41:42.911076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665497+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.667274+0000","last_change":"2023-12-24T20:01:29.667274+0000","last_active":"2023-12-24T20:01:29.667274+0000","last_peered":"2023-12-24T20:01:29.667274+0000","last_clean":"2023-12-24T20:01:29.667274+0000","last_became_active":"2023-12-24T20:01:29.666919+0000","last_became_peered":"2023-12-24T20:01:29.666919+0000","last_unstale":"2023-12-24T20:01:29.667274+0000","last_undegraded":"2023-12-24T20:01:29.667274+0000","last_fullsized":"2023-12-24T20:01:29.667274+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:27.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670210+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679875+0000","last_change":"2023-12-24T20:01:29.679875+0000","last_active":"2023-12-24T20:01:29.679875+0000","last_peered":"2023-12-24T20:01:29.679875+0000","last_clean":"2023-12-24T20:01:29.679875+0000","last_became_active":"2023-12-24T20:01:29.679578+0000","last_became_peered":"2023-12-24T20:01:29.679578+0000","last_unstale":"2023-12-24T20:01:29.679875+0000","last_undegraded":"2023-12-24T20:01:29.679875+0000","last_fullsized":"2023-12-24T20:01:29.679875+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:26.206071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669495+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672474+0000","last_change":"2023-12-24T20:01:29.672474+0000","last_active":"2023-12-24T20:01:29.672474+0000","last_peered":"2023-12-24T20:01:29.672474+0000","last_clean":"2023-12-24T20:01:29.672474+0000","last_became_active":"2023-12-24T20:01:29.672181+0000","last_became_peered":"2023-12-24T20:01:29.672181+0000","last_unstale":"2023-12-24T20:01:29.672474+0000","last_undegraded":"2023-12-24T20:01:29.672474+0000","last_fullsized":"2023-12-24T20:01:29.672474+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:15:18.329574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669559+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.671487+0000","last_change":"2023-12-24T20:01:29.671487+0000","last_active":"2023-12-24T20:01:29.671487+0000","last_peered":"2023-12-24T20:01:29.671487+0000","last_clean":"2023-12-24T20:01:29.671487+0000","last_became_active":"2023-12-24T20:01:29.671331+0000","last_became_peered":"2023-12-24T20:01:29.671331+0000","last_unstale":"2023-12-24T20:01:29.671487+0000","last_undegraded":"2023-12-24T20:01:29.671487+0000","last_fullsized":"2023-12-24T20:01:29.671487+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:37.477665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668310+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:50:59.398891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.675924+0000","last_change":"2023-12-24T20:01:29.675924+0000","last_active":"2023-12-24T20:01:29.675924+0000","last_peered":"2023-12-24T20:01:29.675924+0000","last_clean":"2023-12-24T20:01:29.675924+0000","last_became_active":"2023-12-24T20:01:29.675675+0000","last_became_peered":"2023-12-24T20:01:29.675675+0000","last_unstale":"2023-12-24T20:01:29.675924+0000","last_undegraded":"2023-12-24T20:01:29.675924+0000","last_fullsized":"2023-12-24T20:01:29.675924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:58.129491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665498+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.680409+0000","last_change":"2023-12-24T20:01:29.680409+0000","last_active":"2023-12-24T20:01:29.680409+0000","last_peered":"2023-12-24T20:01:29.680409+0000","last_clean":"2023-12-24T20:01:29.680409+0000","last_became_active":"2023-12-24T20:01:29.679770+0000","last_became_peered":"2023-12-24T20:01:29.679770+0000","last_unstale":"2023-12-24T20:01:29.680409+0000","last_undegraded":"2023-12-24T20:01:29.680409+0000","last_fullsized":"2023-12-24T20:01:29.680409+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:14.371806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.673608+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679483+0000","last_change":"2023-12-24T20:01:29.679483+0000","last_active":"2023-12-24T20:01:29.679483+0000","last_peered":"2023-12-24T20:01:29.679483+0000","last_clean":"2023-12-24T20:01:29.679483+0000","last_became_active":"2023-12-24T20:01:29.679256+0000","last_became_peered":"2023-12-24T20:01:29.679256+0000","last_unstale":"2023-12-24T20:01:29.679483+0000","last_undegraded":"2023-12-24T20:01:29.679483+0000","last_fullsized":"2023-12-24T20:01:29.679483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:50.021067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668021+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:59.902267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672620+0000","last_change":"2023-12-24T20:01:29.672620+0000","last_active":"2023-12-24T20:01:29.672620+0000","last_peered":"2023-12-24T20:01:29.672620+0000","last_clean":"2023-12-24T20:01:29.672620+0000","last_became_active":"2023-12-24T20:01:29.672380+0000","last_became_peered":"2023-12-24T20:01:29.672380+0000","last_unstale":"2023-12-24T20:01:29.672620+0000","last_undegraded":"2023-12-24T20:01:29.672620+0000","last_fullsized":"2023-12-24T20:01:29.672620+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:32.908184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-12-24T20:01:28.664725+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:01:28.664725+0000","last_peered":"2023-12-24T20:01:28.664725+0000","last_clean":"2023-12-24T20:01:28.664725+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:01:28.664725+0000","last_undegraded":"2023-12-24T20:01:28.664725+0000","last_fullsized":"2023-12-24T20:01:28.664725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888829,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.50900000000000001,"15min":0.497},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.50700000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81000000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44}]},{"osd":2,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80000000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.624,"15min":0.628},"min":{"1min":0.439,"5min":0.437,"15min":0.437},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67600000000000005}]},{"osd":4,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77600000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.745,"15min":0.745},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.873,"15min":0.873},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194810,"statfs":{"total":200000000,"available":199485460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.33600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80400000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.629},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.5}]},{"osd":1,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69299999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.52400000000000002},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67200000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67600000000000005,"5min":1.077,"15min":1.077},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.753,"5min":1.048,"15min":1.048},"last":0.64300000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68200000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.745,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60999999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68000000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66300000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194803,"statfs":{"total":200000000,"available":199479197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65600000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.372,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.307}]},{"osd":3,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.378},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40100000000000002,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.621},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.45100000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":0.878,"15min":0.878},"last":0.51400000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73899999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88200000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888829,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38400000000000001,"15min":0.433},"min":{"1min":0.24199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56100000000000005,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.215,"15min":0.215},"max":{"1min":0.60199999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.36099999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.246,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59799999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.31,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.30099999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.441,"15min":0.46899999999999997},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57299999999999995,"5min":2.573,"15min":2.573},"last":0.318},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.33700000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58999999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93300000000000005,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64700000000000002,"15min":0.68700000000000006},"min":{"1min":0.442,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.63}]},{"osd":5,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.625,"15min":0.624},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89500000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72799999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92100000000000004,"5min":1.655,"15min":1.655},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94299999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.752}]},{"osd":7,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69299999999999995,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194803,"statfs":{"total":200000000,"available":199479197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.24399999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48599999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.375,"15min":0.374},"min":{"1min":0.25700000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.33300000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40300000000000002,"15min":0.40400000000000003},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54000000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.443}]},{"osd":3,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.624,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.375,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":3.577,"15min":3.577},"last":0.498},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.872,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.51000000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":1.04,"15min":1.04},"last":0.621},{"interface":"front","average":{"1min":0.625,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91300000000000003,"5min":3.637,"15min":3.637},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88700000000000001,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.01,"5min":1.331,"15min":1.331},"last":0.65900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194803,"statfs":{"total":200000000,"available":199479197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.33200000000000002,"15min":0.32400000000000001},"min":{"1min":0.24299999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.502,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"min":{"1min":0.25900000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59199999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.56499999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.316,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.435},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.504}]},{"osd":4,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.59999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86799999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.60199999999999998},"min":{"1min":0.49299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.94999999999999996,"5min":1.337,"15min":1.337},"last":0.54700000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.626,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92400000000000004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88500000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.78800000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65000000000000002,"15min":0.63400000000000001},"min":{"1min":0.54600000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.0149999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":1.006,"15min":1.006},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194810,"statfs":{"total":200000000,"available":199485460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.34399999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71199999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.373}]},{"osd":1,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.65200000000000002,"15min":0.73799999999999999},"min":{"1min":0.379,"5min":0.378,"15min":0.378},"max":{"1min":0.69199999999999995,"5min":4.883,"15min":4.883},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.544,"15min":1.544},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72699999999999998,"5min":0.88,"15min":0.88},"last":0.433},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72099999999999997,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.35399999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70599999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.748,"15min":0.92200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77300000000000002,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.496,"15min":0.52800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.745,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.58299999999999996,"15min":0.65900000000000003},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.83299999999999996,"15min":1.119},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75600000000000001,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.31,"15min":0.31},"max":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194810,"statfs":{"total":200000000,"available":199485460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52200000000000002,"15min":0.50600000000000001},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57599999999999996,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79200000000000004,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.746,"5min":1.847,"15min":1.847},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72399999999999998,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.40100000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.51900000000000002},"min":{"1min":0.42899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68000000000000005,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":1.97,"15min":1.97},"last":0.53600000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.56799999999999995},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.76600000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.5},{"interface":"front","average":{"1min":0.626,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.752,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57299999999999995}]},{"osd":4,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.67400000000000004,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53600000000000003,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.55600000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.47299999999999998},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66100000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":3.766,"15min":3.766},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.64800000000000002}]}]}],"pool_statfs":[]}} 2023-12-24T20:01:34.848 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:01:35.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.003+0000 7f71cf8de700 1 Processor -- start 2023-12-24T20:01:35.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.003+0000 7f71cf8de700 1 -- start start 2023-12-24T20:01:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cf8de700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f71c80af710 0x7f71c80afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cf8de700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71c8068c80 0x7f71c8067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cf8de700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c80687f0 con 0x7f71c80a6c80 2023-12-24T20:01:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cf8de700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c80a7100 con 0x7f71c80af710 2023-12-24T20:01:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cf8de700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8067be0 con 0x7f71c8068c80 2023-12-24T20:01:35.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cd67a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f71c80af710 0x7f71c80afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cde7b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f71c80a6c80 0x7f71c815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42076/0 (socket says 172.21.15.61:42076) 2023-12-24T20:01:35.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cde7b700 1 -- 172.21.15.61:0/2369701553 learned_addr learned my addr 172.21.15.61:0/2369701553 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:35.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cd67a700 1 -- 172.21.15.61:0/2369701553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71c8068c80 msgr2=0x7f71c8067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:35.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cd67a700 1 --2- 172.21.15.61:0/2369701553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71c8068c80 0x7f71c8067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cd67a700 1 -- 172.21.15.61:0/2369701553 >> v1:172.21.15.61:6789/0 conn(0x7f71c80a6c80 legacy=0x7f71c815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71cd67a700 1 -- 172.21.15.61:0/2369701553 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8067ec0 con 0x7f71c80af710 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.004+0000 7f71bffff700 1 -- 172.21.15.61:0/2369701553 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924171567 0 0) 0x7f71c80687f0 con 0x7f71c80a6c80 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71cd67a700 1 --2- 172.21.15.61:0/2369701553 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c80af710 0x7f71c80afae0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f71b80098e0 tx=0x7f71b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29c96582235316d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71bffff700 1 -- 172.21.15.61:0/2369701553 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8009e80 con 0x7f71c80af710 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71bffff700 1 -- 172.21.15.61:0/2369701553 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b800b860 con 0x7f71c80af710 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71bffff700 1 -- 172.21.15.61:0/2369701553 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b800bbe0 con 0x7f71c80af710 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71cf8de700 1 -- 172.21.15.61:0/2369701553 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c80af710 msgr2=0x7f71c80afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71cf8de700 1 --2- 172.21.15.61:0/2369701553 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c80af710 0x7f71c80afae0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f71b80098e0 tx=0x7f71b80091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71cf8de700 1 -- 172.21.15.61:0/2369701553 shutdown_connections 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71cf8de700 1 --2- 172.21.15.61:0/2369701553 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c80af710 0x7f71c80afae0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71cf8de700 1 --2- 172.21.15.61:0/2369701553 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71c8068c80 0x7f71c8067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71cf8de700 1 -- 172.21.15.61:0/2369701553 >> 172.21.15.61:0/2369701553 conn(0x7f71c80ca200 msgr2=0x7f71c80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:35.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71cf8de700 1 -- 172.21.15.61:0/2369701553 shutdown_connections 2023-12-24T20:01:35.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.005+0000 7f71cf8de700 1 -- 172.21.15.61:0/2369701553 wait complete. 2023-12-24T20:01:35.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.007+0000 7f71cf8de700 1 Processor -- start 2023-12-24T20:01:35.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.007+0000 7f71cf8de700 1 -- start start 2023-12-24T20:01:35.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.007+0000 7f71cf8de700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c8068c80 0x7f71c8156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.007+0000 7f71cf8de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71c80a6c80 0x7f71c815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.007+0000 7f71cf8de700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71c80af710 0x7f71c815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.007+0000 7f71cf8de700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c81567b0 con 0x7f71c8068c80 2023-12-24T20:01:35.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.007+0000 7f71cf8de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8159910 con 0x7f71c80a6c80 2023-12-24T20:01:35.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.007+0000 7f71cf8de700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c8159bf0 con 0x7f71c80af710 2023-12-24T20:01:35.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cd67a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c8068c80 0x7f71c8156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cd67a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c8068c80 0x7f71c8156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50226/0 (socket says 172.21.15.61:50226) 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cd67a700 1 -- 172.21.15.61:0/2563708164 learned_addr learned my addr 172.21.15.61:0/2563708164 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cde7b700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71c80af710 0x7f71c815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cce79700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71c80a6c80 0x7f71c815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cd67a700 1 -- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71c80af710 msgr2=0x7f71c815aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cd67a700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71c80af710 0x7f71c815aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cd67a700 1 -- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71c80a6c80 msgr2=0x7f71c815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cd67a700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71c80a6c80 0x7f71c815a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cd67a700 1 -- 172.21.15.61:0/2563708164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8009420 con 0x7f71c8068c80 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cde7b700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71c80af710 0x7f71c815aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cd67a700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c8068c80 0x7f71c8156270 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f71c806c9e0 tx=0x7f71b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71bd7fa700 1 -- 172.21.15.61:0/2563708164 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b801f070 con 0x7f71c8068c80 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71bd7fa700 1 -- 172.21.15.61:0/2563708164 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b8000c40 con 0x7f71c8068c80 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cf8de700 1 -- 172.21.15.61:0/2563708164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c8159ed0 con 0x7f71c8068c80 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71bd7fa700 1 -- 172.21.15.61:0/2563708164 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8006e50 con 0x7f71c8068c80 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.008+0000 7f71cf8de700 1 -- 172.21.15.61:0/2563708164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c80b2440 con 0x7f71c8068c80 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.009+0000 7f71cf8de700 1 -- 172.21.15.61:0/2563708164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c804c3c0 con 0x7f71c8068c80 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.010+0000 7f71bd7fa700 1 -- 172.21.15.61:0/2563708164 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f71b8023070 con 0x7f71c8068c80 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.010+0000 7f71bd7fa700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71ac066f30 0x7f71ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.010+0000 7f71bd7fa700 1 -- 172.21.15.61:0/2563708164 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71b8085aa0 con 0x7f71c8068c80 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.010+0000 7f71cce79700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71ac066f30 0x7f71ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.011+0000 7f71cce79700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71ac066f30 0x7f71ac0693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f71c8150a40 tx=0x7f71c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:35.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.014+0000 7f71bd7fa700 1 -- 172.21.15.61:0/2563708164 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71b8052d50 con 0x7f71c8068c80 2023-12-24T20:01:35.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.203+0000 7f71cf8de700 1 -- 172.21.15.61:0/2563708164 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71c806f110 con 0x7f71ac066f30 2023-12-24T20:01:35.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.212+0000 7f71bd7fa700 1 -- 172.21.15.61:0/2563708164 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282129 (secure 0 0 0) 0x7f71c806f110 con 0x7f71ac066f30 2023-12-24T20:01:35.216 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:35.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 -- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71ac066f30 msgr2=0x7f71ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71ac066f30 0x7f71ac0693e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f71c8150a40 tx=0x7f71c4008040 comp rx=0 tx=0).stop 2023-12-24T20:01:35.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 -- 172.21.15.61:0/2563708164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c8068c80 msgr2=0x7f71c8156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c8068c80 0x7f71c8156270 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f71c806c9e0 tx=0x7f71b8017000 comp rx=0 tx=0).stop 2023-12-24T20:01:35.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 -- 172.21.15.61:0/2563708164 shutdown_connections 2023-12-24T20:01:35.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71c80af710 0x7f71c815aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71ac066f30 0x7f71ac0693e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71c8068c80 0x7f71c8156270 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 --2- 172.21.15.61:0/2563708164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71c80a6c80 0x7f71c815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 -- 172.21.15.61:0/2563708164 >> 172.21.15.61:0/2563708164 conn(0x7f71c80ca200 msgr2=0x7f71c8150f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:35.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 -- 172.21.15.61:0/2563708164 shutdown_connections 2023-12-24T20:01:35.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.215+0000 7f71cf8de700 1 -- 172.21.15.61:0/2563708164 wait complete. 2023-12-24T20:01:35.219 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:01:35.228 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2023-12-24T20:01:34.373308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557296,"statfs":{"total":1600000000,"available":1594671629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709831"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671972+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671574+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:30.714451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666425+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.677573+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:59.902267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671243+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:14.179654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668937+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.673741+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:35.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.667355+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:33.913246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.667527+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:59.134553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671494+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670973+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:08:10.343325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671717+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665981+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.677233+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:18.798391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.664511+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:45:28.761106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671077+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:38.693665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671675+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:16:38.971680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.672960+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:22:37.845875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671804+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:14.617306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.673107+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:51.484516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674400+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:28.176483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670456+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:16:02.606248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674809+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:13.388896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.675831+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:21.551679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671138+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:27.166938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666057+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670646+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:37.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674436+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:38.693665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668742+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:20:33.519692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.667870+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:18.798391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669990+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671262+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669876+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679071+0000","last_change":"2023-12-24T20:01:29.679071+0000","last_active":"2023-12-24T20:01:29.679071+0000","last_peered":"2023-12-24T20:01:29.679071+0000","last_clean":"2023-12-24T20:01:29.679071+0000","last_became_active":"2023-12-24T20:01:29.678350+0000","last_became_peered":"2023-12-24T20:01:29.678350+0000","last_unstale":"2023-12-24T20:01:29.679071+0000","last_undegraded":"2023-12-24T20:01:29.679071+0000","last_fullsized":"2023-12-24T20:01:29.679071+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:43.873476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674001+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.675805+0000","last_change":"2023-12-24T20:01:29.675805+0000","last_active":"2023-12-24T20:01:29.675805+0000","last_peered":"2023-12-24T20:01:29.675805+0000","last_clean":"2023-12-24T20:01:29.675805+0000","last_became_active":"2023-12-24T20:01:29.675510+0000","last_became_peered":"2023-12-24T20:01:29.675510+0000","last_unstale":"2023-12-24T20:01:29.675805+0000","last_undegraded":"2023-12-24T20:01:29.675805+0000","last_fullsized":"2023-12-24T20:01:29.675805+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:56.278435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669539+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:59.134553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.669643+0000","last_change":"2023-12-24T20:01:29.669643+0000","last_active":"2023-12-24T20:01:29.669643+0000","last_peered":"2023-12-24T20:01:29.669643+0000","last_clean":"2023-12-24T20:01:29.669643+0000","last_became_active":"2023-12-24T20:01:29.669404+0000","last_became_peered":"2023-12-24T20:01:29.669404+0000","last_unstale":"2023-12-24T20:01:29.669643+0000","last_undegraded":"2023-12-24T20:01:29.669643+0000","last_fullsized":"2023-12-24T20:01:29.669643+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:30.205035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666283+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.669603+0000","last_change":"2023-12-24T20:01:29.669603+0000","last_active":"2023-12-24T20:01:29.669603+0000","last_peered":"2023-12-24T20:01:29.669603+0000","last_clean":"2023-12-24T20:01:29.669603+0000","last_became_active":"2023-12-24T20:01:29.669369+0000","last_became_peered":"2023-12-24T20:01:29.669369+0000","last_unstale":"2023-12-24T20:01:29.669603+0000","last_undegraded":"2023-12-24T20:01:29.669603+0000","last_fullsized":"2023-12-24T20:01:29.669603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:31.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669723+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:49:16.801499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.676516+0000","last_change":"2023-12-24T20:01:29.676516+0000","last_active":"2023-12-24T20:01:29.676516+0000","last_peered":"2023-12-24T20:01:29.676516+0000","last_clean":"2023-12-24T20:01:29.676516+0000","last_became_active":"2023-12-24T20:01:29.676280+0000","last_became_peered":"2023-12-24T20:01:29.676280+0000","last_unstale":"2023-12-24T20:01:29.676516+0000","last_undegraded":"2023-12-24T20:01:29.676516+0000","last_fullsized":"2023-12-24T20:01:29.676516+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:32.908184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670220+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.673265+0000","last_change":"2023-12-24T20:01:29.673265+0000","last_active":"2023-12-24T20:01:29.673265+0000","last_peered":"2023-12-24T20:01:29.673265+0000","last_clean":"2023-12-24T20:01:29.673265+0000","last_became_active":"2023-12-24T20:01:29.672837+0000","last_became_peered":"2023-12-24T20:01:29.672837+0000","last_unstale":"2023-12-24T20:01:29.673265+0000","last_undegraded":"2023-12-24T20:01:29.673265+0000","last_fullsized":"2023-12-24T20:01:29.673265+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:20.057436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666717+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672787+0000","last_change":"2023-12-24T20:01:29.672787+0000","last_active":"2023-12-24T20:01:29.672787+0000","last_peered":"2023-12-24T20:01:29.672787+0000","last_clean":"2023-12-24T20:01:29.672787+0000","last_became_active":"2023-12-24T20:01:29.672509+0000","last_became_peered":"2023-12-24T20:01:29.672509+0000","last_unstale":"2023-12-24T20:01:29.672787+0000","last_undegraded":"2023-12-24T20:01:29.672787+0000","last_fullsized":"2023-12-24T20:01:29.672787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:38.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.664676+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:50:59.398891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672298+0000","last_change":"2023-12-24T20:01:29.672298+0000","last_active":"2023-12-24T20:01:29.672298+0000","last_peered":"2023-12-24T20:01:29.672298+0000","last_clean":"2023-12-24T20:01:29.672298+0000","last_became_active":"2023-12-24T20:01:29.671951+0000","last_became_peered":"2023-12-24T20:01:29.671951+0000","last_unstale":"2023-12-24T20:01:29.672298+0000","last_undegraded":"2023-12-24T20:01:29.672298+0000","last_fullsized":"2023-12-24T20:01:29.672298+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:07:34.865275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.664315+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:18.050260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674193+0000","last_change":"2023-12-24T20:01:29.674193+0000","last_active":"2023-12-24T20:01:29.674193+0000","last_peered":"2023-12-24T20:01:29.674193+0000","last_clean":"2023-12-24T20:01:29.674193+0000","last_became_active":"2023-12-24T20:01:29.673869+0000","last_became_peered":"2023-12-24T20:01:29.673869+0000","last_unstale":"2023-12-24T20:01:29.674193+0000","last_undegraded":"2023-12-24T20:01:29.674193+0000","last_fullsized":"2023-12-24T20:01:29.674193+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:34.391823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668523+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:21.062498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679139+0000","last_change":"2023-12-24T20:01:29.679139+0000","last_active":"2023-12-24T20:01:29.679139+0000","last_peered":"2023-12-24T20:01:29.679139+0000","last_clean":"2023-12-24T20:01:29.679139+0000","last_became_active":"2023-12-24T20:01:29.678908+0000","last_became_peered":"2023-12-24T20:01:29.678908+0000","last_unstale":"2023-12-24T20:01:29.679139+0000","last_undegraded":"2023-12-24T20:01:29.679139+0000","last_fullsized":"2023-12-24T20:01:29.679139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:53.748891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671386+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:36:34.497869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.680251+0000","last_change":"2023-12-24T20:01:29.680251+0000","last_active":"2023-12-24T20:01:29.680251+0000","last_peered":"2023-12-24T20:01:29.680251+0000","last_clean":"2023-12-24T20:01:29.680251+0000","last_became_active":"2023-12-24T20:01:29.678811+0000","last_became_peered":"2023-12-24T20:01:29.678811+0000","last_unstale":"2023-12-24T20:01:29.680251+0000","last_undegraded":"2023-12-24T20:01:29.680251+0000","last_fullsized":"2023-12-24T20:01:29.680251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:22.049103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670020+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.677427+0000","last_change":"2023-12-24T20:01:29.677427+0000","last_active":"2023-12-24T20:01:29.677427+0000","last_peered":"2023-12-24T20:01:29.677427+0000","last_clean":"2023-12-24T20:01:29.677427+0000","last_became_active":"2023-12-24T20:01:29.677236+0000","last_became_peered":"2023-12-24T20:01:29.677236+0000","last_unstale":"2023-12-24T20:01:29.677427+0000","last_undegraded":"2023-12-24T20:01:29.677427+0000","last_fullsized":"2023-12-24T20:01:29.677427+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:15:08.313529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668711+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:23:57.708727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.667181+0000","last_change":"2023-12-24T20:01:29.667181+0000","last_active":"2023-12-24T20:01:29.667181+0000","last_peered":"2023-12-24T20:01:29.667181+0000","last_clean":"2023-12-24T20:01:29.667181+0000","last_became_active":"2023-12-24T20:01:29.666928+0000","last_became_peered":"2023-12-24T20:01:29.666928+0000","last_unstale":"2023-12-24T20:01:29.667181+0000","last_undegraded":"2023-12-24T20:01:29.667181+0000","last_fullsized":"2023-12-24T20:01:29.667181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:52.025332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665911+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.666145+0000","last_change":"2023-12-24T20:01:29.666145+0000","last_active":"2023-12-24T20:01:29.666145+0000","last_peered":"2023-12-24T20:01:29.666145+0000","last_clean":"2023-12-24T20:01:29.666145+0000","last_became_active":"2023-12-24T20:01:29.665940+0000","last_became_peered":"2023-12-24T20:01:29.665940+0000","last_unstale":"2023-12-24T20:01:29.666145+0000","last_undegraded":"2023-12-24T20:01:29.666145+0000","last_fullsized":"2023-12-24T20:01:29.666145+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:30.205035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669339+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:13.363115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.673342+0000","last_change":"2023-12-24T20:01:29.673342+0000","last_active":"2023-12-24T20:01:29.673342+0000","last_peered":"2023-12-24T20:01:29.673342+0000","last_clean":"2023-12-24T20:01:29.673342+0000","last_became_active":"2023-12-24T20:01:29.672893+0000","last_became_peered":"2023-12-24T20:01:29.672893+0000","last_unstale":"2023-12-24T20:01:29.673342+0000","last_undegraded":"2023-12-24T20:01:29.673342+0000","last_fullsized":"2023-12-24T20:01:29.673342+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:34.391823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668444+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:37.631843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.676797+0000","last_change":"2023-12-24T20:01:29.676797+0000","last_active":"2023-12-24T20:01:29.676797+0000","last_peered":"2023-12-24T20:01:29.676797+0000","last_clean":"2023-12-24T20:01:29.676797+0000","last_became_active":"2023-12-24T20:01:29.676392+0000","last_became_peered":"2023-12-24T20:01:29.676392+0000","last_unstale":"2023-12-24T20:01:29.676797+0000","last_undegraded":"2023-12-24T20:01:29.676797+0000","last_fullsized":"2023-12-24T20:01:29.676797+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:40.530541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665468+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.678929+0000","last_change":"2023-12-24T20:01:29.678929+0000","last_active":"2023-12-24T20:01:29.678929+0000","last_peered":"2023-12-24T20:01:29.678929+0000","last_clean":"2023-12-24T20:01:29.678929+0000","last_became_active":"2023-12-24T20:01:29.675007+0000","last_became_peered":"2023-12-24T20:01:29.675007+0000","last_unstale":"2023-12-24T20:01:29.678929+0000","last_undegraded":"2023-12-24T20:01:29.678929+0000","last_fullsized":"2023-12-24T20:01:29.678929+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:15:08.313529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670204+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:21.062498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674859+0000","last_change":"2023-12-24T20:01:29.674859+0000","last_active":"2023-12-24T20:01:29.674859+0000","last_peered":"2023-12-24T20:01:29.674859+0000","last_clean":"2023-12-24T20:01:29.674859+0000","last_became_active":"2023-12-24T20:01:29.674584+0000","last_became_peered":"2023-12-24T20:01:29.674584+0000","last_unstale":"2023-12-24T20:01:29.674859+0000","last_undegraded":"2023-12-24T20:01:29.674859+0000","last_fullsized":"2023-12-24T20:01:29.674859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:12.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669449+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.671113+0000","last_change":"2023-12-24T20:01:29.671113+0000","last_active":"2023-12-24T20:01:29.671113+0000","last_peered":"2023-12-24T20:01:29.671113+0000","last_clean":"2023-12-24T20:01:29.671113+0000","last_became_active":"2023-12-24T20:01:29.670833+0000","last_became_peered":"2023-12-24T20:01:29.670833+0000","last_unstale":"2023-12-24T20:01:29.671113+0000","last_undegraded":"2023-12-24T20:01:29.671113+0000","last_fullsized":"2023-12-24T20:01:29.671113+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:17.045198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.672433+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:55:23.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674484+0000","last_change":"2023-12-24T20:01:29.674484+0000","last_active":"2023-12-24T20:01:29.674484+0000","last_peered":"2023-12-24T20:01:29.674484+0000","last_clean":"2023-12-24T20:01:29.674484+0000","last_became_active":"2023-12-24T20:01:29.673766+0000","last_became_peered":"2023-12-24T20:01:29.673766+0000","last_unstale":"2023-12-24T20:01:29.674484+0000","last_undegraded":"2023-12-24T20:01:29.674484+0000","last_fullsized":"2023-12-24T20:01:29.674484+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:37.477665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666897+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:19:14.852304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679308+0000","last_change":"2023-12-24T20:01:29.679308+0000","last_active":"2023-12-24T20:01:29.679308+0000","last_peered":"2023-12-24T20:01:29.679308+0000","last_clean":"2023-12-24T20:01:29.679308+0000","last_became_active":"2023-12-24T20:01:29.678200+0000","last_became_peered":"2023-12-24T20:01:29.678200+0000","last_unstale":"2023-12-24T20:01:29.679308+0000","last_undegraded":"2023-12-24T20:01:29.679308+0000","last_fullsized":"2023-12-24T20:01:29.679308+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:37:31.083373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671983+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:35:55.532002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.678815+0000","last_change":"2023-12-24T20:01:29.678815+0000","last_active":"2023-12-24T20:01:29.678815+0000","last_peered":"2023-12-24T20:01:29.678815+0000","last_clean":"2023-12-24T20:01:29.678815+0000","last_became_active":"2023-12-24T20:01:29.678629+0000","last_became_peered":"2023-12-24T20:01:29.678629+0000","last_unstale":"2023-12-24T20:01:29.678815+0000","last_undegraded":"2023-12-24T20:01:29.678815+0000","last_fullsized":"2023-12-24T20:01:29.678815+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:30:21.747257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668662+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674009+0000","last_change":"2023-12-24T20:01:29.674009+0000","last_active":"2023-12-24T20:01:29.674009+0000","last_peered":"2023-12-24T20:01:29.674009+0000","last_clean":"2023-12-24T20:01:29.674009+0000","last_became_active":"2023-12-24T20:01:29.673781+0000","last_became_peered":"2023-12-24T20:01:29.673781+0000","last_unstale":"2023-12-24T20:01:29.674009+0000","last_undegraded":"2023-12-24T20:01:29.674009+0000","last_fullsized":"2023-12-24T20:01:29.674009+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:31.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669646+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672645+0000","last_change":"2023-12-24T20:01:29.672645+0000","last_active":"2023-12-24T20:01:29.672645+0000","last_peered":"2023-12-24T20:01:29.672645+0000","last_clean":"2023-12-24T20:01:29.672645+0000","last_became_active":"2023-12-24T20:01:29.671896+0000","last_became_peered":"2023-12-24T20:01:29.671896+0000","last_unstale":"2023-12-24T20:01:29.672645+0000","last_undegraded":"2023-12-24T20:01:29.672645+0000","last_fullsized":"2023-12-24T20:01:29.672645+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:41:42.911076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665497+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.667274+0000","last_change":"2023-12-24T20:01:29.667274+0000","last_active":"2023-12-24T20:01:29.667274+0000","last_peered":"2023-12-24T20:01:29.667274+0000","last_clean":"2023-12-24T20:01:29.667274+0000","last_became_active":"2023-12-24T20:01:29.666919+0000","last_became_peered":"2023-12-24T20:01:29.666919+0000","last_unstale":"2023-12-24T20:01:29.667274+0000","last_undegraded":"2023-12-24T20:01:29.667274+0000","last_fullsized":"2023-12-24T20:01:29.667274+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:27.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670210+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679875+0000","last_change":"2023-12-24T20:01:29.679875+0000","last_active":"2023-12-24T20:01:29.679875+0000","last_peered":"2023-12-24T20:01:29.679875+0000","last_clean":"2023-12-24T20:01:29.679875+0000","last_became_active":"2023-12-24T20:01:29.679578+0000","last_became_peered":"2023-12-24T20:01:29.679578+0000","last_unstale":"2023-12-24T20:01:29.679875+0000","last_undegraded":"2023-12-24T20:01:29.679875+0000","last_fullsized":"2023-12-24T20:01:29.679875+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:26.206071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669495+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672474+0000","last_change":"2023-12-24T20:01:29.672474+0000","last_active":"2023-12-24T20:01:29.672474+0000","last_peered":"2023-12-24T20:01:29.672474+0000","last_clean":"2023-12-24T20:01:29.672474+0000","last_became_active":"2023-12-24T20:01:29.672181+0000","last_became_peered":"2023-12-24T20:01:29.672181+0000","last_unstale":"2023-12-24T20:01:29.672474+0000","last_undegraded":"2023-12-24T20:01:29.672474+0000","last_fullsized":"2023-12-24T20:01:29.672474+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:15:18.329574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669559+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.671487+0000","last_change":"2023-12-24T20:01:29.671487+0000","last_active":"2023-12-24T20:01:29.671487+0000","last_peered":"2023-12-24T20:01:29.671487+0000","last_clean":"2023-12-24T20:01:29.671487+0000","last_became_active":"2023-12-24T20:01:29.671331+0000","last_became_peered":"2023-12-24T20:01:29.671331+0000","last_unstale":"2023-12-24T20:01:29.671487+0000","last_undegraded":"2023-12-24T20:01:29.671487+0000","last_fullsized":"2023-12-24T20:01:29.671487+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:37.477665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668310+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:50:59.398891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.675924+0000","last_change":"2023-12-24T20:01:29.675924+0000","last_active":"2023-12-24T20:01:29.675924+0000","last_peered":"2023-12-24T20:01:29.675924+0000","last_clean":"2023-12-24T20:01:29.675924+0000","last_became_active":"2023-12-24T20:01:29.675675+0000","last_became_peered":"2023-12-24T20:01:29.675675+0000","last_unstale":"2023-12-24T20:01:29.675924+0000","last_undegraded":"2023-12-24T20:01:29.675924+0000","last_fullsized":"2023-12-24T20:01:29.675924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:58.129491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665498+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.680409+0000","last_change":"2023-12-24T20:01:29.680409+0000","last_active":"2023-12-24T20:01:29.680409+0000","last_peered":"2023-12-24T20:01:29.680409+0000","last_clean":"2023-12-24T20:01:29.680409+0000","last_became_active":"2023-12-24T20:01:29.679770+0000","last_became_peered":"2023-12-24T20:01:29.679770+0000","last_unstale":"2023-12-24T20:01:29.680409+0000","last_undegraded":"2023-12-24T20:01:29.680409+0000","last_fullsized":"2023-12-24T20:01:29.680409+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:14.371806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.673608+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679483+0000","last_change":"2023-12-24T20:01:29.679483+0000","last_active":"2023-12-24T20:01:29.679483+0000","last_peered":"2023-12-24T20:01:29.679483+0000","last_clean":"2023-12-24T20:01:29.679483+0000","last_became_active":"2023-12-24T20:01:29.679256+0000","last_became_peered":"2023-12-24T20:01:29.679256+0000","last_unstale":"2023-12-24T20:01:29.679483+0000","last_undegraded":"2023-12-24T20:01:29.679483+0000","last_fullsized":"2023-12-24T20:01:29.679483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:50.021067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668021+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:59.902267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672620+0000","last_change":"2023-12-24T20:01:29.672620+0000","last_active":"2023-12-24T20:01:29.672620+0000","last_peered":"2023-12-24T20:01:29.672620+0000","last_clean":"2023-12-24T20:01:29.672620+0000","last_became_active":"2023-12-24T20:01:29.672380+0000","last_became_peered":"2023-12-24T20:01:29.672380+0000","last_unstale":"2023-12-24T20:01:29.672620+0000","last_undegraded":"2023-12-24T20:01:29.672620+0000","last_fullsized":"2023-12-24T20:01:29.672620+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:32.908184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-12-24T20:01:28.664725+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:01:28.664725+0000","last_peered":"2023-12-24T20:01:28.664725+0000","last_clean":"2023-12-24T20:01:28.664725+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:01:28.664725+0000","last_undegraded":"2023-12-24T20:01:28.664725+0000","last_fullsized":"2023-12-24T20:01:28.664725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888829,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.50900000000000001,"15min":0.497},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.50700000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81000000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44}]},{"osd":2,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80000000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.624,"15min":0.628},"min":{"1min":0.439,"5min":0.437,"15min":0.437},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67600000000000005}]},{"osd":4,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77600000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.745,"15min":0.745},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.873,"15min":0.873},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194810,"statfs":{"total":200000000,"available":199485460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.33600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80400000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.629},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.5}]},{"osd":1,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69299999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.52400000000000002},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67200000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67600000000000005,"5min":1.077,"15min":1.077},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.753,"5min":1.048,"15min":1.048},"last":0.64300000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68200000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.745,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60999999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68000000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66300000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194803,"statfs":{"total":200000000,"available":199479197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65600000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.372,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.307}]},{"osd":3,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.378},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40100000000000002,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.621},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.45100000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":0.878,"15min":0.878},"last":0.51400000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73899999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88200000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888829,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38400000000000001,"15min":0.433},"min":{"1min":0.24199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56100000000000005,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.215,"15min":0.215},"max":{"1min":0.60199999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.36099999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.246,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59799999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.31,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.30099999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.441,"15min":0.46899999999999997},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57299999999999995,"5min":2.573,"15min":2.573},"last":0.318},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.33700000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58999999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93300000000000005,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64700000000000002,"15min":0.68700000000000006},"min":{"1min":0.442,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.63}]},{"osd":5,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.625,"15min":0.624},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89500000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72799999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92100000000000004,"5min":1.655,"15min":1.655},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94299999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.752}]},{"osd":7,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69299999999999995,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194803,"statfs":{"total":200000000,"available":199479197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.24399999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48599999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.375,"15min":0.374},"min":{"1min":0.25700000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.33300000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40300000000000002,"15min":0.40400000000000003},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54000000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.443}]},{"osd":3,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.624,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.375,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":3.577,"15min":3.577},"last":0.498},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.872,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.51000000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":1.04,"15min":1.04},"last":0.621},{"interface":"front","average":{"1min":0.625,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91300000000000003,"5min":3.637,"15min":3.637},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88700000000000001,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.01,"5min":1.331,"15min":1.331},"last":0.65900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194803,"statfs":{"total":200000000,"available":199479197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.33200000000000002,"15min":0.32400000000000001},"min":{"1min":0.24299999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.502,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"min":{"1min":0.25900000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59199999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.56499999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.316,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.435},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.504}]},{"osd":4,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.59999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86799999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.60199999999999998},"min":{"1min":0.49299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.94999999999999996,"5min":1.337,"15min":1.337},"last":0.54700000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.626,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92400000000000004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88500000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.78800000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65000000000000002,"15min":0.63400000000000001},"min":{"1min":0.54600000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.0149999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":1.006,"15min":1.006},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194810,"statfs":{"total":200000000,"available":199485460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.34399999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71199999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.373}]},{"osd":1,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.65200000000000002,"15min":0.73799999999999999},"min":{"1min":0.379,"5min":0.378,"15min":0.378},"max":{"1min":0.69199999999999995,"5min":4.883,"15min":4.883},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.544,"15min":1.544},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72699999999999998,"5min":0.88,"15min":0.88},"last":0.433},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72099999999999997,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.35399999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70599999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.748,"15min":0.92200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77300000000000002,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.496,"15min":0.52800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.745,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.58299999999999996,"15min":0.65900000000000003},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.83299999999999996,"15min":1.119},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75600000000000001,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.31,"15min":0.31},"max":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194810,"statfs":{"total":200000000,"available":199485460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52200000000000002,"15min":0.50600000000000001},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57599999999999996,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79200000000000004,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.746,"5min":1.847,"15min":1.847},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72399999999999998,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.40100000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.51900000000000002},"min":{"1min":0.42899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68000000000000005,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":1.97,"15min":1.97},"last":0.53600000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.56799999999999995},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.76600000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.5},{"interface":"front","average":{"1min":0.626,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.752,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57299999999999995}]},{"osd":4,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.67400000000000004,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53600000000000003,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.55600000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.47299999999999998},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66100000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":3.766,"15min":3.766},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.64800000000000002}]}]}],"pool_statfs":[]}} 2023-12-24T20:01:35.233 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:01:35.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.389+0000 7f0aec573700 1 Processor -- start 2023-12-24T20:01:35.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.389+0000 7f0aec573700 1 -- start start 2023-12-24T20:01:35.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0aec573700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0ae40b3d30 0x7f0ae40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0aec573700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae40b2890 con 0x7f0ae4068140 2023-12-24T20:01:35.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0aec573700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae40cf630 con 0x7f0ae4068510 2023-12-24T20:01:35.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0aec573700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae40b2240 con 0x7f0ae40b3d30 2023-12-24T20:01:35.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0aeab10700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0ae40b3d30 0x7f0ae40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0aea30f700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0ae4068140 0x7f0ae40b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42080/0 (socket says 172.21.15.61:42080) 2023-12-24T20:01:35.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0aea30f700 1 -- 172.21.15.61:0/3023509664 learned_addr learned my addr 172.21.15.61:0/3023509664 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:35.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0aeab10700 1 -- 172.21.15.61:0/3023509664 >> v1:172.21.15.133:6789/0 conn(0x7f0ae4068510 legacy=0x7f0ae4159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0aeab10700 1 -- 172.21.15.61:0/3023509664 >> v1:172.21.15.61:6789/0 conn(0x7f0ae4068140 legacy=0x7f0ae40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0aeab10700 1 -- 172.21.15.61:0/3023509664 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae40b2520 con 0x7f0ae40b3d30 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.390+0000 7f0ae930d700 1 -- 172.21.15.61:0/3023509664 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470966243 0 0) 0x7f0ae40b2890 con 0x7f0ae4068140 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0aeab10700 1 --2- 172.21.15.61:0/3023509664 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 0x7f0ae40cefa0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009e60 tx=0x7f0adc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8108bfd7c6b50ab1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0ae930d700 1 -- 172.21.15.61:0/3023509664 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00e070 con 0x7f0ae40b3d30 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0ae930d700 1 -- 172.21.15.61:0/3023509664 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc00bc30 con 0x7f0ae40b3d30 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0ae930d700 1 -- 172.21.15.61:0/3023509664 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc012430 con 0x7f0ae40b3d30 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0aec573700 1 -- 172.21.15.61:0/3023509664 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 msgr2=0x7f0ae40cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0aec573700 1 --2- 172.21.15.61:0/3023509664 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 0x7f0ae40cefa0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009e60 tx=0x7f0adc009780 comp rx=0 tx=0).stop 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0aec573700 1 -- 172.21.15.61:0/3023509664 shutdown_connections 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0aec573700 1 --2- 172.21.15.61:0/3023509664 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 0x7f0ae40cefa0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0aec573700 1 -- 172.21.15.61:0/3023509664 >> 172.21.15.61:0/3023509664 conn(0x7f0ae4097a10 msgr2=0x7f0ae40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0aec573700 1 -- 172.21.15.61:0/3023509664 shutdown_connections 2023-12-24T20:01:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.391+0000 7f0aec573700 1 -- 172.21.15.61:0/3023509664 wait complete. 2023-12-24T20:01:35.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aec573700 1 Processor -- start 2023-12-24T20:01:35.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aec573700 1 -- start start 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aec573700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ae4068140 0x7f0ae4157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aec573700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ae4068510 0x7f0ae415ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aec573700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 0x7f0ae415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aec573700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae415c880 con 0x7f0ae40b3d30 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aec573700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae409ae70 con 0x7f0ae4068510 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aec573700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae409a260 con 0x7f0ae4068140 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aeab10700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 0x7f0ae415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aeab10700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 0x7f0ae415bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50254/0 (socket says 172.21.15.61:50254) 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.393+0000 7f0aeab10700 1 -- 172.21.15.61:0/3253133031 learned_addr learned my addr 172.21.15.61:0/3253133031 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0aea30f700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ae4068140 0x7f0ae4157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0ae9b0e700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ae4068510 0x7f0ae415ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0aeab10700 1 -- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ae4068140 msgr2=0x7f0ae4157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0aeab10700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ae4068140 0x7f0ae4157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0aeab10700 1 -- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ae4068510 msgr2=0x7f0ae415ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0aeab10700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ae4068510 0x7f0ae415ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0aeab10700 1 -- 172.21.15.61:0/3253133031 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc009a20 con 0x7f0ae40b3d30 2023-12-24T20:01:35.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0aea30f700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ae4068140 0x7f0ae4157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:35.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0aeab10700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 0x7f0ae415bf50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0adc013000 tx=0x7f0adc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:35.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0ada7fc700 1 -- 172.21.15.61:0/3253133031 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc01b630 con 0x7f0ae40b3d30 2023-12-24T20:01:35.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0ada7fc700 1 -- 172.21.15.61:0/3253133031 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc01b790 con 0x7f0ae40b3d30 2023-12-24T20:01:35.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0aec573700 1 -- 172.21.15.61:0/3253133031 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae409a540 con 0x7f0ae40b3d30 2023-12-24T20:01:35.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0ada7fc700 1 -- 172.21.15.61:0/3253133031 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc01bb30 con 0x7f0ae40b3d30 2023-12-24T20:01:35.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.394+0000 7f0aec573700 1 -- 172.21.15.61:0/3253133031 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae409ab00 con 0x7f0ae40b3d30 2023-12-24T20:01:35.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.395+0000 7f0aec573700 1 -- 172.21.15.61:0/3253133031 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae406d440 con 0x7f0ae40b3d30 2023-12-24T20:01:35.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.396+0000 7f0ada7fc700 1 -- 172.21.15.61:0/3253133031 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0adc01c400 con 0x7f0ae40b3d30 2023-12-24T20:01:35.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.396+0000 7f0ada7fc700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ac8066f30 0x7f0ac80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.396+0000 7f0ada7fc700 1 -- 172.21.15.61:0/3253133031 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0adc086440 con 0x7f0ae40b3d30 2023-12-24T20:01:35.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.396+0000 7f0aea30f700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ac8066f30 0x7f0ac80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.397+0000 7f0aea30f700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ac8066f30 0x7f0ac80693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4001840 tx=0x7f0ad4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:35.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.400+0000 7f0ada7fc700 1 -- 172.21.15.61:0/3253133031 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0adc0536b0 con 0x7f0ae40b3d30 2023-12-24T20:01:35.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.588+0000 7f0aec573700 1 -- 172.21.15.61:0/3253133031 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ae404c3c0 con 0x7f0ac8066f30 2023-12-24T20:01:35.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.597+0000 7f0ada7fc700 1 -- 172.21.15.61:0/3253133031 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282129 (secure 0 0 0) 0x7f0ae404c3c0 con 0x7f0ac8066f30 2023-12-24T20:01:35.601 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:35.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.599+0000 7f0aec573700 1 -- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ac8066f30 msgr2=0x7f0ac80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.599+0000 7f0aec573700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ac8066f30 0x7f0ac80693e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4001840 tx=0x7f0ad4009040 comp rx=0 tx=0).stop 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.599+0000 7f0aec573700 1 -- 172.21.15.61:0/3253133031 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 msgr2=0x7f0ae415bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.599+0000 7f0aec573700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 0x7f0ae415bf50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0adc013000 tx=0x7f0adc019000 comp rx=0 tx=0).stop 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.600+0000 7f0aec573700 1 -- 172.21.15.61:0/3253133031 shutdown_connections 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.600+0000 7f0aec573700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ae4068140 0x7f0ae4157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.600+0000 7f0aec573700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ac8066f30 0x7f0ac80693e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.600+0000 7f0aec573700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0ae40b3d30 0x7f0ae415bf50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.600+0000 7f0aec573700 1 --2- 172.21.15.61:0/3253133031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ae4068510 0x7f0ae415ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.600+0000 7f0aec573700 1 -- 172.21.15.61:0/3253133031 >> 172.21.15.61:0/3253133031 conn(0x7f0ae4097a10 msgr2=0x7f0ae406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.600+0000 7f0aec573700 1 -- 172.21.15.61:0/3253133031 shutdown_connections 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.600+0000 7f0aec573700 1 -- 172.21.15.61:0/3253133031 wait complete. 2023-12-24T20:01:35.604 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:01:35.613 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2023-12-24T20:01:34.373308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5203,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557296,"statfs":{"total":1600000000,"available":1594671629,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709831"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671972+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671574+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:30.714451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666425+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.677573+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:59.902267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671243+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:14.179654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668937+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.673741+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:35.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.667355+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:33.913246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.667527+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:59.134553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671494+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670973+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:08:10.343325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671717+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665981+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.677233+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:18.798391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.664511+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:45:28.761106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671077+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:38.693665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671675+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:16:38.971680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.672960+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:22:37.845875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671804+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:14.617306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.673107+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:51.484516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674400+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:28.176483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670456+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:16:02.606248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674809+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:13.388896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.675831+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:19:21.551679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671138+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:27.166938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666057+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670646+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:37.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674436+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:38.693665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668742+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:20:33.519692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.667870+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:21:18.798391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669990+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671262+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669876+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679071+0000","last_change":"2023-12-24T20:01:29.679071+0000","last_active":"2023-12-24T20:01:29.679071+0000","last_peered":"2023-12-24T20:01:29.679071+0000","last_clean":"2023-12-24T20:01:29.679071+0000","last_became_active":"2023-12-24T20:01:29.678350+0000","last_became_peered":"2023-12-24T20:01:29.678350+0000","last_unstale":"2023-12-24T20:01:29.679071+0000","last_undegraded":"2023-12-24T20:01:29.679071+0000","last_fullsized":"2023-12-24T20:01:29.679071+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:43.873476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.674001+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.675805+0000","last_change":"2023-12-24T20:01:29.675805+0000","last_active":"2023-12-24T20:01:29.675805+0000","last_peered":"2023-12-24T20:01:29.675805+0000","last_clean":"2023-12-24T20:01:29.675805+0000","last_became_active":"2023-12-24T20:01:29.675510+0000","last_became_peered":"2023-12-24T20:01:29.675510+0000","last_unstale":"2023-12-24T20:01:29.675805+0000","last_undegraded":"2023-12-24T20:01:29.675805+0000","last_fullsized":"2023-12-24T20:01:29.675805+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:56.278435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669539+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:59.134553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.669643+0000","last_change":"2023-12-24T20:01:29.669643+0000","last_active":"2023-12-24T20:01:29.669643+0000","last_peered":"2023-12-24T20:01:29.669643+0000","last_clean":"2023-12-24T20:01:29.669643+0000","last_became_active":"2023-12-24T20:01:29.669404+0000","last_became_peered":"2023-12-24T20:01:29.669404+0000","last_unstale":"2023-12-24T20:01:29.669643+0000","last_undegraded":"2023-12-24T20:01:29.669643+0000","last_fullsized":"2023-12-24T20:01:29.669643+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:30.205035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666283+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.669603+0000","last_change":"2023-12-24T20:01:29.669603+0000","last_active":"2023-12-24T20:01:29.669603+0000","last_peered":"2023-12-24T20:01:29.669603+0000","last_clean":"2023-12-24T20:01:29.669603+0000","last_became_active":"2023-12-24T20:01:29.669369+0000","last_became_peered":"2023-12-24T20:01:29.669369+0000","last_unstale":"2023-12-24T20:01:29.669603+0000","last_undegraded":"2023-12-24T20:01:29.669603+0000","last_fullsized":"2023-12-24T20:01:29.669603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:31.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669723+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:49:16.801499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.676516+0000","last_change":"2023-12-24T20:01:29.676516+0000","last_active":"2023-12-24T20:01:29.676516+0000","last_peered":"2023-12-24T20:01:29.676516+0000","last_clean":"2023-12-24T20:01:29.676516+0000","last_became_active":"2023-12-24T20:01:29.676280+0000","last_became_peered":"2023-12-24T20:01:29.676280+0000","last_unstale":"2023-12-24T20:01:29.676516+0000","last_undegraded":"2023-12-24T20:01:29.676516+0000","last_fullsized":"2023-12-24T20:01:29.676516+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:32.908184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670220+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.673265+0000","last_change":"2023-12-24T20:01:29.673265+0000","last_active":"2023-12-24T20:01:29.673265+0000","last_peered":"2023-12-24T20:01:29.673265+0000","last_clean":"2023-12-24T20:01:29.673265+0000","last_became_active":"2023-12-24T20:01:29.672837+0000","last_became_peered":"2023-12-24T20:01:29.672837+0000","last_unstale":"2023-12-24T20:01:29.673265+0000","last_undegraded":"2023-12-24T20:01:29.673265+0000","last_fullsized":"2023-12-24T20:01:29.673265+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:20.057436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666717+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672787+0000","last_change":"2023-12-24T20:01:29.672787+0000","last_active":"2023-12-24T20:01:29.672787+0000","last_peered":"2023-12-24T20:01:29.672787+0000","last_clean":"2023-12-24T20:01:29.672787+0000","last_became_active":"2023-12-24T20:01:29.672509+0000","last_became_peered":"2023-12-24T20:01:29.672509+0000","last_unstale":"2023-12-24T20:01:29.672787+0000","last_undegraded":"2023-12-24T20:01:29.672787+0000","last_fullsized":"2023-12-24T20:01:29.672787+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:38.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.664676+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:50:59.398891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672298+0000","last_change":"2023-12-24T20:01:29.672298+0000","last_active":"2023-12-24T20:01:29.672298+0000","last_peered":"2023-12-24T20:01:29.672298+0000","last_clean":"2023-12-24T20:01:29.672298+0000","last_became_active":"2023-12-24T20:01:29.671951+0000","last_became_peered":"2023-12-24T20:01:29.671951+0000","last_unstale":"2023-12-24T20:01:29.672298+0000","last_undegraded":"2023-12-24T20:01:29.672298+0000","last_fullsized":"2023-12-24T20:01:29.672298+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:07:34.865275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.664315+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:18.050260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674193+0000","last_change":"2023-12-24T20:01:29.674193+0000","last_active":"2023-12-24T20:01:29.674193+0000","last_peered":"2023-12-24T20:01:29.674193+0000","last_clean":"2023-12-24T20:01:29.674193+0000","last_became_active":"2023-12-24T20:01:29.673869+0000","last_became_peered":"2023-12-24T20:01:29.673869+0000","last_unstale":"2023-12-24T20:01:29.674193+0000","last_undegraded":"2023-12-24T20:01:29.674193+0000","last_fullsized":"2023-12-24T20:01:29.674193+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:34.391823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668523+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:21.062498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679139+0000","last_change":"2023-12-24T20:01:29.679139+0000","last_active":"2023-12-24T20:01:29.679139+0000","last_peered":"2023-12-24T20:01:29.679139+0000","last_clean":"2023-12-24T20:01:29.679139+0000","last_became_active":"2023-12-24T20:01:29.678908+0000","last_became_peered":"2023-12-24T20:01:29.678908+0000","last_unstale":"2023-12-24T20:01:29.679139+0000","last_undegraded":"2023-12-24T20:01:29.679139+0000","last_fullsized":"2023-12-24T20:01:29.679139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:53.748891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671386+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:36:34.497869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.680251+0000","last_change":"2023-12-24T20:01:29.680251+0000","last_active":"2023-12-24T20:01:29.680251+0000","last_peered":"2023-12-24T20:01:29.680251+0000","last_clean":"2023-12-24T20:01:29.680251+0000","last_became_active":"2023-12-24T20:01:29.678811+0000","last_became_peered":"2023-12-24T20:01:29.678811+0000","last_unstale":"2023-12-24T20:01:29.680251+0000","last_undegraded":"2023-12-24T20:01:29.680251+0000","last_fullsized":"2023-12-24T20:01:29.680251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:22.049103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670020+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.677427+0000","last_change":"2023-12-24T20:01:29.677427+0000","last_active":"2023-12-24T20:01:29.677427+0000","last_peered":"2023-12-24T20:01:29.677427+0000","last_clean":"2023-12-24T20:01:29.677427+0000","last_became_active":"2023-12-24T20:01:29.677236+0000","last_became_peered":"2023-12-24T20:01:29.677236+0000","last_unstale":"2023-12-24T20:01:29.677427+0000","last_undegraded":"2023-12-24T20:01:29.677427+0000","last_fullsized":"2023-12-24T20:01:29.677427+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:15:08.313529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668711+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:23:57.708727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.667181+0000","last_change":"2023-12-24T20:01:29.667181+0000","last_active":"2023-12-24T20:01:29.667181+0000","last_peered":"2023-12-24T20:01:29.667181+0000","last_clean":"2023-12-24T20:01:29.667181+0000","last_became_active":"2023-12-24T20:01:29.666928+0000","last_became_peered":"2023-12-24T20:01:29.666928+0000","last_unstale":"2023-12-24T20:01:29.667181+0000","last_undegraded":"2023-12-24T20:01:29.667181+0000","last_fullsized":"2023-12-24T20:01:29.667181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:52.025332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665911+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.666145+0000","last_change":"2023-12-24T20:01:29.666145+0000","last_active":"2023-12-24T20:01:29.666145+0000","last_peered":"2023-12-24T20:01:29.666145+0000","last_clean":"2023-12-24T20:01:29.666145+0000","last_became_active":"2023-12-24T20:01:29.665940+0000","last_became_peered":"2023-12-24T20:01:29.665940+0000","last_unstale":"2023-12-24T20:01:29.666145+0000","last_undegraded":"2023-12-24T20:01:29.666145+0000","last_fullsized":"2023-12-24T20:01:29.666145+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:30.205035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669339+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:13.363115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.673342+0000","last_change":"2023-12-24T20:01:29.673342+0000","last_active":"2023-12-24T20:01:29.673342+0000","last_peered":"2023-12-24T20:01:29.673342+0000","last_clean":"2023-12-24T20:01:29.673342+0000","last_became_active":"2023-12-24T20:01:29.672893+0000","last_became_peered":"2023-12-24T20:01:29.672893+0000","last_unstale":"2023-12-24T20:01:29.673342+0000","last_undegraded":"2023-12-24T20:01:29.673342+0000","last_fullsized":"2023-12-24T20:01:29.673342+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:34.391823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668444+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:37.631843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.676797+0000","last_change":"2023-12-24T20:01:29.676797+0000","last_active":"2023-12-24T20:01:29.676797+0000","last_peered":"2023-12-24T20:01:29.676797+0000","last_clean":"2023-12-24T20:01:29.676797+0000","last_became_active":"2023-12-24T20:01:29.676392+0000","last_became_peered":"2023-12-24T20:01:29.676392+0000","last_unstale":"2023-12-24T20:01:29.676797+0000","last_undegraded":"2023-12-24T20:01:29.676797+0000","last_fullsized":"2023-12-24T20:01:29.676797+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:40.530541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665468+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.678929+0000","last_change":"2023-12-24T20:01:29.678929+0000","last_active":"2023-12-24T20:01:29.678929+0000","last_peered":"2023-12-24T20:01:29.678929+0000","last_clean":"2023-12-24T20:01:29.678929+0000","last_became_active":"2023-12-24T20:01:29.675007+0000","last_became_peered":"2023-12-24T20:01:29.675007+0000","last_unstale":"2023-12-24T20:01:29.678929+0000","last_undegraded":"2023-12-24T20:01:29.678929+0000","last_fullsized":"2023-12-24T20:01:29.678929+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:15:08.313529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670204+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:21.062498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674859+0000","last_change":"2023-12-24T20:01:29.674859+0000","last_active":"2023-12-24T20:01:29.674859+0000","last_peered":"2023-12-24T20:01:29.674859+0000","last_clean":"2023-12-24T20:01:29.674859+0000","last_became_active":"2023-12-24T20:01:29.674584+0000","last_became_peered":"2023-12-24T20:01:29.674584+0000","last_unstale":"2023-12-24T20:01:29.674859+0000","last_undegraded":"2023-12-24T20:01:29.674859+0000","last_fullsized":"2023-12-24T20:01:29.674859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:12.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669449+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.671113+0000","last_change":"2023-12-24T20:01:29.671113+0000","last_active":"2023-12-24T20:01:29.671113+0000","last_peered":"2023-12-24T20:01:29.671113+0000","last_clean":"2023-12-24T20:01:29.671113+0000","last_became_active":"2023-12-24T20:01:29.670833+0000","last_became_peered":"2023-12-24T20:01:29.670833+0000","last_unstale":"2023-12-24T20:01:29.671113+0000","last_undegraded":"2023-12-24T20:01:29.671113+0000","last_fullsized":"2023-12-24T20:01:29.671113+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:17.045198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.672433+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:55:23.601865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674484+0000","last_change":"2023-12-24T20:01:29.674484+0000","last_active":"2023-12-24T20:01:29.674484+0000","last_peered":"2023-12-24T20:01:29.674484+0000","last_clean":"2023-12-24T20:01:29.674484+0000","last_became_active":"2023-12-24T20:01:29.673766+0000","last_became_peered":"2023-12-24T20:01:29.673766+0000","last_unstale":"2023-12-24T20:01:29.674484+0000","last_undegraded":"2023-12-24T20:01:29.674484+0000","last_fullsized":"2023-12-24T20:01:29.674484+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:37.477665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.666897+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:19:14.852304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679308+0000","last_change":"2023-12-24T20:01:29.679308+0000","last_active":"2023-12-24T20:01:29.679308+0000","last_peered":"2023-12-24T20:01:29.679308+0000","last_clean":"2023-12-24T20:01:29.679308+0000","last_became_active":"2023-12-24T20:01:29.678200+0000","last_became_peered":"2023-12-24T20:01:29.678200+0000","last_unstale":"2023-12-24T20:01:29.679308+0000","last_undegraded":"2023-12-24T20:01:29.679308+0000","last_fullsized":"2023-12-24T20:01:29.679308+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:37:31.083373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.671983+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:35:55.532002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.678815+0000","last_change":"2023-12-24T20:01:29.678815+0000","last_active":"2023-12-24T20:01:29.678815+0000","last_peered":"2023-12-24T20:01:29.678815+0000","last_clean":"2023-12-24T20:01:29.678815+0000","last_became_active":"2023-12-24T20:01:29.678629+0000","last_became_peered":"2023-12-24T20:01:29.678629+0000","last_unstale":"2023-12-24T20:01:29.678815+0000","last_undegraded":"2023-12-24T20:01:29.678815+0000","last_fullsized":"2023-12-24T20:01:29.678815+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:30:21.747257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668662+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.674009+0000","last_change":"2023-12-24T20:01:29.674009+0000","last_active":"2023-12-24T20:01:29.674009+0000","last_peered":"2023-12-24T20:01:29.674009+0000","last_clean":"2023-12-24T20:01:29.674009+0000","last_became_active":"2023-12-24T20:01:29.673781+0000","last_became_peered":"2023-12-24T20:01:29.673781+0000","last_unstale":"2023-12-24T20:01:29.674009+0000","last_undegraded":"2023-12-24T20:01:29.674009+0000","last_fullsized":"2023-12-24T20:01:29.674009+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:31.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669646+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672645+0000","last_change":"2023-12-24T20:01:29.672645+0000","last_active":"2023-12-24T20:01:29.672645+0000","last_peered":"2023-12-24T20:01:29.672645+0000","last_clean":"2023-12-24T20:01:29.672645+0000","last_became_active":"2023-12-24T20:01:29.671896+0000","last_became_peered":"2023-12-24T20:01:29.671896+0000","last_unstale":"2023-12-24T20:01:29.672645+0000","last_undegraded":"2023-12-24T20:01:29.672645+0000","last_fullsized":"2023-12-24T20:01:29.672645+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:41:42.911076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665497+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.667274+0000","last_change":"2023-12-24T20:01:29.667274+0000","last_active":"2023-12-24T20:01:29.667274+0000","last_peered":"2023-12-24T20:01:29.667274+0000","last_clean":"2023-12-24T20:01:29.667274+0000","last_became_active":"2023-12-24T20:01:29.666919+0000","last_became_peered":"2023-12-24T20:01:29.666919+0000","last_unstale":"2023-12-24T20:01:29.667274+0000","last_undegraded":"2023-12-24T20:01:29.667274+0000","last_fullsized":"2023-12-24T20:01:29.667274+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:27.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.670210+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679875+0000","last_change":"2023-12-24T20:01:29.679875+0000","last_active":"2023-12-24T20:01:29.679875+0000","last_peered":"2023-12-24T20:01:29.679875+0000","last_clean":"2023-12-24T20:01:29.679875+0000","last_became_active":"2023-12-24T20:01:29.679578+0000","last_became_peered":"2023-12-24T20:01:29.679578+0000","last_unstale":"2023-12-24T20:01:29.679875+0000","last_undegraded":"2023-12-24T20:01:29.679875+0000","last_fullsized":"2023-12-24T20:01:29.679875+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:26.206071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669495+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672474+0000","last_change":"2023-12-24T20:01:29.672474+0000","last_active":"2023-12-24T20:01:29.672474+0000","last_peered":"2023-12-24T20:01:29.672474+0000","last_clean":"2023-12-24T20:01:29.672474+0000","last_became_active":"2023-12-24T20:01:29.672181+0000","last_became_peered":"2023-12-24T20:01:29.672181+0000","last_unstale":"2023-12-24T20:01:29.672474+0000","last_undegraded":"2023-12-24T20:01:29.672474+0000","last_fullsized":"2023-12-24T20:01:29.672474+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:15:18.329574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.669559+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.671487+0000","last_change":"2023-12-24T20:01:29.671487+0000","last_active":"2023-12-24T20:01:29.671487+0000","last_peered":"2023-12-24T20:01:29.671487+0000","last_clean":"2023-12-24T20:01:29.671487+0000","last_became_active":"2023-12-24T20:01:29.671331+0000","last_became_peered":"2023-12-24T20:01:29.671331+0000","last_unstale":"2023-12-24T20:01:29.671487+0000","last_undegraded":"2023-12-24T20:01:29.671487+0000","last_fullsized":"2023-12-24T20:01:29.671487+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:37.477665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668310+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:50:59.398891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.675924+0000","last_change":"2023-12-24T20:01:29.675924+0000","last_active":"2023-12-24T20:01:29.675924+0000","last_peered":"2023-12-24T20:01:29.675924+0000","last_clean":"2023-12-24T20:01:29.675924+0000","last_became_active":"2023-12-24T20:01:29.675675+0000","last_became_peered":"2023-12-24T20:01:29.675675+0000","last_unstale":"2023-12-24T20:01:29.675924+0000","last_undegraded":"2023-12-24T20:01:29.675924+0000","last_fullsized":"2023-12-24T20:01:29.675924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:58.129491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.665498+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.680409+0000","last_change":"2023-12-24T20:01:29.680409+0000","last_active":"2023-12-24T20:01:29.680409+0000","last_peered":"2023-12-24T20:01:29.680409+0000","last_clean":"2023-12-24T20:01:29.680409+0000","last_became_active":"2023-12-24T20:01:29.679770+0000","last_became_peered":"2023-12-24T20:01:29.679770+0000","last_unstale":"2023-12-24T20:01:29.680409+0000","last_undegraded":"2023-12-24T20:01:29.680409+0000","last_fullsized":"2023-12-24T20:01:29.680409+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:14.371806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.673608+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.679483+0000","last_change":"2023-12-24T20:01:29.679483+0000","last_active":"2023-12-24T20:01:29.679483+0000","last_peered":"2023-12-24T20:01:29.679483+0000","last_clean":"2023-12-24T20:01:29.679483+0000","last_became_active":"2023-12-24T20:01:29.679256+0000","last_became_peered":"2023-12-24T20:01:29.679256+0000","last_unstale":"2023-12-24T20:01:29.679483+0000","last_undegraded":"2023-12-24T20:01:29.679483+0000","last_fullsized":"2023-12-24T20:01:29.679483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:50.021067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:01:29.660123+0000","last_change":"2023-12-24T20:01:29.668021+0000","last_active":"2023-12-24T20:01:29.660123+0000","last_peered":"2023-12-24T20:01:29.660123+0000","last_clean":"2023-12-24T20:01:29.660123+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:01:29.660123+0000","last_undegraded":"2023-12-24T20:01:29.660123+0000","last_fullsized":"2023-12-24T20:01:29.660123+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:12:59.902267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":8,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-24T20:01:29.672620+0000","last_change":"2023-12-24T20:01:29.672620+0000","last_active":"2023-12-24T20:01:29.672620+0000","last_peered":"2023-12-24T20:01:29.672620+0000","last_clean":"2023-12-24T20:01:29.672620+0000","last_became_active":"2023-12-24T20:01:29.672380+0000","last_became_peered":"2023-12-24T20:01:29.672380+0000","last_unstale":"2023-12-24T20:01:29.672620+0000","last_undegraded":"2023-12-24T20:01:29.672620+0000","last_fullsized":"2023-12-24T20:01:29.672620+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:32.908184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":231,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-12-24T20:01:28.664725+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:01:28.664725+0000","last_peered":"2023-12-24T20:01:28.664725+0000","last_clean":"2023-12-24T20:01:28.664725+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:01:28.664725+0000","last_undegraded":"2023-12-24T20:01:28.664725+0000","last_fullsized":"2023-12-24T20:01:28.664725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888829,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.50900000000000001,"15min":0.497},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.50700000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81000000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44}]},{"osd":2,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80000000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.624,"15min":0.628},"min":{"1min":0.439,"5min":0.437,"15min":0.437},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67600000000000005}]},{"osd":4,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77600000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.745,"15min":0.745},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.873,"15min":0.873},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194810,"statfs":{"total":200000000,"available":199485460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.33600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80400000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.629},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.5}]},{"osd":1,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69299999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.52400000000000002},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67200000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47599999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67600000000000005,"5min":1.077,"15min":1.077},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.753,"5min":1.048,"15min":1.048},"last":0.64300000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68200000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.745,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60999999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68000000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66300000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194803,"statfs":{"total":200000000,"available":199479197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65600000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.372,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.307}]},{"osd":3,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.378},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40100000000000002,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.621},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.45100000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":0.878,"15min":0.878},"last":0.51400000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73899999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88200000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888829,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38400000000000001,"15min":0.433},"min":{"1min":0.24199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56100000000000005,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.215,"15min":0.215},"max":{"1min":0.60199999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.36099999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.246,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59799999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.31,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.30099999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.441,"15min":0.46899999999999997},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57299999999999995,"5min":2.573,"15min":2.573},"last":0.318},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.33700000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58999999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93300000000000005,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64700000000000002,"15min":0.68700000000000006},"min":{"1min":0.442,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.63}]},{"osd":5,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.625,"15min":0.624},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89500000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72799999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92100000000000004,"5min":1.655,"15min":1.655},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94299999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.752}]},{"osd":7,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69299999999999995,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194803,"statfs":{"total":200000000,"available":199479197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.24399999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48599999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.375,"15min":0.374},"min":{"1min":0.25700000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.33300000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40300000000000002,"15min":0.40400000000000003},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54000000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.443}]},{"osd":3,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.624,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.375,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":3.577,"15min":3.577},"last":0.498},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.872,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.51000000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":1.04,"15min":1.04},"last":0.621},{"interface":"front","average":{"1min":0.625,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91300000000000003,"5min":3.637,"15min":3.637},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88700000000000001,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.01,"5min":1.331,"15min":1.331},"last":0.65900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194803,"statfs":{"total":200000000,"available":199479197,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.33200000000000002,"15min":0.32400000000000001},"min":{"1min":0.24299999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.502,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"min":{"1min":0.25900000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59199999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.56499999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.316,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.435},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.504}]},{"osd":4,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.59999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86799999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.60199999999999998},"min":{"1min":0.49299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.94999999999999996,"5min":1.337,"15min":1.337},"last":0.54700000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.626,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92400000000000004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88500000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60899999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.78800000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65000000000000002,"15min":0.63400000000000001},"min":{"1min":0.54600000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.0149999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":1.006,"15min":1.006},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194810,"statfs":{"total":200000000,"available":199485460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.34399999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71199999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.373}]},{"osd":1,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.65200000000000002,"15min":0.73799999999999999},"min":{"1min":0.379,"5min":0.378,"15min":0.378},"max":{"1min":0.69199999999999995,"5min":4.883,"15min":4.883},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.544,"15min":1.544},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72699999999999998,"5min":0.88,"15min":0.88},"last":0.433},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72099999999999997,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.35399999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70599999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.748,"15min":0.92200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77300000000000002,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.496,"15min":0.52800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.745,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.58299999999999996,"15min":0.65900000000000003},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.83299999999999996,"15min":1.119},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75600000000000001,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.31,"15min":0.31},"max":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":502,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194810,"statfs":{"total":200000000,"available":199485460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52200000000000002,"15min":0.50600000000000001},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57599999999999996,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79200000000000004,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.746,"5min":1.847,"15min":1.847},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72399999999999998,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.40100000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.51900000000000002},"min":{"1min":0.42899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68000000000000005,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":1.97,"15min":1.97},"last":0.53600000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.56799999999999995},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.76600000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.5},{"interface":"front","average":{"1min":0.626,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.752,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57299999999999995}]},{"osd":4,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.67400000000000004,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53600000000000003,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.55600000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.47299999999999998},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66100000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":3.766,"15min":3.766},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.64800000000000002}]}]}],"pool_statfs":[]}} 2023-12-24T20:01:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-12-24T20:01:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671972+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-12-24T20:01:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671574+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T21:49:30.714451+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:01:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-12-24T20:01:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.666425+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:01:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.677573+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T01:12:59.902267+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671243+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T02:11:14.179654+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.668937+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.673741+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T01:05:35.193816+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.667355+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T23:20:33.913246+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-12-24T20:01:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.667527+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:15:59.134553+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:01:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-12-24T20:01:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671494+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-12-24T20:01:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.670973+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:08:10.343325+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:01:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-12-24T20:01:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671717+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-12-24T20:01:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.665981+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:01:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-12-24T20:01:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.677233+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:21:18.798391+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:01:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-12-24T20:01:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.664511+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T21:45:28.761106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:01:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-12-24T20:01:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671077+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:45:38.693665+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-12-24T20:01:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671675+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:16:38.971680+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-12-24T20:01:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.672960+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:22:37.845875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:01:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-12-24T20:01:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671804+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T05:25:14.617306+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.673107+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T06:05:51.484516+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.674400+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:29:28.176483+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.670456+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T23:16:02.606248+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.674809+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:06:13.388896+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.675831+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T23:19:21.551679+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:01:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671138+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T05:33:27.166938+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.666057+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.670646+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:28:37.917351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.674436+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:45:38.693665+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.668742+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:20:33.519692+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-12-24T20:01:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.667870+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:21:18.798391+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:01:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-12-24T20:01:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.669990+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-12-24T20:01:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671262+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-12-24T20:01:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.669876+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-12-24T20:01:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.674001+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-12-24T20:01:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.669539+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:15:59.134553+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.666283+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.669723+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:49:16.801499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.670220+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.666717+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.664676+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:50:59.398891+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-12-24T20:01:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.664315+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T06:10:18.050260+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.668523+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:25:21.062498+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671386+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:36:34.497869+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.670020+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.668711+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:23:57.708727+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.665911+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-12-24T20:01:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.669339+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T02:30:13.363115+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.668444+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:46:37.631843+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.665468+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.670204+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:25:21.062498+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.669449+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.672433+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:55:23.601865+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-12-24T20:01:35.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.666897+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T02:19:14.852304+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.671983+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T01:35:55.532002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.668662+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.669646+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.665497+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.670210+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:33:57.283496+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.669495+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.669559+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:06:02.897365+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.668310+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:50:59.398891+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.665498+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:33:51.026129+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.673608+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-12-24T20:01:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:01:29.660123+0000', 'last_change': '2023-12-24T20:01:29.668021+0000', 'last_active': '2023-12-24T20:01:29.660123+0000', 'last_peered': '2023-12-24T20:01:29.660123+0000', 'last_clean': '2023-12-24T20:01:29.660123+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:01:29.660123+0000', 'last_undegraded': '2023-12-24T20:01:29.660123+0000', 'last_fullsized': '2023-12-24T20:01:29.660123+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'last_clean_scrub_stamp': '2023-12-24T20:01:29.660123+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T01:12:59.902267+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:01:35.631 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T20:01:35.656 INFO:tasks.ceph.mds.c.smithi061.stderr:2023-12-24T20:01:35.655+0000 7fd3cad2b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:01:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.773+0000 7f9da7288700 1 Processor -- start 2023-12-24T20:01:35.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.773+0000 7f9da7288700 1 -- start start 2023-12-24T20:01:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.774+0000 7f9da7288700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9da00b3d30 0x7f9da00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.774+0000 7f9da7288700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da00b2890 con 0x7f9da0068140 2023-12-24T20:01:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.774+0000 7f9da7288700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da00cf630 con 0x7f9da0068510 2023-12-24T20:01:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.774+0000 7f9da7288700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da00b2240 con 0x7f9da00b3d30 2023-12-24T20:01:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.774+0000 7f9da5825700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9da00b3d30 0x7f9da00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.774+0000 7f9da5024700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9da0068140 0x7f9da00b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42082/0 (socket says 172.21.15.61:42082) 2023-12-24T20:01:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.774+0000 7f9da5024700 1 -- 172.21.15.61:0/2774123347 learned_addr learned my addr 172.21.15.61:0/2774123347 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.774+0000 7f9da5825700 1 -- 172.21.15.61:0/2774123347 >> v1:172.21.15.133:6789/0 conn(0x7f9da0068510 legacy=0x7f9da0159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.774+0000 7f9da5825700 1 -- 172.21.15.61:0/2774123347 >> v1:172.21.15.61:6789/0 conn(0x7f9da0068140 legacy=0x7f9da00b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.774+0000 7f9da5825700 1 -- 172.21.15.61:0/2774123347 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da00b2520 con 0x7f9da00b3d30 2023-12-24T20:01:35.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9da5825700 1 --2- 172.21.15.61:0/2774123347 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 0x7f9da00cefa0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009e60 tx=0x7f9d98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ba177fadd2c84e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:35.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9d97fff700 1 -- 172.21.15.61:0/2774123347 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9800e070 con 0x7f9da00b3d30 2023-12-24T20:01:35.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9d97fff700 1 -- 172.21.15.61:0/2774123347 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9800bc30 con 0x7f9da00b3d30 2023-12-24T20:01:35.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9d97fff700 1 -- 172.21.15.61:0/2774123347 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98012430 con 0x7f9da00b3d30 2023-12-24T20:01:35.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9da7288700 1 -- 172.21.15.61:0/2774123347 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 msgr2=0x7f9da00cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9da7288700 1 --2- 172.21.15.61:0/2774123347 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 0x7f9da00cefa0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009e60 tx=0x7f9d98009780 comp rx=0 tx=0).stop 2023-12-24T20:01:35.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9da7288700 1 -- 172.21.15.61:0/2774123347 shutdown_connections 2023-12-24T20:01:35.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9da7288700 1 --2- 172.21.15.61:0/2774123347 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 0x7f9da00cefa0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9da7288700 1 -- 172.21.15.61:0/2774123347 >> 172.21.15.61:0/2774123347 conn(0x7f9da0097a10 msgr2=0x7f9da00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:35.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9da7288700 1 -- 172.21.15.61:0/2774123347 shutdown_connections 2023-12-24T20:01:35.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.775+0000 7f9da7288700 1 -- 172.21.15.61:0/2774123347 wait complete. 2023-12-24T20:01:35.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.777+0000 7f9da7288700 1 Processor -- start 2023-12-24T20:01:35.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.777+0000 7f9da7288700 1 -- start start 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da7288700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9da0068140 0x7f9da0155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da7288700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da0068510 0x7f9da015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da7288700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 0x7f9da006be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da7288700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0156480 con 0x7f9da00b3d30 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da7288700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da015b3f0 con 0x7f9da0068510 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da7288700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da015a800 con 0x7f9da0068140 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da5825700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 0x7f9da006be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da5825700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 0x7f9da006be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50268/0 (socket says 172.21.15.61:50268) 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da5825700 1 -- 172.21.15.61:0/2854035434 learned_addr learned my addr 172.21.15.61:0/2854035434 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da5024700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9da0068140 0x7f9da0155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.778+0000 7f9da4823700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da0068510 0x7f9da015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9da5825700 1 -- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9da0068140 msgr2=0x7f9da0155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9da5825700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9da0068140 0x7f9da0155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9da5825700 1 -- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da0068510 msgr2=0x7f9da015de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9da5825700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da0068510 0x7f9da015de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9da5825700 1 -- 172.21.15.61:0/2854035434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d98009a20 con 0x7f9da00b3d30 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9da4823700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da0068510 0x7f9da015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9da5825700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 0x7f9da006be00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9d980097c0 tx=0x7f9d98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9d957fa700 1 -- 172.21.15.61:0/2854035434 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9801e630 con 0x7f9da00b3d30 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9d957fa700 1 -- 172.21.15.61:0/2854035434 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9801e790 con 0x7f9da00b3d30 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9da7288700 1 -- 172.21.15.61:0/2854035434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da015aac0 con 0x7f9da00b3d30 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9d957fa700 1 -- 172.21.15.61:0/2854035434 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9801eb50 con 0x7f9da00b3d30 2023-12-24T20:01:35.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.779+0000 7f9da7288700 1 -- 172.21.15.61:0/2854035434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da015b080 con 0x7f9da00b3d30 2023-12-24T20:01:35.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.780+0000 7f9da7288700 1 -- 172.21.15.61:0/2854035434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da0070a80 con 0x7f9da00b3d30 2023-12-24T20:01:35.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.780+0000 7f9d957fa700 1 -- 172.21.15.61:0/2854035434 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9d98024070 con 0x7f9da00b3d30 2023-12-24T20:01:35.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.781+0000 7f9d957fa700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d84066f30 0x7f9d840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:35.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.781+0000 7f9d957fa700 1 -- 172.21.15.61:0/2854035434 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d98086de0 con 0x7f9da00b3d30 2023-12-24T20:01:35.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.781+0000 7f9da5024700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d84066f30 0x7f9d840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:35.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.782+0000 7f9da5024700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d84066f30 0x7f9d840693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9d90002950 tx=0x7f9d90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:35.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:35.785+0000 7f9d957fa700 1 -- 172.21.15.61:0/2854035434 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d98054050 con 0x7f9da00b3d30 2023-12-24T20:01:36.028 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:01:36.030 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:01:36.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.062+0000 7f9da7288700 1 -- 172.21.15.61:0/2854035434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9da006d440 con 0x7f9da00b3d30 2023-12-24T20:01:36.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.062+0000 7f9d957fa700 1 -- 172.21.15.61:0/2854035434 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1190 (secure 0 0 0) 0x7f9d9802c4c0 con 0x7f9da00b3d30 2023-12-24T20:01:36.064 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:36.064 INFO:teuthology.orchestra.run.smithi061.stdout:{"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":287,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1703447814,"num_in_osds":8,"osd_in_since":1703447811,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":5328371,"bytes_avail":1594671629,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":52,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6318}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-12-24T20:00:22.355520+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 -- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d84066f30 msgr2=0x7f9d840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d84066f30 0x7f9d840693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9d90002950 tx=0x7f9d90009040 comp rx=0 tx=0).stop 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 -- 172.21.15.61:0/2854035434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 msgr2=0x7f9da006be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 0x7f9da006be00 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9d980097c0 tx=0x7f9d98019000 comp rx=0 tx=0).stop 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 -- 172.21.15.61:0/2854035434 shutdown_connections 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9da0068140 0x7f9da0155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9d84066f30 0x7f9d840693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9da00b3d30 0x7f9da006be00 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 --2- 172.21.15.61:0/2854035434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9da0068510 0x7f9da015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 -- 172.21.15.61:0/2854035434 >> 172.21.15.61:0/2854035434 conn(0x7f9da0097a10 msgr2=0x7f9da0157c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 -- 172.21.15.61:0/2854035434 shutdown_connections 2023-12-24T20:01:36.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.064+0000 7f9da7288700 1 -- 172.21.15.61:0/2854035434 wait complete. 2023-12-24T20:01:36.078 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T20:01:36.078 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:01:36.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.238+0000 7f47b5a94700 1 Processor -- start 2023-12-24T20:01:36.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.238+0000 7f47b5a94700 1 -- start start 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.239+0000 7f47b5a94700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b0159fe0 0x7f47b00cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.239+0000 7f47b5a94700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00af880 con 0x7f47b00c5ee0 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.239+0000 7f47b5a94700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00c6fc0 con 0x7f47b0159c10 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.239+0000 7f47b5a94700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00c63b0 con 0x7f47b0159fe0 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.239+0000 7f47affff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f47b00c5ee0 0x7f47b00b09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:42090/0 (socket says 172.21.15.61:42090) 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.239+0000 7f47affff700 1 -- 172.21.15.61:0/2484770403 learned_addr learned my addr 172.21.15.61:0/2484770403 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47aeffd700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b0159fe0 0x7f47b00cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221553803 0 0) 0x7f47b00af880 con 0x7f47b00c5ee0 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4798003570 con 0x7f47b00c5ee0 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425197098 0 0) 0x7f47b00c6fc0 con 0x7f47b0159c10 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b00af880 con 0x7f47b0159c10 2023-12-24T20:01:36.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821161847 0 0) 0x7f4798003570 con 0x7f47b00c5ee0 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b0159fe0 msgr2=0x7f47b00cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b0159fe0 0x7f47b00cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 >> v1:172.21.15.133:6789/0 conn(0x7f47b0159c10 legacy=0x7f47b00c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00c6690 con 0x7f47b00c5ee0 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f47a80017f0 con 0x7f47b00c5ee0 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 >> v1:172.21.15.61:6789/0 conn(0x7f47b00c5ee0 legacy=0x7f47b00b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798003c20 0x7f4798004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4798004810 0x7f4798004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b0159fe0 0x7f47980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00c63b0 con 0x7f4798004810 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479800bb40 con 0x7f4798003c20 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479800bd00 con 0x7f47b0159fe0 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47aeffd700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4798004810 0x7f4798004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47affff700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b0159fe0 0x7f47980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:36.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47af7fe700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798003c20 0x7f4798004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47aeffd700 1 -- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b0159fe0 msgr2=0x7f47980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47aeffd700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b0159fe0 0x7f47980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47aeffd700 1 -- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798003c20 msgr2=0x7f4798004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.240+0000 7f47aeffd700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798003c20 0x7f4798004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47aeffd700 1 -- 172.21.15.61:0/2484770403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798003570 con 0x7f4798004810 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47af7fe700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798003c20 0x7f4798004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47aeffd700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4798004810 0x7f4798004c80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009c00 tx=0x7f47a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136dca68cc5092ef server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400e710 con 0x7f4798004810 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a400e870 con 0x7f4798004810 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47ae7fc700 1 -- 172.21.15.61:0/2484770403 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400ec30 con 0x7f4798004810 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47b5a94700 1 -- 172.21.15.61:0/2484770403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4798004810 msgr2=0x7f4798004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47b5a94700 1 --2- 172.21.15.61:0/2484770403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4798004810 0x7f4798004c80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009c00 tx=0x7f47a40091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47affff700 1 -- 172.21.15.61:0/2484770403 reap_dead start 2023-12-24T20:01:36.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47b5a94700 1 -- 172.21.15.61:0/2484770403 shutdown_connections 2023-12-24T20:01:36.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47b5a94700 1 -- 172.21.15.61:0/2484770403 >> 172.21.15.61:0/2484770403 conn(0x7f47b006e640 msgr2=0x7f47b0067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:36.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47b5a94700 1 -- 172.21.15.61:0/2484770403 shutdown_connections 2023-12-24T20:01:36.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.241+0000 7f47b5a94700 1 -- 172.21.15.61:0/2484770403 wait complete. 2023-12-24T20:01:36.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.243+0000 7f47b5a94700 1 Processor -- start 2023-12-24T20:01:36.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.243+0000 7f47b5a94700 1 -- start start 2023-12-24T20:01:36.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.243+0000 7f47b5a94700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798004810 0x7f47b00b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:36.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.243+0000 7f47b5a94700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f47b00b20e0 0x7f47b00c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:36.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.243+0000 7f47b5a94700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b016d970 0x7f47b016de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:36.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.243+0000 7f47b5a94700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b016e350 con 0x7f47b00b20e0 2023-12-24T20:01:36.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.243+0000 7f47b5a94700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00b1c50 con 0x7f4798004810 2023-12-24T20:01:36.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.243+0000 7f47b5a94700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00b1040 con 0x7f47b016d970 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47aeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f47b00b20e0 0x7f47b00c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47aeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f47b00b20e0 0x7f47b00c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:50290/0 (socket says 172.21.15.61:50290) 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47aeffd700 1 -- 172.21.15.61:0/919739143 learned_addr learned my addr 172.21.15.61:0/919739143 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47af7fe700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798004810 0x7f47b00b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47affff700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b016d970 0x7f47b016de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47aeffd700 1 -- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b016d970 msgr2=0x7f47b016de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47aeffd700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b016d970 0x7f47b016de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47aeffd700 1 -- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798004810 msgr2=0x7f47b00b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47aeffd700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798004810 0x7f47b00b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47aeffd700 1 -- 172.21.15.61:0/919739143 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00b1320 con 0x7f47b00b20e0 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47af7fe700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798004810 0x7f47b00b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47aeffd700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f47b00b20e0 0x7f47b00c7bc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f479800bb10 tx=0x7f47a401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47977fe700 1 -- 172.21.15.61:0/919739143 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4022070 con 0x7f47b00b20e0 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47977fe700 1 -- 172.21.15.61:0/919739143 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a400ebf0 con 0x7f47b00b20e0 2023-12-24T20:01:36.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47977fe700 1 -- 172.21.15.61:0/919739143 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a401c6a0 con 0x7f47b00b20e0 2023-12-24T20:01:36.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47b5a94700 1 -- 172.21.15.61:0/919739143 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b00b1600 con 0x7f47b00b20e0 2023-12-24T20:01:36.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.244+0000 7f47b5a94700 1 -- 172.21.15.61:0/919739143 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b014db70 con 0x7f47b00b20e0 2023-12-24T20:01:36.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.245+0000 7f47b5a94700 1 -- 172.21.15.61:0/919739143 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b00890b0 con 0x7f47b00b20e0 2023-12-24T20:01:36.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.246+0000 7f47977fe700 1 -- 172.21.15.61:0/919739143 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f47a401ca90 con 0x7f47b00b20e0 2023-12-24T20:01:36.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.246+0000 7f47977fe700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f479c066f30 0x7f479c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:36.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.246+0000 7f47977fe700 1 -- 172.21.15.61:0/919739143 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47a4085d80 con 0x7f47b00b20e0 2023-12-24T20:01:36.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.246+0000 7f47af7fe700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f479c066f30 0x7f479c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:36.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.247+0000 7f47af7fe700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f479c066f30 0x7f479c0693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f47a0000f60 tx=0x7f47a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:36.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.251+0000 7f47977fe700 1 -- 172.21.15.61:0/919739143 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47a4053030 con 0x7f47b00b20e0 2023-12-24T20:01:36.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.441+0000 7f47b5a94700 1 -- 172.21.15.61:0/919739143 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47b004c3c0 con 0x7f479c066f30 2023-12-24T20:01:36.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.450+0000 7f47977fe700 1 -- 172.21.15.61:0/919739143 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285005 (secure 0 0 0) 0x7f47b004c3c0 con 0x7f479c066f30 2023-12-24T20:01:36.454 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:36.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 -- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f479c066f30 msgr2=0x7f479c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:36.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f479c066f30 0x7f479c0693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f47a0000f60 tx=0x7f47a0009040 comp rx=0 tx=0).stop 2023-12-24T20:01:36.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 -- 172.21.15.61:0/919739143 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f47b00b20e0 msgr2=0x7f47b00c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:36.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f47b00b20e0 0x7f47b00c7bc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f479800bb10 tx=0x7f47a401a000 comp rx=0 tx=0).stop 2023-12-24T20:01:36.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 -- 172.21.15.61:0/919739143 shutdown_connections 2023-12-24T20:01:36.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f47b016d970 0x7f47b016de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f479c066f30 0x7f479c0693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4798004810 0x7f47b00b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 --2- 172.21.15.61:0/919739143 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f47b00b20e0 0x7f47b00c7bc0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:36.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 -- 172.21.15.61:0/919739143 >> 172.21.15.61:0/919739143 conn(0x7f47b006e640 msgr2=0x7f47b00c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:36.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 -- 172.21.15.61:0/919739143 shutdown_connections 2023-12-24T20:01:36.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:36.453+0000 7f47b5a94700 1 -- 172.21.15.61:0/919739143 wait complete. 2023-12-24T20:01:36.458 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:01:36.467 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2023-12-24T20:01:36.373732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5328,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557171,"statfs":{"total":1600000000,"available":1594543820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.710598"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.691646+0000","last_change":"2023-12-24T20:01:30.691589+0000","last_active":"2023-12-24T20:01:30.691646+0000","last_peered":"2023-12-24T20:01:30.691646+0000","last_clean":"2023-12-24T20:01:30.691646+0000","last_became_active":"2023-12-24T20:01:30.691194+0000","last_became_peered":"2023-12-24T20:01:30.691194+0000","last_unstale":"2023-12-24T20:01:30.691646+0000","last_undegraded":"2023-12-24T20:01:30.691646+0000","last_fullsized":"2023-12-24T20:01:30.691646+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:16:38.971680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690666+0000","last_change":"2023-12-24T20:01:30.690516+0000","last_active":"2023-12-24T20:01:30.690666+0000","last_peered":"2023-12-24T20:01:30.690666+0000","last_clean":"2023-12-24T20:01:30.690666+0000","last_became_active":"2023-12-24T20:01:30.689819+0000","last_became_peered":"2023-12-24T20:01:30.689819+0000","last_unstale":"2023-12-24T20:01:30.690666+0000","last_undegraded":"2023-12-24T20:01:30.690666+0000","last_fullsized":"2023-12-24T20:01:30.690666+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:46:32.224046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.693507+0000","last_change":"2023-12-24T20:01:30.693456+0000","last_active":"2023-12-24T20:01:30.693507+0000","last_peered":"2023-12-24T20:01:30.693507+0000","last_clean":"2023-12-24T20:01:30.693507+0000","last_became_active":"2023-12-24T20:01:30.693028+0000","last_became_peered":"2023-12-24T20:01:30.693028+0000","last_unstale":"2023-12-24T20:01:30.693507+0000","last_undegraded":"2023-12-24T20:01:30.693507+0000","last_fullsized":"2023-12-24T20:01:30.693507+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:39.708945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.683426+0000","last_change":"2023-12-24T20:01:30.683228+0000","last_active":"2023-12-24T20:01:30.683426+0000","last_peered":"2023-12-24T20:01:30.683426+0000","last_clean":"2023-12-24T20:01:30.683426+0000","last_became_active":"2023-12-24T20:01:30.682583+0000","last_became_peered":"2023-12-24T20:01:30.682583+0000","last_unstale":"2023-12-24T20:01:30.683426+0000","last_undegraded":"2023-12-24T20:01:30.683426+0000","last_fullsized":"2023-12-24T20:01:30.683426+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:56.051668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689135+0000","last_change":"2023-12-24T20:01:30.687905+0000","last_active":"2023-12-24T20:01:30.689135+0000","last_peered":"2023-12-24T20:01:30.689135+0000","last_clean":"2023-12-24T20:01:30.689135+0000","last_became_active":"2023-12-24T20:01:30.687613+0000","last_became_peered":"2023-12-24T20:01:30.687613+0000","last_unstale":"2023-12-24T20:01:30.689135+0000","last_undegraded":"2023-12-24T20:01:30.689135+0000","last_fullsized":"2023-12-24T20:01:30.689135+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:41.535603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690694+0000","last_change":"2023-12-24T20:01:30.690625+0000","last_active":"2023-12-24T20:01:30.690694+0000","last_peered":"2023-12-24T20:01:30.690694+0000","last_clean":"2023-12-24T20:01:30.690694+0000","last_became_active":"2023-12-24T20:01:30.690190+0000","last_became_peered":"2023-12-24T20:01:30.690190+0000","last_unstale":"2023-12-24T20:01:30.690694+0000","last_undegraded":"2023-12-24T20:01:30.690694+0000","last_fullsized":"2023-12-24T20:01:30.690694+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.693526+0000","last_change":"2023-12-24T20:01:30.693463+0000","last_active":"2023-12-24T20:01:30.693526+0000","last_peered":"2023-12-24T20:01:30.693526+0000","last_clean":"2023-12-24T20:01:30.693526+0000","last_became_active":"2023-12-24T20:01:30.693226+0000","last_became_peered":"2023-12-24T20:01:30.693226+0000","last_unstale":"2023-12-24T20:01:30.693526+0000","last_undegraded":"2023-12-24T20:01:30.693526+0000","last_fullsized":"2023-12-24T20:01:30.693526+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:53.030393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.693188+0000","last_change":"2023-12-24T20:01:30.693120+0000","last_active":"2023-12-24T20:01:30.693188+0000","last_peered":"2023-12-24T20:01:30.693188+0000","last_clean":"2023-12-24T20:01:30.693188+0000","last_became_active":"2023-12-24T20:01:30.692891+0000","last_became_peered":"2023-12-24T20:01:30.692891+0000","last_unstale":"2023-12-24T20:01:30.693188+0000","last_undegraded":"2023-12-24T20:01:30.693188+0000","last_fullsized":"2023-12-24T20:01:30.693188+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689659+0000","last_change":"2023-12-24T20:01:30.689567+0000","last_active":"2023-12-24T20:01:30.689659+0000","last_peered":"2023-12-24T20:01:30.689659+0000","last_clean":"2023-12-24T20:01:30.689659+0000","last_became_active":"2023-12-24T20:01:30.689327+0000","last_became_peered":"2023-12-24T20:01:30.689327+0000","last_unstale":"2023-12-24T20:01:30.689659+0000","last_undegraded":"2023-12-24T20:01:30.689659+0000","last_fullsized":"2023-12-24T20:01:30.689659+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688260+0000","last_change":"2023-12-24T20:01:30.688167+0000","last_active":"2023-12-24T20:01:30.688260+0000","last_peered":"2023-12-24T20:01:30.688260+0000","last_clean":"2023-12-24T20:01:30.688260+0000","last_became_active":"2023-12-24T20:01:30.687925+0000","last_became_peered":"2023-12-24T20:01:30.687925+0000","last_unstale":"2023-12-24T20:01:30.688260+0000","last_undegraded":"2023-12-24T20:01:30.688260+0000","last_fullsized":"2023-12-24T20:01:30.688260+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:41.535603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.687198+0000","last_change":"2023-12-24T20:01:30.687127+0000","last_active":"2023-12-24T20:01:30.687198+0000","last_peered":"2023-12-24T20:01:30.687198+0000","last_clean":"2023-12-24T20:01:30.687198+0000","last_became_active":"2023-12-24T20:01:30.686292+0000","last_became_peered":"2023-12-24T20:01:30.686292+0000","last_unstale":"2023-12-24T20:01:30.687198+0000","last_undegraded":"2023-12-24T20:01:30.687198+0000","last_fullsized":"2023-12-24T20:01:30.687198+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:54.753953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.692860+0000","last_change":"2023-12-24T20:01:30.692307+0000","last_active":"2023-12-24T20:01:30.692860+0000","last_peered":"2023-12-24T20:01:30.692860+0000","last_clean":"2023-12-24T20:01:30.692860+0000","last_became_active":"2023-12-24T20:01:30.691917+0000","last_became_peered":"2023-12-24T20:01:30.691917+0000","last_unstale":"2023-12-24T20:01:30.692860+0000","last_undegraded":"2023-12-24T20:01:30.692860+0000","last_fullsized":"2023-12-24T20:01:30.692860+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:14.179654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.693374+0000","last_change":"2023-12-24T20:01:30.693296+0000","last_active":"2023-12-24T20:01:30.693374+0000","last_peered":"2023-12-24T20:01:30.693374+0000","last_clean":"2023-12-24T20:01:30.693374+0000","last_became_active":"2023-12-24T20:01:30.691298+0000","last_became_peered":"2023-12-24T20:01:30.691298+0000","last_unstale":"2023-12-24T20:01:30.693374+0000","last_undegraded":"2023-12-24T20:01:30.693374+0000","last_fullsized":"2023-12-24T20:01:30.693374+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:38.693665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684232+0000","last_change":"2023-12-24T20:01:30.683702+0000","last_active":"2023-12-24T20:01:30.684232+0000","last_peered":"2023-12-24T20:01:30.684232+0000","last_clean":"2023-12-24T20:01:30.684232+0000","last_became_active":"2023-12-24T20:01:30.682983+0000","last_became_peered":"2023-12-24T20:01:30.682983+0000","last_unstale":"2023-12-24T20:01:30.684232+0000","last_undegraded":"2023-12-24T20:01:30.684232+0000","last_fullsized":"2023-12-24T20:01:30.684232+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:49:16.801499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.685997+0000","last_change":"2023-12-24T20:01:30.685819+0000","last_active":"2023-12-24T20:01:30.685997+0000","last_peered":"2023-12-24T20:01:30.685997+0000","last_clean":"2023-12-24T20:01:30.685997+0000","last_became_active":"2023-12-24T20:01:30.685569+0000","last_became_peered":"2023-12-24T20:01:30.685569+0000","last_unstale":"2023-12-24T20:01:30.685997+0000","last_undegraded":"2023-12-24T20:01:30.685997+0000","last_fullsized":"2023-12-24T20:01:30.685997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:14.617306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.697332+0000","last_change":"2023-12-24T20:01:30.697086+0000","last_active":"2023-12-24T20:01:30.697332+0000","last_peered":"2023-12-24T20:01:30.697332+0000","last_clean":"2023-12-24T20:01:30.697332+0000","last_became_active":"2023-12-24T20:01:30.696633+0000","last_became_peered":"2023-12-24T20:01:30.696633+0000","last_unstale":"2023-12-24T20:01:30.697332+0000","last_undegraded":"2023-12-24T20:01:30.697332+0000","last_fullsized":"2023-12-24T20:01:30.697332+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:31.210096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.696784+0000","last_change":"2023-12-24T20:01:30.696682+0000","last_active":"2023-12-24T20:01:30.696784+0000","last_peered":"2023-12-24T20:01:30.696784+0000","last_clean":"2023-12-24T20:01:30.696784+0000","last_became_active":"2023-12-24T20:01:30.696206+0000","last_became_peered":"2023-12-24T20:01:30.696206+0000","last_unstale":"2023-12-24T20:01:30.696784+0000","last_undegraded":"2023-12-24T20:01:30.696784+0000","last_fullsized":"2023-12-24T20:01:30.696784+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:32.333494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689655+0000","last_change":"2023-12-24T20:01:30.689533+0000","last_active":"2023-12-24T20:01:30.689655+0000","last_peered":"2023-12-24T20:01:30.689655+0000","last_clean":"2023-12-24T20:01:30.689655+0000","last_became_active":"2023-12-24T20:01:30.689077+0000","last_became_peered":"2023-12-24T20:01:30.689077+0000","last_unstale":"2023-12-24T20:01:30.689655+0000","last_undegraded":"2023-12-24T20:01:30.689655+0000","last_fullsized":"2023-12-24T20:01:30.689655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:20:33.519692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688972+0000","last_change":"2023-12-24T20:01:30.688714+0000","last_active":"2023-12-24T20:01:30.688972+0000","last_peered":"2023-12-24T20:01:30.688972+0000","last_clean":"2023-12-24T20:01:30.688972+0000","last_became_active":"2023-12-24T20:01:30.688182+0000","last_became_peered":"2023-12-24T20:01:30.688182+0000","last_unstale":"2023-12-24T20:01:30.688972+0000","last_undegraded":"2023-12-24T20:01:30.688972+0000","last_fullsized":"2023-12-24T20:01:30.688972+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:55:38.750992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684286+0000","last_change":"2023-12-24T20:01:30.684127+0000","last_active":"2023-12-24T20:01:30.684286+0000","last_peered":"2023-12-24T20:01:30.684286+0000","last_clean":"2023-12-24T20:01:30.684286+0000","last_became_active":"2023-12-24T20:01:30.683878+0000","last_became_peered":"2023-12-24T20:01:30.683878+0000","last_unstale":"2023-12-24T20:01:30.684286+0000","last_undegraded":"2023-12-24T20:01:30.684286+0000","last_fullsized":"2023-12-24T20:01:30.684286+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:07:35.870337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689621+0000","last_change":"2023-12-24T20:01:30.689256+0000","last_active":"2023-12-24T20:01:30.689621+0000","last_peered":"2023-12-24T20:01:30.689621+0000","last_clean":"2023-12-24T20:01:30.689621+0000","last_became_active":"2023-12-24T20:01:30.684589+0000","last_became_peered":"2023-12-24T20:01:30.684589+0000","last_unstale":"2023-12-24T20:01:30.689621+0000","last_undegraded":"2023-12-24T20:01:30.689621+0000","last_fullsized":"2023-12-24T20:01:30.689621+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:42:11.494990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690153+0000","last_change":"2023-12-24T20:01:30.689284+0000","last_active":"2023-12-24T20:01:30.690153+0000","last_peered":"2023-12-24T20:01:30.690153+0000","last_clean":"2023-12-24T20:01:30.690153+0000","last_became_active":"2023-12-24T20:01:30.687484+0000","last_became_peered":"2023-12-24T20:01:30.687484+0000","last_unstale":"2023-12-24T20:01:30.690153+0000","last_undegraded":"2023-12-24T20:01:30.690153+0000","last_fullsized":"2023-12-24T20:01:30.690153+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:52:22.284692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686619+0000","last_change":"2023-12-24T20:01:30.686378+0000","last_active":"2023-12-24T20:01:30.686619+0000","last_peered":"2023-12-24T20:01:30.686619+0000","last_clean":"2023-12-24T20:01:30.686619+0000","last_became_active":"2023-12-24T20:01:30.685807+0000","last_became_peered":"2023-12-24T20:01:30.685807+0000","last_unstale":"2023-12-24T20:01:30.686619+0000","last_undegraded":"2023-12-24T20:01:30.686619+0000","last_fullsized":"2023-12-24T20:01:30.686619+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:32.333494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684255+0000","last_change":"2023-12-24T20:01:30.683862+0000","last_active":"2023-12-24T20:01:30.684255+0000","last_peered":"2023-12-24T20:01:30.684255+0000","last_clean":"2023-12-24T20:01:30.684255+0000","last_became_active":"2023-12-24T20:01:30.683465+0000","last_became_peered":"2023-12-24T20:01:30.683465+0000","last_unstale":"2023-12-24T20:01:30.684255+0000","last_undegraded":"2023-12-24T20:01:30.684255+0000","last_fullsized":"2023-12-24T20:01:30.684255+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:13.363115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686754+0000","last_change":"2023-12-24T20:01:30.686675+0000","last_active":"2023-12-24T20:01:30.686754+0000","last_peered":"2023-12-24T20:01:30.686754+0000","last_clean":"2023-12-24T20:01:30.686754+0000","last_became_active":"2023-12-24T20:01:30.686426+0000","last_became_peered":"2023-12-24T20:01:30.686426+0000","last_unstale":"2023-12-24T20:01:30.686754+0000","last_undegraded":"2023-12-24T20:01:30.686754+0000","last_fullsized":"2023-12-24T20:01:30.686754+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:22:04.355354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.692094+0000","last_change":"2023-12-24T20:01:30.692031+0000","last_active":"2023-12-24T20:01:30.692094+0000","last_peered":"2023-12-24T20:01:30.692094+0000","last_clean":"2023-12-24T20:01:30.692094+0000","last_became_active":"2023-12-24T20:01:30.691266+0000","last_became_peered":"2023-12-24T20:01:30.691266+0000","last_unstale":"2023-12-24T20:01:30.692094+0000","last_undegraded":"2023-12-24T20:01:30.692094+0000","last_fullsized":"2023-12-24T20:01:30.692094+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:37.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.697351+0000","last_change":"2023-12-24T20:01:30.697228+0000","last_active":"2023-12-24T20:01:30.697351+0000","last_peered":"2023-12-24T20:01:30.697351+0000","last_clean":"2023-12-24T20:01:30.697351+0000","last_became_active":"2023-12-24T20:01:30.696974+0000","last_became_peered":"2023-12-24T20:01:30.696974+0000","last_unstale":"2023-12-24T20:01:30.697351+0000","last_undegraded":"2023-12-24T20:01:30.697351+0000","last_fullsized":"2023-12-24T20:01:30.697351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:18.050260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.687621+0000","last_change":"2023-12-24T20:01:30.687554+0000","last_active":"2023-12-24T20:01:30.687621+0000","last_peered":"2023-12-24T20:01:30.687621+0000","last_clean":"2023-12-24T20:01:30.687621+0000","last_became_active":"2023-12-24T20:01:30.687357+0000","last_became_peered":"2023-12-24T20:01:30.687357+0000","last_unstale":"2023-12-24T20:01:30.687621+0000","last_undegraded":"2023-12-24T20:01:30.687621+0000","last_fullsized":"2023-12-24T20:01:30.687621+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:31.210096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684655+0000","last_change":"2023-12-24T20:01:30.684550+0000","last_active":"2023-12-24T20:01:30.684655+0000","last_peered":"2023-12-24T20:01:30.684655+0000","last_clean":"2023-12-24T20:01:30.684655+0000","last_became_active":"2023-12-24T20:01:30.683797+0000","last_became_peered":"2023-12-24T20:01:30.683797+0000","last_unstale":"2023-12-24T20:01:30.684655+0000","last_undegraded":"2023-12-24T20:01:30.684655+0000","last_fullsized":"2023-12-24T20:01:30.684655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:15:19.334636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686183+0000","last_change":"2023-12-24T20:01:30.685665+0000","last_active":"2023-12-24T20:01:30.686183+0000","last_peered":"2023-12-24T20:01:30.686183+0000","last_clean":"2023-12-24T20:01:30.686183+0000","last_became_active":"2023-12-24T20:01:30.685312+0000","last_became_peered":"2023-12-24T20:01:30.685312+0000","last_unstale":"2023-12-24T20:01:30.686183+0000","last_undegraded":"2023-12-24T20:01:30.686183+0000","last_fullsized":"2023-12-24T20:01:30.686183+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:15.376868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686836+0000","last_change":"2023-12-24T20:01:30.686756+0000","last_active":"2023-12-24T20:01:30.686836+0000","last_peered":"2023-12-24T20:01:30.686836+0000","last_clean":"2023-12-24T20:01:30.686836+0000","last_became_active":"2023-12-24T20:01:30.686347+0000","last_became_peered":"2023-12-24T20:01:30.686347+0000","last_unstale":"2023-12-24T20:01:30.686836+0000","last_undegraded":"2023-12-24T20:01:30.686836+0000","last_fullsized":"2023-12-24T20:01:30.686836+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:45:28.761106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.692842+0000","last_change":"2023-12-24T20:01:30.692150+0000","last_active":"2023-12-24T20:01:30.692842+0000","last_peered":"2023-12-24T20:01:30.692842+0000","last_clean":"2023-12-24T20:01:30.692842+0000","last_became_active":"2023-12-24T20:01:30.691646+0000","last_became_peered":"2023-12-24T20:01:30.691646+0000","last_unstale":"2023-12-24T20:01:30.692842+0000","last_undegraded":"2023-12-24T20:01:30.692842+0000","last_fullsized":"2023-12-24T20:01:30.692842+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.695201+0000","last_change":"2023-12-24T20:01:30.694470+0000","last_active":"2023-12-24T20:01:30.695201+0000","last_peered":"2023-12-24T20:01:30.695201+0000","last_clean":"2023-12-24T20:01:30.695201+0000","last_became_active":"2023-12-24T20:01:30.689061+0000","last_became_peered":"2023-12-24T20:01:30.689061+0000","last_unstale":"2023-12-24T20:01:30.695201+0000","last_undegraded":"2023-12-24T20:01:30.695201+0000","last_fullsized":"2023-12-24T20:01:30.695201+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:23:57.708727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"98'4","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705559+0000","last_change":"2023-12-24T20:01:29.679071+0000","last_active":"2023-12-24T20:01:30.705559+0000","last_peered":"2023-12-24T20:01:30.705559+0000","last_clean":"2023-12-24T20:01:30.705559+0000","last_became_active":"2023-12-24T20:01:29.678350+0000","last_became_peered":"2023-12-24T20:01:29.678350+0000","last_unstale":"2023-12-24T20:01:30.705559+0000","last_undegraded":"2023-12-24T20:01:30.705559+0000","last_fullsized":"2023-12-24T20:01:30.705559+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:43.873476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686638+0000","last_change":"2023-12-24T20:01:30.686524+0000","last_active":"2023-12-24T20:01:30.686638+0000","last_peered":"2023-12-24T20:01:30.686638+0000","last_clean":"2023-12-24T20:01:30.686638+0000","last_became_active":"2023-12-24T20:01:30.686135+0000","last_became_peered":"2023-12-24T20:01:30.686135+0000","last_unstale":"2023-12-24T20:01:30.686638+0000","last_undegraded":"2023-12-24T20:01:30.686638+0000","last_fullsized":"2023-12-24T20:01:30.686638+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:38.482726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705449+0000","last_change":"2023-12-24T20:01:29.675805+0000","last_active":"2023-12-24T20:01:30.705449+0000","last_peered":"2023-12-24T20:01:30.705449+0000","last_clean":"2023-12-24T20:01:30.705449+0000","last_became_active":"2023-12-24T20:01:29.675510+0000","last_became_peered":"2023-12-24T20:01:29.675510+0000","last_unstale":"2023-12-24T20:01:30.705449+0000","last_undegraded":"2023-12-24T20:01:30.705449+0000","last_fullsized":"2023-12-24T20:01:30.705449+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:56.278435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.691516+0000","last_change":"2023-12-24T20:01:30.691425+0000","last_active":"2023-12-24T20:01:30.691516+0000","last_peered":"2023-12-24T20:01:30.691516+0000","last_clean":"2023-12-24T20:01:30.691516+0000","last_became_active":"2023-12-24T20:01:30.689761+0000","last_became_peered":"2023-12-24T20:01:30.689761+0000","last_unstale":"2023-12-24T20:01:30.691516+0000","last_undegraded":"2023-12-24T20:01:30.691516+0000","last_fullsized":"2023-12-24T20:01:30.691516+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.702335+0000","last_change":"2023-12-24T20:01:29.669643+0000","last_active":"2023-12-24T20:01:30.702335+0000","last_peered":"2023-12-24T20:01:30.702335+0000","last_clean":"2023-12-24T20:01:30.702335+0000","last_became_active":"2023-12-24T20:01:29.669404+0000","last_became_peered":"2023-12-24T20:01:29.669404+0000","last_unstale":"2023-12-24T20:01:30.702335+0000","last_undegraded":"2023-12-24T20:01:30.702335+0000","last_fullsized":"2023-12-24T20:01:30.702335+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:30.205035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.694622+0000","last_change":"2023-12-24T20:01:30.694557+0000","last_active":"2023-12-24T20:01:30.694622+0000","last_peered":"2023-12-24T20:01:30.694622+0000","last_clean":"2023-12-24T20:01:30.694622+0000","last_became_active":"2023-12-24T20:01:30.693781+0000","last_became_peered":"2023-12-24T20:01:30.693781+0000","last_unstale":"2023-12-24T20:01:30.694622+0000","last_undegraded":"2023-12-24T20:01:30.694622+0000","last_fullsized":"2023-12-24T20:01:30.694622+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:13.388896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.702790+0000","last_change":"2023-12-24T20:01:29.669603+0000","last_active":"2023-12-24T20:01:30.702790+0000","last_peered":"2023-12-24T20:01:30.702790+0000","last_clean":"2023-12-24T20:01:30.702790+0000","last_became_active":"2023-12-24T20:01:29.669369+0000","last_became_peered":"2023-12-24T20:01:29.669369+0000","last_unstale":"2023-12-24T20:01:30.702790+0000","last_undegraded":"2023-12-24T20:01:30.702790+0000","last_fullsized":"2023-12-24T20:01:30.702790+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:31.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690171+0000","last_change":"2023-12-24T20:01:30.689426+0000","last_active":"2023-12-24T20:01:30.690171+0000","last_peered":"2023-12-24T20:01:30.690171+0000","last_clean":"2023-12-24T20:01:30.690171+0000","last_became_active":"2023-12-24T20:01:30.688830+0000","last_became_peered":"2023-12-24T20:01:30.688830+0000","last_unstale":"2023-12-24T20:01:30.690171+0000","last_undegraded":"2023-12-24T20:01:30.690171+0000","last_fullsized":"2023-12-24T20:01:30.690171+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:27.211132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.704648+0000","last_change":"2023-12-24T20:01:29.676516+0000","last_active":"2023-12-24T20:01:30.704648+0000","last_peered":"2023-12-24T20:01:30.704648+0000","last_clean":"2023-12-24T20:01:30.704648+0000","last_became_active":"2023-12-24T20:01:29.676280+0000","last_became_peered":"2023-12-24T20:01:29.676280+0000","last_unstale":"2023-12-24T20:01:30.704648+0000","last_undegraded":"2023-12-24T20:01:30.704648+0000","last_fullsized":"2023-12-24T20:01:30.704648+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:32.908184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.696573+0000","last_change":"2023-12-24T20:01:30.696470+0000","last_active":"2023-12-24T20:01:30.696573+0000","last_peered":"2023-12-24T20:01:30.696573+0000","last_clean":"2023-12-24T20:01:30.696573+0000","last_became_active":"2023-12-24T20:01:30.695864+0000","last_became_peered":"2023-12-24T20:01:30.695864+0000","last_unstale":"2023-12-24T20:01:30.696573+0000","last_undegraded":"2023-12-24T20:01:30.696573+0000","last_fullsized":"2023-12-24T20:01:30.696573+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:13.388896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705456+0000","last_change":"2023-12-24T20:01:29.673265+0000","last_active":"2023-12-24T20:01:30.705456+0000","last_peered":"2023-12-24T20:01:30.705456+0000","last_clean":"2023-12-24T20:01:30.705456+0000","last_became_active":"2023-12-24T20:01:29.672837+0000","last_became_peered":"2023-12-24T20:01:29.672837+0000","last_unstale":"2023-12-24T20:01:30.705456+0000","last_undegraded":"2023-12-24T20:01:30.705456+0000","last_fullsized":"2023-12-24T20:01:30.705456+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:20.057436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.694322+0000","last_change":"2023-12-24T20:01:30.694223+0000","last_active":"2023-12-24T20:01:30.694322+0000","last_peered":"2023-12-24T20:01:30.694322+0000","last_clean":"2023-12-24T20:01:30.694322+0000","last_became_active":"2023-12-24T20:01:30.693323+0000","last_became_peered":"2023-12-24T20:01:30.693323+0000","last_unstale":"2023-12-24T20:01:30.694322+0000","last_undegraded":"2023-12-24T20:01:30.694322+0000","last_fullsized":"2023-12-24T20:01:30.694322+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:41.535603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.682256+0000","last_change":"2023-12-24T20:01:29.672787+0000","last_active":"2023-12-24T20:01:30.682256+0000","last_peered":"2023-12-24T20:01:30.682256+0000","last_clean":"2023-12-24T20:01:30.682256+0000","last_became_active":"2023-12-24T20:01:29.672509+0000","last_became_peered":"2023-12-24T20:01:29.672509+0000","last_unstale":"2023-12-24T20:01:30.682256+0000","last_undegraded":"2023-12-24T20:01:30.682256+0000","last_fullsized":"2023-12-24T20:01:30.682256+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:38.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684021+0000","last_change":"2023-12-24T20:01:30.683434+0000","last_active":"2023-12-24T20:01:30.684021+0000","last_peered":"2023-12-24T20:01:30.684021+0000","last_clean":"2023-12-24T20:01:30.684021+0000","last_became_active":"2023-12-24T20:01:30.683197+0000","last_became_peered":"2023-12-24T20:01:30.683197+0000","last_unstale":"2023-12-24T20:01:30.684021+0000","last_undegraded":"2023-12-24T20:01:30.684021+0000","last_fullsized":"2023-12-24T20:01:30.684021+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:36:34.497869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.678791+0000","last_change":"2023-12-24T20:01:29.672298+0000","last_active":"2023-12-24T20:01:30.678791+0000","last_peered":"2023-12-24T20:01:30.678791+0000","last_clean":"2023-12-24T20:01:30.678791+0000","last_became_active":"2023-12-24T20:01:29.671951+0000","last_became_peered":"2023-12-24T20:01:29.671951+0000","last_unstale":"2023-12-24T20:01:30.678791+0000","last_undegraded":"2023-12-24T20:01:30.678791+0000","last_fullsized":"2023-12-24T20:01:30.678791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:07:34.865275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684001+0000","last_change":"2023-12-24T20:01:30.682688+0000","last_active":"2023-12-24T20:01:30.684001+0000","last_peered":"2023-12-24T20:01:30.684001+0000","last_clean":"2023-12-24T20:01:30.684001+0000","last_became_active":"2023-12-24T20:01:30.682439+0000","last_became_peered":"2023-12-24T20:01:30.682439+0000","last_unstale":"2023-12-24T20:01:30.684001+0000","last_undegraded":"2023-12-24T20:01:30.684001+0000","last_fullsized":"2023-12-24T20:01:30.684001+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:23:57.708727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688105+0000","last_change":"2023-12-24T20:01:29.674193+0000","last_active":"2023-12-24T20:01:30.688105+0000","last_peered":"2023-12-24T20:01:30.688105+0000","last_clean":"2023-12-24T20:01:30.688105+0000","last_became_active":"2023-12-24T20:01:29.673869+0000","last_became_peered":"2023-12-24T20:01:29.673869+0000","last_unstale":"2023-12-24T20:01:30.688105+0000","last_undegraded":"2023-12-24T20:01:30.688105+0000","last_fullsized":"2023-12-24T20:01:30.688105+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:34.391823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690626+0000","last_change":"2023-12-24T20:01:30.690477+0000","last_active":"2023-12-24T20:01:30.690626+0000","last_peered":"2023-12-24T20:01:30.690626+0000","last_clean":"2023-12-24T20:01:30.690626+0000","last_became_active":"2023-12-24T20:01:30.689840+0000","last_became_peered":"2023-12-24T20:01:30.689840+0000","last_unstale":"2023-12-24T20:01:30.690626+0000","last_undegraded":"2023-12-24T20:01:30.690626+0000","last_fullsized":"2023-12-24T20:01:30.690626+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.685316+0000","last_change":"2023-12-24T20:01:29.679139+0000","last_active":"2023-12-24T20:01:30.685316+0000","last_peered":"2023-12-24T20:01:30.685316+0000","last_clean":"2023-12-24T20:01:30.685316+0000","last_became_active":"2023-12-24T20:01:29.678908+0000","last_became_peered":"2023-12-24T20:01:29.678908+0000","last_unstale":"2023-12-24T20:01:30.685316+0000","last_undegraded":"2023-12-24T20:01:30.685316+0000","last_fullsized":"2023-12-24T20:01:30.685316+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:53.748891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688989+0000","last_change":"2023-12-24T20:01:30.688890+0000","last_active":"2023-12-24T20:01:30.688989+0000","last_peered":"2023-12-24T20:01:30.688989+0000","last_clean":"2023-12-24T20:01:30.688989+0000","last_became_active":"2023-12-24T20:01:30.688486+0000","last_became_peered":"2023-12-24T20:01:30.688486+0000","last_unstale":"2023-12-24T20:01:30.688989+0000","last_undegraded":"2023-12-24T20:01:30.688989+0000","last_fullsized":"2023-12-24T20:01:30.688989+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:39:44.091736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"98'3","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705227+0000","last_change":"2023-12-24T20:01:29.680251+0000","last_active":"2023-12-24T20:01:30.705227+0000","last_peered":"2023-12-24T20:01:30.705227+0000","last_clean":"2023-12-24T20:01:30.705227+0000","last_became_active":"2023-12-24T20:01:29.678811+0000","last_became_peered":"2023-12-24T20:01:29.678811+0000","last_unstale":"2023-12-24T20:01:30.705227+0000","last_undegraded":"2023-12-24T20:01:30.705227+0000","last_fullsized":"2023-12-24T20:01:30.705227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:22.049103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689159+0000","last_change":"2023-12-24T20:01:30.688851+0000","last_active":"2023-12-24T20:01:30.689159+0000","last_peered":"2023-12-24T20:01:30.689159+0000","last_clean":"2023-12-24T20:01:30.689159+0000","last_became_active":"2023-12-24T20:01:30.688569+0000","last_became_peered":"2023-12-24T20:01:30.688569+0000","last_unstale":"2023-12-24T20:01:30.689159+0000","last_undegraded":"2023-12-24T20:01:30.689159+0000","last_fullsized":"2023-12-24T20:01:30.689159+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:50:59.398891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"98'6","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.706512+0000","last_change":"2023-12-24T20:01:29.677427+0000","last_active":"2023-12-24T20:01:30.706512+0000","last_peered":"2023-12-24T20:01:30.706512+0000","last_clean":"2023-12-24T20:01:30.706512+0000","last_became_active":"2023-12-24T20:01:29.677236+0000","last_became_peered":"2023-12-24T20:01:29.677236+0000","last_unstale":"2023-12-24T20:01:30.706512+0000","last_undegraded":"2023-12-24T20:01:30.706512+0000","last_fullsized":"2023-12-24T20:01:30.706512+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:15:08.313529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688014+0000","last_change":"2023-12-24T20:01:30.687785+0000","last_active":"2023-12-24T20:01:30.688014+0000","last_peered":"2023-12-24T20:01:30.688014+0000","last_clean":"2023-12-24T20:01:30.688014+0000","last_became_active":"2023-12-24T20:01:30.687008+0000","last_became_peered":"2023-12-24T20:01:30.687008+0000","last_unstale":"2023-12-24T20:01:30.688014+0000","last_undegraded":"2023-12-24T20:01:30.688014+0000","last_fullsized":"2023-12-24T20:01:30.688014+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:05:34.303284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705352+0000","last_change":"2023-12-24T20:01:29.667181+0000","last_active":"2023-12-24T20:01:30.705352+0000","last_peered":"2023-12-24T20:01:30.705352+0000","last_clean":"2023-12-24T20:01:30.705352+0000","last_became_active":"2023-12-24T20:01:29.666928+0000","last_became_peered":"2023-12-24T20:01:29.666928+0000","last_unstale":"2023-12-24T20:01:30.705352+0000","last_undegraded":"2023-12-24T20:01:30.705352+0000","last_fullsized":"2023-12-24T20:01:30.705352+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:52.025332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.694469+0000","last_change":"2023-12-24T20:01:30.694407+0000","last_active":"2023-12-24T20:01:30.694469+0000","last_peered":"2023-12-24T20:01:30.694469+0000","last_clean":"2023-12-24T20:01:30.694469+0000","last_became_active":"2023-12-24T20:01:30.693554+0000","last_became_peered":"2023-12-24T20:01:30.693554+0000","last_unstale":"2023-12-24T20:01:30.694469+0000","last_undegraded":"2023-12-24T20:01:30.694469+0000","last_fullsized":"2023-12-24T20:01:30.694469+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:16:38.971680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.679941+0000","last_change":"2023-12-24T20:01:29.666145+0000","last_active":"2023-12-24T20:01:30.679941+0000","last_peered":"2023-12-24T20:01:30.679941+0000","last_clean":"2023-12-24T20:01:30.679941+0000","last_became_active":"2023-12-24T20:01:29.665940+0000","last_became_peered":"2023-12-24T20:01:29.665940+0000","last_unstale":"2023-12-24T20:01:30.679941+0000","last_undegraded":"2023-12-24T20:01:30.679941+0000","last_fullsized":"2023-12-24T20:01:30.679941+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:30.205035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690192+0000","last_change":"2023-12-24T20:01:30.689577+0000","last_active":"2023-12-24T20:01:30.690192+0000","last_peered":"2023-12-24T20:01:30.690192+0000","last_clean":"2023-12-24T20:01:30.690192+0000","last_became_active":"2023-12-24T20:01:30.689169+0000","last_became_peered":"2023-12-24T20:01:30.689169+0000","last_unstale":"2023-12-24T20:01:30.690192+0000","last_undegraded":"2023-12-24T20:01:30.690192+0000","last_fullsized":"2023-12-24T20:01:30.690192+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:57.182265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.682302+0000","last_change":"2023-12-24T20:01:29.673342+0000","last_active":"2023-12-24T20:01:30.682302+0000","last_peered":"2023-12-24T20:01:30.682302+0000","last_clean":"2023-12-24T20:01:30.682302+0000","last_became_active":"2023-12-24T20:01:29.672893+0000","last_became_peered":"2023-12-24T20:01:29.672893+0000","last_unstale":"2023-12-24T20:01:30.682302+0000","last_undegraded":"2023-12-24T20:01:30.682302+0000","last_fullsized":"2023-12-24T20:01:30.682302+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:34.391823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690439+0000","last_change":"2023-12-24T20:01:30.690368+0000","last_active":"2023-12-24T20:01:30.690439+0000","last_peered":"2023-12-24T20:01:30.690439+0000","last_clean":"2023-12-24T20:01:30.690439+0000","last_became_active":"2023-12-24T20:01:30.689500+0000","last_became_peered":"2023-12-24T20:01:30.689500+0000","last_unstale":"2023-12-24T20:01:30.690439+0000","last_undegraded":"2023-12-24T20:01:30.690439+0000","last_fullsized":"2023-12-24T20:01:30.690439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:55.189414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"98'8","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705707+0000","last_change":"2023-12-24T20:01:29.676797+0000","last_active":"2023-12-24T20:01:30.705707+0000","last_peered":"2023-12-24T20:01:30.705707+0000","last_clean":"2023-12-24T20:01:30.705707+0000","last_became_active":"2023-12-24T20:01:29.676392+0000","last_became_peered":"2023-12-24T20:01:29.676392+0000","last_unstale":"2023-12-24T20:01:30.705707+0000","last_undegraded":"2023-12-24T20:01:30.705707+0000","last_fullsized":"2023-12-24T20:01:30.705707+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:40.530541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.694120+0000","last_change":"2023-12-24T20:01:30.694055+0000","last_active":"2023-12-24T20:01:30.694120+0000","last_peered":"2023-12-24T20:01:30.694120+0000","last_clean":"2023-12-24T20:01:30.694120+0000","last_became_active":"2023-12-24T20:01:30.690928+0000","last_became_peered":"2023-12-24T20:01:30.690928+0000","last_unstale":"2023-12-24T20:01:30.694120+0000","last_undegraded":"2023-12-24T20:01:30.694120+0000","last_fullsized":"2023-12-24T20:01:30.694120+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:38.482726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.703146+0000","last_change":"2023-12-24T20:01:29.678929+0000","last_active":"2023-12-24T20:01:30.703146+0000","last_peered":"2023-12-24T20:01:30.703146+0000","last_clean":"2023-12-24T20:01:30.703146+0000","last_became_active":"2023-12-24T20:01:29.675007+0000","last_became_peered":"2023-12-24T20:01:29.675007+0000","last_unstale":"2023-12-24T20:01:30.703146+0000","last_undegraded":"2023-12-24T20:01:30.703146+0000","last_fullsized":"2023-12-24T20:01:30.703146+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:15:08.313529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.692877+0000","last_change":"2023-12-24T20:01:30.692497+0000","last_active":"2023-12-24T20:01:30.692877+0000","last_peered":"2023-12-24T20:01:30.692877+0000","last_clean":"2023-12-24T20:01:30.692877+0000","last_became_active":"2023-12-24T20:01:30.692134+0000","last_became_peered":"2023-12-24T20:01:30.692134+0000","last_unstale":"2023-12-24T20:01:30.692877+0000","last_undegraded":"2023-12-24T20:01:30.692877+0000","last_fullsized":"2023-12-24T20:01:30.692877+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.703041+0000","last_change":"2023-12-24T20:01:29.674859+0000","last_active":"2023-12-24T20:01:30.703041+0000","last_peered":"2023-12-24T20:01:30.703041+0000","last_clean":"2023-12-24T20:01:30.703041+0000","last_became_active":"2023-12-24T20:01:29.674584+0000","last_became_peered":"2023-12-24T20:01:29.674584+0000","last_unstale":"2023-12-24T20:01:30.703041+0000","last_undegraded":"2023-12-24T20:01:30.703041+0000","last_fullsized":"2023-12-24T20:01:30.703041+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:12.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689108+0000","last_change":"2023-12-24T20:01:30.688328+0000","last_active":"2023-12-24T20:01:30.689108+0000","last_peered":"2023-12-24T20:01:30.689108+0000","last_clean":"2023-12-24T20:01:30.689108+0000","last_became_active":"2023-12-24T20:01:30.688019+0000","last_became_peered":"2023-12-24T20:01:30.688019+0000","last_unstale":"2023-12-24T20:01:30.689108+0000","last_undegraded":"2023-12-24T20:01:30.689108+0000","last_fullsized":"2023-12-24T20:01:30.689108+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:39.708945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.681648+0000","last_change":"2023-12-24T20:01:29.671113+0000","last_active":"2023-12-24T20:01:30.681648+0000","last_peered":"2023-12-24T20:01:30.681648+0000","last_clean":"2023-12-24T20:01:30.681648+0000","last_became_active":"2023-12-24T20:01:29.670833+0000","last_became_peered":"2023-12-24T20:01:29.670833+0000","last_unstale":"2023-12-24T20:01:30.681648+0000","last_undegraded":"2023-12-24T20:01:30.681648+0000","last_fullsized":"2023-12-24T20:01:30.681648+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:17.045198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684887+0000","last_change":"2023-12-24T20:01:30.684807+0000","last_active":"2023-12-24T20:01:30.684887+0000","last_peered":"2023-12-24T20:01:30.684887+0000","last_clean":"2023-12-24T20:01:30.684887+0000","last_became_active":"2023-12-24T20:01:30.684548+0000","last_became_peered":"2023-12-24T20:01:30.684548+0000","last_unstale":"2023-12-24T20:01:30.684887+0000","last_undegraded":"2023-12-24T20:01:30.684887+0000","last_fullsized":"2023-12-24T20:01:30.684887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:37.631843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705103+0000","last_change":"2023-12-24T20:01:29.674484+0000","last_active":"2023-12-24T20:01:30.705103+0000","last_peered":"2023-12-24T20:01:30.705103+0000","last_clean":"2023-12-24T20:01:30.705103+0000","last_became_active":"2023-12-24T20:01:29.673766+0000","last_became_peered":"2023-12-24T20:01:29.673766+0000","last_unstale":"2023-12-24T20:01:30.705103+0000","last_undegraded":"2023-12-24T20:01:30.705103+0000","last_fullsized":"2023-12-24T20:01:30.705103+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:37.477665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688545+0000","last_change":"2023-12-24T20:01:30.688472+0000","last_active":"2023-12-24T20:01:30.688545+0000","last_peered":"2023-12-24T20:01:30.688545+0000","last_clean":"2023-12-24T20:01:30.688545+0000","last_became_active":"2023-12-24T20:01:30.688084+0000","last_became_peered":"2023-12-24T20:01:30.688084+0000","last_unstale":"2023-12-24T20:01:30.688545+0000","last_undegraded":"2023-12-24T20:01:30.688545+0000","last_fullsized":"2023-12-24T20:01:30.688545+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.680557+0000","last_change":"2023-12-24T20:01:29.679308+0000","last_active":"2023-12-24T20:01:30.680557+0000","last_peered":"2023-12-24T20:01:30.680557+0000","last_clean":"2023-12-24T20:01:30.680557+0000","last_became_active":"2023-12-24T20:01:29.678200+0000","last_became_peered":"2023-12-24T20:01:29.678200+0000","last_unstale":"2023-12-24T20:01:30.680557+0000","last_undegraded":"2023-12-24T20:01:30.680557+0000","last_fullsized":"2023-12-24T20:01:30.680557+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:37:31.083373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689640+0000","last_change":"2023-12-24T20:01:30.689508+0000","last_active":"2023-12-24T20:01:30.689640+0000","last_peered":"2023-12-24T20:01:30.689640+0000","last_clean":"2023-12-24T20:01:30.689640+0000","last_became_active":"2023-12-24T20:01:30.689012+0000","last_became_peered":"2023-12-24T20:01:30.689012+0000","last_unstale":"2023-12-24T20:01:30.689640+0000","last_undegraded":"2023-12-24T20:01:30.689640+0000","last_fullsized":"2023-12-24T20:01:30.689640+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:41:43.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.679565+0000","last_change":"2023-12-24T20:01:29.678815+0000","last_active":"2023-12-24T20:01:30.679565+0000","last_peered":"2023-12-24T20:01:30.679565+0000","last_clean":"2023-12-24T20:01:30.679565+0000","last_became_active":"2023-12-24T20:01:29.678629+0000","last_became_peered":"2023-12-24T20:01:29.678629+0000","last_unstale":"2023-12-24T20:01:30.679565+0000","last_undegraded":"2023-12-24T20:01:30.679565+0000","last_fullsized":"2023-12-24T20:01:30.679565+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:30:21.747257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686034+0000","last_change":"2023-12-24T20:01:30.685981+0000","last_active":"2023-12-24T20:01:30.686034+0000","last_peered":"2023-12-24T20:01:30.686034+0000","last_clean":"2023-12-24T20:01:30.686034+0000","last_became_active":"2023-12-24T20:01:30.685793+0000","last_became_peered":"2023-12-24T20:01:30.685793+0000","last_unstale":"2023-12-24T20:01:30.686034+0000","last_undegraded":"2023-12-24T20:01:30.686034+0000","last_fullsized":"2023-12-24T20:01:30.686034+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.680046+0000","last_change":"2023-12-24T20:01:29.674009+0000","last_active":"2023-12-24T20:01:30.680046+0000","last_peered":"2023-12-24T20:01:30.680046+0000","last_clean":"2023-12-24T20:01:30.680046+0000","last_became_active":"2023-12-24T20:01:29.673781+0000","last_became_peered":"2023-12-24T20:01:29.673781+0000","last_unstale":"2023-12-24T20:01:30.680046+0000","last_undegraded":"2023-12-24T20:01:30.680046+0000","last_fullsized":"2023-12-24T20:01:30.680046+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:31.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689062+0000","last_change":"2023-12-24T20:01:30.688314+0000","last_active":"2023-12-24T20:01:30.689062+0000","last_peered":"2023-12-24T20:01:30.689062+0000","last_clean":"2023-12-24T20:01:30.689062+0000","last_became_active":"2023-12-24T20:01:30.687811+0000","last_became_peered":"2023-12-24T20:01:30.687811+0000","last_unstale":"2023-12-24T20:01:30.689062+0000","last_undegraded":"2023-12-24T20:01:30.689062+0000","last_fullsized":"2023-12-24T20:01:30.689062+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:38.482726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705216+0000","last_change":"2023-12-24T20:01:29.672645+0000","last_active":"2023-12-24T20:01:30.705216+0000","last_peered":"2023-12-24T20:01:30.705216+0000","last_clean":"2023-12-24T20:01:30.705216+0000","last_became_active":"2023-12-24T20:01:29.671896+0000","last_became_peered":"2023-12-24T20:01:29.671896+0000","last_unstale":"2023-12-24T20:01:30.705216+0000","last_undegraded":"2023-12-24T20:01:30.705216+0000","last_fullsized":"2023-12-24T20:01:30.705216+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:41:42.911076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.694554+0000","last_change":"2023-12-24T20:01:30.694497+0000","last_active":"2023-12-24T20:01:30.694554+0000","last_peered":"2023-12-24T20:01:30.694554+0000","last_clean":"2023-12-24T20:01:30.694554+0000","last_became_active":"2023-12-24T20:01:30.694244+0000","last_became_peered":"2023-12-24T20:01:30.694244+0000","last_unstale":"2023-12-24T20:01:30.694554+0000","last_undegraded":"2023-12-24T20:01:30.694554+0000","last_fullsized":"2023-12-24T20:01:30.694554+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:14.179654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-12-24T20:01:31.681883+0000","last_change":"2023-12-24T20:01:29.667274+0000","last_active":"2023-12-24T20:01:31.681883+0000","last_peered":"2023-12-24T20:01:31.681883+0000","last_clean":"2023-12-24T20:01:31.681883+0000","last_became_active":"2023-12-24T20:01:29.666919+0000","last_became_peered":"2023-12-24T20:01:29.666919+0000","last_unstale":"2023-12-24T20:01:31.681883+0000","last_undegraded":"2023-12-24T20:01:31.681883+0000","last_fullsized":"2023-12-24T20:01:31.681883+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:27.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690862+0000","last_change":"2023-12-24T20:01:30.690768+0000","last_active":"2023-12-24T20:01:30.690862+0000","last_peered":"2023-12-24T20:01:30.690862+0000","last_clean":"2023-12-24T20:01:30.690862+0000","last_became_active":"2023-12-24T20:01:30.690510+0000","last_became_peered":"2023-12-24T20:01:30.690510+0000","last_unstale":"2023-12-24T20:01:30.690862+0000","last_undegraded":"2023-12-24T20:01:30.690862+0000","last_fullsized":"2023-12-24T20:01:30.690862+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:37.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686107+0000","last_change":"2023-12-24T20:01:29.679875+0000","last_active":"2023-12-24T20:01:30.686107+0000","last_peered":"2023-12-24T20:01:30.686107+0000","last_clean":"2023-12-24T20:01:30.686107+0000","last_became_active":"2023-12-24T20:01:29.679578+0000","last_became_peered":"2023-12-24T20:01:29.679578+0000","last_unstale":"2023-12-24T20:01:30.686107+0000","last_undegraded":"2023-12-24T20:01:30.686107+0000","last_fullsized":"2023-12-24T20:01:30.686107+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:26.206071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.695221+0000","last_change":"2023-12-24T20:01:30.694615+0000","last_active":"2023-12-24T20:01:30.695221+0000","last_peered":"2023-12-24T20:01:30.695221+0000","last_clean":"2023-12-24T20:01:30.695221+0000","last_became_active":"2023-12-24T20:01:30.694217+0000","last_became_peered":"2023-12-24T20:01:30.694217+0000","last_unstale":"2023-12-24T20:01:30.695221+0000","last_undegraded":"2023-12-24T20:01:30.695221+0000","last_fullsized":"2023-12-24T20:01:30.695221+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:06.004869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684813+0000","last_change":"2023-12-24T20:01:29.672474+0000","last_active":"2023-12-24T20:01:30.684813+0000","last_peered":"2023-12-24T20:01:30.684813+0000","last_clean":"2023-12-24T20:01:30.684813+0000","last_became_active":"2023-12-24T20:01:29.672181+0000","last_became_peered":"2023-12-24T20:01:29.672181+0000","last_unstale":"2023-12-24T20:01:30.684813+0000","last_undegraded":"2023-12-24T20:01:30.684813+0000","last_fullsized":"2023-12-24T20:01:30.684813+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:15:18.329574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.691420+0000","last_change":"2023-12-24T20:01:30.691296+0000","last_active":"2023-12-24T20:01:30.691420+0000","last_peered":"2023-12-24T20:01:30.691420+0000","last_clean":"2023-12-24T20:01:30.691420+0000","last_became_active":"2023-12-24T20:01:30.690898+0000","last_became_peered":"2023-12-24T20:01:30.690898+0000","last_unstale":"2023-12-24T20:01:30.691420+0000","last_undegraded":"2023-12-24T20:01:30.691420+0000","last_fullsized":"2023-12-24T20:01:30.691420+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.682891+0000","last_change":"2023-12-24T20:01:29.671487+0000","last_active":"2023-12-24T20:01:30.682891+0000","last_peered":"2023-12-24T20:01:30.682891+0000","last_clean":"2023-12-24T20:01:30.682891+0000","last_became_active":"2023-12-24T20:01:29.671331+0000","last_became_peered":"2023-12-24T20:01:29.671331+0000","last_unstale":"2023-12-24T20:01:30.682891+0000","last_undegraded":"2023-12-24T20:01:30.682891+0000","last_fullsized":"2023-12-24T20:01:30.682891+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:37.477665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688032+0000","last_change":"2023-12-24T20:01:30.687951+0000","last_active":"2023-12-24T20:01:30.688032+0000","last_peered":"2023-12-24T20:01:30.688032+0000","last_clean":"2023-12-24T20:01:30.688032+0000","last_became_active":"2023-12-24T20:01:30.687452+0000","last_became_peered":"2023-12-24T20:01:30.687452+0000","last_unstale":"2023-12-24T20:01:30.688032+0000","last_undegraded":"2023-12-24T20:01:30.688032+0000","last_fullsized":"2023-12-24T20:01:30.688032+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:41:42.900888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.695613+0000","last_change":"2023-12-24T20:01:29.675924+0000","last_active":"2023-12-24T20:01:30.695613+0000","last_peered":"2023-12-24T20:01:30.695613+0000","last_clean":"2023-12-24T20:01:30.695613+0000","last_became_active":"2023-12-24T20:01:29.675675+0000","last_became_peered":"2023-12-24T20:01:29.675675+0000","last_unstale":"2023-12-24T20:01:30.695613+0000","last_undegraded":"2023-12-24T20:01:30.695613+0000","last_fullsized":"2023-12-24T20:01:30.695613+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:58.129491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.691742+0000","last_change":"2023-12-24T20:01:30.691656+0000","last_active":"2023-12-24T20:01:30.691742+0000","last_peered":"2023-12-24T20:01:30.691742+0000","last_clean":"2023-12-24T20:01:30.691742+0000","last_became_active":"2023-12-24T20:01:30.690873+0000","last_became_peered":"2023-12-24T20:01:30.690873+0000","last_unstale":"2023-12-24T20:01:30.691742+0000","last_undegraded":"2023-12-24T20:01:30.691742+0000","last_fullsized":"2023-12-24T20:01:30.691742+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684962+0000","last_change":"2023-12-24T20:01:29.680409+0000","last_active":"2023-12-24T20:01:30.684962+0000","last_peered":"2023-12-24T20:01:30.684962+0000","last_clean":"2023-12-24T20:01:30.684962+0000","last_became_active":"2023-12-24T20:01:29.679770+0000","last_became_peered":"2023-12-24T20:01:29.679770+0000","last_unstale":"2023-12-24T20:01:30.684962+0000","last_undegraded":"2023-12-24T20:01:30.684962+0000","last_fullsized":"2023-12-24T20:01:30.684962+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:14.371806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690693+0000","last_change":"2023-12-24T20:01:30.690623+0000","last_active":"2023-12-24T20:01:30.690693+0000","last_peered":"2023-12-24T20:01:30.690693+0000","last_clean":"2023-12-24T20:01:30.690693+0000","last_became_active":"2023-12-24T20:01:30.690281+0000","last_became_peered":"2023-12-24T20:01:30.690281+0000","last_unstale":"2023-12-24T20:01:30.690693+0000","last_undegraded":"2023-12-24T20:01:30.690693+0000","last_fullsized":"2023-12-24T20:01:30.690693+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:39.708945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.682264+0000","last_change":"2023-12-24T20:01:29.679483+0000","last_active":"2023-12-24T20:01:30.682264+0000","last_peered":"2023-12-24T20:01:30.682264+0000","last_clean":"2023-12-24T20:01:30.682264+0000","last_became_active":"2023-12-24T20:01:29.679256+0000","last_became_peered":"2023-12-24T20:01:29.679256+0000","last_unstale":"2023-12-24T20:01:30.682264+0000","last_undegraded":"2023-12-24T20:01:30.682264+0000","last_fullsized":"2023-12-24T20:01:30.682264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:50.021067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.691301+0000","last_change":"2023-12-24T20:01:30.690728+0000","last_active":"2023-12-24T20:01:30.691301+0000","last_peered":"2023-12-24T20:01:30.691301+0000","last_clean":"2023-12-24T20:01:30.691301+0000","last_became_active":"2023-12-24T20:01:30.690143+0000","last_became_peered":"2023-12-24T20:01:30.690143+0000","last_unstale":"2023-12-24T20:01:30.691301+0000","last_undegraded":"2023-12-24T20:01:30.691301+0000","last_fullsized":"2023-12-24T20:01:30.691301+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:56.051668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705323+0000","last_change":"2023-12-24T20:01:29.672620+0000","last_active":"2023-12-24T20:01:30.705323+0000","last_peered":"2023-12-24T20:01:30.705323+0000","last_clean":"2023-12-24T20:01:30.705323+0000","last_became_active":"2023-12-24T20:01:29.672380+0000","last_became_peered":"2023-12-24T20:01:29.672380+0000","last_unstale":"2023-12-24T20:01:30.705323+0000","last_undegraded":"2023-12-24T20:01:30.705323+0000","last_fullsized":"2023-12-24T20:01:30.705323+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:32.908184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.682546+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:01:30.682546+0000","last_peered":"2023-12-24T20:01:30.682546+0000","last_clean":"2023-12-24T20:01:30.682546+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:01:30.682546+0000","last_undegraded":"2023-12-24T20:01:30.682546+0000","last_fullsized":"2023-12-24T20:01:30.682546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1097,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194214,"statfs":{"total":200000000,"available":198875708,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.50900000000000001,"15min":0.497},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81000000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46700000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80000000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.624,"15min":0.628},"min":{"1min":0.439,"5min":0.437,"15min":0.437},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54100000000000004}]},{"osd":4,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77600000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.621}]},{"osd":5,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.745,"15min":0.745},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60699999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.873,"15min":0.873},"last":0.63}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465480,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.33600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80400000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.621}]},{"osd":1,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69299999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.52400000000000002},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67200000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67600000000000005,"5min":1.077,"15min":1.077},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.753,"5min":1.048,"15min":1.048},"last":0.65200000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68200000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.745,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46999999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68000000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.44900000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66300000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65600000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.311}]},{"osd":2,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.372,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.26600000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40100000000000002,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35299999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47999999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.621},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.443}]},{"osd":6,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":0.878,"15min":0.878},"last":0.52600000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73899999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88200000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1097,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194214,"statfs":{"total":200000000,"available":198875744,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38400000000000001,"15min":0.433},"min":{"1min":0.24199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56100000000000005,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.215,"15min":0.215},"max":{"1min":0.60199999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.35199999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.246,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59799999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.31,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38600000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.441,"15min":0.46899999999999997},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57299999999999995,"5min":2.573,"15min":2.573},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.33700000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58999999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33600000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93300000000000005,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64700000000000002,"15min":0.68700000000000006},"min":{"1min":0.442,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.51400000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.625,"15min":0.624},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89500000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.499}]},{"osd":6,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92100000000000004,"5min":1.655,"15min":1.655},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94299999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.437}]},{"osd":7,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69299999999999995,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.42499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465592,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.24399999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48599999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.316},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.375,"15min":0.374},"min":{"1min":0.25700000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.34899999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40300000000000002,"15min":0.40400000000000003},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54000000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.27500000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.624,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.374}]},{"osd":4,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.375,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51700000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":3.577,"15min":3.577},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.872,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.54000000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":1.04,"15min":1.04},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91300000000000003,"5min":3.637,"15min":3.637},"last":0.71699999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88700000000000001,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.626},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.01,"5min":1.331,"15min":1.331},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464610,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.33200000000000002,"15min":0.32400000000000001},"min":{"1min":0.24299999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.502,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"min":{"1min":0.25900000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.30599999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59199999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.316,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.502}]},{"osd":4,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.59999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86799999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.60199999999999998},"min":{"1min":0.49299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.94999999999999996,"5min":1.337,"15min":1.337},"last":0.47899999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.626,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92400000000000004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.442},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88500000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51700000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65000000000000002,"15min":0.63400000000000001},"min":{"1min":0.54600000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.0149999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":1.006,"15min":1.006},"last":0.54900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194791,"statfs":{"total":200000000,"available":199466146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.34399999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71199999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.65200000000000002,"15min":0.73799999999999999},"min":{"1min":0.379,"5min":0.378,"15min":0.378},"max":{"1min":0.69199999999999995,"5min":4.883,"15min":4.883},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.544,"15min":1.544},"last":0.70099999999999996}]},{"osd":2,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72699999999999998,"5min":0.88,"15min":0.88},"last":0.628},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72099999999999997,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70599999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.748,"15min":0.92200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77300000000000002,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.496,"15min":0.52800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.745,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.58299999999999996,"15min":0.65900000000000003},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.44900000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.48999999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.83299999999999996,"15min":1.119},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75600000000000001,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.31,"15min":0.31},"max":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52200000000000002,"15min":0.50600000000000001},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57599999999999996,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79200000000000004,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.746,"5min":1.847,"15min":1.847},"last":0.621},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72399999999999998,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.51900000000000002},"min":{"1min":0.42899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68000000000000005,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":1.97,"15min":1.97},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.56799999999999995},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.76600000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.752,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.67400000000000004,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.503},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53600000000000003,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.54700000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.47299999999999998},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66100000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":3.766,"15min":3.766},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56399999999999995}]}]}],"pool_statfs":[]}} 2023-12-24T20:01:39.473 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:01:39.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.609+0000 7f540e855700 1 Processor -- start 2023-12-24T20:01:39.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.609+0000 7f540e855700 1 -- start start 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f540e855700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f54081599e0 0x7f540815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f540e855700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 0x7f54080cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f540e855700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54080cc2a0 con 0x7f54080cbac0 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f540e855700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080cedc0 con 0x7f54081599e0 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f540e855700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5408067f60 con 0x7f54080cdb80 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f5407fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f54081599e0 0x7f540815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f5407fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f54081599e0 0x7f540815ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57318/0 (socket says 172.21.15.61:57318) 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f5407fff700 1 -- 172.21.15.61:0/2304991244 learned_addr learned my addr 172.21.15.61:0/2304991244 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f540cdf2700 1 --2- 172.21.15.61:0/2304991244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 0x7f54080cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f5407fff700 1 -- 172.21.15.61:0/2304991244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 msgr2=0x7f54080cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:39.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f5407fff700 1 --2- 172.21.15.61:0/2304991244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 0x7f54080cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f5407fff700 1 -- 172.21.15.61:0/2304991244 >> v1:172.21.15.133:6789/0 conn(0x7f54080cbac0 legacy=0x7f54080cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f5407fff700 1 -- 172.21.15.61:0/2304991244 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540815b040 con 0x7f54081599e0 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f540cdf2700 1 --2- 172.21.15.61:0/2304991244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 0x7f54080cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.610+0000 7f5407fff700 1 --2- 172.21.15.61:0/2304991244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54081599e0 0x7f540815ab00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f53f80099b0 tx=0x7f53f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31689dded107758 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f5406ffd700 1 -- 172.21.15.61:0/2304991244 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f800b860 con 0x7f54081599e0 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f5406ffd700 1 -- 172.21.15.61:0/2304991244 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f800b9c0 con 0x7f54081599e0 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f5406ffd700 1 -- 172.21.15.61:0/2304991244 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f800bd60 con 0x7f54081599e0 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f540e855700 1 -- 172.21.15.61:0/2304991244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54081599e0 msgr2=0x7f540815ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f540e855700 1 --2- 172.21.15.61:0/2304991244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54081599e0 0x7f540815ab00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f53f80099b0 tx=0x7f53f8009250 comp rx=0 tx=0).stop 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f540e855700 1 -- 172.21.15.61:0/2304991244 shutdown_connections 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f540e855700 1 --2- 172.21.15.61:0/2304991244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 0x7f54080cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f540e855700 1 --2- 172.21.15.61:0/2304991244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f54081599e0 0x7f540815ab00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:39.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f540e855700 1 -- 172.21.15.61:0/2304991244 >> 172.21.15.61:0/2304991244 conn(0x7f540806e640 msgr2=0x7f5408067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:39.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f540e855700 1 -- 172.21.15.61:0/2304991244 shutdown_connections 2023-12-24T20:01:39.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.611+0000 7f540e855700 1 -- 172.21.15.61:0/2304991244 wait complete. 2023-12-24T20:01:39.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.613+0000 7f540e855700 1 Processor -- start 2023-12-24T20:01:39.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.613+0000 7f540e855700 1 -- start start 2023-12-24T20:01:39.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f540e855700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080cbac0 0x7f5408154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:39.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f540e855700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 0x7f5408155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:39.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f540e855700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5408156060 0x7f54081584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:39.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f540e855700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5408156500 con 0x7f5408156060 2023-12-24T20:01:39.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f540e855700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5408157310 con 0x7f54080cbac0 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f540e855700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540816b360 con 0x7f54080cdb80 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f540cdf2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5408156060 0x7f54081584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f540cdf2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5408156060 0x7f54081584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57328/0 (socket says 172.21.15.61:57328) 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f540cdf2700 1 -- 172.21.15.61:0/2293812765 learned_addr learned my addr 172.21.15.61:0/2293812765 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f5407fff700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080cbac0 0x7f5408154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.614+0000 7f54077fe700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 0x7f5408155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f540cdf2700 1 -- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 msgr2=0x7f5408155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f540cdf2700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 0x7f5408155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f540cdf2700 1 -- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080cbac0 msgr2=0x7f5408154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f540cdf2700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080cbac0 0x7f5408154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f540cdf2700 1 -- 172.21.15.61:0/2293812765 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80094f0 con 0x7f5408156060 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f540cdf2700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5408156060 0x7f54081584a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5400009fa0 tx=0x7f54000099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f53effff700 1 -- 172.21.15.61:0/2293812765 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540000dbb0 con 0x7f5408156060 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f53effff700 1 -- 172.21.15.61:0/2293812765 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540000f040 con 0x7f5408156060 2023-12-24T20:01:39.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f540e855700 1 -- 172.21.15.61:0/2293812765 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5408156700 con 0x7f5408156060 2023-12-24T20:01:39.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f53effff700 1 -- 172.21.15.61:0/2293812765 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400015400 con 0x7f5408156060 2023-12-24T20:01:39.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.615+0000 7f540e855700 1 -- 172.21.15.61:0/2293812765 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5408156cc0 con 0x7f5408156060 2023-12-24T20:01:39.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.616+0000 7f540e855700 1 -- 172.21.15.61:0/2293812765 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5408157480 con 0x7f5408156060 2023-12-24T20:01:39.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.616+0000 7f53effff700 1 -- 172.21.15.61:0/2293812765 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f54000157f0 con 0x7f5408156060 2023-12-24T20:01:39.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.617+0000 7f53effff700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53f4066f30 0x7f53f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:39.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.617+0000 7f53effff700 1 -- 172.21.15.61:0/2293812765 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5400084c10 con 0x7f5408156060 2023-12-24T20:01:39.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.617+0000 7f5407fff700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53f4066f30 0x7f53f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:39.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.617+0000 7f5407fff700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53f4066f30 0x7f53f40693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f53f80099b0 tx=0x7f53f8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:39.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.621+0000 7f53effff700 1 -- 172.21.15.61:0/2293812765 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5400051e80 con 0x7f5408156060 2023-12-24T20:01:39.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.814+0000 7f540e855700 1 -- 172.21.15.61:0/2293812765 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f540804c3c0 con 0x7f53f4066f30 2023-12-24T20:01:39.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.823+0000 7f53effff700 1 -- 172.21.15.61:0/2293812765 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285005 (secure 0 0 0) 0x7f540804c3c0 con 0x7f53f4066f30 2023-12-24T20:01:39.827 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 -- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53f4066f30 msgr2=0x7f53f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53f4066f30 0x7f53f40693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f53f80099b0 tx=0x7f53f8017000 comp rx=0 tx=0).stop 2023-12-24T20:01:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 -- 172.21.15.61:0/2293812765 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5408156060 msgr2=0x7f54081584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5408156060 0x7f54081584a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5400009fa0 tx=0x7f54000099b0 comp rx=0 tx=0).stop 2023-12-24T20:01:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 -- 172.21.15.61:0/2293812765 shutdown_connections 2023-12-24T20:01:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53f4066f30 0x7f53f40693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5408156060 0x7f54081584a0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54080cbac0 0x7f5408154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 --2- 172.21.15.61:0/2293812765 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f54080cdb80 0x7f5408155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 -- 172.21.15.61:0/2293812765 >> 172.21.15.61:0/2293812765 conn(0x7f540806e640 msgr2=0x7f54080b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 -- 172.21.15.61:0/2293812765 shutdown_connections 2023-12-24T20:01:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:39.826+0000 7f540e855700 1 -- 172.21.15.61:0/2293812765 wait complete. 2023-12-24T20:01:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:01:39.838 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2023-12-24T20:01:38.374448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5328,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557171,"statfs":{"total":1600000000,"available":1594543820,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002151"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.691646+0000","last_change":"2023-12-24T20:01:30.691589+0000","last_active":"2023-12-24T20:01:30.691646+0000","last_peered":"2023-12-24T20:01:30.691646+0000","last_clean":"2023-12-24T20:01:30.691646+0000","last_became_active":"2023-12-24T20:01:30.691194+0000","last_became_peered":"2023-12-24T20:01:30.691194+0000","last_unstale":"2023-12-24T20:01:30.691646+0000","last_undegraded":"2023-12-24T20:01:30.691646+0000","last_fullsized":"2023-12-24T20:01:30.691646+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:16:38.971680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690666+0000","last_change":"2023-12-24T20:01:30.690516+0000","last_active":"2023-12-24T20:01:30.690666+0000","last_peered":"2023-12-24T20:01:30.690666+0000","last_clean":"2023-12-24T20:01:30.690666+0000","last_became_active":"2023-12-24T20:01:30.689819+0000","last_became_peered":"2023-12-24T20:01:30.689819+0000","last_unstale":"2023-12-24T20:01:30.690666+0000","last_undegraded":"2023-12-24T20:01:30.690666+0000","last_fullsized":"2023-12-24T20:01:30.690666+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:46:32.224046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.693507+0000","last_change":"2023-12-24T20:01:30.693456+0000","last_active":"2023-12-24T20:01:30.693507+0000","last_peered":"2023-12-24T20:01:30.693507+0000","last_clean":"2023-12-24T20:01:30.693507+0000","last_became_active":"2023-12-24T20:01:30.693028+0000","last_became_peered":"2023-12-24T20:01:30.693028+0000","last_unstale":"2023-12-24T20:01:30.693507+0000","last_undegraded":"2023-12-24T20:01:30.693507+0000","last_fullsized":"2023-12-24T20:01:30.693507+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:39.708945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.683426+0000","last_change":"2023-12-24T20:01:30.683228+0000","last_active":"2023-12-24T20:01:30.683426+0000","last_peered":"2023-12-24T20:01:30.683426+0000","last_clean":"2023-12-24T20:01:30.683426+0000","last_became_active":"2023-12-24T20:01:30.682583+0000","last_became_peered":"2023-12-24T20:01:30.682583+0000","last_unstale":"2023-12-24T20:01:30.683426+0000","last_undegraded":"2023-12-24T20:01:30.683426+0000","last_fullsized":"2023-12-24T20:01:30.683426+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:56.051668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689135+0000","last_change":"2023-12-24T20:01:30.687905+0000","last_active":"2023-12-24T20:01:30.689135+0000","last_peered":"2023-12-24T20:01:30.689135+0000","last_clean":"2023-12-24T20:01:30.689135+0000","last_became_active":"2023-12-24T20:01:30.687613+0000","last_became_peered":"2023-12-24T20:01:30.687613+0000","last_unstale":"2023-12-24T20:01:30.689135+0000","last_undegraded":"2023-12-24T20:01:30.689135+0000","last_fullsized":"2023-12-24T20:01:30.689135+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:41.535603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690694+0000","last_change":"2023-12-24T20:01:30.690625+0000","last_active":"2023-12-24T20:01:30.690694+0000","last_peered":"2023-12-24T20:01:30.690694+0000","last_clean":"2023-12-24T20:01:30.690694+0000","last_became_active":"2023-12-24T20:01:30.690190+0000","last_became_peered":"2023-12-24T20:01:30.690190+0000","last_unstale":"2023-12-24T20:01:30.690694+0000","last_undegraded":"2023-12-24T20:01:30.690694+0000","last_fullsized":"2023-12-24T20:01:30.690694+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.693526+0000","last_change":"2023-12-24T20:01:30.693463+0000","last_active":"2023-12-24T20:01:30.693526+0000","last_peered":"2023-12-24T20:01:30.693526+0000","last_clean":"2023-12-24T20:01:30.693526+0000","last_became_active":"2023-12-24T20:01:30.693226+0000","last_became_peered":"2023-12-24T20:01:30.693226+0000","last_unstale":"2023-12-24T20:01:30.693526+0000","last_undegraded":"2023-12-24T20:01:30.693526+0000","last_fullsized":"2023-12-24T20:01:30.693526+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:53.030393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.693188+0000","last_change":"2023-12-24T20:01:30.693120+0000","last_active":"2023-12-24T20:01:30.693188+0000","last_peered":"2023-12-24T20:01:30.693188+0000","last_clean":"2023-12-24T20:01:30.693188+0000","last_became_active":"2023-12-24T20:01:30.692891+0000","last_became_peered":"2023-12-24T20:01:30.692891+0000","last_unstale":"2023-12-24T20:01:30.693188+0000","last_undegraded":"2023-12-24T20:01:30.693188+0000","last_fullsized":"2023-12-24T20:01:30.693188+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:51:10.869086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689659+0000","last_change":"2023-12-24T20:01:30.689567+0000","last_active":"2023-12-24T20:01:30.689659+0000","last_peered":"2023-12-24T20:01:30.689659+0000","last_clean":"2023-12-24T20:01:30.689659+0000","last_became_active":"2023-12-24T20:01:30.689327+0000","last_became_peered":"2023-12-24T20:01:30.689327+0000","last_unstale":"2023-12-24T20:01:30.689659+0000","last_undegraded":"2023-12-24T20:01:30.689659+0000","last_fullsized":"2023-12-24T20:01:30.689659+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688260+0000","last_change":"2023-12-24T20:01:30.688167+0000","last_active":"2023-12-24T20:01:30.688260+0000","last_peered":"2023-12-24T20:01:30.688260+0000","last_clean":"2023-12-24T20:01:30.688260+0000","last_became_active":"2023-12-24T20:01:30.687925+0000","last_became_peered":"2023-12-24T20:01:30.687925+0000","last_unstale":"2023-12-24T20:01:30.688260+0000","last_undegraded":"2023-12-24T20:01:30.688260+0000","last_fullsized":"2023-12-24T20:01:30.688260+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:41.535603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.687198+0000","last_change":"2023-12-24T20:01:30.687127+0000","last_active":"2023-12-24T20:01:30.687198+0000","last_peered":"2023-12-24T20:01:30.687198+0000","last_clean":"2023-12-24T20:01:30.687198+0000","last_became_active":"2023-12-24T20:01:30.686292+0000","last_became_peered":"2023-12-24T20:01:30.686292+0000","last_unstale":"2023-12-24T20:01:30.687198+0000","last_undegraded":"2023-12-24T20:01:30.687198+0000","last_fullsized":"2023-12-24T20:01:30.687198+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:54.753953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.692860+0000","last_change":"2023-12-24T20:01:30.692307+0000","last_active":"2023-12-24T20:01:30.692860+0000","last_peered":"2023-12-24T20:01:30.692860+0000","last_clean":"2023-12-24T20:01:30.692860+0000","last_became_active":"2023-12-24T20:01:30.691917+0000","last_became_peered":"2023-12-24T20:01:30.691917+0000","last_unstale":"2023-12-24T20:01:30.692860+0000","last_undegraded":"2023-12-24T20:01:30.692860+0000","last_fullsized":"2023-12-24T20:01:30.692860+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:14.179654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.693374+0000","last_change":"2023-12-24T20:01:30.693296+0000","last_active":"2023-12-24T20:01:30.693374+0000","last_peered":"2023-12-24T20:01:30.693374+0000","last_clean":"2023-12-24T20:01:30.693374+0000","last_became_active":"2023-12-24T20:01:30.691298+0000","last_became_peered":"2023-12-24T20:01:30.691298+0000","last_unstale":"2023-12-24T20:01:30.693374+0000","last_undegraded":"2023-12-24T20:01:30.693374+0000","last_fullsized":"2023-12-24T20:01:30.693374+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:45:38.693665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684232+0000","last_change":"2023-12-24T20:01:30.683702+0000","last_active":"2023-12-24T20:01:30.684232+0000","last_peered":"2023-12-24T20:01:30.684232+0000","last_clean":"2023-12-24T20:01:30.684232+0000","last_became_active":"2023-12-24T20:01:30.682983+0000","last_became_peered":"2023-12-24T20:01:30.682983+0000","last_unstale":"2023-12-24T20:01:30.684232+0000","last_undegraded":"2023-12-24T20:01:30.684232+0000","last_fullsized":"2023-12-24T20:01:30.684232+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:49:16.801499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.685997+0000","last_change":"2023-12-24T20:01:30.685819+0000","last_active":"2023-12-24T20:01:30.685997+0000","last_peered":"2023-12-24T20:01:30.685997+0000","last_clean":"2023-12-24T20:01:30.685997+0000","last_became_active":"2023-12-24T20:01:30.685569+0000","last_became_peered":"2023-12-24T20:01:30.685569+0000","last_unstale":"2023-12-24T20:01:30.685997+0000","last_undegraded":"2023-12-24T20:01:30.685997+0000","last_fullsized":"2023-12-24T20:01:30.685997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:14.617306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.697332+0000","last_change":"2023-12-24T20:01:30.697086+0000","last_active":"2023-12-24T20:01:30.697332+0000","last_peered":"2023-12-24T20:01:30.697332+0000","last_clean":"2023-12-24T20:01:30.697332+0000","last_became_active":"2023-12-24T20:01:30.696633+0000","last_became_peered":"2023-12-24T20:01:30.696633+0000","last_unstale":"2023-12-24T20:01:30.697332+0000","last_undegraded":"2023-12-24T20:01:30.697332+0000","last_fullsized":"2023-12-24T20:01:30.697332+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:31.210096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.696784+0000","last_change":"2023-12-24T20:01:30.696682+0000","last_active":"2023-12-24T20:01:30.696784+0000","last_peered":"2023-12-24T20:01:30.696784+0000","last_clean":"2023-12-24T20:01:30.696784+0000","last_became_active":"2023-12-24T20:01:30.696206+0000","last_became_peered":"2023-12-24T20:01:30.696206+0000","last_unstale":"2023-12-24T20:01:30.696784+0000","last_undegraded":"2023-12-24T20:01:30.696784+0000","last_fullsized":"2023-12-24T20:01:30.696784+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:32.333494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689655+0000","last_change":"2023-12-24T20:01:30.689533+0000","last_active":"2023-12-24T20:01:30.689655+0000","last_peered":"2023-12-24T20:01:30.689655+0000","last_clean":"2023-12-24T20:01:30.689655+0000","last_became_active":"2023-12-24T20:01:30.689077+0000","last_became_peered":"2023-12-24T20:01:30.689077+0000","last_unstale":"2023-12-24T20:01:30.689655+0000","last_undegraded":"2023-12-24T20:01:30.689655+0000","last_fullsized":"2023-12-24T20:01:30.689655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:20:33.519692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688972+0000","last_change":"2023-12-24T20:01:30.688714+0000","last_active":"2023-12-24T20:01:30.688972+0000","last_peered":"2023-12-24T20:01:30.688972+0000","last_clean":"2023-12-24T20:01:30.688972+0000","last_became_active":"2023-12-24T20:01:30.688182+0000","last_became_peered":"2023-12-24T20:01:30.688182+0000","last_unstale":"2023-12-24T20:01:30.688972+0000","last_undegraded":"2023-12-24T20:01:30.688972+0000","last_fullsized":"2023-12-24T20:01:30.688972+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:55:38.750992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684286+0000","last_change":"2023-12-24T20:01:30.684127+0000","last_active":"2023-12-24T20:01:30.684286+0000","last_peered":"2023-12-24T20:01:30.684286+0000","last_clean":"2023-12-24T20:01:30.684286+0000","last_became_active":"2023-12-24T20:01:30.683878+0000","last_became_peered":"2023-12-24T20:01:30.683878+0000","last_unstale":"2023-12-24T20:01:30.684286+0000","last_undegraded":"2023-12-24T20:01:30.684286+0000","last_fullsized":"2023-12-24T20:01:30.684286+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:07:35.870337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689621+0000","last_change":"2023-12-24T20:01:30.689256+0000","last_active":"2023-12-24T20:01:30.689621+0000","last_peered":"2023-12-24T20:01:30.689621+0000","last_clean":"2023-12-24T20:01:30.689621+0000","last_became_active":"2023-12-24T20:01:30.684589+0000","last_became_peered":"2023-12-24T20:01:30.684589+0000","last_unstale":"2023-12-24T20:01:30.689621+0000","last_undegraded":"2023-12-24T20:01:30.689621+0000","last_fullsized":"2023-12-24T20:01:30.689621+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:42:11.494990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690153+0000","last_change":"2023-12-24T20:01:30.689284+0000","last_active":"2023-12-24T20:01:30.690153+0000","last_peered":"2023-12-24T20:01:30.690153+0000","last_clean":"2023-12-24T20:01:30.690153+0000","last_became_active":"2023-12-24T20:01:30.687484+0000","last_became_peered":"2023-12-24T20:01:30.687484+0000","last_unstale":"2023-12-24T20:01:30.690153+0000","last_undegraded":"2023-12-24T20:01:30.690153+0000","last_fullsized":"2023-12-24T20:01:30.690153+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:52:22.284692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686619+0000","last_change":"2023-12-24T20:01:30.686378+0000","last_active":"2023-12-24T20:01:30.686619+0000","last_peered":"2023-12-24T20:01:30.686619+0000","last_clean":"2023-12-24T20:01:30.686619+0000","last_became_active":"2023-12-24T20:01:30.685807+0000","last_became_peered":"2023-12-24T20:01:30.685807+0000","last_unstale":"2023-12-24T20:01:30.686619+0000","last_undegraded":"2023-12-24T20:01:30.686619+0000","last_fullsized":"2023-12-24T20:01:30.686619+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:32.333494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684255+0000","last_change":"2023-12-24T20:01:30.683862+0000","last_active":"2023-12-24T20:01:30.684255+0000","last_peered":"2023-12-24T20:01:30.684255+0000","last_clean":"2023-12-24T20:01:30.684255+0000","last_became_active":"2023-12-24T20:01:30.683465+0000","last_became_peered":"2023-12-24T20:01:30.683465+0000","last_unstale":"2023-12-24T20:01:30.684255+0000","last_undegraded":"2023-12-24T20:01:30.684255+0000","last_fullsized":"2023-12-24T20:01:30.684255+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:13.363115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686754+0000","last_change":"2023-12-24T20:01:30.686675+0000","last_active":"2023-12-24T20:01:30.686754+0000","last_peered":"2023-12-24T20:01:30.686754+0000","last_clean":"2023-12-24T20:01:30.686754+0000","last_became_active":"2023-12-24T20:01:30.686426+0000","last_became_peered":"2023-12-24T20:01:30.686426+0000","last_unstale":"2023-12-24T20:01:30.686754+0000","last_undegraded":"2023-12-24T20:01:30.686754+0000","last_fullsized":"2023-12-24T20:01:30.686754+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:22:04.355354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.692094+0000","last_change":"2023-12-24T20:01:30.692031+0000","last_active":"2023-12-24T20:01:30.692094+0000","last_peered":"2023-12-24T20:01:30.692094+0000","last_clean":"2023-12-24T20:01:30.692094+0000","last_became_active":"2023-12-24T20:01:30.691266+0000","last_became_peered":"2023-12-24T20:01:30.691266+0000","last_unstale":"2023-12-24T20:01:30.692094+0000","last_undegraded":"2023-12-24T20:01:30.692094+0000","last_fullsized":"2023-12-24T20:01:30.692094+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:37.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.697351+0000","last_change":"2023-12-24T20:01:30.697228+0000","last_active":"2023-12-24T20:01:30.697351+0000","last_peered":"2023-12-24T20:01:30.697351+0000","last_clean":"2023-12-24T20:01:30.697351+0000","last_became_active":"2023-12-24T20:01:30.696974+0000","last_became_peered":"2023-12-24T20:01:30.696974+0000","last_unstale":"2023-12-24T20:01:30.697351+0000","last_undegraded":"2023-12-24T20:01:30.697351+0000","last_fullsized":"2023-12-24T20:01:30.697351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:18.050260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.687621+0000","last_change":"2023-12-24T20:01:30.687554+0000","last_active":"2023-12-24T20:01:30.687621+0000","last_peered":"2023-12-24T20:01:30.687621+0000","last_clean":"2023-12-24T20:01:30.687621+0000","last_became_active":"2023-12-24T20:01:30.687357+0000","last_became_peered":"2023-12-24T20:01:30.687357+0000","last_unstale":"2023-12-24T20:01:30.687621+0000","last_undegraded":"2023-12-24T20:01:30.687621+0000","last_fullsized":"2023-12-24T20:01:30.687621+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:31.210096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684655+0000","last_change":"2023-12-24T20:01:30.684550+0000","last_active":"2023-12-24T20:01:30.684655+0000","last_peered":"2023-12-24T20:01:30.684655+0000","last_clean":"2023-12-24T20:01:30.684655+0000","last_became_active":"2023-12-24T20:01:30.683797+0000","last_became_peered":"2023-12-24T20:01:30.683797+0000","last_unstale":"2023-12-24T20:01:30.684655+0000","last_undegraded":"2023-12-24T20:01:30.684655+0000","last_fullsized":"2023-12-24T20:01:30.684655+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:15:19.334636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686183+0000","last_change":"2023-12-24T20:01:30.685665+0000","last_active":"2023-12-24T20:01:30.686183+0000","last_peered":"2023-12-24T20:01:30.686183+0000","last_clean":"2023-12-24T20:01:30.686183+0000","last_became_active":"2023-12-24T20:01:30.685312+0000","last_became_peered":"2023-12-24T20:01:30.685312+0000","last_unstale":"2023-12-24T20:01:30.686183+0000","last_undegraded":"2023-12-24T20:01:30.686183+0000","last_fullsized":"2023-12-24T20:01:30.686183+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:15.376868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686836+0000","last_change":"2023-12-24T20:01:30.686756+0000","last_active":"2023-12-24T20:01:30.686836+0000","last_peered":"2023-12-24T20:01:30.686836+0000","last_clean":"2023-12-24T20:01:30.686836+0000","last_became_active":"2023-12-24T20:01:30.686347+0000","last_became_peered":"2023-12-24T20:01:30.686347+0000","last_unstale":"2023-12-24T20:01:30.686836+0000","last_undegraded":"2023-12-24T20:01:30.686836+0000","last_fullsized":"2023-12-24T20:01:30.686836+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:45:28.761106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.692842+0000","last_change":"2023-12-24T20:01:30.692150+0000","last_active":"2023-12-24T20:01:30.692842+0000","last_peered":"2023-12-24T20:01:30.692842+0000","last_clean":"2023-12-24T20:01:30.692842+0000","last_became_active":"2023-12-24T20:01:30.691646+0000","last_became_peered":"2023-12-24T20:01:30.691646+0000","last_unstale":"2023-12-24T20:01:30.692842+0000","last_undegraded":"2023-12-24T20:01:30.692842+0000","last_fullsized":"2023-12-24T20:01:30.692842+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:12:50.281314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.695201+0000","last_change":"2023-12-24T20:01:30.694470+0000","last_active":"2023-12-24T20:01:30.695201+0000","last_peered":"2023-12-24T20:01:30.695201+0000","last_clean":"2023-12-24T20:01:30.695201+0000","last_became_active":"2023-12-24T20:01:30.689061+0000","last_became_peered":"2023-12-24T20:01:30.689061+0000","last_unstale":"2023-12-24T20:01:30.695201+0000","last_undegraded":"2023-12-24T20:01:30.695201+0000","last_fullsized":"2023-12-24T20:01:30.695201+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:23:57.708727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"98'4","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705559+0000","last_change":"2023-12-24T20:01:29.679071+0000","last_active":"2023-12-24T20:01:30.705559+0000","last_peered":"2023-12-24T20:01:30.705559+0000","last_clean":"2023-12-24T20:01:30.705559+0000","last_became_active":"2023-12-24T20:01:29.678350+0000","last_became_peered":"2023-12-24T20:01:29.678350+0000","last_unstale":"2023-12-24T20:01:30.705559+0000","last_undegraded":"2023-12-24T20:01:30.705559+0000","last_fullsized":"2023-12-24T20:01:30.705559+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:35:43.873476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686638+0000","last_change":"2023-12-24T20:01:30.686524+0000","last_active":"2023-12-24T20:01:30.686638+0000","last_peered":"2023-12-24T20:01:30.686638+0000","last_clean":"2023-12-24T20:01:30.686638+0000","last_became_active":"2023-12-24T20:01:30.686135+0000","last_became_peered":"2023-12-24T20:01:30.686135+0000","last_unstale":"2023-12-24T20:01:30.686638+0000","last_undegraded":"2023-12-24T20:01:30.686638+0000","last_fullsized":"2023-12-24T20:01:30.686638+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:38.482726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705449+0000","last_change":"2023-12-24T20:01:29.675805+0000","last_active":"2023-12-24T20:01:30.705449+0000","last_peered":"2023-12-24T20:01:30.705449+0000","last_clean":"2023-12-24T20:01:30.705449+0000","last_became_active":"2023-12-24T20:01:29.675510+0000","last_became_peered":"2023-12-24T20:01:29.675510+0000","last_unstale":"2023-12-24T20:01:30.705449+0000","last_undegraded":"2023-12-24T20:01:30.705449+0000","last_fullsized":"2023-12-24T20:01:30.705449+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:33:56.278435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.691516+0000","last_change":"2023-12-24T20:01:30.691425+0000","last_active":"2023-12-24T20:01:30.691516+0000","last_peered":"2023-12-24T20:01:30.691516+0000","last_clean":"2023-12-24T20:01:30.691516+0000","last_became_active":"2023-12-24T20:01:30.689761+0000","last_became_peered":"2023-12-24T20:01:30.689761+0000","last_unstale":"2023-12-24T20:01:30.691516+0000","last_undegraded":"2023-12-24T20:01:30.691516+0000","last_fullsized":"2023-12-24T20:01:30.691516+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:14:04.971246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.702335+0000","last_change":"2023-12-24T20:01:29.669643+0000","last_active":"2023-12-24T20:01:30.702335+0000","last_peered":"2023-12-24T20:01:30.702335+0000","last_clean":"2023-12-24T20:01:30.702335+0000","last_became_active":"2023-12-24T20:01:29.669404+0000","last_became_peered":"2023-12-24T20:01:29.669404+0000","last_unstale":"2023-12-24T20:01:30.702335+0000","last_undegraded":"2023-12-24T20:01:30.702335+0000","last_fullsized":"2023-12-24T20:01:30.702335+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:30.205035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.694622+0000","last_change":"2023-12-24T20:01:30.694557+0000","last_active":"2023-12-24T20:01:30.694622+0000","last_peered":"2023-12-24T20:01:30.694622+0000","last_clean":"2023-12-24T20:01:30.694622+0000","last_became_active":"2023-12-24T20:01:30.693781+0000","last_became_peered":"2023-12-24T20:01:30.693781+0000","last_unstale":"2023-12-24T20:01:30.694622+0000","last_undegraded":"2023-12-24T20:01:30.694622+0000","last_fullsized":"2023-12-24T20:01:30.694622+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:13.388896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.702790+0000","last_change":"2023-12-24T20:01:29.669603+0000","last_active":"2023-12-24T20:01:30.702790+0000","last_peered":"2023-12-24T20:01:30.702790+0000","last_clean":"2023-12-24T20:01:30.702790+0000","last_became_active":"2023-12-24T20:01:29.669369+0000","last_became_peered":"2023-12-24T20:01:29.669369+0000","last_unstale":"2023-12-24T20:01:30.702790+0000","last_undegraded":"2023-12-24T20:01:30.702790+0000","last_fullsized":"2023-12-24T20:01:30.702790+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:31.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690171+0000","last_change":"2023-12-24T20:01:30.689426+0000","last_active":"2023-12-24T20:01:30.690171+0000","last_peered":"2023-12-24T20:01:30.690171+0000","last_clean":"2023-12-24T20:01:30.690171+0000","last_became_active":"2023-12-24T20:01:30.688830+0000","last_became_peered":"2023-12-24T20:01:30.688830+0000","last_unstale":"2023-12-24T20:01:30.690171+0000","last_undegraded":"2023-12-24T20:01:30.690171+0000","last_fullsized":"2023-12-24T20:01:30.690171+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:27.211132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.704648+0000","last_change":"2023-12-24T20:01:29.676516+0000","last_active":"2023-12-24T20:01:30.704648+0000","last_peered":"2023-12-24T20:01:30.704648+0000","last_clean":"2023-12-24T20:01:30.704648+0000","last_became_active":"2023-12-24T20:01:29.676280+0000","last_became_peered":"2023-12-24T20:01:29.676280+0000","last_unstale":"2023-12-24T20:01:30.704648+0000","last_undegraded":"2023-12-24T20:01:30.704648+0000","last_fullsized":"2023-12-24T20:01:30.704648+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:32.908184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.696573+0000","last_change":"2023-12-24T20:01:30.696470+0000","last_active":"2023-12-24T20:01:30.696573+0000","last_peered":"2023-12-24T20:01:30.696573+0000","last_clean":"2023-12-24T20:01:30.696573+0000","last_became_active":"2023-12-24T20:01:30.695864+0000","last_became_peered":"2023-12-24T20:01:30.695864+0000","last_unstale":"2023-12-24T20:01:30.696573+0000","last_undegraded":"2023-12-24T20:01:30.696573+0000","last_fullsized":"2023-12-24T20:01:30.696573+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:13.388896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705456+0000","last_change":"2023-12-24T20:01:29.673265+0000","last_active":"2023-12-24T20:01:30.705456+0000","last_peered":"2023-12-24T20:01:30.705456+0000","last_clean":"2023-12-24T20:01:30.705456+0000","last_became_active":"2023-12-24T20:01:29.672837+0000","last_became_peered":"2023-12-24T20:01:29.672837+0000","last_unstale":"2023-12-24T20:01:30.705456+0000","last_undegraded":"2023-12-24T20:01:30.705456+0000","last_fullsized":"2023-12-24T20:01:30.705456+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:20.057436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.694322+0000","last_change":"2023-12-24T20:01:30.694223+0000","last_active":"2023-12-24T20:01:30.694322+0000","last_peered":"2023-12-24T20:01:30.694322+0000","last_clean":"2023-12-24T20:01:30.694322+0000","last_became_active":"2023-12-24T20:01:30.693323+0000","last_became_peered":"2023-12-24T20:01:30.693323+0000","last_unstale":"2023-12-24T20:01:30.694322+0000","last_undegraded":"2023-12-24T20:01:30.694322+0000","last_fullsized":"2023-12-24T20:01:30.694322+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:41.535603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.682256+0000","last_change":"2023-12-24T20:01:29.672787+0000","last_active":"2023-12-24T20:01:30.682256+0000","last_peered":"2023-12-24T20:01:30.682256+0000","last_clean":"2023-12-24T20:01:30.682256+0000","last_became_active":"2023-12-24T20:01:29.672509+0000","last_became_peered":"2023-12-24T20:01:29.672509+0000","last_unstale":"2023-12-24T20:01:30.682256+0000","last_undegraded":"2023-12-24T20:01:30.682256+0000","last_fullsized":"2023-12-24T20:01:30.682256+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:38.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684021+0000","last_change":"2023-12-24T20:01:30.683434+0000","last_active":"2023-12-24T20:01:30.684021+0000","last_peered":"2023-12-24T20:01:30.684021+0000","last_clean":"2023-12-24T20:01:30.684021+0000","last_became_active":"2023-12-24T20:01:30.683197+0000","last_became_peered":"2023-12-24T20:01:30.683197+0000","last_unstale":"2023-12-24T20:01:30.684021+0000","last_undegraded":"2023-12-24T20:01:30.684021+0000","last_fullsized":"2023-12-24T20:01:30.684021+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:36:34.497869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.678791+0000","last_change":"2023-12-24T20:01:29.672298+0000","last_active":"2023-12-24T20:01:30.678791+0000","last_peered":"2023-12-24T20:01:30.678791+0000","last_clean":"2023-12-24T20:01:30.678791+0000","last_became_active":"2023-12-24T20:01:29.671951+0000","last_became_peered":"2023-12-24T20:01:29.671951+0000","last_unstale":"2023-12-24T20:01:30.678791+0000","last_undegraded":"2023-12-24T20:01:30.678791+0000","last_fullsized":"2023-12-24T20:01:30.678791+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:07:34.865275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684001+0000","last_change":"2023-12-24T20:01:30.682688+0000","last_active":"2023-12-24T20:01:30.684001+0000","last_peered":"2023-12-24T20:01:30.684001+0000","last_clean":"2023-12-24T20:01:30.684001+0000","last_became_active":"2023-12-24T20:01:30.682439+0000","last_became_peered":"2023-12-24T20:01:30.682439+0000","last_unstale":"2023-12-24T20:01:30.684001+0000","last_undegraded":"2023-12-24T20:01:30.684001+0000","last_fullsized":"2023-12-24T20:01:30.684001+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:23:57.708727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688105+0000","last_change":"2023-12-24T20:01:29.674193+0000","last_active":"2023-12-24T20:01:30.688105+0000","last_peered":"2023-12-24T20:01:30.688105+0000","last_clean":"2023-12-24T20:01:30.688105+0000","last_became_active":"2023-12-24T20:01:29.673869+0000","last_became_peered":"2023-12-24T20:01:29.673869+0000","last_unstale":"2023-12-24T20:01:30.688105+0000","last_undegraded":"2023-12-24T20:01:30.688105+0000","last_fullsized":"2023-12-24T20:01:30.688105+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:34.391823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690626+0000","last_change":"2023-12-24T20:01:30.690477+0000","last_active":"2023-12-24T20:01:30.690626+0000","last_peered":"2023-12-24T20:01:30.690626+0000","last_clean":"2023-12-24T20:01:30.690626+0000","last_became_active":"2023-12-24T20:01:30.689840+0000","last_became_peered":"2023-12-24T20:01:30.689840+0000","last_unstale":"2023-12-24T20:01:30.690626+0000","last_undegraded":"2023-12-24T20:01:30.690626+0000","last_fullsized":"2023-12-24T20:01:30.690626+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:45:21.268253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.685316+0000","last_change":"2023-12-24T20:01:29.679139+0000","last_active":"2023-12-24T20:01:30.685316+0000","last_peered":"2023-12-24T20:01:30.685316+0000","last_clean":"2023-12-24T20:01:30.685316+0000","last_became_active":"2023-12-24T20:01:29.678908+0000","last_became_peered":"2023-12-24T20:01:29.678908+0000","last_unstale":"2023-12-24T20:01:30.685316+0000","last_undegraded":"2023-12-24T20:01:30.685316+0000","last_fullsized":"2023-12-24T20:01:30.685316+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:53.748891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688989+0000","last_change":"2023-12-24T20:01:30.688890+0000","last_active":"2023-12-24T20:01:30.688989+0000","last_peered":"2023-12-24T20:01:30.688989+0000","last_clean":"2023-12-24T20:01:30.688989+0000","last_became_active":"2023-12-24T20:01:30.688486+0000","last_became_peered":"2023-12-24T20:01:30.688486+0000","last_unstale":"2023-12-24T20:01:30.688989+0000","last_undegraded":"2023-12-24T20:01:30.688989+0000","last_fullsized":"2023-12-24T20:01:30.688989+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:39:44.091736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"98'3","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705227+0000","last_change":"2023-12-24T20:01:29.680251+0000","last_active":"2023-12-24T20:01:30.705227+0000","last_peered":"2023-12-24T20:01:30.705227+0000","last_clean":"2023-12-24T20:01:30.705227+0000","last_became_active":"2023-12-24T20:01:29.678811+0000","last_became_peered":"2023-12-24T20:01:29.678811+0000","last_unstale":"2023-12-24T20:01:30.705227+0000","last_undegraded":"2023-12-24T20:01:30.705227+0000","last_fullsized":"2023-12-24T20:01:30.705227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:22.049103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689159+0000","last_change":"2023-12-24T20:01:30.688851+0000","last_active":"2023-12-24T20:01:30.689159+0000","last_peered":"2023-12-24T20:01:30.689159+0000","last_clean":"2023-12-24T20:01:30.689159+0000","last_became_active":"2023-12-24T20:01:30.688569+0000","last_became_peered":"2023-12-24T20:01:30.688569+0000","last_unstale":"2023-12-24T20:01:30.689159+0000","last_undegraded":"2023-12-24T20:01:30.689159+0000","last_fullsized":"2023-12-24T20:01:30.689159+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:50:59.398891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"98'6","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.706512+0000","last_change":"2023-12-24T20:01:29.677427+0000","last_active":"2023-12-24T20:01:30.706512+0000","last_peered":"2023-12-24T20:01:30.706512+0000","last_clean":"2023-12-24T20:01:30.706512+0000","last_became_active":"2023-12-24T20:01:29.677236+0000","last_became_peered":"2023-12-24T20:01:29.677236+0000","last_unstale":"2023-12-24T20:01:30.706512+0000","last_undegraded":"2023-12-24T20:01:30.706512+0000","last_fullsized":"2023-12-24T20:01:30.706512+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:15:08.313529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688014+0000","last_change":"2023-12-24T20:01:30.687785+0000","last_active":"2023-12-24T20:01:30.688014+0000","last_peered":"2023-12-24T20:01:30.688014+0000","last_clean":"2023-12-24T20:01:30.688014+0000","last_became_active":"2023-12-24T20:01:30.687008+0000","last_became_peered":"2023-12-24T20:01:30.687008+0000","last_unstale":"2023-12-24T20:01:30.688014+0000","last_undegraded":"2023-12-24T20:01:30.688014+0000","last_fullsized":"2023-12-24T20:01:30.688014+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:05:34.303284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705352+0000","last_change":"2023-12-24T20:01:29.667181+0000","last_active":"2023-12-24T20:01:30.705352+0000","last_peered":"2023-12-24T20:01:30.705352+0000","last_clean":"2023-12-24T20:01:30.705352+0000","last_became_active":"2023-12-24T20:01:29.666928+0000","last_became_peered":"2023-12-24T20:01:29.666928+0000","last_unstale":"2023-12-24T20:01:30.705352+0000","last_undegraded":"2023-12-24T20:01:30.705352+0000","last_fullsized":"2023-12-24T20:01:30.705352+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:14:52.025332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.694469+0000","last_change":"2023-12-24T20:01:30.694407+0000","last_active":"2023-12-24T20:01:30.694469+0000","last_peered":"2023-12-24T20:01:30.694469+0000","last_clean":"2023-12-24T20:01:30.694469+0000","last_became_active":"2023-12-24T20:01:30.693554+0000","last_became_peered":"2023-12-24T20:01:30.693554+0000","last_unstale":"2023-12-24T20:01:30.694469+0000","last_undegraded":"2023-12-24T20:01:30.694469+0000","last_fullsized":"2023-12-24T20:01:30.694469+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:16:38.971680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.679941+0000","last_change":"2023-12-24T20:01:29.666145+0000","last_active":"2023-12-24T20:01:30.679941+0000","last_peered":"2023-12-24T20:01:30.679941+0000","last_clean":"2023-12-24T20:01:30.679941+0000","last_became_active":"2023-12-24T20:01:29.665940+0000","last_became_peered":"2023-12-24T20:01:29.665940+0000","last_unstale":"2023-12-24T20:01:30.679941+0000","last_undegraded":"2023-12-24T20:01:30.679941+0000","last_fullsized":"2023-12-24T20:01:30.679941+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:15:30.205035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690192+0000","last_change":"2023-12-24T20:01:30.689577+0000","last_active":"2023-12-24T20:01:30.690192+0000","last_peered":"2023-12-24T20:01:30.690192+0000","last_clean":"2023-12-24T20:01:30.690192+0000","last_became_active":"2023-12-24T20:01:30.689169+0000","last_became_peered":"2023-12-24T20:01:30.689169+0000","last_unstale":"2023-12-24T20:01:30.690192+0000","last_undegraded":"2023-12-24T20:01:30.690192+0000","last_fullsized":"2023-12-24T20:01:30.690192+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:56:57.182265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.682302+0000","last_change":"2023-12-24T20:01:29.673342+0000","last_active":"2023-12-24T20:01:30.682302+0000","last_peered":"2023-12-24T20:01:30.682302+0000","last_clean":"2023-12-24T20:01:30.682302+0000","last_became_active":"2023-12-24T20:01:29.672893+0000","last_became_peered":"2023-12-24T20:01:29.672893+0000","last_unstale":"2023-12-24T20:01:30.682302+0000","last_undegraded":"2023-12-24T20:01:30.682302+0000","last_fullsized":"2023-12-24T20:01:30.682302+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:34.391823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690439+0000","last_change":"2023-12-24T20:01:30.690368+0000","last_active":"2023-12-24T20:01:30.690439+0000","last_peered":"2023-12-24T20:01:30.690439+0000","last_clean":"2023-12-24T20:01:30.690439+0000","last_became_active":"2023-12-24T20:01:30.689500+0000","last_became_peered":"2023-12-24T20:01:30.689500+0000","last_unstale":"2023-12-24T20:01:30.690439+0000","last_undegraded":"2023-12-24T20:01:30.690439+0000","last_fullsized":"2023-12-24T20:01:30.690439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:55.189414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"98'8","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705707+0000","last_change":"2023-12-24T20:01:29.676797+0000","last_active":"2023-12-24T20:01:30.705707+0000","last_peered":"2023-12-24T20:01:30.705707+0000","last_clean":"2023-12-24T20:01:30.705707+0000","last_became_active":"2023-12-24T20:01:29.676392+0000","last_became_peered":"2023-12-24T20:01:29.676392+0000","last_unstale":"2023-12-24T20:01:30.705707+0000","last_undegraded":"2023-12-24T20:01:30.705707+0000","last_fullsized":"2023-12-24T20:01:30.705707+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:40.530541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.694120+0000","last_change":"2023-12-24T20:01:30.694055+0000","last_active":"2023-12-24T20:01:30.694120+0000","last_peered":"2023-12-24T20:01:30.694120+0000","last_clean":"2023-12-24T20:01:30.694120+0000","last_became_active":"2023-12-24T20:01:30.690928+0000","last_became_peered":"2023-12-24T20:01:30.690928+0000","last_unstale":"2023-12-24T20:01:30.694120+0000","last_undegraded":"2023-12-24T20:01:30.694120+0000","last_fullsized":"2023-12-24T20:01:30.694120+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:38.482726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.703146+0000","last_change":"2023-12-24T20:01:29.678929+0000","last_active":"2023-12-24T20:01:30.703146+0000","last_peered":"2023-12-24T20:01:30.703146+0000","last_clean":"2023-12-24T20:01:30.703146+0000","last_became_active":"2023-12-24T20:01:29.675007+0000","last_became_peered":"2023-12-24T20:01:29.675007+0000","last_unstale":"2023-12-24T20:01:30.703146+0000","last_undegraded":"2023-12-24T20:01:30.703146+0000","last_fullsized":"2023-12-24T20:01:30.703146+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:15:08.313529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.692877+0000","last_change":"2023-12-24T20:01:30.692497+0000","last_active":"2023-12-24T20:01:30.692877+0000","last_peered":"2023-12-24T20:01:30.692877+0000","last_clean":"2023-12-24T20:01:30.692877+0000","last_became_active":"2023-12-24T20:01:30.692134+0000","last_became_peered":"2023-12-24T20:01:30.692134+0000","last_unstale":"2023-12-24T20:01:30.692877+0000","last_undegraded":"2023-12-24T20:01:30.692877+0000","last_fullsized":"2023-12-24T20:01:30.692877+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.703041+0000","last_change":"2023-12-24T20:01:29.674859+0000","last_active":"2023-12-24T20:01:30.703041+0000","last_peered":"2023-12-24T20:01:30.703041+0000","last_clean":"2023-12-24T20:01:30.703041+0000","last_became_active":"2023-12-24T20:01:29.674584+0000","last_became_peered":"2023-12-24T20:01:29.674584+0000","last_unstale":"2023-12-24T20:01:30.703041+0000","last_undegraded":"2023-12-24T20:01:30.703041+0000","last_fullsized":"2023-12-24T20:01:30.703041+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:06:12.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689108+0000","last_change":"2023-12-24T20:01:30.688328+0000","last_active":"2023-12-24T20:01:30.689108+0000","last_peered":"2023-12-24T20:01:30.689108+0000","last_clean":"2023-12-24T20:01:30.689108+0000","last_became_active":"2023-12-24T20:01:30.688019+0000","last_became_peered":"2023-12-24T20:01:30.688019+0000","last_unstale":"2023-12-24T20:01:30.689108+0000","last_undegraded":"2023-12-24T20:01:30.689108+0000","last_fullsized":"2023-12-24T20:01:30.689108+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:39.708945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.681648+0000","last_change":"2023-12-24T20:01:29.671113+0000","last_active":"2023-12-24T20:01:30.681648+0000","last_peered":"2023-12-24T20:01:30.681648+0000","last_clean":"2023-12-24T20:01:30.681648+0000","last_became_active":"2023-12-24T20:01:29.670833+0000","last_became_peered":"2023-12-24T20:01:29.670833+0000","last_unstale":"2023-12-24T20:01:30.681648+0000","last_undegraded":"2023-12-24T20:01:30.681648+0000","last_fullsized":"2023-12-24T20:01:30.681648+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:10:17.045198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684887+0000","last_change":"2023-12-24T20:01:30.684807+0000","last_active":"2023-12-24T20:01:30.684887+0000","last_peered":"2023-12-24T20:01:30.684887+0000","last_clean":"2023-12-24T20:01:30.684887+0000","last_became_active":"2023-12-24T20:01:30.684548+0000","last_became_peered":"2023-12-24T20:01:30.684548+0000","last_unstale":"2023-12-24T20:01:30.684887+0000","last_undegraded":"2023-12-24T20:01:30.684887+0000","last_fullsized":"2023-12-24T20:01:30.684887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:37.631843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705103+0000","last_change":"2023-12-24T20:01:29.674484+0000","last_active":"2023-12-24T20:01:30.705103+0000","last_peered":"2023-12-24T20:01:30.705103+0000","last_clean":"2023-12-24T20:01:30.705103+0000","last_became_active":"2023-12-24T20:01:29.673766+0000","last_became_peered":"2023-12-24T20:01:29.673766+0000","last_unstale":"2023-12-24T20:01:30.705103+0000","last_undegraded":"2023-12-24T20:01:30.705103+0000","last_fullsized":"2023-12-24T20:01:30.705103+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:37.477665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688545+0000","last_change":"2023-12-24T20:01:30.688472+0000","last_active":"2023-12-24T20:01:30.688545+0000","last_peered":"2023-12-24T20:01:30.688545+0000","last_clean":"2023-12-24T20:01:30.688545+0000","last_became_active":"2023-12-24T20:01:30.688084+0000","last_became_peered":"2023-12-24T20:01:30.688084+0000","last_unstale":"2023-12-24T20:01:30.688545+0000","last_undegraded":"2023-12-24T20:01:30.688545+0000","last_fullsized":"2023-12-24T20:01:30.688545+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:39:16.672859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.680557+0000","last_change":"2023-12-24T20:01:29.679308+0000","last_active":"2023-12-24T20:01:30.680557+0000","last_peered":"2023-12-24T20:01:30.680557+0000","last_clean":"2023-12-24T20:01:30.680557+0000","last_became_active":"2023-12-24T20:01:29.678200+0000","last_became_peered":"2023-12-24T20:01:29.678200+0000","last_unstale":"2023-12-24T20:01:30.680557+0000","last_undegraded":"2023-12-24T20:01:30.680557+0000","last_fullsized":"2023-12-24T20:01:30.680557+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:37:31.083373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689640+0000","last_change":"2023-12-24T20:01:30.689508+0000","last_active":"2023-12-24T20:01:30.689640+0000","last_peered":"2023-12-24T20:01:30.689640+0000","last_clean":"2023-12-24T20:01:30.689640+0000","last_became_active":"2023-12-24T20:01:30.689012+0000","last_became_peered":"2023-12-24T20:01:30.689012+0000","last_unstale":"2023-12-24T20:01:30.689640+0000","last_undegraded":"2023-12-24T20:01:30.689640+0000","last_fullsized":"2023-12-24T20:01:30.689640+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:41:43.916138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.679565+0000","last_change":"2023-12-24T20:01:29.678815+0000","last_active":"2023-12-24T20:01:30.679565+0000","last_peered":"2023-12-24T20:01:30.679565+0000","last_clean":"2023-12-24T20:01:30.679565+0000","last_became_active":"2023-12-24T20:01:29.678629+0000","last_became_peered":"2023-12-24T20:01:29.678629+0000","last_unstale":"2023-12-24T20:01:30.679565+0000","last_undegraded":"2023-12-24T20:01:30.679565+0000","last_fullsized":"2023-12-24T20:01:30.679565+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:30:21.747257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686034+0000","last_change":"2023-12-24T20:01:30.685981+0000","last_active":"2023-12-24T20:01:30.686034+0000","last_peered":"2023-12-24T20:01:30.686034+0000","last_clean":"2023-12-24T20:01:30.686034+0000","last_became_active":"2023-12-24T20:01:30.685793+0000","last_became_peered":"2023-12-24T20:01:30.685793+0000","last_unstale":"2023-12-24T20:01:30.686034+0000","last_undegraded":"2023-12-24T20:01:30.686034+0000","last_fullsized":"2023-12-24T20:01:30.686034+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:46.421765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.680046+0000","last_change":"2023-12-24T20:01:29.674009+0000","last_active":"2023-12-24T20:01:30.680046+0000","last_peered":"2023-12-24T20:01:30.680046+0000","last_clean":"2023-12-24T20:01:30.680046+0000","last_became_active":"2023-12-24T20:01:29.673781+0000","last_became_peered":"2023-12-24T20:01:29.673781+0000","last_unstale":"2023-12-24T20:01:30.680046+0000","last_undegraded":"2023-12-24T20:01:30.680046+0000","last_fullsized":"2023-12-24T20:01:30.680046+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:31.328432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.689062+0000","last_change":"2023-12-24T20:01:30.688314+0000","last_active":"2023-12-24T20:01:30.689062+0000","last_peered":"2023-12-24T20:01:30.689062+0000","last_clean":"2023-12-24T20:01:30.689062+0000","last_became_active":"2023-12-24T20:01:30.687811+0000","last_became_peered":"2023-12-24T20:01:30.687811+0000","last_unstale":"2023-12-24T20:01:30.689062+0000","last_undegraded":"2023-12-24T20:01:30.689062+0000","last_fullsized":"2023-12-24T20:01:30.689062+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:38.482726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705216+0000","last_change":"2023-12-24T20:01:29.672645+0000","last_active":"2023-12-24T20:01:30.705216+0000","last_peered":"2023-12-24T20:01:30.705216+0000","last_clean":"2023-12-24T20:01:30.705216+0000","last_became_active":"2023-12-24T20:01:29.671896+0000","last_became_peered":"2023-12-24T20:01:29.671896+0000","last_unstale":"2023-12-24T20:01:30.705216+0000","last_undegraded":"2023-12-24T20:01:30.705216+0000","last_fullsized":"2023-12-24T20:01:30.705216+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:41:42.911076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.694554+0000","last_change":"2023-12-24T20:01:30.694497+0000","last_active":"2023-12-24T20:01:30.694554+0000","last_peered":"2023-12-24T20:01:30.694554+0000","last_clean":"2023-12-24T20:01:30.694554+0000","last_became_active":"2023-12-24T20:01:30.694244+0000","last_became_peered":"2023-12-24T20:01:30.694244+0000","last_unstale":"2023-12-24T20:01:30.694554+0000","last_undegraded":"2023-12-24T20:01:30.694554+0000","last_fullsized":"2023-12-24T20:01:30.694554+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:14.179654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-12-24T20:01:31.681883+0000","last_change":"2023-12-24T20:01:29.667274+0000","last_active":"2023-12-24T20:01:31.681883+0000","last_peered":"2023-12-24T20:01:31.681883+0000","last_clean":"2023-12-24T20:01:31.681883+0000","last_became_active":"2023-12-24T20:01:29.666919+0000","last_became_peered":"2023-12-24T20:01:29.666919+0000","last_unstale":"2023-12-24T20:01:31.681883+0000","last_undegraded":"2023-12-24T20:01:31.681883+0000","last_fullsized":"2023-12-24T20:01:31.681883+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:29:27.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690862+0000","last_change":"2023-12-24T20:01:30.690768+0000","last_active":"2023-12-24T20:01:30.690862+0000","last_peered":"2023-12-24T20:01:30.690862+0000","last_clean":"2023-12-24T20:01:30.690862+0000","last_became_active":"2023-12-24T20:01:30.690510+0000","last_became_peered":"2023-12-24T20:01:30.690510+0000","last_unstale":"2023-12-24T20:01:30.690862+0000","last_undegraded":"2023-12-24T20:01:30.690862+0000","last_fullsized":"2023-12-24T20:01:30.690862+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:28:37.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.686107+0000","last_change":"2023-12-24T20:01:29.679875+0000","last_active":"2023-12-24T20:01:30.686107+0000","last_peered":"2023-12-24T20:01:30.686107+0000","last_clean":"2023-12-24T20:01:30.686107+0000","last_became_active":"2023-12-24T20:01:29.679578+0000","last_became_peered":"2023-12-24T20:01:29.679578+0000","last_unstale":"2023-12-24T20:01:30.686107+0000","last_undegraded":"2023-12-24T20:01:30.686107+0000","last_fullsized":"2023-12-24T20:01:30.686107+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:26.206071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.695221+0000","last_change":"2023-12-24T20:01:30.694615+0000","last_active":"2023-12-24T20:01:30.695221+0000","last_peered":"2023-12-24T20:01:30.695221+0000","last_clean":"2023-12-24T20:01:30.695221+0000","last_became_active":"2023-12-24T20:01:30.694217+0000","last_became_peered":"2023-12-24T20:01:30.694217+0000","last_unstale":"2023-12-24T20:01:30.695221+0000","last_undegraded":"2023-12-24T20:01:30.695221+0000","last_fullsized":"2023-12-24T20:01:30.695221+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:21:06.004869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684813+0000","last_change":"2023-12-24T20:01:29.672474+0000","last_active":"2023-12-24T20:01:30.684813+0000","last_peered":"2023-12-24T20:01:30.684813+0000","last_clean":"2023-12-24T20:01:30.684813+0000","last_became_active":"2023-12-24T20:01:29.672181+0000","last_became_peered":"2023-12-24T20:01:29.672181+0000","last_unstale":"2023-12-24T20:01:30.684813+0000","last_undegraded":"2023-12-24T20:01:30.684813+0000","last_fullsized":"2023-12-24T20:01:30.684813+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:15:18.329574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.691420+0000","last_change":"2023-12-24T20:01:30.691296+0000","last_active":"2023-12-24T20:01:30.691420+0000","last_peered":"2023-12-24T20:01:30.691420+0000","last_clean":"2023-12-24T20:01:30.691420+0000","last_became_active":"2023-12-24T20:01:30.690898+0000","last_became_peered":"2023-12-24T20:01:30.690898+0000","last_unstale":"2023-12-24T20:01:30.691420+0000","last_undegraded":"2023-12-24T20:01:30.691420+0000","last_fullsized":"2023-12-24T20:01:30.691420+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.682891+0000","last_change":"2023-12-24T20:01:29.671487+0000","last_active":"2023-12-24T20:01:30.682891+0000","last_peered":"2023-12-24T20:01:30.682891+0000","last_clean":"2023-12-24T20:01:30.682891+0000","last_became_active":"2023-12-24T20:01:29.671331+0000","last_became_peered":"2023-12-24T20:01:29.671331+0000","last_unstale":"2023-12-24T20:01:30.682891+0000","last_undegraded":"2023-12-24T20:01:30.682891+0000","last_fullsized":"2023-12-24T20:01:30.682891+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:37.477665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.688032+0000","last_change":"2023-12-24T20:01:30.687951+0000","last_active":"2023-12-24T20:01:30.688032+0000","last_peered":"2023-12-24T20:01:30.688032+0000","last_clean":"2023-12-24T20:01:30.688032+0000","last_became_active":"2023-12-24T20:01:30.687452+0000","last_became_peered":"2023-12-24T20:01:30.687452+0000","last_unstale":"2023-12-24T20:01:30.688032+0000","last_undegraded":"2023-12-24T20:01:30.688032+0000","last_fullsized":"2023-12-24T20:01:30.688032+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:41:42.900888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.695613+0000","last_change":"2023-12-24T20:01:29.675924+0000","last_active":"2023-12-24T20:01:30.695613+0000","last_peered":"2023-12-24T20:01:30.695613+0000","last_clean":"2023-12-24T20:01:30.695613+0000","last_became_active":"2023-12-24T20:01:29.675675+0000","last_became_peered":"2023-12-24T20:01:29.675675+0000","last_unstale":"2023-12-24T20:01:30.695613+0000","last_undegraded":"2023-12-24T20:01:30.695613+0000","last_fullsized":"2023-12-24T20:01:30.695613+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:15:58.129491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.691742+0000","last_change":"2023-12-24T20:01:30.691656+0000","last_active":"2023-12-24T20:01:30.691742+0000","last_peered":"2023-12-24T20:01:30.691742+0000","last_clean":"2023-12-24T20:01:30.691742+0000","last_became_active":"2023-12-24T20:01:30.690873+0000","last_became_peered":"2023-12-24T20:01:30.690873+0000","last_unstale":"2023-12-24T20:01:30.691742+0000","last_undegraded":"2023-12-24T20:01:30.691742+0000","last_fullsized":"2023-12-24T20:01:30.691742+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:58.010463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.684962+0000","last_change":"2023-12-24T20:01:29.680409+0000","last_active":"2023-12-24T20:01:30.684962+0000","last_peered":"2023-12-24T20:01:30.684962+0000","last_clean":"2023-12-24T20:01:30.684962+0000","last_became_active":"2023-12-24T20:01:29.679770+0000","last_became_peered":"2023-12-24T20:01:29.679770+0000","last_unstale":"2023-12-24T20:01:30.684962+0000","last_undegraded":"2023-12-24T20:01:30.684962+0000","last_fullsized":"2023-12-24T20:01:30.684962+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:14.371806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.690693+0000","last_change":"2023-12-24T20:01:30.690623+0000","last_active":"2023-12-24T20:01:30.690693+0000","last_peered":"2023-12-24T20:01:30.690693+0000","last_clean":"2023-12-24T20:01:30.690693+0000","last_became_active":"2023-12-24T20:01:30.690281+0000","last_became_peered":"2023-12-24T20:01:30.690281+0000","last_unstale":"2023-12-24T20:01:30.690693+0000","last_undegraded":"2023-12-24T20:01:30.690693+0000","last_fullsized":"2023-12-24T20:01:30.690693+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:59:39.708945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.682264+0000","last_change":"2023-12-24T20:01:29.679483+0000","last_active":"2023-12-24T20:01:30.682264+0000","last_peered":"2023-12-24T20:01:30.682264+0000","last_clean":"2023-12-24T20:01:30.682264+0000","last_became_active":"2023-12-24T20:01:29.679256+0000","last_became_peered":"2023-12-24T20:01:29.679256+0000","last_unstale":"2023-12-24T20:01:30.682264+0000","last_undegraded":"2023-12-24T20:01:30.682264+0000","last_fullsized":"2023-12-24T20:01:30.682264+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:33:50.021067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.691301+0000","last_change":"2023-12-24T20:01:30.690728+0000","last_active":"2023-12-24T20:01:30.691301+0000","last_peered":"2023-12-24T20:01:30.691301+0000","last_clean":"2023-12-24T20:01:30.691301+0000","last_became_active":"2023-12-24T20:01:30.690143+0000","last_became_peered":"2023-12-24T20:01:30.690143+0000","last_unstale":"2023-12-24T20:01:30.691301+0000","last_undegraded":"2023-12-24T20:01:30.691301+0000","last_fullsized":"2023-12-24T20:01:30.691301+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:29.660123+0000","last_clean_scrub_stamp":"2023-12-24T20:01:29.660123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:56.051668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.705323+0000","last_change":"2023-12-24T20:01:29.672620+0000","last_active":"2023-12-24T20:01:30.705323+0000","last_peered":"2023-12-24T20:01:30.705323+0000","last_clean":"2023-12-24T20:01:30.705323+0000","last_became_active":"2023-12-24T20:01:29.672380+0000","last_became_peered":"2023-12-24T20:01:29.672380+0000","last_unstale":"2023-12-24T20:01:30.705323+0000","last_undegraded":"2023-12-24T20:01:30.705323+0000","last_fullsized":"2023-12-24T20:01:30.705323+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:01:28.655061+0000","last_clean_scrub_stamp":"2023-12-24T20:01:28.655061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:20:32.908184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":233,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-12-24T20:01:30.682546+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:01:30.682546+0000","last_peered":"2023-12-24T20:01:30.682546+0000","last_clean":"2023-12-24T20:01:30.682546+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:01:30.682546+0000","last_undegraded":"2023-12-24T20:01:30.682546+0000","last_fullsized":"2023-12-24T20:01:30.682546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1097,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194214,"statfs":{"total":200000000,"available":198875708,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.50900000000000001,"15min":0.497},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.754},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81000000000000005,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46700000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75800000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80000000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.624,"15min":0.628},"min":{"1min":0.439,"5min":0.437,"15min":0.437},"max":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54100000000000004}]},{"osd":4,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.51600000000000001,"15min":0.53300000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.67300000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77600000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.621}]},{"osd":5,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.55100000000000005,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73699999999999999,"5min":0.745,"15min":0.745},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.56599999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60699999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82599999999999996,"5min":0.873,"15min":0.873},"last":0.63}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465480,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54200000000000004,"15min":0.51400000000000001},"min":{"1min":0.33600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80400000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.40999999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.621}]},{"osd":1,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.55400000000000005,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75700000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69299999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.52400000000000002},"min":{"1min":0.37,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67200000000000004,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57099999999999995,"15min":0.55700000000000005},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67600000000000005,"5min":1.077,"15min":1.077},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.49099999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.753,"5min":1.048,"15min":1.048},"last":0.65200000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47299999999999998,"15min":0.46700000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68200000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.745,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46999999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68000000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.498},"min":{"1min":0.33000000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.68899999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.44900000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.66300000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76600000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.58499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52200000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.35999999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65600000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.311}]},{"osd":2,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.372,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.372,"15min":0.36499999999999999},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.57299999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.26600000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55100000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40100000000000002,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.56799999999999995,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35299999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.47999999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.621},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84599999999999997,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60699999999999998,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.443}]},{"osd":6,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.627,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":0.878,"15min":0.878},"last":0.52600000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:01:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.73899999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.63900000000000001},"min":{"1min":0.47599999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88200000000000001,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1097,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194214,"statfs":{"total":200000000,"available":198875744,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38400000000000001,"15min":0.433},"min":{"1min":0.24199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.56100000000000005,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.215,"15min":0.215},"max":{"1min":0.60199999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.35199999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.35999999999999999,"15min":0.36599999999999999},"min":{"1min":0.246,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.59799999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.31,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55400000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38600000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.441,"15min":0.46899999999999997},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57299999999999995,"5min":2.573,"15min":2.573},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.33700000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.58999999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33600000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59399999999999997,"15min":0.60199999999999998},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93300000000000005,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64700000000000002,"15min":0.68700000000000006},"min":{"1min":0.442,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.51400000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.45000000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.625,"15min":0.624},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89500000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.499}]},{"osd":6,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.60599999999999998},"min":{"1min":0.46100000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92100000000000004,"5min":1.655,"15min":1.655},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.64900000000000002},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94299999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.437}]},{"osd":7,"last update":"Sun Dec 24 20:01:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96599999999999997,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.69299999999999995,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.42499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194790,"statfs":{"total":200000000,"available":199465592,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.24399999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48599999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.316},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.375,"15min":0.374},"min":{"1min":0.25700000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.34899999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.254,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.51100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40300000000000002,"15min":0.40400000000000003},"min":{"1min":0.32000000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54000000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.27500000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41999999999999998,"15min":0.42099999999999999},"min":{"1min":0.29599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56799999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.30599999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.624,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.374}]},{"osd":4,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.375,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51700000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64700000000000002,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":3.577,"15min":3.577},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.435,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.872,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.54000000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":1.04,"15min":1.04},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.65800000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91300000000000003,"5min":3.637,"15min":3.637},"last":0.71699999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:00:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68999999999999995,"15min":0.65800000000000003},"min":{"1min":0.45300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88700000000000001,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.626},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67700000000000005,"15min":0.68300000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.01,"5min":1.331,"15min":1.331},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464610,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.33200000000000002,"15min":0.32400000000000001},"min":{"1min":0.24299999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.502,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"min":{"1min":0.25900000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.30599999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35899999999999999,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59199999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.40300000000000002,"15min":0.40500000000000003},"min":{"1min":0.316,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.502}]},{"osd":4,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60899999999999999,"15min":0.59999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86799999999999999,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.621,"15min":0.60199999999999998},"min":{"1min":0.49299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.94999999999999996,"5min":1.337,"15min":1.337},"last":0.47899999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.626,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92400000000000004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.442},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88500000000000001,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.626,"15min":0.61599999999999999},"min":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51700000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65000000000000002,"15min":0.63400000000000001},"min":{"1min":0.54600000000000004,"5min":0.435,"15min":0.435},"max":{"1min":1.0149999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.41699999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92600000000000005,"5min":1.006,"15min":1.006},"last":0.54900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":521,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194791,"statfs":{"total":200000000,"available":199466146,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.34399999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71199999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.65200000000000002,"15min":0.73799999999999999},"min":{"1min":0.379,"5min":0.378,"15min":0.378},"max":{"1min":0.69199999999999995,"5min":4.883,"15min":4.883},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75600000000000001,"5min":1.544,"15min":1.544},"last":0.70099999999999996}]},{"osd":2,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72699999999999998,"5min":0.88,"15min":0.88},"last":0.628},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57999999999999996,"15min":0.59599999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72099999999999997,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70599999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.748,"15min":0.92200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77300000000000002,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.496,"15min":0.52800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.745,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.58299999999999996,"15min":0.65900000000000003},"min":{"1min":0.34499999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.70499999999999996,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.44900000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.60699999999999998,"15min":0.64100000000000001},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.48999999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:01:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.83299999999999996,"15min":1.119},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75600000000000001,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.38,"5min":0.31,"15min":0.31},"max":{"1min":0.73499999999999999,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":522,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194789,"statfs":{"total":200000000,"available":199464588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52200000000000002,"15min":0.50600000000000001},"min":{"1min":0.318,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57599999999999996,"15min":0.54400000000000004},"min":{"1min":0.38,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79200000000000004,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.379,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.746,"5min":1.847,"15min":1.847},"last":0.621},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58899999999999997,"15min":0.55900000000000005},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72399999999999998,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.51900000000000002},"min":{"1min":0.42899999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.68000000000000005,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.56200000000000006,"15min":0.54100000000000004},"min":{"1min":0.40799999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":1.97,"15min":1.97},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59799999999999998,"15min":0.56799999999999995},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.76600000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.57599999999999996,"15min":0.56000000000000005},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.752,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52900000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.33200000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.67400000000000004,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.503},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53600000000000003,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.54700000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.47899999999999998,"15min":0.47299999999999998},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66100000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.41399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:01:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56799999999999995,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":3.766,"15min":3.766},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36599999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56399999999999995}]}]}],"pool_statfs":[]}} 2023-12-24T20:01:39.843 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T20:01:39.843 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T20:01:40.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.008+0000 7f6a3c295700 1 Processor -- start 2023-12-24T20:01:40.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.008+0000 7f6a3c295700 1 -- start start 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3c295700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6a340b2ec0 0x7f6a340685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3c295700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a3406a7e0 0x7f6a340c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3c295700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3415bec0 con 0x7f6a340c9850 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3c295700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a34068ee0 con 0x7f6a340b2ec0 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3c295700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34071650 con 0x7f6a3406a7e0 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3a031700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6a340b2ec0 0x7f6a340685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3a031700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6a340b2ec0 0x7f6a340685d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57330/0 (socket says 172.21.15.61:57330) 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3a031700 1 -- 172.21.15.61:0/389132173 learned_addr learned my addr 172.21.15.61:0/389132173 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a39830700 1 --2- 172.21.15.61:0/389132173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a3406a7e0 0x7f6a340c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3a031700 1 -- 172.21.15.61:0/389132173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a3406a7e0 msgr2=0x7f6a340c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:40.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3a031700 1 --2- 172.21.15.61:0/389132173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a3406a7e0 0x7f6a340c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3a031700 1 -- 172.21.15.61:0/389132173 >> v1:172.21.15.133:6789/0 conn(0x7f6a340c9850 legacy=0x7f6a34067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.009+0000 7f6a3a031700 1 -- 172.21.15.61:0/389132173 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3415b590 con 0x7f6a340b2ec0 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3a031700 1 --2- 172.21.15.61:0/389132173 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a340b2ec0 0x7f6a340685d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6a300099b0 tx=0x7f6a30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f838e30cdf8ea server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3902f700 1 -- 172.21.15.61:0/389132173 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000b860 con 0x7f6a340b2ec0 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3902f700 1 -- 172.21.15.61:0/389132173 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3000b9c0 con 0x7f6a340b2ec0 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3902f700 1 -- 172.21.15.61:0/389132173 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000bd60 con 0x7f6a340b2ec0 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3c295700 1 -- 172.21.15.61:0/389132173 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a340b2ec0 msgr2=0x7f6a340685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3c295700 1 --2- 172.21.15.61:0/389132173 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a340b2ec0 0x7f6a340685d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6a300099b0 tx=0x7f6a30009250 comp rx=0 tx=0).stop 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3c295700 1 -- 172.21.15.61:0/389132173 shutdown_connections 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3c295700 1 --2- 172.21.15.61:0/389132173 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a340b2ec0 0x7f6a340685d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3c295700 1 --2- 172.21.15.61:0/389132173 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a3406a7e0 0x7f6a340c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3c295700 1 -- 172.21.15.61:0/389132173 >> 172.21.15.61:0/389132173 conn(0x7f6a340ce170 msgr2=0x7f6a340ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3c295700 1 -- 172.21.15.61:0/389132173 shutdown_connections 2023-12-24T20:01:40.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.010+0000 7f6a3c295700 1 -- 172.21.15.61:0/389132173 wait complete. 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.012+0000 7f6a3c295700 1 Processor -- start 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.012+0000 7f6a3c295700 1 -- start start 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3c295700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a3406a7e0 0x7f6a3414f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3c295700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a340b2ec0 0x7f6a340cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3c295700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a340c9850 0x7f6a34158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3c295700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340c2a70 con 0x7f6a3406a7e0 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3c295700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340c35f0 con 0x7f6a340b2ec0 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3c295700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3414f7e0 con 0x7f6a340c9850 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3a031700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a3406a7e0 0x7f6a3414f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3a031700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a3406a7e0 0x7f6a3414f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57342/0 (socket says 172.21.15.61:57342) 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3a031700 1 -- 172.21.15.61:0/2434319005 learned_addr learned my addr 172.21.15.61:0/2434319005 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:40.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a39830700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a340b2ec0 0x7f6a340cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3a832700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a340c9850 0x7f6a34158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3a031700 1 -- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a340c9850 msgr2=0x7f6a34158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3a031700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a340c9850 0x7f6a34158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3a031700 1 -- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a340b2ec0 msgr2=0x7f6a340cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3a031700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a340b2ec0 0x7f6a340cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3a031700 1 -- 172.21.15.61:0/2434319005 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a300094f0 con 0x7f6a3406a7e0 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.013+0000 7f6a3a031700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a3406a7e0 0x7f6a3414f2a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6a30006fd0 tx=0x7f6a30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.014+0000 7f6a2a7fc700 1 -- 172.21.15.61:0/2434319005 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30024440 con 0x7f6a3406a7e0 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.014+0000 7f6a2a7fc700 1 -- 172.21.15.61:0/2434319005 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a300245c0 con 0x7f6a3406a7e0 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.014+0000 7f6a2a7fc700 1 -- 172.21.15.61:0/2434319005 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30024980 con 0x7f6a3406a7e0 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.014+0000 7f6a3c295700 1 -- 172.21.15.61:0/2434319005 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a340c2cc0 con 0x7f6a3406a7e0 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.014+0000 7f6a3c295700 1 -- 172.21.15.61:0/2434319005 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a340c3280 con 0x7f6a3406a7e0 2023-12-24T20:01:40.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.015+0000 7f6a3c295700 1 -- 172.21.15.61:0/2434319005 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a340c38d0 con 0x7f6a3406a7e0 2023-12-24T20:01:40.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.015+0000 7f6a2a7fc700 1 -- 172.21.15.61:0/2434319005 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6a3001a420 con 0x7f6a3406a7e0 2023-12-24T20:01:40.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.015+0000 7f6a2a7fc700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6a18066f30 0x7f6a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.015+0000 7f6a2a7fc700 1 -- 172.21.15.61:0/2434319005 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a300863b0 con 0x7f6a3406a7e0 2023-12-24T20:01:40.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.016+0000 7f6a39830700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6a18066f30 0x7f6a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.016+0000 7f6a39830700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6a18066f30 0x7f6a180693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6a340afd40 tx=0x7f6a24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:40.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.020+0000 7f6a2a7fc700 1 -- 172.21.15.61:0/2434319005 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a30053620 con 0x7f6a3406a7e0 2023-12-24T20:01:40.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.298+0000 7f6a3c295700 1 -- 172.21.15.61:0/2434319005 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6a340c3410 con 0x7f6a3406a7e0 2023-12-24T20:01:40.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.302+0000 7f6a2a7fc700 1 -- 172.21.15.61:0/2434319005 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6a30056c40 con 0x7f6a3406a7e0 2023-12-24T20:01:40.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 -- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6a18066f30 msgr2=0x7f6a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6a18066f30 0x7f6a180693e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6a340afd40 tx=0x7f6a24008040 comp rx=0 tx=0).stop 2023-12-24T20:01:40.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 -- 172.21.15.61:0/2434319005 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a3406a7e0 msgr2=0x7f6a3414f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a3406a7e0 0x7f6a3414f2a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6a30006fd0 tx=0x7f6a30017000 comp rx=0 tx=0).stop 2023-12-24T20:01:40.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 -- 172.21.15.61:0/2434319005 shutdown_connections 2023-12-24T20:01:40.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6a340c9850 0x7f6a34158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6a18066f30 0x7f6a180693e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6a3406a7e0 0x7f6a3414f2a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 --2- 172.21.15.61:0/2434319005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a340b2ec0 0x7f6a340cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 -- 172.21.15.61:0/2434319005 >> 172.21.15.61:0/2434319005 conn(0x7f6a340ce170 msgr2=0x7f6a340cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:40.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 -- 172.21.15.61:0/2434319005 shutdown_connections 2023-12-24T20:01:40.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.304+0000 7f6a3c295700 1 -- 172.21.15.61:0/2434319005 wait complete. 2023-12-24T20:01:40.306 INFO:teuthology.orchestra.run.smithi061.stderr:updated caps for client.0 2023-12-24T20:01:40.316 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:01:40.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.437+0000 7fd1dc51b700 1 Processor -- start 2023-12-24T20:01:40.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.437+0000 7fd1dc51b700 1 -- start start 2023-12-24T20:01:40.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.438+0000 7fd1dc51b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1d4068510 0x7fd1d40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.438+0000 7fd1dc51b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1d4159a60 0x7fd1d4159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.438+0000 7fd1dc51b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d40b2890 con 0x7fd1d4068140 2023-12-24T20:01:40.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.438+0000 7fd1dc51b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d40cf630 con 0x7fd1d4068510 2023-12-24T20:01:40.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.438+0000 7fd1dc51b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40b2240 con 0x7fd1d4159a60 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.438+0000 7fd1da2b7700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd1d4068140 0x7fd1d40b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:37792/0 (socket says 172.21.15.61:37792) 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.438+0000 7fd1da2b7700 1 -- 172.21.15.61:0/138567560 learned_addr learned my addr 172.21.15.61:0/138567560 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906544527 0 0) 0x7fd1d40b2890 con 0x7fd1d4068140 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c0003570 con 0x7fd1d4068140 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1daab8700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1d4159a60 0x7fd1d4159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d9ab6700 1 --2- 172.21.15.61:0/138567560 >> v2:172.21.15.133:3300/0 conn(0x7fd1d4068510 0x7fd1d40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1944728762 0 0) 0x7fd1c0003570 con 0x7fd1d4068140 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1d4159a60 msgr2=0x7fd1d4159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1d4159a60 0x7fd1d4159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 >> v2:172.21.15.133:3300/0 conn(0x7fd1d4068510 msgr2=0x7fd1d40cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 --2- 172.21.15.61:0/138567560 >> v2:172.21.15.133:3300/0 conn(0x7fd1d4068510 0x7fd1d40cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40b2520 con 0x7fd1d4068140 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fd1d00015f0 con 0x7fd1d4068140 2023-12-24T20:01:40.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 >> v1:172.21.15.61:6789/0 conn(0x7fd1d4068140 legacy=0x7fd1d40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c0003a60 0x7fd1c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1c0004810 0x7fd1c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1d4159a60 0x7fd1c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40cf630 con 0x7fd1c0004810 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40b2240 con 0x7fd1c0003a60 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c000ba60 con 0x7fd1d4159a60 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1d9ab6700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1c0004810 0x7fd1c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1da2b7700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c0003a60 0x7fd1c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.439+0000 7fd1daab8700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1d4159a60 0x7fd1c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1d9ab6700 1 -- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1d4159a60 msgr2=0x7fd1c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1d9ab6700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1d4159a60 0x7fd1c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1d9ab6700 1 -- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c0003a60 msgr2=0x7fd1c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:40.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1d9ab6700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c0003a60 0x7fd1c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1d9ab6700 1 -- 172.21.15.61:0/138567560 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c0003570 con 0x7fd1c0004810 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1d9ab6700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1c0004810 0x7fd1c0004c80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009c30 tx=0x7fd1c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d42e0026df7d0f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c400e710 con 0x7fd1c0004810 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c400e870 con 0x7fd1c0004810 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1d92b5700 1 -- 172.21.15.61:0/138567560 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c400ec30 con 0x7fd1c0004810 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1dc51b700 1 -- 172.21.15.61:0/138567560 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1c0004810 msgr2=0x7fd1c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1dc51b700 1 --2- 172.21.15.61:0/138567560 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1c0004810 0x7fd1c0004c80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009c30 tx=0x7fd1c40091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1daab8700 1 -- 172.21.15.61:0/138567560 reap_dead start 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1dc51b700 1 -- 172.21.15.61:0/138567560 shutdown_connections 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.440+0000 7fd1dc51b700 1 -- 172.21.15.61:0/138567560 >> 172.21.15.61:0/138567560 conn(0x7fd1d4097a10 msgr2=0x7fd1d40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.441+0000 7fd1dc51b700 1 -- 172.21.15.61:0/138567560 shutdown_connections 2023-12-24T20:01:40.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.441+0000 7fd1dc51b700 1 -- 172.21.15.61:0/138567560 wait complete. 2023-12-24T20:01:40.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.442+0000 7fd1dc51b700 1 Processor -- start 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.442+0000 7fd1dc51b700 1 -- start start 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.442+0000 7fd1dc51b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1c0004810 0x7fd1d415d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.442+0000 7fd1dc51b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1d41569c0 0x7fd1d40996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.442+0000 7fd1dc51b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1d4099c30 0x7fd1d409a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.442+0000 7fd1dc51b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d415d890 con 0x7fd1d4099c30 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.442+0000 7fd1dc51b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d415a940 con 0x7fd1d41569c0 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.442+0000 7fd1dc51b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d415a380 con 0x7fd1c0004810 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.442+0000 7fd1daab8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1d4099c30 0x7fd1d409a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1daab8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1d4099c30 0x7fd1d409a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57368/0 (socket says 172.21.15.61:57368) 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1daab8700 1 -- 172.21.15.61:0/2665252891 learned_addr learned my addr 172.21.15.61:0/2665252891 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1d9ab6700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1d41569c0 0x7fd1d40996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1da2b7700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1c0004810 0x7fd1d415d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1daab8700 1 -- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1c0004810 msgr2=0x7fd1d415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1daab8700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1c0004810 0x7fd1d415d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1daab8700 1 -- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1d41569c0 msgr2=0x7fd1d40996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1daab8700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1d41569c0 0x7fd1d40996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1daab8700 1 -- 172.21.15.61:0/2665252891 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d415a660 con 0x7fd1d4099c30 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1daab8700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1d4099c30 0x7fd1d409a0a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd1d406e8a0 tx=0x7fd1cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1ca7fc700 1 -- 172.21.15.61:0/2665252891 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00e070 con 0x7fd1d4099c30 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1ca7fc700 1 -- 172.21.15.61:0/2665252891 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc011d00 con 0x7fd1d4099c30 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1ca7fc700 1 -- 172.21.15.61:0/2665252891 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0166c0 con 0x7fd1d4099c30 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1dc51b700 1 -- 172.21.15.61:0/2665252891 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d415ad10 con 0x7fd1d4099c30 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.443+0000 7fd1dc51b700 1 -- 172.21.15.61:0/2665252891 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d4157140 con 0x7fd1d4099c30 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.444+0000 7fd1dc51b700 1 -- 172.21.15.61:0/2665252891 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d415ab60 con 0x7fd1d4099c30 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.445+0000 7fd1ca7fc700 1 -- 172.21.15.61:0/2665252891 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd1cc016ab0 con 0x7fd1d4099c30 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.445+0000 7fd1ca7fc700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1b8066f30 0x7fd1b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:40.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.445+0000 7fd1ca7fc700 1 -- 172.21.15.61:0/2665252891 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1cc085000 con 0x7fd1d4099c30 2023-12-24T20:01:40.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.445+0000 7fd1da2b7700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1b8066f30 0x7fd1b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:40.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.446+0000 7fd1da2b7700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1b8066f30 0x7fd1b80693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0000ef0 tx=0x7fd1d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:40.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.449+0000 7fd1ca7fc700 1 -- 172.21.15.61:0/2665252891 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1cc052270 con 0x7fd1d4099c30 2023-12-24T20:01:40.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.689+0000 7fd1dc51b700 1 -- 172.21.15.61:0/2665252891 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1d415b230 con 0x7fd1d4099c30 2023-12-24T20:01:40.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.689+0000 7fd1ca7fc700 1 -- 172.21.15.61:0/2665252891 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fd1d415b230 con 0x7fd1d4099c30 2023-12-24T20:01:40.690 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:40.690 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2634636374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2634636374},{"type":"v1","addr":"172.21.15.61:6835","nonce":2634636374}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/856986572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":856986572},{"type":"v1","addr":"172.21.15.133:6836","nonce":856986572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1475170652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1475170652},{"type":"v1","addr":"172.21.15.133:6837","nonce":1475170652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:01:30.072202+0000","modified":"2023-12-24T20:01:33.718490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2512648595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2512648595},{"type":"v1","addr":"172.21.15.61:6834","nonce":2512648595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 -- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1b8066f30 msgr2=0x7fd1b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1b8066f30 0x7fd1b80693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0000ef0 tx=0x7fd1d0009040 comp rx=0 tx=0).stop 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 -- 172.21.15.61:0/2665252891 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1d4099c30 msgr2=0x7fd1d409a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1d4099c30 0x7fd1d409a0a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd1d406e8a0 tx=0x7fd1cc00b040 comp rx=0 tx=0).stop 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 -- 172.21.15.61:0/2665252891 shutdown_connections 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd1c0004810 0x7fd1d415d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1b8066f30 0x7fd1b80693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd1d4099c30 0x7fd1d409a0a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 --2- 172.21.15.61:0/2665252891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1d41569c0 0x7fd1d40996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 -- 172.21.15.61:0/2665252891 >> 172.21.15.61:0/2665252891 conn(0x7fd1d4097a10 msgr2=0x7fd1d406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:40.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 -- 172.21.15.61:0/2665252891 shutdown_connections 2023-12-24T20:01:40.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:40.691+0000 7fd1dc51b700 1 -- 172.21.15.61:0/2665252891 wait complete. 2023-12-24T20:01:40.693 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 52 2023-12-24T20:01:41.106 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T20:01:30.072202+0000', 'modified': '2023-12-24T20:01:33.718490+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6318}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6318': {'gid': 6318, 'name': 'c', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.61:6834/2512648595', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.61:6832', 'nonce': 2512648595}, {'type': 'v1', 'addr': '172.21.15.61:6834', 'nonce': 2512648595}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T20:01:41.106 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T20:01:41.106 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-24T20:01:41.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.231+0000 7ff038292700 1 Processor -- start 2023-12-24T20:01:41.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.231+0000 7ff038292700 1 -- start start 2023-12-24T20:01:41.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.232+0000 7ff038292700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff030159c40 0x7ff030070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.232+0000 7ff038292700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030070db0 0x7ff0300c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.232+0000 7ff038292700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff0300c4010 0x7ff030069b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.232+0000 7ff038292700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff030067f10 con 0x7ff0300c4010 2023-12-24T20:01:41.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.232+0000 7ff038292700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff030068d10 con 0x7ff030159c40 2023-12-24T20:01:41.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.232+0000 7ff038292700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff030068100 con 0x7ff030070db0 2023-12-24T20:01:41.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.232+0000 7ff03682f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff0300c4010 0x7ff030069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.232+0000 7ff03682f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff0300c4010 0x7ff030069b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57370/0 (socket says 172.21.15.61:57370) 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.232+0000 7ff03682f700 1 -- 172.21.15.61:0/3229224049 learned_addr learned my addr 172.21.15.61:0/3229224049 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03602e700 1 --2- 172.21.15.61:0/3229224049 >> v2:172.21.15.133:3300/0 conn(0x7ff030159c40 0x7ff030070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03582d700 1 --2- 172.21.15.61:0/3229224049 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030070db0 0x7ff0300c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03682f700 1 -- 172.21.15.61:0/3229224049 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030070db0 msgr2=0x7ff0300c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03682f700 1 --2- 172.21.15.61:0/3229224049 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030070db0 0x7ff0300c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03682f700 1 -- 172.21.15.61:0/3229224049 >> v2:172.21.15.133:3300/0 conn(0x7ff030159c40 msgr2=0x7ff030070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03682f700 1 --2- 172.21.15.61:0/3229224049 >> v2:172.21.15.133:3300/0 conn(0x7ff030159c40 0x7ff030070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03682f700 1 -- 172.21.15.61:0/3229224049 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300683e0 con 0x7ff0300c4010 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03682f700 1 --2- 172.21.15.61:0/3229224049 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0300c4010 0x7ff030069b40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff03006c990 tx=0x7ff028009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b071b597341e56 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03502c700 1 -- 172.21.15.61:0/3229224049 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02800e070 con 0x7ff0300c4010 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03502c700 1 -- 172.21.15.61:0/3229224049 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02800b970 con 0x7ff0300c4010 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.233+0000 7ff03502c700 1 -- 172.21.15.61:0/3229224049 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0280092e0 con 0x7ff0300c4010 2023-12-24T20:01:41.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.234+0000 7ff038292700 1 -- 172.21.15.61:0/3229224049 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0300c4010 msgr2=0x7ff030069b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.234+0000 7ff038292700 1 --2- 172.21.15.61:0/3229224049 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0300c4010 0x7ff030069b40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff03006c990 tx=0x7ff028009840 comp rx=0 tx=0).stop 2023-12-24T20:01:41.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.234+0000 7ff038292700 1 -- 172.21.15.61:0/3229224049 shutdown_connections 2023-12-24T20:01:41.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.234+0000 7ff038292700 1 --2- 172.21.15.61:0/3229224049 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0300c4010 0x7ff030069b40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.234+0000 7ff038292700 1 --2- 172.21.15.61:0/3229224049 >> v2:172.21.15.133:3300/0 conn(0x7ff030159c40 0x7ff030070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.234+0000 7ff038292700 1 --2- 172.21.15.61:0/3229224049 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030070db0 0x7ff0300c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.234+0000 7ff038292700 1 -- 172.21.15.61:0/3229224049 >> 172.21.15.61:0/3229224049 conn(0x7ff0300ce190 msgr2=0x7ff0300ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:41.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.234+0000 7ff038292700 1 -- 172.21.15.61:0/3229224049 shutdown_connections 2023-12-24T20:01:41.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.234+0000 7ff038292700 1 -- 172.21.15.61:0/3229224049 wait complete. 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.235+0000 7ff038292700 1 Processor -- start 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.235+0000 7ff038292700 1 -- start start 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff038292700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070db0 0x7ff0301697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff038292700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0300c4010 0x7ff03014c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff038292700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff030159c40 0x7ff0300ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff038292700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300b3090 con 0x7ff030070db0 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff038292700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03015b870 con 0x7ff030159c40 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff038292700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03015ac60 con 0x7ff0300c4010 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03602e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070db0 0x7ff0301697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03602e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070db0 0x7ff0301697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57384/0 (socket says 172.21.15.61:57384) 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03602e700 1 -- 172.21.15.61:0/4117436763 learned_addr learned my addr 172.21.15.61:0/4117436763 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03582d700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0300c4010 0x7ff03014c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03682f700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff030159c40 0x7ff0300ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03602e700 1 -- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0300c4010 msgr2=0x7ff03014c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03602e700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0300c4010 0x7ff03014c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03602e700 1 -- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff030159c40 msgr2=0x7ff0300ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03602e700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff030159c40 0x7ff0300ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03602e700 1 -- 172.21.15.61:0/4117436763 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff028009ae0 con 0x7ff030070db0 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff03602e700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070db0 0x7ff0301697b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff02000ec80 tx=0x7ff0200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff0267fc700 1 -- 172.21.15.61:0/4117436763 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000c850 con 0x7ff030070db0 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff0267fc700 1 -- 172.21.15.61:0/4117436763 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02000c9b0 con 0x7ff030070db0 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff038292700 1 -- 172.21.15.61:0/4117436763 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03015af40 con 0x7ff030070db0 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.236+0000 7ff0267fc700 1 -- 172.21.15.61:0/4117436763 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000cd50 con 0x7ff030070db0 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.237+0000 7ff038292700 1 -- 172.21.15.61:0/4117436763 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03015b580 con 0x7ff030070db0 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.238+0000 7ff0267fc700 1 -- 172.21.15.61:0/4117436763 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff020013680 con 0x7ff030070db0 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.238+0000 7ff0267fc700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff014066f30 0x7ff0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.238+0000 7ff0267fc700 1 -- 172.21.15.61:0/4117436763 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff020084830 con 0x7ff030070db0 2023-12-24T20:01:41.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.239+0000 7ff03582d700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff014066f30 0x7ff0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.239+0000 7ff03582d700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff014066f30 0x7ff0140693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff0300b2ca0 tx=0x7ff02c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:41.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.240+0000 7ff041592b80 1 Processor -- start 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.241+0000 7ff041592b80 1 -- start start 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.241+0000 7ff041592b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e8fa0 0x5589e50e9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.241+0000 7ff041592b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50e4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.241+0000 7ff041592b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e5170 0x5589e5105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.241+0000 7ff041592b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e50173e0 con 0x5589e50e98b0 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.241+0000 7ff041592b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e5014be0 con 0x5589e50e8fa0 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.241+0000 7ff041592b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589e50109d0 con 0x5589e50e5170 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.241+0000 7ff03582d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50e4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.241+0000 7ff03582d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50e4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57392/0 (socket says 172.21.15.61:57392) 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.241+0000 7ff03582d700 1 -- 172.21.15.61:0/3884889433 learned_addr learned my addr 172.21.15.61:0/3884889433 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff03602e700 1 --2- 172.21.15.61:0/3884889433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e8fa0 0x5589e50e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff03682f700 1 --2- 172.21.15.61:0/3884889433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e5170 0x5589e5105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff03582d700 1 -- 172.21.15.61:0/3884889433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e5170 msgr2=0x5589e5105360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff03582d700 1 --2- 172.21.15.61:0/3884889433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e5170 0x5589e5105360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff03582d700 1 -- 172.21.15.61:0/3884889433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e8fa0 msgr2=0x5589e50e9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff03582d700 1 --2- 172.21.15.61:0/3884889433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e8fa0 0x5589e50e9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff03582d700 1 -- 172.21.15.61:0/3884889433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589e4ea4360 con 0x5589e50e98b0 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff03582d700 1 --2- 172.21.15.61:0/3884889433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50e4c30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff02c011dc0 tx=0x7ff02c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada7be9a8908e77a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff0137fe700 1 -- 172.21.15.61:0/3884889433 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c014bb0 con 0x5589e50e98b0 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff0137fe700 1 -- 172.21.15.61:0/3884889433 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c014d10 con 0x5589e50e98b0 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.242+0000 7ff0137fe700 1 -- 172.21.15.61:0/3884889433 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c021660 con 0x5589e50e98b0 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 -- 172.21.15.61:0/3884889433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 msgr2=0x5589e50e4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 --2- 172.21.15.61:0/3884889433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50e4c30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff02c011dc0 tx=0x7ff02c019000 comp rx=0 tx=0).stop 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 -- 172.21.15.61:0/3884889433 shutdown_connections 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 --2- 172.21.15.61:0/3884889433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e5170 0x5589e5105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 --2- 172.21.15.61:0/3884889433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e8fa0 0x5589e50e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 --2- 172.21.15.61:0/3884889433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50e4c30 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 -- 172.21.15.61:0/3884889433 >> 172.21.15.61:0/3884889433 conn(0x5589e50bf440 msgr2=0x5589e510adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:41.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 -- 172.21.15.61:0/3884889433 shutdown_connections 2023-12-24T20:01:41.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 -- 172.21.15.61:0/3884889433 wait complete. 2023-12-24T20:01:41.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 -- start start 2023-12-24T20:01:41.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.243+0000 7ff041592b80 1 Processor -- start 2023-12-24T20:01:41.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.244+0000 7ff041592b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 0x5589e5119bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.244+0000 7ff041592b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e8fa0 0x5589e50edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.244+0000 7ff041592b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.244+0000 7ff041592b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e4fbd1b0 con 0x5589e50e98b0 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.244+0000 7ff041592b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e4fbce50 con 0x5589e50e5170 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.244+0000 7ff041592b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589e4f09e40 con 0x5589e50e8fa0 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.244+0000 7ff041592b80 10 client.0 _ll_register_callbacks cb 0x5589e4f0c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.244+0000 7ff03682f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03682f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57404/0 (socket says 172.21.15.61:57404) 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03682f700 1 -- 172.21.15.61:0/3059751234 learned_addr learned my addr 172.21.15.61:0/3059751234 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03602e700 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 0x5589e5119bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03582d700 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e8fa0 0x5589e50edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03682f700 1 -- 172.21.15.61:0/3059751234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e8fa0 msgr2=0x5589e50edcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03682f700 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e8fa0 0x5589e50edcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03682f700 1 -- 172.21.15.61:0/3059751234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 msgr2=0x5589e5119bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03682f700 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 0x5589e5119bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03682f700 1 -- 172.21.15.61:0/3059751234 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c011a20 con 0x5589e50e98b0 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03602e700 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 0x5589e5119bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff03682f700 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50c2660 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff02800b610 tx=0x7ff028018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650cd36ec5e85956 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff010ff9700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff010ff9700 1 -- 172.21.15.61:0/3059751234 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028022070 con 0x5589e50e98b0 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff010ff9700 1 -- 172.21.15.61:0/3059751234 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff028026400 con 0x5589e50e98b0 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff041592b80 1 -- 172.21.15.61:0/3059751234 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589e5091eb0 con 0x5589e50e98b0 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff010ff9700 1 -- 172.21.15.61:0/3059751234 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff028009940 con 0x5589e50e98b0 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff041592b80 10 client.6504 fetch_fsmap learned FSMap version 52 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff041592b80 1 -- 172.21.15.61:0/3059751234 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x5589e4e50b10 con 0x5589e50e98b0 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.245+0000 7ff010ff9700 1 -- 172.21.15.61:0/3059751234 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5589e5091eb0 con 0x5589e50e98b0 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.246+0000 7ff010ff9700 1 -- 172.21.15.61:0/3059751234 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff02800b050 con 0x5589e50e98b0 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.246+0000 7ff041592b80 10 client.6504 fetch_fsmap finished waiting for FSMap version 52 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.246+0000 7ff041592b80 10 client.6504 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T20:01:41.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.246+0000 7ff041592b80 20 client.6504 populate_metadata read hostname 'smithi061' 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.246+0000 7ff041592b80 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.61:6832/2512648595,v1:172.21.15.61:6834/2512648595] conn(0x5589e5118200 0x5589e51185d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.246+0000 7ff041592b80 4 client.6504 mds_command: new command op to 6318 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.246+0000 7ff041592b80 1 -- 172.21.15.61:0/3059751234 --> [v2:172.21.15.61:6832/2512648595,v1:172.21.15.61:6834/2512648595] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589e4fe7880 con 0x5589e5118200 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.246+0000 7ff03602e700 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.61:6832/2512648595,v1:172.21.15.61:6834/2512648595] conn(0x5589e5118200 0x5589e51185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.246+0000 7ff03602e700 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.61:6832/2512648595,v1:172.21.15.61:6834/2512648595] conn(0x5589e5118200 0x5589e51185d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6bd6fa8a2e8386e server_cookie=c1e06e7ce36cfcd8 in_seq=0 out_seq=0 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.246+0000 7ff010ff9700 10 client.6504 ms_handle_connect on v2:172.21.15.61:6832/2512648595 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff010ff9700 1 -- 172.21.15.61:0/3059751234 <== mds.0 v2:172.21.15.61:6832/2512648595 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5589e4fe7880 con 0x5589e5118200 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff010ff9700 10 client.6504 handle_command_reply: tid=0 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 client.6504 shutdown 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 -- 172.21.15.61:0/3059751234 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 msgr2=0x5589e50c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50c2660 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff02800b610 tx=0x7ff028018000 comp rx=0 tx=0).stop 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 -- 172.21.15.61:0/3059751234 shutdown_connections 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.61:6832/2512648595,v1:172.21.15.61:6834/2512648595] conn(0x5589e5118200 0x5589e51185d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e98b0 0x5589e50c2660 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 0x5589e5119bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff010ff9700 0 client.6504 ms_handle_reset on v2:172.21.15.61:6832/2512648595 2023-12-24T20:01:41.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 --2- 172.21.15.61:0/3059751234 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e8fa0 0x5589e50edcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 -- 172.21.15.61:0/3059751234 >> 172.21.15.61:0/3059751234 conn(0x5589e50bf440 msgr2=0x5589e50bf810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:41.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 -- 172.21.15.61:0/3059751234 shutdown_connections 2023-12-24T20:01:41.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 1 -- 172.21.15.61:0/3059751234 wait complete. 2023-12-24T20:01:41.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.247+0000 7ff041592b80 20 client.6504 trim_cache size 0 max 16384 2023-12-24T20:01:41.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.264+0000 7ff041592b80 1 Processor -- start 2023-12-24T20:01:41.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.264+0000 7ff041592b80 1 -- start start 2023-12-24T20:01:41.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff041592b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e5170 0x5589e50b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff041592b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50b7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff041592b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e98b0 0x5589e51061b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff041592b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e5107b70 con 0x5589e50e8fa0 2023-12-24T20:01:41.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff041592b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e5107e40 con 0x5589e50e98b0 2023-12-24T20:01:41.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff041592b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589e50e9370 con 0x5589e50e5170 2023-12-24T20:01:41.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03582d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03582d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57408/0 (socket says 172.21.15.61:57408) 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03582d700 1 -- 172.21.15.61:0/1485118010 learned_addr learned my addr 172.21.15.61:0/1485118010 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03682f700 1 --2- 172.21.15.61:0/1485118010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e98b0 0x5589e51061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03602e700 1 --2- 172.21.15.61:0/1485118010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e5170 0x5589e50b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03582d700 1 -- 172.21.15.61:0/1485118010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e5170 msgr2=0x5589e50b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03582d700 1 --2- 172.21.15.61:0/1485118010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e5170 0x5589e50b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03582d700 1 -- 172.21.15.61:0/1485118010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e98b0 msgr2=0x5589e51061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03582d700 1 --2- 172.21.15.61:0/1485118010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e98b0 0x5589e51061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03582d700 1 -- 172.21.15.61:0/1485118010 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589e4fdf290 con 0x5589e50e8fa0 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff03582d700 1 --2- 172.21.15.61:0/1485118010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50b7420 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff02c023000 tx=0x7ff02c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4501d99fe5218d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff013fff700 1 -- 172.21.15.61:0/1485118010 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c030070 con 0x5589e50e8fa0 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.265+0000 7ff013fff700 1 -- 172.21.15.61:0/1485118010 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c021450 con 0x5589e50e8fa0 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.266+0000 7ff013fff700 1 -- 172.21.15.61:0/1485118010 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c014b30 con 0x5589e50e8fa0 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.266+0000 7ff041592b80 1 -- 172.21.15.61:0/1485118010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 msgr2=0x5589e50b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.266+0000 7ff041592b80 1 --2- 172.21.15.61:0/1485118010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50b7420 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff02c023000 tx=0x7ff02c022000 comp rx=0 tx=0).stop 2023-12-24T20:01:41.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.266+0000 7ff041592b80 1 -- 172.21.15.61:0/1485118010 shutdown_connections 2023-12-24T20:01:41.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.266+0000 7ff041592b80 1 --2- 172.21.15.61:0/1485118010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e5170 0x5589e50b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.266+0000 7ff041592b80 1 --2- 172.21.15.61:0/1485118010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e98b0 0x5589e51061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.266+0000 7ff041592b80 1 --2- 172.21.15.61:0/1485118010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50b7420 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.266+0000 7ff041592b80 1 -- 172.21.15.61:0/1485118010 >> 172.21.15.61:0/1485118010 conn(0x5589e50bf440 msgr2=0x5589e50b6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:41.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.266+0000 7ff041592b80 1 -- 172.21.15.61:0/1485118010 shutdown_connections 2023-12-24T20:01:41.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.266+0000 7ff041592b80 1 -- 172.21.15.61:0/1485118010 wait complete. 2023-12-24T20:01:41.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.267+0000 7ff041592b80 1 -- start start 2023-12-24T20:01:41.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.267+0000 7ff041592b80 1 Processor -- start 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff041592b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 0x5589e50ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff041592b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50ee5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff041592b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e98b0 0x5589e50eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff041592b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e50e80d0 con 0x5589e50e8fa0 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff041592b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e5105d60 con 0x5589e50e5170 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff041592b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589e5105fb0 con 0x5589e50e98b0 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff041592b80 10 client.0 _ll_register_callbacks cb 0x5589e50c3620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03582d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50ee5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03582d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50ee5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57412/0 (socket says 172.21.15.61:57412) 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03582d700 1 -- 172.21.15.61:0/331698872 learned_addr learned my addr 172.21.15.61:0/331698872 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03682f700 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e98b0 0x5589e50eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03602e700 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 0x5589e50ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03582d700 1 -- 172.21.15.61:0/331698872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e98b0 msgr2=0x5589e50eeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03582d700 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e98b0 0x5589e50eeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03582d700 1 -- 172.21.15.61:0/331698872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 msgr2=0x5589e50ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03582d700 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 0x5589e50ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03582d700 1 -- 172.21.15.61:0/331698872 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589e4ea4360 con 0x5589e50e8fa0 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff03582d700 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50ee5a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff02c014a00 tx=0x7ff02c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c833dcca68fccfe2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff010ff9700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff010ff9700 1 -- 172.21.15.61:0/331698872 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c021c60 con 0x5589e50e8fa0 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff010ff9700 1 -- 172.21.15.61:0/331698872 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff02c01a030 con 0x5589e50e8fa0 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.268+0000 7ff041592b80 1 -- 172.21.15.61:0/331698872 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589e50bed90 con 0x5589e50e8fa0 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff010ff9700 1 -- 172.21.15.61:0/331698872 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff02c005a00 con 0x5589e50e8fa0 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff041592b80 10 client.6510 fetch_fsmap learned FSMap version 52 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff041592b80 1 -- 172.21.15.61:0/331698872 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x5589e4ea8c80 con 0x5589e50e8fa0 2023-12-24T20:01:41.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff010ff9700 1 -- 172.21.15.61:0/331698872 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5589e50bed90 con 0x5589e50e8fa0 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff010ff9700 1 -- 172.21.15.61:0/331698872 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 52) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff02c03b030 con 0x5589e50e8fa0 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff041592b80 10 client.6510 fetch_fsmap finished waiting for FSMap version 52 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff041592b80 10 client.6510 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff041592b80 20 client.6510 populate_metadata read hostname 'smithi061' 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff041592b80 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.61:6832/2512648595,v1:172.21.15.61:6834/2512648595] conn(0x5589e516c560 0x5589e50e7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff041592b80 4 client.6510 mds_command: new command op to 6318 tid=0[{"prefix": "status"}] 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff041592b80 1 -- 172.21.15.61:0/331698872 --> [v2:172.21.15.61:6832/2512648595,v1:172.21.15.61:6834/2512648595] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5589e50b5490 con 0x5589e516c560 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff03602e700 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.61:6832/2512648595,v1:172.21.15.61:6834/2512648595] conn(0x5589e516c560 0x5589e50e7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff010ff9700 10 client.6510 ms_handle_connect on v2:172.21.15.61:6832/2512648595 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.269+0000 7ff03602e700 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.61:6832/2512648595,v1:172.21.15.61:6834/2512648595] conn(0x5589e516c560 0x5589e50e7550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5a5820cb3670646 server_cookie=c28db54dc0c068f4 in_seq=0 out_seq=0 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff010ff9700 1 -- 172.21.15.61:0/331698872 <== mds.0 v2:172.21.15.61:6832/2512648595 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5589e50b5490 con 0x5589e516c560 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff010ff9700 10 client.6510 handle_command_reply: tid=0 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 client.6510 shutdown 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 -- 172.21.15.61:0/331698872 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 msgr2=0x5589e50ee5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50ee5a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff02c014a00 tx=0x7ff02c030000 comp rx=0 tx=0).stop 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 -- 172.21.15.61:0/331698872 shutdown_connections 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.61:6832/2512648595,v1:172.21.15.61:6834/2512648595] conn(0x5589e516c560 0x5589e50e7550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5589e50e98b0 0x5589e50eeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5589e50e5170 0x5589e50ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff010ff9700 0 client.6510 ms_handle_reset on v2:172.21.15.61:6832/2512648595 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 --2- 172.21.15.61:0/331698872 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5589e50e8fa0 0x5589e50ee5a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 -- 172.21.15.61:0/331698872 >> 172.21.15.61:0/331698872 conn(0x5589e50bf440 msgr2=0x5589e50b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 -- 172.21.15.61:0/331698872 shutdown_connections 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 1 -- 172.21.15.61:0/331698872 wait complete. 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff041592b80 20 client.6510 trim_cache size 0 max 16384 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:01:41.276 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 6318, 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 10.577818024000001, 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 52, 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 99, 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 99, 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 16.498741956 2023-12-24T20:01:41.277 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:01:41.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff038292700 1 -- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff014066f30 msgr2=0x7ff0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff038292700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff014066f30 0x7ff0140693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff0300b2ca0 tx=0x7ff02c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff038292700 1 -- 172.21.15.61:0/4117436763 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070db0 msgr2=0x7ff0301697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff038292700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070db0 0x7ff0301697b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff02000ec80 tx=0x7ff0200091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff038292700 1 -- 172.21.15.61:0/4117436763 shutdown_connections 2023-12-24T20:01:41.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff038292700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff014066f30 0x7ff0140693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff038292700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff030159c40 0x7ff0300ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff038292700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070db0 0x7ff0301697b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.270+0000 7ff038292700 1 --2- 172.21.15.61:0/4117436763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0300c4010 0x7ff03014c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.271+0000 7ff038292700 1 -- 172.21.15.61:0/4117436763 >> 172.21.15.61:0/4117436763 conn(0x7ff0300ce190 msgr2=0x7ff0300c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:41.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.271+0000 7ff038292700 1 -- 172.21.15.61:0/4117436763 shutdown_connections 2023-12-24T20:01:41.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.271+0000 7ff038292700 1 -- 172.21.15.61:0/4117436763 wait complete. 2023-12-24T20:01:41.283 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:01:41.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.404+0000 7f7b710d1700 1 Processor -- start 2023-12-24T20:01:41.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.404+0000 7f7b710d1700 1 -- start start 2023-12-24T20:01:41.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b710d1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b6c068140 0x7f7b6c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b710d1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7b6c159a60 0x7f7b6c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b710d1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c0b2890 con 0x7f7b6c068510 2023-12-24T20:01:41.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b710d1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c0cf630 con 0x7f7b6c159a60 2023-12-24T20:01:41.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b710d1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c0b2240 con 0x7f7b6c068140 2023-12-24T20:01:41.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b6b59e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7b6c159a60 0x7f7b6c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b6b59e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7b6c159a60 0x7f7b6c159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57416/0 (socket says 172.21.15.61:57416) 2023-12-24T20:01:41.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b6b59e700 1 -- 172.21.15.61:0/3687606356 learned_addr learned my addr 172.21.15.61:0/3687606356 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:41.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b6b59e700 1 -- 172.21.15.61:0/3687606356 >> v2:172.21.15.133:3300/0 conn(0x7f7b6c068140 msgr2=0x7f7b6c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b6ad9d700 1 --2- 172.21.15.61:0/3687606356 >> v2:172.21.15.133:3300/0 conn(0x7f7b6c068140 0x7f7b6c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b6b59e700 1 --2- 172.21.15.61:0/3687606356 >> v2:172.21.15.133:3300/0 conn(0x7f7b6c068140 0x7f7b6c0cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b6b59e700 1 -- 172.21.15.61:0/3687606356 >> v1:172.21.15.133:6789/0 conn(0x7f7b6c068510 legacy=0x7f7b6c0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.405+0000 7f7b6b59e700 1 -- 172.21.15.61:0/3687606356 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c0b2520 con 0x7f7b6c159a60 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b6b59e700 1 --2- 172.21.15.61:0/3687606356 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c159a60 0x7f7b6c159ee0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c06e290 tx=0x7f7b64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1932b1fb39bb80b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b69d9b700 1 -- 172.21.15.61:0/3687606356 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400e070 con 0x7f7b6c159a60 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b69d9b700 1 -- 172.21.15.61:0/3687606356 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6400ba10 con 0x7f7b6c159a60 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b69d9b700 1 -- 172.21.15.61:0/3687606356 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b640092e0 con 0x7f7b6c159a60 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b710d1700 1 -- 172.21.15.61:0/3687606356 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c159a60 msgr2=0x7f7b6c159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b710d1700 1 --2- 172.21.15.61:0/3687606356 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c159a60 0x7f7b6c159ee0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c06e290 tx=0x7f7b64009840 comp rx=0 tx=0).stop 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b710d1700 1 -- 172.21.15.61:0/3687606356 shutdown_connections 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b710d1700 1 --2- 172.21.15.61:0/3687606356 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c159a60 0x7f7b6c159ee0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b710d1700 1 --2- 172.21.15.61:0/3687606356 >> v2:172.21.15.133:3300/0 conn(0x7f7b6c068140 0x7f7b6c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b710d1700 1 -- 172.21.15.61:0/3687606356 >> 172.21.15.61:0/3687606356 conn(0x7f7b6c097a10 msgr2=0x7f7b6c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:41.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b710d1700 1 -- 172.21.15.61:0/3687606356 shutdown_connections 2023-12-24T20:01:41.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.406+0000 7f7b710d1700 1 -- 172.21.15.61:0/3687606356 wait complete. 2023-12-24T20:01:41.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.408+0000 7f7b710d1700 1 Processor -- start 2023-12-24T20:01:41.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.408+0000 7f7b710d1700 1 -- start start 2023-12-24T20:01:41.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.408+0000 7f7b710d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b6c068140 0x7f7b6c0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.408+0000 7f7b710d1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c068510 0x7f7b6c15d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.408+0000 7f7b710d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c159a60 0x7f7b6c15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.408+0000 7f7b710d1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0c3630 con 0x7f7b6c068510 2023-12-24T20:01:41.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.408+0000 7f7b710d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c15b760 con 0x7f7b6c159a60 2023-12-24T20:01:41.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.408+0000 7f7b710d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c09bcb0 con 0x7f7b6c068140 2023-12-24T20:01:41.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.408+0000 7f7b6a59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c068510 0x7f7b6c15d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b6a59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c068510 0x7f7b6c15d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57428/0 (socket says 172.21.15.61:57428) 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b6a59c700 1 -- 172.21.15.61:0/997710482 learned_addr learned my addr 172.21.15.61:0/997710482 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b6b59e700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c159a60 0x7f7b6c15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b6a59c700 1 -- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b6c068140 msgr2=0x7f7b6c0cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b6ad9d700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b6c068140 0x7f7b6c0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b6a59c700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b6c068140 0x7f7b6c0cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b6a59c700 1 -- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c159a60 msgr2=0x7f7b6c15dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b6a59c700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c159a60 0x7f7b6c15dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b6a59c700 1 -- 172.21.15.61:0/997710482 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64009ae0 con 0x7f7b6c068510 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b6a59c700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c068510 0x7f7b6c15d7e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c5d0 tx=0x7f7b5c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b52ffd700 1 -- 172.21.15.61:0/997710482 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c011590 con 0x7f7b6c068510 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b52ffd700 1 -- 172.21.15.61:0/997710482 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c011710 con 0x7f7b6c068510 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b710d1700 1 -- 172.21.15.61:0/997710482 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c15ae30 con 0x7f7b6c068510 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b52ffd700 1 -- 172.21.15.61:0/997710482 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c011ad0 con 0x7f7b6c068510 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.409+0000 7f7b710d1700 1 -- 172.21.15.61:0/997710482 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c15b3f0 con 0x7f7b6c068510 2023-12-24T20:01:41.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.410+0000 7f7b710d1700 1 -- 172.21.15.61:0/997710482 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c15b910 con 0x7f7b6c068510 2023-12-24T20:01:41.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.411+0000 7f7b52ffd700 1 -- 172.21.15.61:0/997710482 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7b5c01c460 con 0x7f7b6c068510 2023-12-24T20:01:41.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.411+0000 7f7b52ffd700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b58066f30 0x7f7b580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:41.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.411+0000 7f7b52ffd700 1 -- 172.21.15.61:0/997710482 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b5c0842f0 con 0x7f7b6c068510 2023-12-24T20:01:41.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.411+0000 7f7b6ad9d700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b58066f30 0x7f7b580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:41.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.412+0000 7f7b6ad9d700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b58066f30 0x7f7b580693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7b60006fd0 tx=0x7f7b60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:41.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.415+0000 7f7b52ffd700 1 -- 172.21.15.61:0/997710482 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b6c15b910 con 0x7f7b6c068510 2023-12-24T20:01:41.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.659+0000 7f7b710d1700 1 -- 172.21.15.61:0/997710482 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7b6c06d440 con 0x7f7b6c068510 2023-12-24T20:01:41.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.659+0000 7f7b52ffd700 1 -- 172.21.15.61:0/997710482 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7b5c051560 con 0x7f7b6c068510 2023-12-24T20:01:41.660 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:01:41.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 -- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b58066f30 msgr2=0x7f7b580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b58066f30 0x7f7b580693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7b60006fd0 tx=0x7f7b60008040 comp rx=0 tx=0).stop 2023-12-24T20:01:41.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 -- 172.21.15.61:0/997710482 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c068510 msgr2=0x7f7b6c15d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:41.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c068510 0x7f7b6c15d7e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c5d0 tx=0x7f7b5c007f60 comp rx=0 tx=0).stop 2023-12-24T20:01:41.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 -- 172.21.15.61:0/997710482 shutdown_connections 2023-12-24T20:01:41.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7b6c068140 0x7f7b6c0cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7b58066f30 0x7f7b580693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c159a60 0x7f7b6c15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 --2- 172.21.15.61:0/997710482 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7b6c068510 0x7f7b6c15d7e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:41.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 -- 172.21.15.61:0/997710482 >> 172.21.15.61:0/997710482 conn(0x7f7b6c097a10 msgr2=0x7f7b6c0ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:41.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 -- 172.21.15.61:0/997710482 shutdown_connections 2023-12-24T20:01:41.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:41.661+0000 7f7b710d1700 1 -- 172.21.15.61:0/997710482 wait complete. 2023-12-24T20:01:41.674 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:01:41.674 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:01:41.674 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T20:01:41.674 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T20:01:41.674 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T20:01:41.675 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:01:41.675 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:01:41.675 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:01:41.675 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:01:41.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:41.675 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T20:01:41.693 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:01:41.693 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:01:41.693 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:01:41.693 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:41.693 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T20:01:41.693 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42264sec preferred_lft 42264sec 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:41.694 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 12:83:d1:9f:62:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1083:d1ff:fe9f:62aa/64 scope link 2023-12-24T20:01:41.695 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:41.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:41.696 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:01:41.760 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T20:01:41.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:41.761 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T20:01:41.820 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T20:01:41.821 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:01:41.821 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:01:41.821 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:01:41.821 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:01:41.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:41.821 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T20:01:41.821 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T20:01:41.821 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:01:41.821 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:01:41.821 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:01:41.822 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T20:01:41.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:41.929 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T20:01:41.946 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:01:41.946 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:01:41.946 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:01:41.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:41.947 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T20:01:42.014 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T20:01:42.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:01:42.014 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T20:01:42.071 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:01:42.071 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:01:42.072 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:01:42.128 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:01:42.196 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:01:42.196 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:01:42.264 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:01:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:01:42.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:42.265 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:01:42.322 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:01:42.322 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T20:01:42.365 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:01:42.392 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:01:42.392 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:01:42.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T20:01:42.451+0000 7f7e5e1fa540 -1 init, newargv = 0x555d15eaa1e0 newargc=15 2023-12-24T20:01:42.451 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[60640]: starting ceph client 2023-12-24T20:01:42.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[60640]: starting fuse 2023-12-24T20:01:42.461 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:01:42.463 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:01:42.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:42.463 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:01:42.520 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T20:01:42.520 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T20:01:42.520 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:01:42.521 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:01:42.522 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:01:42.645 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.60640.asok 2023-12-24T20:01:42.827 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.60640.asok 2023-12-24T20:01:42.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:42.828 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.60640.asok status 2023-12-24T20:01:42.984 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:01:42.984 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "60640", 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 6522, 2023-12-24T20:01:42.985 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 6522 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 4098918198 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:01:42.986 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 4098918198 2023-12-24T20:01:42.987 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:42.987 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.6522 192.168.0.1:0/4098918198", 2023-12-24T20:01:42.987 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/4098918198", 2023-12-24T20:01:42.987 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T20:01:42.987 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 52, 2023-12-24T20:01:42.987 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 99, 2023-12-24T20:01:42.987 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:01:42.987 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:01:42.987 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:01:42.987 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:01:42.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:42.995 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T20:01:42.995 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T20:01:43.013 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T20:01:43.013 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T20:01:43.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:43.013 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:01:43.081 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:01:43.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.243+0000 7f40caf9e700 1 Processor -- start 2023-12-24T20:01:43.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.243+0000 7f40caf9e700 1 -- start start 2023-12-24T20:01:43.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.244+0000 7f40caf9e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40c40b0d50 0x7f40c40ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:43.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.244+0000 7f40caf9e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f40c40b3460 0x7f40c40c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:43.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.244+0000 7f40caf9e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c40c99e0 con 0x7f40c40b0980 2023-12-24T20:01:43.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.244+0000 7f40caf9e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c415a520 con 0x7f40c40b3460 2023-12-24T20:01:43.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.244+0000 7f40caf9e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c40cd0f0 con 0x7f40c40b0d50 2023-12-24T20:01:43.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.244+0000 7f40ca79d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f40c40b3460 0x7f40c40c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.244+0000 7f40ca79d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f40c40b3460 0x7f40c40c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57438/0 (socket says 172.21.15.61:57438) 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.244+0000 7f40ca79d700 1 -- 172.21.15.61:0/2691425416 learned_addr learned my addr 172.21.15.61:0/2691425416 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.244+0000 7f40c979b700 1 --2- 172.21.15.61:0/2691425416 >> v2:172.21.15.133:3300/0 conn(0x7f40c40b0d50 0x7f40c40ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40ca79d700 1 -- 172.21.15.61:0/2691425416 >> v2:172.21.15.133:3300/0 conn(0x7f40c40b0d50 msgr2=0x7f40c40ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40ca79d700 1 --2- 172.21.15.61:0/2691425416 >> v2:172.21.15.133:3300/0 conn(0x7f40c40b0d50 0x7f40c40ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40ca79d700 1 -- 172.21.15.61:0/2691425416 >> v1:172.21.15.133:6789/0 conn(0x7f40c40b0980 legacy=0x7f40c40b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40ca79d700 1 -- 172.21.15.61:0/2691425416 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c40c96b0 con 0x7f40c40b3460 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40ca79d700 1 --2- 172.21.15.61:0/2691425416 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b3460 0x7f40c40c9e70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f40c406d4a0 tx=0x7f40bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cd52ef32cd5175 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40c8f9a700 1 -- 172.21.15.61:0/2691425416 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc00e070 con 0x7f40c40b3460 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40c8f9a700 1 -- 172.21.15.61:0/2691425416 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc00ba40 con 0x7f40c40b3460 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40c8f9a700 1 -- 172.21.15.61:0/2691425416 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc0092e0 con 0x7f40c40b3460 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40caf9e700 1 -- 172.21.15.61:0/2691425416 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b3460 msgr2=0x7f40c40c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40caf9e700 1 --2- 172.21.15.61:0/2691425416 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b3460 0x7f40c40c9e70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f40c406d4a0 tx=0x7f40bc009840 comp rx=0 tx=0).stop 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.245+0000 7f40caf9e700 1 -- 172.21.15.61:0/2691425416 shutdown_connections 2023-12-24T20:01:43.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.246+0000 7f40caf9e700 1 --2- 172.21.15.61:0/2691425416 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b3460 0x7f40c40c9e70 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:43.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.246+0000 7f40caf9e700 1 --2- 172.21.15.61:0/2691425416 >> v2:172.21.15.133:3300/0 conn(0x7f40c40b0d50 0x7f40c40ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:43.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.246+0000 7f40caf9e700 1 -- 172.21.15.61:0/2691425416 >> 172.21.15.61:0/2691425416 conn(0x7f40c40b14f0 msgr2=0x7f40c40b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:43.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.246+0000 7f40caf9e700 1 -- 172.21.15.61:0/2691425416 shutdown_connections 2023-12-24T20:01:43.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.246+0000 7f40caf9e700 1 -- 172.21.15.61:0/2691425416 wait complete. 2023-12-24T20:01:43.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.247+0000 7f40caf9e700 1 Processor -- start 2023-12-24T20:01:43.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.247+0000 7f40caf9e700 1 -- start start 2023-12-24T20:01:43.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.247+0000 7f40caf9e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b0980 0x7f40c40c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:43.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40caf9e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c40b0d50 0x7f40c415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:43.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40caf9e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40b3460 0x7f40c4153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:43.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40caf9e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c415e5f0 con 0x7f40c40b0980 2023-12-24T20:01:43.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40caf9e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c415dc20 con 0x7f40c40b3460 2023-12-24T20:01:43.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40caf9e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4153970 con 0x7f40c40b0d50 2023-12-24T20:01:43.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40c9f9c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b0980 0x7f40c40c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40c9f9c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b0980 0x7f40c40c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57454/0 (socket says 172.21.15.61:57454) 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40c9f9c700 1 -- 172.21.15.61:0/615257301 learned_addr learned my addr 172.21.15.61:0/615257301 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40c979b700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c40b0d50 0x7f40c415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40ca79d700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40b3460 0x7f40c4153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40c9f9c700 1 -- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c40b0d50 msgr2=0x7f40c415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40c9f9c700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c40b0d50 0x7f40c415e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40c9f9c700 1 -- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40b3460 msgr2=0x7f40c4153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40c9f9c700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40b3460 0x7f40c4153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40c9f9c700 1 -- 172.21.15.61:0/615257301 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc009ae0 con 0x7f40c40b0980 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40c9f9c700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b0980 0x7f40c40c8740 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f40b400c540 tx=0x7f40b4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40b9ffb700 1 -- 172.21.15.61:0/615257301 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4011590 con 0x7f40c40b0980 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40b9ffb700 1 -- 172.21.15.61:0/615257301 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b40116f0 con 0x7f40c40b0980 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40caf9e700 1 -- 172.21.15.61:0/615257301 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c415d010 con 0x7f40c40b0980 2023-12-24T20:01:43.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.248+0000 7f40b9ffb700 1 -- 172.21.15.61:0/615257301 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4011ab0 con 0x7f40c40b0980 2023-12-24T20:01:43.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.249+0000 7f40caf9e700 1 -- 172.21.15.61:0/615257301 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c415d5d0 con 0x7f40c40b0980 2023-12-24T20:01:43.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.249+0000 7f40caf9e700 1 -- 172.21.15.61:0/615257301 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c415df00 con 0x7f40c40b0980 2023-12-24T20:01:43.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.250+0000 7f40b9ffb700 1 -- 172.21.15.61:0/615257301 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f40b401b3b0 con 0x7f40c40b0980 2023-12-24T20:01:43.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.250+0000 7f40b9ffb700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40a8066f60 0x7f40a8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:43.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.250+0000 7f40b9ffb700 1 -- 172.21.15.61:0/615257301 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40b40839a0 con 0x7f40c40b0980 2023-12-24T20:01:43.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.251+0000 7f40c979b700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40a8066f60 0x7f40a8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:43.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.251+0000 7f40c979b700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40a8066f60 0x7f40a8069410 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f40c40cdb10 tx=0x7f40c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:43.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.255+0000 7f40b9ffb700 1 -- 172.21.15.61:0/615257301 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40b4050c20 con 0x7f40c40b0980 2023-12-24T20:01:43.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.494+0000 7f40caf9e700 1 -- 172.21.15.61:0/615257301 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40c406d1f0 con 0x7f40c40b0980 2023-12-24T20:01:43.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.494+0000 7f40b9ffb700 1 -- 172.21.15.61:0/615257301 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7f40b4017020 con 0x7f40c40b0980 2023-12-24T20:01:43.494 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:01:43.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 -- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40a8066f60 msgr2=0x7f40a8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:43.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40a8066f60 0x7f40a8069410 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f40c40cdb10 tx=0x7f40c0008040 comp rx=0 tx=0).stop 2023-12-24T20:01:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 -- 172.21.15.61:0/615257301 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b0980 msgr2=0x7f40c40c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b0980 0x7f40c40c8740 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f40b400c540 tx=0x7f40b4001070 comp rx=0 tx=0).stop 2023-12-24T20:01:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 -- 172.21.15.61:0/615257301 shutdown_connections 2023-12-24T20:01:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40a8066f60 0x7f40a8069410 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40b3460 0x7f40c4153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40c40b0980 0x7f40c40c8740 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 --2- 172.21.15.61:0/615257301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f40c40b0d50 0x7f40c415e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 -- 172.21.15.61:0/615257301 >> 172.21.15.61:0/615257301 conn(0x7f40c40b14f0 msgr2=0x7f40c4157860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 -- 172.21.15.61:0/615257301 shutdown_connections 2023-12-24T20:01:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:43.496+0000 7f40caf9e700 1 -- 172.21.15.61:0/615257301 wait complete. 2023-12-24T20:01:43.508 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:01:43.508 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:01:43.509 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T20:01:43.509 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T20:01:43.509 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T20:01:43.509 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:01:43.509 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:01:43.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:01:43.509 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:01:43.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:43.509 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T20:01:43.531 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:01:43.531 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:01:43.532 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42269sec preferred_lft 42269sec 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link 2023-12-24T20:01:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:43.534 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:01:43.534 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T20:01:43.534 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::accb:c5ff:feae:915/64 scope link 2023-12-24T20:01:43.534 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:01:43.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:43.534 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:01:43.601 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T20:01:43.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:43.603 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T20:01:43.665 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T20:01:43.665 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:01:43.665 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:01:43.665 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:01:43.665 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:01:43.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:43.666 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T20:01:43.666 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T20:01:43.666 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:01:43.666 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:01:43.666 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:01:43.666 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T20:01:43.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:43.775 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T20:01:43.792 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T20:01:43.792 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T20:01:43.793 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:01:43.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:01:43.793 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T20:01:43.860 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T20:01:43.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:01:43.860 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T20:01:43.917 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:01:43.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:01:43.918 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:01:43.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:01:44.042 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:01:44.042 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:01:44.108 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:01:44.110 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:01:44.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:44.110 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:01:44.167 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:01:44.167 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T20:01:44.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:01:44.236 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:01:44.236 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:01:44.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T20:01:44.293+0000 7f6c0a64c540 -1 init, newargv = 0x564d7ba32770 newargc=15 2023-12-24T20:01:44.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[45772]: starting ceph client 2023-12-24T20:01:44.297 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[45772]: starting fuse 2023-12-24T20:01:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:01:44.305 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:01:44.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:44.305 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:01:44.363 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T20:01:44.364 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T20:01:44.364 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:01:44.364 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T20:01:44.364 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T20:01:44.364 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T20:01:44.364 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T20:01:44.364 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:01:44.364 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T20:01:44.364 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T20:01:44.364 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T20:01:44.364 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:01:44.365 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T20:01:44.366 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T20:01:44.486 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.45772.asok 2023-12-24T20:01:44.668 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45772.asok 2023-12-24T20:01:44.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:44.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45772.asok status 2023-12-24T20:01:44.822 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T20:01:44.822 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T20:01:44.822 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:01:44.822 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:01:44.822 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T20:01:44.822 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T20:01:44.822 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T20:01:44.822 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "45772", 2023-12-24T20:01:44.822 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T20:01:44.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5992, 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 5992 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 523960976 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:01:44.823 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 523960976 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.5992 192.168.0.1:0/523960976", 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/523960976", 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 52, 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 99, 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T20:01:44.824 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T20:01:44.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:44.832 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T20:01:44.832 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T20:01:44.849 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T20:01:44.849 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T20:01:44.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:44.849 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:01:44.917 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:01:45.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.053+0000 7fd528bae700 1 Processor -- start 2023-12-24T20:01:45.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.053+0000 7fd528bae700 1 -- start start 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd528bae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd52415bb60 0x7fd524098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd528bae700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd5240b2660 0x7fd5240b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd528bae700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5240b2eb0 con 0x7fd524098aa0 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd528bae700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5240afc20 con 0x7fd5240b2660 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd528bae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5240b2bd0 con 0x7fd52415bb60 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd522d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd5240b2660 0x7fd5240b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd522d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd5240b2660 0x7fd5240b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57458/0 (socket says 172.21.15.61:57458) 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd522d9d700 1 -- 172.21.15.61:0/2980050960 learned_addr learned my addr 172.21.15.61:0/2980050960 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd522d9d700 1 -- 172.21.15.61:0/2980050960 >> v2:172.21.15.133:3300/0 conn(0x7fd52415bb60 msgr2=0x7fd524098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd52259c700 1 --2- 172.21.15.61:0/2980050960 >> v2:172.21.15.133:3300/0 conn(0x7fd52415bb60 0x7fd524098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:45.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd522d9d700 1 --2- 172.21.15.61:0/2980050960 >> v2:172.21.15.133:3300/0 conn(0x7fd52415bb60 0x7fd524098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:45.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd522d9d700 1 -- 172.21.15.61:0/2980050960 >> v1:172.21.15.133:6789/0 conn(0x7fd524098aa0 legacy=0x7fd52415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:45.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd522d9d700 1 -- 172.21.15.61:0/2980050960 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240afe10 con 0x7fd5240b2660 2023-12-24T20:01:45.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.054+0000 7fd522d9d700 1 --2- 172.21.15.61:0/2980050960 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5240b2660 0x7fd5240b08f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd52406d9b0 tx=0x7fd51c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a3edc1060f4138 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:45.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd52159a700 1 -- 172.21.15.61:0/2980050960 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00e070 con 0x7fd5240b2660 2023-12-24T20:01:45.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd52159a700 1 -- 172.21.15.61:0/2980050960 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c00ba10 con 0x7fd5240b2660 2023-12-24T20:01:45.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd52159a700 1 -- 172.21.15.61:0/2980050960 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0092e0 con 0x7fd5240b2660 2023-12-24T20:01:45.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd528bae700 1 -- 172.21.15.61:0/2980050960 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5240b2660 msgr2=0x7fd5240b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:45.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd528bae700 1 --2- 172.21.15.61:0/2980050960 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5240b2660 0x7fd5240b08f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd52406d9b0 tx=0x7fd51c009840 comp rx=0 tx=0).stop 2023-12-24T20:01:45.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd528bae700 1 -- 172.21.15.61:0/2980050960 shutdown_connections 2023-12-24T20:01:45.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd528bae700 1 --2- 172.21.15.61:0/2980050960 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd5240b2660 0x7fd5240b08f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:45.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd528bae700 1 --2- 172.21.15.61:0/2980050960 >> v2:172.21.15.133:3300/0 conn(0x7fd52415bb60 0x7fd524098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:45.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd528bae700 1 -- 172.21.15.61:0/2980050960 >> 172.21.15.61:0/2980050960 conn(0x7fd524097a10 msgr2=0x7fd5240ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:45.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd528bae700 1 -- 172.21.15.61:0/2980050960 shutdown_connections 2023-12-24T20:01:45.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.055+0000 7fd528bae700 1 -- 172.21.15.61:0/2980050960 wait complete. 2023-12-24T20:01:45.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.056+0000 7fd528bae700 1 Processor -- start 2023-12-24T20:01:45.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.056+0000 7fd528bae700 1 -- start start 2023-12-24T20:01:45.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd528bae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd524098aa0 0x7fd524168ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:45.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd528bae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5240b2660 0x7fd524154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:45.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd528bae700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd52415bb60 0x7fd52409b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:45.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd528bae700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52416ba50 con 0x7fd52415bb60 2023-12-24T20:01:45.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd528bae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52416c5d0 con 0x7fd5240b2660 2023-12-24T20:01:45.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd528bae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52416bca0 con 0x7fd524098aa0 2023-12-24T20:01:45.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd522d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd52415bb60 0x7fd52409b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:45.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd522d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd52415bb60 0x7fd52409b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57464/0 (socket says 172.21.15.61:57464) 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd522d9d700 1 -- 172.21.15.61:0/1644965584 learned_addr learned my addr 172.21.15.61:0/1644965584 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd521d9b700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5240b2660 0x7fd524154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.057+0000 7fd52259c700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd524098aa0 0x7fd524168ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd522d9d700 1 -- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd524098aa0 msgr2=0x7fd524168ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd522d9d700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd524098aa0 0x7fd524168ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd522d9d700 1 -- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5240b2660 msgr2=0x7fd524154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd522d9d700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5240b2660 0x7fd524154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd522d9d700 1 -- 172.21.15.61:0/1644965584 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c009ae0 con 0x7fd52415bb60 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd52259c700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd524098aa0 0x7fd524168ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd522d9d700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd52415bb60 0x7fd52409b1c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd52406d8b0 tx=0x7fd51c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd5127fc700 1 -- 172.21.15.61:0/1644965584 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0094e0 con 0x7fd52415bb60 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd5127fc700 1 -- 172.21.15.61:0/1644965584 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0032f0 con 0x7fd52415bb60 2023-12-24T20:01:45.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd5127fc700 1 -- 172.21.15.61:0/1644965584 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c01d630 con 0x7fd52415bb60 2023-12-24T20:01:45.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd528bae700 1 -- 172.21.15.61:0/1644965584 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52416bf80 con 0x7fd52415bb60 2023-12-24T20:01:45.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.058+0000 7fd528bae700 1 -- 172.21.15.61:0/1644965584 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd524155e40 con 0x7fd52415bb60 2023-12-24T20:01:45.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.059+0000 7fd528bae700 1 -- 172.21.15.61:0/1644965584 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52416c8b0 con 0x7fd52415bb60 2023-12-24T20:01:45.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.059+0000 7fd5127fc700 1 -- 172.21.15.61:0/1644965584 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd51c01da60 con 0x7fd52415bb60 2023-12-24T20:01:45.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.060+0000 7fd5127fc700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd504066f30 0x7fd5040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:45.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.060+0000 7fd5127fc700 1 -- 172.21.15.61:0/1644965584 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd51c085d90 con 0x7fd52415bb60 2023-12-24T20:01:45.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.060+0000 7fd52259c700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd504066f30 0x7fd5040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:45.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.060+0000 7fd52259c700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd504066f30 0x7fd5040693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd5140089d0 tx=0x7fd514008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:45.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.064+0000 7fd5127fc700 1 -- 172.21.15.61:0/1644965584 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd51c053000 con 0x7fd52415bb60 2023-12-24T20:01:45.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.302+0000 7fd528bae700 1 -- 172.21.15.61:0/1644965584 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd52406d440 con 0x7fd52415bb60 2023-12-24T20:01:45.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.302+0000 7fd5127fc700 1 -- 172.21.15.61:0/1644965584 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fd51c012e60 con 0x7fd52415bb60 2023-12-24T20:01:45.303 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:45.303 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2634636374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2634636374},{"type":"v1","addr":"172.21.15.61:6835","nonce":2634636374}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/856986572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":856986572},{"type":"v1","addr":"172.21.15.133:6836","nonce":856986572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1475170652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1475170652},{"type":"v1","addr":"172.21.15.133:6837","nonce":1475170652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:01:30.072202+0000","modified":"2023-12-24T20:01:33.718490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2512648595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2512648595},{"type":"v1","addr":"172.21.15.61:6834","nonce":2512648595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T20:01:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 -- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd504066f30 msgr2=0x7fd5040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd504066f30 0x7fd5040693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd5140089d0 tx=0x7fd514008040 comp rx=0 tx=0).stop 2023-12-24T20:01:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 -- 172.21.15.61:0/1644965584 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd52415bb60 msgr2=0x7fd52409b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd52415bb60 0x7fd52409b1c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd52406d8b0 tx=0x7fd51c017000 comp rx=0 tx=0).stop 2023-12-24T20:01:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 -- 172.21.15.61:0/1644965584 shutdown_connections 2023-12-24T20:01:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd524098aa0 0x7fd524168ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd504066f30 0x7fd5040693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd52415bb60 0x7fd52409b1c0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 --2- 172.21.15.61:0/1644965584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5240b2660 0x7fd524154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 -- 172.21.15.61:0/1644965584 >> 172.21.15.61:0/1644965584 conn(0x7fd524097a10 msgr2=0x7fd52406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 -- 172.21.15.61:0/1644965584 shutdown_connections 2023-12-24T20:01:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:45.304+0000 7fd528bae700 1 -- 172.21.15.61:0/1644965584 wait complete. 2023-12-24T20:01:45.308 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 52 2023-12-24T20:01:45.317 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-24T20:01:45.458 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":6318,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.755716276999999,"mdsmap_epoch":52,"osdmap_epoch":99,"osdmap_epoch_barrier":99,"uptime":20.676642256000001} 2023-12-24T20:01:45.459 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 6318, "mdsmap_epoch": 52, "osdmap_epoch": 99, "osdmap_epoch_barrier": 99, "rank_uptime": 14.755716277, "state": "up:active", "uptime": 20.676642256, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:01:45.459 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-24T20:01:45.595 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_mon_report_interval":"5"} 2023-12-24T20:01:45.596 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-24T20:01:45.596 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-12-24T20:01:45.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:45.596 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-12-24T20:01:47.154 INFO:teuthology.orchestra.run.smithi061.stderr:265+0 records in 2023-12-24T20:01:47.154 INFO:teuthology.orchestra.run.smithi061.stderr:265+0 records out 2023-12-24T20:01:47.155 INFO:teuthology.orchestra.run.smithi061.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.53701 s, 181 MB/s 2023-12-24T20:01:47.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:47.155 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-12-24T20:01:48.810 INFO:teuthology.orchestra.run.smithi061.stderr:292+0 records in 2023-12-24T20:01:48.811 INFO:teuthology.orchestra.run.smithi061.stderr:292+0 records out 2023-12-24T20:01:48.811 INFO:teuthology.orchestra.run.smithi061.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.63369 s, 187 MB/s 2023-12-24T20:01:48.811 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-24T20:01:48.811 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:01:48.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.931+0000 7fc37fa5c700 1 Processor -- start 2023-12-24T20:01:48.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.931+0000 7fc37fa5c700 1 -- start start 2023-12-24T20:01:48.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.932+0000 7fc37fa5c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3780cbac0 0x7fc3780cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:48.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.932+0000 7fc37fa5c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3780cd9b0 0x7fc3780cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.932+0000 7fc37fa5c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3780cc2a0 con 0x7fc3781599e0 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.932+0000 7fc37fa5c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3780cedc0 con 0x7fc3780cbac0 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.932+0000 7fc37fa5c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc378067f60 con 0x7fc3780cd9b0 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.932+0000 7fc37d7f8700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fc3781599e0 0x7fc37815ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46446/0 (socket says 172.21.15.61:46446) 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.932+0000 7fc37d7f8700 1 -- 172.21.15.61:0/2797259634 learned_addr learned my addr 172.21.15.61:0/2797259634 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc37cff7700 1 --2- 172.21.15.61:0/2797259634 >> v2:172.21.15.133:3300/0 conn(0x7fc3780cbac0 0x7fc3780cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc37dff9700 1 --2- 172.21.15.61:0/2797259634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3780cd9b0 0x7fc3780cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc36ffff700 1 -- 172.21.15.61:0/2797259634 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672252423 0 0) 0x7fc3780cc2a0 con 0x7fc3781599e0 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc36ffff700 1 -- 172.21.15.61:0/2797259634 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc364003570 con 0x7fc3781599e0 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc37cff7700 1 -- 172.21.15.61:0/2797259634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3780cd9b0 msgr2=0x7fc3780cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc36ffff700 1 -- 172.21.15.61:0/2797259634 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 886449465 0 0) 0x7fc364003570 con 0x7fc3781599e0 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc37cff7700 1 --2- 172.21.15.61:0/2797259634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3780cd9b0 0x7fc3780cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc37cff7700 1 -- 172.21.15.61:0/2797259634 >> v1:172.21.15.61:6789/0 conn(0x7fc3781599e0 legacy=0x7fc37815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:48.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc37cff7700 1 -- 172.21.15.61:0/2797259634 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3780cddf0 con 0x7fc3780cbac0 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc37cff7700 1 --2- 172.21.15.61:0/2797259634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3780cbac0 0x7fc3780cd470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc3740098e0 tx=0x7fc3740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a032e7c25b581d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc36ffff700 1 -- 172.21.15.61:0/2797259634 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368001470 con 0x7fc3780cbac0 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc36ffff700 1 -- 172.21.15.61:0/2797259634 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc374011420 con 0x7fc3780cbac0 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.933+0000 7fc36ffff700 1 -- 172.21.15.61:0/2797259634 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3740117c0 con 0x7fc3780cbac0 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.934+0000 7fc37fa5c700 1 -- 172.21.15.61:0/2797259634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3780cbac0 msgr2=0x7fc3780cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.934+0000 7fc37fa5c700 1 --2- 172.21.15.61:0/2797259634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3780cbac0 0x7fc3780cd470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc3740098e0 tx=0x7fc3740091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.934+0000 7fc37fa5c700 1 -- 172.21.15.61:0/2797259634 shutdown_connections 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.934+0000 7fc37fa5c700 1 --2- 172.21.15.61:0/2797259634 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3780cd9b0 0x7fc3780cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.934+0000 7fc37fa5c700 1 --2- 172.21.15.61:0/2797259634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3780cbac0 0x7fc3780cd470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.934+0000 7fc37fa5c700 1 -- 172.21.15.61:0/2797259634 >> 172.21.15.61:0/2797259634 conn(0x7fc37806e640 msgr2=0x7fc378067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.934+0000 7fc37fa5c700 1 -- 172.21.15.61:0/2797259634 shutdown_connections 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.934+0000 7fc37fa5c700 1 -- 172.21.15.61:0/2797259634 wait complete. 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.935+0000 7fc37fa5c700 1 Processor -- start 2023-12-24T20:01:48.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.935+0000 7fc37fa5c700 1 -- start start 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37fa5c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3780cbac0 0x7fc378150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37fa5c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3780cd9b0 0x7fc3780b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37fa5c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3781599e0 0x7fc3780b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37fa5c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc378150570 con 0x7fc3780cd9b0 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37fa5c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37814f960 con 0x7fc3780cbac0 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37fa5c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37814fc40 con 0x7fc3781599e0 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37cff7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3780cd9b0 0x7fc3780b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37cff7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3780cd9b0 0x7fc3780b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:38376/0 (socket says 172.21.15.61:38376) 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37cff7700 1 -- 172.21.15.61:0/3602727857 learned_addr learned my addr 172.21.15.61:0/3602727857 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37dff9700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3781599e0 0x7fc3780b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:48.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.936+0000 7fc37d7f8700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3780cbac0 0x7fc378150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:48.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc37cff7700 1 -- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3781599e0 msgr2=0x7fc3780b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:48.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc37cff7700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3781599e0 0x7fc3780b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:48.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc37cff7700 1 -- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3780cbac0 msgr2=0x7fc378150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:48.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc37cff7700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3780cbac0 0x7fc378150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:48.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc37cff7700 1 -- 172.21.15.61:0/3602727857 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374009420 con 0x7fc3780cd9b0 2023-12-24T20:01:48.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc37cff7700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3780cd9b0 0x7fc3780b4ac0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc378071db0 tx=0x7fc374016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:48.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc36d7fa700 1 -- 172.21.15.61:0/3602727857 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37401caf0 con 0x7fc3780cd9b0 2023-12-24T20:01:48.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc36d7fa700 1 -- 172.21.15.61:0/3602727857 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37401cc90 con 0x7fc3780cd9b0 2023-12-24T20:01:48.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc37fa5c700 1 -- 172.21.15.61:0/3602727857 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37814ff20 con 0x7fc3780cd9b0 2023-12-24T20:01:48.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc36d7fa700 1 -- 172.21.15.61:0/3602727857 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37401a6a0 con 0x7fc3780cd9b0 2023-12-24T20:01:48.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.937+0000 7fc37fa5c700 1 -- 172.21.15.61:0/3602727857 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc378150f40 con 0x7fc3780cd9b0 2023-12-24T20:01:48.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.938+0000 7fc37fa5c700 1 -- 172.21.15.61:0/3602727857 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37804c3c0 con 0x7fc3780cd9b0 2023-12-24T20:01:48.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.938+0000 7fc36d7fa700 1 -- 172.21.15.61:0/3602727857 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc37401aa50 con 0x7fc3780cd9b0 2023-12-24T20:01:48.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.939+0000 7fc36d7fa700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc35c066f30 0x7fc35c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:48.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.939+0000 7fc36d7fa700 1 -- 172.21.15.61:0/3602727857 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc374085e10 con 0x7fc3780cd9b0 2023-12-24T20:01:48.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.939+0000 7fc37d7f8700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc35c066f30 0x7fc35c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:48.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.939+0000 7fc37d7f8700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc35c066f30 0x7fc35c0693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc368004e60 tx=0x7fc368001a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:48.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:48.943+0000 7fc36d7fa700 1 -- 172.21.15.61:0/3602727857 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc374053080 con 0x7fc3780cd9b0 2023-12-24T20:01:49.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.137+0000 7fc37fa5c700 1 -- 172.21.15.61:0/3602727857 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc3781506b0 con 0x7fc3780cd9b0 2023-12-24T20:01:49.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.138+0000 7fc36d7fa700 1 -- 172.21.15.61:0/3602727857 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v99) v1 ==== 81+0+32263 (secure 0 0 0) 0x7fc374029090 con 0x7fc3780cd9b0 2023-12-24T20:01:49.139 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:49.139 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:01:49.139 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 99, 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:01:31.676823+0000", 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:01:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 13, 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.141 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:49.142 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "90", 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:49.143 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:49.144 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:49.145 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:01:49.146 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 12, 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:28.014512+0000", 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:49.148 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "98", 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:49.149 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:49.150 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:49.150 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:49.150 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:49.150 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:49.150 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:49.150 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:49.150 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:49.150 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:49.150 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:49.150 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:49.151 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:01:49.152 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 13, 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:29.062088+0000", 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:49.154 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:49.154 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:49.154 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:49.154 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:49.154 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:49.154 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:01:49.154 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:01:49.154 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:01:49.154 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:01:49.154 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "99", 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:49.155 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:49.156 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:49.156 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:49.156 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:49.156 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:49.156 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:49.156 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:49.156 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:49.157 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:49.158 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:01:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:01:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:01:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:01:49.166 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.167 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.168 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.169 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.170 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:01:49.172 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:49.173 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:49.174 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:49.175 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.176 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:49.178 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.179 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:49.180 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.181 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.182 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:01:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:49.184 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:49.185 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.186 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:49.187 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.188 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:01:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:49.190 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:01:49.191 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:01:49.192 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:49.193 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:49.195 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.196 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.197 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:01:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:49.207 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:01:49.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.140+0000 7fc37fa5c700 1 -- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc35c066f30 msgr2=0x7fc35c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:49.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.140+0000 7fc37fa5c700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc35c066f30 0x7fc35c0693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc368004e60 tx=0x7fc368001a10 comp rx=0 tx=0).stop 2023-12-24T20:01:49.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.140+0000 7fc37fa5c700 1 -- 172.21.15.61:0/3602727857 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3780cd9b0 msgr2=0x7fc3780b4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:49.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.140+0000 7fc37fa5c700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3780cd9b0 0x7fc3780b4ac0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc378071db0 tx=0x7fc374016000 comp rx=0 tx=0).stop 2023-12-24T20:01:49.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.141+0000 7fc37fa5c700 1 -- 172.21.15.61:0/3602727857 shutdown_connections 2023-12-24T20:01:49.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.141+0000 7fc37fa5c700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3781599e0 0x7fc3780b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:49.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.141+0000 7fc37fa5c700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc35c066f30 0x7fc35c0693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:49.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.141+0000 7fc37fa5c700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3780cbac0 0x7fc378150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:49.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.141+0000 7fc37fa5c700 1 --2- 172.21.15.61:0/3602727857 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3780cd9b0 0x7fc3780b4ac0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:49.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.141+0000 7fc37fa5c700 1 -- 172.21.15.61:0/3602727857 >> 172.21.15.61:0/3602727857 conn(0x7fc37806e640 msgr2=0x7fc3781589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:49.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.141+0000 7fc37fa5c700 1 -- 172.21.15.61:0/3602727857 shutdown_connections 2023-12-24T20:01:49.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:49.141+0000 7fc37fa5c700 1 -- 172.21.15.61:0/3602727857 wait complete. 2023-12-24T20:01:49.210 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:01:49.549 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:01:49.549+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-12-24T20:01:54.211 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:01:54.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.347+0000 7ff858af8700 1 Processor -- start 2023-12-24T20:01:54.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.347+0000 7ff858af8700 1 -- start start 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.348+0000 7ff858af8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff85415bb60 0x7ff854098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.348+0000 7ff858af8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8540b2660 0x7ff8540b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.348+0000 7ff858af8700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8540b2eb0 con 0x7ff854098aa0 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.348+0000 7ff858af8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8540afc20 con 0x7ff8540b2660 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.348+0000 7ff858af8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540b2bd0 con 0x7ff85415bb60 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.348+0000 7ff851d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff854098aa0 0x7ff85415bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46458/0 (socket says 172.21.15.61:46458) 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.348+0000 7ff851d9b700 1 -- 172.21.15.61:0/2978476670 learned_addr learned my addr 172.21.15.61:0/2978476670 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.348+0000 7ff852d9d700 1 --2- 172.21.15.61:0/2978476670 >> v2:172.21.15.133:3300/0 conn(0x7ff8540b2660 0x7ff8540b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.348+0000 7ff85259c700 1 --2- 172.21.15.61:0/2978476670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff85415bb60 0x7ff854098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85159a700 1 -- 172.21.15.61:0/2978476670 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494871897 0 0) 0x7ff8540b2eb0 con 0x7ff854098aa0 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85159a700 1 -- 172.21.15.61:0/2978476670 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff83c003570 con 0x7ff854098aa0 2023-12-24T20:01:54.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85259c700 1 -- 172.21.15.61:0/2978476670 >> v2:172.21.15.133:3300/0 conn(0x7ff8540b2660 msgr2=0x7ff8540b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:54.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85259c700 1 --2- 172.21.15.61:0/2978476670 >> v2:172.21.15.133:3300/0 conn(0x7ff8540b2660 0x7ff8540b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85259c700 1 -- 172.21.15.61:0/2978476670 >> v1:172.21.15.61:6789/0 conn(0x7ff854098aa0 legacy=0x7ff85415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85159a700 1 -- 172.21.15.61:0/2978476670 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2353688049 0 0) 0x7ff83c003570 con 0x7ff854098aa0 2023-12-24T20:01:54.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85259c700 1 -- 172.21.15.61:0/2978476670 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8540afe10 con 0x7ff85415bb60 2023-12-24T20:01:54.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff852d9d700 1 --2- 172.21.15.61:0/2978476670 >> v2:172.21.15.133:3300/0 conn(0x7ff8540b2660 0x7ff8540b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:01:54.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85259c700 1 --2- 172.21.15.61:0/2978476670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff85415bb60 0x7ff854098560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff8480098d0 tx=0x7ff848009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c909add810c52724 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:54.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85159a700 1 -- 172.21.15.61:0/2978476670 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844001470 con 0x7ff85415bb60 2023-12-24T20:01:54.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85159a700 1 -- 172.21.15.61:0/2978476670 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848011420 con 0x7ff85415bb60 2023-12-24T20:01:54.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.349+0000 7ff85159a700 1 -- 172.21.15.61:0/2978476670 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480117a0 con 0x7ff85415bb60 2023-12-24T20:01:54.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.350+0000 7ff858af8700 1 -- 172.21.15.61:0/2978476670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff85415bb60 msgr2=0x7ff854098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.350+0000 7ff858af8700 1 --2- 172.21.15.61:0/2978476670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff85415bb60 0x7ff854098560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff8480098d0 tx=0x7ff848009120 comp rx=0 tx=0).stop 2023-12-24T20:01:54.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.350+0000 7ff858af8700 1 -- 172.21.15.61:0/2978476670 shutdown_connections 2023-12-24T20:01:54.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.350+0000 7ff858af8700 1 --2- 172.21.15.61:0/2978476670 >> v2:172.21.15.133:3300/0 conn(0x7ff8540b2660 0x7ff8540b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.350+0000 7ff858af8700 1 --2- 172.21.15.61:0/2978476670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff85415bb60 0x7ff854098560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.350+0000 7ff858af8700 1 -- 172.21.15.61:0/2978476670 >> 172.21.15.61:0/2978476670 conn(0x7ff854097a10 msgr2=0x7ff8540ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.350+0000 7ff858af8700 1 -- 172.21.15.61:0/2978476670 shutdown_connections 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.350+0000 7ff858af8700 1 -- 172.21.15.61:0/2978476670 wait complete. 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.351+0000 7ff858af8700 1 Processor -- start 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.352+0000 7ff858af8700 1 -- start start 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.352+0000 7ff858af8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff854098aa0 0x7ff85415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff858af8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8540b2660 0x7ff8540c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff858af8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff85415bb60 0x7ff854148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff858af8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff854168450 con 0x7ff85415bb60 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff858af8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85415dd40 con 0x7ff854098aa0 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff858af8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85415c510 con 0x7ff8540b2660 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff852d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff85415bb60 0x7ff854148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff852d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff85415bb60 0x7ff854148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:38380/0 (socket says 172.21.15.61:38380) 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff852d9d700 1 -- 172.21.15.61:0/2951778591 learned_addr learned my addr 172.21.15.61:0/2951778591 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff851d9b700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8540b2660 0x7ff8540c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff85259c700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff854098aa0 0x7ff85415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff852d9d700 1 -- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8540b2660 msgr2=0x7ff8540c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff852d9d700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8540b2660 0x7ff8540c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff852d9d700 1 -- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff854098aa0 msgr2=0x7ff85415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff852d9d700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff854098aa0 0x7ff85415bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff852d9d700 1 -- 172.21.15.61:0/2951778591 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c009a20 con 0x7ff85415bb60 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff852d9d700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff85415bb60 0x7ff854148bd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00c0f0 tx=0x7ff84c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff8427fc700 1 -- 172.21.15.61:0/2951778591 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00cc30 con 0x7ff85415bb60 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff8427fc700 1 -- 172.21.15.61:0/2951778591 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c00f040 con 0x7ff85415bb60 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff858af8700 1 -- 172.21.15.61:0/2951778591 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8480093c0 con 0x7ff85415bb60 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.353+0000 7ff8427fc700 1 -- 172.21.15.61:0/2951778591 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c014480 con 0x7ff85415bb60 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.354+0000 7ff858af8700 1 -- 172.21.15.61:0/2951778591 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85415cad0 con 0x7ff85415bb60 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.354+0000 7ff858af8700 1 -- 172.21.15.61:0/2951778591 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff854168600 con 0x7ff85415bb60 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.355+0000 7ff8427fc700 1 -- 172.21.15.61:0/2951778591 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff84c003020 con 0x7ff85415bb60 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.355+0000 7ff8427fc700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff834066f30 0x7ff8340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.355+0000 7ff8427fc700 1 -- 172.21.15.61:0/2951778591 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff84c084ee0 con 0x7ff85415bb60 2023-12-24T20:01:54.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.356+0000 7ff8427fc700 1 -- 172.21.15.61:0/2951778591 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=103}) v3 -- 0x7ff83406ea50 con 0x7ff85415bb60 2023-12-24T20:01:54.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.356+0000 7ff85259c700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff834066f30 0x7ff8340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.356+0000 7ff85259c700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff834066f30 0x7ff8340693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff848009160 tx=0x7ff848016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:54.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.360+0000 7ff8427fc700 1 -- 172.21.15.61:0/2951778591 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff854168600 con 0x7ff85415bb60 2023-12-24T20:01:54.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.556+0000 7ff858af8700 1 -- 172.21.15.61:0/2951778591 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff85406d440 con 0x7ff85415bb60 2023-12-24T20:01:54.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.557+0000 7ff8427fc700 1 -- 172.21.15.61:0/2951778591 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v102) v1 ==== 81+0+32442 (secure 0 0 0) 0x7ff84c018020 con 0x7ff85415bb60 2023-12-24T20:01:54.558 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:54.558 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:01:54.558 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 102, 2023-12-24T20:01:54.558 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:01:54.558 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:01:54.558 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:01:51.763499+0000", 2023-12-24T20:01:54.558 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:01:54.558 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:01:54.558 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:01:54.558 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 13, 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:01:54.559 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:54.560 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:54.561 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:54.562 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:54.563 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:54.564 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:01:54.565 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:01:54.565 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.565 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:54.565 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:01:54.565 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.565 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.565 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.565 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 12, 2023-12-24T20:01:54.565 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:01:54.565 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:28.014512+0000", 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:01:54.566 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:54.567 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:54.568 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:54.569 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:01:54.570 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 13, 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:29.062088+0000", 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:54.571 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:54.572 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:54.573 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:54.574 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:54.575 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:01:54.576 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:54.577 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:54.578 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:54.579 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.580 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:01:54.581 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:54.582 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:54.583 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:54.583 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:54.583 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:54.583 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:54.583 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:54.583 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.584 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.584 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.584 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:01:54.584 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:54.584 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.584 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.585 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:54.586 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.587 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull", 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:54.588 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.589 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.590 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:54.591 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.592 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:54.593 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:54.594 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.595 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:01:54.596 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.597 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:54.598 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.599 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.600 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:54.601 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.602 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:54.603 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.604 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.605 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:01:54.606 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.607 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:54.608 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:54.609 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.610 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.611 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:54.612 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:01:54.613 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:01:54.614 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:54.615 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.616 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:54.617 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull", 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:54.618 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:54.619 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.620 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:54.621 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.622 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:54.623 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:01:54.624 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:54.625 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:01:54.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 -- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff834066f30 msgr2=0x7ff8340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff834066f30 0x7ff8340693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff848009160 tx=0x7ff848016000 comp rx=0 tx=0).stop 2023-12-24T20:01:54.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 -- 172.21.15.61:0/2951778591 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff85415bb60 msgr2=0x7ff854148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff85415bb60 0x7ff854148bd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00c0f0 tx=0x7ff84c00b040 comp rx=0 tx=0).stop 2023-12-24T20:01:54.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 -- 172.21.15.61:0/2951778591 shutdown_connections 2023-12-24T20:01:54.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff834066f30 0x7ff8340693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff85415bb60 0x7ff854148bd0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff854098aa0 0x7ff85415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 --2- 172.21.15.61:0/2951778591 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff8540b2660 0x7ff8540c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 -- 172.21.15.61:0/2951778591 >> 172.21.15.61:0/2951778591 conn(0x7ff854097a10 msgr2=0x7ff85406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:54.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 -- 172.21.15.61:0/2951778591 shutdown_connections 2023-12-24T20:01:54.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.559+0000 7ff858af8700 1 -- 172.21.15.61:0/2951778591 wait complete. 2023-12-24T20:01:54.628 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-24T20:01:54.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:54.629 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-12-24T20:01:54.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:01:54.725 INFO:teuthology.orchestra.run.smithi061.stderr:dd: error writing 'large_file_b': No space left on device 2023-12-24T20:01:54.725 INFO:teuthology.orchestra.run.smithi061.stderr:dd: closing output file 'large_file_b': No space left on device 2023-12-24T20:01:54.726 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:01:54.784 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:01:54.784+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-12-24T20:01:54.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.849+0000 7f997a27e700 1 Processor -- start 2023-12-24T20:01:54.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.849+0000 7f997a27e700 1 -- start start 2023-12-24T20:01:54.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.850+0000 7f997a27e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f99740aaf90 0x7f9974159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.850+0000 7f997a27e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997406a630 con 0x7f997406aac0 2023-12-24T20:01:54.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.850+0000 7f997a27e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9974069d00 con 0x7f9974159850 2023-12-24T20:01:54.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.850+0000 7f997a27e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99740cccf0 con 0x7f99740aaf90 2023-12-24T20:01:54.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.850+0000 7f99737fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f997406aac0 0x7f99740aa880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46474/0 (socket says 172.21.15.61:46474) 2023-12-24T20:01:54.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.850+0000 7f99737fe700 1 -- 172.21.15.61:0/1959998039 learned_addr learned my addr 172.21.15.61:0/1959998039 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f997881b700 1 --2- 172.21.15.61:0/1959998039 >> v2:172.21.15.133:3300/0 conn(0x7f99740aaf90 0x7f9974159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143775662 0 0) 0x7f997406a630 con 0x7f997406aac0 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f995c003570 con 0x7f997406aac0 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 51465792 0 0) 0x7f995c003570 con 0x7f997406aac0 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 >> v2:172.21.15.133:3300/0 conn(0x7f99740aaf90 msgr2=0x7f9974159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 --2- 172.21.15.61:0/1959998039 >> v2:172.21.15.133:3300/0 conn(0x7f99740aaf90 0x7f9974159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 >> v1:172.21.15.133:6789/0 conn(0x7f9974159850 legacy=0x7f99740cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974069fe0 con 0x7f997406aac0 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f9968001470 con 0x7f997406aac0 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 >> v1:172.21.15.61:6789/0 conn(0x7f997406aac0 legacy=0x7f99740aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f995c003a60 0x7f995c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995c004810 0x7f995c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f995c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99740cccf0 con 0x7f995c0051c0 2023-12-24T20:01:54.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c00c160 con 0x7f995c004810 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c00c320 con 0x7f995c003a60 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f997881b700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f995c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f99737fe700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995c004810 0x7f995c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.851+0000 7f9973fff700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f995c003a60 0x7f995c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997881b700 1 -- 172.21.15.61:0/1959998039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f995c003a60 msgr2=0x7f995c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997881b700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f995c003a60 0x7f995c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997881b700 1 -- 172.21.15.61:0/1959998039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995c004810 msgr2=0x7f995c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997881b700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995c004810 0x7f995c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997881b700 1 -- 172.21.15.61:0/1959998039 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c003570 con 0x7f995c0051c0 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f99737fe700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995c004810 0x7f995c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997881b700 1 -- 172.21.15.61:0/1959998039 reap_dead start 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997881b700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f995c00ba60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f99740ab390 tx=0x7f996c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130374ff43dee583 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00ea90 con 0x7f995c0051c0 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c00f040 con 0x7f995c0051c0 2023-12-24T20:01:54.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f9972ffd700 1 -- 172.21.15.61:0/1959998039 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00ee40 con 0x7f995c0051c0 2023-12-24T20:01:54.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997a27e700 1 -- 172.21.15.61:0/1959998039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 msgr2=0x7f995c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997a27e700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f995c00ba60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f99740ab390 tx=0x7f996c00b040 comp rx=0 tx=0).stop 2023-12-24T20:01:54.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997a27e700 1 -- 172.21.15.61:0/1959998039 shutdown_connections 2023-12-24T20:01:54.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997a27e700 1 --2- 172.21.15.61:0/1959998039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f995c00ba60 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997a27e700 1 -- 172.21.15.61:0/1959998039 >> 172.21.15.61:0/1959998039 conn(0x7f99740cceb0 msgr2=0x7f99740cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:54.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997a27e700 1 -- 172.21.15.61:0/1959998039 shutdown_connections 2023-12-24T20:01:54.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.852+0000 7f997a27e700 1 -- 172.21.15.61:0/1959998039 wait complete. 2023-12-24T20:01:54.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.854+0000 7f997a27e700 1 Processor -- start 2023-12-24T20:01:54.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.854+0000 7f997a27e700 1 -- start start 2023-12-24T20:01:54.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.854+0000 7f997a27e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f99740aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f997a27e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99740c24e0 0x7f99740c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f997a27e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9974169ef0 0x7f997416a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f997a27e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997416ae60 con 0x7f995c0051c0 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f997a27e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974156090 con 0x7f99740c24e0 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f997a27e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99740c2e90 con 0x7f9974169ef0 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f9973fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f99740aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f9973fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f99740aba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:38394/0 (socket says 172.21.15.61:38394) 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f9973fff700 1 -- 172.21.15.61:0/2634095651 learned_addr learned my addr 172.21.15.61:0/2634095651 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f99737fe700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99740c24e0 0x7f99740c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f997881b700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9974169ef0 0x7f997416a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f9973fff700 1 -- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9974169ef0 msgr2=0x7f997416a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f9973fff700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9974169ef0 0x7f997416a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f9973fff700 1 -- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99740c24e0 msgr2=0x7f99740c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f9973fff700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99740c24e0 0x7f99740c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f9973fff700 1 -- 172.21.15.61:0/2634095651 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997416dc90 con 0x7f995c0051c0 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f997881b700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9974169ef0 0x7f997416a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:01:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f9973fff700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f99740aba80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9964002980 tx=0x7f9964007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f995bfff700 1 -- 172.21.15.61:0/2634095651 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964002e10 con 0x7f995c0051c0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f995bfff700 1 -- 172.21.15.61:0/2634095651 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996400f8d0 con 0x7f995c0051c0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f997a27e700 1 -- 172.21.15.61:0/2634095651 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997416ab80 con 0x7f995c0051c0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f995bfff700 1 -- 172.21.15.61:0/2634095651 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996400fc70 con 0x7f995c0051c0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.855+0000 7f997a27e700 1 -- 172.21.15.61:0/2634095651 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997416d920 con 0x7f995c0051c0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.856+0000 7f997a27e700 1 -- 172.21.15.61:0/2634095651 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997404c3c0 con 0x7f995c0051c0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.857+0000 7f995bfff700 1 -- 172.21.15.61:0/2634095651 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f996401c400 con 0x7f995c0051c0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.857+0000 7f995bfff700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9960066f80 0x7f9960069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.857+0000 7f995bfff700 1 -- 172.21.15.61:0/2634095651 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99640849b0 con 0x7f995c0051c0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.857+0000 7f995bfff700 1 -- 172.21.15.61:0/2634095651 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=104}) v3 -- 0x7f996006eaa0 con 0x7f995c0051c0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.857+0000 7f99737fe700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9960066f80 0x7f9960069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:54.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.858+0000 7f99737fe700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9960066f80 0x7f9960069430 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9968000fd0 tx=0x7f9968001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:54.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:54.862+0000 7f995bfff700 1 -- 172.21.15.61:0/2634095651 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9964051c30 con 0x7f995c0051c0 2023-12-24T20:01:55.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.057+0000 7f997a27e700 1 -- 172.21.15.61:0/2634095651 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f997406a2c0 con 0x7f995c0051c0 2023-12-24T20:01:55.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.058+0000 7f995bfff700 1 -- 172.21.15.61:0/2634095651 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v103) v1 ==== 81+0+32434 (secure 0 0 0) 0x7f9964055250 con 0x7f995c0051c0 2023-12-24T20:01:55.061 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:55.061 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 103, 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:01:54.785204+0000", 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:55.062 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:01:55.063 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:01:55.063 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:01:55.063 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:01:55.063 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:01:55.063 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 13, 2023-12-24T20:01:55.063 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:01:55.063 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:01:55.064 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:01:55.064 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:01:55.064 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:01:55.064 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.064 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:01:55.064 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:55.065 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:55.066 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:55.066 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:55.066 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:01:55.066 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:01:55.066 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:01:55.066 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:01:55.066 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:01:55.066 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:55.066 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:55.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:55.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:55.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:55.067 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:55.067 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:55.067 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:01:55.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:55.068 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:55.069 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.070 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 12, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:28.014512+0000", 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:55.071 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:01:55.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:55.073 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:55.074 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:55.075 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:55.075 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:55.075 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:55.075 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:55.075 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:55.075 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:55.075 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:55.075 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:55.075 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:55.075 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 13, 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:29.062088+0000", 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:01:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:01:55.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:55.078 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:55.079 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:55.080 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:01:55.081 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.082 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.083 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:01:55.084 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.085 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.086 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:55.087 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:01:55.088 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:01:55.089 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.090 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.091 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:55.092 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:55.093 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.094 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.095 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:55.096 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.096 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.096 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.096 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:01:55.096 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:55.096 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.096 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.096 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.097 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:55.098 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:55.099 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:55.099 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:55.099 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.099 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.099 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.099 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:01:55.099 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:55.099 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:55.100 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:55.100 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:55.100 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:55.100 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:55.100 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:55.100 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:55.100 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:55.101 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:55.101 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:55.101 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:55.101 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.101 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.101 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.101 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:01:55.101 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:55.102 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.102 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.102 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.102 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:01:55.102 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:55.102 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.102 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.102 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.103 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:55.103 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.103 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.103 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.103 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:01:55.103 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:55.103 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:01:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.105 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:55.105 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.105 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.105 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.105 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:01:55.105 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:55.105 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:01:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:01:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.108 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:01:55.108 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:55.108 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.108 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.108 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.108 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:01:55.108 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:01:55.109 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:01:55.109 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:01:55.109 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:55.109 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:55.109 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:55.109 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.109 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:01:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:01:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:01:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:01:55.115 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:55.116 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:55.116 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:55.116 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:55.116 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:55.116 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:55.116 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:55.116 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:55.116 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:55.116 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:01:55.118 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:55.118 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.118 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.118 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.118 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:55.118 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.118 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.118 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.118 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:01:55.118 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.119 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.120 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:01:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:01:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:01:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:55.126 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:01:55.127 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:55.128 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:55.128 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:55.128 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:55.128 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:55.128 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:55.128 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:55.128 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:55.128 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:55.128 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.129 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.131 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:55.132 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:55.132 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.132 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:55.132 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:01:55.132 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:55.132 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.132 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.132 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:55.132 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:01:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:01:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:01:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:01:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:01:55.134 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:55.134 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull", 2023-12-24T20:01:55.134 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:55.134 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:55.134 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:55.134 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:01:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:01:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:01:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:01:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:01:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.138 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:01:55.138 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:55.138 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:55.138 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:55.138 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:55.138 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:55.138 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:01:55.139 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:55.139 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.139 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.139 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:01:55.139 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:55.139 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:55.139 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:55.140 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:55.140 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:55.140 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:01:55.140 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:55.140 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.140 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.140 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:01:55.141 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:55.141 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:55.141 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:55.141 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:55.141 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:55.141 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:01:55.141 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:55.142 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.142 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.142 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:01:55.142 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:55.142 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:55.142 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:55.142 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:55.143 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:55.143 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:01:55.143 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:55.143 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.143 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.143 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:01:55.143 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:55.144 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:55.144 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:55.144 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:55.144 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:55.144 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:01:55.144 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:55.144 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.144 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:55.144 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:01:55.145 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:55.145 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:55.145 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:55.145 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:55.145 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:55.145 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:01:55.145 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:55.145 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.146 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:55.146 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:01:55.146 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:01:55.146 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:01:55.146 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:01:55.146 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:01:55.146 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:01:55.146 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:01:55.146 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:01:55.147 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:01:55.147 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:01:55.147 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:01:55.147 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:01:55.147 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:01:55.147 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.147 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:55.148 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:01:55.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 -- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9960066f80 msgr2=0x7f9960069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:55.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9960066f80 0x7f9960069430 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9968000fd0 tx=0x7f9968001e50 comp rx=0 tx=0).stop 2023-12-24T20:01:55.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 -- 172.21.15.61:0/2634095651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 msgr2=0x7f99740aba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:55.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f99740aba80 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f9964002980 tx=0x7f9964007d30 comp rx=0 tx=0).stop 2023-12-24T20:01:55.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 -- 172.21.15.61:0/2634095651 shutdown_connections 2023-12-24T20:01:55.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9974169ef0 0x7f997416a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9960066f80 0x7f9960069430 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f995c0051c0 0x7f99740aba80 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 --2- 172.21.15.61:0/2634095651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99740c24e0 0x7f99740c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 -- 172.21.15.61:0/2634095651 >> 172.21.15.61:0/2634095651 conn(0x7f99740cceb0 msgr2=0x7f99740cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:55.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 -- 172.21.15.61:0/2634095651 shutdown_connections 2023-12-24T20:01:55.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.060+0000 7f997a27e700 1 -- 172.21.15.61:0/2634095651 wait complete. 2023-12-24T20:01:55.152 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:01:55.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.273+0000 7fa6fc792700 1 Processor -- start 2023-12-24T20:01:55.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.273+0000 7fa6fc792700 1 -- start start 2023-12-24T20:01:55.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.274+0000 7fa6fc792700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f4159b00 0x7fa6f4067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:55.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.274+0000 7fa6fc792700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa6f4070d50 0x7fa6f40afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:55.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.274+0000 7fa6fc792700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40a84d0 con 0x7fa6f40af7d0 2023-12-24T20:01:55.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.274+0000 7fa6fc792700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f40b0180 con 0x7fa6f4070d50 2023-12-24T20:01:55.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.274+0000 7fa6fc792700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40a7620 con 0x7fa6f4159b00 2023-12-24T20:01:55.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6f9d2d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa6f40af7d0 0x7fa6f4070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46476/0 (socket says 172.21.15.61:46476) 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6f9d2d700 1 -- 172.21.15.61:0/2914097113 learned_addr learned my addr 172.21.15.61:0/2914097113 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6fad2f700 1 --2- 172.21.15.61:0/2914097113 >> v2:172.21.15.133:3300/0 conn(0x7fa6f4070d50 0x7fa6f40afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6fa52e700 1 --2- 172.21.15.61:0/2914097113 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f4159b00 0x7fa6f4067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6f952c700 1 -- 172.21.15.61:0/2914097113 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449643460 0 0) 0x7fa6f40a84d0 con 0x7fa6f40af7d0 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6f952c700 1 -- 172.21.15.61:0/2914097113 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e0003570 con 0x7fa6f40af7d0 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6fad2f700 1 -- 172.21.15.61:0/2914097113 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f4159b00 msgr2=0x7fa6f4067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6fad2f700 1 --2- 172.21.15.61:0/2914097113 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f4159b00 0x7fa6f4067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6fad2f700 1 -- 172.21.15.61:0/2914097113 >> v1:172.21.15.61:6789/0 conn(0x7fa6f40af7d0 legacy=0x7fa6f4070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6fad2f700 1 -- 172.21.15.61:0/2914097113 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40a78c0 con 0x7fa6f4070d50 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6fa52e700 1 --2- 172.21.15.61:0/2914097113 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f4159b00 0x7fa6f4067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6fad2f700 1 --2- 172.21.15.61:0/2914097113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4070d50 0x7fa6f40afc40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009e60 tx=0x7fa6ec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17393093fa642041 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6f952c700 1 -- 172.21.15.61:0/2914097113 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00e070 con 0x7fa6f4070d50 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6f952c700 1 -- 172.21.15.61:0/2914097113 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec00bab0 con 0x7fa6f4070d50 2023-12-24T20:01:55.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.275+0000 7fa6f952c700 1 -- 172.21.15.61:0/2914097113 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec00be70 con 0x7fa6f4070d50 2023-12-24T20:01:55.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.276+0000 7fa6fc792700 1 -- 172.21.15.61:0/2914097113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4070d50 msgr2=0x7fa6f40afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:55.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.276+0000 7fa6fc792700 1 --2- 172.21.15.61:0/2914097113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4070d50 0x7fa6f40afc40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec009e60 tx=0x7fa6ec009780 comp rx=0 tx=0).stop 2023-12-24T20:01:55.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.276+0000 7fa6fc792700 1 -- 172.21.15.61:0/2914097113 shutdown_connections 2023-12-24T20:01:55.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.276+0000 7fa6fc792700 1 --2- 172.21.15.61:0/2914097113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4070d50 0x7fa6f40afc40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.276+0000 7fa6fc792700 1 --2- 172.21.15.61:0/2914097113 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f4159b00 0x7fa6f4067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.276+0000 7fa6fc792700 1 -- 172.21.15.61:0/2914097113 >> 172.21.15.61:0/2914097113 conn(0x7fa6f40ca200 msgr2=0x7fa6f40ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:55.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.276+0000 7fa6fc792700 1 -- 172.21.15.61:0/2914097113 shutdown_connections 2023-12-24T20:01:55.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.276+0000 7fa6fc792700 1 -- 172.21.15.61:0/2914097113 wait complete. 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.277+0000 7fa6fc792700 1 Processor -- start 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.277+0000 7fa6fc792700 1 -- start start 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fc792700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4070d50 0x7fa6f415e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fc792700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f40af7d0 0x7fa6f40b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fc792700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6f4159b00 0x7fa6f40ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fc792700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4153910 con 0x7fa6f4159b00 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fc792700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4158340 con 0x7fa6f4070d50 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fc792700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f415e930 con 0x7fa6f40af7d0 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fad2f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6f4159b00 0x7fa6f40ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fad2f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6f4159b00 0x7fa6f40ae560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:38408/0 (socket says 172.21.15.61:38408) 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fad2f700 1 -- 172.21.15.61:0/3670404293 learned_addr learned my addr 172.21.15.61:0/3670404293 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fa52e700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4070d50 0x7fa6f415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:55.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6f9d2d700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f40af7d0 0x7fa6f40b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fad2f700 1 -- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f40af7d0 msgr2=0x7fa6f40b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fad2f700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f40af7d0 0x7fa6f40b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fad2f700 1 -- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4070d50 msgr2=0x7fa6f415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fad2f700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4070d50 0x7fa6f415e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fad2f700 1 -- 172.21.15.61:0/3670404293 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f0009420 con 0x7fa6f4159b00 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.278+0000 7fa6fad2f700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6f4159b00 0x7fa6f40ae560 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec013000 tx=0x7fa6ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.279+0000 7fa6e67fc700 1 -- 172.21.15.61:0/3670404293 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec012e10 con 0x7fa6f4159b00 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.279+0000 7fa6e67fc700 1 -- 172.21.15.61:0/3670404293 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec027470 con 0x7fa6f4159b00 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.279+0000 7fa6fc792700 1 -- 172.21.15.61:0/3670404293 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec009a20 con 0x7fa6f4159b00 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.279+0000 7fa6e67fc700 1 -- 172.21.15.61:0/3670404293 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec027830 con 0x7fa6f4159b00 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.279+0000 7fa6fc792700 1 -- 172.21.15.61:0/3670404293 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f4157cf0 con 0x7fa6f4159b00 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.280+0000 7fa6fc792700 1 -- 172.21.15.61:0/3670404293 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f404c3c0 con 0x7fa6f4159b00 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.280+0000 7fa6e67fc700 1 -- 172.21.15.61:0/3670404293 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa6ec024070 con 0x7fa6f4159b00 2023-12-24T20:01:55.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.280+0000 7fa6e67fc700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa6d8066f30 0x7fa6d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:55.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.281+0000 7fa6e67fc700 1 -- 172.21.15.61:0/3670404293 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6ec086f30 con 0x7fa6f4159b00 2023-12-24T20:01:55.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.281+0000 7fa6e67fc700 1 -- 172.21.15.61:0/3670404293 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=104}) v3 -- 0x7fa6d806ea50 con 0x7fa6f4159b00 2023-12-24T20:01:55.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.281+0000 7fa6fa52e700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa6d8066f30 0x7fa6d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:55.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.281+0000 7fa6fa52e700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa6d8066f30 0x7fa6d80693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009ea0 tx=0x7fa6f00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:55.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.285+0000 7fa6e67fc700 1 -- 172.21.15.61:0/3670404293 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6ec0541a0 con 0x7fa6f4159b00 2023-12-24T20:01:55.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.524+0000 7fa6fc792700 1 -- 172.21.15.61:0/3670404293 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6f4067550 con 0x7fa6f4159b00 2023-12-24T20:01:55.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.524+0000 7fa6e67fc700 1 -- 172.21.15.61:0/3670404293 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fa6ec02c020 con 0x7fa6f4159b00 2023-12-24T20:01:55.525 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:55.525 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2634636374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2634636374},{"type":"v1","addr":"172.21.15.61:6835","nonce":2634636374}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/856986572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":856986572},{"type":"v1","addr":"172.21.15.133:6836","nonce":856986572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1475170652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1475170652},{"type":"v1","addr":"172.21.15.133:6837","nonce":1475170652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:01:30.072202+0000","modified":"2023-12-24T20:01:33.718490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2512648595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2512648595},{"type":"v1","addr":"172.21.15.61:6834","nonce":2512648595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 -- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa6d8066f30 msgr2=0x7fa6d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa6d8066f30 0x7fa6d80693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0009ea0 tx=0x7fa6f00091a0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 -- 172.21.15.61:0/3670404293 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6f4159b00 msgr2=0x7fa6f40ae560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6f4159b00 0x7fa6f40ae560 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec013000 tx=0x7fa6ec019000 comp rx=0 tx=0).stop 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 -- 172.21.15.61:0/3670404293 shutdown_connections 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa6d8066f30 0x7fa6d80693e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6f4159b00 0x7fa6f40ae560 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4070d50 0x7fa6f415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 --2- 172.21.15.61:0/3670404293 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa6f40af7d0 0x7fa6f40b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 -- 172.21.15.61:0/3670404293 >> 172.21.15.61:0/3670404293 conn(0x7fa6f40ca200 msgr2=0x7fa6f4155160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:55.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 -- 172.21.15.61:0/3670404293 shutdown_connections 2023-12-24T20:01:55.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:55.526+0000 7fa6fc792700 1 -- 172.21.15.61:0/3670404293 wait complete. 2023-12-24T20:01:55.528 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 52 2023-12-24T20:01:55.539 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-24T20:01:55.680 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":6318,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":24.977542284999998,"mdsmap_epoch":52,"osdmap_epoch":103,"osdmap_epoch_barrier":99,"uptime":30.898467805999999} 2023-12-24T20:01:55.680 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 6318, "mdsmap_epoch": 52, "osdmap_epoch": 103, "osdmap_epoch_barrier": 99, "rank_uptime": 24.977542285, "state": "up:active", "uptime": 30.898467806, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:01:55.680 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-24T20:01:55.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:55.681 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-12-24T20:01:55.699 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T20:01:55.699+0000 7f7e3effd700 -1 client.6522 handle_client_reply no pending request on tid 14 safe is:1 2023-12-24T20:01:55.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:01:55.700 INFO:teuthology.orchestra.run.smithi061.stderr:dd: failed to open 'small_file_1': Permission denied 2023-12-24T20:01:55.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:55.700 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-24T20:01:55.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:01:55.762 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-24T20:01:55.841 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:01:56.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.003+0000 7f53f7407700 1 Processor -- start 2023-12-24T20:01:56.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.003+0000 7f53f7407700 1 -- start start 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.004+0000 7f53f7407700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53f00afee0 0x7f53f0067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.004+0000 7f53f7407700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f53f0070640 0x7f53f0070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.004+0000 7f53f7407700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f00a84d0 con 0x7f53f0159b00 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.004+0000 7f53f7407700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f0070fd0 con 0x7f53f0070640 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.004+0000 7f53f7407700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f00a7620 con 0x7f53f00afee0 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.004+0000 7f53f59a4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f53f0070640 0x7f53f0070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.004+0000 7f53f51a3700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f53f0159b00 0x7f53f00af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:46492/0 (socket says 172.21.15.61:46492) 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.004+0000 7f53f59a4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f53f0070640 0x7f53f0070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:38416/0 (socket says 172.21.15.61:38416) 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.004+0000 7f53f51a3700 1 -- 172.21.15.61:0/2048996992 learned_addr learned my addr 172.21.15.61:0/2048996992 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.004+0000 7f53f59a4700 1 -- 172.21.15.61:0/2048996992 >> v2:172.21.15.133:3300/0 conn(0x7f53f00afee0 msgr2=0x7f53f0067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53f59a4700 1 --2- 172.21.15.61:0/2048996992 >> v2:172.21.15.133:3300/0 conn(0x7f53f00afee0 0x7f53f0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:56.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53f59a4700 1 -- 172.21.15.61:0/2048996992 >> v1:172.21.15.61:6789/0 conn(0x7f53f0159b00 legacy=0x7f53f00af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53f59a4700 1 -- 172.21.15.61:0/2048996992 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f00a78c0 con 0x7f53f0070640 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53e7fff700 1 -- 172.21.15.61:0/2048996992 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639563643 0 0) 0x7f53f00a84d0 con 0x7f53f0159b00 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53f59a4700 1 --2- 172.21.15.61:0/2048996992 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 0x7f53f0070a90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f53f00cd6c0 tx=0x7f53e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b818d7ff6db8f862 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53e7fff700 1 -- 172.21.15.61:0/2048996992 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800e070 con 0x7f53f0070640 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53e7fff700 1 -- 172.21.15.61:0/2048996992 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e800bc30 con 0x7f53f0070640 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53e7fff700 1 -- 172.21.15.61:0/2048996992 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8012430 con 0x7f53f0070640 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53f7407700 1 -- 172.21.15.61:0/2048996992 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 msgr2=0x7f53f0070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53f7407700 1 --2- 172.21.15.61:0/2048996992 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 0x7f53f0070a90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f53f00cd6c0 tx=0x7f53e8009780 comp rx=0 tx=0).stop 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53f7407700 1 -- 172.21.15.61:0/2048996992 shutdown_connections 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53f7407700 1 --2- 172.21.15.61:0/2048996992 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0070640 0x7f53f0070a90 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53f7407700 1 --2- 172.21.15.61:0/2048996992 >> v2:172.21.15.133:3300/0 conn(0x7f53f00afee0 0x7f53f0067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.005+0000 7f53f7407700 1 -- 172.21.15.61:0/2048996992 >> 172.21.15.61:0/2048996992 conn(0x7f53f00ca200 msgr2=0x7f53f00ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.006+0000 7f53f7407700 1 -- 172.21.15.61:0/2048996992 shutdown_connections 2023-12-24T20:01:56.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.006+0000 7f53f7407700 1 -- 172.21.15.61:0/2048996992 wait complete. 2023-12-24T20:01:56.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.007+0000 7f53f7407700 1 Processor -- start 2023-12-24T20:01:56.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.007+0000 7f53f7407700 1 -- start start 2023-12-24T20:01:56.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.007+0000 7f53f7407700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53f0070640 0x7f53f0158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:56.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f7407700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53f00afee0 0x7f53f0169bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:56.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f7407700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0159b00 0x7f53f0148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:56.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f7407700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f016a100 con 0x7f53f0159b00 2023-12-24T20:01:56.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f7407700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f016abc0 con 0x7f53f00afee0 2023-12-24T20:01:56.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f7407700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f01487a0 con 0x7f53f0070640 2023-12-24T20:01:56.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f59a4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0159b00 0x7f53f0148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:56.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f59a4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0159b00 0x7f53f0148260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:38426/0 (socket says 172.21.15.61:38426) 2023-12-24T20:01:56.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f59a4700 1 -- 172.21.15.61:0/3733055465 learned_addr learned my addr 172.21.15.61:0/3733055465 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:01:56.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f49a2700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53f00afee0 0x7f53f0169bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:56.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f51a3700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53f0070640 0x7f53f0158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:56.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f59a4700 1 -- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53f0070640 msgr2=0x7f53f0158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:56.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f59a4700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53f0070640 0x7f53f0158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:56.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f59a4700 1 -- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53f00afee0 msgr2=0x7f53f0169bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:56.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f59a4700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53f00afee0 0x7f53f0169bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:56.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f59a4700 1 -- 172.21.15.61:0/3733055465 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e8009a20 con 0x7f53f0159b00 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f59a4700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0159b00 0x7f53f0148260 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f53e8013000 tx=0x7f53e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53e57fa700 1 -- 172.21.15.61:0/3733055465 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8012ea0 con 0x7f53f0159b00 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53e57fa700 1 -- 172.21.15.61:0/3733055465 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e801d630 con 0x7f53f0159b00 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f7407700 1 -- 172.21.15.61:0/3733055465 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f016d330 con 0x7f53f0159b00 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53e57fa700 1 -- 172.21.15.61:0/3733055465 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e801d9f0 con 0x7f53f0159b00 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.008+0000 7f53f7407700 1 -- 172.21.15.61:0/3733055465 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f016a320 con 0x7f53f0159b00 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.009+0000 7f53f7407700 1 -- 172.21.15.61:0/3733055465 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f004c3c0 con 0x7f53f0159b00 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.010+0000 7f53e57fa700 1 -- 172.21.15.61:0/3733055465 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f53e8024070 con 0x7f53f0159b00 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.010+0000 7f53e57fa700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d4066f30 0x7f53d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.010+0000 7f53e57fa700 1 -- 172.21.15.61:0/3733055465 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f53e8086e10 con 0x7f53f0159b00 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.010+0000 7f53f51a3700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d4066f30 0x7f53d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:01:56.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.010+0000 7f53e57fa700 1 -- 172.21.15.61:0/3733055465 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=105}) v3 -- 0x7f53d406eab0 con 0x7f53f0159b00 2023-12-24T20:01:56.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.011+0000 7f53f51a3700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d4066f30 0x7f53d40693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f53f00b3650 tx=0x7f53e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:01:56.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.015+0000 7f53e57fa700 1 -- 172.21.15.61:0/3733055465 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53e8054060 con 0x7f53f0159b00 2023-12-24T20:01:56.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.209+0000 7f53f7407700 1 -- 172.21.15.61:0/3733055465 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f53f016d4c0 con 0x7f53f0159b00 2023-12-24T20:01:56.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.210+0000 7f53e57fa700 1 -- 172.21.15.61:0/3733055465 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) v1 ==== 81+0+32626 (secure 0 0 0) 0x7f53e805d080 con 0x7f53f0159b00 2023-12-24T20:01:56.211 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:01:56.211 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:01:56.211 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 104, 2023-12-24T20:01:56.211 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:01:56.211 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:01:56.211 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:01:55.790410+0000", 2023-12-24T20:01:56.211 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:01:56.212 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 13, 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "luminous", 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:56.213 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:56.214 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:56.215 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:56.216 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:56.217 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 12, 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:28.014512+0000", 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:56.218 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:56.219 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:56.220 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:56.221 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:56.222 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 13, 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:29.062088+0000", 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:01:56.223 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:01:56.224 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:01:56.225 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:01:56.226 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:01:56.227 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:01:56.228 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:56.229 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:56.230 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.231 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.232 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:01:56.233 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:56.234 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.235 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.236 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.237 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:01:56.238 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:56.239 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.240 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.241 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:56.242 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:56.244 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:56.245 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.246 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.247 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.248 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.249 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.250 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:56.251 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.252 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.253 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.254 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:56.255 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.256 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.257 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:01:56.258 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:56.259 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:56.260 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.261 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.262 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:56.263 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:01:56.264 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:01:56.265 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:01:56.266 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:56.267 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.268 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:01:56.269 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull", 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:56.270 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.271 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:56.272 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.273 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:56.274 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:01:56.275 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [ 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "13.3e", 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 1, 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 3 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:01:56.276 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:01:56.277 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:01:56.278 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:01:56.278 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:01:56.278 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:01:56.278 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:01:56.278 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:01:56.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.212+0000 7f53f7407700 1 -- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d4066f30 msgr2=0x7f53d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:56.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.212+0000 7f53f7407700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d4066f30 0x7f53d40693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f53f00b3650 tx=0x7f53e0009040 comp rx=0 tx=0).stop 2023-12-24T20:01:56.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.213+0000 7f53f7407700 1 -- 172.21.15.61:0/3733055465 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0159b00 msgr2=0x7f53f0148260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:01:56.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.213+0000 7f53f7407700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0159b00 0x7f53f0148260 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f53e8013000 tx=0x7f53e8019000 comp rx=0 tx=0).stop 2023-12-24T20:01:56.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.213+0000 7f53f7407700 1 -- 172.21.15.61:0/3733055465 shutdown_connections 2023-12-24T20:01:56.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.213+0000 7f53f7407700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f53f0070640 0x7f53f0158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:56.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.213+0000 7f53f7407700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f53d4066f30 0x7f53d40693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:56.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.213+0000 7f53f7407700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f53f0159b00 0x7f53f0148260 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:56.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.213+0000 7f53f7407700 1 --2- 172.21.15.61:0/3733055465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53f00afee0 0x7f53f0169bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:01:56.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.213+0000 7f53f7407700 1 -- 172.21.15.61:0/3733055465 >> 172.21.15.61:0/3733055465 conn(0x7f53f00ca200 msgr2=0x7f53f01565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:01:56.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.213+0000 7f53f7407700 1 -- 172.21.15.61:0/3733055465 shutdown_connections 2023-12-24T20:01:56.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:01:56.213+0000 7f53f7407700 1 -- 172.21.15.61:0/3733055465 wait complete. 2023-12-24T20:01:56.281 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:01:59.812 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:01:59.812+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-24T20:02:00.822 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:02:00.822+0000 7f5e51f5c700 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2023-12-24T20:02:01.282 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:02:01.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.420+0000 7f1a16f0d700 1 Processor -- start 2023-12-24T20:02:01.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.420+0000 7f1a16f0d700 1 -- start start 2023-12-24T20:02:01.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.421+0000 7f1a16f0d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9910 0x7f1a10157040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:01.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.421+0000 7f1a16f0d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a100c9ce0 0x7f1a100af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:01.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.421+0000 7f1a16f0d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a10156bb0 con 0x7f1a100af900 2023-12-24T20:02:01.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.421+0000 7f1a16f0d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a101565d0 con 0x7f1a100c9ce0 2023-12-24T20:02:01.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.421+0000 7f1a16f0d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100afe10 con 0x7f1a100c9910 2023-12-24T20:02:01.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.421+0000 7f1a14ca9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9910 0x7f1a10157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:01.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.421+0000 7f1a14ca9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9910 0x7f1a10157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:54644/0 (socket says 172.21.15.61:54644) 2023-12-24T20:02:01.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.421+0000 7f1a0ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a100c9ce0 0x7f1a100af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:01.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.421+0000 7f1a14ca9700 1 -- 172.21.15.61:0/2235967604 learned_addr learned my addr 172.21.15.61:0/2235967604 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:01.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.422+0000 7f1a0f7fe700 1 -- 172.21.15.61:0/2235967604 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868516631 0 0) 0x7f1a10156bb0 con 0x7f1a100af900 2023-12-24T20:02:01.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.422+0000 7f1a0f7fe700 1 -- 172.21.15.61:0/2235967604 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a00003570 con 0x7f1a100af900 2023-12-24T20:02:01.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.422+0000 7f1a14ca9700 1 -- 172.21.15.61:0/2235967604 >> v2:172.21.15.133:3300/0 conn(0x7f1a100c9ce0 msgr2=0x7f1a100af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.422+0000 7f1a14ca9700 1 --2- 172.21.15.61:0/2235967604 >> v2:172.21.15.133:3300/0 conn(0x7f1a100c9ce0 0x7f1a100af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.422+0000 7f1a14ca9700 1 -- 172.21.15.61:0/2235967604 >> v1:172.21.15.133:6789/0 conn(0x7f1a100af900 legacy=0x7f1a100adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.422+0000 7f1a14ca9700 1 -- 172.21.15.61:0/2235967604 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100b00f0 con 0x7f1a100c9910 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.422+0000 7f1a14ca9700 1 --2- 172.21.15.61:0/2235967604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9910 0x7f1a10157040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400bc50 tx=0x7f1a0400b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64cd728b4501ecd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.422+0000 7f1a0f7fe700 1 -- 172.21.15.61:0/2235967604 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0400db40 con 0x7f1a100c9910 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.422+0000 7f1a0f7fe700 1 -- 172.21.15.61:0/2235967604 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0400dca0 con 0x7f1a100c9910 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.422+0000 7f1a0f7fe700 1 -- 172.21.15.61:0/2235967604 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040196b0 con 0x7f1a100c9910 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.423+0000 7f1a16f0d700 1 -- 172.21.15.61:0/2235967604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9910 msgr2=0x7f1a10157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.423+0000 7f1a16f0d700 1 --2- 172.21.15.61:0/2235967604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9910 0x7f1a10157040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400bc50 tx=0x7f1a0400b4f0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.423+0000 7f1a16f0d700 1 -- 172.21.15.61:0/2235967604 shutdown_connections 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.423+0000 7f1a16f0d700 1 --2- 172.21.15.61:0/2235967604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9910 0x7f1a10157040 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.423+0000 7f1a16f0d700 1 --2- 172.21.15.61:0/2235967604 >> v2:172.21.15.133:3300/0 conn(0x7f1a100c9ce0 0x7f1a100af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.423+0000 7f1a16f0d700 1 -- 172.21.15.61:0/2235967604 >> 172.21.15.61:0/2235967604 conn(0x7f1a10067fe0 msgr2=0x7f1a100cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:01.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.423+0000 7f1a16f0d700 1 -- 172.21.15.61:0/2235967604 shutdown_connections 2023-12-24T20:02:01.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.423+0000 7f1a16f0d700 1 -- 172.21.15.61:0/2235967604 wait complete. 2023-12-24T20:02:01.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.424+0000 7f1a16f0d700 1 Processor -- start 2023-12-24T20:02:01.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.424+0000 7f1a16f0d700 1 -- start start 2023-12-24T20:02:01.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a16f0d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a100af900 0x7f1a1016db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:01.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a16f0d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a100c9910 0x7f1a10151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:01.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a16f0d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9ce0 0x7f1a1015a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:01.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a16f0d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10159ab0 con 0x7f1a100af900 2023-12-24T20:02:01.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a16f0d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1016e0a0 con 0x7f1a100c9910 2023-12-24T20:02:01.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a16f0d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1016e340 con 0x7f1a100c9ce0 2023-12-24T20:02:01.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a14ca9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a100af900 0x7f1a1016db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:01.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a14ca9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a100af900 0x7f1a1016db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51200/0 (socket says 172.21.15.61:51200) 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a14ca9700 1 -- 172.21.15.61:0/1082324533 learned_addr learned my addr 172.21.15.61:0/1082324533 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a0ffff700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a100c9910 0x7f1a10151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a154aa700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9ce0 0x7f1a1015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a14ca9700 1 -- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9ce0 msgr2=0x7f1a1015a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a14ca9700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9ce0 0x7f1a1015a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a14ca9700 1 -- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a100c9910 msgr2=0x7f1a10151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a14ca9700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a100c9910 0x7f1a10151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.425+0000 7f1a14ca9700 1 -- 172.21.15.61:0/1082324533 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0400b790 con 0x7f1a100af900 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.426+0000 7f1a14ca9700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a100af900 0x7f1a1016db60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1a1006c2d0 tx=0x7f1a0401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.426+0000 7f1a0cff9700 1 -- 172.21.15.61:0/1082324533 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04010470 con 0x7f1a100af900 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.426+0000 7f1a0cff9700 1 -- 172.21.15.61:0/1082324533 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a040105d0 con 0x7f1a100af900 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.426+0000 7f1a16f0d700 1 -- 172.21.15.61:0/1082324533 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1016e620 con 0x7f1a100af900 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.426+0000 7f1a0cff9700 1 -- 172.21.15.61:0/1082324533 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04010970 con 0x7f1a100af900 2023-12-24T20:02:01.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.426+0000 7f1a16f0d700 1 -- 172.21.15.61:0/1082324533 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a10159d50 con 0x7f1a100af900 2023-12-24T20:02:01.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.427+0000 7f1a16f0d700 1 -- 172.21.15.61:0/1082324533 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1015a0c0 con 0x7f1a100af900 2023-12-24T20:02:01.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.427+0000 7f1a0cff9700 1 -- 172.21.15.61:0/1082324533 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1a0402c430 con 0x7f1a100af900 2023-12-24T20:02:01.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.428+0000 7f1a0cff9700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19f4066f30 0x7f19f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:01.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.428+0000 7f1a0cff9700 1 -- 172.21.15.61:0/1082324533 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f1a04014070 con 0x7f1a100af900 2023-12-24T20:02:01.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.428+0000 7f1a0cff9700 1 -- 172.21.15.61:0/1082324533 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=109}) v3 -- 0x7f19f406eab0 con 0x7f1a100af900 2023-12-24T20:02:01.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.428+0000 7f1a0ffff700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19f4066f30 0x7f19f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:01.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.429+0000 7f1a0ffff700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19f4066f30 0x7f19f40693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1a1006f330 tx=0x7f19fc0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:01.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.432+0000 7f1a0cff9700 1 -- 172.21.15.61:0/1082324533 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a04053630 con 0x7f1a100af900 2023-12-24T20:02:01.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.627+0000 7f1a16f0d700 1 -- 172.21.15.61:0/1082324533 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1a1006fc70 con 0x7f1a100af900 2023-12-24T20:02:01.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.628+0000 7f1a0cff9700 1 -- 172.21.15.61:0/1082324533 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v108) v1 ==== 81+0+32531 (secure 0 0 0) 0x7f1a04056c50 con 0x7f1a100af900 2023-12-24T20:02:01.629 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:01.630 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:01.630 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 108, 2023-12-24T20:02:01.630 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:02:01.630 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:02:01.630 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:02:00.823142+0000", 2023-12-24T20:02:01.630 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:02:01.631 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:02:01.631 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:02:01.631 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:02:01.631 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:02:01.631 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:02:01.631 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:02:01.631 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:02:01.631 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:02:01.631 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:01.631 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 13, 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "luminous", 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:02:01.632 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:02:01.633 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:02:01.634 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:02:01.635 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:02:01.636 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.637 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.638 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 12, 2023-12-24T20:02:01.638 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:02:01.638 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:28.014512+0000", 2023-12-24T20:02:01.638 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:02:01.638 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:02:01.638 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:02:01.638 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:02:01.638 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:02:01.638 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:02:01.638 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:02:01.639 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:02:01.639 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:02:01.639 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:02:01.639 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:02:01.639 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:02:01.639 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:02:01.639 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:02:01.639 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:02:01.639 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:02:01.639 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:02:01.640 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:02:01.640 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:02:01.640 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:02:01.640 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:02:01.640 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:02:01.640 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:02:01.640 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:02:01.640 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.640 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:02:01.641 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:02:01.641 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:02:01.641 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:02:01.641 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:02:01.641 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:02:01.641 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:02:01.641 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:02:01.641 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:02:01.642 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:02:01.643 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:02:01.643 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:02:01.643 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:02:01.643 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:02:01.643 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:02:01.643 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:02:01.643 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:02:01.643 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.643 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:02:01.643 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:02:01.644 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:02:01.644 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:02:01.644 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:02:01.644 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:02:01.644 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:02:01.644 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:02:01.644 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:02:01.644 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:02:01.644 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:02:01.645 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:02:01.645 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:02:01.645 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:02:01.645 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:02:01.645 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.645 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:02:01.645 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:02:01.645 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:02:01.645 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.646 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.646 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.646 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.646 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 13, 2023-12-24T20:02:01.646 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:02:01.646 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:29.062088+0000", 2023-12-24T20:02:01.646 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 3, 2023-12-24T20:02:01.646 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full", 2023-12-24T20:02:01.646 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:02:01.647 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:02:01.647 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:02:01.647 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:02:01.647 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:02:01.647 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:02:01.647 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:02:01.647 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:02:01.647 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:02:01.647 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:02:01.647 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:02:01.648 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:02:01.648 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:02:01.648 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:02:01.648 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:02:01.648 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:02:01.648 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:02:01.648 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:02:01.648 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:02:01.648 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:02:01.649 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:02:01.649 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:02:01.649 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.649 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "100", 2023-12-24T20:02:01.649 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:02:01.649 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:02:01.649 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:02:01.650 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:02:01.650 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:02:01.651 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:02:01.652 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:02:01.652 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:02:01.652 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:02:01.652 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:02:01.652 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:02:01.652 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:02:01.652 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:02:01.652 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:02:01.652 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:02:01.652 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.653 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:02:01.654 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:01.655 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.656 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.657 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.658 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:02:01.658 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:01.658 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.658 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.659 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.659 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:02:01.659 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:01.659 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.659 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.659 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.659 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:01.659 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.659 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.659 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.660 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.661 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.661 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:02:01.661 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:01.661 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.661 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.661 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.661 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.662 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.663 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.664 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.665 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.666 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:02:01.667 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:02:01.668 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:02:01.668 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:01.668 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:01.668 INFO:teuthology.orchestra.run.smithi061.stdout: "full", 2023-12-24T20:02:01.668 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:01.668 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.668 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.668 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.668 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.669 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:01.670 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.671 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.671 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.671 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:02:01.671 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:01.671 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.672 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.672 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:02:01.673 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.674 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:02:01.675 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:01.676 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 104, 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.677 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.678 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:01.679 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.680 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:01.681 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.682 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:01.683 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:01.684 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:01.684 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.684 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.684 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.684 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:02:01.684 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:01.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.684 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.685 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.685 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:02:01.685 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:01.685 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.686 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.687 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.688 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:01.689 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:02:01.690 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:02:01.691 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.692 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.693 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.693 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:02:01.693 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:01.693 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.693 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.693 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.693 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:01.693 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.693 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:02:01.694 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:01.695 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.696 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.697 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.698 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.700 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:01.701 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:01.702 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.703 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:01.704 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:02:01.705 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull", 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:01.706 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.707 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:01.708 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.709 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:01.710 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:01.711 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [ 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "13.3e", 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 1, 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 3 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:02:01.712 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:02:01.713 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:02:01.714 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:02:01.714 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:02:01.714 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:02:01.714 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:02:01.714 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:02:01.714 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:01.714 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 -- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19f4066f30 msgr2=0x7f19f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19f4066f30 0x7f19f40693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1a1006f330 tx=0x7f19fc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 -- 172.21.15.61:0/1082324533 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a100af900 msgr2=0x7f1a1016db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a100af900 0x7f1a1016db60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1a1006c2d0 tx=0x7f1a0401b000 comp rx=0 tx=0).stop 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 -- 172.21.15.61:0/1082324533 shutdown_connections 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1a100c9ce0 0x7f1a1015a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19f4066f30 0x7f19f40693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a100af900 0x7f1a1016db60 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 --2- 172.21.15.61:0/1082324533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a100c9910 0x7f1a10151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 -- 172.21.15.61:0/1082324533 >> 172.21.15.61:0/1082324533 conn(0x7f1a10067fe0 msgr2=0x7f1a100b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 -- 172.21.15.61:0/1082324533 shutdown_connections 2023-12-24T20:02:01.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:01.630+0000 7f1a16f0d700 1 -- 172.21.15.61:0/1082324533 wait complete. 2023-12-24T20:02:01.717 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:02:06.113 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:02:06.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:02:06.718 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:02:06.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.855+0000 7fbc844d1700 1 Processor -- start 2023-12-24T20:02:06.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.855+0000 7fbc844d1700 1 -- start start 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc844d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc7c15bb60 0x7fbc7c098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc844d1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbc7c098aa0 0x7fbc7c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc844d1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c0b2eb0 con 0x7fbc7c15c470 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc844d1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c0afc20 con 0x7fbc7c098aa0 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc844d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0b2bd0 con 0x7fbc7c15bb60 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc81a6c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbc7c098aa0 0x7fbc7c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc81a6c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbc7c098aa0 0x7fbc7c15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52686/0 (socket says 172.21.15.61:52686) 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc81a6c700 1 -- 172.21.15.61:0/2290770966 learned_addr learned my addr 172.21.15.61:0/2290770966 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc8226d700 1 --2- 172.21.15.61:0/2290770966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc7c15bb60 0x7fbc7c098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc81a6c700 1 -- 172.21.15.61:0/2290770966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc7c15bb60 msgr2=0x7fbc7c098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc81a6c700 1 --2- 172.21.15.61:0/2290770966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc7c15bb60 0x7fbc7c098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:06.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc81a6c700 1 -- 172.21.15.61:0/2290770966 >> v1:172.21.15.133:6789/0 conn(0x7fbc7c15c470 legacy=0x7fbc7c0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:06.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc81a6c700 1 -- 172.21.15.61:0/2290770966 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0afe10 con 0x7fbc7c098aa0 2023-12-24T20:02:06.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.856+0000 7fbc81a6c700 1 --2- 172.21.15.61:0/2290770966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 0x7fbc7c15bf30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0099b0 tx=0x7fbc6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fb184cfa04c261 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:06.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc8126b700 1 -- 172.21.15.61:0/2290770966 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c009ea0 con 0x7fbc7c098aa0 2023-12-24T20:02:06.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc8126b700 1 -- 172.21.15.61:0/2290770966 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c00b860 con 0x7fbc7c098aa0 2023-12-24T20:02:06.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc8126b700 1 -- 172.21.15.61:0/2290770966 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00bc00 con 0x7fbc7c098aa0 2023-12-24T20:02:06.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc844d1700 1 -- 172.21.15.61:0/2290770966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 msgr2=0x7fbc7c15bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:06.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc844d1700 1 --2- 172.21.15.61:0/2290770966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 0x7fbc7c15bf30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0099b0 tx=0x7fbc6c009250 comp rx=0 tx=0).stop 2023-12-24T20:02:06.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc844d1700 1 -- 172.21.15.61:0/2290770966 shutdown_connections 2023-12-24T20:02:06.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc844d1700 1 --2- 172.21.15.61:0/2290770966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc7c15bb60 0x7fbc7c098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:06.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc844d1700 1 --2- 172.21.15.61:0/2290770966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 0x7fbc7c15bf30 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:06.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc844d1700 1 -- 172.21.15.61:0/2290770966 >> 172.21.15.61:0/2290770966 conn(0x7fbc7c097a10 msgr2=0x7fbc7c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:06.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc844d1700 1 -- 172.21.15.61:0/2290770966 shutdown_connections 2023-12-24T20:02:06.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.857+0000 7fbc844d1700 1 -- 172.21.15.61:0/2290770966 wait complete. 2023-12-24T20:02:06.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.858+0000 7fbc844d1700 1 Processor -- start 2023-12-24T20:02:06.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.858+0000 7fbc844d1700 1 -- start start 2023-12-24T20:02:06.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc844d1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 0x7fbc7c169c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:06.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc844d1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc7c15bb60 0x7fbc7c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:06.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc844d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c15c470 0x7fbc7c155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:06.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc844d1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c152900 con 0x7fbc7c098aa0 2023-12-24T20:02:06.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc844d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c068ca0 con 0x7fbc7c15c470 2023-12-24T20:02:06.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc844d1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c1559a0 con 0x7fbc7c15bb60 2023-12-24T20:02:06.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc8226d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 0x7fbc7c169c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:06.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc8226d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 0x7fbc7c169c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52696/0 (socket says 172.21.15.61:52696) 2023-12-24T20:02:06.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc8226d700 1 -- 172.21.15.61:0/1229738357 learned_addr learned my addr 172.21.15.61:0/1229738357 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:06.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc82a6e700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c15c470 0x7fbc7c155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:06.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.859+0000 7fbc81a6c700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc7c15bb60 0x7fbc7c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:06.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc8226d700 1 -- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc7c15bb60 msgr2=0x7fbc7c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:06.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc8226d700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc7c15bb60 0x7fbc7c154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:06.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc8226d700 1 -- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c15c470 msgr2=0x7fbc7c155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:06.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc8226d700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c15c470 0x7fbc7c155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:06.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc8226d700 1 -- 172.21.15.61:0/1229738357 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0094f0 con 0x7fbc7c098aa0 2023-12-24T20:02:06.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc8226d700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 0x7fbc7c169c40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800ec80 tx=0x7fbc78009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:06.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc727fc700 1 -- 172.21.15.61:0/1229738357 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800c850 con 0x7fbc7c098aa0 2023-12-24T20:02:06.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc727fc700 1 -- 172.21.15.61:0/1229738357 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7800c9b0 con 0x7fbc7c098aa0 2023-12-24T20:02:06.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc844d1700 1 -- 172.21.15.61:0/1229738357 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c16a180 con 0x7fbc7c098aa0 2023-12-24T20:02:06.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc727fc700 1 -- 172.21.15.61:0/1229738357 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800cd30 con 0x7fbc7c098aa0 2023-12-24T20:02:06.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.860+0000 7fbc844d1700 1 -- 172.21.15.61:0/1229738357 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c068370 con 0x7fbc7c098aa0 2023-12-24T20:02:06.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.861+0000 7fbc844d1700 1 -- 172.21.15.61:0/1229738357 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c06d440 con 0x7fbc7c098aa0 2023-12-24T20:02:06.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.862+0000 7fbc727fc700 1 -- 172.21.15.61:0/1229738357 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbc78013680 con 0x7fbc7c098aa0 2023-12-24T20:02:06.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.862+0000 7fbc727fc700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbc60066f30 0x7fbc600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:06.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.862+0000 7fbc727fc700 1 -- 172.21.15.61:0/1229738357 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fbc78084ad0 con 0x7fbc7c098aa0 2023-12-24T20:02:06.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.862+0000 7fbc81a6c700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbc60066f30 0x7fbc600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:06.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.863+0000 7fbc81a6c700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbc60066f30 0x7fbc600693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0099b0 tx=0x7fbc6c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:06.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:06.866+0000 7fbc727fc700 1 -- 172.21.15.61:0/1229738357 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc78051d20 con 0x7fbc7c098aa0 2023-12-24T20:02:07.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.064+0000 7fbc844d1700 1 -- 172.21.15.61:0/1229738357 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbc7c04c3c0 con 0x7fbc7c098aa0 2023-12-24T20:02:07.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.065+0000 7fbc727fc700 1 -- 172.21.15.61:0/1229738357 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+32460 (secure 0 0 0) 0x7fbc78021090 con 0x7fbc7c098aa0 2023-12-24T20:02:07.066 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:07.066 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:07.066 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 110, 2023-12-24T20:02:07.066 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:02:07.066 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:02:07.067 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:02:02.833407+0000", 2023-12-24T20:02:07.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:02:07.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:02:07.067 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:02:07.067 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:02:07.068 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:02:07.068 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:02:07.068 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:02:07.068 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:02:07.068 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:02:07.068 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:07.068 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:02:07.068 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:02:07.068 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:02:07.069 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:02:07.069 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:02:07.069 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 13, 2023-12-24T20:02:07.069 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:02:07.069 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:02:07.069 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "luminous", 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:02:07.070 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:02:07.071 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:02:07.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:02:07.072 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:02:07.072 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:02:07.072 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:02:07.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:02:07.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:02:07.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:02:07.072 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:02:07.072 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:02:07.073 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:02:07.073 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:02:07.073 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:02:07.073 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:02:07.073 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:02:07.073 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:02:07.073 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:02:07.073 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:02:07.073 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:02:07.073 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:02:07.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:02:07.075 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:02:07.075 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:02:07.075 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:02:07.075 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:02:07.075 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:02:07.075 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:02:07.075 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:02:07.075 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:02:07.075 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 12, 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:28.014512+0000", 2023-12-24T20:02:07.076 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:02:07.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.078 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:02:07.079 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:02:07.080 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:02:07.081 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.082 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 13, 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:29.062088+0000", 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:02:07.083 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:02:07.084 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:02:07.085 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:02:07.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:02:07.087 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.088 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.089 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.090 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.091 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.092 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.093 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.094 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:02:07.095 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.096 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:02:07.097 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.098 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.099 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.100 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.101 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.102 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:02:07.103 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 104, 2023-12-24T20:02:07.104 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.105 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.106 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.107 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:02:07.108 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.109 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:02:07.110 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.111 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.112 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.113 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.114 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.115 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.116 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.118 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.123 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.124 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.125 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.127 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.128 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.129 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.132 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.133 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.134 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [ 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "13.3e", 2023-12-24T20:02:07.135 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 1, 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 3 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:02:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:02:07.137 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:02:07.138 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.138 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:07.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 -- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbc60066f30 msgr2=0x7fbc600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbc60066f30 0x7fbc600693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0099b0 tx=0x7fbc6c017000 comp rx=0 tx=0).stop 2023-12-24T20:02:07.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 -- 172.21.15.61:0/1229738357 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 msgr2=0x7fbc7c169c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 0x7fbc7c169c40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800ec80 tx=0x7fbc78009120 comp rx=0 tx=0).stop 2023-12-24T20:02:07.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 -- 172.21.15.61:0/1229738357 shutdown_connections 2023-12-24T20:02:07.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbc60066f30 0x7fbc600693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c15c470 0x7fbc7c155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc7c098aa0 0x7fbc7c169c40 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 --2- 172.21.15.61:0/1229738357 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc7c15bb60 0x7fbc7c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 -- 172.21.15.61:0/1229738357 >> 172.21.15.61:0/1229738357 conn(0x7fbc7c097a10 msgr2=0x7fbc7c0a8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:07.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 -- 172.21.15.61:0/1229738357 shutdown_connections 2023-12-24T20:02:07.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.067+0000 7fbc844d1700 1 -- 172.21.15.61:0/1229738357 wait complete. 2023-12-24T20:02:07.141 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-24T20:02:07.141 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:02:07.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.263+0000 7f4832c55700 1 Processor -- start 2023-12-24T20:02:07.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.263+0000 7f4832c55700 1 -- start start 2023-12-24T20:02:07.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.263+0000 7f4832c55700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f482c1599e0 0x7f482c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.263+0000 7f4832c55700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f482c0cbac0 0x7f482c0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.263+0000 7f4832c55700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c0cc2a0 con 0x7f482c0cd9b0 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f4832c55700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c0cedc0 con 0x7f482c0cbac0 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f4832c55700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c067f60 con 0x7f482c1599e0 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f482c0cbac0 0x7f482c0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f482c0cbac0 0x7f482c0cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52712/0 (socket says 172.21.15.61:52712) 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482bfff700 1 -- 172.21.15.61:0/1232992159 learned_addr learned my addr 172.21.15.61:0/1232992159 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f48309f1700 1 --2- 172.21.15.61:0/1232992159 >> v2:172.21.15.133:3300/0 conn(0x7f482c1599e0 0x7f482c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482bfff700 1 -- 172.21.15.61:0/1232992159 >> v2:172.21.15.133:3300/0 conn(0x7f482c1599e0 msgr2=0x7f482c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482bfff700 1 --2- 172.21.15.61:0/1232992159 >> v2:172.21.15.133:3300/0 conn(0x7f482c1599e0 0x7f482c15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482bfff700 1 -- 172.21.15.61:0/1232992159 >> v1:172.21.15.133:6789/0 conn(0x7f482c0cd9b0 legacy=0x7f482c15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482bfff700 1 -- 172.21.15.61:0/1232992159 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c15b040 con 0x7f482c0cbac0 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482bfff700 1 --2- 172.21.15.61:0/1232992159 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c0cbac0 0x7f482c0cd470 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f482c0895d0 tx=0x7f4818009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f770713810743222 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:07.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482b7fe700 1 -- 172.21.15.61:0/1232992159 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481800b820 con 0x7f482c0cbac0 2023-12-24T20:02:07.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482b7fe700 1 -- 172.21.15.61:0/1232992159 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481800b980 con 0x7f482c0cbac0 2023-12-24T20:02:07.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.264+0000 7f482b7fe700 1 -- 172.21.15.61:0/1232992159 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481800bd20 con 0x7f482c0cbac0 2023-12-24T20:02:07.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.265+0000 7f4832c55700 1 -- 172.21.15.61:0/1232992159 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c0cbac0 msgr2=0x7f482c0cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.265+0000 7f4832c55700 1 --2- 172.21.15.61:0/1232992159 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c0cbac0 0x7f482c0cd470 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f482c0895d0 tx=0x7f4818009250 comp rx=0 tx=0).stop 2023-12-24T20:02:07.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.265+0000 7f4832c55700 1 -- 172.21.15.61:0/1232992159 shutdown_connections 2023-12-24T20:02:07.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.265+0000 7f4832c55700 1 --2- 172.21.15.61:0/1232992159 >> v2:172.21.15.133:3300/0 conn(0x7f482c1599e0 0x7f482c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.265+0000 7f4832c55700 1 --2- 172.21.15.61:0/1232992159 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c0cbac0 0x7f482c0cd470 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.265+0000 7f4832c55700 1 -- 172.21.15.61:0/1232992159 >> 172.21.15.61:0/1232992159 conn(0x7f482c06e640 msgr2=0x7f482c067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:07.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.265+0000 7f4832c55700 1 -- 172.21.15.61:0/1232992159 shutdown_connections 2023-12-24T20:02:07.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.265+0000 7f4832c55700 1 -- 172.21.15.61:0/1232992159 wait complete. 2023-12-24T20:02:07.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.266+0000 7f4832c55700 1 Processor -- start 2023-12-24T20:02:07.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.266+0000 7f4832c55700 1 -- start start 2023-12-24T20:02:07.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f4832c55700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f482c0cbac0 0x7f482c1537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f4832c55700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f482c0cd9b0 0x7f482c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f4832c55700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c1599e0 0x7f482c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f4832c55700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c158ce0 con 0x7f482c1599e0 2023-12-24T20:02:07.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f4832c55700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0b42e0 con 0x7f482c0cbac0 2023-12-24T20:02:07.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f4832c55700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0b39b0 con 0x7f482c0cd9b0 2023-12-24T20:02:07.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f48311f2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c1599e0 0x7f482c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f48311f2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c1599e0 0x7f482c155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52722/0 (socket says 172.21.15.61:52722) 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f48311f2700 1 -- 172.21.15.61:0/2167007328 learned_addr learned my addr 172.21.15.61:0/2167007328 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f482bfff700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f482c0cd9b0 0x7f482c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.267+0000 7f48309f1700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f482c0cbac0 0x7f482c1537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f48311f2700 1 -- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f482c0cd9b0 msgr2=0x7f482c0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f48311f2700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f482c0cd9b0 0x7f482c0c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f48311f2700 1 -- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f482c0cbac0 msgr2=0x7f482c1537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f48311f2700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f482c0cbac0 0x7f482c1537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f48311f2700 1 -- 172.21.15.61:0/2167007328 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48180094f0 con 0x7f482c1599e0 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f48311f2700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c1599e0 0x7f482c155f40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f482400bc30 tx=0x7f4824009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f4828ff9700 1 -- 172.21.15.61:0/2167007328 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482400c840 con 0x7f482c1599e0 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f4828ff9700 1 -- 172.21.15.61:0/2167007328 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482400c9e0 con 0x7f482c1599e0 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f4832c55700 1 -- 172.21.15.61:0/2167007328 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c0b3c90 con 0x7f482c1599e0 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f4828ff9700 1 -- 172.21.15.61:0/2167007328 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482400cda0 con 0x7f482c1599e0 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.268+0000 7f4832c55700 1 -- 172.21.15.61:0/2167007328 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c158070 con 0x7f482c1599e0 2023-12-24T20:02:07.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.269+0000 7f4832c55700 1 -- 172.21.15.61:0/2167007328 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c04c3c0 con 0x7f482c1599e0 2023-12-24T20:02:07.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.270+0000 7f4828ff9700 1 -- 172.21.15.61:0/2167007328 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4824014620 con 0x7f482c1599e0 2023-12-24T20:02:07.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.270+0000 7f4828ff9700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4810066f30 0x7f48100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.270+0000 7f4828ff9700 1 -- 172.21.15.61:0/2167007328 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f48240844c0 con 0x7f482c1599e0 2023-12-24T20:02:07.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.270+0000 7f48309f1700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4810066f30 0x7f48100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.271+0000 7f48309f1700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4810066f30 0x7f48100693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f482c0cb3f0 tx=0x7f4820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:07.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.274+0000 7f4828ff9700 1 -- 172.21.15.61:0/2167007328 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f482404c5a0 con 0x7f482c1599e0 2023-12-24T20:02:07.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.471+0000 7f4832c55700 1 -- 172.21.15.61:0/2167007328 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f482c0d0420 con 0x7f482c1599e0 2023-12-24T20:02:07.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.472+0000 7f4828ff9700 1 -- 172.21.15.61:0/2167007328 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+32460 (secure 0 0 0) 0x7f4824051710 con 0x7f482c1599e0 2023-12-24T20:02:07.472 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:07.472 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 110, 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:02:02.833407+0000", 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:02:07.473 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 13, 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "luminous", 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:02:07.474 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:02:07.475 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:02:07.476 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:02:07.477 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:02:07.477 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:02:07.477 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:02:07.477 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:02:07.477 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:02:07.477 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:02:07.477 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:02:07.477 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:02:07.477 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:02:07.478 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:02:07.479 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 12, 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:28.014512+0000", 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:02:07.480 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:02:07.481 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:02:07.482 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:02:07.483 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:02:07.484 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.485 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 13, 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:01:29.062088+0000", 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:02:07.486 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:02:07.487 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:02:07.488 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:02:07.489 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:02:07.490 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.491 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:02:07.492 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:02:07.493 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.494 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.495 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.496 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.497 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.498 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.499 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.500 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:02:07.501 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.502 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.503 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:02:07.504 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:02:07.505 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:02:07.506 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:02:07.507 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 104, 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.508 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.509 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:02:07.510 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:02:07.511 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.512 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.513 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.514 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.515 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.516 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:02:07.517 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.518 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.519 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.520 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.521 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.522 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:02:07.523 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.524 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:02:07.525 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.526 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.527 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.528 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:02:07.529 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 97, 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:02:07.530 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.531 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.532 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.533 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.534 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.535 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.536 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.537 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.538 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.539 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [ 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "pgid": "13.3e", 2023-12-24T20:02:07.540 INFO:teuthology.orchestra.run.smithi061.stdout: "mappings": [ 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: "from": 1, 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: "to": 3 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:02:07.541 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:02:07.542 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:02:07.543 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:02:07.543 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:02:07.543 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:07.543 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:07.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 -- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4810066f30 msgr2=0x7f48100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4810066f30 0x7f48100693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f482c0cb3f0 tx=0x7f4820008040 comp rx=0 tx=0).stop 2023-12-24T20:02:07.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 -- 172.21.15.61:0/2167007328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c1599e0 msgr2=0x7f482c155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c1599e0 0x7f482c155f40 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f482400bc30 tx=0x7f4824009820 comp rx=0 tx=0).stop 2023-12-24T20:02:07.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 -- 172.21.15.61:0/2167007328 shutdown_connections 2023-12-24T20:02:07.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4810066f30 0x7f48100693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f482c1599e0 0x7f482c155f40 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f482c0cbac0 0x7f482c1537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 --2- 172.21.15.61:0/2167007328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f482c0cd9b0 0x7f482c0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 -- 172.21.15.61:0/2167007328 >> 172.21.15.61:0/2167007328 conn(0x7f482c06e640 msgr2=0x7f482c0c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:07.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 -- 172.21.15.61:0/2167007328 shutdown_connections 2023-12-24T20:02:07.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.474+0000 7f4832c55700 1 -- 172.21.15.61:0/2167007328 wait complete. 2023-12-24T20:02:07.546 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:07.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.667+0000 7ff31ce23700 1 Processor -- start 2023-12-24T20:02:07.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.668+0000 7ff31ce23700 1 -- start start 2023-12-24T20:02:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.668+0000 7ff31ce23700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3180b2660 0x7ff31815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.668+0000 7ff31ce23700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815c470 0x7ff3180b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.668+0000 7ff31ce23700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3180b2eb0 con 0x7ff31815bb60 2023-12-24T20:02:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.668+0000 7ff31ce23700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3180afc20 con 0x7ff3180b2660 2023-12-24T20:02:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.668+0000 7ff31ce23700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180b2bd0 con 0x7ff31815c470 2023-12-24T20:02:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31659c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff31815bb60 0x7ff318098560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39428/0 (socket says 172.21.15.61:39428) 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31659c700 1 -- 172.21.15.61:0/2042577513 learned_addr learned my addr 172.21.15.61:0/2042577513 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298960518 0 0) 0x7ff3180b2eb0 con 0x7ff31815bb60 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff315d9b700 1 --2- 172.21.15.61:0/2042577513 >> v2:172.21.15.133:3300/0 conn(0x7ff3180b2660 0x7ff31815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff316d9d700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815c470 0x7ff3180b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff300003570 con 0x7ff31815bb60 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2730495947 0 0) 0x7ff300003570 con 0x7ff31815bb60 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815c470 msgr2=0x7ff3180b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815c470 0x7ff3180b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 >> v2:172.21.15.133:3300/0 conn(0x7ff3180b2660 msgr2=0x7ff31815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 --2- 172.21.15.61:0/2042577513 >> v2:172.21.15.133:3300/0 conn(0x7ff3180b2660 0x7ff31815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3180afe10 con 0x7ff31815bb60 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7ff3080015f0 con 0x7ff31815bb60 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 >> v1:172.21.15.61:6789/0 conn(0x7ff31815bb60 legacy=0x7ff318098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff300003ae0 0x7ff300003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815c470 0x7ff300004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 0x7ff3000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180b2bd0 con 0x7ff300004d50 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30000bb10 con 0x7ff300003ae0 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30000bc50 con 0x7ff31815c470 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.669+0000 7ff316d9d700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 0x7ff3000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff31659c700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff300003ae0 0x7ff300003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff315d9b700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815c470 0x7ff300004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff316d9d700 1 -- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815c470 msgr2=0x7ff300004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff316d9d700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815c470 0x7ff300004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff316d9d700 1 -- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff300003ae0 msgr2=0x7ff300003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff316d9d700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff300003ae0 0x7ff300003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff316d9d700 1 -- 172.21.15.61:0/2042577513 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff300003570 con 0x7ff300004d50 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff316d9d700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 0x7ff3000051c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff31000e240 tx=0x7ff31000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d4d6c2056eb371 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:07.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31000eaf0 con 0x7ff300004d50 2023-12-24T20:02:07.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31000f040 con 0x7ff300004d50 2023-12-24T20:02:07.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.670+0000 7ff31559a700 1 -- 172.21.15.61:0/2042577513 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31000eea0 con 0x7ff300004d50 2023-12-24T20:02:07.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.671+0000 7ff31ce23700 1 -- 172.21.15.61:0/2042577513 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 msgr2=0x7ff3000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.671+0000 7ff31ce23700 1 --2- 172.21.15.61:0/2042577513 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 0x7ff3000051c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7ff31000e240 tx=0x7ff31000b040 comp rx=0 tx=0).stop 2023-12-24T20:02:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.671+0000 7ff316d9d700 1 -- 172.21.15.61:0/2042577513 reap_dead start 2023-12-24T20:02:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.671+0000 7ff31ce23700 1 -- 172.21.15.61:0/2042577513 shutdown_connections 2023-12-24T20:02:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.671+0000 7ff31ce23700 1 -- 172.21.15.61:0/2042577513 >> 172.21.15.61:0/2042577513 conn(0x7ff318097a10 msgr2=0x7ff3180ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:07.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.671+0000 7ff31ce23700 1 -- 172.21.15.61:0/2042577513 shutdown_connections 2023-12-24T20:02:07.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.671+0000 7ff31ce23700 1 -- 172.21.15.61:0/2042577513 wait complete. 2023-12-24T20:02:07.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.672+0000 7ff31ce23700 1 Processor -- start 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.672+0000 7ff31ce23700 1 -- start start 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31ce23700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 0x7ff318156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31ce23700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815cd50 0x7ff31815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31ce23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3180c8400 0x7ff3180c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31ce23700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff318068570 con 0x7ff300004d50 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31ce23700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180c9970 con 0x7ff3180c8400 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31ce23700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3181573f0 con 0x7ff31815cd50 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 0x7ff318156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 0x7ff318156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52726/0 (socket says 172.21.15.61:52726) 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31659c700 1 -- 172.21.15.61:0/2759651228 learned_addr learned my addr 172.21.15.61:0/2759651228 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff315d9b700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815cd50 0x7ff31815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff316d9d700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3180c8400 0x7ff3180c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31659c700 1 -- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815cd50 msgr2=0x7ff31815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31659c700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815cd50 0x7ff31815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31659c700 1 -- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3180c8400 msgr2=0x7ff3180c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31659c700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3180c8400 0x7ff3180c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31659c700 1 -- 172.21.15.61:0/2759651228 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31815d700 con 0x7ff300004d50 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31659c700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 0x7ff318156eb0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ff30800fc30 tx=0x7ff308009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff3067fc700 1 -- 172.21.15.61:0/2759651228 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080072e0 con 0x7ff300004d50 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff3067fc700 1 -- 172.21.15.61:0/2759651228 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff308007480 con 0x7ff300004d50 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31ce23700 1 -- 172.21.15.61:0/2759651228 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31816a400 con 0x7ff300004d50 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff3067fc700 1 -- 172.21.15.61:0/2759651228 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080057f0 con 0x7ff300004d50 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.673+0000 7ff31ce23700 1 -- 172.21.15.61:0/2759651228 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3180c93b0 con 0x7ff300004d50 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.674+0000 7ff31ce23700 1 -- 172.21.15.61:0/2759651228 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31816a1b0 con 0x7ff300004d50 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.675+0000 7ff3067fc700 1 -- 172.21.15.61:0/2759651228 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff308005b60 con 0x7ff300004d50 2023-12-24T20:02:07.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.675+0000 7ff3067fc700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f8066f30 0x7ff2f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:07.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.675+0000 7ff3067fc700 1 -- 172.21.15.61:0/2759651228 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7ff3080845f0 con 0x7ff300004d50 2023-12-24T20:02:07.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.675+0000 7ff315d9b700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f8066f30 0x7ff2f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:07.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.676+0000 7ff315d9b700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f8066f30 0x7ff2f80693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff318069220 tx=0x7ff30c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:07.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.679+0000 7ff3067fc700 1 -- 172.21.15.61:0/2759651228 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff308051840 con 0x7ff300004d50 2023-12-24T20:02:07.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.921+0000 7ff31ce23700 1 -- 172.21.15.61:0/2759651228 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff31806d440 con 0x7ff300004d50 2023-12-24T20:02:07.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.921+0000 7ff3067fc700 1 -- 172.21.15.61:0/2759651228 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7ff308054e60 con 0x7ff300004d50 2023-12-24T20:02:07.922 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:07.922 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2634636374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2634636374},{"type":"v1","addr":"172.21.15.61:6835","nonce":2634636374}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/856986572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":856986572},{"type":"v1","addr":"172.21.15.133:6836","nonce":856986572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1475170652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1475170652},{"type":"v1","addr":"172.21.15.133:6837","nonce":1475170652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:01:30.072202+0000","modified":"2023-12-24T20:01:33.718490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2512648595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2512648595},{"type":"v1","addr":"172.21.15.61:6834","nonce":2512648595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T20:02:07.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 -- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f8066f30 msgr2=0x7ff2f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f8066f30 0x7ff2f80693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff318069220 tx=0x7ff30c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 -- 172.21.15.61:0/2759651228 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 msgr2=0x7ff318156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:07.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 0x7ff318156eb0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7ff30800fc30 tx=0x7ff308009040 comp rx=0 tx=0).stop 2023-12-24T20:02:07.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 -- 172.21.15.61:0/2759651228 shutdown_connections 2023-12-24T20:02:07.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff2f8066f30 0x7ff2f80693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3180c8400 0x7ff3180c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff300004d50 0x7ff318156eb0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 --2- 172.21.15.61:0/2759651228 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff31815cd50 0x7ff31815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:07.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 -- 172.21.15.61:0/2759651228 >> 172.21.15.61:0/2759651228 conn(0x7ff318097a10 msgr2=0x7ff3180ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:07.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 -- 172.21.15.61:0/2759651228 shutdown_connections 2023-12-24T20:02:07.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:07.923+0000 7ff31ce23700 1 -- 172.21.15.61:0/2759651228 wait complete. 2023-12-24T20:02:07.925 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 52 2023-12-24T20:02:07.936 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-24T20:02:08.077 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":6318,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":37.374180434000003,"mdsmap_epoch":52,"osdmap_epoch":110,"osdmap_epoch_barrier":102,"uptime":43.295110293} 2023-12-24T20:02:08.077 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 6318, "mdsmap_epoch": 52, "osdmap_epoch": 110, "osdmap_epoch_barrier": 102, "rank_uptime": 37.374180434, "state": "up:active", "uptime": 43.295110293, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:02:08.077 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-24T20:02:08.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:08.078 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-24T20:02:08.381 INFO:teuthology.orchestra.run.smithi061.stderr:50+0 records in 2023-12-24T20:02:08.381 INFO:teuthology.orchestra.run.smithi061.stderr:50+0 records out 2023-12-24T20:02:08.381 INFO:teuthology.orchestra.run.smithi061.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.284447 s, 184 MB/s 2023-12-24T20:02:08.382 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:02:08.383 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:02:08.426 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:02:08.472 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:02:08.472 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T20:02:08.472 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:02:08.472 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T20:02:08.513 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[60640]: fuse finished with error 0 and tester_r 0 2023-12-24T20:02:08.517 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:02:08.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:08.517 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:02:08.679 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T20:02:08.679 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:02:08.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T20:02:08.717 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[45772]: fuse finished with error 0 and tester_r 0 2023-12-24T20:02:08.719 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:02:08.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:08.719 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T20:02:08.889 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:02:08.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:08.890 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T20:02:08.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:02:08.908 INFO:teuthology.orchestra.run.smithi061.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-24T20:02:08.908 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:02:08.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:08.908 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T20:02:08.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:02:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-24T20:02:08.949 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.072+0000 7feda2777700 1 Processor -- start 2023-12-24T20:02:09.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.072+0000 7feda2777700 1 -- start start 2023-12-24T20:02:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.073+0000 7feda2777700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159850 0x7fed9c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.073+0000 7feda2777700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fed9c06aac0 0x7fed9c0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.073+0000 7feda2777700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c06a630 con 0x7fed9c0caa80 2023-12-24T20:02:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.073+0000 7feda2777700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c069d00 con 0x7fed9c06aac0 2023-12-24T20:02:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.073+0000 7feda2777700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c069fe0 con 0x7fed9c159850 2023-12-24T20:02:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.073+0000 7fed9b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fed9c06aac0 0x7fed9c0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.073+0000 7fed9b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fed9c06aac0 0x7fed9c0cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52742/0 (socket says 172.21.15.61:52742) 2023-12-24T20:02:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.073+0000 7fed9b7fe700 1 -- 172.21.15.61:0/1132122470 learned_addr learned my addr 172.21.15.61:0/1132122470 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.073+0000 7fed9bfff700 1 --2- 172.21.15.61:0/1132122470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159850 0x7fed9c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7fed9b7fe700 1 -- 172.21.15.61:0/1132122470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159850 msgr2=0x7fed9c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7fed9b7fe700 1 --2- 172.21.15.61:0/1132122470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159850 0x7fed9c159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7fed9b7fe700 1 -- 172.21.15.61:0/1132122470 >> v1:172.21.15.133:6789/0 conn(0x7fed9c0caa80 legacy=0x7fed9c0aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7fed9b7fe700 1 -- 172.21.15.61:0/1132122470 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c06a2c0 con 0x7fed9c06aac0 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7fed9b7fe700 1 --2- 172.21.15.61:0/1132122470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c06aac0 0x7fed9c0cc5e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fed840099b0 tx=0x7fed84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b311c5c7db7f2f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7fed9affd700 1 -- 172.21.15.61:0/1132122470 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8400b860 con 0x7fed9c06aac0 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7fed9affd700 1 -- 172.21.15.61:0/1132122470 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8400b9c0 con 0x7fed9c06aac0 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7fed9affd700 1 -- 172.21.15.61:0/1132122470 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8400bd60 con 0x7fed9c06aac0 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7feda2777700 1 -- 172.21.15.61:0/1132122470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c06aac0 msgr2=0x7fed9c0cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7feda2777700 1 --2- 172.21.15.61:0/1132122470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c06aac0 0x7fed9c0cc5e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fed840099b0 tx=0x7fed84009250 comp rx=0 tx=0).stop 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7feda2777700 1 -- 172.21.15.61:0/1132122470 shutdown_connections 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7feda2777700 1 --2- 172.21.15.61:0/1132122470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159850 0x7fed9c159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7feda2777700 1 --2- 172.21.15.61:0/1132122470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c06aac0 0x7fed9c0cc5e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.074+0000 7feda2777700 1 -- 172.21.15.61:0/1132122470 >> 172.21.15.61:0/1132122470 conn(0x7fed9c0cceb0 msgr2=0x7fed9c0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.075+0000 7feda2777700 1 -- 172.21.15.61:0/1132122470 shutdown_connections 2023-12-24T20:02:09.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.075+0000 7feda2777700 1 -- 172.21.15.61:0/1132122470 wait complete. 2023-12-24T20:02:09.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.076+0000 7feda2777700 1 Processor -- start 2023-12-24T20:02:09.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.076+0000 7feda2777700 1 -- start start 2023-12-24T20:02:09.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.076+0000 7feda2777700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed9c06aac0 0x7fed9c0c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.076+0000 7feda2777700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c0caa80 0x7fed9c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.076+0000 7feda2777700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159850 0x7fed9c16cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.076+0000 7feda2777700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c16d0f0 con 0x7fed9c0caa80 2023-12-24T20:02:09.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.076+0000 7feda2777700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c1525b0 con 0x7fed9c06aac0 2023-12-24T20:02:09.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.076+0000 7feda2777700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c169e00 con 0x7fed9c159850 2023-12-24T20:02:09.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c0caa80 0x7fed9c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed9b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c0caa80 0x7fed9c15cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52750/0 (socket says 172.21.15.61:52750) 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed9b7fe700 1 -- 172.21.15.61:0/2523196460 learned_addr learned my addr 172.21.15.61:0/2523196460 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed9bfff700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed9c06aac0 0x7fed9c0c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7feda0d14700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159850 0x7fed9c16cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed9b7fe700 1 -- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159850 msgr2=0x7fed9c16cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed9b7fe700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159850 0x7fed9c16cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed9b7fe700 1 -- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed9c06aac0 msgr2=0x7fed9c0c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed9b7fe700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed9c06aac0 0x7fed9c0c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed9b7fe700 1 -- 172.21.15.61:0/2523196460 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed840094f0 con 0x7fed9c0caa80 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed9b7fe700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c0caa80 0x7fed9c15cd40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fed84006fd0 tx=0x7fed84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed93fff700 1 -- 172.21.15.61:0/2523196460 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84024440 con 0x7fed9c0caa80 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed93fff700 1 -- 172.21.15.61:0/2523196460 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed840245c0 con 0x7fed9c0caa80 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7feda2777700 1 -- 172.21.15.61:0/2523196460 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c16a0e0 con 0x7fed9c0caa80 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7fed93fff700 1 -- 172.21.15.61:0/2523196460 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84024980 con 0x7fed9c0caa80 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.077+0000 7feda2777700 1 -- 172.21.15.61:0/2523196460 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c16a6a0 con 0x7fed9c0caa80 2023-12-24T20:02:09.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.078+0000 7feda2777700 1 -- 172.21.15.61:0/2523196460 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c04c3c0 con 0x7fed9c0caa80 2023-12-24T20:02:09.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.079+0000 7fed93fff700 1 -- 172.21.15.61:0/2523196460 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fed8401a420 con 0x7fed9c0caa80 2023-12-24T20:02:09.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.079+0000 7fed93fff700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed7c066f30 0x7fed7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.079+0000 7fed93fff700 1 -- 172.21.15.61:0/2523196460 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fed84086320 con 0x7fed9c0caa80 2023-12-24T20:02:09.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.079+0000 7fed9bfff700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed7c066f30 0x7fed7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.080+0000 7fed9bfff700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed7c066f30 0x7fed7c0693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fed8c006fd0 tx=0x7fed8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:09.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.084+0000 7fed93fff700 1 -- 172.21.15.61:0/2523196460 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed84053570 con 0x7fed9c0caa80 2023-12-24T20:02:09.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.327+0000 7feda2777700 1 -- 172.21.15.61:0/2523196460 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed9c0ccb20 con 0x7fed9c0caa80 2023-12-24T20:02:09.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.328+0000 7fed93fff700 1 -- 172.21.15.61:0/2523196460 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fed84056b90 con 0x7fed9c0caa80 2023-12-24T20:02:09.328 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:09.328 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2634636374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2634636374},{"type":"v1","addr":"172.21.15.61:6835","nonce":2634636374}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/856986572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":856986572},{"type":"v1","addr":"172.21.15.133:6836","nonce":856986572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1475170652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1475170652},{"type":"v1","addr":"172.21.15.133:6837","nonce":1475170652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:01:30.072202+0000","modified":"2023-12-24T20:01:33.718490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2512648595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2512648595},{"type":"v1","addr":"172.21.15.61:6834","nonce":2512648595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T20:02:09.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 -- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed7c066f30 msgr2=0x7fed7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed7c066f30 0x7fed7c0693e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fed8c006fd0 tx=0x7fed8c008040 comp rx=0 tx=0).stop 2023-12-24T20:02:09.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 -- 172.21.15.61:0/2523196460 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c0caa80 msgr2=0x7fed9c15cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c0caa80 0x7fed9c15cd40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fed84006fd0 tx=0x7fed84017000 comp rx=0 tx=0).stop 2023-12-24T20:02:09.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 -- 172.21.15.61:0/2523196460 shutdown_connections 2023-12-24T20:02:09.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed9c159850 0x7fed9c16cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed7c066f30 0x7fed7c0693e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed9c06aac0 0x7fed9c0c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 --2- 172.21.15.61:0/2523196460 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed9c0caa80 0x7fed9c15cd40 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 -- 172.21.15.61:0/2523196460 >> 172.21.15.61:0/2523196460 conn(0x7fed9c0cceb0 msgr2=0x7fed9c1572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:09.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 -- 172.21.15.61:0/2523196460 shutdown_connections 2023-12-24T20:02:09.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.330+0000 7feda2777700 1 -- 172.21.15.61:0/2523196460 wait complete. 2023-12-24T20:02:09.331 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 52 2023-12-24T20:02:09.343 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:09.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.464+0000 7f7d3f388700 1 Processor -- start 2023-12-24T20:02:09.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.464+0000 7f7d3f388700 1 -- start start 2023-12-24T20:02:09.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3f388700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7d3806ec70 0x7f7d3806f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3f388700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d381595e0 0x7f7d38159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3f388700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d380cd9c0 0x7f7d380cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3f388700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3806c300 con 0x7f7d3806ec70 2023-12-24T20:02:09.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3f388700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3806ce80 con 0x7f7d380cd9c0 2023-12-24T20:02:09.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3f388700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38159fa0 con 0x7f7d381595e0 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3d124700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7d3806ec70 0x7f7d3806f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3d124700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7d3806ec70 0x7f7d3806f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52758/0 (socket says 172.21.15.61:52758) 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3d124700 1 -- 172.21.15.61:0/4155361321 learned_addr learned my addr 172.21.15.61:0/4155361321 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3d925700 1 --2- 172.21.15.61:0/4155361321 >> v2:172.21.15.133:3300/0 conn(0x7f7d380cd9c0 0x7f7d380cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3c923700 1 --2- 172.21.15.61:0/4155361321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d381595e0 0x7f7d38159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3d124700 1 -- 172.21.15.61:0/4155361321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d381595e0 msgr2=0x7f7d38159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3d124700 1 --2- 172.21.15.61:0/4155361321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d381595e0 0x7f7d38159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3d124700 1 -- 172.21.15.61:0/4155361321 >> v2:172.21.15.133:3300/0 conn(0x7f7d380cd9c0 msgr2=0x7f7d380cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3d124700 1 --2- 172.21.15.61:0/4155361321 >> v2:172.21.15.133:3300/0 conn(0x7f7d380cd9c0 0x7f7d380cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3d124700 1 -- 172.21.15.61:0/4155361321 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3806c550 con 0x7f7d3806ec70 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.465+0000 7f7d3c923700 1 --2- 172.21.15.61:0/4155361321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d381595e0 0x7f7d38159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d3d124700 1 --2- 172.21.15.61:0/4155361321 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d3806ec70 0x7f7d3806f040 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7d380cb250 tx=0x7f7d28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6fc8c0420d048a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d2ffff700 1 -- 172.21.15.61:0/4155361321 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28009e70 con 0x7f7d3806ec70 2023-12-24T20:02:09.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d2ffff700 1 -- 172.21.15.61:0/4155361321 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2800b860 con 0x7f7d3806ec70 2023-12-24T20:02:09.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d2ffff700 1 -- 172.21.15.61:0/4155361321 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2800bc00 con 0x7f7d3806ec70 2023-12-24T20:02:09.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d3f388700 1 -- 172.21.15.61:0/4155361321 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d3806ec70 msgr2=0x7f7d3806f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d3f388700 1 --2- 172.21.15.61:0/4155361321 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d3806ec70 0x7f7d3806f040 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7d380cb250 tx=0x7f7d28009250 comp rx=0 tx=0).stop 2023-12-24T20:02:09.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d3f388700 1 -- 172.21.15.61:0/4155361321 shutdown_connections 2023-12-24T20:02:09.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d3f388700 1 --2- 172.21.15.61:0/4155361321 >> v2:172.21.15.133:3300/0 conn(0x7f7d380cd9c0 0x7f7d380cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d3f388700 1 --2- 172.21.15.61:0/4155361321 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d3806ec70 0x7f7d3806f040 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d3f388700 1 --2- 172.21.15.61:0/4155361321 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d381595e0 0x7f7d38159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.466+0000 7f7d3f388700 1 -- 172.21.15.61:0/4155361321 >> 172.21.15.61:0/4155361321 conn(0x7f7d3806b650 msgr2=0x7f7d380ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:09.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.467+0000 7f7d3f388700 1 -- 172.21.15.61:0/4155361321 shutdown_connections 2023-12-24T20:02:09.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.467+0000 7f7d3f388700 1 -- 172.21.15.61:0/4155361321 wait complete. 2023-12-24T20:02:09.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.468+0000 7f7d3f388700 1 Processor -- start 2023-12-24T20:02:09.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.468+0000 7f7d3f388700 1 -- start start 2023-12-24T20:02:09.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3f388700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d3806ec70 0x7f7d38153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3f388700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380cd9c0 0x7f7d380b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3f388700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d381595e0 0x7f7d380689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3f388700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38169a20 con 0x7f7d381595e0 2023-12-24T20:02:09.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3f388700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38154330 con 0x7f7d380cd9c0 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3f388700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3816a830 con 0x7f7d3806ec70 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3d925700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d381595e0 0x7f7d380689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3d925700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d381595e0 0x7f7d380689f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52762/0 (socket says 172.21.15.61:52762) 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3d925700 1 -- 172.21.15.61:0/3273125696 learned_addr learned my addr 172.21.15.61:0/3273125696 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3d124700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d3806ec70 0x7f7d38153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3c923700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380cd9c0 0x7f7d380b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3d925700 1 -- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d3806ec70 msgr2=0x7f7d38153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3d925700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d3806ec70 0x7f7d38153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3d925700 1 -- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380cd9c0 msgr2=0x7f7d380b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3d925700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380cd9c0 0x7f7d380b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3d925700 1 -- 172.21.15.61:0/3273125696 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d280094f0 con 0x7f7d381595e0 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3d925700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d381595e0 0x7f7d380689f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009e90 tx=0x7f7d3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:09.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d2d7fa700 1 -- 172.21.15.61:0/3273125696 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000cb10 con 0x7f7d381595e0 2023-12-24T20:02:09.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d2d7fa700 1 -- 172.21.15.61:0/3273125696 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3000f040 con 0x7f7d381595e0 2023-12-24T20:02:09.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3f388700 1 -- 172.21.15.61:0/3273125696 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d38169c20 con 0x7f7d381595e0 2023-12-24T20:02:09.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d2d7fa700 1 -- 172.21.15.61:0/3273125696 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000cee0 con 0x7f7d381595e0 2023-12-24T20:02:09.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.469+0000 7f7d3f388700 1 -- 172.21.15.61:0/3273125696 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3816a4c0 con 0x7f7d381595e0 2023-12-24T20:02:09.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.470+0000 7f7d3f388700 1 -- 172.21.15.61:0/3273125696 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3804c3c0 con 0x7f7d381595e0 2023-12-24T20:02:09.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.471+0000 7f7d2d7fa700 1 -- 172.21.15.61:0/3273125696 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7d30014690 con 0x7f7d381595e0 2023-12-24T20:02:09.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.471+0000 7f7d2d7fa700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7d1c066f30 0x7f7d1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.471+0000 7f7d2d7fa700 1 -- 172.21.15.61:0/3273125696 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f7d30084ee0 con 0x7f7d381595e0 2023-12-24T20:02:09.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.472+0000 7f7d3d124700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7d1c066f30 0x7f7d1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.472+0000 7f7d3d124700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7d1c066f30 0x7f7d1c0693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7d380cb250 tx=0x7f7d28017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:09.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.476+0000 7f7d2d7fa700 1 -- 172.21.15.61:0/3273125696 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d30055bc0 con 0x7f7d381595e0 2023-12-24T20:02:09.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.675+0000 7f7d3f388700 1 -- 172.21.15.61:0/3273125696 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d3806c830 con 0x7f7d381595e0 2023-12-24T20:02:09.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.676+0000 7f7d2d7fa700 1 -- 172.21.15.61:0/3273125696 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+15408 (secure 0 0 0) 0x7f7d30055750 con 0x7f7d381595e0 2023-12-24T20:02:09.676 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:09.677 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":110,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:02.833407+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:01:28.014512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-24T20:01:29.062088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:09.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.678+0000 7f7d3f388700 1 -- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7d1c066f30 msgr2=0x7f7d1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.678+0000 7f7d3f388700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7d1c066f30 0x7f7d1c0693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7d380cb250 tx=0x7f7d28017000 comp rx=0 tx=0).stop 2023-12-24T20:02:09.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.678+0000 7f7d3f388700 1 -- 172.21.15.61:0/3273125696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d381595e0 msgr2=0x7f7d380689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.678+0000 7f7d3f388700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d381595e0 0x7f7d380689f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009e90 tx=0x7f7d3000b040 comp rx=0 tx=0).stop 2023-12-24T20:02:09.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.679+0000 7f7d3f388700 1 -- 172.21.15.61:0/3273125696 shutdown_connections 2023-12-24T20:02:09.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.679+0000 7f7d3f388700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7d3806ec70 0x7f7d38153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.679+0000 7f7d3f388700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7d1c066f30 0x7f7d1c0693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.679+0000 7f7d3f388700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7d381595e0 0x7f7d380689f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.679+0000 7f7d3f388700 1 --2- 172.21.15.61:0/3273125696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d380cd9c0 0x7f7d380b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.679+0000 7f7d3f388700 1 -- 172.21.15.61:0/3273125696 >> 172.21.15.61:0/3273125696 conn(0x7f7d3806b650 msgr2=0x7f7d380c4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:09.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.679+0000 7f7d3f388700 1 -- 172.21.15.61:0/3273125696 shutdown_connections 2023-12-24T20:02:09.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.679+0000 7f7d3f388700 1 -- 172.21.15.61:0/3273125696 wait complete. 2023-12-24T20:02:09.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T20:01:28.014512+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T20:01:29.062088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:02:09.693 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:02:09.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.818+0000 7f36519af700 1 Processor -- start 2023-12-24T20:02:09.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.818+0000 7f36519af700 1 -- start start 2023-12-24T20:02:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f36519af700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c1598d0 0x7f364c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f36519af700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f364c06e280 0x7f364c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f36519af700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c0cbf80 con 0x7f364c159ca0 2023-12-24T20:02:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f36519af700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364c15a110 con 0x7f364c06e280 2023-12-24T20:02:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f36519af700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0b11c0 con 0x7f364c1598d0 2023-12-24T20:02:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f364b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f364c06e280 0x7f364c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f364b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f364c06e280 0x7f364c0cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52768/0 (socket says 172.21.15.61:52768) 2023-12-24T20:02:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f364b7fe700 1 -- 172.21.15.61:0/1438574660 learned_addr learned my addr 172.21.15.61:0/1438574660 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f364affd700 1 --2- 172.21.15.61:0/1438574660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c1598d0 0x7f364c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f364b7fe700 1 -- 172.21.15.61:0/1438574660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c1598d0 msgr2=0x7f364c0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f364b7fe700 1 --2- 172.21.15.61:0/1438574660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c1598d0 0x7f364c0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f364b7fe700 1 -- 172.21.15.61:0/1438574660 >> v1:172.21.15.133:6789/0 conn(0x7f364c159ca0 legacy=0x7f364c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f364b7fe700 1 -- 172.21.15.61:0/1438574660 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c0b14a0 con 0x7f364c06e280 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f364affd700 1 --2- 172.21.15.61:0/1438574660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c1598d0 0x7f364c0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.819+0000 7f364b7fe700 1 --2- 172.21.15.61:0/1438574660 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c06e280 0x7f364c0cc410 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3644009f20 tx=0x7f3644009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4cd1a9e7825eb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f3649ffb700 1 -- 172.21.15.61:0/1438574660 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400e070 con 0x7f364c06e280 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f3649ffb700 1 -- 172.21.15.61:0/1438574660 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364400ba40 con 0x7f364c06e280 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f3649ffb700 1 -- 172.21.15.61:0/1438574660 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36440092e0 con 0x7f364c06e280 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f36519af700 1 -- 172.21.15.61:0/1438574660 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c06e280 msgr2=0x7f364c0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f36519af700 1 --2- 172.21.15.61:0/1438574660 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c06e280 0x7f364c0cc410 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f3644009f20 tx=0x7f3644009840 comp rx=0 tx=0).stop 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f36519af700 1 -- 172.21.15.61:0/1438574660 shutdown_connections 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f36519af700 1 --2- 172.21.15.61:0/1438574660 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c06e280 0x7f364c0cc410 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f36519af700 1 --2- 172.21.15.61:0/1438574660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c1598d0 0x7f364c0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f36519af700 1 -- 172.21.15.61:0/1438574660 >> 172.21.15.61:0/1438574660 conn(0x7f364c067550 msgr2=0x7f364c067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:09.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f36519af700 1 -- 172.21.15.61:0/1438574660 shutdown_connections 2023-12-24T20:02:09.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.820+0000 7f36519af700 1 -- 172.21.15.61:0/1438574660 wait complete. 2023-12-24T20:02:09.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.821+0000 7f36519af700 1 Processor -- start 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.822+0000 7f36519af700 1 -- start start 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.822+0000 7f36519af700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364c06e280 0x7f364c15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.822+0000 7f36519af700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c1598d0 0x7f364c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.822+0000 7f36519af700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c159ca0 0x7f364c16aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.822+0000 7f36519af700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0c8b60 con 0x7f364c1598d0 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.822+0000 7f36519af700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c15c560 con 0x7f364c06e280 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.822+0000 7f36519af700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c16b410 con 0x7f364c159ca0 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.822+0000 7f364a7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c1598d0 0x7f364c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.822+0000 7f364a7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c1598d0 0x7f364c15c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52778/0 (socket says 172.21.15.61:52778) 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.822+0000 7f364a7fc700 1 -- 172.21.15.61:0/3629204331 learned_addr learned my addr 172.21.15.61:0/3629204331 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f364b7fe700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c159ca0 0x7f364c16aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f364a7fc700 1 -- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c159ca0 msgr2=0x7f364c16aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f364affd700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364c06e280 0x7f364c15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f364a7fc700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c159ca0 0x7f364c16aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f364a7fc700 1 -- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364c06e280 msgr2=0x7f364c15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f364a7fc700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364c06e280 0x7f364c15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f364a7fc700 1 -- 172.21.15.61:0/3629204331 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644009ae0 con 0x7f364c1598d0 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f364b7fe700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c159ca0 0x7f364c16aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f364affd700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364c06e280 0x7f364c15a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f364a7fc700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c1598d0 0x7f364c15c020 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f363c00c5d0 tx=0x7f363c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f3632ffd700 1 -- 172.21.15.61:0/3629204331 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c011590 con 0x7f364c1598d0 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f36519af700 1 -- 172.21.15.61:0/3629204331 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c15aca0 con 0x7f364c1598d0 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f3632ffd700 1 -- 172.21.15.61:0/3629204331 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c011710 con 0x7f364c1598d0 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f3632ffd700 1 -- 172.21.15.61:0/3629204331 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c011ad0 con 0x7f364c1598d0 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.823+0000 7f36519af700 1 -- 172.21.15.61:0/3629204331 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c15b260 con 0x7f364c1598d0 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.824+0000 7f36519af700 1 -- 172.21.15.61:0/3629204331 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364c089120 con 0x7f364c1598d0 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.824+0000 7f3632ffd700 1 -- 172.21.15.61:0/3629204331 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f363c01c460 con 0x7f364c1598d0 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.825+0000 7f3632ffd700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3638066f30 0x7f36380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.825+0000 7f3632ffd700 1 -- 172.21.15.61:0/3629204331 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f363c0843d0 con 0x7f364c1598d0 2023-12-24T20:02:09.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.825+0000 7f364affd700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3638066f30 0x7f36380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:09.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.826+0000 7f364affd700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3638066f30 0x7f36380693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3640006fd0 tx=0x7f3640008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:09.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:09.829+0000 7f3632ffd700 1 -- 172.21.15.61:0/3629204331 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f363c051620 con 0x7f364c1598d0 2023-12-24T20:02:10.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.020+0000 7f36519af700 1 -- 172.21.15.61:0/3629204331 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f364c04c3c0 con 0x7f364c1598d0 2023-12-24T20:02:10.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.021+0000 7f3632ffd700 1 -- 172.21.15.61:0/3629204331 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f363c054c40 con 0x7f364c1598d0 2023-12-24T20:02:10.021 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:02:10.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 -- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3638066f30 msgr2=0x7f36380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3638066f30 0x7f36380693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3640006fd0 tx=0x7f3640008040 comp rx=0 tx=0).stop 2023-12-24T20:02:10.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 -- 172.21.15.61:0/3629204331 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c1598d0 msgr2=0x7f364c15c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c1598d0 0x7f364c15c020 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f363c00c5d0 tx=0x7f363c007f60 comp rx=0 tx=0).stop 2023-12-24T20:02:10.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 -- 172.21.15.61:0/3629204331 shutdown_connections 2023-12-24T20:02:10.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f364c159ca0 0x7f364c16aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3638066f30 0x7f36380693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f364c06e280 0x7f364c15a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 --2- 172.21.15.61:0/3629204331 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f364c1598d0 0x7f364c15c020 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 -- 172.21.15.61:0/3629204331 >> 172.21.15.61:0/3629204331 conn(0x7f364c067550 msgr2=0x7f364c1568b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:10.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 -- 172.21.15.61:0/3629204331 shutdown_connections 2023-12-24T20:02:10.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.023+0000 7f36519af700 1 -- 172.21.15.61:0/3629204331 wait complete. 2023-12-24T20:02:10.035 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:02:10.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.159+0000 7fd48f6dd700 1 Processor -- start 2023-12-24T20:02:10.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.159+0000 7fd48f6dd700 1 -- start start 2023-12-24T20:02:10.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.160+0000 7fd48f6dd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd4880cdf90 0x7fd48806b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.160+0000 7fd48f6dd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488158c50 0x7fd4880cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.160+0000 7fd48f6dd700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48815bad0 con 0x7fd4880ce360 2023-12-24T20:02:10.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.160+0000 7fd48f6dd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4881590d0 con 0x7fd4880cdf90 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.160+0000 7fd48f6dd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48815bdb0 con 0x7fd488158c50 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.160+0000 7fd48cc78700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd4880ce360 0x7fd488158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39434/0 (socket says 172.21.15.61:39434) 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.160+0000 7fd48cc78700 1 -- 172.21.15.61:0/3737224318 learned_addr learned my addr 172.21.15.61:0/3737224318 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102987511 0 0) 0x7fd48815bad0 con 0x7fd4880ce360 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48d479700 1 --2- 172.21.15.61:0/3737224318 >> v2:172.21.15.133:3300/0 conn(0x7fd4880cdf90 0x7fd48806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd474003570 con 0x7fd4880ce360 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48dc7a700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488158c50 0x7fd4880cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 803666443 0 0) 0x7fd474003570 con 0x7fd4880ce360 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488158c50 msgr2=0x7fd4880cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488158c50 0x7fd4880cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 >> v2:172.21.15.133:3300/0 conn(0x7fd4880cdf90 msgr2=0x7fd48806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 --2- 172.21.15.61:0/3737224318 >> v2:172.21.15.133:3300/0 conn(0x7fd4880cdf90 0x7fd48806b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48815c090 con 0x7fd4880ce360 2023-12-24T20:02:10.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fd484001470 con 0x7fd4880ce360 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48d479700 1 --2- 172.21.15.61:0/3737224318 >> v2:172.21.15.133:3300/0 conn(0x7fd4880cdf90 0x7fd48806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48dc7a700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488158c50 0x7fd4880cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 >> v1:172.21.15.61:6789/0 conn(0x7fd4880ce360 legacy=0x7fd488158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474003ae0 0x7fd474003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488158c50 0x7fd474004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd474004d50 0x7fd4740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4881590d0 con 0x7fd474004d50 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48815bdb0 con 0x7fd474003ae0 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47400bc20 con 0x7fd488158c50 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48dc7a700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd474004d50 0x7fd4740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48cc78700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488158c50 0x7fd474004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48d479700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474003ae0 0x7fd474003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48dc7a700 1 -- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488158c50 msgr2=0x7fd474004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48dc7a700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488158c50 0x7fd474004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48dc7a700 1 -- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474003ae0 msgr2=0x7fd474003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48dc7a700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474003ae0 0x7fd474003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48dc7a700 1 -- 172.21.15.61:0/3737224318 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd474003570 con 0x7fd474004d50 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.161+0000 7fd48d479700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474003ae0 0x7fd474003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.162+0000 7fd48dc7a700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd474004d50 0x7fd4740051c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd480007550 tx=0x7fd4800097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c02a070b0ddfb1d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.162+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480009ae0 con 0x7fd474004d50 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.162+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd480007da0 con 0x7fd474004d50 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.162+0000 7fd47ffff700 1 -- 172.21.15.61:0/3737224318 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480014630 con 0x7fd474004d50 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.162+0000 7fd48f6dd700 1 -- 172.21.15.61:0/3737224318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd474004d50 msgr2=0x7fd4740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.162+0000 7fd48f6dd700 1 --2- 172.21.15.61:0/3737224318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd474004d50 0x7fd4740051c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd480007550 tx=0x7fd4800097d0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.162+0000 7fd48dc7a700 1 -- 172.21.15.61:0/3737224318 reap_dead start 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.162+0000 7fd48f6dd700 1 -- 172.21.15.61:0/3737224318 shutdown_connections 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.162+0000 7fd48f6dd700 1 -- 172.21.15.61:0/3737224318 >> 172.21.15.61:0/3737224318 conn(0x7fd48806f810 msgr2=0x7fd48806ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.163+0000 7fd48f6dd700 1 -- 172.21.15.61:0/3737224318 shutdown_connections 2023-12-24T20:02:10.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.163+0000 7fd48f6dd700 1 -- 172.21.15.61:0/3737224318 wait complete. 2023-12-24T20:02:10.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.164+0000 7fd48f6dd700 1 Processor -- start 2023-12-24T20:02:10.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.164+0000 7fd48f6dd700 1 -- start start 2023-12-24T20:02:10.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.164+0000 7fd48f6dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474004d50 0x7fd4880b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.164+0000 7fd48f6dd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488068df0 0x7fd4880afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.164+0000 7fd48f6dd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd48815a1e0 0x7fd48815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.164+0000 7fd48f6dd700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880af1e0 con 0x7fd48815a1e0 2023-12-24T20:02:10.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.164+0000 7fd48f6dd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880abf40 con 0x7fd474004d50 2023-12-24T20:02:10.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.164+0000 7fd48f6dd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48815ab90 con 0x7fd488068df0 2023-12-24T20:02:10.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48dc7a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd48815a1e0 0x7fd48815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48dc7a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd48815a1e0 0x7fd48815a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52792/0 (socket says 172.21.15.61:52792) 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48dc7a700 1 -- 172.21.15.61:0/2875542472 learned_addr learned my addr 172.21.15.61:0/2875542472 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48dc7a700 1 -- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488068df0 msgr2=0x7fd4880afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48dc7a700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488068df0 0x7fd4880afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48d479700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474004d50 0x7fd4880b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48dc7a700 1 -- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474004d50 msgr2=0x7fd4880b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48dc7a700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474004d50 0x7fd4880b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48dc7a700 1 -- 172.21.15.61:0/2875542472 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880ac200 con 0x7fd48815a1e0 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48dc7a700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd48815a1e0 0x7fd48815a650 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd480014000 tx=0x7fd480018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd47d7fa700 1 -- 172.21.15.61:0/2875542472 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48001f630 con 0x7fd48815a1e0 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd47d7fa700 1 -- 172.21.15.61:0/2875542472 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48001f790 con 0x7fd48815a1e0 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48f6dd700 1 -- 172.21.15.61:0/2875542472 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4880ae940 con 0x7fd48815a1e0 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd47d7fa700 1 -- 172.21.15.61:0/2875542472 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48001fb50 con 0x7fd48815a1e0 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.165+0000 7fd48f6dd700 1 -- 172.21.15.61:0/2875542472 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4880aef00 con 0x7fd48815a1e0 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.166+0000 7fd48f6dd700 1 -- 172.21.15.61:0/2875542472 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48804c3c0 con 0x7fd48815a1e0 2023-12-24T20:02:10.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.167+0000 7fd47d7fa700 1 -- 172.21.15.61:0/2875542472 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd48001e3b0 con 0x7fd48815a1e0 2023-12-24T20:02:10.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.167+0000 7fd47d7fa700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd46c066f30 0x7fd46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.167+0000 7fd47d7fa700 1 -- 172.21.15.61:0/2875542472 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fd480086670 con 0x7fd48815a1e0 2023-12-24T20:02:10.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.168+0000 7fd48d479700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd46c066f30 0x7fd46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.168+0000 7fd48d479700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd46c066f30 0x7fd46c0693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd478006f00 tx=0x7fd47800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:10.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.171+0000 7fd47d7fa700 1 -- 172.21.15.61:0/2875542472 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd480053820 con 0x7fd48815a1e0 2023-12-24T20:02:10.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.365+0000 7fd48f6dd700 1 -- 172.21.15.61:0/2875542472 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4880ac390 con 0x7fd48815a1e0 2023-12-24T20:02:10.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.365+0000 7fd47d7fa700 1 -- 172.21.15.61:0/2875542472 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd480056e40 con 0x7fd48815a1e0 2023-12-24T20:02:10.366 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 -- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd46c066f30 msgr2=0x7fd46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd46c066f30 0x7fd46c0693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd478006f00 tx=0x7fd47800b040 comp rx=0 tx=0).stop 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 -- 172.21.15.61:0/2875542472 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd48815a1e0 msgr2=0x7fd48815a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd48815a1e0 0x7fd48815a650 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd480014000 tx=0x7fd480018000 comp rx=0 tx=0).stop 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 -- 172.21.15.61:0/2875542472 shutdown_connections 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd46c066f30 0x7fd46c0693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd48815a1e0 0x7fd48815a650 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474004d50 0x7fd4880b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 --2- 172.21.15.61:0/2875542472 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd488068df0 0x7fd4880afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 -- 172.21.15.61:0/2875542472 >> 172.21.15.61:0/2875542472 conn(0x7fd48806f810 msgr2=0x7fd4880c4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 -- 172.21.15.61:0/2875542472 shutdown_connections 2023-12-24T20:02:10.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.367+0000 7fd48f6dd700 1 -- 172.21.15.61:0/2875542472 wait complete. 2023-12-24T20:02:10.380 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:02:10.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.505+0000 7f10e2823700 1 Processor -- start 2023-12-24T20:02:10.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.505+0000 7f10e2823700 1 -- start start 2023-12-24T20:02:10.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10e2823700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f10dc0af7b0 0x7f10dc070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10e2823700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10dc070b80 0x7f10dc067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10e2823700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc0b03a0 con 0x7f10dc157b70 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10e2823700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc15bcb0 con 0x7f10dc0af7b0 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10e2823700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc070f80 con 0x7f10dc070b80 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10db7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f10dc0af7b0 0x7f10dc070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10dbfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f10dc157b70 0x7f10dc068980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39438/0 (socket says 172.21.15.61:39438) 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10dbfff700 1 -- 172.21.15.61:0/2740666769 learned_addr learned my addr 172.21.15.61:0/2740666769 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10e0dc0700 1 --2- 172.21.15.61:0/2740666769 >> v2:172.21.15.133:3300/0 conn(0x7f10dc070b80 0x7f10dc067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10db7fe700 1 -- 172.21.15.61:0/2740666769 >> v2:172.21.15.133:3300/0 conn(0x7f10dc070b80 msgr2=0x7f10dc067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10db7fe700 1 --2- 172.21.15.61:0/2740666769 >> v2:172.21.15.133:3300/0 conn(0x7f10dc070b80 0x7f10dc067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10db7fe700 1 -- 172.21.15.61:0/2740666769 >> v1:172.21.15.61:6789/0 conn(0x7f10dc157b70 legacy=0x7f10dc068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10db7fe700 1 -- 172.21.15.61:0/2740666769 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0afde0 con 0x7f10dc0af7b0 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10daffd700 1 -- 172.21.15.61:0/2740666769 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679348064 0 0) 0x7f10dc0b03a0 con 0x7f10dc157b70 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.506+0000 7f10db7fe700 1 --2- 172.21.15.61:0/2740666769 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 0x7f10dc070640 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0687c0 tx=0x7f10d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2530de4b41e14c20 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:10.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10daffd700 1 -- 172.21.15.61:0/2740666769 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000b6b0 con 0x7f10dc0af7b0 2023-12-24T20:02:10.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10daffd700 1 -- 172.21.15.61:0/2740666769 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d000b810 con 0x7f10dc0af7b0 2023-12-24T20:02:10.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10daffd700 1 -- 172.21.15.61:0/2740666769 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000bbb0 con 0x7f10dc0af7b0 2023-12-24T20:02:10.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10e2823700 1 -- 172.21.15.61:0/2740666769 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 msgr2=0x7f10dc070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10e2823700 1 --2- 172.21.15.61:0/2740666769 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 0x7f10dc070640 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0687c0 tx=0x7f10d00091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10e2823700 1 -- 172.21.15.61:0/2740666769 shutdown_connections 2023-12-24T20:02:10.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10e2823700 1 --2- 172.21.15.61:0/2740666769 >> v2:172.21.15.133:3300/0 conn(0x7f10dc070b80 0x7f10dc067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10e2823700 1 --2- 172.21.15.61:0/2740666769 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 0x7f10dc070640 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10e2823700 1 -- 172.21.15.61:0/2740666769 >> 172.21.15.61:0/2740666769 conn(0x7f10dc0ce420 msgr2=0x7f10dc0ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:10.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10e2823700 1 -- 172.21.15.61:0/2740666769 shutdown_connections 2023-12-24T20:02:10.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.507+0000 7f10e2823700 1 -- 172.21.15.61:0/2740666769 wait complete. 2023-12-24T20:02:10.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.508+0000 7f10e2823700 1 Processor -- start 2023-12-24T20:02:10.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10e2823700 1 -- start start 2023-12-24T20:02:10.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10e2823700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc070b80 0x7f10dc156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10e2823700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 0x7f10dc0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10e2823700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10dc157b70 0x7f10dc157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10e2823700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc14efa0 con 0x7f10dc0af7b0 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10e2823700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc1570d0 con 0x7f10dc070b80 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10e2823700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc16ae00 con 0x7f10dc157b70 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10db7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 0x7f10dc0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10db7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 0x7f10dc0aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52808/0 (socket says 172.21.15.61:52808) 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10db7fe700 1 -- 172.21.15.61:0/420814837 learned_addr learned my addr 172.21.15.61:0/420814837 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.509+0000 7f10dbfff700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc070b80 0x7f10dc156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10e0dc0700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10dc157b70 0x7f10dc157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10db7fe700 1 -- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10dc157b70 msgr2=0x7f10dc157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10db7fe700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10dc157b70 0x7f10dc157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10db7fe700 1 -- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc070b80 msgr2=0x7f10dc156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10db7fe700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc070b80 0x7f10dc156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10db7fe700 1 -- 172.21.15.61:0/420814837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d0009420 con 0x7f10dc0af7b0 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10e0dc0700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10dc157b70 0x7f10dc157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10db7fe700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 0x7f10dc0aedb0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f10dc06d260 tx=0x7f10d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:10.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10c3fff700 1 -- 172.21.15.61:0/420814837 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000bb90 con 0x7f10dc0af7b0 2023-12-24T20:02:10.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10c3fff700 1 -- 172.21.15.61:0/420814837 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0011420 con 0x7f10dc0af7b0 2023-12-24T20:02:10.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10e2823700 1 -- 172.21.15.61:0/420814837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc16a1f0 con 0x7f10dc0af7b0 2023-12-24T20:02:10.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10c3fff700 1 -- 172.21.15.61:0/420814837 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0011800 con 0x7f10dc0af7b0 2023-12-24T20:02:10.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.510+0000 7f10e2823700 1 -- 172.21.15.61:0/420814837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc16a7b0 con 0x7f10dc0af7b0 2023-12-24T20:02:10.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.511+0000 7f10e2823700 1 -- 172.21.15.61:0/420814837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc1500e0 con 0x7f10dc0af7b0 2023-12-24T20:02:10.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.511+0000 7f10c3fff700 1 -- 172.21.15.61:0/420814837 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f10d0011c30 con 0x7f10dc0af7b0 2023-12-24T20:02:10.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.512+0000 7f10c3fff700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10c8066f30 0x7f10c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.512+0000 7f10c3fff700 1 -- 172.21.15.61:0/420814837 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f10d0085db0 con 0x7f10dc0af7b0 2023-12-24T20:02:10.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.512+0000 7f10dbfff700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10c8066f30 0x7f10c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.512+0000 7f10dbfff700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10c8066f30 0x7f10c80693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f10cc007fd0 tx=0x7f10cc007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:10.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.516+0000 7f10c3fff700 1 -- 172.21.15.61:0/420814837 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10d0053000 con 0x7f10dc0af7b0 2023-12-24T20:02:10.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.714+0000 7f10e2823700 1 -- 172.21.15.61:0/420814837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f10dc04c3c0 con 0x7f10dc0af7b0 2023-12-24T20:02:10.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.715+0000 7f10c3fff700 1 -- 172.21.15.61:0/420814837 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10d0056620 con 0x7f10dc0af7b0 2023-12-24T20:02:10.717 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T20:02:10.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 -- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10c8066f30 msgr2=0x7f10c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10c8066f30 0x7f10c80693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f10cc007fd0 tx=0x7f10cc007d30 comp rx=0 tx=0).stop 2023-12-24T20:02:10.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 -- 172.21.15.61:0/420814837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 msgr2=0x7f10dc0aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 0x7f10dc0aedb0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f10dc06d260 tx=0x7f10d0017000 comp rx=0 tx=0).stop 2023-12-24T20:02:10.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 -- 172.21.15.61:0/420814837 shutdown_connections 2023-12-24T20:02:10.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f10dc157b70 0x7f10dc157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10c8066f30 0x7f10c80693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10dc070b80 0x7f10dc156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 --2- 172.21.15.61:0/420814837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10dc0af7b0 0x7f10dc0aedb0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 -- 172.21.15.61:0/420814837 >> 172.21.15.61:0/420814837 conn(0x7f10dc0ce420 msgr2=0x7f10dc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 -- 172.21.15.61:0/420814837 shutdown_connections 2023-12-24T20:02:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.717+0000 7f10e2823700 1 -- 172.21.15.61:0/420814837 wait complete. 2023-12-24T20:02:10.730 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.851+0000 7f38a8e99700 1 Processor -- start 2023-12-24T20:02:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.851+0000 7f38a8e99700 1 -- start start 2023-12-24T20:02:10.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.852+0000 7f38a8e99700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38a406ec70 0x7f38a406f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.852+0000 7f38a8e99700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f38a41595e0 0x7f38a4159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.852+0000 7f38a8e99700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a40cd9c0 0x7f38a40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.852+0000 7f38a8e99700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a406c300 con 0x7f38a41595e0 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.852+0000 7f38a8e99700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a406ce80 con 0x7f38a406ec70 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.852+0000 7f38a8e99700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a4159fa0 con 0x7f38a40cd9c0 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a1d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f38a41595e0 0x7f38a4159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a1d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f38a41595e0 0x7f38a4159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52818/0 (socket says 172.21.15.61:52818) 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a1d9b700 1 -- 172.21.15.61:0/3321499018 learned_addr learned my addr 172.21.15.61:0/3321499018 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a259c700 1 --2- 172.21.15.61:0/3321499018 >> v2:172.21.15.133:3300/0 conn(0x7f38a406ec70 0x7f38a406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a2d9d700 1 --2- 172.21.15.61:0/3321499018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a40cd9c0 0x7f38a40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a1d9b700 1 -- 172.21.15.61:0/3321499018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a40cd9c0 msgr2=0x7f38a40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a1d9b700 1 --2- 172.21.15.61:0/3321499018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a40cd9c0 0x7f38a40cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a1d9b700 1 -- 172.21.15.61:0/3321499018 >> v2:172.21.15.133:3300/0 conn(0x7f38a406ec70 msgr2=0x7f38a406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a1d9b700 1 --2- 172.21.15.61:0/3321499018 >> v2:172.21.15.133:3300/0 conn(0x7f38a406ec70 0x7f38a406f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a1d9b700 1 -- 172.21.15.61:0/3321499018 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a406c550 con 0x7f38a41595e0 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a259c700 1 --2- 172.21.15.61:0/3321499018 >> v2:172.21.15.133:3300/0 conn(0x7f38a406ec70 0x7f38a406f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a1d9b700 1 --2- 172.21.15.61:0/3321499018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 0x7f38a4159a60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f38a4071880 tx=0x7f388c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3472dda6f0a1405f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a159a700 1 -- 172.21.15.61:0/3321499018 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00b860 con 0x7f38a41595e0 2023-12-24T20:02:10.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a159a700 1 -- 172.21.15.61:0/3321499018 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c00b9c0 con 0x7f38a41595e0 2023-12-24T20:02:10.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.853+0000 7f38a159a700 1 -- 172.21.15.61:0/3321499018 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00bd60 con 0x7f38a41595e0 2023-12-24T20:02:10.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.854+0000 7f38a8e99700 1 -- 172.21.15.61:0/3321499018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 msgr2=0x7f38a4159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.854+0000 7f38a8e99700 1 --2- 172.21.15.61:0/3321499018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 0x7f38a4159a60 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f38a4071880 tx=0x7f388c009250 comp rx=0 tx=0).stop 2023-12-24T20:02:10.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.854+0000 7f38a8e99700 1 -- 172.21.15.61:0/3321499018 shutdown_connections 2023-12-24T20:02:10.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.854+0000 7f38a8e99700 1 --2- 172.21.15.61:0/3321499018 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a40cd9c0 0x7f38a40cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.854+0000 7f38a8e99700 1 --2- 172.21.15.61:0/3321499018 >> v2:172.21.15.133:3300/0 conn(0x7f38a406ec70 0x7f38a406f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.854+0000 7f38a8e99700 1 --2- 172.21.15.61:0/3321499018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 0x7f38a4159a60 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.854+0000 7f38a8e99700 1 -- 172.21.15.61:0/3321499018 >> 172.21.15.61:0/3321499018 conn(0x7f38a406b650 msgr2=0x7f38a40ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:10.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.854+0000 7f38a8e99700 1 -- 172.21.15.61:0/3321499018 shutdown_connections 2023-12-24T20:02:10.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.854+0000 7f38a8e99700 1 -- 172.21.15.61:0/3321499018 wait complete. 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.855+0000 7f38a8e99700 1 Processor -- start 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.855+0000 7f38a8e99700 1 -- start start 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a8e99700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a406ec70 0x7f38a4156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a8e99700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a40cd9c0 0x7f38a4154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a8e99700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 0x7f38a40aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a8e99700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40ad620 con 0x7f38a41595e0 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a8e99700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a41571e0 con 0x7f38a40cd9c0 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a8e99700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a41546d0 con 0x7f38a406ec70 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a2d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 0x7f38a40aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a2d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 0x7f38a40aca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52830/0 (socket says 172.21.15.61:52830) 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a2d9d700 1 -- 172.21.15.61:0/333216083 learned_addr learned my addr 172.21.15.61:0/333216083 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a259c700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a406ec70 0x7f38a4156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a1d9b700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a40cd9c0 0x7f38a4154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a2d9d700 1 -- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a406ec70 msgr2=0x7f38a4156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a2d9d700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a406ec70 0x7f38a4156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a2d9d700 1 -- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a40cd9c0 msgr2=0x7f38a4154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a2d9d700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a40cd9c0 0x7f38a4154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a2d9d700 1 -- 172.21.15.61:0/333216083 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c0094f0 con 0x7f38a41595e0 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.856+0000 7f38a2d9d700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 0x7f38a40aca30 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f389c009fd0 tx=0x7f389c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.857+0000 7f389a7fc700 1 -- 172.21.15.61:0/333216083 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c00ebf0 con 0x7f38a41595e0 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.857+0000 7f389a7fc700 1 -- 172.21.15.61:0/333216083 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c00ed50 con 0x7f38a41595e0 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.857+0000 7f38a8e99700 1 -- 172.21.15.61:0/333216083 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a40acf70 con 0x7f38a41595e0 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.857+0000 7f389a7fc700 1 -- 172.21.15.61:0/333216083 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c014670 con 0x7f38a41595e0 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.857+0000 7f38a8e99700 1 -- 172.21.15.61:0/333216083 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a4155ee0 con 0x7f38a41595e0 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.858+0000 7f38a8e99700 1 -- 172.21.15.61:0/333216083 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a404c3c0 con 0x7f38a41595e0 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.858+0000 7f389a7fc700 1 -- 172.21.15.61:0/333216083 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f389c0149e0 con 0x7f38a41595e0 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.858+0000 7f389a7fc700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3884066f30 0x7f38840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.859+0000 7f389a7fc700 1 -- 172.21.15.61:0/333216083 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f389c084ba0 con 0x7f38a41595e0 2023-12-24T20:02:10.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.859+0000 7f38a259c700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3884066f30 0x7f38840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:10.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.859+0000 7f38a259c700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3884066f30 0x7f38840693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f389400adc0 tx=0x7f3894006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:10.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:10.863+0000 7f389a7fc700 1 -- 172.21.15.61:0/333216083 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f389c051df0 con 0x7f38a41595e0 2023-12-24T20:02:11.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.101+0000 7f38a8e99700 1 -- 172.21.15.61:0/333216083 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38a406c830 con 0x7f38a41595e0 2023-12-24T20:02:11.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.102+0000 7f389a7fc700 1 -- 172.21.15.61:0/333216083 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f389c055410 con 0x7f38a41595e0 2023-12-24T20:02:11.102 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:11.102 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2634636374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2634636374},{"type":"v1","addr":"172.21.15.61:6835","nonce":2634636374}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/856986572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":856986572},{"type":"v1","addr":"172.21.15.133:6836","nonce":856986572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1475170652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1475170652},{"type":"v1","addr":"172.21.15.133:6837","nonce":1475170652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:01:30.072202+0000","modified":"2023-12-24T20:01:33.718490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2512648595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2512648595},{"type":"v1","addr":"172.21.15.61:6834","nonce":2512648595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 -- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3884066f30 msgr2=0x7f38840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3884066f30 0x7f38840693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f389400adc0 tx=0x7f3894006f90 comp rx=0 tx=0).stop 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 -- 172.21.15.61:0/333216083 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 msgr2=0x7f38a40aca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 0x7f38a40aca30 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f389c009fd0 tx=0x7f389c009900 comp rx=0 tx=0).stop 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 -- 172.21.15.61:0/333216083 shutdown_connections 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a406ec70 0x7f38a4156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3884066f30 0x7f38840693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a41595e0 0x7f38a40aca30 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 --2- 172.21.15.61:0/333216083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a40cd9c0 0x7f38a4154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 -- 172.21.15.61:0/333216083 >> 172.21.15.61:0/333216083 conn(0x7f38a406b650 msgr2=0x7f38a40ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 -- 172.21.15.61:0/333216083 shutdown_connections 2023-12-24T20:02:11.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.104+0000 7f38a8e99700 1 -- 172.21.15.61:0/333216083 wait complete. 2023-12-24T20:02:11.106 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 52 2023-12-24T20:02:11.117 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:11.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.238+0000 7f1bc841c700 1 Processor -- start 2023-12-24T20:02:11.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.238+0000 7f1bc841c700 1 -- start start 2023-12-24T20:02:11.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.239+0000 7f1bc841c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1bc00b3d30 0x7f1bc00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.239+0000 7f1bc841c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc00b2890 con 0x7f1bc0068140 2023-12-24T20:02:11.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.239+0000 7f1bc841c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc00cf630 con 0x7f1bc0068510 2023-12-24T20:02:11.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.239+0000 7f1bc841c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc00b2240 con 0x7f1bc00b3d30 2023-12-24T20:02:11.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.239+0000 7f1bc69b9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1bc00b3d30 0x7f1bc00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.239+0000 7f1bc61b8700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1bc0068140 0x7f1bc00b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39454/0 (socket says 172.21.15.61:39454) 2023-12-24T20:02:11.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.239+0000 7f1bc61b8700 1 -- 172.21.15.61:0/2874433609 learned_addr learned my addr 172.21.15.61:0/2874433609 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:11.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.239+0000 7f1bc51b6700 1 -- 172.21.15.61:0/2874433609 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936614359 0 0) 0x7f1bc00b2890 con 0x7f1bc0068140 2023-12-24T20:02:11.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.239+0000 7f1bc51b6700 1 -- 172.21.15.61:0/2874433609 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bac003570 con 0x7f1bc0068140 2023-12-24T20:02:11.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.240+0000 7f1bc69b9700 1 -- 172.21.15.61:0/2874433609 >> v1:172.21.15.133:6789/0 conn(0x7f1bc0068510 legacy=0x7f1bc0159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.240+0000 7f1bc69b9700 1 -- 172.21.15.61:0/2874433609 >> v1:172.21.15.61:6789/0 conn(0x7f1bc0068140 legacy=0x7f1bc00b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.240+0000 7f1bc69b9700 1 -- 172.21.15.61:0/2874433609 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00b2520 con 0x7f1bc00b3d30 2023-12-24T20:02:11.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.240+0000 7f1bc69b9700 1 --2- 172.21.15.61:0/2874433609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc00b3d30 0x7f1bc00cefa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009e60 tx=0x7f1bb8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76167c1e2404fc0b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:11.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.240+0000 7f1bc51b6700 1 -- 172.21.15.61:0/2874433609 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800e070 con 0x7f1bc00b3d30 2023-12-24T20:02:11.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.240+0000 7f1bc51b6700 1 -- 172.21.15.61:0/2874433609 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb800bb60 con 0x7f1bc00b3d30 2023-12-24T20:02:11.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.240+0000 7f1bc51b6700 1 -- 172.21.15.61:0/2874433609 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8012430 con 0x7f1bc00b3d30 2023-12-24T20:02:11.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.240+0000 7f1bc841c700 1 -- 172.21.15.61:0/2874433609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc00b3d30 msgr2=0x7f1bc00cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.240+0000 7f1bc841c700 1 --2- 172.21.15.61:0/2874433609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc00b3d30 0x7f1bc00cefa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009e60 tx=0x7f1bb8009780 comp rx=0 tx=0).stop 2023-12-24T20:02:11.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.241+0000 7f1bc841c700 1 -- 172.21.15.61:0/2874433609 shutdown_connections 2023-12-24T20:02:11.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.241+0000 7f1bc841c700 1 --2- 172.21.15.61:0/2874433609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc00b3d30 0x7f1bc00cefa0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.241+0000 7f1bc841c700 1 -- 172.21.15.61:0/2874433609 >> 172.21.15.61:0/2874433609 conn(0x7f1bc0097a10 msgr2=0x7f1bc00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:11.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.241+0000 7f1bc841c700 1 -- 172.21.15.61:0/2874433609 shutdown_connections 2023-12-24T20:02:11.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.241+0000 7f1bc841c700 1 -- 172.21.15.61:0/2874433609 wait complete. 2023-12-24T20:02:11.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.242+0000 7f1bc841c700 1 Processor -- start 2023-12-24T20:02:11.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.242+0000 7f1bc841c700 1 -- start start 2023-12-24T20:02:11.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc841c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc0068140 0x7f1bc009a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc841c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc0068510 0x7f1bc0157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc841c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bc00b3d30 0x7f1bc0157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc841c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc01583a0 con 0x7f1bc0068140 2023-12-24T20:02:11.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc841c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc015b8b0 con 0x7f1bc0068510 2023-12-24T20:02:11.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc841c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc015bb90 con 0x7f1bc00b3d30 2023-12-24T20:02:11.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc61b8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc0068140 0x7f1bc009a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc61b8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc0068140 0x7f1bc009a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52846/0 (socket says 172.21.15.61:52846) 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc61b8700 1 -- 172.21.15.61:0/563179168 learned_addr learned my addr 172.21.15.61:0/563179168 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc69b9700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bc00b3d30 0x7f1bc0157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.243+0000 7f1bc59b7700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc0068510 0x7f1bc0157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bc61b8700 1 -- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bc00b3d30 msgr2=0x7f1bc0157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bc61b8700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bc00b3d30 0x7f1bc0157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bc61b8700 1 -- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc0068510 msgr2=0x7f1bc0157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bc61b8700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc0068510 0x7f1bc0157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bc61b8700 1 -- 172.21.15.61:0/563179168 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb8009a20 con 0x7f1bc0068140 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bc69b9700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bc00b3d30 0x7f1bc0157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bc59b7700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc0068510 0x7f1bc0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bc61b8700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc0068140 0x7f1bc009a920 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c790 tx=0x7f1bbc007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bb67fc700 1 -- 172.21.15.61:0/563179168 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc007300 con 0x7f1bc0068140 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bb67fc700 1 -- 172.21.15.61:0/563179168 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc007460 con 0x7f1bc0068140 2023-12-24T20:02:11.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bc841c700 1 -- 172.21.15.61:0/563179168 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc015be70 con 0x7f1bc0068140 2023-12-24T20:02:11.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bb67fc700 1 -- 172.21.15.61:0/563179168 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0057f0 con 0x7f1bc0068140 2023-12-24T20:02:11.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.244+0000 7f1bc841c700 1 -- 172.21.15.61:0/563179168 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc0169ef0 con 0x7f1bc0068140 2023-12-24T20:02:11.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.245+0000 7f1bc841c700 1 -- 172.21.15.61:0/563179168 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc006d440 con 0x7f1bc0068140 2023-12-24T20:02:11.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.245+0000 7f1bb67fc700 1 -- 172.21.15.61:0/563179168 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1bbc005c20 con 0x7f1bc0068140 2023-12-24T20:02:11.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.246+0000 7f1bb67fc700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ba4066f30 0x7f1ba40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.246+0000 7f1bb67fc700 1 -- 172.21.15.61:0/563179168 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f1bbc084040 con 0x7f1bc0068140 2023-12-24T20:02:11.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.246+0000 7f1bc59b7700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ba4066f30 0x7f1ba40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.246+0000 7f1bc59b7700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ba4066f30 0x7f1ba40693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1bc015d8b0 tx=0x7f1bb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:11.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.250+0000 7f1bb67fc700 1 -- 172.21.15.61:0/563179168 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bbc051310 con 0x7f1bc0068140 2023-12-24T20:02:11.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.449+0000 7f1bc841c700 1 -- 172.21.15.61:0/563179168 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bc004c3c0 con 0x7f1bc0068140 2023-12-24T20:02:11.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.450+0000 7f1bb67fc700 1 -- 172.21.15.61:0/563179168 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+15408 (secure 0 0 0) 0x7f1bbc054930 con 0x7f1bc0068140 2023-12-24T20:02:11.450 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:11.450 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":110,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:02.833407+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:01:28.014512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-24T20:01:29.062088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:11.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 -- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ba4066f30 msgr2=0x7f1ba40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ba4066f30 0x7f1ba40693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1bc015d8b0 tx=0x7f1bb0009040 comp rx=0 tx=0).stop 2023-12-24T20:02:11.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 -- 172.21.15.61:0/563179168 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc0068140 msgr2=0x7f1bc009a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc0068140 0x7f1bc009a920 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c790 tx=0x7f1bbc007c80 comp rx=0 tx=0).stop 2023-12-24T20:02:11.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 -- 172.21.15.61:0/563179168 shutdown_connections 2023-12-24T20:02:11.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1bc00b3d30 0x7f1bc0157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ba4066f30 0x7f1ba40693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bc0068140 0x7f1bc009a920 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 --2- 172.21.15.61:0/563179168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc0068510 0x7f1bc0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 -- 172.21.15.61:0/563179168 >> 172.21.15.61:0/563179168 conn(0x7f1bc0097a10 msgr2=0x7f1bc00aeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:11.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 -- 172.21.15.61:0/563179168 shutdown_connections 2023-12-24T20:02:11.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.452+0000 7f1bc841c700 1 -- 172.21.15.61:0/563179168 wait complete. 2023-12-24T20:02:11.465 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:02:11.465 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:11.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.587+0000 7faaf1685700 1 Processor -- start 2023-12-24T20:02:11.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.587+0000 7faaf1685700 1 -- start start 2023-12-24T20:02:11.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.587+0000 7faaf1685700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faaec159fe0 0x7faaec0cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.587+0000 7faaf1685700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faaec0c5ee0 0x7faaec0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaf1685700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec0af880 con 0x7faaec159c10 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaf1685700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec0c6fc0 con 0x7faaec0c5ee0 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaf1685700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec0c63b0 con 0x7faaec159fe0 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaeb7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faaec0c5ee0 0x7faaec0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaeb7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faaec0c5ee0 0x7faaec0cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52860/0 (socket says 172.21.15.61:52860) 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaeb7fe700 1 -- 172.21.15.61:0/1425931778 learned_addr learned my addr 172.21.15.61:0/1425931778 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaea7fc700 1 --2- 172.21.15.61:0/1425931778 >> v2:172.21.15.133:3300/0 conn(0x7faaec159fe0 0x7faaec0cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaeb7fe700 1 -- 172.21.15.61:0/1425931778 >> v2:172.21.15.133:3300/0 conn(0x7faaec159fe0 msgr2=0x7faaec0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaeb7fe700 1 --2- 172.21.15.61:0/1425931778 >> v2:172.21.15.133:3300/0 conn(0x7faaec159fe0 0x7faaec0cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaeb7fe700 1 -- 172.21.15.61:0/1425931778 >> v1:172.21.15.133:6789/0 conn(0x7faaec159c10 legacy=0x7faaec0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaeb7fe700 1 -- 172.21.15.61:0/1425931778 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0c6690 con 0x7faaec0c5ee0 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaea7fc700 1 --2- 172.21.15.61:0/1425931778 >> v2:172.21.15.133:3300/0 conn(0x7faaec159fe0 0x7faaec0cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:11.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faaeb7fe700 1 --2- 172.21.15.61:0/1425931778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec0c5ee0 0x7faaec0cbfc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7faaec0d1b20 tx=0x7faae4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a2756dcb0f00cf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faae9ffb700 1 -- 172.21.15.61:0/1425931778 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae400e070 con 0x7faaec0c5ee0 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faae9ffb700 1 -- 172.21.15.61:0/1425931778 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae400ba10 con 0x7faaec0c5ee0 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.588+0000 7faae9ffb700 1 -- 172.21.15.61:0/1425931778 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae40092e0 con 0x7faaec0c5ee0 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.589+0000 7faaf1685700 1 -- 172.21.15.61:0/1425931778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec0c5ee0 msgr2=0x7faaec0cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.589+0000 7faaf1685700 1 --2- 172.21.15.61:0/1425931778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec0c5ee0 0x7faaec0cbfc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7faaec0d1b20 tx=0x7faae4009840 comp rx=0 tx=0).stop 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.589+0000 7faaf1685700 1 -- 172.21.15.61:0/1425931778 shutdown_connections 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.589+0000 7faaf1685700 1 --2- 172.21.15.61:0/1425931778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec0c5ee0 0x7faaec0cbfc0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.589+0000 7faaf1685700 1 --2- 172.21.15.61:0/1425931778 >> v2:172.21.15.133:3300/0 conn(0x7faaec159fe0 0x7faaec0cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.589+0000 7faaf1685700 1 -- 172.21.15.61:0/1425931778 >> 172.21.15.61:0/1425931778 conn(0x7faaec06e640 msgr2=0x7faaec067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.589+0000 7faaf1685700 1 -- 172.21.15.61:0/1425931778 shutdown_connections 2023-12-24T20:02:11.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.589+0000 7faaf1685700 1 -- 172.21.15.61:0/1425931778 wait complete. 2023-12-24T20:02:11.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.591+0000 7faaf1685700 1 Processor -- start 2023-12-24T20:02:11.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.591+0000 7faaf1685700 1 -- start start 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaf1685700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaec0c5ee0 0x7faaec14a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaf1685700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec159c10 0x7faaec0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaf1685700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec159fe0 0x7faaec0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaf1685700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec14aac0 con 0x7faaec159c10 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaf1685700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0b5260 con 0x7faaec159fe0 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaf1685700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0b4650 con 0x7faaec0c5ee0 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaea7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec159c10 0x7faaec0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaea7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec159c10 0x7faaec0b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52862/0 (socket says 172.21.15.61:52862) 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaea7fc700 1 -- 172.21.15.61:0/2073077824 learned_addr learned my addr 172.21.15.61:0/2073077824 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaeaffd700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaec0c5ee0 0x7faaec14a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaea7fc700 1 -- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaec0c5ee0 msgr2=0x7faaec14a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaeb7fe700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec159fe0 0x7faaec0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaea7fc700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaec0c5ee0 0x7faaec14a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaea7fc700 1 -- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec159fe0 msgr2=0x7faaec0c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaea7fc700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec159fe0 0x7faaec0c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaea7fc700 1 -- 172.21.15.61:0/2073077824 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae4009ae0 con 0x7faaec159c10 2023-12-24T20:02:11.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaea7fc700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec159c10 0x7faaec0b56f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7faae000c880 tx=0x7faae0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:11.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faad2ffd700 1 -- 172.21.15.61:0/2073077824 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0011600 con 0x7faaec159c10 2023-12-24T20:02:11.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faad2ffd700 1 -- 172.21.15.61:0/2073077824 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faae0011760 con 0x7faaec159c10 2023-12-24T20:02:11.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faad2ffd700 1 -- 172.21.15.61:0/2073077824 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faae0011b00 con 0x7faaec159c10 2023-12-24T20:02:11.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaf1685700 1 -- 172.21.15.61:0/2073077824 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaec0b4930 con 0x7faaec159c10 2023-12-24T20:02:11.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.592+0000 7faaf1685700 1 -- 172.21.15.61:0/2073077824 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaec0b4ef0 con 0x7faaec159c10 2023-12-24T20:02:11.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.593+0000 7faaf1685700 1 -- 172.21.15.61:0/2073077824 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaec0890b0 con 0x7faaec159c10 2023-12-24T20:02:11.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.594+0000 7faad2ffd700 1 -- 172.21.15.61:0/2073077824 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7faae000a3e0 con 0x7faaec159c10 2023-12-24T20:02:11.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.594+0000 7faad2ffd700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faad8066f30 0x7faad80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.594+0000 7faad2ffd700 1 -- 172.21.15.61:0/2073077824 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7faae0084300 con 0x7faaec159c10 2023-12-24T20:02:11.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.594+0000 7faaeaffd700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faad8066f30 0x7faad80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.595+0000 7faaeaffd700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faad8066f30 0x7faad80693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faadc0027e0 tx=0x7faadc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:11.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.598+0000 7faad2ffd700 1 -- 172.21.15.61:0/2073077824 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faae0051550 con 0x7faaec159c10 2023-12-24T20:02:11.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.839+0000 7faaf1685700 1 -- 172.21.15.61:0/2073077824 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaec15cbe0 con 0x7faaec159c10 2023-12-24T20:02:11.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.840+0000 7faad2ffd700 1 -- 172.21.15.61:0/2073077824 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7faae0054b70 con 0x7faaec159c10 2023-12-24T20:02:11.840 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:11.840 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2634636374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2634636374},{"type":"v1","addr":"172.21.15.61:6835","nonce":2634636374}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/856986572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":856986572},{"type":"v1","addr":"172.21.15.133:6836","nonce":856986572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1475170652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1475170652},{"type":"v1","addr":"172.21.15.133:6837","nonce":1475170652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:01:30.072202+0000","modified":"2023-12-24T20:01:33.718490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2512648595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2512648595},{"type":"v1","addr":"172.21.15.61:6834","nonce":2512648595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T20:02:11.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.841+0000 7faaf1685700 1 -- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faad8066f30 msgr2=0x7faad80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.841+0000 7faaf1685700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faad8066f30 0x7faad80693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faadc0027e0 tx=0x7faadc009040 comp rx=0 tx=0).stop 2023-12-24T20:02:11.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.841+0000 7faaf1685700 1 -- 172.21.15.61:0/2073077824 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec159c10 msgr2=0x7faaec0b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.841+0000 7faaf1685700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec159c10 0x7faaec0b56f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7faae000c880 tx=0x7faae0008040 comp rx=0 tx=0).stop 2023-12-24T20:02:11.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.841+0000 7faaf1685700 1 -- 172.21.15.61:0/2073077824 shutdown_connections 2023-12-24T20:02:11.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.841+0000 7faaf1685700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faaec0c5ee0 0x7faaec14a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.841+0000 7faaf1685700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faad8066f30 0x7faad80693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.841+0000 7faaf1685700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faaec159fe0 0x7faaec0c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.841+0000 7faaf1685700 1 --2- 172.21.15.61:0/2073077824 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faaec159c10 0x7faaec0b56f0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.841+0000 7faaf1685700 1 -- 172.21.15.61:0/2073077824 >> 172.21.15.61:0/2073077824 conn(0x7faaec06e640 msgr2=0x7faaec0b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:11.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.842+0000 7faaf1685700 1 -- 172.21.15.61:0/2073077824 shutdown_connections 2023-12-24T20:02:11.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.842+0000 7faaf1685700 1 -- 172.21.15.61:0/2073077824 wait complete. 2023-12-24T20:02:11.843 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 52 2023-12-24T20:02:11.854 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.975+0000 7f758b1fe700 1 Processor -- start 2023-12-24T20:02:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.975+0000 7f758b1fe700 1 -- start start 2023-12-24T20:02:11.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.976+0000 7f758b1fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f75840afee0 0x7f7584067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.976+0000 7f758b1fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584070640 0x7f7584070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.976+0000 7f758b1fe700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75840a84d0 con 0x7f7584159b00 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.976+0000 7f758b1fe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7584070fd0 con 0x7f75840afee0 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.976+0000 7f758b1fe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75840a7620 con 0x7f7584070640 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.976+0000 7f7588f9a700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7584159b00 0x7f75840af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39458/0 (socket says 172.21.15.61:39458) 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.976+0000 7f7588f9a700 1 -- 172.21.15.61:0/784647587 learned_addr learned my addr 172.21.15.61:0/784647587 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f7583fff700 1 --2- 172.21.15.61:0/784647587 >> v2:172.21.15.133:3300/0 conn(0x7f75840afee0 0x7f7584067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418111457 0 0) 0x7f75840a84d0 con 0x7f7584159b00 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f758979b700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584070640 0x7f7584070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7574003570 con 0x7f7584159b00 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1383424302 0 0) 0x7f7574003570 con 0x7f7584159b00 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584070640 msgr2=0x7f7584070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584070640 0x7f7584070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 >> v2:172.21.15.133:3300/0 conn(0x7f75840afee0 msgr2=0x7f7584067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 --2- 172.21.15.61:0/784647587 >> v2:172.21.15.133:3300/0 conn(0x7f75840afee0 0x7f7584067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840a78c0 con 0x7f7584159b00 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f7578001470 con 0x7f7584159b00 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 >> v1:172.21.15.61:6789/0 conn(0x7f7584159b00 legacy=0x7f75840af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7574003a60 0x7f7574003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7574004810 0x7f7574004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584070640 0x7f75740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584070fd0 con 0x7f7574004810 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840a7620 con 0x7f7574003a60 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757400ba60 con 0x7f7584070640 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f7583fff700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7574004810 0x7f7574004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f7588f9a700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7574003a60 0x7f7574003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f758979b700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584070640 0x7f75740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f7583fff700 1 -- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584070640 msgr2=0x7f75740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f7583fff700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7584070640 0x7f75740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f7583fff700 1 -- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7574003a60 msgr2=0x7f7574003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f7583fff700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7574003a60 0x7f7574003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.977+0000 7f7583fff700 1 -- 172.21.15.61:0/784647587 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574003570 con 0x7f7574004810 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f7583fff700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7574004810 0x7f7574004c80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7584071720 tx=0x7f75700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6ae6f8291b10ef server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000e710 con 0x7f7574004810 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000e870 con 0x7f7574004810 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f75837fe700 1 -- 172.21.15.61:0/784647587 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000ec30 con 0x7f7574004810 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f758b1fe700 1 -- 172.21.15.61:0/784647587 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7574004810 msgr2=0x7f7574004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f758b1fe700 1 --2- 172.21.15.61:0/784647587 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7574004810 0x7f7574004c80 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7584071720 tx=0x7f75700091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f758979b700 1 -- 172.21.15.61:0/784647587 reap_dead start 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f758b1fe700 1 -- 172.21.15.61:0/784647587 shutdown_connections 2023-12-24T20:02:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f758b1fe700 1 -- 172.21.15.61:0/784647587 >> 172.21.15.61:0/784647587 conn(0x7f75840ca200 msgr2=0x7f75840ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:11.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f758b1fe700 1 -- 172.21.15.61:0/784647587 shutdown_connections 2023-12-24T20:02:11.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.978+0000 7f758b1fe700 1 -- 172.21.15.61:0/784647587 wait complete. 2023-12-24T20:02:11.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.979+0000 7f758b1fe700 1 Processor -- start 2023-12-24T20:02:11.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.980+0000 7f758b1fe700 1 -- start start 2023-12-24T20:02:11.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.980+0000 7f758b1fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7574004810 0x7f75841513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.980+0000 7f758b1fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75840b1120 0x7f75840b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.980+0000 7f758b1fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f758415c540 0x7f758415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.980+0000 7f758b1fe700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584151930 con 0x7f758415c540 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.980+0000 7f758b1fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840b1ad0 con 0x7f75840b1120 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.980+0000 7f758b1fe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758415cf00 con 0x7f7574004810 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.980+0000 7f758979b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f758415c540 0x7f758415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f758979b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f758415c540 0x7f758415c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52892/0 (socket says 172.21.15.61:52892) 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f758979b700 1 -- 172.21.15.61:0/490994536 learned_addr learned my addr 172.21.15.61:0/490994536 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f7588f9a700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7574004810 0x7f75841513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f7583fff700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75840b1120 0x7f75840b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f758979b700 1 -- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7574004810 msgr2=0x7f75841513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f758979b700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7574004810 0x7f75841513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f758979b700 1 -- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75840b1120 msgr2=0x7f75840b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f758979b700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75840b1120 0x7f75840b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f758979b700 1 -- 172.21.15.61:0/490994536 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840b28f0 con 0x7f758415c540 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f7583fff700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75840b1120 0x7f75840b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:11.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f758979b700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f758415c540 0x7f758415c9c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f757c0094d0 tx=0x7f757c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f7580ff9700 1 -- 172.21.15.61:0/490994536 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00e040 con 0x7f758415c540 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f7580ff9700 1 -- 172.21.15.61:0/490994536 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c00f040 con 0x7f758415c540 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f758b1fe700 1 -- 172.21.15.61:0/490994536 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75840b1ce0 con 0x7f758415c540 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f7580ff9700 1 -- 172.21.15.61:0/490994536 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00fe50 con 0x7f758415c540 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.981+0000 7f758b1fe700 1 -- 172.21.15.61:0/490994536 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75840b22a0 con 0x7f758415c540 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.982+0000 7f758b1fe700 1 -- 172.21.15.61:0/490994536 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75840b2aa0 con 0x7f758415c540 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.983+0000 7f7580ff9700 1 -- 172.21.15.61:0/490994536 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f757c015640 con 0x7f758415c540 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.983+0000 7f7580ff9700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.983+0000 7f7580ff9700 1 -- 172.21.15.61:0/490994536 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f757c084c80 con 0x7f758415c540 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.983+0000 7f7588f9a700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.984+0000 7f7588f9a700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7568066f30 0x7f75680693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7578001d20 tx=0x7f7578001e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:11.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:11.987+0000 7f7580ff9700 1 -- 172.21.15.61:0/490994536 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75840b2aa0 con 0x7f758415c540 2023-12-24T20:02:12.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.226+0000 7f758b1fe700 1 -- 172.21.15.61:0/490994536 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75840b2aa0 con 0x7f758415c540 2023-12-24T20:02:12.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.227+0000 7f7580ff9700 1 -- 172.21.15.61:0/490994536 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f75840b2aa0 con 0x7f758415c540 2023-12-24T20:02:12.227 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:12.227 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2634636374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2634636374},{"type":"v1","addr":"172.21.15.61:6835","nonce":2634636374}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/856986572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":856986572},{"type":"v1","addr":"172.21.15.133:6836","nonce":856986572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1475170652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1475170652},{"type":"v1","addr":"172.21.15.133:6837","nonce":1475170652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:01:30.072202+0000","modified":"2023-12-24T20:01:33.718490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6318":{"gid":6318,"name":"c","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6834/2512648595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2512648595},{"type":"v1","addr":"172.21.15.61:6834","nonce":2512648595}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-12-24T20:02:12.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 -- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7568066f30 msgr2=0x7f75680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7568066f30 0x7f75680693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7578001d20 tx=0x7f7578001e90 comp rx=0 tx=0).stop 2023-12-24T20:02:12.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 -- 172.21.15.61:0/490994536 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f758415c540 msgr2=0x7f758415c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f758415c540 0x7f758415c9c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f757c0094d0 tx=0x7f757c00b040 comp rx=0 tx=0).stop 2023-12-24T20:02:12.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 -- 172.21.15.61:0/490994536 shutdown_connections 2023-12-24T20:02:12.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7574004810 0x7f75841513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7568066f30 0x7f75680693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f758415c540 0x7f758415c9c0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 --2- 172.21.15.61:0/490994536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75840b1120 0x7f75840b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 -- 172.21.15.61:0/490994536 >> 172.21.15.61:0/490994536 conn(0x7f75840ca200 msgr2=0x7f75841555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:12.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 -- 172.21.15.61:0/490994536 shutdown_connections 2023-12-24T20:02:12.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.229+0000 7f758b1fe700 1 -- 172.21.15.61:0/490994536 wait complete. 2023-12-24T20:02:12.230 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 52 2023-12-24T20:02:12.241 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:12.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.364+0000 7fcd3df65700 1 Processor -- start 2023-12-24T20:02:12.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.364+0000 7fcd3df65700 1 -- start start 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd3df65700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd38157780 0x7fcd3806c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd3df65700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcd380ca270 0x7fcd380cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd3df65700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd380ca6f0 con 0x7fcd3806c840 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd3df65700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd380ca9d0 con 0x7fcd380ca270 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd3df65700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd380cacb0 con 0x7fcd38157780 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd36ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcd380ca270 0x7fcd380cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd37fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fcd3806c840 0x7fcd3815ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39460/0 (socket says 172.21.15.61:39460) 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd37fff700 1 -- 172.21.15.61:0/289414758 learned_addr learned my addr 172.21.15.61:0/289414758 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd377fe700 1 --2- 172.21.15.61:0/289414758 >> v2:172.21.15.133:3300/0 conn(0x7fcd38157780 0x7fcd3806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd36ffd700 1 -- 172.21.15.61:0/289414758 >> v2:172.21.15.133:3300/0 conn(0x7fcd38157780 msgr2=0x7fcd3806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd36ffd700 1 --2- 172.21.15.61:0/289414758 >> v2:172.21.15.133:3300/0 conn(0x7fcd38157780 0x7fcd3806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd36ffd700 1 -- 172.21.15.61:0/289414758 >> v1:172.21.15.61:6789/0 conn(0x7fcd3806c840 legacy=0x7fcd3815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd36ffd700 1 -- 172.21.15.61:0/289414758 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380caf90 con 0x7fcd380ca270 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.365+0000 7fcd36ffd700 1 --2- 172.21.15.61:0/289414758 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd380ca270 0x7fcd380cdbb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fcd380cc2b0 tx=0x7fcd2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eeb15cebc1ea2cc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd367fc700 1 -- 172.21.15.61:0/289414758 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00b6b0 con 0x7fcd380ca270 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd367fc700 1 -- 172.21.15.61:0/289414758 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c00b810 con 0x7fcd380ca270 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd367fc700 1 -- 172.21.15.61:0/289414758 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00bbb0 con 0x7fcd380ca270 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd3df65700 1 -- 172.21.15.61:0/289414758 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd380ca270 msgr2=0x7fcd380cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd3df65700 1 --2- 172.21.15.61:0/289414758 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd380ca270 0x7fcd380cdbb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fcd380cc2b0 tx=0x7fcd2c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd3df65700 1 -- 172.21.15.61:0/289414758 shutdown_connections 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd3df65700 1 --2- 172.21.15.61:0/289414758 >> v2:172.21.15.133:3300/0 conn(0x7fcd38157780 0x7fcd3806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd3df65700 1 --2- 172.21.15.61:0/289414758 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd380ca270 0x7fcd380cdbb0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd3df65700 1 -- 172.21.15.61:0/289414758 >> 172.21.15.61:0/289414758 conn(0x7fcd3806b650 msgr2=0x7fcd380ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:12.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd3df65700 1 -- 172.21.15.61:0/289414758 shutdown_connections 2023-12-24T20:02:12.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.366+0000 7fcd3df65700 1 -- 172.21.15.61:0/289414758 wait complete. 2023-12-24T20:02:12.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.368+0000 7fcd3df65700 1 Processor -- start 2023-12-24T20:02:12.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.368+0000 7fcd3df65700 1 -- start start 2023-12-24T20:02:12.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd3df65700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd3806c840 0x7fcd38149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd3df65700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd38157780 0x7fcd38169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd3df65700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd381562b0 0x7fcd3816a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd3df65700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd38155e20 con 0x7fcd3806c840 2023-12-24T20:02:12.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd3df65700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381554f0 con 0x7fcd381562b0 2023-12-24T20:02:12.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd3df65700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381557d0 con 0x7fcd38157780 2023-12-24T20:02:12.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd377fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd3806c840 0x7fcd38149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd377fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd3806c840 0x7fcd38149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52908/0 (socket says 172.21.15.61:52908) 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd377fe700 1 -- 172.21.15.61:0/3335480768 learned_addr learned my addr 172.21.15.61:0/3335480768 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd37fff700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd381562b0 0x7fcd3816a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd36ffd700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd38157780 0x7fcd38169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd377fe700 1 -- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd38157780 msgr2=0x7fcd38169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd377fe700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd38157780 0x7fcd38169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd377fe700 1 -- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd381562b0 msgr2=0x7fcd3816a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd377fe700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd381562b0 0x7fcd3816a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd377fe700 1 -- 172.21.15.61:0/3335480768 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c009420 con 0x7fcd3806c840 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd37fff700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd381562b0 0x7fcd3816a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd36ffd700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd38157780 0x7fcd38169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.369+0000 7fcd377fe700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd3806c840 0x7fcd38149f40 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800d860 tx=0x7fcd28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.370+0000 7fcd1f7fe700 1 -- 172.21.15.61:0/3335480768 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28009610 con 0x7fcd3806c840 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.370+0000 7fcd1f7fe700 1 -- 172.21.15.61:0/3335480768 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28009770 con 0x7fcd3806c840 2023-12-24T20:02:12.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.370+0000 7fcd1f7fe700 1 -- 172.21.15.61:0/3335480768 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28009b30 con 0x7fcd3806c840 2023-12-24T20:02:12.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.370+0000 7fcd3df65700 1 -- 172.21.15.61:0/3335480768 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd38155ab0 con 0x7fcd3806c840 2023-12-24T20:02:12.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.370+0000 7fcd3df65700 1 -- 172.21.15.61:0/3335480768 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3816deb0 con 0x7fcd3806c840 2023-12-24T20:02:12.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.371+0000 7fcd3df65700 1 -- 172.21.15.61:0/3335480768 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3804c3c0 con 0x7fcd3806c840 2023-12-24T20:02:12.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.371+0000 7fcd1f7fe700 1 -- 172.21.15.61:0/3335480768 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcd2801e460 con 0x7fcd3806c840 2023-12-24T20:02:12.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.371+0000 7fcd1f7fe700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcd24066f30 0x7fcd240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.372+0000 7fcd1f7fe700 1 -- 172.21.15.61:0/3335480768 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fcd28084bc0 con 0x7fcd3806c840 2023-12-24T20:02:12.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.372+0000 7fcd36ffd700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcd24066f30 0x7fcd240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.372+0000 7fcd36ffd700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcd24066f30 0x7fcd240693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcd3816dc50 tx=0x7fcd2c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:12.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.376+0000 7fcd1f7fe700 1 -- 172.21.15.61:0/3335480768 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd28051e10 con 0x7fcd3806c840 2023-12-24T20:02:12.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.574+0000 7fcd3df65700 1 -- 172.21.15.61:0/3335480768 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd3815b560 con 0x7fcd3806c840 2023-12-24T20:02:12.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.575+0000 7fcd1f7fe700 1 -- 172.21.15.61:0/3335480768 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+15408 (secure 0 0 0) 0x7fcd28055430 con 0x7fcd3806c840 2023-12-24T20:02:12.575 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:12.575 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":110,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:02.833407+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:01:28.014512+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-24T20:01:29.062088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 -- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcd24066f30 msgr2=0x7fcd240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcd24066f30 0x7fcd240693e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcd3816dc50 tx=0x7fcd2c017000 comp rx=0 tx=0).stop 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 -- 172.21.15.61:0/3335480768 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd3806c840 msgr2=0x7fcd38149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd3806c840 0x7fcd38149f40 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800d860 tx=0x7fcd28008040 comp rx=0 tx=0).stop 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 -- 172.21.15.61:0/3335480768 shutdown_connections 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcd24066f30 0x7fcd240693e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd381562b0 0x7fcd3816a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd3806c840 0x7fcd38149f40 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 --2- 172.21.15.61:0/3335480768 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd38157780 0x7fcd38169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 -- 172.21.15.61:0/3335480768 >> 172.21.15.61:0/3335480768 conn(0x7fcd3806b650 msgr2=0x7fcd381546e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:12.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 -- 172.21.15.61:0/3335480768 shutdown_connections 2023-12-24T20:02:12.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.577+0000 7fcd3df65700 1 -- 172.21.15.61:0/3335480768 wait complete. 2023-12-24T20:02:12.590 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:02:12.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.712+0000 7f3a9eb98700 1 Processor -- start 2023-12-24T20:02:12.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.712+0000 7f3a9eb98700 1 -- start start 2023-12-24T20:02:12.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.712+0000 7f3a9eb98700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a980cdff0 0x7f3a98159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.712+0000 7f3a9eb98700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98068310 0x7f3a9806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a9eb98700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a98067e80 con 0x7f3a981598e0 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a9eb98700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a980687b0 con 0x7f3a980cdff0 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a9eb98700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980ce460 con 0x7f3a98068310 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a9c934700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3a981598e0 0x7f3a980cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39470/0 (socket says 172.21.15.61:39470) 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a9c934700 1 -- 172.21.15.61:0/769422404 learned_addr learned my addr 172.21.15.61:0/769422404 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157911378 0 0) 0x7f3a98067e80 con 0x7f3a981598e0 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a88003570 con 0x7f3a981598e0 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a97fff700 1 --2- 172.21.15.61:0/769422404 >> v2:172.21.15.133:3300/0 conn(0x7f3a980cdff0 0x7f3a98159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a9d135700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98068310 0x7f3a9806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 372398483 0 0) 0x7f3a88003570 con 0x7f3a981598e0 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98068310 msgr2=0x7f3a9806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98068310 0x7f3a9806eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 >> v2:172.21.15.133:3300/0 conn(0x7f3a980cdff0 msgr2=0x7f3a98159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 --2- 172.21.15.61:0/769422404 >> v2:172.21.15.133:3300/0 conn(0x7f3a980cdff0 0x7f3a98159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98067550 con 0x7f3a981598e0 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f3a8c001470 con 0x7f3a981598e0 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 >> v1:172.21.15.61:6789/0 conn(0x7f3a981598e0 legacy=0x7f3a980cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a88003a60 0x7f3a88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98068310 0x7f3a88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a88004d50 0x7f3a880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980687b0 con 0x7f3a88004d50 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980ce460 con 0x7f3a88003a60 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8800ba60 con 0x7f3a98068310 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a9d135700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a88004d50 0x7f3a880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.713+0000 7f3a9c934700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a88003a60 0x7f3a88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a97fff700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98068310 0x7f3a88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a9d135700 1 -- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98068310 msgr2=0x7f3a88004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a9d135700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98068310 0x7f3a88004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a9d135700 1 -- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a88003a60 msgr2=0x7f3a88003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a9d135700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a88003a60 0x7f3a88003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a9d135700 1 -- 172.21.15.61:0/769422404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a88003570 con 0x7f3a88004d50 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a97fff700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98068310 0x7f3a88004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a9d135700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a88004d50 0x7f3a880051c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000e210 tx=0x7f3a9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607cf421550d1fc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000ea60 con 0x7f3a88004d50 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9000f040 con 0x7f3a88004d50 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a977fe700 1 -- 172.21.15.61:0/769422404 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000ee10 con 0x7f3a88004d50 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a9eb98700 1 -- 172.21.15.61:0/769422404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a88004d50 msgr2=0x7f3a880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a9eb98700 1 --2- 172.21.15.61:0/769422404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a88004d50 0x7f3a880051c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000e210 tx=0x7f3a9000b040 comp rx=0 tx=0).stop 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.714+0000 7f3a9d135700 1 -- 172.21.15.61:0/769422404 reap_dead start 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.715+0000 7f3a9eb98700 1 -- 172.21.15.61:0/769422404 shutdown_connections 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.715+0000 7f3a9eb98700 1 -- 172.21.15.61:0/769422404 >> 172.21.15.61:0/769422404 conn(0x7f3a9806b6a0 msgr2=0x7f3a980ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:12.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.715+0000 7f3a9eb98700 1 -- 172.21.15.61:0/769422404 shutdown_connections 2023-12-24T20:02:12.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.715+0000 7f3a9eb98700 1 -- 172.21.15.61:0/769422404 wait complete. 2023-12-24T20:02:12.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.716+0000 7f3a9eb98700 1 Processor -- start 2023-12-24T20:02:12.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.716+0000 7f3a9eb98700 1 -- start start 2023-12-24T20:02:12.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9eb98700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98153b40 0x7f3a98153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9eb98700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a980ad4b0 0x7f3a980c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9eb98700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a980b15e0 0x7f3a980c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9eb98700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980aa880 con 0x7f3a980b15e0 2023-12-24T20:02:12.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9eb98700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980aab60 con 0x7f3a980ad4b0 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9eb98700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980b2190 con 0x7f3a98153b40 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9d135700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a980b15e0 0x7f3a980c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9d135700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a980b15e0 0x7f3a980c3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52916/0 (socket says 172.21.15.61:52916) 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9d135700 1 -- 172.21.15.61:0/3555433710 learned_addr learned my addr 172.21.15.61:0/3555433710 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a97fff700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a980ad4b0 0x7f3a980c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9c934700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98153b40 0x7f3a98153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9d135700 1 -- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98153b40 msgr2=0x7f3a98153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9d135700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98153b40 0x7f3a98153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9d135700 1 -- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a980ad4b0 msgr2=0x7f3a980c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9d135700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a980ad4b0 0x7f3a980c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9d135700 1 -- 172.21.15.61:0/3555433710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a980b2470 con 0x7f3a980b15e0 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a97fff700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a980ad4b0 0x7f3a980c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9d135700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a980b15e0 0x7f3a980c3b20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000afd0 tx=0x7f3a9001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:12.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a94ff9700 1 -- 172.21.15.61:0/3555433710 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000ee60 con 0x7f3a980b15e0 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a94ff9700 1 -- 172.21.15.61:0/3555433710 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a90022070 con 0x7f3a980b15e0 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9eb98700 1 -- 172.21.15.61:0/3555433710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a98154450 con 0x7f3a980b15e0 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a94ff9700 1 -- 172.21.15.61:0/3555433710 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9001e890 con 0x7f3a980b15e0 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.717+0000 7f3a9eb98700 1 -- 172.21.15.61:0/3555433710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a98169a10 con 0x7f3a980b15e0 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.718+0000 7f3a9eb98700 1 -- 172.21.15.61:0/3555433710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a980aacd0 con 0x7f3a980b15e0 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.719+0000 7f3a94ff9700 1 -- 172.21.15.61:0/3555433710 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3a90003040 con 0x7f3a980b15e0 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.719+0000 7f3a94ff9700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a7c066f30 0x7f3a7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.719+0000 7f3a94ff9700 1 -- 172.21.15.61:0/3555433710 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f3a90024070 con 0x7f3a980b15e0 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.719+0000 7f3a9c934700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a7c066f30 0x7f3a7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.720+0000 7f3a9c934700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a7c066f30 0x7f3a7c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c000e10 tx=0x7f3a8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:12.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.723+0000 7f3a94ff9700 1 -- 172.21.15.61:0/3555433710 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a900533f0 con 0x7f3a980b15e0 2023-12-24T20:02:12.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.961+0000 7f3a9eb98700 1 -- 172.21.15.61:0/3555433710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3a9804c3c0 con 0x7f3a980b15e0 2023-12-24T20:02:12.962 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:02:12.962+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:02:12.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.968+0000 7f3a94ff9700 1 -- 172.21.15.61:0/3555433710 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3a90056a10 con 0x7f3a980b15e0 2023-12-24T20:02:12.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 -- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a7c066f30 msgr2=0x7f3a7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a7c066f30 0x7f3a7c0693e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c000e10 tx=0x7f3a8c009040 comp rx=0 tx=0).stop 2023-12-24T20:02:12.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 -- 172.21.15.61:0/3555433710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a980b15e0 msgr2=0x7f3a980c3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:12.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a980b15e0 0x7f3a980c3b20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000afd0 tx=0x7f3a9001a000 comp rx=0 tx=0).stop 2023-12-24T20:02:12.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 -- 172.21.15.61:0/3555433710 shutdown_connections 2023-12-24T20:02:12.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a98153b40 0x7f3a98153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a7c066f30 0x7f3a7c0693e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a980b15e0 0x7f3a980c3b20 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 --2- 172.21.15.61:0/3555433710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a980ad4b0 0x7f3a980c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:12.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 -- 172.21.15.61:0/3555433710 >> 172.21.15.61:0/3555433710 conn(0x7f3a9806b6a0 msgr2=0x7f3a98155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:12.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 -- 172.21.15.61:0/3555433710 shutdown_connections 2023-12-24T20:02:12.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:12.971+0000 7f3a9eb98700 1 -- 172.21.15.61:0/3555433710 wait complete. 2023-12-24T20:02:12.972 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:02:12.973 INFO:tasks.ceph.mds.c.smithi061.stderr: -9446> 2023-12-24T20:01:35.655+0000 7fd3cad2b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:02:12.984 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:02:13.004 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T20:02:13.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.109+0000 7efd44fa0700 1 Processor -- start 2023-12-24T20:02:13.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.109+0000 7efd44fa0700 1 -- start start 2023-12-24T20:02:13.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd44fa0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 0x7efd4015e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:13.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd44fa0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd401596a0 0x7efd40159b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:13.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd44fa0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4015de70 con 0x7efd4006ae60 2023-12-24T20:02:13.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd44fa0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd400cac80 con 0x7efd401596a0 2023-12-24T20:02:13.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd44fa0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400caf60 con 0x7efd4006b230 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd3dd9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 0x7efd4015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd3e59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efd4006ae60 0x7efd400ca1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:52092/0 (socket says 172.21.15.61:52092) 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd3ed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd401596a0 0x7efd40159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd3e59c700 1 -- 172.21.15.61:0/261717826 learned_addr learned my addr 172.21.15.61:0/261717826 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd3ed9d700 1 -- 172.21.15.61:0/261717826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 msgr2=0x7efd4015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd3ed9d700 1 --2- 172.21.15.61:0/261717826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 0x7efd4015e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd3ed9d700 1 -- 172.21.15.61:0/261717826 >> v1:172.21.15.133:6789/0 conn(0x7efd4006ae60 legacy=0x7efd400ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd3ed9d700 1 -- 172.21.15.61:0/261717826 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4015d820 con 0x7efd401596a0 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd3d59a700 1 -- 172.21.15.61:0/261717826 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596267331 0 0) 0x7efd4015de70 con 0x7efd4006ae60 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.110+0000 7efd3dd9b700 1 --2- 172.21.15.61:0/261717826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 0x7efd4015e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:13.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.111+0000 7efd3ed9d700 1 --2- 172.21.15.61:0/261717826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd401596a0 0x7efd40159b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efd38009e60 tx=0x7efd38009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9874b9a64cc0458e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.111+0000 7efd3d59a700 1 -- 172.21.15.61:0/261717826 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3800e070 con 0x7efd401596a0 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.111+0000 7efd3d59a700 1 -- 172.21.15.61:0/261717826 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3800bb60 con 0x7efd401596a0 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.111+0000 7efd3d59a700 1 -- 172.21.15.61:0/261717826 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38012430 con 0x7efd401596a0 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.111+0000 7efd44fa0700 1 -- 172.21.15.61:0/261717826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd401596a0 msgr2=0x7efd40159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.111+0000 7efd44fa0700 1 --2- 172.21.15.61:0/261717826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd401596a0 0x7efd40159b20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efd38009e60 tx=0x7efd38009780 comp rx=0 tx=0).stop 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.111+0000 7efd44fa0700 1 -- 172.21.15.61:0/261717826 shutdown_connections 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.111+0000 7efd44fa0700 1 --2- 172.21.15.61:0/261717826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd401596a0 0x7efd40159b20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.111+0000 7efd44fa0700 1 --2- 172.21.15.61:0/261717826 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 0x7efd4015e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.111+0000 7efd44fa0700 1 -- 172.21.15.61:0/261717826 >> 172.21.15.61:0/261717826 conn(0x7efd400ce800 msgr2=0x7efd400cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.112+0000 7efd44fa0700 1 -- 172.21.15.61:0/261717826 shutdown_connections 2023-12-24T20:02:13.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.112+0000 7efd44fa0700 1 -- 172.21.15.61:0/261717826 wait complete. 2023-12-24T20:02:13.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.113+0000 7efd44fa0700 1 Processor -- start 2023-12-24T20:02:13.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.113+0000 7efd44fa0700 1 -- start start 2023-12-24T20:02:13.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.113+0000 7efd44fa0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4006ae60 0x7efd40158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.113+0000 7efd44fa0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 0x7efd40159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.113+0000 7efd44fa0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd401596a0 0x7efd40159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.113+0000 7efd44fa0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c5810 con 0x7efd401596a0 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.113+0000 7efd44fa0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400b0bd0 con 0x7efd4006ae60 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.113+0000 7efd44fa0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4015a660 con 0x7efd4006b230 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.113+0000 7efd3ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd401596a0 0x7efd40159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd3ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd401596a0 0x7efd40159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52942/0 (socket says 172.21.15.61:52942) 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd3ed9d700 1 -- 172.21.15.61:0/3613915241 learned_addr learned my addr 172.21.15.61:0/3613915241 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd3dd9b700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 0x7efd40159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd3e59c700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4006ae60 0x7efd40158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd3ed9d700 1 -- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 msgr2=0x7efd40159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd3ed9d700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 0x7efd40159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd3ed9d700 1 -- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4006ae60 msgr2=0x7efd40158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:13.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd3ed9d700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4006ae60 0x7efd40158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:13.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd3ed9d700 1 -- 172.21.15.61:0/3613915241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd34009420 con 0x7efd401596a0 2023-12-24T20:02:13.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd3ed9d700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd401596a0 0x7efd40159fe0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efd3800b6c0 tx=0x7efd38019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:13.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd2e7fc700 1 -- 172.21.15.61:0/3613915241 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38012e90 con 0x7efd401596a0 2023-12-24T20:02:13.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd2e7fc700 1 -- 172.21.15.61:0/3613915241 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd38027470 con 0x7efd401596a0 2023-12-24T20:02:13.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd2e7fc700 1 -- 172.21.15.61:0/3613915241 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38027830 con 0x7efd401596a0 2023-12-24T20:02:13.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd44fa0700 1 -- 172.21.15.61:0/3613915241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd38009a20 con 0x7efd401596a0 2023-12-24T20:02:13.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.114+0000 7efd44fa0700 1 -- 172.21.15.61:0/3613915241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4015ac20 con 0x7efd401596a0 2023-12-24T20:02:13.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.115+0000 7efd44fa0700 1 -- 172.21.15.61:0/3613915241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4004c3c0 con 0x7efd401596a0 2023-12-24T20:02:13.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.116+0000 7efd2e7fc700 1 -- 172.21.15.61:0/3613915241 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7efd38024070 con 0x7efd401596a0 2023-12-24T20:02:13.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.116+0000 7efd2e7fc700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd20066f30 0x7efd200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:13.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.116+0000 7efd2e7fc700 1 -- 172.21.15.61:0/3613915241 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5820+0+0 (secure 0 0 0) 0x7efd38086c30 con 0x7efd401596a0 2023-12-24T20:02:13.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.116+0000 7efd3e59c700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd20066f30 0x7efd200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:13.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.117+0000 7efd3e59c700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd20066f30 0x7efd200693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efd30007fd0 tx=0x7efd30007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:13.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.120+0000 7efd2e7fc700 1 -- 172.21.15.61:0/3613915241 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd38053e30 con 0x7efd401596a0 2023-12-24T20:02:13.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.361+0000 7efd44fa0700 1 -- 172.21.15.61:0/3613915241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efd400c5950 con 0x7efd401596a0 2023-12-24T20:02:13.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.968+0000 7efd2e7fc700 1 -- 172.21.15.61:0/3613915241 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7efd400c5950 con 0x7efd401596a0 2023-12-24T20:02:13.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 -- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd20066f30 msgr2=0x7efd200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:13.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd20066f30 0x7efd200693e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efd30007fd0 tx=0x7efd30007d30 comp rx=0 tx=0).stop 2023-12-24T20:02:13.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 -- 172.21.15.61:0/3613915241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd401596a0 msgr2=0x7efd40159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:13.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd401596a0 0x7efd40159fe0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efd3800b6c0 tx=0x7efd38019000 comp rx=0 tx=0).stop 2023-12-24T20:02:13.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 -- 172.21.15.61:0/3613915241 shutdown_connections 2023-12-24T20:02:13.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7efd20066f30 0x7efd200693e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:13.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7efd401596a0 0x7efd40159fe0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:13.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4006ae60 0x7efd40158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:13.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 --2- 172.21.15.61:0/3613915241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7efd4006b230 0x7efd40159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:13.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 -- 172.21.15.61:0/3613915241 >> 172.21.15.61:0/3613915241 conn(0x7efd400ce800 msgr2=0x7efd400cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:13.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 -- 172.21.15.61:0/3613915241 shutdown_connections 2023-12-24T20:02:13.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:13.971+0000 7efd44fa0700 1 -- 172.21.15.61:0/3613915241 wait complete. 2023-12-24T20:02:13.986 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:02:14.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.161+0000 7f0a1e8c2700 1 Processor -- start 2023-12-24T20:02:14.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.161+0000 7f0a1e8c2700 1 -- start start 2023-12-24T20:02:14.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a1e8c2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a18159a10 0x7f0a180c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:14.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a1e8c2700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a18070d50 con 0x7f0a18159de0 2023-12-24T20:02:14.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a1e8c2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a18071290 con 0x7f0a1806a800 2023-12-24T20:02:14.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a1e8c2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18070fb0 con 0x7f0a18159a10 2023-12-24T20:02:14.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a1ce5f700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0a18159de0 0x7f0a180cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39494/0 (socket says 172.21.15.61:39494) 2023-12-24T20:02:14.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a1ce5f700 1 -- 172.21.15.61:0/2876165659 learned_addr learned my addr 172.21.15.61:0/2876165659 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:14.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a17fff700 1 --2- 172.21.15.61:0/2876165659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a18159a10 0x7f0a180c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:14.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a16ffd700 1 -- 172.21.15.61:0/2876165659 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418942343 0 0) 0x7f0a18070d50 con 0x7f0a18159de0 2023-12-24T20:02:14.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a16ffd700 1 -- 172.21.15.61:0/2876165659 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a00003570 con 0x7f0a18159de0 2023-12-24T20:02:14.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a16ffd700 1 -- 172.21.15.61:0/2876165659 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904650803 0 0) 0x7f0a18071290 con 0x7f0a1806a800 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.162+0000 7f0a16ffd700 1 -- 172.21.15.61:0/2876165659 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a18070d50 con 0x7f0a1806a800 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.163+0000 7f0a16ffd700 1 -- 172.21.15.61:0/2876165659 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3117254824 0 0) 0x7f0a00003570 con 0x7f0a18159de0 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.163+0000 7f0a17fff700 1 -- 172.21.15.61:0/2876165659 >> v1:172.21.15.133:6789/0 conn(0x7f0a1806a800 legacy=0x7f0a18070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.163+0000 7f0a17fff700 1 -- 172.21.15.61:0/2876165659 >> v1:172.21.15.61:6789/0 conn(0x7f0a18159de0 legacy=0x7f0a180cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.163+0000 7f0a17fff700 1 -- 172.21.15.61:0/2876165659 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180675f0 con 0x7f0a18159a10 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.163+0000 7f0a17fff700 1 --2- 172.21.15.61:0/2876165659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a18159a10 0x7f0a180c7d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009910 tx=0x7f0a080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32defe6250a2a774 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.163+0000 7f0a16ffd700 1 -- 172.21.15.61:0/2876165659 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100017f0 con 0x7f0a18159a10 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.163+0000 7f0a16ffd700 1 -- 172.21.15.61:0/2876165659 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a08011420 con 0x7f0a18159a10 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.163+0000 7f0a16ffd700 1 -- 172.21.15.61:0/2876165659 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080117c0 con 0x7f0a18159a10 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.163+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/2876165659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a18159a10 msgr2=0x7f0a180c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.163+0000 7f0a1e8c2700 1 --2- 172.21.15.61:0/2876165659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a18159a10 0x7f0a180c7d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009910 tx=0x7f0a080091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.164+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/2876165659 shutdown_connections 2023-12-24T20:02:14.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.164+0000 7f0a1e8c2700 1 --2- 172.21.15.61:0/2876165659 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a18159a10 0x7f0a180c7d40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:14.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.164+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/2876165659 >> 172.21.15.61:0/2876165659 conn(0x7f0a180ce180 msgr2=0x7f0a180ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:14.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.164+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/2876165659 shutdown_connections 2023-12-24T20:02:14.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.164+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/2876165659 wait complete. 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.165+0000 7f0a1e8c2700 1 Processor -- start 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.165+0000 7f0a1e8c2700 1 -- start start 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1e8c2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a1806a800 0x7f0a180c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1e8c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a18159a10 0x7f0a1814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1e8c2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a18159de0 0x7f0a180c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1e8c2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180c5e70 con 0x7f0a18159de0 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1e8c2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1814c8f0 con 0x7f0a18159a10 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1e8c2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180c7960 con 0x7f0a1806a800 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1ce5f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a18159de0 0x7f0a180c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1ce5f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a18159de0 0x7f0a180c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52954/0 (socket says 172.21.15.61:52954) 2023-12-24T20:02:14.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1ce5f700 1 -- 172.21.15.61:0/355940720 learned_addr learned my addr 172.21.15.61:0/355940720 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a17fff700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a1806a800 0x7f0a180c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a177fe700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a18159a10 0x7f0a1814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1ce5f700 1 -- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a1806a800 msgr2=0x7f0a180c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1ce5f700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a1806a800 0x7f0a180c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1ce5f700 1 -- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a18159a10 msgr2=0x7f0a1814c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1ce5f700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a18159a10 0x7f0a1814c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1ce5f700 1 -- 172.21.15.61:0/355940720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a08009420 con 0x7f0a18159de0 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a17fff700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a1806a800 0x7f0a180c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1ce5f700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a18159de0 0x7f0a180c7420 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000ccc0 tx=0x7f0a10007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f09fffff700 1 -- 172.21.15.61:0/355940720 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000ce70 con 0x7f0a18159de0 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f09fffff700 1 -- 172.21.15.61:0/355940720 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a10004dc0 con 0x7f0a18159de0 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/355940720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a180c5540 con 0x7f0a18159de0 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.166+0000 7f09fffff700 1 -- 172.21.15.61:0/355940720 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000ab50 con 0x7f0a18159de0 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.167+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/355940720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a180c5b00 con 0x7f0a18159de0 2023-12-24T20:02:14.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.167+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/355940720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1815d210 con 0x7f0a18159de0 2023-12-24T20:02:14.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.168+0000 7f09fffff700 1 -- 172.21.15.61:0/355940720 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0a10007150 con 0x7f0a18159de0 2023-12-24T20:02:14.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.168+0000 7f09fffff700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a04066f30 0x7f0a040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:14.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.168+0000 7f09fffff700 1 -- 172.21.15.61:0/355940720 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5820+0+0 (secure 0 0 0) 0x7f0a10083d20 con 0x7f0a18159de0 2023-12-24T20:02:14.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.169+0000 7f0a17fff700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a04066f30 0x7f0a040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:14.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.169+0000 7f0a17fff700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a04066f30 0x7f0a040693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0a080030c0 tx=0x7f0a08016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:14.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.173+0000 7f09fffff700 1 -- 172.21.15.61:0/355940720 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a10050f20 con 0x7f0a18159de0 2023-12-24T20:02:14.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.367+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/355940720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a1804c3c0 con 0x7f0a18159de0 2023-12-24T20:02:14.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.976+0000 7f09fffff700 1 -- 172.21.15.61:0/355940720 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v112) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0a100180d0 con 0x7f0a18159de0 2023-12-24T20:02:14.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a04066f30 msgr2=0x7f0a040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:14.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a04066f30 0x7f0a040693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0a080030c0 tx=0x7f0a08016000 comp rx=0 tx=0).stop 2023-12-24T20:02:14.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/355940720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a18159de0 msgr2=0x7f0a180c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:14.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a18159de0 0x7f0a180c7420 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000ccc0 tx=0x7f0a10007d20 comp rx=0 tx=0).stop 2023-12-24T20:02:14.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/355940720 shutdown_connections 2023-12-24T20:02:14.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a1806a800 0x7f0a180c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:14.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a04066f30 0x7f0a040693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:14.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a18159de0 0x7f0a180c7420 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:14.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 --2- 172.21.15.61:0/355940720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a18159a10 0x7f0a1814c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:14.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/355940720 >> 172.21.15.61:0/355940720 conn(0x7f0a180ce180 msgr2=0x7f0a18159090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:14.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.981+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/355940720 shutdown_connections 2023-12-24T20:02:14.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:14.982+0000 7f0a1e8c2700 1 -- 172.21.15.61:0/355940720 wait complete. 2023-12-24T20:02:14.983 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:02:14.997 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:02:15.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.128+0000 7f5e08984700 1 Processor -- start 2023-12-24T20:02:15.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.128+0000 7f5e08984700 1 -- start start 2023-12-24T20:02:15.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e08984700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 0x7f5e040c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:15.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e08984700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e04070640 0x7f5e04070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:15.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e08984700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e040cb340 con 0x7f5e04157890 2023-12-24T20:02:15.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e08984700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e04071000 con 0x7f5e04070640 2023-12-24T20:02:15.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e08984700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040cb900 con 0x7f5e040cd230 2023-12-24T20:02:15.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e02d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e04070640 0x7f5e04070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e0259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5e04157890 0x7f5e040cbd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:52118/0 (socket says 172.21.15.61:52118) 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 0x7f5e040c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e0259c700 1 -- 172.21.15.61:0/2885952419 learned_addr learned my addr 172.21.15.61:0/2885952419 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e01d9b700 1 -- 172.21.15.61:0/2885952419 >> v2:172.21.15.133:3300/0 conn(0x7f5e04070640 msgr2=0x7f5e04070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e01d9b700 1 --2- 172.21.15.61:0/2885952419 >> v2:172.21.15.133:3300/0 conn(0x7f5e04070640 0x7f5e04070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.130+0000 7f5e01d9b700 1 -- 172.21.15.61:0/2885952419 >> v1:172.21.15.133:6789/0 conn(0x7f5e04157890 legacy=0x7f5e040cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.131+0000 7f5e01d9b700 1 -- 172.21.15.61:0/2885952419 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040c9b00 con 0x7f5e040cd230 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.131+0000 7f5e02d9d700 1 --2- 172.21.15.61:0/2885952419 >> v2:172.21.15.133:3300/0 conn(0x7f5e04070640 0x7f5e04070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.131+0000 7f5e01d9b700 1 --2- 172.21.15.61:0/2885952419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 0x7f5e040c9160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5df40098e0 tx=0x7f5df40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae3f962ee8730a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.131+0000 7f5e0159a700 1 -- 172.21.15.61:0/2885952419 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400b640 con 0x7f5e040cd230 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.131+0000 7f5e0159a700 1 -- 172.21.15.61:0/2885952419 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400b7a0 con 0x7f5e040cd230 2023-12-24T20:02:15.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.131+0000 7f5e0159a700 1 -- 172.21.15.61:0/2885952419 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400bb40 con 0x7f5e040cd230 2023-12-24T20:02:15.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.131+0000 7f5e08984700 1 -- 172.21.15.61:0/2885952419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 msgr2=0x7f5e040c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:15.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.131+0000 7f5e08984700 1 --2- 172.21.15.61:0/2885952419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 0x7f5e040c9160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5df40098e0 tx=0x7f5df40091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:15.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.132+0000 7f5e08984700 1 -- 172.21.15.61:0/2885952419 shutdown_connections 2023-12-24T20:02:15.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.132+0000 7f5e08984700 1 --2- 172.21.15.61:0/2885952419 >> v2:172.21.15.133:3300/0 conn(0x7f5e04070640 0x7f5e04070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:15.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.132+0000 7f5e08984700 1 --2- 172.21.15.61:0/2885952419 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 0x7f5e040c9160 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:15.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.132+0000 7f5e08984700 1 -- 172.21.15.61:0/2885952419 >> 172.21.15.61:0/2885952419 conn(0x7f5e040ca1e0 msgr2=0x7f5e040ca5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:15.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.132+0000 7f5e08984700 1 -- 172.21.15.61:0/2885952419 shutdown_connections 2023-12-24T20:02:15.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.132+0000 7f5e08984700 1 -- 172.21.15.61:0/2885952419 wait complete. 2023-12-24T20:02:15.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.133+0000 7f5e08984700 1 Processor -- start 2023-12-24T20:02:15.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.133+0000 7f5e08984700 1 -- start start 2023-12-24T20:02:15.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e08984700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5e04070640 0x7f5e040b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:15.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e08984700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 0x7f5e040c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:15.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e08984700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e04157890 0x7f5e040c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:15.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e08984700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040b10c0 con 0x7f5e04070640 2023-12-24T20:02:15.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e08984700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040c6d50 con 0x7f5e04157890 2023-12-24T20:02:15.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e08984700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040c7030 con 0x7f5e040cd230 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e0259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5e04070640 0x7f5e040b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e0259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5e04070640 0x7f5e040b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52962/0 (socket says 172.21.15.61:52962) 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e0259c700 1 -- 172.21.15.61:0/758465369 learned_addr learned my addr 172.21.15.61:0/758465369 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e01d9b700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 0x7f5e040c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.134+0000 7f5e02d9d700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e04157890 0x7f5e040c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5e0259c700 1 -- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 msgr2=0x7f5e040c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5e0259c700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 0x7f5e040c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5e0259c700 1 -- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e04157890 msgr2=0x7f5e040c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5e0259c700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e04157890 0x7f5e040c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5e0259c700 1 -- 172.21.15.61:0/758465369 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc009a20 con 0x7f5e04070640 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5e0259c700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5e04070640 0x7f5e040b3020 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c560 tx=0x7f5dec001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5dfa7fc700 1 -- 172.21.15.61:0/758465369 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec005b30 con 0x7f5e04070640 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5dfa7fc700 1 -- 172.21.15.61:0/758465369 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec005cb0 con 0x7f5e04070640 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5e08984700 1 -- 172.21.15.61:0/758465369 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df4009420 con 0x7f5e04070640 2023-12-24T20:02:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5dfa7fc700 1 -- 172.21.15.61:0/758465369 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec007320 con 0x7f5e04070640 2023-12-24T20:02:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.135+0000 7f5e08984700 1 -- 172.21.15.61:0/758465369 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e040ad2c0 con 0x7f5e04070640 2023-12-24T20:02:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.136+0000 7f5e08984700 1 -- 172.21.15.61:0/758465369 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0404c3c0 con 0x7f5e04070640 2023-12-24T20:02:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.136+0000 7f5dfa7fc700 1 -- 172.21.15.61:0/758465369 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5dec007690 con 0x7f5e04070640 2023-12-24T20:02:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.137+0000 7f5dfa7fc700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5de4066f30 0x7f5de40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.137+0000 7f5dfa7fc700 1 -- 172.21.15.61:0/758465369 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f5dec083760 con 0x7f5e04070640 2023-12-24T20:02:15.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.137+0000 7f5e01d9b700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5de4066f30 0x7f5de40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:15.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.137+0000 7f5e01d9b700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5de4066f30 0x7f5de40693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5df40093f0 tx=0x7f5df4017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:15.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.141+0000 7f5dfa7fc700 1 -- 172.21.15.61:0/758465369 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5dec050bd0 con 0x7f5e04070640 2023-12-24T20:02:15.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.334+0000 7f5e08984700 1 -- 172.21.15.61:0/758465369 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5e040c9de0 con 0x7f5e04070640 2023-12-24T20:02:15.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.978+0000 7f5dfa7fc700 1 -- 172.21.15.61:0/758465369 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v113) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5dec0541f0 con 0x7f5e04070640 2023-12-24T20:02:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 -- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5de4066f30 msgr2=0x7f5de40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5de4066f30 0x7f5de40693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5df40093f0 tx=0x7f5df4017000 comp rx=0 tx=0).stop 2023-12-24T20:02:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 -- 172.21.15.61:0/758465369 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5e04070640 msgr2=0x7f5e040b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5e04070640 0x7f5e040b3020 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c560 tx=0x7f5dec001020 comp rx=0 tx=0).stop 2023-12-24T20:02:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 -- 172.21.15.61:0/758465369 shutdown_connections 2023-12-24T20:02:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5de4066f30 0x7f5de40693e0 secure :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5df40093f0 tx=0x7f5df4017000 comp rx=0 tx=0).stop 2023-12-24T20:02:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e04157890 0x7f5e040c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5e04070640 0x7f5e040b3020 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 --2- 172.21.15.61:0/758465369 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5e040cd230 0x7f5e040c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 -- 172.21.15.61:0/758465369 >> 172.21.15.61:0/758465369 conn(0x7f5e040ca1e0 msgr2=0x7f5e04069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.981+0000 7f5e08984700 1 -- 172.21.15.61:0/758465369 shutdown_connections 2023-12-24T20:02:15.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:15.982+0000 7f5e08984700 1 -- 172.21.15.61:0/758465369 wait complete. 2023-12-24T20:02:15.986 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T20:02:16.000 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:02:16.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.125+0000 7f91e550b700 1 Processor -- start 2023-12-24T20:02:16.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.125+0000 7f91e550b700 1 -- start start 2023-12-24T20:02:16.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.126+0000 7f91e550b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91e0159c60 0x7f91e00c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.126+0000 7f91e550b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e006b190 con 0x7f91e015a030 2023-12-24T20:02:16.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.126+0000 7f91e550b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e006a5c0 con 0x7f91e0070d50 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.126+0000 7f91e550b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e006a860 con 0x7f91e0159c60 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.126+0000 7f91de7fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f91e015a030 0x7f91e0070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39500/0 (socket says 172.21.15.61:39500) 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.126+0000 7f91de7fc700 1 -- 172.21.15.61:0/1223895183 learned_addr learned my addr 172.21.15.61:0/1223895183 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.126+0000 7f91deffd700 1 --2- 172.21.15.61:0/1223895183 >> v2:172.21.15.133:3300/0 conn(0x7f91e0159c60 0x7f91e00c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91ddffb700 1 -- 172.21.15.61:0/1223895183 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145104177 0 0) 0x7f91e006b190 con 0x7f91e015a030 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91ddffb700 1 -- 172.21.15.61:0/1223895183 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91cc003570 con 0x7f91e015a030 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91ddffb700 1 -- 172.21.15.61:0/1223895183 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756645801 0 0) 0x7f91e006a5c0 con 0x7f91e0070d50 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91ddffb700 1 -- 172.21.15.61:0/1223895183 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e006b190 con 0x7f91e0070d50 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91deffd700 1 -- 172.21.15.61:0/1223895183 >> v1:172.21.15.133:6789/0 conn(0x7f91e0070d50 legacy=0x7f91e00c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91deffd700 1 -- 172.21.15.61:0/1223895183 >> v1:172.21.15.61:6789/0 conn(0x7f91e015a030 legacy=0x7f91e0070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91ddffb700 1 -- 172.21.15.61:0/1223895183 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280227716 0 0) 0x7f91cc003570 con 0x7f91e015a030 2023-12-24T20:02:16.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91deffd700 1 -- 172.21.15.61:0/1223895183 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e006ab40 con 0x7f91e0159c60 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91deffd700 1 --2- 172.21.15.61:0/1223895183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e0159c60 0x7f91e00c4000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f91c80098e0 tx=0x7f91c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c780ef9ea5f0397 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91ddffb700 1 -- 172.21.15.61:0/1223895183 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8011630 con 0x7f91e0159c60 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91ddffb700 1 -- 172.21.15.61:0/1223895183 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c8011790 con 0x7f91e0159c60 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.127+0000 7f91ddffb700 1 -- 172.21.15.61:0/1223895183 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8011b30 con 0x7f91e0159c60 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.128+0000 7f91e550b700 1 -- 172.21.15.61:0/1223895183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e0159c60 msgr2=0x7f91e00c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.128+0000 7f91e550b700 1 --2- 172.21.15.61:0/1223895183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e0159c60 0x7f91e00c4000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f91c80098e0 tx=0x7f91c80091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.128+0000 7f91e550b700 1 -- 172.21.15.61:0/1223895183 shutdown_connections 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.128+0000 7f91e550b700 1 --2- 172.21.15.61:0/1223895183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e0159c60 0x7f91e00c4000 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.128+0000 7f91e550b700 1 -- 172.21.15.61:0/1223895183 >> 172.21.15.61:0/1223895183 conn(0x7f91e00ce420 msgr2=0x7f91e00ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.128+0000 7f91e550b700 1 -- 172.21.15.61:0/1223895183 shutdown_connections 2023-12-24T20:02:16.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.128+0000 7f91e550b700 1 -- 172.21.15.61:0/1223895183 wait complete. 2023-12-24T20:02:16.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.130+0000 7f91e550b700 1 Processor -- start 2023-12-24T20:02:16.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.130+0000 7f91e550b700 1 -- start start 2023-12-24T20:02:16.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.130+0000 7f91e550b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e0070d50 0x7f91e016abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91e550b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91e0159c60 0x7f91e01524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91e550b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91e015a030 0x7f91e00b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91e550b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e016a720 con 0x7f91e015a030 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91e550b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e0152a00 con 0x7f91e0070d50 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91e550b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00b1190 con 0x7f91e0159c60 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91df7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91e015a030 0x7f91e00b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91df7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91e015a030 0x7f91e00b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52974/0 (socket says 172.21.15.61:52974) 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91df7fe700 1 -- 172.21.15.61:0/3328668851 learned_addr learned my addr 172.21.15.61:0/3328668851 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91de7fc700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91e0159c60 0x7f91e01524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91deffd700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e0070d50 0x7f91e016abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91df7fe700 1 -- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91e0159c60 msgr2=0x7f91e01524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91df7fe700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91e0159c60 0x7f91e01524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91df7fe700 1 -- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e0070d50 msgr2=0x7f91e016abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91df7fe700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e0070d50 0x7f91e016abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91df7fe700 1 -- 172.21.15.61:0/3328668851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8009420 con 0x7f91e015a030 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91de7fc700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91e0159c60 0x7f91e01524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91deffd700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e0070d50 0x7f91e016abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91df7fe700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91e015a030 0x7f91e00b0890 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c830 tx=0x7f91d8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91d6ffd700 1 -- 172.21.15.61:0/3328668851 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8012630 con 0x7f91e015a030 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91d6ffd700 1 -- 172.21.15.61:0/3328668851 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d8012790 con 0x7f91e015a030 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91d6ffd700 1 -- 172.21.15.61:0/3328668851 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d8012b90 con 0x7f91e015a030 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91e550b700 1 -- 172.21.15.61:0/3328668851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e00b1470 con 0x7f91e015a030 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.131+0000 7f91e550b700 1 -- 172.21.15.61:0/3328668851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e016a080 con 0x7f91e015a030 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.132+0000 7f91e550b700 1 -- 172.21.15.61:0/3328668851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e004c3c0 con 0x7f91e015a030 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.133+0000 7f91d6ffd700 1 -- 172.21.15.61:0/3328668851 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f91d801b400 con 0x7f91e015a030 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.133+0000 7f91d6ffd700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f91c0066f30 0x7f91c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.133+0000 7f91d6ffd700 1 -- 172.21.15.61:0/3328668851 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f91d8084740 con 0x7f91e015a030 2023-12-24T20:02:16.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.133+0000 7f91deffd700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f91c0066f30 0x7f91c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.134+0000 7f91deffd700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f91c0066f30 0x7f91c00693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91e00ccc40 tx=0x7f91c8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:16.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.138+0000 7f91d6ffd700 1 -- 172.21.15.61:0/3328668851 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91d8051c10 con 0x7f91e015a030 2023-12-24T20:02:16.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.335+0000 7f91e550b700 1 -- 172.21.15.61:0/3328668851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f91e016a860 con 0x7f91e015a030 2023-12-24T20:02:16.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.339+0000 7f91d6ffd700 1 -- 172.21.15.61:0/3328668851 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f91d8055230 con 0x7f91e015a030 2023-12-24T20:02:16.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 -- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f91c0066f30 msgr2=0x7f91c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f91c0066f30 0x7f91c00693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f91e00ccc40 tx=0x7f91c8017000 comp rx=0 tx=0).stop 2023-12-24T20:02:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 -- 172.21.15.61:0/3328668851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91e015a030 msgr2=0x7f91e00b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91e015a030 0x7f91e00b0890 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f91d800c830 tx=0x7f91d8007f90 comp rx=0 tx=0).stop 2023-12-24T20:02:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 -- 172.21.15.61:0/3328668851 shutdown_connections 2023-12-24T20:02:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f91c0066f30 0x7f91c00693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91e015a030 0x7f91e00b0890 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91e0070d50 0x7f91e016abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 --2- 172.21.15.61:0/3328668851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91e0159c60 0x7f91e01524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 -- 172.21.15.61:0/3328668851 >> 172.21.15.61:0/3328668851 conn(0x7f91e00ce420 msgr2=0x7f91e0070640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 -- 172.21.15.61:0/3328668851 shutdown_connections 2023-12-24T20:02:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.341+0000 7f91e550b700 1 -- 172.21.15.61:0/3328668851 wait complete. 2023-12-24T20:02:16.353 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-12-24T20:02:16.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.475+0000 7f4b40c01700 1 Processor -- start 2023-12-24T20:02:16.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.475+0000 7f4b40c01700 1 -- start start 2023-12-24T20:02:16.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b40c01700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4b3c159b00 0x7f4b3c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b40c01700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b3c070d50 0x7f4b3c0afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b40c01700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3c0a84d0 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b40c01700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3c0b01b0 con 0x7f4b3c159b00 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b40c01700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0a7620 con 0x7f4b3c070d50 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3a59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4b3c159b00 0x7f4b3c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3a59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4b3c159b00 0x7f4b3c067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41536/0 (socket says 172.21.15.61:41536) 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3a59c700 1 -- 172.21.15.61:0/4130399606 learned_addr learned my addr 172.21.15.61:0/4130399606 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3ad9d700 1 --2- 172.21.15.61:0/4130399606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b3c070d50 0x7f4b3c0afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3a59c700 1 -- 172.21.15.61:0/4130399606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b3c070d50 msgr2=0x7f4b3c0afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3a59c700 1 --2- 172.21.15.61:0/4130399606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b3c070d50 0x7f4b3c0afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3a59c700 1 -- 172.21.15.61:0/4130399606 >> v1:172.21.15.133:6789/0 conn(0x7f4b3c0af7d0 legacy=0x7f4b3c070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3a59c700 1 -- 172.21.15.61:0/4130399606 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c0a78c0 con 0x7f4b3c159b00 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3a59c700 1 --2- 172.21.15.61:0/4130399606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c159b00 0x7f4b3c067550 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0099b0 tx=0x7f4b2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f260aff58c56ca server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:16.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3959a700 1 -- 172.21.15.61:0/4130399606 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00b820 con 0x7f4b3c159b00 2023-12-24T20:02:16.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3959a700 1 -- 172.21.15.61:0/4130399606 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00b980 con 0x7f4b3c159b00 2023-12-24T20:02:16.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.476+0000 7f4b3959a700 1 -- 172.21.15.61:0/4130399606 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00bd20 con 0x7f4b3c159b00 2023-12-24T20:02:16.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.477+0000 7f4b40c01700 1 -- 172.21.15.61:0/4130399606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c159b00 msgr2=0x7f4b3c067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.477+0000 7f4b40c01700 1 --2- 172.21.15.61:0/4130399606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c159b00 0x7f4b3c067550 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0099b0 tx=0x7f4b2c009250 comp rx=0 tx=0).stop 2023-12-24T20:02:16.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.477+0000 7f4b40c01700 1 -- 172.21.15.61:0/4130399606 shutdown_connections 2023-12-24T20:02:16.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.477+0000 7f4b40c01700 1 --2- 172.21.15.61:0/4130399606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b3c070d50 0x7f4b3c0afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.477+0000 7f4b40c01700 1 --2- 172.21.15.61:0/4130399606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c159b00 0x7f4b3c067550 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.477+0000 7f4b40c01700 1 -- 172.21.15.61:0/4130399606 >> 172.21.15.61:0/4130399606 conn(0x7f4b3c0ca200 msgr2=0x7f4b3c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:16.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.477+0000 7f4b40c01700 1 -- 172.21.15.61:0/4130399606 shutdown_connections 2023-12-24T20:02:16.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.477+0000 7f4b40c01700 1 -- 172.21.15.61:0/4130399606 wait complete. 2023-12-24T20:02:16.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.478+0000 7f4b40c01700 1 Processor -- start 2023-12-24T20:02:16.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.478+0000 7f4b40c01700 1 -- start start 2023-12-24T20:02:16.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b40c01700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b3c070d50 0x7f4b3c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b40c01700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c0af7d0 0x7f4b3c0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b40c01700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b3c159b00 0x7f4b3c15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b40c01700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c15e5f0 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b40c01700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c15e8d0 con 0x7f4b3c159b00 2023-12-24T20:02:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b40c01700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c15ebb0 con 0x7f4b3c070d50 2023-12-24T20:02:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b39d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c0af7d0 0x7f4b3c0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b39d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c0af7d0 0x7f4b3c0b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41540/0 (socket says 172.21.15.61:41540) 2023-12-24T20:02:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b39d9b700 1 -- 172.21.15.61:0/2187436372 learned_addr learned my addr 172.21.15.61:0/2187436372 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b3a59c700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b3c070d50 0x7f4b3c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b3ad9d700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b3c159b00 0x7f4b3c15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b39d9b700 1 -- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b3c070d50 msgr2=0x7f4b3c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b39d9b700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b3c070d50 0x7f4b3c15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b39d9b700 1 -- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b3c159b00 msgr2=0x7f4b3c15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b39d9b700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b3c159b00 0x7f4b3c15b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b39d9b700 1 -- 172.21.15.61:0/2187436372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0094f0 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.479+0000 7f4b39d9b700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c0af7d0 0x7f4b3c0b13a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c5d0 tx=0x7f4b30007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.480+0000 7f4b2a7fc700 1 -- 172.21.15.61:0/2187436372 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30011590 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.480+0000 7f4b2a7fc700 1 -- 172.21.15.61:0/2187436372 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b30011710 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.480+0000 7f4b40c01700 1 -- 172.21.15.61:0/2187436372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3c15ee90 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.480+0000 7f4b2a7fc700 1 -- 172.21.15.61:0/2187436372 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30011ad0 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.480+0000 7f4b40c01700 1 -- 172.21.15.61:0/2187436372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3c15f670 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.481+0000 7f4b40c01700 1 -- 172.21.15.61:0/2187436372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3c04c3c0 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.481+0000 7f4b2a7fc700 1 -- 172.21.15.61:0/2187436372 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4b3001c460 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.481+0000 7f4b2a7fc700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b1c066f30 0x7f4b1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:16.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.481+0000 7f4b2a7fc700 1 -- 172.21.15.61:0/2187436372 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4b30083ef0 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.482+0000 7f4b3a59c700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b1c066f30 0x7f4b1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:16.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.482+0000 7f4b3a59c700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b1c066f30 0x7f4b1c0693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0099b0 tx=0x7f4b2c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:16.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.486+0000 7f4b2a7fc700 1 -- 172.21.15.61:0/2187436372 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b30051460 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.762+0000 7f4b40c01700 1 -- 172.21.15.61:0/2187436372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f4b3c0af3a0 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.979+0000 7f4b2a7fc700 1 -- 172.21.15.61:0/2187436372 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v272) v1 ==== 137+0+0 (secure 0 0 0) 0x7f4b30054a80 con 0x7f4b3c0af7d0 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 -- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b1c066f30 msgr2=0x7f4b1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b1c066f30 0x7f4b1c0693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0099b0 tx=0x7f4b2c016000 comp rx=0 tx=0).stop 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 -- 172.21.15.61:0/2187436372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c0af7d0 msgr2=0x7f4b3c0b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c0af7d0 0x7f4b3c0b13a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c5d0 tx=0x7f4b30007f60 comp rx=0 tx=0).stop 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 -- 172.21.15.61:0/2187436372 shutdown_connections 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b3c070d50 0x7f4b3c15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b1c066f30 0x7f4b1c0693e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b3c159b00 0x7f4b3c15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 --2- 172.21.15.61:0/2187436372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b3c0af7d0 0x7f4b3c0b13a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 -- 172.21.15.61:0/2187436372 >> 172.21.15.61:0/2187436372 conn(0x7f4b3c0ca200 msgr2=0x7f4b3c068120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 -- 172.21.15.61:0/2187436372 shutdown_connections 2023-12-24T20:02:16.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:16.981+0000 7f4b40c01700 1 -- 172.21.15.61:0/2187436372 wait complete. 2023-12-24T20:02:16.994 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-24T20:02:16.994 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-12-24T20:02:16.994 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-12-24T20:02:16.994 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-12-24T20:02:17.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.116+0000 7f915996e700 1 Processor -- start 2023-12-24T20:02:17.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.116+0000 7f915996e700 1 -- start start 2023-12-24T20:02:17.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.117+0000 7f915996e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f915415bb60 0x7f9154098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:17.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.117+0000 7f915996e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9154098aa0 0x7f915415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:17.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.117+0000 7f915996e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91540b2eb0 con 0x7f915415c470 2023-12-24T20:02:17.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.117+0000 7f915996e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91540afc20 con 0x7f915415bb60 2023-12-24T20:02:17.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.117+0000 7f915996e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91540b2bd0 con 0x7f9154098aa0 2023-12-24T20:02:17.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.117+0000 7f9152ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f915415bb60 0x7f9154098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:17.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.117+0000 7f9152ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f915415bb60 0x7f9154098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41546/0 (socket says 172.21.15.61:41546) 2023-12-24T20:02:17.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.117+0000 7f9152ffd700 1 -- 172.21.15.61:0/2442754987 learned_addr learned my addr 172.21.15.61:0/2442754987 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.118+0000 7f91527fc700 1 --2- 172.21.15.61:0/2442754987 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9154098aa0 0x7f915415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.118+0000 7f9152ffd700 1 -- 172.21.15.61:0/2442754987 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9154098aa0 msgr2=0x7f915415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.118+0000 7f9152ffd700 1 --2- 172.21.15.61:0/2442754987 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9154098aa0 0x7f915415bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.118+0000 7f9152ffd700 1 -- 172.21.15.61:0/2442754987 >> v1:172.21.15.133:6789/0 conn(0x7f915415c470 legacy=0x7f91540b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.118+0000 7f9152ffd700 1 -- 172.21.15.61:0/2442754987 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91540afe10 con 0x7f915415bb60 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.118+0000 7f9152ffd700 1 --2- 172.21.15.61:0/2442754987 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415bb60 0x7f9154098560 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9148009990 tx=0x7f9148009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44eca1490324147 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.118+0000 7f9151ffb700 1 -- 172.21.15.61:0/2442754987 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148005c10 con 0x7f915415bb60 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.118+0000 7f9151ffb700 1 -- 172.21.15.61:0/2442754987 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148005d70 con 0x7f915415bb60 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.118+0000 7f9151ffb700 1 -- 172.21.15.61:0/2442754987 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914800b840 con 0x7f915415bb60 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.119+0000 7f915996e700 1 -- 172.21.15.61:0/2442754987 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415bb60 msgr2=0x7f9154098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.119+0000 7f915996e700 1 --2- 172.21.15.61:0/2442754987 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415bb60 0x7f9154098560 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9148009990 tx=0x7f9148009220 comp rx=0 tx=0).stop 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.119+0000 7f915996e700 1 -- 172.21.15.61:0/2442754987 shutdown_connections 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.119+0000 7f915996e700 1 --2- 172.21.15.61:0/2442754987 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415bb60 0x7f9154098560 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.119+0000 7f915996e700 1 --2- 172.21.15.61:0/2442754987 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9154098aa0 0x7f915415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:17.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.119+0000 7f915996e700 1 -- 172.21.15.61:0/2442754987 >> 172.21.15.61:0/2442754987 conn(0x7f9154097a10 msgr2=0x7f91540ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:17.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.119+0000 7f915996e700 1 -- 172.21.15.61:0/2442754987 shutdown_connections 2023-12-24T20:02:17.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.119+0000 7f915996e700 1 -- 172.21.15.61:0/2442754987 wait complete. 2023-12-24T20:02:17.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.120+0000 7f915996e700 1 Processor -- start 2023-12-24T20:02:17.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.120+0000 7f915996e700 1 -- start start 2023-12-24T20:02:17.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.121+0000 7f915996e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9154098aa0 0x7f915414ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:17.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.121+0000 7f915996e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915415bb60 0x7f9154153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:17.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.121+0000 7f915996e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415c470 0x7f91540b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:17.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.121+0000 7f915996e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9154154e30 con 0x7f915415c470 2023-12-24T20:02:17.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.121+0000 7f915996e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91541559b0 con 0x7f9154098aa0 2023-12-24T20:02:17.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.121+0000 7f915996e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9154155080 con 0x7f915415bb60 2023-12-24T20:02:17.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f91537fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415c470 0x7f91540b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f91537fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415c470 0x7f91540b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41560/0 (socket says 172.21.15.61:41560) 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f91537fe700 1 -- 172.21.15.61:0/992196007 learned_addr learned my addr 172.21.15.61:0/992196007 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f91527fc700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915415bb60 0x7f9154153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f9152ffd700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9154098aa0 0x7f915414ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f91537fe700 1 -- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915415bb60 msgr2=0x7f9154153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f91537fe700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915415bb60 0x7f9154153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f91537fe700 1 -- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9154098aa0 msgr2=0x7f915414ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f91537fe700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9154098aa0 0x7f915414ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f91537fe700 1 -- 172.21.15.61:0/992196007 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9148009480 con 0x7f915415c470 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f91537fe700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415c470 0x7f91540b1740 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f914c00bc30 tx=0x7f914c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f913affd700 1 -- 172.21.15.61:0/992196007 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c00c9b0 con 0x7f915415c470 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f913affd700 1 -- 172.21.15.61:0/992196007 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c00cb50 con 0x7f915415c470 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f915996e700 1 -- 172.21.15.61:0/992196007 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9154155360 con 0x7f915415c470 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f913affd700 1 -- 172.21.15.61:0/992196007 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c014410 con 0x7f915415c470 2023-12-24T20:02:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.122+0000 7f915996e700 1 -- 172.21.15.61:0/992196007 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915414f250 con 0x7f915415c470 2023-12-24T20:02:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.123+0000 7f915996e700 1 -- 172.21.15.61:0/992196007 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915406d440 con 0x7f915415c470 2023-12-24T20:02:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.124+0000 7f913affd700 1 -- 172.21.15.61:0/992196007 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f914c014800 con 0x7f915415c470 2023-12-24T20:02:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.124+0000 7f913affd700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9140066f30 0x7f91400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.124+0000 7f913affd700 1 -- 172.21.15.61:0/992196007 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f914c084be0 con 0x7f915415c470 2023-12-24T20:02:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.125+0000 7f9152ffd700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9140066f30 0x7f91400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.125+0000 7f9152ffd700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9140066f30 0x7f91400693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f91480030c0 tx=0x7f9148015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:17.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.128+0000 7f913affd700 1 -- 172.21.15.61:0/992196007 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f914c052130 con 0x7f915415c470 2023-12-24T20:02:17.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.410+0000 7f915996e700 1 -- 172.21.15.61:0/992196007 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f915404c3c0 con 0x7f915415c470 2023-12-24T20:02:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.980+0000 7f913affd700 1 -- 172.21.15.61:0/992196007 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v273) v1 ==== 131+0+0 (secure 0 0 0) 0x7f914c055750 con 0x7f915415c470 2023-12-24T20:02:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.982+0000 7f915996e700 1 -- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9140066f30 msgr2=0x7f91400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.982+0000 7f915996e700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9140066f30 0x7f91400693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f91480030c0 tx=0x7f9148015000 comp rx=0 tx=0).stop 2023-12-24T20:02:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.982+0000 7f915996e700 1 -- 172.21.15.61:0/992196007 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415c470 msgr2=0x7f91540b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.982+0000 7f915996e700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415c470 0x7f91540b1740 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f914c00bc30 tx=0x7f914c009820 comp rx=0 tx=0).stop 2023-12-24T20:02:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.982+0000 7f915996e700 1 -- 172.21.15.61:0/992196007 shutdown_connections 2023-12-24T20:02:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.982+0000 7f915996e700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9140066f30 0x7f91400693e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.982+0000 7f915996e700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f915415c470 0x7f91540b1740 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:17.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.982+0000 7f915996e700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9154098aa0 0x7f915414ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.982+0000 7f915996e700 1 --2- 172.21.15.61:0/992196007 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f915415bb60 0x7f9154153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.982+0000 7f915996e700 1 -- 172.21.15.61:0/992196007 >> 172.21.15.61:0/992196007 conn(0x7f9154097a10 msgr2=0x7f91540a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.983+0000 7f915996e700 1 -- 172.21.15.61:0/992196007 shutdown_connections 2023-12-24T20:02:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:17.983+0000 7f915996e700 1 -- 172.21.15.61:0/992196007 wait complete. 2023-12-24T20:02:17.997 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T20:02:18.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.124+0000 7f74c6c6c700 1 Processor -- start 2023-12-24T20:02:18.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.124+0000 7f74c6c6c700 1 -- start start 2023-12-24T20:02:18.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.125+0000 7f74c6c6c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74c00caa70 0x7f74c00caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.125+0000 7f74c6c6c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 0x7f74c0069910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.125+0000 7f74c6c6c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c00ab770 con 0x7f74c01578b0 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.125+0000 7f74c6c6c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c00cb450 con 0x7f74c00caa70 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.125+0000 7f74c6c6c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00aa880 con 0x7f74c0069500 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.125+0000 7f74c4a08700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f74c01578b0 0x7f74c015ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:43626/0 (socket says 172.21.15.61:43626) 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.125+0000 7f74c4a08700 1 -- 172.21.15.61:0/3782621747 learned_addr learned my addr 172.21.15.61:0/3782621747 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bffff700 1 --2- 172.21.15.61:0/3782621747 >> v2:172.21.15.133:3300/0 conn(0x7f74c00caa70 0x7f74c00caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74c5209700 1 --2- 172.21.15.61:0/3782621747 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 0x7f74c0069910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bf7fe700 1 -- 172.21.15.61:0/3782621747 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701947467 0 0) 0x7f74c00ab770 con 0x7f74c01578b0 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bf7fe700 1 -- 172.21.15.61:0/3782621747 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b0003570 con 0x7f74c01578b0 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bffff700 1 -- 172.21.15.61:0/3782621747 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 msgr2=0x7f74c0069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bffff700 1 --2- 172.21.15.61:0/3782621747 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 0x7f74c0069910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bffff700 1 -- 172.21.15.61:0/3782621747 >> v1:172.21.15.61:6789/0 conn(0x7f74c01578b0 legacy=0x7f74c015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bf7fe700 1 -- 172.21.15.61:0/3782621747 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2225186579 0 0) 0x7f74b0003570 con 0x7f74c01578b0 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bffff700 1 -- 172.21.15.61:0/3782621747 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c00aab60 con 0x7f74c00caa70 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74c5209700 1 --2- 172.21.15.61:0/3782621747 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 0x7f74c0069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bffff700 1 --2- 172.21.15.61:0/3782621747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c00caa70 0x7f74c00caf10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0098e0 tx=0x7f74ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd9984bcfd507904 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bf7fe700 1 -- 172.21.15.61:0/3782621747 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4001470 con 0x7f74c00caa70 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bf7fe700 1 -- 172.21.15.61:0/3782621747 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac011420 con 0x7f74c00caa70 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.126+0000 7f74bf7fe700 1 -- 172.21.15.61:0/3782621747 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0117a0 con 0x7f74c00caa70 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.127+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3782621747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c00caa70 msgr2=0x7f74c00caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.127+0000 7f74c6c6c700 1 --2- 172.21.15.61:0/3782621747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c00caa70 0x7f74c00caf10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0098e0 tx=0x7f74ac0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.127+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3782621747 shutdown_connections 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.127+0000 7f74c6c6c700 1 --2- 172.21.15.61:0/3782621747 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 0x7f74c0069910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.127+0000 7f74c6c6c700 1 --2- 172.21.15.61:0/3782621747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c00caa70 0x7f74c00caf10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.127+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3782621747 >> 172.21.15.61:0/3782621747 conn(0x7f74c0067fd0 msgr2=0x7f74c00ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:18.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.127+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3782621747 shutdown_connections 2023-12-24T20:02:18.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.127+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3782621747 wait complete. 2023-12-24T20:02:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.128+0000 7f74c6c6c700 1 Processor -- start 2023-12-24T20:02:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.128+0000 7f74c6c6c700 1 -- start start 2023-12-24T20:02:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74c6c6c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 0x7f74c015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74c6c6c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74c00caa70 0x7f74c00b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74c6c6c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c01578b0 0x7f74c015f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74c6c6c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c015d8f0 con 0x7f74c00caa70 2023-12-24T20:02:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74c6c6c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00b26f0 con 0x7f74c01578b0 2023-12-24T20:02:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74c6c6c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00c8590 con 0x7f74c0069500 2023-12-24T20:02:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74bffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74c00caa70 0x7f74c00b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74bffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74c00caa70 0x7f74c00b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41574/0 (socket says 172.21.15.61:41574) 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74bffff700 1 -- 172.21.15.61:0/3949290907 learned_addr learned my addr 172.21.15.61:0/3949290907 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74c5209700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c01578b0 0x7f74c015f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.129+0000 7f74c4a08700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 0x7f74c015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74bffff700 1 -- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 msgr2=0x7f74c015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74bffff700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 0x7f74c015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74bffff700 1 -- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c01578b0 msgr2=0x7f74c015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74bffff700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c01578b0 0x7f74c015f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74bffff700 1 -- 172.21.15.61:0/3949290907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8009a20 con 0x7f74c00caa70 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74c5209700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c01578b0 0x7f74c015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74c4a08700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 0x7f74c015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74bffff700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74c00caa70 0x7f74c00b0860 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f74c006afa0 tx=0x7f74ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74bcff9700 1 -- 172.21.15.61:0/3949290907 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac01cba0 con 0x7f74c00caa70 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74bcff9700 1 -- 172.21.15.61:0/3949290907 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac01cd00 con 0x7f74c00caa70 2023-12-24T20:02:18.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3949290907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac009420 con 0x7f74c00caa70 2023-12-24T20:02:18.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74bcff9700 1 -- 172.21.15.61:0/3949290907 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac01a680 con 0x7f74c00caa70 2023-12-24T20:02:18.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.130+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3949290907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c00c7c60 con 0x7f74c00caa70 2023-12-24T20:02:18.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.131+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3949290907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c004c3c0 con 0x7f74c00caa70 2023-12-24T20:02:18.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.131+0000 7f74bcff9700 1 -- 172.21.15.61:0/3949290907 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f74ac01aa30 con 0x7f74c00caa70 2023-12-24T20:02:18.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.132+0000 7f74bcff9700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74a4066f30 0x7f74a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.132+0000 7f74bcff9700 1 -- 172.21.15.61:0/3949290907 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f74ac085b80 con 0x7f74c00caa70 2023-12-24T20:02:18.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.132+0000 7f74c4a08700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74a4066f30 0x7f74a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.132+0000 7f74c4a08700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74a4066f30 0x7f74a40693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f74b4007ba0 tx=0x7f74b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.136+0000 7f74bcff9700 1 -- 172.21.15.61:0/3949290907 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74ac0530f0 con 0x7f74c00caa70 2023-12-24T20:02:18.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.330+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3949290907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f74c00aae40 con 0x7f74c00caa70 2023-12-24T20:02:18.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.333+0000 7f74bcff9700 1 -- 172.21.15.61:0/3949290907 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f74ac056710 con 0x7f74c00caa70 2023-12-24T20:02:18.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74a4066f30 msgr2=0x7f74a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74a4066f30 0x7f74a40693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f74b4007ba0 tx=0x7f74b4009040 comp rx=0 tx=0).stop 2023-12-24T20:02:18.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3949290907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74c00caa70 msgr2=0x7f74c00b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74c00caa70 0x7f74c00b0860 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f74c006afa0 tx=0x7f74ac016000 comp rx=0 tx=0).stop 2023-12-24T20:02:18.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3949290907 shutdown_connections 2023-12-24T20:02:18.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74c0069500 0x7f74c015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74a4066f30 0x7f74a40693e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74c01578b0 0x7f74c015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 --2- 172.21.15.61:0/3949290907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74c00caa70 0x7f74c00b0860 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3949290907 >> 172.21.15.61:0/3949290907 conn(0x7f74c0067fd0 msgr2=0x7f74c0156540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:18.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3949290907 shutdown_connections 2023-12-24T20:02:18.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.335+0000 7f74c6c6c700 1 -- 172.21.15.61:0/3949290907 wait complete. 2023-12-24T20:02:18.348 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:02:18.348 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:02:18.387 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:02:18.438 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:02:18.438 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T20:02:18.439 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:18.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.561+0000 7f2f4db49700 1 Processor -- start 2023-12-24T20:02:18.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.561+0000 7f2f4db49700 1 -- start start 2023-12-24T20:02:18.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f4db49700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f48068140 0x7f2f480cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f4db49700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2f48068510 0x7f2f480b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f4db49700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48159a60 0x7f2f48159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f4db49700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f480b2890 con 0x7f2f48068510 2023-12-24T20:02:18.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f4db49700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f480b11e0 con 0x7f2f48068140 2023-12-24T20:02:18.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f4db49700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480cf630 con 0x7f2f48159a60 2023-12-24T20:02:18.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f46ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2f48068510 0x7f2f480b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f46ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2f48068510 0x7f2f480b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41578/0 (socket says 172.21.15.61:41578) 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f46ffd700 1 -- 172.21.15.61:0/1011067942 learned_addr learned my addr 172.21.15.61:0/1011067942 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f46ffd700 1 -- 172.21.15.61:0/1011067942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48159a60 msgr2=0x7f2f48159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f47fff700 1 --2- 172.21.15.61:0/1011067942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48159a60 0x7f2f48159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f477fe700 1 --2- 172.21.15.61:0/1011067942 >> v2:172.21.15.133:3300/0 conn(0x7f2f48068140 0x7f2f480cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f46ffd700 1 --2- 172.21.15.61:0/1011067942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48159a60 0x7f2f48159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f46ffd700 1 -- 172.21.15.61:0/1011067942 >> v2:172.21.15.133:3300/0 conn(0x7f2f48068140 msgr2=0x7f2f480cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f46ffd700 1 --2- 172.21.15.61:0/1011067942 >> v2:172.21.15.133:3300/0 conn(0x7f2f48068140 0x7f2f480cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f46ffd700 1 -- 172.21.15.61:0/1011067942 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480b2240 con 0x7f2f48068510 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f46ffd700 1 --2- 172.21.15.61:0/1011067942 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48068510 0x7f2f480b0ca0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f2f4806e290 tx=0x7f2f3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d43c43cc3402e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.562+0000 7f2f467fc700 1 -- 172.21.15.61:0/1011067942 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00b860 con 0x7f2f48068510 2023-12-24T20:02:18.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f467fc700 1 -- 172.21.15.61:0/1011067942 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c00b9c0 con 0x7f2f48068510 2023-12-24T20:02:18.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f467fc700 1 -- 172.21.15.61:0/1011067942 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00bd60 con 0x7f2f48068510 2023-12-24T20:02:18.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f4db49700 1 -- 172.21.15.61:0/1011067942 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48068510 msgr2=0x7f2f480b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f4db49700 1 --2- 172.21.15.61:0/1011067942 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48068510 0x7f2f480b0ca0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f2f4806e290 tx=0x7f2f3c009250 comp rx=0 tx=0).stop 2023-12-24T20:02:18.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f4db49700 1 -- 172.21.15.61:0/1011067942 shutdown_connections 2023-12-24T20:02:18.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f4db49700 1 --2- 172.21.15.61:0/1011067942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48159a60 0x7f2f48159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f4db49700 1 --2- 172.21.15.61:0/1011067942 >> v2:172.21.15.133:3300/0 conn(0x7f2f48068140 0x7f2f480cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f4db49700 1 --2- 172.21.15.61:0/1011067942 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48068510 0x7f2f480b0ca0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f4db49700 1 -- 172.21.15.61:0/1011067942 >> 172.21.15.61:0/1011067942 conn(0x7f2f48097a10 msgr2=0x7f2f480ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:18.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f4db49700 1 -- 172.21.15.61:0/1011067942 shutdown_connections 2023-12-24T20:02:18.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.563+0000 7f2f4db49700 1 -- 172.21.15.61:0/1011067942 wait complete. 2023-12-24T20:02:18.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.564+0000 7f2f4db49700 1 Processor -- start 2023-12-24T20:02:18.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.564+0000 7f2f4db49700 1 -- start start 2023-12-24T20:02:18.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f4db49700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f48068140 0x7f2f4815c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f4db49700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48068510 0x7f2f48155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f4db49700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48159a60 0x7f2f480af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f4db49700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4815be00 con 0x7f2f48159a60 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f4db49700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4815c7d0 con 0x7f2f48068140 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f4db49700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4815b1f0 con 0x7f2f48068510 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f47fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48159a60 0x7f2f480af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f47fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48159a60 0x7f2f480af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41580/0 (socket says 172.21.15.61:41580) 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f47fff700 1 -- 172.21.15.61:0/1212831183 learned_addr learned my addr 172.21.15.61:0/1212831183 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f46ffd700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48068510 0x7f2f48155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.565+0000 7f2f477fe700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f48068140 0x7f2f4815c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f47fff700 1 -- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48068510 msgr2=0x7f2f48155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f47fff700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48068510 0x7f2f48155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f47fff700 1 -- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f48068140 msgr2=0x7f2f4815c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f47fff700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f48068140 0x7f2f4815c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f47fff700 1 -- 172.21.15.61:0/1212831183 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c0094f0 con 0x7f2f48159a60 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f46ffd700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48068510 0x7f2f48155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f477fe700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f48068140 0x7f2f4815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f47fff700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48159a60 0x7f2f480af3c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000cdb0 tx=0x7f2f400077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f2f7fe700 1 -- 172.21.15.61:0/1212831183 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4000aa80 con 0x7f2f48159a60 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f2f7fe700 1 -- 172.21.15.61:0/1212831183 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4000abe0 con 0x7f2f48159a60 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f2f7fe700 1 -- 172.21.15.61:0/1212831183 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40017430 con 0x7f2f48159a60 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f4db49700 1 -- 172.21.15.61:0/1212831183 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4815b4d0 con 0x7f2f48159a60 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.566+0000 7f2f4db49700 1 -- 172.21.15.61:0/1212831183 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4815ba90 con 0x7f2f48159a60 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.567+0000 7f2f4db49700 1 -- 172.21.15.61:0/1212831183 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4806d440 con 0x7f2f48159a60 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.567+0000 7f2f2f7fe700 1 -- 172.21.15.61:0/1212831183 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2f40003020 con 0x7f2f48159a60 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.568+0000 7f2f2f7fe700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f34066f30 0x7f2f340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.568+0000 7f2f2f7fe700 1 -- 172.21.15.61:0/1212831183 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2f40013070 con 0x7f2f48159a60 2023-12-24T20:02:18.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.568+0000 7f2f477fe700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f34066f30 0x7f2f340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:18.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.569+0000 7f2f477fe700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f34066f30 0x7f2f340693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2f38006fd0 tx=0x7f2f38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:18.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.572+0000 7f2f2f7fe700 1 -- 172.21.15.61:0/1212831183 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f40051c50 con 0x7f2f48159a60 2023-12-24T20:02:18.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.810+0000 7f2f4db49700 1 -- 172.21.15.61:0/1212831183 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f4804c3c0 con 0x7f2f48159a60 2023-12-24T20:02:18.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.810+0000 7f2f2f7fe700 1 -- 172.21.15.61:0/1212831183 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f2f40055270 con 0x7f2f48159a60 2023-12-24T20:02:18.811 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:18.811 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2634636374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2634636374},{"type":"v1","addr":"172.21.15.61:6835","nonce":2634636374}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/856986572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":856986572},{"type":"v1","addr":"172.21.15.133:6836","nonce":856986572}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":5866,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1475170652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1475170652},{"type":"v1","addr":"172.21.15.133:6837","nonce":1475170652}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6672,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1888972194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1888972194},{"type":"v1","addr":"172.21.15.61:6834","nonce":1888972194}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[]} 2023-12-24T20:02:18.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 -- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f34066f30 msgr2=0x7f2f340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f34066f30 0x7f2f340693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2f38006fd0 tx=0x7f2f38008040 comp rx=0 tx=0).stop 2023-12-24T20:02:18.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 -- 172.21.15.61:0/1212831183 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48159a60 msgr2=0x7f2f480af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:18.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48159a60 0x7f2f480af3c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000cdb0 tx=0x7f2f400077d0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 -- 172.21.15.61:0/1212831183 shutdown_connections 2023-12-24T20:02:18.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2f34066f30 0x7f2f340693e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2f48159a60 0x7f2f480af3c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f48068140 0x7f2f4815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 --2- 172.21.15.61:0/1212831183 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2f48068510 0x7f2f48155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:18.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 -- 172.21.15.61:0/1212831183 >> 172.21.15.61:0/1212831183 conn(0x7f2f48097a10 msgr2=0x7f2f480ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:18.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 -- 172.21.15.61:0/1212831183 shutdown_connections 2023-12-24T20:02:18.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:18.813+0000 7f2f4db49700 1 -- 172.21.15.61:0/1212831183 wait complete. 2023-12-24T20:02:18.814 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 54 2023-12-24T20:02:18.826 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T20:02:18.826 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T20:02:18.826 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:02:18.826 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:02:18.826 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T20:02:18.826 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T20:02:18.827 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:02:18.827 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:02:18.827 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T20:02:18.827 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T20:02:18.827 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:02:18.827 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:02:18.827 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T20:02:18.827 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T20:02:18.828 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:02:18.828 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:02:18.834 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:02:18.835 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T20:02:18.835 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:02:18.835 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T20:02:18.838 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:02:18.838 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T20:02:18.839 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:02:18.839 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T20:02:18.877 INFO:tasks.ceph.mds.a:Started 2023-12-24T20:02:18.878 DEBUG:teuthology.parallel:result is None 2023-12-24T20:02:18.878 INFO:tasks.ceph.mds.c:Started 2023-12-24T20:02:18.878 DEBUG:teuthology.parallel:result is None 2023-12-24T20:02:18.880 INFO:tasks.ceph.mds.d:Started 2023-12-24T20:02:18.881 DEBUG:teuthology.parallel:result is None 2023-12-24T20:02:18.881 INFO:tasks.ceph.mds.b:Started 2023-12-24T20:02:18.881 DEBUG:teuthology.parallel:result is None 2023-12-24T20:02:18.882 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T20:02:18.957 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T20:02:18.957 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T20:02:18.958 INFO:tasks.ceph.mds.c.smithi061.stderr:2023-12-24T20:02:18.958+0000 7f992016e700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-12-24T20:02:18.966 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T20:02:18.966 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T20:02:19.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.011+0000 7fba22610700 1 Processor -- start 2023-12-24T20:02:19.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.011+0000 7fba22610700 1 -- start start 2023-12-24T20:02:19.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.012+0000 7fba22610700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba1c159920 0x7fba1c06f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:19.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.012+0000 7fba22610700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1c0cd920 0x7fba1c0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:19.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.012+0000 7fba22610700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c15aba0 con 0x7fba1c159cf0 2023-12-24T20:02:19.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.012+0000 7fba22610700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c06fbe0 con 0x7fba1c159920 2023-12-24T20:02:19.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.012+0000 7fba22610700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c15ae80 con 0x7fba1c0cd920 2023-12-24T20:02:19.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.013+0000 7fba1bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba1c159920 0x7fba1c06f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:19.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.013+0000 7fba1bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba1c159920 0x7fba1c06f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:54266/0 (socket says 172.21.15.61:54266) 2023-12-24T20:02:19.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.013+0000 7fba20bad700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fba1c159cf0 0x7fba1c15a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:37636/0 (socket says 172.21.15.61:37636) 2023-12-24T20:02:19.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.013+0000 7fba1bfff700 1 -- 172.21.15.61:0/1049917834 learned_addr learned my addr 172.21.15.61:0/1049917834 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:19.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.013+0000 7fba1b7fe700 1 --2- 172.21.15.61:0/1049917834 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1c0cd920 0x7fba1c0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:19.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.013+0000 7fba1bfff700 1 -- 172.21.15.61:0/1049917834 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1c0cd920 msgr2=0x7fba1c0cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:19.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.013+0000 7fba1bfff700 1 --2- 172.21.15.61:0/1049917834 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1c0cd920 0x7fba1c0cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:19.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.013+0000 7fba1bfff700 1 -- 172.21.15.61:0/1049917834 >> v1:172.21.15.133:6789/0 conn(0x7fba1c159cf0 legacy=0x7fba1c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:19.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.013+0000 7fba1bfff700 1 -- 172.21.15.61:0/1049917834 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c06ebc0 con 0x7fba1c159920 2023-12-24T20:02:19.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.013+0000 7fba1bfff700 1 --2- 172.21.15.61:0/1049917834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba1c159920 0x7fba1c06f6a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0099b0 tx=0x7fba0c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c099fcb4f8d6bfb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:19.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba1affd700 1 -- 172.21.15.61:0/1049917834 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c009ea0 con 0x7fba1c159920 2023-12-24T20:02:19.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba1affd700 1 -- 172.21.15.61:0/1049917834 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c00b860 con 0x7fba1c159920 2023-12-24T20:02:19.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba1affd700 1 -- 172.21.15.61:0/1049917834 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00bc00 con 0x7fba1c159920 2023-12-24T20:02:19.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba22610700 1 -- 172.21.15.61:0/1049917834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba1c159920 msgr2=0x7fba1c06f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:19.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba22610700 1 --2- 172.21.15.61:0/1049917834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba1c159920 0x7fba1c06f6a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0099b0 tx=0x7fba0c009250 comp rx=0 tx=0).stop 2023-12-24T20:02:19.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba22610700 1 -- 172.21.15.61:0/1049917834 shutdown_connections 2023-12-24T20:02:19.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba22610700 1 --2- 172.21.15.61:0/1049917834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba1c159920 0x7fba1c06f6a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:19.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba22610700 1 --2- 172.21.15.61:0/1049917834 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1c0cd920 0x7fba1c0cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:19.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba22610700 1 -- 172.21.15.61:0/1049917834 >> 172.21.15.61:0/1049917834 conn(0x7fba1c06b790 msgr2=0x7fba1c069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:19.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba22610700 1 -- 172.21.15.61:0/1049917834 shutdown_connections 2023-12-24T20:02:19.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.014+0000 7fba22610700 1 -- 172.21.15.61:0/1049917834 wait complete. 2023-12-24T20:02:19.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.015+0000 7fba22610700 1 Processor -- start 2023-12-24T20:02:19.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.016+0000 7fba22610700 1 -- start start 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.016+0000 7fba22610700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba1c0cd920 0x7fba1c0abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.016+0000 7fba22610700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fba1c159920 0x7fba1c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.016+0000 7fba22610700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1c159cf0 0x7fba1c0b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.016+0000 7fba22610700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0ae360 con 0x7fba1c159920 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.016+0000 7fba22610700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0acf40 con 0x7fba1c0cd920 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.016+0000 7fba22610700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0ac070 con 0x7fba1c159cf0 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fba1c159920 0x7fba1c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fba1c159920 0x7fba1c156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41620/0 (socket says 172.21.15.61:41620) 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1b7fe700 1 -- 172.21.15.61:0/4077319683 learned_addr learned my addr 172.21.15.61:0/4077319683 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1bfff700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba1c0cd920 0x7fba1c0abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba20bad700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1c159cf0 0x7fba1c0b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:19.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1b7fe700 1 -- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1c159cf0 msgr2=0x7fba1c0b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1b7fe700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1c159cf0 0x7fba1c0b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1b7fe700 1 -- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba1c0cd920 msgr2=0x7fba1c0abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1b7fe700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba1c0cd920 0x7fba1c0abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1b7fe700 1 -- 172.21.15.61:0/4077319683 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c0094f0 con 0x7fba1c159920 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1bfff700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba1c0cd920 0x7fba1c0abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba1b7fe700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fba1c159920 0x7fba1c156880 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fba1000ec80 tx=0x7fba100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba03fff700 1 -- 172.21.15.61:0/4077319683 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000c9d0 con 0x7fba1c159920 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba03fff700 1 -- 172.21.15.61:0/4077319683 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1000cb30 con 0x7fba1c159920 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba03fff700 1 -- 172.21.15.61:0/4077319683 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10013470 con 0x7fba1c159920 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba22610700 1 -- 172.21.15.61:0/4077319683 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c0ac330 con 0x7fba1c159920 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.017+0000 7fba22610700 1 -- 172.21.15.61:0/4077319683 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c0ac8f0 con 0x7fba1c159920 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.018+0000 7fba22610700 1 -- 172.21.15.61:0/4077319683 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c06e0e0 con 0x7fba1c159920 2023-12-24T20:02:19.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.019+0000 7fba03fff700 1 -- 172.21.15.61:0/4077319683 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fba10013820 con 0x7fba1c159920 2023-12-24T20:02:19.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.019+0000 7fba03fff700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fba08066f30 0x7fba080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:19.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.019+0000 7fba03fff700 1 -- 172.21.15.61:0/4077319683 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fba100845a0 con 0x7fba1c159920 2023-12-24T20:02:19.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.019+0000 7fba1bfff700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fba08066f30 0x7fba080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:19.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.020+0000 7fba1bfff700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fba08066f30 0x7fba080693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0099b0 tx=0x7fba0c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:19.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.023+0000 7fba03fff700 1 -- 172.21.15.61:0/4077319683 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba10051b10 con 0x7fba1c159920 2023-12-24T20:02:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:19.234+0000 7fba22610700 1 -- 172.21.15.61:0/4077319683 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fba1c0ad0b0 con 0x7fba1c159920 2023-12-24T20:02:20.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.010+0000 7fba03fff700 1 -- 172.21.15.61:0/4077319683 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v118) v1 ==== 97+0+0 (secure 0 0 0) 0x7fba10055130 con 0x7fba1c159920 2023-12-24T20:02:20.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 -- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fba08066f30 msgr2=0x7fba080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fba08066f30 0x7fba080693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0099b0 tx=0x7fba0c017000 comp rx=0 tx=0).stop 2023-12-24T20:02:20.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 -- 172.21.15.61:0/4077319683 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fba1c159920 msgr2=0x7fba1c156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fba1c159920 0x7fba1c156880 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fba1000ec80 tx=0x7fba100091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 -- 172.21.15.61:0/4077319683 shutdown_connections 2023-12-24T20:02:20.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fba1c159cf0 0x7fba1c0b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fba08066f30 0x7fba080693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba1c0cd920 0x7fba1c0abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 --2- 172.21.15.61:0/4077319683 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fba1c159920 0x7fba1c156880 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 -- 172.21.15.61:0/4077319683 >> 172.21.15.61:0/4077319683 conn(0x7fba1c06b790 msgr2=0x7fba1c1587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:20.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 -- 172.21.15.61:0/4077319683 shutdown_connections 2023-12-24T20:02:20.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.013+0000 7fba22610700 1 -- 172.21.15.61:0/4077319683 wait complete. 2023-12-24T20:02:20.015 INFO:teuthology.orchestra.run.smithi061.stderr: removed all blocklist entries 2023-12-24T20:02:20.029 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T20:02:20.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.156+0000 7f753c9c6700 1 Processor -- start 2023-12-24T20:02:20.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.156+0000 7f753c9c6700 1 -- start start 2023-12-24T20:02:20.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f753c9c6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7538068510 0x7f75380cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f753c9c6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7538159a60 0x7f7538159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f753c9c6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75380b2890 con 0x7f7538068140 2023-12-24T20:02:20.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f753c9c6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75380cf630 con 0x7f7538159a60 2023-12-24T20:02:20.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f753c9c6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75380b2240 con 0x7f7538068510 2023-12-24T20:02:20.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f7536d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7538159a60 0x7f7538159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f7536d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7538159a60 0x7f7538159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41628/0 (socket says 172.21.15.61:41628) 2023-12-24T20:02:20.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f7536d9d700 1 -- 172.21.15.61:0/2486886685 learned_addr learned my addr 172.21.15.61:0/2486886685 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:20.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f7535d9b700 1 --2- 172.21.15.61:0/2486886685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7538068510 0x7f75380cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f7536d9d700 1 -- 172.21.15.61:0/2486886685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7538068510 msgr2=0x7f75380cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f7536d9d700 1 --2- 172.21.15.61:0/2486886685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7538068510 0x7f75380cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f7536d9d700 1 -- 172.21.15.61:0/2486886685 >> v1:172.21.15.133:6789/0 conn(0x7f7538068140 legacy=0x7f75380b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.157+0000 7f7536d9d700 1 -- 172.21.15.61:0/2486886685 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380b2520 con 0x7f7538159a60 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f7536d9d700 1 --2- 172.21.15.61:0/2486886685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 0x7f7538159ee0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7530009f20 tx=0x7f7530009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5c1c65412b9650 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753559a700 1 -- 172.21.15.61:0/2486886685 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000e070 con 0x7f7538159a60 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753559a700 1 -- 172.21.15.61:0/2486886685 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000ba80 con 0x7f7538159a60 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753559a700 1 -- 172.21.15.61:0/2486886685 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75300092e0 con 0x7f7538159a60 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753c9c6700 1 -- 172.21.15.61:0/2486886685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 msgr2=0x7f7538159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753c9c6700 1 --2- 172.21.15.61:0/2486886685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 0x7f7538159ee0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f7530009f20 tx=0x7f7530009840 comp rx=0 tx=0).stop 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753c9c6700 1 -- 172.21.15.61:0/2486886685 shutdown_connections 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753c9c6700 1 --2- 172.21.15.61:0/2486886685 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 0x7f7538159ee0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753c9c6700 1 --2- 172.21.15.61:0/2486886685 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7538068510 0x7f75380cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753c9c6700 1 -- 172.21.15.61:0/2486886685 >> 172.21.15.61:0/2486886685 conn(0x7f7538097a10 msgr2=0x7f75380ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:20.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753c9c6700 1 -- 172.21.15.61:0/2486886685 shutdown_connections 2023-12-24T20:02:20.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.158+0000 7f753c9c6700 1 -- 172.21.15.61:0/2486886685 wait complete. 2023-12-24T20:02:20.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.159+0000 7f753c9c6700 1 Processor -- start 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.160+0000 7f753c9c6700 1 -- start start 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.160+0000 7f753c9c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7538068140 0x7f75381558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.160+0000 7f753c9c6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7538068510 0x7f753815bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.160+0000 7f753c9c6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 0x7f753809b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.160+0000 7f753c9c6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753809a470 con 0x7f7538159a60 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.160+0000 7f753c9c6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7538155df0 con 0x7f7538068140 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.160+0000 7f753c9c6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753815c510 con 0x7f7538068510 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.160+0000 7f7536d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 0x7f753809b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.160+0000 7f7536d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 0x7f753809b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41632/0 (socket says 172.21.15.61:41632) 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.160+0000 7f7536d9d700 1 -- 172.21.15.61:0/1321018432 learned_addr learned my addr 172.21.15.61:0/1321018432 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:20.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f753659c700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7538068140 0x7f75381558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f7535d9b700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7538068510 0x7f753815bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f7536d9d700 1 -- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7538068510 msgr2=0x7f753815bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f7536d9d700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7538068510 0x7f753815bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f7536d9d700 1 -- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7538068140 msgr2=0x7f75381558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f7536d9d700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7538068140 0x7f75381558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f7536d9d700 1 -- 172.21.15.61:0/1321018432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530009ae0 con 0x7f7538159a60 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f7536d9d700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 0x7f753809b760 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f753806d8b0 tx=0x7f7530018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f75267fc700 1 -- 172.21.15.61:0/1321018432 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75300094e0 con 0x7f7538159a60 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f75267fc700 1 -- 172.21.15.61:0/1321018432 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530008e80 con 0x7f7538159a60 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f75267fc700 1 -- 172.21.15.61:0/1321018432 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75300266b0 con 0x7f7538159a60 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f753c9c6700 1 -- 172.21.15.61:0/1321018432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753809a6c0 con 0x7f7538159a60 2023-12-24T20:02:20.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.161+0000 7f753c9c6700 1 -- 172.21.15.61:0/1321018432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753809ac80 con 0x7f7538159a60 2023-12-24T20:02:20.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.162+0000 7f753c9c6700 1 -- 172.21.15.61:0/1321018432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753809b5b0 con 0x7f7538159a60 2023-12-24T20:02:20.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.162+0000 7f75267fc700 1 -- 172.21.15.61:0/1321018432 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7530003040 con 0x7f7538159a60 2023-12-24T20:02:20.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.163+0000 7f75267fc700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7518066f30 0x7f75180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.163+0000 7f75267fc700 1 -- 172.21.15.61:0/1321018432 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7530086220 con 0x7f7538159a60 2023-12-24T20:02:20.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.163+0000 7f753659c700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7518066f30 0x7f75180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.163+0000 7f753659c700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7518066f30 0x7f75180693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7528003890 tx=0x7f7528009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:20.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.167+0000 7f75267fc700 1 -- 172.21.15.61:0/1321018432 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7530053890 con 0x7f7538159a60 2023-12-24T20:02:20.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.449+0000 7f753c9c6700 1 -- 172.21.15.61:0/1321018432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f753806d440 con 0x7f7538159a60 2023-12-24T20:02:20.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.449+0000 7f75267fc700 1 -- 172.21.15.61:0/1321018432 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7530056eb0 con 0x7f7538159a60 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout: "auth_dump": [ 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.a", 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew==", 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:02:20.450 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.b", 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw==", 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.451 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.c", 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g==", 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.d", 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg==", 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:20.452 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.0", 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag==", 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.453 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.1", 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw==", 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.2", 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ==", 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:20.454 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.3", 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA==", 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.455 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.4", 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ==", 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.5", 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w==", 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:20.456 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.6", 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw==", 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.457 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.7", 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw==", 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.0", 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA==", 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow r", 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.458 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.1", 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w==", 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.2", 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg==", 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:20.459 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.3", 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g==", 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.460 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.admin", 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlwF3pGRAA8h0Cld7lwZprlrgMAN7tSg==", 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.x", 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg==", 2023-12-24T20:02:20.461 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.y", 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A==", 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:20.462 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:20.463 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:20.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 -- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7518066f30 msgr2=0x7f75180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7518066f30 0x7f75180693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7528003890 tx=0x7f7528009040 comp rx=0 tx=0).stop 2023-12-24T20:02:20.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 -- 172.21.15.61:0/1321018432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 msgr2=0x7f753809b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 0x7f753809b760 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f753806d8b0 tx=0x7f7530018000 comp rx=0 tx=0).stop 2023-12-24T20:02:20.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 -- 172.21.15.61:0/1321018432 shutdown_connections 2023-12-24T20:02:20.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7518066f30 0x7f75180693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7538159a60 0x7f753809b760 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7538068140 0x7f75381558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 --2- 172.21.15.61:0/1321018432 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7538068510 0x7f753815bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 -- 172.21.15.61:0/1321018432 >> 172.21.15.61:0/1321018432 conn(0x7f7538097a10 msgr2=0x7f753806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:20.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 -- 172.21.15.61:0/1321018432 shutdown_connections 2023-12-24T20:02:20.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.451+0000 7f753c9c6700 1 -- 172.21.15.61:0/1321018432 wait complete. 2023-12-24T20:02:20.465 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:20.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.587+0000 7f19f9e77700 1 Processor -- start 2023-12-24T20:02:20.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.587+0000 7f19f9e77700 1 -- start start 2023-12-24T20:02:20.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.587+0000 7f19f9e77700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19f413faa0 0x7f19f40c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.587+0000 7f19f9e77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f40c7a30 0x7f19f4069c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.587+0000 7f19f9e77700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f413fe70 con 0x7f19f406a140 2023-12-24T20:02:20.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.587+0000 7f19f9e77700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f40cbdc0 con 0x7f19f413faa0 2023-12-24T20:02:20.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f9e77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f406d640 con 0x7f19f40c7a30 2023-12-24T20:02:20.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19f413faa0 0x7f19f40c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f2ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f40c7a30 0x7f19f4069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f2ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f40c7a30 0x7f19f4069c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:36246/0 (socket says 172.21.15.61:36246) 2023-12-24T20:02:20.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f19f406a140 0x7f19f40caa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:37648/0 (socket says 172.21.15.61:37648) 2023-12-24T20:02:20.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19f413faa0 0x7f19f40c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:54304/0 (socket says 172.21.15.61:54304) 2023-12-24T20:02:20.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f2ffd700 1 -- 172.21.15.61:0/2067700566 learned_addr learned my addr 172.21.15.61:0/2067700566 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:20.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f2ffd700 1 -- 172.21.15.61:0/2067700566 >> v2:172.21.15.133:3300/0 conn(0x7f19f413faa0 msgr2=0x7f19f40c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:20.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f2ffd700 1 --2- 172.21.15.61:0/2067700566 >> v2:172.21.15.133:3300/0 conn(0x7f19f413faa0 0x7f19f40c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f2ffd700 1 -- 172.21.15.61:0/2067700566 >> v1:172.21.15.133:6789/0 conn(0x7f19f406a140 legacy=0x7f19f40caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f2ffd700 1 -- 172.21.15.61:0/2067700566 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f40c7e80 con 0x7f19f40c7a30 2023-12-24T20:02:20.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.588+0000 7f19f37fe700 1 --2- 172.21.15.61:0/2067700566 >> v2:172.21.15.133:3300/0 conn(0x7f19f413faa0 0x7f19f40c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:20.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f2ffd700 1 --2- 172.21.15.61:0/2067700566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f40c7a30 0x7f19f4069c00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f19e80099b0 tx=0x7f19e8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2673eafaeec1084c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:20.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f27fc700 1 -- 172.21.15.61:0/2067700566 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8009ea0 con 0x7f19f40c7a30 2023-12-24T20:02:20.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f27fc700 1 -- 172.21.15.61:0/2067700566 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e800b860 con 0x7f19f40c7a30 2023-12-24T20:02:20.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f27fc700 1 -- 172.21.15.61:0/2067700566 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e800bc00 con 0x7f19f40c7a30 2023-12-24T20:02:20.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f9e77700 1 -- 172.21.15.61:0/2067700566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f40c7a30 msgr2=0x7f19f4069c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f9e77700 1 --2- 172.21.15.61:0/2067700566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f40c7a30 0x7f19f4069c00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f19e80099b0 tx=0x7f19e8009250 comp rx=0 tx=0).stop 2023-12-24T20:02:20.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f9e77700 1 -- 172.21.15.61:0/2067700566 shutdown_connections 2023-12-24T20:02:20.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f9e77700 1 --2- 172.21.15.61:0/2067700566 >> v2:172.21.15.133:3300/0 conn(0x7f19f413faa0 0x7f19f40c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f9e77700 1 --2- 172.21.15.61:0/2067700566 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f40c7a30 0x7f19f4069c00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f9e77700 1 -- 172.21.15.61:0/2067700566 >> 172.21.15.61:0/2067700566 conn(0x7f19f40cceb0 msgr2=0x7f19f40cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:20.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f9e77700 1 -- 172.21.15.61:0/2067700566 shutdown_connections 2023-12-24T20:02:20.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.589+0000 7f19f9e77700 1 -- 172.21.15.61:0/2067700566 wait complete. 2023-12-24T20:02:20.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f9e77700 1 Processor -- start 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f9e77700 1 -- start start 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f9e77700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19f406a140 0x7f19f416ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f9e77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f40c7a30 0x7f19f4158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f9e77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f413faa0 0x7f19f4158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f9e77700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f41696c0 con 0x7f19f406a140 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f9e77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f416bfb0 con 0x7f19f40c7a30 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f9e77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40cd520 con 0x7f19f413faa0 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19f406a140 0x7f19f416ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19f406a140 0x7f19f416ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41646/0 (socket says 172.21.15.61:41646) 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.591+0000 7f19f37fe700 1 -- 172.21.15.61:0/1759281630 learned_addr learned my addr 172.21.15.61:0/1759281630 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f3fff700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f413faa0 0x7f19f4158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f2ffd700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f40c7a30 0x7f19f4158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f37fe700 1 -- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f413faa0 msgr2=0x7f19f4158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f37fe700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f413faa0 0x7f19f4158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f37fe700 1 -- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f40c7a30 msgr2=0x7f19f4158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f37fe700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f40c7a30 0x7f19f4158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f37fe700 1 -- 172.21.15.61:0/1759281630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e4009420 con 0x7f19f406a140 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f2ffd700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f40c7a30 0x7f19f4158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f37fe700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19f406a140 0x7f19f416ba70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f19e400ec80 tx=0x7f19e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19db7fe700 1 -- 172.21.15.61:0/1759281630 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e400c9d0 con 0x7f19f406a140 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19db7fe700 1 -- 172.21.15.61:0/1759281630 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e400cb30 con 0x7f19f406a140 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f9e77700 1 -- 172.21.15.61:0/1759281630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e80094f0 con 0x7f19f406a140 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19db7fe700 1 -- 172.21.15.61:0/1759281630 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e400ceb0 con 0x7f19f406a140 2023-12-24T20:02:20.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.592+0000 7f19f9e77700 1 -- 172.21.15.61:0/1759281630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f4168d20 con 0x7f19f406a140 2023-12-24T20:02:20.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.593+0000 7f19f9e77700 1 -- 172.21.15.61:0/1759281630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f404c3c0 con 0x7f19f406a140 2023-12-24T20:02:20.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.594+0000 7f19db7fe700 1 -- 172.21.15.61:0/1759281630 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f19e4013680 con 0x7f19f406a140 2023-12-24T20:02:20.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.594+0000 7f19db7fe700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19e0066f30 0x7f19e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.594+0000 7f19db7fe700 1 -- 172.21.15.61:0/1759281630 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f19e4084540 con 0x7f19f406a140 2023-12-24T20:02:20.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.594+0000 7f19f2ffd700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19e0066f30 0x7f19e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.595+0000 7f19f2ffd700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19e0066f30 0x7f19e00693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f19e80099b0 tx=0x7f19e8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:20.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.598+0000 7f19db7fe700 1 -- 172.21.15.61:0/1759281630 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19e4051b00 con 0x7f19f406a140 2023-12-24T20:02:20.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.795+0000 7f19f9e77700 1 -- 172.21.15.61:0/1759281630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19f406a8b0 con 0x7f19f406a140 2023-12-24T20:02:20.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.796+0000 7f19db7fe700 1 -- 172.21.15.61:0/1759281630 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+12138 (secure 0 0 0) 0x7f19e4055120 con 0x7f19f406a140 2023-12-24T20:02:20.796 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:20.796 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":118,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:20.006988+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:20.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 -- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19e0066f30 msgr2=0x7f19e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19e0066f30 0x7f19e00693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f19e80099b0 tx=0x7f19e8017000 comp rx=0 tx=0).stop 2023-12-24T20:02:20.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 -- 172.21.15.61:0/1759281630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19f406a140 msgr2=0x7f19f416ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19f406a140 0x7f19f416ba70 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f19e400ec80 tx=0x7f19e40091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 -- 172.21.15.61:0/1759281630 shutdown_connections 2023-12-24T20:02:20.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19f413faa0 0x7f19f4158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19e0066f30 0x7f19e00693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19f406a140 0x7f19f416ba70 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 --2- 172.21.15.61:0/1759281630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f40c7a30 0x7f19f4158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 -- 172.21.15.61:0/1759281630 >> 172.21.15.61:0/1759281630 conn(0x7f19f40cceb0 msgr2=0x7f19f4063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:20.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 -- 172.21.15.61:0/1759281630 shutdown_connections 2023-12-24T20:02:20.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.798+0000 7f19f9e77700 1 -- 172.21.15.61:0/1759281630 wait complete. 2023-12-24T20:02:20.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T20:02:20.811 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:02:20.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.935+0000 7fad7eadc700 1 Processor -- start 2023-12-24T20:02:20.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.935+0000 7fad7eadc700 1 -- start start 2023-12-24T20:02:20.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad7eadc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780cdb80 0x7fad78164c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad7eadc700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad780cf150 con 0x7fad7815a1c0 2023-12-24T20:02:20.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad7eadc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad780d05f0 con 0x7fad78159df0 2023-12-24T20:02:20.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad7eadc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad780cc5f0 con 0x7fad780cdb80 2023-12-24T20:02:20.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad77fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fad7815a1c0 0x7fad780cd470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:43652/0 (socket says 172.21.15.61:43652) 2023-12-24T20:02:20.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad77fff700 1 -- 172.21.15.61:0/554927326 learned_addr learned my addr 172.21.15.61:0/554927326 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:20.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad7d079700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780cdb80 0x7fad78164c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509497488 0 0) 0x7fad780cf150 con 0x7fad7815a1c0 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad68003570 con 0x7fad7815a1c0 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1359166376 0 0) 0x7fad68003570 con 0x7fad7815a1c0 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780cdb80 msgr2=0x7fad78164c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad777fe700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780cdb80 0x7fad78164c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 >> v1:172.21.15.133:6789/0 conn(0x7fad78159df0 legacy=0x7fad780cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780ce820 con 0x7fad7815a1c0 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fad64001470 con 0x7fad7815a1c0 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.936+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 >> v1:172.21.15.61:6789/0 conn(0x7fad7815a1c0 legacy=0x7fad780cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad777fe700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 0x7fad68003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad777fe700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad68004810 0x7fad68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad777fe700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780cdb80 0x7fad680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780cc5f0 con 0x7fad68003a90 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6800bb10 con 0x7fad68004810 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6800bcd0 con 0x7fad780cdb80 2023-12-24T20:02:20.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad7c878700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 0x7fad68003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad77fff700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad68004810 0x7fad68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad7d079700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780cdb80 0x7fad680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad7c878700 1 -- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780cdb80 msgr2=0x7fad680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad7c878700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780cdb80 0x7fad680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad7c878700 1 -- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad68004810 msgr2=0x7fad68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad7c878700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad68004810 0x7fad68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad7c878700 1 -- 172.21.15.61:0/554927326 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68003570 con 0x7fad68003a90 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad7d079700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780cdb80 0x7fad680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad77fff700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad68004810 0x7fad68004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad7c878700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 0x7fad68003e60 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0019a0 tx=0x7fad6c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31328b4e15e5e44f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00c5d0 con 0x7fad68003a90 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c00c730 con 0x7fad68003a90 2023-12-24T20:02:20.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.937+0000 7fad777fe700 1 -- 172.21.15.61:0/554927326 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00cad0 con 0x7fad68003a90 2023-12-24T20:02:20.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.938+0000 7fad7eadc700 1 -- 172.21.15.61:0/554927326 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 msgr2=0x7fad68003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.938+0000 7fad7eadc700 1 --2- 172.21.15.61:0/554927326 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 0x7fad68003e60 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0019a0 tx=0x7fad6c007d10 comp rx=0 tx=0).stop 2023-12-24T20:02:20.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.938+0000 7fad7d079700 1 -- 172.21.15.61:0/554927326 reap_dead start 2023-12-24T20:02:20.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.938+0000 7fad7eadc700 1 -- 172.21.15.61:0/554927326 shutdown_connections 2023-12-24T20:02:20.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.938+0000 7fad7eadc700 1 -- 172.21.15.61:0/554927326 >> 172.21.15.61:0/554927326 conn(0x7fad7806e600 msgr2=0x7fad78067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:20.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.938+0000 7fad7eadc700 1 -- 172.21.15.61:0/554927326 shutdown_connections 2023-12-24T20:02:20.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.938+0000 7fad7eadc700 1 -- 172.21.15.61:0/554927326 wait complete. 2023-12-24T20:02:20.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.939+0000 7fad7eadc700 1 Processor -- start 2023-12-24T20:02:20.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.939+0000 7fad7eadc700 1 -- start start 2023-12-24T20:02:20.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7eadc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 0x7fad7815d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7eadc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad78155750 0x7fad7815a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7eadc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780b1b60 0x7fad780b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7eadc700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad780b2510 con 0x7fad68003a90 2023-12-24T20:02:20.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7eadc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7815b3c0 con 0x7fad78155750 2023-12-24T20:02:20.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7eadc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7815ab60 con 0x7fad780b1b60 2023-12-24T20:02:20.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7c878700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 0x7fad7815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7c878700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 0x7fad7815d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41660/0 (socket says 172.21.15.61:41660) 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7c878700 1 -- 172.21.15.61:0/3581618296 learned_addr learned my addr 172.21.15.61:0/3581618296 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7d079700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780b1b60 0x7fad780b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad77fff700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad78155750 0x7fad7815a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7c878700 1 -- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780b1b60 msgr2=0x7fad780b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7c878700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780b1b60 0x7fad780b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7c878700 1 -- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad78155750 msgr2=0x7fad7815a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7c878700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad78155750 0x7fad7815a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7c878700 1 -- 172.21.15.61:0/3581618296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78155bc0 con 0x7fad68003a90 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad77fff700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad78155750 0x7fad7815a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7d079700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780b1b60 0x7fad780b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.940+0000 7fad7c878700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 0x7fad7815d510 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fad68004770 tx=0x7fad6c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.941+0000 7fad74ff9700 1 -- 172.21.15.61:0/3581618296 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00c5d0 con 0x7fad68003a90 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.941+0000 7fad74ff9700 1 -- 172.21.15.61:0/3581618296 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c00ce40 con 0x7fad68003a90 2023-12-24T20:02:20.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.941+0000 7fad7eadc700 1 -- 172.21.15.61:0/3581618296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7815ae00 con 0x7fad68003a90 2023-12-24T20:02:20.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.941+0000 7fad74ff9700 1 -- 172.21.15.61:0/3581618296 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00cad0 con 0x7fad68003a90 2023-12-24T20:02:20.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.941+0000 7fad7eadc700 1 -- 172.21.15.61:0/3581618296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad780b3b70 con 0x7fad68003a90 2023-12-24T20:02:20.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.942+0000 7fad7eadc700 1 -- 172.21.15.61:0/3581618296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad780b41c0 con 0x7fad68003a90 2023-12-24T20:02:20.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.942+0000 7fad74ff9700 1 -- 172.21.15.61:0/3581618296 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fad6c019030 con 0x7fad68003a90 2023-12-24T20:02:20.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.943+0000 7fad74ff9700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:20.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.943+0000 7fad74ff9700 1 -- 172.21.15.61:0/3581618296 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fad6c085690 con 0x7fad68003a90 2023-12-24T20:02:20.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.943+0000 7fad77fff700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:20.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.943+0000 7fad77fff700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad5c066f30 0x7fad5c0693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fad64000f60 tx=0x7fad64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:20.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:20.947+0000 7fad74ff9700 1 -- 172.21.15.61:0/3581618296 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad6c052d10 con 0x7fad68003a90 2023-12-24T20:02:21.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.144+0000 7fad7eadc700 1 -- 172.21.15.61:0/3581618296 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad780b2510 con 0x7fad68003a90 2023-12-24T20:02:21.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.145+0000 7fad74ff9700 1 -- 172.21.15.61:0/3581618296 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad6c0170a0 con 0x7fad68003a90 2023-12-24T20:02:21.145 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:02:21.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.146+0000 7fad7eadc700 1 -- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad5c066f30 msgr2=0x7fad5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.146+0000 7fad7eadc700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad5c066f30 0x7fad5c0693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fad64000f60 tx=0x7fad64009040 comp rx=0 tx=0).stop 2023-12-24T20:02:21.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.146+0000 7fad7eadc700 1 -- 172.21.15.61:0/3581618296 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 msgr2=0x7fad7815d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.146+0000 7fad7eadc700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 0x7fad7815d510 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fad68004770 tx=0x7fad6c015000 comp rx=0 tx=0).stop 2023-12-24T20:02:21.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.146+0000 7fad7eadc700 1 -- 172.21.15.61:0/3581618296 shutdown_connections 2023-12-24T20:02:21.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.146+0000 7fad7eadc700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad780b1b60 0x7fad780b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.146+0000 7fad7eadc700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad5c066f30 0x7fad5c0693e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.146+0000 7fad7eadc700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad68003a90 0x7fad7815d510 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.146+0000 7fad7eadc700 1 --2- 172.21.15.61:0/3581618296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad78155750 0x7fad7815a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.146+0000 7fad7eadc700 1 -- 172.21.15.61:0/3581618296 >> 172.21.15.61:0/3581618296 conn(0x7fad7806e600 msgr2=0x7fad780c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:21.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.147+0000 7fad7eadc700 1 -- 172.21.15.61:0/3581618296 shutdown_connections 2023-12-24T20:02:21.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.147+0000 7fad7eadc700 1 -- 172.21.15.61:0/3581618296 wait complete. 2023-12-24T20:02:21.159 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T20:02:21.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.280+0000 7f6f13d28700 1 Processor -- start 2023-12-24T20:02:21.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.281+0000 7f6f13d28700 1 -- start start 2023-12-24T20:02:21.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.281+0000 7f6f13d28700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c159a90 0x7f6f0c070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.281+0000 7f6f13d28700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c06a090 con 0x7f6f0c0b04c0 2023-12-24T20:02:21.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f13d28700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c06ac10 con 0x7f6f0c159e60 2023-12-24T20:02:21.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f13d28700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c06a2e0 con 0x7f6f0c159a90 2023-12-24T20:02:21.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f122c5700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f6f0c0b04c0 0x7f6f0c06d970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:43660/0 (socket says 172.21.15.61:43660) 2023-12-24T20:02:21.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f122c5700 1 -- 172.21.15.61:0/2950358759 learned_addr learned my addr 172.21.15.61:0/2950358759 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:21.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f11ac4700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c159a90 0x7f6f0c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165848755 0 0) 0x7f6f0c06a090 con 0x7f6f0c0b04c0 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef8003570 con 0x7f6f0c0b04c0 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278893307 0 0) 0x7f6f0c06ac10 con 0x7f6f0c159e60 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f0c06a090 con 0x7f6f0c159e60 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3113286507 0 0) 0x7f6ef8003570 con 0x7f6f0c0b04c0 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c159a90 msgr2=0x7f6f0c070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c159a90 0x7f6f0c070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 >> v1:172.21.15.133:6789/0 conn(0x7f6f0c159e60 legacy=0x7f6f0c0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c06a5c0 con 0x7f6f0c0b04c0 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f6f040017f0 con 0x7f6f0c0b04c0 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f11ac4700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c159a90 0x7f6f0c070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 >> v1:172.21.15.61:6789/0 conn(0x7f6f0c0b04c0 legacy=0x7f6f0c06d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6ef8003c20 0x7f6ef8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c159a90 0x7f6ef8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8004d50 0x7f6ef80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c06a2e0 con 0x7f6ef8003c20 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef800bb10 con 0x7f6ef8004d50 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef800bcd0 con 0x7f6f0c159a90 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.282+0000 7f6f11ac4700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6ef8003c20 0x7f6ef8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f122c5700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8004d50 0x7f6ef80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f112c3700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c159a90 0x7f6ef8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f11ac4700 1 -- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c159a90 msgr2=0x7f6ef8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f11ac4700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c159a90 0x7f6ef8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f11ac4700 1 -- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8004d50 msgr2=0x7f6ef80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f11ac4700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8004d50 0x7f6ef80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f11ac4700 1 -- 172.21.15.61:0/2950358759 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f08009420 con 0x7f6ef8003c20 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f122c5700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8004d50 0x7f6ef80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f11ac4700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6ef8003c20 0x7f6ef8004010 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009df0 tx=0x7f6f080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6178fbc715d148c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:21.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08009740 con 0x7f6ef8003c20 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0800e920 con 0x7f6ef8003c20 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f10ac2700 1 -- 172.21.15.61:0/2950358759 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800ece0 con 0x7f6ef8003c20 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f13d28700 1 -- 172.21.15.61:0/2950358759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6ef8003c20 msgr2=0x7f6ef8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.283+0000 7f6f13d28700 1 --2- 172.21.15.61:0/2950358759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6ef8003c20 0x7f6ef8004010 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009df0 tx=0x7f6f080091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.284+0000 7f6f122c5700 1 -- 172.21.15.61:0/2950358759 reap_dead start 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.284+0000 7f6f13d28700 1 -- 172.21.15.61:0/2950358759 shutdown_connections 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.284+0000 7f6f13d28700 1 -- 172.21.15.61:0/2950358759 >> 172.21.15.61:0/2950358759 conn(0x7f6f0c0cd6f0 msgr2=0x7f6f0c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.284+0000 7f6f13d28700 1 -- 172.21.15.61:0/2950358759 shutdown_connections 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.284+0000 7f6f13d28700 1 -- 172.21.15.61:0/2950358759 wait complete. 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.285+0000 7f6f13d28700 1 Processor -- start 2023-12-24T20:02:21.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.285+0000 7f6f13d28700 1 -- start start 2023-12-24T20:02:21.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.285+0000 7f6f13d28700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8003c20 0x7f6f0c0c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.285+0000 7f6f13d28700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f0c0c5a50 0x7f6f0c157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.285+0000 7f6f13d28700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c0c32c0 0x7f6f0c0c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.285+0000 7f6f13d28700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c0c5600 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.285+0000 7f6f13d28700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c0c3c80 con 0x7f6ef8003c20 2023-12-24T20:02:21.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.285+0000 7f6f13d28700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c0c6c20 con 0x7f6f0c0c32c0 2023-12-24T20:02:21.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f112c3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f0c0c5a50 0x7f6f0c157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f112c3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f0c0c5a50 0x7f6f0c157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41684/0 (socket says 172.21.15.61:41684) 2023-12-24T20:02:21.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f112c3700 1 -- 172.21.15.61:0/2472830550 learned_addr learned my addr 172.21.15.61:0/2472830550 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:21.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f11ac4700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8003c20 0x7f6f0c0c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f122c5700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c0c32c0 0x7f6f0c0c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f112c3700 1 -- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c0c32c0 msgr2=0x7f6f0c0c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f112c3700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c0c32c0 0x7f6f0c0c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f112c3700 1 -- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8003c20 msgr2=0x7f6f0c0c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f112c3700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8003c20 0x7f6f0c0c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f112c3700 1 -- 172.21.15.61:0/2472830550 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c0c6010 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f112c3700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f0c0c5a50 0x7f6f0c157ef0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00e870 tx=0x7f6efc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f01ffb700 1 -- 172.21.15.61:0/2472830550 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc013700 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f01ffb700 1 -- 172.21.15.61:0/2472830550 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc013860 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f13d28700 1 -- 172.21.15.61:0/2472830550 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0c0c62f0 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.286+0000 7f6f01ffb700 1 -- 172.21.15.61:0/2472830550 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc013c20 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.287+0000 7f6f13d28700 1 -- 172.21.15.61:0/2472830550 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0c0c68b0 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.288+0000 7f6f13d28700 1 -- 172.21.15.61:0/2472830550 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0c04c3c0 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.288+0000 7f6f01ffb700 1 -- 172.21.15.61:0/2472830550 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6efc0023c0 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.288+0000 7f6f01ffb700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6ef0066f30 0x7f6ef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.288+0000 7f6f01ffb700 1 -- 172.21.15.61:0/2472830550 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6efc0848d0 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.288+0000 7f6f11ac4700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6ef0066f30 0x7f6ef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.289+0000 7f6f11ac4700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6ef0066f30 0x7f6ef00693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c16cfb0 tx=0x7f6f0801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:21.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.292+0000 7f6f01ffb700 1 -- 172.21.15.61:0/2472830550 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6efc051f40 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.491+0000 7f6f13d28700 1 -- 172.21.15.61:0/2472830550 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6f0c06a8a0 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.491+0000 7f6f01ffb700 1 -- 172.21.15.61:0/2472830550 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v118) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6efc055560 con 0x7f6f0c0c5a50 2023-12-24T20:02:21.492 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:21.492 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T20:02:21.492 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:21.492 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T20:02:21.492 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T20:02:21.492 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:21.492 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T20:02:21.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 -- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6ef0066f30 msgr2=0x7f6ef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6ef0066f30 0x7f6ef00693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c16cfb0 tx=0x7f6f0801a000 comp rx=0 tx=0).stop 2023-12-24T20:02:21.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 -- 172.21.15.61:0/2472830550 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f0c0c5a50 msgr2=0x7f6f0c157ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f0c0c5a50 0x7f6f0c157ef0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00e870 tx=0x7f6efc009040 comp rx=0 tx=0).stop 2023-12-24T20:02:21.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 -- 172.21.15.61:0/2472830550 shutdown_connections 2023-12-24T20:02:21.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f0c0c32c0 0x7f6f0c0c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6ef0066f30 0x7f6ef00693e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ef8003c20 0x7f6f0c0c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 --2- 172.21.15.61:0/2472830550 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f0c0c5a50 0x7f6f0c157ef0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 -- 172.21.15.61:0/2472830550 >> 172.21.15.61:0/2472830550 conn(0x7f6f0c0cd6f0 msgr2=0x7f6f0c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:21.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 -- 172.21.15.61:0/2472830550 shutdown_connections 2023-12-24T20:02:21.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.493+0000 7f6f13d28700 1 -- 172.21.15.61:0/2472830550 wait complete. 2023-12-24T20:02:21.506 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T20:02:21.506 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T20:02:21.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.631+0000 7f8b88f3e700 1 Processor -- start 2023-12-24T20:02:21.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.631+0000 7f8b88f3e700 1 -- start start 2023-12-24T20:02:21.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.632+0000 7f8b88f3e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8b84157730 0x7f8b840aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.632+0000 7f8b88f3e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8b84157b00 0x7f8b840ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.632+0000 7f8b88f3e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b840adb50 con 0x7f8b84063ac0 2023-12-24T20:02:21.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.632+0000 7f8b88f3e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840adda0 con 0x7f8b84157730 2023-12-24T20:02:21.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.632+0000 7f8b88f3e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840ae080 con 0x7f8b84157b00 2023-12-24T20:02:21.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.632+0000 7f8b8259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8b84157730 0x7f8b840aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.632+0000 7f8b82d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8b84063ac0 0x7f8b840b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:43674/0 (socket says 172.21.15.61:43674) 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.632+0000 7f8b82d9d700 1 -- 172.21.15.61:0/2800027279 learned_addr learned my addr 172.21.15.61:0/2800027279 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.632+0000 7f8b81d9b700 1 --2- 172.21.15.61:0/2800027279 >> v2:172.21.15.133:3300/0 conn(0x7f8b84157b00 0x7f8b840ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.633+0000 7f8b8159a700 1 -- 172.21.15.61:0/2800027279 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575334832 0 0) 0x7f8b840adb50 con 0x7f8b84063ac0 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.633+0000 7f8b8159a700 1 -- 172.21.15.61:0/2800027279 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b6c003570 con 0x7f8b84063ac0 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.633+0000 7f8b8259c700 1 -- 172.21.15.61:0/2800027279 >> v2:172.21.15.133:3300/0 conn(0x7f8b84157b00 msgr2=0x7f8b840ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.633+0000 7f8b8259c700 1 --2- 172.21.15.61:0/2800027279 >> v2:172.21.15.133:3300/0 conn(0x7f8b84157b00 0x7f8b840ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.633+0000 7f8b8259c700 1 -- 172.21.15.61:0/2800027279 >> v1:172.21.15.61:6789/0 conn(0x7f8b84063ac0 legacy=0x7f8b840b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.633+0000 7f8b8259c700 1 -- 172.21.15.61:0/2800027279 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840ae360 con 0x7f8b84157730 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.633+0000 7f8b8259c700 1 --2- 172.21.15.61:0/2800027279 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84157730 0x7f8b840aeb60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8b84157f80 tx=0x7f8b740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f675f7cf9c1002f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.633+0000 7f8b8159a700 1 -- 172.21.15.61:0/2800027279 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74011630 con 0x7f8b84157730 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.633+0000 7f8b8159a700 1 -- 172.21.15.61:0/2800027279 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b740117b0 con 0x7f8b84157730 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.633+0000 7f8b8159a700 1 -- 172.21.15.61:0/2800027279 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74011b70 con 0x7f8b84157730 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.634+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2800027279 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84157730 msgr2=0x7f8b840aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.634+0000 7f8b88f3e700 1 --2- 172.21.15.61:0/2800027279 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84157730 0x7f8b840aeb60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8b84157f80 tx=0x7f8b740091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.634+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2800027279 shutdown_connections 2023-12-24T20:02:21.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.634+0000 7f8b88f3e700 1 --2- 172.21.15.61:0/2800027279 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84157730 0x7f8b840aeb60 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.634+0000 7f8b88f3e700 1 --2- 172.21.15.61:0/2800027279 >> v2:172.21.15.133:3300/0 conn(0x7f8b84157b00 0x7f8b840ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.634+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2800027279 >> 172.21.15.61:0/2800027279 conn(0x7f8b84067fd0 msgr2=0x7f8b840cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:21.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.634+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2800027279 shutdown_connections 2023-12-24T20:02:21.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.634+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2800027279 wait complete. 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.635+0000 7f8b88f3e700 1 Processor -- start 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.635+0000 7f8b88f3e700 1 -- start start 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b88f3e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84063ac0 0x7f8b8414eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b88f3e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b84157730 0x7f8b841589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b88f3e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b84157b00 0x7f8b84153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b88f3e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8414f070 con 0x7f8b84063ac0 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b88f3e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b841592e0 con 0x7f8b84157730 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b88f3e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840aa9b0 con 0x7f8b84157b00 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b8259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84063ac0 0x7f8b8414eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b8259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84063ac0 0x7f8b8414eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41702/0 (socket says 172.21.15.61:41702) 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b8259c700 1 -- 172.21.15.61:0/2226642545 learned_addr learned my addr 172.21.15.61:0/2226642545 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b82d9d700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b84157b00 0x7f8b84153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b81d9b700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b84157730 0x7f8b841589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b8259c700 1 -- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b84157b00 msgr2=0x7f8b84153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b8259c700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b84157b00 0x7f8b84153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b8259c700 1 -- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b84157730 msgr2=0x7f8b841589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b8259c700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b84157730 0x7f8b841589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b8259c700 1 -- 172.21.15.61:0/2226642545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b74009420 con 0x7f8b84063ac0 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b81d9b700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b84157730 0x7f8b841589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b8259c700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84063ac0 0x7f8b8414eb30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8b74013000 tx=0x7f8b74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b727fc700 1 -- 172.21.15.61:0/2226642545 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7401f070 con 0x7f8b84063ac0 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b727fc700 1 -- 172.21.15.61:0/2226642545 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74000bc0 con 0x7f8b84063ac0 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2226642545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b840aac50 con 0x7f8b84063ac0 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.636+0000 7f8b727fc700 1 -- 172.21.15.61:0/2226642545 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74011b70 con 0x7f8b84063ac0 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.637+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2226642545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b840ab210 con 0x7f8b84063ac0 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.637+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2226642545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8404c3c0 con 0x7f8b84063ac0 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.638+0000 7f8b727fc700 1 -- 172.21.15.61:0/2226642545 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8b74023070 con 0x7f8b84063ac0 2023-12-24T20:02:21.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.638+0000 7f8b727fc700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8b64066f30 0x7f8b640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:21.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.638+0000 7f8b727fc700 1 -- 172.21.15.61:0/2226642545 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8b74085510 con 0x7f8b84063ac0 2023-12-24T20:02:21.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.638+0000 7f8b81d9b700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8b64066f30 0x7f8b640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:21.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.639+0000 7f8b81d9b700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8b64066f30 0x7f8b640693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8b78006f00 tx=0x7f8b78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:21.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.642+0000 7f8b727fc700 1 -- 172.21.15.61:0/2226642545 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b74052ad0 con 0x7f8b84063ac0 2023-12-24T20:02:21.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:21.836+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2226642545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8b840c9350 con 0x7f8b84063ac0 2023-12-24T20:02:22.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.016+0000 7f8b727fc700 1 -- 172.21.15.61:0/2226642545 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v119) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8b740150b0 con 0x7f8b84063ac0 2023-12-24T20:02:22.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8b64066f30 msgr2=0x7f8b640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8b64066f30 0x7f8b640693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8b78006f00 tx=0x7f8b78008040 comp rx=0 tx=0).stop 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2226642545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84063ac0 msgr2=0x7f8b8414eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84063ac0 0x7f8b8414eb30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8b74013000 tx=0x7f8b74017000 comp rx=0 tx=0).stop 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2226642545 shutdown_connections 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8b84157b00 0x7f8b84153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8b64066f30 0x7f8b640693e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8b84063ac0 0x7f8b8414eb30 secure :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8b74013000 tx=0x7f8b74017000 comp rx=0 tx=0).stop 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 --2- 172.21.15.61:0/2226642545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8b84157730 0x7f8b841589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2226642545 >> 172.21.15.61:0/2226642545 conn(0x7f8b84067fd0 msgr2=0x7f8b8406d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2226642545 shutdown_connections 2023-12-24T20:02:22.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.020+0000 7f8b88f3e700 1 -- 172.21.15.61:0/2226642545 wait complete. 2023-12-24T20:02:22.022 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T20:02:22.033 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T20:02:22.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.160+0000 7f6b7bf22700 1 Processor -- start 2023-12-24T20:02:22.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.161+0000 7f6b7bf22700 1 -- start start 2023-12-24T20:02:22.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b7bf22700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b7415afd0 0x7f6b740cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:22.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b7bf22700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b740cb3d0 0x7f6b740aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:22.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b7bf22700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740cb7e0 con 0x7f6b7415ac00 2023-12-24T20:02:22.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b7bf22700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740c8c30 con 0x7f6b740cb3d0 2023-12-24T20:02:22.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b7bf22700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740c7e00 con 0x7f6b7415afd0 2023-12-24T20:02:22.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b7a4bf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b740cb3d0 0x7f6b740aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:22.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b794bd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b7415afd0 0x7f6b740cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:22.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b7a4bf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b740cb3d0 0x7f6b740aabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:54388/0 (socket says 172.21.15.61:54388) 2023-12-24T20:02:22.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b794bd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b7415afd0 0x7f6b740cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:36326/0 (socket says 172.21.15.61:36326) 2023-12-24T20:02:22.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b7a4bf700 1 -- 172.21.15.61:0/1606466667 learned_addr learned my addr 172.21.15.61:0/1606466667 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:22.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b79cbe700 1 --1- 172.21.15.61:0/1606466667 >> v1:172.21.15.133:6789/0 conn(0x7f6b7415ac00 0x7f6b740c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:37668/0 (socket says 172.21.15.61:37668) 2023-12-24T20:02:22.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b794bd700 1 -- 172.21.15.61:0/1606466667 >> v2:172.21.15.133:3300/0 conn(0x7f6b740cb3d0 msgr2=0x7f6b740aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:22.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b794bd700 1 --2- 172.21.15.61:0/1606466667 >> v2:172.21.15.133:3300/0 conn(0x7f6b740cb3d0 0x7f6b740aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:22.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b794bd700 1 -- 172.21.15.61:0/1606466667 >> v1:172.21.15.133:6789/0 conn(0x7f6b7415ac00 legacy=0x7f6b740c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:22.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b794bd700 1 -- 172.21.15.61:0/1606466667 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740c80b0 con 0x7f6b7415afd0 2023-12-24T20:02:22.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b7a4bf700 1 --2- 172.21.15.61:0/1606466667 >> v2:172.21.15.133:3300/0 conn(0x7f6b740cb3d0 0x7f6b740aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:22.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.162+0000 7f6b794bd700 1 --2- 172.21.15.61:0/1606466667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b7415afd0 0x7f6b740cae90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6b640098e0 tx=0x7f6b640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=283fc88c4610490d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:22.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b78cbc700 1 -- 172.21.15.61:0/1606466667 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6400b640 con 0x7f6b7415afd0 2023-12-24T20:02:22.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b78cbc700 1 -- 172.21.15.61:0/1606466667 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6400b7a0 con 0x7f6b7415afd0 2023-12-24T20:02:22.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b78cbc700 1 -- 172.21.15.61:0/1606466667 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6400bb40 con 0x7f6b7415afd0 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b7bf22700 1 -- 172.21.15.61:0/1606466667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b7415afd0 msgr2=0x7f6b740cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b7bf22700 1 --2- 172.21.15.61:0/1606466667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b7415afd0 0x7f6b740cae90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6b640098e0 tx=0x7f6b640091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b7bf22700 1 -- 172.21.15.61:0/1606466667 shutdown_connections 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b7bf22700 1 --2- 172.21.15.61:0/1606466667 >> v2:172.21.15.133:3300/0 conn(0x7f6b740cb3d0 0x7f6b740aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b7bf22700 1 --2- 172.21.15.61:0/1606466667 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b7415afd0 0x7f6b740cae90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b7bf22700 1 -- 172.21.15.61:0/1606466667 >> 172.21.15.61:0/1606466667 conn(0x7f6b740cd0b0 msgr2=0x7f6b740cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b7bf22700 1 -- 172.21.15.61:0/1606466667 shutdown_connections 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.163+0000 7f6b7bf22700 1 -- 172.21.15.61:0/1606466667 wait complete. 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.164+0000 7f6b7bf22700 1 Processor -- start 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b7bf22700 1 -- start start 2023-12-24T20:02:22.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b7bf22700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b740cb3d0 0x7f6b7415e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b7bf22700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b7415ac00 0x7f6b7416ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b7bf22700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b7415afd0 0x7f6b74069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b7bf22700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7415f2e0 con 0x7f6b7415ac00 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b7bf22700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7415e7d0 con 0x7f6b7415afd0 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b7bf22700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740b1860 con 0x7f6b740cb3d0 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b794bd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b7415ac00 0x7f6b7416ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b794bd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b7415ac00 0x7f6b7416ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41706/0 (socket says 172.21.15.61:41706) 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b794bd700 1 -- 172.21.15.61:0/2153723192 learned_addr learned my addr 172.21.15.61:0/2153723192 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.165+0000 7f6b79cbe700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b740cb3d0 0x7f6b7415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b7a4bf700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b7415afd0 0x7f6b74069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b794bd700 1 -- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b740cb3d0 msgr2=0x7f6b7415e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b794bd700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b740cb3d0 0x7f6b7415e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b794bd700 1 -- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b7415afd0 msgr2=0x7f6b74069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:22.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b794bd700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b7415afd0 0x7f6b74069ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:22.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b794bd700 1 -- 172.21.15.61:0/2153723192 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c009ae0 con 0x7f6b7415ac00 2023-12-24T20:02:22.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b794bd700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b7415ac00 0x7f6b7416ac00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6b640093f0 tx=0x7f6b64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:22.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b69ffb700 1 -- 172.21.15.61:0/2153723192 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6401bc80 con 0x7f6b7415ac00 2023-12-24T20:02:22.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b69ffb700 1 -- 172.21.15.61:0/2153723192 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6401bde0 con 0x7f6b7415ac00 2023-12-24T20:02:22.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b7bf22700 1 -- 172.21.15.61:0/2153723192 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b64009420 con 0x7f6b7415ac00 2023-12-24T20:02:22.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b69ffb700 1 -- 172.21.15.61:0/2153723192 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64011670 con 0x7f6b7415ac00 2023-12-24T20:02:22.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.166+0000 7f6b7bf22700 1 -- 172.21.15.61:0/2153723192 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7406de10 con 0x7f6b7415ac00 2023-12-24T20:02:22.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.167+0000 7f6b7bf22700 1 -- 172.21.15.61:0/2153723192 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7404c3c0 con 0x7f6b7415ac00 2023-12-24T20:02:22.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.168+0000 7f6b69ffb700 1 -- 172.21.15.61:0/2153723192 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6b64011aa0 con 0x7f6b7415ac00 2023-12-24T20:02:22.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.168+0000 7f6b69ffb700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b58066f30 0x7f6b580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:22.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.168+0000 7f6b69ffb700 1 -- 172.21.15.61:0/2153723192 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6b64085b80 con 0x7f6b7415ac00 2023-12-24T20:02:22.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.169+0000 7f6b79cbe700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b58066f30 0x7f6b580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:22.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.169+0000 7f6b79cbe700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b58066f30 0x7f6b580693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6b70007060 tx=0x7f6b70007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:22.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.172+0000 7f6b69ffb700 1 -- 172.21.15.61:0/2153723192 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b64053130 con 0x7f6b7415ac00 2023-12-24T20:02:22.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:22.366+0000 7f6b7bf22700 1 -- 172.21.15.61:0/2153723192 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6b740b1a20 con 0x7f6b7415ac00 2023-12-24T20:02:23.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.018+0000 7f6b69ffb700 1 -- 172.21.15.61:0/2153723192 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v120) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6b64056750 con 0x7f6b7415ac00 2023-12-24T20:02:23.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.022+0000 7f6b7bf22700 1 -- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b58066f30 msgr2=0x7f6b580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:23.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.022+0000 7f6b7bf22700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b58066f30 0x7f6b580693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6b70007060 tx=0x7f6b70007ea0 comp rx=0 tx=0).stop 2023-12-24T20:02:23.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.022+0000 7f6b7bf22700 1 -- 172.21.15.61:0/2153723192 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b7415ac00 msgr2=0x7f6b7416ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:23.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.022+0000 7f6b7bf22700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b7415ac00 0x7f6b7416ac00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6b640093f0 tx=0x7f6b64017000 comp rx=0 tx=0).stop 2023-12-24T20:02:23.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.023+0000 7f6b7bf22700 1 -- 172.21.15.61:0/2153723192 shutdown_connections 2023-12-24T20:02:23.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.023+0000 7f6b7bf22700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6b740cb3d0 0x7f6b7415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:23.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.023+0000 7f6b7bf22700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6b58066f30 0x7f6b580693e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:23.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.023+0000 7f6b7bf22700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b7415afd0 0x7f6b74069ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:23.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.023+0000 7f6b7bf22700 1 --2- 172.21.15.61:0/2153723192 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b7415ac00 0x7f6b7416ac00 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:23.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.023+0000 7f6b7bf22700 1 -- 172.21.15.61:0/2153723192 >> 172.21.15.61:0/2153723192 conn(0x7f6b740cd0b0 msgr2=0x7f6b7415b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:23.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.024+0000 7f6b7bf22700 1 -- 172.21.15.61:0/2153723192 shutdown_connections 2023-12-24T20:02:23.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.024+0000 7f6b7bf22700 1 -- 172.21.15.61:0/2153723192 wait complete. 2023-12-24T20:02:23.030 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T20:02:23.045 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T20:02:23.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.170+0000 7f2194fd6700 1 Processor -- start 2023-12-24T20:02:23.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.170+0000 7f2194fd6700 1 -- start start 2023-12-24T20:02:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f2194fd6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f21900ce020 0x7f2190068e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f2194fd6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219006d460 con 0x7f21900ce3f0 2023-12-24T20:02:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f2194fd6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219006c450 con 0x7f219006b730 2023-12-24T20:02:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f2194fd6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219006c6a0 con 0x7f21900ce020 2023-12-24T20:02:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f218e59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f21900ce020 0x7f2190068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f218ed9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f21900ce3f0 0x7f2190067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:43676/0 (socket says 172.21.15.61:43676) 2023-12-24T20:02:23.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f218ed9d700 1 -- 172.21.15.61:0/1975594673 learned_addr learned my addr 172.21.15.61:0/1975594673 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f218d59a700 1 -- 172.21.15.61:0/1975594673 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193892201 0 0) 0x7f219006d460 con 0x7f21900ce3f0 2023-12-24T20:02:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f218d59a700 1 -- 172.21.15.61:0/1975594673 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2178003570 con 0x7f21900ce3f0 2023-12-24T20:02:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f218e59c700 1 -- 172.21.15.61:0/1975594673 >> v1:172.21.15.133:6789/0 conn(0x7f219006b730 legacy=0x7f21901596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f218e59c700 1 -- 172.21.15.61:0/1975594673 >> v1:172.21.15.61:6789/0 conn(0x7f21900ce3f0 legacy=0x7f2190067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.171+0000 7f218e59c700 1 -- 172.21.15.61:0/1975594673 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219006c980 con 0x7f21900ce020 2023-12-24T20:02:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f218e59c700 1 --2- 172.21.15.61:0/1975594673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce020 0x7f2190068e70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f21800098e0 tx=0x7f21800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf296b30f3d5e070 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f218d59a700 1 -- 172.21.15.61:0/1975594673 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180011630 con 0x7f21900ce020 2023-12-24T20:02:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f218d59a700 1 -- 172.21.15.61:0/1975594673 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2180011790 con 0x7f21900ce020 2023-12-24T20:02:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f218d59a700 1 -- 172.21.15.61:0/1975594673 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180011b30 con 0x7f21900ce020 2023-12-24T20:02:23.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f2194fd6700 1 -- 172.21.15.61:0/1975594673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce020 msgr2=0x7f2190068e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:23.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f2194fd6700 1 --2- 172.21.15.61:0/1975594673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce020 0x7f2190068e70 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f21800098e0 tx=0x7f21800091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:23.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f2194fd6700 1 -- 172.21.15.61:0/1975594673 shutdown_connections 2023-12-24T20:02:23.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f2194fd6700 1 --2- 172.21.15.61:0/1975594673 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce020 0x7f2190068e70 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:23.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f2194fd6700 1 -- 172.21.15.61:0/1975594673 >> 172.21.15.61:0/1975594673 conn(0x7f219006f820 msgr2=0x7f219006ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:23.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f2194fd6700 1 -- 172.21.15.61:0/1975594673 shutdown_connections 2023-12-24T20:02:23.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.172+0000 7f2194fd6700 1 -- 172.21.15.61:0/1975594673 wait complete. 2023-12-24T20:02:23.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.173+0000 7f2194fd6700 1 Processor -- start 2023-12-24T20:02:23.176 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.174+0000 7f2194fd6700 1 -- start start 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.174+0000 7f2194fd6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f219006b730 0x7f21900b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.174+0000 7f2194fd6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21900ce020 0x7f2190156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.174+0000 7f2194fd6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce3f0 0x7f219016de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.174+0000 7f2194fd6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21900b3cc0 con 0x7f21900ce3f0 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.174+0000 7f2194fd6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219016e360 con 0x7f219006b730 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.174+0000 7f2194fd6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21900b30b0 con 0x7f21900ce020 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.174+0000 7f218ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce3f0 0x7f219016de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.174+0000 7f218ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce3f0 0x7f219016de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41730/0 (socket says 172.21.15.61:41730) 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.174+0000 7f218ed9d700 1 -- 172.21.15.61:0/278569552 learned_addr learned my addr 172.21.15.61:0/278569552 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f218dd9b700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21900ce020 0x7f2190156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f218e59c700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f219006b730 0x7f21900b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f218ed9d700 1 -- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21900ce020 msgr2=0x7f2190156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f218ed9d700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21900ce020 0x7f2190156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f218ed9d700 1 -- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f219006b730 msgr2=0x7f21900b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:23.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f218ed9d700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f219006b730 0x7f21900b2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:23.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f218ed9d700 1 -- 172.21.15.61:0/278569552 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180009420 con 0x7f21900ce3f0 2023-12-24T20:02:23.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f218e59c700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f219006b730 0x7f21900b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:23.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f218ed9d700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce3f0 0x7f219016de20 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2188001460 tx=0x7f2188001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:23.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f217e7fc700 1 -- 172.21.15.61:0/278569552 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800a8a0 con 0x7f21900ce3f0 2023-12-24T20:02:23.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f217e7fc700 1 -- 172.21.15.61:0/278569552 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218800aa00 con 0x7f21900ce3f0 2023-12-24T20:02:23.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f217e7fc700 1 -- 172.21.15.61:0/278569552 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218800ad80 con 0x7f21900ce3f0 2023-12-24T20:02:23.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f2194fd6700 1 -- 172.21.15.61:0/278569552 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21900b3390 con 0x7f21900ce3f0 2023-12-24T20:02:23.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.175+0000 7f2194fd6700 1 -- 172.21.15.61:0/278569552 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21900b3950 con 0x7f21900ce3f0 2023-12-24T20:02:23.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.176+0000 7f2194fd6700 1 -- 172.21.15.61:0/278569552 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219004c3c0 con 0x7f21900ce3f0 2023-12-24T20:02:23.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.177+0000 7f217e7fc700 1 -- 172.21.15.61:0/278569552 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2188007300 con 0x7f21900ce3f0 2023-12-24T20:02:23.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.177+0000 7f217e7fc700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2170066f30 0x7f21700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:23.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.177+0000 7f217e7fc700 1 -- 172.21.15.61:0/278569552 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f2188084910 con 0x7f21900ce3f0 2023-12-24T20:02:23.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.177+0000 7f218e59c700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2170066f30 0x7f21700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:23.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.178+0000 7f218e59c700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2170066f30 0x7f21700693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f21800091e0 tx=0x7f2180016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:23.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.181+0000 7f217e7fc700 1 -- 172.21.15.61:0/278569552 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2188051b30 con 0x7f21900ce3f0 2023-12-24T20:02:23.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:23.421+0000 7f2194fd6700 1 -- 172.21.15.61:0/278569552 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f219006cc60 con 0x7f21900ce3f0 2023-12-24T20:02:24.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.038+0000 7f217e7fc700 1 -- 172.21.15.61:0/278569552 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2188055150 con 0x7f21900ce3f0 2023-12-24T20:02:24.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.041+0000 7f2194fd6700 1 -- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2170066f30 msgr2=0x7f21700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.041+0000 7f2194fd6700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2170066f30 0x7f21700693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f21800091e0 tx=0x7f2180016000 comp rx=0 tx=0).stop 2023-12-24T20:02:24.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.042+0000 7f2194fd6700 1 -- 172.21.15.61:0/278569552 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce3f0 msgr2=0x7f219016de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.042+0000 7f2194fd6700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce3f0 0x7f219016de20 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f2188001460 tx=0x7f2188001a40 comp rx=0 tx=0).stop 2023-12-24T20:02:24.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.042+0000 7f2194fd6700 1 -- 172.21.15.61:0/278569552 shutdown_connections 2023-12-24T20:02:24.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.042+0000 7f2194fd6700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2170066f30 0x7f21700693e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.042+0000 7f2194fd6700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21900ce3f0 0x7f219016de20 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.042+0000 7f2194fd6700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f219006b730 0x7f21900b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.042+0000 7f2194fd6700 1 --2- 172.21.15.61:0/278569552 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21900ce020 0x7f2190156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.042+0000 7f2194fd6700 1 -- 172.21.15.61:0/278569552 >> 172.21.15.61:0/278569552 conn(0x7f219006f820 msgr2=0x7f21901584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:24.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.043+0000 7f2194fd6700 1 -- 172.21.15.61:0/278569552 shutdown_connections 2023-12-24T20:02:24.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.044+0000 7f2194fd6700 1 -- 172.21.15.61:0/278569552 wait complete. 2023-12-24T20:02:24.045 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 14 and data pool 15 2023-12-24T20:02:24.058 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:24.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.180+0000 7fd06aeb2700 1 Processor -- start 2023-12-24T20:02:24.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.181+0000 7fd06aeb2700 1 -- start start 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd06aeb2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0640b08f0 0x7fd0640b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd06aeb2700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0640b2eb0 con 0x7fd0640b2660 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd06aeb2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0640b2bd0 con 0x7fd06415bb60 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd06aeb2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0640afc20 con 0x7fd0640b08f0 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd063fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd0640b2660 0x7fd06415bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:43680/0 (socket says 172.21.15.61:43680) 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd063fff700 1 -- 172.21.15.61:0/3464104484 learned_addr learned my addr 172.21.15.61:0/3464104484 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd06944f700 1 --2- 172.21.15.61:0/3464104484 >> v2:172.21.15.133:3300/0 conn(0x7fd0640b08f0 0x7fd0640b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396195249 0 0) 0x7fd0640b2eb0 con 0x7fd0640b2660 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd054003570 con 0x7fd0640b2660 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 105443249 0 0) 0x7fd054003570 con 0x7fd0640b2660 2023-12-24T20:02:24.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 >> v2:172.21.15.133:3300/0 conn(0x7fd0640b08f0 msgr2=0x7fd0640b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd0637fe700 1 --2- 172.21.15.61:0/3464104484 >> v2:172.21.15.133:3300/0 conn(0x7fd0640b08f0 0x7fd0640b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 >> v1:172.21.15.133:6789/0 conn(0x7fd06415bb60 legacy=0x7fd064098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640afe10 con 0x7fd0640b2660 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.182+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fd050001470 con 0x7fd0640b2660 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 >> v1:172.21.15.61:6789/0 conn(0x7fd0640b2660 legacy=0x7fd06415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd0637fe700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd054003a60 0x7fd054003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd0637fe700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd054004810 0x7fd054004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd0637fe700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd05400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05400c0a0 con 0x7fd0540051c0 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05400c210 con 0x7fd054003a60 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05400c3d0 con 0x7fd054004810 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd06944f700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd05400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd068c4e700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd054003a60 0x7fd054003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd063fff700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd054004810 0x7fd054004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd06944f700 1 -- 172.21.15.61:0/3464104484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd054004810 msgr2=0x7fd054004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd06944f700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd054004810 0x7fd054004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd06944f700 1 -- 172.21.15.61:0/3464104484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd054003a60 msgr2=0x7fd054003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd06944f700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd054003a60 0x7fd054003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd06944f700 1 -- 172.21.15.61:0/3464104484 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054003570 con 0x7fd0540051c0 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd06944f700 1 -- 172.21.15.61:0/3464104484 reap_dead start 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd06944f700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd05400ba60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00e210 tx=0x7fd05c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cd9eba7bac180f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00eac0 con 0x7fd0540051c0 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c00f040 con 0x7fd0540051c0 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.183+0000 7fd0637fe700 1 -- 172.21.15.61:0/3464104484 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00ee70 con 0x7fd0540051c0 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.184+0000 7fd06aeb2700 1 -- 172.21.15.61:0/3464104484 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 msgr2=0x7fd05400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.184+0000 7fd06aeb2700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd05400ba60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00e210 tx=0x7fd05c00b040 comp rx=0 tx=0).stop 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.184+0000 7fd06aeb2700 1 -- 172.21.15.61:0/3464104484 shutdown_connections 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.184+0000 7fd06aeb2700 1 --2- 172.21.15.61:0/3464104484 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd05400ba60 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.184+0000 7fd06aeb2700 1 -- 172.21.15.61:0/3464104484 >> 172.21.15.61:0/3464104484 conn(0x7fd064097a10 msgr2=0x7fd0640ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:24.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.184+0000 7fd06aeb2700 1 -- 172.21.15.61:0/3464104484 shutdown_connections 2023-12-24T20:02:24.188 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.184+0000 7fd06aeb2700 1 -- 172.21.15.61:0/3464104484 wait complete. 2023-12-24T20:02:24.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.185+0000 7fd06aeb2700 1 Processor -- start 2023-12-24T20:02:24.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.185+0000 7fd06aeb2700 1 -- start start 2023-12-24T20:02:24.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd06aeb2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd0640cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd06aeb2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064068560 0x7fd064155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd06aeb2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd06416d4c0 0x7fd06416d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd06aeb2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06416de70 con 0x7fd0540051c0 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd06aeb2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd064068c60 con 0x7fd064068560 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd06aeb2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640689d0 con 0x7fd06416d4c0 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd068c4e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd0640cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd068c4e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd0640cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41752/0 (socket says 172.21.15.61:41752) 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd068c4e700 1 -- 172.21.15.61:0/2564151545 learned_addr learned my addr 172.21.15.61:0/2564151545 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd063fff700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064068560 0x7fd064155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd068c4e700 1 -- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd06416d4c0 msgr2=0x7fd06416d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd068c4e700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd06416d4c0 0x7fd06416d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd068c4e700 1 -- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064068560 msgr2=0x7fd064155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd068c4e700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064068560 0x7fd064155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.186+0000 7fd068c4e700 1 -- 172.21.15.61:0/2564151545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06409b2b0 con 0x7fd0540051c0 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.187+0000 7fd068c4e700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd0640cea70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd0580078f0 tx=0x7fd058007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.187+0000 7fd060ff9700 1 -- 172.21.15.61:0/2564151545 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd058002e80 con 0x7fd0540051c0 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.187+0000 7fd060ff9700 1 -- 172.21.15.61:0/2564151545 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05800f8d0 con 0x7fd0540051c0 2023-12-24T20:02:24.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.187+0000 7fd06aeb2700 1 -- 172.21.15.61:0/2564151545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06409b590 con 0x7fd0540051c0 2023-12-24T20:02:24.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.187+0000 7fd060ff9700 1 -- 172.21.15.61:0/2564151545 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800fc50 con 0x7fd0540051c0 2023-12-24T20:02:24.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.187+0000 7fd06aeb2700 1 -- 172.21.15.61:0/2564151545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06409bb50 con 0x7fd0540051c0 2023-12-24T20:02:24.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.188+0000 7fd06aeb2700 1 -- 172.21.15.61:0/2564151545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06406d440 con 0x7fd0540051c0 2023-12-24T20:02:24.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.188+0000 7fd060ff9700 1 -- 172.21.15.61:0/2564151545 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd05801c400 con 0x7fd0540051c0 2023-12-24T20:02:24.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.189+0000 7fd060ff9700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd048066fb0 0x7fd048069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.189+0000 7fd060ff9700 1 -- 172.21.15.61:0/2564151545 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd058084b00 con 0x7fd0540051c0 2023-12-24T20:02:24.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.189+0000 7fd063fff700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd048066fb0 0x7fd048069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.190+0000 7fd063fff700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd048066fb0 0x7fd048069460 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd050001050 tx=0x7fd050009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:24.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.193+0000 7fd060ff9700 1 -- 172.21.15.61:0/2564151545 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd058051d80 con 0x7fd0540051c0 2023-12-24T20:02:24.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.391+0000 7fd06aeb2700 1 -- 172.21.15.61:0/2564151545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd06409bce0 con 0x7fd0540051c0 2023-12-24T20:02:24.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.392+0000 7fd060ff9700 1 -- 172.21.15.61:0/2564151545 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fd0580553a0 con 0x7fd0540051c0 2023-12-24T20:02:24.392 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:24.392 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":121,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:23.422415+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:21.867619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:22.397630+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:24.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 -- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd048066fb0 msgr2=0x7fd048069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd048066fb0 0x7fd048069460 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd050001050 tx=0x7fd050009040 comp rx=0 tx=0).stop 2023-12-24T20:02:24.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 -- 172.21.15.61:0/2564151545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 msgr2=0x7fd0640cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd0640cea70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd0580078f0 tx=0x7fd058007d80 comp rx=0 tx=0).stop 2023-12-24T20:02:24.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 -- 172.21.15.61:0/2564151545 shutdown_connections 2023-12-24T20:02:24.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd06416d4c0 0x7fd06416d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd048066fb0 0x7fd048069460 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0540051c0 0x7fd0640cea70 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 --2- 172.21.15.61:0/2564151545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064068560 0x7fd064155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 -- 172.21.15.61:0/2564151545 >> 172.21.15.61:0/2564151545 conn(0x7fd064097a10 msgr2=0x7fd06406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:24.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 -- 172.21.15.61:0/2564151545 shutdown_connections 2023-12-24T20:02:24.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.394+0000 7fd06aeb2700 1 -- 172.21.15.61:0/2564151545 wait complete. 2023-12-24T20:02:24.407 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:24.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.528+0000 7fcd06650700 1 Processor -- start 2023-12-24T20:02:24.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.528+0000 7fcd06650700 1 -- start start 2023-12-24T20:02:24.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.529+0000 7fcd06650700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 0x7fcd000cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.529+0000 7fcd06650700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd000b2890 con 0x7fcd00068510 2023-12-24T20:02:24.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.529+0000 7fcd06650700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd000cf630 con 0x7fcd00068140 2023-12-24T20:02:24.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.529+0000 7fcd06650700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000b2240 con 0x7fcd000b3d30 2023-12-24T20:02:24.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.529+0000 7fccff7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fcd00068510 0x7fcd00159a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:43688/0 (socket says 172.21.15.61:43688) 2023-12-24T20:02:24.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.529+0000 7fccff7fe700 1 -- 172.21.15.61:0/684792341 learned_addr learned my addr 172.21.15.61:0/684792341 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:24.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.529+0000 7fcd04bed700 1 --2- 172.21.15.61:0/684792341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 0x7fcd000cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.529+0000 7fccfeffd700 1 -- 172.21.15.61:0/684792341 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150088952 0 0) 0x7fcd000b2890 con 0x7fcd00068510 2023-12-24T20:02:24.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.529+0000 7fccfeffd700 1 -- 172.21.15.61:0/684792341 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccec003570 con 0x7fcd00068510 2023-12-24T20:02:24.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.530+0000 7fccfeffd700 1 -- 172.21.15.61:0/684792341 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816606867 0 0) 0x7fcd000cf630 con 0x7fcd00068140 2023-12-24T20:02:24.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.530+0000 7fccfeffd700 1 -- 172.21.15.61:0/684792341 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd000b2890 con 0x7fcd00068140 2023-12-24T20:02:24.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.530+0000 7fccfeffd700 1 -- 172.21.15.61:0/684792341 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1874305456 0 0) 0x7fccec003570 con 0x7fcd00068510 2023-12-24T20:02:24.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.530+0000 7fcd04bed700 1 -- 172.21.15.61:0/684792341 >> v1:172.21.15.133:6789/0 conn(0x7fcd00068140 legacy=0x7fcd000b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.530+0000 7fcd04bed700 1 -- 172.21.15.61:0/684792341 >> v1:172.21.15.61:6789/0 conn(0x7fcd00068510 legacy=0x7fcd00159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.530+0000 7fcd04bed700 1 -- 172.21.15.61:0/684792341 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000b2520 con 0x7fcd000b3d30 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.530+0000 7fcd04bed700 1 --2- 172.21.15.61:0/684792341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 0x7fcd000cefa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009e90 tx=0x7fccf8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e0f03201f16bc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.530+0000 7fccfeffd700 1 -- 172.21.15.61:0/684792341 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf800e070 con 0x7fcd000b3d30 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.530+0000 7fccfeffd700 1 -- 172.21.15.61:0/684792341 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf800b870 con 0x7fcd000b3d30 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.530+0000 7fccfeffd700 1 -- 172.21.15.61:0/684792341 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8001470 con 0x7fcd000b3d30 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.531+0000 7fcd06650700 1 -- 172.21.15.61:0/684792341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 msgr2=0x7fcd000cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.531+0000 7fcd06650700 1 --2- 172.21.15.61:0/684792341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 0x7fcd000cefa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009e90 tx=0x7fccf8009780 comp rx=0 tx=0).stop 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.531+0000 7fcd06650700 1 -- 172.21.15.61:0/684792341 shutdown_connections 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.531+0000 7fcd06650700 1 --2- 172.21.15.61:0/684792341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 0x7fcd000cefa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.531+0000 7fcd06650700 1 -- 172.21.15.61:0/684792341 >> 172.21.15.61:0/684792341 conn(0x7fcd00097a10 msgr2=0x7fcd000ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:24.534 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.531+0000 7fcd06650700 1 -- 172.21.15.61:0/684792341 shutdown_connections 2023-12-24T20:02:24.534 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.531+0000 7fcd06650700 1 -- 172.21.15.61:0/684792341 wait complete. 2023-12-24T20:02:24.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.532+0000 7fcd06650700 1 Processor -- start 2023-12-24T20:02:24.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.532+0000 7fcd06650700 1 -- start start 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fcd06650700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd00068140 0x7fcd001598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fcd06650700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd00068510 0x7fcd0015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fcd06650700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 0x7fcd0016d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fcd06650700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0015b280 con 0x7fcd00068510 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fcd06650700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0015a1e0 con 0x7fcd00068140 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fcd06650700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0015a4c0 con 0x7fcd000b3d30 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fccff7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd00068510 0x7fcd0015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fccff7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd00068510 0x7fcd0015c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41754/0 (socket says 172.21.15.61:41754) 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fccff7fe700 1 -- 172.21.15.61:0/1936907510 learned_addr learned my addr 172.21.15.61:0/1936907510 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fcd04bed700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 0x7fcd0016d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fccfffff700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd00068140 0x7fcd001598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fccff7fe700 1 -- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 msgr2=0x7fcd0016d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fccff7fe700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 0x7fcd0016d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fccff7fe700 1 -- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd00068140 msgr2=0x7fcd001598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fccff7fe700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd00068140 0x7fcd001598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fccff7fe700 1 -- 172.21.15.61:0/1936907510 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8009a20 con 0x7fcd00068510 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.533+0000 7fccff7fe700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd00068510 0x7fcd0015c770 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fcce800cb70 tx=0x7fcce8001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.534+0000 7fccf7fff700 1 -- 172.21.15.61:0/1936907510 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800ce80 con 0x7fcd00068510 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.534+0000 7fccf7fff700 1 -- 172.21.15.61:0/1936907510 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8007360 con 0x7fcd00068510 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.534+0000 7fccf7fff700 1 -- 172.21.15.61:0/1936907510 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8007700 con 0x7fcd00068510 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.534+0000 7fcd06650700 1 -- 172.21.15.61:0/1936907510 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0015a7a0 con 0x7fcd00068510 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.534+0000 7fcd06650700 1 -- 172.21.15.61:0/1936907510 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0015ade0 con 0x7fcd00068510 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.534+0000 7fcd06650700 1 -- 172.21.15.61:0/1936907510 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0006d440 con 0x7fcd00068510 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.535+0000 7fccf7fff700 1 -- 172.21.15.61:0/1936907510 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcce8004a40 con 0x7fcd00068510 2023-12-24T20:02:24.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.535+0000 7fccf7fff700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcce0066f30 0x7fcce00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.535+0000 7fccf7fff700 1 -- 172.21.15.61:0/1936907510 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcce80839c0 con 0x7fcd00068510 2023-12-24T20:02:24.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.536+0000 7fccfffff700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcce0066f30 0x7fcce00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.536+0000 7fccfffff700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcce0066f30 0x7fcce00693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fccf0007fd0 tx=0x7fccf0007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:24.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.540+0000 7fccf7fff700 1 -- 172.21.15.61:0/1936907510 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcce8050c10 con 0x7fcd00068510 2023-12-24T20:02:24.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.737+0000 7fcd06650700 1 -- 172.21.15.61:0/1936907510 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd0015af70 con 0x7fcd00068510 2023-12-24T20:02:24.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.738+0000 7fccf7fff700 1 -- 172.21.15.61:0/1936907510 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+15365 (secure 0 0 0) 0x7fcce8018020 con 0x7fcd00068510 2023-12-24T20:02:24.739 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:24.739 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":122,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:24.556916+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:21.867619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:22.397630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:24.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 -- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcce0066f30 msgr2=0x7fcce00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcce0066f30 0x7fcce00693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fccf0007fd0 tx=0x7fccf0007d30 comp rx=0 tx=0).stop 2023-12-24T20:02:24.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 -- 172.21.15.61:0/1936907510 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd00068510 msgr2=0x7fcd0015c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd00068510 0x7fcd0015c770 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fcce800cb70 tx=0x7fcce8001b50 comp rx=0 tx=0).stop 2023-12-24T20:02:24.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 -- 172.21.15.61:0/1936907510 shutdown_connections 2023-12-24T20:02:24.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcd000b3d30 0x7fcd0016d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcce0066f30 0x7fcce00693e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd00068140 0x7fcd001598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 --2- 172.21.15.61:0/1936907510 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcd00068510 0x7fcd0015c770 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 -- 172.21.15.61:0/1936907510 >> 172.21.15.61:0/1936907510 conn(0x7fcd00097a10 msgr2=0x7fcd000af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:24.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 -- 172.21.15.61:0/1936907510 shutdown_connections 2023-12-24T20:02:24.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.740+0000 7fcd06650700 1 -- 172.21.15.61:0/1936907510 wait complete. 2023-12-24T20:02:24.753 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T20:02:24.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.877+0000 7f91bae99700 1 Processor -- start 2023-12-24T20:02:24.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.878+0000 7f91bae99700 1 -- start start 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.878+0000 7f91bae99700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91b415afd0 0x7f91b40cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.878+0000 7f91bae99700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40c8c30 con 0x7f91b415ac00 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.878+0000 7f91bae99700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40c7e00 con 0x7f91b40cb3d0 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.878+0000 7f91bae99700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b40cb7c0 con 0x7f91b415afd0 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b8c35700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f91b415ac00 0x7f91b40c76f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:43704/0 (socket says 172.21.15.61:43704) 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b8c35700 1 -- 172.21.15.61:0/4230613547 learned_addr learned my addr 172.21.15.61:0/4230613547 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b3fff700 1 --2- 172.21.15.61:0/4230613547 >> v2:172.21.15.133:3300/0 conn(0x7f91b415afd0 0x7f91b40cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383022474 0 0) 0x7f91b40c8c30 con 0x7f91b415ac00 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a4003570 con 0x7f91b415ac00 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2214513605 0 0) 0x7f91a4003570 con 0x7f91b415ac00 2023-12-24T20:02:24.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 >> v2:172.21.15.133:3300/0 conn(0x7f91b415afd0 msgr2=0x7f91b40cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 --2- 172.21.15.61:0/4230613547 >> v2:172.21.15.133:3300/0 conn(0x7f91b415afd0 0x7f91b40cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 >> v1:172.21.15.133:6789/0 conn(0x7f91b40cb3d0 legacy=0x7f91b40aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40c80b0 con 0x7f91b415ac00 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f91a80015f0 con 0x7f91b415ac00 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 >> v1:172.21.15.61:6789/0 conn(0x7f91b415ac00 legacy=0x7f91b40c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91a4003ab0 0x7f91a4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91a4004810 0x7f91a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91a4005210 0x7f91a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40cb7c0 con 0x7f91a4004810 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a400c1b0 con 0x7f91a4005210 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a400c370 con 0x7f91a4003ab0 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b3fff700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91a4004810 0x7f91a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b8c35700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91a4003ab0 0x7f91a4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.879+0000 7f91b9436700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91a4005210 0x7f91a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b3fff700 1 -- 172.21.15.61:0/4230613547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91a4003ab0 msgr2=0x7f91a4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:24.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b3fff700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91a4003ab0 0x7f91a4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b3fff700 1 -- 172.21.15.61:0/4230613547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91a4005210 msgr2=0x7f91a400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b3fff700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91a4005210 0x7f91a400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b3fff700 1 -- 172.21.15.61:0/4230613547 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a4003570 con 0x7f91a4004810 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b9436700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91a4005210 0x7f91a400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b9436700 1 -- 172.21.15.61:0/4230613547 reap_dead start 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b3fff700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91a4004810 0x7f91a4004c80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009c00 tx=0x7f91a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63258d666037bf6d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000e710 con 0x7f91a4004810 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a000e870 con 0x7f91a4004810 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91b37fe700 1 -- 172.21.15.61:0/4230613547 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000ec30 con 0x7f91a4004810 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91bae99700 1 -- 172.21.15.61:0/4230613547 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91a4004810 msgr2=0x7f91a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91bae99700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91a4004810 0x7f91a4004c80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009c00 tx=0x7f91a00091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91bae99700 1 -- 172.21.15.61:0/4230613547 shutdown_connections 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91bae99700 1 --2- 172.21.15.61:0/4230613547 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91a4004810 0x7f91a4004c80 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91bae99700 1 -- 172.21.15.61:0/4230613547 >> 172.21.15.61:0/4230613547 conn(0x7f91b40cd0b0 msgr2=0x7f91b40cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:24.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.880+0000 7f91bae99700 1 -- 172.21.15.61:0/4230613547 shutdown_connections 2023-12-24T20:02:24.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.881+0000 7f91bae99700 1 -- 172.21.15.61:0/4230613547 wait complete. 2023-12-24T20:02:24.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.882+0000 7f91bae99700 1 Processor -- start 2023-12-24T20:02:24.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.882+0000 7f91bae99700 1 -- start start 2023-12-24T20:02:24.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.882+0000 7f91bae99700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91a4004810 0x7f91b416ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.882+0000 7f91bae99700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91b4150580 0x7f91b40c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.882+0000 7f91bae99700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b41509f0 0x7f91b40c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.882+0000 7f91bae99700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b416b390 con 0x7f91b4150580 2023-12-24T20:02:24.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.882+0000 7f91bae99700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b416dd20 con 0x7f91b41509f0 2023-12-24T20:02:24.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.882+0000 7f91bae99700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b416e000 con 0x7f91a4004810 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91b4150580 0x7f91b40c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91b4150580 0x7f91b40c2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41766/0 (socket says 172.21.15.61:41766) 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b3fff700 1 -- 172.21.15.61:0/4288076847 learned_addr learned my addr 172.21.15.61:0/4288076847 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b3fff700 1 -- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91a4004810 msgr2=0x7f91b416ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b3fff700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91a4004810 0x7f91b416ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b3fff700 1 -- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b41509f0 msgr2=0x7f91b40c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b9436700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b41509f0 0x7f91b40c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b3fff700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b41509f0 0x7f91b40c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b3fff700 1 -- 172.21.15.61:0/4288076847 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b416e2e0 con 0x7f91b4150580 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b9436700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b41509f0 0x7f91b40c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b3fff700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91b4150580 0x7f91b40c2510 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f91a400c180 tx=0x7f91a001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b0ff9700 1 -- 172.21.15.61:0/4288076847 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0022070 con 0x7f91b4150580 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b0ff9700 1 -- 172.21.15.61:0/4288076847 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a000e9e0 con 0x7f91b4150580 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91bae99700 1 -- 172.21.15.61:0/4288076847 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b416e5c0 con 0x7f91b4150580 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91b0ff9700 1 -- 172.21.15.61:0/4288076847 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a001c450 con 0x7f91b4150580 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.883+0000 7f91bae99700 1 -- 172.21.15.61:0/4288076847 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b40ae160 con 0x7f91b4150580 2023-12-24T20:02:24.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.884+0000 7f91bae99700 1 -- 172.21.15.61:0/4288076847 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b404c3c0 con 0x7f91b4150580 2023-12-24T20:02:24.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.885+0000 7f91b0ff9700 1 -- 172.21.15.61:0/4288076847 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f91a001c880 con 0x7f91b4150580 2023-12-24T20:02:24.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.885+0000 7f91b0ff9700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 0x7f91980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:24.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.885+0000 7f91b0ff9700 1 -- 172.21.15.61:0/4288076847 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91a0085cf0 con 0x7f91b4150580 2023-12-24T20:02:24.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.885+0000 7f91b8c35700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 0x7f91980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:24.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.886+0000 7f91b8c35700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 0x7f91980693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f91a8001380 tx=0x7f91a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:24.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:24.889+0000 7f91b0ff9700 1 -- 172.21.15.61:0/4288076847 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91a00530d0 con 0x7f91b4150580 2023-12-24T20:02:25.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:25.133+0000 7f91bae99700 1 -- 172.21.15.61:0/4288076847 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91b40c8390 con 0x7f91b4150580 2023-12-24T20:02:26.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.055+0000 7f91b0ff9700 1 -- 172.21.15.61:0/4288076847 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7f91a0056630 con 0x7f91b4150580 2023-12-24T20:02:26.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.057+0000 7f91bae99700 1 -- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 msgr2=0x7f91980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:26.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.057+0000 7f91bae99700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 0x7f91980693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f91a8001380 tx=0x7f91a8009040 comp rx=0 tx=0).stop 2023-12-24T20:02:26.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.057+0000 7f91bae99700 1 -- 172.21.15.61:0/4288076847 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91b4150580 msgr2=0x7f91b40c2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:26.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.057+0000 7f91bae99700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91b4150580 0x7f91b40c2510 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f91a400c180 tx=0x7f91a001a000 comp rx=0 tx=0).stop 2023-12-24T20:02:26.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.057+0000 7f91bae99700 1 -- 172.21.15.61:0/4288076847 shutdown_connections 2023-12-24T20:02:26.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.057+0000 7f91bae99700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91a4004810 0x7f91b416ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.057+0000 7f91bae99700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 0x7f91980693e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.057+0000 7f91bae99700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b41509f0 0x7f91b40c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.057+0000 7f91bae99700 1 --2- 172.21.15.61:0/4288076847 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91b4150580 0x7f91b40c2510 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.057+0000 7f91bae99700 1 -- 172.21.15.61:0/4288076847 >> 172.21.15.61:0/4288076847 conn(0x7f91b40cd0b0 msgr2=0x7f91b4153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:26.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.058+0000 7f91bae99700 1 -- 172.21.15.61:0/4288076847 shutdown_connections 2023-12-24T20:02:26.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.058+0000 7f91bae99700 1 -- 172.21.15.61:0/4288076847 wait complete. 2023-12-24T20:02:26.073 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T20:02:26.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.203+0000 7f71f8847700 1 Processor -- start 2023-12-24T20:02:26.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.204+0000 7f71f8847700 1 -- start start 2023-12-24T20:02:26.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f8847700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f71f40cdf90 0x7f71f406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:26.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f8847700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4158c50 0x7f71f40cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f8847700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f415bad0 con 0x7f71f40ce360 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f8847700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f41590d0 con 0x7f71f40cdf90 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f8847700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f415bdb0 con 0x7f71f4158c50 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f1d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f71f40ce360 0x7f71f4158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:43706/0 (socket says 172.21.15.61:43706) 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f1d9b700 1 -- 172.21.15.61:0/1396850136 learned_addr learned my addr 172.21.15.61:0/1396850136 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f259c700 1 --2- 172.21.15.61:0/1396850136 >> v2:172.21.15.133:3300/0 conn(0x7f71f40cdf90 0x7f71f406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f2d9d700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4158c50 0x7f71f40cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512385473 0 0) 0x7f71f415bad0 con 0x7f71f40ce360 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e0003570 con 0x7f71f40ce360 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3143355470 0 0) 0x7f71e0003570 con 0x7f71f40ce360 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4158c50 msgr2=0x7f71f40cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4158c50 0x7f71f40cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 >> v2:172.21.15.133:3300/0 conn(0x7f71f40cdf90 msgr2=0x7f71f406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 --2- 172.21.15.61:0/1396850136 >> v2:172.21.15.133:3300/0 conn(0x7f71f40cdf90 0x7f71f406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f415c090 con 0x7f71f40ce360 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f71e4001470 con 0x7f71f40ce360 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 >> v1:172.21.15.61:6789/0 conn(0x7f71f40ce360 legacy=0x7f71f4158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 0x7f71e0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71e0004810 0x7f71e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4158c50 0x7f71e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41590d0 con 0x7f71e0003ae0 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f415bdb0 con 0x7f71e0004810 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.205+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e000bb10 con 0x7f71f4158c50 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f259c700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 0x7f71e0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f1d9b700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71e0004810 0x7f71e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f2d9d700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4158c50 0x7f71e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f259c700 1 -- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4158c50 msgr2=0x7f71e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f259c700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4158c50 0x7f71e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f259c700 1 -- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71e0004810 msgr2=0x7f71e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f259c700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71e0004810 0x7f71e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f259c700 1 -- 172.21.15.61:0/1396850136 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0003570 con 0x7f71e0003ae0 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f2d9d700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4158c50 0x7f71e00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f259c700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 0x7f71e0003ef0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009c00 tx=0x7f71dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0cbde99edf1c26 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00e710 con 0x7f71e0003ae0 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00e870 con 0x7f71e0003ae0 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.206+0000 7f71f159a700 1 -- 172.21.15.61:0/1396850136 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00ec30 con 0x7f71e0003ae0 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.207+0000 7f71f8847700 1 -- 172.21.15.61:0/1396850136 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 msgr2=0x7f71e0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.207+0000 7f71f8847700 1 --2- 172.21.15.61:0/1396850136 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 0x7f71e0003ef0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009c00 tx=0x7f71dc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.207+0000 7f71f2d9d700 1 -- 172.21.15.61:0/1396850136 reap_dead start 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.207+0000 7f71f8847700 1 -- 172.21.15.61:0/1396850136 shutdown_connections 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.207+0000 7f71f8847700 1 -- 172.21.15.61:0/1396850136 >> 172.21.15.61:0/1396850136 conn(0x7f71f406f810 msgr2=0x7f71f406ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.207+0000 7f71f8847700 1 -- 172.21.15.61:0/1396850136 shutdown_connections 2023-12-24T20:02:26.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.207+0000 7f71f8847700 1 -- 172.21.15.61:0/1396850136 wait complete. 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.208+0000 7f71f8847700 1 Processor -- start 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.208+0000 7f71f8847700 1 -- start start 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f8847700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 0x7f71f40b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f8847700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71f4168a30 0x7f71f41570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f8847700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4157620 0x7f71f40c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f8847700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f4157a80 con 0x7f71e0003ae0 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f8847700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40b3c70 con 0x7f71f4168a30 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f8847700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40b3f50 con 0x7f71f4157620 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 0x7f71f40b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 0x7f71f40b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41778/0 (socket says 172.21.15.61:41778) 2023-12-24T20:02:26.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f259c700 1 -- 172.21.15.61:0/1104671521 learned_addr learned my addr 172.21.15.61:0/1104671521 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f2d9d700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4157620 0x7f71f40c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f1d9b700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71f4168a30 0x7f71f41570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f259c700 1 -- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4157620 msgr2=0x7f71f40c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f259c700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4157620 0x7f71f40c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f259c700 1 -- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71f4168a30 msgr2=0x7f71f41570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f259c700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71f4168a30 0x7f71f41570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f259c700 1 -- 172.21.15.61:0/1104671521 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40b4230 con 0x7f71e0003ae0 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f259c700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 0x7f71f40b35d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f71e000ba60 tx=0x7f71dc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71ea7fc700 1 -- 172.21.15.61:0/1104671521 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc022070 con 0x7f71e0003ae0 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71ea7fc700 1 -- 172.21.15.61:0/1104671521 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00e9e0 con 0x7f71e0003ae0 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71f8847700 1 -- 172.21.15.61:0/1104671521 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f40b4510 con 0x7f71e0003ae0 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.209+0000 7f71ea7fc700 1 -- 172.21.15.61:0/1104671521 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc01c450 con 0x7f71e0003ae0 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.210+0000 7f71f8847700 1 -- 172.21.15.61:0/1104671521 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f40c85d0 con 0x7f71e0003ae0 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.210+0000 7f71f8847700 1 -- 172.21.15.61:0/1104671521 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f4157a20 con 0x7f71e0003ae0 2023-12-24T20:02:26.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.211+0000 7f71ea7fc700 1 -- 172.21.15.61:0/1104671521 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f71dc01c8a0 con 0x7f71e0003ae0 2023-12-24T20:02:26.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.211+0000 7f71ea7fc700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71d4066f30 0x7f71d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:26.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.211+0000 7f71ea7fc700 1 -- 172.21.15.61:0/1104671521 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71dc085cc0 con 0x7f71e0003ae0 2023-12-24T20:02:26.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.211+0000 7f71f1d9b700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71d4066f30 0x7f71d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:26.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.212+0000 7f71f1d9b700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71d4066f30 0x7f71d40693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f71e4001660 tx=0x7f71e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:26.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.216+0000 7f71ea7fc700 1 -- 172.21.15.61:0/1104671521 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71f4157a20 con 0x7f71e0003ae0 2023-12-24T20:02:26.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:26.459+0000 7f71f8847700 1 -- 172.21.15.61:0/1104671521 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f71f4157a20 con 0x7f71e0003ae0 2023-12-24T20:02:27.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.057+0000 7f71ea7fc700 1 -- 172.21.15.61:0/1104671521 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v60) v1 ==== 122+0+0 (secure 0 0 0) 0x7f71dc052f70 con 0x7f71e0003ae0 2023-12-24T20:02:27.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.059+0000 7f71f8847700 1 -- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71d4066f30 msgr2=0x7f71d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.059+0000 7f71f8847700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71d4066f30 0x7f71d40693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f71e4001660 tx=0x7f71e4009040 comp rx=0 tx=0).stop 2023-12-24T20:02:27.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.060+0000 7f71f8847700 1 -- 172.21.15.61:0/1104671521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 msgr2=0x7f71f40b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.060+0000 7f71f8847700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 0x7f71f40b35d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f71e000ba60 tx=0x7f71dc01a000 comp rx=0 tx=0).stop 2023-12-24T20:02:27.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.060+0000 7f71f8847700 1 -- 172.21.15.61:0/1104671521 shutdown_connections 2023-12-24T20:02:27.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.060+0000 7f71f8847700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71f4157620 0x7f71f40c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.060+0000 7f71f8847700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f71d4066f30 0x7f71d40693e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.060+0000 7f71f8847700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71e0003ae0 0x7f71f40b35d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.060+0000 7f71f8847700 1 --2- 172.21.15.61:0/1104671521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71f4168a30 0x7f71f41570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.060+0000 7f71f8847700 1 -- 172.21.15.61:0/1104671521 >> 172.21.15.61:0/1104671521 conn(0x7f71f406f810 msgr2=0x7f71f40c39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:27.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.060+0000 7f71f8847700 1 -- 172.21.15.61:0/1104671521 shutdown_connections 2023-12-24T20:02:27.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.060+0000 7f71f8847700 1 -- 172.21.15.61:0/1104671521 wait complete. 2023-12-24T20:02:27.074 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:27.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.198+0000 7fec84453700 1 Processor -- start 2023-12-24T20:02:27.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.198+0000 7fec84453700 1 -- start start 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec84453700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fec7c150cb0 0x7fec7c06ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec84453700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 0x7fec7c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec84453700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7c06f440 con 0x7fec7c151080 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec84453700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c064000 con 0x7fec7c150cb0 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec84453700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c1573b0 con 0x7fec7c06aa70 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec829f0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 0x7fec7c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec821ef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fec7c150cb0 0x7fec7c06ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec829f0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 0x7fec7c06db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:47352/0 (socket says 172.21.15.61:47352) 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec829f0700 1 -- 172.21.15.61:0/1082297601 learned_addr learned my addr 172.21.15.61:0/1082297601 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec821ef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fec7c150cb0 0x7fec7c06ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:39486/0 (socket says 172.21.15.61:39486) 2023-12-24T20:02:27.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.199+0000 7fec819ee700 1 --1- 172.21.15.61:0/1082297601 >> v1:172.21.15.133:6789/0 conn(0x7fec7c151080 0x7fec7c06a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:33246/0 (socket says 172.21.15.61:33246) 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.200+0000 7fec829f0700 1 -- 172.21.15.61:0/1082297601 >> v2:172.21.15.133:3300/0 conn(0x7fec7c150cb0 msgr2=0x7fec7c06ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.200+0000 7fec829f0700 1 --2- 172.21.15.61:0/1082297601 >> v2:172.21.15.133:3300/0 conn(0x7fec7c150cb0 0x7fec7c06ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.200+0000 7fec829f0700 1 -- 172.21.15.61:0/1082297601 >> v1:172.21.15.133:6789/0 conn(0x7fec7c151080 legacy=0x7fec7c06a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.200+0000 7fec829f0700 1 -- 172.21.15.61:0/1082297601 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c157690 con 0x7fec7c06aa70 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.200+0000 7fec821ef700 1 --2- 172.21.15.61:0/1082297601 >> v2:172.21.15.133:3300/0 conn(0x7fec7c150cb0 0x7fec7c06ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.200+0000 7fec829f0700 1 --2- 172.21.15.61:0/1082297601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 0x7fec7c06db10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fec74009f20 tx=0x7fec74009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13b65291fef4ea13 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.200+0000 7fec811ed700 1 -- 172.21.15.61:0/1082297601 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7400e070 con 0x7fec7c06aa70 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.200+0000 7fec811ed700 1 -- 172.21.15.61:0/1082297601 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7400b9d0 con 0x7fec7c06aa70 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.200+0000 7fec811ed700 1 -- 172.21.15.61:0/1082297601 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec740092e0 con 0x7fec7c06aa70 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.201+0000 7fec84453700 1 -- 172.21.15.61:0/1082297601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 msgr2=0x7fec7c06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.201+0000 7fec84453700 1 --2- 172.21.15.61:0/1082297601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 0x7fec7c06db10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fec74009f20 tx=0x7fec74009840 comp rx=0 tx=0).stop 2023-12-24T20:02:27.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.201+0000 7fec84453700 1 -- 172.21.15.61:0/1082297601 shutdown_connections 2023-12-24T20:02:27.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.201+0000 7fec84453700 1 --2- 172.21.15.61:0/1082297601 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 0x7fec7c06db10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.201+0000 7fec84453700 1 --2- 172.21.15.61:0/1082297601 >> v2:172.21.15.133:3300/0 conn(0x7fec7c150cb0 0x7fec7c06ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.201+0000 7fec84453700 1 -- 172.21.15.61:0/1082297601 >> 172.21.15.61:0/1082297601 conn(0x7fec7c0cceb0 msgr2=0x7fec7c0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:27.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.201+0000 7fec84453700 1 -- 172.21.15.61:0/1082297601 shutdown_connections 2023-12-24T20:02:27.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.201+0000 7fec84453700 1 -- 172.21.15.61:0/1082297601 wait complete. 2023-12-24T20:02:27.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.202+0000 7fec84453700 1 Processor -- start 2023-12-24T20:02:27.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.202+0000 7fec84453700 1 -- start start 2023-12-24T20:02:27.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec84453700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 0x7fec7c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec84453700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec7c150cb0 0x7fec7c0b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec84453700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec7c151080 0x7fec7c149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec84453700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c159e10 con 0x7fec7c150cb0 2023-12-24T20:02:27.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec84453700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0b2d60 con 0x7fec7c151080 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec84453700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c149f50 con 0x7fec7c06aa70 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec819ee700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec7c150cb0 0x7fec7c0b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec819ee700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec7c150cb0 0x7fec7c0b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54402/0 (socket says 172.21.15.61:54402) 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec829f0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec7c151080 0x7fec7c149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec819ee700 1 -- 172.21.15.61:0/2058284265 learned_addr learned my addr 172.21.15.61:0/2058284265 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec821ef700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 0x7fec7c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec819ee700 1 -- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 msgr2=0x7fec7c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec819ee700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 0x7fec7c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec819ee700 1 -- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec7c151080 msgr2=0x7fec7c149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec819ee700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec7c151080 0x7fec7c149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec819ee700 1 -- 172.21.15.61:0/2058284265 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c009420 con 0x7fec7c150cb0 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.203+0000 7fec819ee700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec7c150cb0 0x7fec7c0b2820 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fec78001eb0 tx=0x7fec78007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.204+0000 7fec727fc700 1 -- 172.21.15.61:0/2058284265 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec78005a70 con 0x7fec7c150cb0 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.204+0000 7fec727fc700 1 -- 172.21.15.61:0/2058284265 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec78005bd0 con 0x7fec7c150cb0 2023-12-24T20:02:27.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.204+0000 7fec84453700 1 -- 172.21.15.61:0/2058284265 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec74009ae0 con 0x7fec7c150cb0 2023-12-24T20:02:27.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.204+0000 7fec727fc700 1 -- 172.21.15.61:0/2058284265 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780070d0 con 0x7fec7c150cb0 2023-12-24T20:02:27.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.204+0000 7fec84453700 1 -- 172.21.15.61:0/2058284265 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c15a3c0 con 0x7fec7c150cb0 2023-12-24T20:02:27.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.205+0000 7fec84453700 1 -- 172.21.15.61:0/2058284265 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7c04c3c0 con 0x7fec7c150cb0 2023-12-24T20:02:27.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.205+0000 7fec727fc700 1 -- 172.21.15.61:0/2058284265 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fec78007480 con 0x7fec7c150cb0 2023-12-24T20:02:27.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.205+0000 7fec727fc700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec60066f30 0x7fec600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.206+0000 7fec727fc700 1 -- 172.21.15.61:0/2058284265 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec780836d0 con 0x7fec7c150cb0 2023-12-24T20:02:27.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.206+0000 7fec821ef700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec60066f30 0x7fec600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.206+0000 7fec821ef700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec60066f30 0x7fec600693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009f40 tx=0x7fec6c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:27.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.210+0000 7fec727fc700 1 -- 172.21.15.61:0/2058284265 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec78050940 con 0x7fec7c150cb0 2023-12-24T20:02:27.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.448+0000 7fec84453700 1 -- 172.21.15.61:0/2058284265 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec7c06f440 con 0x7fec7c150cb0 2023-12-24T20:02:27.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.449+0000 7fec727fc700 1 -- 172.21.15.61:0/2058284265 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fec7c06f440 con 0x7fec7c150cb0 2023-12-24T20:02:27.449 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:27.450 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2890522920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2890522920},{"type":"v1","addr":"172.21.15.133:6836","nonce":2890522920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/946349829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":946349829},{"type":"v1","addr":"172.21.15.133:6837","nonce":946349829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3897383544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3897383544},{"type":"v1","addr":"172.21.15.61:6834","nonce":3897383544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:23.422714+0000","modified":"2023-12-24T20:02:27.054403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/447554724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":447554724},{"type":"v1","addr":"172.21.15.61:6835","nonce":447554724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 -- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec60066f30 msgr2=0x7fec600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec60066f30 0x7fec600693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009f40 tx=0x7fec6c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 -- 172.21.15.61:0/2058284265 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec7c150cb0 msgr2=0x7fec7c0b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec7c150cb0 0x7fec7c0b2820 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fec78001eb0 tx=0x7fec78007f40 comp rx=0 tx=0).stop 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 -- 172.21.15.61:0/2058284265 shutdown_connections 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fec7c06aa70 0x7fec7c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fec60066f30 0x7fec600693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec7c151080 0x7fec7c149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 --2- 172.21.15.61:0/2058284265 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec7c150cb0 0x7fec7c0b2820 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 -- 172.21.15.61:0/2058284265 >> 172.21.15.61:0/2058284265 conn(0x7fec7c0cceb0 msgr2=0x7fec7c0c1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 -- 172.21.15.61:0/2058284265 shutdown_connections 2023-12-24T20:02:27.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.451+0000 7fec84453700 1 -- 172.21.15.61:0/2058284265 wait complete. 2023-12-24T20:02:27.453 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 60 2023-12-24T20:02:27.464 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:27.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.585+0000 7f1762427700 1 Processor -- start 2023-12-24T20:02:27.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.585+0000 7f1762427700 1 -- start start 2023-12-24T20:02:27.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f1762427700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f175c159850 0x7f175c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f1762427700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c06a630 con 0x7f175c06aac0 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f1762427700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c069d00 con 0x7f175c0caa80 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f1762427700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0cccf0 con 0x7f175c159850 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f175b7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f175c06aac0 0x7f175c0cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33796/0 (socket says 172.21.15.61:33796) 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f175b7fe700 1 -- 172.21.15.61:0/2902082877 learned_addr learned my addr 172.21.15.61:0/2902082877 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f175bfff700 1 --2- 172.21.15.61:0/2902082877 >> v2:172.21.15.133:3300/0 conn(0x7f175c159850 0x7f175c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f175affd700 1 -- 172.21.15.61:0/2902082877 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486498109 0 0) 0x7f175c06a630 con 0x7f175c06aac0 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f175affd700 1 -- 172.21.15.61:0/2902082877 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1744003570 con 0x7f175c06aac0 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f175affd700 1 -- 172.21.15.61:0/2902082877 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4249107406 0 0) 0x7f1744003570 con 0x7f175c06aac0 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f175bfff700 1 -- 172.21.15.61:0/2902082877 >> v1:172.21.15.133:6789/0 conn(0x7f175c0caa80 legacy=0x7f175c0aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f175bfff700 1 -- 172.21.15.61:0/2902082877 >> v1:172.21.15.61:6789/0 conn(0x7f175c06aac0 legacy=0x7f175c0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.586+0000 7f175bfff700 1 -- 172.21.15.61:0/2902082877 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c069fe0 con 0x7f175c159850 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f175bfff700 1 --2- 172.21.15.61:0/2902082877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c159850 0x7f175c159c20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f174c0098e0 tx=0x7f174c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf77108e65e719fd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:27.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f175affd700 1 -- 172.21.15.61:0/2902082877 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750001470 con 0x7f175c159850 2023-12-24T20:02:27.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f175affd700 1 -- 172.21.15.61:0/2902082877 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c011420 con 0x7f175c159850 2023-12-24T20:02:27.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f175affd700 1 -- 172.21.15.61:0/2902082877 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c0117c0 con 0x7f175c159850 2023-12-24T20:02:27.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f1762427700 1 -- 172.21.15.61:0/2902082877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c159850 msgr2=0x7f175c159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f1762427700 1 --2- 172.21.15.61:0/2902082877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c159850 0x7f175c159c20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f174c0098e0 tx=0x7f174c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f1762427700 1 -- 172.21.15.61:0/2902082877 shutdown_connections 2023-12-24T20:02:27.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f1762427700 1 --2- 172.21.15.61:0/2902082877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c159850 0x7f175c159c20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f1762427700 1 -- 172.21.15.61:0/2902082877 >> 172.21.15.61:0/2902082877 conn(0x7f175c0cceb0 msgr2=0x7f175c0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:27.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f1762427700 1 -- 172.21.15.61:0/2902082877 shutdown_connections 2023-12-24T20:02:27.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.587+0000 7f1762427700 1 -- 172.21.15.61:0/2902082877 wait complete. 2023-12-24T20:02:27.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.588+0000 7f1762427700 1 Processor -- start 2023-12-24T20:02:27.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.589+0000 7f1762427700 1 -- start start 2023-12-24T20:02:27.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.589+0000 7f1762427700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f175c06aac0 0x7f175c144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.589+0000 7f1762427700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c0caa80 0x7f175c15ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.589+0000 7f1762427700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159850 0x7f175c1604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.589+0000 7f1762427700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c169fc0 con 0x7f175c06aac0 2023-12-24T20:02:27.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.589+0000 7f1762427700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c16a280 con 0x7f175c0caa80 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.589+0000 7f1762427700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c16a560 con 0x7f175c159850 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.589+0000 7f175bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f175c06aac0 0x7f175c144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.589+0000 7f175bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f175c06aac0 0x7f175c144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54414/0 (socket says 172.21.15.61:54414) 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f175bfff700 1 -- 172.21.15.61:0/2673638881 learned_addr learned my addr 172.21.15.61:0/2673638881 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f175b7fe700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c0caa80 0x7f175c15ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f17609c4700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159850 0x7f175c1604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f175bfff700 1 -- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159850 msgr2=0x7f175c1604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f175bfff700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159850 0x7f175c1604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f175bfff700 1 -- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c0caa80 msgr2=0x7f175c15ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f175bfff700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c0caa80 0x7f175c15ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f175bfff700 1 -- 172.21.15.61:0/2673638881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c009420 con 0x7f175c06aac0 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f175b7fe700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c0caa80 0x7f175c15ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f17609c4700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159850 0x7f175c1604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f175bfff700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f175c06aac0 0x7f175c144ad0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f175c06c4b0 tx=0x7f174c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:27.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f1743fff700 1 -- 172.21.15.61:0/2673638881 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c010c20 con 0x7f175c06aac0 2023-12-24T20:02:27.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f1743fff700 1 -- 172.21.15.61:0/2673638881 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c010d80 con 0x7f175c06aac0 2023-12-24T20:02:27.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f1762427700 1 -- 172.21.15.61:0/2673638881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175c16a840 con 0x7f175c06aac0 2023-12-24T20:02:27.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f1743fff700 1 -- 172.21.15.61:0/2673638881 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c01d680 con 0x7f175c06aac0 2023-12-24T20:02:27.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.590+0000 7f1762427700 1 -- 172.21.15.61:0/2673638881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c15bbb0 con 0x7f175c06aac0 2023-12-24T20:02:27.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.591+0000 7f1762427700 1 -- 172.21.15.61:0/2673638881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c16ace0 con 0x7f175c06aac0 2023-12-24T20:02:27.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.592+0000 7f1743fff700 1 -- 172.21.15.61:0/2673638881 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f174c01da30 con 0x7f175c06aac0 2023-12-24T20:02:27.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.592+0000 7f1743fff700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1748066f30 0x7f17480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.592+0000 7f1743fff700 1 -- 172.21.15.61:0/2673638881 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f174c086280 con 0x7f175c06aac0 2023-12-24T20:02:27.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.592+0000 7f175b7fe700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1748066f30 0x7f17480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.593+0000 7f175b7fe700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1748066f30 0x7f17480693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f175c06eaf0 tx=0x7f1750009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:27.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.596+0000 7f1743fff700 1 -- 172.21.15.61:0/2673638881 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f174c0534f0 con 0x7f175c06aac0 2023-12-24T20:02:27.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.792+0000 7f1762427700 1 -- 172.21.15.61:0/2673638881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f175c04c3c0 con 0x7f175c06aac0 2023-12-24T20:02:27.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.792+0000 7f1743fff700 1 -- 172.21.15.61:0/2673638881 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f174c056b10 con 0x7f175c06aac0 2023-12-24T20:02:27.793 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:27.793 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":122,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:24.556916+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:21.867619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:22.397630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 -- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1748066f30 msgr2=0x7f17480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1748066f30 0x7f17480693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f175c06eaf0 tx=0x7f1750009040 comp rx=0 tx=0).stop 2023-12-24T20:02:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 -- 172.21.15.61:0/2673638881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f175c06aac0 msgr2=0x7f175c144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f175c06aac0 0x7f175c144ad0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f175c06c4b0 tx=0x7f174c017000 comp rx=0 tx=0).stop 2023-12-24T20:02:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 -- 172.21.15.61:0/2673638881 shutdown_connections 2023-12-24T20:02:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f175c159850 0x7f175c1604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1748066f30 0x7f17480693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f175c06aac0 0x7f175c144ad0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 --2- 172.21.15.61:0/2673638881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f175c0caa80 0x7f175c15ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 -- 172.21.15.61:0/2673638881 >> 172.21.15.61:0/2673638881 conn(0x7f175c0cceb0 msgr2=0x7f175c06e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.794+0000 7f1762427700 1 -- 172.21.15.61:0/2673638881 shutdown_connections 2023-12-24T20:02:27.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.795+0000 7f1762427700 1 -- 172.21.15.61:0/2673638881 wait complete. 2023-12-24T20:02:27.807 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T20:02:27.807 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:02:27.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.928+0000 7f880c817700 1 Processor -- start 2023-12-24T20:02:27.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.928+0000 7f880c817700 1 -- start start 2023-12-24T20:02:27.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.929+0000 7f880c817700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88080afee0 0x7f8808067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.929+0000 7f880c817700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8808070640 0x7f8808070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.929+0000 7f880c817700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080a84d0 con 0x7f8808159b00 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.929+0000 7f880c817700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8808070fd0 con 0x7f88080afee0 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.929+0000 7f880c817700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88080a7620 con 0x7f8808070640 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.929+0000 7f8805d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88080afee0 0x7f8808067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f8805d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88080afee0 0x7f8808067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54416/0 (socket says 172.21.15.61:54416) 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f8805d9b700 1 -- 172.21.15.61:0/838064691 learned_addr learned my addr 172.21.15.61:0/838064691 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f8806d9d700 1 --2- 172.21.15.61:0/838064691 >> v2:172.21.15.133:3300/0 conn(0x7f8808070640 0x7f8808070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f8805d9b700 1 -- 172.21.15.61:0/838064691 >> v2:172.21.15.133:3300/0 conn(0x7f8808070640 msgr2=0x7f8808070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f8805d9b700 1 --2- 172.21.15.61:0/838064691 >> v2:172.21.15.133:3300/0 conn(0x7f8808070640 0x7f8808070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f8805d9b700 1 -- 172.21.15.61:0/838064691 >> v1:172.21.15.133:6789/0 conn(0x7f8808159b00 legacy=0x7f88080af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f8805d9b700 1 -- 172.21.15.61:0/838064691 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080a78c0 con 0x7f88080afee0 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f8806d9d700 1 --2- 172.21.15.61:0/838064691 >> v2:172.21.15.133:3300/0 conn(0x7f8808070640 0x7f8808070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f8805d9b700 1 --2- 172.21.15.61:0/838064691 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 0x7f8808067550 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8808069040 tx=0x7f87fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12461c0f28a01dbb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f880559a700 1 -- 172.21.15.61:0/838064691 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00b820 con 0x7f88080afee0 2023-12-24T20:02:27.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f880559a700 1 -- 172.21.15.61:0/838064691 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00b980 con 0x7f88080afee0 2023-12-24T20:02:27.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.930+0000 7f880559a700 1 -- 172.21.15.61:0/838064691 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00bd20 con 0x7f88080afee0 2023-12-24T20:02:27.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.931+0000 7f880c817700 1 -- 172.21.15.61:0/838064691 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 msgr2=0x7f8808067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.931+0000 7f880c817700 1 --2- 172.21.15.61:0/838064691 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 0x7f8808067550 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8808069040 tx=0x7f87fc009250 comp rx=0 tx=0).stop 2023-12-24T20:02:27.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.931+0000 7f880c817700 1 -- 172.21.15.61:0/838064691 shutdown_connections 2023-12-24T20:02:27.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.931+0000 7f880c817700 1 --2- 172.21.15.61:0/838064691 >> v2:172.21.15.133:3300/0 conn(0x7f8808070640 0x7f8808070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.931+0000 7f880c817700 1 --2- 172.21.15.61:0/838064691 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 0x7f8808067550 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.931+0000 7f880c817700 1 -- 172.21.15.61:0/838064691 >> 172.21.15.61:0/838064691 conn(0x7f88080ca200 msgr2=0x7f88080ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:27.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.931+0000 7f880c817700 1 -- 172.21.15.61:0/838064691 shutdown_connections 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.931+0000 7f880c817700 1 -- 172.21.15.61:0/838064691 wait complete. 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.932+0000 7f880c817700 1 Processor -- start 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.932+0000 7f880c817700 1 -- start start 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f880c817700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8808070640 0x7f880815f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f880c817700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 0x7f880815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f880c817700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808159b00 0x7f88081451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f880c817700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080cc160 con 0x7f88080afee0 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f880c817700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880815db50 con 0x7f8808159b00 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f880c817700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880815ddb0 con 0x7f8808070640 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f8805d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 0x7f880815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f8805d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 0x7f880815d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54420/0 (socket says 172.21.15.61:54420) 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f8805d9b700 1 -- 172.21.15.61:0/2759218972 learned_addr learned my addr 172.21.15.61:0/2759218972 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f880659c700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8808070640 0x7f880815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f8806d9d700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808159b00 0x7f88081451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f8805d9b700 1 -- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8808070640 msgr2=0x7f880815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f8805d9b700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8808070640 0x7f880815f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f8805d9b700 1 -- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808159b00 msgr2=0x7f88081451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:27.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f8805d9b700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808159b00 0x7f88081451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:27.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f8805d9b700 1 -- 172.21.15.61:0/2759218972 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0094f0 con 0x7f88080afee0 2023-12-24T20:02:27.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f880659c700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8808070640 0x7f880815f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:27.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f8805d9b700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 0x7f880815d610 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f880806c750 tx=0x7f87fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:27.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f87f67fc700 1 -- 172.21.15.61:0/2759218972 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc011e20 con 0x7f88080afee0 2023-12-24T20:02:27.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f87f67fc700 1 -- 172.21.15.61:0/2759218972 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc01b680 con 0x7f88080afee0 2023-12-24T20:02:27.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f880c817700 1 -- 172.21.15.61:0/2759218972 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88080cb830 con 0x7f88080afee0 2023-12-24T20:02:27.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f87f67fc700 1 -- 172.21.15.61:0/2759218972 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc01ba40 con 0x7f88080afee0 2023-12-24T20:02:27.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.933+0000 7f880c817700 1 -- 172.21.15.61:0/2759218972 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88080cbdf0 con 0x7f88080afee0 2023-12-24T20:02:27.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.934+0000 7f880c817700 1 -- 172.21.15.61:0/2759218972 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88080cafb0 con 0x7f88080afee0 2023-12-24T20:02:27.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.935+0000 7f87f67fc700 1 -- 172.21.15.61:0/2759218972 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f87fc01c450 con 0x7f88080afee0 2023-12-24T20:02:27.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.935+0000 7f87f67fc700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f87e8066f30 0x7f87e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:27.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.935+0000 7f87f67fc700 1 -- 172.21.15.61:0/2759218972 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87fc086250 con 0x7f88080afee0 2023-12-24T20:02:27.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.935+0000 7f880659c700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f87e8066f30 0x7f87e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:27.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.936+0000 7f880659c700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f87e8066f30 0x7f87e80693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f87f8006fd0 tx=0x7f87f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:27.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:27.940+0000 7f87f67fc700 1 -- 172.21.15.61:0/2759218972 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87fc0534c0 con 0x7f88080afee0 2023-12-24T20:02:28.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.132+0000 7f880c817700 1 -- 172.21.15.61:0/2759218972 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f880804c3c0 con 0x7f87e8066f30 2023-12-24T20:02:28.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.141+0000 7f87f67fc700 1 -- 172.21.15.61:0/2759218972 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285516 (secure 0 0 0) 0x7f880804c3c0 con 0x7f87e8066f30 2023-12-24T20:02:28.145 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:28.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.144+0000 7f880c817700 1 -- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f87e8066f30 msgr2=0x7f87e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.144+0000 7f880c817700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f87e8066f30 0x7f87e80693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f87f8006fd0 tx=0x7f87f8008040 comp rx=0 tx=0).stop 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.144+0000 7f880c817700 1 -- 172.21.15.61:0/2759218972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 msgr2=0x7f880815d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.144+0000 7f880c817700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 0x7f880815d610 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f880806c750 tx=0x7f87fc016000 comp rx=0 tx=0).stop 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.144+0000 7f880c817700 1 -- 172.21.15.61:0/2759218972 shutdown_connections 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.145+0000 7f880c817700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8808070640 0x7f880815f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.145+0000 7f880c817700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f87e8066f30 0x7f87e80693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.145+0000 7f880c817700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8808159b00 0x7f88081451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.145+0000 7f880c817700 1 --2- 172.21.15.61:0/2759218972 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88080afee0 0x7f880815d610 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.145+0000 7f880c817700 1 -- 172.21.15.61:0/2759218972 >> 172.21.15.61:0/2759218972 conn(0x7f88080ca200 msgr2=0x7f88080ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.145+0000 7f880c817700 1 -- 172.21.15.61:0/2759218972 shutdown_connections 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.145+0000 7f880c817700 1 -- 172.21.15.61:0/2759218972 wait complete. 2023-12-24T20:02:28.148 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:02:28.157 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2023-12-24T20:02:26.385618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6354,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556145,"statfs":{"total":1600000000,"available":1593493476,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.369372"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569198+0000","last_change":"2023-12-24T20:02:23.569139+0000","last_active":"2023-12-24T20:02:23.569198+0000","last_peered":"2023-12-24T20:02:23.569198+0000","last_clean":"2023-12-24T20:02:23.569198+0000","last_became_active":"2023-12-24T20:02:23.568917+0000","last_became_peered":"2023-12-24T20:02:23.568917+0000","last_unstale":"2023-12-24T20:02:23.569198+0000","last_undegraded":"2023-12-24T20:02:23.569198+0000","last_fullsized":"2023-12-24T20:02:23.569198+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:54.691218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.563386+0000","last_change":"2023-12-24T20:02:23.563319+0000","last_active":"2023-12-24T20:02:23.563386+0000","last_peered":"2023-12-24T20:02:23.563386+0000","last_clean":"2023-12-24T20:02:23.563386+0000","last_became_active":"2023-12-24T20:02:23.562800+0000","last_became_peered":"2023-12-24T20:02:23.562800+0000","last_unstale":"2023-12-24T20:02:23.563386+0000","last_undegraded":"2023-12-24T20:02:23.563386+0000","last_fullsized":"2023-12-24T20:02:23.563386+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:26.596303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568193+0000","last_change":"2023-12-24T20:02:23.568135+0000","last_active":"2023-12-24T20:02:23.568193+0000","last_peered":"2023-12-24T20:02:23.568193+0000","last_clean":"2023-12-24T20:02:23.568193+0000","last_became_active":"2023-12-24T20:02:23.567913+0000","last_became_peered":"2023-12-24T20:02:23.567913+0000","last_unstale":"2023-12-24T20:02:23.568193+0000","last_undegraded":"2023-12-24T20:02:23.568193+0000","last_fullsized":"2023-12-24T20:02:23.568193+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:21:34.811234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569269+0000","last_change":"2023-12-24T20:02:23.569269+0000","last_active":"2023-12-24T20:02:23.569269+0000","last_peered":"2023-12-24T20:02:23.569269+0000","last_clean":"2023-12-24T20:02:23.569269+0000","last_became_active":"2023-12-24T20:02:23.569066+0000","last_became_peered":"2023-12-24T20:02:23.569066+0000","last_unstale":"2023-12-24T20:02:23.569269+0000","last_undegraded":"2023-12-24T20:02:23.569269+0000","last_fullsized":"2023-12-24T20:02:23.569269+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:52.075459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569906+0000","last_change":"2023-12-24T20:02:23.569843+0000","last_active":"2023-12-24T20:02:23.569906+0000","last_peered":"2023-12-24T20:02:23.569906+0000","last_clean":"2023-12-24T20:02:23.569906+0000","last_became_active":"2023-12-24T20:02:23.569630+0000","last_became_peered":"2023-12-24T20:02:23.569630+0000","last_unstale":"2023-12-24T20:02:23.569906+0000","last_undegraded":"2023-12-24T20:02:23.569906+0000","last_fullsized":"2023-12-24T20:02:23.569906+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:28:24.326359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.573707+0000","last_change":"2023-12-24T20:02:23.573707+0000","last_active":"2023-12-24T20:02:23.573707+0000","last_peered":"2023-12-24T20:02:23.573707+0000","last_clean":"2023-12-24T20:02:23.573707+0000","last_became_active":"2023-12-24T20:02:23.573457+0000","last_became_peered":"2023-12-24T20:02:23.573457+0000","last_unstale":"2023-12-24T20:02:23.573707+0000","last_undegraded":"2023-12-24T20:02:23.573707+0000","last_fullsized":"2023-12-24T20:02:23.573707+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:54:59.084379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568107+0000","last_change":"2023-12-24T20:02:23.568107+0000","last_active":"2023-12-24T20:02:23.568107+0000","last_peered":"2023-12-24T20:02:23.568107+0000","last_clean":"2023-12-24T20:02:23.568107+0000","last_became_active":"2023-12-24T20:02:23.567875+0000","last_became_peered":"2023-12-24T20:02:23.567875+0000","last_unstale":"2023-12-24T20:02:23.568107+0000","last_undegraded":"2023-12-24T20:02:23.568107+0000","last_fullsized":"2023-12-24T20:02:23.568107+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:41.317326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569565+0000","last_change":"2023-12-24T20:02:23.569507+0000","last_active":"2023-12-24T20:02:23.569565+0000","last_peered":"2023-12-24T20:02:23.569565+0000","last_clean":"2023-12-24T20:02:23.569565+0000","last_became_active":"2023-12-24T20:02:23.569194+0000","last_became_peered":"2023-12-24T20:02:23.569194+0000","last_unstale":"2023-12-24T20:02:23.569565+0000","last_undegraded":"2023-12-24T20:02:23.569565+0000","last_fullsized":"2023-12-24T20:02:23.569565+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:01:20.708433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570579+0000","last_change":"2023-12-24T20:02:23.570460+0000","last_active":"2023-12-24T20:02:23.570579+0000","last_peered":"2023-12-24T20:02:23.570579+0000","last_clean":"2023-12-24T20:02:23.570579+0000","last_became_active":"2023-12-24T20:02:23.569983+0000","last_became_peered":"2023-12-24T20:02:23.569983+0000","last_unstale":"2023-12-24T20:02:23.570579+0000","last_undegraded":"2023-12-24T20:02:23.570579+0000","last_fullsized":"2023-12-24T20:02:23.570579+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:06:04.064643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568086+0000","last_change":"2023-12-24T20:02:23.568020+0000","last_active":"2023-12-24T20:02:23.568086+0000","last_peered":"2023-12-24T20:02:23.568086+0000","last_clean":"2023-12-24T20:02:23.568086+0000","last_became_active":"2023-12-24T20:02:23.567713+0000","last_became_peered":"2023-12-24T20:02:23.567713+0000","last_unstale":"2023-12-24T20:02:23.568086+0000","last_undegraded":"2023-12-24T20:02:23.568086+0000","last_fullsized":"2023-12-24T20:02:23.568086+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:53.703650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571316+0000","last_change":"2023-12-24T20:02:23.571316+0000","last_active":"2023-12-24T20:02:23.571316+0000","last_peered":"2023-12-24T20:02:23.571316+0000","last_clean":"2023-12-24T20:02:23.571316+0000","last_became_active":"2023-12-24T20:02:23.570561+0000","last_became_peered":"2023-12-24T20:02:23.570561+0000","last_unstale":"2023-12-24T20:02:23.571316+0000","last_undegraded":"2023-12-24T20:02:23.571316+0000","last_fullsized":"2023-12-24T20:02:23.571316+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:24.429255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568903+0000","last_change":"2023-12-24T20:02:23.568736+0000","last_active":"2023-12-24T20:02:23.568903+0000","last_peered":"2023-12-24T20:02:23.568903+0000","last_clean":"2023-12-24T20:02:23.568903+0000","last_became_active":"2023-12-24T20:02:23.568545+0000","last_became_peered":"2023-12-24T20:02:23.568545+0000","last_unstale":"2023-12-24T20:02:23.568903+0000","last_undegraded":"2023-12-24T20:02:23.568903+0000","last_fullsized":"2023-12-24T20:02:23.568903+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:41.645930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569936+0000","last_change":"2023-12-24T20:02:23.569936+0000","last_active":"2023-12-24T20:02:23.569936+0000","last_peered":"2023-12-24T20:02:23.569936+0000","last_clean":"2023-12-24T20:02:23.569936+0000","last_became_active":"2023-12-24T20:02:23.569768+0000","last_became_peered":"2023-12-24T20:02:23.569768+0000","last_unstale":"2023-12-24T20:02:23.569936+0000","last_undegraded":"2023-12-24T20:02:23.569936+0000","last_fullsized":"2023-12-24T20:02:23.569936+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:04:35.842656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.567027+0000","last_change":"2023-12-24T20:02:23.567027+0000","last_active":"2023-12-24T20:02:23.567027+0000","last_peered":"2023-12-24T20:02:23.567027+0000","last_clean":"2023-12-24T20:02:23.567027+0000","last_became_active":"2023-12-24T20:02:23.566685+0000","last_became_peered":"2023-12-24T20:02:23.566685+0000","last_unstale":"2023-12-24T20:02:23.567027+0000","last_undegraded":"2023-12-24T20:02:23.567027+0000","last_fullsized":"2023-12-24T20:02:23.567027+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:54.691218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569108+0000","last_change":"2023-12-24T20:02:23.569108+0000","last_active":"2023-12-24T20:02:23.569108+0000","last_peered":"2023-12-24T20:02:23.569108+0000","last_clean":"2023-12-24T20:02:23.569108+0000","last_became_active":"2023-12-24T20:02:23.568392+0000","last_became_peered":"2023-12-24T20:02:23.568392+0000","last_unstale":"2023-12-24T20:02:23.569108+0000","last_undegraded":"2023-12-24T20:02:23.569108+0000","last_fullsized":"2023-12-24T20:02:23.569108+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:24.429255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.573209+0000","last_change":"2023-12-24T20:02:23.573209+0000","last_active":"2023-12-24T20:02:23.573209+0000","last_peered":"2023-12-24T20:02:23.573209+0000","last_clean":"2023-12-24T20:02:23.573209+0000","last_became_active":"2023-12-24T20:02:23.572935+0000","last_became_peered":"2023-12-24T20:02:23.572935+0000","last_unstale":"2023-12-24T20:02:23.573209+0000","last_undegraded":"2023-12-24T20:02:23.573209+0000","last_fullsized":"2023-12-24T20:02:23.573209+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:47.887151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570918+0000","last_change":"2023-12-24T20:02:23.570855+0000","last_active":"2023-12-24T20:02:23.570918+0000","last_peered":"2023-12-24T20:02:23.570918+0000","last_clean":"2023-12-24T20:02:23.570918+0000","last_became_active":"2023-12-24T20:02:23.570711+0000","last_became_peered":"2023-12-24T20:02:23.570711+0000","last_unstale":"2023-12-24T20:02:23.570918+0000","last_undegraded":"2023-12-24T20:02:23.570918+0000","last_fullsized":"2023-12-24T20:02:23.570918+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:07:01.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.573430+0000","last_change":"2023-12-24T20:02:23.573430+0000","last_active":"2023-12-24T20:02:23.573430+0000","last_peered":"2023-12-24T20:02:23.573430+0000","last_clean":"2023-12-24T20:02:23.573430+0000","last_became_active":"2023-12-24T20:02:23.573184+0000","last_became_peered":"2023-12-24T20:02:23.573184+0000","last_unstale":"2023-12-24T20:02:23.573430+0000","last_undegraded":"2023-12-24T20:02:23.573430+0000","last_fullsized":"2023-12-24T20:02:23.573430+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:10:36.193427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.566864+0000","last_change":"2023-12-24T20:02:23.566864+0000","last_active":"2023-12-24T20:02:23.566864+0000","last_peered":"2023-12-24T20:02:23.566864+0000","last_clean":"2023-12-24T20:02:23.566864+0000","last_became_active":"2023-12-24T20:02:23.566374+0000","last_became_peered":"2023-12-24T20:02:23.566374+0000","last_unstale":"2023-12-24T20:02:23.566864+0000","last_undegraded":"2023-12-24T20:02:23.566864+0000","last_fullsized":"2023-12-24T20:02:23.566864+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:40.781529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571841+0000","last_change":"2023-12-24T20:02:23.571302+0000","last_active":"2023-12-24T20:02:23.571841+0000","last_peered":"2023-12-24T20:02:23.571841+0000","last_clean":"2023-12-24T20:02:23.571841+0000","last_became_active":"2023-12-24T20:02:23.571074+0000","last_became_peered":"2023-12-24T20:02:23.571074+0000","last_unstale":"2023-12-24T20:02:23.571841+0000","last_undegraded":"2023-12-24T20:02:23.571841+0000","last_fullsized":"2023-12-24T20:02:23.571841+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:22.864773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.560703+0000","last_change":"2023-12-24T20:02:23.560703+0000","last_active":"2023-12-24T20:02:23.560703+0000","last_peered":"2023-12-24T20:02:23.560703+0000","last_clean":"2023-12-24T20:02:23.560703+0000","last_became_active":"2023-12-24T20:02:23.560536+0000","last_became_peered":"2023-12-24T20:02:23.560536+0000","last_unstale":"2023-12-24T20:02:23.560703+0000","last_undegraded":"2023-12-24T20:02:23.560703+0000","last_fullsized":"2023-12-24T20:02:23.560703+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:29:52.658393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.563519+0000","last_change":"2023-12-24T20:02:23.563459+0000","last_active":"2023-12-24T20:02:23.563519+0000","last_peered":"2023-12-24T20:02:23.563519+0000","last_clean":"2023-12-24T20:02:23.563519+0000","last_became_active":"2023-12-24T20:02:23.563100+0000","last_became_peered":"2023-12-24T20:02:23.563100+0000","last_unstale":"2023-12-24T20:02:23.563519+0000","last_undegraded":"2023-12-24T20:02:23.563519+0000","last_fullsized":"2023-12-24T20:02:23.563519+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:08:44.638549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.563538+0000","last_change":"2023-12-24T20:02:23.563470+0000","last_active":"2023-12-24T20:02:23.563538+0000","last_peered":"2023-12-24T20:02:23.563538+0000","last_clean":"2023-12-24T20:02:23.563538+0000","last_became_active":"2023-12-24T20:02:23.563115+0000","last_became_peered":"2023-12-24T20:02:23.563115+0000","last_unstale":"2023-12-24T20:02:23.563538+0000","last_undegraded":"2023-12-24T20:02:23.563538+0000","last_fullsized":"2023-12-24T20:02:23.563538+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:14:26.335698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571847+0000","last_change":"2023-12-24T20:02:23.571847+0000","last_active":"2023-12-24T20:02:23.571847+0000","last_peered":"2023-12-24T20:02:23.571847+0000","last_clean":"2023-12-24T20:02:23.571847+0000","last_became_active":"2023-12-24T20:02:23.571614+0000","last_became_peered":"2023-12-24T20:02:23.571614+0000","last_unstale":"2023-12-24T20:02:23.571847+0000","last_undegraded":"2023-12-24T20:02:23.571847+0000","last_fullsized":"2023-12-24T20:02:23.571847+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:47.602893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.574563+0000","last_change":"2023-12-24T20:02:23.574507+0000","last_active":"2023-12-24T20:02:23.574563+0000","last_peered":"2023-12-24T20:02:23.574563+0000","last_clean":"2023-12-24T20:02:23.574563+0000","last_became_active":"2023-12-24T20:02:23.574229+0000","last_became_peered":"2023-12-24T20:02:23.574229+0000","last_unstale":"2023-12-24T20:02:23.574563+0000","last_undegraded":"2023-12-24T20:02:23.574563+0000","last_fullsized":"2023-12-24T20:02:23.574563+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:24.429255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571782+0000","last_change":"2023-12-24T20:02:23.571727+0000","last_active":"2023-12-24T20:02:23.571782+0000","last_peered":"2023-12-24T20:02:23.571782+0000","last_clean":"2023-12-24T20:02:23.571782+0000","last_became_active":"2023-12-24T20:02:23.571107+0000","last_became_peered":"2023-12-24T20:02:23.571107+0000","last_unstale":"2023-12-24T20:02:23.571782+0000","last_undegraded":"2023-12-24T20:02:23.571782+0000","last_fullsized":"2023-12-24T20:02:23.571782+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:24.089160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569833+0000","last_change":"2023-12-24T20:02:23.569833+0000","last_active":"2023-12-24T20:02:23.569833+0000","last_peered":"2023-12-24T20:02:23.569833+0000","last_clean":"2023-12-24T20:02:23.569833+0000","last_became_active":"2023-12-24T20:02:23.569584+0000","last_became_peered":"2023-12-24T20:02:23.569584+0000","last_unstale":"2023-12-24T20:02:23.569833+0000","last_undegraded":"2023-12-24T20:02:23.569833+0000","last_fullsized":"2023-12-24T20:02:23.569833+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:12.529600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572917+0000","last_change":"2023-12-24T20:02:23.572810+0000","last_active":"2023-12-24T20:02:23.572917+0000","last_peered":"2023-12-24T20:02:23.572917+0000","last_clean":"2023-12-24T20:02:23.572917+0000","last_became_active":"2023-12-24T20:02:23.572441+0000","last_became_peered":"2023-12-24T20:02:23.572441+0000","last_unstale":"2023-12-24T20:02:23.572917+0000","last_undegraded":"2023-12-24T20:02:23.572917+0000","last_fullsized":"2023-12-24T20:02:23.572917+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:22.864773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568442+0000","last_change":"2023-12-24T20:02:23.568143+0000","last_active":"2023-12-24T20:02:23.568442+0000","last_peered":"2023-12-24T20:02:23.568442+0000","last_clean":"2023-12-24T20:02:23.568442+0000","last_became_active":"2023-12-24T20:02:23.567924+0000","last_became_peered":"2023-12-24T20:02:23.567924+0000","last_unstale":"2023-12-24T20:02:23.568442+0000","last_undegraded":"2023-12-24T20:02:23.568442+0000","last_fullsized":"2023-12-24T20:02:23.568442+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:13:45.227757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.565209+0000","last_change":"2023-12-24T20:02:23.565209+0000","last_active":"2023-12-24T20:02:23.565209+0000","last_peered":"2023-12-24T20:02:23.565209+0000","last_clean":"2023-12-24T20:02:23.565209+0000","last_became_active":"2023-12-24T20:02:23.564988+0000","last_became_peered":"2023-12-24T20:02:23.564988+0000","last_unstale":"2023-12-24T20:02:23.565209+0000","last_undegraded":"2023-12-24T20:02:23.565209+0000","last_fullsized":"2023-12-24T20:02:23.565209+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:40.098061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570202+0000","last_change":"2023-12-24T20:02:23.570202+0000","last_active":"2023-12-24T20:02:23.570202+0000","last_peered":"2023-12-24T20:02:23.570202+0000","last_clean":"2023-12-24T20:02:23.570202+0000","last_became_active":"2023-12-24T20:02:23.569827+0000","last_became_peered":"2023-12-24T20:02:23.569827+0000","last_unstale":"2023-12-24T20:02:23.570202+0000","last_undegraded":"2023-12-24T20:02:23.570202+0000","last_fullsized":"2023-12-24T20:02:23.570202+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:22.864773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.567791+0000","last_change":"2023-12-24T20:02:23.567568+0000","last_active":"2023-12-24T20:02:23.567791+0000","last_peered":"2023-12-24T20:02:23.567791+0000","last_clean":"2023-12-24T20:02:23.567791+0000","last_became_active":"2023-12-24T20:02:23.567082+0000","last_became_peered":"2023-12-24T20:02:23.567082+0000","last_unstale":"2023-12-24T20:02:23.567791+0000","last_undegraded":"2023-12-24T20:02:23.567791+0000","last_fullsized":"2023-12-24T20:02:23.567791+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:16.773234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.574051+0000","last_change":"2023-12-24T20:02:23.574051+0000","last_active":"2023-12-24T20:02:23.574051+0000","last_peered":"2023-12-24T20:02:23.574051+0000","last_clean":"2023-12-24T20:02:23.574051+0000","last_became_active":"2023-12-24T20:02:23.573645+0000","last_became_peered":"2023-12-24T20:02:23.573645+0000","last_unstale":"2023-12-24T20:02:23.574051+0000","last_undegraded":"2023-12-24T20:02:23.574051+0000","last_fullsized":"2023-12-24T20:02:23.574051+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:16:36.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"121'4","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.045429+0000","last_change":"2023-12-24T20:02:23.024611+0000","last_active":"2023-12-24T20:02:24.045429+0000","last_peered":"2023-12-24T20:02:24.045429+0000","last_clean":"2023-12-24T20:02:24.045429+0000","last_became_active":"2023-12-24T20:02:23.024351+0000","last_became_peered":"2023-12-24T20:02:23.024351+0000","last_unstale":"2023-12-24T20:02:24.045429+0000","last_undegraded":"2023-12-24T20:02:24.045429+0000","last_fullsized":"2023-12-24T20:02:24.045429+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:21.863234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.574271+0000","last_change":"2023-12-24T20:02:23.574271+0000","last_active":"2023-12-24T20:02:23.574271+0000","last_peered":"2023-12-24T20:02:23.574271+0000","last_clean":"2023-12-24T20:02:23.574271+0000","last_became_active":"2023-12-24T20:02:23.574058+0000","last_became_peered":"2023-12-24T20:02:23.574058+0000","last_unstale":"2023-12-24T20:02:23.574271+0000","last_undegraded":"2023-12-24T20:02:23.574271+0000","last_fullsized":"2023-12-24T20:02:23.574271+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:06:04.064643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"121'1","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569779+0000","last_change":"2023-12-24T20:02:23.025063+0000","last_active":"2023-12-24T20:02:23.569779+0000","last_peered":"2023-12-24T20:02:23.569779+0000","last_clean":"2023-12-24T20:02:23.569779+0000","last_became_active":"2023-12-24T20:02:23.024811+0000","last_became_peered":"2023-12-24T20:02:23.024811+0000","last_unstale":"2023-12-24T20:02:23.569779+0000","last_undegraded":"2023-12-24T20:02:23.569779+0000","last_fullsized":"2023-12-24T20:02:23.569779+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:59.835841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569696+0000","last_change":"2023-12-24T20:02:23.569637+0000","last_active":"2023-12-24T20:02:23.569696+0000","last_peered":"2023-12-24T20:02:23.569696+0000","last_clean":"2023-12-24T20:02:23.569696+0000","last_became_active":"2023-12-24T20:02:23.569419+0000","last_became_peered":"2023-12-24T20:02:23.569419+0000","last_unstale":"2023-12-24T20:02:23.569696+0000","last_undegraded":"2023-12-24T20:02:23.569696+0000","last_fullsized":"2023-12-24T20:02:23.569696+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:36.571250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.044918+0000","last_change":"2023-12-24T20:02:23.032237+0000","last_active":"2023-12-24T20:02:24.044918+0000","last_peered":"2023-12-24T20:02:24.044918+0000","last_clean":"2023-12-24T20:02:24.044918+0000","last_became_active":"2023-12-24T20:02:23.031666+0000","last_became_peered":"2023-12-24T20:02:23.031666+0000","last_unstale":"2023-12-24T20:02:24.044918+0000","last_undegraded":"2023-12-24T20:02:24.044918+0000","last_fullsized":"2023-12-24T20:02:24.044918+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:10:35.191888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571857+0000","last_change":"2023-12-24T20:02:23.571781+0000","last_active":"2023-12-24T20:02:23.571857+0000","last_peered":"2023-12-24T20:02:23.571857+0000","last_clean":"2023-12-24T20:02:23.571857+0000","last_became_active":"2023-12-24T20:02:23.571532+0000","last_became_peered":"2023-12-24T20:02:23.571532+0000","last_unstale":"2023-12-24T20:02:23.571857+0000","last_undegraded":"2023-12-24T20:02:23.571857+0000","last_fullsized":"2023-12-24T20:02:23.571857+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:32.581915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.044083+0000","last_change":"2023-12-24T20:02:23.029755+0000","last_active":"2023-12-24T20:02:24.044083+0000","last_peered":"2023-12-24T20:02:24.044083+0000","last_clean":"2023-12-24T20:02:24.044083+0000","last_became_active":"2023-12-24T20:02:23.029531+0000","last_became_peered":"2023-12-24T20:02:23.029531+0000","last_unstale":"2023-12-24T20:02:24.044083+0000","last_undegraded":"2023-12-24T20:02:24.044083+0000","last_fullsized":"2023-12-24T20:02:24.044083+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:52.702111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570676+0000","last_change":"2023-12-24T20:02:23.570450+0000","last_active":"2023-12-24T20:02:23.570676+0000","last_peered":"2023-12-24T20:02:23.570676+0000","last_clean":"2023-12-24T20:02:23.570676+0000","last_became_active":"2023-12-24T20:02:23.570212+0000","last_became_peered":"2023-12-24T20:02:23.570212+0000","last_unstale":"2023-12-24T20:02:23.570676+0000","last_undegraded":"2023-12-24T20:02:23.570676+0000","last_fullsized":"2023-12-24T20:02:23.570676+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:41:11.025292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.043178+0000","last_change":"2023-12-24T20:02:23.028192+0000","last_active":"2023-12-24T20:02:24.043178+0000","last_peered":"2023-12-24T20:02:24.043178+0000","last_clean":"2023-12-24T20:02:24.043178+0000","last_became_active":"2023-12-24T20:02:23.027863+0000","last_became_peered":"2023-12-24T20:02:23.027863+0000","last_unstale":"2023-12-24T20:02:24.043178+0000","last_undegraded":"2023-12-24T20:02:24.043178+0000","last_fullsized":"2023-12-24T20:02:24.043178+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:12:52.307394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572257+0000","last_change":"2023-12-24T20:02:23.572257+0000","last_active":"2023-12-24T20:02:23.572257+0000","last_peered":"2023-12-24T20:02:23.572257+0000","last_clean":"2023-12-24T20:02:23.572257+0000","last_became_active":"2023-12-24T20:02:23.572034+0000","last_became_peered":"2023-12-24T20:02:23.572034+0000","last_unstale":"2023-12-24T20:02:23.572257+0000","last_undegraded":"2023-12-24T20:02:23.572257+0000","last_fullsized":"2023-12-24T20:02:23.572257+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:41.645930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.045159+0000","last_change":"2023-12-24T20:02:23.021301+0000","last_active":"2023-12-24T20:02:24.045159+0000","last_peered":"2023-12-24T20:02:24.045159+0000","last_clean":"2023-12-24T20:02:24.045159+0000","last_became_active":"2023-12-24T20:02:23.021136+0000","last_became_peered":"2023-12-24T20:02:23.021136+0000","last_unstale":"2023-12-24T20:02:24.045159+0000","last_undegraded":"2023-12-24T20:02:24.045159+0000","last_fullsized":"2023-12-24T20:02:24.045159+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:06:03.063104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569289+0000","last_change":"2023-12-24T20:02:23.569289+0000","last_active":"2023-12-24T20:02:23.569289+0000","last_peered":"2023-12-24T20:02:23.569289+0000","last_clean":"2023-12-24T20:02:23.569289+0000","last_became_active":"2023-12-24T20:02:23.568817+0000","last_became_peered":"2023-12-24T20:02:23.568817+0000","last_unstale":"2023-12-24T20:02:23.569289+0000","last_undegraded":"2023-12-24T20:02:23.569289+0000","last_fullsized":"2023-12-24T20:02:23.569289+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:53.703650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.564665+0000","last_change":"2023-12-24T20:02:23.026711+0000","last_active":"2023-12-24T20:02:23.564665+0000","last_peered":"2023-12-24T20:02:23.564665+0000","last_clean":"2023-12-24T20:02:23.564665+0000","last_became_active":"2023-12-24T20:02:23.026248+0000","last_became_peered":"2023-12-24T20:02:23.026248+0000","last_unstale":"2023-12-24T20:02:23.564665+0000","last_undegraded":"2023-12-24T20:02:23.564665+0000","last_fullsized":"2023-12-24T20:02:23.564665+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:22:27.830486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.575463+0000","last_change":"2023-12-24T20:02:23.575390+0000","last_active":"2023-12-24T20:02:23.575463+0000","last_peered":"2023-12-24T20:02:23.575463+0000","last_clean":"2023-12-24T20:02:23.575463+0000","last_became_active":"2023-12-24T20:02:23.572189+0000","last_became_peered":"2023-12-24T20:02:23.572189+0000","last_unstale":"2023-12-24T20:02:23.575463+0000","last_undegraded":"2023-12-24T20:02:23.575463+0000","last_fullsized":"2023-12-24T20:02:23.575463+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:16.154734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.564055+0000","last_change":"2023-12-24T20:02:23.034672+0000","last_active":"2023-12-24T20:02:23.564055+0000","last_peered":"2023-12-24T20:02:23.564055+0000","last_clean":"2023-12-24T20:02:23.564055+0000","last_became_active":"2023-12-24T20:02:23.034446+0000","last_became_peered":"2023-12-24T20:02:23.034446+0000","last_unstale":"2023-12-24T20:02:23.564055+0000","last_undegraded":"2023-12-24T20:02:23.564055+0000","last_fullsized":"2023-12-24T20:02:23.564055+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:45.467872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570119+0000","last_change":"2023-12-24T20:02:23.570057+0000","last_active":"2023-12-24T20:02:23.570119+0000","last_peered":"2023-12-24T20:02:23.570119+0000","last_clean":"2023-12-24T20:02:23.570119+0000","last_became_active":"2023-12-24T20:02:23.569843+0000","last_became_peered":"2023-12-24T20:02:23.569843+0000","last_unstale":"2023-12-24T20:02:23.570119+0000","last_undegraded":"2023-12-24T20:02:23.570119+0000","last_fullsized":"2023-12-24T20:02:23.570119+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:34.786744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.564535+0000","last_change":"2023-12-24T20:02:23.019942+0000","last_active":"2023-12-24T20:02:23.564535+0000","last_peered":"2023-12-24T20:02:23.564535+0000","last_clean":"2023-12-24T20:02:23.564535+0000","last_became_active":"2023-12-24T20:02:23.019691+0000","last_became_peered":"2023-12-24T20:02:23.019691+0000","last_unstale":"2023-12-24T20:02:23.564535+0000","last_undegraded":"2023-12-24T20:02:23.564535+0000","last_fullsized":"2023-12-24T20:02:23.564535+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:31:32.567507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.575445+0000","last_change":"2023-12-24T20:02:23.575379+0000","last_active":"2023-12-24T20:02:23.575445+0000","last_peered":"2023-12-24T20:02:23.575445+0000","last_clean":"2023-12-24T20:02:23.575445+0000","last_became_active":"2023-12-24T20:02:23.575125+0000","last_became_peered":"2023-12-24T20:02:23.575125+0000","last_unstale":"2023-12-24T20:02:23.575445+0000","last_undegraded":"2023-12-24T20:02:23.575445+0000","last_fullsized":"2023-12-24T20:02:23.575445+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:28:24.326359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.035715+0000","last_change":"2023-12-24T20:02:23.035629+0000","last_active":"2023-12-24T20:02:23.035715+0000","last_peered":"2023-12-24T20:02:23.035715+0000","last_clean":"2023-12-24T20:02:23.035715+0000","last_became_active":"2023-12-24T20:02:23.035417+0000","last_became_peered":"2023-12-24T20:02:23.035417+0000","last_unstale":"2023-12-24T20:02:23.035715+0000","last_undegraded":"2023-12-24T20:02:23.035715+0000","last_fullsized":"2023-12-24T20:02:23.035715+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:16:08.178078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568468+0000","last_change":"2023-12-24T20:02:23.568312+0000","last_active":"2023-12-24T20:02:23.568468+0000","last_peered":"2023-12-24T20:02:23.568468+0000","last_clean":"2023-12-24T20:02:23.568468+0000","last_became_active":"2023-12-24T20:02:23.567734+0000","last_became_peered":"2023-12-24T20:02:23.567734+0000","last_unstale":"2023-12-24T20:02:23.568468+0000","last_undegraded":"2023-12-24T20:02:23.568468+0000","last_fullsized":"2023-12-24T20:02:23.568468+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:04:35.842656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"121'3","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.043610+0000","last_change":"2023-12-24T20:02:23.027251+0000","last_active":"2023-12-24T20:02:24.043610+0000","last_peered":"2023-12-24T20:02:24.043610+0000","last_clean":"2023-12-24T20:02:24.043610+0000","last_became_active":"2023-12-24T20:02:23.027007+0000","last_became_peered":"2023-12-24T20:02:23.027007+0000","last_unstale":"2023-12-24T20:02:24.043610+0000","last_undegraded":"2023-12-24T20:02:24.043610+0000","last_fullsized":"2023-12-24T20:02:24.043610+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:57:56.764425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571969+0000","last_change":"2023-12-24T20:02:23.571969+0000","last_active":"2023-12-24T20:02:23.571969+0000","last_peered":"2023-12-24T20:02:23.571969+0000","last_clean":"2023-12-24T20:02:23.571969+0000","last_became_active":"2023-12-24T20:02:23.571129+0000","last_became_peered":"2023-12-24T20:02:23.571129+0000","last_unstale":"2023-12-24T20:02:23.571969+0000","last_undegraded":"2023-12-24T20:02:23.571969+0000","last_fullsized":"2023-12-24T20:02:23.571969+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:56:12.316892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"121'6","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.047293+0000","last_change":"2023-12-24T20:02:23.031232+0000","last_active":"2023-12-24T20:02:24.047293+0000","last_peered":"2023-12-24T20:02:24.047293+0000","last_clean":"2023-12-24T20:02:24.047293+0000","last_became_active":"2023-12-24T20:02:23.030979+0000","last_became_peered":"2023-12-24T20:02:23.030979+0000","last_unstale":"2023-12-24T20:02:24.047293+0000","last_undegraded":"2023-12-24T20:02:24.047293+0000","last_fullsized":"2023-12-24T20:02:24.047293+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:46.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570099+0000","last_change":"2023-12-24T20:02:23.570099+0000","last_active":"2023-12-24T20:02:23.570099+0000","last_peered":"2023-12-24T20:02:23.570099+0000","last_clean":"2023-12-24T20:02:23.570099+0000","last_became_active":"2023-12-24T20:02:23.569608+0000","last_became_peered":"2023-12-24T20:02:23.569608+0000","last_unstale":"2023-12-24T20:02:23.570099+0000","last_undegraded":"2023-12-24T20:02:23.570099+0000","last_fullsized":"2023-12-24T20:02:23.570099+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:32.581915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"121'2","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.045638+0000","last_change":"2023-12-24T20:02:23.031756+0000","last_active":"2023-12-24T20:02:24.045638+0000","last_peered":"2023-12-24T20:02:24.045638+0000","last_clean":"2023-12-24T20:02:24.045638+0000","last_became_active":"2023-12-24T20:02:23.031368+0000","last_became_peered":"2023-12-24T20:02:23.031368+0000","last_unstale":"2023-12-24T20:02:24.045638+0000","last_undegraded":"2023-12-24T20:02:24.045638+0000","last_fullsized":"2023-12-24T20:02:24.045638+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:55.724030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.565588+0000","last_change":"2023-12-24T20:02:23.565523+0000","last_active":"2023-12-24T20:02:23.565588+0000","last_peered":"2023-12-24T20:02:23.565588+0000","last_clean":"2023-12-24T20:02:23.565588+0000","last_became_active":"2023-12-24T20:02:23.565160+0000","last_became_peered":"2023-12-24T20:02:23.565160+0000","last_unstale":"2023-12-24T20:02:23.565588+0000","last_undegraded":"2023-12-24T20:02:23.565588+0000","last_fullsized":"2023-12-24T20:02:23.565588+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:26.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.027121+0000","last_change":"2023-12-24T20:02:23.027059+0000","last_active":"2023-12-24T20:02:23.027121+0000","last_peered":"2023-12-24T20:02:23.027121+0000","last_clean":"2023-12-24T20:02:23.027121+0000","last_became_active":"2023-12-24T20:02:23.026830+0000","last_became_peered":"2023-12-24T20:02:23.026830+0000","last_unstale":"2023-12-24T20:02:23.027121+0000","last_undegraded":"2023-12-24T20:02:23.027121+0000","last_fullsized":"2023-12-24T20:02:23.027121+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:16:08.754612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.575479+0000","last_change":"2023-12-24T20:02:23.575399+0000","last_active":"2023-12-24T20:02:23.575479+0000","last_peered":"2023-12-24T20:02:23.575479+0000","last_clean":"2023-12-24T20:02:23.575479+0000","last_became_active":"2023-12-24T20:02:23.575143+0000","last_became_peered":"2023-12-24T20:02:23.575143+0000","last_unstale":"2023-12-24T20:02:23.575479+0000","last_undegraded":"2023-12-24T20:02:23.575479+0000","last_fullsized":"2023-12-24T20:02:23.575479+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:24.429255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568133+0000","last_change":"2023-12-24T20:02:23.026606+0000","last_active":"2023-12-24T20:02:23.568133+0000","last_peered":"2023-12-24T20:02:23.568133+0000","last_clean":"2023-12-24T20:02:23.568133+0000","last_became_active":"2023-12-24T20:02:23.026307+0000","last_became_peered":"2023-12-24T20:02:23.026307+0000","last_unstale":"2023-12-24T20:02:23.568133+0000","last_undegraded":"2023-12-24T20:02:23.568133+0000","last_fullsized":"2023-12-24T20:02:23.568133+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:22:27.830486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571907+0000","last_change":"2023-12-24T20:02:23.571907+0000","last_active":"2023-12-24T20:02:23.571907+0000","last_peered":"2023-12-24T20:02:23.571907+0000","last_clean":"2023-12-24T20:02:23.571907+0000","last_became_active":"2023-12-24T20:02:23.571548+0000","last_became_peered":"2023-12-24T20:02:23.571548+0000","last_unstale":"2023-12-24T20:02:23.571907+0000","last_undegraded":"2023-12-24T20:02:23.571907+0000","last_fullsized":"2023-12-24T20:02:23.571907+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:14:23.431516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"121'8","reported_seq":18,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.046242+0000","last_change":"2023-12-24T20:02:23.034956+0000","last_active":"2023-12-24T20:02:24.046242+0000","last_peered":"2023-12-24T20:02:24.046242+0000","last_clean":"2023-12-24T20:02:24.046242+0000","last_became_active":"2023-12-24T20:02:23.034025+0000","last_became_peered":"2023-12-24T20:02:23.034025+0000","last_unstale":"2023-12-24T20:02:24.046242+0000","last_undegraded":"2023-12-24T20:02:24.046242+0000","last_fullsized":"2023-12-24T20:02:24.046242+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:04:38.943757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568535+0000","last_change":"2023-12-24T20:02:23.568473+0000","last_active":"2023-12-24T20:02:23.568535+0000","last_peered":"2023-12-24T20:02:23.568535+0000","last_clean":"2023-12-24T20:02:23.568535+0000","last_became_active":"2023-12-24T20:02:23.568055+0000","last_became_peered":"2023-12-24T20:02:23.568055+0000","last_unstale":"2023-12-24T20:02:23.568535+0000","last_undegraded":"2023-12-24T20:02:23.568535+0000","last_fullsized":"2023-12-24T20:02:23.568535+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:12.529600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.044790+0000","last_change":"2023-12-24T20:02:23.028264+0000","last_active":"2023-12-24T20:02:24.044790+0000","last_peered":"2023-12-24T20:02:24.044790+0000","last_clean":"2023-12-24T20:02:24.044790+0000","last_became_active":"2023-12-24T20:02:23.027989+0000","last_became_peered":"2023-12-24T20:02:23.027989+0000","last_unstale":"2023-12-24T20:02:24.044790+0000","last_undegraded":"2023-12-24T20:02:24.044790+0000","last_fullsized":"2023-12-24T20:02:24.044790+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:45:16.245252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.566619+0000","last_change":"2023-12-24T20:02:23.566551+0000","last_active":"2023-12-24T20:02:23.566619+0000","last_peered":"2023-12-24T20:02:23.566619+0000","last_clean":"2023-12-24T20:02:23.566619+0000","last_became_active":"2023-12-24T20:02:23.565925+0000","last_became_peered":"2023-12-24T20:02:23.565925+0000","last_unstale":"2023-12-24T20:02:23.566619+0000","last_undegraded":"2023-12-24T20:02:23.566619+0000","last_fullsized":"2023-12-24T20:02:23.566619+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:36.343150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.043552+0000","last_change":"2023-12-24T20:02:23.023573+0000","last_active":"2023-12-24T20:02:24.043552+0000","last_peered":"2023-12-24T20:02:24.043552+0000","last_clean":"2023-12-24T20:02:24.043552+0000","last_became_active":"2023-12-24T20:02:23.023311+0000","last_became_peered":"2023-12-24T20:02:23.023311+0000","last_unstale":"2023-12-24T20:02:24.043552+0000","last_undegraded":"2023-12-24T20:02:24.043552+0000","last_fullsized":"2023-12-24T20:02:24.043552+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:37.150181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571464+0000","last_change":"2023-12-24T20:02:23.571464+0000","last_active":"2023-12-24T20:02:23.571464+0000","last_peered":"2023-12-24T20:02:23.571464+0000","last_clean":"2023-12-24T20:02:23.571464+0000","last_became_active":"2023-12-24T20:02:23.570871+0000","last_became_peered":"2023-12-24T20:02:23.570871+0000","last_unstale":"2023-12-24T20:02:23.571464+0000","last_undegraded":"2023-12-24T20:02:23.571464+0000","last_fullsized":"2023-12-24T20:02:23.571464+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:16.154734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.562204+0000","last_change":"2023-12-24T20:02:23.029832+0000","last_active":"2023-12-24T20:02:23.562204+0000","last_peered":"2023-12-24T20:02:23.562204+0000","last_clean":"2023-12-24T20:02:23.562204+0000","last_became_active":"2023-12-24T20:02:23.029622+0000","last_became_peered":"2023-12-24T20:02:23.029622+0000","last_unstale":"2023-12-24T20:02:23.562204+0000","last_undegraded":"2023-12-24T20:02:23.562204+0000","last_fullsized":"2023-12-24T20:02:23.562204+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:28:23.324820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.573878+0000","last_change":"2023-12-24T20:02:23.573878+0000","last_active":"2023-12-24T20:02:23.573878+0000","last_peered":"2023-12-24T20:02:23.573878+0000","last_clean":"2023-12-24T20:02:23.573878+0000","last_became_active":"2023-12-24T20:02:23.573151+0000","last_became_peered":"2023-12-24T20:02:23.573151+0000","last_unstale":"2023-12-24T20:02:23.573878+0000","last_undegraded":"2023-12-24T20:02:23.573878+0000","last_fullsized":"2023-12-24T20:02:23.573878+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:16.773234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.045532+0000","last_change":"2023-12-24T20:02:23.027804+0000","last_active":"2023-12-24T20:02:24.045532+0000","last_peered":"2023-12-24T20:02:24.045532+0000","last_clean":"2023-12-24T20:02:24.045532+0000","last_became_active":"2023-12-24T20:02:23.027431+0000","last_became_peered":"2023-12-24T20:02:23.027431+0000","last_unstale":"2023-12-24T20:02:24.045532+0000","last_undegraded":"2023-12-24T20:02:24.045532+0000","last_fullsized":"2023-12-24T20:02:24.045532+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:09:18.167143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.562385+0000","last_change":"2023-12-24T20:02:23.562385+0000","last_active":"2023-12-24T20:02:23.562385+0000","last_peered":"2023-12-24T20:02:23.562385+0000","last_clean":"2023-12-24T20:02:23.562385+0000","last_became_active":"2023-12-24T20:02:23.562172+0000","last_became_peered":"2023-12-24T20:02:23.562172+0000","last_unstale":"2023-12-24T20:02:23.562385+0000","last_undegraded":"2023-12-24T20:02:23.562385+0000","last_fullsized":"2023-12-24T20:02:23.562385+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:20.714683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.560069+0000","last_change":"2023-12-24T20:02:23.021126+0000","last_active":"2023-12-24T20:02:23.560069+0000","last_peered":"2023-12-24T20:02:23.560069+0000","last_clean":"2023-12-24T20:02:23.560069+0000","last_became_active":"2023-12-24T20:02:23.020897+0000","last_became_peered":"2023-12-24T20:02:23.020897+0000","last_unstale":"2023-12-24T20:02:23.560069+0000","last_undegraded":"2023-12-24T20:02:23.560069+0000","last_fullsized":"2023-12-24T20:02:23.560069+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:21:33.809695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572987+0000","last_change":"2023-12-24T20:02:23.572987+0000","last_active":"2023-12-24T20:02:23.572987+0000","last_peered":"2023-12-24T20:02:23.572987+0000","last_clean":"2023-12-24T20:02:23.572987+0000","last_became_active":"2023-12-24T20:02:23.572740+0000","last_became_peered":"2023-12-24T20:02:23.572740+0000","last_unstale":"2023-12-24T20:02:23.572987+0000","last_undegraded":"2023-12-24T20:02:23.572987+0000","last_fullsized":"2023-12-24T20:02:23.572987+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:34.405578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.560289+0000","last_change":"2023-12-24T20:02:23.032567+0000","last_active":"2023-12-24T20:02:23.560289+0000","last_peered":"2023-12-24T20:02:23.560289+0000","last_clean":"2023-12-24T20:02:23.560289+0000","last_became_active":"2023-12-24T20:02:23.032320+0000","last_became_peered":"2023-12-24T20:02:23.032320+0000","last_unstale":"2023-12-24T20:02:23.560289+0000","last_undegraded":"2023-12-24T20:02:23.560289+0000","last_fullsized":"2023-12-24T20:02:23.560289+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:47:30.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.566486+0000","last_change":"2023-12-24T20:02:23.566414+0000","last_active":"2023-12-24T20:02:23.566486+0000","last_peered":"2023-12-24T20:02:23.566486+0000","last_clean":"2023-12-24T20:02:23.566486+0000","last_became_active":"2023-12-24T20:02:23.566192+0000","last_became_peered":"2023-12-24T20:02:23.566192+0000","last_unstale":"2023-12-24T20:02:23.566486+0000","last_undegraded":"2023-12-24T20:02:23.566486+0000","last_fullsized":"2023-12-24T20:02:23.566486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:16.154734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.561259+0000","last_change":"2023-12-24T20:02:23.022526+0000","last_active":"2023-12-24T20:02:23.561259+0000","last_peered":"2023-12-24T20:02:23.561259+0000","last_clean":"2023-12-24T20:02:23.561259+0000","last_became_active":"2023-12-24T20:02:23.022268+0000","last_became_peered":"2023-12-24T20:02:23.022268+0000","last_unstale":"2023-12-24T20:02:23.561259+0000","last_undegraded":"2023-12-24T20:02:23.561259+0000","last_fullsized":"2023-12-24T20:02:23.561259+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:23.427716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.563406+0000","last_change":"2023-12-24T20:02:23.563336+0000","last_active":"2023-12-24T20:02:23.563406+0000","last_peered":"2023-12-24T20:02:23.563406+0000","last_clean":"2023-12-24T20:02:23.563406+0000","last_became_active":"2023-12-24T20:02:23.562820+0000","last_became_peered":"2023-12-24T20:02:23.562820+0000","last_unstale":"2023-12-24T20:02:23.563406+0000","last_undegraded":"2023-12-24T20:02:23.563406+0000","last_fullsized":"2023-12-24T20:02:23.563406+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:20:50.407707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.044243+0000","last_change":"2023-12-24T20:02:23.023321+0000","last_active":"2023-12-24T20:02:24.044243+0000","last_peered":"2023-12-24T20:02:24.044243+0000","last_clean":"2023-12-24T20:02:24.044243+0000","last_became_active":"2023-12-24T20:02:23.023074+0000","last_became_peered":"2023-12-24T20:02:23.023074+0000","last_unstale":"2023-12-24T20:02:24.044243+0000","last_undegraded":"2023-12-24T20:02:24.044243+0000","last_fullsized":"2023-12-24T20:02:24.044243+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:59.561872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.567759+0000","last_change":"2023-12-24T20:02:23.567373+0000","last_active":"2023-12-24T20:02:23.567759+0000","last_peered":"2023-12-24T20:02:23.567759+0000","last_clean":"2023-12-24T20:02:23.567759+0000","last_became_active":"2023-12-24T20:02:23.566765+0000","last_became_peered":"2023-12-24T20:02:23.566765+0000","last_unstale":"2023-12-24T20:02:23.567759+0000","last_undegraded":"2023-12-24T20:02:23.567759+0000","last_fullsized":"2023-12-24T20:02:23.567759+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:40.781529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.561856+0000","last_change":"2023-12-24T20:02:23.027973+0000","last_active":"2023-12-24T20:02:23.561856+0000","last_peered":"2023-12-24T20:02:23.561856+0000","last_clean":"2023-12-24T20:02:23.561856+0000","last_became_active":"2023-12-24T20:02:23.027638+0000","last_became_peered":"2023-12-24T20:02:23.027638+0000","last_unstale":"2023-12-24T20:02:23.561856+0000","last_undegraded":"2023-12-24T20:02:23.561856+0000","last_fullsized":"2023-12-24T20:02:23.561856+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:51.073920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.567732+0000","last_change":"2023-12-24T20:02:23.566768+0000","last_active":"2023-12-24T20:02:23.567732+0000","last_peered":"2023-12-24T20:02:23.567732+0000","last_clean":"2023-12-24T20:02:23.567732+0000","last_became_active":"2023-12-24T20:02:23.566446+0000","last_became_peered":"2023-12-24T20:02:23.566446+0000","last_unstale":"2023-12-24T20:02:23.567732+0000","last_undegraded":"2023-12-24T20:02:23.567732+0000","last_fullsized":"2023-12-24T20:02:23.567732+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:16:36.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.561140+0000","last_change":"2023-12-24T20:02:23.030321+0000","last_active":"2023-12-24T20:02:23.561140+0000","last_peered":"2023-12-24T20:02:23.561140+0000","last_clean":"2023-12-24T20:02:23.561140+0000","last_became_active":"2023-12-24T20:02:23.030054+0000","last_became_peered":"2023-12-24T20:02:23.030054+0000","last_unstale":"2023-12-24T20:02:23.561140+0000","last_undegraded":"2023-12-24T20:02:23.561140+0000","last_fullsized":"2023-12-24T20:02:23.561140+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:04:34.841117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572936+0000","last_change":"2023-12-24T20:02:23.572868+0000","last_active":"2023-12-24T20:02:23.572936+0000","last_peered":"2023-12-24T20:02:23.572936+0000","last_clean":"2023-12-24T20:02:23.572936+0000","last_became_active":"2023-12-24T20:02:23.572622+0000","last_became_peered":"2023-12-24T20:02:23.572622+0000","last_unstale":"2023-12-24T20:02:23.572936+0000","last_undegraded":"2023-12-24T20:02:23.572936+0000","last_fullsized":"2023-12-24T20:02:23.572936+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:32.581915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.565294+0000","last_change":"2023-12-24T20:02:23.027927+0000","last_active":"2023-12-24T20:02:23.565294+0000","last_peered":"2023-12-24T20:02:23.565294+0000","last_clean":"2023-12-24T20:02:23.565294+0000","last_became_active":"2023-12-24T20:02:23.027128+0000","last_became_peered":"2023-12-24T20:02:23.027128+0000","last_unstale":"2023-12-24T20:02:23.565294+0000","last_undegraded":"2023-12-24T20:02:23.565294+0000","last_fullsized":"2023-12-24T20:02:23.565294+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:46.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571783+0000","last_change":"2023-12-24T20:02:23.571783+0000","last_active":"2023-12-24T20:02:23.571783+0000","last_peered":"2023-12-24T20:02:23.571783+0000","last_clean":"2023-12-24T20:02:23.571783+0000","last_became_active":"2023-12-24T20:02:23.571265+0000","last_became_peered":"2023-12-24T20:02:23.571265+0000","last_unstale":"2023-12-24T20:02:23.571783+0000","last_undegraded":"2023-12-24T20:02:23.571783+0000","last_fullsized":"2023-12-24T20:02:23.571783+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:34:54.042392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.561353+0000","last_change":"2023-12-24T20:02:23.033767+0000","last_active":"2023-12-24T20:02:23.561353+0000","last_peered":"2023-12-24T20:02:23.561353+0000","last_clean":"2023-12-24T20:02:23.561353+0000","last_became_active":"2023-12-24T20:02:23.033580+0000","last_became_peered":"2023-12-24T20:02:23.033580+0000","last_unstale":"2023-12-24T20:02:23.561353+0000","last_undegraded":"2023-12-24T20:02:23.561353+0000","last_fullsized":"2023-12-24T20:02:23.561353+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:31.580376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568924+0000","last_change":"2023-12-24T20:02:23.568789+0000","last_active":"2023-12-24T20:02:23.568924+0000","last_peered":"2023-12-24T20:02:23.568924+0000","last_clean":"2023-12-24T20:02:23.568924+0000","last_became_active":"2023-12-24T20:02:23.567700+0000","last_became_peered":"2023-12-24T20:02:23.567700+0000","last_unstale":"2023-12-24T20:02:23.568924+0000","last_undegraded":"2023-12-24T20:02:23.568924+0000","last_fullsized":"2023-12-24T20:02:23.568924+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:53.703650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.563888+0000","last_change":"2023-12-24T20:02:23.027463+0000","last_active":"2023-12-24T20:02:23.563888+0000","last_peered":"2023-12-24T20:02:23.563888+0000","last_clean":"2023-12-24T20:02:23.563888+0000","last_became_active":"2023-12-24T20:02:23.027225+0000","last_became_peered":"2023-12-24T20:02:23.027225+0000","last_unstale":"2023-12-24T20:02:23.563888+0000","last_undegraded":"2023-12-24T20:02:23.563888+0000","last_fullsized":"2023-12-24T20:02:23.563888+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:30.130299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571334+0000","last_change":"2023-12-24T20:02:23.571334+0000","last_active":"2023-12-24T20:02:23.571334+0000","last_peered":"2023-12-24T20:02:23.571334+0000","last_clean":"2023-12-24T20:02:23.571334+0000","last_became_active":"2023-12-24T20:02:23.571147+0000","last_became_peered":"2023-12-24T20:02:23.571147+0000","last_unstale":"2023-12-24T20:02:23.571334+0000","last_undegraded":"2023-12-24T20:02:23.571334+0000","last_fullsized":"2023-12-24T20:02:23.571334+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:36.571250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.037722+0000","last_change":"2023-12-24T20:02:23.037474+0000","last_active":"2023-12-24T20:02:23.037722+0000","last_peered":"2023-12-24T20:02:23.037722+0000","last_clean":"2023-12-24T20:02:23.037722+0000","last_became_active":"2023-12-24T20:02:23.037249+0000","last_became_peered":"2023-12-24T20:02:23.037249+0000","last_unstale":"2023-12-24T20:02:23.037722+0000","last_undegraded":"2023-12-24T20:02:23.037722+0000","last_fullsized":"2023-12-24T20:02:23.037722+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:28.247507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572899+0000","last_change":"2023-12-24T20:02:23.572670+0000","last_active":"2023-12-24T20:02:23.572899+0000","last_peered":"2023-12-24T20:02:23.572899+0000","last_clean":"2023-12-24T20:02:23.572899+0000","last_became_active":"2023-12-24T20:02:23.572129+0000","last_became_peered":"2023-12-24T20:02:23.572129+0000","last_unstale":"2023-12-24T20:02:23.572899+0000","last_undegraded":"2023-12-24T20:02:23.572899+0000","last_fullsized":"2023-12-24T20:02:23.572899+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:06:04.064643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.033878+0000","last_change":"2023-12-24T20:02:23.033491+0000","last_active":"2023-12-24T20:02:23.033878+0000","last_peered":"2023-12-24T20:02:23.033878+0000","last_clean":"2023-12-24T20:02:23.033878+0000","last_became_active":"2023-12-24T20:02:23.032194+0000","last_became_peered":"2023-12-24T20:02:23.032194+0000","last_unstale":"2023-12-24T20:02:23.033878+0000","last_undegraded":"2023-12-24T20:02:23.033878+0000","last_fullsized":"2023-12-24T20:02:23.033878+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:10:47.382250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572787+0000","last_change":"2023-12-24T20:02:23.572787+0000","last_active":"2023-12-24T20:02:23.572787+0000","last_peered":"2023-12-24T20:02:23.572787+0000","last_clean":"2023-12-24T20:02:23.572787+0000","last_became_active":"2023-12-24T20:02:23.572570+0000","last_became_peered":"2023-12-24T20:02:23.572570+0000","last_unstale":"2023-12-24T20:02:23.572787+0000","last_undegraded":"2023-12-24T20:02:23.572787+0000","last_fullsized":"2023-12-24T20:02:23.572787+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:42:55.152185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"121'1","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569879+0000","last_change":"2023-12-24T20:02:23.030514+0000","last_active":"2023-12-24T20:02:23.569879+0000","last_peered":"2023-12-24T20:02:23.569879+0000","last_clean":"2023-12-24T20:02:23.569879+0000","last_became_active":"2023-12-24T20:02:23.030365+0000","last_became_peered":"2023-12-24T20:02:23.030365+0000","last_unstale":"2023-12-24T20:02:23.569879+0000","last_undegraded":"2023-12-24T20:02:23.569879+0000","last_fullsized":"2023-12-24T20:02:23.569879+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:28:03.372616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":253,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.022782+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:02:23.022782+0000","last_peered":"2023-12-24T20:02:23.022782+0000","last_clean":"2023-12-24T20:02:23.022782+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:02:23.022782+0000","last_undegraded":"2023-12-24T20:02:23.022782+0000","last_fullsized":"2023-12-24T20:02:23.022782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1224,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194087,"statfs":{"total":200000000,"available":198745945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.501},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70799999999999996,"5min":0.754,"15min":0.754},"last":0.40899999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81799999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.504},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72899999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.61799999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.63700000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.627},"min":{"1min":0.44,"5min":0.437,"15min":0.437},"max":{"1min":0.76800000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71099999999999997}]},{"osd":4,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.503,"15min":0.52900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.621,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.58599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70099999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.55800000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.69399999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.41699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.873,"15min":0.873},"last":0.76700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":654,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194657,"statfs":{"total":200000000,"available":199329513,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76600000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47099999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.53400000000000003},"min":{"1min":0.40100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80900000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54200000000000004,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78900000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.41699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53600000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57399999999999995,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83399999999999996,"5min":1.077,"15min":1.077},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60599999999999998,"15min":0.57499999999999996},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.752,"5min":1.048,"15min":1.048},"last":0.505}]},{"osd":4,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.32900000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72499999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42499999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72999999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.505,"15min":0.499},"min":{"1min":0.37,"5min":0.254,"15min":0.254},"max":{"1min":0.70199999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":648,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194664,"statfs":{"total":200000000,"available":199336425,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.27300000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.5,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.312},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.28399999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59999999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.35199999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.29999999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.57799999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.33500000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41899999999999998,"15min":0.41299999999999998},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.372},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40300000000000002,"15min":0.39500000000000002},"min":{"1min":0.29799999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.29499999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.752,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.47999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59899999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.627,"15min":0.621},"min":{"1min":0.45600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85199999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":0.79800000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46500000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89900000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63700000000000001,"15min":0.61099999999999999},"min":{"1min":0.51100000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84899999999999998,"5min":0.878,"15min":0.878},"last":0.61499999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.87,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66000000000000003,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194087,"statfs":{"total":200000000,"available":198745503,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.35799999999999998,"15min":0.42399999999999999},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.49199999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.27300000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.60999999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.251}]},{"osd":2,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35699999999999998,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52600000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55000000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.29699999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42899999999999999,"15min":0.46500000000000002},"min":{"1min":0.27300000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57499999999999996,"5min":2.573,"15min":2.573},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.42699999999999999,"15min":0.42399999999999999},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59499999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.34699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91400000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.68200000000000005},"min":{"1min":0.47499999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97499999999999998,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.47899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.93400000000000005,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.624},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.65100000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.504,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78100000000000003,"5min":1.655,"15min":1.655},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97499999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59599999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95399999999999996,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.66700000000000004,"15min":0.72699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93200000000000005,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.55400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":648,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194664,"statfs":{"total":200000000,"available":199336391,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.371},"min":{"1min":0.24199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.67700000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.22},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.255}]},{"osd":1,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.23899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.30499999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29999999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.32200000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.47299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65900000000000003,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1559999999999999,"5min":3.577,"15min":3.577},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2809999999999999,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.52300000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.111,"5min":3.637,"15min":3.637},"last":0.51000000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69899999999999995,"15min":0.66100000000000003},"min":{"1min":0.49099999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.141,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.48699999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.232,"5min":1.331,"15min":1.331},"last":0.49399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":649,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334867,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34499999999999997,"15min":0.32800000000000001},"min":{"1min":0.27700000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.48599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.35499999999999998},"min":{"1min":0.30499999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.34799999999999998},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.504,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.438,"5min":0.40300000000000002,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.32900000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.436,"15min":0.42699999999999999},"min":{"1min":0.29399999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.55400000000000005}]},{"osd":4,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84599999999999997,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.875},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":1.337,"15min":1.337},"last":0.73599999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.89900000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.435,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86799999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.874,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.93300000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66600000000000004,"15min":0.64000000000000001},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85799999999999998,"5min":1.006,"15min":1.006},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199328477,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73399999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77300000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63800000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60599999999999998,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.73599999999999999,"5min":4.883,"15min":4.883},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.59299999999999997},"min":{"1min":0.39300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72999999999999998,"5min":1.544,"15min":1.544},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.628,"5min":0.88,"15min":0.88},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.59199999999999997},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69299999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.38900000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70199999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.66000000000000003,"15min":0.89200000000000002},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.45900000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66500000000000004,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.80300000000000005,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.73599999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51800000000000002,"15min":0.53500000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68300000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59299999999999997,"15min":0.63700000000000001},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.751,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.69399999999999995,"15min":1.073},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.63100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":648,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194664,"statfs":{"total":200000000,"available":199336355,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76500000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83299999999999996,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.66300000000000003}]},{"osd":1,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67100000000000004,"5min":1.847,"15min":1.847},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59199999999999997,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.52300000000000002},"min":{"1min":0.42599999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.37,"15min":0.37},"max":{"1min":0.64200000000000002,"5min":1.97,"15min":1.97},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.56999999999999995},"min":{"1min":0.41599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.76400000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.70999999999999996}]},{"osd":4,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66900000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.745}]},{"osd":6,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.73299999999999998}]},{"osd":7,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":3.766,"15min":3.766},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70199999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.75700000000000001}]}]}],"pool_statfs":[]}} 2023-12-24T20:02:28.163 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:02:28.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.318+0000 7f298087f700 1 Processor -- start 2023-12-24T20:02:28.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.318+0000 7f298087f700 1 -- start start 2023-12-24T20:02:28.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.319+0000 7f298087f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f297c15bb60 0x7f297c098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.319+0000 7f298087f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c0b2eb0 con 0x7f297c098aa0 2023-12-24T20:02:28.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.319+0000 7f298087f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c0b2bd0 con 0x7f297c0b2660 2023-12-24T20:02:28.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.319+0000 7f298087f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297c0afc20 con 0x7f297c15bb60 2023-12-24T20:02:28.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.319+0000 7f2979d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f297c098aa0 0x7f297c15bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33812/0 (socket says 172.21.15.61:33812) 2023-12-24T20:02:28.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.319+0000 7f2979d9b700 1 -- 172.21.15.61:0/176249421 learned_addr learned my addr 172.21.15.61:0/176249421 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:28.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.319+0000 7f297a59c700 1 --2- 172.21.15.61:0/176249421 >> v2:172.21.15.133:3300/0 conn(0x7f297c15bb60 0x7f297c098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657274847 0 0) 0x7f297c0b2eb0 con 0x7f297c098aa0 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2964003570 con 0x7f297c098aa0 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3735172462 0 0) 0x7f2964003570 con 0x7f297c098aa0 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 >> v2:172.21.15.133:3300/0 conn(0x7f297c15bb60 msgr2=0x7f297c098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 --2- 172.21.15.61:0/176249421 >> v2:172.21.15.133:3300/0 conn(0x7f297c15bb60 0x7f297c098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 >> v1:172.21.15.133:6789/0 conn(0x7f297c0b2660 legacy=0x7f297c0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0afe10 con 0x7f297c098aa0 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f296c001470 con 0x7f297c098aa0 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 >> v1:172.21.15.61:6789/0 conn(0x7f297c098aa0 legacy=0x7f297c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2964003ab0 0x7f2964003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2964004810 0x7f2964004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2964005210 0x7f296400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296400c180 con 0x7f2964003ab0 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296400c2f0 con 0x7f2964005210 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296400c4b0 con 0x7f2964004810 2023-12-24T20:02:28.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297a59c700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2964003ab0 0x7f2964003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297ad9d700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2964005210 0x7f296400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f2979d9b700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2964004810 0x7f2964004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297a59c700 1 -- 172.21.15.61:0/176249421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2964004810 msgr2=0x7f2964004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297a59c700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2964004810 0x7f2964004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297a59c700 1 -- 172.21.15.61:0/176249421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2964005210 msgr2=0x7f296400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297a59c700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2964005210 0x7f296400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297ad9d700 1 -- 172.21.15.61:0/176249421 reap_dead start 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297a59c700 1 -- 172.21.15.61:0/176249421 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964003570 con 0x7f2964003ab0 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.320+0000 7f297a59c700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2964003ab0 0x7f2964003ec0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2970009bf0 tx=0x7f2970009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5580f58434eb241b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.321+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970005a00 con 0x7f2964003ab0 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.321+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2970005b60 con 0x7f2964003ab0 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.321+0000 7f297959a700 1 -- 172.21.15.61:0/176249421 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000e710 con 0x7f2964003ab0 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.321+0000 7f298087f700 1 -- 172.21.15.61:0/176249421 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2964003ab0 msgr2=0x7f2964003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.321+0000 7f298087f700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2964003ab0 0x7f2964003ec0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2970009bf0 tx=0x7f2970009120 comp rx=0 tx=0).stop 2023-12-24T20:02:28.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.321+0000 7f298087f700 1 -- 172.21.15.61:0/176249421 shutdown_connections 2023-12-24T20:02:28.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.321+0000 7f298087f700 1 --2- 172.21.15.61:0/176249421 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2964003ab0 0x7f2964003ec0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.321+0000 7f298087f700 1 -- 172.21.15.61:0/176249421 >> 172.21.15.61:0/176249421 conn(0x7f297c097a10 msgr2=0x7f297c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:28.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.321+0000 7f298087f700 1 -- 172.21.15.61:0/176249421 shutdown_connections 2023-12-24T20:02:28.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.321+0000 7f298087f700 1 -- 172.21.15.61:0/176249421 wait complete. 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.322+0000 7f298087f700 1 Processor -- start 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.322+0000 7f298087f700 1 -- start start 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f298087f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2964003ab0 0x7f297c0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f298087f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f297c0ce1e0 0x7f297c16ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f298087f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f297c068280 0x7f297c068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f298087f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c069110 con 0x7f297c0ce1e0 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f298087f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c16b060 con 0x7f297c068280 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f298087f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297c067550 con 0x7f2964003ab0 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f2979d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f297c0ce1e0 0x7f297c16ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f2979d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f297c0ce1e0 0x7f297c16ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54442/0 (socket says 172.21.15.61:54442) 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f2979d9b700 1 -- 172.21.15.61:0/16666884 learned_addr learned my addr 172.21.15.61:0/16666884 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f297ad9d700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f297c068280 0x7f297c068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.323+0000 7f297a59c700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2964003ab0 0x7f297c0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f2979d9b700 1 -- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2964003ab0 msgr2=0x7f297c0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f2979d9b700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2964003ab0 0x7f297c0ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f2979d9b700 1 -- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f297c068280 msgr2=0x7f297c068720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f2979d9b700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f297c068280 0x7f297c068720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f2979d9b700 1 -- 172.21.15.61:0/16666884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0ad490 con 0x7f297c0ce1e0 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f2979d9b700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f297c0ce1e0 0x7f297c16ab20 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f296c00e810 tx=0x7f296c000c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f296a7fc700 1 -- 172.21.15.61:0/16666884 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c012590 con 0x7f297c0ce1e0 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f296a7fc700 1 -- 172.21.15.61:0/16666884 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c0126f0 con 0x7f297c0ce1e0 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f298087f700 1 -- 172.21.15.61:0/16666884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c0677a0 con 0x7f297c0ce1e0 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f296a7fc700 1 -- 172.21.15.61:0/16666884 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c012ab0 con 0x7f297c0ce1e0 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.324+0000 7f298087f700 1 -- 172.21.15.61:0/16666884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297c067d60 con 0x7f297c0ce1e0 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.325+0000 7f298087f700 1 -- 172.21.15.61:0/16666884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c06d440 con 0x7f297c0ce1e0 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.325+0000 7f296a7fc700 1 -- 172.21.15.61:0/16666884 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f296c01d460 con 0x7f297c0ce1e0 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.326+0000 7f296a7fc700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f295c067000 0x7f295c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.326+0000 7f296a7fc700 1 -- 172.21.15.61:0/16666884 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f296c084430 con 0x7f297c0ce1e0 2023-12-24T20:02:28.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.326+0000 7f297a59c700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f295c067000 0x7f295c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.326+0000 7f297a59c700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f295c067000 0x7f295c0694b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2970009160 tx=0x7f2970019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:28.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.330+0000 7f296a7fc700 1 -- 172.21.15.61:0/16666884 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f296c051680 con 0x7f297c0ce1e0 2023-12-24T20:02:28.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.518+0000 7f298087f700 1 -- 172.21.15.61:0/16666884 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f297c04c3c0 con 0x7f295c067000 2023-12-24T20:02:28.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.527+0000 7f296a7fc700 1 -- 172.21.15.61:0/16666884 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285516 (secure 0 0 0) 0x7f297c04c3c0 con 0x7f295c067000 2023-12-24T20:02:28.531 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:28.534 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 -- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f295c067000 msgr2=0x7f295c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.534 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f295c067000 0x7f295c0694b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2970009160 tx=0x7f2970019000 comp rx=0 tx=0).stop 2023-12-24T20:02:28.534 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 -- 172.21.15.61:0/16666884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f297c0ce1e0 msgr2=0x7f297c16ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f297c0ce1e0 0x7f297c16ab20 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f296c00e810 tx=0x7f296c000c80 comp rx=0 tx=0).stop 2023-12-24T20:02:28.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 -- 172.21.15.61:0/16666884 shutdown_connections 2023-12-24T20:02:28.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2964003ab0 0x7f297c0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f295c067000 0x7f295c0694b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f297c068280 0x7f297c068720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 --2- 172.21.15.61:0/16666884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f297c0ce1e0 0x7f297c16ab20 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 -- 172.21.15.61:0/16666884 >> 172.21.15.61:0/16666884 conn(0x7f297c097a10 msgr2=0x7f297c158250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:28.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 -- 172.21.15.61:0/16666884 shutdown_connections 2023-12-24T20:02:28.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.530+0000 7f298087f700 1 -- 172.21.15.61:0/16666884 wait complete. 2023-12-24T20:02:28.535 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:02:28.543 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2023-12-24T20:02:28.386171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6354,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556145,"statfs":{"total":1600000000,"available":1593493476,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001429"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569198+0000","last_change":"2023-12-24T20:02:23.569139+0000","last_active":"2023-12-24T20:02:23.569198+0000","last_peered":"2023-12-24T20:02:23.569198+0000","last_clean":"2023-12-24T20:02:23.569198+0000","last_became_active":"2023-12-24T20:02:23.568917+0000","last_became_peered":"2023-12-24T20:02:23.568917+0000","last_unstale":"2023-12-24T20:02:23.569198+0000","last_undegraded":"2023-12-24T20:02:23.569198+0000","last_fullsized":"2023-12-24T20:02:23.569198+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:54.691218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.563386+0000","last_change":"2023-12-24T20:02:23.563319+0000","last_active":"2023-12-24T20:02:23.563386+0000","last_peered":"2023-12-24T20:02:23.563386+0000","last_clean":"2023-12-24T20:02:23.563386+0000","last_became_active":"2023-12-24T20:02:23.562800+0000","last_became_peered":"2023-12-24T20:02:23.562800+0000","last_unstale":"2023-12-24T20:02:23.563386+0000","last_undegraded":"2023-12-24T20:02:23.563386+0000","last_fullsized":"2023-12-24T20:02:23.563386+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:26.596303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568193+0000","last_change":"2023-12-24T20:02:23.568135+0000","last_active":"2023-12-24T20:02:23.568193+0000","last_peered":"2023-12-24T20:02:23.568193+0000","last_clean":"2023-12-24T20:02:23.568193+0000","last_became_active":"2023-12-24T20:02:23.567913+0000","last_became_peered":"2023-12-24T20:02:23.567913+0000","last_unstale":"2023-12-24T20:02:23.568193+0000","last_undegraded":"2023-12-24T20:02:23.568193+0000","last_fullsized":"2023-12-24T20:02:23.568193+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:21:34.811234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569269+0000","last_change":"2023-12-24T20:02:23.569269+0000","last_active":"2023-12-24T20:02:23.569269+0000","last_peered":"2023-12-24T20:02:23.569269+0000","last_clean":"2023-12-24T20:02:23.569269+0000","last_became_active":"2023-12-24T20:02:23.569066+0000","last_became_peered":"2023-12-24T20:02:23.569066+0000","last_unstale":"2023-12-24T20:02:23.569269+0000","last_undegraded":"2023-12-24T20:02:23.569269+0000","last_fullsized":"2023-12-24T20:02:23.569269+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:52.075459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569906+0000","last_change":"2023-12-24T20:02:23.569843+0000","last_active":"2023-12-24T20:02:23.569906+0000","last_peered":"2023-12-24T20:02:23.569906+0000","last_clean":"2023-12-24T20:02:23.569906+0000","last_became_active":"2023-12-24T20:02:23.569630+0000","last_became_peered":"2023-12-24T20:02:23.569630+0000","last_unstale":"2023-12-24T20:02:23.569906+0000","last_undegraded":"2023-12-24T20:02:23.569906+0000","last_fullsized":"2023-12-24T20:02:23.569906+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:28:24.326359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.573707+0000","last_change":"2023-12-24T20:02:23.573707+0000","last_active":"2023-12-24T20:02:23.573707+0000","last_peered":"2023-12-24T20:02:23.573707+0000","last_clean":"2023-12-24T20:02:23.573707+0000","last_became_active":"2023-12-24T20:02:23.573457+0000","last_became_peered":"2023-12-24T20:02:23.573457+0000","last_unstale":"2023-12-24T20:02:23.573707+0000","last_undegraded":"2023-12-24T20:02:23.573707+0000","last_fullsized":"2023-12-24T20:02:23.573707+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:54:59.084379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568107+0000","last_change":"2023-12-24T20:02:23.568107+0000","last_active":"2023-12-24T20:02:23.568107+0000","last_peered":"2023-12-24T20:02:23.568107+0000","last_clean":"2023-12-24T20:02:23.568107+0000","last_became_active":"2023-12-24T20:02:23.567875+0000","last_became_peered":"2023-12-24T20:02:23.567875+0000","last_unstale":"2023-12-24T20:02:23.568107+0000","last_undegraded":"2023-12-24T20:02:23.568107+0000","last_fullsized":"2023-12-24T20:02:23.568107+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:56:41.317326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569565+0000","last_change":"2023-12-24T20:02:23.569507+0000","last_active":"2023-12-24T20:02:23.569565+0000","last_peered":"2023-12-24T20:02:23.569565+0000","last_clean":"2023-12-24T20:02:23.569565+0000","last_became_active":"2023-12-24T20:02:23.569194+0000","last_became_peered":"2023-12-24T20:02:23.569194+0000","last_unstale":"2023-12-24T20:02:23.569565+0000","last_undegraded":"2023-12-24T20:02:23.569565+0000","last_fullsized":"2023-12-24T20:02:23.569565+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:01:20.708433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570579+0000","last_change":"2023-12-24T20:02:23.570460+0000","last_active":"2023-12-24T20:02:23.570579+0000","last_peered":"2023-12-24T20:02:23.570579+0000","last_clean":"2023-12-24T20:02:23.570579+0000","last_became_active":"2023-12-24T20:02:23.569983+0000","last_became_peered":"2023-12-24T20:02:23.569983+0000","last_unstale":"2023-12-24T20:02:23.570579+0000","last_undegraded":"2023-12-24T20:02:23.570579+0000","last_fullsized":"2023-12-24T20:02:23.570579+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:06:04.064643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568086+0000","last_change":"2023-12-24T20:02:23.568020+0000","last_active":"2023-12-24T20:02:23.568086+0000","last_peered":"2023-12-24T20:02:23.568086+0000","last_clean":"2023-12-24T20:02:23.568086+0000","last_became_active":"2023-12-24T20:02:23.567713+0000","last_became_peered":"2023-12-24T20:02:23.567713+0000","last_unstale":"2023-12-24T20:02:23.568086+0000","last_undegraded":"2023-12-24T20:02:23.568086+0000","last_fullsized":"2023-12-24T20:02:23.568086+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:53.703650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571316+0000","last_change":"2023-12-24T20:02:23.571316+0000","last_active":"2023-12-24T20:02:23.571316+0000","last_peered":"2023-12-24T20:02:23.571316+0000","last_clean":"2023-12-24T20:02:23.571316+0000","last_became_active":"2023-12-24T20:02:23.570561+0000","last_became_peered":"2023-12-24T20:02:23.570561+0000","last_unstale":"2023-12-24T20:02:23.571316+0000","last_undegraded":"2023-12-24T20:02:23.571316+0000","last_fullsized":"2023-12-24T20:02:23.571316+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:24.429255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568903+0000","last_change":"2023-12-24T20:02:23.568736+0000","last_active":"2023-12-24T20:02:23.568903+0000","last_peered":"2023-12-24T20:02:23.568903+0000","last_clean":"2023-12-24T20:02:23.568903+0000","last_became_active":"2023-12-24T20:02:23.568545+0000","last_became_peered":"2023-12-24T20:02:23.568545+0000","last_unstale":"2023-12-24T20:02:23.568903+0000","last_undegraded":"2023-12-24T20:02:23.568903+0000","last_fullsized":"2023-12-24T20:02:23.568903+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:41.645930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569936+0000","last_change":"2023-12-24T20:02:23.569936+0000","last_active":"2023-12-24T20:02:23.569936+0000","last_peered":"2023-12-24T20:02:23.569936+0000","last_clean":"2023-12-24T20:02:23.569936+0000","last_became_active":"2023-12-24T20:02:23.569768+0000","last_became_peered":"2023-12-24T20:02:23.569768+0000","last_unstale":"2023-12-24T20:02:23.569936+0000","last_undegraded":"2023-12-24T20:02:23.569936+0000","last_fullsized":"2023-12-24T20:02:23.569936+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:04:35.842656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.567027+0000","last_change":"2023-12-24T20:02:23.567027+0000","last_active":"2023-12-24T20:02:23.567027+0000","last_peered":"2023-12-24T20:02:23.567027+0000","last_clean":"2023-12-24T20:02:23.567027+0000","last_became_active":"2023-12-24T20:02:23.566685+0000","last_became_peered":"2023-12-24T20:02:23.566685+0000","last_unstale":"2023-12-24T20:02:23.567027+0000","last_undegraded":"2023-12-24T20:02:23.567027+0000","last_fullsized":"2023-12-24T20:02:23.567027+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:37:54.691218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569108+0000","last_change":"2023-12-24T20:02:23.569108+0000","last_active":"2023-12-24T20:02:23.569108+0000","last_peered":"2023-12-24T20:02:23.569108+0000","last_clean":"2023-12-24T20:02:23.569108+0000","last_became_active":"2023-12-24T20:02:23.568392+0000","last_became_peered":"2023-12-24T20:02:23.568392+0000","last_unstale":"2023-12-24T20:02:23.569108+0000","last_undegraded":"2023-12-24T20:02:23.569108+0000","last_fullsized":"2023-12-24T20:02:23.569108+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:24.429255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.573209+0000","last_change":"2023-12-24T20:02:23.573209+0000","last_active":"2023-12-24T20:02:23.573209+0000","last_peered":"2023-12-24T20:02:23.573209+0000","last_clean":"2023-12-24T20:02:23.573209+0000","last_became_active":"2023-12-24T20:02:23.572935+0000","last_became_peered":"2023-12-24T20:02:23.572935+0000","last_unstale":"2023-12-24T20:02:23.573209+0000","last_undegraded":"2023-12-24T20:02:23.573209+0000","last_fullsized":"2023-12-24T20:02:23.573209+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:47.887151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570918+0000","last_change":"2023-12-24T20:02:23.570855+0000","last_active":"2023-12-24T20:02:23.570918+0000","last_peered":"2023-12-24T20:02:23.570918+0000","last_clean":"2023-12-24T20:02:23.570918+0000","last_became_active":"2023-12-24T20:02:23.570711+0000","last_became_peered":"2023-12-24T20:02:23.570711+0000","last_unstale":"2023-12-24T20:02:23.570918+0000","last_undegraded":"2023-12-24T20:02:23.570918+0000","last_fullsized":"2023-12-24T20:02:23.570918+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:07:01.723607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.573430+0000","last_change":"2023-12-24T20:02:23.573430+0000","last_active":"2023-12-24T20:02:23.573430+0000","last_peered":"2023-12-24T20:02:23.573430+0000","last_clean":"2023-12-24T20:02:23.573430+0000","last_became_active":"2023-12-24T20:02:23.573184+0000","last_became_peered":"2023-12-24T20:02:23.573184+0000","last_unstale":"2023-12-24T20:02:23.573430+0000","last_undegraded":"2023-12-24T20:02:23.573430+0000","last_fullsized":"2023-12-24T20:02:23.573430+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:10:36.193427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.566864+0000","last_change":"2023-12-24T20:02:23.566864+0000","last_active":"2023-12-24T20:02:23.566864+0000","last_peered":"2023-12-24T20:02:23.566864+0000","last_clean":"2023-12-24T20:02:23.566864+0000","last_became_active":"2023-12-24T20:02:23.566374+0000","last_became_peered":"2023-12-24T20:02:23.566374+0000","last_unstale":"2023-12-24T20:02:23.566864+0000","last_undegraded":"2023-12-24T20:02:23.566864+0000","last_fullsized":"2023-12-24T20:02:23.566864+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:40.781529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571841+0000","last_change":"2023-12-24T20:02:23.571302+0000","last_active":"2023-12-24T20:02:23.571841+0000","last_peered":"2023-12-24T20:02:23.571841+0000","last_clean":"2023-12-24T20:02:23.571841+0000","last_became_active":"2023-12-24T20:02:23.571074+0000","last_became_peered":"2023-12-24T20:02:23.571074+0000","last_unstale":"2023-12-24T20:02:23.571841+0000","last_undegraded":"2023-12-24T20:02:23.571841+0000","last_fullsized":"2023-12-24T20:02:23.571841+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:22.864773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.560703+0000","last_change":"2023-12-24T20:02:23.560703+0000","last_active":"2023-12-24T20:02:23.560703+0000","last_peered":"2023-12-24T20:02:23.560703+0000","last_clean":"2023-12-24T20:02:23.560703+0000","last_became_active":"2023-12-24T20:02:23.560536+0000","last_became_peered":"2023-12-24T20:02:23.560536+0000","last_unstale":"2023-12-24T20:02:23.560703+0000","last_undegraded":"2023-12-24T20:02:23.560703+0000","last_fullsized":"2023-12-24T20:02:23.560703+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:29:52.658393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.563519+0000","last_change":"2023-12-24T20:02:23.563459+0000","last_active":"2023-12-24T20:02:23.563519+0000","last_peered":"2023-12-24T20:02:23.563519+0000","last_clean":"2023-12-24T20:02:23.563519+0000","last_became_active":"2023-12-24T20:02:23.563100+0000","last_became_peered":"2023-12-24T20:02:23.563100+0000","last_unstale":"2023-12-24T20:02:23.563519+0000","last_undegraded":"2023-12-24T20:02:23.563519+0000","last_fullsized":"2023-12-24T20:02:23.563519+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:08:44.638549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.563538+0000","last_change":"2023-12-24T20:02:23.563470+0000","last_active":"2023-12-24T20:02:23.563538+0000","last_peered":"2023-12-24T20:02:23.563538+0000","last_clean":"2023-12-24T20:02:23.563538+0000","last_became_active":"2023-12-24T20:02:23.563115+0000","last_became_peered":"2023-12-24T20:02:23.563115+0000","last_unstale":"2023-12-24T20:02:23.563538+0000","last_undegraded":"2023-12-24T20:02:23.563538+0000","last_fullsized":"2023-12-24T20:02:23.563538+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:14:26.335698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571847+0000","last_change":"2023-12-24T20:02:23.571847+0000","last_active":"2023-12-24T20:02:23.571847+0000","last_peered":"2023-12-24T20:02:23.571847+0000","last_clean":"2023-12-24T20:02:23.571847+0000","last_became_active":"2023-12-24T20:02:23.571614+0000","last_became_peered":"2023-12-24T20:02:23.571614+0000","last_unstale":"2023-12-24T20:02:23.571847+0000","last_undegraded":"2023-12-24T20:02:23.571847+0000","last_fullsized":"2023-12-24T20:02:23.571847+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:47.602893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.574563+0000","last_change":"2023-12-24T20:02:23.574507+0000","last_active":"2023-12-24T20:02:23.574563+0000","last_peered":"2023-12-24T20:02:23.574563+0000","last_clean":"2023-12-24T20:02:23.574563+0000","last_became_active":"2023-12-24T20:02:23.574229+0000","last_became_peered":"2023-12-24T20:02:23.574229+0000","last_unstale":"2023-12-24T20:02:23.574563+0000","last_undegraded":"2023-12-24T20:02:23.574563+0000","last_fullsized":"2023-12-24T20:02:23.574563+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:24.429255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571782+0000","last_change":"2023-12-24T20:02:23.571727+0000","last_active":"2023-12-24T20:02:23.571782+0000","last_peered":"2023-12-24T20:02:23.571782+0000","last_clean":"2023-12-24T20:02:23.571782+0000","last_became_active":"2023-12-24T20:02:23.571107+0000","last_became_peered":"2023-12-24T20:02:23.571107+0000","last_unstale":"2023-12-24T20:02:23.571782+0000","last_undegraded":"2023-12-24T20:02:23.571782+0000","last_fullsized":"2023-12-24T20:02:23.571782+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:24.089160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569833+0000","last_change":"2023-12-24T20:02:23.569833+0000","last_active":"2023-12-24T20:02:23.569833+0000","last_peered":"2023-12-24T20:02:23.569833+0000","last_clean":"2023-12-24T20:02:23.569833+0000","last_became_active":"2023-12-24T20:02:23.569584+0000","last_became_peered":"2023-12-24T20:02:23.569584+0000","last_unstale":"2023-12-24T20:02:23.569833+0000","last_undegraded":"2023-12-24T20:02:23.569833+0000","last_fullsized":"2023-12-24T20:02:23.569833+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:12.529600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572917+0000","last_change":"2023-12-24T20:02:23.572810+0000","last_active":"2023-12-24T20:02:23.572917+0000","last_peered":"2023-12-24T20:02:23.572917+0000","last_clean":"2023-12-24T20:02:23.572917+0000","last_became_active":"2023-12-24T20:02:23.572441+0000","last_became_peered":"2023-12-24T20:02:23.572441+0000","last_unstale":"2023-12-24T20:02:23.572917+0000","last_undegraded":"2023-12-24T20:02:23.572917+0000","last_fullsized":"2023-12-24T20:02:23.572917+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:22.864773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568442+0000","last_change":"2023-12-24T20:02:23.568143+0000","last_active":"2023-12-24T20:02:23.568442+0000","last_peered":"2023-12-24T20:02:23.568442+0000","last_clean":"2023-12-24T20:02:23.568442+0000","last_became_active":"2023-12-24T20:02:23.567924+0000","last_became_peered":"2023-12-24T20:02:23.567924+0000","last_unstale":"2023-12-24T20:02:23.568442+0000","last_undegraded":"2023-12-24T20:02:23.568442+0000","last_fullsized":"2023-12-24T20:02:23.568442+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:13:45.227757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.565209+0000","last_change":"2023-12-24T20:02:23.565209+0000","last_active":"2023-12-24T20:02:23.565209+0000","last_peered":"2023-12-24T20:02:23.565209+0000","last_clean":"2023-12-24T20:02:23.565209+0000","last_became_active":"2023-12-24T20:02:23.564988+0000","last_became_peered":"2023-12-24T20:02:23.564988+0000","last_unstale":"2023-12-24T20:02:23.565209+0000","last_undegraded":"2023-12-24T20:02:23.565209+0000","last_fullsized":"2023-12-24T20:02:23.565209+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:05:40.098061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570202+0000","last_change":"2023-12-24T20:02:23.570202+0000","last_active":"2023-12-24T20:02:23.570202+0000","last_peered":"2023-12-24T20:02:23.570202+0000","last_clean":"2023-12-24T20:02:23.570202+0000","last_became_active":"2023-12-24T20:02:23.569827+0000","last_became_peered":"2023-12-24T20:02:23.569827+0000","last_unstale":"2023-12-24T20:02:23.570202+0000","last_undegraded":"2023-12-24T20:02:23.570202+0000","last_fullsized":"2023-12-24T20:02:23.570202+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:22.864773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.567791+0000","last_change":"2023-12-24T20:02:23.567568+0000","last_active":"2023-12-24T20:02:23.567791+0000","last_peered":"2023-12-24T20:02:23.567791+0000","last_clean":"2023-12-24T20:02:23.567791+0000","last_became_active":"2023-12-24T20:02:23.567082+0000","last_became_peered":"2023-12-24T20:02:23.567082+0000","last_unstale":"2023-12-24T20:02:23.567791+0000","last_undegraded":"2023-12-24T20:02:23.567791+0000","last_fullsized":"2023-12-24T20:02:23.567791+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:16.773234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.574051+0000","last_change":"2023-12-24T20:02:23.574051+0000","last_active":"2023-12-24T20:02:23.574051+0000","last_peered":"2023-12-24T20:02:23.574051+0000","last_clean":"2023-12-24T20:02:23.574051+0000","last_became_active":"2023-12-24T20:02:23.573645+0000","last_became_peered":"2023-12-24T20:02:23.573645+0000","last_unstale":"2023-12-24T20:02:23.574051+0000","last_undegraded":"2023-12-24T20:02:23.574051+0000","last_fullsized":"2023-12-24T20:02:23.574051+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:16:36.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"121'4","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.045429+0000","last_change":"2023-12-24T20:02:23.024611+0000","last_active":"2023-12-24T20:02:24.045429+0000","last_peered":"2023-12-24T20:02:24.045429+0000","last_clean":"2023-12-24T20:02:24.045429+0000","last_became_active":"2023-12-24T20:02:23.024351+0000","last_became_peered":"2023-12-24T20:02:23.024351+0000","last_unstale":"2023-12-24T20:02:24.045429+0000","last_undegraded":"2023-12-24T20:02:24.045429+0000","last_fullsized":"2023-12-24T20:02:24.045429+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:21.863234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.574271+0000","last_change":"2023-12-24T20:02:23.574271+0000","last_active":"2023-12-24T20:02:23.574271+0000","last_peered":"2023-12-24T20:02:23.574271+0000","last_clean":"2023-12-24T20:02:23.574271+0000","last_became_active":"2023-12-24T20:02:23.574058+0000","last_became_peered":"2023-12-24T20:02:23.574058+0000","last_unstale":"2023-12-24T20:02:23.574271+0000","last_undegraded":"2023-12-24T20:02:23.574271+0000","last_fullsized":"2023-12-24T20:02:23.574271+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:06:04.064643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"121'1","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569779+0000","last_change":"2023-12-24T20:02:23.025063+0000","last_active":"2023-12-24T20:02:23.569779+0000","last_peered":"2023-12-24T20:02:23.569779+0000","last_clean":"2023-12-24T20:02:23.569779+0000","last_became_active":"2023-12-24T20:02:23.024811+0000","last_became_peered":"2023-12-24T20:02:23.024811+0000","last_unstale":"2023-12-24T20:02:23.569779+0000","last_undegraded":"2023-12-24T20:02:23.569779+0000","last_fullsized":"2023-12-24T20:02:23.569779+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:06:59.835841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569696+0000","last_change":"2023-12-24T20:02:23.569637+0000","last_active":"2023-12-24T20:02:23.569696+0000","last_peered":"2023-12-24T20:02:23.569696+0000","last_clean":"2023-12-24T20:02:23.569696+0000","last_became_active":"2023-12-24T20:02:23.569419+0000","last_became_peered":"2023-12-24T20:02:23.569419+0000","last_unstale":"2023-12-24T20:02:23.569696+0000","last_undegraded":"2023-12-24T20:02:23.569696+0000","last_fullsized":"2023-12-24T20:02:23.569696+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:36.571250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.044918+0000","last_change":"2023-12-24T20:02:23.032237+0000","last_active":"2023-12-24T20:02:24.044918+0000","last_peered":"2023-12-24T20:02:24.044918+0000","last_clean":"2023-12-24T20:02:24.044918+0000","last_became_active":"2023-12-24T20:02:23.031666+0000","last_became_peered":"2023-12-24T20:02:23.031666+0000","last_unstale":"2023-12-24T20:02:24.044918+0000","last_undegraded":"2023-12-24T20:02:24.044918+0000","last_fullsized":"2023-12-24T20:02:24.044918+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:10:35.191888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571857+0000","last_change":"2023-12-24T20:02:23.571781+0000","last_active":"2023-12-24T20:02:23.571857+0000","last_peered":"2023-12-24T20:02:23.571857+0000","last_clean":"2023-12-24T20:02:23.571857+0000","last_became_active":"2023-12-24T20:02:23.571532+0000","last_became_peered":"2023-12-24T20:02:23.571532+0000","last_unstale":"2023-12-24T20:02:23.571857+0000","last_undegraded":"2023-12-24T20:02:23.571857+0000","last_fullsized":"2023-12-24T20:02:23.571857+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:32.581915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.044083+0000","last_change":"2023-12-24T20:02:23.029755+0000","last_active":"2023-12-24T20:02:24.044083+0000","last_peered":"2023-12-24T20:02:24.044083+0000","last_clean":"2023-12-24T20:02:24.044083+0000","last_became_active":"2023-12-24T20:02:23.029531+0000","last_became_peered":"2023-12-24T20:02:23.029531+0000","last_unstale":"2023-12-24T20:02:24.044083+0000","last_undegraded":"2023-12-24T20:02:24.044083+0000","last_fullsized":"2023-12-24T20:02:24.044083+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:52.702111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570676+0000","last_change":"2023-12-24T20:02:23.570450+0000","last_active":"2023-12-24T20:02:23.570676+0000","last_peered":"2023-12-24T20:02:23.570676+0000","last_clean":"2023-12-24T20:02:23.570676+0000","last_became_active":"2023-12-24T20:02:23.570212+0000","last_became_peered":"2023-12-24T20:02:23.570212+0000","last_unstale":"2023-12-24T20:02:23.570676+0000","last_undegraded":"2023-12-24T20:02:23.570676+0000","last_fullsized":"2023-12-24T20:02:23.570676+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:41:11.025292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.043178+0000","last_change":"2023-12-24T20:02:23.028192+0000","last_active":"2023-12-24T20:02:24.043178+0000","last_peered":"2023-12-24T20:02:24.043178+0000","last_clean":"2023-12-24T20:02:24.043178+0000","last_became_active":"2023-12-24T20:02:23.027863+0000","last_became_peered":"2023-12-24T20:02:23.027863+0000","last_unstale":"2023-12-24T20:02:24.043178+0000","last_undegraded":"2023-12-24T20:02:24.043178+0000","last_fullsized":"2023-12-24T20:02:24.043178+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:12:52.307394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572257+0000","last_change":"2023-12-24T20:02:23.572257+0000","last_active":"2023-12-24T20:02:23.572257+0000","last_peered":"2023-12-24T20:02:23.572257+0000","last_clean":"2023-12-24T20:02:23.572257+0000","last_became_active":"2023-12-24T20:02:23.572034+0000","last_became_peered":"2023-12-24T20:02:23.572034+0000","last_unstale":"2023-12-24T20:02:23.572257+0000","last_undegraded":"2023-12-24T20:02:23.572257+0000","last_fullsized":"2023-12-24T20:02:23.572257+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:41.645930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.045159+0000","last_change":"2023-12-24T20:02:23.021301+0000","last_active":"2023-12-24T20:02:24.045159+0000","last_peered":"2023-12-24T20:02:24.045159+0000","last_clean":"2023-12-24T20:02:24.045159+0000","last_became_active":"2023-12-24T20:02:23.021136+0000","last_became_peered":"2023-12-24T20:02:23.021136+0000","last_unstale":"2023-12-24T20:02:24.045159+0000","last_undegraded":"2023-12-24T20:02:24.045159+0000","last_fullsized":"2023-12-24T20:02:24.045159+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:06:03.063104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569289+0000","last_change":"2023-12-24T20:02:23.569289+0000","last_active":"2023-12-24T20:02:23.569289+0000","last_peered":"2023-12-24T20:02:23.569289+0000","last_clean":"2023-12-24T20:02:23.569289+0000","last_became_active":"2023-12-24T20:02:23.568817+0000","last_became_peered":"2023-12-24T20:02:23.568817+0000","last_unstale":"2023-12-24T20:02:23.569289+0000","last_undegraded":"2023-12-24T20:02:23.569289+0000","last_fullsized":"2023-12-24T20:02:23.569289+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:53.703650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.564665+0000","last_change":"2023-12-24T20:02:23.026711+0000","last_active":"2023-12-24T20:02:23.564665+0000","last_peered":"2023-12-24T20:02:23.564665+0000","last_clean":"2023-12-24T20:02:23.564665+0000","last_became_active":"2023-12-24T20:02:23.026248+0000","last_became_peered":"2023-12-24T20:02:23.026248+0000","last_unstale":"2023-12-24T20:02:23.564665+0000","last_undegraded":"2023-12-24T20:02:23.564665+0000","last_fullsized":"2023-12-24T20:02:23.564665+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:22:27.830486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.575463+0000","last_change":"2023-12-24T20:02:23.575390+0000","last_active":"2023-12-24T20:02:23.575463+0000","last_peered":"2023-12-24T20:02:23.575463+0000","last_clean":"2023-12-24T20:02:23.575463+0000","last_became_active":"2023-12-24T20:02:23.572189+0000","last_became_peered":"2023-12-24T20:02:23.572189+0000","last_unstale":"2023-12-24T20:02:23.575463+0000","last_undegraded":"2023-12-24T20:02:23.575463+0000","last_fullsized":"2023-12-24T20:02:23.575463+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:16.154734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.564055+0000","last_change":"2023-12-24T20:02:23.034672+0000","last_active":"2023-12-24T20:02:23.564055+0000","last_peered":"2023-12-24T20:02:23.564055+0000","last_clean":"2023-12-24T20:02:23.564055+0000","last_became_active":"2023-12-24T20:02:23.034446+0000","last_became_peered":"2023-12-24T20:02:23.034446+0000","last_unstale":"2023-12-24T20:02:23.564055+0000","last_undegraded":"2023-12-24T20:02:23.564055+0000","last_fullsized":"2023-12-24T20:02:23.564055+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:45:45.467872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570119+0000","last_change":"2023-12-24T20:02:23.570057+0000","last_active":"2023-12-24T20:02:23.570119+0000","last_peered":"2023-12-24T20:02:23.570119+0000","last_clean":"2023-12-24T20:02:23.570119+0000","last_became_active":"2023-12-24T20:02:23.569843+0000","last_became_peered":"2023-12-24T20:02:23.569843+0000","last_unstale":"2023-12-24T20:02:23.570119+0000","last_undegraded":"2023-12-24T20:02:23.570119+0000","last_fullsized":"2023-12-24T20:02:23.570119+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:34.786744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.564535+0000","last_change":"2023-12-24T20:02:23.019942+0000","last_active":"2023-12-24T20:02:23.564535+0000","last_peered":"2023-12-24T20:02:23.564535+0000","last_clean":"2023-12-24T20:02:23.564535+0000","last_became_active":"2023-12-24T20:02:23.019691+0000","last_became_peered":"2023-12-24T20:02:23.019691+0000","last_unstale":"2023-12-24T20:02:23.564535+0000","last_undegraded":"2023-12-24T20:02:23.564535+0000","last_fullsized":"2023-12-24T20:02:23.564535+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:31:32.567507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.575445+0000","last_change":"2023-12-24T20:02:23.575379+0000","last_active":"2023-12-24T20:02:23.575445+0000","last_peered":"2023-12-24T20:02:23.575445+0000","last_clean":"2023-12-24T20:02:23.575445+0000","last_became_active":"2023-12-24T20:02:23.575125+0000","last_became_peered":"2023-12-24T20:02:23.575125+0000","last_unstale":"2023-12-24T20:02:23.575445+0000","last_undegraded":"2023-12-24T20:02:23.575445+0000","last_fullsized":"2023-12-24T20:02:23.575445+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:28:24.326359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.035715+0000","last_change":"2023-12-24T20:02:23.035629+0000","last_active":"2023-12-24T20:02:23.035715+0000","last_peered":"2023-12-24T20:02:23.035715+0000","last_clean":"2023-12-24T20:02:23.035715+0000","last_became_active":"2023-12-24T20:02:23.035417+0000","last_became_peered":"2023-12-24T20:02:23.035417+0000","last_unstale":"2023-12-24T20:02:23.035715+0000","last_undegraded":"2023-12-24T20:02:23.035715+0000","last_fullsized":"2023-12-24T20:02:23.035715+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:16:08.178078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568468+0000","last_change":"2023-12-24T20:02:23.568312+0000","last_active":"2023-12-24T20:02:23.568468+0000","last_peered":"2023-12-24T20:02:23.568468+0000","last_clean":"2023-12-24T20:02:23.568468+0000","last_became_active":"2023-12-24T20:02:23.567734+0000","last_became_peered":"2023-12-24T20:02:23.567734+0000","last_unstale":"2023-12-24T20:02:23.568468+0000","last_undegraded":"2023-12-24T20:02:23.568468+0000","last_fullsized":"2023-12-24T20:02:23.568468+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:04:35.842656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"121'3","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.043610+0000","last_change":"2023-12-24T20:02:23.027251+0000","last_active":"2023-12-24T20:02:24.043610+0000","last_peered":"2023-12-24T20:02:24.043610+0000","last_clean":"2023-12-24T20:02:24.043610+0000","last_became_active":"2023-12-24T20:02:23.027007+0000","last_became_peered":"2023-12-24T20:02:23.027007+0000","last_unstale":"2023-12-24T20:02:24.043610+0000","last_undegraded":"2023-12-24T20:02:24.043610+0000","last_fullsized":"2023-12-24T20:02:24.043610+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:57:56.764425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571969+0000","last_change":"2023-12-24T20:02:23.571969+0000","last_active":"2023-12-24T20:02:23.571969+0000","last_peered":"2023-12-24T20:02:23.571969+0000","last_clean":"2023-12-24T20:02:23.571969+0000","last_became_active":"2023-12-24T20:02:23.571129+0000","last_became_peered":"2023-12-24T20:02:23.571129+0000","last_unstale":"2023-12-24T20:02:23.571969+0000","last_undegraded":"2023-12-24T20:02:23.571969+0000","last_fullsized":"2023-12-24T20:02:23.571969+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:56:12.316892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"121'6","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.047293+0000","last_change":"2023-12-24T20:02:23.031232+0000","last_active":"2023-12-24T20:02:24.047293+0000","last_peered":"2023-12-24T20:02:24.047293+0000","last_clean":"2023-12-24T20:02:24.047293+0000","last_became_active":"2023-12-24T20:02:23.030979+0000","last_became_peered":"2023-12-24T20:02:23.030979+0000","last_unstale":"2023-12-24T20:02:24.047293+0000","last_undegraded":"2023-12-24T20:02:24.047293+0000","last_fullsized":"2023-12-24T20:02:24.047293+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:46.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.570099+0000","last_change":"2023-12-24T20:02:23.570099+0000","last_active":"2023-12-24T20:02:23.570099+0000","last_peered":"2023-12-24T20:02:23.570099+0000","last_clean":"2023-12-24T20:02:23.570099+0000","last_became_active":"2023-12-24T20:02:23.569608+0000","last_became_peered":"2023-12-24T20:02:23.569608+0000","last_unstale":"2023-12-24T20:02:23.570099+0000","last_undegraded":"2023-12-24T20:02:23.570099+0000","last_fullsized":"2023-12-24T20:02:23.570099+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:32.581915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"121'2","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.045638+0000","last_change":"2023-12-24T20:02:23.031756+0000","last_active":"2023-12-24T20:02:24.045638+0000","last_peered":"2023-12-24T20:02:24.045638+0000","last_clean":"2023-12-24T20:02:24.045638+0000","last_became_active":"2023-12-24T20:02:23.031368+0000","last_became_peered":"2023-12-24T20:02:23.031368+0000","last_unstale":"2023-12-24T20:02:24.045638+0000","last_undegraded":"2023-12-24T20:02:24.045638+0000","last_fullsized":"2023-12-24T20:02:24.045638+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:05:55.724030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.565588+0000","last_change":"2023-12-24T20:02:23.565523+0000","last_active":"2023-12-24T20:02:23.565588+0000","last_peered":"2023-12-24T20:02:23.565588+0000","last_clean":"2023-12-24T20:02:23.565588+0000","last_became_active":"2023-12-24T20:02:23.565160+0000","last_became_peered":"2023-12-24T20:02:23.565160+0000","last_unstale":"2023-12-24T20:02:23.565588+0000","last_undegraded":"2023-12-24T20:02:23.565588+0000","last_fullsized":"2023-12-24T20:02:23.565588+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:27:26.852338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.027121+0000","last_change":"2023-12-24T20:02:23.027059+0000","last_active":"2023-12-24T20:02:23.027121+0000","last_peered":"2023-12-24T20:02:23.027121+0000","last_clean":"2023-12-24T20:02:23.027121+0000","last_became_active":"2023-12-24T20:02:23.026830+0000","last_became_peered":"2023-12-24T20:02:23.026830+0000","last_unstale":"2023-12-24T20:02:23.027121+0000","last_undegraded":"2023-12-24T20:02:23.027121+0000","last_fullsized":"2023-12-24T20:02:23.027121+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:16:08.754612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.575479+0000","last_change":"2023-12-24T20:02:23.575399+0000","last_active":"2023-12-24T20:02:23.575479+0000","last_peered":"2023-12-24T20:02:23.575479+0000","last_clean":"2023-12-24T20:02:23.575479+0000","last_became_active":"2023-12-24T20:02:23.575143+0000","last_became_peered":"2023-12-24T20:02:23.575143+0000","last_unstale":"2023-12-24T20:02:23.575479+0000","last_undegraded":"2023-12-24T20:02:23.575479+0000","last_fullsized":"2023-12-24T20:02:23.575479+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:24.429255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568133+0000","last_change":"2023-12-24T20:02:23.026606+0000","last_active":"2023-12-24T20:02:23.568133+0000","last_peered":"2023-12-24T20:02:23.568133+0000","last_clean":"2023-12-24T20:02:23.568133+0000","last_became_active":"2023-12-24T20:02:23.026307+0000","last_became_peered":"2023-12-24T20:02:23.026307+0000","last_unstale":"2023-12-24T20:02:23.568133+0000","last_undegraded":"2023-12-24T20:02:23.568133+0000","last_fullsized":"2023-12-24T20:02:23.568133+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:22:27.830486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571907+0000","last_change":"2023-12-24T20:02:23.571907+0000","last_active":"2023-12-24T20:02:23.571907+0000","last_peered":"2023-12-24T20:02:23.571907+0000","last_clean":"2023-12-24T20:02:23.571907+0000","last_became_active":"2023-12-24T20:02:23.571548+0000","last_became_peered":"2023-12-24T20:02:23.571548+0000","last_unstale":"2023-12-24T20:02:23.571907+0000","last_undegraded":"2023-12-24T20:02:23.571907+0000","last_fullsized":"2023-12-24T20:02:23.571907+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:14:23.431516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"121'8","reported_seq":18,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.046242+0000","last_change":"2023-12-24T20:02:23.034956+0000","last_active":"2023-12-24T20:02:24.046242+0000","last_peered":"2023-12-24T20:02:24.046242+0000","last_clean":"2023-12-24T20:02:24.046242+0000","last_became_active":"2023-12-24T20:02:23.034025+0000","last_became_peered":"2023-12-24T20:02:23.034025+0000","last_unstale":"2023-12-24T20:02:24.046242+0000","last_undegraded":"2023-12-24T20:02:24.046242+0000","last_fullsized":"2023-12-24T20:02:24.046242+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:04:38.943757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568535+0000","last_change":"2023-12-24T20:02:23.568473+0000","last_active":"2023-12-24T20:02:23.568535+0000","last_peered":"2023-12-24T20:02:23.568535+0000","last_clean":"2023-12-24T20:02:23.568535+0000","last_became_active":"2023-12-24T20:02:23.568055+0000","last_became_peered":"2023-12-24T20:02:23.568055+0000","last_unstale":"2023-12-24T20:02:23.568535+0000","last_undegraded":"2023-12-24T20:02:23.568535+0000","last_fullsized":"2023-12-24T20:02:23.568535+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:09:12.529600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.044790+0000","last_change":"2023-12-24T20:02:23.028264+0000","last_active":"2023-12-24T20:02:24.044790+0000","last_peered":"2023-12-24T20:02:24.044790+0000","last_clean":"2023-12-24T20:02:24.044790+0000","last_became_active":"2023-12-24T20:02:23.027989+0000","last_became_peered":"2023-12-24T20:02:23.027989+0000","last_unstale":"2023-12-24T20:02:24.044790+0000","last_undegraded":"2023-12-24T20:02:24.044790+0000","last_fullsized":"2023-12-24T20:02:24.044790+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:45:16.245252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.566619+0000","last_change":"2023-12-24T20:02:23.566551+0000","last_active":"2023-12-24T20:02:23.566619+0000","last_peered":"2023-12-24T20:02:23.566619+0000","last_clean":"2023-12-24T20:02:23.566619+0000","last_became_active":"2023-12-24T20:02:23.565925+0000","last_became_peered":"2023-12-24T20:02:23.565925+0000","last_unstale":"2023-12-24T20:02:23.566619+0000","last_undegraded":"2023-12-24T20:02:23.566619+0000","last_fullsized":"2023-12-24T20:02:23.566619+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:36.343150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"121'1","reported_seq":11,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.043552+0000","last_change":"2023-12-24T20:02:23.023573+0000","last_active":"2023-12-24T20:02:24.043552+0000","last_peered":"2023-12-24T20:02:24.043552+0000","last_clean":"2023-12-24T20:02:24.043552+0000","last_became_active":"2023-12-24T20:02:23.023311+0000","last_became_peered":"2023-12-24T20:02:23.023311+0000","last_unstale":"2023-12-24T20:02:24.043552+0000","last_undegraded":"2023-12-24T20:02:24.043552+0000","last_fullsized":"2023-12-24T20:02:24.043552+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:37.150181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571464+0000","last_change":"2023-12-24T20:02:23.571464+0000","last_active":"2023-12-24T20:02:23.571464+0000","last_peered":"2023-12-24T20:02:23.571464+0000","last_clean":"2023-12-24T20:02:23.571464+0000","last_became_active":"2023-12-24T20:02:23.570871+0000","last_became_peered":"2023-12-24T20:02:23.570871+0000","last_unstale":"2023-12-24T20:02:23.571464+0000","last_undegraded":"2023-12-24T20:02:23.571464+0000","last_fullsized":"2023-12-24T20:02:23.571464+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:16.154734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.562204+0000","last_change":"2023-12-24T20:02:23.029832+0000","last_active":"2023-12-24T20:02:23.562204+0000","last_peered":"2023-12-24T20:02:23.562204+0000","last_clean":"2023-12-24T20:02:23.562204+0000","last_became_active":"2023-12-24T20:02:23.029622+0000","last_became_peered":"2023-12-24T20:02:23.029622+0000","last_unstale":"2023-12-24T20:02:23.562204+0000","last_undegraded":"2023-12-24T20:02:23.562204+0000","last_fullsized":"2023-12-24T20:02:23.562204+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:28:23.324820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.573878+0000","last_change":"2023-12-24T20:02:23.573878+0000","last_active":"2023-12-24T20:02:23.573878+0000","last_peered":"2023-12-24T20:02:23.573878+0000","last_clean":"2023-12-24T20:02:23.573878+0000","last_became_active":"2023-12-24T20:02:23.573151+0000","last_became_peered":"2023-12-24T20:02:23.573151+0000","last_unstale":"2023-12-24T20:02:23.573878+0000","last_undegraded":"2023-12-24T20:02:23.573878+0000","last_fullsized":"2023-12-24T20:02:23.573878+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:50:16.773234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.045532+0000","last_change":"2023-12-24T20:02:23.027804+0000","last_active":"2023-12-24T20:02:24.045532+0000","last_peered":"2023-12-24T20:02:24.045532+0000","last_clean":"2023-12-24T20:02:24.045532+0000","last_became_active":"2023-12-24T20:02:23.027431+0000","last_became_peered":"2023-12-24T20:02:23.027431+0000","last_unstale":"2023-12-24T20:02:24.045532+0000","last_undegraded":"2023-12-24T20:02:24.045532+0000","last_fullsized":"2023-12-24T20:02:24.045532+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:09:18.167143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.562385+0000","last_change":"2023-12-24T20:02:23.562385+0000","last_active":"2023-12-24T20:02:23.562385+0000","last_peered":"2023-12-24T20:02:23.562385+0000","last_clean":"2023-12-24T20:02:23.562385+0000","last_became_active":"2023-12-24T20:02:23.562172+0000","last_became_peered":"2023-12-24T20:02:23.562172+0000","last_unstale":"2023-12-24T20:02:23.562385+0000","last_undegraded":"2023-12-24T20:02:23.562385+0000","last_fullsized":"2023-12-24T20:02:23.562385+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:07:20.714683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.560069+0000","last_change":"2023-12-24T20:02:23.021126+0000","last_active":"2023-12-24T20:02:23.560069+0000","last_peered":"2023-12-24T20:02:23.560069+0000","last_clean":"2023-12-24T20:02:23.560069+0000","last_became_active":"2023-12-24T20:02:23.020897+0000","last_became_peered":"2023-12-24T20:02:23.020897+0000","last_unstale":"2023-12-24T20:02:23.560069+0000","last_undegraded":"2023-12-24T20:02:23.560069+0000","last_fullsized":"2023-12-24T20:02:23.560069+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:21:33.809695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572987+0000","last_change":"2023-12-24T20:02:23.572987+0000","last_active":"2023-12-24T20:02:23.572987+0000","last_peered":"2023-12-24T20:02:23.572987+0000","last_clean":"2023-12-24T20:02:23.572987+0000","last_became_active":"2023-12-24T20:02:23.572740+0000","last_became_peered":"2023-12-24T20:02:23.572740+0000","last_unstale":"2023-12-24T20:02:23.572987+0000","last_undegraded":"2023-12-24T20:02:23.572987+0000","last_fullsized":"2023-12-24T20:02:23.572987+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:34.405578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.560289+0000","last_change":"2023-12-24T20:02:23.032567+0000","last_active":"2023-12-24T20:02:23.560289+0000","last_peered":"2023-12-24T20:02:23.560289+0000","last_clean":"2023-12-24T20:02:23.560289+0000","last_became_active":"2023-12-24T20:02:23.032320+0000","last_became_peered":"2023-12-24T20:02:23.032320+0000","last_unstale":"2023-12-24T20:02:23.560289+0000","last_undegraded":"2023-12-24T20:02:23.560289+0000","last_fullsized":"2023-12-24T20:02:23.560289+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:47:30.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.566486+0000","last_change":"2023-12-24T20:02:23.566414+0000","last_active":"2023-12-24T20:02:23.566486+0000","last_peered":"2023-12-24T20:02:23.566486+0000","last_clean":"2023-12-24T20:02:23.566486+0000","last_became_active":"2023-12-24T20:02:23.566192+0000","last_became_peered":"2023-12-24T20:02:23.566192+0000","last_unstale":"2023-12-24T20:02:23.566486+0000","last_undegraded":"2023-12-24T20:02:23.566486+0000","last_fullsized":"2023-12-24T20:02:23.566486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:21:16.154734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.561259+0000","last_change":"2023-12-24T20:02:23.022526+0000","last_active":"2023-12-24T20:02:23.561259+0000","last_peered":"2023-12-24T20:02:23.561259+0000","last_clean":"2023-12-24T20:02:23.561259+0000","last_became_active":"2023-12-24T20:02:23.022268+0000","last_became_peered":"2023-12-24T20:02:23.022268+0000","last_unstale":"2023-12-24T20:02:23.561259+0000","last_undegraded":"2023-12-24T20:02:23.561259+0000","last_fullsized":"2023-12-24T20:02:23.561259+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:36:23.427716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.563406+0000","last_change":"2023-12-24T20:02:23.563336+0000","last_active":"2023-12-24T20:02:23.563406+0000","last_peered":"2023-12-24T20:02:23.563406+0000","last_clean":"2023-12-24T20:02:23.563406+0000","last_became_active":"2023-12-24T20:02:23.562820+0000","last_became_peered":"2023-12-24T20:02:23.562820+0000","last_unstale":"2023-12-24T20:02:23.563406+0000","last_undegraded":"2023-12-24T20:02:23.563406+0000","last_fullsized":"2023-12-24T20:02:23.563406+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:20:50.407707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"121'2","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:24.044243+0000","last_change":"2023-12-24T20:02:23.023321+0000","last_active":"2023-12-24T20:02:24.044243+0000","last_peered":"2023-12-24T20:02:24.044243+0000","last_clean":"2023-12-24T20:02:24.044243+0000","last_became_active":"2023-12-24T20:02:23.023074+0000","last_became_peered":"2023-12-24T20:02:23.023074+0000","last_unstale":"2023-12-24T20:02:24.044243+0000","last_undegraded":"2023-12-24T20:02:24.044243+0000","last_fullsized":"2023-12-24T20:02:24.044243+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:59.561872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.567759+0000","last_change":"2023-12-24T20:02:23.567373+0000","last_active":"2023-12-24T20:02:23.567759+0000","last_peered":"2023-12-24T20:02:23.567759+0000","last_clean":"2023-12-24T20:02:23.567759+0000","last_became_active":"2023-12-24T20:02:23.566765+0000","last_became_peered":"2023-12-24T20:02:23.566765+0000","last_unstale":"2023-12-24T20:02:23.567759+0000","last_undegraded":"2023-12-24T20:02:23.567759+0000","last_fullsized":"2023-12-24T20:02:23.567759+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:40.781529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.561856+0000","last_change":"2023-12-24T20:02:23.027973+0000","last_active":"2023-12-24T20:02:23.561856+0000","last_peered":"2023-12-24T20:02:23.561856+0000","last_clean":"2023-12-24T20:02:23.561856+0000","last_became_active":"2023-12-24T20:02:23.027638+0000","last_became_peered":"2023-12-24T20:02:23.027638+0000","last_unstale":"2023-12-24T20:02:23.561856+0000","last_undegraded":"2023-12-24T20:02:23.561856+0000","last_fullsized":"2023-12-24T20:02:23.561856+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:51.073920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.567732+0000","last_change":"2023-12-24T20:02:23.566768+0000","last_active":"2023-12-24T20:02:23.567732+0000","last_peered":"2023-12-24T20:02:23.567732+0000","last_clean":"2023-12-24T20:02:23.567732+0000","last_became_active":"2023-12-24T20:02:23.566446+0000","last_became_peered":"2023-12-24T20:02:23.566446+0000","last_unstale":"2023-12-24T20:02:23.567732+0000","last_undegraded":"2023-12-24T20:02:23.567732+0000","last_fullsized":"2023-12-24T20:02:23.567732+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:16:36.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.561140+0000","last_change":"2023-12-24T20:02:23.030321+0000","last_active":"2023-12-24T20:02:23.561140+0000","last_peered":"2023-12-24T20:02:23.561140+0000","last_clean":"2023-12-24T20:02:23.561140+0000","last_became_active":"2023-12-24T20:02:23.030054+0000","last_became_peered":"2023-12-24T20:02:23.030054+0000","last_unstale":"2023-12-24T20:02:23.561140+0000","last_undegraded":"2023-12-24T20:02:23.561140+0000","last_fullsized":"2023-12-24T20:02:23.561140+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:04:34.841117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572936+0000","last_change":"2023-12-24T20:02:23.572868+0000","last_active":"2023-12-24T20:02:23.572936+0000","last_peered":"2023-12-24T20:02:23.572936+0000","last_clean":"2023-12-24T20:02:23.572936+0000","last_became_active":"2023-12-24T20:02:23.572622+0000","last_became_peered":"2023-12-24T20:02:23.572622+0000","last_unstale":"2023-12-24T20:02:23.572936+0000","last_undegraded":"2023-12-24T20:02:23.572936+0000","last_fullsized":"2023-12-24T20:02:23.572936+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:32.581915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.565294+0000","last_change":"2023-12-24T20:02:23.027927+0000","last_active":"2023-12-24T20:02:23.565294+0000","last_peered":"2023-12-24T20:02:23.565294+0000","last_clean":"2023-12-24T20:02:23.565294+0000","last_became_active":"2023-12-24T20:02:23.027128+0000","last_became_peered":"2023-12-24T20:02:23.027128+0000","last_unstale":"2023-12-24T20:02:23.565294+0000","last_undegraded":"2023-12-24T20:02:23.565294+0000","last_fullsized":"2023-12-24T20:02:23.565294+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:46.601354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571783+0000","last_change":"2023-12-24T20:02:23.571783+0000","last_active":"2023-12-24T20:02:23.571783+0000","last_peered":"2023-12-24T20:02:23.571783+0000","last_clean":"2023-12-24T20:02:23.571783+0000","last_became_active":"2023-12-24T20:02:23.571265+0000","last_became_peered":"2023-12-24T20:02:23.571265+0000","last_unstale":"2023-12-24T20:02:23.571783+0000","last_undegraded":"2023-12-24T20:02:23.571783+0000","last_fullsized":"2023-12-24T20:02:23.571783+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:34:54.042392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.561353+0000","last_change":"2023-12-24T20:02:23.033767+0000","last_active":"2023-12-24T20:02:23.561353+0000","last_peered":"2023-12-24T20:02:23.561353+0000","last_clean":"2023-12-24T20:02:23.561353+0000","last_became_active":"2023-12-24T20:02:23.033580+0000","last_became_peered":"2023-12-24T20:02:23.033580+0000","last_unstale":"2023-12-24T20:02:23.561353+0000","last_undegraded":"2023-12-24T20:02:23.561353+0000","last_fullsized":"2023-12-24T20:02:23.561353+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:21:31.580376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.568924+0000","last_change":"2023-12-24T20:02:23.568789+0000","last_active":"2023-12-24T20:02:23.568924+0000","last_peered":"2023-12-24T20:02:23.568924+0000","last_clean":"2023-12-24T20:02:23.568924+0000","last_became_active":"2023-12-24T20:02:23.567700+0000","last_became_peered":"2023-12-24T20:02:23.567700+0000","last_unstale":"2023-12-24T20:02:23.568924+0000","last_undegraded":"2023-12-24T20:02:23.568924+0000","last_fullsized":"2023-12-24T20:02:23.568924+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:49:53.703650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.563888+0000","last_change":"2023-12-24T20:02:23.027463+0000","last_active":"2023-12-24T20:02:23.563888+0000","last_peered":"2023-12-24T20:02:23.563888+0000","last_clean":"2023-12-24T20:02:23.563888+0000","last_became_active":"2023-12-24T20:02:23.027225+0000","last_became_peered":"2023-12-24T20:02:23.027225+0000","last_unstale":"2023-12-24T20:02:23.563888+0000","last_undegraded":"2023-12-24T20:02:23.563888+0000","last_fullsized":"2023-12-24T20:02:23.563888+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:17:30.130299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.571334+0000","last_change":"2023-12-24T20:02:23.571334+0000","last_active":"2023-12-24T20:02:23.571334+0000","last_peered":"2023-12-24T20:02:23.571334+0000","last_clean":"2023-12-24T20:02:23.571334+0000","last_became_active":"2023-12-24T20:02:23.571147+0000","last_became_peered":"2023-12-24T20:02:23.571147+0000","last_unstale":"2023-12-24T20:02:23.571334+0000","last_undegraded":"2023-12-24T20:02:23.571334+0000","last_fullsized":"2023-12-24T20:02:23.571334+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:25:36.571250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.037722+0000","last_change":"2023-12-24T20:02:23.037474+0000","last_active":"2023-12-24T20:02:23.037722+0000","last_peered":"2023-12-24T20:02:23.037722+0000","last_clean":"2023-12-24T20:02:23.037722+0000","last_became_active":"2023-12-24T20:02:23.037249+0000","last_became_peered":"2023-12-24T20:02:23.037249+0000","last_unstale":"2023-12-24T20:02:23.037722+0000","last_undegraded":"2023-12-24T20:02:23.037722+0000","last_fullsized":"2023-12-24T20:02:23.037722+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:28.247507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572899+0000","last_change":"2023-12-24T20:02:23.572670+0000","last_active":"2023-12-24T20:02:23.572899+0000","last_peered":"2023-12-24T20:02:23.572899+0000","last_clean":"2023-12-24T20:02:23.572899+0000","last_became_active":"2023-12-24T20:02:23.572129+0000","last_became_peered":"2023-12-24T20:02:23.572129+0000","last_unstale":"2023-12-24T20:02:23.572899+0000","last_undegraded":"2023-12-24T20:02:23.572899+0000","last_fullsized":"2023-12-24T20:02:23.572899+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:06:04.064643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.033878+0000","last_change":"2023-12-24T20:02:23.033491+0000","last_active":"2023-12-24T20:02:23.033878+0000","last_peered":"2023-12-24T20:02:23.033878+0000","last_clean":"2023-12-24T20:02:23.033878+0000","last_became_active":"2023-12-24T20:02:23.032194+0000","last_became_peered":"2023-12-24T20:02:23.032194+0000","last_unstale":"2023-12-24T20:02:23.033878+0000","last_undegraded":"2023-12-24T20:02:23.033878+0000","last_fullsized":"2023-12-24T20:02:23.033878+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:10:47.382250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.572787+0000","last_change":"2023-12-24T20:02:23.572787+0000","last_active":"2023-12-24T20:02:23.572787+0000","last_peered":"2023-12-24T20:02:23.572787+0000","last_clean":"2023-12-24T20:02:23.572787+0000","last_became_active":"2023-12-24T20:02:23.572570+0000","last_became_peered":"2023-12-24T20:02:23.572570+0000","last_unstale":"2023-12-24T20:02:23.572787+0000","last_undegraded":"2023-12-24T20:02:23.572787+0000","last_fullsized":"2023-12-24T20:02:23.572787+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:23.014475+0000","last_clean_scrub_stamp":"2023-12-24T20:02:23.014475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:42:55.152185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"121'1","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.569879+0000","last_change":"2023-12-24T20:02:23.030514+0000","last_active":"2023-12-24T20:02:23.569879+0000","last_peered":"2023-12-24T20:02:23.569879+0000","last_clean":"2023-12-24T20:02:23.569879+0000","last_became_active":"2023-12-24T20:02:23.030365+0000","last_became_peered":"2023-12-24T20:02:23.030365+0000","last_unstale":"2023-12-24T20:02:23.569879+0000","last_undegraded":"2023-12-24T20:02:23.569879+0000","last_fullsized":"2023-12-24T20:02:23.569879+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:22.012936+0000","last_clean_scrub_stamp":"2023-12-24T20:02:22.012936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:28:03.372616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":253,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-12-24T20:02:23.022782+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:02:23.022782+0000","last_peered":"2023-12-24T20:02:23.022782+0000","last_clean":"2023-12-24T20:02:23.022782+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:02:23.022782+0000","last_undegraded":"2023-12-24T20:02:23.022782+0000","last_fullsized":"2023-12-24T20:02:23.022782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1224,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194087,"statfs":{"total":200000000,"available":198745945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.501},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70799999999999996,"5min":0.754,"15min":0.754},"last":0.40899999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81799999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.504},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72899999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.61799999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.63700000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.627},"min":{"1min":0.44,"5min":0.437,"15min":0.437},"max":{"1min":0.76800000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71099999999999997}]},{"osd":4,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.503,"15min":0.52900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.621,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.58599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70099999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.55800000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.69399999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.41699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.873,"15min":0.873},"last":0.76700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":654,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194657,"statfs":{"total":200000000,"available":199329513,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76600000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47099999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.53400000000000003},"min":{"1min":0.40100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80900000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54200000000000004,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78900000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.41699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.53600000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57399999999999995,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83399999999999996,"5min":1.077,"15min":1.077},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60599999999999998,"15min":0.57499999999999996},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.752,"5min":1.048,"15min":1.048},"last":0.505}]},{"osd":4,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.32900000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72499999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.42499999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72999999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.505,"15min":0.499},"min":{"1min":0.37,"5min":0.254,"15min":0.254},"max":{"1min":0.70199999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":648,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194664,"statfs":{"total":200000000,"available":199336425,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.27300000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.5,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.312},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.28399999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59999999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.35199999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.29999999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.57799999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.33500000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41899999999999998,"15min":0.41299999999999998},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.372},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40300000000000002,"15min":0.39500000000000002},"min":{"1min":0.29799999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.29499999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.752,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.47999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59899999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.627,"15min":0.621},"min":{"1min":0.45600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85199999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":0.79800000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.46500000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89900000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63700000000000001,"15min":0.61099999999999999},"min":{"1min":0.51100000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84899999999999998,"5min":0.878,"15min":0.878},"last":0.61499999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.87,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66000000000000003,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.53000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194087,"statfs":{"total":200000000,"available":198745503,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.35799999999999998,"15min":0.42399999999999999},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.49199999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.27300000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.60999999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.251}]},{"osd":2,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35699999999999998,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52600000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55000000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.29699999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42899999999999999,"15min":0.46500000000000002},"min":{"1min":0.27300000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57499999999999996,"5min":2.573,"15min":2.573},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.42699999999999999,"15min":0.42399999999999999},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59499999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.34699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91400000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.68200000000000005},"min":{"1min":0.47499999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97499999999999998,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.48999999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.47899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.93400000000000005,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.624},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.65100000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.504,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78100000000000003,"5min":1.655,"15min":1.655},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97499999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59599999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95399999999999996,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.66700000000000004,"15min":0.72699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93200000000000005,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.55400000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":648,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194664,"statfs":{"total":200000000,"available":199336391,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.371},"min":{"1min":0.24199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.67700000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.22},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.255}]},{"osd":1,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.23899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.30499999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29999999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.32200000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.47299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65900000000000003,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1559999999999999,"5min":3.577,"15min":3.577},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2809999999999999,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.52300000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.111,"5min":3.637,"15min":3.637},"last":0.51000000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69899999999999995,"15min":0.66100000000000003},"min":{"1min":0.49099999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.141,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.48699999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.232,"5min":1.331,"15min":1.331},"last":0.49399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":649,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334867,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34499999999999997,"15min":0.32800000000000001},"min":{"1min":0.27700000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.48599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.35499999999999998},"min":{"1min":0.30499999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.34799999999999998},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.504,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.438,"5min":0.40300000000000002,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.32900000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.436,"15min":0.42699999999999999},"min":{"1min":0.29399999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.55400000000000005}]},{"osd":4,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84599999999999997,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.875},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":1.337,"15min":1.337},"last":0.73599999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.89900000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.435,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86799999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.874,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.93300000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66600000000000004,"15min":0.64000000000000001},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85799999999999998,"5min":1.006,"15min":1.006},"last":0.79400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199328477,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73399999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77300000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.63800000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60599999999999998,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.73599999999999999,"5min":4.883,"15min":4.883},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.59299999999999997},"min":{"1min":0.39300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72999999999999998,"5min":1.544,"15min":1.544},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.628,"5min":0.88,"15min":0.88},"last":0.5},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.59199999999999997},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69299999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.38900000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70199999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.66000000000000003,"15min":0.89200000000000002},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.45900000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66500000000000004,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.80300000000000005,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.73599999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51800000000000002,"15min":0.53500000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68300000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59299999999999997,"15min":0.63700000000000001},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.751,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.69399999999999995,"15min":1.073},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.63100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":648,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194664,"statfs":{"total":200000000,"available":199336355,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76500000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83299999999999996,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.66300000000000003}]},{"osd":1,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67100000000000004,"5min":1.847,"15min":1.847},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59199999999999997,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.52300000000000002},"min":{"1min":0.42599999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.37,"15min":0.37},"max":{"1min":0.64200000000000002,"5min":1.97,"15min":1.97},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.56999999999999995},"min":{"1min":0.41599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.76400000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.70999999999999996}]},{"osd":4,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66900000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.745}]},{"osd":6,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.73299999999999998}]},{"osd":7,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":3.766,"15min":3.766},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70199999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.75700000000000001}]}]}],"pool_statfs":[]}} 2023-12-24T20:02:28.547 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T20:02:28.548 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T20:02:28.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.713+0000 7f88b70a9700 1 Processor -- start 2023-12-24T20:02:28.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.713+0000 7f88b70a9700 1 -- start start 2023-12-24T20:02:28.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b70a9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88b00ce360 0x7f88b0158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b70a9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88b0158a80 0x7f88b00cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b70a9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b015bad0 con 0x7f88b00cdf90 2023-12-24T20:02:28.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b70a9700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b015bdb0 con 0x7f88b0158a80 2023-12-24T20:02:28.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b70a9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b015c090 con 0x7f88b00ce360 2023-12-24T20:02:28.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b5646700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88b0158a80 0x7f88b00cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b5646700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88b0158a80 0x7f88b00cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54454/0 (socket says 172.21.15.61:54454) 2023-12-24T20:02:28.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b5646700 1 -- 172.21.15.61:0/1345661945 learned_addr learned my addr 172.21.15.61:0/1345661945 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88affff700 1 --2- 172.21.15.61:0/1345661945 >> v2:172.21.15.133:3300/0 conn(0x7f88b00ce360 0x7f88b0158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b5646700 1 -- 172.21.15.61:0/1345661945 >> v2:172.21.15.133:3300/0 conn(0x7f88b00ce360 msgr2=0x7f88b0158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b5646700 1 --2- 172.21.15.61:0/1345661945 >> v2:172.21.15.133:3300/0 conn(0x7f88b00ce360 0x7f88b0158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b5646700 1 -- 172.21.15.61:0/1345661945 >> v1:172.21.15.133:6789/0 conn(0x7f88b00cdf90 legacy=0x7f88b006b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b5646700 1 -- 172.21.15.61:0/1345661945 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b015c370 con 0x7f88b0158a80 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.714+0000 7f88b5646700 1 --2- 172.21.15.61:0/1345661945 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b0158a80 0x7f88b00cc990 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f88b00cfad0 tx=0x7f88a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b6ea1080a6c441 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88af7fe700 1 -- 172.21.15.61:0/1345661945 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a800e070 con 0x7f88b0158a80 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88af7fe700 1 -- 172.21.15.61:0/1345661945 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a800ba20 con 0x7f88b0158a80 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88af7fe700 1 -- 172.21.15.61:0/1345661945 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80092e0 con 0x7f88b0158a80 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88b70a9700 1 -- 172.21.15.61:0/1345661945 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b0158a80 msgr2=0x7f88b00cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88b70a9700 1 --2- 172.21.15.61:0/1345661945 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b0158a80 0x7f88b00cc990 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f88b00cfad0 tx=0x7f88a8009840 comp rx=0 tx=0).stop 2023-12-24T20:02:28.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88b70a9700 1 -- 172.21.15.61:0/1345661945 shutdown_connections 2023-12-24T20:02:28.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88b70a9700 1 --2- 172.21.15.61:0/1345661945 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b0158a80 0x7f88b00cc990 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88b70a9700 1 --2- 172.21.15.61:0/1345661945 >> v2:172.21.15.133:3300/0 conn(0x7f88b00ce360 0x7f88b0158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88b70a9700 1 -- 172.21.15.61:0/1345661945 >> 172.21.15.61:0/1345661945 conn(0x7f88b006f810 msgr2=0x7f88b006ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:28.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88b70a9700 1 -- 172.21.15.61:0/1345661945 shutdown_connections 2023-12-24T20:02:28.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.715+0000 7f88b70a9700 1 -- 172.21.15.61:0/1345661945 wait complete. 2023-12-24T20:02:28.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.716+0000 7f88b70a9700 1 Processor -- start 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.717+0000 7f88b70a9700 1 -- start start 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.717+0000 7f88b70a9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88b00cdf90 0x7f88b016d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.717+0000 7f88b70a9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b00ce360 0x7f88b0067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.717+0000 7f88b70a9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b0158a80 0x7f88b00aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.717+0000 7f88b70a9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b00ab350 con 0x7f88b00ce360 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.717+0000 7f88b70a9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b016d720 con 0x7f88b0158a80 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.717+0000 7f88b70a9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b00aaa20 con 0x7f88b00cdf90 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.717+0000 7f88affff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b00ce360 0x7f88b0067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.717+0000 7f88affff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b00ce360 0x7f88b0067f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54468/0 (socket says 172.21.15.61:54468) 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.717+0000 7f88affff700 1 -- 172.21.15.61:0/13119922 learned_addr learned my addr 172.21.15.61:0/13119922 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88b5646700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b0158a80 0x7f88b00aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88b4e45700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88b00cdf90 0x7f88b016d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88affff700 1 -- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88b00cdf90 msgr2=0x7f88b016d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88affff700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88b00cdf90 0x7f88b016d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88affff700 1 -- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b0158a80 msgr2=0x7f88b00aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88affff700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b0158a80 0x7f88b00aefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88affff700 1 -- 172.21.15.61:0/13119922 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a8009ae0 con 0x7f88b00ce360 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88b5646700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b0158a80 0x7f88b00aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88affff700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b00ce360 0x7f88b0067f00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f889c00e930 tx=0x7f889c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88acff9700 1 -- 172.21.15.61:0/13119922 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c00eed0 con 0x7f88b00ce360 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88acff9700 1 -- 172.21.15.61:0/13119922 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c00c850 con 0x7f88b00ce360 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88acff9700 1 -- 172.21.15.61:0/13119922 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c00cbf0 con 0x7f88b00ce360 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88b70a9700 1 -- 172.21.15.61:0/13119922 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b00aad00 con 0x7f88b00ce360 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.718+0000 7f88b70a9700 1 -- 172.21.15.61:0/13119922 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b0069040 con 0x7f88b00ce360 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.719+0000 7f88b70a9700 1 -- 172.21.15.61:0/13119922 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b00ab500 con 0x7f88b00ce360 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.719+0000 7f88acff9700 1 -- 172.21.15.61:0/13119922 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f889c013470 con 0x7f88b00ce360 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.720+0000 7f88acff9700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8894066f30 0x7f88940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:28.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.720+0000 7f88acff9700 1 -- 172.21.15.61:0/13119922 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f889c084720 con 0x7f88b00ce360 2023-12-24T20:02:28.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.720+0000 7f88b4e45700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8894066f30 0x7f88940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:28.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.721+0000 7f88b4e45700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8894066f30 0x7f88940693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f88a40016c0 tx=0x7f88a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:28.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.724+0000 7f88acff9700 1 -- 172.21.15.61:0/13119922 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88b00ab500 con 0x7f88b00ce360 2023-12-24T20:02:28.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:28.998+0000 7f88b70a9700 1 -- 172.21.15.61:0/13119922 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f88b004c3c0 con 0x7f88b00ce360 2023-12-24T20:02:29.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.002+0000 7f88acff9700 1 -- 172.21.15.61:0/13119922 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f889c055420 con 0x7f88b00ce360 2023-12-24T20:02:29.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 -- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8894066f30 msgr2=0x7f88940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8894066f30 0x7f88940693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f88a40016c0 tx=0x7f88a4009040 comp rx=0 tx=0).stop 2023-12-24T20:02:29.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 -- 172.21.15.61:0/13119922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b00ce360 msgr2=0x7f88b0067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b00ce360 0x7f88b0067f00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f889c00e930 tx=0x7f889c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 -- 172.21.15.61:0/13119922 shutdown_connections 2023-12-24T20:02:29.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88b00cdf90 0x7f88b016d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8894066f30 0x7f88940693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b0158a80 0x7f88b00aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 --2- 172.21.15.61:0/13119922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88b00ce360 0x7f88b0067f00 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 -- 172.21.15.61:0/13119922 >> 172.21.15.61:0/13119922 conn(0x7f88b006f810 msgr2=0x7f88b0157320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:29.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 -- 172.21.15.61:0/13119922 shutdown_connections 2023-12-24T20:02:29.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.004+0000 7f88b70a9700 1 -- 172.21.15.61:0/13119922 wait complete. 2023-12-24T20:02:29.005 INFO:teuthology.orchestra.run.smithi061.stderr:updated caps for client.0 2023-12-24T20:02:29.016 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:29.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.139+0000 7f0d930a1700 1 Processor -- start 2023-12-24T20:02:29.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.139+0000 7f0d930a1700 1 -- start start 2023-12-24T20:02:29.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.139+0000 7f0d930a1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0d8c070d50 0x7f0d8c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d930a1700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c0a84d0 con 0x7f0d8c159b00 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d930a1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c0a7620 con 0x7f0d8c0afee0 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d930a1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c0a78c0 con 0x7f0d8c070d50 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d90e3d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0d8c159b00 0x7f0d8c0af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33816/0 (socket says 172.21.15.61:33816) 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d90e3d700 1 -- 172.21.15.61:0/1510349865 learned_addr learned my addr 172.21.15.61:0/1510349865 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055619087 0 0) 0x7f0d8c0a84d0 con 0x7f0d8c159b00 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d7c003570 con 0x7f0d8c159b00 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d9163e700 1 --2- 172.21.15.61:0/1510349865 >> v2:172.21.15.133:3300/0 conn(0x7f0d8c070d50 0x7f0d8c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2838475441 0 0) 0x7f0d7c003570 con 0x7f0d8c159b00 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 >> v2:172.21.15.133:3300/0 conn(0x7f0d8c070d50 msgr2=0x7f0d8c067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 --2- 172.21.15.61:0/1510349865 >> v2:172.21.15.133:3300/0 conn(0x7f0d8c070d50 0x7f0d8c067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 >> v1:172.21.15.133:6789/0 conn(0x7f0d8c0afee0 legacy=0x7f0d8c070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c0a7ba0 con 0x7f0d8c159b00 2023-12-24T20:02:29.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f0d80001470 con 0x7f0d8c159b00 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 >> v1:172.21.15.61:6789/0 conn(0x7f0d8c159b00 legacy=0x7f0d8c0af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d7c003a60 0x7f0d7c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c004810 0x7f0d7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d7c0051c0 0x7f0d7c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0a78c0 con 0x7f0d7c0051c0 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c00c160 con 0x7f0d7c003a60 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c00c320 con 0x7f0d7c004810 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.140+0000 7f0d9163e700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d7c0051c0 0x7f0d7c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d90e3d700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d7c003a60 0x7f0d7c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d8bfff700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c004810 0x7f0d7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d9163e700 1 -- 172.21.15.61:0/1510349865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c004810 msgr2=0x7f0d7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d9163e700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c004810 0x7f0d7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d9163e700 1 -- 172.21.15.61:0/1510349865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d7c003a60 msgr2=0x7f0d7c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d9163e700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d7c003a60 0x7f0d7c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d9163e700 1 -- 172.21.15.61:0/1510349865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c003570 con 0x7f0d7c0051c0 2023-12-24T20:02:29.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d8bfff700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c004810 0x7f0d7c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d9163e700 1 -- 172.21.15.61:0/1510349865 reap_dead start 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d9163e700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d7c0051c0 0x7f0d7c00ba60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0a8480 tx=0x7f0d8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e99d879f2637a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400ea60 con 0x7f0d7c0051c0 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8400f040 con 0x7f0d7c0051c0 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.141+0000 7f0d8b7fe700 1 -- 172.21.15.61:0/1510349865 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400ee10 con 0x7f0d7c0051c0 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.142+0000 7f0d930a1700 1 -- 172.21.15.61:0/1510349865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d7c0051c0 msgr2=0x7f0d7c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.142+0000 7f0d930a1700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d7c0051c0 0x7f0d7c00ba60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0a8480 tx=0x7f0d8400b040 comp rx=0 tx=0).stop 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.142+0000 7f0d930a1700 1 -- 172.21.15.61:0/1510349865 shutdown_connections 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.142+0000 7f0d930a1700 1 --2- 172.21.15.61:0/1510349865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d7c0051c0 0x7f0d7c00ba60 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.142+0000 7f0d930a1700 1 -- 172.21.15.61:0/1510349865 >> 172.21.15.61:0/1510349865 conn(0x7f0d8c0ca200 msgr2=0x7f0d8c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.142+0000 7f0d930a1700 1 -- 172.21.15.61:0/1510349865 shutdown_connections 2023-12-24T20:02:29.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.142+0000 7f0d930a1700 1 -- 172.21.15.61:0/1510349865 wait complete. 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.143+0000 7f0d930a1700 1 Processor -- start 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.143+0000 7f0d930a1700 1 -- start start 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d930a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c0051c0 0x7f0d8c159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d930a1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d8c0b1e20 0x7f0d8c0c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d930a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d8c0b0530 0x7f0d8c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d930a1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0b1990 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d930a1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0c9380 con 0x7f0d8c0b0530 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d930a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0b0d80 con 0x7f0d7c0051c0 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d8bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d8c0b1e20 0x7f0d8c0c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d8bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d8c0b1e20 0x7f0d8c0c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54492/0 (socket says 172.21.15.61:54492) 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d8bfff700 1 -- 172.21.15.61:0/174617670 learned_addr learned my addr 172.21.15.61:0/174617670 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d90e3d700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c0051c0 0x7f0d8c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d9163e700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d8c0b0530 0x7f0d8c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d8bfff700 1 -- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c0051c0 msgr2=0x7f0d8c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d8bfff700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c0051c0 0x7f0d8c159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d8bfff700 1 -- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d8c0b0530 msgr2=0x7f0d8c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d8bfff700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d8c0b0530 0x7f0d8c0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d8bfff700 1 -- 172.21.15.61:0/174617670 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c0b1060 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d90e3d700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c0051c0 0x7f0d8c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d9163e700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d8c0b0530 0x7f0d8c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d8bfff700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d8c0b1e20 0x7f0d8c0c8e40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f0d78007a80 tx=0x7f0d78009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d88ff9700 1 -- 172.21.15.61:0/174617670 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78011530 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d88ff9700 1 -- 172.21.15.61:0/174617670 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78010040 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d930a1700 1 -- 172.21.15.61:0/174617670 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8c0b1340 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d88ff9700 1 -- 172.21.15.61:0/174617670 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d780118c0 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.144+0000 7f0d930a1700 1 -- 172.21.15.61:0/174617670 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c0b2290 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.145+0000 7f0d930a1700 1 -- 172.21.15.61:0/174617670 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c0b1b00 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.146+0000 7f0d88ff9700 1 -- 172.21.15.61:0/174617670 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0d78011cb0 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.146+0000 7f0d88ff9700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0d70066f30 0x7f0d700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.146+0000 7f0d88ff9700 1 -- 172.21.15.61:0/174617670 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d78083700 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.146+0000 7f0d90e3d700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0d70066f30 0x7f0d700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.147+0000 7f0d90e3d700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0d70066f30 0x7f0d700693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0d80001ce0 tx=0x7f0d80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:29.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.151+0000 7f0d88ff9700 1 -- 172.21.15.61:0/174617670 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d7804d5a0 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.391+0000 7f0d930a1700 1 -- 172.21.15.61:0/174617670 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d8c04c3c0 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.391+0000 7f0d88ff9700 1 -- 172.21.15.61:0/174617670 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f0d78050a20 con 0x7f0d8c0b1e20 2023-12-24T20:02:29.392 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:29.392 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2890522920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2890522920},{"type":"v1","addr":"172.21.15.133:6836","nonce":2890522920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/946349829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":946349829},{"type":"v1","addr":"172.21.15.133:6837","nonce":946349829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3897383544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3897383544},{"type":"v1","addr":"172.21.15.61:6834","nonce":3897383544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:23.422714+0000","modified":"2023-12-24T20:02:27.054403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/447554724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":447554724},{"type":"v1","addr":"172.21.15.61:6835","nonce":447554724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T20:02:29.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.393+0000 7f0d930a1700 1 -- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0d70066f30 msgr2=0x7f0d700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.393+0000 7f0d930a1700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0d70066f30 0x7f0d700693e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0d80001ce0 tx=0x7f0d80009040 comp rx=0 tx=0).stop 2023-12-24T20:02:29.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.394+0000 7f0d930a1700 1 -- 172.21.15.61:0/174617670 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d8c0b1e20 msgr2=0x7f0d8c0c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.394+0000 7f0d930a1700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d8c0b1e20 0x7f0d8c0c8e40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f0d78007a80 tx=0x7f0d78009040 comp rx=0 tx=0).stop 2023-12-24T20:02:29.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.394+0000 7f0d930a1700 1 -- 172.21.15.61:0/174617670 shutdown_connections 2023-12-24T20:02:29.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.394+0000 7f0d930a1700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0d7c0051c0 0x7f0d8c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.394+0000 7f0d930a1700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0d70066f30 0x7f0d700693e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.394+0000 7f0d930a1700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d8c0b0530 0x7f0d8c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.394+0000 7f0d930a1700 1 --2- 172.21.15.61:0/174617670 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0d8c0b1e20 0x7f0d8c0c8e40 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.394+0000 7f0d930a1700 1 -- 172.21.15.61:0/174617670 >> 172.21.15.61:0/174617670 conn(0x7f0d8c0ca200 msgr2=0x7f0d8c06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:29.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.394+0000 7f0d930a1700 1 -- 172.21.15.61:0/174617670 shutdown_connections 2023-12-24T20:02:29.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.394+0000 7f0d930a1700 1 -- 172.21.15.61:0/174617670 wait complete. 2023-12-24T20:02:29.395 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 60 2023-12-24T20:02:29.563 INFO:tasks.ceph.mds.c.smithi061.stderr:2023-12-24T20:02:29.563+0000 7f991a162700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:02:29.809 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T20:02:23.422714+0000', 'modified': '2023-12-24T20:02:27.054403+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6726}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6726': {'gid': 6726, 'name': 'c', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.61:6835/447554724', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.61:6833', 'nonce': 447554724}, {'type': 'v1', 'addr': '172.21.15.61:6835', 'nonce': 447554724}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T20:02:29.809 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T20:02:29.810 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-24T20:02:29.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.934+0000 7f3a2fa1e700 1 Processor -- start 2023-12-24T20:02:29.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.934+0000 7f3a2fa1e700 1 -- start start 2023-12-24T20:02:29.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.935+0000 7f3a2fa1e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a28157660 0x7f3a28157a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.935+0000 7f3a2fa1e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a2815b4e0 0x7f3a280ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.935+0000 7f3a2fa1e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a280b08e0 con 0x7f3a2806ac10 2023-12-24T20:02:29.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.935+0000 7f3a2fa1e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a280af310 con 0x7f3a2815b4e0 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.935+0000 7f3a2fa1e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280af480 con 0x7f3a28157660 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.935+0000 7f3a2dfbb700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3a2806ac10 0x7f3a28069760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33818/0 (socket says 172.21.15.61:33818) 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.935+0000 7f3a2dfbb700 1 -- 172.21.15.61:0/2989708942 learned_addr learned my addr 172.21.15.61:0/2989708942 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.935+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/2989708942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a28157660 0x7f3a28157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.935+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/2989708942 >> v2:172.21.15.133:3300/0 conn(0x7f3a2815b4e0 0x7f3a280ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a1ffff700 1 -- 172.21.15.61:0/2989708942 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681005072 0 0) 0x7f3a280b08e0 con 0x7f3a2806ac10 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a1ffff700 1 -- 172.21.15.61:0/2989708942 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a14003570 con 0x7f3a2806ac10 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/2989708942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a28157660 msgr2=0x7f3a28157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/2989708942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a28157660 0x7f3a28157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/2989708942 >> v1:172.21.15.61:6789/0 conn(0x7f3a2806ac10 legacy=0x7f3a28069760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a1ffff700 1 -- 172.21.15.61:0/2989708942 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 281468686 0 0) 0x7f3a14003570 con 0x7f3a2806ac10 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/2989708942 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2815b9e0 con 0x7f3a2815b4e0 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/2989708942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a28157660 0x7f3a28157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:29.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/2989708942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2815b4e0 0x7f3a280ada10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3a240098e0 tx=0x7f3a240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e4a710d195f5999 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a1ffff700 1 -- 172.21.15.61:0/2989708942 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a200017f0 con 0x7f3a2815b4e0 2023-12-24T20:02:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a1ffff700 1 -- 172.21.15.61:0/2989708942 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24011420 con 0x7f3a2815b4e0 2023-12-24T20:02:29.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.936+0000 7f3a1ffff700 1 -- 172.21.15.61:0/2989708942 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a240117c0 con 0x7f3a2815b4e0 2023-12-24T20:02:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.937+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/2989708942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2815b4e0 msgr2=0x7f3a280ada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.937+0000 7f3a2fa1e700 1 --2- 172.21.15.61:0/2989708942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2815b4e0 0x7f3a280ada10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3a240098e0 tx=0x7f3a240091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.937+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/2989708942 shutdown_connections 2023-12-24T20:02:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.937+0000 7f3a2fa1e700 1 --2- 172.21.15.61:0/2989708942 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a28157660 0x7f3a28157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.937+0000 7f3a2fa1e700 1 --2- 172.21.15.61:0/2989708942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2815b4e0 0x7f3a280ada10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.937+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/2989708942 >> 172.21.15.61:0/2989708942 conn(0x7f3a280ce7e0 msgr2=0x7f3a280cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.937+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/2989708942 shutdown_connections 2023-12-24T20:02:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.937+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/2989708942 wait complete. 2023-12-24T20:02:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.938+0000 7f3a2fa1e700 1 Processor -- start 2023-12-24T20:02:29.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.938+0000 7f3a2fa1e700 1 -- start start 2023-12-24T20:02:29.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2fa1e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a2806ac10 0x7f3a280c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2fa1e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a28157660 0x7f3a280cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2fa1e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a2815b4e0 0x7f3a280cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2fa1e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28168d00 con 0x7f3a2806ac10 2023-12-24T20:02:29.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2fa1e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28167e20 con 0x7f3a28157660 2023-12-24T20:02:29.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2fa1e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280c2f10 con 0x7f3a2815b4e0 2023-12-24T20:02:29.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2d7ba700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a2806ac10 0x7f3a280c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2d7ba700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a2806ac10 0x7f3a280c29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54500/0 (socket says 172.21.15.61:54500) 2023-12-24T20:02:29.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2d7ba700 1 -- 172.21.15.61:0/3984977985 learned_addr learned my addr 172.21.15.61:0/3984977985 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:29.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a28157660 0x7f3a280cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2dfbb700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a2815b4e0 0x7f3a280cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2d7ba700 1 -- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a2815b4e0 msgr2=0x7f3a280cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a2815b4e0 0x7f3a280cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2d7ba700 1 -- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a28157660 msgr2=0x7f3a280cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a28157660 0x7f3a280cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2d7ba700 1 -- 172.21.15.61:0/3984977985 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a18009420 con 0x7f3a2806ac10 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.939+0000 7f3a2dfbb700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a2815b4e0 0x7f3a280cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.940+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a2806ac10 0x7f3a280c29d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009e80 tx=0x7f3a180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.940+0000 7f3a1d7fa700 1 -- 172.21.15.61:0/3984977985 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18013470 con 0x7f3a2806ac10 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.940+0000 7f3a1d7fa700 1 -- 172.21.15.61:0/3984977985 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1800c920 con 0x7f3a2806ac10 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.940+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/3984977985 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a24009420 con 0x7f3a2806ac10 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.940+0000 7f3a1d7fa700 1 -- 172.21.15.61:0/3984977985 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800cce0 con 0x7f3a2806ac10 2023-12-24T20:02:29.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.940+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/3984977985 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a281683d0 con 0x7f3a2806ac10 2023-12-24T20:02:29.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.942+0000 7f3a1d7fa700 1 -- 172.21.15.61:0/3984977985 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3a180125e0 con 0x7f3a2806ac10 2023-12-24T20:02:29.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.942+0000 7f3a1d7fa700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a0c066f30 0x7f3a0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.942+0000 7f3a1d7fa700 1 -- 172.21.15.61:0/3984977985 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a1808d3d0 con 0x7f3a2806ac10 2023-12-24T20:02:29.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.942+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a0c066f30 0x7f3a0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.943+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a0c066f30 0x7f3a0c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3a2815b910 tx=0x7f3a24016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:29.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.943+0000 7f3a38d1eb80 1 Processor -- start 2023-12-24T20:02:29.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a38d1eb80 1 -- start start 2023-12-24T20:02:29.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b68fa0 0x564bf7b69370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b698b0 0x564bf7b64c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 0x564bf7b85360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf7a973e0 con 0x564bf7b698b0 2023-12-24T20:02:29.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf7a94be0 con 0x564bf7b65170 2023-12-24T20:02:29.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564bf7a909d0 con 0x564bf7b68fa0 2023-12-24T20:02:29.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a2cfb9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b698b0 0x564bf7b64c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a2cfb9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b698b0 0x564bf7b64c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54504/0 (socket says 172.21.15.61:54504) 2023-12-24T20:02:29.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/3639096384 learned_addr learned my addr 172.21.15.61:0/3639096384 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/3639096384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b68fa0 0x564bf7b69370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.944+0000 7f3a2dfbb700 1 --2- 172.21.15.61:0/3639096384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 0x564bf7b85360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/3639096384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b68fa0 msgr2=0x564bf7b69370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/3639096384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b68fa0 0x564bf7b69370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/3639096384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 msgr2=0x564bf7b85360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/3639096384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 0x564bf7b85360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/3639096384 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bf7924360 con 0x564bf7b698b0 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a2dfbb700 1 --2- 172.21.15.61:0/3639096384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 0x564bf7b85360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/3639096384 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b698b0 0x564bf7b64c30 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3a24011b60 tx=0x7f3a24022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f63af0ef56a368 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a127fc700 1 -- 172.21.15.61:0/3639096384 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24022070 con 0x564bf7b698b0 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a127fc700 1 -- 172.21.15.61:0/3639096384 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2401c620 con 0x564bf7b698b0 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a127fc700 1 -- 172.21.15.61:0/3639096384 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2401c790 con 0x564bf7b698b0 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/3639096384 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b698b0 msgr2=0x564bf7b64c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.945+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/3639096384 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b698b0 0x564bf7b64c30 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3a24011b60 tx=0x7f3a24022000 comp rx=0 tx=0).stop 2023-12-24T20:02:29.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.946+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/3639096384 shutdown_connections 2023-12-24T20:02:29.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.946+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/3639096384 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b68fa0 0x564bf7b69370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.946+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/3639096384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 0x564bf7b85360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.946+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/3639096384 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b698b0 0x564bf7b64c30 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.946+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/3639096384 >> 172.21.15.61:0/3639096384 conn(0x564bf7b3f440 msgr2=0x564bf7b8adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:29.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.946+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/3639096384 shutdown_connections 2023-12-24T20:02:29.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.946+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/3639096384 wait complete. 2023-12-24T20:02:29.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.946+0000 7f3a38d1eb80 1 -- start start 2023-12-24T20:02:29.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.947+0000 7f3a38d1eb80 1 Processor -- start 2023-12-24T20:02:29.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b65170 0x564bf7b640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b68fa0 0x564bf7b66290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 0x564bf7b9a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf7a3d1b0 con 0x564bf7b65170 2023-12-24T20:02:29.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf7a3ce50 con 0x564bf7b68fa0 2023-12-24T20:02:29.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564bf7989e40 con 0x564bf7b698b0 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a38d1eb80 10 client.0 _ll_register_callbacks cb 0x564bf798c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2d7ba700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b65170 0x564bf7b640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2d7ba700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b65170 0x564bf7b640c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54510/0 (socket says 172.21.15.61:54510) 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2d7ba700 1 -- 172.21.15.61:0/1690257927 learned_addr learned my addr 172.21.15.61:0/1690257927 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2dfbb700 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 0x564bf7b9a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b68fa0 0x564bf7b66290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2d7ba700 1 -- 172.21.15.61:0/1690257927 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 msgr2=0x564bf7b9a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 0x564bf7b9a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2d7ba700 1 -- 172.21.15.61:0/1690257927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b68fa0 msgr2=0x564bf7b66290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b68fa0 0x564bf7b66290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2d7ba700 1 -- 172.21.15.61:0/1690257927 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2815b9e0 con 0x564bf7b65170 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b65170 0x564bf7b640c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3a1805e290 tx=0x7f3a18009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92deceb27861bc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a077fe700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a077fe700 1 -- 172.21.15.61:0/1690257927 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800ce40 con 0x564bf7b65170 2023-12-24T20:02:29.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a077fe700 1 -- 172.21.15.61:0/1690257927 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a1805e560 con 0x564bf7b65170 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.948+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/1690257927 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564bf7b11eb0 con 0x564bf7b65170 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a077fe700 1 -- 172.21.15.61:0/1690257927 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a1805d7f0 con 0x564bf7b65170 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a38d1eb80 10 client.6846 fetch_fsmap learned FSMap version 60 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/1690257927 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x564bf78d0b10 con 0x564bf7b65170 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a077fe700 1 -- 172.21.15.61:0/1690257927 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a18069080 con 0x564bf7b65170 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a077fe700 1 -- 172.21.15.61:0/1690257927 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3a18064e10 con 0x564bf7b65170 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a38d1eb80 10 client.6846 fetch_fsmap finished waiting for FSMap version 60 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a38d1eb80 10 client.6846 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a38d1eb80 20 client.6846 populate_metadata read hostname 'smithi061' 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.61:6833/447554724,v1:172.21.15.61:6835/447554724] conn(0x564bf7b67b70 0x564bf7b67f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a38d1eb80 4 client.6846 mds_command: new command op to 6726 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/1690257927 --> [v2:172.21.15.61:6833/447554724,v1:172.21.15.61:6835/447554724] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564bf7a67880 con 0x564bf7b67b70 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.61:6833/447554724,v1:172.21.15.61:6835/447554724] conn(0x564bf7b67b70 0x564bf7b67f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a077fe700 10 client.6846 ms_handle_connect on v2:172.21.15.61:6833/447554724 2023-12-24T20:02:29.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.949+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.61:6833/447554724,v1:172.21.15.61:6835/447554724] conn(0x564bf7b67b70 0x564bf7b67f40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ab483a3178c1b67 server_cookie=7fa686211cc7b55e in_seq=0 out_seq=0 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a077fe700 1 -- 172.21.15.61:0/1690257927 <== mds.0 v2:172.21.15.61:6833/447554724 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564bf7a67880 con 0x564bf7b67b70 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a077fe700 10 client.6846 handle_command_reply: tid=0 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 client.6846 shutdown 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/1690257927 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b65170 msgr2=0x564bf7b640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b65170 0x564bf7b640c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3a1805e290 tx=0x7f3a18009860 comp rx=0 tx=0).stop 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/1690257927 shutdown_connections 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.61:6833/447554724,v1:172.21.15.61:6835/447554724] conn(0x564bf7b67b70 0x564bf7b67f40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 0x564bf7b9a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b65170 0x564bf7b640c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a077fe700 0 client.6846 ms_handle_reset on v2:172.21.15.61:6833/447554724 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/1690257927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b68fa0 0x564bf7b66290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/1690257927 >> 172.21.15.61:0/1690257927 conn(0x564bf7b3f440 msgr2=0x564bf7b3d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/1690257927 shutdown_connections 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/1690257927 wait complete. 2023-12-24T20:02:29.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.950+0000 7f3a38d1eb80 20 client.6846 trim_cache size 0 max 16384 2023-12-24T20:02:29.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.967+0000 7f3a38d1eb80 1 Processor -- start 2023-12-24T20:02:29.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.968+0000 7f3a38d1eb80 1 -- start start 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.968+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b65170 0x564bf7b99da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.968+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b3d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.968+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b698b0 0x564bf7b3da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.968+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf7b68bb0 con 0x564bf7b68fa0 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.968+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf7b3ea00 con 0x564bf7b698b0 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.968+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564bf7b40750 con 0x564bf7b65170 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.968+0000 7f3a2cfb9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b3d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.968+0000 7f3a2cfb9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b3d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54516/0 (socket says 172.21.15.61:54516) 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.968+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/503169809 learned_addr learned my addr 172.21.15.61:0/503169809 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/503169809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b65170 msgr2=0x564bf7b99da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/503169809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b65170 0x564bf7b99da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/503169809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b698b0 msgr2=0x564bf7b3da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/503169809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b698b0 0x564bf7b3da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/503169809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564bf7a5f290 con 0x564bf7b68fa0 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/503169809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b3d510 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3a24011b60 tx=0x7f3a24013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15a862b96d5ce2f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a12ffd700 1 -- 172.21.15.61:0/503169809 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24022040 con 0x564bf7b68fa0 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a12ffd700 1 -- 172.21.15.61:0/503169809 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2401c5a0 con 0x564bf7b68fa0 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a12ffd700 1 -- 172.21.15.61:0/503169809 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2401c710 con 0x564bf7b68fa0 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/503169809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 msgr2=0x564bf7b3d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/503169809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b3d510 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f3a24011b60 tx=0x7f3a24013000 comp rx=0 tx=0).stop 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/503169809 shutdown_connections 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/503169809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b65170 0x564bf7b99da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/503169809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b698b0 0x564bf7b3da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/503169809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b3d510 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.969+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/503169809 >> 172.21.15.61:0/503169809 conn(0x564bf7b3f440 msgr2=0x564bf7b6fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.970+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/503169809 shutdown_connections 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.970+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/503169809 wait complete. 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.970+0000 7f3a38d1eb80 1 -- start start 2023-12-24T20:02:29.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.970+0000 7f3a38d1eb80 1 Processor -- start 2023-12-24T20:02:29.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 0x564bf7b95eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b963f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a38d1eb80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 0x564bf7b98bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf7becd50 con 0x564bf7b68fa0 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564bf7b99f30 con 0x564bf7b65170 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a38d1eb80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x564bf7b9a0e0 con 0x564bf7b698b0 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a38d1eb80 10 client.0 _ll_register_callbacks cb 0x564bf798c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a2cfb9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a2cfb9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54532/0 (socket says 172.21.15.61:54532) 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/2781493206 learned_addr learned my addr 172.21.15.61:0/2781493206 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a2dfbb700 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 0x564bf7b98bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.971+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 0x564bf7b95eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/2781493206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 msgr2=0x564bf7b98bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 0x564bf7b98bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/2781493206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 msgr2=0x564bf7b95eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 0x564bf7b95eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a2cfb9700 1 -- 172.21.15.61:0/2781493206 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564bf7924360 con 0x564bf7b68fa0 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a2dfbb700 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 0x564bf7b98bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 0x564bf7b95eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a2cfb9700 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b963f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3a2401cbe0 tx=0x7f3a24033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6c7a913a164e8e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a077fe700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a077fe700 1 -- 172.21.15.61:0/2781493206 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24022030 con 0x564bf7b68fa0 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a077fe700 1 -- 172.21.15.61:0/2781493206 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a2403e750 con 0x564bf7b68fa0 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/2781493206 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564bf7b35490 con 0x564bf7b68fa0 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a077fe700 1 -- 172.21.15.61:0/2781493206 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a2403eb20 con 0x564bf7b68fa0 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a38d1eb80 10 client.6852 fetch_fsmap learned FSMap version 60 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/2781493206 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x564bf7928c80 con 0x564bf7b68fa0 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a077fe700 1 -- 172.21.15.61:0/2781493206 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564bf7b35490 con 0x564bf7b68fa0 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a077fe700 1 -- 172.21.15.61:0/2781493206 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3a2403ec80 con 0x564bf7b68fa0 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a38d1eb80 10 client.6852 fetch_fsmap finished waiting for FSMap version 60 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a38d1eb80 10 client.6852 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a38d1eb80 20 client.6852 populate_metadata read hostname 'smithi061' 2023-12-24T20:02:29.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.61:6833/447554724,v1:172.21.15.61:6835/447554724] conn(0x564bf7ba0d10 0x564bf7b99100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a38d1eb80 4 client.6852 mds_command: new command op to 6726 tid=0[{"prefix": "status"}] 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.972+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/2781493206 --> [v2:172.21.15.61:6833/447554724,v1:172.21.15.61:6835/447554724] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564bf7a33910 con 0x564bf7ba0d10 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.61:6833/447554724,v1:172.21.15.61:6835/447554724] conn(0x564bf7ba0d10 0x564bf7b99100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a2d7ba700 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.61:6833/447554724,v1:172.21.15.61:6835/447554724] conn(0x564bf7ba0d10 0x564bf7b99100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d06bba7762ebbb server_cookie=5a77f5910957924f in_seq=0 out_seq=0 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a077fe700 10 client.6852 ms_handle_connect on v2:172.21.15.61:6833/447554724 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a077fe700 1 -- 172.21.15.61:0/2781493206 <== mds.0 v2:172.21.15.61:6833/447554724 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x564bf7a33910 con 0x564bf7ba0d10 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a077fe700 10 client.6852 handle_command_reply: tid=0 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 client.6852 shutdown 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/2781493206 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 msgr2=0x564bf7b963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b963f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3a2401cbe0 tx=0x7f3a24033000 comp rx=0 tx=0).stop 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/2781493206 shutdown_connections 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.61:6833/447554724,v1:172.21.15.61:6835/447554724] conn(0x564bf7ba0d10 0x564bf7b99100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x564bf7b698b0 0x564bf7b98bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564bf7b65170 0x564bf7b95eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a077fe700 0 client.6852 ms_handle_reset on v2:172.21.15.61:6833/447554724 2023-12-24T20:02:29.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 --2- 172.21.15.61:0/2781493206 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x564bf7b68fa0 0x564bf7b963f0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/2781493206 >> 172.21.15.61:0/2781493206 conn(0x564bf7b3f440 msgr2=0x564bf7b82960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:29.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/2781493206 shutdown_connections 2023-12-24T20:02:29.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 1 -- 172.21.15.61:0/2781493206 wait complete. 2023-12-24T20:02:29.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.973+0000 7f3a38d1eb80 20 client.6852 trim_cache size 0 max 16384 2023-12-24T20:02:29.981 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:29.981 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:02:29.981 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T20:02:29.981 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 6726, 2023-12-24T20:02:29.981 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T20:02:29.982 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T20:02:29.982 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T20:02:29.982 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 5.9380977850000001, 2023-12-24T20:02:29.982 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 60, 2023-12-24T20:02:29.982 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 122, 2023-12-24T20:02:29.982 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 122, 2023-12-24T20:02:29.982 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 11.015238565000001 2023-12-24T20:02:29.982 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a0c066f30 msgr2=0x7f3a0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a0c066f30 0x7f3a0c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3a2815b910 tx=0x7f3a24016000 comp rx=0 tx=0).stop 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/3984977985 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a2806ac10 msgr2=0x7f3a280c29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a2806ac10 0x7f3a280c29d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009e80 tx=0x7f3a180091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/3984977985 shutdown_connections 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3a2815b4e0 0x7f3a280cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3a0c066f30 0x7f3a0c0693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3a2806ac10 0x7f3a280c29d0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 --2- 172.21.15.61:0/3984977985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a28157660 0x7f3a280cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/3984977985 >> 172.21.15.61:0/3984977985 conn(0x7f3a280ce7e0 msgr2=0x7f3a280c99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:29.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/3984977985 shutdown_connections 2023-12-24T20:02:29.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:29.974+0000 7f3a2fa1e700 1 -- 172.21.15.61:0/3984977985 wait complete. 2023-12-24T20:02:29.987 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:02:30.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.108+0000 7f7501189700 1 Processor -- start 2023-12-24T20:02:30.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.108+0000 7f7501189700 1 -- start start 2023-12-24T20:02:30.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f7501189700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f74fc068140 0x7f74fc0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:30.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f7501189700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74fc068510 0x7f74fc0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:30.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f7501189700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc0b2890 con 0x7f74fc159a60 2023-12-24T20:02:30.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f7501189700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc0b11e0 con 0x7f74fc068140 2023-12-24T20:02:30.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f7501189700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc0cf630 con 0x7f74fc068510 2023-12-24T20:02:30.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74fad9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f74fc068140 0x7f74fc0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74fb59e700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f74fc159a60 0x7f74fc159ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33820/0 (socket says 172.21.15.61:33820) 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74fad9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f74fc068140 0x7f74fc0cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54542/0 (socket says 172.21.15.61:54542) 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74fb59e700 1 -- 172.21.15.61:0/3356746439 learned_addr learned my addr 172.21.15.61:0/3356746439 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74fa59c700 1 --2- 172.21.15.61:0/3356746439 >> v2:172.21.15.133:3300/0 conn(0x7f74fc068510 0x7f74fc0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74fad9d700 1 -- 172.21.15.61:0/3356746439 >> v2:172.21.15.133:3300/0 conn(0x7f74fc068510 msgr2=0x7f74fc0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74fad9d700 1 --2- 172.21.15.61:0/3356746439 >> v2:172.21.15.133:3300/0 conn(0x7f74fc068510 0x7f74fc0b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74fad9d700 1 -- 172.21.15.61:0/3356746439 >> v1:172.21.15.61:6789/0 conn(0x7f74fc159a60 legacy=0x7f74fc159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74fad9d700 1 -- 172.21.15.61:0/3356746439 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc0b2240 con 0x7f74fc068140 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74f9d9b700 1 -- 172.21.15.61:0/3356746439 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044085492 0 0) 0x7f74fc0b2890 con 0x7f74fc159a60 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.109+0000 7f74fad9d700 1 --2- 172.21.15.61:0/3356746439 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 0x7f74fc0cefa0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f74fc06d800 tx=0x7f74f0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500e5a9d7c8622be server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f74f9d9b700 1 -- 172.21.15.61:0/3356746439 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0005c10 con 0x7f74fc068140 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f74f9d9b700 1 -- 172.21.15.61:0/3356746439 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f0005d70 con 0x7f74fc068140 2023-12-24T20:02:30.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f74f9d9b700 1 -- 172.21.15.61:0/3356746439 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0006260 con 0x7f74fc068140 2023-12-24T20:02:30.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f7501189700 1 -- 172.21.15.61:0/3356746439 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 msgr2=0x7f74fc0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:30.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f7501189700 1 --2- 172.21.15.61:0/3356746439 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 0x7f74fc0cefa0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f74fc06d800 tx=0x7f74f0009120 comp rx=0 tx=0).stop 2023-12-24T20:02:30.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f7501189700 1 -- 172.21.15.61:0/3356746439 shutdown_connections 2023-12-24T20:02:30.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f7501189700 1 --2- 172.21.15.61:0/3356746439 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 0x7f74fc0cefa0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:30.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f7501189700 1 --2- 172.21.15.61:0/3356746439 >> v2:172.21.15.133:3300/0 conn(0x7f74fc068510 0x7f74fc0b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:30.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f7501189700 1 -- 172.21.15.61:0/3356746439 >> 172.21.15.61:0/3356746439 conn(0x7f74fc097a10 msgr2=0x7f74fc0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:30.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f7501189700 1 -- 172.21.15.61:0/3356746439 shutdown_connections 2023-12-24T20:02:30.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.110+0000 7f7501189700 1 -- 172.21.15.61:0/3356746439 wait complete. 2023-12-24T20:02:30.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f7501189700 1 Processor -- start 2023-12-24T20:02:30.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f7501189700 1 -- start start 2023-12-24T20:02:30.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f7501189700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 0x7f74fc0c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:30.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f7501189700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc068510 0x7f74fc15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:30.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f7501189700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74fc159a60 0x7f74fc15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:30.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f7501189700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc169e50 con 0x7f74fc068140 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f7501189700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc15da50 con 0x7f74fc068510 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f7501189700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0c3b70 con 0x7f74fc159a60 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f74fad9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 0x7f74fc0c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f74fad9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 0x7f74fc0c3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54546/0 (socket says 172.21.15.61:54546) 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.112+0000 7f74fad9d700 1 -- 172.21.15.61:0/1582757099 learned_addr learned my addr 172.21.15.61:0/1582757099 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74fb59e700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74fc159a60 0x7f74fc15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74fa59c700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc068510 0x7f74fc15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74fad9d700 1 -- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74fc159a60 msgr2=0x7f74fc15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74fad9d700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74fc159a60 0x7f74fc15ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74fad9d700 1 -- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc068510 msgr2=0x7f74fc15a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74fad9d700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc068510 0x7f74fc15a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74fad9d700 1 -- 172.21.15.61:0/1582757099 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f00093c0 con 0x7f74fc068140 2023-12-24T20:02:30.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74fad9d700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 0x7f74fc0c3630 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009f40 tx=0x7f74f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74e2ffd700 1 -- 172.21.15.61:0/1582757099 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f001d880 con 0x7f74fc068140 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74e2ffd700 1 -- 172.21.15.61:0/1582757099 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f001d9e0 con 0x7f74fc068140 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f7501189700 1 -- 172.21.15.61:0/1582757099 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc15f680 con 0x7f74fc068140 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f74e2ffd700 1 -- 172.21.15.61:0/1582757099 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f001dda0 con 0x7f74fc068140 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.113+0000 7f7501189700 1 -- 172.21.15.61:0/1582757099 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc15d1a0 con 0x7f74fc068140 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.114+0000 7f7501189700 1 -- 172.21.15.61:0/1582757099 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc06d440 con 0x7f74fc068140 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.115+0000 7f74e2ffd700 1 -- 172.21.15.61:0/1582757099 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f74f001b690 con 0x7f74fc068140 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.115+0000 7f74e2ffd700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74e8066f30 0x7f74e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.115+0000 7f74e2ffd700 1 -- 172.21.15.61:0/1582757099 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74f0086550 con 0x7f74fc068140 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.115+0000 7f74fa59c700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74e8066f30 0x7f74e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:30.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.116+0000 7f74fa59c700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74e8066f30 0x7f74e80693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0b0880 tx=0x7f74ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:30.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.119+0000 7f74e2ffd700 1 -- 172.21.15.61:0/1582757099 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74f00537c0 con 0x7f74fc068140 2023-12-24T20:02:30.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.361+0000 7f7501189700 1 -- 172.21.15.61:0/1582757099 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f74fc04c3c0 con 0x7f74fc068140 2023-12-24T20:02:30.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.361+0000 7f74e2ffd700 1 -- 172.21.15.61:0/1582757099 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7f74f0056de0 con 0x7f74fc068140 2023-12-24T20:02:30.363 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:02:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.363+0000 7f7501189700 1 -- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74e8066f30 msgr2=0x7f74e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.363+0000 7f7501189700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74e8066f30 0x7f74e80693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0b0880 tx=0x7f74ec008040 comp rx=0 tx=0).stop 2023-12-24T20:02:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.363+0000 7f7501189700 1 -- 172.21.15.61:0/1582757099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 msgr2=0x7f74fc0c3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.363+0000 7f7501189700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 0x7f74fc0c3630 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f74f0009f40 tx=0x7f74f0016000 comp rx=0 tx=0).stop 2023-12-24T20:02:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.364+0000 7f7501189700 1 -- 172.21.15.61:0/1582757099 shutdown_connections 2023-12-24T20:02:30.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.364+0000 7f7501189700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f74fc159a60 0x7f74fc15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:30.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.364+0000 7f7501189700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f74e8066f30 0x7f74e80693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:30.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.364+0000 7f7501189700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f74fc068140 0x7f74fc0c3630 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:30.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.364+0000 7f7501189700 1 --2- 172.21.15.61:0/1582757099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74fc068510 0x7f74fc15a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:30.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.364+0000 7f7501189700 1 -- 172.21.15.61:0/1582757099 >> 172.21.15.61:0/1582757099 conn(0x7f74fc097a10 msgr2=0x7f74fc157840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:30.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.364+0000 7f7501189700 1 -- 172.21.15.61:0/1582757099 shutdown_connections 2023-12-24T20:02:30.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:30.364+0000 7f7501189700 1 -- 172.21.15.61:0/1582757099 wait complete. 2023-12-24T20:02:30.377 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:02:30.378 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:02:30.378 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T20:02:30.378 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T20:02:30.378 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T20:02:30.378 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:02:30.378 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:02:30.378 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:02:30.378 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:02:30.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:30.378 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T20:02:30.397 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:02:30.397 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:02:30.397 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:02:30.397 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:30.398 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T20:02:30.398 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:30.398 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:02:30.398 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T20:02:30.398 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T20:02:30.398 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:02:30.398 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T20:02:30.399 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T20:02:30.399 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:02:30.399 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:02:30.399 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:02:30.399 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:02:30.399 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:02:30.399 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42215sec preferred_lft 42215sec 2023-12-24T20:02:30.399 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T20:02:30.399 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:30.400 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:02:30.400 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:02:30.400 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:02:30.400 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:30.400 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T20:02:30.400 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:30.400 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:02:30.400 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:02:30.401 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link 2023-12-24T20:02:30.401 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:30.401 INFO:teuthology.orchestra.run.smithi061.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:02:30.401 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 12:83:d1:9f:62:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:02:30.401 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1083:d1ff:fe9f:62aa/64 scope link 2023-12-24T20:02:30.401 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:30.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:30.402 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:02:30.464 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T20:02:30.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:30.466 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T20:02:30.526 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T20:02:30.526 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:02:30.526 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:02:30.526 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:02:30.526 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:02:30.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:30.526 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T20:02:30.526 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T20:02:30.527 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:02:30.527 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:02:30.527 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:02:30.527 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T20:02:30.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:30.634 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T20:02:30.651 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:02:30.651 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:02:30.652 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:02:30.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:30.652 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T20:02:30.720 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T20:02:30.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:02:30.720 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T20:02:30.778 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:02:30.778 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:02:30.778 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:02:30.835 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:02:30.903 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:02:30.903 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:02:30.969 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:02:30.971 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:02:30.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:30.971 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:02:31.029 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:02:31.029 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T20:02:31.071 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:02:31.099 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:02:31.099 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:02:31.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T20:02:31.156+0000 7f7e9f873540 -1 init, newargv = 0x561d5cabf730 newargc=15 2023-12-24T20:02:31.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[63907]: starting ceph client 2023-12-24T20:02:31.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[63907]: starting fuse 2023-12-24T20:02:31.171 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:02:31.172 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:02:31.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:31.173 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:02:31.231 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T20:02:31.231 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T20:02:31.231 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:02:31.231 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:02:31.231 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:02:31.231 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:02:31.232 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:02:31.233 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:02:31.233 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:02:31.233 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:02:31.233 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:02:31.233 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:02:31.233 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:31.233 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:02:31.233 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:02:31.356 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.63907.asok 2023-12-24T20:02:31.538 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.63907.asok 2023-12-24T20:02:31.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:31.539 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.63907.asok status 2023-12-24T20:02:31.697 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:31.697 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:02:31.697 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:02:31.697 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "63907", 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 6867, 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 6867 2023-12-24T20:02:31.698 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2505477793 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2505477793 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.6867 192.168.0.1:0/2505477793", 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2505477793", 2023-12-24T20:02:31.699 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T20:02:31.700 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 60, 2023-12-24T20:02:31.700 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 122, 2023-12-24T20:02:31.700 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:02:31.700 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:02:31.700 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:02:31.700 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:31.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:31.707 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T20:02:31.707 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T20:02:31.725 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T20:02:31.725 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T20:02:31.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:31.726 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:02:31.793 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:02:31.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.954+0000 7fef9e04f700 1 Processor -- start 2023-12-24T20:02:31.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.954+0000 7fef9e04f700 1 -- start start 2023-12-24T20:02:31.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef9e04f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fef980af710 0x7fef980afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:31.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef9e04f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef98068c80 0x7fef98067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:31.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef9e04f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef980a6c80 0x7fef9815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:31.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef9e04f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef980687f0 con 0x7fef980af710 2023-12-24T20:02:31.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef9e04f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef980a7100 con 0x7fef980a6c80 2023-12-24T20:02:31.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef9e04f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef98067be0 con 0x7fef98068c80 2023-12-24T20:02:31.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef977fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fef980af710 0x7fef980afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:31.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef977fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fef980af710 0x7fef980afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54550/0 (socket says 172.21.15.61:54550) 2023-12-24T20:02:31.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef977fe700 1 -- 172.21.15.61:0/2794655309 learned_addr learned my addr 172.21.15.61:0/2794655309 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef96ffd700 1 --2- 172.21.15.61:0/2794655309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef98068c80 0x7fef98067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef97fff700 1 --2- 172.21.15.61:0/2794655309 >> v2:172.21.15.133:3300/0 conn(0x7fef980a6c80 0x7fef9815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef977fe700 1 -- 172.21.15.61:0/2794655309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef98068c80 msgr2=0x7fef98067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef977fe700 1 --2- 172.21.15.61:0/2794655309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef98068c80 0x7fef98067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef977fe700 1 -- 172.21.15.61:0/2794655309 >> v2:172.21.15.133:3300/0 conn(0x7fef980a6c80 msgr2=0x7fef9815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef977fe700 1 --2- 172.21.15.61:0/2794655309 >> v2:172.21.15.133:3300/0 conn(0x7fef980a6c80 0x7fef9815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef977fe700 1 -- 172.21.15.61:0/2794655309 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98067ec0 con 0x7fef980af710 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.955+0000 7fef97fff700 1 --2- 172.21.15.61:0/2794655309 >> v2:172.21.15.133:3300/0 conn(0x7fef980a6c80 0x7fef9815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef977fe700 1 --2- 172.21.15.61:0/2794655309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef980af710 0x7fef980afae0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fef980b3840 tx=0x7fef8800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756c4e505d66260 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef967fc700 1 -- 172.21.15.61:0/2794655309 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800dc50 con 0x7fef980af710 2023-12-24T20:02:31.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef967fc700 1 -- 172.21.15.61:0/2794655309 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8800ddb0 con 0x7fef980af710 2023-12-24T20:02:31.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef967fc700 1 -- 172.21.15.61:0/2794655309 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef880196d0 con 0x7fef980af710 2023-12-24T20:02:31.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef9e04f700 1 -- 172.21.15.61:0/2794655309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef980af710 msgr2=0x7fef980afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:31.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef9e04f700 1 --2- 172.21.15.61:0/2794655309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef980af710 0x7fef980afae0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fef980b3840 tx=0x7fef8800b4f0 comp rx=0 tx=0).stop 2023-12-24T20:02:31.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef9e04f700 1 -- 172.21.15.61:0/2794655309 shutdown_connections 2023-12-24T20:02:31.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef9e04f700 1 --2- 172.21.15.61:0/2794655309 >> v2:172.21.15.133:3300/0 conn(0x7fef980a6c80 0x7fef9815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:31.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef9e04f700 1 --2- 172.21.15.61:0/2794655309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef980af710 0x7fef980afae0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:31.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef9e04f700 1 --2- 172.21.15.61:0/2794655309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef98068c80 0x7fef98067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:31.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef9e04f700 1 -- 172.21.15.61:0/2794655309 >> 172.21.15.61:0/2794655309 conn(0x7fef980ca200 msgr2=0x7fef980ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:31.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef9e04f700 1 -- 172.21.15.61:0/2794655309 shutdown_connections 2023-12-24T20:02:31.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.956+0000 7fef9e04f700 1 -- 172.21.15.61:0/2794655309 wait complete. 2023-12-24T20:02:31.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.958+0000 7fef9e04f700 1 Processor -- start 2023-12-24T20:02:31.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.958+0000 7fef9e04f700 1 -- start start 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.958+0000 7fef9e04f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef98068c80 0x7fef981412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.958+0000 7fef9e04f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef980a6c80 0x7fef98154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.958+0000 7fef9e04f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef980af710 0x7fef980b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.958+0000 7fef9e04f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef980b2040 con 0x7fef98068c80 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.958+0000 7fef9e04f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9815a260 con 0x7fef980a6c80 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.958+0000 7fef9e04f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef98157380 con 0x7fef980af710 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef977fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef98068c80 0x7fef981412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef977fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef98068c80 0x7fef981412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54566/0 (socket says 172.21.15.61:54566) 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef977fe700 1 -- 172.21.15.61:0/3070144978 learned_addr learned my addr 172.21.15.61:0/3070144978 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef97fff700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef980af710 0x7fef980b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef96ffd700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef980a6c80 0x7fef98154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:31.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef977fe700 1 -- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef980af710 msgr2=0x7fef980b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef977fe700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef980af710 0x7fef980b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef977fe700 1 -- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef980a6c80 msgr2=0x7fef98154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef977fe700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef980a6c80 0x7fef98154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef977fe700 1 -- 172.21.15.61:0/3070144978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8800b790 con 0x7fef98068c80 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef977fe700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef98068c80 0x7fef981412d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fef8800b760 tx=0x7fef8801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef7f7fe700 1 -- 172.21.15.61:0/3070144978 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88010540 con 0x7fef98068c80 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef7f7fe700 1 -- 172.21.15.61:0/3070144978 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef880106a0 con 0x7fef98068c80 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef9e04f700 1 -- 172.21.15.61:0/3070144978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef98157660 con 0x7fef98068c80 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef7f7fe700 1 -- 172.21.15.61:0/3070144978 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88010a60 con 0x7fef98068c80 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.959+0000 7fef9e04f700 1 -- 172.21.15.61:0/3070144978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef98153660 con 0x7fef98068c80 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.960+0000 7fef9e04f700 1 -- 172.21.15.61:0/3070144978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9804c3c0 con 0x7fef98068c80 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.961+0000 7fef7f7fe700 1 -- 172.21.15.61:0/3070144978 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fef88022030 con 0x7fef98068c80 2023-12-24T20:02:31.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.961+0000 7fef7f7fe700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef84066f60 0x7fef84069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:31.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.961+0000 7fef7f7fe700 1 -- 172.21.15.61:0/3070144978 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef88014070 con 0x7fef98068c80 2023-12-24T20:02:31.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.961+0000 7fef96ffd700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef84066f60 0x7fef84069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:31.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.962+0000 7fef96ffd700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef84066f60 0x7fef84069410 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fef980b3550 tx=0x7fef8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:31.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:31.965+0000 7fef7f7fe700 1 -- 172.21.15.61:0/3070144978 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef88055970 con 0x7fef98068c80 2023-12-24T20:02:32.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.209+0000 7fef9e04f700 1 -- 172.21.15.61:0/3070144978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fef9806f110 con 0x7fef98068c80 2023-12-24T20:02:32.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.209+0000 7fef7f7fe700 1 -- 172.21.15.61:0/3070144978 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7fef88058f90 con 0x7fef98068c80 2023-12-24T20:02:32.210 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:02:32.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 -- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef84066f60 msgr2=0x7fef84069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:32.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef84066f60 0x7fef84069410 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fef980b3550 tx=0x7fef8c008040 comp rx=0 tx=0).stop 2023-12-24T20:02:32.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 -- 172.21.15.61:0/3070144978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef98068c80 msgr2=0x7fef981412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:32.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef98068c80 0x7fef981412d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fef8800b760 tx=0x7fef8801b000 comp rx=0 tx=0).stop 2023-12-24T20:02:32.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 -- 172.21.15.61:0/3070144978 shutdown_connections 2023-12-24T20:02:32.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fef980af710 0x7fef980b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:32.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fef84066f60 0x7fef84069410 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:32.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fef98068c80 0x7fef981412d0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:32.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 --2- 172.21.15.61:0/3070144978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef980a6c80 0x7fef98154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:32.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 -- 172.21.15.61:0/3070144978 >> 172.21.15.61:0/3070144978 conn(0x7fef980ca200 msgr2=0x7fef98069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:32.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 -- 172.21.15.61:0/3070144978 shutdown_connections 2023-12-24T20:02:32.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:32.211+0000 7fef9e04f700 1 -- 172.21.15.61:0/3070144978 wait complete. 2023-12-24T20:02:32.225 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:02:32.225 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:02:32.225 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T20:02:32.225 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T20:02:32.225 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T20:02:32.225 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:02:32.225 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:02:32.225 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:02:32.225 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:02:32.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:32.226 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T20:02:32.248 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:02:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:02:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:02:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T20:02:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:32.248 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:02:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:02:32.248 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T20:02:32.249 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:02:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:02:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T20:02:32.249 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:02:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:02:32.249 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:02:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:02:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:02:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42220sec preferred_lft 42220sec 2023-12-24T20:02:32.249 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::accb:c5ff:feae:915/64 scope link 2023-12-24T20:02:32.250 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:02:32.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:32.251 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:02:32.319 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T20:02:32.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:32.321 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T20:02:32.381 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T20:02:32.381 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:02:32.381 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:02:32.381 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:02:32.382 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:02:32.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:32.382 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T20:02:32.382 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T20:02:32.382 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:02:32.382 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:02:32.382 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:02:32.382 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T20:02:32.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:32.492 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T20:02:32.509 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T20:02:32.509 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T20:02:32.509 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:02:32.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:32.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T20:02:32.577 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T20:02:32.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:02:32.578 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T20:02:32.634 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:02:32.635 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:02:32.635 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:02:32.691 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:02:32.758 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:02:32.758 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:02:32.824 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:02:32.825 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:02:32.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:32.826 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:02:32.883 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:02:32.883 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T20:02:32.926 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:02:32.952 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:02:32.952 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:02:33.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T20:02:33.009+0000 7f4233ac8540 -1 init, newargv = 0x5580b5a79010 newargc=15 2023-12-24T20:02:33.008 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[46446]: starting ceph client 2023-12-24T20:02:33.013 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[46446]: starting fuse 2023-12-24T20:02:33.021 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:02:33.022 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:02:33.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:33.023 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:02:33.080 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T20:02:33.080 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T20:02:33.081 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:02:33.082 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T20:02:33.083 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T20:02:33.203 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.46446.asok 2023-12-24T20:02:33.386 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.46446.asok 2023-12-24T20:02:33.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:33.387 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.46446.asok status 2023-12-24T20:02:33.539 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T20:02:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T20:02:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "46446", 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5846, 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 5846 2023-12-24T20:02:33.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 336986513 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 336986513 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.5846 192.168.0.1:0/336986513", 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/336986513", 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 60, 2023-12-24T20:02:33.541 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 122, 2023-12-24T20:02:33.542 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:02:33.542 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T20:02:33.542 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T20:02:33.542 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T20:02:33.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:33.549 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T20:02:33.549 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T20:02:33.566 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T20:02:33.566 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T20:02:33.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:33.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:02:33.633 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:33.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.768+0000 7f2891eb3700 1 Processor -- start 2023-12-24T20:02:33.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.768+0000 7f2891eb3700 1 -- start start 2023-12-24T20:02:33.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f2891eb3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f288c070800 0x7f288c070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:33.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f2891eb3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f288c0af9e0 0x7f288c157580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:33.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f2891eb3700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288c06e790 con 0x7f288c0afe50 2023-12-24T20:02:33.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f2891eb3700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c06d8e0 con 0x7f288c070800 2023-12-24T20:02:33.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f2891eb3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c15c500 con 0x7f288c0af9e0 2023-12-24T20:02:33.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f288b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f288c070800 0x7f288c070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:33.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f288bfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f288c0afe50 0x7f288c069b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33836/0 (socket says 172.21.15.61:33836) 2023-12-24T20:02:33.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f288bfff700 1 -- 172.21.15.61:0/14556189 learned_addr learned my addr 172.21.15.61:0/14556189 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f288affd700 1 --2- 172.21.15.61:0/14556189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f288c0af9e0 0x7f288c157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f288b7fe700 1 -- 172.21.15.61:0/14556189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f288c0af9e0 msgr2=0x7f288c157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f288b7fe700 1 --2- 172.21.15.61:0/14556189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f288c0af9e0 0x7f288c157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f288b7fe700 1 -- 172.21.15.61:0/14556189 >> v1:172.21.15.61:6789/0 conn(0x7f288c0afe50 legacy=0x7f288c069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f288b7fe700 1 -- 172.21.15.61:0/14556189 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c06db80 con 0x7f288c070800 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.769+0000 7f288a7fc700 1 -- 172.21.15.61:0/14556189 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615089862 0 0) 0x7f288c06e790 con 0x7f288c0afe50 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f288b7fe700 1 --2- 172.21.15.61:0/14556189 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c070800 0x7f288c070bd0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f28740098e0 tx=0x7f28740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc671669d664502 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f288a7fc700 1 -- 172.21.15.61:0/14556189 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400b640 con 0x7f288c070800 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f288a7fc700 1 -- 172.21.15.61:0/14556189 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400b7a0 con 0x7f288c070800 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f288a7fc700 1 -- 172.21.15.61:0/14556189 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400bb40 con 0x7f288c070800 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f2891eb3700 1 -- 172.21.15.61:0/14556189 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c070800 msgr2=0x7f288c070bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f2891eb3700 1 --2- 172.21.15.61:0/14556189 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c070800 0x7f288c070bd0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f28740098e0 tx=0x7f28740091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f2891eb3700 1 -- 172.21.15.61:0/14556189 shutdown_connections 2023-12-24T20:02:33.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f2891eb3700 1 --2- 172.21.15.61:0/14556189 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c070800 0x7f288c070bd0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:33.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f2891eb3700 1 --2- 172.21.15.61:0/14556189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f288c0af9e0 0x7f288c157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:33.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f2891eb3700 1 -- 172.21.15.61:0/14556189 >> 172.21.15.61:0/14556189 conn(0x7f288c0cd6f0 msgr2=0x7f288c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:33.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f2891eb3700 1 -- 172.21.15.61:0/14556189 shutdown_connections 2023-12-24T20:02:33.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.770+0000 7f2891eb3700 1 -- 172.21.15.61:0/14556189 wait complete. 2023-12-24T20:02:33.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.772+0000 7f2891eb3700 1 Processor -- start 2023-12-24T20:02:33.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.772+0000 7f2891eb3700 1 -- start start 2023-12-24T20:02:33.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.772+0000 7f2891eb3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f288c070800 0x7f288c168060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.772+0000 7f2891eb3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c0af9e0 0x7f288c0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.772+0000 7f2891eb3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f288c0afe50 0x7f288c0b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.772+0000 7f2891eb3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c154970 con 0x7f288c0af9e0 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.772+0000 7f2891eb3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c154c50 con 0x7f288c070800 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f2891eb3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c168960 con 0x7f288c0afe50 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c0af9e0 0x7f288c0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c0af9e0 0x7f288c0b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54578/0 (socket says 172.21.15.61:54578) 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288affd700 1 -- 172.21.15.61:0/742266707 learned_addr learned my addr 172.21.15.61:0/742266707 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288bfff700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f288c0afe50 0x7f288c0b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288b7fe700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f288c070800 0x7f288c168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288affd700 1 -- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f288c0afe50 msgr2=0x7f288c0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288affd700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f288c0afe50 0x7f288c0b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288affd700 1 -- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f288c070800 msgr2=0x7f288c168060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288affd700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f288c070800 0x7f288c168060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:33.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288affd700 1 -- 172.21.15.61:0/742266707 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009420 con 0x7f288c0af9e0 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288b7fe700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f288c070800 0x7f288c168060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f288affd700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c0af9e0 0x7f288c0b2130 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f287c00ec80 tx=0x7f287c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f28837fe700 1 -- 172.21.15.61:0/742266707 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00c850 con 0x7f288c0af9e0 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f28837fe700 1 -- 172.21.15.61:0/742266707 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c00c9b0 con 0x7f288c0af9e0 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f2891eb3700 1 -- 172.21.15.61:0/742266707 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c168c40 con 0x7f288c0af9e0 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f28837fe700 1 -- 172.21.15.61:0/742266707 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00cd50 con 0x7f288c0af9e0 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.773+0000 7f2891eb3700 1 -- 172.21.15.61:0/742266707 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c1685a0 con 0x7f288c0af9e0 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.774+0000 7f2891eb3700 1 -- 172.21.15.61:0/742266707 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c04c3c0 con 0x7f288c0af9e0 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.775+0000 7f28837fe700 1 -- 172.21.15.61:0/742266707 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f287c013680 con 0x7f288c0af9e0 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.775+0000 7f28837fe700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f286c066f30 0x7f286c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:33.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.775+0000 7f28837fe700 1 -- 172.21.15.61:0/742266707 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f287c084b60 con 0x7f288c0af9e0 2023-12-24T20:02:33.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.775+0000 7f288b7fe700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f286c066f30 0x7f286c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:33.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.776+0000 7f288b7fe700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f286c066f30 0x7f286c0693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f28740093f0 tx=0x7f2874017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:33.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:33.780+0000 7f28837fe700 1 -- 172.21.15.61:0/742266707 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f287c051dd0 con 0x7f288c0af9e0 2023-12-24T20:02:34.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.019+0000 7f2891eb3700 1 -- 172.21.15.61:0/742266707 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f288c154d90 con 0x7f288c0af9e0 2023-12-24T20:02:34.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.019+0000 7f28837fe700 1 -- 172.21.15.61:0/742266707 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f287c017090 con 0x7f288c0af9e0 2023-12-24T20:02:34.021 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:34.021 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2890522920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2890522920},{"type":"v1","addr":"172.21.15.133:6836","nonce":2890522920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/946349829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":946349829},{"type":"v1","addr":"172.21.15.133:6837","nonce":946349829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3897383544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3897383544},{"type":"v1","addr":"172.21.15.61:6834","nonce":3897383544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:23.422714+0000","modified":"2023-12-24T20:02:27.054403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/447554724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":447554724},{"type":"v1","addr":"172.21.15.61:6835","nonce":447554724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T20:02:34.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 -- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f286c066f30 msgr2=0x7f286c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:34.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f286c066f30 0x7f286c0693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f28740093f0 tx=0x7f2874017000 comp rx=0 tx=0).stop 2023-12-24T20:02:34.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 -- 172.21.15.61:0/742266707 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c0af9e0 msgr2=0x7f288c0b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:34.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c0af9e0 0x7f288c0b2130 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f287c00ec80 tx=0x7f287c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 -- 172.21.15.61:0/742266707 shutdown_connections 2023-12-24T20:02:34.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f288c0afe50 0x7f288c0b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f286c066f30 0x7f286c0693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f288c070800 0x7f288c168060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 --2- 172.21.15.61:0/742266707 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f288c0af9e0 0x7f288c0b2130 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 -- 172.21.15.61:0/742266707 >> 172.21.15.61:0/742266707 conn(0x7f288c0cd6f0 msgr2=0x7f288c15c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:34.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 -- 172.21.15.61:0/742266707 shutdown_connections 2023-12-24T20:02:34.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.021+0000 7f2891eb3700 1 -- 172.21.15.61:0/742266707 wait complete. 2023-12-24T20:02:34.024 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 60 2023-12-24T20:02:34.035 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-24T20:02:34.176 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":6726,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.129240000999999,"mdsmap_epoch":60,"osdmap_epoch":122,"osdmap_epoch_barrier":122,"uptime":15.206383444} 2023-12-24T20:02:34.176 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 6726, "mdsmap_epoch": 60, "osdmap_epoch": 122, "osdmap_epoch_barrier": 122, "rank_uptime": 10.129240001, "state": "up:active", "uptime": 15.206383444, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:02:34.176 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-24T20:02:34.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.301+0000 7f130aeba700 1 Processor -- start 2023-12-24T20:02:34.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.301+0000 7f130aeba700 1 -- start start 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f130aeba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f130415e240 0x7f13040c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f130aeba700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f13040c4140 0x7f13040cc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f130aeba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040ccda0 0x7f13040c2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f130aeba700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1304068ab0 con 0x7f13040c4140 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f130aeba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13040683b0 con 0x7f130415e240 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f130aeba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13040cd540 con 0x7f13040ccda0 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1303fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f13040c4140 0x7f13040cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1303fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f13040c4140 0x7f13040cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54586/0 (socket says 172.21.15.61:54586) 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1303fff700 1 -- 172.21.15.61:0/593247137 learned_addr learned my addr 172.21.15.61:0/593247137 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1308c56700 1 --2- 172.21.15.61:0/593247137 >> v2:172.21.15.133:3300/0 conn(0x7f130415e240 0x7f13040c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:34.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1309457700 1 --2- 172.21.15.61:0/593247137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040ccda0 0x7f13040c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1303fff700 1 -- 172.21.15.61:0/593247137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040ccda0 msgr2=0x7f13040c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1303fff700 1 --2- 172.21.15.61:0/593247137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040ccda0 0x7f13040c2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1303fff700 1 -- 172.21.15.61:0/593247137 >> v2:172.21.15.133:3300/0 conn(0x7f130415e240 msgr2=0x7f13040c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1303fff700 1 --2- 172.21.15.61:0/593247137 >> v2:172.21.15.133:3300/0 conn(0x7f130415e240 0x7f13040c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1303fff700 1 -- 172.21.15.61:0/593247137 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304067f20 con 0x7f13040c4140 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1309457700 1 --2- 172.21.15.61:0/593247137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040ccda0 0x7f13040c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.302+0000 7f1303fff700 1 --2- 172.21.15.61:0/593247137 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13040c4140 0x7f13040cc860 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f130406f230 tx=0x7f12f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59189c3b5948a37 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f13037fe700 1 -- 172.21.15.61:0/593247137 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f000b820 con 0x7f13040c4140 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f13037fe700 1 -- 172.21.15.61:0/593247137 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f000b980 con 0x7f13040c4140 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f13037fe700 1 -- 172.21.15.61:0/593247137 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f000bd20 con 0x7f13040c4140 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f130aeba700 1 -- 172.21.15.61:0/593247137 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13040c4140 msgr2=0x7f13040cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f130aeba700 1 --2- 172.21.15.61:0/593247137 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13040c4140 0x7f13040cc860 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f130406f230 tx=0x7f12f0009250 comp rx=0 tx=0).stop 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f130aeba700 1 -- 172.21.15.61:0/593247137 shutdown_connections 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f130aeba700 1 --2- 172.21.15.61:0/593247137 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040ccda0 0x7f13040c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f130aeba700 1 --2- 172.21.15.61:0/593247137 >> v2:172.21.15.133:3300/0 conn(0x7f130415e240 0x7f13040c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f130aeba700 1 --2- 172.21.15.61:0/593247137 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13040c4140 0x7f13040cc860 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f130aeba700 1 -- 172.21.15.61:0/593247137 >> 172.21.15.61:0/593247137 conn(0x7f13040ca1e0 msgr2=0x7f13040ca5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:34.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f130aeba700 1 -- 172.21.15.61:0/593247137 shutdown_connections 2023-12-24T20:02:34.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.303+0000 7f130aeba700 1 -- 172.21.15.61:0/593247137 wait complete. 2023-12-24T20:02:34.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.304+0000 7f130aeba700 1 Processor -- start 2023-12-24T20:02:34.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.305+0000 7f130aeba700 1 -- start start 2023-12-24T20:02:34.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.305+0000 7f130aeba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040c4140 0x7f13040af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:34.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.305+0000 7f130aeba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13040ccda0 0x7f13040ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.305+0000 7f130aeba700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f130415e240 0x7f13040adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.305+0000 7f130aeba700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130416d7b0 con 0x7f130415e240 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.305+0000 7f130aeba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13040ad020 con 0x7f13040ccda0 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.305+0000 7f130aeba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130416da50 con 0x7f13040c4140 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.305+0000 7f1309457700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f130415e240 0x7f13040adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.305+0000 7f1309457700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f130415e240 0x7f13040adbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54598/0 (socket says 172.21.15.61:54598) 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.305+0000 7f1309457700 1 -- 172.21.15.61:0/2778238509 learned_addr learned my addr 172.21.15.61:0/2778238509 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1308c56700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040c4140 0x7f13040af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1303fff700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13040ccda0 0x7f13040ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1309457700 1 -- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040c4140 msgr2=0x7f13040af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1309457700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040c4140 0x7f13040af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1309457700 1 -- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13040ccda0 msgr2=0x7f13040ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1309457700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13040ccda0 0x7f13040ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1309457700 1 -- 172.21.15.61:0/2778238509 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00094f0 con 0x7f130415e240 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1309457700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f130415e240 0x7f13040adbc0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00a380 tx=0x7f12fc007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1300ff9700 1 -- 172.21.15.61:0/2778238509 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc015440 con 0x7f130415e240 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1300ff9700 1 -- 172.21.15.61:0/2778238509 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc0155a0 con 0x7f130415e240 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f1300ff9700 1 -- 172.21.15.61:0/2778238509 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc015960 con 0x7f130415e240 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f130aeba700 1 -- 172.21.15.61:0/2778238509 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130416dd30 con 0x7f130415e240 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.306+0000 7f130aeba700 1 -- 172.21.15.61:0/2778238509 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13040accb0 con 0x7f130415e240 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.307+0000 7f130aeba700 1 -- 172.21.15.61:0/2778238509 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130415b0a0 con 0x7f130415e240 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.308+0000 7f1300ff9700 1 -- 172.21.15.61:0/2778238509 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f12fc00d440 con 0x7f130415e240 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.308+0000 7f1300ff9700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f12e8066f60 0x7f12e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.308+0000 7f1300ff9700 1 -- 172.21.15.61:0/2778238509 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12fc084fb0 con 0x7f130415e240 2023-12-24T20:02:34.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.308+0000 7f1308c56700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f12e8066f60 0x7f12e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:34.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.309+0000 7f1308c56700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f12e8066f60 0x7f12e8069410 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f12f8006fd0 tx=0x7f12f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:34.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.312+0000 7f1300ff9700 1 -- 172.21.15.61:0/2778238509 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12fc052220 con 0x7f130415e240 2023-12-24T20:02:34.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.510+0000 7f130aeba700 1 -- 172.21.15.61:0/2778238509 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f130404c3c0 con 0x7f130415e240 2023-12-24T20:02:34.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.576+0000 7f1300ff9700 1 -- 172.21.15.61:0/2778238509 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v123) v1 ==== 181+0+0 (secure 0 0 0) 0x7f12fc01a0c0 con 0x7f130415e240 2023-12-24T20:02:34.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 -- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f12e8066f60 msgr2=0x7f12e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:34.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f12e8066f60 0x7f12e8069410 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f12f8006fd0 tx=0x7f12f8008040 comp rx=0 tx=0).stop 2023-12-24T20:02:34.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 -- 172.21.15.61:0/2778238509 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f130415e240 msgr2=0x7f13040adbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:34.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f130415e240 0x7f13040adbc0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f12fc00a380 tx=0x7f12fc007900 comp rx=0 tx=0).stop 2023-12-24T20:02:34.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 -- 172.21.15.61:0/2778238509 shutdown_connections 2023-12-24T20:02:34.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13040c4140 0x7f13040af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f12e8066f60 0x7f12e8069410 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f130415e240 0x7f13040adbc0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 --2- 172.21.15.61:0/2778238509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13040ccda0 0x7f13040ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:34.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 -- 172.21.15.61:0/2778238509 >> 172.21.15.61:0/2778238509 conn(0x7f13040ca1e0 msgr2=0x7f1304070640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:34.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 -- 172.21.15.61:0/2778238509 shutdown_connections 2023-12-24T20:02:34.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:34.579+0000 7f130aeba700 1 -- 172.21.15.61:0/2778238509 wait complete. 2023-12-24T20:02:34.581 INFO:teuthology.orchestra.run.smithi061.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-24T20:02:34.593 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:02:34.593 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:02:34.593 DEBUG:teuthology.orchestra.run.smithi061:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-24T20:02:34.593 DEBUG:teuthology.orchestra.run.smithi061:> os.fchmod(fd, 0O666) 2023-12-24T20:02:34.593 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(fd) 2023-12-24T20:02:34.593 DEBUG:teuthology.orchestra.run.smithi061:> os.close(fd) 2023-12-24T20:02:34.593 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:02:34.849 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:02:34.850 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:02:34.850 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:02:34.850 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:02:34.850 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:02:34.850 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:34.850 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:02:34.851 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:02:34.851 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:02:34.851 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:02:34.851 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:34.851 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:02:34.851 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:02:34.851 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:02:34.852 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:02:34.852 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:34.852 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:02:34.852 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:02:34.852 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:02:34.852 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:02:34.852 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:02:34.852 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:02:34.853 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:02:34.853 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:02:34.853 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:34.853 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:02:34.853 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:02:34.976 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.63907.asok 2023-12-24T20:02:35.159 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.63907.asok 2023-12-24T20:02:35.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:35.159 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.63907.asok status 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "63907", 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 1, 2023-12-24T20:02:35.318 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 6867, 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 6867 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2505477793 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:02:35.319 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2505477793 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.6867 192.168.0.1:0/2505477793", 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2505477793", 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 2, 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 60, 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 122, 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 122, 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:02:35.320 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:35.328 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-12-24T20:02:35.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.448+0000 7f99388ea700 1 Processor -- start 2023-12-24T20:02:35.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.448+0000 7f99388ea700 1 -- start start 2023-12-24T20:02:35.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.449+0000 7f99388ea700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9934159920 0x7f993406f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.449+0000 7f99388ea700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993415aba0 con 0x7f9934159cf0 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.449+0000 7f99388ea700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993415ae80 con 0x7f99340cd920 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.449+0000 7f99388ea700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993406fbe0 con 0x7f9934159920 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.449+0000 7f9932d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9934159cf0 0x7f993415a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33850/0 (socket says 172.21.15.61:33850) 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.449+0000 7f9932d9d700 1 -- 172.21.15.61:0/4000329505 learned_addr learned my addr 172.21.15.61:0/4000329505 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993259c700 1 --2- 172.21.15.61:0/4000329505 >> v2:172.21.15.133:3300/0 conn(0x7f9934159920 0x7f993406f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796845418 0 0) 0x7f993415aba0 con 0x7f9934159cf0 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f991c003570 con 0x7f9934159cf0 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1261321155 0 0) 0x7f991c003570 con 0x7f9934159cf0 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 >> v2:172.21.15.133:3300/0 conn(0x7f9934159920 msgr2=0x7f993406f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 --2- 172.21.15.61:0/4000329505 >> v2:172.21.15.133:3300/0 conn(0x7f9934159920 0x7f993406f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 >> v1:172.21.15.133:6789/0 conn(0x7f99340cd920 legacy=0x7f99340cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993406ebc0 con 0x7f9934159cf0 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f992c0017f0 con 0x7f9934159cf0 2023-12-24T20:02:35.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 >> v1:172.21.15.61:6789/0 conn(0x7f9934159cf0 legacy=0x7f993415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c003a60 0x7f991c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f991c004810 0x7f991c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c0051c0 0x7f991c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993406fbe0 con 0x7f991c004810 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c00c0d0 con 0x7f991c003a60 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c00c290 con 0x7f991c0051c0 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f9931d9b700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f991c004810 0x7f991c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f993259c700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c003a60 0x7f991c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f9932d9d700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c0051c0 0x7f991c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f9931d9b700 1 -- 172.21.15.61:0/4000329505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c0051c0 msgr2=0x7f991c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:35.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f9931d9b700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c0051c0 0x7f991c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:35.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f9931d9b700 1 -- 172.21.15.61:0/4000329505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c003a60 msgr2=0x7f991c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:35.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f9931d9b700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f991c003a60 0x7f991c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:35.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.450+0000 7f9931d9b700 1 -- 172.21.15.61:0/4000329505 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c003570 con 0x7f991c004810 2023-12-24T20:02:35.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f9932d9d700 1 -- 172.21.15.61:0/4000329505 reap_dead start 2023-12-24T20:02:35.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f9931d9b700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f991c004810 0x7f991c004c80 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f99240018b0 tx=0x7f9924007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ce48cb6ae410c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:35.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924012420 con 0x7f991c004810 2023-12-24T20:02:35.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99240125a0 con 0x7f991c004810 2023-12-24T20:02:35.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f993159a700 1 -- 172.21.15.61:0/4000329505 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924012960 con 0x7f991c004810 2023-12-24T20:02:35.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f99388ea700 1 -- 172.21.15.61:0/4000329505 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f991c004810 msgr2=0x7f991c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:35.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f99388ea700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f991c004810 0x7f991c004c80 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f99240018b0 tx=0x7f9924007d30 comp rx=0 tx=0).stop 2023-12-24T20:02:35.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f99388ea700 1 -- 172.21.15.61:0/4000329505 shutdown_connections 2023-12-24T20:02:35.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f99388ea700 1 --2- 172.21.15.61:0/4000329505 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f991c004810 0x7f991c004c80 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:35.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f99388ea700 1 -- 172.21.15.61:0/4000329505 >> 172.21.15.61:0/4000329505 conn(0x7f993406b790 msgr2=0x7f9934069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:35.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f99388ea700 1 -- 172.21.15.61:0/4000329505 shutdown_connections 2023-12-24T20:02:35.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.451+0000 7f99388ea700 1 -- 172.21.15.61:0/4000329505 wait complete. 2023-12-24T20:02:35.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f99388ea700 1 Processor -- start 2023-12-24T20:02:35.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f99388ea700 1 -- start start 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f99388ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c004810 0x7f99340cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f99388ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9934153520 0x7f9934155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f99388ea700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99340b2ba0 0x7f99340b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f99388ea700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99340ae0d0 con 0x7f99340b2ba0 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f99388ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99340cbca0 con 0x7f9934153520 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f99388ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99340b3550 con 0x7f991c004810 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f9932d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99340b2ba0 0x7f99340b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f9932d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99340b2ba0 0x7f99340b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:54620/0 (socket says 172.21.15.61:54620) 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.453+0000 7f9932d9d700 1 -- 172.21.15.61:0/551475458 learned_addr learned my addr 172.21.15.61:0/551475458 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f993259c700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c004810 0x7f99340cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:35.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f9931d9b700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9934153520 0x7f9934155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f9932d9d700 1 -- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c004810 msgr2=0x7f99340cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f9932d9d700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c004810 0x7f99340cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f9932d9d700 1 -- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9934153520 msgr2=0x7f9934155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f9932d9d700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9934153520 0x7f9934155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f9932d9d700 1 -- 172.21.15.61:0/551475458 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99341592e0 con 0x7f99340b2ba0 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f993259c700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c004810 0x7f99340cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f9932d9d700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99340b2ba0 0x7f99340b3010 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f99340cc600 tx=0x7f992c00e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f99227fc700 1 -- 172.21.15.61:0/551475458 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00ed00 con 0x7f99340b2ba0 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f99227fc700 1 -- 172.21.15.61:0/551475458 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00ee60 con 0x7f99340b2ba0 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f99388ea700 1 -- 172.21.15.61:0/551475458 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99340aeef0 con 0x7f99340b2ba0 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f99227fc700 1 -- 172.21.15.61:0/551475458 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c013670 con 0x7f99340b2ba0 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.454+0000 7f99388ea700 1 -- 172.21.15.61:0/551475458 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99340ae600 con 0x7f99340b2ba0 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.455+0000 7f99388ea700 1 -- 172.21.15.61:0/551475458 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993404c3c0 con 0x7f99340b2ba0 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.455+0000 7f99227fc700 1 -- 172.21.15.61:0/551475458 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f992c0139e0 con 0x7f99340b2ba0 2023-12-24T20:02:35.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.456+0000 7f99227fc700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9914066f30 0x7f99140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:35.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.456+0000 7f99227fc700 1 -- 172.21.15.61:0/551475458 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f992c084c40 con 0x7f99340b2ba0 2023-12-24T20:02:35.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.456+0000 7f993259c700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9914066f30 0x7f99140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:35.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.456+0000 7f993259c700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9914066f30 0x7f99140693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9934066960 tx=0x7f9928008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:35.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.460+0000 7f99227fc700 1 -- 172.21.15.61:0/551475458 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f992c051eb0 con 0x7f99340b2ba0 2023-12-24T20:02:35.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:35.669+0000 7f99388ea700 1 -- 172.21.15.61:0/551475458 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f993404c3c0 con 0x7f99340b2ba0 2023-12-24T20:02:36.206 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:02:36.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:02:36.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.588+0000 7f99227fc700 1 -- 172.21.15.61:0/551475458 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v124) v1 ==== 93+0+0 (secure 0 0 0) 0x7f992c0554d0 con 0x7f99340b2ba0 2023-12-24T20:02:36.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.590+0000 7f99388ea700 1 -- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9914066f30 msgr2=0x7f99140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:36.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.590+0000 7f99388ea700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9914066f30 0x7f99140693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9934066960 tx=0x7f9928008040 comp rx=0 tx=0).stop 2023-12-24T20:02:36.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.590+0000 7f99388ea700 1 -- 172.21.15.61:0/551475458 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99340b2ba0 msgr2=0x7f99340b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:36.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.590+0000 7f99388ea700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99340b2ba0 0x7f99340b3010 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f99340cc600 tx=0x7f992c00e440 comp rx=0 tx=0).stop 2023-12-24T20:02:36.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.591+0000 7f99388ea700 1 -- 172.21.15.61:0/551475458 shutdown_connections 2023-12-24T20:02:36.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.591+0000 7f99388ea700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f991c004810 0x7f99340cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:36.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.591+0000 7f99388ea700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9914066f30 0x7f99140693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:36.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.591+0000 7f99388ea700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99340b2ba0 0x7f99340b3010 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:36.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.591+0000 7f99388ea700 1 --2- 172.21.15.61:0/551475458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9934153520 0x7f9934155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:36.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.591+0000 7f99388ea700 1 -- 172.21.15.61:0/551475458 >> 172.21.15.61:0/551475458 conn(0x7f993406b790 msgr2=0x7f99340c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:36.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.591+0000 7f99388ea700 1 -- 172.21.15.61:0/551475458 shutdown_connections 2023-12-24T20:02:36.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.591+0000 7f99388ea700 1 -- 172.21.15.61:0/551475458 wait complete. 2023-12-24T20:02:36.593 INFO:teuthology.orchestra.run.smithi061.stderr:pauserd,pausewr is set 2023-12-24T20:02:36.607 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-12-24T20:02:36.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.733+0000 7fd853279700 1 Processor -- start 2023-12-24T20:02:36.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.733+0000 7fd853279700 1 -- start start 2023-12-24T20:02:36.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.734+0000 7fd853279700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c06de80 0x7fd84c06e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:36.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.734+0000 7fd853279700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd84c0b3300 0x7fd84c156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:36.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.734+0000 7fd853279700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c068140 con 0x7fd84c0cb820 2023-12-24T20:02:36.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.734+0000 7fd853279700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84c067550 con 0x7fd84c0b3300 2023-12-24T20:02:36.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.734+0000 7fd853279700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c068ce0 con 0x7fd84c06de80 2023-12-24T20:02:36.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.734+0000 7fd851816700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd84c0b3300 0x7fd84c156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:36.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.734+0000 7fd851816700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd84c0b3300 0x7fd84c156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47042/0 (socket says 172.21.15.61:47042) 2023-12-24T20:02:36.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.734+0000 7fd851816700 1 -- 172.21.15.61:0/4019463138 learned_addr learned my addr 172.21.15.61:0/4019463138 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd851015700 1 --2- 172.21.15.61:0/4019463138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c06de80 0x7fd84c06e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd851816700 1 -- 172.21.15.61:0/4019463138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c06de80 msgr2=0x7fd84c06e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd851816700 1 --2- 172.21.15.61:0/4019463138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c06de80 0x7fd84c06e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd851816700 1 -- 172.21.15.61:0/4019463138 >> v1:172.21.15.133:6789/0 conn(0x7fd84c0cb820 legacy=0x7fd84c0685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd851816700 1 -- 172.21.15.61:0/4019463138 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0cbc30 con 0x7fd84c0b3300 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd851015700 1 --2- 172.21.15.61:0/4019463138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c06de80 0x7fd84c06e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd851816700 1 --2- 172.21.15.61:0/4019463138 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0b3300 0x7fd84c156640 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd844009f20 tx=0x7fd844009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1584c29227f14bed server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd843fff700 1 -- 172.21.15.61:0/4019463138 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84400e070 con 0x7fd84c0b3300 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd843fff700 1 -- 172.21.15.61:0/4019463138 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84400bad0 con 0x7fd84c0b3300 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd843fff700 1 -- 172.21.15.61:0/4019463138 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8440092e0 con 0x7fd84c0b3300 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.735+0000 7fd853279700 1 -- 172.21.15.61:0/4019463138 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0b3300 msgr2=0x7fd84c156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.736+0000 7fd853279700 1 --2- 172.21.15.61:0/4019463138 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0b3300 0x7fd84c156640 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd844009f20 tx=0x7fd844009840 comp rx=0 tx=0).stop 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.736+0000 7fd853279700 1 -- 172.21.15.61:0/4019463138 shutdown_connections 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.736+0000 7fd853279700 1 --2- 172.21.15.61:0/4019463138 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0b3300 0x7fd84c156640 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:36.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.736+0000 7fd853279700 1 --2- 172.21.15.61:0/4019463138 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c06de80 0x7fd84c06e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:36.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.736+0000 7fd853279700 1 -- 172.21.15.61:0/4019463138 >> 172.21.15.61:0/4019463138 conn(0x7fd84c0ce3f0 msgr2=0x7fd84c0b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:36.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.736+0000 7fd853279700 1 -- 172.21.15.61:0/4019463138 shutdown_connections 2023-12-24T20:02:36.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.736+0000 7fd853279700 1 -- 172.21.15.61:0/4019463138 wait complete. 2023-12-24T20:02:36.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.737+0000 7fd853279700 1 Processor -- start 2023-12-24T20:02:36.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.737+0000 7fd853279700 1 -- start start 2023-12-24T20:02:36.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd853279700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c06de80 0x7fd84c13ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:36.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd853279700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c0b3300 0x7fd84c13d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:36.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd853279700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0cb820 0x7fd84c13da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:36.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd853279700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c150f40 con 0x7fd84c0cb820 2023-12-24T20:02:36.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd853279700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0c3f70 con 0x7fd84c06de80 2023-12-24T20:02:36.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd853279700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0c3360 con 0x7fd84c0b3300 2023-12-24T20:02:36.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851816700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0cb820 0x7fd84c13da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851816700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0cb820 0x7fd84c13da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47052/0 (socket says 172.21.15.61:47052) 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851816700 1 -- 172.21.15.61:0/895775599 learned_addr learned my addr 172.21.15.61:0/895775599 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851015700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c06de80 0x7fd84c13ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd850814700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c0b3300 0x7fd84c13d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851816700 1 -- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c0b3300 msgr2=0x7fd84c13d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851816700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c0b3300 0x7fd84c13d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851816700 1 -- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c06de80 msgr2=0x7fd84c13ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851816700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c06de80 0x7fd84c13ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851816700 1 -- 172.21.15.61:0/895775599 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844009ae0 con 0x7fd84c0cb820 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851015700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c06de80 0x7fd84c13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd850814700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c0b3300 0x7fd84c13d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd851816700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0cb820 0x7fd84c13da10 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fd84400b6c0 tx=0x7fd844017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd8417fa700 1 -- 172.21.15.61:0/895775599 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd844012e10 con 0x7fd84c0cb820 2023-12-24T20:02:36.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd8417fa700 1 -- 172.21.15.61:0/895775599 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84401d420 con 0x7fd84c0cb820 2023-12-24T20:02:36.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd853279700 1 -- 172.21.15.61:0/895775599 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c0c3640 con 0x7fd84c0cb820 2023-12-24T20:02:36.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd8417fa700 1 -- 172.21.15.61:0/895775599 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84401d7e0 con 0x7fd84c0cb820 2023-12-24T20:02:36.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.738+0000 7fd853279700 1 -- 172.21.15.61:0/895775599 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c0c3c00 con 0x7fd84c0cb820 2023-12-24T20:02:36.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.739+0000 7fd853279700 1 -- 172.21.15.61:0/895775599 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84c0c4100 con 0x7fd84c0cb820 2023-12-24T20:02:36.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.740+0000 7fd8417fa700 1 -- 172.21.15.61:0/895775599 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd84401dbd0 con 0x7fd84c0cb820 2023-12-24T20:02:36.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.740+0000 7fd8417fa700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd830066f30 0x7fd8300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:36.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.740+0000 7fd8417fa700 1 -- 172.21.15.61:0/895775599 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd844085fd0 con 0x7fd84c0cb820 2023-12-24T20:02:36.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.740+0000 7fd8417fa700 1 -- 172.21.15.61:0/895775599 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=125+}) v3 -- 0x7fd83006ea50 con 0x7fd84c0cb820 2023-12-24T20:02:36.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.741+0000 7fd851015700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd830066f30 0x7fd8300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:36.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.741+0000 7fd851015700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd830066f30 0x7fd8300693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00ac10 tx=0x7fd83c006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:36.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.745+0000 7fd8417fa700 1 -- 172.21.15.61:0/895775599 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8440531a0 con 0x7fd84c0cb820 2023-12-24T20:02:36.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:36.956+0000 7fd853279700 1 -- 172.21.15.61:0/895775599 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fd84c04c3c0 con 0x7fd84c0cb820 2023-12-24T20:02:37.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.589+0000 7fd8417fa700 1 -- 172.21.15.61:0/895775599 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(125..125 src has 1..125) v4 ==== 280+0+0 (secure 0 0 0) 0x7fd844057560 con 0x7fd84c0cb820 2023-12-24T20:02:37.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.589+0000 7fd8417fa700 1 -- 172.21.15.61:0/895775599 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=126}) v3 -- 0x7fd83006f3a0 con 0x7fd84c0cb820 2023-12-24T20:02:37.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.592+0000 7fd8417fa700 1 -- 172.21.15.61:0/895775599 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v125) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd84402a030 con 0x7fd84c0cb820 2023-12-24T20:02:37.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 -- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd830066f30 msgr2=0x7fd8300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd830066f30 0x7fd8300693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00ac10 tx=0x7fd83c006f90 comp rx=0 tx=0).stop 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 -- 172.21.15.61:0/895775599 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0cb820 msgr2=0x7fd84c13da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0cb820 0x7fd84c13da10 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fd84400b6c0 tx=0x7fd844017000 comp rx=0 tx=0).stop 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 -- 172.21.15.61:0/895775599 shutdown_connections 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd830066f30 0x7fd8300693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd84c0cb820 0x7fd84c13da10 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd84c06de80 0x7fd84c13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 --2- 172.21.15.61:0/895775599 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd84c0b3300 0x7fd84c13d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 -- 172.21.15.61:0/895775599 >> 172.21.15.61:0/895775599 conn(0x7fd84c0ce3f0 msgr2=0x7fd84c0b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 -- 172.21.15.61:0/895775599 shutdown_connections 2023-12-24T20:02:37.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.595+0000 7fd853279700 1 -- 172.21.15.61:0/895775599 wait complete. 2023-12-24T20:02:37.597 INFO:teuthology.orchestra.run.smithi061.stderr:pauserd,pausewr is unset 2023-12-24T20:02:37.610 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:37.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.739+0000 7f2deeac0700 1 Processor -- start 2023-12-24T20:02:37.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.739+0000 7f2deeac0700 1 -- start start 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.740+0000 7f2deeac0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2de80aaf90 0x7f2de8159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.740+0000 7f2deeac0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de806a630 con 0x7f2de8159850 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.740+0000 7f2deeac0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de8069d00 con 0x7f2de806aac0 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.740+0000 7f2deeac0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80cccf0 con 0x7f2de80aaf90 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.740+0000 7f2ded05d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2de80aaf90 0x7f2de8159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.740+0000 7f2dec85c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2de8159850 0x7f2de80cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34248/0 (socket says 172.21.15.61:34248) 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.740+0000 7f2dec85c700 1 -- 172.21.15.61:0/1443034747 learned_addr learned my addr 172.21.15.61:0/1443034747 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2ded05d700 1 -- 172.21.15.61:0/1443034747 >> v1:172.21.15.133:6789/0 conn(0x7f2de806aac0 legacy=0x7f2de80aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2ded05d700 1 -- 172.21.15.61:0/1443034747 >> v1:172.21.15.61:6789/0 conn(0x7f2de8159850 legacy=0x7f2de80cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2de77fe700 1 -- 172.21.15.61:0/1443034747 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937133564 0 0) 0x7f2de806a630 con 0x7f2de8159850 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2ded05d700 1 -- 172.21.15.61:0/1443034747 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de8069fe0 con 0x7f2de80aaf90 2023-12-24T20:02:37.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2ded05d700 1 --2- 172.21.15.61:0/1443034747 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de80aaf90 0x7f2de8159c20 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009e60 tx=0x7f2de0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c6c316af4ca0b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:37.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2de77fe700 1 -- 172.21.15.61:0/1443034747 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de000e070 con 0x7f2de80aaf90 2023-12-24T20:02:37.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2de77fe700 1 -- 172.21.15.61:0/1443034747 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de000bbf0 con 0x7f2de80aaf90 2023-12-24T20:02:37.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2de77fe700 1 -- 172.21.15.61:0/1443034747 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0012430 con 0x7f2de80aaf90 2023-12-24T20:02:37.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2deeac0700 1 -- 172.21.15.61:0/1443034747 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de80aaf90 msgr2=0x7f2de8159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:37.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2deeac0700 1 --2- 172.21.15.61:0/1443034747 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de80aaf90 0x7f2de8159c20 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009e60 tx=0x7f2de0009780 comp rx=0 tx=0).stop 2023-12-24T20:02:37.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2deeac0700 1 -- 172.21.15.61:0/1443034747 shutdown_connections 2023-12-24T20:02:37.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2deeac0700 1 --2- 172.21.15.61:0/1443034747 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de80aaf90 0x7f2de8159c20 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2deeac0700 1 -- 172.21.15.61:0/1443034747 >> 172.21.15.61:0/1443034747 conn(0x7f2de80cceb0 msgr2=0x7f2de80cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:37.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.741+0000 7f2deeac0700 1 -- 172.21.15.61:0/1443034747 shutdown_connections 2023-12-24T20:02:37.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.742+0000 7f2deeac0700 1 -- 172.21.15.61:0/1443034747 wait complete. 2023-12-24T20:02:37.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.743+0000 7f2deeac0700 1 Processor -- start 2023-12-24T20:02:37.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.743+0000 7f2deeac0700 1 -- start start 2023-12-24T20:02:37.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2deeac0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de806aac0 0x7f2de80ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:37.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2deeac0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2de80aaf90 0x7f2de80af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:37.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2deeac0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de8159850 0x7f2de8169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:37.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2deeac0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80af950 con 0x7f2de8159850 2023-12-24T20:02:37.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2deeac0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de8143200 con 0x7f2de806aac0 2023-12-24T20:02:37.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2deeac0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de815f2a0 con 0x7f2de80aaf90 2023-12-24T20:02:37.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2ded05d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de8159850 0x7f2de8169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:37.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2ded05d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de8159850 0x7f2de8169fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47068/0 (socket says 172.21.15.61:47068) 2023-12-24T20:02:37.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2ded05d700 1 -- 172.21.15.61:0/3559346749 learned_addr learned my addr 172.21.15.61:0/3559346749 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:37.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2dec85c700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de806aac0 0x7f2de80ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:37.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2de7fff700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2de80aaf90 0x7f2de80af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:37.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2ded05d700 1 -- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2de80aaf90 msgr2=0x7f2de80af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:37.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2ded05d700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2de80aaf90 0x7f2de80af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2ded05d700 1 -- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de806aac0 msgr2=0x7f2de80ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:37.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2ded05d700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de806aac0 0x7f2de80ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2ded05d700 1 -- 172.21.15.61:0/3559346749 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de0009a20 con 0x7f2de8159850 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2ded05d700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de8159850 0x7f2de8169fd0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2de0003000 tx=0x7f2de0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2de4ff9700 1 -- 172.21.15.61:0/3559346749 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de001e710 con 0x7f2de8159850 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2de4ff9700 1 -- 172.21.15.61:0/3559346749 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de001e870 con 0x7f2de8159850 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2deeac0700 1 -- 172.21.15.61:0/3559346749 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de815d3e0 con 0x7f2de8159850 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2de4ff9700 1 -- 172.21.15.61:0/3559346749 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de001ec30 con 0x7f2de8159850 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.744+0000 7f2deeac0700 1 -- 172.21.15.61:0/3559346749 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de815ec50 con 0x7f2de8159850 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.745+0000 7f2deeac0700 1 -- 172.21.15.61:0/3559346749 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de804c3c0 con 0x7f2de8159850 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.746+0000 7f2de4ff9700 1 -- 172.21.15.61:0/3559346749 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2de0024070 con 0x7f2de8159850 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.746+0000 7f2de4ff9700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2dcc066f30 0x7f2dcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.746+0000 7f2de4ff9700 1 -- 172.21.15.61:0/3559346749 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2de0087070 con 0x7f2de8159850 2023-12-24T20:02:37.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.746+0000 7f2dec85c700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2dcc066f30 0x7f2dcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:37.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.747+0000 7f2dec85c700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2dcc066f30 0x7f2dcc0693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00c8f0 tx=0x7f2ddc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:37.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.750+0000 7f2de4ff9700 1 -- 172.21.15.61:0/3559346749 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2de00542e0 con 0x7f2de8159850 2023-12-24T20:02:37.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.946+0000 7f2deeac0700 1 -- 172.21.15.61:0/3559346749 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2de815f3e0 con 0x7f2de8159850 2023-12-24T20:02:37.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.947+0000 7f2de4ff9700 1 -- 172.21.15.61:0/3559346749 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f2de0057900 con 0x7f2de8159850 2023-12-24T20:02:37.948 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:37.948 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":125,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:37.588176+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:21.867619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:22.397630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:37.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 -- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2dcc066f30 msgr2=0x7f2dcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:37.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2dcc066f30 0x7f2dcc0693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00c8f0 tx=0x7f2ddc009040 comp rx=0 tx=0).stop 2023-12-24T20:02:37.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 -- 172.21.15.61:0/3559346749 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de8159850 msgr2=0x7f2de8169fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:37.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de8159850 0x7f2de8169fd0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2de0003000 tx=0x7f2de0018000 comp rx=0 tx=0).stop 2023-12-24T20:02:37.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 -- 172.21.15.61:0/3559346749 shutdown_connections 2023-12-24T20:02:37.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2dcc066f30 0x7f2dcc0693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2de8159850 0x7f2de8169fd0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de806aac0 0x7f2de80ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 --2- 172.21.15.61:0/3559346749 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2de80aaf90 0x7f2de80af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:37.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 -- 172.21.15.61:0/3559346749 >> 172.21.15.61:0/3559346749 conn(0x7f2de80cceb0 msgr2=0x7f2de80c2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:37.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 -- 172.21.15.61:0/3559346749 shutdown_connections 2023-12-24T20:02:37.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:37.949+0000 7f2deeac0700 1 -- 172.21.15.61:0/3559346749 wait complete. 2023-12-24T20:02:37.962 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:02:37.962 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:02:37.963 DEBUG:teuthology.orchestra.run.smithi061:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-24T20:02:37.963 DEBUG:teuthology.orchestra.run.smithi061:> os.fchmod(fd, 0O666) 2023-12-24T20:02:37.963 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(fd) 2023-12-24T20:02:37.963 DEBUG:teuthology.orchestra.run.smithi061:> os.close(fd) 2023-12-24T20:02:37.963 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:02:38.219 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:02:38.219 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:02:38.219 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:02:38.220 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:02:38.221 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:02:38.221 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:02:38.221 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:02:38.221 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:02:38.221 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:02:38.221 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:38.221 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:02:38.221 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:02:38.346 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.63907.asok 2023-12-24T20:02:38.528 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.63907.asok 2023-12-24T20:02:38.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:38.528 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.63907.asok status 2023-12-24T20:02:38.687 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:38.687 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:02:38.687 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:02:38.687 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:02:38.687 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "63907", 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 1, 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 6867, 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 6867 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:38.688 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2505477793 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2505477793 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.6867 192.168.0.1:0/2505477793", 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2505477793", 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 2, 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 60, 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 122, 2023-12-24T20:02:38.689 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 122, 2023-12-24T20:02:38.690 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:02:38.690 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:02:38.690 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:38.697 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:38.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.819+0000 7f970c655700 1 Processor -- start 2023-12-24T20:02:38.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.819+0000 7f970c655700 1 -- start start 2023-12-24T20:02:38.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f970c655700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f97040cbac0 0x7f97040cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:38.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f970c655700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97040cc2a0 con 0x7f97041599e0 2023-12-24T20:02:38.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f970c655700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97040cedc0 con 0x7f97040cd9b0 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f970c655700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9704067f60 con 0x7f97040cbac0 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f970a3f1700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f97041599e0 0x7f970415ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34250/0 (socket says 172.21.15.61:34250) 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f970a3f1700 1 -- 172.21.15.61:0/2136391024 learned_addr learned my addr 172.21.15.61:0/2136391024 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f9709bf0700 1 --2- 172.21.15.61:0/2136391024 >> v2:172.21.15.133:3300/0 conn(0x7f97040cbac0 0x7f97040cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843880923 0 0) 0x7f97040cc2a0 con 0x7f97041599e0 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96f0003570 con 0x7f97041599e0 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3648449835 0 0) 0x7f96f0003570 con 0x7f97041599e0 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 >> v2:172.21.15.133:3300/0 conn(0x7f97040cbac0 msgr2=0x7f97040cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 --2- 172.21.15.61:0/2136391024 >> v2:172.21.15.133:3300/0 conn(0x7f97040cbac0 0x7f97040cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 >> v1:172.21.15.133:6789/0 conn(0x7f97040cd9b0 legacy=0x7f97040cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97040cddb0 con 0x7f97041599e0 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f9700001470 con 0x7f97041599e0 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 >> v1:172.21.15.61:6789/0 conn(0x7f97041599e0 legacy=0x7f970415ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:38.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f96f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:38.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96f0004810 0x7f96f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:38.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96f00051c0 0x7f96f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:38.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9704067f60 con 0x7f96f0003a60 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f000c160 con 0x7f96f0004810 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.820+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f000c320 con 0x7f96f00051c0 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f970a3f1700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f96f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f9709bf0700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96f0004810 0x7f96f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f970abf2700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96f00051c0 0x7f96f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f970a3f1700 1 -- 172.21.15.61:0/2136391024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96f00051c0 msgr2=0x7f96f000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f970a3f1700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96f00051c0 0x7f96f000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f970a3f1700 1 -- 172.21.15.61:0/2136391024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96f0004810 msgr2=0x7f96f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f970a3f1700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96f0004810 0x7f96f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f970abf2700 1 -- 172.21.15.61:0/2136391024 reap_dead start 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f970a3f1700 1 -- 172.21.15.61:0/2136391024 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f0003570 con 0x7f96f0003a60 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f970a3f1700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f96f0003e70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f970000c390 tx=0x7f97040cdf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbfa68b61a0ec8f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970000cc60 con 0x7f96f0003a60 2023-12-24T20:02:38.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970000cdc0 con 0x7f96f0003a60 2023-12-24T20:02:38.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.821+0000 7f97093ef700 1 -- 172.21.15.61:0/2136391024 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700005b70 con 0x7f96f0003a60 2023-12-24T20:02:38.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.822+0000 7f970c655700 1 -- 172.21.15.61:0/2136391024 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 msgr2=0x7f96f0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:38.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.822+0000 7f970c655700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f96f0003e70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f970000c390 tx=0x7f97040cdf40 comp rx=0 tx=0).stop 2023-12-24T20:02:38.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.822+0000 7f970c655700 1 -- 172.21.15.61:0/2136391024 shutdown_connections 2023-12-24T20:02:38.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.822+0000 7f970c655700 1 --2- 172.21.15.61:0/2136391024 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f96f0003e70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:38.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.822+0000 7f970c655700 1 -- 172.21.15.61:0/2136391024 >> 172.21.15.61:0/2136391024 conn(0x7f970406e640 msgr2=0x7f9704067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:38.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.822+0000 7f970c655700 1 -- 172.21.15.61:0/2136391024 shutdown_connections 2023-12-24T20:02:38.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.822+0000 7f970c655700 1 -- 172.21.15.61:0/2136391024 wait complete. 2023-12-24T20:02:38.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.823+0000 7f970c655700 1 Processor -- start 2023-12-24T20:02:38.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.824+0000 7f970c655700 1 -- start start 2023-12-24T20:02:38.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.824+0000 7f970c655700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f9704157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:38.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.824+0000 7f970c655700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9704155430 0x7f9704154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:38.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.824+0000 7f970c655700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97040b5960 0x7f97040b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:38.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.824+0000 7f970c655700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9704158530 con 0x7f96f0003a60 2023-12-24T20:02:38.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.824+0000 7f970c655700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97040c8e40 con 0x7f97040b5960 2023-12-24T20:02:38.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.824+0000 7f970c655700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97040b62f0 con 0x7f9704155430 2023-12-24T20:02:38.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970a3f1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f9704157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970a3f1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f9704157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47088/0 (socket says 172.21.15.61:47088) 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970a3f1700 1 -- 172.21.15.61:0/342018233 learned_addr learned my addr 172.21.15.61:0/342018233 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f9709bf0700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9704155430 0x7f9704154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970abf2700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97040b5960 0x7f97040b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970a3f1700 1 -- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9704155430 msgr2=0x7f9704154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970a3f1700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9704155430 0x7f9704154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970a3f1700 1 -- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97040b5960 msgr2=0x7f97040b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970a3f1700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97040b5960 0x7f97040b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970a3f1700 1 -- 172.21.15.61:0/342018233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704158760 con 0x7f96f0003a60 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970a3f1700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f9704157ff0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f970000c980 tx=0x7f9700015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f96fa7fc700 1 -- 172.21.15.61:0/342018233 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700022070 con 0x7f96f0003a60 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f96fa7fc700 1 -- 172.21.15.61:0/342018233 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97000070d0 con 0x7f96f0003a60 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970c655700 1 -- 172.21.15.61:0/342018233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9704158a40 con 0x7f96f0003a60 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f96fa7fc700 1 -- 172.21.15.61:0/342018233 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700007470 con 0x7f96f0003a60 2023-12-24T20:02:38.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.825+0000 7f970c655700 1 -- 172.21.15.61:0/342018233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97040c9090 con 0x7f96f0003a60 2023-12-24T20:02:38.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.826+0000 7f970c655700 1 -- 172.21.15.61:0/342018233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970404c3c0 con 0x7f96f0003a60 2023-12-24T20:02:38.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.826+0000 7f96fa7fc700 1 -- 172.21.15.61:0/342018233 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f970001e430 con 0x7f96f0003a60 2023-12-24T20:02:38.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.827+0000 7f96fa7fc700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96e8066f30 0x7f96e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:38.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.827+0000 7f96fa7fc700 1 -- 172.21.15.61:0/342018233 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97000856c0 con 0x7f96f0003a60 2023-12-24T20:02:38.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.827+0000 7f9709bf0700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96e8066f30 0x7f96e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:38.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.828+0000 7f9709bf0700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96e8066f30 0x7f96e80693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f97040b6930 tx=0x7f96f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:38.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:38.831+0000 7f96fa7fc700 1 -- 172.21.15.61:0/342018233 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9700052930 con 0x7f96f0003a60 2023-12-24T20:02:39.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.072+0000 7f970c655700 1 -- 172.21.15.61:0/342018233 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97040c9400 con 0x7f96f0003a60 2023-12-24T20:02:39.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.072+0000 7f96fa7fc700 1 -- 172.21.15.61:0/342018233 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f9700055f50 con 0x7f96f0003a60 2023-12-24T20:02:39.073 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:39.073 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2890522920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2890522920},{"type":"v1","addr":"172.21.15.133:6836","nonce":2890522920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/946349829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":946349829},{"type":"v1","addr":"172.21.15.133:6837","nonce":946349829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3897383544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3897383544},{"type":"v1","addr":"172.21.15.61:6834","nonce":3897383544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:23.422714+0000","modified":"2023-12-24T20:02:27.054403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/447554724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":447554724},{"type":"v1","addr":"172.21.15.61:6835","nonce":447554724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 -- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96e8066f30 msgr2=0x7f96e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96e8066f30 0x7f96e80693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f97040b6930 tx=0x7f96f4008040 comp rx=0 tx=0).stop 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 -- 172.21.15.61:0/342018233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 msgr2=0x7f9704157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f9704157ff0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f970000c980 tx=0x7f9700015000 comp rx=0 tx=0).stop 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 -- 172.21.15.61:0/342018233 shutdown_connections 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96e8066f30 0x7f96e80693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97040b5960 0x7f97040b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96f0003a60 0x7f9704157ff0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 --2- 172.21.15.61:0/342018233 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9704155430 0x7f9704154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 -- 172.21.15.61:0/342018233 >> 172.21.15.61:0/342018233 conn(0x7f970406e640 msgr2=0x7f97040c6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 -- 172.21.15.61:0/342018233 shutdown_connections 2023-12-24T20:02:39.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:39.074+0000 7f970c655700 1 -- 172.21.15.61:0/342018233 wait complete. 2023-12-24T20:02:39.076 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 60 2023-12-24T20:02:39.087 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 125 2023-12-24T20:02:39.227 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-24T20:02:39.228 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:02:39.228 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:02:39.228 DEBUG:teuthology.orchestra.run.smithi061:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-24T20:02:39.228 DEBUG:teuthology.orchestra.run.smithi061:> os.fchmod(fd, 0O666) 2023-12-24T20:02:39.228 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(fd) 2023-12-24T20:02:39.228 DEBUG:teuthology.orchestra.run.smithi061:> os.close(fd) 2023-12-24T20:02:39.228 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:02:39.484 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:02:39.485 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:02:39.486 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:02:39.614 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.63907.asok 2023-12-24T20:02:39.796 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.63907.asok 2023-12-24T20:02:39.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:39.796 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.63907.asok status 2023-12-24T20:02:39.953 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:39.953 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:02:39.953 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:02:39.953 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:02:39.953 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:02:39.953 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:02:39.953 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:02:39.953 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "63907", 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 2, 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 6867, 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 6867 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2505477793 2023-12-24T20:02:39.954 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2505477793 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.6867 192.168.0.1:0/2505477793", 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2505477793", 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 3, 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 60, 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 125, 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 125, 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:02:39.955 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:39.964 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:02:39.964 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:02:39.964 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:02:39.964 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:02:39.964 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:02:39.964 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:39.964 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:02:39.964 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:02:39.965 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:02:39.966 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:02:39.966 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:02:40.051 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.63907.asok 2023-12-24T20:02:40.233 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.63907.asok 2023-12-24T20:02:40.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:02:40.233 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.63907.asok status 2023-12-24T20:02:40.390 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:40.390 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:02:40.390 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:02:40.390 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:02:40.390 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:02:40.390 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:02:40.390 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:02:40.390 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "63907", 2023-12-24T20:02:40.390 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 2, 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 6867, 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 6867 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2505477793 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:40.391 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2505477793 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.6867 192.168.0.1:0/2505477793", 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2505477793", 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 3, 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 60, 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 125, 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 125, 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:02:40.392 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:40.401 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-24T20:02:40.401 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:02:40.401 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:02:40.442 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:02:40.494 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:02:40.494 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T20:02:40.494 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:02:40.495 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T20:02:40.539 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[63907]: fuse finished with error 0 and tester_r 0 2023-12-24T20:02:40.541 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:02:40.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:40.541 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:02:40.695 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T20:02:40.696 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:02:40.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T20:02:40.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[46446]: fuse finished with error 0 and tester_r 0 2023-12-24T20:02:40.736 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:02:40.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:40.737 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T20:02:40.811 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:02:40.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:40.812 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T20:02:40.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:02:40.830 INFO:teuthology.orchestra.run.smithi061.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-24T20:02:40.830 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:02:40.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:02:40.830 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T20:02:40.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:02:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-24T20:02:40.869 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:40.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.991+0000 7f56469e2700 1 Processor -- start 2023-12-24T20:02:40.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.991+0000 7f56469e2700 1 -- start start 2023-12-24T20:02:40.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.992+0000 7f56469e2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5640068140 0x7f56400cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:40.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.992+0000 7f56469e2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5640068510 0x7f56400b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:40.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.992+0000 7f56469e2700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56400b2890 con 0x7f5640159a60 2023-12-24T20:02:40.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.992+0000 7f56469e2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56400b11e0 con 0x7f5640068140 2023-12-24T20:02:40.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.992+0000 7f56469e2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400cf630 con 0x7f5640068510 2023-12-24T20:02:40.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.992+0000 7f5644f7f700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f5640159a60 0x7f5640159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34266/0 (socket says 172.21.15.61:34266) 2023-12-24T20:02:40.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.992+0000 7f5644f7f700 1 -- 172.21.15.61:0/999569821 learned_addr learned my addr 172.21.15.61:0/999569821 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:40.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.992+0000 7f563ffff700 1 --2- 172.21.15.61:0/999569821 >> v2:172.21.15.133:3300/0 conn(0x7f5640068140 0x7f56400cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:40.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.992+0000 7f563f7fe700 1 --2- 172.21.15.61:0/999569821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5640068510 0x7f56400b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.993+0000 7f563effd700 1 -- 172.21.15.61:0/999569821 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574804371 0 0) 0x7f56400b2890 con 0x7f5640159a60 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.993+0000 7f563effd700 1 -- 172.21.15.61:0/999569821 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5628003570 con 0x7f5640159a60 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.993+0000 7f563ffff700 1 -- 172.21.15.61:0/999569821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5640068510 msgr2=0x7f56400b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.993+0000 7f563ffff700 1 --2- 172.21.15.61:0/999569821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5640068510 0x7f56400b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.993+0000 7f563ffff700 1 -- 172.21.15.61:0/999569821 >> v1:172.21.15.61:6789/0 conn(0x7f5640159a60 legacy=0x7f5640159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.993+0000 7f563ffff700 1 -- 172.21.15.61:0/999569821 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400b2240 con 0x7f5640068140 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.993+0000 7f563ffff700 1 --2- 172.21.15.61:0/999569821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5640068140 0x7f56400cefa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f56300098d0 tx=0x7f5630009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cb0bbe89b3f9ff8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.993+0000 7f563effd700 1 -- 172.21.15.61:0/999569821 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630005c10 con 0x7f5640068140 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.993+0000 7f563effd700 1 -- 172.21.15.61:0/999569821 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630005d70 con 0x7f5640068140 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.993+0000 7f563effd700 1 -- 172.21.15.61:0/999569821 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630006240 con 0x7f5640068140 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.994+0000 7f56469e2700 1 -- 172.21.15.61:0/999569821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5640068140 msgr2=0x7f56400cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.994+0000 7f56469e2700 1 --2- 172.21.15.61:0/999569821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5640068140 0x7f56400cefa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f56300098d0 tx=0x7f5630009120 comp rx=0 tx=0).stop 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.994+0000 7f56469e2700 1 -- 172.21.15.61:0/999569821 shutdown_connections 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.994+0000 7f56469e2700 1 --2- 172.21.15.61:0/999569821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5640068140 0x7f56400cefa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:40.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.994+0000 7f56469e2700 1 --2- 172.21.15.61:0/999569821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5640068510 0x7f56400b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:40.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.994+0000 7f56469e2700 1 -- 172.21.15.61:0/999569821 >> 172.21.15.61:0/999569821 conn(0x7f5640097a10 msgr2=0x7f56400ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:40.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.994+0000 7f56469e2700 1 -- 172.21.15.61:0/999569821 shutdown_connections 2023-12-24T20:02:40.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.994+0000 7f56469e2700 1 -- 172.21.15.61:0/999569821 wait complete. 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.995+0000 7f56469e2700 1 Processor -- start 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.995+0000 7f56469e2700 1 -- start start 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f56469e2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5640068140 0x7f56401601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f56469e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5640068510 0x7f564009b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f56469e2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5640159a60 0x7f564015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f56469e2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564009b520 con 0x7f5640159a60 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f56469e2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564015e160 con 0x7f5640068510 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f56469e2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56401606e0 con 0x7f5640068140 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f5644f7f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5640159a60 0x7f564015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f5644f7f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5640159a60 0x7f564015a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47090/0 (socket says 172.21.15.61:47090) 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f5644f7f700 1 -- 172.21.15.61:0/4026768238 learned_addr learned my addr 172.21.15.61:0/4026768238 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f563ffff700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5640068140 0x7f56401601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:40.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f563f7fe700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5640068510 0x7f564009b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f5644f7f700 1 -- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5640068140 msgr2=0x7f56401601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f5644f7f700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5640068140 0x7f56401601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f5644f7f700 1 -- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5640068510 msgr2=0x7f564009b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f5644f7f700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5640068510 0x7f564009b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f5644f7f700 1 -- 172.21.15.61:0/4026768238 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56300093c0 con 0x7f5640159a60 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.996+0000 7f5644f7f700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5640159a60 0x7f564015a680 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5638001460 tx=0x7f5638001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.997+0000 7f5627fff700 1 -- 172.21.15.61:0/4026768238 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800a870 con 0x7f5640159a60 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.997+0000 7f5627fff700 1 -- 172.21.15.61:0/4026768238 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800a9d0 con 0x7f5640159a60 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.997+0000 7f56469e2700 1 -- 172.21.15.61:0/4026768238 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564009bc10 con 0x7f5640159a60 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.997+0000 7f5627fff700 1 -- 172.21.15.61:0/4026768238 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800ad50 con 0x7f5640159a60 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.997+0000 7f56469e2700 1 -- 172.21.15.61:0/4026768238 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564009abf0 con 0x7f5640159a60 2023-12-24T20:02:40.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.998+0000 7f56469e2700 1 -- 172.21.15.61:0/4026768238 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564015e2d0 con 0x7f5640159a60 2023-12-24T20:02:41.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.998+0000 7f5627fff700 1 -- 172.21.15.61:0/4026768238 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5638007300 con 0x7f5640159a60 2023-12-24T20:02:41.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.998+0000 7f5627fff700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f562c066f30 0x7f562c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.998+0000 7f5627fff700 1 -- 172.21.15.61:0/4026768238 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5638084790 con 0x7f5640159a60 2023-12-24T20:02:41.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.999+0000 7f563ffff700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f562c066f30 0x7f562c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:40.999+0000 7f563ffff700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f562c066f30 0x7f562c0693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f56300098d0 tx=0x7f5630016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:41.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.002+0000 7f5627fff700 1 -- 172.21.15.61:0/4026768238 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f564015e2d0 con 0x7f5640159a60 2023-12-24T20:02:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.245+0000 7f56469e2700 1 -- 172.21.15.61:0/4026768238 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f564015e2d0 con 0x7f5640159a60 2023-12-24T20:02:41.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.245+0000 7f5627fff700 1 -- 172.21.15.61:0/4026768238 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f564015e2d0 con 0x7f5640159a60 2023-12-24T20:02:41.246 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:41.246 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2890522920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2890522920},{"type":"v1","addr":"172.21.15.133:6836","nonce":2890522920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/946349829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":946349829},{"type":"v1","addr":"172.21.15.133:6837","nonce":946349829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3897383544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3897383544},{"type":"v1","addr":"172.21.15.61:6834","nonce":3897383544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:23.422714+0000","modified":"2023-12-24T20:02:27.054403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/447554724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":447554724},{"type":"v1","addr":"172.21.15.61:6835","nonce":447554724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T20:02:41.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 -- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f562c066f30 msgr2=0x7f562c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f562c066f30 0x7f562c0693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f56300098d0 tx=0x7f5630016000 comp rx=0 tx=0).stop 2023-12-24T20:02:41.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 -- 172.21.15.61:0/4026768238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5640159a60 msgr2=0x7f564015a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5640159a60 0x7f564015a680 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5638001460 tx=0x7f5638001a40 comp rx=0 tx=0).stop 2023-12-24T20:02:41.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 -- 172.21.15.61:0/4026768238 shutdown_connections 2023-12-24T20:02:41.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5640068140 0x7f56401601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f562c066f30 0x7f562c0693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5640159a60 0x7f564015a680 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 --2- 172.21.15.61:0/4026768238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5640068510 0x7f564009b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 -- 172.21.15.61:0/4026768238 >> 172.21.15.61:0/4026768238 conn(0x7f5640097a10 msgr2=0x7f5640156650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:41.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 -- 172.21.15.61:0/4026768238 shutdown_connections 2023-12-24T20:02:41.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.247+0000 7f56469e2700 1 -- 172.21.15.61:0/4026768238 wait complete. 2023-12-24T20:02:41.249 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 60 2023-12-24T20:02:41.260 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:41.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.381+0000 7fa27039f700 1 Processor -- start 2023-12-24T20:02:41.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.382+0000 7fa27039f700 1 -- start start 2023-12-24T20:02:41.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.382+0000 7fa27039f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268070d50 0x7fa2680c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa27039f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26806a090 con 0x7fa268159a90 2023-12-24T20:02:41.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa27039f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26806ac10 con 0x7fa268159e60 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa27039f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26806a2e0 con 0x7fa268070d50 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26e13b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa268159a90 0x7fa268070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34278/0 (socket says 172.21.15.61:34278) 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26e13b700 1 -- 172.21.15.61:0/1258662320 learned_addr learned my addr 172.21.15.61:0/1258662320 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26e93c700 1 --2- 172.21.15.61:0/1258662320 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268070d50 0x7fa2680c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26d139700 1 -- 172.21.15.61:0/1258662320 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791718477 0 0) 0x7fa26806a090 con 0x7fa268159a90 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26d139700 1 -- 172.21.15.61:0/1258662320 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa254003570 con 0x7fa268159a90 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26d139700 1 -- 172.21.15.61:0/1258662320 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552843715 0 0) 0x7fa26806ac10 con 0x7fa268159e60 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26d139700 1 -- 172.21.15.61:0/1258662320 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa26806a090 con 0x7fa268159e60 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26e93c700 1 -- 172.21.15.61:0/1258662320 >> v1:172.21.15.133:6789/0 conn(0x7fa268159e60 legacy=0x7fa2680c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26e93c700 1 -- 172.21.15.61:0/1258662320 >> v1:172.21.15.61:6789/0 conn(0x7fa268159a90 legacy=0x7fa268070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26d139700 1 -- 172.21.15.61:0/1258662320 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 694277193 0 0) 0x7fa254003570 con 0x7fa268159a90 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26e93c700 1 -- 172.21.15.61:0/1258662320 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26806a5c0 con 0x7fa268070d50 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.383+0000 7fa26e93c700 1 --2- 172.21.15.61:0/1258662320 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268070d50 0x7fa2680c9ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa260009e90 tx=0x7fa260009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff2e7b2c8c7b79e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:41.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.384+0000 7fa26d139700 1 -- 172.21.15.61:0/1258662320 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000e070 con 0x7fa268070d50 2023-12-24T20:02:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.384+0000 7fa26d139700 1 -- 172.21.15.61:0/1258662320 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26000b870 con 0x7fa268070d50 2023-12-24T20:02:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.384+0000 7fa26d139700 1 -- 172.21.15.61:0/1258662320 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264001470 con 0x7fa268070d50 2023-12-24T20:02:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.384+0000 7fa27039f700 1 -- 172.21.15.61:0/1258662320 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268070d50 msgr2=0x7fa2680c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.384+0000 7fa27039f700 1 --2- 172.21.15.61:0/1258662320 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268070d50 0x7fa2680c9ad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa260009e90 tx=0x7fa260009780 comp rx=0 tx=0).stop 2023-12-24T20:02:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.384+0000 7fa27039f700 1 -- 172.21.15.61:0/1258662320 shutdown_connections 2023-12-24T20:02:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.384+0000 7fa27039f700 1 --2- 172.21.15.61:0/1258662320 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268070d50 0x7fa2680c9ad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.384+0000 7fa27039f700 1 -- 172.21.15.61:0/1258662320 >> 172.21.15.61:0/1258662320 conn(0x7fa2680cd6f0 msgr2=0x7fa2680cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.384+0000 7fa27039f700 1 -- 172.21.15.61:0/1258662320 shutdown_connections 2023-12-24T20:02:41.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.384+0000 7fa27039f700 1 -- 172.21.15.61:0/1258662320 wait complete. 2023-12-24T20:02:41.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.385+0000 7fa27039f700 1 Processor -- start 2023-12-24T20:02:41.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.385+0000 7fa27039f700 1 -- start start 2023-12-24T20:02:41.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa27039f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa268070d50 0x7fa2681583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa27039f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa268159a90 0x7fa26815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa27039f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268159e60 0x7fa26815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa27039f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680c55b0 con 0x7fa268159a90 2023-12-24T20:02:41.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa27039f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680c4700 con 0x7fa268070d50 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa27039f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680c49a0 con 0x7fa268159e60 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa26d93a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa268159a90 0x7fa26815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa26d93a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa268159a90 0x7fa26815c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47098/0 (socket says 172.21.15.61:47098) 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa26d93a700 1 -- 172.21.15.61:0/2705557752 learned_addr learned my addr 172.21.15.61:0/2705557752 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa26e13b700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa268070d50 0x7fa2681583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.386+0000 7fa26e93c700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268159e60 0x7fa26815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa26d93a700 1 -- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268159e60 msgr2=0x7fa26815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa26d93a700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268159e60 0x7fa26815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa26d93a700 1 -- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa268070d50 msgr2=0x7fa2681583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa26d93a700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa268070d50 0x7fa2681583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa26d93a700 1 -- 172.21.15.61:0/2705557752 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260009a20 con 0x7fa268159a90 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa26e13b700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa268070d50 0x7fa2681583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa26d93a700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa268159a90 0x7fa26815c240 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00c4e0 tx=0x7fa25c007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa25a7fc700 1 -- 172.21.15.61:0/2705557752 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c016070 con 0x7fa268159a90 2023-12-24T20:02:41.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa25a7fc700 1 -- 172.21.15.61:0/2705557752 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c011660 con 0x7fa268159a90 2023-12-24T20:02:41.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa27039f700 1 -- 172.21.15.61:0/2705557752 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2680c4c80 con 0x7fa268159a90 2023-12-24T20:02:41.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa25a7fc700 1 -- 172.21.15.61:0/2705557752 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c011a00 con 0x7fa268159a90 2023-12-24T20:02:41.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.387+0000 7fa27039f700 1 -- 172.21.15.61:0/2705557752 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2680c5240 con 0x7fa268159a90 2023-12-24T20:02:41.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.388+0000 7fa27039f700 1 -- 172.21.15.61:0/2705557752 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26804c3c0 con 0x7fa268159a90 2023-12-24T20:02:41.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.388+0000 7fa25a7fc700 1 -- 172.21.15.61:0/2705557752 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa25c012420 con 0x7fa268159a90 2023-12-24T20:02:41.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.389+0000 7fa25a7fc700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa24c066f30 0x7fa24c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.389+0000 7fa25a7fc700 1 -- 172.21.15.61:0/2705557752 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa25c0842a0 con 0x7fa268159a90 2023-12-24T20:02:41.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.389+0000 7fa26e13b700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa24c066f30 0x7fa24c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.390+0000 7fa26e13b700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa24c066f30 0x7fa24c0693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa2640015a0 tx=0x7fa264000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:41.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.393+0000 7fa25a7fc700 1 -- 172.21.15.61:0/2705557752 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa25c051470 con 0x7fa268159a90 2023-12-24T20:02:41.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.591+0000 7fa27039f700 1 -- 172.21.15.61:0/2705557752 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa26806a8a0 con 0x7fa268159a90 2023-12-24T20:02:41.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.592+0000 7fa25a7fc700 1 -- 172.21.15.61:0/2705557752 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fa25c054a90 con 0x7fa268159a90 2023-12-24T20:02:41.592 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:41.592 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":125,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:37.588176+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:21.867619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:22.397630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:41.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 -- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa24c066f30 msgr2=0x7fa24c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa24c066f30 0x7fa24c0693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa2640015a0 tx=0x7fa264000bc0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 -- 172.21.15.61:0/2705557752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa268159a90 msgr2=0x7fa26815c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa268159a90 0x7fa26815c240 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00c4e0 tx=0x7fa25c007d80 comp rx=0 tx=0).stop 2023-12-24T20:02:41.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 -- 172.21.15.61:0/2705557752 shutdown_connections 2023-12-24T20:02:41.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa268159e60 0x7fa26815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa24c066f30 0x7fa24c0693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa268070d50 0x7fa2681583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 --2- 172.21.15.61:0/2705557752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa268159a90 0x7fa26815c240 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 -- 172.21.15.61:0/2705557752 >> 172.21.15.61:0/2705557752 conn(0x7fa2680cd6f0 msgr2=0x7fa2680ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:41.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 -- 172.21.15.61:0/2705557752 shutdown_connections 2023-12-24T20:02:41.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.594+0000 7fa27039f700 1 -- 172.21.15.61:0/2705557752 wait complete. 2023-12-24T20:02:41.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T20:02:21.867619+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T20:02:22.397630+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:02:41.607 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:02:41.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.732+0000 7f63c69b5700 1 Processor -- start 2023-12-24T20:02:41.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.732+0000 7f63c69b5700 1 -- start start 2023-12-24T20:02:41.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.732+0000 7f63c69b5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c00caa70 0x7f63c00caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63c69b5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c00ab770 con 0x7f63c0069500 2023-12-24T20:02:41.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63c69b5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c00aa880 con 0x7f63c01578b0 2023-12-24T20:02:41.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63c69b5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c00aab60 con 0x7f63c00caa70 2023-12-24T20:02:41.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63c4f52700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f63c0069500 0x7f63c0069940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34286/0 (socket says 172.21.15.61:34286) 2023-12-24T20:02:41.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63c4f52700 1 -- 172.21.15.61:0/3157810778 learned_addr learned my addr 172.21.15.61:0/3157810778 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:41.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63bf7fe700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c00caa70 0x7f63c00caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036494586 0 0) 0x7f63c00ab770 con 0x7f63c0069500 2023-12-24T20:02:41.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63ac003570 con 0x7f63c0069500 2023-12-24T20:02:41.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889164734 0 0) 0x7f63c00aa880 con 0x7f63c01578b0 2023-12-24T20:02:41.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c00ab770 con 0x7f63c01578b0 2023-12-24T20:02:41.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3065309484 0 0) 0x7f63ac003570 con 0x7f63c0069500 2023-12-24T20:02:41.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c00caa70 msgr2=0x7f63c00caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:41.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c00caa70 0x7f63c00caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 >> v1:172.21.15.133:6789/0 conn(0x7f63c01578b0 legacy=0x7f63c015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c00aae40 con 0x7f63c0069500 2023-12-24T20:02:41.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f63b80017f0 con 0x7f63c0069500 2023-12-24T20:02:41.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 >> v1:172.21.15.61:6789/0 conn(0x7f63c0069500 legacy=0x7f63c0069940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c00caa70 0x7f63ac003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63ac004180 0x7f63ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ac004d50 0x7f63ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c00aab60 con 0x7f63ac004180 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac00bba0 con 0x7f63ac004d50 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac00bd60 con 0x7f63c00caa70 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.733+0000 7f63bf7fe700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63ac004180 0x7f63ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63bffff700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c00caa70 0x7f63ac003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63c4f52700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ac004d50 0x7f63ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63bf7fe700 1 -- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c00caa70 msgr2=0x7f63ac003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63bf7fe700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63c00caa70 0x7f63ac003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63bf7fe700 1 -- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ac004d50 msgr2=0x7f63ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:41.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63bf7fe700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63ac004d50 0x7f63ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63bf7fe700 1 -- 172.21.15.61:0/3157810778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac003570 con 0x7f63ac004180 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63bf7fe700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63ac004180 0x7f63ac004810 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009c00 tx=0x7f63a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671c1d7fb13a775d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a800e710 con 0x7f63ac004180 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a800e870 con 0x7f63ac004180 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.734+0000 7f63beffd700 1 -- 172.21.15.61:0/3157810778 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a800ec30 con 0x7f63ac004180 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.735+0000 7f63c69b5700 1 -- 172.21.15.61:0/3157810778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63ac004180 msgr2=0x7f63ac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.735+0000 7f63c69b5700 1 --2- 172.21.15.61:0/3157810778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63ac004180 0x7f63ac004810 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009c00 tx=0x7f63a80091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.735+0000 7f63c4f52700 1 -- 172.21.15.61:0/3157810778 reap_dead start 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.735+0000 7f63c69b5700 1 -- 172.21.15.61:0/3157810778 shutdown_connections 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.735+0000 7f63c69b5700 1 -- 172.21.15.61:0/3157810778 >> 172.21.15.61:0/3157810778 conn(0x7f63c0067fd0 msgr2=0x7f63c00ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.735+0000 7f63c69b5700 1 -- 172.21.15.61:0/3157810778 shutdown_connections 2023-12-24T20:02:41.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.735+0000 7f63c69b5700 1 -- 172.21.15.61:0/3157810778 wait complete. 2023-12-24T20:02:41.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.736+0000 7f63c69b5700 1 Processor -- start 2023-12-24T20:02:41.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.736+0000 7f63c69b5700 1 -- start start 2023-12-24T20:02:41.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.737+0000 7f63c69b5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ac004180 0x7f63c01524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.737+0000 7f63c69b5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63c00b27a0 0x7f63c0152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.737+0000 7f63c69b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00c4bd0 0x7f63c00c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.737+0000 7f63c69b5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c014e560 con 0x7f63c00b27a0 2023-12-24T20:02:41.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.737+0000 7f63c69b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c00c5930 con 0x7f63c00c4bd0 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.737+0000 7f63c69b5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c00c5c10 con 0x7f63ac004180 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.737+0000 7f63bf7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63c00b27a0 0x7f63c0152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63bf7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63c00b27a0 0x7f63c0152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47122/0 (socket says 172.21.15.61:47122) 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63bf7fe700 1 -- 172.21.15.61:0/2211865215 learned_addr learned my addr 172.21.15.61:0/2211865215 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63bffff700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ac004180 0x7f63c01524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63c4f52700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00c4bd0 0x7f63c00c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63bf7fe700 1 -- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ac004180 msgr2=0x7f63c01524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63bf7fe700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ac004180 0x7f63c01524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63bf7fe700 1 -- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00c4bd0 msgr2=0x7f63c00c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63bf7fe700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00c4bd0 0x7f63c00c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63bf7fe700 1 -- 172.21.15.61:0/2211865215 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c00c5ef0 con 0x7f63c00b27a0 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63bf7fe700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63c00b27a0 0x7f63c0152a20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00bb70 tx=0x7f63a801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63b7fff700 1 -- 172.21.15.61:0/2211865215 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a8022070 con 0x7f63c00b27a0 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63b7fff700 1 -- 172.21.15.61:0/2211865215 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a800ebf0 con 0x7f63c00b27a0 2023-12-24T20:02:41.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63c69b5700 1 -- 172.21.15.61:0/2211865215 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c00c61d0 con 0x7f63c00b27a0 2023-12-24T20:02:41.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63b7fff700 1 -- 172.21.15.61:0/2211865215 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a801c6a0 con 0x7f63c00b27a0 2023-12-24T20:02:41.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.738+0000 7f63c69b5700 1 -- 172.21.15.61:0/2211865215 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c00c5580 con 0x7f63c00b27a0 2023-12-24T20:02:41.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.739+0000 7f63c69b5700 1 -- 172.21.15.61:0/2211865215 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c00b0900 con 0x7f63c00b27a0 2023-12-24T20:02:41.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.739+0000 7f63b7fff700 1 -- 172.21.15.61:0/2211865215 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f63a801ca50 con 0x7f63c00b27a0 2023-12-24T20:02:41.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.740+0000 7f63b7fff700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f63a0066f30 0x7f63a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:41.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.740+0000 7f63b7fff700 1 -- 172.21.15.61:0/2211865215 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63a8085de0 con 0x7f63c00b27a0 2023-12-24T20:02:41.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.740+0000 7f63bffff700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f63a0066f30 0x7f63a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:41.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.741+0000 7f63bffff700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f63a0066f30 0x7f63a00693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f63b00010e0 tx=0x7f63b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:41.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.744+0000 7f63b7fff700 1 -- 172.21.15.61:0/2211865215 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63a8052fb0 con 0x7f63c00b27a0 2023-12-24T20:02:41.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.938+0000 7f63c69b5700 1 -- 172.21.15.61:0/2211865215 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63c00c6410 con 0x7f63c00b27a0 2023-12-24T20:02:41.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.939+0000 7f63b7fff700 1 -- 172.21.15.61:0/2211865215 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63a802b0a0 con 0x7f63c00b27a0 2023-12-24T20:02:41.939 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:02:41.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 -- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f63a0066f30 msgr2=0x7f63a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f63a0066f30 0x7f63a00693e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f63b00010e0 tx=0x7f63b0009040 comp rx=0 tx=0).stop 2023-12-24T20:02:41.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 -- 172.21.15.61:0/2211865215 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63c00b27a0 msgr2=0x7f63c0152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:41.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63c00b27a0 0x7f63c0152a20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00bb70 tx=0x7f63a801a000 comp rx=0 tx=0).stop 2023-12-24T20:02:41.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 -- 172.21.15.61:0/2211865215 shutdown_connections 2023-12-24T20:02:41.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63ac004180 0x7f63c01524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f63a0066f30 0x7f63a00693e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00c4bd0 0x7f63c00c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 --2- 172.21.15.61:0/2211865215 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f63c00b27a0 0x7f63c0152a20 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:41.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 -- 172.21.15.61:0/2211865215 >> 172.21.15.61:0/2211865215 conn(0x7f63c0067fd0 msgr2=0x7f63c01540c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:41.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 -- 172.21.15.61:0/2211865215 shutdown_connections 2023-12-24T20:02:41.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:41.941+0000 7f63c69b5700 1 -- 172.21.15.61:0/2211865215 wait complete. 2023-12-24T20:02:41.953 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:02:42.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.077+0000 7f86508aa700 1 Processor -- start 2023-12-24T20:02:42.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.077+0000 7f86508aa700 1 -- start start 2023-12-24T20:02:42.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.078+0000 7f86508aa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f864c0b0130 0x7f864c070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.078+0000 7f86508aa700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864c15e470 con 0x7f864c0afd60 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.078+0000 7f86508aa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864c068db0 con 0x7f864c0688b0 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.078+0000 7f86508aa700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c15db40 con 0x7f864c0b0130 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864a59c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f864c0afd60 0x7f864c0cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34298/0 (socket says 172.21.15.61:34298) 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864a59c700 1 -- 172.21.15.61:0/3421072999 learned_addr learned my addr 172.21.15.61:0/3421072999 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f8649d9b700 1 --2- 172.21.15.61:0/3421072999 >> v2:172.21.15.133:3300/0 conn(0x7f864c0b0130 0x7f864c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197313612 0 0) 0x7f864c15e470 con 0x7f864c0afd60 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8634003570 con 0x7f864c0afd60 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 739434266 0 0) 0x7f8634003570 con 0x7f864c0afd60 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 >> v2:172.21.15.133:3300/0 conn(0x7f864c0b0130 msgr2=0x7f864c070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 --2- 172.21.15.61:0/3421072999 >> v2:172.21.15.133:3300/0 conn(0x7f864c0b0130 0x7f864c070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 >> v1:172.21.15.133:6789/0 conn(0x7f864c0688b0 legacy=0x7f864c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c15de20 con 0x7f864c0afd60 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f8649d9b700 1 --2- 172.21.15.61:0/3421072999 >> v2:172.21.15.133:3300/0 conn(0x7f864c0b0130 0x7f864c070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f863c001470 con 0x7f864c0afd60 2023-12-24T20:02:42.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 >> v1:172.21.15.61:6789/0 conn(0x7f864c0afd60 legacy=0x7f864c0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8634003a60 0x7f8634003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8634004810 0x7f8634004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86340051c0 0x7f863400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c15db40 con 0x7f8634004810 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863400c160 con 0x7f8634003a60 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863400c320 con 0x7f86340051c0 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f8649d9b700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8634004810 0x7f8634004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864a59c700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8634003a60 0x7f8634003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.079+0000 7f864ad9d700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86340051c0 0x7f863400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f8649d9b700 1 -- 172.21.15.61:0/3421072999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86340051c0 msgr2=0x7f863400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f8649d9b700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86340051c0 0x7f863400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f8649d9b700 1 -- 172.21.15.61:0/3421072999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8634003a60 msgr2=0x7f8634003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f8649d9b700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8634003a60 0x7f8634003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f8649d9b700 1 -- 172.21.15.61:0/3421072999 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634003570 con 0x7f8634004810 2023-12-24T20:02:42.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f864a59c700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8634003a60 0x7f8634003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f864ad9d700 1 -- 172.21.15.61:0/3421072999 reap_dead start 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f8649d9b700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8634004810 0x7f8634004c80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8640009df0 tx=0x7f86400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a910a5e463d72d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640009740 con 0x7f8634004810 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864000e920 con 0x7f8634004810 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f864959a700 1 -- 172.21.15.61:0/3421072999 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864000ecc0 con 0x7f8634004810 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f86508aa700 1 -- 172.21.15.61:0/3421072999 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8634004810 msgr2=0x7f8634004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.080+0000 7f86508aa700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8634004810 0x7f8634004c80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8640009df0 tx=0x7f86400091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.081+0000 7f86508aa700 1 -- 172.21.15.61:0/3421072999 shutdown_connections 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.081+0000 7f86508aa700 1 --2- 172.21.15.61:0/3421072999 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8634004810 0x7f8634004c80 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.081+0000 7f86508aa700 1 -- 172.21.15.61:0/3421072999 >> 172.21.15.61:0/3421072999 conn(0x7f864c0ce400 msgr2=0x7f864c0ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.081+0000 7f86508aa700 1 -- 172.21.15.61:0/3421072999 shutdown_connections 2023-12-24T20:02:42.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.081+0000 7f86508aa700 1 -- 172.21.15.61:0/3421072999 wait complete. 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.082+0000 7f86508aa700 1 Processor -- start 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.082+0000 7f86508aa700 1 -- start start 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.082+0000 7f86508aa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8634004810 0x7f864c15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.082+0000 7f86508aa700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f864c15c3a0 0x7f864c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.082+0000 7f86508aa700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c158480 0x7f864c1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.082+0000 7f86508aa700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c15bb30 con 0x7f864c15c3a0 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.082+0000 7f86508aa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c158e30 con 0x7f8634004810 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.082+0000 7f86508aa700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0c4330 con 0x7f864c158480 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f8649d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f864c15c3a0 0x7f864c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f8649d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f864c15c3a0 0x7f864c156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47132/0 (socket says 172.21.15.61:47132) 2023-12-24T20:02:42.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f8649d9b700 1 -- 172.21.15.61:0/2375268025 learned_addr learned my addr 172.21.15.61:0/2375268025 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f864a59c700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8634004810 0x7f864c15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f864ad9d700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c158480 0x7f864c1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f8649d9b700 1 -- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c158480 msgr2=0x7f864c1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f8649d9b700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c158480 0x7f864c1588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f8649d9b700 1 -- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8634004810 msgr2=0x7f864c15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f8649d9b700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8634004810 0x7f864c15a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f8649d9b700 1 -- 172.21.15.61:0/2375268025 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c15af20 con 0x7f864c15c3a0 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f8649d9b700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f864c15c3a0 0x7f864c156f60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f86400091e0 tx=0x7f864001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f863a7fc700 1 -- 172.21.15.61:0/2375268025 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640022070 con 0x7f864c15c3a0 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f863a7fc700 1 -- 172.21.15.61:0/2375268025 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8640013d80 con 0x7f864c15c3a0 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f86508aa700 1 -- 172.21.15.61:0/2375268025 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c15b200 con 0x7f864c15c3a0 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f863a7fc700 1 -- 172.21.15.61:0/2375268025 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864001c6a0 con 0x7f864c15c3a0 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.083+0000 7f86508aa700 1 -- 172.21.15.61:0/2375268025 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c15b7c0 con 0x7f864c15c3a0 2023-12-24T20:02:42.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.084+0000 7f86508aa700 1 -- 172.21.15.61:0/2375268025 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c04c3c0 con 0x7f864c15c3a0 2023-12-24T20:02:42.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.085+0000 7f863a7fc700 1 -- 172.21.15.61:0/2375268025 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f864001cad0 con 0x7f864c15c3a0 2023-12-24T20:02:42.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.085+0000 7f863a7fc700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f862c066f30 0x7f862c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.085+0000 7f863a7fc700 1 -- 172.21.15.61:0/2375268025 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8640085dc0 con 0x7f864c15c3a0 2023-12-24T20:02:42.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.085+0000 7f864a59c700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f862c066f30 0x7f862c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.086+0000 7f864a59c700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f862c066f30 0x7f862c0693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f863c001ed0 tx=0x7f863c007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:42.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.089+0000 7f863a7fc700 1 -- 172.21.15.61:0/2375268025 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8640053070 con 0x7f864c15c3a0 2023-12-24T20:02:42.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.284+0000 7f86508aa700 1 -- 172.21.15.61:0/2375268025 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f864c0c6000 con 0x7f864c15c3a0 2023-12-24T20:02:42.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.285+0000 7f863a7fc700 1 -- 172.21.15.61:0/2375268025 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8640017020 con 0x7f864c15c3a0 2023-12-24T20:02:42.285 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T20:02:42.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.286+0000 7f86508aa700 1 -- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f862c066f30 msgr2=0x7f862c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.286+0000 7f86508aa700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f862c066f30 0x7f862c0693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f863c001ed0 tx=0x7f863c007040 comp rx=0 tx=0).stop 2023-12-24T20:02:42.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.286+0000 7f86508aa700 1 -- 172.21.15.61:0/2375268025 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f864c15c3a0 msgr2=0x7f864c156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.287+0000 7f86508aa700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f864c15c3a0 0x7f864c156f60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f86400091e0 tx=0x7f864001a000 comp rx=0 tx=0).stop 2023-12-24T20:02:42.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.287+0000 7f86508aa700 1 -- 172.21.15.61:0/2375268025 shutdown_connections 2023-12-24T20:02:42.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.287+0000 7f86508aa700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f864c158480 0x7f864c1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.287+0000 7f86508aa700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f862c066f30 0x7f862c0693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.287+0000 7f86508aa700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8634004810 0x7f864c15a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.287+0000 7f86508aa700 1 --2- 172.21.15.61:0/2375268025 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f864c15c3a0 0x7f864c156f60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.287+0000 7f86508aa700 1 -- 172.21.15.61:0/2375268025 >> 172.21.15.61:0/2375268025 conn(0x7f864c0ce400 msgr2=0x7f864c0cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:42.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.287+0000 7f86508aa700 1 -- 172.21.15.61:0/2375268025 shutdown_connections 2023-12-24T20:02:42.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.287+0000 7f86508aa700 1 -- 172.21.15.61:0/2375268025 wait complete. 2023-12-24T20:02:42.299 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:02:42.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.424+0000 7f43dabdf700 1 Processor -- start 2023-12-24T20:02:42.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.424+0000 7f43dabdf700 1 -- start start 2023-12-24T20:02:42.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.425+0000 7f43dabdf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43d40b0130 0x7f43d4070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.425+0000 7f43dabdf700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f43d40688b0 0x7f43d4070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.425+0000 7f43dabdf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d415e470 con 0x7f43d40afd60 2023-12-24T20:02:42.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.425+0000 7f43dabdf700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d406ad90 con 0x7f43d40688b0 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.425+0000 7f43dabdf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4068db0 con 0x7f43d40b0130 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.425+0000 7f43d917c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f43d40688b0 0x7f43d4070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.425+0000 7f43d917c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f43d40688b0 0x7f43d4070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47146/0 (socket says 172.21.15.61:47146) 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.425+0000 7f43d917c700 1 -- 172.21.15.61:0/1581974715 learned_addr learned my addr 172.21.15.61:0/1581974715 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.425+0000 7f43d3fff700 1 --2- 172.21.15.61:0/1581974715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43d40b0130 0x7f43d4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43d917c700 1 -- 172.21.15.61:0/1581974715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43d40b0130 msgr2=0x7f43d4070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43d917c700 1 --2- 172.21.15.61:0/1581974715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43d40b0130 0x7f43d4070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43d917c700 1 -- 172.21.15.61:0/1581974715 >> v1:172.21.15.133:6789/0 conn(0x7f43d40afd60 legacy=0x7f43d40cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43d917c700 1 -- 172.21.15.61:0/1581974715 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d415db40 con 0x7f43d40688b0 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43d917c700 1 --2- 172.21.15.61:0/1581974715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 0x7f43d4070b80 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009f20 tx=0x7f43cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a794e829a3fd2ce server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43d37fe700 1 -- 172.21.15.61:0/1581974715 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00e070 con 0x7f43d40688b0 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43d37fe700 1 -- 172.21.15.61:0/1581974715 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00ba80 con 0x7f43d40688b0 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43d37fe700 1 -- 172.21.15.61:0/1581974715 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0092e0 con 0x7f43d40688b0 2023-12-24T20:02:42.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43dabdf700 1 -- 172.21.15.61:0/1581974715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 msgr2=0x7f43d4070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43dabdf700 1 --2- 172.21.15.61:0/1581974715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 0x7f43d4070b80 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009f20 tx=0x7f43cc009840 comp rx=0 tx=0).stop 2023-12-24T20:02:42.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43dabdf700 1 -- 172.21.15.61:0/1581974715 shutdown_connections 2023-12-24T20:02:42.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43dabdf700 1 --2- 172.21.15.61:0/1581974715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 0x7f43d4070b80 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43dabdf700 1 --2- 172.21.15.61:0/1581974715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43d40b0130 0x7f43d4070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.426+0000 7f43dabdf700 1 -- 172.21.15.61:0/1581974715 >> 172.21.15.61:0/1581974715 conn(0x7f43d40ce400 msgr2=0x7f43d40ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:42.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.427+0000 7f43dabdf700 1 -- 172.21.15.61:0/1581974715 shutdown_connections 2023-12-24T20:02:42.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.427+0000 7f43dabdf700 1 -- 172.21.15.61:0/1581974715 wait complete. 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.428+0000 7f43dabdf700 1 Processor -- start 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.428+0000 7f43dabdf700 1 -- start start 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.428+0000 7f43dabdf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 0x7f43d40c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43dabdf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d40afd60 0x7f43d406e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43dabdf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43d416e660 0x7f43d41494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43dabdf700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40c5d40 con 0x7f43d40688b0 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43dabdf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40c6020 con 0x7f43d40afd60 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43dabdf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40c6300 con 0x7f43d416e660 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d897b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 0x7f43d40c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d897b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 0x7f43d40c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47152/0 (socket says 172.21.15.61:47152) 2023-12-24T20:02:42.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d897b700 1 -- 172.21.15.61:0/1928206317 learned_addr learned my addr 172.21.15.61:0/1928206317 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d917c700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43d416e660 0x7f43d41494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d3fff700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d40afd60 0x7f43d406e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d897b700 1 -- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43d416e660 msgr2=0x7f43d41494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d897b700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43d416e660 0x7f43d41494b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d897b700 1 -- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d40afd60 msgr2=0x7f43d406e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d897b700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d40afd60 0x7f43d406e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d897b700 1 -- 172.21.15.61:0/1928206317 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009ae0 con 0x7f43d40688b0 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d3fff700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d40afd60 0x7f43d406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d897b700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 0x7f43d40c5410 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f43c800c590 tx=0x7f43c800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d0ff9700 1 -- 172.21.15.61:0/1928206317 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8011590 con 0x7f43d40688b0 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d0ff9700 1 -- 172.21.15.61:0/1928206317 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c80116f0 con 0x7f43d40688b0 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43dabdf700 1 -- 172.21.15.61:0/1928206317 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d40c65e0 con 0x7f43d40688b0 2023-12-24T20:02:42.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43d0ff9700 1 -- 172.21.15.61:0/1928206317 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8011ab0 con 0x7f43d40688b0 2023-12-24T20:02:42.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.429+0000 7f43dabdf700 1 -- 172.21.15.61:0/1928206317 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d40c5950 con 0x7f43d40688b0 2023-12-24T20:02:42.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.430+0000 7f43dabdf700 1 -- 172.21.15.61:0/1928206317 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d40c6160 con 0x7f43d40688b0 2023-12-24T20:02:42.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.431+0000 7f43d0ff9700 1 -- 172.21.15.61:0/1928206317 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f43c801b3b0 con 0x7f43d40688b0 2023-12-24T20:02:42.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.431+0000 7f43d0ff9700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43b8066f30 0x7f43b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.431+0000 7f43d0ff9700 1 -- 172.21.15.61:0/1928206317 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43c8083ac0 con 0x7f43d40688b0 2023-12-24T20:02:42.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.431+0000 7f43d3fff700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43b8066f30 0x7f43b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.432+0000 7f43d3fff700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43b8066f30 0x7f43b80693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f43d40c4f10 tx=0x7f43c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:42.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.435+0000 7f43d0ff9700 1 -- 172.21.15.61:0/1928206317 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43d40c6160 con 0x7f43d40688b0 2023-12-24T20:02:42.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.629+0000 7f43dabdf700 1 -- 172.21.15.61:0/1928206317 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43d40c6160 con 0x7f43d40688b0 2023-12-24T20:02:42.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.630+0000 7f43d0ff9700 1 -- 172.21.15.61:0/1928206317 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43d40c6160 con 0x7f43d40688b0 2023-12-24T20:02:42.630 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T20:02:42.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 -- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43b8066f30 msgr2=0x7f43b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43b8066f30 0x7f43b80693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f43d40c4f10 tx=0x7f43c0008040 comp rx=0 tx=0).stop 2023-12-24T20:02:42.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 -- 172.21.15.61:0/1928206317 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 msgr2=0x7f43d40c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 0x7f43d40c5410 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f43c800c590 tx=0x7f43c800c950 comp rx=0 tx=0).stop 2023-12-24T20:02:42.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 -- 172.21.15.61:0/1928206317 shutdown_connections 2023-12-24T20:02:42.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43d416e660 0x7f43d41494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43b8066f30 0x7f43b80693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43d40688b0 0x7f43d40c5410 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 --2- 172.21.15.61:0/1928206317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d40afd60 0x7f43d406e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 -- 172.21.15.61:0/1928206317 >> 172.21.15.61:0/1928206317 conn(0x7f43d40ce400 msgr2=0x7f43d40cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:42.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 -- 172.21.15.61:0/1928206317 shutdown_connections 2023-12-24T20:02:42.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.632+0000 7f43dabdf700 1 -- 172.21.15.61:0/1928206317 wait complete. 2023-12-24T20:02:42.645 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:42.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.766+0000 7f0062920700 1 Processor -- start 2023-12-24T20:02:42.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.766+0000 7f0062920700 1 -- start start 2023-12-24T20:02:42.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f0062920700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f005c159c10 0x7f005c0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f0062920700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f005c0cc190 0x7f005c0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f0062920700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005c0af880 con 0x7f005c159fe0 2023-12-24T20:02:42.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f0062920700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005c0c6fc0 con 0x7f005c159c10 2023-12-24T20:02:42.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f0062920700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c0c63b0 con 0x7f005c0cc190 2023-12-24T20:02:42.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f005bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f005c159c10 0x7f005c0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f005bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f005c159c10 0x7f005c0c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47160/0 (socket says 172.21.15.61:47160) 2023-12-24T20:02:42.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f005bfff700 1 -- 172.21.15.61:0/62494827 learned_addr learned my addr 172.21.15.61:0/62494827 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f005bfff700 1 -- 172.21.15.61:0/62494827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f005c0cc190 msgr2=0x7f005c0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f005bfff700 1 --2- 172.21.15.61:0/62494827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f005c0cc190 0x7f005c0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f005bfff700 1 -- 172.21.15.61:0/62494827 >> v1:172.21.15.133:6789/0 conn(0x7f005c159fe0 legacy=0x7f005c0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f005bfff700 1 -- 172.21.15.61:0/62494827 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c0c6690 con 0x7f005c159c10 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.767+0000 7f005bfff700 1 --2- 172.21.15.61:0/62494827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 0x7f005c0c57d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f00440099b0 tx=0x7f0044009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f518a430772d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f005affd700 1 -- 172.21.15.61:0/62494827 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400b820 con 0x7f005c159c10 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f005affd700 1 -- 172.21.15.61:0/62494827 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004400b980 con 0x7f005c159c10 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f005affd700 1 -- 172.21.15.61:0/62494827 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400bd20 con 0x7f005c159c10 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f0062920700 1 -- 172.21.15.61:0/62494827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 msgr2=0x7f005c0c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f0062920700 1 --2- 172.21.15.61:0/62494827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 0x7f005c0c57d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f00440099b0 tx=0x7f0044009250 comp rx=0 tx=0).stop 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f0062920700 1 -- 172.21.15.61:0/62494827 shutdown_connections 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f0062920700 1 --2- 172.21.15.61:0/62494827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f005c0cc190 0x7f005c0c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f0062920700 1 --2- 172.21.15.61:0/62494827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 0x7f005c0c57d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f0062920700 1 -- 172.21.15.61:0/62494827 >> 172.21.15.61:0/62494827 conn(0x7f005c06e640 msgr2=0x7f005c067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:42.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f0062920700 1 -- 172.21.15.61:0/62494827 shutdown_connections 2023-12-24T20:02:42.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.768+0000 7f0062920700 1 -- 172.21.15.61:0/62494827 wait complete. 2023-12-24T20:02:42.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.770+0000 7f0062920700 1 Processor -- start 2023-12-24T20:02:42.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.770+0000 7f0062920700 1 -- start start 2023-12-24T20:02:42.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f0062920700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f005c0cc190 0x7f005c149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f0062920700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 0x7f005c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f0062920700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c159fe0 0x7f005c15b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f0062920700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c15e380 con 0x7f005c159c10 2023-12-24T20:02:42.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f0062920700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c15d2e0 con 0x7f005c159fe0 2023-12-24T20:02:42.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f0062920700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c15d5c0 con 0x7f005c0cc190 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f005b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 0x7f005c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f005b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 0x7f005c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47162/0 (socket says 172.21.15.61:47162) 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f005b7fe700 1 -- 172.21.15.61:0/194153921 learned_addr learned my addr 172.21.15.61:0/194153921 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f005bfff700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f005c0cc190 0x7f005c149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f0060ebd700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c159fe0 0x7f005c15b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f005b7fe700 1 -- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f005c0cc190 msgr2=0x7f005c149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f005b7fe700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f005c0cc190 0x7f005c149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f005b7fe700 1 -- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c159fe0 msgr2=0x7f005c15b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f005b7fe700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c159fe0 0x7f005c15b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f005b7fe700 1 -- 172.21.15.61:0/194153921 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440094f0 con 0x7f005c159c10 2023-12-24T20:02:42.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.771+0000 7f005b7fe700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 0x7f005c15b0a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f004c00b5e0 tx=0x7f004c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:42.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.772+0000 7f0053fff700 1 -- 172.21.15.61:0/194153921 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00f510 con 0x7f005c159c10 2023-12-24T20:02:42.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.772+0000 7f0053fff700 1 -- 172.21.15.61:0/194153921 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c00f670 con 0x7f005c159c10 2023-12-24T20:02:42.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.772+0000 7f0062920700 1 -- 172.21.15.61:0/194153921 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c15d8a0 con 0x7f005c159c10 2023-12-24T20:02:42.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.772+0000 7f0053fff700 1 -- 172.21.15.61:0/194153921 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c00fa30 con 0x7f005c159c10 2023-12-24T20:02:42.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.772+0000 7f0062920700 1 -- 172.21.15.61:0/194153921 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c15de60 con 0x7f005c159c10 2023-12-24T20:02:42.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.773+0000 7f0062920700 1 -- 172.21.15.61:0/194153921 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c0890b0 con 0x7f005c159c10 2023-12-24T20:02:42.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.773+0000 7f0053fff700 1 -- 172.21.15.61:0/194153921 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f004c01a400 con 0x7f005c159c10 2023-12-24T20:02:42.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.774+0000 7f0053fff700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f003c066f30 0x7f003c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:42.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.774+0000 7f0053fff700 1 -- 172.21.15.61:0/194153921 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f004c084060 con 0x7f005c159c10 2023-12-24T20:02:42.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.774+0000 7f005bfff700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f003c066f30 0x7f003c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:42.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.774+0000 7f005bfff700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f003c066f30 0x7f003c0693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f00440099b0 tx=0x7f0044016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:42.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:42.778+0000 7f0053fff700 1 -- 172.21.15.61:0/194153921 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f004c051350 con 0x7f005c159c10 2023-12-24T20:02:43.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.019+0000 7f0062920700 1 -- 172.21.15.61:0/194153921 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f005c15e080 con 0x7f005c159c10 2023-12-24T20:02:43.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.019+0000 7f0053fff700 1 -- 172.21.15.61:0/194153921 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f004c054970 con 0x7f005c159c10 2023-12-24T20:02:43.036 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:43.036 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2890522920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2890522920},{"type":"v1","addr":"172.21.15.133:6836","nonce":2890522920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/946349829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":946349829},{"type":"v1","addr":"172.21.15.133:6837","nonce":946349829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3897383544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3897383544},{"type":"v1","addr":"172.21.15.61:6834","nonce":3897383544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:23.422714+0000","modified":"2023-12-24T20:02:27.054403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/447554724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":447554724},{"type":"v1","addr":"172.21.15.61:6835","nonce":447554724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T20:02:43.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 -- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f003c066f30 msgr2=0x7f003c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f003c066f30 0x7f003c0693e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f00440099b0 tx=0x7f0044016000 comp rx=0 tx=0).stop 2023-12-24T20:02:43.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 -- 172.21.15.61:0/194153921 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 msgr2=0x7f005c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 0x7f005c15b0a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f004c00b5e0 tx=0x7f004c0090f0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 -- 172.21.15.61:0/194153921 shutdown_connections 2023-12-24T20:02:43.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f005c0cc190 0x7f005c149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f003c066f30 0x7f003c0693e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c159fe0 0x7f005c15b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 --2- 172.21.15.61:0/194153921 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f005c159c10 0x7f005c15b0a0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 -- 172.21.15.61:0/194153921 >> 172.21.15.61:0/194153921 conn(0x7f005c06e640 msgr2=0x7f005c0c5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:43.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 -- 172.21.15.61:0/194153921 shutdown_connections 2023-12-24T20:02:43.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.021+0000 7f0062920700 1 -- 172.21.15.61:0/194153921 wait complete. 2023-12-24T20:02:43.039 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 60 2023-12-24T20:02:43.039 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:43.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.160+0000 7f8848aba700 1 Processor -- start 2023-12-24T20:02:43.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.160+0000 7f8848aba700 1 -- start start 2023-12-24T20:02:43.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.161+0000 7f8848aba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f884415bb60 0x7f8844098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.161+0000 7f8848aba700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88440b2660 0x7f88440b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.161+0000 7f8848aba700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88440b2eb0 con 0x7f8844098aa0 2023-12-24T20:02:43.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.161+0000 7f8848aba700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440afc20 con 0x7f88440b2660 2023-12-24T20:02:43.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.161+0000 7f8848aba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440b2bd0 con 0x7f884415bb60 2023-12-24T20:02:43.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.161+0000 7f8842d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88440b2660 0x7f88440b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.161+0000 7f8842d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88440b2660 0x7f88440b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47166/0 (socket says 172.21.15.61:47166) 2023-12-24T20:02:43.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.161+0000 7f8842d9d700 1 -- 172.21.15.61:0/3833747613 learned_addr learned my addr 172.21.15.61:0/3833747613 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:43.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.162+0000 7f884259c700 1 --2- 172.21.15.61:0/3833747613 >> v2:172.21.15.133:3300/0 conn(0x7f884415bb60 0x7f8844098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.162+0000 7f8842d9d700 1 -- 172.21.15.61:0/3833747613 >> v2:172.21.15.133:3300/0 conn(0x7f884415bb60 msgr2=0x7f8844098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.162+0000 7f8842d9d700 1 --2- 172.21.15.61:0/3833747613 >> v2:172.21.15.133:3300/0 conn(0x7f884415bb60 0x7f8844098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.162+0000 7f8842d9d700 1 -- 172.21.15.61:0/3833747613 >> v1:172.21.15.133:6789/0 conn(0x7f8844098aa0 legacy=0x7f884415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.162+0000 7f8842d9d700 1 -- 172.21.15.61:0/3833747613 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440afe10 con 0x7f88440b2660 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.162+0000 7f8842d9d700 1 --2- 172.21.15.61:0/3833747613 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 0x7f88440b08f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f884406d9b0 tx=0x7f883c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dd678a1bff4ce3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.162+0000 7f884159a700 1 -- 172.21.15.61:0/3833747613 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00e070 con 0x7f88440b2660 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.162+0000 7f884159a700 1 -- 172.21.15.61:0/3833747613 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00ba10 con 0x7f88440b2660 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.162+0000 7f884159a700 1 -- 172.21.15.61:0/3833747613 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0092e0 con 0x7f88440b2660 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.163+0000 7f8848aba700 1 -- 172.21.15.61:0/3833747613 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 msgr2=0x7f88440b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.163+0000 7f8848aba700 1 --2- 172.21.15.61:0/3833747613 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 0x7f88440b08f0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f884406d9b0 tx=0x7f883c009840 comp rx=0 tx=0).stop 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.163+0000 7f8848aba700 1 -- 172.21.15.61:0/3833747613 shutdown_connections 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.163+0000 7f8848aba700 1 --2- 172.21.15.61:0/3833747613 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 0x7f88440b08f0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.163+0000 7f8848aba700 1 --2- 172.21.15.61:0/3833747613 >> v2:172.21.15.133:3300/0 conn(0x7f884415bb60 0x7f8844098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.163+0000 7f8848aba700 1 -- 172.21.15.61:0/3833747613 >> 172.21.15.61:0/3833747613 conn(0x7f8844097a10 msgr2=0x7f88440ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:43.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.163+0000 7f8848aba700 1 -- 172.21.15.61:0/3833747613 shutdown_connections 2023-12-24T20:02:43.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.163+0000 7f8848aba700 1 -- 172.21.15.61:0/3833747613 wait complete. 2023-12-24T20:02:43.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.164+0000 7f8848aba700 1 Processor -- start 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.164+0000 7f8848aba700 1 -- start start 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8848aba700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8844098aa0 0x7f8844168ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8848aba700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 0x7f8844154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8848aba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f884415bb60 0x7f884409b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8848aba700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884416ba50 con 0x7f88440b2660 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8848aba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884416c5d0 con 0x7f884415bb60 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8848aba700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884416bca0 con 0x7f8844098aa0 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8841d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 0x7f8844154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8841d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 0x7f8844154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47168/0 (socket says 172.21.15.61:47168) 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8841d9b700 1 -- 172.21.15.61:0/2723096657 learned_addr learned my addr 172.21.15.61:0/2723096657 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f884259c700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8844098aa0 0x7f8844168ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8842d9d700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f884415bb60 0x7f884409b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8841d9b700 1 -- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8844098aa0 msgr2=0x7f8844168ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8841d9b700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8844098aa0 0x7f8844168ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8841d9b700 1 -- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f884415bb60 msgr2=0x7f884409b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8841d9b700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f884415bb60 0x7f884409b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8841d9b700 1 -- 172.21.15.61:0/2723096657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c009ae0 con 0x7f88440b2660 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8842d9d700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f884415bb60 0x7f884409b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8841d9b700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 0x7f8844154d70 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f883400c5d0 tx=0x7f8834007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f883a7fc700 1 -- 172.21.15.61:0/2723096657 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834011590 con 0x7f88440b2660 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f883a7fc700 1 -- 172.21.15.61:0/2723096657 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88340116f0 con 0x7f88440b2660 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f8848aba700 1 -- 172.21.15.61:0/2723096657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884416bf80 con 0x7f88440b2660 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.165+0000 7f883a7fc700 1 -- 172.21.15.61:0/2723096657 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834011ab0 con 0x7f88440b2660 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.166+0000 7f8848aba700 1 -- 172.21.15.61:0/2723096657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8844155e40 con 0x7f88440b2660 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.166+0000 7f8848aba700 1 -- 172.21.15.61:0/2723096657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884416c780 con 0x7f88440b2660 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.167+0000 7f883a7fc700 1 -- 172.21.15.61:0/2723096657 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f883401c460 con 0x7f88440b2660 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.167+0000 7f883a7fc700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8824066f30 0x7f88240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.167+0000 7f883a7fc700 1 -- 172.21.15.61:0/2723096657 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f88340841a0 con 0x7f88440b2660 2023-12-24T20:02:43.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.167+0000 7f884259c700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8824066f30 0x7f88240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.168+0000 7f884259c700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8824066f30 0x7f88240693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f882c0061f0 tx=0x7f882c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:43.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.171+0000 7f883a7fc700 1 -- 172.21.15.61:0/2723096657 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f884416c780 con 0x7f88440b2660 2023-12-24T20:02:43.368 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.368+0000 7f8848aba700 1 -- 172.21.15.61:0/2723096657 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f884406d440 con 0x7f88440b2660 2023-12-24T20:02:43.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.368+0000 7f883a7fc700 1 -- 172.21.15.61:0/2723096657 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f8834051410 con 0x7f88440b2660 2023-12-24T20:02:43.369 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:43.369 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":125,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:37.588176+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:21.867619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:22.397630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:43.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.370+0000 7f8848aba700 1 -- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8824066f30 msgr2=0x7f88240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.370+0000 7f8848aba700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8824066f30 0x7f88240693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f882c0061f0 tx=0x7f882c008040 comp rx=0 tx=0).stop 2023-12-24T20:02:43.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.370+0000 7f8848aba700 1 -- 172.21.15.61:0/2723096657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 msgr2=0x7f8844154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.370+0000 7f8848aba700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 0x7f8844154d70 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f883400c5d0 tx=0x7f8834007f60 comp rx=0 tx=0).stop 2023-12-24T20:02:43.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.371+0000 7f8848aba700 1 -- 172.21.15.61:0/2723096657 shutdown_connections 2023-12-24T20:02:43.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.371+0000 7f8848aba700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8844098aa0 0x7f8844168ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.371+0000 7f8848aba700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8824066f30 0x7f88240693e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.371+0000 7f8848aba700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f884415bb60 0x7f884409b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.371+0000 7f8848aba700 1 --2- 172.21.15.61:0/2723096657 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88440b2660 0x7f8844154d70 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.371+0000 7f8848aba700 1 -- 172.21.15.61:0/2723096657 >> 172.21.15.61:0/2723096657 conn(0x7f8844097a10 msgr2=0x7f884406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:43.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.371+0000 7f8848aba700 1 -- 172.21.15.61:0/2723096657 shutdown_connections 2023-12-24T20:02:43.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.371+0000 7f8848aba700 1 -- 172.21.15.61:0/2723096657 wait complete. 2023-12-24T20:02:43.383 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:02:43.383 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:43.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.505+0000 7faf1dc94700 1 Processor -- start 2023-12-24T20:02:43.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.505+0000 7faf1dc94700 1 -- start start 2023-12-24T20:02:43.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf1dc94700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf181575f0 0x7faf180cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf1dc94700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1806f740 con 0x7faf1806c320 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf1dc94700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1806eb30 con 0x7faf181579c0 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf1dc94700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1806ee10 con 0x7faf181575f0 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf17fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7faf1806c320 0x7faf180cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34308/0 (socket says 172.21.15.61:34308) 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf17fff700 1 -- 172.21.15.61:0/3092038721 learned_addr learned my addr 172.21.15.61:0/3092038721 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf177fe700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf181575f0 0x7faf180cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773607692 0 0) 0x7faf1806f740 con 0x7faf1806c320 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf00003570 con 0x7faf1806c320 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921666399 0 0) 0x7faf1806eb30 con 0x7faf181579c0 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf1806f740 con 0x7faf181579c0 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 953571127 0 0) 0x7faf00003570 con 0x7faf1806c320 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf181575f0 msgr2=0x7faf180cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf167fc700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf181575f0 0x7faf180cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 >> v1:172.21.15.133:6789/0 conn(0x7faf181579c0 legacy=0x7faf1815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1806f0f0 con 0x7faf1806c320 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7faf100017f0 con 0x7faf1806c320 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.506+0000 7faf177fe700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf181575f0 0x7faf180cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 >> v1:172.21.15.61:6789/0 conn(0x7faf1806c320 legacy=0x7faf180cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf167fc700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf00003c20 0x7faf00004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf167fc700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00004810 0x7faf00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf167fc700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf181575f0 0x7faf000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1806ee10 con 0x7faf00003c20 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0000bb10 con 0x7faf00004810 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0000bcd0 con 0x7faf181575f0 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf177fe700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf00003c20 0x7faf00004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf17fff700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf181575f0 0x7faf000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf16ffd700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00004810 0x7faf00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf177fe700 1 -- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf181575f0 msgr2=0x7faf000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf177fe700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf181575f0 0x7faf000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf177fe700 1 -- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00004810 msgr2=0x7faf00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf177fe700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00004810 0x7faf00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf177fe700 1 -- 172.21.15.61:0/3092038721 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08009420 con 0x7faf00003c20 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf16ffd700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00004810 0x7faf00004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf17fff700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf181575f0 0x7faf000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf177fe700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf00003c20 0x7faf00004010 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7faf08009df0 tx=0x7faf080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836971be71b16d42 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf08009740 con 0x7faf00003c20 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0800e920 con 0x7faf00003c20 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.507+0000 7faf167fc700 1 -- 172.21.15.61:0/3092038721 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800ece0 con 0x7faf00003c20 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.508+0000 7faf1dc94700 1 -- 172.21.15.61:0/3092038721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf00003c20 msgr2=0x7faf00004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.508+0000 7faf1dc94700 1 --2- 172.21.15.61:0/3092038721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf00003c20 0x7faf00004010 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7faf08009df0 tx=0x7faf080091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.508+0000 7faf17fff700 1 -- 172.21.15.61:0/3092038721 reap_dead start 2023-12-24T20:02:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.508+0000 7faf1dc94700 1 -- 172.21.15.61:0/3092038721 shutdown_connections 2023-12-24T20:02:43.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.508+0000 7faf1dc94700 1 -- 172.21.15.61:0/3092038721 >> 172.21.15.61:0/3092038721 conn(0x7faf1806b620 msgr2=0x7faf180ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:43.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.508+0000 7faf1dc94700 1 -- 172.21.15.61:0/3092038721 shutdown_connections 2023-12-24T20:02:43.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.508+0000 7faf1dc94700 1 -- 172.21.15.61:0/3092038721 wait complete. 2023-12-24T20:02:43.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.509+0000 7faf1dc94700 1 Processor -- start 2023-12-24T20:02:43.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.510+0000 7faf1dc94700 1 -- start start 2023-12-24T20:02:43.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.510+0000 7faf1dc94700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00003c20 0x7faf180c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.510+0000 7faf1dc94700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1815a520 0x7faf181580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.510+0000 7faf1dc94700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf180b3a90 0x7faf1816b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.510+0000 7faf1dc94700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf18148220 con 0x7faf180b3a90 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.510+0000 7faf1dc94700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf180c8660 con 0x7faf00003c20 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.510+0000 7faf1dc94700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1815a9c0 con 0x7faf1815a520 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.510+0000 7faf17fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf180b3a90 0x7faf1816b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.510+0000 7faf17fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf180b3a90 0x7faf1816b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47184/0 (socket says 172.21.15.61:47184) 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.510+0000 7faf17fff700 1 -- 172.21.15.61:0/1619004003 learned_addr learned my addr 172.21.15.61:0/1619004003 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf16ffd700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1815a520 0x7faf181580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf177fe700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00003c20 0x7faf180c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf17fff700 1 -- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1815a520 msgr2=0x7faf181580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf17fff700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1815a520 0x7faf181580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf17fff700 1 -- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00003c20 msgr2=0x7faf180c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf17fff700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00003c20 0x7faf180c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf17fff700 1 -- 172.21.15.61:0/1619004003 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1815aca0 con 0x7faf180b3a90 2023-12-24T20:02:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf16ffd700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1815a520 0x7faf181580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf177fe700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00003c20 0x7faf180c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf17fff700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf180b3a90 0x7faf1816b770 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7faf10000f80 tx=0x7faf100012a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faeff7fe700 1 -- 172.21.15.61:0/1619004003 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000ec30 con 0x7faf180b3a90 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faeff7fe700 1 -- 172.21.15.61:0/1619004003 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1000edb0 con 0x7faf180b3a90 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf1dc94700 1 -- 172.21.15.61:0/1619004003 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf18158910 con 0x7faf180b3a90 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faeff7fe700 1 -- 172.21.15.61:0/1619004003 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf10013670 con 0x7faf180b3a90 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.511+0000 7faf1dc94700 1 -- 172.21.15.61:0/1619004003 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf18158ed0 con 0x7faf180b3a90 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.512+0000 7faf1dc94700 1 -- 172.21.15.61:0/1619004003 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf18157f30 con 0x7faf180b3a90 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.513+0000 7faeff7fe700 1 -- 172.21.15.61:0/1619004003 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7faf10013a60 con 0x7faf180b3a90 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.513+0000 7faeff7fe700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf04066f30 0x7faf040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.513+0000 7faeff7fe700 1 -- 172.21.15.61:0/1619004003 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf10084bd0 con 0x7faf180b3a90 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.513+0000 7faf177fe700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf04066f30 0x7faf040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.514+0000 7faf177fe700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf04066f30 0x7faf040693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7faf0800e890 tx=0x7faf0801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:43.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.517+0000 7faeff7fe700 1 -- 172.21.15.61:0/1619004003 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf10051e40 con 0x7faf180b3a90 2023-12-24T20:02:43.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.758+0000 7faf1dc94700 1 -- 172.21.15.61:0/1619004003 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf1804c3c0 con 0x7faf180b3a90 2023-12-24T20:02:43.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.759+0000 7faeff7fe700 1 -- 172.21.15.61:0/1619004003 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7faf10055460 con 0x7faf180b3a90 2023-12-24T20:02:43.759 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:43.759 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2890522920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2890522920},{"type":"v1","addr":"172.21.15.133:6836","nonce":2890522920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/946349829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":946349829},{"type":"v1","addr":"172.21.15.133:6837","nonce":946349829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3897383544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3897383544},{"type":"v1","addr":"172.21.15.61:6834","nonce":3897383544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:23.422714+0000","modified":"2023-12-24T20:02:27.054403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/447554724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":447554724},{"type":"v1","addr":"172.21.15.61:6835","nonce":447554724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T20:02:43.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 -- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf04066f30 msgr2=0x7faf040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf04066f30 0x7faf040693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7faf0800e890 tx=0x7faf0801a000 comp rx=0 tx=0).stop 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 -- 172.21.15.61:0/1619004003 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf180b3a90 msgr2=0x7faf1816b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf180b3a90 0x7faf1816b770 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7faf10000f80 tx=0x7faf100012a0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 -- 172.21.15.61:0/1619004003 shutdown_connections 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faf04066f30 0x7faf040693e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf180b3a90 0x7faf1816b770 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf00003c20 0x7faf180c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 --2- 172.21.15.61:0/1619004003 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf1815a520 0x7faf181580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 -- 172.21.15.61:0/1619004003 >> 172.21.15.61:0/1619004003 conn(0x7faf1806b620 msgr2=0x7faf180cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 -- 172.21.15.61:0/1619004003 shutdown_connections 2023-12-24T20:02:43.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.761+0000 7faf1dc94700 1 -- 172.21.15.61:0/1619004003 wait complete. 2023-12-24T20:02:43.763 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 60 2023-12-24T20:02:43.774 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:43.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.896+0000 7f62269f5700 1 Processor -- start 2023-12-24T20:02:43.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.896+0000 7f62269f5700 1 -- start start 2023-12-24T20:02:43.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f62269f5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f622006f040 0x7f62200ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f62269f5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622006c300 con 0x7f6220159cf0 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f62269f5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622006ce80 con 0x7f622006ec70 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f62269f5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622006f480 con 0x7f622006f040 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f6224f92700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f622006f040 0x7f62200ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f621f7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f6220159cf0 0x7f62200cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34318/0 (socket says 172.21.15.61:34318) 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f6224f92700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f622006f040 0x7f62200ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47192/0 (socket says 172.21.15.61:47192) 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f621f7fe700 1 -- 172.21.15.61:0/382506789 learned_addr learned my addr 172.21.15.61:0/382506789 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f6224f92700 1 -- 172.21.15.61:0/382506789 >> v1:172.21.15.133:6789/0 conn(0x7f622006ec70 legacy=0x7f62201595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f6224f92700 1 -- 172.21.15.61:0/382506789 >> v1:172.21.15.61:6789/0 conn(0x7f6220159cf0 legacy=0x7f62200cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f6224f92700 1 -- 172.21.15.61:0/382506789 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6220068560 con 0x7f622006f040 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.897+0000 7f621effd700 1 -- 172.21.15.61:0/382506789 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445538221 0 0) 0x7f622006c300 con 0x7f6220159cf0 2023-12-24T20:02:43.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f6224f92700 1 --2- 172.21.15.61:0/382506789 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f622006f040 0x7f62200ce0d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6218009e60 tx=0x7f6218009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e4e9fe6dea9f37 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:43.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f621effd700 1 -- 172.21.15.61:0/382506789 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621800e070 con 0x7f622006f040 2023-12-24T20:02:43.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f621effd700 1 -- 172.21.15.61:0/382506789 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621800bbf0 con 0x7f622006f040 2023-12-24T20:02:43.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f621effd700 1 -- 172.21.15.61:0/382506789 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218012430 con 0x7f622006f040 2023-12-24T20:02:43.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f62269f5700 1 -- 172.21.15.61:0/382506789 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f622006f040 msgr2=0x7f62200ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f62269f5700 1 --2- 172.21.15.61:0/382506789 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f622006f040 0x7f62200ce0d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6218009e60 tx=0x7f6218009780 comp rx=0 tx=0).stop 2023-12-24T20:02:43.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f62269f5700 1 -- 172.21.15.61:0/382506789 shutdown_connections 2023-12-24T20:02:43.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f62269f5700 1 --2- 172.21.15.61:0/382506789 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f622006f040 0x7f62200ce0d0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f62269f5700 1 -- 172.21.15.61:0/382506789 >> 172.21.15.61:0/382506789 conn(0x7f622006b650 msgr2=0x7f62200ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:43.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f62269f5700 1 -- 172.21.15.61:0/382506789 shutdown_connections 2023-12-24T20:02:43.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.898+0000 7f62269f5700 1 -- 172.21.15.61:0/382506789 wait complete. 2023-12-24T20:02:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.899+0000 7f62269f5700 1 Processor -- start 2023-12-24T20:02:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.900+0000 7f62269f5700 1 -- start start 2023-12-24T20:02:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.900+0000 7f62269f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f622006ec70 0x7f62200acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.900+0000 7f62269f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f622006f040 0x7f62200adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.900+0000 7f62269f5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6220159cf0 0x7f6220156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.900+0000 7f62269f5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62200ac8f0 con 0x7f6220159cf0 2023-12-24T20:02:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.900+0000 7f62269f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62200abce0 con 0x7f622006f040 2023-12-24T20:02:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.900+0000 7f62269f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200abfc0 con 0x7f622006ec70 2023-12-24T20:02:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6224f92700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6220159cf0 0x7f6220156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6224f92700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6220159cf0 0x7f6220156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47206/0 (socket says 172.21.15.61:47206) 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6224f92700 1 -- 172.21.15.61:0/2170033646 learned_addr learned my addr 172.21.15.61:0/2170033646 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f621f7fe700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f622006f040 0x7f62200adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f621ffff700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f622006ec70 0x7f62200acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6224f92700 1 -- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f622006ec70 msgr2=0x7f62200acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6224f92700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f622006ec70 0x7f62200acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6224f92700 1 -- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f622006f040 msgr2=0x7f62200adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6224f92700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f622006f040 0x7f62200adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6224f92700 1 -- 172.21.15.61:0/2170033646 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6218009a20 con 0x7f6220159cf0 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6224f92700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6220159cf0 0x7f6220156440 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f62200cc3b0 tx=0x7f6218018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6217fff700 1 -- 172.21.15.61:0/2170033646 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621801e640 con 0x7f6220159cf0 2023-12-24T20:02:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6217fff700 1 -- 172.21.15.61:0/2170033646 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621801e7a0 con 0x7f6220159cf0 2023-12-24T20:02:43.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f62269f5700 1 -- 172.21.15.61:0/2170033646 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62200ac2a0 con 0x7f6220159cf0 2023-12-24T20:02:43.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f6217fff700 1 -- 172.21.15.61:0/2170033646 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621801eb60 con 0x7f6220159cf0 2023-12-24T20:02:43.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.901+0000 7f62269f5700 1 -- 172.21.15.61:0/2170033646 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62200ae0b0 con 0x7f6220159cf0 2023-12-24T20:02:43.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.902+0000 7f62269f5700 1 -- 172.21.15.61:0/2170033646 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62200acaa0 con 0x7f6220159cf0 2023-12-24T20:02:43.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.902+0000 7f6217fff700 1 -- 172.21.15.61:0/2170033646 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6218024070 con 0x7f6220159cf0 2023-12-24T20:02:43.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.903+0000 7f6217fff700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6200066f30 0x7f62000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:43.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.903+0000 7f6217fff700 1 -- 172.21.15.61:0/2170033646 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6218086fe0 con 0x7f6220159cf0 2023-12-24T20:02:43.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.903+0000 7f621ffff700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6200066f30 0x7f62000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:43.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.904+0000 7f621ffff700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6200066f30 0x7f62000693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6210006fd0 tx=0x7f6210008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:43.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:43.907+0000 7f6217fff700 1 -- 172.21.15.61:0/2170033646 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62200acaa0 con 0x7f6220159cf0 2023-12-24T20:02:44.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.147+0000 7f62269f5700 1 -- 172.21.15.61:0/2170033646 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f622004c3c0 con 0x7f6220159cf0 2023-12-24T20:02:44.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.148+0000 7f6217fff700 1 -- 172.21.15.61:0/2170033646 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6218054300 con 0x7f6220159cf0 2023-12-24T20:02:44.148 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:44.148 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2890522920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2890522920},{"type":"v1","addr":"172.21.15.133:6836","nonce":2890522920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/946349829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":946349829},{"type":"v1","addr":"172.21.15.133:6837","nonce":946349829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3897383544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3897383544},{"type":"v1","addr":"172.21.15.61:6834","nonce":3897383544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:23.422714+0000","modified":"2023-12-24T20:02:27.054403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/447554724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":447554724},{"type":"v1","addr":"172.21.15.61:6835","nonce":447554724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-12-24T20:02:44.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 -- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6200066f30 msgr2=0x7f62000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6200066f30 0x7f62000693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6210006fd0 tx=0x7f6210008040 comp rx=0 tx=0).stop 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 -- 172.21.15.61:0/2170033646 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6220159cf0 msgr2=0x7f6220156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6220159cf0 0x7f6220156440 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f62200cc3b0 tx=0x7f6218018000 comp rx=0 tx=0).stop 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 -- 172.21.15.61:0/2170033646 shutdown_connections 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f622006ec70 0x7f62200acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6200066f30 0x7f62000693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6220159cf0 0x7f6220156440 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 --2- 172.21.15.61:0/2170033646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f622006f040 0x7f62200adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 -- 172.21.15.61:0/2170033646 >> 172.21.15.61:0/2170033646 conn(0x7f622006b650 msgr2=0x7f62200c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 -- 172.21.15.61:0/2170033646 shutdown_connections 2023-12-24T20:02:44.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.150+0000 7f62269f5700 1 -- 172.21.15.61:0/2170033646 wait complete. 2023-12-24T20:02:44.152 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 60 2023-12-24T20:02:44.163 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:44.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.284+0000 7f7080a98700 1 Processor -- start 2023-12-24T20:02:44.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.284+0000 7f7080a98700 1 -- start start 2023-12-24T20:02:44.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f7080a98700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f707c0af710 0x7f707c0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f7080a98700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f707c068c80 0x7f707c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f7080a98700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c0687f0 con 0x7f707c0a6c80 2023-12-24T20:02:44.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f7080a98700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707c0a7100 con 0x7f707c0af710 2023-12-24T20:02:44.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f7080a98700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c067be0 con 0x7f707c068c80 2023-12-24T20:02:44.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f707a59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f707c0af710 0x7f707c0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f707a59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f707c0af710 0x7f707c0afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47222/0 (socket says 172.21.15.61:47222) 2023-12-24T20:02:44.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f707a59c700 1 -- 172.21.15.61:0/3055438858 learned_addr learned my addr 172.21.15.61:0/3055438858 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:44.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f7079d9b700 1 --2- 172.21.15.61:0/3055438858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f707c068c80 0x7f707c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f707a59c700 1 -- 172.21.15.61:0/3055438858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f707c068c80 msgr2=0x7f707c067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f707a59c700 1 --2- 172.21.15.61:0/3055438858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f707c068c80 0x7f707c067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f707a59c700 1 -- 172.21.15.61:0/3055438858 >> v1:172.21.15.133:6789/0 conn(0x7f707c0a6c80 legacy=0x7f707c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.285+0000 7f707a59c700 1 -- 172.21.15.61:0/3055438858 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c067ec0 con 0x7f707c0af710 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f707a59c700 1 --2- 172.21.15.61:0/3055438858 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0af710 0x7f707c0afae0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f70700099b0 tx=0x7f7070009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0b7e659102228d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f707959a700 1 -- 172.21.15.61:0/3055438858 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707000b820 con 0x7f707c0af710 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f707959a700 1 -- 172.21.15.61:0/3055438858 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707000b980 con 0x7f707c0af710 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f707959a700 1 -- 172.21.15.61:0/3055438858 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707000bd20 con 0x7f707c0af710 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f7080a98700 1 -- 172.21.15.61:0/3055438858 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0af710 msgr2=0x7f707c0afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f7080a98700 1 --2- 172.21.15.61:0/3055438858 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0af710 0x7f707c0afae0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f70700099b0 tx=0x7f7070009250 comp rx=0 tx=0).stop 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f7080a98700 1 -- 172.21.15.61:0/3055438858 shutdown_connections 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f7080a98700 1 --2- 172.21.15.61:0/3055438858 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0af710 0x7f707c0afae0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f7080a98700 1 --2- 172.21.15.61:0/3055438858 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f707c068c80 0x7f707c067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f7080a98700 1 -- 172.21.15.61:0/3055438858 >> 172.21.15.61:0/3055438858 conn(0x7f707c0ca200 msgr2=0x7f707c0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f7080a98700 1 -- 172.21.15.61:0/3055438858 shutdown_connections 2023-12-24T20:02:44.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.286+0000 7f7080a98700 1 -- 172.21.15.61:0/3055438858 wait complete. 2023-12-24T20:02:44.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7080a98700 1 Processor -- start 2023-12-24T20:02:44.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7080a98700 1 -- start start 2023-12-24T20:02:44.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7080a98700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f707c068c80 0x7f707c0a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7080a98700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0a6c80 0x7f707c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7080a98700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f707c0af710 0x7f707c0ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7080a98700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c166f50 con 0x7f707c0a6c80 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7080a98700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c1671d0 con 0x7f707c0af710 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7080a98700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c1674b0 con 0x7f707c068c80 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7079d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0a6c80 0x7f707c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7079d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0a6c80 0x7f707c0cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47236/0 (socket says 172.21.15.61:47236) 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.288+0000 7f7079d9b700 1 -- 172.21.15.61:0/1410100526 learned_addr learned my addr 172.21.15.61:0/1410100526 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f707a59c700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f707c068c80 0x7f707c0a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f707ad9d700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f707c0af710 0x7f707c0ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f7079d9b700 1 -- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f707c068c80 msgr2=0x7f707c0a87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f7079d9b700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f707c068c80 0x7f707c0a87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f7079d9b700 1 -- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f707c0af710 msgr2=0x7f707c0ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f7079d9b700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f707c0af710 0x7f707c0ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f7079d9b700 1 -- 172.21.15.61:0/1410100526 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70700094f0 con 0x7f707c0a6c80 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f707ad9d700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f707c0af710 0x7f707c0ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f7079d9b700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0a6c80 0x7f707c0cc8b0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c880 tx=0x7f706c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f706a7fc700 1 -- 172.21.15.61:0/1410100526 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c011600 con 0x7f707c0a6c80 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f706a7fc700 1 -- 172.21.15.61:0/1410100526 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c011760 con 0x7f707c0a6c80 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f7080a98700 1 -- 172.21.15.61:0/1410100526 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c167790 con 0x7f707c0a6c80 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f706a7fc700 1 -- 172.21.15.61:0/1410100526 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c011b00 con 0x7f707c0a6c80 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.289+0000 7f7080a98700 1 -- 172.21.15.61:0/1410100526 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c167d50 con 0x7f707c0a6c80 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.290+0000 7f7080a98700 1 -- 172.21.15.61:0/1410100526 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c04c3c0 con 0x7f707c0a6c80 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.291+0000 7f706a7fc700 1 -- 172.21.15.61:0/1410100526 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f706c0223a0 con 0x7f707c0a6c80 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.291+0000 7f706a7fc700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f705c066f30 0x7f705c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.291+0000 7f706a7fc700 1 -- 172.21.15.61:0/1410100526 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f706c084600 con 0x7f707c0a6c80 2023-12-24T20:02:44.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.291+0000 7f707a59c700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f705c066f30 0x7f705c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.292+0000 7f707a59c700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f705c066f30 0x7f705c0693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f70700099b0 tx=0x7f7070016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:44.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.295+0000 7f706a7fc700 1 -- 172.21.15.61:0/1410100526 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f706c051870 con 0x7f707c0a6c80 2023-12-24T20:02:44.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.491+0000 7f7080a98700 1 -- 172.21.15.61:0/1410100526 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f707c0cd540 con 0x7f707c0a6c80 2023-12-24T20:02:44.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.492+0000 7f706a7fc700 1 -- 172.21.15.61:0/1410100526 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f706c054e90 con 0x7f707c0a6c80 2023-12-24T20:02:44.493 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:44.493 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":125,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:37.588176+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:21.867619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:22.397630+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:44.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 -- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f705c066f30 msgr2=0x7f705c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f705c066f30 0x7f705c0693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f70700099b0 tx=0x7f7070016000 comp rx=0 tx=0).stop 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 -- 172.21.15.61:0/1410100526 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0a6c80 msgr2=0x7f707c0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0a6c80 0x7f707c0cc8b0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c880 tx=0x7f706c008040 comp rx=0 tx=0).stop 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 -- 172.21.15.61:0/1410100526 shutdown_connections 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f707c068c80 0x7f707c0a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f705c066f30 0x7f705c0693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f707c0af710 0x7f707c0ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 --2- 172.21.15.61:0/1410100526 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f707c0a6c80 0x7f707c0cc8b0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 -- 172.21.15.61:0/1410100526 >> 172.21.15.61:0/1410100526 conn(0x7f707c0ca200 msgr2=0x7f707c155250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 -- 172.21.15.61:0/1410100526 shutdown_connections 2023-12-24T20:02:44.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.494+0000 7f7080a98700 1 -- 172.21.15.61:0/1410100526 wait complete. 2023-12-24T20:02:44.507 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:02:44.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.630+0000 7ffbb169d700 1 Processor -- start 2023-12-24T20:02:44.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.630+0000 7ffbb169d700 1 -- start start 2023-12-24T20:02:44.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbb169d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffbac1433e0 0x7ffbac15d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbb169d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ffbac1437b0 0x7ffbac15dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbb169d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 0x7ffbac0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbb169d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac15b550 con 0x7ffbac1437b0 2023-12-24T20:02:44.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbb169d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac0d0bb0 con 0x7ffbac1433e0 2023-12-24T20:02:44.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbb169d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac0d0e90 con 0x7ffbac0cfe50 2023-12-24T20:02:44.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbaa7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ffbac1437b0 0x7ffbac15dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbaa7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ffbac1437b0 0x7ffbac15dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47250/0 (socket says 172.21.15.61:47250) 2023-12-24T20:02:44.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbaa7fc700 1 -- 172.21.15.61:0/1676319361 learned_addr learned my addr 172.21.15.61:0/1676319361 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:44.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbab7fe700 1 --2- 172.21.15.61:0/1676319361 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 0x7ffbac0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbaaffd700 1 --2- 172.21.15.61:0/1676319361 >> v2:172.21.15.133:3300/0 conn(0x7ffbac1433e0 0x7ffbac15d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbaa7fc700 1 -- 172.21.15.61:0/1676319361 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 msgr2=0x7ffbac0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbaa7fc700 1 --2- 172.21.15.61:0/1676319361 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 0x7ffbac0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbaa7fc700 1 -- 172.21.15.61:0/1676319361 >> v2:172.21.15.133:3300/0 conn(0x7ffbac1433e0 msgr2=0x7ffbac15d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbaa7fc700 1 --2- 172.21.15.61:0/1676319361 >> v2:172.21.15.133:3300/0 conn(0x7ffbac1433e0 0x7ffbac15d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.631+0000 7ffbaa7fc700 1 -- 172.21.15.61:0/1676319361 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac0d1170 con 0x7ffbac1437b0 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffbaa7fc700 1 --2- 172.21.15.61:0/1676319361 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 0x7ffbac15dd90 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0890c0 tx=0x7ffba0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1081f161c4153eea server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffba9ffb700 1 -- 172.21.15.61:0/1676319361 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba000b860 con 0x7ffbac1437b0 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffba9ffb700 1 -- 172.21.15.61:0/1676319361 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba000b9c0 con 0x7ffbac1437b0 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffba9ffb700 1 -- 172.21.15.61:0/1676319361 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba000bd60 con 0x7ffbac1437b0 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffbb169d700 1 -- 172.21.15.61:0/1676319361 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 msgr2=0x7ffbac15dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffbb169d700 1 --2- 172.21.15.61:0/1676319361 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 0x7ffbac15dd90 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0890c0 tx=0x7ffba0009250 comp rx=0 tx=0).stop 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffbb169d700 1 -- 172.21.15.61:0/1676319361 shutdown_connections 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffbb169d700 1 --2- 172.21.15.61:0/1676319361 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 0x7ffbac0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffbb169d700 1 --2- 172.21.15.61:0/1676319361 >> v2:172.21.15.133:3300/0 conn(0x7ffbac1433e0 0x7ffbac15d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffbb169d700 1 --2- 172.21.15.61:0/1676319361 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 0x7ffbac15dd90 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffbb169d700 1 -- 172.21.15.61:0/1676319361 >> 172.21.15.61:0/1676319361 conn(0x7ffbac06e640 msgr2=0x7ffbac067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:44.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffbb169d700 1 -- 172.21.15.61:0/1676319361 shutdown_connections 2023-12-24T20:02:44.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.632+0000 7ffbb169d700 1 -- 172.21.15.61:0/1676319361 wait complete. 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.634+0000 7ffbb169d700 1 Processor -- start 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.634+0000 7ffbb169d700 1 -- start start 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.634+0000 7ffbb169d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 0x7ffbac0c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.634+0000 7ffbb169d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbac1433e0 0x7ffbac0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.634+0000 7ffbb169d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 0x7ffbac0aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.634+0000 7ffbb169d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac0cc550 con 0x7ffbac1437b0 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.634+0000 7ffbb169d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac0c6930 con 0x7ffbac1433e0 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.634+0000 7ffbb169d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac0c6c10 con 0x7ffbac0cfe50 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbab7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 0x7ffbac0aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbab7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 0x7ffbac0aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47254/0 (socket says 172.21.15.61:47254) 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbab7fe700 1 -- 172.21.15.61:0/2773910453 learned_addr learned my addr 172.21.15.61:0/2773910453 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:44.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbaaffd700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 0x7ffbac0c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbaa7fc700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbac1433e0 0x7ffbac0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbab7fe700 1 -- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 msgr2=0x7ffbac0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbab7fe700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 0x7ffbac0c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbab7fe700 1 -- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbac1433e0 msgr2=0x7ffbac0cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbab7fe700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbac1433e0 0x7ffbac0cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbab7fe700 1 -- 172.21.15.61:0/2773910453 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba00094f0 con 0x7ffbac1437b0 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbaaffd700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 0x7ffbac0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbaa7fc700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbac1433e0 0x7ffbac0cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbab7fe700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 0x7ffbac0aebf0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009fa0 tx=0x7ffba4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffb92ffd700 1 -- 172.21.15.61:0/2773910453 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba400ed20 con 0x7ffbac1437b0 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffb92ffd700 1 -- 172.21.15.61:0/2773910453 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba400ee80 con 0x7ffbac1437b0 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbb169d700 1 -- 172.21.15.61:0/2773910453 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbac0c6ef0 con 0x7ffbac1437b0 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffb92ffd700 1 -- 172.21.15.61:0/2773910453 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4014670 con 0x7ffbac1437b0 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.635+0000 7ffbb169d700 1 -- 172.21.15.61:0/2773910453 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac0cc260 con 0x7ffbac1437b0 2023-12-24T20:02:44.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.636+0000 7ffbb169d700 1 -- 172.21.15.61:0/2773910453 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac089190 con 0x7ffbac1437b0 2023-12-24T20:02:44.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.636+0000 7ffb92ffd700 1 -- 172.21.15.61:0/2773910453 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ffba40149e0 con 0x7ffbac1437b0 2023-12-24T20:02:44.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.637+0000 7ffb92ffd700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffb98066f30 0x7ffb980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:44.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.637+0000 7ffb92ffd700 1 -- 172.21.15.61:0/2773910453 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffba4084d20 con 0x7ffbac1437b0 2023-12-24T20:02:44.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.637+0000 7ffbaaffd700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffb98066f30 0x7ffb980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:44.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.638+0000 7ffbaaffd700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffb98066f30 0x7ffb980693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c006fd0 tx=0x7ffb9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:44.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.641+0000 7ffb92ffd700 1 -- 172.21.15.61:0/2773910453 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffba4051f90 con 0x7ffbac1437b0 2023-12-24T20:02:44.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.879+0000 7ffbb169d700 1 -- 172.21.15.61:0/2773910453 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ffbac0c7410 con 0x7ffbac1437b0 2023-12-24T20:02:44.879 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:02:44.879+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:02:44.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.883+0000 7ffb92ffd700 1 -- 172.21.15.61:0/2773910453 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7ffbac0c7410 con 0x7ffbac1437b0 2023-12-24T20:02:44.884 INFO:tasks.ceph.mds.c.smithi061.stderr: -4269> 2023-12-24T20:02:18.958+0000 7f992016e700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-12-24T20:02:44.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 -- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffb98066f30 msgr2=0x7ffb980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffb98066f30 0x7ffb980693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c006fd0 tx=0x7ffb9c008040 comp rx=0 tx=0).stop 2023-12-24T20:02:44.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 -- 172.21.15.61:0/2773910453 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 msgr2=0x7ffbac0aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:44.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 0x7ffbac0aebf0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009fa0 tx=0x7ffba4009900 comp rx=0 tx=0).stop 2023-12-24T20:02:44.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 -- 172.21.15.61:0/2773910453 shutdown_connections 2023-12-24T20:02:44.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ffbac0cfe50 0x7ffbac0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ffb98066f30 0x7ffb980693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffbac1437b0 0x7ffbac0aebf0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 --2- 172.21.15.61:0/2773910453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbac1433e0 0x7ffbac0cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:44.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 -- 172.21.15.61:0/2773910453 >> 172.21.15.61:0/2773910453 conn(0x7ffbac06e640 msgr2=0x7ffbac0b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:44.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 -- 172.21.15.61:0/2773910453 shutdown_connections 2023-12-24T20:02:44.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:44.885+0000 7ffbb169d700 1 -- 172.21.15.61:0/2773910453 wait complete. 2023-12-24T20:02:44.887 INFO:tasks.ceph.mds.c.smithi061.stderr: -3056> 2023-12-24T20:02:29.563+0000 7f991a162700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:02:44.887 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:02:44.901 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:02:44.914 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T20:02:45.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.026+0000 7f9ea545b700 1 Processor -- start 2023-12-24T20:02:45.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.026+0000 7f9ea545b700 1 -- start start 2023-12-24T20:02:45.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9ea545b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9ea01598d0 0x7f9ea00b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:45.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9ea545b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea006e280 0x7f9ea00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9ea545b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea00cbf80 con 0x7f9ea0159ca0 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9ea545b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea015a110 con 0x7f9ea01598d0 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9ea545b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea00b11c0 con 0x7f9ea006e280 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9e9effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9ea01598d0 0x7f9ea00b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9e9effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9ea01598d0 0x7f9ea00b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47288/0 (socket says 172.21.15.61:47288) 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9e9effd700 1 -- 172.21.15.61:0/3522546180 learned_addr learned my addr 172.21.15.61:0/3522546180 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9e9f7fe700 1 --2- 172.21.15.61:0/3522546180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea006e280 0x7f9ea00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9e9effd700 1 -- 172.21.15.61:0/3522546180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea006e280 msgr2=0x7f9ea00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9e9effd700 1 --2- 172.21.15.61:0/3522546180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea006e280 0x7f9ea00cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9e9effd700 1 -- 172.21.15.61:0/3522546180 >> v1:172.21.15.133:6789/0 conn(0x7f9ea0159ca0 legacy=0x7f9ea006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9e9effd700 1 -- 172.21.15.61:0/3522546180 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00b14a0 con 0x7f9ea01598d0 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9e9effd700 1 --2- 172.21.15.61:0/3522546180 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea01598d0 0x7f9ea00b2aa0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f9e940099b0 tx=0x7f9e94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b2db2ca3db742b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:45.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.027+0000 7f9e9dffb700 1 -- 172.21.15.61:0/3522546180 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400b860 con 0x7f9ea01598d0 2023-12-24T20:02:45.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.028+0000 7f9e9dffb700 1 -- 172.21.15.61:0/3522546180 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9400b9c0 con 0x7f9ea01598d0 2023-12-24T20:02:45.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.028+0000 7f9e9dffb700 1 -- 172.21.15.61:0/3522546180 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400bd60 con 0x7f9ea01598d0 2023-12-24T20:02:45.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.028+0000 7f9ea545b700 1 -- 172.21.15.61:0/3522546180 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea01598d0 msgr2=0x7f9ea00b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:45.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.028+0000 7f9ea545b700 1 --2- 172.21.15.61:0/3522546180 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea01598d0 0x7f9ea00b2aa0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f9e940099b0 tx=0x7f9e94009250 comp rx=0 tx=0).stop 2023-12-24T20:02:45.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.028+0000 7f9ea545b700 1 -- 172.21.15.61:0/3522546180 shutdown_connections 2023-12-24T20:02:45.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.028+0000 7f9ea545b700 1 --2- 172.21.15.61:0/3522546180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea006e280 0x7f9ea00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:45.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.028+0000 7f9ea545b700 1 --2- 172.21.15.61:0/3522546180 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea01598d0 0x7f9ea00b2aa0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:45.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.028+0000 7f9ea545b700 1 -- 172.21.15.61:0/3522546180 >> 172.21.15.61:0/3522546180 conn(0x7f9ea0067550 msgr2=0x7f9ea0067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:45.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.028+0000 7f9ea545b700 1 -- 172.21.15.61:0/3522546180 shutdown_connections 2023-12-24T20:02:45.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.028+0000 7f9ea545b700 1 -- 172.21.15.61:0/3522546180 wait complete. 2023-12-24T20:02:45.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.029+0000 7f9ea545b700 1 Processor -- start 2023-12-24T20:02:45.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.029+0000 7f9ea545b700 1 -- start start 2023-12-24T20:02:45.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.030+0000 7f9ea545b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea006e280 0x7f9ea015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:45.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.030+0000 7f9ea545b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea01598d0 0x7f9ea0067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:45.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.030+0000 7f9ea545b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea0159ca0 0x7f9ea0067e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:45.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.030+0000 7f9ea545b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea015c310 con 0x7f9ea0159ca0 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.030+0000 7f9ea545b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea015c5f0 con 0x7f9ea006e280 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.030+0000 7f9ea545b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea015c8d0 con 0x7f9ea01598d0 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.030+0000 7f9e9f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea0159ca0 0x7f9ea0067e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.030+0000 7f9e9f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea0159ca0 0x7f9ea0067e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47304/0 (socket says 172.21.15.61:47304) 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.030+0000 7f9e9f7fe700 1 -- 172.21.15.61:0/40732501 learned_addr learned my addr 172.21.15.61:0/40732501 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e9e7fc700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea01598d0 0x7f9ea0067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e9effd700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea006e280 0x7f9ea015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e9f7fe700 1 -- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea01598d0 msgr2=0x7f9ea0067920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e9f7fe700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea01598d0 0x7f9ea0067920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e9f7fe700 1 -- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea006e280 msgr2=0x7f9ea015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e9f7fe700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea006e280 0x7f9ea015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e9f7fe700 1 -- 172.21.15.61:0/40732501 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e940094f0 con 0x7f9ea0159ca0 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e9e7fc700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea01598d0 0x7f9ea0067920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:45.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e9effd700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea006e280 0x7f9ea015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:45.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e9f7fe700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea0159ca0 0x7f9ea0067e60 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9e98007f20 tx=0x7f9e98009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:45.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e86ffd700 1 -- 172.21.15.61:0/40732501 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9800eca0 con 0x7f9ea0159ca0 2023-12-24T20:02:45.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e86ffd700 1 -- 172.21.15.61:0/40732501 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9800ee20 con 0x7f9ea0159ca0 2023-12-24T20:02:45.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9e86ffd700 1 -- 172.21.15.61:0/40732501 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98014670 con 0x7f9ea0159ca0 2023-12-24T20:02:45.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9ea545b700 1 -- 172.21.15.61:0/40732501 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea015cbb0 con 0x7f9ea0159ca0 2023-12-24T20:02:45.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.031+0000 7f9ea545b700 1 -- 172.21.15.61:0/40732501 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea015bfc0 con 0x7f9ea0159ca0 2023-12-24T20:02:45.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.032+0000 7f9ea545b700 1 -- 172.21.15.61:0/40732501 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea0089120 con 0x7f9ea0159ca0 2023-12-24T20:02:45.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.033+0000 7f9e86ffd700 1 -- 172.21.15.61:0/40732501 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9e980149e0 con 0x7f9ea0159ca0 2023-12-24T20:02:45.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.033+0000 7f9e86ffd700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e8c066f30 0x7f9e8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:45.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.033+0000 7f9e86ffd700 1 -- 172.21.15.61:0/40732501 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f9e98084cb0 con 0x7f9ea0159ca0 2023-12-24T20:02:45.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.033+0000 7f9e9effd700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e8c066f30 0x7f9e8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:45.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.034+0000 7f9e9effd700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e8c066f30 0x7f9e8c0693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9e940099b0 tx=0x7f9e94017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:45.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.038+0000 7f9e86ffd700 1 -- 172.21.15.61:0/40732501 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e98051ed0 con 0x7f9ea0159ca0 2023-12-24T20:02:45.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.278+0000 7f9ea545b700 1 -- 172.21.15.61:0/40732501 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9ea015d0d0 con 0x7f9ea0159ca0 2023-12-24T20:02:45.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.884+0000 7f9e86ffd700 1 -- 172.21.15.61:0/40732501 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ea015d0d0 con 0x7f9ea0159ca0 2023-12-24T20:02:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 -- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e8c066f30 msgr2=0x7f9e8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e8c066f30 0x7f9e8c0693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9e940099b0 tx=0x7f9e94017000 comp rx=0 tx=0).stop 2023-12-24T20:02:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 -- 172.21.15.61:0/40732501 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea0159ca0 msgr2=0x7f9ea0067e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea0159ca0 0x7f9ea0067e60 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9e98007f20 tx=0x7f9e98009860 comp rx=0 tx=0).stop 2023-12-24T20:02:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 -- 172.21.15.61:0/40732501 shutdown_connections 2023-12-24T20:02:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9e8c066f30 0x7f9e8c0693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ea0159ca0 0x7f9ea0067e60 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ea006e280 0x7f9ea015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 --2- 172.21.15.61:0/40732501 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ea01598d0 0x7f9ea0067920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 -- 172.21.15.61:0/40732501 >> 172.21.15.61:0/40732501 conn(0x7f9ea0067550 msgr2=0x7f9ea00b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 -- 172.21.15.61:0/40732501 shutdown_connections 2023-12-24T20:02:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:45.887+0000 7f9ea545b700 1 -- 172.21.15.61:0/40732501 wait complete. 2023-12-24T20:02:45.901 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:02:46.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.071+0000 7fdce7e69700 1 Processor -- start 2023-12-24T20:02:46.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.072+0000 7fdce7e69700 1 -- start start 2023-12-24T20:02:46.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.072+0000 7fdce7e69700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdce00ce750 0x7fdce006f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.072+0000 7fdce7e69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdce015b590 0x7fdce00ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.072+0000 7fdce7e69700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdce00c9500 0x7fdce00c9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.072+0000 7fdce7e69700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce00c8d90 con 0x7fdce00ce750 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.072+0000 7fdce7e69700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce00cf060 con 0x7fdce00c9500 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.072+0000 7fdce7e69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce015bd00 con 0x7fdce015b590 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce5c05700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdce00ce750 0x7fdce006f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce5c05700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdce00ce750 0x7fdce006f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47314/0 (socket says 172.21.15.61:47314) 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce5c05700 1 -- 172.21.15.61:0/4025940092 learned_addr learned my addr 172.21.15.61:0/4025940092 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce6406700 1 --2- 172.21.15.61:0/4025940092 >> v2:172.21.15.133:3300/0 conn(0x7fdce00c9500 0x7fdce00c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce5c05700 1 -- 172.21.15.61:0/4025940092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdce015b590 msgr2=0x7fdce00ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce5c05700 1 --2- 172.21.15.61:0/4025940092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdce015b590 0x7fdce00ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce5c05700 1 -- 172.21.15.61:0/4025940092 >> v2:172.21.15.133:3300/0 conn(0x7fdce00c9500 msgr2=0x7fdce00c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce5c05700 1 --2- 172.21.15.61:0/4025940092 >> v2:172.21.15.133:3300/0 conn(0x7fdce00c9500 0x7fdce00c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce5c05700 1 -- 172.21.15.61:0/4025940092 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce015bfe0 con 0x7fdce00ce750 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce6406700 1 --2- 172.21.15.61:0/4025940092 >> v2:172.21.15.133:3300/0 conn(0x7fdce00c9500 0x7fdce00c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce5c05700 1 --2- 172.21.15.61:0/4025940092 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 0x7fdce006f850 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fdce00b48a0 tx=0x7fdcdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87db4e3efe71321c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce4c03700 1 -- 172.21.15.61:0/4025940092 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00b860 con 0x7fdce00ce750 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce4c03700 1 -- 172.21.15.61:0/4025940092 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc00b9c0 con 0x7fdce00ce750 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.073+0000 7fdce4c03700 1 -- 172.21.15.61:0/4025940092 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00bd60 con 0x7fdce00ce750 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.074+0000 7fdce7e69700 1 -- 172.21.15.61:0/4025940092 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 msgr2=0x7fdce006f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.074+0000 7fdce7e69700 1 --2- 172.21.15.61:0/4025940092 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 0x7fdce006f850 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fdce00b48a0 tx=0x7fdcdc009250 comp rx=0 tx=0).stop 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.074+0000 7fdce7e69700 1 -- 172.21.15.61:0/4025940092 shutdown_connections 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.074+0000 7fdce7e69700 1 --2- 172.21.15.61:0/4025940092 >> v2:172.21.15.133:3300/0 conn(0x7fdce00c9500 0x7fdce00c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.074+0000 7fdce7e69700 1 --2- 172.21.15.61:0/4025940092 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 0x7fdce006f850 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.074+0000 7fdce7e69700 1 --2- 172.21.15.61:0/4025940092 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdce015b590 0x7fdce00ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.074+0000 7fdce7e69700 1 -- 172.21.15.61:0/4025940092 >> 172.21.15.61:0/4025940092 conn(0x7fdce0069760 msgr2=0x7fdce0069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:46.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.074+0000 7fdce7e69700 1 -- 172.21.15.61:0/4025940092 shutdown_connections 2023-12-24T20:02:46.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.074+0000 7fdce7e69700 1 -- 172.21.15.61:0/4025940092 wait complete. 2023-12-24T20:02:46.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.075+0000 7fdce7e69700 1 Processor -- start 2023-12-24T20:02:46.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.075+0000 7fdce7e69700 1 -- start start 2023-12-24T20:02:46.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce7e69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce00c9500 0x7fdce014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:46.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce7e69700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 0x7fdce0143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:46.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce7e69700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdce015b590 0x7fdce00c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:46.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce7e69700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00b1c10 con 0x7fdce00ce750 2023-12-24T20:02:46.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce7e69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01526e0 con 0x7fdce00c9500 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce7e69700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01529c0 con 0x7fdce015b590 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce5404700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 0x7fdce0143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce5404700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 0x7fdce0143a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47328/0 (socket says 172.21.15.61:47328) 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce5404700 1 -- 172.21.15.61:0/711118647 learned_addr learned my addr 172.21.15.61:0/711118647 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce5c05700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce00c9500 0x7fdce014fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce6406700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdce015b590 0x7fdce00c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce5404700 1 -- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdce015b590 msgr2=0x7fdce00c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce5404700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdce015b590 0x7fdce00c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce5404700 1 -- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce00c9500 msgr2=0x7fdce014fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce5404700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce00c9500 0x7fdce014fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce5404700 1 -- 172.21.15.61:0/711118647 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0094f0 con 0x7fdce00ce750 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.076+0000 7fdce5404700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 0x7fdce0143a20 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000b810 tx=0x7fdcd00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.077+0000 7fdcd5ffb700 1 -- 172.21.15.61:0/711118647 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000f510 con 0x7fdce00ce750 2023-12-24T20:02:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.077+0000 7fdcd5ffb700 1 -- 172.21.15.61:0/711118647 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000f670 con 0x7fdce00ce750 2023-12-24T20:02:46.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.077+0000 7fdce7e69700 1 -- 172.21.15.61:0/711118647 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce00b15c0 con 0x7fdce00ce750 2023-12-24T20:02:46.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.077+0000 7fdcd5ffb700 1 -- 172.21.15.61:0/711118647 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000fa30 con 0x7fdce00ce750 2023-12-24T20:02:46.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.077+0000 7fdce7e69700 1 -- 172.21.15.61:0/711118647 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce0143f60 con 0x7fdce00ce750 2023-12-24T20:02:46.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.078+0000 7fdce7e69700 1 -- 172.21.15.61:0/711118647 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce00b1dc0 con 0x7fdce00ce750 2023-12-24T20:02:46.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.078+0000 7fdcd5ffb700 1 -- 172.21.15.61:0/711118647 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdcd001a400 con 0x7fdce00ce750 2023-12-24T20:02:46.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.079+0000 7fdcd5ffb700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcc4066f30 0x7fdcc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:46.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.079+0000 7fdcd5ffb700 1 -- 172.21.15.61:0/711118647 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fdcd0084000 con 0x7fdce00ce750 2023-12-24T20:02:46.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.079+0000 7fdce5c05700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcc4066f30 0x7fdcc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:46.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.079+0000 7fdce5c05700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcc4066f30 0x7fdcc40693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdce00b48a0 tx=0x7fdcdc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:46.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.083+0000 7fdcd5ffb700 1 -- 172.21.15.61:0/711118647 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdce00b1dc0 con 0x7fdce00ce750 2023-12-24T20:02:46.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.279+0000 7fdce7e69700 1 -- 172.21.15.61:0/711118647 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdce00aecb0 con 0x7fdce00ce750 2023-12-24T20:02:46.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.890+0000 7fdcd5ffb700 1 -- 172.21.15.61:0/711118647 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdcd00512a0 con 0x7fdce00ce750 2023-12-24T20:02:46.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 -- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcc4066f30 msgr2=0x7fdcc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:46.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcc4066f30 0x7fdcc40693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdce00b48a0 tx=0x7fdcdc017000 comp rx=0 tx=0).stop 2023-12-24T20:02:46.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 -- 172.21.15.61:0/711118647 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 msgr2=0x7fdce0143a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:46.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 0x7fdce0143a20 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000b810 tx=0x7fdcd00091d0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 -- 172.21.15.61:0/711118647 shutdown_connections 2023-12-24T20:02:46.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdce015b590 0x7fdce00c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdcc4066f30 0x7fdcc40693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdce00c9500 0x7fdce014fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 --2- 172.21.15.61:0/711118647 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdce00ce750 0x7fdce0143a20 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:46.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 -- 172.21.15.61:0/711118647 >> 172.21.15.61:0/711118647 conn(0x7fdce0069760 msgr2=0x7fdce0159360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:46.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.893+0000 7fdce7e69700 1 -- 172.21.15.61:0/711118647 shutdown_connections 2023-12-24T20:02:46.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:46.894+0000 7fdce7e69700 1 -- 172.21.15.61:0/711118647 wait complete. 2023-12-24T20:02:46.895 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:02:46.908 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:02:47.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.039+0000 7f521e259700 1 Processor -- start 2023-12-24T20:02:47.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.039+0000 7f521e259700 1 -- start start 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f521e259700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5218159e80 0x7f52180cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f521e259700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52180cd8d0 0x7f52180cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f521e259700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52180cdd50 con 0x7f5218159ab0 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f521e259700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52180cec30 con 0x7f52180cd8d0 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f521e259700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52180afcc0 con 0x7f5218159e80 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52177fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f5218159ab0 0x7f52180af5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59900/0 (socket says 172.21.15.61:59900) 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52177fe700 1 -- 172.21.15.61:0/175690822 learned_addr learned my addr 172.21.15.61:0/175690822 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f5217fff700 1 --2- 172.21.15.61:0/175690822 >> v2:172.21.15.133:3300/0 conn(0x7f52180cd8d0 0x7f52180cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733203927 0 0) 0x7f5208001110 con 0x7f5218159ab0 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f5216ffd700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5218159e80 0x7f52180cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5200003570 con 0x7f5218159ab0 2023-12-24T20:02:47.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000246607 0 0) 0x7f5200003570 con 0x7f5218159ab0 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5218159e80 msgr2=0x7f52180cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5218159e80 0x7f52180cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 >> v2:172.21.15.133:3300/0 conn(0x7f52180cd8d0 msgr2=0x7f52180cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 --2- 172.21.15.61:0/175690822 >> v2:172.21.15.133:3300/0 conn(0x7f52180cd8d0 0x7f52180cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52180aff90 con 0x7f5218159ab0 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f5208001600 con 0x7f5218159ab0 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 >> v1:172.21.15.61:6789/0 conn(0x7f5218159ab0 legacy=0x7f52180af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 0x7f5200003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5200004810 0x7f5200004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5218159e80 0x7f52000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52180cec30 con 0x7f5200003a60 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52180afcc0 con 0x7f5200004810 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520000ba60 con 0x7f5218159e80 2023-12-24T20:02:47.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.040+0000 7f52177fe700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 0x7f5200003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f5216ffd700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5200004810 0x7f5200004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f5217fff700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5218159e80 0x7f52000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f52177fe700 1 -- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5218159e80 msgr2=0x7f52000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f52177fe700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5218159e80 0x7f52000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f52177fe700 1 -- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5200004810 msgr2=0x7f5200004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f52177fe700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5200004810 0x7f5200004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f52177fe700 1 -- 172.21.15.61:0/175690822 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200003570 con 0x7f5200003a60 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f52177fe700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 0x7f5200003e70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f520800c620 tx=0x7f5208007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469c3c7c5c1e3ede server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520800cde0 con 0x7f5200003a60 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5208005920 con 0x7f5200003a60 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.041+0000 7f52167fc700 1 -- 172.21.15.61:0/175690822 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208005ce0 con 0x7f5200003a60 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.042+0000 7f521e259700 1 -- 172.21.15.61:0/175690822 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 msgr2=0x7f5200003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.042+0000 7f521e259700 1 --2- 172.21.15.61:0/175690822 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 0x7f5200003e70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f520800c620 tx=0x7f5208007a80 comp rx=0 tx=0).stop 2023-12-24T20:02:47.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.042+0000 7f5217fff700 1 -- 172.21.15.61:0/175690822 reap_dead start 2023-12-24T20:02:47.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.042+0000 7f521e259700 1 -- 172.21.15.61:0/175690822 shutdown_connections 2023-12-24T20:02:47.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.042+0000 7f521e259700 1 -- 172.21.15.61:0/175690822 >> 172.21.15.61:0/175690822 conn(0x7f521806e600 msgr2=0x7f5218067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:47.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.042+0000 7f521e259700 1 -- 172.21.15.61:0/175690822 shutdown_connections 2023-12-24T20:02:47.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.042+0000 7f521e259700 1 -- 172.21.15.61:0/175690822 wait complete. 2023-12-24T20:02:47.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.043+0000 7f521e259700 1 Processor -- start 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.043+0000 7f521e259700 1 -- start start 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f521e259700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 0x7f521816b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f521e259700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52180ca3f0 0x7f52181523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f521e259700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f521816a460 0x7f52180d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f521e259700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52181569b0 con 0x7f5200003a60 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f521e259700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521816ad90 con 0x7f521816a460 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f521e259700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521816b070 con 0x7f52180ca3f0 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f52177fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 0x7f521816b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f52177fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 0x7f521816b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46392/0 (socket says 172.21.15.61:46392) 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f52177fe700 1 -- 172.21.15.61:0/780765644 learned_addr learned my addr 172.21.15.61:0/780765644 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f5217fff700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f521816a460 0x7f52180d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:47.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f5216ffd700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52180ca3f0 0x7f52181523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:47.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f52177fe700 1 -- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52180ca3f0 msgr2=0x7f52181523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:47.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f52177fe700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52180ca3f0 0x7f52181523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f52177fe700 1 -- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f521816a460 msgr2=0x7f52180d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f52177fe700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f521816a460 0x7f52180d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f52177fe700 1 -- 172.21.15.61:0/780765644 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218156640 con 0x7f5200003a60 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f52177fe700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 0x7f521816b350 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5200004700 tx=0x7f5208015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.044+0000 7f51ff7fe700 1 -- 172.21.15.61:0/780765644 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208001740 con 0x7f5200003a60 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.045+0000 7f51ff7fe700 1 -- 172.21.15.61:0/780765644 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52080018e0 con 0x7f5200003a60 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.045+0000 7f521e259700 1 -- 172.21.15.61:0/780765644 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52181528e0 con 0x7f5200003a60 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.045+0000 7f51ff7fe700 1 -- 172.21.15.61:0/780765644 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208007530 con 0x7f5200003a60 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.045+0000 7f521e259700 1 -- 172.21.15.61:0/780765644 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521816aa60 con 0x7f5200003a60 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.046+0000 7f521e259700 1 -- 172.21.15.61:0/780765644 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521804c3c0 con 0x7f5200003a60 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.046+0000 7f51ff7fe700 1 -- 172.21.15.61:0/780765644 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5208019070 con 0x7f5200003a60 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.046+0000 7f51ff7fe700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066fb0 0x7f5204069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.047+0000 7f51ff7fe700 1 -- 172.21.15.61:0/780765644 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f5208084cc0 con 0x7f5200003a60 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.047+0000 7f5216ffd700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066fb0 0x7f5204069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:47.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.047+0000 7f5216ffd700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066fb0 0x7f5204069460 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f521816b890 tx=0x7f520c0091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:47.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.051+0000 7f51ff7fe700 1 -- 172.21.15.61:0/780765644 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52080520a0 con 0x7f5200003a60 2023-12-24T20:02:47.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.246+0000 7f521e259700 1 -- 172.21.15.61:0/780765644 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52180cdd50 con 0x7f5200003a60 2023-12-24T20:02:47.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.897+0000 7f51ff7fe700 1 -- 172.21.15.61:0/780765644 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v128) v1 ==== 169+0+0 (secure 0 0 0) 0x7f52180cdd50 con 0x7f5200003a60 2023-12-24T20:02:47.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.900+0000 7f521e259700 1 -- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066fb0 msgr2=0x7f5204069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:47.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.900+0000 7f521e259700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066fb0 0x7f5204069460 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f521816b890 tx=0x7f520c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.900+0000 7f521e259700 1 -- 172.21.15.61:0/780765644 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 msgr2=0x7f521816b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:47.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.900+0000 7f521e259700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 0x7f521816b350 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5200004700 tx=0x7f5208015000 comp rx=0 tx=0).stop 2023-12-24T20:02:47.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.900+0000 7f521e259700 1 -- 172.21.15.61:0/780765644 shutdown_connections 2023-12-24T20:02:47.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.900+0000 7f521e259700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5204066fb0 0x7f5204069460 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.901+0000 7f521e259700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f521816a460 0x7f52180d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.901+0000 7f521e259700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5200003a60 0x7f521816b350 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.901+0000 7f521e259700 1 --2- 172.21.15.61:0/780765644 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52180ca3f0 0x7f52181523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:47.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.901+0000 7f521e259700 1 -- 172.21.15.61:0/780765644 >> 172.21.15.61:0/780765644 conn(0x7f521806e600 msgr2=0x7f52180c57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:47.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.901+0000 7f521e259700 1 -- 172.21.15.61:0/780765644 shutdown_connections 2023-12-24T20:02:47.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:47.901+0000 7f521e259700 1 -- 172.21.15.61:0/780765644 wait complete. 2023-12-24T20:02:47.902 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T20:02:47.915 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:02:48.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.042+0000 7f38a61a6700 1 Processor -- start 2023-12-24T20:02:48.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.042+0000 7f38a61a6700 1 -- start start 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f38a61a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38a00af330 0x7f38a006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f38a61a6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f38a006b150 0x7f38a00c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f38a61a6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a00caf30 con 0x7f38a01578d0 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f38a61a6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a00af7d0 con 0x7f38a006b150 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f38a61a6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a006b570 con 0x7f38a00af330 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f38a006b150 0x7f38a00c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389f7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f38a01578d0 0x7f38a006f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59908/0 (socket says 172.21.15.61:59908) 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389f7fe700 1 -- 172.21.15.61:0/2754767387 learned_addr learned my addr 172.21.15.61:0/2754767387 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389ffff700 1 -- 172.21.15.61:0/2754767387 >> v2:172.21.15.133:3300/0 conn(0x7f38a00af330 msgr2=0x7f38a006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389effd700 1 --2- 172.21.15.61:0/2754767387 >> v2:172.21.15.133:3300/0 conn(0x7f38a00af330 0x7f38a006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389e7fc700 1 -- 172.21.15.61:0/2754767387 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651370218 0 0) 0x7f38a00caf30 con 0x7f38a01578d0 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389ffff700 1 --2- 172.21.15.61:0/2754767387 >> v2:172.21.15.133:3300/0 conn(0x7f38a00af330 0x7f38a006ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389ffff700 1 -- 172.21.15.61:0/2754767387 >> v1:172.21.15.61:6789/0 conn(0x7f38a01578d0 legacy=0x7f38a006f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389ffff700 1 -- 172.21.15.61:0/2754767387 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00af9f0 con 0x7f38a006b150 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389effd700 1 --2- 172.21.15.61:0/2754767387 >> v2:172.21.15.133:3300/0 conn(0x7f38a00af330 0x7f38a006ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.043+0000 7f389ffff700 1 --2- 172.21.15.61:0/2754767387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 0x7f38a00c8da0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f38a00c21e0 tx=0x7f3898009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce48e47aee0060a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f389e7fc700 1 -- 172.21.15.61:0/2754767387 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389800e070 con 0x7f38a006b150 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f389e7fc700 1 -- 172.21.15.61:0/2754767387 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389800bc30 con 0x7f38a006b150 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f389e7fc700 1 -- 172.21.15.61:0/2754767387 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898012430 con 0x7f38a006b150 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f38a61a6700 1 -- 172.21.15.61:0/2754767387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 msgr2=0x7f38a00c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f38a61a6700 1 --2- 172.21.15.61:0/2754767387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 0x7f38a00c8da0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f38a00c21e0 tx=0x7f3898009780 comp rx=0 tx=0).stop 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f38a61a6700 1 -- 172.21.15.61:0/2754767387 shutdown_connections 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f38a61a6700 1 --2- 172.21.15.61:0/2754767387 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 0x7f38a00c8da0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f38a61a6700 1 --2- 172.21.15.61:0/2754767387 >> v2:172.21.15.133:3300/0 conn(0x7f38a00af330 0x7f38a006ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f38a61a6700 1 -- 172.21.15.61:0/2754767387 >> 172.21.15.61:0/2754767387 conn(0x7f38a00ce800 msgr2=0x7f38a00cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f38a61a6700 1 -- 172.21.15.61:0/2754767387 shutdown_connections 2023-12-24T20:02:48.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.044+0000 7f38a61a6700 1 -- 172.21.15.61:0/2754767387 wait complete. 2023-12-24T20:02:48.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.046+0000 7f38a61a6700 1 Processor -- start 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.046+0000 7f38a61a6700 1 -- start start 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f38a61a6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 0x7f38a015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f38a61a6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a00af330 0x7f38a0167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f38a61a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01578d0 0x7f38a0167ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f38a61a6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a0156f10 con 0x7f38a006b150 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f38a61a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a015c460 con 0x7f38a01578d0 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f38a61a6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a0156960 con 0x7f38a00af330 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 0x7f38a015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 0x7f38a015ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46410/0 (socket says 172.21.15.61:46410) 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389f7fe700 1 -- 172.21.15.61:0/3778902978 learned_addr learned my addr 172.21.15.61:0/3778902978 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389effd700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a00af330 0x7f38a0167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389f7fe700 1 -- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a00af330 msgr2=0x7f38a0167ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389f7fe700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a00af330 0x7f38a0167ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389ffff700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01578d0 0x7f38a0167ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389f7fe700 1 -- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01578d0 msgr2=0x7f38a0167ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389f7fe700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01578d0 0x7f38a0167ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389f7fe700 1 -- 172.21.15.61:0/3778902978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898009a20 con 0x7f38a006b150 2023-12-24T20:02:48.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.047+0000 7f389f7fe700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 0x7f38a015ddf0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f389000c5b0 tx=0x7f3890001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:48.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.048+0000 7f38977fe700 1 -- 172.21.15.61:0/3778902978 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890005b30 con 0x7f38a006b150 2023-12-24T20:02:48.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.048+0000 7f38977fe700 1 -- 172.21.15.61:0/3778902978 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3890005c90 con 0x7f38a006b150 2023-12-24T20:02:48.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.048+0000 7f38977fe700 1 -- 172.21.15.61:0/3778902978 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890007300 con 0x7f38a006b150 2023-12-24T20:02:48.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.048+0000 7f38a61a6700 1 -- 172.21.15.61:0/3778902978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a015b850 con 0x7f38a006b150 2023-12-24T20:02:48.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.048+0000 7f38a61a6700 1 -- 172.21.15.61:0/3778902978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a015be10 con 0x7f38a006b150 2023-12-24T20:02:48.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.049+0000 7f38a61a6700 1 -- 172.21.15.61:0/3778902978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a015c740 con 0x7f38a006b150 2023-12-24T20:02:48.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.049+0000 7f38977fe700 1 -- 172.21.15.61:0/3778902978 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f38900076b0 con 0x7f38a006b150 2023-12-24T20:02:48.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.049+0000 7f38977fe700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3880066f30 0x7f38800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.049+0000 7f38977fe700 1 -- 172.21.15.61:0/3778902978 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f38900836d0 con 0x7f38a006b150 2023-12-24T20:02:48.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.050+0000 7f389effd700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3880066f30 0x7f38800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.050+0000 7f389effd700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3880066f30 0x7f38800693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f38a00b48e0 tx=0x7f3888008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:48.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.054+0000 7f38977fe700 1 -- 172.21.15.61:0/3778902978 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3890050c40 con 0x7f38a006b150 2023-12-24T20:02:48.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.250+0000 7f38a61a6700 1 -- 172.21.15.61:0/3778902978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f38a004c3c0 con 0x7f38a006b150 2023-12-24T20:02:48.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.254+0000 7f38977fe700 1 -- 172.21.15.61:0/3778902978 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3890054260 con 0x7f38a006b150 2023-12-24T20:02:48.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 -- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3880066f30 msgr2=0x7f38800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3880066f30 0x7f38800693e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f38a00b48e0 tx=0x7f3888008040 comp rx=0 tx=0).stop 2023-12-24T20:02:48.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 -- 172.21.15.61:0/3778902978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 msgr2=0x7f38a015ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 0x7f38a015ddf0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f389000c5b0 tx=0x7f3890001070 comp rx=0 tx=0).stop 2023-12-24T20:02:48.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 -- 172.21.15.61:0/3778902978 shutdown_connections 2023-12-24T20:02:48.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3880066f30 0x7f38800693e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01578d0 0x7f38a0167ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38a006b150 0x7f38a015ddf0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 --2- 172.21.15.61:0/3778902978 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f38a00af330 0x7f38a0167ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 -- 172.21.15.61:0/3778902978 >> 172.21.15.61:0/3778902978 conn(0x7f38a00ce800 msgr2=0x7f38a00cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:48.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 -- 172.21.15.61:0/3778902978 shutdown_connections 2023-12-24T20:02:48.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.256+0000 7f38a61a6700 1 -- 172.21.15.61:0/3778902978 wait complete. 2023-12-24T20:02:48.268 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-12-24T20:02:48.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.389+0000 7f23e1b96700 1 Processor -- start 2023-12-24T20:02:48.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.389+0000 7f23e1b96700 1 -- start start 2023-12-24T20:02:48.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.390+0000 7f23e1b96700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 0x7f23dc159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.390+0000 7f23e1b96700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23dc0caa80 0x7f23dc0aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.390+0000 7f23e1b96700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23dc06a630 con 0x7f23dc159850 2023-12-24T20:02:48.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.390+0000 7f23e1b96700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23dc0cccf0 con 0x7f23dc0caa80 2023-12-24T20:02:48.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.390+0000 7f23e1b96700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc069d00 con 0x7f23dc06aac0 2023-12-24T20:02:48.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.390+0000 7f23db7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f23dc159850 0x7f23dc0cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59918/0 (socket says 172.21.15.61:59918) 2023-12-24T20:02:48.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.390+0000 7f23db7fe700 1 -- 172.21.15.61:0/3631551925 learned_addr learned my addr 172.21.15.61:0/3631551925 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.390+0000 7f23dbfff700 1 --2- 172.21.15.61:0/3631551925 >> v2:172.21.15.133:3300/0 conn(0x7f23dc0caa80 0x7f23dc0aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.390+0000 7f23daffd700 1 --2- 172.21.15.61:0/3631551925 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 0x7f23dc159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23da7fc700 1 -- 172.21.15.61:0/3631551925 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568770523 0 0) 0x7f23dc06a630 con 0x7f23dc159850 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23da7fc700 1 -- 172.21.15.61:0/3631551925 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c4003570 con 0x7f23dc159850 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23dbfff700 1 -- 172.21.15.61:0/3631551925 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 msgr2=0x7f23dc159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23dbfff700 1 --2- 172.21.15.61:0/3631551925 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 0x7f23dc159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23dbfff700 1 -- 172.21.15.61:0/3631551925 >> v1:172.21.15.61:6789/0 conn(0x7f23dc159850 legacy=0x7f23dc0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23dbfff700 1 -- 172.21.15.61:0/3631551925 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc069fe0 con 0x7f23dc0caa80 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23daffd700 1 --2- 172.21.15.61:0/3631551925 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 0x7f23dc159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23dbfff700 1 --2- 172.21.15.61:0/3631551925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23dc0caa80 0x7f23dc0aa880 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009e60 tx=0x7f23d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffe7d8931cdbedc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23da7fc700 1 -- 172.21.15.61:0/3631551925 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400e070 con 0x7f23dc0caa80 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23da7fc700 1 -- 172.21.15.61:0/3631551925 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d400bab0 con 0x7f23dc0caa80 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.391+0000 7f23da7fc700 1 -- 172.21.15.61:0/3631551925 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400be70 con 0x7f23dc0caa80 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.392+0000 7f23e1b96700 1 -- 172.21.15.61:0/3631551925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23dc0caa80 msgr2=0x7f23dc0aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.392+0000 7f23e1b96700 1 --2- 172.21.15.61:0/3631551925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23dc0caa80 0x7f23dc0aa880 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009e60 tx=0x7f23d4009780 comp rx=0 tx=0).stop 2023-12-24T20:02:48.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.392+0000 7f23e1b96700 1 -- 172.21.15.61:0/3631551925 shutdown_connections 2023-12-24T20:02:48.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.392+0000 7f23e1b96700 1 --2- 172.21.15.61:0/3631551925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23dc0caa80 0x7f23dc0aa880 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.392+0000 7f23e1b96700 1 --2- 172.21.15.61:0/3631551925 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 0x7f23dc159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.392+0000 7f23e1b96700 1 -- 172.21.15.61:0/3631551925 >> 172.21.15.61:0/3631551925 conn(0x7f23dc0cceb0 msgr2=0x7f23dc0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:48.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.392+0000 7f23e1b96700 1 -- 172.21.15.61:0/3631551925 shutdown_connections 2023-12-24T20:02:48.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.392+0000 7f23e1b96700 1 -- 172.21.15.61:0/3631551925 wait complete. 2023-12-24T20:02:48.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.393+0000 7f23e1b96700 1 Processor -- start 2023-12-24T20:02:48.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.393+0000 7f23e1b96700 1 -- start start 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.394+0000 7f23e1b96700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 0x7f23dc0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.394+0000 7f23e1b96700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23dc0caa80 0x7f23dc14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.394+0000 7f23e1b96700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23dc159850 0x7f23dc16a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.394+0000 7f23e1b96700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0b0e50 con 0x7f23dc159850 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.394+0000 7f23e1b96700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0b0240 con 0x7f23dc0caa80 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.394+0000 7f23e1b96700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc0b0520 con 0x7f23dc06aac0 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23dbfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23dc159850 0x7f23dc16a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23dbfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23dc159850 0x7f23dc16a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46412/0 (socket says 172.21.15.61:46412) 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23dbfff700 1 -- 172.21.15.61:0/98697493 learned_addr learned my addr 172.21.15.61:0/98697493 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23db7fe700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 0x7f23dc0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23daffd700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23dc0caa80 0x7f23dc14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23dbfff700 1 -- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 msgr2=0x7f23dc0b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23dbfff700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 0x7f23dc0b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23dbfff700 1 -- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23dc0caa80 msgr2=0x7f23dc14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23dbfff700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23dc0caa80 0x7f23dc14e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23dbfff700 1 -- 172.21.15.61:0/98697493 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0009420 con 0x7f23dc159850 2023-12-24T20:02:48.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23daffd700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23dc0caa80 0x7f23dc14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:48.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23dbfff700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23dc159850 0x7f23dc16a9b0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f23d4013000 tx=0x7f23d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:48.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23c37fe700 1 -- 172.21.15.61:0/98697493 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4012ea0 con 0x7f23dc159850 2023-12-24T20:02:48.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23c37fe700 1 -- 172.21.15.61:0/98697493 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d4027470 con 0x7f23dc159850 2023-12-24T20:02:48.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23e1b96700 1 -- 172.21.15.61:0/98697493 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d4009a20 con 0x7f23dc159850 2023-12-24T20:02:48.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23c37fe700 1 -- 172.21.15.61:0/98697493 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4027850 con 0x7f23dc159850 2023-12-24T20:02:48.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.395+0000 7f23e1b96700 1 -- 172.21.15.61:0/98697493 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc0b0ae0 con 0x7f23dc159850 2023-12-24T20:02:48.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.396+0000 7f23e1b96700 1 -- 172.21.15.61:0/98697493 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc0b1000 con 0x7f23dc159850 2023-12-24T20:02:48.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.397+0000 7f23c37fe700 1 -- 172.21.15.61:0/98697493 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f23d4024070 con 0x7f23dc159850 2023-12-24T20:02:48.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.397+0000 7f23c37fe700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f23c8066f60 0x7f23c8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:48.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.397+0000 7f23c37fe700 1 -- 172.21.15.61:0/98697493 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f23d4086bf0 con 0x7f23dc159850 2023-12-24T20:02:48.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.398+0000 7f23db7fe700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f23c8066f60 0x7f23c8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:48.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.398+0000 7f23db7fe700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f23c8066f60 0x7f23c8069410 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f23cc007fd0 tx=0x7f23cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:48.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.402+0000 7f23c37fe700 1 -- 172.21.15.61:0/98697493 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23dc0b1000 con 0x7f23dc159850 2023-12-24T20:02:48.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.684+0000 7f23e1b96700 1 -- 172.21.15.61:0/98697493 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f23dc04c3c0 con 0x7f23dc159850 2023-12-24T20:02:48.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.891+0000 7f23c37fe700 1 -- 172.21.15.61:0/98697493 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v302) v1 ==== 128+0+0 (secure 0 0 0) 0x7f23d4054210 con 0x7f23dc159850 2023-12-24T20:02:48.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 -- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f23c8066f60 msgr2=0x7f23c8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f23c8066f60 0x7f23c8069410 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f23cc007fd0 tx=0x7f23cc009040 comp rx=0 tx=0).stop 2023-12-24T20:02:48.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 -- 172.21.15.61:0/98697493 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23dc159850 msgr2=0x7f23dc16a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:48.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23dc159850 0x7f23dc16a9b0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f23d4013000 tx=0x7f23d4019000 comp rx=0 tx=0).stop 2023-12-24T20:02:48.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 -- 172.21.15.61:0/98697493 shutdown_connections 2023-12-24T20:02:48.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23dc06aac0 0x7f23dc0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f23c8066f60 0x7f23c8069410 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23dc159850 0x7f23dc16a9b0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 --2- 172.21.15.61:0/98697493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23dc0caa80 0x7f23dc14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:48.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 -- 172.21.15.61:0/98697493 >> 172.21.15.61:0/98697493 conn(0x7f23dc0cceb0 msgr2=0x7f23dc06de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:48.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 -- 172.21.15.61:0/98697493 shutdown_connections 2023-12-24T20:02:48.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:48.894+0000 7f23e1b96700 1 -- 172.21.15.61:0/98697493 wait complete. 2023-12-24T20:02:48.906 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-12-24T20:02:48.907 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-12-24T20:02:48.907 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-12-24T20:02:49.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.029+0000 7fa449652700 1 Processor -- start 2023-12-24T20:02:49.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.029+0000 7fa449652700 1 -- start start 2023-12-24T20:02:49.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa449652700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4440b5090 0x7fa4440cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:49.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa449652700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa44406e190 0x7fa444162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:49.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa449652700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4440b3bf0 con 0x7fa44406ddc0 2023-12-24T20:02:49.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa449652700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4440ce170 con 0x7fa44406e190 2023-12-24T20:02:49.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa449652700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440cfc90 con 0x7fa4440b5090 2023-12-24T20:02:49.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa442ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa44406ddc0 0x7fa4440cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59930/0 (socket says 172.21.15.61:59930) 2023-12-24T20:02:49.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa442ffd700 1 -- 172.21.15.61:0/129288604 learned_addr learned my addr 172.21.15.61:0/129288604 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:49.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa4437fe700 1 --2- 172.21.15.61:0/129288604 >> v2:172.21.15.61:3300/0 conn(0x7fa44406e190 0x7fa444162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:49.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa441ffb700 1 -- 172.21.15.61:0/129288604 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093705574 0 0) 0x7fa4440b3bf0 con 0x7fa44406ddc0 2023-12-24T20:02:49.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa4427fc700 1 --2- 172.21.15.61:0/129288604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4440b5090 0x7fa4440cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:49.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa441ffb700 1 -- 172.21.15.61:0/129288604 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa42c003570 con 0x7fa44406ddc0 2023-12-24T20:02:49.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa4437fe700 1 -- 172.21.15.61:0/129288604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4440b5090 msgr2=0x7fa4440cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:49.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa4437fe700 1 --2- 172.21.15.61:0/129288604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4440b5090 0x7fa4440cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:49.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa4437fe700 1 -- 172.21.15.61:0/129288604 >> v1:172.21.15.61:6789/0 conn(0x7fa44406ddc0 legacy=0x7fa4440cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:49.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa4437fe700 1 -- 172.21.15.61:0/129288604 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440cff70 con 0x7fa44406e190 2023-12-24T20:02:49.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.030+0000 7fa4437fe700 1 --2- 172.21.15.61:0/129288604 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 0x7fa444162da0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009e60 tx=0x7fa43c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e1f835fd57ba96 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:49.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa441ffb700 1 -- 172.21.15.61:0/129288604 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00e070 con 0x7fa44406e190 2023-12-24T20:02:49.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa441ffb700 1 -- 172.21.15.61:0/129288604 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00bb60 con 0x7fa44406e190 2023-12-24T20:02:49.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa441ffb700 1 -- 172.21.15.61:0/129288604 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c012430 con 0x7fa44406e190 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa449652700 1 -- 172.21.15.61:0/129288604 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 msgr2=0x7fa444162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa449652700 1 --2- 172.21.15.61:0/129288604 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 0x7fa444162da0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009e60 tx=0x7fa43c009780 comp rx=0 tx=0).stop 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa449652700 1 -- 172.21.15.61:0/129288604 shutdown_connections 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa449652700 1 --2- 172.21.15.61:0/129288604 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 0x7fa444162da0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa449652700 1 --2- 172.21.15.61:0/129288604 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa4440b5090 0x7fa4440cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa449652700 1 -- 172.21.15.61:0/129288604 >> 172.21.15.61:0/129288604 conn(0x7fa444067fd0 msgr2=0x7fa4440b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa449652700 1 -- 172.21.15.61:0/129288604 shutdown_connections 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.031+0000 7fa449652700 1 -- 172.21.15.61:0/129288604 wait complete. 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa449652700 1 Processor -- start 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa449652700 1 -- start start 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa449652700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44406ddc0 0x7fa4440caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa449652700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 0x7fa4440d1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa449652700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5090 0x7fa4440af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:49.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa449652700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440cbe20 con 0x7fa44406e190 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa449652700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440caf40 con 0x7fa4440b5090 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa449652700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440cb210 con 0x7fa44406ddc0 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa4427fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 0x7fa4440d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa4427fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 0x7fa4440d1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46426/0 (socket says 172.21.15.61:46426) 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.033+0000 7fa4427fc700 1 -- 172.21.15.61:0/1606176325 learned_addr learned my addr 172.21.15.61:0/1606176325 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa442ffd700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44406ddc0 0x7fa4440caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa4437fe700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5090 0x7fa4440af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa4427fc700 1 -- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44406ddc0 msgr2=0x7fa4440caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa4427fc700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44406ddc0 0x7fa4440caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa4427fc700 1 -- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5090 msgr2=0x7fa4440af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa4427fc700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5090 0x7fa4440af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa4427fc700 1 -- 172.21.15.61:0/1606176325 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009a20 con 0x7fa44406e190 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa4427fc700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 0x7fa4440d1140 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa43800d860 tx=0x7fa438008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa42affd700 1 -- 172.21.15.61:0/1606176325 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438009610 con 0x7fa44406e190 2023-12-24T20:02:49.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa42affd700 1 -- 172.21.15.61:0/1606176325 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa438009770 con 0x7fa44406e190 2023-12-24T20:02:49.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa449652700 1 -- 172.21.15.61:0/1606176325 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4440cb4f0 con 0x7fa44406e190 2023-12-24T20:02:49.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa42affd700 1 -- 172.21.15.61:0/1606176325 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438009b30 con 0x7fa44406e190 2023-12-24T20:02:49.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.034+0000 7fa449652700 1 -- 172.21.15.61:0/1606176325 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4440cbab0 con 0x7fa44406e190 2023-12-24T20:02:49.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.035+0000 7fa449652700 1 -- 172.21.15.61:0/1606176325 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4440cbf90 con 0x7fa44406e190 2023-12-24T20:02:49.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.036+0000 7fa42affd700 1 -- 172.21.15.61:0/1606176325 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa43801e460 con 0x7fa44406e190 2023-12-24T20:02:49.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.036+0000 7fa42affd700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa430066f30 0x7fa4300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:49.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.036+0000 7fa42affd700 1 -- 172.21.15.61:0/1606176325 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa4380848a0 con 0x7fa44406e190 2023-12-24T20:02:49.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.036+0000 7fa442ffd700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa430066f30 0x7fa4300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:49.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.037+0000 7fa442ffd700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa430066f30 0x7fa4300693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa4340058d0 tx=0x7fa434009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:49.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.040+0000 7fa42affd700 1 -- 172.21.15.61:0/1606176325 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa438051e10 con 0x7fa44406e190 2023-12-24T20:02:49.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.314+0000 7fa449652700 1 -- 172.21.15.61:0/1606176325 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7fa44404c3c0 con 0x7fa44406e190 2023-12-24T20:02:49.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.893+0000 7fa42affd700 1 -- 172.21.15.61:0/1606176325 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v303) v1 ==== 143+0+0 (secure 0 0 0) 0x7fa438055430 con 0x7fa44406e190 2023-12-24T20:02:49.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 -- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa430066f30 msgr2=0x7fa4300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa430066f30 0x7fa4300693e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa4340058d0 tx=0x7fa434009040 comp rx=0 tx=0).stop 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 -- 172.21.15.61:0/1606176325 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 msgr2=0x7fa4440d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 0x7fa4440d1140 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa43800d860 tx=0x7fa438008040 comp rx=0 tx=0).stop 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 -- 172.21.15.61:0/1606176325 shutdown_connections 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa44406ddc0 0x7fa4440caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa430066f30 0x7fa4300693e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4440b5090 0x7fa4440af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 --2- 172.21.15.61:0/1606176325 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa44406e190 0x7fa4440d1140 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 -- 172.21.15.61:0/1606176325 >> 172.21.15.61:0/1606176325 conn(0x7fa444067fd0 msgr2=0x7fa4440b5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 -- 172.21.15.61:0/1606176325 shutdown_connections 2023-12-24T20:02:49.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:49.895+0000 7fa449652700 1 -- 172.21.15.61:0/1606176325 wait complete. 2023-12-24T20:02:49.909 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T20:02:50.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.036+0000 7fc575879700 1 Processor -- start 2023-12-24T20:02:50.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.036+0000 7fc575879700 1 -- start start 2023-12-24T20:02:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.037+0000 7fc575879700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc5700afd60 0x7fc5700cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.037+0000 7fc575879700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5700b0130 0x7fc570070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.037+0000 7fc575879700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57015e470 con 0x7fc5700688b0 2023-12-24T20:02:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.037+0000 7fc575879700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57006ad90 con 0x7fc5700afd60 2023-12-24T20:02:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.037+0000 7fc575879700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc570068db0 con 0x7fc5700b0130 2023-12-24T20:02:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.037+0000 7fc56effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc5700afd60 0x7fc5700cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.037+0000 7fc56effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc5700afd60 0x7fc5700cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46428/0 (socket says 172.21.15.61:46428) 2023-12-24T20:02:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.037+0000 7fc56effd700 1 -- 172.21.15.61:0/791098881 learned_addr learned my addr 172.21.15.61:0/791098881 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.038+0000 7fc56e7fc700 1 --2- 172.21.15.61:0/791098881 >> v2:172.21.15.133:3300/0 conn(0x7fc5700b0130 0x7fc570070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.038+0000 7fc56effd700 1 -- 172.21.15.61:0/791098881 >> v2:172.21.15.133:3300/0 conn(0x7fc5700b0130 msgr2=0x7fc570070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.038+0000 7fc56effd700 1 --2- 172.21.15.61:0/791098881 >> v2:172.21.15.133:3300/0 conn(0x7fc5700b0130 0x7fc570070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.038+0000 7fc56effd700 1 -- 172.21.15.61:0/791098881 >> v1:172.21.15.133:6789/0 conn(0x7fc5700688b0 legacy=0x7fc570067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.038+0000 7fc56effd700 1 -- 172.21.15.61:0/791098881 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57015db40 con 0x7fc5700afd60 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.038+0000 7fc56effd700 1 --2- 172.21.15.61:0/791098881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700afd60 0x7fc5700cacc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fc57006d380 tx=0x7fc564009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792235880549d5cf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.038+0000 7fc56dffb700 1 -- 172.21.15.61:0/791098881 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400b820 con 0x7fc5700afd60 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.038+0000 7fc56dffb700 1 -- 172.21.15.61:0/791098881 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56400b980 con 0x7fc5700afd60 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.038+0000 7fc56dffb700 1 -- 172.21.15.61:0/791098881 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400bd40 con 0x7fc5700afd60 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.039+0000 7fc575879700 1 -- 172.21.15.61:0/791098881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700afd60 msgr2=0x7fc5700cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.039+0000 7fc575879700 1 --2- 172.21.15.61:0/791098881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700afd60 0x7fc5700cacc0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fc57006d380 tx=0x7fc564009250 comp rx=0 tx=0).stop 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.039+0000 7fc575879700 1 -- 172.21.15.61:0/791098881 shutdown_connections 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.039+0000 7fc575879700 1 --2- 172.21.15.61:0/791098881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700afd60 0x7fc5700cacc0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.039+0000 7fc575879700 1 --2- 172.21.15.61:0/791098881 >> v2:172.21.15.133:3300/0 conn(0x7fc5700b0130 0x7fc570070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.039+0000 7fc575879700 1 -- 172.21.15.61:0/791098881 >> 172.21.15.61:0/791098881 conn(0x7fc5700ce400 msgr2=0x7fc5700ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.039+0000 7fc575879700 1 -- 172.21.15.61:0/791098881 shutdown_connections 2023-12-24T20:02:50.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.039+0000 7fc575879700 1 -- 172.21.15.61:0/791098881 wait complete. 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.040+0000 7fc575879700 1 Processor -- start 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.040+0000 7fc575879700 1 -- start start 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc575879700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700688b0 0x7fc57016e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc575879700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5700afd60 0x7fc5701516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc575879700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5700c2ab0 0x7fc5700b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc575879700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57016a470 con 0x7fc5700688b0 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc575879700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700c1b10 con 0x7fc5700afd60 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc575879700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57016ea40 con 0x7fc5700c2ab0 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700688b0 0x7fc57016e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700688b0 0x7fc57016e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46430/0 (socket says 172.21.15.61:46430) 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56effd700 1 -- 172.21.15.61:0/1755484502 learned_addr learned my addr 172.21.15.61:0/1755484502 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:50.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56e7fc700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5700afd60 0x7fc5701516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56f7fe700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5700c2ab0 0x7fc5700b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56effd700 1 -- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5700c2ab0 msgr2=0x7fc5700b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56effd700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5700c2ab0 0x7fc5700b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56effd700 1 -- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5700afd60 msgr2=0x7fc5701516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56effd700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5700afd60 0x7fc5701516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56effd700 1 -- 172.21.15.61:0/1755484502 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640094f0 con 0x7fc5700688b0 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56e7fc700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5700afd60 0x7fc5701516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.041+0000 7fc56effd700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700688b0 0x7fc57016e500 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fc57006cbb0 tx=0x7fc564016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.042+0000 7fc556ffd700 1 -- 172.21.15.61:0/1755484502 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564006ab0 con 0x7fc5700688b0 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.042+0000 7fc556ffd700 1 -- 172.21.15.61:0/1755484502 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc564020070 con 0x7fc5700688b0 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.042+0000 7fc575879700 1 -- 172.21.15.61:0/1755484502 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc570152200 con 0x7fc5700688b0 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.042+0000 7fc556ffd700 1 -- 172.21.15.61:0/1755484502 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56401b450 con 0x7fc5700688b0 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.042+0000 7fc575879700 1 -- 172.21.15.61:0/1755484502 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5700c2f40 con 0x7fc5700688b0 2023-12-24T20:02:50.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.042+0000 7fc575879700 1 -- 172.21.15.61:0/1755484502 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57004c3c0 con 0x7fc5700688b0 2023-12-24T20:02:50.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.043+0000 7fc556ffd700 1 -- 172.21.15.61:0/1755484502 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc564022030 con 0x7fc5700688b0 2023-12-24T20:02:50.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.044+0000 7fc556ffd700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc55c066f30 0x7fc55c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.044+0000 7fc556ffd700 1 -- 172.21.15.61:0/1755484502 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc564086510 con 0x7fc5700688b0 2023-12-24T20:02:50.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.044+0000 7fc56e7fc700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc55c066f30 0x7fc55c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.045+0000 7fc56e7fc700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc55c066f30 0x7fc55c0693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc57016daa0 tx=0x7fc560008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:50.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.047+0000 7fc556ffd700 1 -- 172.21.15.61:0/1755484502 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc564053b00 con 0x7fc5700688b0 2023-12-24T20:02:50.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.241+0000 7fc575879700 1 -- 172.21.15.61:0/1755484502 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc57004c3c0 con 0x7fc5700688b0 2023-12-24T20:02:50.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.245+0000 7fc556ffd700 1 -- 172.21.15.61:0/1755484502 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc564057120 con 0x7fc5700688b0 2023-12-24T20:02:50.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 -- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc55c066f30 msgr2=0x7fc55c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc55c066f30 0x7fc55c0693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc57016daa0 tx=0x7fc560008040 comp rx=0 tx=0).stop 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 -- 172.21.15.61:0/1755484502 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700688b0 msgr2=0x7fc57016e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700688b0 0x7fc57016e500 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fc57006cbb0 tx=0x7fc564016000 comp rx=0 tx=0).stop 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 -- 172.21.15.61:0/1755484502 shutdown_connections 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5700c2ab0 0x7fc5700b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc55c066f30 0x7fc55c0693e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc5700688b0 0x7fc57016e500 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 --2- 172.21.15.61:0/1755484502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5700afd60 0x7fc5701516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 -- 172.21.15.61:0/1755484502 >> 172.21.15.61:0/1755484502 conn(0x7fc5700ce400 msgr2=0x7fc570159990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 -- 172.21.15.61:0/1755484502 shutdown_connections 2023-12-24T20:02:50.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.247+0000 7fc575879700 1 -- 172.21.15.61:0/1755484502 wait complete. 2023-12-24T20:02:50.259 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:02:50.260 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:02:50.304 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:02:50.361 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:02:50.361 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T20:02:50.362 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:50.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.483+0000 7f88fd789700 1 Processor -- start 2023-12-24T20:02:50.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.483+0000 7f88fd789700 1 -- start start 2023-12-24T20:02:50.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88fd789700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88f806cc00 0x7f88f80ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88fd789700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88f80aea30 0x7f88f80ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88fd789700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f815adb0 con 0x7f88f80b0d80 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88fd789700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f8154580 con 0x7f88f806cc00 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88fd789700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f815a1a0 con 0x7f88f80aea30 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f67fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f88f806cc00 0x7f88f80ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f6ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f88f80b0d80 0x7f88f806c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59946/0 (socket says 172.21.15.61:59946) 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f6ffd700 1 -- 172.21.15.61:0/3307923719 learned_addr learned my addr 172.21.15.61:0/3307923719 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f67fc700 1 -- 172.21.15.61:0/3307923719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88f80aea30 msgr2=0x7f88f80ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f67fc700 1 --2- 172.21.15.61:0/3307923719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88f80aea30 0x7f88f80ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f67fc700 1 -- 172.21.15.61:0/3307923719 >> v1:172.21.15.61:6789/0 conn(0x7f88f80b0d80 legacy=0x7f88f806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f67fc700 1 -- 172.21.15.61:0/3307923719 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f815a480 con 0x7f88f806cc00 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f67fc700 1 --2- 172.21.15.61:0/3307923719 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f806cc00 0x7f88f80ae4f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0098e0 tx=0x7f88ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e8e7670fbe4780 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f5ffb700 1 -- 172.21.15.61:0/3307923719 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec009e80 con 0x7f88f806cc00 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f5ffb700 1 -- 172.21.15.61:0/3307923719 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec00b860 con 0x7f88f806cc00 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.484+0000 7f88f5ffb700 1 -- 172.21.15.61:0/3307923719 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00bbe0 con 0x7f88f806cc00 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.485+0000 7f88fd789700 1 -- 172.21.15.61:0/3307923719 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f806cc00 msgr2=0x7f88f80ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.485+0000 7f88fd789700 1 --2- 172.21.15.61:0/3307923719 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f806cc00 0x7f88f80ae4f0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0098e0 tx=0x7f88ec0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.485+0000 7f88fd789700 1 -- 172.21.15.61:0/3307923719 shutdown_connections 2023-12-24T20:02:50.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.485+0000 7f88fd789700 1 --2- 172.21.15.61:0/3307923719 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88f80aea30 0x7f88f80ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.485+0000 7f88fd789700 1 --2- 172.21.15.61:0/3307923719 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f806cc00 0x7f88f80ae4f0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.485+0000 7f88fd789700 1 -- 172.21.15.61:0/3307923719 >> 172.21.15.61:0/3307923719 conn(0x7f88f80ce7c0 msgr2=0x7f88f80cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:50.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.485+0000 7f88fd789700 1 -- 172.21.15.61:0/3307923719 shutdown_connections 2023-12-24T20:02:50.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.485+0000 7f88fd789700 1 -- 172.21.15.61:0/3307923719 wait complete. 2023-12-24T20:02:50.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.486+0000 7f88fd789700 1 Processor -- start 2023-12-24T20:02:50.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.486+0000 7f88fd789700 1 -- start start 2023-12-24T20:02:50.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88fd789700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88f806cc00 0x7f88f80cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88fd789700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f80aea30 0x7f88f80ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88fd789700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88f80b0d80 0x7f88f816de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88fd789700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80ad340 con 0x7f88f80aea30 2023-12-24T20:02:50.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88fd789700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8153980 con 0x7f88f80b0d80 2023-12-24T20:02:50.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88fd789700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80cb520 con 0x7f88f806cc00 2023-12-24T20:02:50.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88f67fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f80aea30 0x7f88f80ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88f67fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f80aea30 0x7f88f80ab2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46458/0 (socket says 172.21.15.61:46458) 2023-12-24T20:02:50.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88f67fc700 1 -- 172.21.15.61:0/4252827041 learned_addr learned my addr 172.21.15.61:0/4252827041 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:50.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88f6ffd700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88f806cc00 0x7f88f80cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88f77fe700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88f80b0d80 0x7f88f816de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88f67fc700 1 -- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88f806cc00 msgr2=0x7f88f80cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88f67fc700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88f806cc00 0x7f88f80cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88f67fc700 1 -- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88f80b0d80 msgr2=0x7f88f816de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88f67fc700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88f80b0d80 0x7f88f816de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.487+0000 7f88f67fc700 1 -- 172.21.15.61:0/4252827041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec009420 con 0x7f88f80aea30 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.488+0000 7f88f67fc700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f80aea30 0x7f88f80ab2a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f88ec013000 tx=0x7f88ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.488+0000 7f88deffd700 1 -- 172.21.15.61:0/4252827041 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00bbe0 con 0x7f88f80aea30 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.488+0000 7f88deffd700 1 -- 172.21.15.61:0/4252827041 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec011420 con 0x7f88f80aea30 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.488+0000 7f88deffd700 1 -- 172.21.15.61:0/4252827041 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0117c0 con 0x7f88f80aea30 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.488+0000 7f88fd789700 1 -- 172.21.15.61:0/4252827041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f80c9c60 con 0x7f88f80aea30 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.488+0000 7f88fd789700 1 -- 172.21.15.61:0/4252827041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f80ca220 con 0x7f88f80aea30 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.489+0000 7f88fd789700 1 -- 172.21.15.61:0/4252827041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f804c3c0 con 0x7f88f80aea30 2023-12-24T20:02:50.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.489+0000 7f88deffd700 1 -- 172.21.15.61:0/4252827041 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f88ec011bb0 con 0x7f88f80aea30 2023-12-24T20:02:50.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.490+0000 7f88deffd700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88e4066f30 0x7f88e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.490+0000 7f88deffd700 1 -- 172.21.15.61:0/4252827041 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f88ec085cc0 con 0x7f88f80aea30 2023-12-24T20:02:50.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.490+0000 7f88f6ffd700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88e4066f30 0x7f88e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.490+0000 7f88f6ffd700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88e4066f30 0x7f88e40693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f88f806a040 tx=0x7f88e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:50.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.494+0000 7f88deffd700 1 -- 172.21.15.61:0/4252827041 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88ec08c080 con 0x7f88f80aea30 2023-12-24T20:02:50.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.735+0000 7f88fd789700 1 -- 172.21.15.61:0/4252827041 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88f815a760 con 0x7f88f80aea30 2023-12-24T20:02:50.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.735+0000 7f88deffd700 1 -- 172.21.15.61:0/4252827041 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f88ec015de0 con 0x7f88f80aea30 2023-12-24T20:02:50.736 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:50.736 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6157,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2890522920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2890522920},{"type":"v1","addr":"172.21.15.133:6836","nonce":2890522920}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6160,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/946349829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":946349829},{"type":"v1","addr":"172.21.15.133:6837","nonce":946349829}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3897383544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3897383544},{"type":"v1","addr":"172.21.15.61:6834","nonce":3897383544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6999,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/2847683678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":2847683678},{"type":"v1","addr":"172.21.15.61:6835","nonce":2847683678}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[]} 2023-12-24T20:02:50.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 -- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88e4066f30 msgr2=0x7f88e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88e4066f30 0x7f88e40693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f88f806a040 tx=0x7f88e8009040 comp rx=0 tx=0).stop 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 -- 172.21.15.61:0/4252827041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f80aea30 msgr2=0x7f88f80ab2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f80aea30 0x7f88f80ab2a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f88ec013000 tx=0x7f88ec017000 comp rx=0 tx=0).stop 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 -- 172.21.15.61:0/4252827041 shutdown_connections 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88f806cc00 0x7f88f80cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88e4066f30 0x7f88e40693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88f80b0d80 0x7f88f816de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 --2- 172.21.15.61:0/4252827041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88f80aea30 0x7f88f80ab2a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 -- 172.21.15.61:0/4252827041 >> 172.21.15.61:0/4252827041 conn(0x7f88f80ce7c0 msgr2=0x7f88f80cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 -- 172.21.15.61:0/4252827041 shutdown_connections 2023-12-24T20:02:50.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.737+0000 7f88fd789700 1 -- 172.21.15.61:0/4252827041 wait complete. 2023-12-24T20:02:50.739 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 62 2023-12-24T20:02:50.750 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T20:02:50.750 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T20:02:50.750 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:02:50.750 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:02:50.751 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T20:02:50.751 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T20:02:50.751 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:02:50.751 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:02:50.751 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T20:02:50.751 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T20:02:50.751 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:02:50.751 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:02:50.752 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T20:02:50.752 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T20:02:50.752 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:02:50.752 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:02:50.759 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:02:50.759 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T20:02:50.760 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:02:50.760 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T20:02:50.762 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:02:50.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T20:02:50.763 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:02:50.763 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T20:02:50.801 INFO:tasks.ceph.mds.a:Started 2023-12-24T20:02:50.802 DEBUG:teuthology.parallel:result is None 2023-12-24T20:02:50.802 INFO:tasks.ceph.mds.c:Started 2023-12-24T20:02:50.802 DEBUG:teuthology.parallel:result is None 2023-12-24T20:02:50.805 INFO:tasks.ceph.mds.d:Started 2023-12-24T20:02:50.805 DEBUG:teuthology.parallel:result is None 2023-12-24T20:02:50.805 INFO:tasks.ceph.mds.b:Started 2023-12-24T20:02:50.806 DEBUG:teuthology.parallel:result is None 2023-12-24T20:02:50.806 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T20:02:50.881 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T20:02:50.881 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T20:02:50.888 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T20:02:50.889 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T20:02:50.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.936+0000 7f862ceb5700 1 Processor -- start 2023-12-24T20:02:50.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.936+0000 7f862ceb5700 1 -- start start 2023-12-24T20:02:50.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f862ceb5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86280ce010 0x7f86280ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f862ceb5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f86280ce3e0 0x7f86281587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f862ceb5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8628158350 con 0x7f8628069f00 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f862ceb5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280ca740 con 0x7f86280ce3e0 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f862ceb5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280b1120 con 0x7f86280ce010 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f8625d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f86280ce3e0 0x7f86281587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f8626d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8628069f00 0x7f86280cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59956/0 (socket says 172.21.15.61:59956) 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f8626d9d700 1 -- 172.21.15.61:0/987276354 learned_addr learned my addr 172.21.15.61:0/987276354 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f8625d9b700 1 -- 172.21.15.61:0/987276354 >> v2:172.21.15.133:3300/0 conn(0x7f86280ce010 msgr2=0x7f86280ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f862659c700 1 --2- 172.21.15.61:0/987276354 >> v2:172.21.15.133:3300/0 conn(0x7f86280ce010 0x7f86280ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f8625d9b700 1 --2- 172.21.15.61:0/987276354 >> v2:172.21.15.133:3300/0 conn(0x7f86280ce010 0x7f86280ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f862559a700 1 -- 172.21.15.61:0/987276354 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805089341 0 0) 0x7f8628158350 con 0x7f8628069f00 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f8625d9b700 1 -- 172.21.15.61:0/987276354 >> v1:172.21.15.61:6789/0 conn(0x7f8628069f00 legacy=0x7f86280cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f8625d9b700 1 -- 172.21.15.61:0/987276354 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280ca990 con 0x7f86280ce3e0 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f8625d9b700 1 --2- 172.21.15.61:0/987276354 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce3e0 0x7f86281587e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f86280cb1e0 tx=0x7f861c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8098fbb9750abded server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f862559a700 1 -- 172.21.15.61:0/987276354 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00b6b0 con 0x7f86280ce3e0 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f862559a700 1 -- 172.21.15.61:0/987276354 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c00b810 con 0x7f86280ce3e0 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.937+0000 7f862559a700 1 -- 172.21.15.61:0/987276354 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00bbb0 con 0x7f86280ce3e0 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.938+0000 7f862ceb5700 1 -- 172.21.15.61:0/987276354 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce3e0 msgr2=0x7f86281587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.938+0000 7f862ceb5700 1 --2- 172.21.15.61:0/987276354 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce3e0 0x7f86281587e0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f86280cb1e0 tx=0x7f861c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.938+0000 7f862ceb5700 1 -- 172.21.15.61:0/987276354 shutdown_connections 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.938+0000 7f862ceb5700 1 --2- 172.21.15.61:0/987276354 >> v2:172.21.15.133:3300/0 conn(0x7f86280ce010 0x7f86280ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.938+0000 7f862ceb5700 1 --2- 172.21.15.61:0/987276354 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce3e0 0x7f86281587e0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.938+0000 7f862ceb5700 1 -- 172.21.15.61:0/987276354 >> 172.21.15.61:0/987276354 conn(0x7f862806b790 msgr2=0x7f8628069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:50.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.938+0000 7f862ceb5700 1 -- 172.21.15.61:0/987276354 shutdown_connections 2023-12-24T20:02:50.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.938+0000 7f862ceb5700 1 -- 172.21.15.61:0/987276354 wait complete. 2023-12-24T20:02:50.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.939+0000 7f862ceb5700 1 Processor -- start 2023-12-24T20:02:50.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.939+0000 7f862ceb5700 1 -- start start 2023-12-24T20:02:50.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f862ceb5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8628069f00 0x7f8628157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f862ceb5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce010 0x7f862815a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f862ceb5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86280ce3e0 0x7f86280ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f862ceb5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280b23f0 con 0x7f86280ce010 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f862ceb5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280ae610 con 0x7f8628069f00 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f862ceb5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280ae8b0 con 0x7f86280ce3e0 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f8625d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce010 0x7f862815a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f8625d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce010 0x7f862815a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46500/0 (socket says 172.21.15.61:46500) 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f8625d9b700 1 -- 172.21.15.61:0/2329240473 learned_addr learned my addr 172.21.15.61:0/2329240473 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f862659c700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8628069f00 0x7f8628157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f8626d9d700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86280ce3e0 0x7f86280ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f8625d9b700 1 -- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86280ce3e0 msgr2=0x7f86280ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f8625d9b700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86280ce3e0 0x7f86280ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f8625d9b700 1 -- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8628069f00 msgr2=0x7f8628157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f8625d9b700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8628069f00 0x7f8628157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f8625d9b700 1 -- 172.21.15.61:0/2329240473 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c009420 con 0x7f86280ce010 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f862659c700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8628069f00 0x7f8628157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:50.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.940+0000 7f8625d9b700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce010 0x7f862815a080 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f8628064b60 tx=0x7f861c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.941+0000 7f86167fc700 1 -- 172.21.15.61:0/2329240473 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c011420 con 0x7f86280ce010 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.941+0000 7f86167fc700 1 -- 172.21.15.61:0/2329240473 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c011580 con 0x7f86280ce010 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.941+0000 7f862ceb5700 1 -- 172.21.15.61:0/2329240473 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86280aeb90 con 0x7f86280ce010 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.941+0000 7f86167fc700 1 -- 172.21.15.61:0/2329240473 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c011920 con 0x7f86280ce010 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.941+0000 7f862ceb5700 1 -- 172.21.15.61:0/2329240473 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86280af150 con 0x7f86280ce010 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.942+0000 7f862ceb5700 1 -- 172.21.15.61:0/2329240473 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86280b2560 con 0x7f86280ce010 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.942+0000 7f86167fc700 1 -- 172.21.15.61:0/2329240473 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f861c011d10 con 0x7f86280ce010 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.942+0000 7f86167fc700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8608066f30 0x7f86080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.943+0000 7f86167fc700 1 -- 172.21.15.61:0/2329240473 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f861c085e70 con 0x7f86280ce010 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.943+0000 7f862659c700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8608066f30 0x7f86080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:50.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.943+0000 7f862659c700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8608066f30 0x7f86080693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8628158800 tx=0x7f8618008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:50.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:50.947+0000 7f86167fc700 1 -- 172.21.15.61:0/2329240473 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f861c0533c0 con 0x7f86280ce010 2023-12-24T20:02:51.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.158+0000 7f862ceb5700 1 -- 172.21.15.61:0/2329240473 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f862804c3c0 con 0x7f86280ce010 2023-12-24T20:02:51.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.253+0000 7f86167fc700 1 -- 172.21.15.61:0/2329240473 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v131) v1 ==== 97+0+0 (secure 0 0 0) 0x7f861c015020 con 0x7f86280ce010 2023-12-24T20:02:51.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.255+0000 7f862ceb5700 1 -- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8608066f30 msgr2=0x7f86080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.255+0000 7f862ceb5700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8608066f30 0x7f86080693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8628158800 tx=0x7f8618008040 comp rx=0 tx=0).stop 2023-12-24T20:02:51.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.255+0000 7f862ceb5700 1 -- 172.21.15.61:0/2329240473 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce010 msgr2=0x7f862815a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.255+0000 7f862ceb5700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce010 0x7f862815a080 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f8628064b60 tx=0x7f861c017000 comp rx=0 tx=0).stop 2023-12-24T20:02:51.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.256+0000 7f862ceb5700 1 -- 172.21.15.61:0/2329240473 shutdown_connections 2023-12-24T20:02:51.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.256+0000 7f862ceb5700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f86280ce3e0 0x7f86280ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.256+0000 7f862ceb5700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8608066f30 0x7f86080693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.256+0000 7f862ceb5700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8628069f00 0x7f8628157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.256+0000 7f862ceb5700 1 --2- 172.21.15.61:0/2329240473 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f86280ce010 0x7f862815a080 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.256+0000 7f862ceb5700 1 -- 172.21.15.61:0/2329240473 >> 172.21.15.61:0/2329240473 conn(0x7f862806b790 msgr2=0x7f86280c47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:51.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.256+0000 7f862ceb5700 1 -- 172.21.15.61:0/2329240473 shutdown_connections 2023-12-24T20:02:51.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.256+0000 7f862ceb5700 1 -- 172.21.15.61:0/2329240473 wait complete. 2023-12-24T20:02:51.257 INFO:teuthology.orchestra.run.smithi061.stderr: removed all blocklist entries 2023-12-24T20:02:51.268 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T20:02:51.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.390+0000 7f3dab182700 1 Processor -- start 2023-12-24T20:02:51.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.390+0000 7f3dab182700 1 -- start start 2023-12-24T20:02:51.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3dab182700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4068510 0x7f3da40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3dab182700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3da4159a60 0x7f3da4159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3dab182700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da40b2890 con 0x7f3da4068140 2023-12-24T20:02:51.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3dab182700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da40cf630 con 0x7f3da4159a60 2023-12-24T20:02:51.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3dab182700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40b2240 con 0x7f3da4068510 2023-12-24T20:02:51.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3da8f1e700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3da4068140 0x7f3da40b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59968/0 (socket says 172.21.15.61:59968) 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3da8f1e700 1 -- 172.21.15.61:0/2176274821 learned_addr learned my addr 172.21.15.61:0/2176274821 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3da3fff700 1 --2- 172.21.15.61:0/2176274821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4068510 0x7f3da40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3da971f700 1 --2- 172.21.15.61:0/2176274821 >> v2:172.21.15.133:3300/0 conn(0x7f3da4159a60 0x7f3da4159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3da37fe700 1 -- 172.21.15.61:0/2176274821 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288058072 0 0) 0x7f3da40b2890 con 0x7f3da4068140 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.391+0000 7f3da37fe700 1 -- 172.21.15.61:0/2176274821 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d94003570 con 0x7f3da4068140 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.392+0000 7f3da37fe700 1 -- 172.21.15.61:0/2176274821 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2947304013 0 0) 0x7f3d94003570 con 0x7f3da4068140 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.392+0000 7f3da971f700 1 -- 172.21.15.61:0/2176274821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4068510 msgr2=0x7f3da40cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.392+0000 7f3da971f700 1 --2- 172.21.15.61:0/2176274821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4068510 0x7f3da40cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.392+0000 7f3da971f700 1 -- 172.21.15.61:0/2176274821 >> v1:172.21.15.61:6789/0 conn(0x7f3da4068140 legacy=0x7f3da40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.392+0000 7f3da971f700 1 -- 172.21.15.61:0/2176274821 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da40b2520 con 0x7f3da4159a60 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.392+0000 7f3da3fff700 1 --2- 172.21.15.61:0/2176274821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4068510 0x7f3da40cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.392+0000 7f3da971f700 1 --2- 172.21.15.61:0/2176274821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4159a60 0x7f3da4159ee0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009e60 tx=0x7f3d9c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=def364c77ef0ad59 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.392+0000 7f3da37fe700 1 -- 172.21.15.61:0/2176274821 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00e070 con 0x7f3da4159a60 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.392+0000 7f3da37fe700 1 -- 172.21.15.61:0/2176274821 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c00b7a0 con 0x7f3da4159a60 2023-12-24T20:02:51.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.392+0000 7f3da37fe700 1 -- 172.21.15.61:0/2176274821 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980015f0 con 0x7f3da4159a60 2023-12-24T20:02:51.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.393+0000 7f3dab182700 1 -- 172.21.15.61:0/2176274821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4159a60 msgr2=0x7f3da4159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.393+0000 7f3dab182700 1 --2- 172.21.15.61:0/2176274821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4159a60 0x7f3da4159ee0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009e60 tx=0x7f3d9c009780 comp rx=0 tx=0).stop 2023-12-24T20:02:51.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.393+0000 7f3dab182700 1 -- 172.21.15.61:0/2176274821 shutdown_connections 2023-12-24T20:02:51.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.393+0000 7f3dab182700 1 --2- 172.21.15.61:0/2176274821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4159a60 0x7f3da4159ee0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.393+0000 7f3dab182700 1 --2- 172.21.15.61:0/2176274821 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4068510 0x7f3da40cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.393+0000 7f3dab182700 1 -- 172.21.15.61:0/2176274821 >> 172.21.15.61:0/2176274821 conn(0x7f3da4097a10 msgr2=0x7f3da40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:51.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.393+0000 7f3dab182700 1 -- 172.21.15.61:0/2176274821 shutdown_connections 2023-12-24T20:02:51.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.393+0000 7f3dab182700 1 -- 172.21.15.61:0/2176274821 wait complete. 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.394+0000 7f3dab182700 1 Processor -- start 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.394+0000 7f3dab182700 1 -- start start 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3dab182700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4068140 0x7f3da416b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3dab182700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3da4068510 0x7f3da415e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3dab182700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159a60 0x7f3da415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3dab182700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da416cc70 con 0x7f3da4068510 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3dab182700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da416c060 con 0x7f3da4068140 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3dab182700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da416c340 con 0x7f3da4159a60 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3da4068510 0x7f3da415e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3da4068510 0x7f3da415e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46504/0 (socket says 172.21.15.61:46504) 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da3fff700 1 -- 172.21.15.61:0/4236047714 learned_addr learned my addr 172.21.15.61:0/4236047714 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da8f1e700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4068140 0x7f3da416b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da971f700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159a60 0x7f3da415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da3fff700 1 -- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159a60 msgr2=0x7f3da415e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da3fff700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159a60 0x7f3da415e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da3fff700 1 -- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4068140 msgr2=0x7f3da416b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da3fff700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4068140 0x7f3da416b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da3fff700 1 -- 172.21.15.61:0/4236047714 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90009420 con 0x7f3da4068510 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.395+0000 7f3da3fff700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3da4068510 0x7f3da415e270 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000ec80 tx=0x7f3d900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.396+0000 7f3da0ff9700 1 -- 172.21.15.61:0/4236047714 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000c920 con 0x7f3da4068510 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.396+0000 7f3da0ff9700 1 -- 172.21.15.61:0/4236047714 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9000ca80 con 0x7f3da4068510 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.396+0000 7f3da0ff9700 1 -- 172.21.15.61:0/4236047714 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000ce00 con 0x7f3da4068510 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.396+0000 7f3dab182700 1 -- 172.21.15.61:0/4236047714 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9c009a20 con 0x7f3da4068510 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.396+0000 7f3dab182700 1 -- 172.21.15.61:0/4236047714 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da416c900 con 0x7f3da4068510 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.397+0000 7f3dab182700 1 -- 172.21.15.61:0/4236047714 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da406d440 con 0x7f3da4068510 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.397+0000 7f3da0ff9700 1 -- 172.21.15.61:0/4236047714 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3d90013680 con 0x7f3da4068510 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.397+0000 7f3da0ff9700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d88066f30 0x7f3d880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.397+0000 7f3da0ff9700 1 -- 172.21.15.61:0/4236047714 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3d900845e0 con 0x7f3da4068510 2023-12-24T20:02:51.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.398+0000 7f3da8f1e700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d88066f30 0x7f3d880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.398+0000 7f3da8f1e700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d88066f30 0x7f3d880693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3d98002c70 tx=0x7f3d98002c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:51.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.402+0000 7f3da0ff9700 1 -- 172.21.15.61:0/4236047714 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d90051ba0 con 0x7f3da4068510 2023-12-24T20:02:51.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.674+0000 7f3dab182700 1 -- 172.21.15.61:0/4236047714 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3da416ce20 con 0x7f3da4068510 2023-12-24T20:02:51.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.674+0000 7f3da0ff9700 1 -- 172.21.15.61:0/4236047714 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3da416ce20 con 0x7f3da4068510 2023-12-24T20:02:51.675 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:51.675 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:02:51.675 INFO:teuthology.orchestra.run.smithi061.stdout: "auth_dump": [ 2023-12-24T20:02:51.675 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.675 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.a", 2023-12-24T20:02:51.675 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew==", 2023-12-24T20:02:51.675 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.675 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:51.675 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.b", 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw==", 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.676 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.c", 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g==", 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.d", 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg==", 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.677 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.0", 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag==", 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.678 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.1", 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw==", 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.2", 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ==", 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.679 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.3", 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA==", 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.4", 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ==", 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.680 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.5", 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w==", 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.681 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.6", 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw==", 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.7", 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw==", 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:02:51.682 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.0", 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA==", 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow r", 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.1", 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w==", 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.683 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.2", 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg==", 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.3", 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g==", 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.admin", 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlwF3pGRAA8h0Cld7lwZprlrgMAN7tSg==", 2023-12-24T20:02:51.685 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.x", 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg==", 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.y", 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A==", 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:02:51.687 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:02:51.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 -- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d88066f30 msgr2=0x7f3d880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d88066f30 0x7f3d880693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3d98002c70 tx=0x7f3d98002c00 comp rx=0 tx=0).stop 2023-12-24T20:02:51.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 -- 172.21.15.61:0/4236047714 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3da4068510 msgr2=0x7f3da415e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3da4068510 0x7f3da415e270 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000ec80 tx=0x7f3d900091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 -- 172.21.15.61:0/4236047714 shutdown_connections 2023-12-24T20:02:51.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3da4159a60 0x7f3da415e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3d88066f30 0x7f3d880693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3da4068140 0x7f3da416b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 --2- 172.21.15.61:0/4236047714 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3da4068510 0x7f3da415e270 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 -- 172.21.15.61:0/4236047714 >> 172.21.15.61:0/4236047714 conn(0x7f3da4097a10 msgr2=0x7f3da40aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:51.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 -- 172.21.15.61:0/4236047714 shutdown_connections 2023-12-24T20:02:51.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.676+0000 7f3dab182700 1 -- 172.21.15.61:0/4236047714 wait complete. 2023-12-24T20:02:51.690 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:51.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.811+0000 7f48742c8700 1 Processor -- start 2023-12-24T20:02:51.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.811+0000 7f48742c8700 1 -- start start 2023-12-24T20:02:51.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.812+0000 7f48742c8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f486c15bb60 0x7f486c098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.812+0000 7f48742c8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f486c0b2660 0x7f486c0b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.812+0000 7f48742c8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486c0b2eb0 con 0x7f486c098aa0 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.812+0000 7f48742c8700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486c0afc20 con 0x7f486c0b2660 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.812+0000 7f48742c8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486c0b2bd0 con 0x7f486c15bb60 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.812+0000 7f4872865700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f486c0b2660 0x7f486c0b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.812+0000 7f4872865700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f486c0b2660 0x7f486c0b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46520/0 (socket says 172.21.15.61:46520) 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.812+0000 7f4872865700 1 -- 172.21.15.61:0/3210740706 learned_addr learned my addr 172.21.15.61:0/3210740706 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.813+0000 7f4872064700 1 --2- 172.21.15.61:0/3210740706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f486c15bb60 0x7f486c098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.813+0000 7f4872865700 1 -- 172.21.15.61:0/3210740706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f486c15bb60 msgr2=0x7f486c098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.813+0000 7f4872865700 1 --2- 172.21.15.61:0/3210740706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f486c15bb60 0x7f486c098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.813+0000 7f4872865700 1 -- 172.21.15.61:0/3210740706 >> v1:172.21.15.133:6789/0 conn(0x7f486c098aa0 legacy=0x7f486c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.813+0000 7f4872865700 1 -- 172.21.15.61:0/3210740706 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c0afe10 con 0x7f486c0b2660 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.813+0000 7f4872865700 1 --2- 172.21.15.61:0/3210740706 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c0b2660 0x7f486c0b08f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f4864009f20 tx=0x7f4864009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c917d29b55ae59 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.813+0000 7f4871062700 1 -- 172.21.15.61:0/3210740706 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400e070 con 0x7f486c0b2660 2023-12-24T20:02:51.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.813+0000 7f4871062700 1 -- 172.21.15.61:0/3210740706 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486400ba80 con 0x7f486c0b2660 2023-12-24T20:02:51.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.813+0000 7f4871062700 1 -- 172.21.15.61:0/3210740706 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640092e0 con 0x7f486c0b2660 2023-12-24T20:02:51.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.814+0000 7f48742c8700 1 -- 172.21.15.61:0/3210740706 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c0b2660 msgr2=0x7f486c0b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.814+0000 7f48742c8700 1 --2- 172.21.15.61:0/3210740706 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c0b2660 0x7f486c0b08f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f4864009f20 tx=0x7f4864009840 comp rx=0 tx=0).stop 2023-12-24T20:02:51.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.814+0000 7f48742c8700 1 -- 172.21.15.61:0/3210740706 shutdown_connections 2023-12-24T20:02:51.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.814+0000 7f48742c8700 1 --2- 172.21.15.61:0/3210740706 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c0b2660 0x7f486c0b08f0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.814+0000 7f48742c8700 1 --2- 172.21.15.61:0/3210740706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f486c15bb60 0x7f486c098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.814+0000 7f48742c8700 1 -- 172.21.15.61:0/3210740706 >> 172.21.15.61:0/3210740706 conn(0x7f486c097a10 msgr2=0x7f486c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.814+0000 7f48742c8700 1 -- 172.21.15.61:0/3210740706 shutdown_connections 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.814+0000 7f48742c8700 1 -- 172.21.15.61:0/3210740706 wait complete. 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.815+0000 7f48742c8700 1 Processor -- start 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.815+0000 7f48742c8700 1 -- start start 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f48742c8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c098aa0 0x7f486c09ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f48742c8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f486c0b2660 0x7f486c147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f48742c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f486c15bb60 0x7f486c147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f48742c8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c168e70 con 0x7f486c098aa0 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f48742c8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c169150 con 0x7f486c15bb60 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f48742c8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486c169430 con 0x7f486c0b2660 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4872064700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c098aa0 0x7f486c09ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4872064700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c098aa0 0x7f486c09ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46526/0 (socket says 172.21.15.61:46526) 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4872064700 1 -- 172.21.15.61:0/2904688958 learned_addr learned my addr 172.21.15.61:0/2904688958 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:51.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4872865700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f486c15bb60 0x7f486c147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4871863700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f486c0b2660 0x7f486c147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4872064700 1 -- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f486c0b2660 msgr2=0x7f486c147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4872064700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f486c0b2660 0x7f486c147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4872064700 1 -- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f486c15bb60 msgr2=0x7f486c147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4872064700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f486c15bb60 0x7f486c147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4872064700 1 -- 172.21.15.61:0/2904688958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4864009ae0 con 0x7f486c098aa0 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f4872064700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c098aa0 0x7f486c09ad90 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f486000d840 tx=0x7f4860008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f485e7fc700 1 -- 172.21.15.61:0/2904688958 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860014620 con 0x7f486c098aa0 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f485e7fc700 1 -- 172.21.15.61:0/2904688958 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860014780 con 0x7f486c098aa0 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f485e7fc700 1 -- 172.21.15.61:0/2904688958 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860014b40 con 0x7f486c098aa0 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f48742c8700 1 -- 172.21.15.61:0/2904688958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486c169710 con 0x7f486c098aa0 2023-12-24T20:02:51.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.816+0000 7f48742c8700 1 -- 172.21.15.61:0/2904688958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486c09b490 con 0x7f486c098aa0 2023-12-24T20:02:51.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.818+0000 7f48742c8700 1 -- 172.21.15.61:0/2904688958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486c06d440 con 0x7f486c098aa0 2023-12-24T20:02:51.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.818+0000 7f485e7fc700 1 -- 172.21.15.61:0/2904688958 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f486001d400 con 0x7f486c098aa0 2023-12-24T20:02:51.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.818+0000 7f485e7fc700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4850066f30 0x7f48500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:51.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.819+0000 7f485e7fc700 1 -- 172.21.15.61:0/2904688958 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4860084a80 con 0x7f486c098aa0 2023-12-24T20:02:51.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.819+0000 7f4871863700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4850066f30 0x7f48500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:51.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.819+0000 7f4871863700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4850066f30 0x7f48500693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f486c0c36e0 tx=0x7f4868009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:51.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:51.823+0000 7f485e7fc700 1 -- 172.21.15.61:0/2904688958 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4860052040 con 0x7f486c098aa0 2023-12-24T20:02:52.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.016+0000 7f48742c8700 1 -- 172.21.15.61:0/2904688958 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f486c169a80 con 0x7f486c098aa0 2023-12-24T20:02:52.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.017+0000 7f485e7fc700 1 -- 172.21.15.61:0/2904688958 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f4860055660 con 0x7f486c098aa0 2023-12-24T20:02:52.017 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:52.017 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":132,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:51.254421+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 -- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4850066f30 msgr2=0x7f48500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4850066f30 0x7f48500693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f486c0c36e0 tx=0x7f4868009040 comp rx=0 tx=0).stop 2023-12-24T20:02:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 -- 172.21.15.61:0/2904688958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c098aa0 msgr2=0x7f486c09ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c098aa0 0x7f486c09ad90 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f486000d840 tx=0x7f4860008040 comp rx=0 tx=0).stop 2023-12-24T20:02:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 -- 172.21.15.61:0/2904688958 shutdown_connections 2023-12-24T20:02:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4850066f30 0x7f48500693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f486c15bb60 0x7f486c147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f486c098aa0 0x7f486c09ad90 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 --2- 172.21.15.61:0/2904688958 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f486c0b2660 0x7f486c147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 -- 172.21.15.61:0/2904688958 >> 172.21.15.61:0/2904688958 conn(0x7f486c097a10 msgr2=0x7f486c158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:52.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 -- 172.21.15.61:0/2904688958 shutdown_connections 2023-12-24T20:02:52.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.019+0000 7f48742c8700 1 -- 172.21.15.61:0/2904688958 wait complete. 2023-12-24T20:02:52.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T20:02:52.032 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:02:52.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.156+0000 7f410c9b0700 1 Processor -- start 2023-12-24T20:02:52.156 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.156+0000 7f410c9b0700 1 -- start start 2023-12-24T20:02:52.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f410c9b0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f410806a7e0 0x7f41080c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f410c9b0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410815bec0 con 0x7f41080c9850 2023-12-24T20:02:52.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f410c9b0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410815b590 con 0x7f41080b2ec0 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f410c9b0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4108068ee0 con 0x7f410806a7e0 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f4106d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f41080c9850 0x7f4108070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59980/0 (socket says 172.21.15.61:59980) 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f4106d9d700 1 -- 172.21.15.61:0/2826241778 learned_addr learned my addr 172.21.15.61:0/2826241778 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f4105d9b700 1 --2- 172.21.15.61:0/2826241778 >> v2:172.21.15.133:3300/0 conn(0x7f410806a7e0 0x7f41080c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f410559a700 1 -- 172.21.15.61:0/2826241778 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498935500 0 0) 0x7f410815bec0 con 0x7f41080c9850 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f410559a700 1 -- 172.21.15.61:0/2826241778 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f0003570 con 0x7f41080c9850 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f410559a700 1 -- 172.21.15.61:0/2826241778 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213139098 0 0) 0x7f410815b590 con 0x7f41080b2ec0 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.157+0000 7f410559a700 1 -- 172.21.15.61:0/2826241778 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f410815bec0 con 0x7f41080b2ec0 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.158+0000 7f4105d9b700 1 -- 172.21.15.61:0/2826241778 >> v1:172.21.15.133:6789/0 conn(0x7f41080b2ec0 legacy=0x7f41080685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.158+0000 7f4105d9b700 1 -- 172.21.15.61:0/2826241778 >> v1:172.21.15.61:6789/0 conn(0x7f41080c9850 legacy=0x7f4108070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.158+0000 7f410559a700 1 -- 172.21.15.61:0/2826241778 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2924147051 0 0) 0x7f40f0003570 con 0x7f41080c9850 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.158+0000 7f4105d9b700 1 -- 172.21.15.61:0/2826241778 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410815b870 con 0x7f410806a7e0 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.158+0000 7f4105d9b700 1 --2- 172.21.15.61:0/2826241778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f410806a7e0 0x7f41080c9310 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f40f80098e0 tx=0x7f40f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef7a990cf5c5ac8a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:52.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.158+0000 7f410559a700 1 -- 172.21.15.61:0/2826241778 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41000017f0 con 0x7f410806a7e0 2023-12-24T20:02:52.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.158+0000 7f410559a700 1 -- 172.21.15.61:0/2826241778 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f8011420 con 0x7f410806a7e0 2023-12-24T20:02:52.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.158+0000 7f410559a700 1 -- 172.21.15.61:0/2826241778 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f80117c0 con 0x7f410806a7e0 2023-12-24T20:02:52.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.159+0000 7f410c9b0700 1 -- 172.21.15.61:0/2826241778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f410806a7e0 msgr2=0x7f41080c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.159+0000 7f410c9b0700 1 --2- 172.21.15.61:0/2826241778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f410806a7e0 0x7f41080c9310 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f40f80098e0 tx=0x7f40f80091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.159+0000 7f410c9b0700 1 -- 172.21.15.61:0/2826241778 shutdown_connections 2023-12-24T20:02:52.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.159+0000 7f410c9b0700 1 --2- 172.21.15.61:0/2826241778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f410806a7e0 0x7f41080c9310 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.159+0000 7f410c9b0700 1 -- 172.21.15.61:0/2826241778 >> 172.21.15.61:0/2826241778 conn(0x7f41080ce170 msgr2=0x7f41080ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:52.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.159+0000 7f410c9b0700 1 -- 172.21.15.61:0/2826241778 shutdown_connections 2023-12-24T20:02:52.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.159+0000 7f410c9b0700 1 -- 172.21.15.61:0/2826241778 wait complete. 2023-12-24T20:02:52.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.160+0000 7f410c9b0700 1 Processor -- start 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.160+0000 7f410c9b0700 1 -- start start 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410c9b0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f410806a7e0 0x7f41080af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410c9b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41080b2ec0 0x7f4108168e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410c9b0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41080c9850 0x7f4108169620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410c9b0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108157f30 con 0x7f410806a7e0 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410c9b0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4108154be0 con 0x7f41080b2ec0 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410c9b0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41081693b0 con 0x7f41080c9850 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f410806a7e0 0x7f41080af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f410806a7e0 0x7f41080af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46534/0 (socket says 172.21.15.61:46534) 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410659c700 1 -- 172.21.15.61:0/2099200317 learned_addr learned my addr 172.21.15.61:0/2099200317 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f4105d9b700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41080b2ec0 0x7f4108168e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f4106d9d700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41080c9850 0x7f4108169620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410659c700 1 -- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41080c9850 msgr2=0x7f4108169620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410659c700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41080c9850 0x7f4108169620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410659c700 1 -- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41080b2ec0 msgr2=0x7f4108168e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410659c700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41080b2ec0 0x7f4108168e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410659c700 1 -- 172.21.15.61:0/2099200317 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f8009420 con 0x7f410806a7e0 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f4106d9d700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41080c9850 0x7f4108169620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410659c700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f410806a7e0 0x7f41080af030 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00c7c0 tx=0x7f40fc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f40f67fc700 1 -- 172.21.15.61:0/2099200317 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc010510 con 0x7f410806a7e0 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f40f67fc700 1 -- 172.21.15.61:0/2099200317 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc010690 con 0x7f410806a7e0 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.161+0000 7f410c9b0700 1 -- 172.21.15.61:0/2099200317 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4108158110 con 0x7f410806a7e0 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.162+0000 7f40f67fc700 1 -- 172.21.15.61:0/2099200317 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc010a50 con 0x7f410806a7e0 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.162+0000 7f410c9b0700 1 -- 172.21.15.61:0/2099200317 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41081586d0 con 0x7f410806a7e0 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.162+0000 7f410c9b0700 1 -- 172.21.15.61:0/2099200317 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410804c3c0 con 0x7f410806a7e0 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.163+0000 7f40f67fc700 1 -- 172.21.15.61:0/2099200317 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f40fc01b400 con 0x7f410806a7e0 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.163+0000 7f40f67fc700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40e8066f30 0x7f40e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.163+0000 7f40f67fc700 1 -- 172.21.15.61:0/2099200317 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f40fc083f50 con 0x7f410806a7e0 2023-12-24T20:02:52.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.164+0000 7f4105d9b700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40e8066f30 0x7f40e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.164+0000 7f4105d9b700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40e8066f30 0x7f40e80693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f40f80098e0 tx=0x7f40f8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:52.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.168+0000 7f40f67fc700 1 -- 172.21.15.61:0/2099200317 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40fc051470 con 0x7f410806a7e0 2023-12-24T20:02:52.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.360+0000 7f410c9b0700 1 -- 172.21.15.61:0/2099200317 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f410806aec0 con 0x7f410806a7e0 2023-12-24T20:02:52.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.361+0000 7f40f67fc700 1 -- 172.21.15.61:0/2099200317 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40fc0160a0 con 0x7f410806a7e0 2023-12-24T20:02:52.361 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:02:52.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 -- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40e8066f30 msgr2=0x7f40e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40e8066f30 0x7f40e80693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f40f80098e0 tx=0x7f40f8016000 comp rx=0 tx=0).stop 2023-12-24T20:02:52.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 -- 172.21.15.61:0/2099200317 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f410806a7e0 msgr2=0x7f41080af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f410806a7e0 0x7f41080af030 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f40fc00c7c0 tx=0x7f40fc007e10 comp rx=0 tx=0).stop 2023-12-24T20:02:52.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 -- 172.21.15.61:0/2099200317 shutdown_connections 2023-12-24T20:02:52.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41080c9850 0x7f4108169620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f40e8066f30 0x7f40e80693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f410806a7e0 0x7f41080af030 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 --2- 172.21.15.61:0/2099200317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41080b2ec0 0x7f4108168e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 -- 172.21.15.61:0/2099200317 >> 172.21.15.61:0/2099200317 conn(0x7f41080ce170 msgr2=0x7f41080b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:52.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 -- 172.21.15.61:0/2099200317 shutdown_connections 2023-12-24T20:02:52.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.363+0000 7f410c9b0700 1 -- 172.21.15.61:0/2099200317 wait complete. 2023-12-24T20:02:52.375 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T20:02:52.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.497+0000 7f04691c1700 1 Processor -- start 2023-12-24T20:02:52.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.497+0000 7f04691c1700 1 -- start start 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f04691c1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0464155300 0x7f04640cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f04691c1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04641556d0 0x7f0464157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f04691c1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f046406c260 0x7f046406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f04691c1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04641583d0 con 0x7f046406c260 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f04691c1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0464158670 con 0x7f0464155300 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f04691c1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0464158950 con 0x7f04641556d0 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f046359e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f046406c260 0x7f046406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f046359e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f046406c260 0x7f046406c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46546/0 (socket says 172.21.15.61:46546) 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f046359e700 1 -- 172.21.15.61:0/3089566309 learned_addr learned my addr 172.21.15.61:0/3089566309 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f046259c700 1 --2- 172.21.15.61:0/3089566309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04641556d0 0x7f0464157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.498+0000 7f0462d9d700 1 --2- 172.21.15.61:0/3089566309 >> v2:172.21.15.133:3300/0 conn(0x7f0464155300 0x7f04640cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f046359e700 1 -- 172.21.15.61:0/3089566309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04641556d0 msgr2=0x7f0464157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f046359e700 1 --2- 172.21.15.61:0/3089566309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04641556d0 0x7f0464157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f046359e700 1 -- 172.21.15.61:0/3089566309 >> v2:172.21.15.133:3300/0 conn(0x7f0464155300 msgr2=0x7f04640cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f046359e700 1 --2- 172.21.15.61:0/3089566309 >> v2:172.21.15.133:3300/0 conn(0x7f0464155300 0x7f04640cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f046359e700 1 -- 172.21.15.61:0/3089566309 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0464158c30 con 0x7f046406c260 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f046259c700 1 --2- 172.21.15.61:0/3089566309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04641556d0 0x7f0464157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f0462d9d700 1 --2- 172.21.15.61:0/3089566309 >> v2:172.21.15.133:3300/0 conn(0x7f0464155300 0x7f04640cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f046359e700 1 --2- 172.21.15.61:0/3089566309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f046406c260 0x7f046406c6e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f046406d680 tx=0x7f045c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c21a5e4d9a08ee4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f0461d9b700 1 -- 172.21.15.61:0/3089566309 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c00e070 con 0x7f046406c260 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f0461d9b700 1 -- 172.21.15.61:0/3089566309 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c00ba50 con 0x7f046406c260 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f0461d9b700 1 -- 172.21.15.61:0/3089566309 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c0092e0 con 0x7f046406c260 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f04691c1700 1 -- 172.21.15.61:0/3089566309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f046406c260 msgr2=0x7f046406c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f04691c1700 1 --2- 172.21.15.61:0/3089566309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f046406c260 0x7f046406c6e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f046406d680 tx=0x7f045c009840 comp rx=0 tx=0).stop 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f04691c1700 1 -- 172.21.15.61:0/3089566309 shutdown_connections 2023-12-24T20:02:52.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f04691c1700 1 --2- 172.21.15.61:0/3089566309 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f046406c260 0x7f046406c6e0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f04691c1700 1 --2- 172.21.15.61:0/3089566309 >> v2:172.21.15.133:3300/0 conn(0x7f0464155300 0x7f04640cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f04691c1700 1 --2- 172.21.15.61:0/3089566309 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f04641556d0 0x7f0464157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.499+0000 7f04691c1700 1 -- 172.21.15.61:0/3089566309 >> 172.21.15.61:0/3089566309 conn(0x7f046406b680 msgr2=0x7f04640ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:52.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.500+0000 7f04691c1700 1 -- 172.21.15.61:0/3089566309 shutdown_connections 2023-12-24T20:02:52.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.500+0000 7f04691c1700 1 -- 172.21.15.61:0/3089566309 wait complete. 2023-12-24T20:02:52.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.501+0000 7f04691c1700 1 Processor -- start 2023-12-24T20:02:52.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.501+0000 7f04691c1700 1 -- start start 2023-12-24T20:02:52.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.501+0000 7f04691c1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f046406c260 0x7f0464157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.501+0000 7f04691c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0464155300 0x7f0464142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.501+0000 7f04691c1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04640b15a0 0x7f04640b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.501+0000 7f04691c1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04640b2700 con 0x7f04640b15a0 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.501+0000 7f04691c1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04640b1af0 con 0x7f0464155300 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.501+0000 7f04691c1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04640b1dd0 con 0x7f046406c260 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046359e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04640b15a0 0x7f04640b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046359e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04640b15a0 0x7f04640b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46554/0 (socket says 172.21.15.61:46554) 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046359e700 1 -- 172.21.15.61:0/2336566625 learned_addr learned my addr 172.21.15.61:0/2336566625 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f0462d9d700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f046406c260 0x7f0464157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046259c700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0464155300 0x7f0464142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046359e700 1 -- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f046406c260 msgr2=0x7f0464157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046359e700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f046406c260 0x7f0464157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046359e700 1 -- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0464155300 msgr2=0x7f0464142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046359e700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0464155300 0x7f0464142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046359e700 1 -- 172.21.15.61:0/2336566625 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c009ae0 con 0x7f04640b15a0 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f0462d9d700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f046406c260 0x7f0464157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046259c700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0464155300 0x7f0464142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f046359e700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04640b15a0 0x7f04640b2b90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f046406a8c0 tx=0x7f045c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f044affd700 1 -- 172.21.15.61:0/2336566625 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c008e80 con 0x7f04640b15a0 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f044affd700 1 -- 172.21.15.61:0/2336566625 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c026460 con 0x7f04640b15a0 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f044affd700 1 -- 172.21.15.61:0/2336566625 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c026800 con 0x7f04640b15a0 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f04691c1700 1 -- 172.21.15.61:0/2336566625 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04640b20b0 con 0x7f04640b15a0 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.502+0000 7f04691c1700 1 -- 172.21.15.61:0/2336566625 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0464158050 con 0x7f04640b15a0 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.503+0000 7f04691c1700 1 -- 172.21.15.61:0/2336566625 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046404c3c0 con 0x7f04640b15a0 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.504+0000 7f044affd700 1 -- 172.21.15.61:0/2336566625 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f045c003040 con 0x7f04640b15a0 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.504+0000 7f044affd700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0450066f30 0x7f04500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.504+0000 7f044affd700 1 -- 172.21.15.61:0/2336566625 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f045c085db0 con 0x7f04640b15a0 2023-12-24T20:02:52.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.504+0000 7f0462d9d700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0450066f30 0x7f04500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.505+0000 7f0462d9d700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0450066f30 0x7f04500693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0458008a80 tx=0x7f0458008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:52.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.508+0000 7f044affd700 1 -- 172.21.15.61:0/2336566625 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f045c089030 con 0x7f04640b15a0 2023-12-24T20:02:52.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.710+0000 7f04691c1700 1 -- 172.21.15.61:0/2336566625 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f04640b2840 con 0x7f04640b15a0 2023-12-24T20:02:52.710 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.710+0000 7f044affd700 1 -- 172.21.15.61:0/2336566625 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v132) v1 ==== 84+0+65 (secure 0 0 0) 0x7f045c053370 con 0x7f04640b15a0 2023-12-24T20:02:52.710 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:52.710 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T20:02:52.710 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:02:52.711 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T20:02:52.711 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T20:02:52.711 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:02:52.711 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 -- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0450066f30 msgr2=0x7f04500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0450066f30 0x7f04500693e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0458008a80 tx=0x7f0458008040 comp rx=0 tx=0).stop 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 -- 172.21.15.61:0/2336566625 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04640b15a0 msgr2=0x7f04640b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04640b15a0 0x7f04640b2b90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f046406a8c0 tx=0x7f045c018000 comp rx=0 tx=0).stop 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 -- 172.21.15.61:0/2336566625 shutdown_connections 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f046406c260 0x7f0464157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0450066f30 0x7f04500693e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f04640b15a0 0x7f04640b2b90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 --2- 172.21.15.61:0/2336566625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0464155300 0x7f0464142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 -- 172.21.15.61:0/2336566625 >> 172.21.15.61:0/2336566625 conn(0x7f046406b680 msgr2=0x7f04640ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 -- 172.21.15.61:0/2336566625 shutdown_connections 2023-12-24T20:02:52.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.712+0000 7f04691c1700 1 -- 172.21.15.61:0/2336566625 wait complete. 2023-12-24T20:02:52.725 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T20:02:52.725 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T20:02:52.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.851+0000 7fa067929700 1 Processor -- start 2023-12-24T20:02:52.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.851+0000 7fa067929700 1 -- start start 2023-12-24T20:02:52.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.852+0000 7fa067929700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa060159a10 0x7fa0600c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.852+0000 7fa067929700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa06006a800 0x7fa060070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.852+0000 7fa067929700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060159de0 0x7fa0600cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.852+0000 7fa067929700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa060071290 con 0x7fa06006a800 2023-12-24T20:02:52.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.852+0000 7fa067929700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa060070fb0 con 0x7fa060159a10 2023-12-24T20:02:52.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.852+0000 7fa067929700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600675f0 con 0x7fa060159de0 2023-12-24T20:02:52.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.852+0000 7fa064ec4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa06006a800 0x7fa060070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.852+0000 7fa064ec4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa06006a800 0x7fa060070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46558/0 (socket says 172.21.15.61:46558) 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.852+0000 7fa064ec4700 1 -- 172.21.15.61:0/131842910 learned_addr learned my addr 172.21.15.61:0/131842910 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa065ec6700 1 --2- 172.21.15.61:0/131842910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060159de0 0x7fa0600cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa0656c5700 1 --2- 172.21.15.61:0/131842910 >> v2:172.21.15.133:3300/0 conn(0x7fa060159a10 0x7fa0600c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa064ec4700 1 -- 172.21.15.61:0/131842910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060159de0 msgr2=0x7fa0600cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa064ec4700 1 --2- 172.21.15.61:0/131842910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060159de0 0x7fa0600cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa064ec4700 1 -- 172.21.15.61:0/131842910 >> v2:172.21.15.133:3300/0 conn(0x7fa060159a10 msgr2=0x7fa0600c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa064ec4700 1 --2- 172.21.15.61:0/131842910 >> v2:172.21.15.133:3300/0 conn(0x7fa060159a10 0x7fa0600c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa064ec4700 1 -- 172.21.15.61:0/131842910 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600678d0 con 0x7fa06006a800 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa0656c5700 1 --2- 172.21.15.61:0/131842910 >> v2:172.21.15.133:3300/0 conn(0x7fa060159a10 0x7fa0600c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa064ec4700 1 --2- 172.21.15.61:0/131842910 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa06006a800 0x7fa060070640 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa060064b30 tx=0x7fa05c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca66bd291499a0a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa053fff700 1 -- 172.21.15.61:0/131842910 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00b860 con 0x7fa06006a800 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa053fff700 1 -- 172.21.15.61:0/131842910 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c00b9c0 con 0x7fa06006a800 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.853+0000 7fa053fff700 1 -- 172.21.15.61:0/131842910 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00bd60 con 0x7fa06006a800 2023-12-24T20:02:52.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.854+0000 7fa067929700 1 -- 172.21.15.61:0/131842910 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa06006a800 msgr2=0x7fa060070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.854+0000 7fa067929700 1 --2- 172.21.15.61:0/131842910 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa06006a800 0x7fa060070640 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fa060064b30 tx=0x7fa05c009250 comp rx=0 tx=0).stop 2023-12-24T20:02:52.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.854+0000 7fa067929700 1 -- 172.21.15.61:0/131842910 shutdown_connections 2023-12-24T20:02:52.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.854+0000 7fa067929700 1 --2- 172.21.15.61:0/131842910 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060159de0 0x7fa0600cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.854+0000 7fa067929700 1 --2- 172.21.15.61:0/131842910 >> v2:172.21.15.133:3300/0 conn(0x7fa060159a10 0x7fa0600c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.854+0000 7fa067929700 1 --2- 172.21.15.61:0/131842910 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa06006a800 0x7fa060070640 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.854+0000 7fa067929700 1 -- 172.21.15.61:0/131842910 >> 172.21.15.61:0/131842910 conn(0x7fa0600ce180 msgr2=0x7fa0600ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:52.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.854+0000 7fa067929700 1 -- 172.21.15.61:0/131842910 shutdown_connections 2023-12-24T20:02:52.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.854+0000 7fa067929700 1 -- 172.21.15.61:0/131842910 wait complete. 2023-12-24T20:02:52.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.855+0000 7fa067929700 1 Processor -- start 2023-12-24T20:02:52.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.855+0000 7fa067929700 1 -- start start 2023-12-24T20:02:52.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa067929700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006a800 0x7fa06015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa067929700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa060159a10 0x7fa0600c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa067929700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060159de0 0x7fa060169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa067929700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06015e420 con 0x7fa060159a10 2023-12-24T20:02:52.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa067929700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06015e210 con 0x7fa06006a800 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa067929700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600c5280 con 0x7fa060159de0 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa064ec4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa060159a10 0x7fa0600c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa064ec4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa060159a10 0x7fa0600c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46562/0 (socket says 172.21.15.61:46562) 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa064ec4700 1 -- 172.21.15.61:0/3675749328 learned_addr learned my addr 172.21.15.61:0/3675749328 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa0656c5700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006a800 0x7fa06015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa065ec6700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060159de0 0x7fa060169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa064ec4700 1 -- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060159de0 msgr2=0x7fa060169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa064ec4700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060159de0 0x7fa060169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa064ec4700 1 -- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006a800 msgr2=0x7fa06015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa064ec4700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006a800 0x7fa06015dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa064ec4700 1 -- 172.21.15.61:0/3675749328 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c0094f0 con 0x7fa060159a10 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.856+0000 7fa064ec4700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa060159a10 0x7fa0600c7280 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009290 tx=0x7fa05c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.857+0000 7fa0517fa700 1 -- 172.21.15.61:0/3675749328 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c011e40 con 0x7fa060159a10 2023-12-24T20:02:52.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.857+0000 7fa0517fa700 1 -- 172.21.15.61:0/3675749328 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c01a450 con 0x7fa060159a10 2023-12-24T20:02:52.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.857+0000 7fa0517fa700 1 -- 172.21.15.61:0/3675749328 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c01a810 con 0x7fa060159a10 2023-12-24T20:02:52.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.857+0000 7fa067929700 1 -- 172.21.15.61:0/3675749328 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0600c77c0 con 0x7fa060159a10 2023-12-24T20:02:52.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.857+0000 7fa067929700 1 -- 172.21.15.61:0/3675749328 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0600c4c30 con 0x7fa060159a10 2023-12-24T20:02:52.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.858+0000 7fa067929700 1 -- 172.21.15.61:0/3675749328 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600c3710 con 0x7fa060159a10 2023-12-24T20:02:52.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.858+0000 7fa0517fa700 1 -- 172.21.15.61:0/3675749328 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa05c01abc0 con 0x7fa060159a10 2023-12-24T20:02:52.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.858+0000 7fa0517fa700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa044066f30 0x7fa0440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:52.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.859+0000 7fa0517fa700 1 -- 172.21.15.61:0/3675749328 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa05c085730 con 0x7fa060159a10 2023-12-24T20:02:52.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.859+0000 7fa0656c5700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa044066f30 0x7fa0440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:52.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.859+0000 7fa0656c5700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa044066f30 0x7fa0440693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa054006f00 tx=0x7fa054008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:52.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:52.863+0000 7fa0517fa700 1 -- 172.21.15.61:0/3675749328 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa05c052cf0 con 0x7fa060159a10 2023-12-24T20:02:53.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.065+0000 7fa067929700 1 -- 172.21.15.61:0/3675749328 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa0600cbf70 con 0x7fa060159a10 2023-12-24T20:02:53.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.903+0000 7fa0517fa700 1 -- 172.21.15.61:0/3675749328 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v133) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa05c056310 con 0x7fa060159a10 2023-12-24T20:02:53.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.908+0000 7fa067929700 1 -- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa044066f30 msgr2=0x7fa0440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:53.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.908+0000 7fa067929700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa044066f30 0x7fa0440693e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa054006f00 tx=0x7fa054008040 comp rx=0 tx=0).stop 2023-12-24T20:02:53.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.908+0000 7fa067929700 1 -- 172.21.15.61:0/3675749328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa060159a10 msgr2=0x7fa0600c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:53.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.908+0000 7fa067929700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa060159a10 0x7fa0600c7280 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009290 tx=0x7fa05c017000 comp rx=0 tx=0).stop 2023-12-24T20:02:53.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.908+0000 7fa067929700 1 -- 172.21.15.61:0/3675749328 shutdown_connections 2023-12-24T20:02:53.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.908+0000 7fa067929700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa060159de0 0x7fa060169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:53.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.908+0000 7fa067929700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa044066f30 0x7fa0440693e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:53.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.908+0000 7fa067929700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa06006a800 0x7fa06015dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:53.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.908+0000 7fa067929700 1 --2- 172.21.15.61:0/3675749328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa060159a10 0x7fa0600c7280 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:53.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.908+0000 7fa067929700 1 -- 172.21.15.61:0/3675749328 >> 172.21.15.61:0/3675749328 conn(0x7fa0600ce180 msgr2=0x7fa0600b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:53.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.909+0000 7fa067929700 1 -- 172.21.15.61:0/3675749328 shutdown_connections 2023-12-24T20:02:53.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:53.909+0000 7fa067929700 1 -- 172.21.15.61:0/3675749328 wait complete. 2023-12-24T20:02:53.911 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T20:02:53.925 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T20:02:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.060+0000 7fd20f999700 1 Processor -- start 2023-12-24T20:02:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.060+0000 7fd20f999700 1 -- start start 2023-12-24T20:02:54.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.061+0000 7fd20f999700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2080b2fa0 0x7fd208069b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:54.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.061+0000 7fd20f999700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd2080b3370 0x7fd2080cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:54.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.061+0000 7fd20f999700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20806a4f0 con 0x7fd2080cab60 2023-12-24T20:02:54.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.061+0000 7fd20f999700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2080c84d0 con 0x7fd2080b3370 2023-12-24T20:02:54.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.061+0000 7fd20f999700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2080c87b0 con 0x7fd2080b2fa0 2023-12-24T20:02:54.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd20cf34700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd2080b3370 0x7fd2080cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd20df36700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd2080cab60 0x7fd208067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59982/0 (socket says 172.21.15.61:59982) 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd20df36700 1 -- 172.21.15.61:0/616848219 learned_addr learned my addr 172.21.15.61:0/616848219 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd20cf34700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd2080b3370 0x7fd2080cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46572/0 (socket says 172.21.15.61:46572) 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd20d735700 1 --2- 172.21.15.61:0/616848219 >> v2:172.21.15.133:3300/0 conn(0x7fd2080b2fa0 0x7fd208069b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd20cf34700 1 -- 172.21.15.61:0/616848219 >> v2:172.21.15.133:3300/0 conn(0x7fd2080b2fa0 msgr2=0x7fd208069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd20cf34700 1 --2- 172.21.15.61:0/616848219 >> v2:172.21.15.133:3300/0 conn(0x7fd2080b2fa0 0x7fd208069b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd20cf34700 1 -- 172.21.15.61:0/616848219 >> v1:172.21.15.61:6789/0 conn(0x7fd2080cab60 legacy=0x7fd208067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd20cf34700 1 -- 172.21.15.61:0/616848219 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080c8a90 con 0x7fd2080b3370 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd1fffff700 1 -- 172.21.15.61:0/616848219 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413756295 0 0) 0x7fd20806a4f0 con 0x7fd2080cab60 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd20cf34700 1 --2- 172.21.15.61:0/616848219 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 0x7fd2080cbc40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fd20806ce80 tx=0x7fd2040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c6c961628582f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd1fffff700 1 -- 172.21.15.61:0/616848219 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204011630 con 0x7fd2080b3370 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd1fffff700 1 -- 172.21.15.61:0/616848219 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd204011790 con 0x7fd2080b3370 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.062+0000 7fd1fffff700 1 -- 172.21.15.61:0/616848219 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204011b30 con 0x7fd2080b3370 2023-12-24T20:02:54.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.063+0000 7fd20f999700 1 -- 172.21.15.61:0/616848219 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 msgr2=0x7fd2080cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:54.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.063+0000 7fd20f999700 1 --2- 172.21.15.61:0/616848219 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 0x7fd2080cbc40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fd20806ce80 tx=0x7fd2040091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:54.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.063+0000 7fd20f999700 1 -- 172.21.15.61:0/616848219 shutdown_connections 2023-12-24T20:02:54.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.063+0000 7fd20f999700 1 --2- 172.21.15.61:0/616848219 >> v2:172.21.15.133:3300/0 conn(0x7fd2080b2fa0 0x7fd208069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:54.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.063+0000 7fd20f999700 1 --2- 172.21.15.61:0/616848219 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 0x7fd2080cbc40 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:54.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.063+0000 7fd20f999700 1 -- 172.21.15.61:0/616848219 >> 172.21.15.61:0/616848219 conn(0x7fd2080ce170 msgr2=0x7fd2080ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:54.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.063+0000 7fd20f999700 1 -- 172.21.15.61:0/616848219 shutdown_connections 2023-12-24T20:02:54.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.063+0000 7fd20f999700 1 -- 172.21.15.61:0/616848219 wait complete. 2023-12-24T20:02:54.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.064+0000 7fd20f999700 1 Processor -- start 2023-12-24T20:02:54.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.065+0000 7fd20f999700 1 -- start start 2023-12-24T20:02:54.067 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20f999700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2080b2fa0 0x7fd208156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20f999700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 0x7fd208158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20f999700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2080cab60 0x7fd208158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20f999700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20815b810 con 0x7fd2080b3370 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20f999700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20815aee0 con 0x7fd2080b2fa0 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20f999700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20815b1c0 con 0x7fd2080cab60 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20cf34700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 0x7fd208158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20cf34700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 0x7fd208158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46576/0 (socket says 172.21.15.61:46576) 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20cf34700 1 -- 172.21.15.61:0/3236949557 learned_addr learned my addr 172.21.15.61:0/3236949557 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20d735700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2080b2fa0 0x7fd208156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20df36700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2080cab60 0x7fd208158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20cf34700 1 -- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2080cab60 msgr2=0x7fd208158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20cf34700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2080cab60 0x7fd208158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20cf34700 1 -- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2080b2fa0 msgr2=0x7fd208156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:54.068 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20cf34700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2080b2fa0 0x7fd208156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:54.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20cf34700 1 -- 172.21.15.61:0/3236949557 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204009420 con 0x7fd2080b3370 2023-12-24T20:02:54.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20d735700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2080b2fa0 0x7fd208156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:54.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20cf34700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 0x7fd208158960 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fd204013000 tx=0x7fd204017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:54.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd1fd7fa700 1 -- 172.21.15.61:0/3236949557 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204020070 con 0x7fd2080b3370 2023-12-24T20:02:54.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd1fd7fa700 1 -- 172.21.15.61:0/3236949557 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd204024410 con 0x7fd2080b3370 2023-12-24T20:02:54.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd20f999700 1 -- 172.21.15.61:0/3236949557 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20815b4a0 con 0x7fd2080b3370 2023-12-24T20:02:54.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.066+0000 7fd1fd7fa700 1 -- 172.21.15.61:0/3236949557 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040247d0 con 0x7fd2080b3370 2023-12-24T20:02:54.069 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.067+0000 7fd20f999700 1 -- 172.21.15.61:0/3236949557 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2081566c0 con 0x7fd2080b3370 2023-12-24T20:02:54.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.068+0000 7fd20f999700 1 -- 172.21.15.61:0/3236949557 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20815b980 con 0x7fd2080b3370 2023-12-24T20:02:54.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.068+0000 7fd1fd7fa700 1 -- 172.21.15.61:0/3236949557 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd20402d3b0 con 0x7fd2080b3370 2023-12-24T20:02:54.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.068+0000 7fd1fd7fa700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1ec066f60 0x7fd1ec069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:54.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.068+0000 7fd1fd7fa700 1 -- 172.21.15.61:0/3236949557 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd2040876f0 con 0x7fd2080b3370 2023-12-24T20:02:54.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.069+0000 7fd20d735700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1ec066f60 0x7fd1ec069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:54.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.069+0000 7fd20d735700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1ec066f60 0x7fd1ec069410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009d80 tx=0x7fd1f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:54.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.073+0000 7fd1fd7fa700 1 -- 172.21.15.61:0/3236949557 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd204054b40 con 0x7fd2080b3370 2023-12-24T20:02:54.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.273+0000 7fd20f999700 1 -- 172.21.15.61:0/3236949557 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd20804c3c0 con 0x7fd2080b3370 2023-12-24T20:02:54.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.909+0000 7fd1fd7fa700 1 -- 172.21.15.61:0/3236949557 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v134) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd204058160 con 0x7fd2080b3370 2023-12-24T20:02:54.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.914+0000 7fd20f999700 1 -- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1ec066f60 msgr2=0x7fd1ec069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:54.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.914+0000 7fd20f999700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1ec066f60 0x7fd1ec069410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009d80 tx=0x7fd1f8008040 comp rx=0 tx=0).stop 2023-12-24T20:02:54.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.914+0000 7fd20f999700 1 -- 172.21.15.61:0/3236949557 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 msgr2=0x7fd208158960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:54.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.914+0000 7fd20f999700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 0x7fd208158960 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fd204013000 tx=0x7fd204017000 comp rx=0 tx=0).stop 2023-12-24T20:02:54.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.925+0000 7fd20f999700 1 -- 172.21.15.61:0/3236949557 shutdown_connections 2023-12-24T20:02:54.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.925+0000 7fd20f999700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2080cab60 0x7fd208158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:54.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.925+0000 7fd20f999700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd1ec066f60 0x7fd1ec069410 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:54.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.925+0000 7fd20f999700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2080b2fa0 0x7fd208156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:54.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.925+0000 7fd20f999700 1 --2- 172.21.15.61:0/3236949557 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2080b3370 0x7fd208158960 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:54.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.925+0000 7fd20f999700 1 -- 172.21.15.61:0/3236949557 >> 172.21.15.61:0/3236949557 conn(0x7fd2080ce170 msgr2=0x7fd2080ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:54.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.926+0000 7fd20f999700 1 -- 172.21.15.61:0/3236949557 shutdown_connections 2023-12-24T20:02:54.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:54.926+0000 7fd20f999700 1 -- 172.21.15.61:0/3236949557 wait complete. 2023-12-24T20:02:54.927 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T20:02:54.941 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T20:02:55.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.074+0000 7f3f7b7b6700 1 Processor -- start 2023-12-24T20:02:55.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.074+0000 7f3f7b7b6700 1 -- start start 2023-12-24T20:02:55.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f7b7b6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f741598d0 0x7f3f740b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:55.076 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f7b7b6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f74159ca0 0x7f3f7406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f7b7b6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f740cbf80 con 0x7f3f7406e0b0 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f7b7b6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7415a110 con 0x7f3f741598d0 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f7b7b6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f740b11c0 con 0x7f3f74159ca0 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f79552700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f741598d0 0x7f3f740b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f79d53700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3f7406e0b0 0x7f3f7415d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:59998/0 (socket says 172.21.15.61:59998) 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f79d53700 1 -- 172.21.15.61:0/1451514271 learned_addr learned my addr 172.21.15.61:0/1451514271 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f78d51700 1 --2- 172.21.15.61:0/1451514271 >> v2:172.21.15.133:3300/0 conn(0x7f3f74159ca0 0x7f3f7406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f79552700 1 -- 172.21.15.61:0/1451514271 >> v2:172.21.15.133:3300/0 conn(0x7f3f74159ca0 msgr2=0x7f3f7406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f79552700 1 --2- 172.21.15.61:0/1451514271 >> v2:172.21.15.133:3300/0 conn(0x7f3f74159ca0 0x7f3f7406db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f79552700 1 -- 172.21.15.61:0/1451514271 >> v1:172.21.15.61:6789/0 conn(0x7f3f7406e0b0 legacy=0x7f3f7415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f79552700 1 -- 172.21.15.61:0/1451514271 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740b14a0 con 0x7f3f741598d0 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f6bfff700 1 -- 172.21.15.61:0/1451514271 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258811593 0 0) 0x7f3f740cbf80 con 0x7f3f7406e0b0 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f79552700 1 --2- 172.21.15.61:0/1451514271 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f741598d0 0x7f3f740b2aa0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f3f740cdfd0 tx=0x7f3f700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f431e08b9c561771 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:55.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f6bfff700 1 -- 172.21.15.61:0/1451514271 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000b6b0 con 0x7f3f741598d0 2023-12-24T20:02:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f6bfff700 1 -- 172.21.15.61:0/1451514271 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7000b810 con 0x7f3f741598d0 2023-12-24T20:02:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.075+0000 7f3f6bfff700 1 -- 172.21.15.61:0/1451514271 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000bbb0 con 0x7f3f741598d0 2023-12-24T20:02:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.076+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/1451514271 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f741598d0 msgr2=0x7f3f740b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.076+0000 7f3f7b7b6700 1 --2- 172.21.15.61:0/1451514271 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f741598d0 0x7f3f740b2aa0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f3f740cdfd0 tx=0x7f3f700091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.076+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/1451514271 shutdown_connections 2023-12-24T20:02:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.076+0000 7f3f7b7b6700 1 --2- 172.21.15.61:0/1451514271 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f741598d0 0x7f3f740b2aa0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.076+0000 7f3f7b7b6700 1 --2- 172.21.15.61:0/1451514271 >> v2:172.21.15.133:3300/0 conn(0x7f3f74159ca0 0x7f3f7406db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.076+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/1451514271 >> 172.21.15.61:0/1451514271 conn(0x7f3f74067550 msgr2=0x7f3f74067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.076+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/1451514271 shutdown_connections 2023-12-24T20:02:55.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.076+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/1451514271 wait complete. 2023-12-24T20:02:55.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.077+0000 7f3f7b7b6700 1 Processor -- start 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.077+0000 7f3f7b7b6700 1 -- start start 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f7b7b6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f7406e0b0 0x7f3f74156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f7b7b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f741598d0 0x7f3f740c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f7b7b6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f74159ca0 0x7f3f7415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f7b7b6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7415a7a0 con 0x7f3f7406e0b0 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f7b7b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740c9040 con 0x7f3f741598d0 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f7b7b6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740c8150 con 0x7f3f74159ca0 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f79552700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f7406e0b0 0x7f3f74156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f79552700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f7406e0b0 0x7f3f74156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46590/0 (socket says 172.21.15.61:46590) 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f79552700 1 -- 172.21.15.61:0/3980555404 learned_addr learned my addr 172.21.15.61:0/3980555404 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f79d53700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f74159ca0 0x7f3f7415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f78d51700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f741598d0 0x7f3f740c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:55.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f79552700 1 -- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f74159ca0 msgr2=0x7f3f7415b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f79552700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f74159ca0 0x7f3f7415b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f79552700 1 -- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f741598d0 msgr2=0x7f3f740c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.078+0000 7f3f79552700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f741598d0 0x7f3f740c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.079+0000 7f3f79552700 1 -- 172.21.15.61:0/3980555404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f70009420 con 0x7f3f7406e0b0 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.079+0000 7f3f79552700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f7406e0b0 0x7f3f74156db0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3f74089b20 tx=0x7f3f70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.079+0000 7f3f697fa700 1 -- 172.21.15.61:0/3980555404 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000bb90 con 0x7f3f7406e0b0 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.079+0000 7f3f697fa700 1 -- 172.21.15.61:0/3980555404 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f70011420 con 0x7f3f7406e0b0 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.079+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/3980555404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f740c8430 con 0x7f3f7406e0b0 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.079+0000 7f3f697fa700 1 -- 172.21.15.61:0/3980555404 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700117c0 con 0x7f3f7406e0b0 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.079+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/3980555404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f740c89f0 con 0x7f3f7406e0b0 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.080+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/3980555404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f740b3800 con 0x7f3f7406e0b0 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.080+0000 7f3f697fa700 1 -- 172.21.15.61:0/3980555404 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3f70011bb0 con 0x7f3f7406e0b0 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.081+0000 7f3f697fa700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f58066f30 0x7f3f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.081+0000 7f3f697fa700 1 -- 172.21.15.61:0/3980555404 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f3f70085c30 con 0x7f3f7406e0b0 2023-12-24T20:02:55.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.081+0000 7f3f78d51700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f58066f30 0x7f3f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:55.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.081+0000 7f3f78d51700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f58066f30 0x7f3f580693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3f740ca720 tx=0x7f3f64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:55.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.085+0000 7f3f697fa700 1 -- 172.21.15.61:0/3980555404 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f70052f00 con 0x7f3f7406e0b0 2023-12-24T20:02:55.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.323+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/3980555404 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3f74089120 con 0x7f3f7406e0b0 2023-12-24T20:02:55.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.911+0000 7f3f697fa700 1 -- 172.21.15.61:0/3980555404 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v65) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3f70011e60 con 0x7f3f7406e0b0 2023-12-24T20:02:55.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.916+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f58066f30 msgr2=0x7f3f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:55.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.916+0000 7f3f7b7b6700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f58066f30 0x7f3f580693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3f740ca720 tx=0x7f3f64008040 comp rx=0 tx=0).stop 2023-12-24T20:02:55.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.916+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/3980555404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f7406e0b0 msgr2=0x7f3f74156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:55.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.916+0000 7f3f7b7b6700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f7406e0b0 0x7f3f74156db0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3f74089b20 tx=0x7f3f70017000 comp rx=0 tx=0).stop 2023-12-24T20:02:55.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.919+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/3980555404 shutdown_connections 2023-12-24T20:02:55.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.919+0000 7f3f7b7b6700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f74159ca0 0x7f3f7415b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:55.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.919+0000 7f3f7b7b6700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f58066f30 0x7f3f580693e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:55.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.919+0000 7f3f7b7b6700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f7406e0b0 0x7f3f74156db0 secure :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3f74089b20 tx=0x7f3f70017000 comp rx=0 tx=0).stop 2023-12-24T20:02:55.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.920+0000 7f3f7b7b6700 1 --2- 172.21.15.61:0/3980555404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f741598d0 0x7f3f740c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:55.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.920+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/3980555404 >> 172.21.15.61:0/3980555404 conn(0x7f3f74067550 msgr2=0x7f3f740b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:55.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.924+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/3980555404 shutdown_connections 2023-12-24T20:02:55.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:55.925+0000 7f3f7b7b6700 1 -- 172.21.15.61:0/3980555404 wait complete. 2023-12-24T20:02:55.930 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 16 and data pool 17 2023-12-24T20:02:55.947 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:56.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.074+0000 7fc52c50d700 1 Processor -- start 2023-12-24T20:02:56.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.074+0000 7fc52c50d700 1 -- start start 2023-12-24T20:02:56.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc52c50d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc52415bb60 0x7fc524098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc52c50d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5240b2eb0 con 0x7fc5240b2660 2023-12-24T20:02:56.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc52c50d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5240b2bd0 con 0x7fc524098aa0 2023-12-24T20:02:56.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc52c50d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5240afc20 con 0x7fc52415bb60 2023-12-24T20:02:56.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc52aaaa700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fc5240b2660 0x7fc5240b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60002/0 (socket says 172.21.15.61:60002) 2023-12-24T20:02:56.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc52aaaa700 1 -- 172.21.15.61:0/1407946166 learned_addr learned my addr 172.21.15.61:0/1407946166 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:56.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc52a2a9700 1 --2- 172.21.15.61:0/1407946166 >> v2:172.21.15.133:3300/0 conn(0x7fc52415bb60 0x7fc524098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc5292a7700 1 -- 172.21.15.61:0/1407946166 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774516716 0 0) 0x7fc5240b2eb0 con 0x7fc5240b2660 2023-12-24T20:02:56.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc5292a7700 1 -- 172.21.15.61:0/1407946166 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc510003570 con 0x7fc5240b2660 2023-12-24T20:02:56.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc52a2a9700 1 -- 172.21.15.61:0/1407946166 >> v1:172.21.15.133:6789/0 conn(0x7fc524098aa0 legacy=0x7fc52415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc52a2a9700 1 -- 172.21.15.61:0/1407946166 >> v1:172.21.15.61:6789/0 conn(0x7fc5240b2660 legacy=0x7fc5240b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc5292a7700 1 -- 172.21.15.61:0/1407946166 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 47572127 0 0) 0x7fc510003570 con 0x7fc5240b2660 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.075+0000 7fc52a2a9700 1 -- 172.21.15.61:0/1407946166 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240afe10 con 0x7fc52415bb60 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc52a2a9700 1 --2- 172.21.15.61:0/1407946166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52415bb60 0x7fc524098560 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc5200098d0 tx=0x7fc520009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb6e2ad00dc39d92 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc5292a7700 1 -- 172.21.15.61:0/1407946166 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c0017f0 con 0x7fc52415bb60 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc5292a7700 1 -- 172.21.15.61:0/1407946166 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520011420 con 0x7fc52415bb60 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc5292a7700 1 -- 172.21.15.61:0/1407946166 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200117c0 con 0x7fc52415bb60 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc52c50d700 1 -- 172.21.15.61:0/1407946166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52415bb60 msgr2=0x7fc524098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc52c50d700 1 --2- 172.21.15.61:0/1407946166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52415bb60 0x7fc524098560 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc5200098d0 tx=0x7fc520009120 comp rx=0 tx=0).stop 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc52c50d700 1 -- 172.21.15.61:0/1407946166 shutdown_connections 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc52c50d700 1 --2- 172.21.15.61:0/1407946166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52415bb60 0x7fc524098560 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc52c50d700 1 -- 172.21.15.61:0/1407946166 >> 172.21.15.61:0/1407946166 conn(0x7fc524097a10 msgr2=0x7fc5240ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:56.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc52c50d700 1 -- 172.21.15.61:0/1407946166 shutdown_connections 2023-12-24T20:02:56.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.076+0000 7fc52c50d700 1 -- 172.21.15.61:0/1407946166 wait complete. 2023-12-24T20:02:56.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.077+0000 7fc52c50d700 1 Processor -- start 2023-12-24T20:02:56.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.078+0000 7fc52c50d700 1 -- start start 2023-12-24T20:02:56.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.078+0000 7fc52c50d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc524098aa0 0x7fc52416e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.078+0000 7fc52c50d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5240b2660 0x7fc5240ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.078+0000 7fc52c50d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc52415bb60 0x7fc52415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.078+0000 7fc52c50d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52416af20 con 0x7fc524098aa0 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.078+0000 7fc52c50d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52416e1b0 con 0x7fc5240b2660 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.078+0000 7fc52c50d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5241557a0 con 0x7fc52415bb60 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.078+0000 7fc52a2a9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc524098aa0 0x7fc52416e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.078+0000 7fc52a2a9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc524098aa0 0x7fc52416e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46604/0 (socket says 172.21.15.61:46604) 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.078+0000 7fc52a2a9700 1 -- 172.21.15.61:0/4042597372 learned_addr learned my addr 172.21.15.61:0/4042597372 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc529aa8700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5240b2660 0x7fc5240ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc52aaaa700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc52415bb60 0x7fc52415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc52a2a9700 1 -- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc52415bb60 msgr2=0x7fc52415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc52a2a9700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc52415bb60 0x7fc52415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc52a2a9700 1 -- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5240b2660 msgr2=0x7fc5240ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc52a2a9700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5240b2660 0x7fc5240ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc52a2a9700 1 -- 172.21.15.61:0/4042597372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200093c0 con 0x7fc524098aa0 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc52aaaa700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc52415bb60 0x7fc52415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc52a2a9700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc524098aa0 0x7fc52416e640 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fc520009f70 tx=0x7fc520016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc51a7fc700 1 -- 172.21.15.61:0/4042597372 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52001cc40 con 0x7fc524098aa0 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc51a7fc700 1 -- 172.21.15.61:0/4042597372 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52001cda0 con 0x7fc524098aa0 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc52c50d700 1 -- 172.21.15.61:0/4042597372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52416b120 con 0x7fc524098aa0 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc51a7fc700 1 -- 172.21.15.61:0/4042597372 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52001a680 con 0x7fc524098aa0 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.079+0000 7fc52c50d700 1 -- 172.21.15.61:0/4042597372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52416db60 con 0x7fc524098aa0 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.080+0000 7fc52c50d700 1 -- 172.21.15.61:0/4042597372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52406d440 con 0x7fc524098aa0 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.081+0000 7fc51a7fc700 1 -- 172.21.15.61:0/4042597372 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc52001aa30 con 0x7fc524098aa0 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.081+0000 7fc51a7fc700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc508066f30 0x7fc5080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.081+0000 7fc51a7fc700 1 -- 172.21.15.61:0/4042597372 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc520086140 con 0x7fc524098aa0 2023-12-24T20:02:56.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.081+0000 7fc529aa8700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc508066f30 0x7fc5080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.082+0000 7fc529aa8700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc508066f30 0x7fc5080693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc5240a9600 tx=0x7fc514009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:56.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.086+0000 7fc51a7fc700 1 -- 172.21.15.61:0/4042597372 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5200533b0 con 0x7fc524098aa0 2023-12-24T20:02:56.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.280+0000 7fc52c50d700 1 -- 172.21.15.61:0/4042597372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc52404c3c0 con 0x7fc524098aa0 2023-12-24T20:02:56.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.281+0000 7fc51a7fc700 1 -- 172.21.15.61:0/4042597372 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fc5200569d0 con 0x7fc524098aa0 2023-12-24T20:02:56.283 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:56.283 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":135,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:55.324973+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:53.096572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:54.304286+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 -- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc508066f30 msgr2=0x7fc5080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc508066f30 0x7fc5080693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc5240a9600 tx=0x7fc514009040 comp rx=0 tx=0).stop 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 -- 172.21.15.61:0/4042597372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc524098aa0 msgr2=0x7fc52416e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc524098aa0 0x7fc52416e640 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fc520009f70 tx=0x7fc520016000 comp rx=0 tx=0).stop 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 -- 172.21.15.61:0/4042597372 shutdown_connections 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc52415bb60 0x7fc52415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc508066f30 0x7fc5080693e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc524098aa0 0x7fc52416e640 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 --2- 172.21.15.61:0/4042597372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5240b2660 0x7fc5240ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 -- 172.21.15.61:0/4042597372 >> 172.21.15.61:0/4042597372 conn(0x7fc524097a10 msgr2=0x7fc524098f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:56.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 -- 172.21.15.61:0/4042597372 shutdown_connections 2023-12-24T20:02:56.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.283+0000 7fc52c50d700 1 -- 172.21.15.61:0/4042597372 wait complete. 2023-12-24T20:02:56.296 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:56.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.418+0000 7f9489472700 1 Processor -- start 2023-12-24T20:02:56.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.418+0000 7f9489472700 1 -- start start 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.418+0000 7f9489472700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f948415bb60 0x7f9484098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.418+0000 7f9489472700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9484098aa0 0x7f948415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.418+0000 7f9489472700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f948415c470 0x7f94840b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.418+0000 7f9489472700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94840afc20 con 0x7f948415c470 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.418+0000 7f9489472700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94840b2eb0 con 0x7f948415bb60 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.418+0000 7f9489472700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94840b2bd0 con 0x7f9484098aa0 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f94837fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f948415c470 0x7f94840b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f94837fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f948415c470 0x7f94840b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41350/0 (socket says 172.21.15.61:41350) 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f94837fe700 1 -- 172.21.15.61:0/2797106782 learned_addr learned my addr 172.21.15.61:0/2797106782 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f9482ffd700 1 --2- 172.21.15.61:0/2797106782 >> v2:172.21.15.133:3300/0 conn(0x7f948415bb60 0x7f9484098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f94827fc700 1 --2- 172.21.15.61:0/2797106782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9484098aa0 0x7f948415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f94837fe700 1 -- 172.21.15.61:0/2797106782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9484098aa0 msgr2=0x7f948415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f94837fe700 1 --2- 172.21.15.61:0/2797106782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9484098aa0 0x7f948415bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f94837fe700 1 -- 172.21.15.61:0/2797106782 >> v2:172.21.15.133:3300/0 conn(0x7f948415bb60 msgr2=0x7f9484098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:56.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f94837fe700 1 --2- 172.21.15.61:0/2797106782 >> v2:172.21.15.133:3300/0 conn(0x7f948415bb60 0x7f9484098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f94837fe700 1 -- 172.21.15.61:0/2797106782 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94840afe10 con 0x7f948415c470 2023-12-24T20:02:56.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f9482ffd700 1 --2- 172.21.15.61:0/2797106782 >> v2:172.21.15.133:3300/0 conn(0x7f948415bb60 0x7f9484098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:56.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f94837fe700 1 --2- 172.21.15.61:0/2797106782 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415c470 0x7f94840b08f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f948406d9b0 tx=0x7f947c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524a8aa4ee7fddb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:56.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f9481ffb700 1 -- 172.21.15.61:0/2797106782 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00e070 con 0x7f948415c470 2023-12-24T20:02:56.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f9481ffb700 1 -- 172.21.15.61:0/2797106782 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00ba20 con 0x7f948415c470 2023-12-24T20:02:56.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.419+0000 7f9481ffb700 1 -- 172.21.15.61:0/2797106782 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0092e0 con 0x7f948415c470 2023-12-24T20:02:56.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.420+0000 7f9489472700 1 -- 172.21.15.61:0/2797106782 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415c470 msgr2=0x7f94840b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.420+0000 7f9489472700 1 --2- 172.21.15.61:0/2797106782 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415c470 0x7f94840b08f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f948406d9b0 tx=0x7f947c009840 comp rx=0 tx=0).stop 2023-12-24T20:02:56.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.420+0000 7f9489472700 1 -- 172.21.15.61:0/2797106782 shutdown_connections 2023-12-24T20:02:56.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.420+0000 7f9489472700 1 --2- 172.21.15.61:0/2797106782 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415c470 0x7f94840b08f0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.420+0000 7f9489472700 1 --2- 172.21.15.61:0/2797106782 >> v2:172.21.15.133:3300/0 conn(0x7f948415bb60 0x7f9484098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.420+0000 7f9489472700 1 --2- 172.21.15.61:0/2797106782 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9484098aa0 0x7f948415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.420+0000 7f9489472700 1 -- 172.21.15.61:0/2797106782 >> 172.21.15.61:0/2797106782 conn(0x7f9484097a10 msgr2=0x7f94840ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:56.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.420+0000 7f9489472700 1 -- 172.21.15.61:0/2797106782 shutdown_connections 2023-12-24T20:02:56.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.420+0000 7f9489472700 1 -- 172.21.15.61:0/2797106782 wait complete. 2023-12-24T20:02:56.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.422+0000 7f9489472700 1 Processor -- start 2023-12-24T20:02:56.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.422+0000 7f9489472700 1 -- start start 2023-12-24T20:02:56.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f9489472700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9484098aa0 0x7f9484155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f9489472700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415bb60 0x7f948409b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f9489472700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948415c470 0x7f94840ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f9489472700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948409bb80 con 0x7f948415bb60 2023-12-24T20:02:56.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f9489472700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94840a92d0 con 0x7f948415c470 2023-12-24T20:02:56.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f9489472700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94840ad320 con 0x7f9484098aa0 2023-12-24T20:02:56.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94827fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415bb60 0x7f948409b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94827fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415bb60 0x7f948409b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41356/0 (socket says 172.21.15.61:41356) 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94827fc700 1 -- 172.21.15.61:0/4113212923 learned_addr learned my addr 172.21.15.61:0/4113212923 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94837fe700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948415c470 0x7f94840ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f9482ffd700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9484098aa0 0x7f9484155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94827fc700 1 -- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9484098aa0 msgr2=0x7f9484155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94827fc700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9484098aa0 0x7f9484155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94827fc700 1 -- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948415c470 msgr2=0x7f94840ab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94827fc700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948415c470 0x7f94840ab000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94827fc700 1 -- 172.21.15.61:0/4113212923 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009ae0 con 0x7f948415bb60 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94837fe700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948415c470 0x7f94840ab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f94827fc700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415bb60 0x7f948409b640 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f947800ec80 tx=0x7f94780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.423+0000 7f946affd700 1 -- 172.21.15.61:0/4113212923 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947800c9d0 con 0x7f948415bb60 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.424+0000 7f946affd700 1 -- 172.21.15.61:0/4113212923 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947800cb30 con 0x7f948415bb60 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.424+0000 7f9489472700 1 -- 172.21.15.61:0/4113212923 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94840a8c80 con 0x7f948415bb60 2023-12-24T20:02:56.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.424+0000 7f946affd700 1 -- 172.21.15.61:0/4113212923 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478013470 con 0x7f948415bb60 2023-12-24T20:02:56.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.424+0000 7f9489472700 1 -- 172.21.15.61:0/4113212923 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94840ad600 con 0x7f948415bb60 2023-12-24T20:02:56.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.424+0000 7f9489472700 1 -- 172.21.15.61:0/4113212923 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948409b360 con 0x7f948415bb60 2023-12-24T20:02:56.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.425+0000 7f946affd700 1 -- 172.21.15.61:0/4113212923 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f94780137e0 con 0x7f948415bb60 2023-12-24T20:02:56.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.425+0000 7f946affd700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9470066f60 0x7f9470069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.425+0000 7f946affd700 1 -- 172.21.15.61:0/4113212923 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9478084830 con 0x7f948415bb60 2023-12-24T20:02:56.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.426+0000 7f9482ffd700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9470066f60 0x7f9470069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.426+0000 7f9482ffd700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9470066f60 0x7f9470069410 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9474006ea0 tx=0x7f9474008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:56.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.430+0000 7f946affd700 1 -- 172.21.15.61:0/4113212923 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f948409b360 con 0x7f948415bb60 2023-12-24T20:02:56.624 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.624+0000 7f9489472700 1 -- 172.21.15.61:0/4113212923 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f948409b360 con 0x7f948415bb60 2023-12-24T20:02:56.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.625+0000 7f946affd700 1 -- 172.21.15.61:0/4113212923 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f948409b360 con 0x7f948415bb60 2023-12-24T20:02:56.625 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:56.626 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":135,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:55.324973+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:53.096572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:54.304286+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 -- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9470066f60 msgr2=0x7f9470069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9470066f60 0x7f9470069410 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9474006ea0 tx=0x7f9474008040 comp rx=0 tx=0).stop 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 -- 172.21.15.61:0/4113212923 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415bb60 msgr2=0x7f948409b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415bb60 0x7f948409b640 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f947800ec80 tx=0x7f94780091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 -- 172.21.15.61:0/4113212923 shutdown_connections 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9484098aa0 0x7f9484155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9470066f60 0x7f9470069410 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f948415c470 0x7f94840ab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 --2- 172.21.15.61:0/4113212923 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f948415bb60 0x7f948409b640 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 -- 172.21.15.61:0/4113212923 >> 172.21.15.61:0/4113212923 conn(0x7f9484097a10 msgr2=0x7f94840ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 -- 172.21.15.61:0/4113212923 shutdown_connections 2023-12-24T20:02:56.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.627+0000 7f9489472700 1 -- 172.21.15.61:0/4113212923 wait complete. 2023-12-24T20:02:56.640 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.764+0000 7f0fc28f6700 1 Processor -- start 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.764+0000 7f0fc28f6700 1 -- start start 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.765+0000 7f0fc28f6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0fbc06b320 0x7f0fbc15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.765+0000 7f0fc28f6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06ed20 0x7f0fbc06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.765+0000 7f0fc28f6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc15aa10 con 0x7f0fbc159bb0 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.765+0000 7f0fc28f6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc15b3e0 con 0x7f0fbc06b320 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.765+0000 7f0fc28f6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc06fa30 con 0x7f0fbc06ed20 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.765+0000 7f0fbb7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0fbc06b320 0x7f0fbc15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.765+0000 7f0fbb7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0fbc06b320 0x7f0fbc15aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41364/0 (socket says 172.21.15.61:41364) 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.765+0000 7f0fbb7fe700 1 -- 172.21.15.61:0/3634556431 learned_addr learned my addr 172.21.15.61:0/3634556431 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:56.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.766+0000 7f0fc0e93700 1 --2- 172.21.15.61:0/3634556431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06ed20 0x7f0fbc06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.766+0000 7f0fbb7fe700 1 -- 172.21.15.61:0/3634556431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06ed20 msgr2=0x7f0fbc06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.766+0000 7f0fbb7fe700 1 --2- 172.21.15.61:0/3634556431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06ed20 0x7f0fbc06f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.766+0000 7f0fbb7fe700 1 -- 172.21.15.61:0/3634556431 >> v1:172.21.15.133:6789/0 conn(0x7f0fbc159bb0 legacy=0x7f0fbc06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.766+0000 7f0fbb7fe700 1 -- 172.21.15.61:0/3634556431 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc15a3c0 con 0x7f0fbc06b320 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.766+0000 7f0fbb7fe700 1 --2- 172.21.15.61:0/3634556431 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc06b320 0x7f0fbc15aea0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00099b0 tx=0x7f0fb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce101c0bcf41a51 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.766+0000 7f0fbaffd700 1 -- 172.21.15.61:0/3634556431 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000b820 con 0x7f0fbc06b320 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.766+0000 7f0fbaffd700 1 -- 172.21.15.61:0/3634556431 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000b980 con 0x7f0fbc06b320 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.766+0000 7f0fbaffd700 1 -- 172.21.15.61:0/3634556431 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000bd20 con 0x7f0fbc06b320 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.767+0000 7f0fc28f6700 1 -- 172.21.15.61:0/3634556431 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc06b320 msgr2=0x7f0fbc15aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.767+0000 7f0fc28f6700 1 --2- 172.21.15.61:0/3634556431 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc06b320 0x7f0fbc15aea0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00099b0 tx=0x7f0fb0009250 comp rx=0 tx=0).stop 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.767+0000 7f0fc28f6700 1 -- 172.21.15.61:0/3634556431 shutdown_connections 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.767+0000 7f0fc28f6700 1 --2- 172.21.15.61:0/3634556431 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06ed20 0x7f0fbc06f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.767+0000 7f0fc28f6700 1 --2- 172.21.15.61:0/3634556431 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc06b320 0x7f0fbc15aea0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.767+0000 7f0fc28f6700 1 -- 172.21.15.61:0/3634556431 >> 172.21.15.61:0/3634556431 conn(0x7f0fbc0ce800 msgr2=0x7f0fbc0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:56.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.767+0000 7f0fc28f6700 1 -- 172.21.15.61:0/3634556431 shutdown_connections 2023-12-24T20:02:56.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.767+0000 7f0fc28f6700 1 -- 172.21.15.61:0/3634556431 wait complete. 2023-12-24T20:02:56.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.768+0000 7f0fc28f6700 1 Processor -- start 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.768+0000 7f0fc28f6700 1 -- start start 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc28f6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06b320 0x7f0fbc0b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc28f6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fbc06ed20 0x7f0fbc0afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc28f6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc159bb0 0x7f0fbc157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc28f6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c5810 con 0x7f0fbc159bb0 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc28f6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc16d8a0 con 0x7f0fbc06ed20 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc28f6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc16db80 con 0x7f0fbc06b320 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc0e93700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc159bb0 0x7f0fbc157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc0e93700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc159bb0 0x7f0fbc157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41376/0 (socket says 172.21.15.61:41376) 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc0e93700 1 -- 172.21.15.61:0/79333370 learned_addr learned my addr 172.21.15.61:0/79333370 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fbb7fe700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fbc06ed20 0x7f0fbc0afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fbbfff700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06b320 0x7f0fbc0b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc0e93700 1 -- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06b320 msgr2=0x7f0fbc0b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc0e93700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06b320 0x7f0fbc0b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc0e93700 1 -- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fbc06ed20 msgr2=0x7f0fbc0afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc0e93700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fbc06ed20 0x7f0fbc0afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc0e93700 1 -- 172.21.15.61:0/79333370 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb00094f0 con 0x7f0fbc159bb0 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fbbfff700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06b320 0x7f0fbc0b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fc0e93700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc159bb0 0x7f0fbc157ca0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009fa0 tx=0x7f0fb4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fa3fff700 1 -- 172.21.15.61:0/79333370 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400ec70 con 0x7f0fbc159bb0 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.769+0000 7f0fa3fff700 1 -- 172.21.15.61:0/79333370 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb400edd0 con 0x7f0fbc159bb0 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.770+0000 7f0fa3fff700 1 -- 172.21.15.61:0/79333370 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4014670 con 0x7f0fbc159bb0 2023-12-24T20:02:56.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.770+0000 7f0fc28f6700 1 -- 172.21.15.61:0/79333370 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc16de60 con 0x7f0fbc159bb0 2023-12-24T20:02:56.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.770+0000 7f0fc28f6700 1 -- 172.21.15.61:0/79333370 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc0b2650 con 0x7f0fbc159bb0 2023-12-24T20:02:56.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.770+0000 7f0fc28f6700 1 -- 172.21.15.61:0/79333370 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc0c5980 con 0x7f0fbc159bb0 2023-12-24T20:02:56.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.771+0000 7f0fa3fff700 1 -- 172.21.15.61:0/79333370 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0fb40149e0 con 0x7f0fbc159bb0 2023-12-24T20:02:56.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.771+0000 7f0fa3fff700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fa8066f30 0x7f0fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:56.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.771+0000 7f0fa3fff700 1 -- 172.21.15.61:0/79333370 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0fb4084c70 con 0x7f0fbc159bb0 2023-12-24T20:02:56.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.772+0000 7f0fbbfff700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fa8066f30 0x7f0fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:56.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.772+0000 7f0fbbfff700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fa8066f30 0x7f0fa80693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0fac007fd0 tx=0x7f0fac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:56.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:56.776+0000 7f0fa3fff700 1 -- 172.21.15.61:0/79333370 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fb4051ee0 con 0x7f0fbc159bb0 2023-12-24T20:02:57.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.025+0000 7f0fc28f6700 1 -- 172.21.15.61:0/79333370 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0fbc04c3c0 con 0x7f0fbc159bb0 2023-12-24T20:02:57.256 INFO:tasks.ceph.mds.b.smithi133.stderr:2023-12-24T20:02:57.255+0000 7f59a4caf700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:02:57.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.932+0000 7f0fa3fff700 1 -- 172.21.15.61:0/79333370 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0fb4055500 con 0x7f0fbc159bb0 2023-12-24T20:02:57.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 -- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fa8066f30 msgr2=0x7f0fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:57.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fa8066f30 0x7f0fa80693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0fac007fd0 tx=0x7f0fac009040 comp rx=0 tx=0).stop 2023-12-24T20:02:57.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 -- 172.21.15.61:0/79333370 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc159bb0 msgr2=0x7f0fbc157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:57.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc159bb0 0x7f0fbc157ca0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009fa0 tx=0x7f0fb4009900 comp rx=0 tx=0).stop 2023-12-24T20:02:57.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 -- 172.21.15.61:0/79333370 shutdown_connections 2023-12-24T20:02:57.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0fbc06b320 0x7f0fbc0b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:57.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0fa8066f30 0x7f0fa80693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:57.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0fbc159bb0 0x7f0fbc157ca0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:57.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 --2- 172.21.15.61:0/79333370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fbc06ed20 0x7f0fbc0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:57.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 -- 172.21.15.61:0/79333370 >> 172.21.15.61:0/79333370 conn(0x7f0fbc0ce800 msgr2=0x7f0fbc15b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:57.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 -- 172.21.15.61:0/79333370 shutdown_connections 2023-12-24T20:02:57.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:57.935+0000 7f0fc28f6700 1 -- 172.21.15.61:0/79333370 wait complete. 2023-12-24T20:02:57.951 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T20:02:58.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.082+0000 7f5ca21fb700 1 Processor -- start 2023-12-24T20:02:58.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.082+0000 7f5ca21fb700 1 -- start start 2023-12-24T20:02:58.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5ca21fb700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5c9c0af0c0 0x7f5c9c069400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:58.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5ca21fb700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c1590e0 con 0x7f5c9c06e980 2023-12-24T20:02:58.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5ca21fb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c1584d0 con 0x7f5c9c0aecf0 2023-12-24T20:02:58.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5ca21fb700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c1587b0 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5c9affd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5c9c0af0c0 0x7f5c9c069400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:58.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5c9bfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f5c9c06e980 0x7f5c9c06eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45906/0 (socket says 172.21.15.61:45906) 2023-12-24T20:02:58.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5c9bfff700 1 -- 172.21.15.61:0/378783281 learned_addr learned my addr 172.21.15.61:0/378783281 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:58.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5c9affd700 1 -- 172.21.15.61:0/378783281 >> v1:172.21.15.133:6789/0 conn(0x7f5c9c0aecf0 legacy=0x7f5c9c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:58.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5c9affd700 1 -- 172.21.15.61:0/378783281 >> v1:172.21.15.61:6789/0 conn(0x7f5c9c06e980 legacy=0x7f5c9c06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:58.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5c9affd700 1 -- 172.21.15.61:0/378783281 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c158a90 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5c9affd700 1 --2- 172.21.15.61:0/378783281 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 0x7f5c9c069400 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0098e0 tx=0x7f5c8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a12db4d0fada13 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:58.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5c9a7fc700 1 -- 172.21.15.61:0/378783281 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c009e80 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.083+0000 7f5c9a7fc700 1 -- 172.21.15.61:0/378783281 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00b860 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.084+0000 7f5c9a7fc700 1 -- 172.21.15.61:0/378783281 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00bbe0 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.084+0000 7f5ca21fb700 1 -- 172.21.15.61:0/378783281 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 msgr2=0x7f5c9c069400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:58.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.084+0000 7f5ca21fb700 1 --2- 172.21.15.61:0/378783281 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 0x7f5c9c069400 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0098e0 tx=0x7f5c8c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:58.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.084+0000 7f5ca21fb700 1 -- 172.21.15.61:0/378783281 shutdown_connections 2023-12-24T20:02:58.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.084+0000 7f5ca21fb700 1 --2- 172.21.15.61:0/378783281 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 0x7f5c9c069400 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:58.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.084+0000 7f5ca21fb700 1 -- 172.21.15.61:0/378783281 >> 172.21.15.61:0/378783281 conn(0x7f5c9c067fd0 msgr2=0x7f5c9c0ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:58.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.084+0000 7f5ca21fb700 1 -- 172.21.15.61:0/378783281 shutdown_connections 2023-12-24T20:02:58.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.084+0000 7f5ca21fb700 1 -- 172.21.15.61:0/378783281 wait complete. 2023-12-24T20:02:58.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.085+0000 7f5ca21fb700 1 Processor -- start 2023-12-24T20:02:58.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.085+0000 7f5ca21fb700 1 -- start start 2023-12-24T20:02:58.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.086+0000 7f5ca21fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c06e980 0x7f5c9c150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:58.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.086+0000 7f5ca21fb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c0aecf0 0x7f5c9c0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:58.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.086+0000 7f5ca21fb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 0x7f5c9c15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:58.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.086+0000 7f5ca21fb700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0b2400 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.086+0000 7f5ca21fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0b2570 con 0x7f5c9c06e980 2023-12-24T20:02:58.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.086+0000 7f5ca21fb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c151370 con 0x7f5c9c0aecf0 2023-12-24T20:02:58.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.086+0000 7f5c9bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 0x7f5c9c15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:58.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.086+0000 7f5c9bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 0x7f5c9c15bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41394/0 (socket says 172.21.15.61:41394) 2023-12-24T20:02:58.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.086+0000 7f5c9bfff700 1 -- 172.21.15.61:0/1177819356 learned_addr learned my addr 172.21.15.61:0/1177819356 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c9affd700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c0aecf0 0x7f5c9c0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c9b7fe700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c06e980 0x7f5c9c150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c9bfff700 1 -- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c0aecf0 msgr2=0x7f5c9c0c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c9bfff700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c0aecf0 0x7f5c9c0c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c9bfff700 1 -- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c06e980 msgr2=0x7f5c9c150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c9bfff700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c06e980 0x7f5c9c150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c9bfff700 1 -- 172.21.15.61:0/1177819356 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c009420 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c9b7fe700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c06e980 0x7f5c9c150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c9bfff700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 0x7f5c9c15bb20 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400cbc0 tx=0x7f5c940019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c837fe700 1 -- 172.21.15.61:0/1177819356 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400a940 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c837fe700 1 -- 172.21.15.61:0/1177819356 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9400aaa0 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5ca21fb700 1 -- 172.21.15.61:0/1177819356 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9c0afed0 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5c837fe700 1 -- 172.21.15.61:0/1177819356 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400ae20 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.087+0000 7f5ca21fb700 1 -- 172.21.15.61:0/1177819356 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9c0b2aa0 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.088+0000 7f5ca21fb700 1 -- 172.21.15.61:0/1177819356 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9c0c9760 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.088+0000 7f5c837fe700 1 -- 172.21.15.61:0/1177819356 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5c94007300 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.089+0000 7f5c837fe700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5c88066f30 0x7f5c880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:58.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.089+0000 7f5c837fe700 1 -- 172.21.15.61:0/1177819356 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c94084930 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.089+0000 7f5c9b7fe700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5c88066f30 0x7f5c880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:58.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.089+0000 7f5c9b7fe700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5c88066f30 0x7f5c880693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5c90001840 tx=0x7f5c90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:58.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.093+0000 7f5c837fe700 1 -- 172.21.15.61:0/1177819356 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c94051b90 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.335+0000 7f5ca21fb700 1 -- 172.21.15.61:0/1177819356 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5c9c04c3c0 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.940+0000 7f5c837fe700 1 -- 172.21.15.61:0/1177819356 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5c940551b0 con 0x7f5c9c0af0c0 2023-12-24T20:02:58.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 -- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5c88066f30 msgr2=0x7f5c880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:58.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5c88066f30 0x7f5c880693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5c90001840 tx=0x7f5c90009040 comp rx=0 tx=0).stop 2023-12-24T20:02:58.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 -- 172.21.15.61:0/1177819356 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 msgr2=0x7f5c9c15bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:58.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 0x7f5c9c15bb20 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400cbc0 tx=0x7f5c940019c0 comp rx=0 tx=0).stop 2023-12-24T20:02:58.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 -- 172.21.15.61:0/1177819356 shutdown_connections 2023-12-24T20:02:58.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5c88066f30 0x7f5c880693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:58.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c9c0af0c0 0x7f5c9c15bb20 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:58.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c9c06e980 0x7f5c9c150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:58.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 --2- 172.21.15.61:0/1177819356 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c9c0aecf0 0x7f5c9c0c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:58.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 -- 172.21.15.61:0/1177819356 >> 172.21.15.61:0/1177819356 conn(0x7f5c9c067fd0 msgr2=0x7f5c9c151690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:58.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 -- 172.21.15.61:0/1177819356 shutdown_connections 2023-12-24T20:02:58.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:58.943+0000 7f5ca21fb700 1 -- 172.21.15.61:0/1177819356 wait complete. 2023-12-24T20:02:58.957 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:02:59.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.084+0000 7fedebcc3700 1 Processor -- start 2023-12-24T20:02:59.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.084+0000 7fedebcc3700 1 -- start start 2023-12-24T20:02:59.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.085+0000 7fedebcc3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fede4159850 0x7fede4159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.085+0000 7fedebcc3700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede406a630 con 0x7fede40caa80 2023-12-24T20:02:59.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.085+0000 7fedebcc3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede4069d00 con 0x7fede406aac0 2023-12-24T20:02:59.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.085+0000 7fedebcc3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede40cccf0 con 0x7fede4159850 2023-12-24T20:02:59.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.085+0000 7fedea260700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fede40caa80 0x7fede40aa880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45920/0 (socket says 172.21.15.61:45920) 2023-12-24T20:02:59.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.085+0000 7fedea260700 1 -- 172.21.15.61:0/3326701213 learned_addr learned my addr 172.21.15.61:0/3326701213 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:59.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.085+0000 7fede9a5f700 1 --2- 172.21.15.61:0/3326701213 >> v2:172.21.15.133:3300/0 conn(0x7fede4159850 0x7fede4159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.085+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435725109 0 0) 0x7fede406a630 con 0x7fede40caa80 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.085+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd0003570 con 0x7fede40caa80 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266932907 0 0) 0x7fede4069d00 con 0x7fede406aac0 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fede406a630 con 0x7fede406aac0 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 240857548 0 0) 0x7fedd0003570 con 0x7fede40caa80 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 >> v2:172.21.15.133:3300/0 conn(0x7fede4159850 msgr2=0x7fede4159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 --2- 172.21.15.61:0/3326701213 >> v2:172.21.15.133:3300/0 conn(0x7fede4159850 0x7fede4159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 >> v1:172.21.15.133:6789/0 conn(0x7fede406aac0 legacy=0x7fede40cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4069fe0 con 0x7fede40caa80 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7feddc0017f0 con 0x7fede40caa80 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 >> v1:172.21.15.61:6789/0 conn(0x7fede40caa80 legacy=0x7fede40aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd0003c40 0x7fedd0004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedd0004810 0x7fedd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedd0005280 0x7fedd000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede40cccf0 con 0x7fedd0005280 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd000c250 con 0x7fedd0004810 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd000c410 con 0x7fedd0003c40 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fedea260700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedd0005280 0x7fedd000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede925e700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedd0004810 0x7fedd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fede9a5f700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd0003c40 0x7fedd0004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fedea260700 1 -- 172.21.15.61:0/3326701213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd0003c40 msgr2=0x7fedd0004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fedea260700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd0003c40 0x7fedd0004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fedea260700 1 -- 172.21.15.61:0/3326701213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedd0004810 msgr2=0x7fedd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fedea260700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedd0004810 0x7fedd0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fedea260700 1 -- 172.21.15.61:0/3326701213 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd0003570 con 0x7fedd0005280 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fedea260700 1 -- 172.21.15.61:0/3326701213 reap_dead start 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.086+0000 7fedea260700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedd0005280 0x7fedd000ba60 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7feddc00a800 tx=0x7fede406a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc41887373c860c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.087+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0071a0 con 0x7fedd0005280 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.087+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc007300 con 0x7fedd0005280 2023-12-24T20:02:59.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.087+0000 7fede8a5d700 1 -- 172.21.15.61:0/3326701213 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0076c0 con 0x7fedd0005280 2023-12-24T20:02:59.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.087+0000 7fedebcc3700 1 -- 172.21.15.61:0/3326701213 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedd0005280 msgr2=0x7fedd000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.087+0000 7fedebcc3700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedd0005280 0x7fedd000ba60 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7feddc00a800 tx=0x7fede406a5a0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.087+0000 7fedebcc3700 1 -- 172.21.15.61:0/3326701213 shutdown_connections 2023-12-24T20:02:59.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.087+0000 7fedebcc3700 1 --2- 172.21.15.61:0/3326701213 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fedd0005280 0x7fedd000ba60 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.087+0000 7fedebcc3700 1 -- 172.21.15.61:0/3326701213 >> 172.21.15.61:0/3326701213 conn(0x7fede40cceb0 msgr2=0x7fede40cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:59.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.087+0000 7fedebcc3700 1 -- 172.21.15.61:0/3326701213 shutdown_connections 2023-12-24T20:02:59.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.087+0000 7fedebcc3700 1 -- 172.21.15.61:0/3326701213 wait complete. 2023-12-24T20:02:59.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.088+0000 7fedebcc3700 1 Processor -- start 2023-12-24T20:02:59.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.088+0000 7fedebcc3700 1 -- start start 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fedebcc3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd0005280 0x7fede414b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fedebcc3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fede415b110 0x7fede414d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fedebcc3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede414dc70 0x7fede415c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fedebcc3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede40b0e40 con 0x7fede415b110 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fedebcc3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede40b1120 con 0x7fede414dc70 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fedebcc3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede40b1400 con 0x7fedd0005280 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fede925e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fede415b110 0x7fede414d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fede925e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fede415b110 0x7fede414d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41422/0 (socket says 172.21.15.61:41422) 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fede925e700 1 -- 172.21.15.61:0/2972680485 learned_addr learned my addr 172.21.15.61:0/2972680485 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fede9a5f700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd0005280 0x7fede414b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fedea260700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede414dc70 0x7fede415c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fede925e700 1 -- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd0005280 msgr2=0x7fede414b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.089+0000 7fede925e700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd0005280 0x7fede414b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.090+0000 7fede925e700 1 -- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede414dc70 msgr2=0x7fede415c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.090+0000 7fede925e700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede414dc70 0x7fede415c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.090+0000 7fede925e700 1 -- 172.21.15.61:0/2972680485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede40b16e0 con 0x7fede415b110 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.090+0000 7fede925e700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fede415b110 0x7fede414d730 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fedd40010e0 tx=0x7fedd4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.090+0000 7fedd9ffb700 1 -- 172.21.15.61:0/2972680485 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400f8d0 con 0x7fede415b110 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.090+0000 7fedd9ffb700 1 -- 172.21.15.61:0/2972680485 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd400fa30 con 0x7fede415b110 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.090+0000 7fedebcc3700 1 -- 172.21.15.61:0/2972680485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede40b19c0 con 0x7fede415b110 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.090+0000 7fedd9ffb700 1 -- 172.21.15.61:0/2972680485 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400fdf0 con 0x7fede415b110 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.090+0000 7fedebcc3700 1 -- 172.21.15.61:0/2972680485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede415a340 con 0x7fede415b110 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.091+0000 7fedebcc3700 1 -- 172.21.15.61:0/2972680485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede404c3c0 con 0x7fede415b110 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.091+0000 7fedd9ffb700 1 -- 172.21.15.61:0/2972680485 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fedd4013600 con 0x7fede415b110 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.092+0000 7fedd9ffb700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedc8066fb0 0x7fedc8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.092+0000 7fedd9ffb700 1 -- 172.21.15.61:0/2972680485 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fedd4084b50 con 0x7fede415b110 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.092+0000 7fede9a5f700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedc8066fb0 0x7fedc8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.093+0000 7fede9a5f700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedc8066fb0 0x7fedc8069460 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fede0006f00 tx=0x7fede00091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:59.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.096+0000 7fedd9ffb700 1 -- 172.21.15.61:0/2972680485 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedd4051d20 con 0x7fede415b110 2023-12-24T20:02:59.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.335+0000 7fedebcc3700 1 -- 172.21.15.61:0/2972680485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fede406a2c0 con 0x7fede415b110 2023-12-24T20:02:59.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.335+0000 7fedd9ffb700 1 -- 172.21.15.61:0/2972680485 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fedd4017090 con 0x7fede415b110 2023-12-24T20:02:59.336 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:59.336 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3245805399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3245805399},{"type":"v1","addr":"172.21.15.133:6837","nonce":3245805399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/4168448475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":4168448475},{"type":"v1","addr":"172.21.15.61:6835","nonce":4168448475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1817856586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1817856586},{"type":"v1","addr":"172.21.15.61:6834","nonce":1817856586}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:55.325289+0000","modified":"2023-12-24T20:02:58.932577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7089},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7089":{"gid":7089,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2704897796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2704897796},{"type":"v1","addr":"172.21.15.133:6836","nonce":2704897796}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T20:02:59.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 -- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedc8066fb0 msgr2=0x7fedc8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedc8066fb0 0x7fedc8069460 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fede0006f00 tx=0x7fede00091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 -- 172.21.15.61:0/2972680485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fede415b110 msgr2=0x7fede414d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fede415b110 0x7fede414d730 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fedd40010e0 tx=0x7fedd4007d30 comp rx=0 tx=0).stop 2023-12-24T20:02:59.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 -- 172.21.15.61:0/2972680485 shutdown_connections 2023-12-24T20:02:59.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fedd0005280 0x7fede414b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fedc8066fb0 0x7fedc8069460 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fede414dc70 0x7fede415c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 --2- 172.21.15.61:0/2972680485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fede415b110 0x7fede414d730 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 -- 172.21.15.61:0/2972680485 >> 172.21.15.61:0/2972680485 conn(0x7fede40cceb0 msgr2=0x7fede406df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:59.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 -- 172.21.15.61:0/2972680485 shutdown_connections 2023-12-24T20:02:59.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.337+0000 7fedebcc3700 1 -- 172.21.15.61:0/2972680485 wait complete. 2023-12-24T20:02:59.340 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 69 2023-12-24T20:02:59.350 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:02:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.471+0000 7f36df6dc700 1 Processor -- start 2023-12-24T20:02:59.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.471+0000 7f36df6dc700 1 -- start start 2023-12-24T20:02:59.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.472+0000 7f36df6dc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36d8063ac0 0x7f36d80af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.472+0000 7f36df6dc700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d8158b70 con 0x7f36d8157730 2023-12-24T20:02:59.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.472+0000 7f36df6dc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36d8158240 con 0x7f36d80c94b0 2023-12-24T20:02:59.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.472+0000 7f36df6dc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d8158520 con 0x7f36d8063ac0 2023-12-24T20:02:59.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.472+0000 7f36dd478700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f36d8157730 0x7f36d80c8da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45936/0 (socket says 172.21.15.61:45936) 2023-12-24T20:02:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.472+0000 7f36dd478700 1 -- 172.21.15.61:0/645829178 learned_addr learned my addr 172.21.15.61:0/645829178 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.472+0000 7f36ddc79700 1 --2- 172.21.15.61:0/645829178 >> v2:172.21.15.133:3300/0 conn(0x7f36d8063ac0 0x7f36d80af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36cffff700 1 -- 172.21.15.61:0/645829178 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202064229 0 0) 0x7f36d8158b70 con 0x7f36d8157730 2023-12-24T20:02:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36cffff700 1 -- 172.21.15.61:0/645829178 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c4003570 con 0x7f36d8157730 2023-12-24T20:02:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36cffff700 1 -- 172.21.15.61:0/645829178 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265028504 0 0) 0x7f36d8158240 con 0x7f36d80c94b0 2023-12-24T20:02:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36cffff700 1 -- 172.21.15.61:0/645829178 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d8158b70 con 0x7f36d80c94b0 2023-12-24T20:02:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36ddc79700 1 -- 172.21.15.61:0/645829178 >> v1:172.21.15.133:6789/0 conn(0x7f36d80c94b0 legacy=0x7f36d815f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36ddc79700 1 -- 172.21.15.61:0/645829178 >> v1:172.21.15.61:6789/0 conn(0x7f36d8157730 legacy=0x7f36d80c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36ddc79700 1 -- 172.21.15.61:0/645829178 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8158800 con 0x7f36d8063ac0 2023-12-24T20:02:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36ddc79700 1 --2- 172.21.15.61:0/645829178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36d8063ac0 0x7f36d80af3f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009e60 tx=0x7f36d0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9735cb203ca9c75 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36cffff700 1 -- 172.21.15.61:0/645829178 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d000e070 con 0x7f36d8063ac0 2023-12-24T20:02:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36cffff700 1 -- 172.21.15.61:0/645829178 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d000bab0 con 0x7f36d8063ac0 2023-12-24T20:02:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.473+0000 7f36cffff700 1 -- 172.21.15.61:0/645829178 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d000be70 con 0x7f36d8063ac0 2023-12-24T20:02:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.474+0000 7f36df6dc700 1 -- 172.21.15.61:0/645829178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36d8063ac0 msgr2=0x7f36d80af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.474+0000 7f36df6dc700 1 --2- 172.21.15.61:0/645829178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36d8063ac0 0x7f36d80af3f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009e60 tx=0x7f36d0009780 comp rx=0 tx=0).stop 2023-12-24T20:02:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.474+0000 7f36df6dc700 1 -- 172.21.15.61:0/645829178 shutdown_connections 2023-12-24T20:02:59.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.474+0000 7f36df6dc700 1 --2- 172.21.15.61:0/645829178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36d8063ac0 0x7f36d80af3f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.474+0000 7f36df6dc700 1 -- 172.21.15.61:0/645829178 >> 172.21.15.61:0/645829178 conn(0x7f36d80cceb0 msgr2=0x7f36d80cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:59.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.474+0000 7f36df6dc700 1 -- 172.21.15.61:0/645829178 shutdown_connections 2023-12-24T20:02:59.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.474+0000 7f36df6dc700 1 -- 172.21.15.61:0/645829178 wait complete. 2023-12-24T20:02:59.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.475+0000 7f36df6dc700 1 Processor -- start 2023-12-24T20:02:59.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.475+0000 7f36df6dc700 1 -- start start 2023-12-24T20:02:59.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.476+0000 7f36df6dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36d8063ac0 0x7f36d8156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.476+0000 7f36df6dc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36d80c94b0 0x7f36d80c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.476+0000 7f36df6dc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f36d8157730 0x7f36d80c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.476+0000 7f36df6dc700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d8168040 con 0x7f36d8157730 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36df6dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d815ca70 con 0x7f36d8063ac0 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36df6dc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d815cd50 con 0x7f36d80c94b0 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36ddc79700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f36d8157730 0x7f36d80c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36ddc79700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f36d8157730 0x7f36d80c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41438/0 (socket says 172.21.15.61:41438) 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36ddc79700 1 -- 172.21.15.61:0/3370669394 learned_addr learned my addr 172.21.15.61:0/3370669394 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36dd478700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36d8063ac0 0x7f36d8156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36dcc77700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36d80c94b0 0x7f36d80c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36ddc79700 1 -- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36d80c94b0 msgr2=0x7f36d80c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36ddc79700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36d80c94b0 0x7f36d80c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36ddc79700 1 -- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36d8063ac0 msgr2=0x7f36d8156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36ddc79700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36d8063ac0 0x7f36d8156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36ddc79700 1 -- 172.21.15.61:0/3370669394 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d0009a20 con 0x7f36d8157730 2023-12-24T20:02:59.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36dd478700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36d8063ac0 0x7f36d8156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:59.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36dcc77700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36d80c94b0 0x7f36d80c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:02:59.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36ddc79700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f36d8157730 0x7f36d80c48c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009460 tx=0x7f36d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:59.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36cd7fa700 1 -- 172.21.15.61:0/3370669394 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0026480 con 0x7f36d8157730 2023-12-24T20:02:59.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36cd7fa700 1 -- 172.21.15.61:0/3370669394 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d00265e0 con 0x7f36d8157730 2023-12-24T20:02:59.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36df6dc700 1 -- 172.21.15.61:0/3370669394 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d81679f0 con 0x7f36d8157730 2023-12-24T20:02:59.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36cd7fa700 1 -- 172.21.15.61:0/3370669394 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00269a0 con 0x7f36d8157730 2023-12-24T20:02:59.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.477+0000 7f36df6dc700 1 -- 172.21.15.61:0/3370669394 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d8156d90 con 0x7f36d8157730 2023-12-24T20:02:59.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.478+0000 7f36df6dc700 1 -- 172.21.15.61:0/3370669394 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d81681f0 con 0x7f36d8157730 2023-12-24T20:02:59.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.479+0000 7f36cd7fa700 1 -- 172.21.15.61:0/3370669394 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f36d0026d50 con 0x7f36d8157730 2023-12-24T20:02:59.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.479+0000 7f36cd7fa700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36bc066f30 0x7f36bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.479+0000 7f36cd7fa700 1 -- 172.21.15.61:0/3370669394 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36d0086560 con 0x7f36d8157730 2023-12-24T20:02:59.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.479+0000 7f36dd478700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36bc066f30 0x7f36bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.480+0000 7f36dd478700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36bc066f30 0x7f36bc0693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f36d4007fd0 tx=0x7f36d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:59.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.484+0000 7f36cd7fa700 1 -- 172.21.15.61:0/3370669394 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36d81681f0 con 0x7f36d8157730 2023-12-24T20:02:59.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.684+0000 7f36df6dc700 1 -- 172.21.15.61:0/3370669394 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36d804c3c0 con 0x7f36d8157730 2023-12-24T20:02:59.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.684+0000 7f36cd7fa700 1 -- 172.21.15.61:0/3370669394 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f36d00537d0 con 0x7f36d8157730 2023-12-24T20:02:59.685 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:02:59.685 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":136,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:02:56.909468+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:53.096572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:54.304286+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:02:59.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 -- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36bc066f30 msgr2=0x7f36bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36bc066f30 0x7f36bc0693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f36d4007fd0 tx=0x7f36d4009040 comp rx=0 tx=0).stop 2023-12-24T20:02:59.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 -- 172.21.15.61:0/3370669394 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f36d8157730 msgr2=0x7f36d80c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f36d8157730 0x7f36d80c48c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f36d0009460 tx=0x7f36d0019000 comp rx=0 tx=0).stop 2023-12-24T20:02:59.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 -- 172.21.15.61:0/3370669394 shutdown_connections 2023-12-24T20:02:59.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f36bc066f30 0x7f36bc0693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f36d8157730 0x7f36d80c48c0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36d8063ac0 0x7f36d8156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 --2- 172.21.15.61:0/3370669394 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f36d80c94b0 0x7f36d80c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 -- 172.21.15.61:0/3370669394 >> 172.21.15.61:0/3370669394 conn(0x7f36d80cceb0 msgr2=0x7f36d80c2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:59.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 -- 172.21.15.61:0/3370669394 shutdown_connections 2023-12-24T20:02:59.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.687+0000 7f36df6dc700 1 -- 172.21.15.61:0/3370669394 wait complete. 2023-12-24T20:02:59.700 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T20:02:59.700 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:02:59.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.821+0000 7fb0a232e700 1 Processor -- start 2023-12-24T20:02:59.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.821+0000 7fb0a232e700 1 -- start start 2023-12-24T20:02:59.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb0a232e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb09c068510 0x7fb09c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb0a232e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c0b2890 con 0x7fb09c159a60 2023-12-24T20:02:59.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb0a232e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c0cf630 con 0x7fb09c068140 2023-12-24T20:02:59.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb0a232e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0b2240 con 0x7fb09c068510 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb09b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb09c068510 0x7fb09c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb0a08cb700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb09c159a60 0x7fb09c159ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45944/0 (socket says 172.21.15.61:45944) 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb0a08cb700 1 -- 172.21.15.61:0/727932799 learned_addr learned my addr 172.21.15.61:0/727932799 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb09b7fe700 1 -- 172.21.15.61:0/727932799 >> v1:172.21.15.133:6789/0 conn(0x7fb09c068140 legacy=0x7fb09c0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb09b7fe700 1 -- 172.21.15.61:0/727932799 >> v1:172.21.15.61:6789/0 conn(0x7fb09c159a60 legacy=0x7fb09c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb09b7fe700 1 -- 172.21.15.61:0/727932799 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0b2520 con 0x7fb09c068510 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb09affd700 1 -- 172.21.15.61:0/727932799 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837945740 0 0) 0x7fb09c0b2890 con 0x7fb09c159a60 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.822+0000 7fb09b7fe700 1 --2- 172.21.15.61:0/727932799 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068510 0x7fb09c0cefa0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fb0840098e0 tx=0x7fb0840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcee58569434f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.823+0000 7fb09affd700 1 -- 172.21.15.61:0/727932799 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084009e80 con 0x7fb09c068510 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.823+0000 7fb09affd700 1 -- 172.21.15.61:0/727932799 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08400b860 con 0x7fb09c068510 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.823+0000 7fb09affd700 1 -- 172.21.15.61:0/727932799 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08400bbe0 con 0x7fb09c068510 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.823+0000 7fb0a232e700 1 -- 172.21.15.61:0/727932799 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068510 msgr2=0x7fb09c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.823+0000 7fb0a232e700 1 --2- 172.21.15.61:0/727932799 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068510 0x7fb09c0cefa0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fb0840098e0 tx=0x7fb0840091a0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.823+0000 7fb0a232e700 1 -- 172.21.15.61:0/727932799 shutdown_connections 2023-12-24T20:02:59.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.823+0000 7fb0a232e700 1 --2- 172.21.15.61:0/727932799 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068510 0x7fb09c0cefa0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.823+0000 7fb0a232e700 1 -- 172.21.15.61:0/727932799 >> 172.21.15.61:0/727932799 conn(0x7fb09c097a10 msgr2=0x7fb09c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:02:59.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.823+0000 7fb0a232e700 1 -- 172.21.15.61:0/727932799 shutdown_connections 2023-12-24T20:02:59.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.823+0000 7fb0a232e700 1 -- 172.21.15.61:0/727932799 wait complete. 2023-12-24T20:02:59.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.824+0000 7fb0a232e700 1 Processor -- start 2023-12-24T20:02:59.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.824+0000 7fb0a232e700 1 -- start start 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.825+0000 7fb0a232e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068140 0x7fb09c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.825+0000 7fb0a232e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb09c068510 0x7fb09c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.825+0000 7fb0a232e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09c159a60 0x7fb09c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.825+0000 7fb0a232e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c15f500 con 0x7fb09c068140 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.825+0000 7fb0a232e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c15af90 con 0x7fb09c159a60 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.825+0000 7fb0a232e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c15b1c0 con 0x7fb09c068510 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.825+0000 7fb09bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068140 0x7fb09c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.825+0000 7fb09bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068140 0x7fb09c15aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41452/0 (socket says 172.21.15.61:41452) 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.825+0000 7fb09bfff700 1 -- 172.21.15.61:0/3416851423 learned_addr learned my addr 172.21.15.61:0/3416851423 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb09b7fe700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb09c068510 0x7fb09c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb09bfff700 1 -- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb09c068510 msgr2=0x7fb09c155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb09bfff700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb09c068510 0x7fb09c155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb0a08cb700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09c159a60 0x7fb09c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb09bfff700 1 -- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09c159a60 msgr2=0x7fb09c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:02:59.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb09bfff700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09c159a60 0x7fb09c0b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:02:59.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb09bfff700 1 -- 172.21.15.61:0/3416851423 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb084009420 con 0x7fb09c068140 2023-12-24T20:02:59.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb09bfff700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068140 0x7fb09c15aa50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fb08c00c570 tx=0x7fb08c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:59.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb093fff700 1 -- 172.21.15.61:0/3416851423 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c011590 con 0x7fb09c068140 2023-12-24T20:02:59.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb093fff700 1 -- 172.21.15.61:0/3416851423 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c0116f0 con 0x7fb09c068140 2023-12-24T20:02:59.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb0a232e700 1 -- 172.21.15.61:0/3416851423 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c15b4a0 con 0x7fb09c068140 2023-12-24T20:02:59.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb093fff700 1 -- 172.21.15.61:0/3416851423 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c011ab0 con 0x7fb09c068140 2023-12-24T20:02:59.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.826+0000 7fb0a232e700 1 -- 172.21.15.61:0/3416851423 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c15ba60 con 0x7fb09c068140 2023-12-24T20:02:59.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.827+0000 7fb0a232e700 1 -- 172.21.15.61:0/3416851423 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09c06d440 con 0x7fb09c068140 2023-12-24T20:02:59.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.827+0000 7fb093fff700 1 -- 172.21.15.61:0/3416851423 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb08c01b3b0 con 0x7fb09c068140 2023-12-24T20:02:59.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.828+0000 7fb093fff700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb07c066f30 0x7fb07c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:02:59.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.828+0000 7fb093fff700 1 -- 172.21.15.61:0/3416851423 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb08c083950 con 0x7fb09c068140 2023-12-24T20:02:59.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.828+0000 7fb09b7fe700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb07c066f30 0x7fb07c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:02:59.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.829+0000 7fb09b7fe700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb07c066f30 0x7fb07c0693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb09c16d4f0 tx=0x7fb084017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:02:59.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:02:59.832+0000 7fb093fff700 1 -- 172.21.15.61:0/3416851423 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb08c050c70 con 0x7fb09c068140 2023-12-24T20:03:00.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.021+0000 7fb0a232e700 1 -- 172.21.15.61:0/3416851423 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb09c04c3c0 con 0x7fb07c066f30 2023-12-24T20:03:00.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.030+0000 7fb093fff700 1 -- 172.21.15.61:0/3416851423 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282502 (secure 0 0 0) 0x7fb09c04c3c0 con 0x7fb07c066f30 2023-12-24T20:03:00.035 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:00.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 -- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb07c066f30 msgr2=0x7fb07c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb07c066f30 0x7fb07c0693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb09c16d4f0 tx=0x7fb084017000 comp rx=0 tx=0).stop 2023-12-24T20:03:00.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 -- 172.21.15.61:0/3416851423 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068140 msgr2=0x7fb09c15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068140 0x7fb09c15aa50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fb08c00c570 tx=0x7fb08c001070 comp rx=0 tx=0).stop 2023-12-24T20:03:00.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 -- 172.21.15.61:0/3416851423 shutdown_connections 2023-12-24T20:03:00.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb07c066f30 0x7fb07c0693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb09c159a60 0x7fb09c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb09c068140 0x7fb09c15aa50 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 --2- 172.21.15.61:0/3416851423 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb09c068510 0x7fb09c155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 -- 172.21.15.61:0/3416851423 >> 172.21.15.61:0/3416851423 conn(0x7fb09c097a10 msgr2=0x7fb09c0ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:00.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 -- 172.21.15.61:0/3416851423 shutdown_connections 2023-12-24T20:03:00.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.033+0000 7fb0a232e700 1 -- 172.21.15.61:0/3416851423 wait complete. 2023-12-24T20:03:00.038 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:03:00.045 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2023-12-24T20:02:58.393731+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6882,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555617,"statfs":{"total":1600000000,"available":1592952458,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.486560"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.919237+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:53:25.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916872+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:08:48.057909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.917121+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:17.850898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.920600+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:45:38.943609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.920029+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:06.675211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.912999+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:09:16.527016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.918839+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:18.530984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916762+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:35.210956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915434+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:39.482757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916401+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:30:46.025973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916422+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:48:42.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915527+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:54.960190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916390+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:30:00.118436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.917403+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:46.983224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.912555+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:21:49.049517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.914234+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:36:58.588229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916513+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:37:15.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.920431+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:46.983224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.917006+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:34:38.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.917839+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:42.272812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915952+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:34:38.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915880+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:14:51.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.917159+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:04.622637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916042+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:36:07.176909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.917503+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:43:02.753958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.913959+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:01:06.135022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.913101+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:06.675211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915836+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:28.250698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916231+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:46.983224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916229+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:14:17.116224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.913526+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:50.737193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.912665+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:14:58.224165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.912591+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:07:33.612074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.923547+0000","last_change":"2023-12-24T20:02:54.923547+0000","last_active":"2023-12-24T20:02:54.923547+0000","last_peered":"2023-12-24T20:02:54.923547+0000","last_clean":"2023-12-24T20:02:54.923547+0000","last_became_active":"2023-12-24T20:02:54.923116+0000","last_became_peered":"2023-12-24T20:02:54.923116+0000","last_unstale":"2023-12-24T20:02:54.923547+0000","last_undegraded":"2023-12-24T20:02:54.923547+0000","last_fullsized":"2023-12-24T20:02:54.923547+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:01:51.589757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.919874+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:17.850898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.923135+0000","last_change":"2023-12-24T20:02:54.923135+0000","last_active":"2023-12-24T20:02:54.923135+0000","last_peered":"2023-12-24T20:02:54.923135+0000","last_clean":"2023-12-24T20:02:54.923135+0000","last_became_active":"2023-12-24T20:02:54.922901+0000","last_became_peered":"2023-12-24T20:02:54.922901+0000","last_unstale":"2023-12-24T20:02:54.923135+0000","last_undegraded":"2023-12-24T20:02:54.923135+0000","last_fullsized":"2023-12-24T20:02:54.923135+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:04:32.723520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.912092+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:49:42.814967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.923697+0000","last_change":"2023-12-24T20:02:54.923697+0000","last_active":"2023-12-24T20:02:54.923697+0000","last_peered":"2023-12-24T20:02:54.923697+0000","last_clean":"2023-12-24T20:02:54.923697+0000","last_became_active":"2023-12-24T20:02:54.923407+0000","last_became_peered":"2023-12-24T20:02:54.923407+0000","last_unstale":"2023-12-24T20:02:54.923697+0000","last_undegraded":"2023-12-24T20:02:54.923697+0000","last_fullsized":"2023-12-24T20:02:54.923697+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:14:57.217022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915389+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:11:32.725184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.924549+0000","last_change":"2023-12-24T20:02:54.924549+0000","last_active":"2023-12-24T20:02:54.924549+0000","last_peered":"2023-12-24T20:02:54.924549+0000","last_clean":"2023-12-24T20:02:54.924549+0000","last_became_active":"2023-12-24T20:02:54.924013+0000","last_became_peered":"2023-12-24T20:02:54.924013+0000","last_unstale":"2023-12-24T20:02:54.924549+0000","last_undegraded":"2023-12-24T20:02:54.924549+0000","last_fullsized":"2023-12-24T20:02:54.924549+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:21.289030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916787+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:31:39.703395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.923049+0000","last_change":"2023-12-24T20:02:54.923049+0000","last_active":"2023-12-24T20:02:54.923049+0000","last_peered":"2023-12-24T20:02:54.923049+0000","last_clean":"2023-12-24T20:02:54.923049+0000","last_became_active":"2023-12-24T20:02:54.922824+0000","last_became_peered":"2023-12-24T20:02:54.922824+0000","last_unstale":"2023-12-24T20:02:54.923049+0000","last_undegraded":"2023-12-24T20:02:54.923049+0000","last_fullsized":"2023-12-24T20:02:54.923049+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:09:15.519873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916118+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:17.850898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.924014+0000","last_change":"2023-12-24T20:02:54.924014+0000","last_active":"2023-12-24T20:02:54.924014+0000","last_peered":"2023-12-24T20:02:54.924014+0000","last_clean":"2023-12-24T20:02:54.924014+0000","last_became_active":"2023-12-24T20:02:54.923767+0000","last_became_peered":"2023-12-24T20:02:54.923767+0000","last_unstale":"2023-12-24T20:02:54.924014+0000","last_undegraded":"2023-12-24T20:02:54.924014+0000","last_fullsized":"2023-12-24T20:02:54.924014+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:45.976081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.912416+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:39:02.601816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.922733+0000","last_change":"2023-12-24T20:02:54.922733+0000","last_active":"2023-12-24T20:02:54.922733+0000","last_peered":"2023-12-24T20:02:54.922733+0000","last_clean":"2023-12-24T20:02:54.922733+0000","last_became_active":"2023-12-24T20:02:54.922310+0000","last_became_peered":"2023-12-24T20:02:54.922310+0000","last_unstale":"2023-12-24T20:02:54.922733+0000","last_undegraded":"2023-12-24T20:02:54.922733+0000","last_fullsized":"2023-12-24T20:02:54.922733+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:40.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.917364+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:08:42.112025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.920301+0000","last_change":"2023-12-24T20:02:54.920301+0000","last_active":"2023-12-24T20:02:54.920301+0000","last_peered":"2023-12-24T20:02:54.920301+0000","last_clean":"2023-12-24T20:02:54.920301+0000","last_became_active":"2023-12-24T20:02:54.920001+0000","last_became_peered":"2023-12-24T20:02:54.920001+0000","last_unstale":"2023-12-24T20:02:54.920301+0000","last_undegraded":"2023-12-24T20:02:54.920301+0000","last_fullsized":"2023-12-24T20:02:54.920301+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:29.206378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.918449+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:49.117865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.924689+0000","last_change":"2023-12-24T20:02:54.924689+0000","last_active":"2023-12-24T20:02:54.924689+0000","last_peered":"2023-12-24T20:02:54.924689+0000","last_clean":"2023-12-24T20:02:54.924689+0000","last_became_active":"2023-12-24T20:02:54.924320+0000","last_became_peered":"2023-12-24T20:02:54.924320+0000","last_unstale":"2023-12-24T20:02:54.924689+0000","last_undegraded":"2023-12-24T20:02:54.924689+0000","last_fullsized":"2023-12-24T20:02:54.924689+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:49:41.807823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.920446+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:48:42.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.923134+0000","last_change":"2023-12-24T20:02:54.923134+0000","last_active":"2023-12-24T20:02:54.923134+0000","last_peered":"2023-12-24T20:02:54.923134+0000","last_clean":"2023-12-24T20:02:54.923134+0000","last_became_active":"2023-12-24T20:02:54.921147+0000","last_became_peered":"2023-12-24T20:02:54.921147+0000","last_unstale":"2023-12-24T20:02:54.923134+0000","last_undegraded":"2023-12-24T20:02:54.923134+0000","last_fullsized":"2023-12-24T20:02:54.923134+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:16.843755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915372+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:43:02.753958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.918110+0000","last_change":"2023-12-24T20:02:54.918110+0000","last_active":"2023-12-24T20:02:54.918110+0000","last_peered":"2023-12-24T20:02:54.918110+0000","last_clean":"2023-12-24T20:02:54.918110+0000","last_became_active":"2023-12-24T20:02:54.917094+0000","last_became_peered":"2023-12-24T20:02:54.917094+0000","last_unstale":"2023-12-24T20:02:54.918110+0000","last_undegraded":"2023-12-24T20:02:54.918110+0000","last_fullsized":"2023-12-24T20:02:54.918110+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:35:44.795525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.920478+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:40:19.807060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.925412+0000","last_change":"2023-12-24T20:02:54.925412+0000","last_active":"2023-12-24T20:02:54.925412+0000","last_peered":"2023-12-24T20:02:54.925412+0000","last_clean":"2023-12-24T20:02:54.925412+0000","last_became_active":"2023-12-24T20:02:54.925180+0000","last_became_peered":"2023-12-24T20:02:54.925180+0000","last_unstale":"2023-12-24T20:02:54.925412+0000","last_undegraded":"2023-12-24T20:02:54.925412+0000","last_fullsized":"2023-12-24T20:02:54.925412+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:04.816298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915227+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:04.622637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.918394+0000","last_change":"2023-12-24T20:02:54.918394+0000","last_active":"2023-12-24T20:02:54.918394+0000","last_peered":"2023-12-24T20:02:54.918394+0000","last_clean":"2023-12-24T20:02:54.918394+0000","last_became_active":"2023-12-24T20:02:54.918115+0000","last_became_peered":"2023-12-24T20:02:54.918115+0000","last_unstale":"2023-12-24T20:02:54.918394+0000","last_undegraded":"2023-12-24T20:02:54.918394+0000","last_fullsized":"2023-12-24T20:02:54.918394+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:27.056715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.918168+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:50:01.446179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.927112+0000","last_change":"2023-12-24T20:02:54.927112+0000","last_active":"2023-12-24T20:02:54.927112+0000","last_peered":"2023-12-24T20:02:54.927112+0000","last_clean":"2023-12-24T20:02:54.927112+0000","last_became_active":"2023-12-24T20:02:54.926956+0000","last_became_peered":"2023-12-24T20:02:54.926956+0000","last_unstale":"2023-12-24T20:02:54.927112+0000","last_undegraded":"2023-12-24T20:02:54.927112+0000","last_fullsized":"2023-12-24T20:02:54.927112+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:29:59.111292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915102+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:08:48.057909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.919393+0000","last_change":"2023-12-24T20:02:54.919393+0000","last_active":"2023-12-24T20:02:54.919393+0000","last_peered":"2023-12-24T20:02:54.919393+0000","last_clean":"2023-12-24T20:02:54.919393+0000","last_became_active":"2023-12-24T20:02:54.919117+0000","last_became_peered":"2023-12-24T20:02:54.919117+0000","last_unstale":"2023-12-24T20:02:54.919393+0000","last_undegraded":"2023-12-24T20:02:54.919393+0000","last_fullsized":"2023-12-24T20:02:54.919393+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:11.051901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.919629+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:09:16.527016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.921208+0000","last_change":"2023-12-24T20:02:54.921208+0000","last_active":"2023-12-24T20:02:54.921208+0000","last_peered":"2023-12-24T20:02:54.921208+0000","last_clean":"2023-12-24T20:02:54.921208+0000","last_became_active":"2023-12-24T20:02:54.920935+0000","last_became_peered":"2023-12-24T20:02:54.920935+0000","last_unstale":"2023-12-24T20:02:54.921208+0000","last_undegraded":"2023-12-24T20:02:54.921208+0000","last_fullsized":"2023-12-24T20:02:54.921208+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:18.761654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.912160+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:22.296174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.923119+0000","last_change":"2023-12-24T20:02:54.923119+0000","last_active":"2023-12-24T20:02:54.923119+0000","last_peered":"2023-12-24T20:02:54.923119+0000","last_clean":"2023-12-24T20:02:54.923119+0000","last_became_active":"2023-12-24T20:02:54.922723+0000","last_became_peered":"2023-12-24T20:02:54.922723+0000","last_unstale":"2023-12-24T20:02:54.923119+0000","last_undegraded":"2023-12-24T20:02:54.923119+0000","last_fullsized":"2023-12-24T20:02:54.923119+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:19:55.914676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915046+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:21:35.749541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.925473+0000","last_change":"2023-12-24T20:02:54.925473+0000","last_active":"2023-12-24T20:02:54.925473+0000","last_peered":"2023-12-24T20:02:54.925473+0000","last_clean":"2023-12-24T20:02:54.925473+0000","last_became_active":"2023-12-24T20:02:54.925236+0000","last_became_peered":"2023-12-24T20:02:54.925236+0000","last_unstale":"2023-12-24T20:02:54.925473+0000","last_undegraded":"2023-12-24T20:02:54.925473+0000","last_fullsized":"2023-12-24T20:02:54.925473+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:51.898479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915875+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:41.064381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.922281+0000","last_change":"2023-12-24T20:02:54.922281+0000","last_active":"2023-12-24T20:02:54.922281+0000","last_peered":"2023-12-24T20:02:54.922281+0000","last_clean":"2023-12-24T20:02:54.922281+0000","last_became_active":"2023-12-24T20:02:54.921528+0000","last_became_peered":"2023-12-24T20:02:54.921528+0000","last_unstale":"2023-12-24T20:02:54.922281+0000","last_undegraded":"2023-12-24T20:02:54.922281+0000","last_fullsized":"2023-12-24T20:02:54.922281+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:07:32.604931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.916564+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:31:56.226845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.922259+0000","last_change":"2023-12-24T20:02:54.922259+0000","last_active":"2023-12-24T20:02:54.922259+0000","last_peered":"2023-12-24T20:02:54.922259+0000","last_clean":"2023-12-24T20:02:54.922259+0000","last_became_active":"2023-12-24T20:02:54.922032+0000","last_became_peered":"2023-12-24T20:02:54.922032+0000","last_unstale":"2023-12-24T20:02:54.922259+0000","last_undegraded":"2023-12-24T20:02:54.922259+0000","last_fullsized":"2023-12-24T20:02:54.922259+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:35.990253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915999+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:55.400617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.923435+0000","last_change":"2023-12-24T20:02:54.923435+0000","last_active":"2023-12-24T20:02:54.923435+0000","last_peered":"2023-12-24T20:02:54.923435+0000","last_clean":"2023-12-24T20:02:54.923435+0000","last_became_active":"2023-12-24T20:02:54.923169+0000","last_became_peered":"2023-12-24T20:02:54.923169+0000","last_unstale":"2023-12-24T20:02:54.923435+0000","last_undegraded":"2023-12-24T20:02:54.923435+0000","last_fullsized":"2023-12-24T20:02:54.923435+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:35.990253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915497+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:52.905622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.921890+0000","last_change":"2023-12-24T20:02:54.921890+0000","last_active":"2023-12-24T20:02:54.921890+0000","last_peered":"2023-12-24T20:02:54.921890+0000","last_clean":"2023-12-24T20:02:54.921890+0000","last_became_active":"2023-12-24T20:02:54.921635+0000","last_became_peered":"2023-12-24T20:02:54.921635+0000","last_unstale":"2023-12-24T20:02:54.921890+0000","last_undegraded":"2023-12-24T20:02:54.921890+0000","last_fullsized":"2023-12-24T20:02:54.921890+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:19:55.914676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915409+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:42.272812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.926552+0000","last_change":"2023-12-24T20:02:54.926552+0000","last_active":"2023-12-24T20:02:54.926552+0000","last_peered":"2023-12-24T20:02:54.926552+0000","last_clean":"2023-12-24T20:02:54.926552+0000","last_became_active":"2023-12-24T20:02:54.926318+0000","last_became_peered":"2023-12-24T20:02:54.926318+0000","last_unstale":"2023-12-24T20:02:54.926552+0000","last_undegraded":"2023-12-24T20:02:54.926552+0000","last_fullsized":"2023-12-24T20:02:54.926552+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:27:43.044939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.919501+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:34:38.827547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.920916+0000","last_change":"2023-12-24T20:02:54.920916+0000","last_active":"2023-12-24T20:02:54.920916+0000","last_peered":"2023-12-24T20:02:54.920916+0000","last_clean":"2023-12-24T20:02:54.920916+0000","last_became_active":"2023-12-24T20:02:54.920012+0000","last_became_peered":"2023-12-24T20:02:54.920012+0000","last_unstale":"2023-12-24T20:02:54.920916+0000","last_undegraded":"2023-12-24T20:02:54.920916+0000","last_fullsized":"2023-12-24T20:02:54.920916+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:34:37.820404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.912396+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:22:30.095280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.923774+0000","last_change":"2023-12-24T20:02:54.923774+0000","last_active":"2023-12-24T20:02:54.923774+0000","last_peered":"2023-12-24T20:02:54.923774+0000","last_clean":"2023-12-24T20:02:54.923774+0000","last_became_active":"2023-12-24T20:02:54.923549+0000","last_became_peered":"2023-12-24T20:02:54.923549+0000","last_unstale":"2023-12-24T20:02:54.923774+0000","last_undegraded":"2023-12-24T20:02:54.923774+0000","last_fullsized":"2023-12-24T20:02:54.923774+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:40.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.911896+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:18:08.908895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.924813+0000","last_change":"2023-12-24T20:02:54.924813+0000","last_active":"2023-12-24T20:02:54.924813+0000","last_peered":"2023-12-24T20:02:54.924813+0000","last_clean":"2023-12-24T20:02:54.924813+0000","last_became_active":"2023-12-24T20:02:54.924306+0000","last_became_peered":"2023-12-24T20:02:54.924306+0000","last_unstale":"2023-12-24T20:02:54.924813+0000","last_undegraded":"2023-12-24T20:02:54.924813+0000","last_fullsized":"2023-12-24T20:02:54.924813+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:46:23.977127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.918127+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:35.210956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.919210+0000","last_change":"2023-12-24T20:02:54.919210+0000","last_active":"2023-12-24T20:02:54.919210+0000","last_peered":"2023-12-24T20:02:54.919210+0000","last_clean":"2023-12-24T20:02:54.919210+0000","last_became_active":"2023-12-24T20:02:54.918958+0000","last_became_peered":"2023-12-24T20:02:54.918958+0000","last_unstale":"2023-12-24T20:02:54.919210+0000","last_undegraded":"2023-12-24T20:02:54.919210+0000","last_fullsized":"2023-12-24T20:02:54.919210+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:34.203812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915725+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:35.210956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.924549+0000","last_change":"2023-12-24T20:02:54.924549+0000","last_active":"2023-12-24T20:02:54.924549+0000","last_peered":"2023-12-24T20:02:54.924549+0000","last_clean":"2023-12-24T20:02:54.924549+0000","last_became_active":"2023-12-24T20:02:54.924264+0000","last_became_peered":"2023-12-24T20:02:54.924264+0000","last_unstale":"2023-12-24T20:02:54.924549+0000","last_undegraded":"2023-12-24T20:02:54.924549+0000","last_fullsized":"2023-12-24T20:02:54.924549+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:57.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915497+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:31:56.226845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.924297+0000","last_change":"2023-12-24T20:02:54.924297+0000","last_active":"2023-12-24T20:02:54.924297+0000","last_peered":"2023-12-24T20:02:54.924297+0000","last_clean":"2023-12-24T20:02:54.924297+0000","last_became_active":"2023-12-24T20:02:54.923168+0000","last_became_peered":"2023-12-24T20:02:54.923168+0000","last_unstale":"2023-12-24T20:02:54.924297+0000","last_undegraded":"2023-12-24T20:02:54.924297+0000","last_fullsized":"2023-12-24T20:02:54.924297+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:51.898479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915058+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:54:53.152377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.926460+0000","last_change":"2023-12-24T20:02:54.926460+0000","last_active":"2023-12-24T20:02:54.926460+0000","last_peered":"2023-12-24T20:02:54.926460+0000","last_clean":"2023-12-24T20:02:54.926460+0000","last_became_active":"2023-12-24T20:02:54.926167+0000","last_became_peered":"2023-12-24T20:02:54.926167+0000","last_unstale":"2023-12-24T20:02:54.926460+0000","last_undegraded":"2023-12-24T20:02:54.926460+0000","last_fullsized":"2023-12-24T20:02:54.926460+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:27.056715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.911867+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:04:10.521554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.924954+0000","last_change":"2023-12-24T20:02:54.924954+0000","last_active":"2023-12-24T20:02:54.924954+0000","last_peered":"2023-12-24T20:02:54.924954+0000","last_clean":"2023-12-24T20:02:54.924954+0000","last_became_active":"2023-12-24T20:02:54.924612+0000","last_became_peered":"2023-12-24T20:02:54.924612+0000","last_unstale":"2023-12-24T20:02:54.924954+0000","last_undegraded":"2023-12-24T20:02:54.924954+0000","last_fullsized":"2023-12-24T20:02:54.924954+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:01:06.813618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:02:54.902942+0000","last_change":"2023-12-24T20:02:54.915047+0000","last_active":"2023-12-24T20:02:54.902942+0000","last_peered":"2023-12-24T20:02:54.902942+0000","last_clean":"2023-12-24T20:02:54.902942+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:02:54.902942+0000","last_undegraded":"2023-12-24T20:02:54.902942+0000","last_fullsized":"2023-12-24T20:02:54.902942+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:37:15.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":8,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-24T20:02:54.922634+0000","last_change":"2023-12-24T20:02:54.922634+0000","last_active":"2023-12-24T20:02:54.922634+0000","last_peered":"2023-12-24T20:02:54.922634+0000","last_clean":"2023-12-24T20:02:54.922634+0000","last_became_active":"2023-12-24T20:02:54.922005+0000","last_became_peered":"2023-12-24T20:02:54.922005+0000","last_unstale":"2023-12-24T20:02:54.922634+0000","last_undegraded":"2023-12-24T20:02:54.922634+0000","last_fullsized":"2023-12-24T20:02:54.922634+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:05.668068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":262,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-12-24T20:02:53.906573+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:02:53.906573+0000","last_peered":"2023-12-24T20:02:53.906573+0000","last_clean":"2023-12-24T20:02:53.906573+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:02:53.906573+0000","last_undegraded":"2023-12-24T20:02:53.906573+0000","last_fullsized":"2023-12-24T20:02:53.906573+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1291,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194021,"statfs":{"total":200000000,"available":198677847,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.501},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70799999999999996,"5min":0.754,"15min":0.754},"last":0.70799999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81799999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72899999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.68000000000000005}]},{"osd":2,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.74399999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.627},"min":{"1min":0.44,"5min":0.437,"15min":0.437},"max":{"1min":0.76800000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64300000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.503,"15min":0.52900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.621,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.58599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70099999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47399999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.55800000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.501},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.626}]},{"osd":6,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.41699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.873,"15min":0.873},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268215,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76600000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59799999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.53400000000000003},"min":{"1min":0.40100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80900000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54200000000000004,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78900000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.41699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57399999999999995,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83399999999999996,"5min":1.077,"15min":1.077},"last":0.627},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60599999999999998,"15min":0.57499999999999996},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.752,"5min":1.048,"15min":1.048},"last":0.73299999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.32900000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72499999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.65100000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72999999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.505,"15min":0.499},"min":{"1min":0.37,"5min":0.254,"15min":0.254},"max":{"1min":0.70199999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.66100000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268215,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.27300000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.5,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.28399999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59999999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.34999999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.29999999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.57799999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41899999999999998,"15min":0.41299999999999998},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40300000000000002,"15min":0.39500000000000002},"min":{"1min":0.29799999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.307}]},{"osd":4,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.752,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.47999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.75700000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.627,"15min":0.621},"min":{"1min":0.45600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85199999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":0.79800000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.77100000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89900000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63700000000000001,"15min":0.61099999999999999},"min":{"1min":0.51100000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84899999999999998,"5min":0.878,"15min":0.878},"last":0.79500000000000004}]},{"osd":7,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.87,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66000000000000003,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.61699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1291,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194021,"statfs":{"total":200000000,"available":198677847,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.35799999999999998,"15min":0.42399999999999999},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.49199999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.27300000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.60999999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.29299999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35699999999999998,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52600000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.318},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55000000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.35499999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42899999999999999,"15min":0.46500000000000002},"min":{"1min":0.27300000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57499999999999996,"5min":2.573,"15min":2.573},"last":0.376},{"interface":"front","average":{"1min":0.442,"5min":0.42699999999999999,"15min":0.42399999999999999},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59499999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.38400000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91400000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.68200000000000005},"min":{"1min":0.47499999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97499999999999998,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.47899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.93400000000000005,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.623},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.624},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.504,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78100000000000003,"5min":1.655,"15min":1.655},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97499999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95399999999999996,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.66700000000000004,"15min":0.72699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93200000000000005,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.60099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194591,"statfs":{"total":200000000,"available":199261952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.371},"min":{"1min":0.24199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.67700000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40000000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.23899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48199999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29999999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.47299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65900000000000003,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1559999999999999,"5min":3.577,"15min":3.577},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2809999999999999,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.79700000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.111,"5min":3.637,"15min":3.637},"last":0.67600000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69899999999999995,"15min":0.66100000000000003},"min":{"1min":0.49099999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.141,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.48699999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.232,"5min":1.331,"15min":1.331},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194591,"statfs":{"total":200000000,"available":199261952,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34499999999999997,"15min":0.32800000000000001},"min":{"1min":0.27700000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.48599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.35499999999999998},"min":{"1min":0.30499999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.33400000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.34799999999999998},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.504,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.438,"5min":0.40300000000000002,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.32900000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.436,"15min":0.42699999999999999},"min":{"1min":0.29399999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.377}]},{"osd":4,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84599999999999997,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":1.337,"15min":1.337},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.64200000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.435,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86799999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.627},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.874,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66600000000000004,"15min":0.64000000000000001},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85799999999999998,"5min":1.006,"15min":1.006},"last":0.58099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268215,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73399999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.438},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77300000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51900000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60599999999999998,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.73599999999999999,"5min":4.883,"15min":4.883},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.59299999999999997},"min":{"1min":0.39300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72999999999999998,"5min":1.544,"15min":1.544},"last":0.53800000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.628,"5min":0.88,"15min":0.88},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.59199999999999997},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69299999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.375}]},{"osd":3,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.38900000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70199999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.66000000000000003,"15min":0.89200000000000002},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.503}]},{"osd":5,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66500000000000004,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.80300000000000005,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.59899999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51800000000000002,"15min":0.53500000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68300000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59299999999999997,"15min":0.63700000000000001},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.751,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.69399999999999995,"15min":1.073},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268215,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76500000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83299999999999996,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.77700000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67100000000000004,"5min":1.847,"15min":1.847},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59199999999999997,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.72799999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.52300000000000002},"min":{"1min":0.42599999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.37,"15min":0.37},"max":{"1min":0.64200000000000002,"5min":1.97,"15min":1.97},"last":0.70299999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.56999999999999995},"min":{"1min":0.41599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.76400000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.81200000000000006}]},{"osd":4,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66900000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.64900000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":3.766,"15min":3.766},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70199999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.84599999999999997}]}]}],"pool_statfs":[]}} 2023-12-24T20:03:00.051 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:03:00.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.206+0000 7fab37d4f700 1 Processor -- start 2023-12-24T20:03:00.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.206+0000 7fab37d4f700 1 -- start start 2023-12-24T20:03:00.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.207+0000 7fab37d4f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30159e60 0x7fab300c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.207+0000 7fab37d4f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3006a090 con 0x7fab30070d50 2023-12-24T20:03:00.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.207+0000 7fab37d4f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3006ac10 con 0x7fab30159a90 2023-12-24T20:03:00.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.207+0000 7fab37d4f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3006a2e0 con 0x7fab30159e60 2023-12-24T20:03:00.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.207+0000 7fab362ec700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fab30070d50 0x7fab300c9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45956/0 (socket says 172.21.15.61:45956) 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.207+0000 7fab362ec700 1 -- 172.21.15.61:0/2840366265 learned_addr learned my addr 172.21.15.61:0/2840366265 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab352ea700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30159e60 0x7fab300c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655067891 0 0) 0x7fab3006a090 con 0x7fab30070d50 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab1c003570 con 0x7fab30070d50 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2284882304 0 0) 0x7fab1c003570 con 0x7fab30070d50 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30159e60 msgr2=0x7fab300c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30159e60 0x7fab300c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 >> v1:172.21.15.133:6789/0 conn(0x7fab30159a90 legacy=0x7fab30070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3006a5c0 con 0x7fab30070d50 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fab280017f0 con 0x7fab30070d50 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 >> v1:172.21.15.61:6789/0 conn(0x7fab30070d50 legacy=0x7fab300c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab1c003a90 0x7fab1c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30159e60 0x7fab1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab1c004d50 0x7fab1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3006a2e0 con 0x7fab1c004d50 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c00bb70 con 0x7fab1c003a90 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c00bd30 con 0x7fab30159e60 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab362ec700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab1c004d50 0x7fab1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab352ea700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30159e60 0x7fab1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab35aeb700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab1c003a90 0x7fab1c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab362ec700 1 -- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30159e60 msgr2=0x7fab1c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab362ec700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30159e60 0x7fab1c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab362ec700 1 -- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab1c003a90 msgr2=0x7fab1c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab362ec700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab1c003a90 0x7fab1c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab362ec700 1 -- 172.21.15.61:0/2840366265 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c003570 con 0x7fab1c004d50 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.208+0000 7fab35aeb700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab1c003a90 0x7fab1c003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab362ec700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab1c004d50 0x7fab1c0051c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fab2800a900 tx=0x7fab280021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6b6efa2edac364 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:00.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280070d0 con 0x7fab1c004d50 2023-12-24T20:03:00.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab28007230 con 0x7fab1c004d50 2023-12-24T20:03:00.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab34ae9700 1 -- 172.21.15.61:0/2840366265 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280075f0 con 0x7fab1c004d50 2023-12-24T20:03:00.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab37d4f700 1 -- 172.21.15.61:0/2840366265 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab1c004d50 msgr2=0x7fab1c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab37d4f700 1 --2- 172.21.15.61:0/2840366265 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab1c004d50 0x7fab1c0051c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fab2800a900 tx=0x7fab280021d0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab362ec700 1 -- 172.21.15.61:0/2840366265 reap_dead start 2023-12-24T20:03:00.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab37d4f700 1 -- 172.21.15.61:0/2840366265 shutdown_connections 2023-12-24T20:03:00.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab37d4f700 1 -- 172.21.15.61:0/2840366265 >> 172.21.15.61:0/2840366265 conn(0x7fab300cd6f0 msgr2=0x7fab300cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:00.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab37d4f700 1 -- 172.21.15.61:0/2840366265 shutdown_connections 2023-12-24T20:03:00.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.209+0000 7fab37d4f700 1 -- 172.21.15.61:0/2840366265 wait complete. 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.210+0000 7fab37d4f700 1 Processor -- start 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.211+0000 7fab37d4f700 1 -- start start 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.211+0000 7fab37d4f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30151b60 0x7fab300c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.211+0000 7fab37d4f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab300c6890 0x7fab3015b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.211+0000 7fab37d4f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab30151f30 0x7fab30157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.211+0000 7fab37d4f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab300c6400 con 0x7fab30151f30 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.211+0000 7fab37d4f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab300c57f0 con 0x7fab300c6890 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.211+0000 7fab37d4f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab300c5ad0 con 0x7fab30151b60 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.211+0000 7fab362ec700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab30151f30 0x7fab30157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.211+0000 7fab362ec700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab30151f30 0x7fab30157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41468/0 (socket says 172.21.15.61:41468) 2023-12-24T20:03:00.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.211+0000 7fab362ec700 1 -- 172.21.15.61:0/512719498 learned_addr learned my addr 172.21.15.61:0/512719498 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab35aeb700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30151b60 0x7fab300c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab352ea700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab300c6890 0x7fab3015b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab362ec700 1 -- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30151b60 msgr2=0x7fab300c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab362ec700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30151b60 0x7fab300c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab362ec700 1 -- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab300c6890 msgr2=0x7fab3015b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab362ec700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab300c6890 0x7fab3015b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab362ec700 1 -- 172.21.15.61:0/512719498 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab300c5db0 con 0x7fab30151f30 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab352ea700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab300c6890 0x7fab3015b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab362ec700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab30151f30 0x7fab30157d80 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fab2800a3f0 tx=0x7fab28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab25ffb700 1 -- 172.21.15.61:0/512719498 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab28023070 con 0x7fab30151f30 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab25ffb700 1 -- 172.21.15.61:0/512719498 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab28001a90 con 0x7fab30151f30 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab25ffb700 1 -- 172.21.15.61:0/512719498 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280070d0 con 0x7fab30151f30 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab37d4f700 1 -- 172.21.15.61:0/512719498 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab300c6090 con 0x7fab30151f30 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.212+0000 7fab37d4f700 1 -- 172.21.15.61:0/512719498 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab301582c0 con 0x7fab30151f30 2023-12-24T20:03:00.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.213+0000 7fab37d4f700 1 -- 172.21.15.61:0/512719498 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3004c3c0 con 0x7fab30151f30 2023-12-24T20:03:00.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.214+0000 7fab25ffb700 1 -- 172.21.15.61:0/512719498 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fab280073a0 con 0x7fab30151f30 2023-12-24T20:03:00.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.214+0000 7fab25ffb700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab14066f30 0x7fab140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.214+0000 7fab25ffb700 1 -- 172.21.15.61:0/512719498 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab28085df0 con 0x7fab30151f30 2023-12-24T20:03:00.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.214+0000 7fab35aeb700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab14066f30 0x7fab140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.215+0000 7fab35aeb700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab14066f30 0x7fab140693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab20007fd0 tx=0x7fab2000c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:00.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.218+0000 7fab25ffb700 1 -- 172.21.15.61:0/512719498 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab28053060 con 0x7fab30151f30 2023-12-24T20:03:00.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.412+0000 7fab37d4f700 1 -- 172.21.15.61:0/512719498 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab300c6540 con 0x7fab14066f30 2023-12-24T20:03:00.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.421+0000 7fab25ffb700 1 -- 172.21.15.61:0/512719498 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285455 (secure 0 0 0) 0x7fab300c6540 con 0x7fab14066f30 2023-12-24T20:03:00.424 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 -- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab14066f30 msgr2=0x7fab140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab14066f30 0x7fab140693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab20007fd0 tx=0x7fab2000c040 comp rx=0 tx=0).stop 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 -- 172.21.15.61:0/512719498 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab30151f30 msgr2=0x7fab30157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab30151f30 0x7fab30157d80 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fab2800a3f0 tx=0x7fab28016000 comp rx=0 tx=0).stop 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 -- 172.21.15.61:0/512719498 shutdown_connections 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab30151b60 0x7fab300c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab14066f30 0x7fab140693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab30151f30 0x7fab30157d80 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 --2- 172.21.15.61:0/512719498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab300c6890 0x7fab3015b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 -- 172.21.15.61:0/512719498 >> 172.21.15.61:0/512719498 conn(0x7fab300cd6f0 msgr2=0x7fab300cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 -- 172.21.15.61:0/512719498 shutdown_connections 2023-12-24T20:03:00.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.424+0000 7fab37d4f700 1 -- 172.21.15.61:0/512719498 wait complete. 2023-12-24T20:03:00.428 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:03:00.436 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2023-12-24T20:03:00.394217+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7025,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555474,"statfs":{"total":1600000000,"available":1592805860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001497"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.935017+0000","last_change":"2023-12-24T20:02:55.934059+0000","last_active":"2023-12-24T20:02:55.935017+0000","last_peered":"2023-12-24T20:02:55.935017+0000","last_clean":"2023-12-24T20:02:55.935017+0000","last_became_active":"2023-12-24T20:02:55.933792+0000","last_became_peered":"2023-12-24T20:02:55.933792+0000","last_unstale":"2023-12-24T20:02:55.935017+0000","last_undegraded":"2023-12-24T20:02:55.935017+0000","last_fullsized":"2023-12-24T20:02:55.935017+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:59:02.781907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.917530+0000","last_change":"2023-12-24T20:02:55.917480+0000","last_active":"2023-12-24T20:02:55.917530+0000","last_peered":"2023-12-24T20:02:55.917530+0000","last_clean":"2023-12-24T20:02:55.917530+0000","last_became_active":"2023-12-24T20:02:55.917323+0000","last_became_peered":"2023-12-24T20:02:55.917323+0000","last_unstale":"2023-12-24T20:02:55.917530+0000","last_undegraded":"2023-12-24T20:02:55.917530+0000","last_fullsized":"2023-12-24T20:02:55.917530+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:48.146462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.924073+0000","last_change":"2023-12-24T20:02:55.923624+0000","last_active":"2023-12-24T20:02:55.924073+0000","last_peered":"2023-12-24T20:02:55.924073+0000","last_clean":"2023-12-24T20:02:55.924073+0000","last_became_active":"2023-12-24T20:02:55.923359+0000","last_became_peered":"2023-12-24T20:02:55.923359+0000","last_unstale":"2023-12-24T20:02:55.924073+0000","last_undegraded":"2023-12-24T20:02:55.924073+0000","last_fullsized":"2023-12-24T20:02:55.924073+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:08:48.057909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.921115+0000","last_change":"2023-12-24T20:02:55.917254+0000","last_active":"2023-12-24T20:02:55.921115+0000","last_peered":"2023-12-24T20:02:55.921115+0000","last_clean":"2023-12-24T20:02:55.921115+0000","last_became_active":"2023-12-24T20:02:55.917063+0000","last_became_peered":"2023-12-24T20:02:55.917063+0000","last_unstale":"2023-12-24T20:02:55.921115+0000","last_undegraded":"2023-12-24T20:02:55.921115+0000","last_fullsized":"2023-12-24T20:02:55.921115+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:29:53.386483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.927647+0000","last_change":"2023-12-24T20:02:55.926849+0000","last_active":"2023-12-24T20:02:55.927647+0000","last_peered":"2023-12-24T20:02:55.927647+0000","last_clean":"2023-12-24T20:02:55.927647+0000","last_became_active":"2023-12-24T20:02:55.926489+0000","last_became_peered":"2023-12-24T20:02:55.926489+0000","last_unstale":"2023-12-24T20:02:55.927647+0000","last_undegraded":"2023-12-24T20:02:55.927647+0000","last_fullsized":"2023-12-24T20:02:55.927647+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:01:52.596900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.929520+0000","last_change":"2023-12-24T20:02:55.929136+0000","last_active":"2023-12-24T20:02:55.929520+0000","last_peered":"2023-12-24T20:02:55.929520+0000","last_clean":"2023-12-24T20:02:55.929520+0000","last_became_active":"2023-12-24T20:02:55.928897+0000","last_became_peered":"2023-12-24T20:02:55.928897+0000","last_unstale":"2023-12-24T20:02:55.929520+0000","last_undegraded":"2023-12-24T20:02:55.929520+0000","last_fullsized":"2023-12-24T20:02:55.929520+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:48:18.530984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.926403+0000","last_change":"2023-12-24T20:02:55.926332+0000","last_active":"2023-12-24T20:02:55.926403+0000","last_peered":"2023-12-24T20:02:55.926403+0000","last_clean":"2023-12-24T20:02:55.926403+0000","last_became_active":"2023-12-24T20:02:55.926081+0000","last_became_peered":"2023-12-24T20:02:55.926081+0000","last_unstale":"2023-12-24T20:02:55.926403+0000","last_undegraded":"2023-12-24T20:02:55.926403+0000","last_fullsized":"2023-12-24T20:02:55.926403+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:33:43.274186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.929211+0000","last_change":"2023-12-24T20:02:55.928790+0000","last_active":"2023-12-24T20:02:55.929211+0000","last_peered":"2023-12-24T20:02:55.929211+0000","last_clean":"2023-12-24T20:02:55.929211+0000","last_became_active":"2023-12-24T20:02:55.928105+0000","last_became_peered":"2023-12-24T20:02:55.928105+0000","last_unstale":"2023-12-24T20:02:55.929211+0000","last_undegraded":"2023-12-24T20:02:55.929211+0000","last_fullsized":"2023-12-24T20:02:55.929211+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:37:15.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.921146+0000","last_change":"2023-12-24T20:02:55.920471+0000","last_active":"2023-12-24T20:02:55.921146+0000","last_peered":"2023-12-24T20:02:55.921146+0000","last_clean":"2023-12-24T20:02:55.921146+0000","last_became_active":"2023-12-24T20:02:55.920232+0000","last_became_peered":"2023-12-24T20:02:55.920232+0000","last_unstale":"2023-12-24T20:02:55.921146+0000","last_undegraded":"2023-12-24T20:02:55.921146+0000","last_fullsized":"2023-12-24T20:02:55.921146+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:35:55.422674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.927759+0000","last_change":"2023-12-24T20:02:55.925963+0000","last_active":"2023-12-24T20:02:55.927759+0000","last_peered":"2023-12-24T20:02:55.927759+0000","last_clean":"2023-12-24T20:02:55.927759+0000","last_became_active":"2023-12-24T20:02:55.925628+0000","last_became_peered":"2023-12-24T20:02:55.925628+0000","last_unstale":"2023-12-24T20:02:55.927759+0000","last_undegraded":"2023-12-24T20:02:55.927759+0000","last_fullsized":"2023-12-24T20:02:55.927759+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:06.872388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.929486+0000","last_change":"2023-12-24T20:02:55.929279+0000","last_active":"2023-12-24T20:02:55.929486+0000","last_peered":"2023-12-24T20:02:55.929486+0000","last_clean":"2023-12-24T20:02:55.929486+0000","last_became_active":"2023-12-24T20:02:55.928692+0000","last_became_peered":"2023-12-24T20:02:55.928692+0000","last_unstale":"2023-12-24T20:02:55.929486+0000","last_undegraded":"2023-12-24T20:02:55.929486+0000","last_fullsized":"2023-12-24T20:02:55.929486+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:17:13.131214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.936123+0000","last_change":"2023-12-24T20:02:55.936026+0000","last_active":"2023-12-24T20:02:55.936123+0000","last_peered":"2023-12-24T20:02:55.936123+0000","last_clean":"2023-12-24T20:02:55.936123+0000","last_became_active":"2023-12-24T20:02:55.935142+0000","last_became_peered":"2023-12-24T20:02:55.935142+0000","last_unstale":"2023-12-24T20:02:55.936123+0000","last_undegraded":"2023-12-24T20:02:55.936123+0000","last_fullsized":"2023-12-24T20:02:55.936123+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:28:13.628869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.929227+0000","last_change":"2023-12-24T20:02:55.928932+0000","last_active":"2023-12-24T20:02:55.929227+0000","last_peered":"2023-12-24T20:02:55.929227+0000","last_clean":"2023-12-24T20:02:55.929227+0000","last_became_active":"2023-12-24T20:02:55.928406+0000","last_became_peered":"2023-12-24T20:02:55.928406+0000","last_unstale":"2023-12-24T20:02:55.929227+0000","last_undegraded":"2023-12-24T20:02:55.929227+0000","last_fullsized":"2023-12-24T20:02:55.929227+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:42.272812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.929257+0000","last_change":"2023-12-24T20:02:55.929144+0000","last_active":"2023-12-24T20:02:55.929257+0000","last_peered":"2023-12-24T20:02:55.929257+0000","last_clean":"2023-12-24T20:02:55.929257+0000","last_became_active":"2023-12-24T20:02:55.928778+0000","last_became_peered":"2023-12-24T20:02:55.928778+0000","last_unstale":"2023-12-24T20:02:55.929257+0000","last_undegraded":"2023-12-24T20:02:55.929257+0000","last_fullsized":"2023-12-24T20:02:55.929257+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:45:39.646167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.931172+0000","last_change":"2023-12-24T20:02:55.931059+0000","last_active":"2023-12-24T20:02:55.931172+0000","last_peered":"2023-12-24T20:02:55.931172+0000","last_clean":"2023-12-24T20:02:55.931172+0000","last_became_active":"2023-12-24T20:02:55.930115+0000","last_became_peered":"2023-12-24T20:02:55.930115+0000","last_unstale":"2023-12-24T20:02:55.931172+0000","last_undegraded":"2023-12-24T20:02:55.931172+0000","last_fullsized":"2023-12-24T20:02:55.931172+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:33:55.977627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.923073+0000","last_change":"2023-12-24T20:02:55.922190+0000","last_active":"2023-12-24T20:02:55.923073+0000","last_peered":"2023-12-24T20:02:55.923073+0000","last_clean":"2023-12-24T20:02:55.923073+0000","last_became_active":"2023-12-24T20:02:55.921884+0000","last_became_peered":"2023-12-24T20:02:55.921884+0000","last_unstale":"2023-12-24T20:02:55.923073+0000","last_undegraded":"2023-12-24T20:02:55.923073+0000","last_fullsized":"2023-12-24T20:02:55.923073+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:20.288529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.926270+0000","last_change":"2023-12-24T20:02:55.926207+0000","last_active":"2023-12-24T20:02:55.926270+0000","last_peered":"2023-12-24T20:02:55.926270+0000","last_clean":"2023-12-24T20:02:55.926270+0000","last_became_active":"2023-12-24T20:02:55.925913+0000","last_became_peered":"2023-12-24T20:02:55.925913+0000","last_unstale":"2023-12-24T20:02:55.926270+0000","last_undegraded":"2023-12-24T20:02:55.926270+0000","last_fullsized":"2023-12-24T20:02:55.926270+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:29.647708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.930906+0000","last_change":"2023-12-24T20:02:55.930410+0000","last_active":"2023-12-24T20:02:55.930906+0000","last_peered":"2023-12-24T20:02:55.930906+0000","last_clean":"2023-12-24T20:02:55.930906+0000","last_became_active":"2023-12-24T20:02:55.930188+0000","last_became_peered":"2023-12-24T20:02:55.930188+0000","last_unstale":"2023-12-24T20:02:55.930906+0000","last_undegraded":"2023-12-24T20:02:55.930906+0000","last_fullsized":"2023-12-24T20:02:55.930906+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:43:02.753958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.924055+0000","last_change":"2023-12-24T20:02:55.923522+0000","last_active":"2023-12-24T20:02:55.924055+0000","last_peered":"2023-12-24T20:02:55.924055+0000","last_clean":"2023-12-24T20:02:55.924055+0000","last_became_active":"2023-12-24T20:02:55.922923+0000","last_became_peered":"2023-12-24T20:02:55.922923+0000","last_unstale":"2023-12-24T20:02:55.924055+0000","last_undegraded":"2023-12-24T20:02:55.924055+0000","last_fullsized":"2023-12-24T20:02:55.924055+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:36:07.176909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.918586+0000","last_change":"2023-12-24T20:02:55.918491+0000","last_active":"2023-12-24T20:02:55.918586+0000","last_peered":"2023-12-24T20:02:55.918586+0000","last_clean":"2023-12-24T20:02:55.918586+0000","last_became_active":"2023-12-24T20:02:55.918254+0000","last_became_peered":"2023-12-24T20:02:55.918254+0000","last_unstale":"2023-12-24T20:02:55.918586+0000","last_undegraded":"2023-12-24T20:02:55.918586+0000","last_fullsized":"2023-12-24T20:02:55.918586+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:28.250698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.929503+0000","last_change":"2023-12-24T20:02:55.929422+0000","last_active":"2023-12-24T20:02:55.929503+0000","last_peered":"2023-12-24T20:02:55.929503+0000","last_clean":"2023-12-24T20:02:55.929503+0000","last_became_active":"2023-12-24T20:02:55.929012+0000","last_became_peered":"2023-12-24T20:02:55.929012+0000","last_unstale":"2023-12-24T20:02:55.929503+0000","last_undegraded":"2023-12-24T20:02:55.929503+0000","last_fullsized":"2023-12-24T20:02:55.929503+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:45:39.646167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.930758+0000","last_change":"2023-12-24T20:02:55.930694+0000","last_active":"2023-12-24T20:02:55.930758+0000","last_peered":"2023-12-24T20:02:55.930758+0000","last_clean":"2023-12-24T20:02:55.930758+0000","last_became_active":"2023-12-24T20:02:55.930451+0000","last_became_peered":"2023-12-24T20:02:55.930451+0000","last_unstale":"2023-12-24T20:02:55.930758+0000","last_undegraded":"2023-12-24T20:02:55.930758+0000","last_fullsized":"2023-12-24T20:02:55.930758+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:47.469820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.924082+0000","last_change":"2023-12-24T20:02:55.924009+0000","last_active":"2023-12-24T20:02:55.924082+0000","last_peered":"2023-12-24T20:02:55.924082+0000","last_clean":"2023-12-24T20:02:55.924082+0000","last_became_active":"2023-12-24T20:02:55.923730+0000","last_became_peered":"2023-12-24T20:02:55.923730+0000","last_unstale":"2023-12-24T20:02:55.924082+0000","last_undegraded":"2023-12-24T20:02:55.924082+0000","last_fullsized":"2023-12-24T20:02:55.924082+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:14:51.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.927720+0000","last_change":"2023-12-24T20:02:55.926382+0000","last_active":"2023-12-24T20:02:55.927720+0000","last_peered":"2023-12-24T20:02:55.927720+0000","last_clean":"2023-12-24T20:02:55.927720+0000","last_became_active":"2023-12-24T20:02:55.926153+0000","last_became_peered":"2023-12-24T20:02:55.926153+0000","last_unstale":"2023-12-24T20:02:55.927720+0000","last_undegraded":"2023-12-24T20:02:55.927720+0000","last_fullsized":"2023-12-24T20:02:55.927720+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:42:26.974183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.925732+0000","last_change":"2023-12-24T20:02:55.925548+0000","last_active":"2023-12-24T20:02:55.925732+0000","last_peered":"2023-12-24T20:02:55.925732+0000","last_clean":"2023-12-24T20:02:55.925732+0000","last_became_active":"2023-12-24T20:02:55.925321+0000","last_became_peered":"2023-12-24T20:02:55.925321+0000","last_unstale":"2023-12-24T20:02:55.925732+0000","last_undegraded":"2023-12-24T20:02:55.925732+0000","last_fullsized":"2023-12-24T20:02:55.925732+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:50:01.446179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.931327+0000","last_change":"2023-12-24T20:02:55.929677+0000","last_active":"2023-12-24T20:02:55.931327+0000","last_peered":"2023-12-24T20:02:55.931327+0000","last_clean":"2023-12-24T20:02:55.931327+0000","last_became_active":"2023-12-24T20:02:55.928620+0000","last_became_peered":"2023-12-24T20:02:55.928620+0000","last_unstale":"2023-12-24T20:02:55.931327+0000","last_undegraded":"2023-12-24T20:02:55.931327+0000","last_fullsized":"2023-12-24T20:02:55.931327+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:08.379082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.933124+0000","last_change":"2023-12-24T20:02:55.933059+0000","last_active":"2023-12-24T20:02:55.933124+0000","last_peered":"2023-12-24T20:02:55.933124+0000","last_clean":"2023-12-24T20:02:55.933124+0000","last_became_active":"2023-12-24T20:02:55.932623+0000","last_became_peered":"2023-12-24T20:02:55.932623+0000","last_unstale":"2023-12-24T20:02:55.933124+0000","last_undegraded":"2023-12-24T20:02:55.933124+0000","last_fullsized":"2023-12-24T20:02:55.933124+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:52:49.117865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.931005+0000","last_change":"2023-12-24T20:02:55.930944+0000","last_active":"2023-12-24T20:02:55.931005+0000","last_peered":"2023-12-24T20:02:55.931005+0000","last_clean":"2023-12-24T20:02:55.931005+0000","last_became_active":"2023-12-24T20:02:55.930440+0000","last_became_peered":"2023-12-24T20:02:55.930440+0000","last_unstale":"2023-12-24T20:02:55.931005+0000","last_undegraded":"2023-12-24T20:02:55.931005+0000","last_fullsized":"2023-12-24T20:02:55.931005+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:17:13.131214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.922074+0000","last_change":"2023-12-24T20:02:55.921928+0000","last_active":"2023-12-24T20:02:55.922074+0000","last_peered":"2023-12-24T20:02:55.922074+0000","last_clean":"2023-12-24T20:02:55.922074+0000","last_became_active":"2023-12-24T20:02:55.921646+0000","last_became_peered":"2023-12-24T20:02:55.921646+0000","last_unstale":"2023-12-24T20:02:55.922074+0000","last_undegraded":"2023-12-24T20:02:55.922074+0000","last_fullsized":"2023-12-24T20:02:55.922074+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:56:47.469820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.927891+0000","last_change":"2023-12-24T20:02:55.927832+0000","last_active":"2023-12-24T20:02:55.927891+0000","last_peered":"2023-12-24T20:02:55.927891+0000","last_clean":"2023-12-24T20:02:55.927891+0000","last_became_active":"2023-12-24T20:02:55.927597+0000","last_became_peered":"2023-12-24T20:02:55.927597+0000","last_unstale":"2023-12-24T20:02:55.927891+0000","last_undegraded":"2023-12-24T20:02:55.927891+0000","last_fullsized":"2023-12-24T20:02:55.927891+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:07:28.098423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.931345+0000","last_change":"2023-12-24T20:02:55.929831+0000","last_active":"2023-12-24T20:02:55.931345+0000","last_peered":"2023-12-24T20:02:55.931345+0000","last_clean":"2023-12-24T20:02:55.931345+0000","last_became_active":"2023-12-24T20:02:55.928972+0000","last_became_peered":"2023-12-24T20:02:55.928972+0000","last_unstale":"2023-12-24T20:02:55.931345+0000","last_undegraded":"2023-12-24T20:02:55.931345+0000","last_fullsized":"2023-12-24T20:02:55.931345+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:32:13.337617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.932974+0000","last_change":"2023-12-24T20:02:55.932895+0000","last_active":"2023-12-24T20:02:55.932974+0000","last_peered":"2023-12-24T20:02:55.932974+0000","last_clean":"2023-12-24T20:02:55.932974+0000","last_became_active":"2023-12-24T20:02:55.932302+0000","last_became_peered":"2023-12-24T20:02:55.932302+0000","last_unstale":"2023-12-24T20:02:55.932974+0000","last_undegraded":"2023-12-24T20:02:55.932974+0000","last_fullsized":"2023-12-24T20:02:55.932974+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:08:42.112025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.920862+0000","last_change":"2023-12-24T20:02:55.920784+0000","last_active":"2023-12-24T20:02:55.920862+0000","last_peered":"2023-12-24T20:02:55.920862+0000","last_clean":"2023-12-24T20:02:55.920862+0000","last_became_active":"2023-12-24T20:02:55.920508+0000","last_became_peered":"2023-12-24T20:02:55.920508+0000","last_unstale":"2023-12-24T20:02:55.920862+0000","last_undegraded":"2023-12-24T20:02:55.920862+0000","last_fullsized":"2023-12-24T20:02:55.920862+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:01:52.596900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"135'4","reported_seq":14,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.926095+0000","last_change":"2023-12-24T20:02:54.923547+0000","last_active":"2023-12-24T20:02:55.926095+0000","last_peered":"2023-12-24T20:02:55.926095+0000","last_clean":"2023-12-24T20:02:55.926095+0000","last_became_active":"2023-12-24T20:02:54.923116+0000","last_became_peered":"2023-12-24T20:02:54.923116+0000","last_unstale":"2023-12-24T20:02:55.926095+0000","last_undegraded":"2023-12-24T20:02:55.926095+0000","last_fullsized":"2023-12-24T20:02:55.926095+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:01:51.589757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.930925+0000","last_change":"2023-12-24T20:02:55.930847+0000","last_active":"2023-12-24T20:02:55.930925+0000","last_peered":"2023-12-24T20:02:55.930925+0000","last_clean":"2023-12-24T20:02:55.930925+0000","last_became_active":"2023-12-24T20:02:55.930623+0000","last_became_peered":"2023-12-24T20:02:55.930623+0000","last_unstale":"2023-12-24T20:02:55.930925+0000","last_undegraded":"2023-12-24T20:02:55.930925+0000","last_fullsized":"2023-12-24T20:02:55.930925+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:04.622637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.926909+0000","last_change":"2023-12-24T20:02:54.923135+0000","last_active":"2023-12-24T20:02:55.926909+0000","last_peered":"2023-12-24T20:02:55.926909+0000","last_clean":"2023-12-24T20:02:55.926909+0000","last_became_active":"2023-12-24T20:02:54.922901+0000","last_became_peered":"2023-12-24T20:02:54.922901+0000","last_unstale":"2023-12-24T20:02:55.926909+0000","last_undegraded":"2023-12-24T20:02:55.926909+0000","last_fullsized":"2023-12-24T20:02:55.926909+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:04:32.723520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.929466+0000","last_change":"2023-12-24T20:02:55.927587+0000","last_active":"2023-12-24T20:02:55.929466+0000","last_peered":"2023-12-24T20:02:55.929466+0000","last_clean":"2023-12-24T20:02:55.929466+0000","last_became_active":"2023-12-24T20:02:55.927195+0000","last_became_peered":"2023-12-24T20:02:55.927195+0000","last_unstale":"2023-12-24T20:02:55.929466+0000","last_undegraded":"2023-12-24T20:02:55.929466+0000","last_fullsized":"2023-12-24T20:02:55.929466+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:14:17.116224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.928309+0000","last_change":"2023-12-24T20:02:54.923697+0000","last_active":"2023-12-24T20:02:55.928309+0000","last_peered":"2023-12-24T20:02:55.928309+0000","last_clean":"2023-12-24T20:02:55.928309+0000","last_became_active":"2023-12-24T20:02:54.923407+0000","last_became_peered":"2023-12-24T20:02:54.923407+0000","last_unstale":"2023-12-24T20:02:55.928309+0000","last_undegraded":"2023-12-24T20:02:55.928309+0000","last_fullsized":"2023-12-24T20:02:55.928309+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:14:57.217022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.922610+0000","last_change":"2023-12-24T20:02:55.920497+0000","last_active":"2023-12-24T20:02:55.922610+0000","last_peered":"2023-12-24T20:02:55.922610+0000","last_clean":"2023-12-24T20:02:55.922610+0000","last_became_active":"2023-12-24T20:02:55.920265+0000","last_became_peered":"2023-12-24T20:02:55.920265+0000","last_unstale":"2023-12-24T20:02:55.922610+0000","last_undegraded":"2023-12-24T20:02:55.922610+0000","last_fullsized":"2023-12-24T20:02:55.922610+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:28.250698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.929888+0000","last_change":"2023-12-24T20:02:54.924549+0000","last_active":"2023-12-24T20:02:55.929888+0000","last_peered":"2023-12-24T20:02:55.929888+0000","last_clean":"2023-12-24T20:02:55.929888+0000","last_became_active":"2023-12-24T20:02:54.924013+0000","last_became_peered":"2023-12-24T20:02:54.924013+0000","last_unstale":"2023-12-24T20:02:55.929888+0000","last_undegraded":"2023-12-24T20:02:55.929888+0000","last_fullsized":"2023-12-24T20:02:55.929888+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:21:21.289030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.929549+0000","last_change":"2023-12-24T20:02:55.929018+0000","last_active":"2023-12-24T20:02:55.929549+0000","last_peered":"2023-12-24T20:02:55.929549+0000","last_clean":"2023-12-24T20:02:55.929549+0000","last_became_active":"2023-12-24T20:02:55.925516+0000","last_became_peered":"2023-12-24T20:02:55.925516+0000","last_unstale":"2023-12-24T20:02:55.929549+0000","last_undegraded":"2023-12-24T20:02:55.929549+0000","last_fullsized":"2023-12-24T20:02:55.929549+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:43:51.861428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.920827+0000","last_change":"2023-12-24T20:02:54.923049+0000","last_active":"2023-12-24T20:02:55.920827+0000","last_peered":"2023-12-24T20:02:55.920827+0000","last_clean":"2023-12-24T20:02:55.920827+0000","last_became_active":"2023-12-24T20:02:54.922824+0000","last_became_peered":"2023-12-24T20:02:54.922824+0000","last_unstale":"2023-12-24T20:02:55.920827+0000","last_undegraded":"2023-12-24T20:02:55.920827+0000","last_fullsized":"2023-12-24T20:02:55.920827+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:09:15.519873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.916146+0000","last_change":"2023-12-24T20:02:55.916001+0000","last_active":"2023-12-24T20:02:55.916146+0000","last_peered":"2023-12-24T20:02:55.916146+0000","last_clean":"2023-12-24T20:02:55.916146+0000","last_became_active":"2023-12-24T20:02:55.915754+0000","last_became_peered":"2023-12-24T20:02:55.915754+0000","last_unstale":"2023-12-24T20:02:55.916146+0000","last_undegraded":"2023-12-24T20:02:55.916146+0000","last_fullsized":"2023-12-24T20:02:55.916146+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:24:41.196362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.930619+0000","last_change":"2023-12-24T20:02:54.924014+0000","last_active":"2023-12-24T20:02:55.930619+0000","last_peered":"2023-12-24T20:02:55.930619+0000","last_clean":"2023-12-24T20:02:55.930619+0000","last_became_active":"2023-12-24T20:02:54.923767+0000","last_became_peered":"2023-12-24T20:02:54.923767+0000","last_unstale":"2023-12-24T20:02:55.930619+0000","last_undegraded":"2023-12-24T20:02:55.930619+0000","last_fullsized":"2023-12-24T20:02:55.930619+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:37:45.976081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.923107+0000","last_change":"2023-12-24T20:02:55.922469+0000","last_active":"2023-12-24T20:02:55.923107+0000","last_peered":"2023-12-24T20:02:55.923107+0000","last_clean":"2023-12-24T20:02:55.923107+0000","last_became_active":"2023-12-24T20:02:55.921469+0000","last_became_peered":"2023-12-24T20:02:55.921469+0000","last_unstale":"2023-12-24T20:02:55.923107+0000","last_undegraded":"2023-12-24T20:02:55.923107+0000","last_fullsized":"2023-12-24T20:02:55.923107+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:44:55.756762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.915596+0000","last_change":"2023-12-24T20:02:54.922733+0000","last_active":"2023-12-24T20:02:55.915596+0000","last_peered":"2023-12-24T20:02:55.915596+0000","last_clean":"2023-12-24T20:02:55.915596+0000","last_became_active":"2023-12-24T20:02:54.922310+0000","last_became_peered":"2023-12-24T20:02:54.922310+0000","last_unstale":"2023-12-24T20:02:55.915596+0000","last_undegraded":"2023-12-24T20:02:55.915596+0000","last_fullsized":"2023-12-24T20:02:55.915596+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:40.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.930792+0000","last_change":"2023-12-24T20:02:55.930723+0000","last_active":"2023-12-24T20:02:55.930792+0000","last_peered":"2023-12-24T20:02:55.930792+0000","last_clean":"2023-12-24T20:02:55.930792+0000","last_became_active":"2023-12-24T20:02:55.930422+0000","last_became_peered":"2023-12-24T20:02:55.930422+0000","last_unstale":"2023-12-24T20:02:55.930792+0000","last_undegraded":"2023-12-24T20:02:55.930792+0000","last_fullsized":"2023-12-24T20:02:55.930792+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:09:40.926604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.920954+0000","last_change":"2023-12-24T20:02:54.920301+0000","last_active":"2023-12-24T20:02:55.920954+0000","last_peered":"2023-12-24T20:02:55.920954+0000","last_clean":"2023-12-24T20:02:55.920954+0000","last_became_active":"2023-12-24T20:02:54.920001+0000","last_became_peered":"2023-12-24T20:02:54.920001+0000","last_unstale":"2023-12-24T20:02:55.920954+0000","last_undegraded":"2023-12-24T20:02:55.920954+0000","last_fullsized":"2023-12-24T20:02:55.920954+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:06:29.206378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.920218+0000","last_change":"2023-12-24T20:02:55.919687+0000","last_active":"2023-12-24T20:02:55.920218+0000","last_peered":"2023-12-24T20:02:55.920218+0000","last_clean":"2023-12-24T20:02:55.920218+0000","last_became_active":"2023-12-24T20:02:55.919413+0000","last_became_peered":"2023-12-24T20:02:55.919413+0000","last_unstale":"2023-12-24T20:02:55.920218+0000","last_undegraded":"2023-12-24T20:02:55.920218+0000","last_fullsized":"2023-12-24T20:02:55.920218+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:34:43.423908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.918532+0000","last_change":"2023-12-24T20:02:54.924689+0000","last_active":"2023-12-24T20:02:55.918532+0000","last_peered":"2023-12-24T20:02:55.918532+0000","last_clean":"2023-12-24T20:02:55.918532+0000","last_became_active":"2023-12-24T20:02:54.924320+0000","last_became_peered":"2023-12-24T20:02:54.924320+0000","last_unstale":"2023-12-24T20:02:55.918532+0000","last_undegraded":"2023-12-24T20:02:55.918532+0000","last_fullsized":"2023-12-24T20:02:55.918532+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:49:41.807823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.934543+0000","last_change":"2023-12-24T20:02:55.934501+0000","last_active":"2023-12-24T20:02:55.934543+0000","last_peered":"2023-12-24T20:02:55.934543+0000","last_clean":"2023-12-24T20:02:55.934543+0000","last_became_active":"2023-12-24T20:02:55.934216+0000","last_became_peered":"2023-12-24T20:02:55.934216+0000","last_unstale":"2023-12-24T20:02:55.934543+0000","last_undegraded":"2023-12-24T20:02:55.934543+0000","last_fullsized":"2023-12-24T20:02:55.934543+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:42.272812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.923964+0000","last_change":"2023-12-24T20:02:54.923134+0000","last_active":"2023-12-24T20:02:55.923964+0000","last_peered":"2023-12-24T20:02:55.923964+0000","last_clean":"2023-12-24T20:02:55.923964+0000","last_became_active":"2023-12-24T20:02:54.921147+0000","last_became_peered":"2023-12-24T20:02:54.921147+0000","last_unstale":"2023-12-24T20:02:55.923964+0000","last_undegraded":"2023-12-24T20:02:55.923964+0000","last_fullsized":"2023-12-24T20:02:55.923964+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:16.843755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.925700+0000","last_change":"2023-12-24T20:02:55.925089+0000","last_active":"2023-12-24T20:02:55.925700+0000","last_peered":"2023-12-24T20:02:55.925700+0000","last_clean":"2023-12-24T20:02:55.925700+0000","last_became_active":"2023-12-24T20:02:55.924639+0000","last_became_peered":"2023-12-24T20:02:55.924639+0000","last_unstale":"2023-12-24T20:02:55.925700+0000","last_undegraded":"2023-12-24T20:02:55.925700+0000","last_fullsized":"2023-12-24T20:02:55.925700+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:10:29.647708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"135'3","reported_seq":13,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.938620+0000","last_change":"2023-12-24T20:02:54.918110+0000","last_active":"2023-12-24T20:02:55.938620+0000","last_peered":"2023-12-24T20:02:55.938620+0000","last_clean":"2023-12-24T20:02:55.938620+0000","last_became_active":"2023-12-24T20:02:54.917094+0000","last_became_peered":"2023-12-24T20:02:54.917094+0000","last_unstale":"2023-12-24T20:02:55.938620+0000","last_undegraded":"2023-12-24T20:02:55.938620+0000","last_fullsized":"2023-12-24T20:02:55.938620+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:35:44.795525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.923917+0000","last_change":"2023-12-24T20:02:55.923847+0000","last_active":"2023-12-24T20:02:55.923917+0000","last_peered":"2023-12-24T20:02:55.923917+0000","last_clean":"2023-12-24T20:02:55.923917+0000","last_became_active":"2023-12-24T20:02:55.923506+0000","last_became_peered":"2023-12-24T20:02:55.923506+0000","last_unstale":"2023-12-24T20:02:55.923917+0000","last_undegraded":"2023-12-24T20:02:55.923917+0000","last_fullsized":"2023-12-24T20:02:55.923917+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:44:00.857227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"135'6","reported_seq":16,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.944092+0000","last_change":"2023-12-24T20:02:54.925412+0000","last_active":"2023-12-24T20:02:55.944092+0000","last_peered":"2023-12-24T20:02:55.944092+0000","last_clean":"2023-12-24T20:02:55.944092+0000","last_became_active":"2023-12-24T20:02:54.925180+0000","last_became_peered":"2023-12-24T20:02:54.925180+0000","last_unstale":"2023-12-24T20:02:55.944092+0000","last_undegraded":"2023-12-24T20:02:55.944092+0000","last_fullsized":"2023-12-24T20:02:55.944092+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:18:04.816298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.928196+0000","last_change":"2023-12-24T20:02:55.928128+0000","last_active":"2023-12-24T20:02:55.928196+0000","last_peered":"2023-12-24T20:02:55.928196+0000","last_clean":"2023-12-24T20:02:55.928196+0000","last_became_active":"2023-12-24T20:02:55.927796+0000","last_became_peered":"2023-12-24T20:02:55.927796+0000","last_unstale":"2023-12-24T20:02:55.928196+0000","last_undegraded":"2023-12-24T20:02:55.928196+0000","last_fullsized":"2023-12-24T20:02:55.928196+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:37:37.285209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.930470+0000","last_change":"2023-12-24T20:02:54.918394+0000","last_active":"2023-12-24T20:02:55.930470+0000","last_peered":"2023-12-24T20:02:55.930470+0000","last_clean":"2023-12-24T20:02:55.930470+0000","last_became_active":"2023-12-24T20:02:54.918115+0000","last_became_peered":"2023-12-24T20:02:54.918115+0000","last_unstale":"2023-12-24T20:02:55.930470+0000","last_undegraded":"2023-12-24T20:02:55.930470+0000","last_fullsized":"2023-12-24T20:02:55.930470+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:27.056715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.925164+0000","last_change":"2023-12-24T20:02:55.924747+0000","last_active":"2023-12-24T20:02:55.925164+0000","last_peered":"2023-12-24T20:02:55.925164+0000","last_clean":"2023-12-24T20:02:55.925164+0000","last_became_active":"2023-12-24T20:02:55.924434+0000","last_became_peered":"2023-12-24T20:02:55.924434+0000","last_unstale":"2023-12-24T20:02:55.925164+0000","last_undegraded":"2023-12-24T20:02:55.925164+0000","last_fullsized":"2023-12-24T20:02:55.925164+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:24:41.196362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.927088+0000","last_change":"2023-12-24T20:02:54.927112+0000","last_active":"2023-12-24T20:02:55.927088+0000","last_peered":"2023-12-24T20:02:55.927088+0000","last_clean":"2023-12-24T20:02:55.927088+0000","last_became_active":"2023-12-24T20:02:54.926956+0000","last_became_peered":"2023-12-24T20:02:54.926956+0000","last_unstale":"2023-12-24T20:02:55.927088+0000","last_undegraded":"2023-12-24T20:02:55.927088+0000","last_fullsized":"2023-12-24T20:02:55.927088+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:29:59.111292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.927997+0000","last_change":"2023-12-24T20:02:55.927903+0000","last_active":"2023-12-24T20:02:55.927997+0000","last_peered":"2023-12-24T20:02:55.927997+0000","last_clean":"2023-12-24T20:02:55.927997+0000","last_became_active":"2023-12-24T20:02:55.927657+0000","last_became_peered":"2023-12-24T20:02:55.927657+0000","last_unstale":"2023-12-24T20:02:55.927997+0000","last_undegraded":"2023-12-24T20:02:55.927997+0000","last_fullsized":"2023-12-24T20:02:55.927997+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:35:45.802669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"135'8","reported_seq":18,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.931393+0000","last_change":"2023-12-24T20:02:54.919393+0000","last_active":"2023-12-24T20:02:55.931393+0000","last_peered":"2023-12-24T20:02:55.931393+0000","last_clean":"2023-12-24T20:02:55.931393+0000","last_became_active":"2023-12-24T20:02:54.919117+0000","last_became_peered":"2023-12-24T20:02:54.919117+0000","last_unstale":"2023-12-24T20:02:55.931393+0000","last_undegraded":"2023-12-24T20:02:55.931393+0000","last_fullsized":"2023-12-24T20:02:55.931393+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:01:11.051901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.927678+0000","last_change":"2023-12-24T20:02:55.927492+0000","last_active":"2023-12-24T20:02:55.927678+0000","last_peered":"2023-12-24T20:02:55.927678+0000","last_clean":"2023-12-24T20:02:55.927678+0000","last_became_active":"2023-12-24T20:02:55.927202+0000","last_became_peered":"2023-12-24T20:02:55.927202+0000","last_unstale":"2023-12-24T20:02:55.927678+0000","last_undegraded":"2023-12-24T20:02:55.927678+0000","last_fullsized":"2023-12-24T20:02:55.927678+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:58.484770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.935870+0000","last_change":"2023-12-24T20:02:54.921208+0000","last_active":"2023-12-24T20:02:55.935870+0000","last_peered":"2023-12-24T20:02:55.935870+0000","last_clean":"2023-12-24T20:02:55.935870+0000","last_became_active":"2023-12-24T20:02:54.920935+0000","last_became_peered":"2023-12-24T20:02:54.920935+0000","last_unstale":"2023-12-24T20:02:55.935870+0000","last_undegraded":"2023-12-24T20:02:55.935870+0000","last_fullsized":"2023-12-24T20:02:55.935870+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:19:18.761654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.915704+0000","last_change":"2023-12-24T20:02:55.915598+0000","last_active":"2023-12-24T20:02:55.915704+0000","last_peered":"2023-12-24T20:02:55.915704+0000","last_clean":"2023-12-24T20:02:55.915704+0000","last_became_active":"2023-12-24T20:02:55.915382+0000","last_became_peered":"2023-12-24T20:02:55.915382+0000","last_unstale":"2023-12-24T20:02:55.915704+0000","last_undegraded":"2023-12-24T20:02:55.915704+0000","last_fullsized":"2023-12-24T20:02:55.915704+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:58.484770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.926972+0000","last_change":"2023-12-24T20:02:54.923119+0000","last_active":"2023-12-24T20:02:55.926972+0000","last_peered":"2023-12-24T20:02:55.926972+0000","last_clean":"2023-12-24T20:02:55.926972+0000","last_became_active":"2023-12-24T20:02:54.922723+0000","last_became_peered":"2023-12-24T20:02:54.922723+0000","last_unstale":"2023-12-24T20:02:55.926972+0000","last_undegraded":"2023-12-24T20:02:55.926972+0000","last_fullsized":"2023-12-24T20:02:55.926972+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:19:55.914676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.935900+0000","last_change":"2023-12-24T20:02:55.935855+0000","last_active":"2023-12-24T20:02:55.935900+0000","last_peered":"2023-12-24T20:02:55.935900+0000","last_clean":"2023-12-24T20:02:55.935900+0000","last_became_active":"2023-12-24T20:02:55.935666+0000","last_became_peered":"2023-12-24T20:02:55.935666+0000","last_unstale":"2023-12-24T20:02:55.935900+0000","last_undegraded":"2023-12-24T20:02:55.935900+0000","last_fullsized":"2023-12-24T20:02:55.935900+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:48:42.409375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"135'1","reported_seq":11,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.932892+0000","last_change":"2023-12-24T20:02:54.925473+0000","last_active":"2023-12-24T20:02:55.932892+0000","last_peered":"2023-12-24T20:02:55.932892+0000","last_clean":"2023-12-24T20:02:55.932892+0000","last_became_active":"2023-12-24T20:02:54.925236+0000","last_became_peered":"2023-12-24T20:02:54.925236+0000","last_unstale":"2023-12-24T20:02:55.932892+0000","last_undegraded":"2023-12-24T20:02:55.932892+0000","last_fullsized":"2023-12-24T20:02:55.932892+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:51.898479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.922648+0000","last_change":"2023-12-24T20:02:55.921563+0000","last_active":"2023-12-24T20:02:55.922648+0000","last_peered":"2023-12-24T20:02:55.922648+0000","last_clean":"2023-12-24T20:02:55.922648+0000","last_became_active":"2023-12-24T20:02:55.921315+0000","last_became_peered":"2023-12-24T20:02:55.921315+0000","last_unstale":"2023-12-24T20:02:55.922648+0000","last_undegraded":"2023-12-24T20:02:55.922648+0000","last_fullsized":"2023-12-24T20:02:55.922648+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:00:04.622637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.915054+0000","last_change":"2023-12-24T20:02:54.922281+0000","last_active":"2023-12-24T20:02:55.915054+0000","last_peered":"2023-12-24T20:02:55.915054+0000","last_clean":"2023-12-24T20:02:55.915054+0000","last_became_active":"2023-12-24T20:02:54.921528+0000","last_became_peered":"2023-12-24T20:02:54.921528+0000","last_unstale":"2023-12-24T20:02:55.915054+0000","last_undegraded":"2023-12-24T20:02:55.915054+0000","last_fullsized":"2023-12-24T20:02:55.915054+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:07:32.604931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.924088+0000","last_change":"2023-12-24T20:02:55.923700+0000","last_active":"2023-12-24T20:02:55.924088+0000","last_peered":"2023-12-24T20:02:55.924088+0000","last_clean":"2023-12-24T20:02:55.924088+0000","last_became_active":"2023-12-24T20:02:55.923269+0000","last_became_peered":"2023-12-24T20:02:55.923269+0000","last_unstale":"2023-12-24T20:02:55.924088+0000","last_undegraded":"2023-12-24T20:02:55.924088+0000","last_fullsized":"2023-12-24T20:02:55.924088+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:14:51.274924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.930613+0000","last_change":"2023-12-24T20:02:54.922259+0000","last_active":"2023-12-24T20:02:55.930613+0000","last_peered":"2023-12-24T20:02:55.930613+0000","last_clean":"2023-12-24T20:02:55.930613+0000","last_became_active":"2023-12-24T20:02:54.922032+0000","last_became_peered":"2023-12-24T20:02:54.922032+0000","last_unstale":"2023-12-24T20:02:55.930613+0000","last_undegraded":"2023-12-24T20:02:55.930613+0000","last_fullsized":"2023-12-24T20:02:55.930613+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:35.990253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.931288+0000","last_change":"2023-12-24T20:02:55.929203+0000","last_active":"2023-12-24T20:02:55.931288+0000","last_peered":"2023-12-24T20:02:55.931288+0000","last_clean":"2023-12-24T20:02:55.931288+0000","last_became_active":"2023-12-24T20:02:55.926077+0000","last_became_peered":"2023-12-24T20:02:55.926077+0000","last_unstale":"2023-12-24T20:02:55.931288+0000","last_undegraded":"2023-12-24T20:02:55.931288+0000","last_fullsized":"2023-12-24T20:02:55.931288+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:05:04.237343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.918112+0000","last_change":"2023-12-24T20:02:54.923435+0000","last_active":"2023-12-24T20:02:55.918112+0000","last_peered":"2023-12-24T20:02:55.918112+0000","last_clean":"2023-12-24T20:02:55.918112+0000","last_became_active":"2023-12-24T20:02:54.923169+0000","last_became_peered":"2023-12-24T20:02:54.923169+0000","last_unstale":"2023-12-24T20:02:55.918112+0000","last_undegraded":"2023-12-24T20:02:55.918112+0000","last_fullsized":"2023-12-24T20:02:55.918112+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:29:35.990253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.925497+0000","last_change":"2023-12-24T20:02:55.925428+0000","last_active":"2023-12-24T20:02:55.925497+0000","last_peered":"2023-12-24T20:02:55.925497+0000","last_clean":"2023-12-24T20:02:55.925497+0000","last_became_active":"2023-12-24T20:02:55.925200+0000","last_became_peered":"2023-12-24T20:02:55.925200+0000","last_unstale":"2023-12-24T20:02:55.925497+0000","last_undegraded":"2023-12-24T20:02:55.925497+0000","last_fullsized":"2023-12-24T20:02:55.925497+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:43:02.753958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.911405+0000","last_change":"2023-12-24T20:02:54.921890+0000","last_active":"2023-12-24T20:02:55.911405+0000","last_peered":"2023-12-24T20:02:55.911405+0000","last_clean":"2023-12-24T20:02:55.911405+0000","last_became_active":"2023-12-24T20:02:54.921635+0000","last_became_peered":"2023-12-24T20:02:54.921635+0000","last_unstale":"2023-12-24T20:02:55.911405+0000","last_undegraded":"2023-12-24T20:02:55.911405+0000","last_fullsized":"2023-12-24T20:02:55.911405+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:19:55.914676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.930279+0000","last_change":"2023-12-24T20:02:55.930187+0000","last_active":"2023-12-24T20:02:55.930279+0000","last_peered":"2023-12-24T20:02:55.930279+0000","last_clean":"2023-12-24T20:02:55.930279+0000","last_became_active":"2023-12-24T20:02:55.929750+0000","last_became_peered":"2023-12-24T20:02:55.929750+0000","last_unstale":"2023-12-24T20:02:55.930279+0000","last_undegraded":"2023-12-24T20:02:55.930279+0000","last_fullsized":"2023-12-24T20:02:55.930279+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:48.146462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.917601+0000","last_change":"2023-12-24T20:02:54.926552+0000","last_active":"2023-12-24T20:02:55.917601+0000","last_peered":"2023-12-24T20:02:55.917601+0000","last_clean":"2023-12-24T20:02:55.917601+0000","last_became_active":"2023-12-24T20:02:54.926318+0000","last_became_peered":"2023-12-24T20:02:54.926318+0000","last_unstale":"2023-12-24T20:02:55.917601+0000","last_undegraded":"2023-12-24T20:02:55.917601+0000","last_fullsized":"2023-12-24T20:02:55.917601+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:27:43.044939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.942574+0000","last_change":"2023-12-24T20:02:55.942526+0000","last_active":"2023-12-24T20:02:55.942574+0000","last_peered":"2023-12-24T20:02:55.942574+0000","last_clean":"2023-12-24T20:02:55.942574+0000","last_became_active":"2023-12-24T20:02:55.942394+0000","last_became_peered":"2023-12-24T20:02:55.942394+0000","last_unstale":"2023-12-24T20:02:55.942574+0000","last_undegraded":"2023-12-24T20:02:55.942574+0000","last_fullsized":"2023-12-24T20:02:55.942574+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:08:48.057909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"135'2","reported_seq":12,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.934419+0000","last_change":"2023-12-24T20:02:54.920916+0000","last_active":"2023-12-24T20:02:55.934419+0000","last_peered":"2023-12-24T20:02:55.934419+0000","last_clean":"2023-12-24T20:02:55.934419+0000","last_became_active":"2023-12-24T20:02:54.920012+0000","last_became_peered":"2023-12-24T20:02:54.920012+0000","last_unstale":"2023-12-24T20:02:55.934419+0000","last_undegraded":"2023-12-24T20:02:55.934419+0000","last_fullsized":"2023-12-24T20:02:55.934419+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:34:37.820404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.936253+0000","last_change":"2023-12-24T20:02:55.936200+0000","last_active":"2023-12-24T20:02:55.936253+0000","last_peered":"2023-12-24T20:02:55.936253+0000","last_clean":"2023-12-24T20:02:55.936253+0000","last_became_active":"2023-12-24T20:02:55.935534+0000","last_became_peered":"2023-12-24T20:02:55.935534+0000","last_unstale":"2023-12-24T20:02:55.936253+0000","last_undegraded":"2023-12-24T20:02:55.936253+0000","last_fullsized":"2023-12-24T20:02:55.936253+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:43.126631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.928953+0000","last_change":"2023-12-24T20:02:54.923774+0000","last_active":"2023-12-24T20:02:55.928953+0000","last_peered":"2023-12-24T20:02:55.928953+0000","last_clean":"2023-12-24T20:02:55.928953+0000","last_became_active":"2023-12-24T20:02:54.923549+0000","last_became_peered":"2023-12-24T20:02:54.923549+0000","last_unstale":"2023-12-24T20:02:55.928953+0000","last_undegraded":"2023-12-24T20:02:55.928953+0000","last_fullsized":"2023-12-24T20:02:55.928953+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:41:40.057237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.923124+0000","last_change":"2023-12-24T20:02:55.922621+0000","last_active":"2023-12-24T20:02:55.923124+0000","last_peered":"2023-12-24T20:02:55.923124+0000","last_clean":"2023-12-24T20:02:55.923124+0000","last_became_active":"2023-12-24T20:02:55.921762+0000","last_became_peered":"2023-12-24T20:02:55.921762+0000","last_unstale":"2023-12-24T20:02:55.923124+0000","last_undegraded":"2023-12-24T20:02:55.923124+0000","last_fullsized":"2023-12-24T20:02:55.923124+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:03:56.415308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.914785+0000","last_change":"2023-12-24T20:02:54.924813+0000","last_active":"2023-12-24T20:02:55.914785+0000","last_peered":"2023-12-24T20:02:55.914785+0000","last_clean":"2023-12-24T20:02:55.914785+0000","last_became_active":"2023-12-24T20:02:54.924306+0000","last_became_peered":"2023-12-24T20:02:54.924306+0000","last_unstale":"2023-12-24T20:02:55.914785+0000","last_undegraded":"2023-12-24T20:02:55.914785+0000","last_fullsized":"2023-12-24T20:02:55.914785+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:46:23.977127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.928086+0000","last_change":"2023-12-24T20:02:55.928016+0000","last_active":"2023-12-24T20:02:55.928086+0000","last_peered":"2023-12-24T20:02:55.928086+0000","last_clean":"2023-12-24T20:02:55.928086+0000","last_became_active":"2023-12-24T20:02:55.927706+0000","last_became_peered":"2023-12-24T20:02:55.927706+0000","last_unstale":"2023-12-24T20:02:55.928086+0000","last_undegraded":"2023-12-24T20:02:55.928086+0000","last_fullsized":"2023-12-24T20:02:55.928086+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:37:15.544876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.923616+0000","last_change":"2023-12-24T20:02:54.919210+0000","last_active":"2023-12-24T20:02:55.923616+0000","last_peered":"2023-12-24T20:02:55.923616+0000","last_clean":"2023-12-24T20:02:55.923616+0000","last_became_active":"2023-12-24T20:02:54.918958+0000","last_became_peered":"2023-12-24T20:02:54.918958+0000","last_unstale":"2023-12-24T20:02:55.923616+0000","last_undegraded":"2023-12-24T20:02:55.923616+0000","last_fullsized":"2023-12-24T20:02:55.923616+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:00:34.203812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.917272+0000","last_change":"2023-12-24T20:02:55.917081+0000","last_active":"2023-12-24T20:02:55.917272+0000","last_peered":"2023-12-24T20:02:55.917272+0000","last_clean":"2023-12-24T20:02:55.917272+0000","last_became_active":"2023-12-24T20:02:55.916812+0000","last_became_peered":"2023-12-24T20:02:55.916812+0000","last_unstale":"2023-12-24T20:02:55.917272+0000","last_undegraded":"2023-12-24T20:02:55.917272+0000","last_fullsized":"2023-12-24T20:02:55.917272+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:37:37.285209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.914138+0000","last_change":"2023-12-24T20:02:54.924549+0000","last_active":"2023-12-24T20:02:55.914138+0000","last_peered":"2023-12-24T20:02:55.914138+0000","last_clean":"2023-12-24T20:02:55.914138+0000","last_became_active":"2023-12-24T20:02:54.924264+0000","last_became_peered":"2023-12-24T20:02:54.924264+0000","last_unstale":"2023-12-24T20:02:55.914138+0000","last_undegraded":"2023-12-24T20:02:55.914138+0000","last_fullsized":"2023-12-24T20:02:55.914138+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:16:57.477627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.920300+0000","last_change":"2023-12-24T20:02:55.919578+0000","last_active":"2023-12-24T20:02:55.920300+0000","last_peered":"2023-12-24T20:02:55.920300+0000","last_clean":"2023-12-24T20:02:55.920300+0000","last_became_active":"2023-12-24T20:02:55.919352+0000","last_became_peered":"2023-12-24T20:02:55.919352+0000","last_unstale":"2023-12-24T20:02:55.920300+0000","last_undegraded":"2023-12-24T20:02:55.920300+0000","last_fullsized":"2023-12-24T20:02:55.920300+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:36:07.176909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.914987+0000","last_change":"2023-12-24T20:02:54.924297+0000","last_active":"2023-12-24T20:02:55.914987+0000","last_peered":"2023-12-24T20:02:55.914987+0000","last_clean":"2023-12-24T20:02:55.914987+0000","last_became_active":"2023-12-24T20:02:54.923168+0000","last_became_peered":"2023-12-24T20:02:54.923168+0000","last_unstale":"2023-12-24T20:02:55.914987+0000","last_undegraded":"2023-12-24T20:02:55.914987+0000","last_fullsized":"2023-12-24T20:02:55.914987+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:51.898479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.929242+0000","last_change":"2023-12-24T20:02:55.929005+0000","last_active":"2023-12-24T20:02:55.929242+0000","last_peered":"2023-12-24T20:02:55.929242+0000","last_clean":"2023-12-24T20:02:55.929242+0000","last_became_active":"2023-12-24T20:02:55.928510+0000","last_became_peered":"2023-12-24T20:02:55.928510+0000","last_unstale":"2023-12-24T20:02:55.929242+0000","last_undegraded":"2023-12-24T20:02:55.929242+0000","last_fullsized":"2023-12-24T20:02:55.929242+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:50:01.446179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.918313+0000","last_change":"2023-12-24T20:02:54.926460+0000","last_active":"2023-12-24T20:02:55.918313+0000","last_peered":"2023-12-24T20:02:55.918313+0000","last_clean":"2023-12-24T20:02:55.918313+0000","last_became_active":"2023-12-24T20:02:54.926167+0000","last_became_peered":"2023-12-24T20:02:54.926167+0000","last_unstale":"2023-12-24T20:02:55.918313+0000","last_undegraded":"2023-12-24T20:02:55.918313+0000","last_fullsized":"2023-12-24T20:02:55.918313+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:38:27.056715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.936967+0000","last_change":"2023-12-24T20:02:55.936909+0000","last_active":"2023-12-24T20:02:55.936967+0000","last_peered":"2023-12-24T20:02:55.936967+0000","last_clean":"2023-12-24T20:02:55.936967+0000","last_became_active":"2023-12-24T20:02:55.936400+0000","last_became_peered":"2023-12-24T20:02:55.936400+0000","last_unstale":"2023-12-24T20:02:55.936967+0000","last_undegraded":"2023-12-24T20:02:55.936967+0000","last_fullsized":"2023-12-24T20:02:55.936967+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:24:38.592851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.914894+0000","last_change":"2023-12-24T20:02:54.924954+0000","last_active":"2023-12-24T20:02:55.914894+0000","last_peered":"2023-12-24T20:02:55.914894+0000","last_clean":"2023-12-24T20:02:55.914894+0000","last_became_active":"2023-12-24T20:02:54.924612+0000","last_became_peered":"2023-12-24T20:02:54.924612+0000","last_unstale":"2023-12-24T20:02:55.914894+0000","last_undegraded":"2023-12-24T20:02:55.914894+0000","last_fullsized":"2023-12-24T20:02:55.914894+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:01:06.813618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.930882+0000","last_change":"2023-12-24T20:02:55.930793+0000","last_active":"2023-12-24T20:02:55.930882+0000","last_peered":"2023-12-24T20:02:55.930882+0000","last_clean":"2023-12-24T20:02:55.930882+0000","last_became_active":"2023-12-24T20:02:55.930053+0000","last_became_peered":"2023-12-24T20:02:55.930053+0000","last_unstale":"2023-12-24T20:02:55.930882+0000","last_undegraded":"2023-12-24T20:02:55.930882+0000","last_fullsized":"2023-12-24T20:02:55.930882+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:54.902942+0000","last_clean_scrub_stamp":"2023-12-24T20:02:54.902942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:45:39.646167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.914871+0000","last_change":"2023-12-24T20:02:54.922634+0000","last_active":"2023-12-24T20:02:55.914871+0000","last_peered":"2023-12-24T20:02:55.914871+0000","last_clean":"2023-12-24T20:02:55.914871+0000","last_became_active":"2023-12-24T20:02:54.922005+0000","last_became_peered":"2023-12-24T20:02:54.922005+0000","last_unstale":"2023-12-24T20:02:55.914871+0000","last_undegraded":"2023-12-24T20:02:55.914871+0000","last_fullsized":"2023-12-24T20:02:55.914871+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:02:53.895799+0000","last_clean_scrub_stamp":"2023-12-24T20:02:53.895799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:05.668068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":264,"reported_epoch":135,"state":"active+clean","last_fresh":"2023-12-24T20:02:55.919262+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:02:55.919262+0000","last_peered":"2023-12-24T20:02:55.919262+0000","last_clean":"2023-12-24T20:02:55.919262+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:02:55.919262+0000","last_undegraded":"2023-12-24T20:02:55.919262+0000","last_fullsized":"2023-12-24T20:02:55.919262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1310,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194001,"statfs":{"total":200000000,"available":198657945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52000000000000002,"15min":0.501},"min":{"1min":0.38800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70799999999999996,"5min":0.754,"15min":0.754},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81799999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54900000000000004,"15min":0.53900000000000003},"min":{"1min":0.435,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72899999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.50800000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.755,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.62,"15min":0.627},"min":{"1min":0.44,"5min":0.437,"15min":0.437},"max":{"1min":0.76800000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.503,"15min":0.52900000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.621,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.502},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.54200000000000004,"15min":0.58599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70099999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63500000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.55800000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.56399999999999995},"min":{"1min":0.39500000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.41699999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.79300000000000004,"5min":0.873,"15min":0.873},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":733,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194578,"statfs":{"total":200000000,"available":199248831,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.51700000000000002},"min":{"1min":0.35099999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76600000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.441}]},{"osd":1,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56399999999999995,"15min":0.53400000000000003},"min":{"1min":0.40100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80900000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54200000000000004,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.34499999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78900000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.41699999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69799999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.378}]},{"osd":3,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57399999999999995,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83399999999999996,"5min":1.077,"15min":1.077},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60599999999999998,"15min":0.57499999999999996},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.752,"5min":1.048,"15min":1.048},"last":0.497}]},{"osd":4,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.32900000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72499999999999998,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70399999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55000000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72999999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.505,"15min":0.499},"min":{"1min":0.37,"5min":0.254,"15min":0.254},"max":{"1min":0.70199999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53800000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.41199999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.622}]}]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":733,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194578,"statfs":{"total":200000000,"available":199248777,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.27300000000000002,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.5,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.28399999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59999999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.379,"15min":0.36699999999999999},"min":{"1min":0.29999999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.57799999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.307}]},{"osd":3,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.41899999999999998,"15min":0.41299999999999998},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40300000000000002,"15min":0.39500000000000002},"min":{"1min":0.29799999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.51500000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.38300000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59699999999999998,"15min":0.59199999999999997},"min":{"1min":0.443,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.752,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.495},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.58799999999999997,"15min":0.57199999999999995},"min":{"1min":0.47999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.81499999999999995,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56799999999999995}]},{"osd":5,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.627,"15min":0.621},"min":{"1min":0.45600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85199999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.443,"5min":0.433,"15min":0.433},"max":{"1min":0.79800000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60399999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.623,"15min":0.60499999999999998},"min":{"1min":0.43099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.89900000000000002,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63700000000000001,"15min":0.61099999999999999},"min":{"1min":0.51100000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84899999999999998,"5min":0.878,"15min":0.878},"last":0.54500000000000004}]},{"osd":7,"last update":"Sun Dec 24 20:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.87,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.621},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66000000000000003,"15min":0.64200000000000002},"min":{"1min":0.51700000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.63200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1311,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194000,"statfs":{"total":200000000,"available":198656885,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.35799999999999998,"15min":0.42399999999999999},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.49199999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.27300000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.60999999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.24199999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35699999999999998,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52600000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.30099999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.55000000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.27900000000000003}]},{"osd":3,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42899999999999999,"15min":0.46500000000000002},"min":{"1min":0.27300000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57499999999999996,"5min":2.573,"15min":2.573},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.442,"5min":0.42699999999999999,"15min":0.42399999999999999},"min":{"1min":0.33600000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59499999999999997,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.49399999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91400000000000003,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.68200000000000005},"min":{"1min":0.47499999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97499999999999998,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.43099999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.71499999999999997},"min":{"1min":0.47899999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.93400000000000005,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.624},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47099999999999997}]},{"osd":6,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.504,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78100000000000003,"5min":1.655,"15min":1.655},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97499999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.45300000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64000000000000001,"15min":0.64400000000000002},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95399999999999996,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.502},{"interface":"front","average":{"1min":0.629,"5min":0.66700000000000004,"15min":0.72699999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93200000000000005,"5min":2.6579999999999999,"15min":2.6579999999999999},"last":0.52100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":733,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194579,"statfs":{"total":200000000,"available":199248901,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36299999999999999,"15min":0.371},"min":{"1min":0.24199999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.67700000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.379,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.40000000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.371,"15min":0.36299999999999999},"min":{"1min":0.23899999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48199999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29999999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.505},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61399999999999999,"15min":0.628},"min":{"1min":0.47299999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86699999999999999,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.72499999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65900000000000003,"15min":0.627},"min":{"1min":0.46999999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1559999999999999,"5min":3.577,"15min":3.577},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2809999999999999,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.79700000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67100000000000004,"15min":0.63900000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.111,"5min":3.637,"15min":3.637},"last":0.67600000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69899999999999995,"15min":0.66100000000000003},"min":{"1min":0.49099999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.141,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67900000000000005,"15min":0.68300000000000005},"min":{"1min":0.48699999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.232,"5min":1.331,"15min":1.331},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":735,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194577,"statfs":{"total":200000000,"available":199247295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.34499999999999997,"15min":0.32800000000000001},"min":{"1min":0.27700000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.48599999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.35499999999999998},"min":{"1min":0.30499999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.34799999999999998},"min":{"1min":0.27800000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.504,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.40300000000000002,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.378}]},{"osd":2,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.41299999999999998,"15min":0.40899999999999997},"min":{"1min":0.32900000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.436,"15min":0.42699999999999999},"min":{"1min":0.29399999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.44}]},{"osd":4,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84599999999999997,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.60299999999999998},"min":{"1min":0.45600000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80800000000000005,"5min":1.337,"15min":1.337},"last":0.35499999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84599999999999997,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85099999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.48999999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.61799999999999999},"min":{"1min":0.435,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86799999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.502},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.623},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.874,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.51600000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.66600000000000004,"15min":0.64000000000000001},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.91600000000000004,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65500000000000003,"15min":0.64100000000000001},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85799999999999998,"5min":1.006,"15min":1.006},"last":0.54100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":733,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194579,"statfs":{"total":200000000,"available":199248901,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.35699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73399999999999999,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77300000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.66800000000000004}]},{"osd":1,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.60599999999999998,"15min":0.72299999999999998},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.73599999999999999,"5min":4.883,"15min":4.883},"last":0.751},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55800000000000005,"15min":0.59299999999999997},"min":{"1min":0.39300000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72999999999999998,"5min":1.544,"15min":1.544},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.628,"5min":0.88,"15min":0.88},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.59199999999999997},"min":{"1min":0.35399999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69299999999999995,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.73199999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.38900000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70199999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.66000000000000003,"15min":0.89200000000000002},"min":{"1min":0.47999999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72099999999999997,"5min":8.8200000000000003,"15min":8.8200000000000003},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.52400000000000002},"min":{"1min":0.34899999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66500000000000004,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.64900000000000002},"min":{"1min":0.39400000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.80300000000000005,"5min":3.8279999999999998,"15min":3.8279999999999998},"last":0.71999999999999997}]},{"osd":6,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51800000000000002,"15min":0.53500000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68300000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59299999999999997,"15min":0.63700000000000001},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.751,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Sun Dec 24 20:02:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.69399999999999995,"15min":1.073},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":14.039999999999999,"15min":14.039999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.36599999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194578,"statfs":{"total":200000000,"available":199248325,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53700000000000003,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76500000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.54900000000000004},"min":{"1min":0.39500000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83299999999999996,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55200000000000005,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67100000000000004,"5min":1.847,"15min":1.847},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59199999999999997,"15min":0.56000000000000005},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.74299999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.52300000000000002},"min":{"1min":0.42599999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.37,"15min":0.37},"max":{"1min":0.64200000000000002,"5min":1.97,"15min":1.97},"last":0.57599999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.60599999999999998,"15min":0.56999999999999995},"min":{"1min":0.41599999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.76400000000000001,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.56299999999999994},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78100000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.65700000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.51900000000000002},"min":{"1min":0.32200000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66900000000000004,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.47399999999999998},"min":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.29499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.68700000000000006,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:02:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.71699999999999997,"5min":3.766,"15min":3.766},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70199999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.70399999999999996}]}]}],"pool_statfs":[]}} 2023-12-24T20:03:00.441 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T20:03:00.441 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T20:03:00.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.606+0000 7f8e7f767700 1 Processor -- start 2023-12-24T20:03:00.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.607+0000 7f8e7f767700 1 -- start start 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.607+0000 7f8e7f767700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e78159df0 0x7f8e780cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.607+0000 7f8e7f767700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e780cc0e0 0x7f8e780cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.607+0000 7f8e7f767700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e780cf150 con 0x7f8e7815a1c0 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.607+0000 7f8e7f767700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e780cc5f0 con 0x7f8e780cc0e0 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.607+0000 7f8e7f767700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780ce820 con 0x7f8e78159df0 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e7cd02700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8e7815a1c0 0x7f8e780cd470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45960/0 (socket says 172.21.15.61:45960) 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e7cd02700 1 -- 172.21.15.61:0/2960973308 learned_addr learned my addr 172.21.15.61:0/2960973308 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e7dd04700 1 --2- 172.21.15.61:0/2960973308 >> v2:172.21.15.133:3300/0 conn(0x7f8e780cc0e0 0x7f8e780cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e7d503700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e78159df0 0x7f8e780cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426308520 0 0) 0x7f8e780cf150 con 0x7f8e7815a1c0 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e64003570 con 0x7f8e7815a1c0 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1129841210 0 0) 0x7f8e64003570 con 0x7f8e7815a1c0 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e78159df0 msgr2=0x7f8e780cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:00.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e78159df0 0x7f8e780cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 >> v2:172.21.15.133:3300/0 conn(0x7f8e780cc0e0 msgr2=0x7f8e780cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 --2- 172.21.15.61:0/2960973308 >> v2:172.21.15.133:3300/0 conn(0x7f8e780cc0e0 0x7f8e780cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780ceb00 con 0x7f8e7815a1c0 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f8e74001470 con 0x7f8e7815a1c0 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 >> v1:172.21.15.61:6789/0 conn(0x7f8e7815a1c0 legacy=0x7f8e780cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e64003ae0 0x7f8e64003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e78159df0 0x7f8e64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e64004d50 0x7f8e640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780cc5f0 con 0x7f8e64003ae0 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780ce820 con 0x7f8e64004d50 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6400bb10 con 0x7f8e78159df0 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e7d503700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e64003ae0 0x7f8e64003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e7cd02700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e78159df0 0x7f8e64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.608+0000 7f8e7dd04700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e64004d50 0x7f8e640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7d503700 1 -- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e78159df0 msgr2=0x7f8e64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:00.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7d503700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e78159df0 0x7f8e64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7d503700 1 -- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e64004d50 msgr2=0x7f8e640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7d503700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e64004d50 0x7f8e640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7d503700 1 -- 172.21.15.61:0/2960973308 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e64003570 con 0x7f8e64003ae0 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7dd04700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e64004d50 0x7f8e640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7d503700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e64003ae0 0x7f8e64003ef0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009c30 tx=0x7f8e6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e701c6eab1ad6b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00e710 con 0x7f8e64003ae0 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c00e870 con 0x7f8e64003ae0 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e6bfff700 1 -- 172.21.15.61:0/2960973308 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00ec30 con 0x7f8e64003ae0 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7f767700 1 -- 172.21.15.61:0/2960973308 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e64003ae0 msgr2=0x7f8e64003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7f767700 1 --2- 172.21.15.61:0/2960973308 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e64003ae0 0x7f8e64003ef0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009c30 tx=0x7f8e6c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7dd04700 1 -- 172.21.15.61:0/2960973308 reap_dead start 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7f767700 1 -- 172.21.15.61:0/2960973308 shutdown_connections 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.609+0000 7f8e7f767700 1 -- 172.21.15.61:0/2960973308 >> 172.21.15.61:0/2960973308 conn(0x7f8e7806e600 msgr2=0x7f8e78067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.610+0000 7f8e7f767700 1 -- 172.21.15.61:0/2960973308 shutdown_connections 2023-12-24T20:03:00.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.610+0000 7f8e7f767700 1 -- 172.21.15.61:0/2960973308 wait complete. 2023-12-24T20:03:00.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.611+0000 7f8e7f767700 1 Processor -- start 2023-12-24T20:03:00.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.611+0000 7f8e7f767700 1 -- start start 2023-12-24T20:03:00.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7f767700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e64003ae0 0x7f8e780b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7f767700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e78154b50 0x7f8e78157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7f767700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e78157c60 0x7f8e780b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7f767700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e78158100 con 0x7f8e78154b50 2023-12-24T20:03:00.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7f767700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780b39f0 con 0x7f8e78157c60 2023-12-24T20:03:00.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7f767700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e780b3cd0 con 0x7f8e64003ae0 2023-12-24T20:03:00.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7cd02700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e78154b50 0x7f8e78157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7cd02700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e78154b50 0x7f8e78157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41494/0 (socket says 172.21.15.61:41494) 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7cd02700 1 -- 172.21.15.61:0/815640210 learned_addr learned my addr 172.21.15.61:0/815640210 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7dd04700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e78157c60 0x7f8e780b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7d503700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e64003ae0 0x7f8e780b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7cd02700 1 -- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e64003ae0 msgr2=0x7f8e780b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7cd02700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e64003ae0 0x7f8e780b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7cd02700 1 -- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e78157c60 msgr2=0x7f8e780b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7cd02700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e78157c60 0x7f8e780b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7cd02700 1 -- 172.21.15.61:0/815640210 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e780ca100 con 0x7f8e78154b50 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7d503700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e64003ae0 0x7f8e780b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7cd02700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e78154b50 0x7f8e78157720 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8e74007390 tx=0x7f8e74001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e697fa700 1 -- 172.21.15.61:0/815640210 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74018030 con 0x7f8e78154b50 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e697fa700 1 -- 172.21.15.61:0/815640210 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e74007750 con 0x7f8e78154b50 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e697fa700 1 -- 172.21.15.61:0/815640210 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400fa80 con 0x7f8e78154b50 2023-12-24T20:03:00.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7f767700 1 -- 172.21.15.61:0/815640210 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7815d0e0 con 0x7f8e78154b50 2023-12-24T20:03:00.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.612+0000 7f8e7f767700 1 -- 172.21.15.61:0/815640210 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7815d6a0 con 0x7f8e78154b50 2023-12-24T20:03:00.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.613+0000 7f8e7f767700 1 -- 172.21.15.61:0/815640210 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e78089040 con 0x7f8e78154b50 2023-12-24T20:03:00.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.614+0000 7f8e697fa700 1 -- 172.21.15.61:0/815640210 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8e7401b070 con 0x7f8e78154b50 2023-12-24T20:03:00.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.614+0000 7f8e697fa700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8e5c066f30 0x7f8e5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:00.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.614+0000 7f8e697fa700 1 -- 172.21.15.61:0/815640210 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e74019070 con 0x7f8e78154b50 2023-12-24T20:03:00.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.614+0000 7f8e7d503700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8e5c066f30 0x7f8e5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:00.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.615+0000 7f8e7d503700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8e5c066f30 0x7f8e5c0693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0091e0 tx=0x7f8e6c01a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:00.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.619+0000 7f8e697fa700 1 -- 172.21.15.61:0/815640210 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e74051580 con 0x7f8e78154b50 2023-12-24T20:03:00.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.894+0000 7f8e7f767700 1 -- 172.21.15.61:0/815640210 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8e7804c3c0 con 0x7f8e78154b50 2023-12-24T20:03:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.898+0000 7f8e697fa700 1 -- 172.21.15.61:0/815640210 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8e74054ba0 con 0x7f8e78154b50 2023-12-24T20:03:00.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 -- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8e5c066f30 msgr2=0x7f8e5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8e5c066f30 0x7f8e5c0693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0091e0 tx=0x7f8e6c01a000 comp rx=0 tx=0).stop 2023-12-24T20:03:00.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 -- 172.21.15.61:0/815640210 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e78154b50 msgr2=0x7f8e78157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:00.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e78154b50 0x7f8e78157720 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f8e74007390 tx=0x7f8e74001dc0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 -- 172.21.15.61:0/815640210 shutdown_connections 2023-12-24T20:03:00.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8e64003ae0 0x7f8e780b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8e5c066f30 0x7f8e5c0693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e78157c60 0x7f8e780b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 --2- 172.21.15.61:0/815640210 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8e78154b50 0x7f8e78157720 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:00.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 -- 172.21.15.61:0/815640210 >> 172.21.15.61:0/815640210 conn(0x7f8e7806e600 msgr2=0x7f8e781584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:00.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 -- 172.21.15.61:0/815640210 shutdown_connections 2023-12-24T20:03:00.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:00.900+0000 7f8e7f767700 1 -- 172.21.15.61:0/815640210 wait complete. 2023-12-24T20:03:00.901 INFO:teuthology.orchestra.run.smithi061.stderr:updated caps for client.0 2023-12-24T20:03:00.912 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:01.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.034+0000 7fd2f81b3700 1 Processor -- start 2023-12-24T20:03:01.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.035+0000 7fd2f81b3700 1 -- start start 2023-12-24T20:03:01.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.035+0000 7fd2f81b3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2f0068140 0x7fd2f00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.035+0000 7fd2f81b3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd2f0068510 0x7fd2f00b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.035+0000 7fd2f81b3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2f0159a60 0x7fd2f0159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.035+0000 7fd2f81b3700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f00b2890 con 0x7fd2f0068510 2023-12-24T20:03:01.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.035+0000 7fd2f81b3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f00b11e0 con 0x7fd2f0159a60 2023-12-24T20:03:01.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.035+0000 7fd2f81b3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00cf630 con 0x7fd2f0068140 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.035+0000 7fd2f574e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd2f0068510 0x7fd2f00b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f574e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd2f0068510 0x7fd2f00b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41506/0 (socket says 172.21.15.61:41506) 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f574e700 1 -- 172.21.15.61:0/3070525041 learned_addr learned my addr 172.21.15.61:0/3070525041 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f6750700 1 --2- 172.21.15.61:0/3070525041 >> v2:172.21.15.133:3300/0 conn(0x7fd2f0159a60 0x7fd2f0159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f5f4f700 1 --2- 172.21.15.61:0/3070525041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2f0068140 0x7fd2f00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f574e700 1 -- 172.21.15.61:0/3070525041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2f0068140 msgr2=0x7fd2f00cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f574e700 1 --2- 172.21.15.61:0/3070525041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2f0068140 0x7fd2f00cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f574e700 1 -- 172.21.15.61:0/3070525041 >> v2:172.21.15.133:3300/0 conn(0x7fd2f0159a60 msgr2=0x7fd2f0159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f574e700 1 --2- 172.21.15.61:0/3070525041 >> v2:172.21.15.133:3300/0 conn(0x7fd2f0159a60 0x7fd2f0159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f574e700 1 -- 172.21.15.61:0/3070525041 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00b2240 con 0x7fd2f0068510 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f574e700 1 --2- 172.21.15.61:0/3070525041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0068510 0x7fd2f00b0ca0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0067bf0 tx=0x7fd2ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d66ce45fb7e2c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f4f4d700 1 -- 172.21.15.61:0/3070525041 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec00b860 con 0x7fd2f0068510 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f4f4d700 1 -- 172.21.15.61:0/3070525041 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec00b9c0 con 0x7fd2f0068510 2023-12-24T20:03:01.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.036+0000 7fd2f4f4d700 1 -- 172.21.15.61:0/3070525041 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec00bd60 con 0x7fd2f0068510 2023-12-24T20:03:01.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.037+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3070525041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0068510 msgr2=0x7fd2f00b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.037+0000 7fd2f81b3700 1 --2- 172.21.15.61:0/3070525041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0068510 0x7fd2f00b0ca0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0067bf0 tx=0x7fd2ec009250 comp rx=0 tx=0).stop 2023-12-24T20:03:01.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.037+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3070525041 shutdown_connections 2023-12-24T20:03:01.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.037+0000 7fd2f81b3700 1 --2- 172.21.15.61:0/3070525041 >> v2:172.21.15.133:3300/0 conn(0x7fd2f0159a60 0x7fd2f0159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.037+0000 7fd2f81b3700 1 --2- 172.21.15.61:0/3070525041 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2f0068140 0x7fd2f00cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.037+0000 7fd2f81b3700 1 --2- 172.21.15.61:0/3070525041 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0068510 0x7fd2f00b0ca0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.037+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3070525041 >> 172.21.15.61:0/3070525041 conn(0x7fd2f0097a10 msgr2=0x7fd2f00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:01.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.037+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3070525041 shutdown_connections 2023-12-24T20:03:01.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.037+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3070525041 wait complete. 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.038+0000 7fd2f81b3700 1 Processor -- start 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.038+0000 7fd2f81b3700 1 -- start start 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f81b3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2f0068140 0x7fd2f00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f81b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2f0068510 0x7fd2f00c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f81b3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0159a60 0x7fd2f01508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f81b3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00ce530 con 0x7fd2f0159a60 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f81b3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00c6c90 con 0x7fd2f0068510 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f81b3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00c60a0 con 0x7fd2f0068140 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f6750700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0159a60 0x7fd2f01508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f6750700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0159a60 0x7fd2f01508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41522/0 (socket says 172.21.15.61:41522) 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f6750700 1 -- 172.21.15.61:0/3799085346 learned_addr learned my addr 172.21.15.61:0/3799085346 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f574e700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2f0068510 0x7fd2f00c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f5f4f700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2f0068140 0x7fd2f00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f6750700 1 -- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2f0068140 msgr2=0x7fd2f00c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f6750700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2f0068140 0x7fd2f00c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f6750700 1 -- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2f0068510 msgr2=0x7fd2f00c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f6750700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2f0068510 0x7fd2f00c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f6750700 1 -- 172.21.15.61:0/3799085346 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0094f0 con 0x7fd2f0159a60 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2f6750700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0159a60 0x7fd2f01508f0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8007f20 tx=0x7fd2e8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2e5ffb700 1 -- 172.21.15.61:0/3799085346 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e800eb90 con 0x7fd2f0159a60 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.039+0000 7fd2e5ffb700 1 -- 172.21.15.61:0/3799085346 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e800ed10 con 0x7fd2f0159a60 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.040+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3799085346 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f00c5550 con 0x7fd2f0159a60 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.040+0000 7fd2e5ffb700 1 -- 172.21.15.61:0/3799085346 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8014670 con 0x7fd2f0159a60 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.040+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3799085346 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f00c6640 con 0x7fd2f0159a60 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.041+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3799085346 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f006d440 con 0x7fd2f0159a60 2023-12-24T20:03:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.041+0000 7fd2e5ffb700 1 -- 172.21.15.61:0/3799085346 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd2e80149e0 con 0x7fd2f0159a60 2023-12-24T20:03:01.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.041+0000 7fd2e5ffb700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2d4066f30 0x7fd2d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.041+0000 7fd2e5ffb700 1 -- 172.21.15.61:0/3799085346 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2e8084b30 con 0x7fd2f0159a60 2023-12-24T20:03:01.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.042+0000 7fd2f5f4f700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2d4066f30 0x7fd2d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.042+0000 7fd2f5f4f700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2d4066f30 0x7fd2d40693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0006aa0 tx=0x7fd2e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:01.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.046+0000 7fd2e5ffb700 1 -- 172.21.15.61:0/3799085346 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2e8051da0 con 0x7fd2f0159a60 2023-12-24T20:03:01.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.283+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3799085346 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2f00c6e00 con 0x7fd2f0159a60 2023-12-24T20:03:01.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.283+0000 7fd2e5ffb700 1 -- 172.21.15.61:0/3799085346 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fd2e80553c0 con 0x7fd2f0159a60 2023-12-24T20:03:01.284 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:01.284 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3245805399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3245805399},{"type":"v1","addr":"172.21.15.133:6837","nonce":3245805399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/4168448475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":4168448475},{"type":"v1","addr":"172.21.15.61:6835","nonce":4168448475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1817856586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1817856586},{"type":"v1","addr":"172.21.15.61:6834","nonce":1817856586}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:55.325289+0000","modified":"2023-12-24T20:02:58.932577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7089},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7089":{"gid":7089,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2704897796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2704897796},{"type":"v1","addr":"172.21.15.133:6836","nonce":2704897796}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T20:03:01.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.285+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2d4066f30 msgr2=0x7fd2d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.285+0000 7fd2f81b3700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2d4066f30 0x7fd2d40693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0006aa0 tx=0x7fd2e0008040 comp rx=0 tx=0).stop 2023-12-24T20:03:01.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.285+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3799085346 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0159a60 msgr2=0x7fd2f01508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.285+0000 7fd2f81b3700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0159a60 0x7fd2f01508f0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8007f20 tx=0x7fd2e8009860 comp rx=0 tx=0).stop 2023-12-24T20:03:01.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.286+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3799085346 shutdown_connections 2023-12-24T20:03:01.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.286+0000 7fd2f81b3700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd2f0068140 0x7fd2f00c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.286+0000 7fd2f81b3700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd2d4066f30 0x7fd2d40693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.286+0000 7fd2f81b3700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd2f0159a60 0x7fd2f01508f0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.286+0000 7fd2f81b3700 1 --2- 172.21.15.61:0/3799085346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2f0068510 0x7fd2f00c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.286+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3799085346 >> 172.21.15.61:0/3799085346 conn(0x7fd2f0097a10 msgr2=0x7fd2f00aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:01.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.286+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3799085346 shutdown_connections 2023-12-24T20:03:01.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.286+0000 7fd2f81b3700 1 -- 172.21.15.61:0/3799085346 wait complete. 2023-12-24T20:03:01.287 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 69 2023-12-24T20:03:01.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T20:02:55.325289+0000', 'modified': '2023-12-24T20:02:58.932577+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7089}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7089': {'gid': 7089, 'name': 'b', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6836/2704897796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 2704897796}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 2704897796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T20:03:01.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T20:03:01.701 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-24T20:03:01.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.826+0000 7f381cb63700 1 Processor -- start 2023-12-24T20:03:01.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.826+0000 7f381cb63700 1 -- start start 2023-12-24T20:03:01.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f381cb63700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f38180ce030 0x7f381806f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f381cb63700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3818159cf0 0x7f381815a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f381cb63700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381815aba0 con 0x7f3818159920 2023-12-24T20:03:01.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f381cb63700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381806fbe0 con 0x7f38180ce030 2023-12-24T20:03:01.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f381cb63700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381815ae80 con 0x7f3818159cf0 2023-12-24T20:03:01.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f3815d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f38180ce030 0x7f381806f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f3815d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f38180ce030 0x7f381806f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41530/0 (socket says 172.21.15.61:41530) 2023-12-24T20:03:01.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f3815d9b700 1 -- 172.21.15.61:0/1359346032 learned_addr learned my addr 172.21.15.61:0/1359346032 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:01.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f3816d9d700 1 --2- 172.21.15.61:0/1359346032 >> v2:172.21.15.133:3300/0 conn(0x7f3818159cf0 0x7f381815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f3815d9b700 1 -- 172.21.15.61:0/1359346032 >> v2:172.21.15.133:3300/0 conn(0x7f3818159cf0 msgr2=0x7f381815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f3815d9b700 1 --2- 172.21.15.61:0/1359346032 >> v2:172.21.15.133:3300/0 conn(0x7f3818159cf0 0x7f381815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f3815d9b700 1 -- 172.21.15.61:0/1359346032 >> v1:172.21.15.133:6789/0 conn(0x7f3818159920 legacy=0x7f38180cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.827+0000 7f3815d9b700 1 -- 172.21.15.61:0/1359346032 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381806ebc0 con 0x7f38180ce030 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f3815d9b700 1 --2- 172.21.15.61:0/1359346032 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 0x7f381806f6a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f38180cc630 tx=0x7f3808009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9beb18d65fe1ad5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f381559a700 1 -- 172.21.15.61:0/1359346032 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808009e70 con 0x7f38180ce030 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f381559a700 1 -- 172.21.15.61:0/1359346032 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380800b860 con 0x7f38180ce030 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f381559a700 1 -- 172.21.15.61:0/1359346032 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380800bc00 con 0x7f38180ce030 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f381cb63700 1 -- 172.21.15.61:0/1359346032 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 msgr2=0x7f381806f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f381cb63700 1 --2- 172.21.15.61:0/1359346032 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 0x7f381806f6a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f38180cc630 tx=0x7f3808009250 comp rx=0 tx=0).stop 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f381cb63700 1 -- 172.21.15.61:0/1359346032 shutdown_connections 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f381cb63700 1 --2- 172.21.15.61:0/1359346032 >> v2:172.21.15.133:3300/0 conn(0x7f3818159cf0 0x7f381815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f381cb63700 1 --2- 172.21.15.61:0/1359346032 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 0x7f381806f6a0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f381cb63700 1 -- 172.21.15.61:0/1359346032 >> 172.21.15.61:0/1359346032 conn(0x7f381806b790 msgr2=0x7f3818069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:01.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.828+0000 7f381cb63700 1 -- 172.21.15.61:0/1359346032 shutdown_connections 2023-12-24T20:03:01.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.829+0000 7f381cb63700 1 -- 172.21.15.61:0/1359346032 wait complete. 2023-12-24T20:03:01.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.830+0000 7f381cb63700 1 Processor -- start 2023-12-24T20:03:01.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.830+0000 7f381cb63700 1 -- start start 2023-12-24T20:03:01.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.830+0000 7f381cb63700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 0x7f38180c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.830+0000 7f381cb63700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3818159920 0x7f38180acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.830+0000 7f381cb63700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3818159cf0 0x7f38180c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.830+0000 7f381cb63700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180c6310 con 0x7f38180ce030 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.830+0000 7f381cb63700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180c65f0 con 0x7f3818159920 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.830+0000 7f381cb63700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38180c6e60 con 0x7f3818159cf0 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 0x7f38180c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 0x7f38180c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41548/0 (socket says 172.21.15.61:41548) 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381659c700 1 -- 172.21.15.61:0/915823434 learned_addr learned my addr 172.21.15.61:0/915823434 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f3815d9b700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3818159920 0x7f38180acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f3816d9d700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3818159cf0 0x7f38180c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381659c700 1 -- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3818159cf0 msgr2=0x7f38180c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381659c700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3818159cf0 0x7f38180c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381659c700 1 -- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3818159920 msgr2=0x7f38180acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381659c700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3818159920 0x7f38180acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381659c700 1 -- 172.21.15.61:0/915823434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080094f0 con 0x7f38180ce030 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381659c700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 0x7f38180c9c50 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f380c00c590 tx=0x7f380c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f38067fc700 1 -- 172.21.15.61:0/915823434 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c011590 con 0x7f38180ce030 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f38067fc700 1 -- 172.21.15.61:0/915823434 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c0116f0 con 0x7f38180ce030 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381cb63700 1 -- 172.21.15.61:0/915823434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38180c7140 con 0x7f38180ce030 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f38067fc700 1 -- 172.21.15.61:0/915823434 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c011ab0 con 0x7f38180ce030 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.831+0000 7f381cb63700 1 -- 172.21.15.61:0/915823434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3818156970 con 0x7f38180ce030 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.833+0000 7f38067fc700 1 -- 172.21.15.61:0/915823434 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f380c01b3b0 con 0x7f38180ce030 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.833+0000 7f38067fc700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37f8066f30 0x7f37f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.833+0000 7f38067fc700 1 -- 172.21.15.61:0/915823434 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f380c083ae0 con 0x7f38180ce030 2023-12-24T20:03:01.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.833+0000 7f3815d9b700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37f8066f30 0x7f37f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.834+0000 7f3815d9b700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37f8066f30 0x7f37f80693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f38180cc630 tx=0x7f3808017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.835+0000 7f3825e63b80 1 Processor -- start 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.835+0000 7f3825e63b80 1 -- start start 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d767f530 0x5588d767f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7667b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763bda0 0x5588d7677c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3825e63b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588d75913e0 con 0x5588d763cdc0 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3825e63b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588d758ebe0 con 0x5588d767f530 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3825e63b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588d758a9d0 con 0x5588d763bda0 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3815d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7667b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3815d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7667b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41562/0 (socket says 172.21.15.61:41562) 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3815d9b700 1 -- 172.21.15.61:0/1608542159 learned_addr learned my addr 172.21.15.61:0/1608542159 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f381659c700 1 --2- 172.21.15.61:0/1608542159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d767f530 0x5588d767f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3816d9d700 1 --2- 172.21.15.61:0/1608542159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763bda0 0x5588d7677c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3815d9b700 1 -- 172.21.15.61:0/1608542159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763bda0 msgr2=0x5588d7677c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3815d9b700 1 --2- 172.21.15.61:0/1608542159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763bda0 0x5588d7677c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3815d9b700 1 -- 172.21.15.61:0/1608542159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d767f530 msgr2=0x5588d767f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3815d9b700 1 --2- 172.21.15.61:0/1608542159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d767f530 0x5588d767f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.836+0000 7f3815d9b700 1 -- 172.21.15.61:0/1608542159 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588d741e360 con 0x5588d763cdc0 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f3815d9b700 1 --2- 172.21.15.61:0/1608542159 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7667b90 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f3818064b60 tx=0x7f3808020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcd000df04a92cf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f37f77fe700 1 -- 172.21.15.61:0/1608542159 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808020070 con 0x5588d763cdc0 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f37f77fe700 1 -- 172.21.15.61:0/1608542159 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808029890 con 0x5588d763cdc0 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f37f77fe700 1 -- 172.21.15.61:0/1608542159 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808029a00 con 0x5588d763cdc0 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f3825e63b80 1 -- 172.21.15.61:0/1608542159 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 msgr2=0x5588d7667b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f3825e63b80 1 --2- 172.21.15.61:0/1608542159 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7667b90 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f3818064b60 tx=0x7f3808020000 comp rx=0 tx=0).stop 2023-12-24T20:03:01.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f3825e63b80 1 -- 172.21.15.61:0/1608542159 shutdown_connections 2023-12-24T20:03:01.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f3825e63b80 1 --2- 172.21.15.61:0/1608542159 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763bda0 0x5588d7677c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f3825e63b80 1 --2- 172.21.15.61:0/1608542159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d767f530 0x5588d767f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f3825e63b80 1 --2- 172.21.15.61:0/1608542159 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7667b90 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f3825e63b80 1 -- 172.21.15.61:0/1608542159 >> 172.21.15.61:0/1608542159 conn(0x5588d7639440 msgr2=0x5588d7684dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:01.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f3825e63b80 1 -- 172.21.15.61:0/1608542159 shutdown_connections 2023-12-24T20:03:01.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.837+0000 7f3825e63b80 1 -- 172.21.15.61:0/1608542159 wait complete. 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.838+0000 7f3825e63b80 1 -- start start 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.838+0000 7f3825e63b80 1 Processor -- start 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 0x5588d7667910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763cdc0 0x5588d767d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d767f530 0x5588d767ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3825e63b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588d75371b0 con 0x5588d767f530 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3825e63b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588d7536e50 con 0x5588d763bda0 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3825e63b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588d7483e40 con 0x5588d763cdc0 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3825e63b80 10 client.0 _ll_register_callbacks cb 0x5588d74867b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3816d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d767f530 0x5588d767ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3816d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d767f530 0x5588d767ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41576/0 (socket says 172.21.15.61:41576) 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3816d9d700 1 -- 172.21.15.61:0/3397459989 learned_addr learned my addr 172.21.15.61:0/3397459989 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:01.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3815d9b700 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763cdc0 0x5588d767d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f381659c700 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 0x5588d7667910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3816d9d700 1 -- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763cdc0 msgr2=0x5588d767d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3816d9d700 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763cdc0 0x5588d767d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3816d9d700 1 -- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 msgr2=0x5588d7667910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.839+0000 7f3816d9d700 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 0x5588d7667910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3816d9d700 1 -- 172.21.15.61:0/3397459989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381806ebc0 con 0x5588d767f530 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f381659c700 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 0x5588d7667910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3816d9d700 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d767f530 0x5588d767ab80 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3810007eb0 tx=0x7f381000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51a396e84fb9085 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f37f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f37f4ff9700 1 -- 172.21.15.61:0/3397459989 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000e050 con 0x5588d767f530 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f37f4ff9700 1 -- 172.21.15.61:0/3397459989 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3810013db0 con 0x5588d767f530 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3825e63b80 1 -- 172.21.15.61:0/3397459989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588d760beb0 con 0x5588d767f530 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f37f4ff9700 1 -- 172.21.15.61:0/3397459989 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3810019690 con 0x5588d767f530 2023-12-24T20:03:01.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3825e63b80 10 client.7224 fetch_fsmap learned FSMap version 69 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3825e63b80 1 -- 172.21.15.61:0/3397459989 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x5588d73cab10 con 0x5588d767f530 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f37f4ff9700 1 -- 172.21.15.61:0/3397459989 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5588d760beb0 con 0x5588d767f530 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f37f4ff9700 1 -- 172.21.15.61:0/3397459989 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 69) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f38100197f0 con 0x5588d767f530 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3825e63b80 10 client.7224 fetch_fsmap finished waiting for FSMap version 69 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3825e63b80 10 client.7224 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3825e63b80 20 client.7224 populate_metadata read hostname 'smithi061' 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3825e63b80 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:6834/2704897796,v1:172.21.15.133:6836/2704897796] conn(0x5588d7683b70 0x5588d7683f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3825e63b80 4 client.7224 mds_command: new command op to 7089 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.840+0000 7f3825e63b80 1 -- 172.21.15.61:0/3397459989 --> [v2:172.21.15.133:6834/2704897796,v1:172.21.15.133:6836/2704897796] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588d7561880 con 0x5588d7683b70 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.841+0000 7f381659c700 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:6834/2704897796,v1:172.21.15.133:6836/2704897796] conn(0x5588d7683b70 0x5588d7683f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.841+0000 7f37f4ff9700 10 client.7224 ms_handle_connect on v2:172.21.15.133:6834/2704897796 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.841+0000 7f381659c700 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:6834/2704897796,v1:172.21.15.133:6836/2704897796] conn(0x5588d7683b70 0x5588d7683f40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8f7086280b6329a server_cookie=7243a2442397711b in_seq=0 out_seq=0 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f37f4ff9700 1 -- 172.21.15.61:0/3397459989 <== mds.0 v2:172.21.15.133:6834/2704897796 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5588d7561880 con 0x5588d7683b70 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f37f4ff9700 10 client.7224 handle_command_reply: tid=0 2023-12-24T20:03:01.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 client.7224 shutdown 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 -- 172.21.15.61:0/3397459989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d767f530 msgr2=0x5588d767ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d767f530 0x5588d767ab80 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3810007eb0 tx=0x7f381000b040 comp rx=0 tx=0).stop 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 -- 172.21.15.61:0/3397459989 shutdown_connections 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:6834/2704897796,v1:172.21.15.133:6836/2704897796] conn(0x5588d7683b70 0x5588d7683f40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d767f530 0x5588d767ab80 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 0x5588d7667910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f37f4ff9700 0 client.7224 ms_handle_reset on v2:172.21.15.133:6834/2704897796 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 --2- 172.21.15.61:0/3397459989 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763cdc0 0x5588d767d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 -- 172.21.15.61:0/3397459989 >> 172.21.15.61:0/3397459989 conn(0x5588d7639440 msgr2=0x5588d7636a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 -- 172.21.15.61:0/3397459989 shutdown_connections 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 1 -- 172.21.15.61:0/3397459989 wait complete. 2023-12-24T20:03:01.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.842+0000 7f3825e63b80 20 client.7224 trim_cache size 0 max 16384 2023-12-24T20:03:01.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.859+0000 7f3825e63b80 1 Processor -- start 2023-12-24T20:03:01.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.859+0000 7f3825e63b80 1 -- start start 2023-12-24T20:03:01.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 0x5588d76e5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7630ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d767f530 0x5588d7631420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3825e63b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588d7638dc0 con 0x5588d763cdc0 2023-12-24T20:03:01.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3825e63b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588d76e59b0 con 0x5588d763bda0 2023-12-24T20:03:01.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3825e63b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588d763ac00 con 0x5588d767f530 2023-12-24T20:03:01.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3815d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7630ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3815d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7630ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41582/0 (socket says 172.21.15.61:41582) 2023-12-24T20:03:01.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3815d9b700 1 -- 172.21.15.61:0/2782646892 learned_addr learned my addr 172.21.15.61:0/2782646892 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:01.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f381659c700 1 --2- 172.21.15.61:0/2782646892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 0x5588d76e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3816d9d700 1 --2- 172.21.15.61:0/2782646892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d767f530 0x5588d7631420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3815d9b700 1 -- 172.21.15.61:0/2782646892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d767f530 msgr2=0x5588d7631420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3815d9b700 1 --2- 172.21.15.61:0/2782646892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d767f530 0x5588d7631420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3815d9b700 1 -- 172.21.15.61:0/2782646892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 msgr2=0x5588d76e5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3815d9b700 1 --2- 172.21.15.61:0/2782646892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 0x5588d76e5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.860+0000 7f3815d9b700 1 -- 172.21.15.61:0/2782646892 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588d7559290 con 0x5588d763cdc0 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f3815d9b700 1 --2- 172.21.15.61:0/2782646892 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7630ee0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3808033040 tx=0x7f380802b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77089fd45249b345 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f37f7fff700 1 -- 172.21.15.61:0/2782646892 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808020040 con 0x5588d763cdc0 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f37f7fff700 1 -- 172.21.15.61:0/2782646892 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808029860 con 0x5588d763cdc0 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f37f7fff700 1 -- 172.21.15.61:0/2782646892 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380801a670 con 0x5588d763cdc0 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f3825e63b80 1 -- 172.21.15.61:0/2782646892 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 msgr2=0x5588d7630ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f3825e63b80 1 --2- 172.21.15.61:0/2782646892 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7630ee0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3808033040 tx=0x7f380802b040 comp rx=0 tx=0).stop 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f3825e63b80 1 -- 172.21.15.61:0/2782646892 shutdown_connections 2023-12-24T20:03:01.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f3825e63b80 1 --2- 172.21.15.61:0/2782646892 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d767f530 0x5588d7631420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f3825e63b80 1 --2- 172.21.15.61:0/2782646892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d763bda0 0x5588d76e5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f3825e63b80 1 --2- 172.21.15.61:0/2782646892 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763cdc0 0x5588d7630ee0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f3825e63b80 1 -- 172.21.15.61:0/2782646892 >> 172.21.15.61:0/2782646892 conn(0x5588d7639440 msgr2=0x5588d767df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:01.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f3825e63b80 1 -- 172.21.15.61:0/2782646892 shutdown_connections 2023-12-24T20:03:01.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.861+0000 7f3825e63b80 1 -- 172.21.15.61:0/2782646892 wait complete. 2023-12-24T20:03:01.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.862+0000 7f3825e63b80 1 -- start start 2023-12-24T20:03:01.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.862+0000 7f3825e63b80 1 Processor -- start 2023-12-24T20:03:01.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763bda0 0x5588d7631530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763cdc0 0x5588d76e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f3825e63b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d767f530 0x5588d76e7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f3825e63b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588d76e1e40 con 0x5588d763bda0 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f3825e63b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588d763b0c0 con 0x5588d767f530 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f3825e63b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588d76e8510 con 0x5588d763cdc0 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f3825e63b80 10 client.0 _ll_register_callbacks cb 0x7f38100077d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f381659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763bda0 0x5588d7631530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f381659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763bda0 0x5588d7631530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41590/0 (socket says 172.21.15.61:41590) 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f381659c700 1 -- 172.21.15.61:0/156786243 learned_addr learned my addr 172.21.15.61:0/156786243 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f3815d9b700 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763cdc0 0x5588d76e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f3816d9d700 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d767f530 0x5588d76e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f381659c700 1 -- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763cdc0 msgr2=0x5588d76e15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f381659c700 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763cdc0 0x5588d76e15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f381659c700 1 -- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d767f530 msgr2=0x5588d76e7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f381659c700 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d767f530 0x5588d76e7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f381659c700 1 -- 172.21.15.61:0/156786243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588d741e360 con 0x5588d763bda0 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f381659c700 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763bda0 0x5588d7631530 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f380c00cd50 tx=0x7f380c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9480bfb4d29a3e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.863+0000 7f37f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f37f4ff9700 1 -- 172.21.15.61:0/156786243 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c054a90 con 0x5588d763bda0 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f37f4ff9700 1 -- 172.21.15.61:0/156786243 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f380c052b50 con 0x5588d763bda0 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f3825e63b80 1 -- 172.21.15.61:0/156786243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588d762f490 con 0x5588d763bda0 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f37f4ff9700 1 -- 172.21.15.61:0/156786243 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f380c053f00 con 0x5588d763bda0 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f3825e63b80 10 client.7230 fetch_fsmap learned FSMap version 69 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f3825e63b80 1 -- 172.21.15.61:0/156786243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x5588d7422c80 con 0x5588d763bda0 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f37f4ff9700 1 -- 172.21.15.61:0/156786243 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c064020 con 0x5588d763bda0 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f37f4ff9700 1 -- 172.21.15.61:0/156786243 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 69) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f380c05b520 con 0x5588d763bda0 2023-12-24T20:03:01.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f3825e63b80 10 client.7230 fetch_fsmap finished waiting for FSMap version 69 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f3825e63b80 10 client.7230 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f3825e63b80 20 client.7230 populate_metadata read hostname 'smithi061' 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f3825e63b80 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:6834/2704897796,v1:172.21.15.133:6836/2704897796] conn(0x5588d76a2970 0x5588d76a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f3825e63b80 4 client.7230 mds_command: new command op to 7089 tid=0[{"prefix": "status"}] 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f3825e63b80 1 -- 172.21.15.61:0/156786243 --> [v2:172.21.15.133:6834/2704897796,v1:172.21.15.133:6836/2704897796] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5588d752d910 con 0x5588d76a2970 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.864+0000 7f3815d9b700 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:6834/2704897796,v1:172.21.15.133:6836/2704897796] conn(0x5588d76a2970 0x5588d76a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f37f4ff9700 10 client.7230 ms_handle_connect on v2:172.21.15.133:6834/2704897796 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3815d9b700 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:6834/2704897796,v1:172.21.15.133:6836/2704897796] conn(0x5588d76a2970 0x5588d76a2d40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73f438c7fda880ff server_cookie=13181c75db88f159 in_seq=0 out_seq=0 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f37f4ff9700 1 -- 172.21.15.61:0/156786243 <== mds.0 v2:172.21.15.133:6834/2704897796 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5588d752d910 con 0x5588d76a2970 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f37f4ff9700 10 client.7230 handle_command_reply: tid=0 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 client.7230 shutdown 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 -- 172.21.15.61:0/156786243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763bda0 msgr2=0x5588d7631530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763bda0 0x5588d7631530 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f380c00cd50 tx=0x7f380c014040 comp rx=0 tx=0).stop 2023-12-24T20:03:01.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 -- 172.21.15.61:0/156786243 shutdown_connections 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:6834/2704897796,v1:172.21.15.133:6836/2704897796] conn(0x5588d76a2970 0x5588d76a2d40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5588d767f530 0x5588d76e7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x5588d763bda0 0x5588d7631530 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f37f4ff9700 0 client.7230 ms_handle_reset on v2:172.21.15.133:6834/2704897796 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 --2- 172.21.15.61:0/156786243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x5588d763cdc0 0x5588d76e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 -- 172.21.15.61:0/156786243 >> 172.21.15.61:0/156786243 conn(0x5588d7639440 msgr2=0x5588d767df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 -- 172.21.15.61:0/156786243 shutdown_connections 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 1 -- 172.21.15.61:0/156786243 wait complete. 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.865+0000 7f3825e63b80 20 client.7230 trim_cache size 0 max 16384 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:01.871 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 7089, 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 5.9561131180000002, 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 69, 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 136, 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 136, 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 10.975404262 2023-12-24T20:03:01.872 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:01.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 -- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37f8066f30 msgr2=0x7f37f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37f8066f30 0x7f37f80693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f38180cc630 tx=0x7f3808017000 comp rx=0 tx=0).stop 2023-12-24T20:03:01.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 -- 172.21.15.61:0/915823434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 msgr2=0x7f38180c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:01.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 0x7f38180c9c50 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f380c00c590 tx=0x7f380c00c950 comp rx=0 tx=0).stop 2023-12-24T20:03:01.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 -- 172.21.15.61:0/915823434 shutdown_connections 2023-12-24T20:03:01.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3818159cf0 0x7f38180c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f37f8066f30 0x7f37f80693e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f38180ce030 0x7f38180c9c50 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 --2- 172.21.15.61:0/915823434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3818159920 0x7f38180acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:01.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 -- 172.21.15.61:0/915823434 >> 172.21.15.61:0/915823434 conn(0x7f381806b790 msgr2=0x7f3818069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:01.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 -- 172.21.15.61:0/915823434 shutdown_connections 2023-12-24T20:03:01.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:01.866+0000 7f381cb63700 1 -- 172.21.15.61:0/915823434 wait complete. 2023-12-24T20:03:01.878 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:03:02.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.000+0000 7f9361b9f700 1 Processor -- start 2023-12-24T20:03:02.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.000+0000 7f9361b9f700 1 -- start start 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f9361b9f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f935c096670 0x7f935c096a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f9361b9f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935c0cdfa0 con 0x7f935c067550 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f9361b9f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935c0ce430 con 0x7f935c071100 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f9361b9f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935c0b33c0 con 0x7f935c096670 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f936139e700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f935c067550 0x7f935c0c9d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45976/0 (socket says 172.21.15.61:45976) 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f936139e700 1 -- 172.21.15.61:0/1807077192 learned_addr learned my addr 172.21.15.61:0/1807077192 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f9360b9d700 1 --2- 172.21.15.61:0/1807077192 >> v2:172.21.15.133:3300/0 conn(0x7f935c096670 0x7f935c096a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f935b7fe700 1 -- 172.21.15.61:0/1807077192 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274607254 0 0) 0x7f935c0cdfa0 con 0x7f935c067550 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f935b7fe700 1 -- 172.21.15.61:0/1807077192 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f934c003570 con 0x7f935c067550 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f935b7fe700 1 -- 172.21.15.61:0/1807077192 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796946218 0 0) 0x7f935c0ce430 con 0x7f935c071100 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f935b7fe700 1 -- 172.21.15.61:0/1807077192 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f935c0cdfa0 con 0x7f935c071100 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f9360b9d700 1 -- 172.21.15.61:0/1807077192 >> v1:172.21.15.133:6789/0 conn(0x7f935c071100 legacy=0x7f935c0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f935b7fe700 1 -- 172.21.15.61:0/1807077192 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2903288773 0 0) 0x7f934c003570 con 0x7f935c067550 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f9360b9d700 1 -- 172.21.15.61:0/1807077192 >> v1:172.21.15.61:6789/0 conn(0x7f935c067550 legacy=0x7f935c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.001+0000 7f9360b9d700 1 -- 172.21.15.61:0/1807077192 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c0cd6b0 con 0x7f935c096670 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f9360b9d700 1 --2- 172.21.15.61:0/1807077192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c096670 0x7f935c096a40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f93500098d0 tx=0x7f9350009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c9526b955eedf90 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f935b7fe700 1 -- 172.21.15.61:0/1807077192 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93540017f0 con 0x7f935c096670 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f935b7fe700 1 -- 172.21.15.61:0/1807077192 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9350011420 con 0x7f935c096670 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f935b7fe700 1 -- 172.21.15.61:0/1807077192 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93500117e0 con 0x7f935c096670 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f9361b9f700 1 -- 172.21.15.61:0/1807077192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c096670 msgr2=0x7f935c096a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f9361b9f700 1 --2- 172.21.15.61:0/1807077192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c096670 0x7f935c096a40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f93500098d0 tx=0x7f9350009120 comp rx=0 tx=0).stop 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f9361b9f700 1 -- 172.21.15.61:0/1807077192 shutdown_connections 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f9361b9f700 1 --2- 172.21.15.61:0/1807077192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c096670 0x7f935c096a40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f9361b9f700 1 -- 172.21.15.61:0/1807077192 >> 172.21.15.61:0/1807077192 conn(0x7f935c0b0ea0 msgr2=0x7f935c0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f9361b9f700 1 -- 172.21.15.61:0/1807077192 shutdown_connections 2023-12-24T20:03:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.002+0000 7f9361b9f700 1 -- 172.21.15.61:0/1807077192 wait complete. 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.003+0000 7f9361b9f700 1 Processor -- start 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.004+0000 7f9361b9f700 1 -- start start 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.004+0000 7f9361b9f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935c067550 0x7f935c169f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.004+0000 7f9361b9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c071100 0x7f935c0999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.004+0000 7f9361b9f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935c096670 0x7f935c099f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.004+0000 7f9361b9f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c09a440 con 0x7f935c096670 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.004+0000 7f9361b9f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c097220 con 0x7f935c071100 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.004+0000 7f9361b9f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c097500 con 0x7f935c067550 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f936139e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935c096670 0x7f935c099f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f936139e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935c096670 0x7f935c099f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41606/0 (socket says 172.21.15.61:41606) 2023-12-24T20:03:02.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f936139e700 1 -- 172.21.15.61:0/3246867484 learned_addr learned my addr 172.21.15.61:0/3246867484 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f9360b9d700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935c067550 0x7f935c169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f935bfff700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c071100 0x7f935c0999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f936139e700 1 -- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935c067550 msgr2=0x7f935c169f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f936139e700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935c067550 0x7f935c169f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f936139e700 1 -- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c071100 msgr2=0x7f935c0999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f936139e700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c071100 0x7f935c0999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f936139e700 1 -- 172.21.15.61:0/3246867484 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500093c0 con 0x7f935c096670 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f935bfff700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c071100 0x7f935c0999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f9360b9d700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935c067550 0x7f935c169f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f936139e700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935c096670 0x7f935c099f00 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f935400cbd0 tx=0x7f9354007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f9358ff9700 1 -- 172.21.15.61:0/3246867484 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354004dc0 con 0x7f935c096670 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f9358ff9700 1 -- 172.21.15.61:0/3246867484 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935400a6b0 con 0x7f935c096670 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f9361b9f700 1 -- 172.21.15.61:0/3246867484 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935c0977e0 con 0x7f935c096670 2023-12-24T20:03:02.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f9358ff9700 1 -- 172.21.15.61:0/3246867484 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935400aa70 con 0x7f935c096670 2023-12-24T20:03:02.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.005+0000 7f9361b9f700 1 -- 172.21.15.61:0/3246867484 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935c097da0 con 0x7f935c096670 2023-12-24T20:03:02.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.006+0000 7f9361b9f700 1 -- 172.21.15.61:0/3246867484 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935c06c170 con 0x7f935c096670 2023-12-24T20:03:02.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.007+0000 7f9358ff9700 1 -- 172.21.15.61:0/3246867484 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9354007150 con 0x7f935c096670 2023-12-24T20:03:02.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.007+0000 7f9358ff9700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9340066f30 0x7f93400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:02.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.007+0000 7f9358ff9700 1 -- 172.21.15.61:0/3246867484 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9354083b90 con 0x7f935c096670 2023-12-24T20:03:02.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.007+0000 7f9360b9d700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9340066f30 0x7f93400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:02.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.008+0000 7f9360b9d700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9340066f30 0x7f93400693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9350009390 tx=0x7f9350016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:02.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.011+0000 7f9358ff9700 1 -- 172.21.15.61:0/3246867484 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9354050e80 con 0x7f935c096670 2023-12-24T20:03:02.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.252+0000 7f9361b9f700 1 -- 172.21.15.61:0/3246867484 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f935c097fc0 con 0x7f935c096670 2023-12-24T20:03:02.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.252+0000 7f9358ff9700 1 -- 172.21.15.61:0/3246867484 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9354018020 con 0x7f935c096670 2023-12-24T20:03:02.253 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 -- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9340066f30 msgr2=0x7f93400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9340066f30 0x7f93400693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9350009390 tx=0x7f9350016000 comp rx=0 tx=0).stop 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 -- 172.21.15.61:0/3246867484 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935c096670 msgr2=0x7f935c099f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935c096670 0x7f935c099f00 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f935400cbd0 tx=0x7f9354007d20 comp rx=0 tx=0).stop 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 -- 172.21.15.61:0/3246867484 shutdown_connections 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935c067550 0x7f935c169f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9340066f30 0x7f93400693e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935c096670 0x7f935c099f00 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 --2- 172.21.15.61:0/3246867484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c071100 0x7f935c0999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 -- 172.21.15.61:0/3246867484 >> 172.21.15.61:0/3246867484 conn(0x7f935c0b0ea0 msgr2=0x7f935c158c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 -- 172.21.15.61:0/3246867484 shutdown_connections 2023-12-24T20:03:02.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:02.254+0000 7f9361b9f700 1 -- 172.21.15.61:0/3246867484 wait complete. 2023-12-24T20:03:02.267 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:03:02.267 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:03:02.267 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T20:03:02.267 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T20:03:02.267 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:02.267 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:03:02.267 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:03:02.267 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:03:02.267 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:03:02.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:02.268 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T20:03:02.286 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:03:02.286 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:03:02.286 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:03:02.286 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:02.286 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:03:02.287 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42184sec preferred_lft 42184sec 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link 2023-12-24T20:03:02.288 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:02.289 INFO:teuthology.orchestra.run.smithi061.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:03:02.289 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 12:83:d1:9f:62:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:03:02.289 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1083:d1ff:fe9f:62aa/64 scope link 2023-12-24T20:03:02.289 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:02.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:02.289 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:03:02.352 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T20:03:02.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:02.353 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T20:03:02.413 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T20:03:02.413 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:03:02.413 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:03:02.413 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:03:02.414 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:03:02.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:02.414 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T20:03:02.414 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T20:03:02.414 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:03:02.414 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:03:02.414 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:03:02.414 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T20:03:02.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:02.522 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T20:03:02.539 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:03:02.540 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:03:02.540 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:03:02.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:02.540 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T20:03:02.608 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T20:03:02.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:03:02.608 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:02.665 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:03:02.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:03:02.666 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:02.723 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:03:02.791 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:03:02.791 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:03:02.859 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:03:02.859 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:03:02.860 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:02.860 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:03:02.918 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:03:02.918 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T20:03:02.960 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:03:02.988 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:03:02.988 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:03:03.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T20:03:03.047+0000 7fbda07bf540 -1 init, newargv = 0x55d4c577c650 newargc=15 2023-12-24T20:03:03.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[67036]: starting ceph client 2023-12-24T20:03:03.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[67036]: starting fuse 2023-12-24T20:03:03.057 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:03:03.058 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:03:03.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:03.059 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:03:03.116 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T20:03:03.116 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:03.117 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:03:03.118 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:03:03.242 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.67036.asok 2023-12-24T20:03:03.424 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.67036.asok 2023-12-24T20:03:03.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:03.425 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.67036.asok status 2023-12-24T20:03:03.583 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:03.583 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:03:03.583 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:03:03.583 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:03:03.583 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:03:03.583 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:03:03.583 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "67036", 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 7242, 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 7242 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2078131100 2023-12-24T20:03:03.584 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2078131100 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.7242 192.168.0.1:0/2078131100", 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2078131100", 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 69, 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 136, 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:03:03.585 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:03.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:03.593 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T20:03:03.594 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:03.611 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T20:03:03.612 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:03.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:03.612 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:03.681 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:03:03.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.842+0000 7f6fa0f5c700 1 Processor -- start 2023-12-24T20:03:03.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.842+0000 7f6fa0f5c700 1 -- start start 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6fa0f5c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6f9c1599e0 0x7f6f9c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6fa0f5c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f9c0cbac0 0x7f6f9c0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6fa0f5c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9c0cd9b0 0x7f6f9c15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6fa0f5c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c0cc2a0 con 0x7f6f9c1599e0 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6fa0f5c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c0cedc0 con 0x7f6f9c0cbac0 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6fa0f5c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c067f60 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f9a59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6f9c1599e0 0x7f6f9c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f9a59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6f9c1599e0 0x7f6f9c15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41618/0 (socket says 172.21.15.61:41618) 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f9a59c700 1 -- 172.21.15.61:0/594596304 learned_addr learned my addr 172.21.15.61:0/594596304 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f9ad9d700 1 --2- 172.21.15.61:0/594596304 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9c0cd9b0 0x7f6f9c15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f99d9b700 1 --2- 172.21.15.61:0/594596304 >> v2:172.21.15.133:3300/0 conn(0x7f6f9c0cbac0 0x7f6f9c0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:03.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f9a59c700 1 -- 172.21.15.61:0/594596304 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9c0cd9b0 msgr2=0x7f6f9c15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f9a59c700 1 --2- 172.21.15.61:0/594596304 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9c0cd9b0 0x7f6f9c15d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f9a59c700 1 -- 172.21.15.61:0/594596304 >> v2:172.21.15.133:3300/0 conn(0x7f6f9c0cbac0 msgr2=0x7f6f9c0cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f9a59c700 1 --2- 172.21.15.61:0/594596304 >> v2:172.21.15.133:3300/0 conn(0x7f6f9c0cbac0 0x7f6f9c0cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f9a59c700 1 -- 172.21.15.61:0/594596304 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c15b040 con 0x7f6f9c1599e0 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.843+0000 7f6f9a59c700 1 --2- 172.21.15.61:0/594596304 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c1599e0 0x7f6f9c15ab00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0b05b0 tx=0x7f6f8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8e1a78eca0e927 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6f9959a700 1 -- 172.21.15.61:0/594596304 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00b860 con 0x7f6f9c1599e0 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6f9959a700 1 -- 172.21.15.61:0/594596304 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c00b9c0 con 0x7f6f9c1599e0 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6f9959a700 1 -- 172.21.15.61:0/594596304 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00bd60 con 0x7f6f9c1599e0 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/594596304 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c1599e0 msgr2=0x7f6f9c15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6fa0f5c700 1 --2- 172.21.15.61:0/594596304 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c1599e0 0x7f6f9c15ab00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0b05b0 tx=0x7f6f8c009250 comp rx=0 tx=0).stop 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/594596304 shutdown_connections 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6fa0f5c700 1 --2- 172.21.15.61:0/594596304 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9c0cd9b0 0x7f6f9c15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6fa0f5c700 1 --2- 172.21.15.61:0/594596304 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c1599e0 0x7f6f9c15ab00 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6fa0f5c700 1 --2- 172.21.15.61:0/594596304 >> v2:172.21.15.133:3300/0 conn(0x7f6f9c0cbac0 0x7f6f9c0cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:03.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/594596304 >> 172.21.15.61:0/594596304 conn(0x7f6f9c06e640 msgr2=0x7f6f9c067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:03.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/594596304 shutdown_connections 2023-12-24T20:03:03.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.844+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/594596304 wait complete. 2023-12-24T20:03:03.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.845+0000 7f6fa0f5c700 1 Processor -- start 2023-12-24T20:03:03.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.845+0000 7f6fa0f5c700 1 -- start start 2023-12-24T20:03:03.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6fa0f5c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9c0cbac0 0x7f6f9c14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6fa0f5c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c0cd9b0 0x7f6f9c16a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6fa0f5c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c1599e0 0x7f6f9c156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6fa0f5c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0c8af0 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6fa0f5c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0c9670 con 0x7f6f9c1599e0 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6fa0f5c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c155f30 con 0x7f6f9c0cbac0 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6f99d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c0cd9b0 0x7f6f9c16a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6f99d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c0cd9b0 0x7f6f9c16a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41626/0 (socket says 172.21.15.61:41626) 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6f99d9b700 1 -- 172.21.15.61:0/127663665 learned_addr learned my addr 172.21.15.61:0/127663665 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6f9a59c700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9c0cbac0 0x7f6f9c14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.846+0000 7f6f9ad9d700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c1599e0 0x7f6f9c156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6f99d9b700 1 -- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9c0cbac0 msgr2=0x7f6f9c14d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6f99d9b700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9c0cbac0 0x7f6f9c14d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6f99d9b700 1 -- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c1599e0 msgr2=0x7f6f9c156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:03.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6f99d9b700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c1599e0 0x7f6f9c156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6f99d9b700 1 -- 172.21.15.61:0/127663665 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0094f0 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6f9ad9d700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c1599e0 0x7f6f9c156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6f99d9b700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c0cd9b0 0x7f6f9c16a660 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000d890 tx=0x7f6f90008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6f8a7fc700 1 -- 172.21.15.61:0/127663665 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f900125f0 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6f8a7fc700 1 -- 172.21.15.61:0/127663665 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f90012750 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/127663665 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c0c8d40 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6f8a7fc700 1 -- 172.21.15.61:0/127663665 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90012b10 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.847+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/127663665 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c0c9300 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.848+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/127663665 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9c0c9820 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.848+0000 7f6f8a7fc700 1 -- 172.21.15.61:0/127663665 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f6f9001e460 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.849+0000 7f6f8a7fc700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f7c066f30 0x7f6f7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.849+0000 7f6f8a7fc700 1 -- 172.21.15.61:0/127663665 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f90084b50 con 0x7f6f9c0cd9b0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.849+0000 7f6f9a59c700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f7c066f30 0x7f6f7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:03.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.850+0000 7f6f9a59c700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f7c066f30 0x7f6f7c0693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0b05b0 tx=0x7f6f8c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:03.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:03.853+0000 7f6f8a7fc700 1 -- 172.21.15.61:0/127663665 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f9c0c9820 con 0x7f6f9c0cd9b0 2023-12-24T20:03:04.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.094+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/127663665 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6f9c0c97e0 con 0x7f6f9c0cd9b0 2023-12-24T20:03:04.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.094+0000 7f6f8a7fc700 1 -- 172.21.15.61:0/127663665 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6f90051d20 con 0x7f6f9c0cd9b0 2023-12-24T20:03:04.095 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f7c066f30 msgr2=0x7f6f7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f7c066f30 0x7f6f7c0693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0b05b0 tx=0x7f6f8c017000 comp rx=0 tx=0).stop 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/127663665 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c0cd9b0 msgr2=0x7f6f9c16a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c0cd9b0 0x7f6f9c16a660 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000d890 tx=0x7f6f90008040 comp rx=0 tx=0).stop 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/127663665 shutdown_connections 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6f9c0cbac0 0x7f6f9c14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6f7c066f30 0x7f6f7c0693e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f9c1599e0 0x7f6f9c156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 --2- 172.21.15.61:0/127663665 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f9c0cd9b0 0x7f6f9c16a660 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/127663665 >> 172.21.15.61:0/127663665 conn(0x7f6f9c06e640 msgr2=0x7f6f9c0b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:04.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/127663665 shutdown_connections 2023-12-24T20:03:04.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:04.096+0000 7f6fa0f5c700 1 -- 172.21.15.61:0/127663665 wait complete. 2023-12-24T20:03:04.109 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:03:04.109 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:03:04.109 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T20:03:04.109 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T20:03:04.109 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:04.109 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:03:04.109 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:03:04.109 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:03:04.109 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:03:04.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:04.110 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T20:03:04.131 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:03:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42189sec preferred_lft 42189sec 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T20:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link 2023-12-24T20:03:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:04.134 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:03:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T20:03:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::accb:c5ff:feae:915/64 scope link 2023-12-24T20:03:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:04.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:04.134 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:03:04.203 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T20:03:04.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:04.204 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T20:03:04.266 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T20:03:04.266 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:03:04.266 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:03:04.266 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:03:04.266 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:03:04.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:04.267 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T20:03:04.267 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T20:03:04.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:03:04.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:03:04.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:03:04.267 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T20:03:04.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:04.379 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T20:03:04.397 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T20:03:04.397 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T20:03:04.397 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:03:04.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:04.397 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T20:03:04.465 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T20:03:04.465 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:03:04.466 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:04.522 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:03:04.523 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:03:04.523 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:04.579 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:03:04.646 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:03:04.646 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:03:04.712 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:03:04.713 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:03:04.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:04.714 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:03:04.772 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:03:04.772 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T20:03:04.815 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:03:04.841 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:03:04.841 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:03:04.898 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T20:03:04.897+0000 7f310db98540 -1 init, newargv = 0x55a4aca0f150 newargc=15 2023-12-24T20:03:04.898 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[47132]: starting ceph client 2023-12-24T20:03:04.902 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[47132]: starting fuse 2023-12-24T20:03:04.908 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:03:04.909 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:03:04.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:04.910 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:03:04.970 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T20:03:04.970 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T20:03:04.971 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:03:04.972 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:03:04.973 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T20:03:04.973 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T20:03:05.093 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.47132.asok 2023-12-24T20:03:05.276 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.47132.asok 2023-12-24T20:03:05.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:05.276 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.47132.asok status 2023-12-24T20:03:05.428 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T20:03:05.428 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "47132", 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6044, 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T20:03:05.429 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 6044 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3966676981 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 3966676981 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.6044 192.168.0.1:0/3966676981", 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/3966676981", 2023-12-24T20:03:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T20:03:05.431 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 69, 2023-12-24T20:03:05.431 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 136, 2023-12-24T20:03:05.431 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:03:05.431 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T20:03:05.431 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T20:03:05.431 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T20:03:05.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:05.438 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T20:03:05.438 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:05.456 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T20:03:05.456 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:05.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:05.456 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:05.524 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:05.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.658+0000 7f9308ec5700 1 Processor -- start 2023-12-24T20:03:05.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.658+0000 7f9308ec5700 1 -- start start 2023-12-24T20:03:05.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.659+0000 7f9308ec5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9304068c80 0x7f93040afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:05.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.659+0000 7f9308ec5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f930415acf0 0x7f9304067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:05.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.659+0000 7f9308ec5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93040687f0 con 0x7f93040af710 2023-12-24T20:03:05.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.659+0000 7f9308ec5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9304067be0 con 0x7f9304068c80 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.659+0000 7f9308ec5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9304067ec0 con 0x7f930415acf0 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.659+0000 7f9301d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9304068c80 0x7f93040afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f9301d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9304068c80 0x7f93040afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41642/0 (socket says 172.21.15.61:41642) 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f9301d9b700 1 -- 172.21.15.61:0/3905402443 learned_addr learned my addr 172.21.15.61:0/3905402443 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f9302d9d700 1 --2- 172.21.15.61:0/3905402443 >> v2:172.21.15.133:3300/0 conn(0x7f930415acf0 0x7f9304067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f9301d9b700 1 -- 172.21.15.61:0/3905402443 >> v2:172.21.15.133:3300/0 conn(0x7f930415acf0 msgr2=0x7f9304067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f9301d9b700 1 --2- 172.21.15.61:0/3905402443 >> v2:172.21.15.133:3300/0 conn(0x7f930415acf0 0x7f9304067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f9301d9b700 1 -- 172.21.15.61:0/3905402443 >> v1:172.21.15.133:6789/0 conn(0x7f93040af710 legacy=0x7f930415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f9301d9b700 1 -- 172.21.15.61:0/3905402443 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93040681a0 con 0x7f9304068c80 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f9301d9b700 1 --2- 172.21.15.61:0/3905402443 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9304068c80 0x7f93040afae0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f930415a540 tx=0x7f92f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7458e7ab2073bcd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f930159a700 1 -- 172.21.15.61:0/3905402443 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8009e70 con 0x7f9304068c80 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f930159a700 1 -- 172.21.15.61:0/3905402443 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f800b860 con 0x7f9304068c80 2023-12-24T20:03:05.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.660+0000 7f930159a700 1 -- 172.21.15.61:0/3905402443 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f800bc00 con 0x7f9304068c80 2023-12-24T20:03:05.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.661+0000 7f9308ec5700 1 -- 172.21.15.61:0/3905402443 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9304068c80 msgr2=0x7f93040afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:05.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.661+0000 7f9308ec5700 1 --2- 172.21.15.61:0/3905402443 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9304068c80 0x7f93040afae0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f930415a540 tx=0x7f92f8009250 comp rx=0 tx=0).stop 2023-12-24T20:03:05.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.661+0000 7f9308ec5700 1 -- 172.21.15.61:0/3905402443 shutdown_connections 2023-12-24T20:03:05.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.661+0000 7f9308ec5700 1 --2- 172.21.15.61:0/3905402443 >> v2:172.21.15.133:3300/0 conn(0x7f930415acf0 0x7f9304067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:05.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.661+0000 7f9308ec5700 1 --2- 172.21.15.61:0/3905402443 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9304068c80 0x7f93040afae0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:05.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.661+0000 7f9308ec5700 1 -- 172.21.15.61:0/3905402443 >> 172.21.15.61:0/3905402443 conn(0x7f93040ca200 msgr2=0x7f93040ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:05.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.661+0000 7f9308ec5700 1 -- 172.21.15.61:0/3905402443 shutdown_connections 2023-12-24T20:03:05.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.661+0000 7f9308ec5700 1 -- 172.21.15.61:0/3905402443 wait complete. 2023-12-24T20:03:05.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.662+0000 7f9308ec5700 1 Processor -- start 2023-12-24T20:03:05.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.662+0000 7f9308ec5700 1 -- start start 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9308ec5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9304068c80 0x7f930414ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9308ec5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f93040af710 0x7f930416a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9308ec5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f930415acf0 0x7f930416a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9308ec5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93040aeb20 con 0x7f93040af710 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9308ec5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93040c8c80 con 0x7f9304068c80 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9308ec5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93040ae840 con 0x7f930415acf0 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9301d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f93040af710 0x7f930416a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9301d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f93040af710 0x7f930416a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41648/0 (socket says 172.21.15.61:41648) 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9301d9b700 1 -- 172.21.15.61:0/380149754 learned_addr learned my addr 172.21.15.61:0/380149754 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9302d9d700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f930415acf0 0x7f930416a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f930259c700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9304068c80 0x7f930414ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9301d9b700 1 -- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f930415acf0 msgr2=0x7f930416a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:05.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9301d9b700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f930415acf0 0x7f930416a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9301d9b700 1 -- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9304068c80 msgr2=0x7f930414ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9301d9b700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9304068c80 0x7f930414ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9301d9b700 1 -- 172.21.15.61:0/380149754 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f80094f0 con 0x7f93040af710 2023-12-24T20:03:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.663+0000 7f9301d9b700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f93040af710 0x7f930416a390 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f930406c9e0 tx=0x7f92f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.664+0000 7f92f27fc700 1 -- 172.21.15.61:0/380149754 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f800bbe0 con 0x7f93040af710 2023-12-24T20:03:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.664+0000 7f92f27fc700 1 -- 172.21.15.61:0/380149754 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f8011420 con 0x7f93040af710 2023-12-24T20:03:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.664+0000 7f9308ec5700 1 -- 172.21.15.61:0/380149754 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93040c8630 con 0x7f93040af710 2023-12-24T20:03:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.664+0000 7f92f27fc700 1 -- 172.21.15.61:0/380149754 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80117c0 con 0x7f93040af710 2023-12-24T20:03:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.664+0000 7f9308ec5700 1 -- 172.21.15.61:0/380149754 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930414f450 con 0x7f93040af710 2023-12-24T20:03:05.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.665+0000 7f9308ec5700 1 -- 172.21.15.61:0/380149754 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93040c8df0 con 0x7f93040af710 2023-12-24T20:03:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.665+0000 7f92f27fc700 1 -- 172.21.15.61:0/380149754 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f92f8011bf0 con 0x7f93040af710 2023-12-24T20:03:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.666+0000 7f92f27fc700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f92e4066f30 0x7f92e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.666+0000 7f92f27fc700 1 -- 172.21.15.61:0/380149754 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92f8085970 con 0x7f93040af710 2023-12-24T20:03:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.666+0000 7f930259c700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f92e4066f30 0x7f92e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:05.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.666+0000 7f930259c700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f92e4066f30 0x7f92e40693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f92f40039e0 tx=0x7f92f4007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:05.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.670+0000 7f92f27fc700 1 -- 172.21.15.61:0/380149754 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92f8052be0 con 0x7f93040af710 2023-12-24T20:03:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.907+0000 7f9308ec5700 1 -- 172.21.15.61:0/380149754 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f930404c3c0 con 0x7f93040af710 2023-12-24T20:03:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.907+0000 7f92f27fc700 1 -- 172.21.15.61:0/380149754 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f92f8056200 con 0x7f93040af710 2023-12-24T20:03:05.908 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:05.908 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3245805399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3245805399},{"type":"v1","addr":"172.21.15.133:6837","nonce":3245805399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/4168448475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":4168448475},{"type":"v1","addr":"172.21.15.61:6835","nonce":4168448475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1817856586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1817856586},{"type":"v1","addr":"172.21.15.61:6834","nonce":1817856586}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:55.325289+0000","modified":"2023-12-24T20:02:58.932577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7089},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7089":{"gid":7089,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2704897796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2704897796},{"type":"v1","addr":"172.21.15.133:6836","nonce":2704897796}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T20:03:05.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 -- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f92e4066f30 msgr2=0x7f92e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:05.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f92e4066f30 0x7f92e40693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f92f40039e0 tx=0x7f92f4007ec0 comp rx=0 tx=0).stop 2023-12-24T20:03:05.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 -- 172.21.15.61:0/380149754 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f93040af710 msgr2=0x7f930416a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:05.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f93040af710 0x7f930416a390 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f930406c9e0 tx=0x7f92f8017000 comp rx=0 tx=0).stop 2023-12-24T20:03:05.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 -- 172.21.15.61:0/380149754 shutdown_connections 2023-12-24T20:03:05.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f930415acf0 0x7f930416a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:05.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f92e4066f30 0x7f92e40693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:05.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9304068c80 0x7f930414ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:05.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 --2- 172.21.15.61:0/380149754 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f93040af710 0x7f930416a390 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:05.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 -- 172.21.15.61:0/380149754 >> 172.21.15.61:0/380149754 conn(0x7f93040ca200 msgr2=0x7f9304155940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:05.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 -- 172.21.15.61:0/380149754 shutdown_connections 2023-12-24T20:03:05.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:05.909+0000 7f9308ec5700 1 -- 172.21.15.61:0/380149754 wait complete. 2023-12-24T20:03:05.911 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 69 2023-12-24T20:03:05.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-24T20:03:06.058 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":7089,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.139073495,"mdsmap_epoch":69,"osdmap_epoch":136,"osdmap_epoch_barrier":136,"uptime":15.158369853} 2023-12-24T20:03:06.058 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 7089, "mdsmap_epoch": 69, "osdmap_epoch": 136, "osdmap_epoch_barrier": 136, "rank_uptime": 10.139073495, "state": "up:active", "uptime": 15.158369853, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:03:06.059 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-24T20:03:06.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.184+0000 7f377661f700 1 Processor -- start 2023-12-24T20:03:06.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.184+0000 7f377661f700 1 -- start start 2023-12-24T20:03:06.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.185+0000 7f377661f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37701599e0 0x7f3770070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:06.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.185+0000 7f377661f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3770067960 con 0x7f37700cd010 2023-12-24T20:03:06.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.185+0000 7f377661f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37700c7d40 con 0x7f377006a490 2023-12-24T20:03:06.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.185+0000 7f377661f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37700711e0 con 0x7f37701599e0 2023-12-24T20:03:06.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.185+0000 7f3774bbc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f37700cd010 0x7f3770159db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:45982/0 (socket says 172.21.15.61:45982) 2023-12-24T20:03:06.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.185+0000 7f3774bbc700 1 -- 172.21.15.61:0/2536132287 learned_addr learned my addr 172.21.15.61:0/2536132287 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376ffff700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37701599e0 0x7f3770070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436942879 0 0) 0x7f3770067960 con 0x7f37700cd010 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3758003570 con 0x7f37700cd010 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050988329 0 0) 0x7f37700c7d40 con 0x7f377006a490 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3770067960 con 0x7f377006a490 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3408910221 0 0) 0x7f3758003570 con 0x7f37700cd010 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37701599e0 msgr2=0x7f3770070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37701599e0 0x7f3770070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 >> v1:172.21.15.133:6789/0 conn(0x7f377006a490 legacy=0x7f37700cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770070c20 con 0x7f37700cd010 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f37680017f0 con 0x7f37700cd010 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376ffff700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37701599e0 0x7f3770070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 >> v1:172.21.15.61:6789/0 conn(0x7f37700cd010 legacy=0x7f3770159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37701599e0 0x7f3758003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:06.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3758004160 0x7f3758004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3758004d50 0x7f37580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37700711e0 con 0x7f3758004d50 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375800bba0 con 0x7f3758004160 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375800bd60 con 0x7f37701599e0 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f3774bbc700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3758004d50 0x7f37580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376ffff700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37701599e0 0x7f3758003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f376f7fe700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3758004160 0x7f3758004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f3774bbc700 1 -- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37701599e0 msgr2=0x7f3758003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.186+0000 7f3774bbc700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f37701599e0 0x7f3758003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f3774bbc700 1 -- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3758004160 msgr2=0x7f3758004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f3774bbc700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3758004160 0x7f3758004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f3774bbc700 1 -- 172.21.15.61:0/2536132287 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760009420 con 0x7f3758004d50 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f3774bbc700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3758004d50 0x7f37580051c0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f376800a8d0 tx=0x7f3768002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dd1b910d0908b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:06.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37680070d0 con 0x7f3758004d50 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768007230 con 0x7f3758004d50 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f376effd700 1 -- 172.21.15.61:0/2536132287 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37680075f0 con 0x7f3758004d50 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f377661f700 1 -- 172.21.15.61:0/2536132287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3758004d50 msgr2=0x7f37580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f377661f700 1 --2- 172.21.15.61:0/2536132287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3758004d50 0x7f37580051c0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f376800a8d0 tx=0x7f3768002190 comp rx=0 tx=0).stop 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f3774bbc700 1 -- 172.21.15.61:0/2536132287 reap_dead start 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f377661f700 1 -- 172.21.15.61:0/2536132287 shutdown_connections 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f377661f700 1 -- 172.21.15.61:0/2536132287 >> 172.21.15.61:0/2536132287 conn(0x7f37700ce190 msgr2=0x7f37700ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f377661f700 1 -- 172.21.15.61:0/2536132287 shutdown_connections 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.187+0000 7f377661f700 1 -- 172.21.15.61:0/2536132287 wait complete. 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.188+0000 7f377661f700 1 Processor -- start 2023-12-24T20:03:06.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.189+0000 7f377661f700 1 -- start start 2023-12-24T20:03:06.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.189+0000 7f377661f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f377016cc70 0x7f37700c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.189+0000 7f377661f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37700c6c00 0x7f3770156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.189+0000 7f377661f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37701565a0 0x7f37700c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.189+0000 7f377661f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3770156a10 con 0x7f37701565a0 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.189+0000 7f377661f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37700b1470 con 0x7f37700c6c00 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.189+0000 7f377661f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37700b0860 con 0x7f377016cc70 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.189+0000 7f3774bbc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37701565a0 0x7f37700c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3774bbc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37701565a0 0x7f37700c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41662/0 (socket says 172.21.15.61:41662) 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3774bbc700 1 -- 172.21.15.61:0/3395269389 learned_addr learned my addr 172.21.15.61:0/3395269389 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f376ffff700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f377016cc70 0x7f37700c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f376f7fe700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37700c6c00 0x7f3770156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3774bbc700 1 -- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f377016cc70 msgr2=0x7f37700c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3774bbc700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f377016cc70 0x7f37700c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3774bbc700 1 -- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37700c6c00 msgr2=0x7f3770156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:06.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3774bbc700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37700c6c00 0x7f3770156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3774bbc700 1 -- 172.21.15.61:0/3395269389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37700b0b40 con 0x7f37701565a0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f376f7fe700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37700c6c00 0x7f3770156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3774bbc700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37701565a0 0x7f37700c47b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f3768000f80 tx=0x7f3768016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3757fff700 1 -- 172.21.15.61:0/3395269389 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768023070 con 0x7f37701565a0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3757fff700 1 -- 172.21.15.61:0/3395269389 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376801e430 con 0x7f37701565a0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f3757fff700 1 -- 172.21.15.61:0/3395269389 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376801e810 con 0x7f37701565a0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f377661f700 1 -- 172.21.15.61:0/3395269389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37700b0e20 con 0x7f37701565a0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.190+0000 7f377661f700 1 -- 172.21.15.61:0/3395269389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37700b04a0 con 0x7f37701565a0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.191+0000 7f377661f700 1 -- 172.21.15.61:0/3395269389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377004c3c0 con 0x7f37701565a0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.192+0000 7f3757fff700 1 -- 172.21.15.61:0/3395269389 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f376801ec40 con 0x7f37701565a0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.192+0000 7f3757fff700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f375c066f30 0x7f375c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.192+0000 7f3757fff700 1 -- 172.21.15.61:0/3395269389 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3768086080 con 0x7f37701565a0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.192+0000 7f376ffff700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f375c066f30 0x7f375c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:06.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.193+0000 7f376ffff700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f375c066f30 0x7f375c0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f377006a380 tx=0x7f3760008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:06.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.196+0000 7f3757fff700 1 -- 172.21.15.61:0/3395269389 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37680532f0 con 0x7f37701565a0 2023-12-24T20:03:06.275 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:03:06.277 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:03:06.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.393+0000 7f377661f700 1 -- 172.21.15.61:0/3395269389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f3770070f00 con 0x7f37701565a0 2023-12-24T20:03:06.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.576+0000 7f3757fff700 1 -- 172.21.15.61:0/3395269389 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v137) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3768056910 con 0x7f37701565a0 2023-12-24T20:03:06.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.578+0000 7f377661f700 1 -- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f375c066f30 msgr2=0x7f375c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:06.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.578+0000 7f377661f700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f375c066f30 0x7f375c0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f377006a380 tx=0x7f3760008040 comp rx=0 tx=0).stop 2023-12-24T20:03:06.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.578+0000 7f377661f700 1 -- 172.21.15.61:0/3395269389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37701565a0 msgr2=0x7f37700c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:06.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.578+0000 7f377661f700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37701565a0 0x7f37700c47b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f3768000f80 tx=0x7f3768016000 comp rx=0 tx=0).stop 2023-12-24T20:03:06.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.578+0000 7f377661f700 1 -- 172.21.15.61:0/3395269389 shutdown_connections 2023-12-24T20:03:06.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.578+0000 7f377661f700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f377016cc70 0x7f37700c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:06.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.578+0000 7f377661f700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f375c066f30 0x7f375c0693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:06.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.578+0000 7f377661f700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f37701565a0 0x7f37700c47b0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:06.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.578+0000 7f377661f700 1 --2- 172.21.15.61:0/3395269389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37700c6c00 0x7f3770156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:06.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.578+0000 7f377661f700 1 -- 172.21.15.61:0/3395269389 >> 172.21.15.61:0/3395269389 conn(0x7f37700ce190 msgr2=0x7f37700c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:06.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.579+0000 7f377661f700 1 -- 172.21.15.61:0/3395269389 shutdown_connections 2023-12-24T20:03:06.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:06.579+0000 7f377661f700 1 -- 172.21.15.61:0/3395269389 wait complete. 2023-12-24T20:03:06.580 INFO:teuthology.orchestra.run.smithi061.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-24T20:03:06.592 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-24T20:03:06.770 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_mon_report_interval":"5"} 2023-12-24T20:03:06.770 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-24T20:03:06.770 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-12-24T20:03:06.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:06.771 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-12-24T20:03:06.900 INFO:teuthology.orchestra.run.smithi061.stderr:16+0 records in 2023-12-24T20:03:06.900 INFO:teuthology.orchestra.run.smithi061.stderr:16+0 records out 2023-12-24T20:03:06.900 INFO:teuthology.orchestra.run.smithi061.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.107584 s, 156 MB/s 2023-12-24T20:03:06.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:06.901 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-12-24T20:03:07.037 INFO:teuthology.orchestra.run.smithi061.stderr:17+0 records in 2023-12-24T20:03:07.037 INFO:teuthology.orchestra.run.smithi061.stderr:17+0 records out 2023-12-24T20:03:07.037 INFO:teuthology.orchestra.run.smithi061.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.114747 s, 155 MB/s 2023-12-24T20:03:07.037 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-24T20:03:07.038 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:03:07.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.159+0000 7f093ee73700 1 Processor -- start 2023-12-24T20:03:07.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.159+0000 7f093ee73700 1 -- start start 2023-12-24T20:03:07.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.160+0000 7f093ee73700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0938159830 0x7f09380b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:07.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.160+0000 7f093ee73700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f093806b740 0x7f0938067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:07.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.160+0000 7f093ee73700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093806eb40 con 0x7f09380b32d0 2023-12-24T20:03:07.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.160+0000 7f093ee73700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093815a690 con 0x7f0938159830 2023-12-24T20:03:07.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.160+0000 7f093ee73700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093815a970 con 0x7f093806b740 2023-12-24T20:03:07.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.160+0000 7f093d410700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f093806b740 0x7f0938067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:07.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f093cc0f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0938159830 0x7f09380b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:07.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f093d410700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f093806b740 0x7f0938067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:58470/0 (socket says 172.21.15.61:58470) 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f093d410700 1 -- 172.21.15.61:0/486557039 learned_addr learned my addr 172.21.15.61:0/486557039 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f0937fff700 1 --1- 172.21.15.61:0/486557039 >> v1:172.21.15.133:6789/0 conn(0x7f09380b32d0 0x7f0938159c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:51792/0 (socket says 172.21.15.61:51792) 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f093cc0f700 1 -- 172.21.15.61:0/486557039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f093806b740 msgr2=0x7f0938067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f093cc0f700 1 --2- 172.21.15.61:0/486557039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f093806b740 0x7f0938067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f093cc0f700 1 -- 172.21.15.61:0/486557039 >> v1:172.21.15.133:6789/0 conn(0x7f09380b32d0 legacy=0x7f0938159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f093cc0f700 1 -- 172.21.15.61:0/486557039 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093815ac50 con 0x7f0938159830 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f093d410700 1 --2- 172.21.15.61:0/486557039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f093806b740 0x7f0938067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f093cc0f700 1 --2- 172.21.15.61:0/486557039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0938159830 0x7f09380b2d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f092c0098e0 tx=0x7f092c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41bb7fe1f2a4a5b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f09377fe700 1 -- 172.21.15.61:0/486557039 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c00b640 con 0x7f0938159830 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f09377fe700 1 -- 172.21.15.61:0/486557039 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c00b7a0 con 0x7f0938159830 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.161+0000 7f09377fe700 1 -- 172.21.15.61:0/486557039 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c00bb40 con 0x7f0938159830 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.162+0000 7f093ee73700 1 -- 172.21.15.61:0/486557039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0938159830 msgr2=0x7f09380b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.162+0000 7f093ee73700 1 --2- 172.21.15.61:0/486557039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0938159830 0x7f09380b2d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f092c0098e0 tx=0x7f092c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:07.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.162+0000 7f093ee73700 1 -- 172.21.15.61:0/486557039 shutdown_connections 2023-12-24T20:03:07.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.162+0000 7f093ee73700 1 --2- 172.21.15.61:0/486557039 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f093806b740 0x7f0938067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:07.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.162+0000 7f093ee73700 1 --2- 172.21.15.61:0/486557039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0938159830 0x7f09380b2d90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:07.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.162+0000 7f093ee73700 1 -- 172.21.15.61:0/486557039 >> 172.21.15.61:0/486557039 conn(0x7f093806a1e0 msgr2=0x7f093806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:07.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.162+0000 7f093ee73700 1 -- 172.21.15.61:0/486557039 shutdown_connections 2023-12-24T20:03:07.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.162+0000 7f093ee73700 1 -- 172.21.15.61:0/486557039 wait complete. 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.163+0000 7f093ee73700 1 Processor -- start 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.163+0000 7f093ee73700 1 -- start start 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093ee73700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f093806b740 0x7f093814d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093ee73700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0938159830 0x7f09380b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093ee73700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f09380b0c60 0x7f09380c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093ee73700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09380af680 con 0x7f09380b0c60 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093ee73700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09380af960 con 0x7f093806b740 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093ee73700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09380afc40 con 0x7f0938159830 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093d410700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f09380b0c60 0x7f09380c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093d410700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f09380b0c60 0x7f09380c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45578/0 (socket says 172.21.15.61:45578) 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093d410700 1 -- 172.21.15.61:0/1377357009 learned_addr learned my addr 172.21.15.61:0/1377357009 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:07.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f0937fff700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0938159830 0x7f09380b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093cc0f700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f093806b740 0x7f093814d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093d410700 1 -- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0938159830 msgr2=0x7f09380b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093d410700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0938159830 0x7f09380b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093d410700 1 -- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f093806b740 msgr2=0x7f093814d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093d410700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f093806b740 0x7f093814d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.164+0000 7f093d410700 1 -- 172.21.15.61:0/1377357009 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0930009ae0 con 0x7f09380b0c60 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.165+0000 7f093d410700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f09380b0c60 0x7f09380c6ee0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f0930009fd0 tx=0x7f093000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.165+0000 7f0934ff9700 1 -- 172.21.15.61:0/1377357009 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930018070 con 0x7f09380b0c60 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.165+0000 7f0934ff9700 1 -- 172.21.15.61:0/1377357009 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093000f040 con 0x7f09380b0c60 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.165+0000 7f093ee73700 1 -- 172.21.15.61:0/1377357009 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092c009420 con 0x7f09380b0c60 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.165+0000 7f0934ff9700 1 -- 172.21.15.61:0/1377357009 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000cbd0 con 0x7f09380b0c60 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.165+0000 7f093ee73700 1 -- 172.21.15.61:0/1377357009 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09380b0200 con 0x7f09380b0c60 2023-12-24T20:03:07.167 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.166+0000 7f093ee73700 1 -- 172.21.15.61:0/1377357009 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093806e3d0 con 0x7f09380b0c60 2023-12-24T20:03:07.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.166+0000 7f0934ff9700 1 -- 172.21.15.61:0/1377357009 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0930003020 con 0x7f09380b0c60 2023-12-24T20:03:07.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.167+0000 7f0934ff9700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f091c066f30 0x7f091c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:07.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.167+0000 7f0934ff9700 1 -- 172.21.15.61:0/1377357009 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0930084980 con 0x7f09380b0c60 2023-12-24T20:03:07.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.167+0000 7f093cc0f700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f091c066f30 0x7f091c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:07.169 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.167+0000 7f093cc0f700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f091c066f30 0x7f091c0693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f092c0093f0 tx=0x7f092c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:07.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.171+0000 7f0934ff9700 1 -- 172.21.15.61:0/1377357009 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0930051bf0 con 0x7f09380b0c60 2023-12-24T20:03:07.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.366+0000 7f093ee73700 1 -- 172.21.15.61:0/1377357009 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f093804c3c0 con 0x7f09380b0c60 2023-12-24T20:03:07.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.367+0000 7f0934ff9700 1 -- 172.21.15.61:0/1377357009 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f0930055210 con 0x7f09380b0c60 2023-12-24T20:03:07.367 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:07.367 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:07.367 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 137, 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:03:06.570642+0000", 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:03:07.368 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:03:07.369 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:07.369 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:03:07.369 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:03:07.369 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:03:07.369 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:03:07.369 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:03:07.369 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 17, 2023-12-24T20:03:07.369 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:03:07.369 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:07.370 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:07.371 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:07.372 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:07.373 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:07.374 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 16, 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:53.096572+0000", 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:07.375 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:07.376 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "135", 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:07.377 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:07.378 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:07.379 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:07.379 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:07.379 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:07.379 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:07.379 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:07.379 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:07.379 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.379 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:03:07.380 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 17, 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:54.304286+0000", 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:07.381 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:07.382 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "137", 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:07.383 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:07.384 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:07.385 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:07.386 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:07.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:07.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.389 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.390 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.391 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:07.392 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.393 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.394 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.395 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:03:07.396 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:07.397 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.398 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.399 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:03:07.400 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:07.401 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:07.402 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:03:07.403 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:07.404 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:07.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.406 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.407 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.408 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.409 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:03:07.411 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:07.412 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:07.413 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:07.414 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.415 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:03:07.416 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:07.417 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:07.418 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.419 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.420 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.421 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:03:07.422 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:07.423 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.424 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.425 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.426 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:03:07.427 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:07.428 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.429 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:07.430 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:07.431 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:03:07.432 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:07.432 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.432 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.432 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:07.432 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:07.432 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:03:07.433 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:07.434 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:03:07.435 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:03:07.436 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:03:07.437 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:03:07.437 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:07.437 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:07.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 -- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f091c066f30 msgr2=0x7f091c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:07.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f091c066f30 0x7f091c0693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f092c0093f0 tx=0x7f092c017000 comp rx=0 tx=0).stop 2023-12-24T20:03:07.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 -- 172.21.15.61:0/1377357009 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f09380b0c60 msgr2=0x7f09380c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:07.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f09380b0c60 0x7f09380c6ee0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f0930009fd0 tx=0x7f093000b040 comp rx=0 tx=0).stop 2023-12-24T20:03:07.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 -- 172.21.15.61:0/1377357009 shutdown_connections 2023-12-24T20:03:07.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f091c066f30 0x7f091c0693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:07.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f09380b0c60 0x7f09380c6ee0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:07.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f093806b740 0x7f093814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:07.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 --2- 172.21.15.61:0/1377357009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0938159830 0x7f09380b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:07.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 -- 172.21.15.61:0/1377357009 >> 172.21.15.61:0/1377357009 conn(0x7f093806a1e0 msgr2=0x7f09381579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:07.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 -- 172.21.15.61:0/1377357009 shutdown_connections 2023-12-24T20:03:07.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:07.369+0000 7f093ee73700 1 -- 172.21.15.61:0/1377357009 wait complete. 2023-12-24T20:03:07.440 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:03:12.440 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:03:12.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.576+0000 7f122765d700 1 Processor -- start 2023-12-24T20:03:12.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.576+0000 7f122765d700 1 -- start start 2023-12-24T20:03:12.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.577+0000 7f122765d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12201599e0 0x7f122015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:12.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.577+0000 7f122765d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f12200cdb80 0x7f12200cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:12.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.577+0000 7f122765d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12200cc2a0 con 0x7f12200cbac0 2023-12-24T20:03:12.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.577+0000 7f122765d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12200cedc0 con 0x7f12200cdb80 2023-12-24T20:03:12.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.577+0000 7f122765d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1220067f60 con 0x7f12201599e0 2023-12-24T20:03:12.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.577+0000 7f1225bfa700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f12200cdb80 0x7f12200cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:12.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.577+0000 7f1224bf8700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f12200cbac0 0x7f12200cd470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:58682/0 (socket says 172.21.15.61:58682) 2023-12-24T20:03:12.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.577+0000 7f1224bf8700 1 -- 172.21.15.61:0/449221652 learned_addr learned my addr 172.21.15.61:0/449221652 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:12.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.578+0000 7f12253f9700 1 --2- 172.21.15.61:0/449221652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12201599e0 0x7f122015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:12.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.578+0000 7f1225bfa700 1 -- 172.21.15.61:0/449221652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12201599e0 msgr2=0x7f122015ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:12.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.578+0000 7f1225bfa700 1 --2- 172.21.15.61:0/449221652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12201599e0 0x7f122015ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:12.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.578+0000 7f1225bfa700 1 -- 172.21.15.61:0/449221652 >> v1:172.21.15.61:6789/0 conn(0x7f12200cbac0 legacy=0x7f12200cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:12.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.578+0000 7f1217fff700 1 -- 172.21.15.61:0/449221652 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858253265 0 0) 0x7f12200cc2a0 con 0x7f12200cbac0 2023-12-24T20:03:12.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.578+0000 7f1225bfa700 1 -- 172.21.15.61:0/449221652 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122015b040 con 0x7f12200cdb80 2023-12-24T20:03:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.578+0000 7f1225bfa700 1 --2- 172.21.15.61:0/449221652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12200cdb80 0x7f12200cf250 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f1218009e60 tx=0x7f1218009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713cb330cb3f9b90 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.578+0000 7f1217fff700 1 -- 172.21.15.61:0/449221652 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121800e070 con 0x7f12200cdb80 2023-12-24T20:03:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.578+0000 7f1217fff700 1 -- 172.21.15.61:0/449221652 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121800bc30 con 0x7f12200cdb80 2023-12-24T20:03:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.578+0000 7f1217fff700 1 -- 172.21.15.61:0/449221652 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218012430 con 0x7f12200cdb80 2023-12-24T20:03:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.579+0000 7f122765d700 1 -- 172.21.15.61:0/449221652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12200cdb80 msgr2=0x7f12200cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.579+0000 7f122765d700 1 --2- 172.21.15.61:0/449221652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12200cdb80 0x7f12200cf250 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f1218009e60 tx=0x7f1218009780 comp rx=0 tx=0).stop 2023-12-24T20:03:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.579+0000 7f122765d700 1 -- 172.21.15.61:0/449221652 shutdown_connections 2023-12-24T20:03:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.579+0000 7f122765d700 1 --2- 172.21.15.61:0/449221652 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12201599e0 0x7f122015ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:12.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.579+0000 7f122765d700 1 --2- 172.21.15.61:0/449221652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12200cdb80 0x7f12200cf250 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:12.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.579+0000 7f122765d700 1 -- 172.21.15.61:0/449221652 >> 172.21.15.61:0/449221652 conn(0x7f122006e640 msgr2=0x7f1220067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:12.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.579+0000 7f122765d700 1 -- 172.21.15.61:0/449221652 shutdown_connections 2023-12-24T20:03:12.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.579+0000 7f122765d700 1 -- 172.21.15.61:0/449221652 wait complete. 2023-12-24T20:03:12.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.580+0000 7f122765d700 1 Processor -- start 2023-12-24T20:03:12.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.580+0000 7f122765d700 1 -- start start 2023-12-24T20:03:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f122765d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12200cbac0 0x7f122015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f122765d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12200cdb80 0x7f12200b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f122765d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12201599e0 0x7f122016d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f122765d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122015b5c0 con 0x7f12201599e0 2023-12-24T20:03:12.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f122765d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12200b5480 con 0x7f12200cdb80 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f122765d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12200b4be0 con 0x7f12200cbac0 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f1225bfa700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12201599e0 0x7f122016d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f1225bfa700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12201599e0 0x7f122016d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45606/0 (socket says 172.21.15.61:45606) 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f1224bf8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12200cdb80 0x7f12200b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f1225bfa700 1 -- 172.21.15.61:0/3307966368 learned_addr learned my addr 172.21.15.61:0/3307966368 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f12253f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12200cbac0 0x7f122015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f1225bfa700 1 -- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12200cbac0 msgr2=0x7f122015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f1225bfa700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12200cbac0 0x7f122015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f1225bfa700 1 -- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12200cdb80 msgr2=0x7f12200b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f1225bfa700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12200cdb80 0x7f12200b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.581+0000 7f1225bfa700 1 -- 172.21.15.61:0/3307966368 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218009a20 con 0x7f12201599e0 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.582+0000 7f1225bfa700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12201599e0 0x7f122016d610 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f1220071db0 tx=0x7f1218019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.583+0000 7f12157fa700 1 -- 172.21.15.61:0/3307966368 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218027470 con 0x7f12201599e0 2023-12-24T20:03:12.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.583+0000 7f12157fa700 1 -- 172.21.15.61:0/3307966368 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12180275d0 con 0x7f12201599e0 2023-12-24T20:03:12.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.583+0000 7f12157fa700 1 -- 172.21.15.61:0/3307966368 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1218027990 con 0x7f12201599e0 2023-12-24T20:03:12.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.583+0000 7f122765d700 1 -- 172.21.15.61:0/3307966368 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12200b4ec0 con 0x7f12201599e0 2023-12-24T20:03:12.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.583+0000 7f122765d700 1 -- 172.21.15.61:0/3307966368 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122015dae0 con 0x7f12201599e0 2023-12-24T20:03:12.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.584+0000 7f122765d700 1 -- 172.21.15.61:0/3307966368 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122015b390 con 0x7f12201599e0 2023-12-24T20:03:12.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.584+0000 7f12157fa700 1 -- 172.21.15.61:0/3307966368 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1218024070 con 0x7f12201599e0 2023-12-24T20:03:12.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.585+0000 7f12157fa700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1204066f30 0x7f12040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:12.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.585+0000 7f12157fa700 1 -- 172.21.15.61:0/3307966368 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1218086c00 con 0x7f12201599e0 2023-12-24T20:03:12.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.585+0000 7f12253f9700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1204066f30 0x7f12040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:12.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.586+0000 7f12253f9700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1204066f30 0x7f12040693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1210006fd0 tx=0x7f1210008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:12.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.589+0000 7f12157fa700 1 -- 172.21.15.61:0/3307966368 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f122015b390 con 0x7f12201599e0 2023-12-24T20:03:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.785+0000 7f122765d700 1 -- 172.21.15.61:0/3307966368 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f122015b390 con 0x7f12201599e0 2023-12-24T20:03:12.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.786+0000 7f12157fa700 1 -- 172.21.15.61:0/3307966368 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v137) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f122015b390 con 0x7f12201599e0 2023-12-24T20:03:12.786 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:12.786 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:12.786 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 137, 2023-12-24T20:03:12.786 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:03:12.786 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:03:06.570642+0000", 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:03:12.787 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 17, 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:03:12.788 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:03:12.789 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:12.790 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:12.791 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:12.792 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.793 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 16, 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:53.096572+0000", 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:12.794 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:12.795 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:12.796 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.796 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "135", 2023-12-24T20:03:12.796 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:12.796 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:12.796 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:12.796 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:12.796 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:12.796 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:12.796 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:12.797 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:12.798 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:12.799 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:12.799 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:12.799 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:12.799 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:12.799 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:12.799 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:03:12.799 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:03:12.799 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:03:12.799 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.800 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:12.800 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:12.800 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:03:12.800 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.800 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.800 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.801 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.801 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 17, 2023-12-24T20:03:12.801 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:03:12.801 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:54.304286+0000", 2023-12-24T20:03:12.801 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:12.801 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:12.802 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:12.802 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:12.802 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:12.802 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:12.802 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:12.802 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:12.802 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:12.803 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:12.803 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:12.803 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:12.803 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:03:12.803 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:03:12.803 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:03:12.803 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:03:12.804 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:03:12.804 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:12.804 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:12.804 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:12.804 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:12.804 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:12.805 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:12.805 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:12.805 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.805 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "137", 2023-12-24T20:03:12.805 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:12.805 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:12.806 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:12.806 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:12.806 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:12.806 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:12.806 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:12.806 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:12.807 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:12.807 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:03:12.807 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:12.807 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:12.807 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:12.807 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:12.807 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:12.808 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:12.808 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:12.808 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:12.808 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:12.808 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:12.808 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:12.808 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:12.808 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:12.808 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:12.808 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:12.809 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:12.810 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:12.810 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:12.810 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:12.810 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:03:12.810 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:03:12.810 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.810 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:12.810 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:12.810 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:12.811 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:12.812 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.813 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:03:12.814 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:12.815 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:12.816 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:12.817 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:03:12.818 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.819 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.820 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:03:12.820 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:12.820 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.820 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.820 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.820 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:12.820 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.821 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.821 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.821 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:03:12.821 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:12.821 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.821 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.822 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.822 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:03:12.822 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:12.822 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.822 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.822 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.823 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:12.823 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.823 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.823 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.823 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:03:12.823 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:12.823 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.824 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.824 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.824 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:03:12.824 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:12.824 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.824 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.825 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.825 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:03:12.825 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:03:12.825 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:03:12.825 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:03:12.826 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:12.826 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:12.826 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:12.826 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.826 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.826 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.827 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:12.827 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:12.827 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:12.827 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:12.827 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:12.827 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:12.828 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:12.828 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:12.828 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:12.828 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:12.828 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:12.828 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:12.828 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:12.829 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.829 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.829 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.829 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:03:12.829 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:12.829 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.830 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.830 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.830 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:03:12.830 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:12.830 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.830 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.830 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.830 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:12.830 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.831 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.832 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:03:12.833 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:12.834 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.835 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.836 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.837 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:03:12.838 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:12.839 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:03:12.840 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:03:12.841 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:03:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:03:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:03:12.849 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:12.850 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:03:12.851 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.852 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.853 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:03:12.854 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:12.855 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.856 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:03:12.857 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.858 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:12.859 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:12.860 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:12.862 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:12.863 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.864 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:12.865 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:03:12.866 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:03:12.867 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:03:12.867 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:03:12.867 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.867 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:12.867 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:03:12.867 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:03:12.867 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:03:12.867 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:03:12.867 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:03:12.867 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:03:12.868 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:03:12.868 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:03:12.868 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:03:12.868 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:03:12.868 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:03:12.868 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:12.868 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:12.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 -- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1204066f30 msgr2=0x7f12040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:12.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1204066f30 0x7f12040693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1210006fd0 tx=0x7f1210008040 comp rx=0 tx=0).stop 2023-12-24T20:03:12.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 -- 172.21.15.61:0/3307966368 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12201599e0 msgr2=0x7f122016d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:12.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12201599e0 0x7f122016d610 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f1220071db0 tx=0x7f1218019000 comp rx=0 tx=0).stop 2023-12-24T20:03:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 -- 172.21.15.61:0/3307966368 shutdown_connections 2023-12-24T20:03:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12200cbac0 0x7f122015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1204066f30 0x7f12040693e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12201599e0 0x7f122016d610 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 --2- 172.21.15.61:0/3307966368 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12200cdb80 0x7f12200b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 -- 172.21.15.61:0/3307966368 >> 172.21.15.61:0/3307966368 conn(0x7f122006e640 msgr2=0x7f12201588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 -- 172.21.15.61:0/3307966368 shutdown_connections 2023-12-24T20:03:12.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:12.788+0000 7f122765d700 1 -- 172.21.15.61:0/3307966368 wait complete. 2023-12-24T20:03:12.872 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:03:17.872 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:03:18.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.008+0000 7f06c48e4700 1 Processor -- start 2023-12-24T20:03:18.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.008+0000 7f06c48e4700 1 -- start start 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06c48e4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f06c01599e0 0x7f06c015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06c48e4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06c00cbac0 0x7f06c00cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06c48e4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c00cd9b0 0x7f06c015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06c48e4700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c00cc2a0 con 0x7f06c01599e0 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06c48e4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c00cedc0 con 0x7f06c00cbac0 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06c48e4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0067f60 con 0x7f06c00cd9b0 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06be59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f06c01599e0 0x7f06c015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06be59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f06c01599e0 0x7f06c015ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53286/0 (socket says 172.21.15.61:53286) 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06be59c700 1 -- 172.21.15.61:0/3493941938 learned_addr learned my addr 172.21.15.61:0/3493941938 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06bed9d700 1 --2- 172.21.15.61:0/3493941938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c00cd9b0 0x7f06c015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06bdd9b700 1 --2- 172.21.15.61:0/3493941938 >> v2:172.21.15.133:3300/0 conn(0x7f06c00cbac0 0x7f06c00cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.009+0000 7f06be59c700 1 -- 172.21.15.61:0/3493941938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c00cd9b0 msgr2=0x7f06c015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06be59c700 1 --2- 172.21.15.61:0/3493941938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c00cd9b0 0x7f06c015d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06be59c700 1 -- 172.21.15.61:0/3493941938 >> v2:172.21.15.133:3300/0 conn(0x7f06c00cbac0 msgr2=0x7f06c00cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06be59c700 1 --2- 172.21.15.61:0/3493941938 >> v2:172.21.15.133:3300/0 conn(0x7f06c00cbac0 0x7f06c00cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06be59c700 1 -- 172.21.15.61:0/3493941938 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c015b040 con 0x7f06c01599e0 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06be59c700 1 --2- 172.21.15.61:0/3493941938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c01599e0 0x7f06c015ab00 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f06c00b05b0 tx=0x7f06a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7cbc5db072fc75 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06bd59a700 1 -- 172.21.15.61:0/3493941938 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800b860 con 0x7f06c01599e0 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06bd59a700 1 -- 172.21.15.61:0/3493941938 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a800b9c0 con 0x7f06c01599e0 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06bd59a700 1 -- 172.21.15.61:0/3493941938 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800bd60 con 0x7f06c01599e0 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06c48e4700 1 -- 172.21.15.61:0/3493941938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c01599e0 msgr2=0x7f06c015ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06c48e4700 1 --2- 172.21.15.61:0/3493941938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c01599e0 0x7f06c015ab00 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f06c00b05b0 tx=0x7f06a8009250 comp rx=0 tx=0).stop 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06c48e4700 1 -- 172.21.15.61:0/3493941938 shutdown_connections 2023-12-24T20:03:18.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.010+0000 7f06c48e4700 1 --2- 172.21.15.61:0/3493941938 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c00cd9b0 0x7f06c015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.011+0000 7f06c48e4700 1 --2- 172.21.15.61:0/3493941938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c01599e0 0x7f06c015ab00 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.011+0000 7f06c48e4700 1 --2- 172.21.15.61:0/3493941938 >> v2:172.21.15.133:3300/0 conn(0x7f06c00cbac0 0x7f06c00cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.011+0000 7f06c48e4700 1 -- 172.21.15.61:0/3493941938 >> 172.21.15.61:0/3493941938 conn(0x7f06c006e640 msgr2=0x7f06c0067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.011+0000 7f06c48e4700 1 -- 172.21.15.61:0/3493941938 shutdown_connections 2023-12-24T20:03:18.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.011+0000 7f06c48e4700 1 -- 172.21.15.61:0/3493941938 wait complete. 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.012+0000 7f06c48e4700 1 Processor -- start 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.012+0000 7f06c48e4700 1 -- start start 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.012+0000 7f06c48e4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c00cbac0 0x7f06c0169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.012+0000 7f06c48e4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c00cd9b0 0x7f06c00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.012+0000 7f06c48e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01599e0 0x7f06c01574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.012+0000 7f06c48e4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00cae40 con 0x7f06c00cd9b0 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06c48e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00c7c50 con 0x7f06c01599e0 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06c48e4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00c7f30 con 0x7f06c00cbac0 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06bdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c00cd9b0 0x7f06c00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06bdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c00cd9b0 0x7f06c00ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53288/0 (socket says 172.21.15.61:53288) 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06bdd9b700 1 -- 172.21.15.61:0/1130462969 learned_addr learned my addr 172.21.15.61:0/1130462969 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:18.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06be59c700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c00cbac0 0x7f06c0169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06bdd9b700 1 -- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c00cbac0 msgr2=0x7f06c0169e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06bed9d700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01599e0 0x7f06c01574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06bdd9b700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c00cbac0 0x7f06c0169e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06bdd9b700 1 -- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01599e0 msgr2=0x7f06c01574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06bdd9b700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01599e0 0x7f06c01574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06bdd9b700 1 -- 172.21.15.61:0/1130462969 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a80094f0 con 0x7f06c00cd9b0 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06bdd9b700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c00cd9b0 0x7f06c00ca460 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f06b000d860 tx=0x7f06b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06b67fc700 1 -- 172.21.15.61:0/1130462969 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0009610 con 0x7f06c00cd9b0 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06b67fc700 1 -- 172.21.15.61:0/1130462969 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0009770 con 0x7f06c00cd9b0 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06b67fc700 1 -- 172.21.15.61:0/1130462969 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0009b30 con 0x7f06c00cd9b0 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06c48e4700 1 -- 172.21.15.61:0/1130462969 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c00c8210 con 0x7f06c00cd9b0 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.013+0000 7f06c48e4700 1 -- 172.21.15.61:0/1130462969 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c016a350 con 0x7f06c00cd9b0 2023-12-24T20:03:18.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.014+0000 7f06c48e4700 1 -- 172.21.15.61:0/1130462969 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c016a570 con 0x7f06c00cd9b0 2023-12-24T20:03:18.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.015+0000 7f06b67fc700 1 -- 172.21.15.61:0/1130462969 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f06b001e460 con 0x7f06c00cd9b0 2023-12-24T20:03:18.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.015+0000 7f06b67fc700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06a0066f30 0x7f06a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.015+0000 7f06b67fc700 1 -- 172.21.15.61:0/1130462969 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06b0084ba0 con 0x7f06c00cd9b0 2023-12-24T20:03:18.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.015+0000 7f06b67fc700 1 -- 172.21.15.61:0/1130462969 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7f06a006ea50 con 0x7f06c00cd9b0 2023-12-24T20:03:18.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.016+0000 7f06be59c700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06a0066f30 0x7f06a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.016+0000 7f06be59c700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06a0066f30 0x7f06a00693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f06c00b05b0 tx=0x7f06a8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:18.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.020+0000 7f06b67fc700 1 -- 172.21.15.61:0/1130462969 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06b0051e10 con 0x7f06c00cd9b0 2023-12-24T20:03:18.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.215+0000 7f06c48e4700 1 -- 172.21.15.61:0/1130462969 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f06c00c8710 con 0x7f06c00cd9b0 2023-12-24T20:03:18.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.216+0000 7f06b67fc700 1 -- 172.21.15.61:0/1130462969 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f06b0055430 con 0x7f06c00cd9b0 2023-12-24T20:03:18.217 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:18.218 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:18.218 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 138, 2023-12-24T20:03:18.218 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:03:18.218 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:03:18.218 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:03:13.565176+0000", 2023-12-24T20:03:18.218 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:03:18.219 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:03:18.219 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:03:18.219 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:03:18.219 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:03:18.219 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:03:18.219 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:03:18.219 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:03:18.219 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:03:18.219 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:18.220 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:03:18.220 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:03:18.220 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:03:18.220 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:03:18.220 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:03:18.220 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 17, 2023-12-24T20:03:18.220 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:03:18.220 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:18.221 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 16, 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:53.096572+0000", 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:18.227 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:18.228 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:18.228 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:18.228 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:18.228 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:18.228 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:18.228 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:18.228 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:18.228 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:18.229 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "135", 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:18.230 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:18.231 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:18.232 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 17, 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:03:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:54.304286+0000", 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1027, 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "138", 2023-12-24T20:03:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:18.238 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:18.238 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:18.238 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:18.238 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:18.238 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:18.238 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:18.238 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:18.238 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:18.238 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:18.238 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:18.239 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:18.239 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:03:18.239 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:03:18.239 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.239 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:18.239 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.240 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.241 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.242 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.242 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.242 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:03:18.242 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.242 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.242 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.244 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.245 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.245 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.245 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.245 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.245 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.245 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:03:18.245 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.245 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.245 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.245 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.246 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:03:18.247 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.248 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.249 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.250 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.251 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.252 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.253 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.254 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.255 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.256 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.257 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.258 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.259 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.260 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.261 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.262 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.268 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.269 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.270 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.271 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.272 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.273 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:03:18.274 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.275 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.276 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:03:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:03:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:03:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:03:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:03:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.282 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.283 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.284 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.285 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.286 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:03:18.287 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.288 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.289 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:18.290 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.291 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:03:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:03:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:03:18.294 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.294 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:18.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 -- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06a0066f30 msgr2=0x7f06a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06a0066f30 0x7f06a00693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f06c00b05b0 tx=0x7f06a8017000 comp rx=0 tx=0).stop 2023-12-24T20:03:18.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 -- 172.21.15.61:0/1130462969 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c00cd9b0 msgr2=0x7f06c00ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c00cd9b0 0x7f06c00ca460 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f06b000d860 tx=0x7f06b0008040 comp rx=0 tx=0).stop 2023-12-24T20:03:18.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 -- 172.21.15.61:0/1130462969 shutdown_connections 2023-12-24T20:03:18.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f06c00cbac0 0x7f06c0169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f06a0066f30 0x7f06a00693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06c01599e0 0x7f06c01574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 --2- 172.21.15.61:0/1130462969 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06c00cd9b0 0x7f06c00ca460 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 -- 172.21.15.61:0/1130462969 >> 172.21.15.61:0/1130462969 conn(0x7f06c006e640 msgr2=0x7f06c00b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:18.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 -- 172.21.15.61:0/1130462969 shutdown_connections 2023-12-24T20:03:18.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.218+0000 7f06c48e4700 1 -- 172.21.15.61:0/1130462969 wait complete. 2023-12-24T20:03:18.297 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-24T20:03:18.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:18.297 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-12-24T20:03:18.377 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:03:18.377 INFO:teuthology.orchestra.run.smithi061.stderr:dd: error writing 'large_file_b': No space left on device 2023-12-24T20:03:18.378 INFO:teuthology.orchestra.run.smithi061.stderr:dd: closing output file 'large_file_b': No space left on device 2023-12-24T20:03:18.378 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:03:18.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.499+0000 7fcabf5ae700 1 Processor -- start 2023-12-24T20:03:18.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.499+0000 7fcabf5ae700 1 -- start start 2023-12-24T20:03:18.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.500+0000 7fcabf5ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 0x7fcab8070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.500+0000 7fcabf5ae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcab8159e60 0x7fcab8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.500+0000 7fcabf5ae700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcab80b04c0 0x7fcab80c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.500+0000 7fcabf5ae700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab806a090 con 0x7fcab80b04c0 2023-12-24T20:03:18.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.500+0000 7fcabf5ae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab806ac10 con 0x7fcab8159e60 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.500+0000 7fcabf5ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab806a2e0 con 0x7fcab8159a90 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.500+0000 7fcabdb4b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcab80b04c0 0x7fcab80c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.500+0000 7fcabdb4b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcab80b04c0 0x7fcab80c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53302/0 (socket says 172.21.15.61:53302) 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.500+0000 7fcabdb4b700 1 -- 172.21.15.61:0/3409828010 learned_addr learned my addr 172.21.15.61:0/3409828010 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabd34a700 1 --2- 172.21.15.61:0/3409828010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 0x7fcab8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabcb49700 1 --2- 172.21.15.61:0/3409828010 >> v2:172.21.15.133:3300/0 conn(0x7fcab8159e60 0x7fcab8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabdb4b700 1 -- 172.21.15.61:0/3409828010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 msgr2=0x7fcab8070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabdb4b700 1 --2- 172.21.15.61:0/3409828010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 0x7fcab8070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabdb4b700 1 -- 172.21.15.61:0/3409828010 >> v2:172.21.15.133:3300/0 conn(0x7fcab8159e60 msgr2=0x7fcab8070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabdb4b700 1 --2- 172.21.15.61:0/3409828010 >> v2:172.21.15.133:3300/0 conn(0x7fcab8159e60 0x7fcab8070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabdb4b700 1 -- 172.21.15.61:0/3409828010 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab806a5c0 con 0x7fcab80b04c0 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabd34a700 1 --2- 172.21.15.61:0/3409828010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 0x7fcab8070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabdb4b700 1 --2- 172.21.15.61:0/3409828010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 0x7fcab80c93c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fcab806d330 tx=0x7fcab0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44403b2498d612a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:18.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcaaffff700 1 -- 172.21.15.61:0/3409828010 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab000e070 con 0x7fcab80b04c0 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcaaffff700 1 -- 172.21.15.61:0/3409828010 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab000ba50 con 0x7fcab80b04c0 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcaaffff700 1 -- 172.21.15.61:0/3409828010 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab00092e0 con 0x7fcab80b04c0 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabf5ae700 1 -- 172.21.15.61:0/3409828010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 msgr2=0x7fcab80c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.501+0000 7fcabf5ae700 1 --2- 172.21.15.61:0/3409828010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 0x7fcab80c93c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fcab806d330 tx=0x7fcab0009840 comp rx=0 tx=0).stop 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.502+0000 7fcabf5ae700 1 -- 172.21.15.61:0/3409828010 shutdown_connections 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.502+0000 7fcabf5ae700 1 --2- 172.21.15.61:0/3409828010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 0x7fcab80c93c0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.502+0000 7fcabf5ae700 1 --2- 172.21.15.61:0/3409828010 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 0x7fcab8070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.502+0000 7fcabf5ae700 1 --2- 172.21.15.61:0/3409828010 >> v2:172.21.15.133:3300/0 conn(0x7fcab8159e60 0x7fcab8070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.502+0000 7fcabf5ae700 1 -- 172.21.15.61:0/3409828010 >> 172.21.15.61:0/3409828010 conn(0x7fcab80cd6f0 msgr2=0x7fcab80cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.502+0000 7fcabf5ae700 1 -- 172.21.15.61:0/3409828010 shutdown_connections 2023-12-24T20:03:18.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.502+0000 7fcabf5ae700 1 -- 172.21.15.61:0/3409828010 wait complete. 2023-12-24T20:03:18.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.503+0000 7fcabf5ae700 1 Processor -- start 2023-12-24T20:03:18.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.503+0000 7fcabf5ae700 1 -- start start 2023-12-24T20:03:18.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabf5ae700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 0x7fcab8158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabf5ae700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 0x7fcab8169810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabf5ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab8159e60 0x7fcab80c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabf5ae700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab80c1ec0 con 0x7fcab80b04c0 2023-12-24T20:03:18.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabf5ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab80c12b0 con 0x7fcab8159e60 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabf5ae700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab80c1590 con 0x7fcab8159a90 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabd34a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 0x7fcab8158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabd34a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 0x7fcab8158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53318/0 (socket says 172.21.15.61:53318) 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabd34a700 1 -- 172.21.15.61:0/2867193690 learned_addr learned my addr 172.21.15.61:0/2867193690 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabcb49700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 0x7fcab8169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabdb4b700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab8159e60 0x7fcab80c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabd34a700 1 -- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 msgr2=0x7fcab8169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabd34a700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 0x7fcab8169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabd34a700 1 -- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab8159e60 msgr2=0x7fcab80c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabd34a700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab8159e60 0x7fcab80c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabd34a700 1 -- 172.21.15.61:0/2867193690 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab0009ae0 con 0x7fcab80b04c0 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabcb49700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 0x7fcab8169810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabdb4b700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab8159e60 0x7fcab80c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcabd34a700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 0x7fcab8158de0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800c830 tx=0x7fcaa8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:18.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcaad7fa700 1 -- 172.21.15.61:0/2867193690 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8011600 con 0x7fcab80b04c0 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.504+0000 7fcaad7fa700 1 -- 172.21.15.61:0/2867193690 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa8011760 con 0x7fcab80b04c0 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.505+0000 7fcaad7fa700 1 -- 172.21.15.61:0/2867193690 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8011b20 con 0x7fcab80b04c0 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.505+0000 7fcabf5ae700 1 -- 172.21.15.61:0/2867193690 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab80c1870 con 0x7fcab80b04c0 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.505+0000 7fcabf5ae700 1 -- 172.21.15.61:0/2867193690 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab8169d50 con 0x7fcab80b04c0 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.505+0000 7fcabf5ae700 1 -- 172.21.15.61:0/2867193690 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab80c21a0 con 0x7fcab80b04c0 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.506+0000 7fcaad7fa700 1 -- 172.21.15.61:0/2867193690 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcaa800a3e0 con 0x7fcab80b04c0 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.507+0000 7fcaad7fa700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca9c066f30 0x7fca9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.507+0000 7fcaad7fa700 1 -- 172.21.15.61:0/2867193690 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcaa8084c00 con 0x7fcab80b04c0 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.507+0000 7fcaad7fa700 1 -- 172.21.15.61:0/2867193690 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7fca9c06ea50 con 0x7fcab80b04c0 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.507+0000 7fcabcb49700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca9c066f30 0x7fca9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.507+0000 7fcabcb49700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca9c066f30 0x7fca9c0693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcab4006fd0 tx=0x7fcab4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:18.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.510+0000 7fcaad7fa700 1 -- 172.21.15.61:0/2867193690 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcaa8051e50 con 0x7fcab80b04c0 2023-12-24T20:03:18.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.707+0000 7fcabf5ae700 1 -- 172.21.15.61:0/2867193690 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fcab804c3c0 con 0x7fcab80b04c0 2023-12-24T20:03:18.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.708+0000 7fcaad7fa700 1 -- 172.21.15.61:0/2867193690 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+32301 (secure 0 0 0) 0x7fcaa801f090 con 0x7fcab80b04c0 2023-12-24T20:03:18.708 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 138, 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:03:13.565176+0000", 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:03:18.709 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 17, 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.710 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:18.711 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:03:18.712 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:18.713 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:18.714 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.715 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 16, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:53.096572+0000", 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:18.716 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.717 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "135", 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:18.718 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:18.719 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:18.720 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 17, 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:54.304286+0000", 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1027, 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:18.721 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:18.722 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "138", 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:03:18.723 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:18.724 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:03:18.725 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.726 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.727 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.728 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.729 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:03:18.730 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.731 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.732 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.733 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.734 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.735 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:03:18.736 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.737 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:03:18.738 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.739 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:03:18.740 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:03:18.741 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.742 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.743 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.744 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.745 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.746 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:03:18.747 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.748 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.749 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.750 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.751 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.752 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.753 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.754 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.755 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.756 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.757 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:18.758 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.759 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.760 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.761 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:03:18.762 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.763 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:18.764 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.765 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:18.766 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:18.767 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:03:18.768 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:03:18.769 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.770 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.771 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.772 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.773 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:03:18.774 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:03:18.775 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:03:18.776 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:03:18.776 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:03:18.776 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:03:18.776 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:03:18.776 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:03:18.776 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:03:18.776 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:18.776 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:18.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 -- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca9c066f30 msgr2=0x7fca9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca9c066f30 0x7fca9c0693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcab4006fd0 tx=0x7fcab4008040 comp rx=0 tx=0).stop 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 -- 172.21.15.61:0/2867193690 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 msgr2=0x7fcab8158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 0x7fcab8158de0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fcaa800c830 tx=0x7fcaa8008040 comp rx=0 tx=0).stop 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 -- 172.21.15.61:0/2867193690 shutdown_connections 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca9c066f30 0x7fca9c0693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab8159e60 0x7fcab80c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab80b04c0 0x7fcab8158de0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 --2- 172.21.15.61:0/2867193690 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcab8159a90 0x7fcab8169810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 -- 172.21.15.61:0/2867193690 >> 172.21.15.61:0/2867193690 conn(0x7fcab80cd6f0 msgr2=0x7fcab80c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 -- 172.21.15.61:0/2867193690 shutdown_connections 2023-12-24T20:03:18.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.710+0000 7fcabf5ae700 1 -- 172.21.15.61:0/2867193690 wait complete. 2023-12-24T20:03:18.779 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.900+0000 7f889c59e700 1 Processor -- start 2023-12-24T20:03:18.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.900+0000 7f889c59e700 1 -- start start 2023-12-24T20:03:18.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.901+0000 7f889c59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889413faa0 0x7f88940c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.901+0000 7f889c59e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f889406a310 0x7f889406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.901+0000 7f889c59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889413fe70 con 0x7f88940c7a30 2023-12-24T20:03:18.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.901+0000 7f889c59e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88940cbdc0 con 0x7f889406a310 2023-12-24T20:03:18.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.901+0000 7f889c59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889406d640 con 0x7f889413faa0 2023-12-24T20:03:18.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.901+0000 7f889ab3b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f889406a310 0x7f889406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.901+0000 7f889ab3b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f889406a310 0x7f889406dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53332/0 (socket says 172.21.15.61:53332) 2023-12-24T20:03:18.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.901+0000 7f889ab3b700 1 -- 172.21.15.61:0/3850511244 learned_addr learned my addr 172.21.15.61:0/3850511244 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:18.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f889a33a700 1 --2- 172.21.15.61:0/3850511244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889413faa0 0x7f88940c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f889ab3b700 1 -- 172.21.15.61:0/3850511244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889413faa0 msgr2=0x7f88940c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f889ab3b700 1 --2- 172.21.15.61:0/3850511244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889413faa0 0x7f88940c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f889ab3b700 1 -- 172.21.15.61:0/3850511244 >> v1:172.21.15.133:6789/0 conn(0x7f88940c7a30 legacy=0x7f8894069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f889ab3b700 1 -- 172.21.15.61:0/3850511244 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88940c7e80 con 0x7f889406a310 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f889ab3b700 1 --2- 172.21.15.61:0/3850511244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889406a310 0x7f889406dad0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f888c009f20 tx=0x7f888c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34a16659ce4251e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f8899338700 1 -- 172.21.15.61:0/3850511244 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c00e070 con 0x7f889406a310 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f8899338700 1 -- 172.21.15.61:0/3850511244 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c00ba40 con 0x7f889406a310 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f8899338700 1 -- 172.21.15.61:0/3850511244 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0092e0 con 0x7f889406a310 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f889c59e700 1 -- 172.21.15.61:0/3850511244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889406a310 msgr2=0x7f889406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.902+0000 7f889c59e700 1 --2- 172.21.15.61:0/3850511244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889406a310 0x7f889406dad0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f888c009f20 tx=0x7f888c009840 comp rx=0 tx=0).stop 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.903+0000 7f889c59e700 1 -- 172.21.15.61:0/3850511244 shutdown_connections 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.903+0000 7f889c59e700 1 --2- 172.21.15.61:0/3850511244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889406a310 0x7f889406dad0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.903+0000 7f889c59e700 1 --2- 172.21.15.61:0/3850511244 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f889413faa0 0x7f88940c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.903+0000 7f889c59e700 1 -- 172.21.15.61:0/3850511244 >> 172.21.15.61:0/3850511244 conn(0x7f88940cceb0 msgr2=0x7f88940cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:18.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.903+0000 7f889c59e700 1 -- 172.21.15.61:0/3850511244 shutdown_connections 2023-12-24T20:03:18.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.903+0000 7f889c59e700 1 -- 172.21.15.61:0/3850511244 wait complete. 2023-12-24T20:03:18.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.904+0000 7f889c59e700 1 Processor -- start 2023-12-24T20:03:18.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.904+0000 7f889c59e700 1 -- start start 2023-12-24T20:03:18.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889c59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889406a310 0x7f8894159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889c59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88940c7a30 0x7f88940c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889c59e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889413faa0 0x7f8894167690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889c59e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88940c5570 con 0x7f889413faa0 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889c59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88940c5850 con 0x7f889406a310 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889c59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88940c5b30 con 0x7f88940c7a30 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889ab3b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889413faa0 0x7f8894167690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889ab3b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889413faa0 0x7f8894167690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53338/0 (socket says 172.21.15.61:53338) 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889ab3b700 1 -- 172.21.15.61:0/3204203096 learned_addr learned my addr 172.21.15.61:0/3204203096 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889a33a700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889406a310 0x7f8894159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f8899b39700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88940c7a30 0x7f88940c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889ab3b700 1 -- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88940c7a30 msgr2=0x7f88940c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889ab3b700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88940c7a30 0x7f88940c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889ab3b700 1 -- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889406a310 msgr2=0x7f8894159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889ab3b700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889406a310 0x7f8894159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889ab3b700 1 -- 172.21.15.61:0/3204203096 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c009ae0 con 0x7f889413faa0 2023-12-24T20:03:18.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889ab3b700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889413faa0 0x7f8894167690 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f888c009880 tx=0x7f888c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:18.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f888a7fc700 1 -- 172.21.15.61:0/3204203096 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c00beb0 con 0x7f889413faa0 2023-12-24T20:03:18.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f888a7fc700 1 -- 172.21.15.61:0/3204203096 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c0092e0 con 0x7f889413faa0 2023-12-24T20:03:18.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889c59e700 1 -- 172.21.15.61:0/3204203096 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88940c5e10 con 0x7f889413faa0 2023-12-24T20:03:18.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f888a7fc700 1 -- 172.21.15.61:0/3204203096 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c01e430 con 0x7f889413faa0 2023-12-24T20:03:18.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.905+0000 7f889c59e700 1 -- 172.21.15.61:0/3204203096 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889415a1a0 con 0x7f889413faa0 2023-12-24T20:03:18.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.907+0000 7f889c59e700 1 -- 172.21.15.61:0/3204203096 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889415a3c0 con 0x7f889413faa0 2023-12-24T20:03:18.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.907+0000 7f888a7fc700 1 -- 172.21.15.61:0/3204203096 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f888c01e860 con 0x7f889413faa0 2023-12-24T20:03:18.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.907+0000 7f888a7fc700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8878066f30 0x7f88780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:18.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.907+0000 7f888a7fc700 1 -- 172.21.15.61:0/3204203096 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f888c085e10 con 0x7f889413faa0 2023-12-24T20:03:18.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.907+0000 7f888a7fc700 1 -- 172.21.15.61:0/3204203096 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7f887806ea50 con 0x7f889413faa0 2023-12-24T20:03:18.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.907+0000 7f889a33a700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8878066f30 0x7f88780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:18.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.908+0000 7f889a33a700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8878066f30 0x7f88780693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8884006fd0 tx=0x7f8884008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:18.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:18.912+0000 7f888a7fc700 1 -- 172.21.15.61:0/3204203096 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f888c053080 con 0x7f889413faa0 2023-12-24T20:03:19.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.151+0000 7f889c59e700 1 -- 172.21.15.61:0/3204203096 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f889413fe70 con 0x7f889413faa0 2023-12-24T20:03:19.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.151+0000 7f888a7fc700 1 -- 172.21.15.61:0/3204203096 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f889413fe70 con 0x7f889413faa0 2023-12-24T20:03:19.152 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:19.152 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3245805399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3245805399},{"type":"v1","addr":"172.21.15.133:6837","nonce":3245805399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/4168448475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":4168448475},{"type":"v1","addr":"172.21.15.61:6835","nonce":4168448475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1817856586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1817856586},{"type":"v1","addr":"172.21.15.61:6834","nonce":1817856586}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:55.325289+0000","modified":"2023-12-24T20:02:58.932577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7089},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7089":{"gid":7089,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2704897796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2704897796},{"type":"v1","addr":"172.21.15.133:6836","nonce":2704897796}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T20:03:19.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 -- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8878066f30 msgr2=0x7f88780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:19.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8878066f30 0x7f88780693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8884006fd0 tx=0x7f8884008040 comp rx=0 tx=0).stop 2023-12-24T20:03:19.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 -- 172.21.15.61:0/3204203096 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889413faa0 msgr2=0x7f8894167690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:19.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889413faa0 0x7f8894167690 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f888c009880 tx=0x7f888c017000 comp rx=0 tx=0).stop 2023-12-24T20:03:19.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 -- 172.21.15.61:0/3204203096 shutdown_connections 2023-12-24T20:03:19.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8878066f30 0x7f88780693e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f889413faa0 0x7f8894167690 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f889406a310 0x7f8894159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 --2- 172.21.15.61:0/3204203096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88940c7a30 0x7f88940c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 -- 172.21.15.61:0/3204203096 >> 172.21.15.61:0/3204203096 conn(0x7f88940cceb0 msgr2=0x7f88940cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:19.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 -- 172.21.15.61:0/3204203096 shutdown_connections 2023-12-24T20:03:19.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.153+0000 7f889c59e700 1 -- 172.21.15.61:0/3204203096 wait complete. 2023-12-24T20:03:19.155 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 69 2023-12-24T20:03:19.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-24T20:03:19.314 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":7089,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":23.395064023,"mdsmap_epoch":69,"osdmap_epoch":138,"osdmap_epoch_barrier":136,"uptime":28.414360850000001} 2023-12-24T20:03:19.315 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 7089, "mdsmap_epoch": 69, "osdmap_epoch": 138, "osdmap_epoch_barrier": 136, "rank_uptime": 23.395064023, "state": "up:active", "uptime": 28.41436085, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:03:19.315 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-24T20:03:19.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:19.315 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-24T20:03:19.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:19.336 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-24T20:03:19.399 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:03:19.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.561+0000 7f783adc0700 1 Processor -- start 2023-12-24T20:03:19.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.561+0000 7f783adc0700 1 -- start start 2023-12-24T20:03:19.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783adc0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834068510 0x7f78340cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:19.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783adc0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7834159a60 0x7f7834159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783adc0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78340b2890 con 0x7f7834068140 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783adc0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78340cf630 con 0x7f7834159a60 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783adc0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78340b2240 con 0x7f7834068510 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783935d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7834159a60 0x7f7834159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f7838b5c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7834068140 0x7f78340b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:56356/0 (socket says 172.21.15.61:56356) 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f7838b5c700 1 -- 172.21.15.61:0/2867871712 learned_addr learned my addr 172.21.15.61:0/2867871712 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f7833fff700 1 --2- 172.21.15.61:0/2867871712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834068510 0x7f78340cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783935d700 1 -- 172.21.15.61:0/2867871712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834068510 msgr2=0x7f78340cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783935d700 1 --2- 172.21.15.61:0/2867871712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834068510 0x7f78340cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783935d700 1 -- 172.21.15.61:0/2867871712 >> v1:172.21.15.61:6789/0 conn(0x7f7834068140 legacy=0x7f78340b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783935d700 1 -- 172.21.15.61:0/2867871712 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78340b2520 con 0x7f7834159a60 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f7833fff700 1 --2- 172.21.15.61:0/2867871712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834068510 0x7f78340cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f78337fe700 1 -- 172.21.15.61:0/2867871712 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375317268 0 0) 0x7f78340b2890 con 0x7f7834068140 2023-12-24T20:03:19.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f783935d700 1 --2- 172.21.15.61:0/2867871712 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834159a60 0x7f7834159ee0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f782c009e60 tx=0x7f782c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37120aa226a8f643 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f78337fe700 1 -- 172.21.15.61:0/2867871712 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c00e070 con 0x7f7834159a60 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f78337fe700 1 -- 172.21.15.61:0/2867871712 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c00bc30 con 0x7f7834159a60 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.562+0000 7f78337fe700 1 -- 172.21.15.61:0/2867871712 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c012430 con 0x7f7834159a60 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.563+0000 7f783adc0700 1 -- 172.21.15.61:0/2867871712 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834159a60 msgr2=0x7f7834159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.563+0000 7f783adc0700 1 --2- 172.21.15.61:0/2867871712 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834159a60 0x7f7834159ee0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f782c009e60 tx=0x7f782c009780 comp rx=0 tx=0).stop 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.563+0000 7f783adc0700 1 -- 172.21.15.61:0/2867871712 shutdown_connections 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.563+0000 7f783adc0700 1 --2- 172.21.15.61:0/2867871712 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834159a60 0x7f7834159ee0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.563+0000 7f783adc0700 1 --2- 172.21.15.61:0/2867871712 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834068510 0x7f78340cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.563+0000 7f783adc0700 1 -- 172.21.15.61:0/2867871712 >> 172.21.15.61:0/2867871712 conn(0x7f7834097a10 msgr2=0x7f78340ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.563+0000 7f783adc0700 1 -- 172.21.15.61:0/2867871712 shutdown_connections 2023-12-24T20:03:19.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.563+0000 7f783adc0700 1 -- 172.21.15.61:0/2867871712 wait complete. 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.564+0000 7f783adc0700 1 Processor -- start 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.564+0000 7f783adc0700 1 -- start start 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f783adc0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834068140 0x7f783415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f783adc0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834068510 0x7f783415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f783adc0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834159a60 0x7f783415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f783adc0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783415d2b0 con 0x7f7834068510 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f783adc0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783415d590 con 0x7f7834068140 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f783adc0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783415d870 con 0x7f7834159a60 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f7833fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834068510 0x7f783415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f7833fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834068510 0x7f783415eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53346/0 (socket says 172.21.15.61:53346) 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f7833fff700 1 -- 172.21.15.61:0/4138363813 learned_addr learned my addr 172.21.15.61:0/4138363813 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:19.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f7838b5c700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834068140 0x7f783415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f783935d700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834159a60 0x7f783415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f7833fff700 1 -- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834159a60 msgr2=0x7f783415f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f7833fff700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834159a60 0x7f783415f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f7833fff700 1 -- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834068140 msgr2=0x7f783415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f7833fff700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834068140 0x7f783415c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f7833fff700 1 -- 172.21.15.61:0/4138363813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c009a20 con 0x7f7834068510 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.565+0000 7f783935d700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834159a60 0x7f783415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.566+0000 7f7833fff700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834068510 0x7f783415eb10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f782000c830 tx=0x7f7820008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.566+0000 7f7830ff9700 1 -- 172.21.15.61:0/4138363813 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820011600 con 0x7f7834068510 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.566+0000 7f7830ff9700 1 -- 172.21.15.61:0/4138363813 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7820011760 con 0x7f7834068510 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.566+0000 7f783adc0700 1 -- 172.21.15.61:0/4138363813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783415db50 con 0x7f7834068510 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.566+0000 7f7830ff9700 1 -- 172.21.15.61:0/4138363813 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820011b20 con 0x7f7834068510 2023-12-24T20:03:19.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.566+0000 7f783adc0700 1 -- 172.21.15.61:0/4138363813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783415d060 con 0x7f7834068510 2023-12-24T20:03:19.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.567+0000 7f783adc0700 1 -- 172.21.15.61:0/4138363813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783415dec0 con 0x7f7834068510 2023-12-24T20:03:19.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.567+0000 7f7830ff9700 1 -- 172.21.15.61:0/4138363813 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f78200193b0 con 0x7f7834068510 2023-12-24T20:03:19.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.567+0000 7f7830ff9700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7818066f30 0x7f78180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:19.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.568+0000 7f7830ff9700 1 -- 172.21.15.61:0/4138363813 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7820084560 con 0x7f7834068510 2023-12-24T20:03:19.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.568+0000 7f7830ff9700 1 -- 172.21.15.61:0/4138363813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7f781806ea50 con 0x7f7834068510 2023-12-24T20:03:19.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.568+0000 7f7838b5c700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7818066f30 0x7f78180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:19.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.568+0000 7f7838b5c700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7818066f30 0x7f78180693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7828001360 tx=0x7f7828009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:19.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.572+0000 7f7830ff9700 1 -- 172.21.15.61:0/4138363813 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78200517d0 con 0x7f7834068510 2023-12-24T20:03:19.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.765+0000 7f783adc0700 1 -- 172.21.15.61:0/4138363813 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f783406d440 con 0x7f7834068510 2023-12-24T20:03:19.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.766+0000 7f7830ff9700 1 -- 172.21.15.61:0/4138363813 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f7820015090 con 0x7f7834068510 2023-12-24T20:03:19.767 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:19.767 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:19.767 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 138, 2023-12-24T20:03:19.767 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:03:19.767 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:03:19.767 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:03:13.565176+0000", 2023-12-24T20:03:19.767 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:03:19.767 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 17, 2023-12-24T20:03:19.768 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:19.769 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:19.770 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:19.770 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:19.770 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:19.770 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:19.770 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:19.770 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:19.770 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:19.770 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:19.771 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:03:19.771 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:03:19.771 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:03:19.771 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:03:19.771 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:03:19.771 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:19.771 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:19.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:19.771 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:19.771 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:19.772 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:19.773 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:19.774 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 16, 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:03:19.775 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:53.096572+0000", 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:03:19.776 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "135", 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:19.777 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:19.778 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:19.779 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:19.780 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:19.780 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:19.780 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:19.780 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:19.780 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:19.780 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:03:19.781 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:03:19.781 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:03:19.781 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.781 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:19.781 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:19.781 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:03:19.781 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.782 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.782 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.782 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.782 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 17, 2023-12-24T20:03:19.782 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:03:19.782 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:54.304286+0000", 2023-12-24T20:03:19.782 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1027, 2023-12-24T20:03:19.783 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-24T20:03:19.783 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:19.783 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:19.783 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:19.783 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:19.783 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:19.783 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:19.783 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:19.783 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:19.784 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:19.784 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:19.784 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:03:19.784 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:03:19.784 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:03:19.784 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:03:19.784 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:03:19.784 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:19.784 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:19.785 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:19.785 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:19.785 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:19.785 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:19.785 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:19.785 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.785 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "138", 2023-12-24T20:03:19.785 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:19.786 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:19.786 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:19.786 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:19.786 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:19.786 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:19.786 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:19.786 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:19.786 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:19.786 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:03:19.786 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:19.787 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:19.788 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:19.789 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:19.789 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:19.789 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:19.789 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:19.789 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:19.789 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:19.789 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:03:19.789 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:19.790 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.791 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.792 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.793 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:03:19.794 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:19.795 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:19.796 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:19.797 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:19.798 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:19.799 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.800 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:19.801 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:19.802 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:19.802 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:19.802 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:19.802 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:19.802 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:19.802 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:19.802 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:19.802 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:19.802 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.803 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:19.804 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.804 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.804 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.804 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:03:19.804 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:19.804 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.804 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.804 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.804 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:03:19.804 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.805 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:19.806 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:19.807 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:19.808 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:03:19.809 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.810 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.811 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:19.813 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.814 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.815 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:03:19.816 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:03:19.817 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:19.818 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:19.819 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:19.820 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:19.820 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:19.820 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:19.820 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.820 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.820 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.820 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:03:19.820 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:19.820 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.820 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.821 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.821 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:03:19.821 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:19.821 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.821 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.821 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.821 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:19.821 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.821 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.821 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.822 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:03:19.823 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:19.824 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:19.825 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.826 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.827 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:19.828 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:03:19.829 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:19.830 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.831 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.832 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:03:19.834 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:19.835 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.836 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:19.837 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.838 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:19.839 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:19.840 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:03:19.841 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:19.842 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:19.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 -- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7818066f30 msgr2=0x7f78180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:19.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7818066f30 0x7f78180693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7828001360 tx=0x7f7828009040 comp rx=0 tx=0).stop 2023-12-24T20:03:19.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 -- 172.21.15.61:0/4138363813 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834068510 msgr2=0x7f783415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:19.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834068510 0x7f783415eb10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f782000c830 tx=0x7f7820008040 comp rx=0 tx=0).stop 2023-12-24T20:03:19.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 -- 172.21.15.61:0/4138363813 shutdown_connections 2023-12-24T20:03:19.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7834159a60 0x7f783415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7818066f30 0x7f78180693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7834068140 0x7f783415c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 --2- 172.21.15.61:0/4138363813 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7834068510 0x7f783415eb10 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:19.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 -- 172.21.15.61:0/4138363813 >> 172.21.15.61:0/4138363813 conn(0x7f7834097a10 msgr2=0x7f783406c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:19.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 -- 172.21.15.61:0/4138363813 shutdown_connections 2023-12-24T20:03:19.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:19.768+0000 7f783adc0700 1 -- 172.21.15.61:0/4138363813 wait complete. 2023-12-24T20:03:19.845 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:03:24.847 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:03:24.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.982+0000 7fd3a1736700 1 Processor -- start 2023-12-24T20:03:24.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.982+0000 7fd3a1736700 1 -- start start 2023-12-24T20:03:24.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd3a1736700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd39c159c10 0x7fd39c0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:24.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd3a1736700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd39c159fe0 0x7fd39c0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:24.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd3a1736700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c0cba80 0x7fd39c0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:24.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd3a1736700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c0cc440 con 0x7fd39c159c10 2023-12-24T20:03:24.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd3a1736700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c0af880 con 0x7fd39c159fe0 2023-12-24T20:03:24.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd3a1736700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0c6fc0 con 0x7fd39c0cba80 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd39affd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd39c159c10 0x7fd39c0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd39affd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd39c159c10 0x7fd39c0c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53362/0 (socket says 172.21.15.61:53362) 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd39affd700 1 -- 172.21.15.61:0/2234472926 learned_addr learned my addr 172.21.15.61:0/2234472926 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd39b7fe700 1 --2- 172.21.15.61:0/2234472926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c0cba80 0x7fd39c0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd39affd700 1 -- 172.21.15.61:0/2234472926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c0cba80 msgr2=0x7fd39c0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd39a7fc700 1 --2- 172.21.15.61:0/2234472926 >> v2:172.21.15.133:3300/0 conn(0x7fd39c159fe0 0x7fd39c0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.983+0000 7fd39affd700 1 --2- 172.21.15.61:0/2234472926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c0cba80 0x7fd39c0cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd39affd700 1 -- 172.21.15.61:0/2234472926 >> v2:172.21.15.133:3300/0 conn(0x7fd39c159fe0 msgr2=0x7fd39c0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd39affd700 1 --2- 172.21.15.61:0/2234472926 >> v2:172.21.15.133:3300/0 conn(0x7fd39c159fe0 0x7fd39c0c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd39affd700 1 -- 172.21.15.61:0/2234472926 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c0c63b0 con 0x7fd39c159c10 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd39a7fc700 1 --2- 172.21.15.61:0/2234472926 >> v2:172.21.15.133:3300/0 conn(0x7fd39c159fe0 0x7fd39c0c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd39b7fe700 1 --2- 172.21.15.61:0/2234472926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c0cba80 0x7fd39c0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd39affd700 1 --2- 172.21.15.61:0/2234472926 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 0x7fd39c0c57d0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0d1b20 tx=0x7fd390009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff17a3e8d5b97426 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd399ffb700 1 -- 172.21.15.61:0/2234472926 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39000b820 con 0x7fd39c159c10 2023-12-24T20:03:24.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd399ffb700 1 -- 172.21.15.61:0/2234472926 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39000b980 con 0x7fd39c159c10 2023-12-24T20:03:24.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd399ffb700 1 -- 172.21.15.61:0/2234472926 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39000bd20 con 0x7fd39c159c10 2023-12-24T20:03:24.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd3a1736700 1 -- 172.21.15.61:0/2234472926 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 msgr2=0x7fd39c0c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:24.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd3a1736700 1 --2- 172.21.15.61:0/2234472926 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 0x7fd39c0c57d0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0d1b20 tx=0x7fd390009250 comp rx=0 tx=0).stop 2023-12-24T20:03:24.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.984+0000 7fd3a1736700 1 -- 172.21.15.61:0/2234472926 shutdown_connections 2023-12-24T20:03:24.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.985+0000 7fd3a1736700 1 --2- 172.21.15.61:0/2234472926 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c0cba80 0x7fd39c0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:24.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.985+0000 7fd3a1736700 1 --2- 172.21.15.61:0/2234472926 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 0x7fd39c0c57d0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:24.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.985+0000 7fd3a1736700 1 --2- 172.21.15.61:0/2234472926 >> v2:172.21.15.133:3300/0 conn(0x7fd39c159fe0 0x7fd39c0c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:24.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.985+0000 7fd3a1736700 1 -- 172.21.15.61:0/2234472926 >> 172.21.15.61:0/2234472926 conn(0x7fd39c06e640 msgr2=0x7fd39c067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:24.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.985+0000 7fd3a1736700 1 -- 172.21.15.61:0/2234472926 shutdown_connections 2023-12-24T20:03:24.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.985+0000 7fd3a1736700 1 -- 172.21.15.61:0/2234472926 wait complete. 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.986+0000 7fd3a1736700 1 Processor -- start 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.986+0000 7fd3a1736700 1 -- start start 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd3a1736700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd39c0cba80 0x7fd39c0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd3a1736700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 0x7fd39c1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd3a1736700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c159fe0 0x7fd39c0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd3a1736700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0b47f0 con 0x7fd39c159c10 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd3a1736700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0b3e20 con 0x7fd39c0cba80 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd3a1736700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0b4f20 con 0x7fd39c159fe0 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39a7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 0x7fd39c1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39a7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 0x7fd39c1493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:53378/0 (socket says 172.21.15.61:53378) 2023-12-24T20:03:24.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39a7fc700 1 -- 172.21.15.61:0/4025780432 learned_addr learned my addr 172.21.15.61:0/4025780432 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39affd700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd39c0cba80 0x7fd39c0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39b7fe700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c159fe0 0x7fd39c0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39a7fc700 1 -- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c159fe0 msgr2=0x7fd39c0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39a7fc700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c159fe0 0x7fd39c0b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39a7fc700 1 -- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd39c0cba80 msgr2=0x7fd39c0b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39a7fc700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd39c0cba80 0x7fd39c0b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39a7fc700 1 -- 172.21.15.61:0/4025780432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900094f0 con 0x7fd39c159c10 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39affd700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd39c0cba80 0x7fd39c0b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd39a7fc700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 0x7fd39c1493b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c8b0 tx=0x7fd38c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd382ffd700 1 -- 172.21.15.61:0/4025780432 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c011600 con 0x7fd39c159c10 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd382ffd700 1 -- 172.21.15.61:0/4025780432 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c011760 con 0x7fd39c159c10 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd3a1736700 1 -- 172.21.15.61:0/4025780432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c0b5200 con 0x7fd39c159c10 2023-12-24T20:03:24.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.987+0000 7fd382ffd700 1 -- 172.21.15.61:0/4025780432 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c011b20 con 0x7fd39c159c10 2023-12-24T20:03:24.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.988+0000 7fd3a1736700 1 -- 172.21.15.61:0/4025780432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c0b3ab0 con 0x7fd39c159c10 2023-12-24T20:03:24.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.989+0000 7fd3a1736700 1 -- 172.21.15.61:0/4025780432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c0890b0 con 0x7fd39c159c10 2023-12-24T20:03:24.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.989+0000 7fd382ffd700 1 -- 172.21.15.61:0/4025780432 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd38c00a3e0 con 0x7fd39c159c10 2023-12-24T20:03:24.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.989+0000 7fd382ffd700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd388066f30 0x7fd3880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:24.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.989+0000 7fd382ffd700 1 -- 172.21.15.61:0/4025780432 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd38c0845b0 con 0x7fd39c159c10 2023-12-24T20:03:24.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.989+0000 7fd382ffd700 1 -- 172.21.15.61:0/4025780432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=139}) v3 -- 0x7fd38806ea50 con 0x7fd39c159c10 2023-12-24T20:03:24.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.989+0000 7fd39affd700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd388066f30 0x7fd3880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:24.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.990+0000 7fd39affd700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd388066f30 0x7fd3880693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0d1b20 tx=0x7fd390017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:24.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:24.994+0000 7fd382ffd700 1 -- 172.21.15.61:0/4025780432 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd38c051820 con 0x7fd39c159c10 2023-12-24T20:03:25.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.190+0000 7fd3a1736700 1 -- 172.21.15.61:0/4025780432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd39c04c3c0 con 0x7fd39c159c10 2023-12-24T20:03:25.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.191+0000 7fd382ffd700 1 -- 172.21.15.61:0/4025780432 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+32301 (secure 0 0 0) 0x7fd38c01f090 con 0x7fd39c159c10 2023-12-24T20:03:25.192 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:25.192 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:25.192 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 138, 2023-12-24T20:03:25.192 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:03:25.192 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:03:25.192 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:03:13.565176+0000", 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:03:25.193 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 17, 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:25.194 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:03:25.195 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:25.196 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:25.197 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:25.198 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 16, 2023-12-24T20:03:25.199 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:53.096572+0000", 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:03:25.200 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "135", 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:25.201 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:25.202 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:25.203 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.204 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 17, 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:54.304286+0000", 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1027, 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:25.205 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:25.206 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "138", 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:25.207 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.208 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:03:25.209 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:25.210 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:03:25.211 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.212 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.213 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.214 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:25.215 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.216 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.217 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.218 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:03:25.219 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:03:25.220 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:25.221 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.222 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:03:25.223 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:25.224 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.225 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:25.226 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:25.227 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.228 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.229 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.230 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.232 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.232 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:03:25.232 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:25.232 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.232 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.233 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:25.234 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:25.234 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:25.234 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:25.234 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:25.234 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:25.234 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:25.234 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:25.234 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:25.234 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.235 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.236 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.237 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.238 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:25.239 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:25.240 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:25.240 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:25.240 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:25.240 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:25.240 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:25.240 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:25.240 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:25.240 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:25.240 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:25.240 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:25.241 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.242 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.243 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:25.244 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.244 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.244 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.244 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:03:25.244 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:25.244 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.244 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.244 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.245 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:03:25.245 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:25.246 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.246 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.246 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.246 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:03:25.246 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:03:25.246 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:03:25.246 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:03:25.246 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:25.247 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:03:25.248 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:03:25.249 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:03:25.250 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:25.251 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:25.252 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.253 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.254 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.255 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:25.256 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:03:25.257 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:25.258 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:03:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:25.260 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.261 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:25.262 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:03:25.263 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:25.264 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:25.265 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:25.266 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:25.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 -- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd388066f30 msgr2=0x7fd3880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:25.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd388066f30 0x7fd3880693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0d1b20 tx=0x7fd390017000 comp rx=0 tx=0).stop 2023-12-24T20:03:25.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 -- 172.21.15.61:0/4025780432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 msgr2=0x7fd39c1493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:25.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 0x7fd39c1493b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c8b0 tx=0x7fd38c008040 comp rx=0 tx=0).stop 2023-12-24T20:03:25.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 -- 172.21.15.61:0/4025780432 shutdown_connections 2023-12-24T20:03:25.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd39c159fe0 0x7fd39c0b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:25.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd388066f30 0x7fd3880693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:25.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd39c0cba80 0x7fd39c0b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:25.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 --2- 172.21.15.61:0/4025780432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd39c159c10 0x7fd39c1493b0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:25.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 -- 172.21.15.61:0/4025780432 >> 172.21.15.61:0/4025780432 conn(0x7fd39c06e640 msgr2=0x7fd39c1576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:25.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 -- 172.21.15.61:0/4025780432 shutdown_connections 2023-12-24T20:03:25.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:25.193+0000 7fd3a1736700 1 -- 172.21.15.61:0/4025780432 wait complete. 2023-12-24T20:03:25.270 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:03:30.270 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:03:30.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.406+0000 7f41fb464700 1 Processor -- start 2023-12-24T20:03:30.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.406+0000 7f41fb464700 1 -- start start 2023-12-24T20:03:30.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.407+0000 7f41fb464700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41f4157780 0x7f41f406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.407+0000 7f41fb464700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f41f406c840 0x7f41f415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.407+0000 7f41fb464700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f40ca6f0 con 0x7f41f40ca270 2023-12-24T20:03:30.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.407+0000 7f41fb464700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f40ca9d0 con 0x7f41f406c840 2023-12-24T20:03:30.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.407+0000 7f41fb464700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40cacb0 con 0x7f41f4157780 2023-12-24T20:03:30.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.407+0000 7f41f9a01700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f41f406c840 0x7f41f415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.407+0000 7f41f9a01700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f41f406c840 0x7f41f415ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47408/0 (socket says 172.21.15.61:47408) 2023-12-24T20:03:30.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.407+0000 7f41f9a01700 1 -- 172.21.15.61:0/2744846330 learned_addr learned my addr 172.21.15.61:0/2744846330 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:30.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.408+0000 7f41f9200700 1 --2- 172.21.15.61:0/2744846330 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41f4157780 0x7f41f406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.408+0000 7f41f9a01700 1 -- 172.21.15.61:0/2744846330 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41f4157780 msgr2=0x7f41f406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:30.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.408+0000 7f41f9a01700 1 --2- 172.21.15.61:0/2744846330 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41f4157780 0x7f41f406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.408+0000 7f41f9a01700 1 -- 172.21.15.61:0/2744846330 >> v1:172.21.15.133:6789/0 conn(0x7f41f40ca270 legacy=0x7f41f40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:30.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.408+0000 7f41f9a01700 1 -- 172.21.15.61:0/2744846330 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f40caf90 con 0x7f41f406c840 2023-12-24T20:03:30.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.408+0000 7f41f9a01700 1 --2- 172.21.15.61:0/2744846330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 0x7f41f415ba80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009f20 tx=0x7f41ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f60fc1253080f57 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:30.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.408+0000 7f41ebfff700 1 -- 172.21.15.61:0/2744846330 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec00e070 con 0x7f41f406c840 2023-12-24T20:03:30.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.408+0000 7f41ebfff700 1 -- 172.21.15.61:0/2744846330 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec00b9d0 con 0x7f41f406c840 2023-12-24T20:03:30.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.408+0000 7f41ebfff700 1 -- 172.21.15.61:0/2744846330 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec0092e0 con 0x7f41f406c840 2023-12-24T20:03:30.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.409+0000 7f41fb464700 1 -- 172.21.15.61:0/2744846330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 msgr2=0x7f41f415ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:30.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.409+0000 7f41fb464700 1 --2- 172.21.15.61:0/2744846330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 0x7f41f415ba80 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009f20 tx=0x7f41ec009840 comp rx=0 tx=0).stop 2023-12-24T20:03:30.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.409+0000 7f41fb464700 1 -- 172.21.15.61:0/2744846330 shutdown_connections 2023-12-24T20:03:30.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.409+0000 7f41fb464700 1 --2- 172.21.15.61:0/2744846330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 0x7f41f415ba80 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.409+0000 7f41fb464700 1 --2- 172.21.15.61:0/2744846330 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41f4157780 0x7f41f406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.409+0000 7f41fb464700 1 -- 172.21.15.61:0/2744846330 >> 172.21.15.61:0/2744846330 conn(0x7f41f406b650 msgr2=0x7f41f40ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:30.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.409+0000 7f41fb464700 1 -- 172.21.15.61:0/2744846330 shutdown_connections 2023-12-24T20:03:30.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.409+0000 7f41fb464700 1 -- 172.21.15.61:0/2744846330 wait complete. 2023-12-24T20:03:30.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.410+0000 7f41fb464700 1 Processor -- start 2023-12-24T20:03:30.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.410+0000 7f41fb464700 1 -- start start 2023-12-24T20:03:30.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41fb464700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 0x7f41f41533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41fb464700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f4157780 0x7f41f41591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41fb464700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41f414d1f0 0x7f41f414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41fb464700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f414e980 con 0x7f41f406c840 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41fb464700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f4153980 con 0x7f41f4157780 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41fb464700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f415cf80 con 0x7f41f414d1f0 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f9200700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 0x7f41f41533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f9200700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 0x7f41f41533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47418/0 (socket says 172.21.15.61:47418) 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f9200700 1 -- 172.21.15.61:0/2719288210 learned_addr learned my addr 172.21.15.61:0/2719288210 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f9a01700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41f414d1f0 0x7f41f414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f89ff700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f4157780 0x7f41f41591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f9200700 1 -- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41f414d1f0 msgr2=0x7f41f414d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f9200700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41f414d1f0 0x7f41f414d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f9200700 1 -- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f4157780 msgr2=0x7f41f41591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f9200700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f4157780 0x7f41f41591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f9200700 1 -- 172.21.15.61:0/2719288210 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec009ae0 con 0x7f41f406c840 2023-12-24T20:03:30.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.411+0000 7f41f89ff700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f4157780 0x7f41f41591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:30.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.412+0000 7f41f9200700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 0x7f41f41533a0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f41f000e960 tx=0x7f41f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:30.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.412+0000 7f41e97fa700 1 -- 172.21.15.61:0/2719288210 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000c850 con 0x7f41f406c840 2023-12-24T20:03:30.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.412+0000 7f41e97fa700 1 -- 172.21.15.61:0/2719288210 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f000c9b0 con 0x7f41f406c840 2023-12-24T20:03:30.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.412+0000 7f41fb464700 1 -- 172.21.15.61:0/2719288210 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f415d220 con 0x7f41f406c840 2023-12-24T20:03:30.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.412+0000 7f41e97fa700 1 -- 172.21.15.61:0/2719288210 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000cd50 con 0x7f41f406c840 2023-12-24T20:03:30.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.412+0000 7f41fb464700 1 -- 172.21.15.61:0/2719288210 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f41596f0 con 0x7f41f406c840 2023-12-24T20:03:30.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.413+0000 7f41fb464700 1 -- 172.21.15.61:0/2719288210 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f404c3c0 con 0x7f41f406c840 2023-12-24T20:03:30.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.413+0000 7f41e97fa700 1 -- 172.21.15.61:0/2719288210 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f41f0013680 con 0x7f41f406c840 2023-12-24T20:03:30.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.414+0000 7f41e97fa700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41d8066f30 0x7f41d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.414+0000 7f41e97fa700 1 -- 172.21.15.61:0/2719288210 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41f0084760 con 0x7f41f406c840 2023-12-24T20:03:30.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.414+0000 7f41f89ff700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41d8066f30 0x7f41d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.414+0000 7f41f89ff700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41d8066f30 0x7f41d80693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f41f4152d70 tx=0x7f41e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:30.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.418+0000 7f41e97fa700 1 -- 172.21.15.61:0/2719288210 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41f00519d0 con 0x7f41f406c840 2023-12-24T20:03:30.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.613+0000 7f41fb464700 1 -- 172.21.15.61:0/2719288210 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f41f415b560 con 0x7f41f406c840 2023-12-24T20:03:30.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.614+0000 7f41e97fa700 1 -- 172.21.15.61:0/2719288210 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f41f0054ff0 con 0x7f41f406c840 2023-12-24T20:03:30.616 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:30.616 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:30.616 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 139, 2023-12-24T20:03:30.616 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:03:30.616 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:03:30.616 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:03:28.568537+0000", 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:03:30.617 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 17, 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:30.618 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:03:30.619 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:30.620 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:30.621 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:30.622 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 16, 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:53.096572+0000", 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:30.623 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:03:30.624 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "135", 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:30.625 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:30.626 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:30.627 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.628 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 17, 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:54.304286+0000", 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:30.629 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:30.630 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "139", 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:30.631 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.632 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.633 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:30.634 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.635 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:03:30.636 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:30.637 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.637 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.637 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.637 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:30.637 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.638 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.638 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.638 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:03:30.639 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:30.639 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.639 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.639 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.639 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:03:30.639 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:30.639 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.639 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.639 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.640 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:30.640 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.640 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.640 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.640 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:03:30.640 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:30.640 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.640 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:30.641 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:30.642 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.643 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:30.644 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.644 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.644 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.644 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:03:30.644 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:30.644 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.644 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.644 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.644 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:03:30.645 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:03:30.646 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:30.647 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:30.648 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:30.648 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:30.648 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:30.648 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:30.648 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:30.648 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:30.648 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:30.648 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:30.648 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:30.648 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.649 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.650 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.651 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.652 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:30.653 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:30.654 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.655 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.656 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.657 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.658 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.659 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:30.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:30.661 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.662 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.663 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.664 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.665 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:30.666 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.667 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:03:30.668 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:30.669 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.670 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.671 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.672 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.673 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.674 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.675 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.676 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:03:30.677 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:30.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:30.679 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:30.680 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:30.681 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:03:30.682 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:30.683 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.684 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:03:30.685 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:03:30.686 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:03:30.687 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:03:30.687 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:03:30.687 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:03:30.687 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:03:30.687 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:03:30.687 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:03:30.687 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:30.687 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:30.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 -- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41d8066f30 msgr2=0x7f41d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41d8066f30 0x7f41d80693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f41f4152d70 tx=0x7f41e4009040 comp rx=0 tx=0).stop 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 -- 172.21.15.61:0/2719288210 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 msgr2=0x7f41f41533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 0x7f41f41533a0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f41f000e960 tx=0x7f41f00091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 -- 172.21.15.61:0/2719288210 shutdown_connections 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41f414d1f0 0x7f41f414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41d8066f30 0x7f41d80693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41f406c840 0x7f41f41533a0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 --2- 172.21.15.61:0/2719288210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41f4157780 0x7f41f41591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 -- 172.21.15.61:0/2719288210 >> 172.21.15.61:0/2719288210 conn(0x7f41f406b650 msgr2=0x7f41f40b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 -- 172.21.15.61:0/2719288210 shutdown_connections 2023-12-24T20:03:30.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.616+0000 7f41fb464700 1 -- 172.21.15.61:0/2719288210 wait complete. 2023-12-24T20:03:30.690 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-24T20:03:30.690 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:03:30.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.810+0000 7f94d6589700 1 Processor -- start 2023-12-24T20:03:30.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.810+0000 7f94d6589700 1 -- start start 2023-12-24T20:03:30.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.811+0000 7f94d6589700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94d0068140 0x7f94d00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.811+0000 7f94d6589700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f94d0068510 0x7f94d00b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.811+0000 7f94d6589700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d00b2890 con 0x7f94d0159a60 2023-12-24T20:03:30.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.811+0000 7f94d6589700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d00b11e0 con 0x7f94d0068510 2023-12-24T20:03:30.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.811+0000 7f94d6589700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d00cf630 con 0x7f94d0068140 2023-12-24T20:03:30.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.811+0000 7f94cf7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f94d0068510 0x7f94d00b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.811+0000 7f94cf7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f94d0068510 0x7f94d00b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47426/0 (socket says 172.21.15.61:47426) 2023-12-24T20:03:30.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.811+0000 7f94cf7fe700 1 -- 172.21.15.61:0/4101287752 learned_addr learned my addr 172.21.15.61:0/4101287752 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:30.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94cffff700 1 --2- 172.21.15.61:0/4101287752 >> v2:172.21.15.133:3300/0 conn(0x7f94d0068140 0x7f94d00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94cf7fe700 1 -- 172.21.15.61:0/4101287752 >> v2:172.21.15.133:3300/0 conn(0x7f94d0068140 msgr2=0x7f94d00cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94cf7fe700 1 --2- 172.21.15.61:0/4101287752 >> v2:172.21.15.133:3300/0 conn(0x7f94d0068140 0x7f94d00cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94cf7fe700 1 -- 172.21.15.61:0/4101287752 >> v1:172.21.15.133:6789/0 conn(0x7f94d0159a60 legacy=0x7f94d0159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94cf7fe700 1 -- 172.21.15.61:0/4101287752 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d00b2240 con 0x7f94d0068510 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94cf7fe700 1 --2- 172.21.15.61:0/4101287752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 0x7f94d00b0ca0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f94d006e290 tx=0x7f94c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41da9671642c99cf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94ceffd700 1 -- 172.21.15.61:0/4101287752 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000b860 con 0x7f94d0068510 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94ceffd700 1 -- 172.21.15.61:0/4101287752 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c000b9c0 con 0x7f94d0068510 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94ceffd700 1 -- 172.21.15.61:0/4101287752 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000bd60 con 0x7f94d0068510 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94d6589700 1 -- 172.21.15.61:0/4101287752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 msgr2=0x7f94d00b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.812+0000 7f94d6589700 1 --2- 172.21.15.61:0/4101287752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 0x7f94d00b0ca0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f94d006e290 tx=0x7f94c0009250 comp rx=0 tx=0).stop 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.813+0000 7f94d6589700 1 -- 172.21.15.61:0/4101287752 shutdown_connections 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.813+0000 7f94d6589700 1 --2- 172.21.15.61:0/4101287752 >> v2:172.21.15.133:3300/0 conn(0x7f94d0068140 0x7f94d00cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.813+0000 7f94d6589700 1 --2- 172.21.15.61:0/4101287752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 0x7f94d00b0ca0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.813+0000 7f94d6589700 1 -- 172.21.15.61:0/4101287752 >> 172.21.15.61:0/4101287752 conn(0x7f94d0097a10 msgr2=0x7f94d00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.813+0000 7f94d6589700 1 -- 172.21.15.61:0/4101287752 shutdown_connections 2023-12-24T20:03:30.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.813+0000 7f94d6589700 1 -- 172.21.15.61:0/4101287752 wait complete. 2023-12-24T20:03:30.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.814+0000 7f94d6589700 1 Processor -- start 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.814+0000 7f94d6589700 1 -- start start 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94d6589700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94d0068140 0x7f94d016a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94d6589700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 0x7f94d006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94d6589700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94d0159a60 0x7f94d016d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94d6589700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0099780 con 0x7f94d0068510 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94d6589700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d0099d40 con 0x7f94d0159a60 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94d6589700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d016e120 con 0x7f94d0068140 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94cf7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 0x7f94d006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94cf7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 0x7f94d006b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47442/0 (socket says 172.21.15.61:47442) 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94cf7fe700 1 -- 172.21.15.61:0/3446638650 learned_addr learned my addr 172.21.15.61:0/3446638650 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94cffff700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94d0068140 0x7f94d016a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94d4b26700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94d0159a60 0x7f94d016d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94cf7fe700 1 -- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94d0068140 msgr2=0x7f94d016a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94cf7fe700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94d0068140 0x7f94d016a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94cf7fe700 1 -- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94d0159a60 msgr2=0x7f94d016d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:30.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94cf7fe700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94d0159a60 0x7f94d016d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:30.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94cf7fe700 1 -- 172.21.15.61:0/3446638650 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00094f0 con 0x7f94d0068510 2023-12-24T20:03:30.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94cf7fe700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 0x7f94d006b020 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f94d006d8b0 tx=0x7f94c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:30.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94c7fff700 1 -- 172.21.15.61:0/3446638650 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0024440 con 0x7f94d0068510 2023-12-24T20:03:30.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94c7fff700 1 -- 172.21.15.61:0/3446638650 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c00245a0 con 0x7f94d0068510 2023-12-24T20:03:30.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.815+0000 7f94c7fff700 1 -- 172.21.15.61:0/3446638650 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c0024960 con 0x7f94d0068510 2023-12-24T20:03:30.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.816+0000 7f94d6589700 1 -- 172.21.15.61:0/3446638650 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d016e400 con 0x7f94d0068510 2023-12-24T20:03:30.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.816+0000 7f94d6589700 1 -- 172.21.15.61:0/3446638650 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d015a870 con 0x7f94d0068510 2023-12-24T20:03:30.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.816+0000 7f94d6589700 1 -- 172.21.15.61:0/3446638650 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d006d440 con 0x7f94d0068510 2023-12-24T20:03:30.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.817+0000 7f94c7fff700 1 -- 172.21.15.61:0/3446638650 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f94c001a420 con 0x7f94d0068510 2023-12-24T20:03:30.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.817+0000 7f94c7fff700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f94b0066f30 0x7f94b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:30.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.817+0000 7f94c7fff700 1 -- 172.21.15.61:0/3446638650 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94c0086430 con 0x7f94d0068510 2023-12-24T20:03:30.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.818+0000 7f94cffff700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f94b0066f30 0x7f94b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:30.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.818+0000 7f94cffff700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f94b0066f30 0x7f94b00693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f94b8006aa0 tx=0x7f94b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:30.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:30.822+0000 7f94c7fff700 1 -- 172.21.15.61:0/3446638650 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94c0053720 con 0x7f94d0068510 2023-12-24T20:03:31.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.019+0000 7f94d6589700 1 -- 172.21.15.61:0/3446638650 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f94d0099eb0 con 0x7f94d0068510 2023-12-24T20:03:31.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.020+0000 7f94c7fff700 1 -- 172.21.15.61:0/3446638650 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f94c0056d40 con 0x7f94d0068510 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 139, 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:03:28.568537+0000", 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:03:31.022 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 17, 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:03:31.023 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:31.024 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:31.025 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:31.026 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:31.027 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:03:31.028 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 16, 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:53.096572+0000", 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:31.029 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:31.030 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "135", 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:31.031 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:31.032 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:03:31.033 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 17, 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:03:31.034 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:02:54.304286+0000", 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:03:31.035 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "139", 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:03:31.036 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:03:31.037 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:03:31.038 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:03:31.039 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:31.040 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:31.041 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.042 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.044 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:31.045 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.046 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.047 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.048 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.049 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.050 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.051 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.052 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:03:31.053 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:31.054 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:31.055 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:31.056 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.057 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.058 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:31.059 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:03:31.060 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:31.061 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.062 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:03:31.063 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:31.064 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.065 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:31.066 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:31.067 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.068 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.069 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.070 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.071 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.072 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.073 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:03:31.074 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:31.075 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.076 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 134, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:03:31.077 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.078 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.079 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:03:31.080 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:03:31.081 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:03:31.082 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:31.083 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:31.084 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:31.085 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.086 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:03:31.087 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:03:31.088 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:03:31.089 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:03:31.089 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:03:31.089 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:03:31.089 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:03:31.089 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:03:31.089 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:31.089 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:31.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 -- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f94b0066f30 msgr2=0x7f94b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f94b0066f30 0x7f94b00693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f94b8006aa0 tx=0x7f94b8008040 comp rx=0 tx=0).stop 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 -- 172.21.15.61:0/3446638650 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 msgr2=0x7f94d006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 0x7f94d006b020 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f94d006d8b0 tx=0x7f94c0017000 comp rx=0 tx=0).stop 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 -- 172.21.15.61:0/3446638650 shutdown_connections 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f94d0068140 0x7f94d016a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f94b0066f30 0x7f94b00693e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94d0159a60 0x7f94d016d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 --2- 172.21.15.61:0/3446638650 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f94d0068510 0x7f94d006b020 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 -- 172.21.15.61:0/3446638650 >> 172.21.15.61:0/3446638650 conn(0x7f94d0097a10 msgr2=0x7f94d00a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 -- 172.21.15.61:0/3446638650 shutdown_connections 2023-12-24T20:03:31.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.022+0000 7f94d6589700 1 -- 172.21.15.61:0/3446638650 wait complete. 2023-12-24T20:03:31.092 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:31.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.213+0000 7f7fc3757700 1 Processor -- start 2023-12-24T20:03:31.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.213+0000 7f7fc3757700 1 -- start start 2023-12-24T20:03:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc3757700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7fbc0b08f0 0x7f7fbc0b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc3757700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc0b2eb0 con 0x7f7fbc0b2660 2023-12-24T20:03:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc3757700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fbc0b2bd0 con 0x7f7fbc15bb60 2023-12-24T20:03:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc3757700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fbc0afc20 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc1cf4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7fbc0b08f0 0x7f7fbc0b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc0cf2700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7fbc0b2660 0x7f7fbc15bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38382/0 (socket says 172.21.15.61:38382) 2023-12-24T20:03:31.215 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc0cf2700 1 -- 172.21.15.61:0/4277864476 learned_addr learned my addr 172.21.15.61:0/4277864476 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc1cf4700 1 -- 172.21.15.61:0/4277864476 >> v1:172.21.15.133:6789/0 conn(0x7f7fbc15bb60 legacy=0x7f7fbc098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc1cf4700 1 -- 172.21.15.61:0/4277864476 >> v1:172.21.15.61:6789/0 conn(0x7f7fbc0b2660 legacy=0x7f7fbc15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc1cf4700 1 -- 172.21.15.61:0/4277864476 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0afe10 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fb3fff700 1 -- 172.21.15.61:0/4277864476 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261347599 0 0) 0x7f7fbc0b2eb0 con 0x7f7fbc0b2660 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fc1cf4700 1 --2- 172.21.15.61:0/4277864476 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 0x7f7fbc0b0d70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009e60 tx=0x7f7fb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4390fee8bab5f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fb3fff700 1 -- 172.21.15.61:0/4277864476 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400e070 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fb3fff700 1 -- 172.21.15.61:0/4277864476 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb400bc80 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.214+0000 7f7fb3fff700 1 -- 172.21.15.61:0/4277864476 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4012430 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.215+0000 7f7fc3757700 1 -- 172.21.15.61:0/4277864476 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 msgr2=0x7f7fbc0b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.215+0000 7f7fc3757700 1 --2- 172.21.15.61:0/4277864476 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 0x7f7fbc0b0d70 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009e60 tx=0x7f7fb4009780 comp rx=0 tx=0).stop 2023-12-24T20:03:31.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.215+0000 7f7fc3757700 1 -- 172.21.15.61:0/4277864476 shutdown_connections 2023-12-24T20:03:31.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.215+0000 7f7fc3757700 1 --2- 172.21.15.61:0/4277864476 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 0x7f7fbc0b0d70 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.215+0000 7f7fc3757700 1 -- 172.21.15.61:0/4277864476 >> 172.21.15.61:0/4277864476 conn(0x7f7fbc097a10 msgr2=0x7f7fbc0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:31.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.215+0000 7f7fc3757700 1 -- 172.21.15.61:0/4277864476 shutdown_connections 2023-12-24T20:03:31.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.215+0000 7f7fc3757700 1 -- 172.21.15.61:0/4277864476 wait complete. 2023-12-24T20:03:31.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.217+0000 7f7fc3757700 1 Processor -- start 2023-12-24T20:03:31.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.217+0000 7f7fc3757700 1 -- start start 2023-12-24T20:03:31.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc3757700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 0x7f7fbc167460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:31.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc3757700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fbc0b2660 0x7f7fbc0ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:31.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc3757700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fbc15bb60 0x7f7fbc0ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:31.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc3757700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0ad7c0 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc3757700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0acc50 con 0x7f7fbc15bb60 2023-12-24T20:03:31.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc3757700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc0ac040 con 0x7f7fbc0b2660 2023-12-24T20:03:31.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc14f3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 0x7f7fbc167460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc14f3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 0x7f7fbc167460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47452/0 (socket says 172.21.15.61:47452) 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc14f3700 1 -- 172.21.15.61:0/918803081 learned_addr learned my addr 172.21.15.61:0/918803081 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc1cf4700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fbc15bb60 0x7f7fbc0ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc14f3700 1 -- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fbc0b2660 msgr2=0x7f7fbc0ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc0cf2700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fbc0b2660 0x7f7fbc0ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc14f3700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fbc0b2660 0x7f7fbc0ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc14f3700 1 -- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fbc15bb60 msgr2=0x7f7fbc0ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc14f3700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fbc15bb60 0x7f7fbc0ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc14f3700 1 -- 172.21.15.61:0/918803081 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4009a20 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc1cf4700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fbc15bb60 0x7f7fbc0ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc0cf2700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fbc0b2660 0x7f7fbc0ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.218+0000 7f7fc14f3700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 0x7f7fbc167460 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800b5e0 tx=0x7f7fb80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.219+0000 7f7fb17fa700 1 -- 172.21.15.61:0/918803081 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800f510 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.219+0000 7f7fb17fa700 1 -- 172.21.15.61:0/918803081 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb800f690 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.219+0000 7f7fc3757700 1 -- 172.21.15.61:0/918803081 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc0ac320 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.219+0000 7f7fb17fa700 1 -- 172.21.15.61:0/918803081 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800fa50 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.219+0000 7f7fc3757700 1 -- 172.21.15.61:0/918803081 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc0ac8e0 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.220+0000 7f7fc3757700 1 -- 172.21.15.61:0/918803081 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fbc06d440 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.220+0000 7f7fb17fa700 1 -- 172.21.15.61:0/918803081 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7fb801a400 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.220+0000 7f7fb17fa700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7fa0066f30 0x7f7fa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:31.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.220+0000 7f7fb17fa700 1 -- 172.21.15.61:0/918803081 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7fb8084070 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.221+0000 7f7fc0cf2700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7fa0066f30 0x7f7fa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:31.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.221+0000 7f7fc0cf2700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7fa0066f30 0x7f7fa00693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0ce7b0 tx=0x7f7fac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:31.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.225+0000 7f7fb17fa700 1 -- 172.21.15.61:0/918803081 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fb80512e0 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.464+0000 7f7fc3757700 1 -- 172.21.15.61:0/918803081 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fbc04c3c0 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.465+0000 7f7fb17fa700 1 -- 172.21.15.61:0/918803081 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f7fb8054900 con 0x7f7fbc0b08f0 2023-12-24T20:03:31.466 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:31.466 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3245805399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3245805399},{"type":"v1","addr":"172.21.15.133:6837","nonce":3245805399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/4168448475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":4168448475},{"type":"v1","addr":"172.21.15.61:6835","nonce":4168448475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1817856586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1817856586},{"type":"v1","addr":"172.21.15.61:6834","nonce":1817856586}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:55.325289+0000","modified":"2023-12-24T20:02:58.932577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7089},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7089":{"gid":7089,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2704897796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2704897796},{"type":"v1","addr":"172.21.15.133:6836","nonce":2704897796}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T20:03:31.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 -- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7fa0066f30 msgr2=0x7f7fa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:31.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7fa0066f30 0x7f7fa00693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc0ce7b0 tx=0x7f7fac009040 comp rx=0 tx=0).stop 2023-12-24T20:03:31.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 -- 172.21.15.61:0/918803081 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 msgr2=0x7f7fbc167460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:31.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 0x7f7fbc167460 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800b5e0 tx=0x7f7fb80090f0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 -- 172.21.15.61:0/918803081 shutdown_connections 2023-12-24T20:03:31.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7fa0066f30 0x7f7fa00693e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fbc15bb60 0x7f7fbc0ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7fbc0b08f0 0x7f7fbc167460 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 --2- 172.21.15.61:0/918803081 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7fbc0b2660 0x7f7fbc0ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:31.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 -- 172.21.15.61:0/918803081 >> 172.21.15.61:0/918803081 conn(0x7f7fbc097a10 msgr2=0x7f7fbc098cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:31.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 -- 172.21.15.61:0/918803081 shutdown_connections 2023-12-24T20:03:31.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:31.467+0000 7f7fc3757700 1 -- 172.21.15.61:0/918803081 wait complete. 2023-12-24T20:03:31.469 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 69 2023-12-24T20:03:31.481 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-24T20:03:31.629 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":7089,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":35.709302483000002,"mdsmap_epoch":69,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":40.728595693000003} 2023-12-24T20:03:31.629 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 7089, "mdsmap_epoch": 69, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 35.709302483, "state": "up:active", "uptime": 40.728595693, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:03:31.630 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-24T20:03:31.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:31.630 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-24T20:03:31.947 INFO:teuthology.orchestra.run.smithi061.stderr:50+0 records in 2023-12-24T20:03:31.947 INFO:teuthology.orchestra.run.smithi061.stderr:50+0 records out 2023-12-24T20:03:31.947 INFO:teuthology.orchestra.run.smithi061.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.295607 s, 177 MB/s 2023-12-24T20:03:31.948 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:03:31.948 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:03:31.992 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:03:32.034 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:03:32.034 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T20:03:32.035 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:03:32.035 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:32.075 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[67036]: fuse finished with error 0 and tester_r 0 2023-12-24T20:03:32.081 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:03:32.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:32.081 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:03:32.249 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T20:03:32.249 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:03:32.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:32.282 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[47132]: fuse finished with error 0 and tester_r 0 2023-12-24T20:03:32.284 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:03:32.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:32.284 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T20:03:32.341 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:03:32.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:32.342 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T20:03:32.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:03:32.359 INFO:teuthology.orchestra.run.smithi061.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-24T20:03:32.360 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:03:32.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:32.360 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T20:03:32.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:03:32.398 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-24T20:03:32.399 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:32.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.521+0000 7f2335a35700 1 Processor -- start 2023-12-24T20:03:32.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.521+0000 7f2335a35700 1 -- start start 2023-12-24T20:03:32.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.521+0000 7f2335a35700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f23301599e0 0x7f233015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.521+0000 7f2335a35700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23300cbac0 0x7f23300cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.521+0000 7f2335a35700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23300cc2a0 con 0x7f23300cd9b0 2023-12-24T20:03:32.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.521+0000 7f2335a35700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23300cedc0 con 0x7f23301599e0 2023-12-24T20:03:32.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.521+0000 7f2335a35700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2330067f60 con 0x7f23300cbac0 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f23301599e0 0x7f233015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f23301599e0 0x7f233015ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47454/0 (socket says 172.21.15.61:47454) 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232effd700 1 -- 172.21.15.61:0/2789243230 learned_addr learned my addr 172.21.15.61:0/2789243230 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232e7fc700 1 --2- 172.21.15.61:0/2789243230 >> v2:172.21.15.133:3300/0 conn(0x7f23300cbac0 0x7f23300cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232effd700 1 -- 172.21.15.61:0/2789243230 >> v2:172.21.15.133:3300/0 conn(0x7f23300cbac0 msgr2=0x7f23300cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232effd700 1 --2- 172.21.15.61:0/2789243230 >> v2:172.21.15.133:3300/0 conn(0x7f23300cbac0 0x7f23300cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232effd700 1 -- 172.21.15.61:0/2789243230 >> v1:172.21.15.133:6789/0 conn(0x7f23300cd9b0 legacy=0x7f233015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232effd700 1 -- 172.21.15.61:0/2789243230 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233015b040 con 0x7f23301599e0 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232effd700 1 --2- 172.21.15.61:0/2789243230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 0x7f233015ab00 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f23300b05b0 tx=0x7f2320009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d517053de059a8fd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232dffb700 1 -- 172.21.15.61:0/2789243230 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232000b820 con 0x7f23301599e0 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232dffb700 1 -- 172.21.15.61:0/2789243230 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232000b980 con 0x7f23301599e0 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.522+0000 7f232dffb700 1 -- 172.21.15.61:0/2789243230 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232000bd20 con 0x7f23301599e0 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.523+0000 7f2335a35700 1 -- 172.21.15.61:0/2789243230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 msgr2=0x7f233015ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:32.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.523+0000 7f2335a35700 1 --2- 172.21.15.61:0/2789243230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 0x7f233015ab00 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f23300b05b0 tx=0x7f2320009250 comp rx=0 tx=0).stop 2023-12-24T20:03:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.523+0000 7f2335a35700 1 -- 172.21.15.61:0/2789243230 shutdown_connections 2023-12-24T20:03:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.523+0000 7f2335a35700 1 --2- 172.21.15.61:0/2789243230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 0x7f233015ab00 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.523+0000 7f2335a35700 1 --2- 172.21.15.61:0/2789243230 >> v2:172.21.15.133:3300/0 conn(0x7f23300cbac0 0x7f23300cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.523+0000 7f2335a35700 1 -- 172.21.15.61:0/2789243230 >> 172.21.15.61:0/2789243230 conn(0x7f233006e640 msgr2=0x7f2330067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.523+0000 7f2335a35700 1 -- 172.21.15.61:0/2789243230 shutdown_connections 2023-12-24T20:03:32.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.523+0000 7f2335a35700 1 -- 172.21.15.61:0/2789243230 wait complete. 2023-12-24T20:03:32.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.524+0000 7f2335a35700 1 Processor -- start 2023-12-24T20:03:32.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.524+0000 7f2335a35700 1 -- start start 2023-12-24T20:03:32.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f2335a35700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23300cbac0 0x7f2330157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f2335a35700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23300cd9b0 0x7f233016a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f2335a35700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 0x7f23300b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f2335a35700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23300c9c70 con 0x7f23301599e0 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f2335a35700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23301560e0 con 0x7f23300cbac0 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f2335a35700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23300c9990 con 0x7f23300cd9b0 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f232f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 0x7f23300b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f232effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23300cbac0 0x7f2330157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f232f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 0x7f23300b5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47466/0 (socket says 172.21.15.61:47466) 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f232f7fe700 1 -- 172.21.15.61:0/322950059 learned_addr learned my addr 172.21.15.61:0/322950059 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f232e7fc700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23300cd9b0 0x7f233016a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f232f7fe700 1 -- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23300cd9b0 msgr2=0x7f233016a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f232f7fe700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23300cd9b0 0x7f233016a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f232f7fe700 1 -- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23300cbac0 msgr2=0x7f2330157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f232f7fe700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23300cbac0 0x7f2330157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.525+0000 7f232f7fe700 1 -- 172.21.15.61:0/322950059 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200094f0 con 0x7f23301599e0 2023-12-24T20:03:32.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.526+0000 7f232f7fe700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 0x7f23300b5d70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f232800bc60 tx=0x7f2328009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:32.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.526+0000 7f2316ffd700 1 -- 172.21.15.61:0/322950059 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232800c840 con 0x7f23301599e0 2023-12-24T20:03:32.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.526+0000 7f2316ffd700 1 -- 172.21.15.61:0/322950059 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232800c9a0 con 0x7f23301599e0 2023-12-24T20:03:32.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.526+0000 7f2335a35700 1 -- 172.21.15.61:0/322950059 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2330155a90 con 0x7f23301599e0 2023-12-24T20:03:32.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.526+0000 7f2316ffd700 1 -- 172.21.15.61:0/322950059 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232800cda0 con 0x7f23301599e0 2023-12-24T20:03:32.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.526+0000 7f2335a35700 1 -- 172.21.15.61:0/322950059 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2330158430 con 0x7f23301599e0 2023-12-24T20:03:32.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.527+0000 7f2335a35700 1 -- 172.21.15.61:0/322950059 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233004c3c0 con 0x7f23301599e0 2023-12-24T20:03:32.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.527+0000 7f2316ffd700 1 -- 172.21.15.61:0/322950059 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2328014620 con 0x7f23301599e0 2023-12-24T20:03:32.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.528+0000 7f2316ffd700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f231c066f30 0x7f231c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.528+0000 7f2316ffd700 1 -- 172.21.15.61:0/322950059 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2328084480 con 0x7f23301599e0 2023-12-24T20:03:32.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.528+0000 7f232effd700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f231c066f30 0x7f231c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.528+0000 7f232effd700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f231c066f30 0x7f231c0693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f23300b05b0 tx=0x7f2320016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:32.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.532+0000 7f2316ffd700 1 -- 172.21.15.61:0/322950059 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23280516f0 con 0x7f23301599e0 2023-12-24T20:03:32.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.770+0000 7f2335a35700 1 -- 172.21.15.61:0/322950059 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2330156220 con 0x7f23301599e0 2023-12-24T20:03:32.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.771+0000 7f2316ffd700 1 -- 172.21.15.61:0/322950059 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f2328054d10 con 0x7f23301599e0 2023-12-24T20:03:32.772 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:32.773 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3245805399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3245805399},{"type":"v1","addr":"172.21.15.133:6837","nonce":3245805399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/4168448475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":4168448475},{"type":"v1","addr":"172.21.15.61:6835","nonce":4168448475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1817856586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1817856586},{"type":"v1","addr":"172.21.15.61:6834","nonce":1817856586}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:55.325289+0000","modified":"2023-12-24T20:02:58.932577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7089},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7089":{"gid":7089,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2704897796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2704897796},{"type":"v1","addr":"172.21.15.133:6836","nonce":2704897796}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T20:03:32.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 -- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f231c066f30 msgr2=0x7f231c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:32.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f231c066f30 0x7f231c0693e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f23300b05b0 tx=0x7f2320016000 comp rx=0 tx=0).stop 2023-12-24T20:03:32.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 -- 172.21.15.61:0/322950059 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 msgr2=0x7f23300b5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:32.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 0x7f23300b5d70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f232800bc60 tx=0x7f2328009820 comp rx=0 tx=0).stop 2023-12-24T20:03:32.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 -- 172.21.15.61:0/322950059 shutdown_connections 2023-12-24T20:03:32.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f231c066f30 0x7f231c0693e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f23301599e0 0x7f23300b5d70 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23300cbac0 0x7f2330157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 --2- 172.21.15.61:0/322950059 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f23300cd9b0 0x7f233016a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 -- 172.21.15.61:0/322950059 >> 172.21.15.61:0/322950059 conn(0x7f233006e640 msgr2=0x7f23300c70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:32.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 -- 172.21.15.61:0/322950059 shutdown_connections 2023-12-24T20:03:32.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.773+0000 7f2335a35700 1 -- 172.21.15.61:0/322950059 wait complete. 2023-12-24T20:03:32.775 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 69 2023-12-24T20:03:32.787 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:03:32.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.907+0000 7f5721d62700 1 Processor -- start 2023-12-24T20:03:32.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.907+0000 7f5721d62700 1 -- start start 2023-12-24T20:03:32.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.908+0000 7f5721d62700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f571c1599e0 0x7f571c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.908+0000 7f5721d62700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f571c0cbac0 0x7f571c0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.908+0000 7f5721d62700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cd9b0 0x7f571c15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.908+0000 7f5721d62700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c0cc2a0 con 0x7f571c0cbac0 2023-12-24T20:03:32.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.908+0000 7f5721d62700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c0cedc0 con 0x7f571c1599e0 2023-12-24T20:03:32.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.908+0000 7f5721d62700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c067f60 con 0x7f571c0cd9b0 2023-12-24T20:03:32.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.908+0000 7f571affd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f571c0cbac0 0x7f571c0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.908+0000 7f571affd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f571c0cbac0 0x7f571c0cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47478/0 (socket says 172.21.15.61:47478) 2023-12-24T20:03:32.911 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.908+0000 7f571affd700 1 -- 172.21.15.61:0/1867175744 learned_addr learned my addr 172.21.15.61:0/1867175744 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.908+0000 7f571bfff700 1 --2- 172.21.15.61:0/1867175744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cd9b0 0x7f571c15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571b7fe700 1 --2- 172.21.15.61:0/1867175744 >> v2:172.21.15.133:3300/0 conn(0x7f571c1599e0 0x7f571c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571affd700 1 -- 172.21.15.61:0/1867175744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cd9b0 msgr2=0x7f571c15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571affd700 1 --2- 172.21.15.61:0/1867175744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cd9b0 0x7f571c15d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571affd700 1 -- 172.21.15.61:0/1867175744 >> v2:172.21.15.133:3300/0 conn(0x7f571c1599e0 msgr2=0x7f571c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571affd700 1 --2- 172.21.15.61:0/1867175744 >> v2:172.21.15.133:3300/0 conn(0x7f571c1599e0 0x7f571c15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571affd700 1 -- 172.21.15.61:0/1867175744 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c15b040 con 0x7f571c0cbac0 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571bfff700 1 --2- 172.21.15.61:0/1867175744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cd9b0 0x7f571c15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571b7fe700 1 --2- 172.21.15.61:0/1867175744 >> v2:172.21.15.133:3300/0 conn(0x7f571c1599e0 0x7f571c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571affd700 1 --2- 172.21.15.61:0/1867175744 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cbac0 0x7f571c0cd470 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f571c0895d0 tx=0x7f5704009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6fc4ebb614c186 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571a7fc700 1 -- 172.21.15.61:0/1867175744 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400b860 con 0x7f571c0cbac0 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571a7fc700 1 -- 172.21.15.61:0/1867175744 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570400b9c0 con 0x7f571c0cbac0 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f571a7fc700 1 -- 172.21.15.61:0/1867175744 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570400bd60 con 0x7f571c0cbac0 2023-12-24T20:03:32.912 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f5721d62700 1 -- 172.21.15.61:0/1867175744 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cbac0 msgr2=0x7f571c0cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:32.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f5721d62700 1 --2- 172.21.15.61:0/1867175744 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cbac0 0x7f571c0cd470 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f571c0895d0 tx=0x7f5704009250 comp rx=0 tx=0).stop 2023-12-24T20:03:32.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f5721d62700 1 -- 172.21.15.61:0/1867175744 shutdown_connections 2023-12-24T20:03:32.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f5721d62700 1 --2- 172.21.15.61:0/1867175744 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cd9b0 0x7f571c15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f5721d62700 1 --2- 172.21.15.61:0/1867175744 >> v2:172.21.15.133:3300/0 conn(0x7f571c1599e0 0x7f571c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f5721d62700 1 --2- 172.21.15.61:0/1867175744 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cbac0 0x7f571c0cd470 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f5721d62700 1 -- 172.21.15.61:0/1867175744 >> 172.21.15.61:0/1867175744 conn(0x7f571c06e640 msgr2=0x7f571c067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:32.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.909+0000 7f5721d62700 1 -- 172.21.15.61:0/1867175744 shutdown_connections 2023-12-24T20:03:32.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.910+0000 7f5721d62700 1 -- 172.21.15.61:0/1867175744 wait complete. 2023-12-24T20:03:32.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.911+0000 7f5721d62700 1 Processor -- start 2023-12-24T20:03:32.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.911+0000 7f5721d62700 1 -- start start 2023-12-24T20:03:32.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f5721d62700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cbac0 0x7f571c145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f5721d62700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cd9b0 0x7f571c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f5721d62700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f571c1599e0 0x7f571c0ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f5721d62700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c145a90 con 0x7f571c0cd9b0 2023-12-24T20:03:32.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f5721d62700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0c95c0 con 0x7f571c1599e0 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f5721d62700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0b4500 con 0x7f571c0cbac0 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f571affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cd9b0 0x7f571c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f571affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cd9b0 0x7f571c0c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47480/0 (socket says 172.21.15.61:47480) 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f571affd700 1 -- 172.21.15.61:0/1850796475 learned_addr learned my addr 172.21.15.61:0/1850796475 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f571bfff700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f571c1599e0 0x7f571c0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.912+0000 7f571b7fe700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cbac0 0x7f571c145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f571affd700 1 -- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cbac0 msgr2=0x7f571c145550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f571affd700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cbac0 0x7f571c145550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f571affd700 1 -- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f571c1599e0 msgr2=0x7f571c0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f571affd700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f571c1599e0 0x7f571c0ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f571affd700 1 -- 172.21.15.61:0/1850796475 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57040094f0 con 0x7f571c0cd9b0 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f571affd700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cd9b0 0x7f571c0c9db0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f571c071db0 tx=0x7f5704017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f57137fe700 1 -- 172.21.15.61:0/1850796475 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704011dc0 con 0x7f571c0cd9b0 2023-12-24T20:03:32.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f57137fe700 1 -- 172.21.15.61:0/1850796475 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5704024440 con 0x7f571c0cd9b0 2023-12-24T20:03:32.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f5721d62700 1 -- 172.21.15.61:0/1850796475 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c0b47e0 con 0x7f571c0cd9b0 2023-12-24T20:03:32.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f57137fe700 1 -- 172.21.15.61:0/1850796475 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704024800 con 0x7f571c0cd9b0 2023-12-24T20:03:32.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.913+0000 7f5721d62700 1 -- 172.21.15.61:0/1850796475 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c0b41d0 con 0x7f571c0cd9b0 2023-12-24T20:03:32.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.914+0000 7f5721d62700 1 -- 172.21.15.61:0/1850796475 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c04c3c0 con 0x7f571c0cd9b0 2023-12-24T20:03:32.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.915+0000 7f57137fe700 1 -- 172.21.15.61:0/1850796475 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f570401a420 con 0x7f571c0cd9b0 2023-12-24T20:03:32.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.915+0000 7f57137fe700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f56fc066f30 0x7f56fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:32.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.915+0000 7f57137fe700 1 -- 172.21.15.61:0/1850796475 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57040863a0 con 0x7f571c0cd9b0 2023-12-24T20:03:32.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.915+0000 7f571b7fe700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f56fc066f30 0x7f56fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:32.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.915+0000 7f571b7fe700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f56fc066f30 0x7f56fc0693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f571c1593a0 tx=0x7f570c006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:32.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:32.919+0000 7f57137fe700 1 -- 172.21.15.61:0/1850796475 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5704053610 con 0x7f571c0cd9b0 2023-12-24T20:03:33.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.117+0000 7f5721d62700 1 -- 172.21.15.61:0/1850796475 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f571c0b4d00 con 0x7f571c0cd9b0 2023-12-24T20:03:33.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.118+0000 7f57137fe700 1 -- 172.21.15.61:0/1850796475 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f571c0b4d00 con 0x7f571c0cd9b0 2023-12-24T20:03:33.119 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:33.119 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":139,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:03:28.568537+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:53.096572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:54.304286+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:03:33.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 -- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f56fc066f30 msgr2=0x7f56fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f56fc066f30 0x7f56fc0693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f571c1593a0 tx=0x7f570c006f90 comp rx=0 tx=0).stop 2023-12-24T20:03:33.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 -- 172.21.15.61:0/1850796475 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cd9b0 msgr2=0x7f571c0c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cd9b0 0x7f571c0c9db0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f571c071db0 tx=0x7f5704017000 comp rx=0 tx=0).stop 2023-12-24T20:03:33.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 -- 172.21.15.61:0/1850796475 shutdown_connections 2023-12-24T20:03:33.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f571c0cbac0 0x7f571c145550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f56fc066f30 0x7f56fc0693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f571c1599e0 0x7f571c0ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 --2- 172.21.15.61:0/1850796475 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f571c0cd9b0 0x7f571c0c9db0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 -- 172.21.15.61:0/1850796475 >> 172.21.15.61:0/1850796475 conn(0x7f571c06e640 msgr2=0x7f571c0c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:33.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 -- 172.21.15.61:0/1850796475 shutdown_connections 2023-12-24T20:03:33.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.120+0000 7f5721d62700 1 -- 172.21.15.61:0/1850796475 wait complete. 2023-12-24T20:03:33.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T20:02:53.096572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T20:02:54.304286+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:03:33.135 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:03:33.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.257+0000 7f2a9a8ec700 1 Processor -- start 2023-12-24T20:03:33.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.257+0000 7f2a9a8ec700 1 -- start start 2023-12-24T20:03:33.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a9a8ec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a94157880 0x7f2a940b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a9a8ec700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2a940ae8e0 0x7f2a9406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a9a8ec700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9406d010 con 0x7f2a94157c50 2023-12-24T20:03:33.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a9a8ec700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a940b1f70 con 0x7f2a940ae8e0 2023-12-24T20:03:33.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a9a8ec700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a940af5c0 con 0x7f2a94157880 2023-12-24T20:03:33.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a98e89700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2a940ae8e0 0x7f2a9406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a937fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2a94157c50 0x7f2a940ae1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38390/0 (socket says 172.21.15.61:38390) 2023-12-24T20:03:33.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a937fe700 1 -- 172.21.15.61:0/4220397555 learned_addr learned my addr 172.21.15.61:0/4220397555 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:33.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a93fff700 1 --2- 172.21.15.61:0/4220397555 >> v2:172.21.15.133:3300/0 conn(0x7f2a94157880 0x7f2a940b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a98e89700 1 -- 172.21.15.61:0/4220397555 >> v2:172.21.15.133:3300/0 conn(0x7f2a94157880 msgr2=0x7f2a940b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a98e89700 1 --2- 172.21.15.61:0/4220397555 >> v2:172.21.15.133:3300/0 conn(0x7f2a94157880 0x7f2a940b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a98e89700 1 -- 172.21.15.61:0/4220397555 >> v1:172.21.15.61:6789/0 conn(0x7f2a94157c50 legacy=0x7f2a940ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a98e89700 1 -- 172.21.15.61:0/4220397555 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a940b1c90 con 0x7f2a940ae8e0 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.258+0000 7f2a92ffd700 1 -- 172.21.15.61:0/4220397555 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264725790 0 0) 0x7f2a9406d010 con 0x7f2a94157c50 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a98e89700 1 --2- 172.21.15.61:0/4220397555 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a940ae8e0 0x7f2a9406d4a0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ca0d0 tx=0x7f2a8c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e49e748f2dc33 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a92ffd700 1 -- 172.21.15.61:0/4220397555 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c00e070 con 0x7f2a940ae8e0 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a92ffd700 1 -- 172.21.15.61:0/4220397555 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c00bc30 con 0x7f2a940ae8e0 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a92ffd700 1 -- 172.21.15.61:0/4220397555 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c012430 con 0x7f2a940ae8e0 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/4220397555 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a940ae8e0 msgr2=0x7f2a9406d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a9a8ec700 1 --2- 172.21.15.61:0/4220397555 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a940ae8e0 0x7f2a9406d4a0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ca0d0 tx=0x7f2a8c009780 comp rx=0 tx=0).stop 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/4220397555 shutdown_connections 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a9a8ec700 1 --2- 172.21.15.61:0/4220397555 >> v2:172.21.15.133:3300/0 conn(0x7f2a94157880 0x7f2a940b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a9a8ec700 1 --2- 172.21.15.61:0/4220397555 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a940ae8e0 0x7f2a9406d4a0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/4220397555 >> 172.21.15.61:0/4220397555 conn(0x7f2a94067550 msgr2=0x7f2a94067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:33.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/4220397555 shutdown_connections 2023-12-24T20:03:33.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.259+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/4220397555 wait complete. 2023-12-24T20:03:33.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.261+0000 7f2a9a8ec700 1 Processor -- start 2023-12-24T20:03:33.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.261+0000 7f2a9a8ec700 1 -- start start 2023-12-24T20:03:33.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a9a8ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a940ae8e0 0x7f2a94154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a9a8ec700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a94157880 0x7f2a940aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a9a8ec700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a94157c50 0x7f2a940aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a9a8ec700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9415b5a0 con 0x7f2a94157880 2023-12-24T20:03:33.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a9a8ec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940c8990 con 0x7f2a940ae8e0 2023-12-24T20:03:33.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a9a8ec700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940c8c70 con 0x7f2a94157c50 2023-12-24T20:03:33.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a937fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a94157880 0x7f2a940aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a937fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a94157880 0x7f2a940aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47486/0 (socket says 172.21.15.61:47486) 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a937fe700 1 -- 172.21.15.61:0/2774683932 learned_addr learned my addr 172.21.15.61:0/2774683932 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a937fe700 1 -- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a94157c50 msgr2=0x7f2a940aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a98e89700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a94157c50 0x7f2a940aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a937fe700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a94157c50 0x7f2a940aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a93fff700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a940ae8e0 0x7f2a94154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a937fe700 1 -- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a940ae8e0 msgr2=0x7f2a94154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a937fe700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a940ae8e0 0x7f2a94154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.262+0000 7f2a937fe700 1 -- 172.21.15.61:0/2774683932 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c009a20 con 0x7f2a94157880 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.263+0000 7f2a937fe700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a94157880 0x7f2a940aa890 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400c5b0 tx=0x7f2a84001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.263+0000 7f2a8bfff700 1 -- 172.21.15.61:0/2774683932 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84005b30 con 0x7f2a94157880 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.263+0000 7f2a8bfff700 1 -- 172.21.15.61:0/2774683932 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a84005c90 con 0x7f2a94157880 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.263+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/2774683932 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a940c8f50 con 0x7f2a94157880 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.263+0000 7f2a8bfff700 1 -- 172.21.15.61:0/2774683932 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84007300 con 0x7f2a94157880 2023-12-24T20:03:33.266 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.263+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/2774683932 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a94155490 con 0x7f2a94157880 2023-12-24T20:03:33.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.264+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/2774683932 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9415b710 con 0x7f2a94157880 2023-12-24T20:03:33.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.264+0000 7f2a8bfff700 1 -- 172.21.15.61:0/2774683932 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2a8401b3b0 con 0x7f2a94157880 2023-12-24T20:03:33.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.264+0000 7f2a8bfff700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2a74066f30 0x7f2a740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.265+0000 7f2a8bfff700 1 -- 172.21.15.61:0/2774683932 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a84083a60 con 0x7f2a94157880 2023-12-24T20:03:33.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.265+0000 7f2a93fff700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2a74066f30 0x7f2a740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.265+0000 7f2a93fff700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2a74066f30 0x7f2a740693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c006fd0 tx=0x7f2a7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:33.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.269+0000 7f2a8bfff700 1 -- 172.21.15.61:0/2774683932 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a9415b710 con 0x7f2a94157880 2023-12-24T20:03:33.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.461+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/2774683932 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a9404c3c0 con 0x7f2a94157880 2023-12-24T20:03:33.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.461+0000 7f2a8bfff700 1 -- 172.21.15.61:0/2774683932 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v139) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a840170a0 con 0x7f2a94157880 2023-12-24T20:03:33.462 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:03:33.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2a74066f30 msgr2=0x7f2a740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2a74066f30 0x7f2a740693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c006fd0 tx=0x7f2a7c008040 comp rx=0 tx=0).stop 2023-12-24T20:03:33.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/2774683932 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a94157880 msgr2=0x7f2a940aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a94157880 0x7f2a940aa890 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400c5b0 tx=0x7f2a84001070 comp rx=0 tx=0).stop 2023-12-24T20:03:33.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/2774683932 shutdown_connections 2023-12-24T20:03:33.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2a94157c50 0x7f2a940aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2a74066f30 0x7f2a740693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a940ae8e0 0x7f2a94154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 --2- 172.21.15.61:0/2774683932 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2a94157880 0x7f2a940aa890 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/2774683932 >> 172.21.15.61:0/2774683932 conn(0x7f2a94067550 msgr2=0x7f2a940cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:33.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/2774683932 shutdown_connections 2023-12-24T20:03:33.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.463+0000 7f2a9a8ec700 1 -- 172.21.15.61:0/2774683932 wait complete. 2023-12-24T20:03:33.477 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:03:33.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.601+0000 7f4b4c085700 1 Processor -- start 2023-12-24T20:03:33.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.601+0000 7f4b4c085700 1 -- start start 2023-12-24T20:03:33.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.602+0000 7f4b4c085700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b440cdf90 0x7f4b4406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.602+0000 7f4b4c085700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b440ce360 0x7f4b44158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.602+0000 7f4b4c085700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4415bad0 con 0x7f4b44158a80 2023-12-24T20:03:33.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.602+0000 7f4b4c085700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4415bdb0 con 0x7f4b440cdf90 2023-12-24T20:03:33.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.602+0000 7f4b4c085700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4415c090 con 0x7f4b440ce360 2023-12-24T20:03:33.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.602+0000 7f4b4a622700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4b44158a80 0x7f4b4406c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38404/0 (socket says 172.21.15.61:38404) 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.602+0000 7f4b4a622700 1 -- 172.21.15.61:0/1202518952 learned_addr learned my addr 172.21.15.61:0/1202518952 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b49620700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b440ce360 0x7f4b44158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433847919 0 0) 0x7f4b4415bad0 con 0x7f4b44158a80 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b49e21700 1 --2- 172.21.15.61:0/1202518952 >> v2:172.21.15.133:3300/0 conn(0x7f4b440cdf90 0x7f4b4406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b30003570 con 0x7f4b44158a80 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2392689306 0 0) 0x7f4b30003570 con 0x7f4b44158a80 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b440ce360 msgr2=0x7f4b44158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b440ce360 0x7f4b44158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 >> v2:172.21.15.133:3300/0 conn(0x7f4b440cdf90 msgr2=0x7f4b4406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 --2- 172.21.15.61:0/1202518952 >> v2:172.21.15.133:3300/0 conn(0x7f4b440cdf90 0x7f4b4406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4415c370 con 0x7f4b44158a80 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f4b3c0017f0 con 0x7f4b44158a80 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 >> v1:172.21.15.61:6789/0 conn(0x7f4b44158a80 legacy=0x7f4b4406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b30003a60 0x7f4b30003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30004810 0x7f4b30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b440ce360 0x7f4b300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4415bdb0 con 0x7f4b30003a60 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4415c090 con 0x7f4b30004810 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3000ba60 con 0x7f4b440ce360 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b49e21700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b30003a60 0x7f4b30003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b49620700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30004810 0x7f4b30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.603+0000 7f4b4a622700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b440ce360 0x7f4b300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b49e21700 1 -- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b440ce360 msgr2=0x7f4b300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b49e21700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b440ce360 0x7f4b300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b49e21700 1 -- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30004810 msgr2=0x7f4b30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b49e21700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30004810 0x7f4b30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b49e21700 1 -- 172.21.15.61:0/1202518952 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b30003570 con 0x7f4b30003a60 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b4a622700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b440ce360 0x7f4b300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:33.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b49e21700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b30003a60 0x7f4b30003e70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009c30 tx=0x7f4b380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc49f06ec3a551a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:33.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3800e710 con 0x7f4b30003a60 2023-12-24T20:03:33.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3800e870 con 0x7f4b30003a60 2023-12-24T20:03:33.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b48e1f700 1 -- 172.21.15.61:0/1202518952 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3800ec30 con 0x7f4b30003a60 2023-12-24T20:03:33.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b4c085700 1 -- 172.21.15.61:0/1202518952 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b30003a60 msgr2=0x7f4b30003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b4c085700 1 --2- 172.21.15.61:0/1202518952 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b30003a60 0x7f4b30003e70 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009c30 tx=0x7f4b380091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b4a622700 1 -- 172.21.15.61:0/1202518952 reap_dead start 2023-12-24T20:03:33.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b4c085700 1 -- 172.21.15.61:0/1202518952 shutdown_connections 2023-12-24T20:03:33.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.604+0000 7f4b4c085700 1 -- 172.21.15.61:0/1202518952 >> 172.21.15.61:0/1202518952 conn(0x7f4b4406f810 msgr2=0x7f4b4406ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:33.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.605+0000 7f4b4c085700 1 -- 172.21.15.61:0/1202518952 shutdown_connections 2023-12-24T20:03:33.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.605+0000 7f4b4c085700 1 -- 172.21.15.61:0/1202518952 wait complete. 2023-12-24T20:03:33.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.606+0000 7f4b4c085700 1 Processor -- start 2023-12-24T20:03:33.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.606+0000 7f4b4c085700 1 -- start start 2023-12-24T20:03:33.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.606+0000 7f4b4c085700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b30003a60 0x7f4b44156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.606+0000 7f4b4c085700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b44167be0 0x7f4b44168050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.606+0000 7f4b4c085700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b440a6470 0x7f4b440a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.606+0000 7f4b4c085700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b440a6e20 con 0x7f4b440a6470 2023-12-24T20:03:33.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.606+0000 7f4b4c085700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b440b2080 con 0x7f4b44167be0 2023-12-24T20:03:33.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.606+0000 7f4b4c085700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b440b2360 con 0x7f4b30003a60 2023-12-24T20:03:33.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4a622700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b440a6470 0x7f4b440a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4a622700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b440a6470 0x7f4b440a68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47494/0 (socket says 172.21.15.61:47494) 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4a622700 1 -- 172.21.15.61:0/3575870705 learned_addr learned my addr 172.21.15.61:0/3575870705 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b49620700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b44167be0 0x7f4b44168050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b49e21700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b30003a60 0x7f4b44156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4a622700 1 -- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b30003a60 msgr2=0x7f4b44156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4a622700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b30003a60 0x7f4b44156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4a622700 1 -- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b44167be0 msgr2=0x7f4b44168050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4a622700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b44167be0 0x7f4b44168050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4a622700 1 -- 172.21.15.61:0/3575870705 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b440b2640 con 0x7f4b440a6470 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b49620700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b44167be0 0x7f4b44168050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4a622700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b440a6470 0x7f4b440a68e0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c001350 tx=0x7f4b4415c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b35ffb700 1 -- 172.21.15.61:0/3575870705 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c00ebc0 con 0x7f4b440a6470 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b35ffb700 1 -- 172.21.15.61:0/3575870705 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c00ed20 con 0x7f4b440a6470 2023-12-24T20:03:33.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4c085700 1 -- 172.21.15.61:0/3575870705 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b440b2920 con 0x7f4b440a6470 2023-12-24T20:03:33.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b35ffb700 1 -- 172.21.15.61:0/3575870705 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c013670 con 0x7f4b440a6470 2023-12-24T20:03:33.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.607+0000 7f4b4c085700 1 -- 172.21.15.61:0/3575870705 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b44156ac0 con 0x7f4b440a6470 2023-12-24T20:03:33.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.608+0000 7f4b4c085700 1 -- 172.21.15.61:0/3575870705 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b440b24a0 con 0x7f4b440a6470 2023-12-24T20:03:33.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.609+0000 7f4b35ffb700 1 -- 172.21.15.61:0/3575870705 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4b3c013aa0 con 0x7f4b440a6470 2023-12-24T20:03:33.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.609+0000 7f4b35ffb700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b28066f30 0x7f4b280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.609+0000 7f4b35ffb700 1 -- 172.21.15.61:0/3575870705 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b3c084ae0 con 0x7f4b440a6470 2023-12-24T20:03:33.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.609+0000 7f4b49e21700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b28066f30 0x7f4b280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.610+0000 7f4b49e21700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b28066f30 0x7f4b280693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4b38006d60 tx=0x7f4b3801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:33.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.614+0000 7f4b35ffb700 1 -- 172.21.15.61:0/3575870705 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b440b24a0 con 0x7f4b440a6470 2023-12-24T20:03:33.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.806+0000 7f4b4c085700 1 -- 172.21.15.61:0/3575870705 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b440b24a0 con 0x7f4b440a6470 2023-12-24T20:03:33.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.806+0000 7f4b35ffb700 1 -- 172.21.15.61:0/3575870705 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b440b24a0 con 0x7f4b440a6470 2023-12-24T20:03:33.808 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T20:03:33.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 -- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b28066f30 msgr2=0x7f4b280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b28066f30 0x7f4b280693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4b38006d60 tx=0x7f4b3801a000 comp rx=0 tx=0).stop 2023-12-24T20:03:33.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 -- 172.21.15.61:0/3575870705 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b440a6470 msgr2=0x7f4b440a68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b440a6470 0x7f4b440a68e0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c001350 tx=0x7f4b4415c650 comp rx=0 tx=0).stop 2023-12-24T20:03:33.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 -- 172.21.15.61:0/3575870705 shutdown_connections 2023-12-24T20:03:33.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4b30003a60 0x7f4b44156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4b28066f30 0x7f4b280693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4b440a6470 0x7f4b440a68e0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 --2- 172.21.15.61:0/3575870705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b44167be0 0x7f4b44168050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 -- 172.21.15.61:0/3575870705 >> 172.21.15.61:0/3575870705 conn(0x7f4b4406f810 msgr2=0x7f4b440cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:33.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 -- 172.21.15.61:0/3575870705 shutdown_connections 2023-12-24T20:03:33.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.809+0000 7f4b4c085700 1 -- 172.21.15.61:0/3575870705 wait complete. 2023-12-24T20:03:33.822 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:03:33.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.945+0000 7fbc18e8d700 1 Processor -- start 2023-12-24T20:03:33.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.945+0000 7fbc18e8d700 1 -- start start 2023-12-24T20:03:33.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc18e8d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbc14159c60 0x7fbc140c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc18e8d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc1415a030 0x7fbc14070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc18e8d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc1406b190 con 0x7fbc14068b10 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc18e8d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1406a5c0 con 0x7fbc14159c60 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc18e8d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc1406a860 con 0x7fbc1415a030 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc1259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbc14159c60 0x7fbc140c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc12d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fbc14068b10 0x7fbc14067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38410/0 (socket says 172.21.15.61:38410) 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc12d9d700 1 -- 172.21.15.61:0/2877236291 learned_addr learned my addr 172.21.15.61:0/2877236291 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc11d9b700 1 --2- 172.21.15.61:0/2877236291 >> v2:172.21.15.133:3300/0 conn(0x7fbc1415a030 0x7fbc14070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc1259c700 1 -- 172.21.15.61:0/2877236291 >> v2:172.21.15.133:3300/0 conn(0x7fbc1415a030 msgr2=0x7fbc14070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc1259c700 1 --2- 172.21.15.61:0/2877236291 >> v2:172.21.15.133:3300/0 conn(0x7fbc1415a030 0x7fbc14070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc1259c700 1 -- 172.21.15.61:0/2877236291 >> v1:172.21.15.61:6789/0 conn(0x7fbc14068b10 legacy=0x7fbc14067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc1259c700 1 -- 172.21.15.61:0/2877236291 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1406ab40 con 0x7fbc14159c60 2023-12-24T20:03:33.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc1259c700 1 --2- 172.21.15.61:0/2877236291 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 0x7fbc140c4000 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fbc1406d190 tx=0x7fbc040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a83fce3b4922ff2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:33.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc1159a700 1 -- 172.21.15.61:0/2877236291 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400b6b0 con 0x7fbc14159c60 2023-12-24T20:03:33.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc1159a700 1 -- 172.21.15.61:0/2877236291 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0400b810 con 0x7fbc14159c60 2023-12-24T20:03:33.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.946+0000 7fbc1159a700 1 -- 172.21.15.61:0/2877236291 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400bbb0 con 0x7fbc14159c60 2023-12-24T20:03:33.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.947+0000 7fbc18e8d700 1 -- 172.21.15.61:0/2877236291 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 msgr2=0x7fbc140c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.947+0000 7fbc18e8d700 1 --2- 172.21.15.61:0/2877236291 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 0x7fbc140c4000 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fbc1406d190 tx=0x7fbc040091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.947+0000 7fbc18e8d700 1 -- 172.21.15.61:0/2877236291 shutdown_connections 2023-12-24T20:03:33.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.947+0000 7fbc18e8d700 1 --2- 172.21.15.61:0/2877236291 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 0x7fbc140c4000 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.947+0000 7fbc18e8d700 1 --2- 172.21.15.61:0/2877236291 >> v2:172.21.15.133:3300/0 conn(0x7fbc1415a030 0x7fbc14070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.947+0000 7fbc18e8d700 1 -- 172.21.15.61:0/2877236291 >> 172.21.15.61:0/2877236291 conn(0x7fbc140ce420 msgr2=0x7fbc140ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:33.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.947+0000 7fbc18e8d700 1 -- 172.21.15.61:0/2877236291 shutdown_connections 2023-12-24T20:03:33.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.947+0000 7fbc18e8d700 1 -- 172.21.15.61:0/2877236291 wait complete. 2023-12-24T20:03:33.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.949+0000 7fbc18e8d700 1 Processor -- start 2023-12-24T20:03:33.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.949+0000 7fbc18e8d700 1 -- start start 2023-12-24T20:03:33.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc18e8d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc14068b10 0x7fbc1415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc18e8d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 0x7fbc1415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc18e8d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1415a030 0x7fbc14152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc18e8d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1415b620 con 0x7fbc14159c60 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc18e8d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc14152a70 con 0x7fbc1415a030 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc18e8d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1415bf20 con 0x7fbc14068b10 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc11d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 0x7fbc1415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc11d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 0x7fbc1415b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47512/0 (socket says 172.21.15.61:47512) 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc11d9b700 1 -- 172.21.15.61:0/1390398609 learned_addr learned my addr 172.21.15.61:0/1390398609 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc1259c700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc14068b10 0x7fbc1415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc12d9d700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1415a030 0x7fbc14152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc11d9b700 1 -- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc14068b10 msgr2=0x7fbc1415b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc11d9b700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc14068b10 0x7fbc1415b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc11d9b700 1 -- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1415a030 msgr2=0x7fbc14152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:33.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc11d9b700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1415a030 0x7fbc14152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:33.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc11d9b700 1 -- 172.21.15.61:0/1390398609 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04009420 con 0x7fbc14159c60 2023-12-24T20:03:33.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc11d9b700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 0x7fbc1415b0e0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800d890 tx=0x7fbc08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:33.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc027fc700 1 -- 172.21.15.61:0/1390398609 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800b600 con 0x7fbc14159c60 2023-12-24T20:03:33.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc027fc700 1 -- 172.21.15.61:0/1390398609 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0800b760 con 0x7fbc14159c60 2023-12-24T20:03:33.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc18e8d700 1 -- 172.21.15.61:0/1390398609 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1415c200 con 0x7fbc14159c60 2023-12-24T20:03:33.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc027fc700 1 -- 172.21.15.61:0/1390398609 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0800bae0 con 0x7fbc14159c60 2023-12-24T20:03:33.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.950+0000 7fbc18e8d700 1 -- 172.21.15.61:0/1390398609 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1415c7c0 con 0x7fbc14159c60 2023-12-24T20:03:33.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.951+0000 7fbc18e8d700 1 -- 172.21.15.61:0/1390398609 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1404c3c0 con 0x7fbc14159c60 2023-12-24T20:03:33.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.952+0000 7fbc027fc700 1 -- 172.21.15.61:0/1390398609 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbc0801e460 con 0x7fbc14159c60 2023-12-24T20:03:33.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.952+0000 7fbc027fc700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbbf4066f30 0x7fbbf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:33.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.952+0000 7fbc027fc700 1 -- 172.21.15.61:0/1390398609 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc08084bc0 con 0x7fbc14159c60 2023-12-24T20:03:33.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.952+0000 7fbc1259c700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbbf4066f30 0x7fbbf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:33.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.953+0000 7fbc1259c700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbbf4066f30 0x7fbbf40693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbc040093f0 tx=0x7fbc04017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:33.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:33.956+0000 7fbc027fc700 1 -- 172.21.15.61:0/1390398609 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc08051e30 con 0x7fbc14159c60 2023-12-24T20:03:34.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.149+0000 7fbc18e8d700 1 -- 172.21.15.61:0/1390398609 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc140649e0 con 0x7fbc14159c60 2023-12-24T20:03:34.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.150+0000 7fbc027fc700 1 -- 172.21.15.61:0/1390398609 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc08055450 con 0x7fbc14159c60 2023-12-24T20:03:34.151 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T20:03:34.153 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 -- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbbf4066f30 msgr2=0x7fbbf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbbf4066f30 0x7fbbf40693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbc040093f0 tx=0x7fbc04017000 comp rx=0 tx=0).stop 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 -- 172.21.15.61:0/1390398609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 msgr2=0x7fbc1415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 0x7fbc1415b0e0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800d890 tx=0x7fbc08008040 comp rx=0 tx=0).stop 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 -- 172.21.15.61:0/1390398609 shutdown_connections 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbc14068b10 0x7fbc1415b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbbf4066f30 0x7fbbf40693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc1415a030 0x7fbc14152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 --2- 172.21.15.61:0/1390398609 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbc14159c60 0x7fbc1415b0e0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 -- 172.21.15.61:0/1390398609 >> 172.21.15.61:0/1390398609 conn(0x7fbc140ce420 msgr2=0x7fbc140afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 -- 172.21.15.61:0/1390398609 shutdown_connections 2023-12-24T20:03:34.154 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.152+0000 7fbc18e8d700 1 -- 172.21.15.61:0/1390398609 wait complete. 2023-12-24T20:03:34.166 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:34.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.286+0000 7f4e886d8700 1 Processor -- start 2023-12-24T20:03:34.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.286+0000 7f4e886d8700 1 -- start start 2023-12-24T20:03:34.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e886d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e8006aa70 0x7f4e8006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e886d8700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8006f440 con 0x7f4e80151080 2023-12-24T20:03:34.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e886d8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e801573b0 con 0x7f4e80150cb0 2023-12-24T20:03:34.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e886d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80064000 con 0x7f4e8006aa70 2023-12-24T20:03:34.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e86c75700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4e80151080 0x7f4e8006db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38424/0 (socket says 172.21.15.61:38424) 2023-12-24T20:03:34.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e86c75700 1 -- 172.21.15.61:0/3195347992 learned_addr learned my addr 172.21.15.61:0/3195347992 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:34.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85c73700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e8006aa70 0x7f4e8006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338980747 0 0) 0x7f4e78001490 con 0x7f4e80151080 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e6c003570 con 0x7f4e80151080 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558170075 0 0) 0x7f4e801573b0 con 0x7f4e80150cb0 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e78001490 con 0x7f4e80150cb0 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2746197364 0 0) 0x7f4e6c003570 con 0x7f4e80151080 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e8006aa70 msgr2=0x7f4e8006ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e8006aa70 0x7f4e8006ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 >> v1:172.21.15.133:6789/0 conn(0x7f4e80150cb0 legacy=0x7f4e8006a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80157690 con 0x7f4e80151080 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f4e78001980 con 0x7f4e80151080 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 >> v1:172.21.15.61:6789/0 conn(0x7f4e80151080 legacy=0x7f4e8006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.287+0000 7f4e85472700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e8006aa70 0x7f4e6c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e85472700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6c004180 0x7f4e6c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e85472700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e6c004d50 0x7f4e6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80064000 con 0x7f4e6c004d50 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c00bba0 con 0x7f4e6c004180 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c00bd60 con 0x7f4e8006aa70 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e86c75700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e6c004d50 0x7f4e6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e85c73700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6c004180 0x7f4e6c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e86474700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e8006aa70 0x7f4e6c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e86c75700 1 -- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e8006aa70 msgr2=0x7f4e6c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e86c75700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e8006aa70 0x7f4e6c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e86c75700 1 -- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6c004180 msgr2=0x7f4e6c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e86c75700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6c004180 0x7f4e6c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e86c75700 1 -- 172.21.15.61:0/3195347992 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c003570 con 0x7f4e6c004d50 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e85c73700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e6c004180 0x7f4e6c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e86c75700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e6c004d50 0x7f4e6c0051c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f4e800caa30 tx=0x7f4e7800a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4882521e25b267a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800ae00 con 0x7f4e6c004d50 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7800c5d0 con 0x7f4e6c004d50 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.288+0000 7f4e85472700 1 -- 172.21.15.61:0/3195347992 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7800c990 con 0x7f4e6c004d50 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.289+0000 7f4e886d8700 1 -- 172.21.15.61:0/3195347992 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e6c004d50 msgr2=0x7f4e6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.289+0000 7f4e886d8700 1 --2- 172.21.15.61:0/3195347992 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e6c004d50 0x7f4e6c0051c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f4e800caa30 tx=0x7f4e7800a120 comp rx=0 tx=0).stop 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.289+0000 7f4e86c75700 1 -- 172.21.15.61:0/3195347992 reap_dead start 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.289+0000 7f4e886d8700 1 -- 172.21.15.61:0/3195347992 shutdown_connections 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.289+0000 7f4e886d8700 1 -- 172.21.15.61:0/3195347992 >> 172.21.15.61:0/3195347992 conn(0x7f4e800cceb0 msgr2=0x7f4e800cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.289+0000 7f4e886d8700 1 -- 172.21.15.61:0/3195347992 shutdown_connections 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.289+0000 7f4e886d8700 1 -- 172.21.15.61:0/3195347992 wait complete. 2023-12-24T20:03:34.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.290+0000 7f4e886d8700 1 Processor -- start 2023-12-24T20:03:34.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.290+0000 7f4e886d8700 1 -- start start 2023-12-24T20:03:34.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e886d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e6c004d50 0x7f4e800b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e886d8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e8014beb0 0x7f4e800b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e886d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e800b2120 0x7f4e800afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e886d8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80153fd0 con 0x7f4e8014beb0 2023-12-24T20:03:34.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e886d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80153450 con 0x7f4e800b2120 2023-12-24T20:03:34.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e886d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80153730 con 0x7f4e6c004d50 2023-12-24T20:03:34.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e85c73700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e8014beb0 0x7f4e800b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e85c73700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e8014beb0 0x7f4e800b1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47526/0 (socket says 172.21.15.61:47526) 2023-12-24T20:03:34.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e85c73700 1 -- 172.21.15.61:0/1438943931 learned_addr learned my addr 172.21.15.61:0/1438943931 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e86474700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e6c004d50 0x7f4e800b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e86c75700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e800b2120 0x7f4e800afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e85c73700 1 -- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e6c004d50 msgr2=0x7f4e800b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e85c73700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e6c004d50 0x7f4e800b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e85c73700 1 -- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e800b2120 msgr2=0x7f4e800afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e85c73700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e800b2120 0x7f4e800afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e85c73700 1 -- 172.21.15.61:0/1438943931 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80153a10 con 0x7f4e8014beb0 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.291+0000 7f4e85c73700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e8014beb0 0x7f4e800b1be0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c011960 tx=0x7f4e7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.292+0000 7f4e767fc700 1 -- 172.21.15.61:0/1438943931 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c011ea0 con 0x7f4e8014beb0 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.292+0000 7f4e767fc700 1 -- 172.21.15.61:0/1438943931 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c00f860 con 0x7f4e8014beb0 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.292+0000 7f4e886d8700 1 -- 172.21.15.61:0/1438943931 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e80153cf0 con 0x7f4e8014beb0 2023-12-24T20:03:34.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.292+0000 7f4e767fc700 1 -- 172.21.15.61:0/1438943931 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00fbe0 con 0x7f4e8014beb0 2023-12-24T20:03:34.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.292+0000 7f4e886d8700 1 -- 172.21.15.61:0/1438943931 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e800b02a0 con 0x7f4e8014beb0 2023-12-24T20:03:34.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.292+0000 7f4e886d8700 1 -- 172.21.15.61:0/1438943931 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8004c3c0 con 0x7f4e8014beb0 2023-12-24T20:03:34.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.293+0000 7f4e767fc700 1 -- 172.21.15.61:0/1438943931 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4e7c015460 con 0x7f4e8014beb0 2023-12-24T20:03:34.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.293+0000 7f4e767fc700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4e64066f30 0x7f4e640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.294+0000 7f4e767fc700 1 -- 172.21.15.61:0/1438943931 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e7c084da0 con 0x7f4e8014beb0 2023-12-24T20:03:34.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.294+0000 7f4e86474700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4e64066f30 0x7f4e640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.294+0000 7f4e86474700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4e64066f30 0x7f4e640693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4e70007e40 tx=0x7f4e70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:34.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.298+0000 7f4e767fc700 1 -- 172.21.15.61:0/1438943931 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e7c052020 con 0x7f4e8014beb0 2023-12-24T20:03:34.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.542+0000 7f4e886d8700 1 -- 172.21.15.61:0/1438943931 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e80157970 con 0x7f4e8014beb0 2023-12-24T20:03:34.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.542+0000 7f4e767fc700 1 -- 172.21.15.61:0/1438943931 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f4e7c055640 con 0x7f4e8014beb0 2023-12-24T20:03:34.544 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:34.544 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3245805399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3245805399},{"type":"v1","addr":"172.21.15.133:6837","nonce":3245805399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/4168448475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":4168448475},{"type":"v1","addr":"172.21.15.61:6835","nonce":4168448475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1817856586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1817856586},{"type":"v1","addr":"172.21.15.61:6834","nonce":1817856586}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:55.325289+0000","modified":"2023-12-24T20:02:58.932577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7089},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7089":{"gid":7089,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2704897796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2704897796},{"type":"v1","addr":"172.21.15.133:6836","nonce":2704897796}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T20:03:34.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.544+0000 7f4e886d8700 1 -- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4e64066f30 msgr2=0x7f4e640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.544+0000 7f4e886d8700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4e64066f30 0x7f4e640693e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4e70007e40 tx=0x7f4e70009040 comp rx=0 tx=0).stop 2023-12-24T20:03:34.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.544+0000 7f4e886d8700 1 -- 172.21.15.61:0/1438943931 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e8014beb0 msgr2=0x7f4e800b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.544+0000 7f4e886d8700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e8014beb0 0x7f4e800b1be0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c011960 tx=0x7f4e7c008040 comp rx=0 tx=0).stop 2023-12-24T20:03:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.544+0000 7f4e886d8700 1 -- 172.21.15.61:0/1438943931 shutdown_connections 2023-12-24T20:03:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.544+0000 7f4e886d8700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4e6c004d50 0x7f4e800b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.544+0000 7f4e886d8700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4e64066f30 0x7f4e640693e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.544+0000 7f4e886d8700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e800b2120 0x7f4e800afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.544+0000 7f4e886d8700 1 --2- 172.21.15.61:0/1438943931 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e8014beb0 0x7f4e800b1be0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.544+0000 7f4e886d8700 1 -- 172.21.15.61:0/1438943931 >> 172.21.15.61:0/1438943931 conn(0x7f4e800cceb0 msgr2=0x7f4e8014c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.545+0000 7f4e886d8700 1 -- 172.21.15.61:0/1438943931 shutdown_connections 2023-12-24T20:03:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.545+0000 7f4e886d8700 1 -- 172.21.15.61:0/1438943931 wait complete. 2023-12-24T20:03:34.547 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 69 2023-12-24T20:03:34.558 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:03:34.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.680+0000 7f1668dbb700 1 Processor -- start 2023-12-24T20:03:34.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.680+0000 7f1668dbb700 1 -- start start 2023-12-24T20:03:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f1668dbb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1664068c80 0x7f16640afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f1668dbb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166415acf0 0x7f1664067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f1668dbb700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16640687f0 con 0x7f16640af710 2023-12-24T20:03:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f1668dbb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1664067be0 con 0x7f1664068c80 2023-12-24T20:03:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f1668dbb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1664067ec0 con 0x7f166415acf0 2023-12-24T20:03:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f166259c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f16640af710 0x7f166415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38426/0 (socket says 172.21.15.61:38426) 2023-12-24T20:03:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f166259c700 1 -- 172.21.15.61:0/3889980723 learned_addr learned my addr 172.21.15.61:0/3889980723 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:34.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160074810 0 0) 0x7f16640687f0 con 0x7f16640af710 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1650003570 con 0x7f16640af710 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f1661d9b700 1 --2- 172.21.15.61:0/3889980723 >> v2:172.21.15.133:3300/0 conn(0x7f1664068c80 0x7f16640afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.681+0000 7f1662d9d700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166415acf0 0x7f1664067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1366910984 0 0) 0x7f1650003570 con 0x7f16640af710 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166415acf0 msgr2=0x7f1664067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166415acf0 0x7f1664067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 >> v2:172.21.15.133:3300/0 conn(0x7f1664068c80 msgr2=0x7f16640afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 --2- 172.21.15.61:0/3889980723 >> v2:172.21.15.133:3300/0 conn(0x7f1664068c80 0x7f16640afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16640681a0 con 0x7f16640af710 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f1661d9b700 1 --2- 172.21.15.61:0/3889980723 >> v2:172.21.15.133:3300/0 conn(0x7f1664068c80 0x7f16640afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:34.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f164c001470 con 0x7f16640af710 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 >> v1:172.21.15.61:6789/0 conn(0x7f16640af710 legacy=0x7f166415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166415acf0 0x7f1650003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 0x7f1650004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1650004d50 0x7f16500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1664067be0 con 0x7f1650004090 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1664067ec0 con 0x7f1650004d50 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165000bbf0 con 0x7f166415acf0 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f1661d9b700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 0x7f1650004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166259c700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166415acf0 0x7f1650003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f1662d9d700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1650004d50 0x7f16500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f1661d9b700 1 -- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166415acf0 msgr2=0x7f1650003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:34.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f1661d9b700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166415acf0 0x7f1650003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f1661d9b700 1 -- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1650004d50 msgr2=0x7f16500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:34.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f1661d9b700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1650004d50 0x7f16500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f1661d9b700 1 -- 172.21.15.61:0/3889980723 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650003570 con 0x7f1650004090 2023-12-24T20:03:34.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f1662d9d700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1650004d50 0x7f16500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:34.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f1661d9b700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 0x7f1650004810 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1664069070 tx=0x7f1654008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5956eb354dad32 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:34.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165400c070 con 0x7f1650004090 2023-12-24T20:03:34.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165400e5e0 con 0x7f1650004090 2023-12-24T20:03:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.682+0000 7f166159a700 1 -- 172.21.15.61:0/3889980723 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654009510 con 0x7f1650004090 2023-12-24T20:03:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.683+0000 7f1668dbb700 1 -- 172.21.15.61:0/3889980723 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 msgr2=0x7f1650004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.683+0000 7f1668dbb700 1 --2- 172.21.15.61:0/3889980723 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 0x7f1650004810 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f1664069070 tx=0x7f1654008040 comp rx=0 tx=0).stop 2023-12-24T20:03:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.683+0000 7f1662d9d700 1 -- 172.21.15.61:0/3889980723 reap_dead start 2023-12-24T20:03:34.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.683+0000 7f1668dbb700 1 -- 172.21.15.61:0/3889980723 shutdown_connections 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.683+0000 7f1668dbb700 1 -- 172.21.15.61:0/3889980723 >> 172.21.15.61:0/3889980723 conn(0x7f16640ca200 msgr2=0x7f16640ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.683+0000 7f1668dbb700 1 -- 172.21.15.61:0/3889980723 shutdown_connections 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.683+0000 7f1668dbb700 1 -- 172.21.15.61:0/3889980723 wait complete. 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.684+0000 7f1668dbb700 1 Processor -- start 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.684+0000 7f1668dbb700 1 -- start start 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f1668dbb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 0x7f1664154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f1668dbb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16641531a0 0x7f166414e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f1668dbb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166414c770 0x7f16640b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f1668dbb700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1664154370 con 0x7f1650004090 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f1668dbb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166414ec40 con 0x7f16641531a0 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f1668dbb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1664153760 con 0x7f166414c770 2023-12-24T20:03:34.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f166259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 0x7f1664154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f166259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 0x7f1664154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47548/0 (socket says 172.21.15.61:47548) 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f166259c700 1 -- 172.21.15.61:0/479371515 learned_addr learned my addr 172.21.15.61:0/479371515 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f1661d9b700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16641531a0 0x7f166414e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f1662d9d700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166414c770 0x7f16640b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f166259c700 1 -- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166414c770 msgr2=0x7f16640b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f166259c700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166414c770 0x7f16640b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f166259c700 1 -- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16641531a0 msgr2=0x7f166414e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f166259c700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16641531a0 0x7f166414e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f166259c700 1 -- 172.21.15.61:0/479371515 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1664153a40 con 0x7f1650004090 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.685+0000 7f1661d9b700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16641531a0 0x7f166414e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.686+0000 7f166259c700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 0x7f1664154800 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f164c000fd0 tx=0x7f1664068760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.686+0000 7f165a7fc700 1 -- 172.21.15.61:0/479371515 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c018030 con 0x7f1650004090 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.686+0000 7f165a7fc700 1 -- 172.21.15.61:0/479371515 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c00fa30 con 0x7f1650004090 2023-12-24T20:03:34.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.686+0000 7f1668dbb700 1 -- 172.21.15.61:0/479371515 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1664153d20 con 0x7f1650004090 2023-12-24T20:03:34.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.686+0000 7f165a7fc700 1 -- 172.21.15.61:0/479371515 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00fdd0 con 0x7f1650004090 2023-12-24T20:03:34.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.686+0000 7f1668dbb700 1 -- 172.21.15.61:0/479371515 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166414cbe0 con 0x7f1650004090 2023-12-24T20:03:34.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.687+0000 7f1668dbb700 1 -- 172.21.15.61:0/479371515 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1664154650 con 0x7f1650004090 2023-12-24T20:03:34.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.687+0000 7f165a7fc700 1 -- 172.21.15.61:0/479371515 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f164c01b070 con 0x7f1650004090 2023-12-24T20:03:34.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.688+0000 7f165a7fc700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1644066f30 0x7f16440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:34.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.688+0000 7f165a7fc700 1 -- 172.21.15.61:0/479371515 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f164c019070 con 0x7f1650004090 2023-12-24T20:03:34.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.688+0000 7f1661d9b700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1644066f30 0x7f16440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:34.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.688+0000 7f1661d9b700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1644066f30 0x7f16440693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f166406fa80 tx=0x7f165401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:34.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.692+0000 7f165a7fc700 1 -- 172.21.15.61:0/479371515 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f164c051950 con 0x7f1650004090 2023-12-24T20:03:34.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.887+0000 7f1668dbb700 1 -- 172.21.15.61:0/479371515 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f166414ce00 con 0x7f1650004090 2023-12-24T20:03:34.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.888+0000 7f165a7fc700 1 -- 172.21.15.61:0/479371515 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f164c054f70 con 0x7f1650004090 2023-12-24T20:03:34.890 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:34.890 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":139,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:03:28.568537+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:53.096572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:54.304286+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:03:34.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 -- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1644066f30 msgr2=0x7f16440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1644066f30 0x7f16440693e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f166406fa80 tx=0x7f165401a000 comp rx=0 tx=0).stop 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 -- 172.21.15.61:0/479371515 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 msgr2=0x7f1664154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 0x7f1664154800 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f164c000fd0 tx=0x7f1664068760 comp rx=0 tx=0).stop 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 -- 172.21.15.61:0/479371515 shutdown_connections 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f166414c770 0x7f16640b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1644066f30 0x7f16440693e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1650004090 0x7f1664154800 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 --2- 172.21.15.61:0/479371515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16641531a0 0x7f166414e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 -- 172.21.15.61:0/479371515 >> 172.21.15.61:0/479371515 conn(0x7f16640ca200 msgr2=0x7f16640cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 -- 172.21.15.61:0/479371515 shutdown_connections 2023-12-24T20:03:34.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:34.890+0000 7f1668dbb700 1 -- 172.21.15.61:0/479371515 wait complete. 2023-12-24T20:03:34.905 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:03:34.905 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:35.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.026+0000 7f932e10c700 1 Processor -- start 2023-12-24T20:03:35.028 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.026+0000 7f932e10c700 1 -- start start 2023-12-24T20:03:35.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.027+0000 7f932e10c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f932815bb60 0x7f9328098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.027+0000 7f932e10c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93280b2660 0x7f93280b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.027+0000 7f932e10c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93280b2eb0 con 0x7f9328098aa0 2023-12-24T20:03:35.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.027+0000 7f932e10c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93280afc20 con 0x7f932815bb60 2023-12-24T20:03:35.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.027+0000 7f932e10c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93280b2bd0 con 0x7f93280b2660 2023-12-24T20:03:35.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.027+0000 7f93277fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f932815bb60 0x7f9328098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.027+0000 7f93277fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f932815bb60 0x7f9328098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47564/0 (socket says 172.21.15.61:47564) 2023-12-24T20:03:35.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.027+0000 7f93277fe700 1 -- 172.21.15.61:0/4126666703 learned_addr learned my addr 172.21.15.61:0/4126666703 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.027+0000 7f9327fff700 1 --2- 172.21.15.61:0/4126666703 >> v2:172.21.15.133:3300/0 conn(0x7f93280b2660 0x7f93280b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f93277fe700 1 -- 172.21.15.61:0/4126666703 >> v2:172.21.15.133:3300/0 conn(0x7f93280b2660 msgr2=0x7f93280b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f93277fe700 1 --2- 172.21.15.61:0/4126666703 >> v2:172.21.15.133:3300/0 conn(0x7f93280b2660 0x7f93280b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f93277fe700 1 -- 172.21.15.61:0/4126666703 >> v1:172.21.15.133:6789/0 conn(0x7f9328098aa0 legacy=0x7f932815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f93277fe700 1 -- 172.21.15.61:0/4126666703 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93280afe10 con 0x7f932815bb60 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f9327fff700 1 --2- 172.21.15.61:0/4126666703 >> v2:172.21.15.133:3300/0 conn(0x7f93280b2660 0x7f93280b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f93277fe700 1 --2- 172.21.15.61:0/4126666703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f932815bb60 0x7f9328098560 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f93280a9750 tx=0x7f9318009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4da102e1d53a21e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f93267fc700 1 -- 172.21.15.61:0/4126666703 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318005c10 con 0x7f932815bb60 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f93267fc700 1 -- 172.21.15.61:0/4126666703 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318005d70 con 0x7f932815bb60 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f93267fc700 1 -- 172.21.15.61:0/4126666703 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800b840 con 0x7f932815bb60 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f932e10c700 1 -- 172.21.15.61:0/4126666703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f932815bb60 msgr2=0x7f9328098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f932e10c700 1 --2- 172.21.15.61:0/4126666703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f932815bb60 0x7f9328098560 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f93280a9750 tx=0x7f9318009220 comp rx=0 tx=0).stop 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f932e10c700 1 -- 172.21.15.61:0/4126666703 shutdown_connections 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.028+0000 7f932e10c700 1 --2- 172.21.15.61:0/4126666703 >> v2:172.21.15.133:3300/0 conn(0x7f93280b2660 0x7f93280b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.029+0000 7f932e10c700 1 --2- 172.21.15.61:0/4126666703 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f932815bb60 0x7f9328098560 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.029+0000 7f932e10c700 1 -- 172.21.15.61:0/4126666703 >> 172.21.15.61:0/4126666703 conn(0x7f9328097a10 msgr2=0x7f93280ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:35.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.029+0000 7f932e10c700 1 -- 172.21.15.61:0/4126666703 shutdown_connections 2023-12-24T20:03:35.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.029+0000 7f932e10c700 1 -- 172.21.15.61:0/4126666703 wait complete. 2023-12-24T20:03:35.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.030+0000 7f932e10c700 1 Processor -- start 2023-12-24T20:03:35.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.030+0000 7f932e10c700 1 -- start start 2023-12-24T20:03:35.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.031+0000 7f932e10c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9328098aa0 0x7f9328144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.031+0000 7f932e10c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93280b2660 0x7f932815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.031+0000 7f932e10c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f932815bb60 0x7f93280aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.031+0000 7f932e10c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280aab90 con 0x7f9328098aa0 2023-12-24T20:03:35.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.031+0000 7f932e10c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93281581d0 con 0x7f93280b2660 2023-12-24T20:03:35.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.031+0000 7f932e10c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93280aadd0 con 0x7f932815bb60 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.031+0000 7f93277fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9328098aa0 0x7f9328144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.031+0000 7f93277fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9328098aa0 0x7f9328144600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47570/0 (socket says 172.21.15.61:47570) 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.031+0000 7f93277fe700 1 -- 172.21.15.61:0/1384196298 learned_addr learned my addr 172.21.15.61:0/1384196298 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f9327fff700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f932815bb60 0x7f93280aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f93277fe700 1 -- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f932815bb60 msgr2=0x7f93280aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f9326ffd700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93280b2660 0x7f932815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f93277fe700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f932815bb60 0x7f93280aa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f93277fe700 1 -- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93280b2660 msgr2=0x7f932815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f93277fe700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93280b2660 0x7f932815e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f93277fe700 1 -- 172.21.15.61:0/1384196298 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318009480 con 0x7f9328098aa0 2023-12-24T20:03:35.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f93277fe700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9328098aa0 0x7f9328144600 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f93180030c0 tx=0x7f9318015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:35.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f930f7fe700 1 -- 172.21.15.61:0/1384196298 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318011b70 con 0x7f9328098aa0 2023-12-24T20:03:35.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f930f7fe700 1 -- 172.21.15.61:0/1384196298 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318011cf0 con 0x7f9328098aa0 2023-12-24T20:03:35.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f932e10c700 1 -- 172.21.15.61:0/1384196298 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93280ab0b0 con 0x7f9328098aa0 2023-12-24T20:03:35.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f930f7fe700 1 -- 172.21.15.61:0/1384196298 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931801c670 con 0x7f9328098aa0 2023-12-24T20:03:35.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.032+0000 7f932e10c700 1 -- 172.21.15.61:0/1384196298 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93280ab670 con 0x7f9328098aa0 2023-12-24T20:03:35.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.033+0000 7f932e10c700 1 -- 172.21.15.61:0/1384196298 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932806d440 con 0x7f9328098aa0 2023-12-24T20:03:35.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.033+0000 7f930f7fe700 1 -- 172.21.15.61:0/1384196298 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f931801ca60 con 0x7f9328098aa0 2023-12-24T20:03:35.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.034+0000 7f930f7fe700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9314066f30 0x7f93140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.034+0000 7f930f7fe700 1 -- 172.21.15.61:0/1384196298 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9318085d80 con 0x7f9328098aa0 2023-12-24T20:03:35.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.034+0000 7f9326ffd700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9314066f30 0x7f93140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.035+0000 7f9326ffd700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9314066f30 0x7f93140693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f932806bad0 tx=0x7f931c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:35.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.038+0000 7f930f7fe700 1 -- 172.21.15.61:0/1384196298 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9318052ff0 con 0x7f9328098aa0 2023-12-24T20:03:35.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.277+0000 7f932e10c700 1 -- 172.21.15.61:0/1384196298 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f932804c3c0 con 0x7f9328098aa0 2023-12-24T20:03:35.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.278+0000 7f930f7fe700 1 -- 172.21.15.61:0/1384196298 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f9318011e60 con 0x7f9328098aa0 2023-12-24T20:03:35.279 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:35.279 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3245805399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3245805399},{"type":"v1","addr":"172.21.15.133:6837","nonce":3245805399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/4168448475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":4168448475},{"type":"v1","addr":"172.21.15.61:6835","nonce":4168448475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1817856586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1817856586},{"type":"v1","addr":"172.21.15.61:6834","nonce":1817856586}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:55.325289+0000","modified":"2023-12-24T20:02:58.932577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7089},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7089":{"gid":7089,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2704897796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2704897796},{"type":"v1","addr":"172.21.15.133:6836","nonce":2704897796}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 -- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9314066f30 msgr2=0x7f93140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9314066f30 0x7f93140693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f932806bad0 tx=0x7f931c009040 comp rx=0 tx=0).stop 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 -- 172.21.15.61:0/1384196298 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9328098aa0 msgr2=0x7f9328144600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9328098aa0 0x7f9328144600 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f93180030c0 tx=0x7f9318015000 comp rx=0 tx=0).stop 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 -- 172.21.15.61:0/1384196298 shutdown_connections 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f932815bb60 0x7f93280aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9314066f30 0x7f93140693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9328098aa0 0x7f9328144600 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 --2- 172.21.15.61:0/1384196298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93280b2660 0x7f932815e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 -- 172.21.15.61:0/1384196298 >> 172.21.15.61:0/1384196298 conn(0x7f9328097a10 msgr2=0x7f932809bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 -- 172.21.15.61:0/1384196298 shutdown_connections 2023-12-24T20:03:35.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.280+0000 7f932e10c700 1 -- 172.21.15.61:0/1384196298 wait complete. 2023-12-24T20:03:35.283 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 69 2023-12-24T20:03:35.294 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:35.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.414+0000 7fed73530700 1 Processor -- start 2023-12-24T20:03:35.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.414+0000 7fed73530700 1 -- start start 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed73530700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fed6c15bb60 0x7fed6c098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed73530700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 0x7fed6c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed73530700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c0b2eb0 con 0x7fed6c15c470 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed73530700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c0afc20 con 0x7fed6c15bb60 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed73530700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0b2bd0 con 0x7fed6c098aa0 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed712cc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fed6c15bb60 0x7fed6c098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed712cc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fed6c15bb60 0x7fed6c098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47586/0 (socket says 172.21.15.61:47586) 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed71acd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fed6c15c470 0x7fed6c0b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38436/0 (socket says 172.21.15.61:38436) 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed712cc700 1 -- 172.21.15.61:0/493195140 learned_addr learned my addr 172.21.15.61:0/493195140 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed70acb700 1 --2- 172.21.15.61:0/493195140 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 0x7fed6c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed712cc700 1 -- 172.21.15.61:0/493195140 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 msgr2=0x7fed6c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed712cc700 1 --2- 172.21.15.61:0/493195140 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 0x7fed6c15bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed712cc700 1 -- 172.21.15.61:0/493195140 >> v1:172.21.15.61:6789/0 conn(0x7fed6c15c470 legacy=0x7fed6c0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed63fff700 1 -- 172.21.15.61:0/493195140 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299967101 0 0) 0x7fed6c0b2eb0 con 0x7fed6c15c470 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.415+0000 7fed712cc700 1 -- 172.21.15.61:0/493195140 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c0afe10 con 0x7fed6c15bb60 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.416+0000 7fed712cc700 1 --2- 172.21.15.61:0/493195140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 0x7fed6c098560 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009990 tx=0x7fed5c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c325a9baaedccbc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.416+0000 7fed63fff700 1 -- 172.21.15.61:0/493195140 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c005c10 con 0x7fed6c15bb60 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.416+0000 7fed63fff700 1 -- 172.21.15.61:0/493195140 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c005d70 con 0x7fed6c15bb60 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.416+0000 7fed63fff700 1 -- 172.21.15.61:0/493195140 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c00b880 con 0x7fed6c15bb60 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.416+0000 7fed73530700 1 -- 172.21.15.61:0/493195140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 msgr2=0x7fed6c098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.416+0000 7fed73530700 1 --2- 172.21.15.61:0/493195140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 0x7fed6c098560 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009990 tx=0x7fed5c009220 comp rx=0 tx=0).stop 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.416+0000 7fed73530700 1 -- 172.21.15.61:0/493195140 shutdown_connections 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.416+0000 7fed73530700 1 --2- 172.21.15.61:0/493195140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 0x7fed6c098560 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.416+0000 7fed73530700 1 --2- 172.21.15.61:0/493195140 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 0x7fed6c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.416+0000 7fed73530700 1 -- 172.21.15.61:0/493195140 >> 172.21.15.61:0/493195140 conn(0x7fed6c097a10 msgr2=0x7fed6c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:35.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.417+0000 7fed73530700 1 -- 172.21.15.61:0/493195140 shutdown_connections 2023-12-24T20:03:35.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.417+0000 7fed73530700 1 -- 172.21.15.61:0/493195140 wait complete. 2023-12-24T20:03:35.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.418+0000 7fed73530700 1 Processor -- start 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.418+0000 7fed73530700 1 -- start start 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.418+0000 7fed73530700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 0x7fed6c0a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.418+0000 7fed73530700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 0x7fed6c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.418+0000 7fed73530700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed6c15c470 0x7fed6c06b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.418+0000 7fed73530700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0ab0c0 con 0x7fed6c15bb60 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.418+0000 7fed73530700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0aa1a0 con 0x7fed6c15c470 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.418+0000 7fed73530700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0aa480 con 0x7fed6c098aa0 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed70acb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 0x7fed6c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed70acb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 0x7fed6c156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47602/0 (socket says 172.21.15.61:47602) 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed70acb700 1 -- 172.21.15.61:0/1525015766 learned_addr learned my addr 172.21.15.61:0/1525015766 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed70acb700 1 -- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 msgr2=0x7fed6c0a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed712cc700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 0x7fed6c0a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed71acd700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed6c15c470 0x7fed6c06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed70acb700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 0x7fed6c0a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed70acb700 1 -- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed6c15c470 msgr2=0x7fed6c06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed70acb700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed6c15c470 0x7fed6c06b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed70acb700 1 -- 172.21.15.61:0/1525015766 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c009480 con 0x7fed6c15bb60 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed71acd700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed6c15c470 0x7fed6c06b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed712cc700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 0x7fed6c0a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed70acb700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 0x7fed6c156bf0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fed6800d890 tx=0x7fed68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed617fa700 1 -- 172.21.15.61:0/1525015766 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6800b600 con 0x7fed6c15bb60 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed617fa700 1 -- 172.21.15.61:0/1525015766 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6800b760 con 0x7fed6c15bb60 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed73530700 1 -- 172.21.15.61:0/1525015766 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c0aa760 con 0x7fed6c15bb60 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed617fa700 1 -- 172.21.15.61:0/1525015766 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6800bae0 con 0x7fed6c15bb60 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.419+0000 7fed73530700 1 -- 172.21.15.61:0/1525015766 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c16dd10 con 0x7fed6c15bb60 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.420+0000 7fed73530700 1 -- 172.21.15.61:0/1525015766 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c0ab3a0 con 0x7fed6c15bb60 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.421+0000 7fed617fa700 1 -- 172.21.15.61:0/1525015766 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fed6801e460 con 0x7fed6c15bb60 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.421+0000 7fed617fa700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed50066f30 0x7fed500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.421+0000 7fed617fa700 1 -- 172.21.15.61:0/1525015766 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed68084cb0 con 0x7fed6c15bb60 2023-12-24T20:03:35.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.422+0000 7fed712cc700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed50066f30 0x7fed500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.422+0000 7fed712cc700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed50066f30 0x7fed500693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009990 tx=0x7fed5c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:35.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.426+0000 7fed617fa700 1 -- 172.21.15.61:0/1525015766 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed68051e80 con 0x7fed6c15bb60 2023-12-24T20:03:35.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.667+0000 7fed73530700 1 -- 172.21.15.61:0/1525015766 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed6c0ab200 con 0x7fed6c15bb60 2023-12-24T20:03:35.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.667+0000 7fed617fa700 1 -- 172.21.15.61:0/1525015766 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fed6c0ab200 con 0x7fed6c15bb60 2023-12-24T20:03:35.669 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:35.669 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3245805399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3245805399},{"type":"v1","addr":"172.21.15.133:6837","nonce":3245805399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/4168448475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":4168448475},{"type":"v1","addr":"172.21.15.61:6835","nonce":4168448475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1817856586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1817856586},{"type":"v1","addr":"172.21.15.61:6834","nonce":1817856586}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:02:55.325289+0000","modified":"2023-12-24T20:02:58.932577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7089},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7089":{"gid":7089,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/2704897796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2704897796},{"type":"v1","addr":"172.21.15.133:6836","nonce":2704897796}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-12-24T20:03:35.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 -- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed50066f30 msgr2=0x7fed500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed50066f30 0x7fed500693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009990 tx=0x7fed5c016000 comp rx=0 tx=0).stop 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 -- 172.21.15.61:0/1525015766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 msgr2=0x7fed6c156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 0x7fed6c156bf0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fed6800d890 tx=0x7fed68008040 comp rx=0 tx=0).stop 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 -- 172.21.15.61:0/1525015766 shutdown_connections 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fed6c098aa0 0x7fed6c0a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fed50066f30 0x7fed500693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed6c15c470 0x7fed6c06b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 --2- 172.21.15.61:0/1525015766 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c15bb60 0x7fed6c156bf0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 -- 172.21.15.61:0/1525015766 >> 172.21.15.61:0/1525015766 conn(0x7fed6c097a10 msgr2=0x7fed6c157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 -- 172.21.15.61:0/1525015766 shutdown_connections 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.670+0000 7fed73530700 1 -- 172.21.15.61:0/1525015766 wait complete. 2023-12-24T20:03:35.672 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 69 2023-12-24T20:03:35.685 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:03:35.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.806+0000 7f958c1e2700 1 Processor -- start 2023-12-24T20:03:35.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.806+0000 7f958c1e2700 1 -- start start 2023-12-24T20:03:35.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958c1e2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 0x7f9584159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958c1e2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f95840caa80 0x7f95840aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958c1e2700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958406a630 con 0x7f9584159850 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958c1e2700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95840cccf0 con 0x7f95840caa80 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958c1e2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9584069d00 con 0x7f958406aac0 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958a77f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f95840caa80 0x7f95840aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f9589f7e700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9584159850 0x7f95840cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38450/0 (socket says 172.21.15.61:38450) 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f9589f7e700 1 -- 172.21.15.61:0/1433966693 learned_addr learned my addr 172.21.15.61:0/1433966693 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958a77f700 1 -- 172.21.15.61:0/1433966693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 msgr2=0x7f9584159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958977d700 1 --2- 172.21.15.61:0/1433966693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 0x7f9584159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958a77f700 1 --2- 172.21.15.61:0/1433966693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 0x7f9584159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f9588f7c700 1 -- 172.21.15.61:0/1433966693 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555069571 0 0) 0x7f958406a630 con 0x7f9584159850 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958a77f700 1 -- 172.21.15.61:0/1433966693 >> v1:172.21.15.61:6789/0 conn(0x7f9584159850 legacy=0x7f95840cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958a77f700 1 -- 172.21.15.61:0/1433966693 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584069fe0 con 0x7f95840caa80 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958977d700 1 --2- 172.21.15.61:0/1433966693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 0x7f9584159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.807+0000 7f958a77f700 1 --2- 172.21.15.61:0/1433966693 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95840caa80 0x7f95840aa880 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f957c009e60 tx=0x7f957c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8c02f239fec8d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f9588f7c700 1 -- 172.21.15.61:0/1433966693 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c00e070 con 0x7f95840caa80 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f9588f7c700 1 -- 172.21.15.61:0/1433966693 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c00bc30 con 0x7f95840caa80 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f9588f7c700 1 -- 172.21.15.61:0/1433966693 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c012430 con 0x7f95840caa80 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f958c1e2700 1 -- 172.21.15.61:0/1433966693 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95840caa80 msgr2=0x7f95840aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f958c1e2700 1 --2- 172.21.15.61:0/1433966693 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95840caa80 0x7f95840aa880 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f957c009e60 tx=0x7f957c009780 comp rx=0 tx=0).stop 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f958c1e2700 1 -- 172.21.15.61:0/1433966693 shutdown_connections 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f958c1e2700 1 --2- 172.21.15.61:0/1433966693 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95840caa80 0x7f95840aa880 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f958c1e2700 1 --2- 172.21.15.61:0/1433966693 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 0x7f9584159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f958c1e2700 1 -- 172.21.15.61:0/1433966693 >> 172.21.15.61:0/1433966693 conn(0x7f95840cceb0 msgr2=0x7f95840cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f958c1e2700 1 -- 172.21.15.61:0/1433966693 shutdown_connections 2023-12-24T20:03:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.808+0000 7f958c1e2700 1 -- 172.21.15.61:0/1433966693 wait complete. 2023-12-24T20:03:35.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.809+0000 7f958c1e2700 1 Processor -- start 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.809+0000 7f958c1e2700 1 -- start start 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958c1e2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 0x7f958415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958c1e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95840caa80 0x7f9584154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958c1e2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9584159850 0x7f95840b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958c1e2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9584155230 con 0x7f9584159850 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958c1e2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9584169940 con 0x7f95840caa80 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958c1e2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95840b0ec0 con 0x7f958406aac0 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958a77f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9584159850 0x7f95840b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958a77f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9584159850 0x7f95840b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47618/0 (socket says 172.21.15.61:47618) 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958a77f700 1 -- 172.21.15.61:0/3751936260 learned_addr learned my addr 172.21.15.61:0/3751936260 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f9589f7e700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 0x7f958415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958977d700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95840caa80 0x7f9584154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958a77f700 1 -- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 msgr2=0x7f958415c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958a77f700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 0x7f958415c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958a77f700 1 -- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95840caa80 msgr2=0x7f9584154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.810+0000 7f958a77f700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95840caa80 0x7f9584154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.811+0000 7f958a77f700 1 -- 172.21.15.61:0/3751936260 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c009a20 con 0x7f9584159850 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.811+0000 7f958977d700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95840caa80 0x7f9584154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.811+0000 7f958a77f700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9584159850 0x7f95840b0690 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f957c013000 tx=0x7f957c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.811+0000 7f9579ffb700 1 -- 172.21.15.61:0/3751936260 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c012e70 con 0x7f9584159850 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.811+0000 7f9579ffb700 1 -- 172.21.15.61:0/3751936260 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c01e630 con 0x7f9584159850 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.811+0000 7f958c1e2700 1 -- 172.21.15.61:0/3751936260 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95840b11a0 con 0x7f9584159850 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.811+0000 7f9579ffb700 1 -- 172.21.15.61:0/3751936260 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c01ea10 con 0x7f9584159850 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.811+0000 7f958c1e2700 1 -- 172.21.15.61:0/3751936260 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9584169c00 con 0x7f9584159850 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.812+0000 7f958c1e2700 1 -- 172.21.15.61:0/3751936260 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958404c3c0 con 0x7f9584159850 2023-12-24T20:03:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.813+0000 7f9579ffb700 1 -- 172.21.15.61:0/3751936260 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f957c024070 con 0x7f9584159850 2023-12-24T20:03:35.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.813+0000 7f9579ffb700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9568066f30 0x7f95680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:35.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.813+0000 7f9579ffb700 1 -- 172.21.15.61:0/3751936260 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f957c086d80 con 0x7f9584159850 2023-12-24T20:03:35.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.813+0000 7f9589f7e700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9568066f30 0x7f95680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:35.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.814+0000 7f9589f7e700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9568066f30 0x7f95680693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9580007160 tx=0x7f9580007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:35.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:35.818+0000 7f9579ffb700 1 -- 172.21.15.61:0/3751936260 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f957c053ff0 con 0x7f9584159850 2023-12-24T20:03:36.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.016+0000 7f958c1e2700 1 -- 172.21.15.61:0/3751936260 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9584169df0 con 0x7f9584159850 2023-12-24T20:03:36.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.017+0000 7f9579ffb700 1 -- 172.21.15.61:0/3751936260 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f957c057610 con 0x7f9584159850 2023-12-24T20:03:36.018 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:36.018 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":139,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:03:28.568537+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:02:53.096572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-24T20:02:54.304286+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:03:36.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.018+0000 7f958c1e2700 1 -- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9568066f30 msgr2=0x7f95680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.018+0000 7f958c1e2700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9568066f30 0x7f95680693e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9580007160 tx=0x7f9580007f50 comp rx=0 tx=0).stop 2023-12-24T20:03:36.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.018+0000 7f958c1e2700 1 -- 172.21.15.61:0/3751936260 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9584159850 msgr2=0x7f95840b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.018+0000 7f958c1e2700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9584159850 0x7f95840b0690 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f957c013000 tx=0x7f957c019000 comp rx=0 tx=0).stop 2023-12-24T20:03:36.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.019+0000 7f958c1e2700 1 -- 172.21.15.61:0/3751936260 shutdown_connections 2023-12-24T20:03:36.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.019+0000 7f958c1e2700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f958406aac0 0x7f958415c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.019+0000 7f958c1e2700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9568066f30 0x7f95680693e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.019+0000 7f958c1e2700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9584159850 0x7f95840b0690 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.019+0000 7f958c1e2700 1 --2- 172.21.15.61:0/3751936260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95840caa80 0x7f9584154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.019+0000 7f958c1e2700 1 -- 172.21.15.61:0/3751936260 >> 172.21.15.61:0/3751936260 conn(0x7f95840cceb0 msgr2=0x7f958406dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:36.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.019+0000 7f958c1e2700 1 -- 172.21.15.61:0/3751936260 shutdown_connections 2023-12-24T20:03:36.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.019+0000 7f958c1e2700 1 -- 172.21.15.61:0/3751936260 wait complete. 2023-12-24T20:03:36.032 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:03:36.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.153+0000 7fa5240a0700 1 Processor -- start 2023-12-24T20:03:36.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.153+0000 7fa5240a0700 1 -- start start 2023-12-24T20:03:36.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.154+0000 7fa5240a0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa51c159c40 0x7fa51c070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.154+0000 7fa5240a0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa51c070db0 0x7fa51c0c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.154+0000 7fa5240a0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c068d10 con 0x7fa51c0c4010 2023-12-24T20:03:36.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.154+0000 7fa5240a0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c067f10 con 0x7fa51c159c40 2023-12-24T20:03:36.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.154+0000 7fa5240a0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c068100 con 0x7fa51c070db0 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.154+0000 7fa521e3c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa51c159c40 0x7fa51c070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.154+0000 7fa52263d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa51c0c4010 0x7fa51c069b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38462/0 (socket says 172.21.15.61:38462) 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.154+0000 7fa52263d700 1 -- 172.21.15.61:0/1391645070 learned_addr learned my addr 172.21.15.61:0/1391645070 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.155+0000 7fa52163b700 1 --2- 172.21.15.61:0/1391645070 >> v2:172.21.15.133:3300/0 conn(0x7fa51c070db0 0x7fa51c0c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.155+0000 7fa521e3c700 1 -- 172.21.15.61:0/1391645070 >> v2:172.21.15.133:3300/0 conn(0x7fa51c070db0 msgr2=0x7fa51c0c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.155+0000 7fa521e3c700 1 --2- 172.21.15.61:0/1391645070 >> v2:172.21.15.133:3300/0 conn(0x7fa51c070db0 0x7fa51c0c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.155+0000 7fa521e3c700 1 -- 172.21.15.61:0/1391645070 >> v1:172.21.15.61:6789/0 conn(0x7fa51c0c4010 legacy=0x7fa51c069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.155+0000 7fa521e3c700 1 -- 172.21.15.61:0/1391645070 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0683e0 con 0x7fa51c159c40 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.155+0000 7fa520e3a700 1 -- 172.21.15.61:0/1391645070 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083452856 0 0) 0x7fa51c068d10 con 0x7fa51c0c4010 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.155+0000 7fa521e3c700 1 --2- 172.21.15.61:0/1391645070 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 0x7fa51c070870 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0b0160 tx=0x7fa50c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a876cbccfca38a40 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.155+0000 7fa520e3a700 1 -- 172.21.15.61:0/1391645070 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00b6b0 con 0x7fa51c159c40 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.155+0000 7fa520e3a700 1 -- 172.21.15.61:0/1391645070 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c00b810 con 0x7fa51c159c40 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.155+0000 7fa520e3a700 1 -- 172.21.15.61:0/1391645070 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00bbb0 con 0x7fa51c159c40 2023-12-24T20:03:36.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.156+0000 7fa5240a0700 1 -- 172.21.15.61:0/1391645070 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 msgr2=0x7fa51c070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.156+0000 7fa5240a0700 1 --2- 172.21.15.61:0/1391645070 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 0x7fa51c070870 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fa51c0b0160 tx=0x7fa50c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.156+0000 7fa5240a0700 1 -- 172.21.15.61:0/1391645070 shutdown_connections 2023-12-24T20:03:36.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.156+0000 7fa5240a0700 1 --2- 172.21.15.61:0/1391645070 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 0x7fa51c070870 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.156+0000 7fa5240a0700 1 --2- 172.21.15.61:0/1391645070 >> v2:172.21.15.133:3300/0 conn(0x7fa51c070db0 0x7fa51c0c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.156+0000 7fa5240a0700 1 -- 172.21.15.61:0/1391645070 >> 172.21.15.61:0/1391645070 conn(0x7fa51c0ce190 msgr2=0x7fa51c0ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:36.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.156+0000 7fa5240a0700 1 -- 172.21.15.61:0/1391645070 shutdown_connections 2023-12-24T20:03:36.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.156+0000 7fa5240a0700 1 -- 172.21.15.61:0/1391645070 wait complete. 2023-12-24T20:03:36.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.157+0000 7fa5240a0700 1 Processor -- start 2023-12-24T20:03:36.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.157+0000 7fa5240a0700 1 -- start start 2023-12-24T20:03:36.161 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa5240a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa51c070db0 0x7fa51c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa5240a0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa51c0c4010 0x7fa51c141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa5240a0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 0x7fa51c1422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa5240a0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0b1e20 con 0x7fa51c159c40 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa5240a0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0b2c30 con 0x7fa51c070db0 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa5240a0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0b2020 con 0x7fa51c0c4010 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa52263d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 0x7fa51c1422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa52263d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 0x7fa51c1422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47632/0 (socket says 172.21.15.61:47632) 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa52263d700 1 -- 172.21.15.61:0/2644977459 learned_addr learned my addr 172.21.15.61:0/2644977459 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa521e3c700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa51c070db0 0x7fa51c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa52163b700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa51c0c4010 0x7fa51c141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa52263d700 1 -- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa51c0c4010 msgr2=0x7fa51c141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa52263d700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa51c0c4010 0x7fa51c141d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa52263d700 1 -- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa51c070db0 msgr2=0x7fa51c0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa52263d700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa51c070db0 0x7fa51c0c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa52263d700 1 -- 172.21.15.61:0/2644977459 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c009420 con 0x7fa51c159c40 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa52263d700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 0x7fa51c1422a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa51400cc90 tx=0x7fa514001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa511ffb700 1 -- 172.21.15.61:0/2644977459 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51400a8b0 con 0x7fa51c159c40 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa511ffb700 1 -- 172.21.15.61:0/2644977459 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51400aa10 con 0x7fa51c159c40 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.158+0000 7fa5240a0700 1 -- 172.21.15.61:0/2644977459 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c0b2300 con 0x7fa51c159c40 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.159+0000 7fa511ffb700 1 -- 172.21.15.61:0/2644977459 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51400add0 con 0x7fa51c159c40 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.159+0000 7fa5240a0700 1 -- 172.21.15.61:0/2644977459 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c0b28c0 con 0x7fa51c159c40 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.160+0000 7fa5240a0700 1 -- 172.21.15.61:0/2644977459 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c0b2de0 con 0x7fa51c159c40 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.160+0000 7fa511ffb700 1 -- 172.21.15.61:0/2644977459 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa514007300 con 0x7fa51c159c40 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.160+0000 7fa511ffb700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa500066f30 0x7fa5000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.160+0000 7fa511ffb700 1 -- 172.21.15.61:0/2644977459 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa514084870 con 0x7fa51c159c40 2023-12-24T20:03:36.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.161+0000 7fa521e3c700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa500066f30 0x7fa5000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.161+0000 7fa521e3c700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa500066f30 0x7fa5000693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0093f0 tx=0x7fa50c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:36.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.165+0000 7fa511ffb700 1 -- 172.21.15.61:0/2644977459 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa514051b60 con 0x7fa51c159c40 2023-12-24T20:03:36.364 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:03:36.366 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:03:36.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.409+0000 7fa5240a0700 1 -- 172.21.15.61:0/2644977459 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa51c04c3c0 con 0x7fa51c159c40 2023-12-24T20:03:36.410 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:03:36.409+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:03:36.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.415+0000 7fa511ffb700 1 -- 172.21.15.61:0/2644977459 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa514055180 con 0x7fa51c159c40 2023-12-24T20:03:36.419 INFO:tasks.ceph.mds.b.smithi133.stderr: -7747> 2023-12-24T20:02:57.255+0000 7f59a4caf700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 -- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa500066f30 msgr2=0x7fa5000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa500066f30 0x7fa5000693e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0093f0 tx=0x7fa50c017000 comp rx=0 tx=0).stop 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 -- 172.21.15.61:0/2644977459 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 msgr2=0x7fa51c1422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 0x7fa51c1422a0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa51400cc90 tx=0x7fa514001a80 comp rx=0 tx=0).stop 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 -- 172.21.15.61:0/2644977459 shutdown_connections 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa500066f30 0x7fa5000693e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa51c159c40 0x7fa51c1422a0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa51c070db0 0x7fa51c0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 --2- 172.21.15.61:0/2644977459 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa51c0c4010 0x7fa51c141d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 -- 172.21.15.61:0/2644977459 >> 172.21.15.61:0/2644977459 conn(0x7fa51c0ce190 msgr2=0x7fa51c159110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 -- 172.21.15.61:0/2644977459 shutdown_connections 2023-12-24T20:03:36.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.418+0000 7fa5240a0700 1 -- 172.21.15.61:0/2644977459 wait complete. 2023-12-24T20:03:36.421 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:03:36.431 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:03:36.449 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T20:03:36.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7370f2a700 1 Processor -- start 2023-12-24T20:03:36.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7370f2a700 1 -- start start 2023-12-24T20:03:36.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7370f2a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f736c068c50 0x7f736c0af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7370f2a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f736c0c7db0 0x7f736c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7370f2a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f736c0b1b80 0x7f736c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7370f2a700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0aba10 con 0x7f736c0c7db0 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7370f2a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0abc60 con 0x7f736c0b1b80 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7370f2a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0abf40 con 0x7f736c068c50 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7369d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f736c0c7db0 0x7f736c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7369d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f736c0c7db0 0x7f736c0c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40428/0 (socket says 172.21.15.61:40428) 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7369d9b700 1 -- 172.21.15.61:0/4144242398 learned_addr learned my addr 172.21.15.61:0/4144242398 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f736ad9d700 1 --2- 172.21.15.61:0/4144242398 >> v2:172.21.15.133:3300/0 conn(0x7f736c0b1b80 0x7f736c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f736a59c700 1 --2- 172.21.15.61:0/4144242398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f736c068c50 0x7f736c0af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7369d9b700 1 -- 172.21.15.61:0/4144242398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f736c068c50 msgr2=0x7f736c0af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7369d9b700 1 --2- 172.21.15.61:0/4144242398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f736c068c50 0x7f736c0af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7369d9b700 1 -- 172.21.15.61:0/4144242398 >> v2:172.21.15.133:3300/0 conn(0x7f736c0b1b80 msgr2=0x7f736c0c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:36.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7369d9b700 1 --2- 172.21.15.61:0/4144242398 >> v2:172.21.15.133:3300/0 conn(0x7f736c0b1b80 0x7f736c0c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7369d9b700 1 -- 172.21.15.61:0/4144242398 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0ac220 con 0x7f736c0c7db0 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f736ad9d700 1 --2- 172.21.15.61:0/4144242398 >> v2:172.21.15.133:3300/0 conn(0x7f736c0b1b80 0x7f736c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f7369d9b700 1 --2- 172.21.15.61:0/4144242398 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c0c7db0 0x7f736c0c6b90 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f73600099b0 tx=0x7f7360009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf690af2150b41a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.556+0000 7f736959a700 1 -- 172.21.15.61:0/4144242398 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736000b820 con 0x7f736c0c7db0 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f736959a700 1 -- 172.21.15.61:0/4144242398 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736000b980 con 0x7f736c0c7db0 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f736959a700 1 -- 172.21.15.61:0/4144242398 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736000bd20 con 0x7f736c0c7db0 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f7370f2a700 1 -- 172.21.15.61:0/4144242398 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c0c7db0 msgr2=0x7f736c0c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f7370f2a700 1 --2- 172.21.15.61:0/4144242398 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c0c7db0 0x7f736c0c6b90 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f73600099b0 tx=0x7f7360009250 comp rx=0 tx=0).stop 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f7370f2a700 1 -- 172.21.15.61:0/4144242398 shutdown_connections 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f7370f2a700 1 --2- 172.21.15.61:0/4144242398 >> v2:172.21.15.133:3300/0 conn(0x7f736c0b1b80 0x7f736c0c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f7370f2a700 1 --2- 172.21.15.61:0/4144242398 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f736c068c50 0x7f736c0af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f7370f2a700 1 --2- 172.21.15.61:0/4144242398 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c0c7db0 0x7f736c0c6b90 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f7370f2a700 1 -- 172.21.15.61:0/4144242398 >> 172.21.15.61:0/4144242398 conn(0x7f736c067550 msgr2=0x7f736c067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f7370f2a700 1 -- 172.21.15.61:0/4144242398 shutdown_connections 2023-12-24T20:03:36.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.557+0000 7f7370f2a700 1 -- 172.21.15.61:0/4144242398 wait complete. 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.558+0000 7f7370f2a700 1 Processor -- start 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.558+0000 7f7370f2a700 1 -- start start 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f7370f2a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c068c50 0x7f736c159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f7370f2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0b1b80 0x7f736c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f7370f2a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f736c0c7db0 0x7f736c1479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f7370f2a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c15a3b0 con 0x7f736c068c50 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f7370f2a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c1597a0 con 0x7f736c0b1b80 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f7370f2a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c159a80 con 0x7f736c0c7db0 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f736a59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c068c50 0x7f736c159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f736a59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c068c50 0x7f736c159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40438/0 (socket says 172.21.15.61:40438) 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f736a59c700 1 -- 172.21.15.61:0/1801854543 learned_addr learned my addr 172.21.15.61:0/1801854543 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f7369d9b700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0b1b80 0x7f736c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f736a59c700 1 -- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f736c0c7db0 msgr2=0x7f736c1479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f736a59c700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f736c0c7db0 0x7f736c1479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f736a59c700 1 -- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0b1b80 msgr2=0x7f736c156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f736a59c700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0b1b80 0x7f736c156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f736a59c700 1 -- 172.21.15.61:0/1801854543 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600094f0 con 0x7f736c068c50 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.559+0000 7f7369d9b700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0b1b80 0x7f736c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.560+0000 7f736a59c700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c068c50 0x7f736c159100 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f735c00c7d0 tx=0x7f735c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.560+0000 7f735a7fc700 1 -- 172.21.15.61:0/1801854543 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c011600 con 0x7f736c068c50 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.560+0000 7f735a7fc700 1 -- 172.21.15.61:0/1801854543 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c011760 con 0x7f736c068c50 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.560+0000 7f7370f2a700 1 -- 172.21.15.61:0/1801854543 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c159d60 con 0x7f736c068c50 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.560+0000 7f735a7fc700 1 -- 172.21.15.61:0/1801854543 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c011b20 con 0x7f736c068c50 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.560+0000 7f7370f2a700 1 -- 172.21.15.61:0/1801854543 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c157140 con 0x7f736c068c50 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.561+0000 7f7370f2a700 1 -- 172.21.15.61:0/1801854543 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c04c3c0 con 0x7f736c068c50 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.561+0000 7f735a7fc700 1 -- 172.21.15.61:0/1801854543 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f735c0193f0 con 0x7f736c068c50 2023-12-24T20:03:36.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.562+0000 7f735a7fc700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f734c066f30 0x7f734c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:36.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.562+0000 7f735a7fc700 1 -- 172.21.15.61:0/1801854543 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f735c084980 con 0x7f736c068c50 2023-12-24T20:03:36.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.562+0000 7f7369d9b700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f734c066f30 0x7f734c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:36.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.562+0000 7f7369d9b700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f734c066f30 0x7f734c0693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f73600099b0 tx=0x7f7360017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:36.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.567+0000 7f735a7fc700 1 -- 172.21.15.61:0/1801854543 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f735c051ba0 con 0x7f736c068c50 2023-12-24T20:03:36.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:36.814+0000 7f7370f2a700 1 -- 172.21.15.61:0/1801854543 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f736c0ac500 con 0x7f736c068c50 2023-12-24T20:03:37.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.415+0000 7f735a7fc700 1 -- 172.21.15.61:0/1801854543 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) v1 ==== 104+0+0 (secure 0 0 0) 0x7f735c0551c0 con 0x7f736c068c50 2023-12-24T20:03:37.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 -- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f734c066f30 msgr2=0x7f734c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:37.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f734c066f30 0x7f734c0693e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f73600099b0 tx=0x7f7360017000 comp rx=0 tx=0).stop 2023-12-24T20:03:37.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 -- 172.21.15.61:0/1801854543 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c068c50 msgr2=0x7f736c159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:37.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c068c50 0x7f736c159100 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f735c00c7d0 tx=0x7f735c008040 comp rx=0 tx=0).stop 2023-12-24T20:03:37.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 -- 172.21.15.61:0/1801854543 shutdown_connections 2023-12-24T20:03:37.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f736c0c7db0 0x7f736c1479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:37.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f734c066f30 0x7f734c0693e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:37.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f736c068c50 0x7f736c159100 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:37.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 --2- 172.21.15.61:0/1801854543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f736c0b1b80 0x7f736c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:37.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 -- 172.21.15.61:0/1801854543 >> 172.21.15.61:0/1801854543 conn(0x7f736c067550 msgr2=0x7f736c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:37.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 -- 172.21.15.61:0/1801854543 shutdown_connections 2023-12-24T20:03:37.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.418+0000 7f7370f2a700 1 -- 172.21.15.61:0/1801854543 wait complete. 2023-12-24T20:03:37.433 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:03:37.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.563+0000 7f76704cc700 1 Processor -- start 2023-12-24T20:03:37.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.563+0000 7f76704cc700 1 -- start start 2023-12-24T20:03:37.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f76704cc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7668157730 0x7f76680aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f76704cc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7668157b00 0x7f76680ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f76704cc700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76680adb50 con 0x7f7668063ac0 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f76704cc700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76680adda0 con 0x7f7668157730 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f76704cc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76680ae080 con 0x7f7668157b00 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f766e268700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7668157730 0x7f76680aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f766ea69700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7668063ac0 0x7f76680b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60684/0 (socket says 172.21.15.61:60684) 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f766ea69700 1 -- 172.21.15.61:0/2007840101 learned_addr learned my addr 172.21.15.61:0/2007840101 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f766da67700 1 --2- 172.21.15.61:0/2007840101 >> v2:172.21.15.133:3300/0 conn(0x7f7668157b00 0x7f76680ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f766e268700 1 -- 172.21.15.61:0/2007840101 >> v2:172.21.15.133:3300/0 conn(0x7f7668157b00 msgr2=0x7f76680ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f766e268700 1 --2- 172.21.15.61:0/2007840101 >> v2:172.21.15.133:3300/0 conn(0x7f7668157b00 0x7f76680ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f766e268700 1 -- 172.21.15.61:0/2007840101 >> v1:172.21.15.61:6789/0 conn(0x7f7668063ac0 legacy=0x7f76680b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f766e268700 1 -- 172.21.15.61:0/2007840101 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680ae360 con 0x7f7668157730 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.564+0000 7f766e268700 1 --2- 172.21.15.61:0/2007840101 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668157730 0x7f76680aeb60 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7668157f80 tx=0x7f76640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0dd383013b6349b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:37.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f766d266700 1 -- 172.21.15.61:0/2007840101 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400b6b0 con 0x7f7668157730 2023-12-24T20:03:37.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f766d266700 1 -- 172.21.15.61:0/2007840101 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766400b810 con 0x7f7668157730 2023-12-24T20:03:37.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f766d266700 1 -- 172.21.15.61:0/2007840101 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766400bbb0 con 0x7f7668157730 2023-12-24T20:03:37.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f76704cc700 1 -- 172.21.15.61:0/2007840101 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668157730 msgr2=0x7f76680aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:37.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f76704cc700 1 --2- 172.21.15.61:0/2007840101 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668157730 0x7f76680aeb60 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7668157f80 tx=0x7f76640091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:37.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f76704cc700 1 -- 172.21.15.61:0/2007840101 shutdown_connections 2023-12-24T20:03:37.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f76704cc700 1 --2- 172.21.15.61:0/2007840101 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668157730 0x7f76680aeb60 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:37.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f76704cc700 1 --2- 172.21.15.61:0/2007840101 >> v2:172.21.15.133:3300/0 conn(0x7f7668157b00 0x7f76680ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:37.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f76704cc700 1 -- 172.21.15.61:0/2007840101 >> 172.21.15.61:0/2007840101 conn(0x7f7668067fd0 msgr2=0x7f76680cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:37.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f76704cc700 1 -- 172.21.15.61:0/2007840101 shutdown_connections 2023-12-24T20:03:37.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.565+0000 7f76704cc700 1 -- 172.21.15.61:0/2007840101 wait complete. 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.567+0000 7f76704cc700 1 Processor -- start 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.567+0000 7f76704cc700 1 -- start start 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f76704cc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668063ac0 0x7f7668143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f76704cc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7668157730 0x7f76680b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f76704cc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7668157b00 0x7f766815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f76704cc700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76680b0820 con 0x7f7668063ac0 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f76704cc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76680b10c0 con 0x7f7668157b00 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f76704cc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7668143e80 con 0x7f7668157730 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766e268700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668063ac0 0x7f7668143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766e268700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668063ac0 0x7f7668143940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40460/0 (socket says 172.21.15.61:40460) 2023-12-24T20:03:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766e268700 1 -- 172.21.15.61:0/1833389580 learned_addr learned my addr 172.21.15.61:0/1833389580 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766ea69700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7668157b00 0x7f766815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766e268700 1 -- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7668157730 msgr2=0x7f76680b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766e268700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7668157730 0x7f76680b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766e268700 1 -- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7668157b00 msgr2=0x7f766815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766e268700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7668157b00 0x7f766815c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766e268700 1 -- 172.21.15.61:0/1833389580 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7664009420 con 0x7f7668063ac0 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766ea69700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7668157b00 0x7f766815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f766e268700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668063ac0 0x7f7668143940 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7668064bb0 tx=0x7f7664017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f765e7fc700 1 -- 172.21.15.61:0/1833389580 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664011420 con 0x7f7668063ac0 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.568+0000 7f765e7fc700 1 -- 172.21.15.61:0/1833389580 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7664011580 con 0x7f7668063ac0 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.569+0000 7f76704cc700 1 -- 172.21.15.61:0/1833389580 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766815cdd0 con 0x7f7668063ac0 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.569+0000 7f765e7fc700 1 -- 172.21.15.61:0/1833389580 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664011940 con 0x7f7668063ac0 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.569+0000 7f76704cc700 1 -- 172.21.15.61:0/1833389580 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76680b0d50 con 0x7f7668063ac0 2023-12-24T20:03:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.569+0000 7f76704cc700 1 -- 172.21.15.61:0/1833389580 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766804c3c0 con 0x7f7668063ac0 2023-12-24T20:03:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.570+0000 7f765e7fc700 1 -- 172.21.15.61:0/1833389580 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7664011d30 con 0x7f7668063ac0 2023-12-24T20:03:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.570+0000 7f765e7fc700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f764c066f30 0x7f764c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.570+0000 7f765e7fc700 1 -- 172.21.15.61:0/1833389580 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f7664085ab0 con 0x7f7668063ac0 2023-12-24T20:03:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.571+0000 7f766da67700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f764c066f30 0x7f764c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.571+0000 7f766da67700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f764c066f30 0x7f764c0693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f76680cbd30 tx=0x7f7658008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:37.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.574+0000 7f765e7fc700 1 -- 172.21.15.61:0/1833389580 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7664052cd0 con 0x7f7668063ac0 2023-12-24T20:03:37.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:37.770+0000 7f76704cc700 1 -- 172.21.15.61:0/1833389580 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f766806f420 con 0x7f7668063ac0 2023-12-24T20:03:38.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.574+0000 7f765e7fc700 1 -- 172.21.15.61:0/1833389580 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v141) v1 ==== 181+0+0 (secure 0 0 0) 0x7f76640150d0 con 0x7f7668063ac0 2023-12-24T20:03:38.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 -- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f764c066f30 msgr2=0x7f764c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:38.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f764c066f30 0x7f764c0693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f76680cbd30 tx=0x7f7658008040 comp rx=0 tx=0).stop 2023-12-24T20:03:38.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 -- 172.21.15.61:0/1833389580 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668063ac0 msgr2=0x7f7668143940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:38.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668063ac0 0x7f7668143940 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f7668064bb0 tx=0x7f7664017000 comp rx=0 tx=0).stop 2023-12-24T20:03:38.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 -- 172.21.15.61:0/1833389580 shutdown_connections 2023-12-24T20:03:38.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f764c066f30 0x7f764c0693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7668157b00 0x7f766815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7668063ac0 0x7f7668143940 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 --2- 172.21.15.61:0/1833389580 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7668157730 0x7f76680b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 -- 172.21.15.61:0/1833389580 >> 172.21.15.61:0/1833389580 conn(0x7f7668067fd0 msgr2=0x7f766806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:38.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 -- 172.21.15.61:0/1833389580 shutdown_connections 2023-12-24T20:03:38.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.579+0000 7f76704cc700 1 -- 172.21.15.61:0/1833389580 wait complete. 2023-12-24T20:03:38.580 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:03:38.595 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:03:38.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.730+0000 7f650ae90700 1 Processor -- start 2023-12-24T20:03:38.731 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.731+0000 7f650ae90700 1 -- start start 2023-12-24T20:03:38.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.731+0000 7f650ae90700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f65041566c0 0x7f65040cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:38.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.731+0000 7f650ae90700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65040cc240 0x7f6504156a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.731+0000 7f650ae90700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6504156fd0 0x7f6504157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.731+0000 7f650ae90700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6504157da0 con 0x7f65041566c0 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.731+0000 7f650ae90700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6504068ee0 con 0x7f6504156fd0 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.731+0000 7f650ae90700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65040682d0 con 0x7f65040cc240 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f6508c2c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f65041566c0 0x7f65040cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f6508c2c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f65041566c0 0x7f65040cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40474/0 (socket says 172.21.15.61:40474) 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f6508c2c700 1 -- 172.21.15.61:0/530853411 learned_addr learned my addr 172.21.15.61:0/530853411 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f650942d700 1 --2- 172.21.15.61:0/530853411 >> v2:172.21.15.133:3300/0 conn(0x7f6504156fd0 0x7f6504157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f6503fff700 1 --2- 172.21.15.61:0/530853411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65040cc240 0x7f6504156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f6508c2c700 1 -- 172.21.15.61:0/530853411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65040cc240 msgr2=0x7f6504156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f6508c2c700 1 --2- 172.21.15.61:0/530853411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65040cc240 0x7f6504156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f6508c2c700 1 -- 172.21.15.61:0/530853411 >> v2:172.21.15.133:3300/0 conn(0x7f6504156fd0 msgr2=0x7f6504157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:38.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f6508c2c700 1 --2- 172.21.15.61:0/530853411 >> v2:172.21.15.133:3300/0 conn(0x7f6504156fd0 0x7f6504157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f6508c2c700 1 -- 172.21.15.61:0/530853411 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65040685b0 con 0x7f65041566c0 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f6508c2c700 1 --2- 172.21.15.61:0/530853411 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65041566c0 0x7f65040cbd00 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f6504157f60 tx=0x7f64f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296ada3da6b2d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f65037fe700 1 -- 172.21.15.61:0/530853411 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f800b860 con 0x7f65041566c0 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f65037fe700 1 -- 172.21.15.61:0/530853411 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f800b9c0 con 0x7f65041566c0 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.732+0000 7f65037fe700 1 -- 172.21.15.61:0/530853411 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f800bd60 con 0x7f65041566c0 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.733+0000 7f650ae90700 1 -- 172.21.15.61:0/530853411 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65041566c0 msgr2=0x7f65040cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.733+0000 7f650ae90700 1 --2- 172.21.15.61:0/530853411 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65041566c0 0x7f65040cbd00 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f6504157f60 tx=0x7f64f8009250 comp rx=0 tx=0).stop 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.733+0000 7f650ae90700 1 -- 172.21.15.61:0/530853411 shutdown_connections 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.733+0000 7f650ae90700 1 --2- 172.21.15.61:0/530853411 >> v2:172.21.15.133:3300/0 conn(0x7f6504156fd0 0x7f6504157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.733+0000 7f650ae90700 1 --2- 172.21.15.61:0/530853411 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f65041566c0 0x7f65040cbd00 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.733+0000 7f650ae90700 1 --2- 172.21.15.61:0/530853411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65040cc240 0x7f6504156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.733+0000 7f650ae90700 1 -- 172.21.15.61:0/530853411 >> 172.21.15.61:0/530853411 conn(0x7f65040ca1e0 msgr2=0x7f65040ca5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:38.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.733+0000 7f650ae90700 1 -- 172.21.15.61:0/530853411 shutdown_connections 2023-12-24T20:03:38.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.733+0000 7f650ae90700 1 -- 172.21.15.61:0/530853411 wait complete. 2023-12-24T20:03:38.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.734+0000 7f650ae90700 1 Processor -- start 2023-12-24T20:03:38.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.734+0000 7f650ae90700 1 -- start start 2023-12-24T20:03:38.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650ae90700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65040cc240 0x7f650414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:38.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650ae90700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65041566c0 0x7f6504141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:38.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650ae90700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6504156fd0 0x7f6504141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:38.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650ae90700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6504140b90 con 0x7f6504156fd0 2023-12-24T20:03:38.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650ae90700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650413ff80 con 0x7f65041566c0 2023-12-24T20:03:38.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650ae90700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6504140260 con 0x7f65040cc240 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650942d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6504156fd0 0x7f6504141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650942d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6504156fd0 0x7f6504141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40478/0 (socket says 172.21.15.61:40478) 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650942d700 1 -- 172.21.15.61:0/264903849 learned_addr learned my addr 172.21.15.61:0/264903849 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f6508c2c700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65040cc240 0x7f650414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f6503fff700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65041566c0 0x7f6504141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650942d700 1 -- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65040cc240 msgr2=0x7f650414aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650942d700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65040cc240 0x7f650414aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650942d700 1 -- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65041566c0 msgr2=0x7f6504141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650942d700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65041566c0 0x7f6504141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650942d700 1 -- 172.21.15.61:0/264903849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80094f0 con 0x7f6504156fd0 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.735+0000 7f650942d700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6504156fd0 0x7f6504141fd0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f64fc007f20 tx=0x7f64fc009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.736+0000 7f6500ff9700 1 -- 172.21.15.61:0/264903849 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc00eb90 con 0x7f6504156fd0 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.736+0000 7f6500ff9700 1 -- 172.21.15.61:0/264903849 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc00ed10 con 0x7f6504156fd0 2023-12-24T20:03:38.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.736+0000 7f650ae90700 1 -- 172.21.15.61:0/264903849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6504140540 con 0x7f6504156fd0 2023-12-24T20:03:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.736+0000 7f6500ff9700 1 -- 172.21.15.61:0/264903849 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc014670 con 0x7f6504156fd0 2023-12-24T20:03:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.736+0000 7f650ae90700 1 -- 172.21.15.61:0/264903849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65041415a0 con 0x7f6504156fd0 2023-12-24T20:03:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.737+0000 7f650ae90700 1 -- 172.21.15.61:0/264903849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6504140d40 con 0x7f6504156fd0 2023-12-24T20:03:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.737+0000 7f6500ff9700 1 -- 172.21.15.61:0/264903849 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f64fc0149e0 con 0x7f6504156fd0 2023-12-24T20:03:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.737+0000 7f6500ff9700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f64e8066f30 0x7f64e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.738+0000 7f6500ff9700 1 -- 172.21.15.61:0/264903849 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f64fc084a20 con 0x7f6504156fd0 2023-12-24T20:03:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.738+0000 7f6500ff9700 1 -- 172.21.15.61:0/264903849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7f64e806dcf0 con 0x7f6504156fd0 2023-12-24T20:03:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.738+0000 7f6508c2c700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f64e8066f30 0x7f64e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:38.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.738+0000 7f6508c2c700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f64e8066f30 0x7f64e80693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6504157f60 tx=0x7f64f8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:38.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.742+0000 7f6500ff9700 1 -- 172.21.15.61:0/264903849 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6504140d40 con 0x7f6504156fd0 2023-12-24T20:03:38.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:38.936+0000 7f650ae90700 1 -- 172.21.15.61:0/264903849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f650404c3c0 con 0x7f6504156fd0 2023-12-24T20:03:39.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.663+0000 7f6500ff9700 1 -- 172.21.15.61:0/264903849 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(142..142 src has 1..142) v4 ==== 288+0+0 (secure 0 0 0) 0x7f64fc056110 con 0x7f6504156fd0 2023-12-24T20:03:39.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.663+0000 7f6500ff9700 1 -- 172.21.15.61:0/264903849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7f64e806ca80 con 0x7f6504156fd0 2023-12-24T20:03:39.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.666+0000 7f6500ff9700 1 -- 172.21.15.61:0/264903849 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v142) v1 ==== 169+0+0 (secure 0 0 0) 0x7f64fc051d50 con 0x7f6504156fd0 2023-12-24T20:03:39.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.672+0000 7f650ae90700 1 -- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f64e8066f30 msgr2=0x7f64e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:39.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.672+0000 7f650ae90700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f64e8066f30 0x7f64e80693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6504157f60 tx=0x7f64f8017000 comp rx=0 tx=0).stop 2023-12-24T20:03:39.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.672+0000 7f650ae90700 1 -- 172.21.15.61:0/264903849 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6504156fd0 msgr2=0x7f6504141fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:39.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.672+0000 7f650ae90700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6504156fd0 0x7f6504141fd0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f64fc007f20 tx=0x7f64fc009860 comp rx=0 tx=0).stop 2023-12-24T20:03:39.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.672+0000 7f650ae90700 1 -- 172.21.15.61:0/264903849 shutdown_connections 2023-12-24T20:03:39.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.672+0000 7f650ae90700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f65040cc240 0x7f650414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:39.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.672+0000 7f650ae90700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f64e8066f30 0x7f64e80693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:39.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.672+0000 7f650ae90700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6504156fd0 0x7f6504141fd0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:39.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.672+0000 7f650ae90700 1 --2- 172.21.15.61:0/264903849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65041566c0 0x7f6504141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:39.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.672+0000 7f650ae90700 1 -- 172.21.15.61:0/264903849 >> 172.21.15.61:0/264903849 conn(0x7f65040ca1e0 msgr2=0x7f6504067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:39.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.673+0000 7f650ae90700 1 -- 172.21.15.61:0/264903849 shutdown_connections 2023-12-24T20:03:39.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.673+0000 7f650ae90700 1 -- 172.21.15.61:0/264903849 wait complete. 2023-12-24T20:03:39.674 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T20:03:39.690 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:03:39.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.821+0000 7f7974aeb700 1 Processor -- start 2023-12-24T20:03:39.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.821+0000 7f7974aeb700 1 -- start start 2023-12-24T20:03:39.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f7974aeb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f797015a030 0x7f7970070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:39.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f7974aeb700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7970068b10 0x7f7970070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:39.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f7974aeb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79700c4710 con 0x7f7970159c60 2023-12-24T20:03:39.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f7974aeb700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797006b190 con 0x7f7970068b10 2023-12-24T20:03:39.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f7974aeb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797006a5c0 con 0x7f797015a030 2023-12-24T20:03:39.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f796ed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7970068b10 0x7f7970070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:39.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f796ed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7970068b10 0x7f7970070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40486/0 (socket says 172.21.15.61:40486) 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f796ed9d700 1 -- 172.21.15.61:0/3224596301 learned_addr learned my addr 172.21.15.61:0/3224596301 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f796dd9b700 1 --2- 172.21.15.61:0/3224596301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f797015a030 0x7f7970070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f796ed9d700 1 -- 172.21.15.61:0/3224596301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f797015a030 msgr2=0x7f7970070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f796ed9d700 1 --2- 172.21.15.61:0/3224596301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f797015a030 0x7f7970070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f796ed9d700 1 -- 172.21.15.61:0/3224596301 >> v1:172.21.15.133:6789/0 conn(0x7f7970159c60 legacy=0x7f79700c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f796ed9d700 1 -- 172.21.15.61:0/3224596301 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797006a860 con 0x7f7970068b10 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.822+0000 7f796ed9d700 1 --2- 172.21.15.61:0/3224596301 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970068b10 0x7f7970070b80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f7968009f20 tx=0x7f7968009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe7e24779d5d3b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f796d59a700 1 -- 172.21.15.61:0/3224596301 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800e070 con 0x7f7970068b10 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f796d59a700 1 -- 172.21.15.61:0/3224596301 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796800ba40 con 0x7f7970068b10 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f796d59a700 1 -- 172.21.15.61:0/3224596301 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79680092e0 con 0x7f7970068b10 2023-12-24T20:03:39.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f7974aeb700 1 -- 172.21.15.61:0/3224596301 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970068b10 msgr2=0x7f7970070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:39.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f7974aeb700 1 --2- 172.21.15.61:0/3224596301 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970068b10 0x7f7970070b80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f7968009f20 tx=0x7f7968009840 comp rx=0 tx=0).stop 2023-12-24T20:03:39.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f7974aeb700 1 -- 172.21.15.61:0/3224596301 shutdown_connections 2023-12-24T20:03:39.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f7974aeb700 1 --2- 172.21.15.61:0/3224596301 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970068b10 0x7f7970070b80 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:39.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f7974aeb700 1 --2- 172.21.15.61:0/3224596301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f797015a030 0x7f7970070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:39.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f7974aeb700 1 -- 172.21.15.61:0/3224596301 >> 172.21.15.61:0/3224596301 conn(0x7f79700ce420 msgr2=0x7f79700ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:39.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f7974aeb700 1 -- 172.21.15.61:0/3224596301 shutdown_connections 2023-12-24T20:03:39.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.823+0000 7f7974aeb700 1 -- 172.21.15.61:0/3224596301 wait complete. 2023-12-24T20:03:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.824+0000 7f7974aeb700 1 Processor -- start 2023-12-24T20:03:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.824+0000 7f7974aeb700 1 -- start start 2023-12-24T20:03:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.825+0000 7f7974aeb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7970068b10 0x7f797016e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.825+0000 7f7974aeb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970159c60 0x7f79700b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.825+0000 7f7974aeb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f797015a030 0x7f7970142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.825+0000 7f7974aeb700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797016e610 con 0x7f7970159c60 2023-12-24T20:03:39.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.825+0000 7f7974aeb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79700b1b60 con 0x7f7970068b10 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.825+0000 7f7974aeb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79700b0cd0 con 0x7f797015a030 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.825+0000 7f796dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970159c60 0x7f79700b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.825+0000 7f796dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970159c60 0x7f79700b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40494/0 (socket says 172.21.15.61:40494) 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.825+0000 7f796dd9b700 1 -- 172.21.15.61:0/928540615 learned_addr learned my addr 172.21.15.61:0/928540615 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f796dd9b700 1 -- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f797015a030 msgr2=0x7f7970142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f796dd9b700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f797015a030 0x7f7970142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f796dd9b700 1 -- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7970068b10 msgr2=0x7f797016e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f796e59c700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7970068b10 0x7f797016e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f796dd9b700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7970068b10 0x7f797016e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f796dd9b700 1 -- 172.21.15.61:0/928540615 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7968009ae0 con 0x7f7970159c60 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f796e59c700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7970068b10 0x7f797016e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:39.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f796dd9b700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970159c60 0x7f79700b0790 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f796400c830 tx=0x7f7964008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f795e7fc700 1 -- 172.21.15.61:0/928540615 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964011600 con 0x7f7970159c60 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f795e7fc700 1 -- 172.21.15.61:0/928540615 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7964011760 con 0x7f7970159c60 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f795e7fc700 1 -- 172.21.15.61:0/928540615 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964011b20 con 0x7f7970159c60 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f7974aeb700 1 -- 172.21.15.61:0/928540615 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79701434b0 con 0x7f7970159c60 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.826+0000 7f7974aeb700 1 -- 172.21.15.61:0/928540615 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79700b1230 con 0x7f7970159c60 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.827+0000 7f7974aeb700 1 -- 172.21.15.61:0/928540615 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79700c36a0 con 0x7f7970159c60 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.827+0000 7f795e7fc700 1 -- 172.21.15.61:0/928540615 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f79640193f0 con 0x7f7970159c60 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.828+0000 7f795e7fc700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7950066f30 0x7f79500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.828+0000 7f795e7fc700 1 -- 172.21.15.61:0/928540615 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7964084630 con 0x7f7970159c60 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.828+0000 7f796e59c700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7950066f30 0x7f79500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:39.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.829+0000 7f796e59c700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7950066f30 0x7f79500693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7960002880 tx=0x7f7960009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:39.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:39.832+0000 7f795e7fc700 1 -- 172.21.15.61:0/928540615 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7964051ba0 con 0x7f7970159c60 2023-12-24T20:03:40.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.030+0000 7f7974aeb700 1 -- 172.21.15.61:0/928540615 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f797004c3c0 con 0x7f7970159c60 2023-12-24T20:03:40.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.034+0000 7f795e7fc700 1 -- 172.21.15.61:0/928540615 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f79640551c0 con 0x7f7970159c60 2023-12-24T20:03:40.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 -- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7950066f30 msgr2=0x7f79500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7950066f30 0x7f79500693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7960002880 tx=0x7f7960009040 comp rx=0 tx=0).stop 2023-12-24T20:03:40.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 -- 172.21.15.61:0/928540615 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970159c60 msgr2=0x7f79700b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970159c60 0x7f79700b0790 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f796400c830 tx=0x7f7964008040 comp rx=0 tx=0).stop 2023-12-24T20:03:40.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 -- 172.21.15.61:0/928540615 shutdown_connections 2023-12-24T20:03:40.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f797015a030 0x7f7970142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7950066f30 0x7f79500693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7970068b10 0x7f797016e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 --2- 172.21.15.61:0/928540615 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7970159c60 0x7f79700b0790 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 -- 172.21.15.61:0/928540615 >> 172.21.15.61:0/928540615 conn(0x7f79700ce420 msgr2=0x7f79701594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:40.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 -- 172.21.15.61:0/928540615 shutdown_connections 2023-12-24T20:03:40.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.036+0000 7f7974aeb700 1 -- 172.21.15.61:0/928540615 wait complete. 2023-12-24T20:03:40.049 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-12-24T20:03:40.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.170+0000 7f96d7fe2700 1 Processor -- start 2023-12-24T20:03:40.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.170+0000 7f96d7fe2700 1 -- start start 2023-12-24T20:03:40.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.171+0000 7f96d7fe2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96d0068140 0x7f96d00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.171+0000 7f96d7fe2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0159a60 0x7f96d0159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.171+0000 7f96d7fe2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d00b2890 con 0x7f96d0068510 2023-12-24T20:03:40.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.171+0000 7f96d7fe2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d00cf630 con 0x7f96d0068140 2023-12-24T20:03:40.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.171+0000 7f96d7fe2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00b2240 con 0x7f96d0159a60 2023-12-24T20:03:40.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.171+0000 7f96d5d7e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96d0068140 0x7f96d00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.171+0000 7f96d657f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0159a60 0x7f96d0159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.171+0000 7f96d5d7e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96d0068140 0x7f96d00cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:39650/0 (socket says 172.21.15.61:39650) 2023-12-24T20:03:40.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.171+0000 7f96d5d7e700 1 -- 172.21.15.61:0/1141270476 learned_addr learned my addr 172.21.15.61:0/1141270476 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:40.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.172+0000 7f96d5d7e700 1 -- 172.21.15.61:0/1141270476 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0159a60 msgr2=0x7f96d0159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:40.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.172+0000 7f96d5d7e700 1 --2- 172.21.15.61:0/1141270476 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0159a60 0x7f96d0159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.172+0000 7f96d5d7e700 1 -- 172.21.15.61:0/1141270476 >> v1:172.21.15.133:6789/0 conn(0x7f96d0068510 legacy=0x7f96d00b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.172+0000 7f96d5d7e700 1 -- 172.21.15.61:0/1141270476 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00b2520 con 0x7f96d0068140 2023-12-24T20:03:40.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.172+0000 7f96d4d7c700 1 -- 172.21.15.61:0/1141270476 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547215099 0 0) 0x7f96d00b2890 con 0x7f96d0068510 2023-12-24T20:03:40.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.172+0000 7f96d657f700 1 --2- 172.21.15.61:0/1141270476 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0159a60 0x7f96d0159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:03:40.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.172+0000 7f96d5d7e700 1 --2- 172.21.15.61:0/1141270476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96d0068140 0x7f96d00cefa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009990 tx=0x7f96c0009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=624a4064686b75f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:40.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.172+0000 7f96d4d7c700 1 -- 172.21.15.61:0/1141270476 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0009e80 con 0x7f96d0068140 2023-12-24T20:03:40.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.172+0000 7f96d4d7c700 1 -- 172.21.15.61:0/1141270476 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c0005c10 con 0x7f96d0068140 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.172+0000 7f96d4d7c700 1 -- 172.21.15.61:0/1141270476 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000b650 con 0x7f96d0068140 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.173+0000 7f96d7fe2700 1 -- 172.21.15.61:0/1141270476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96d0068140 msgr2=0x7f96d00cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.173+0000 7f96d7fe2700 1 --2- 172.21.15.61:0/1141270476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96d0068140 0x7f96d00cefa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009990 tx=0x7f96c0009220 comp rx=0 tx=0).stop 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.173+0000 7f96d7fe2700 1 -- 172.21.15.61:0/1141270476 shutdown_connections 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.173+0000 7f96d7fe2700 1 --2- 172.21.15.61:0/1141270476 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0159a60 0x7f96d0159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.173+0000 7f96d7fe2700 1 --2- 172.21.15.61:0/1141270476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96d0068140 0x7f96d00cefa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.173+0000 7f96d7fe2700 1 -- 172.21.15.61:0/1141270476 >> 172.21.15.61:0/1141270476 conn(0x7f96d0097a10 msgr2=0x7f96d00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.173+0000 7f96d7fe2700 1 -- 172.21.15.61:0/1141270476 shutdown_connections 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.173+0000 7f96d7fe2700 1 -- 172.21.15.61:0/1141270476 wait complete. 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.174+0000 7f96d7fe2700 1 Processor -- start 2023-12-24T20:03:40.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.174+0000 7f96d7fe2700 1 -- start start 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d7fe2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0068140 0x7f96d01445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d7fe2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96d0068510 0x7f96d015f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d7fe2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96d0159a60 0x7f96d009b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d7fe2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d016b5f0 con 0x7f96d0068510 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d7fe2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d016b8d0 con 0x7f96d0159a60 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d7fe2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d016bbb0 con 0x7f96d0068140 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d557d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96d0068510 0x7f96d015f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d557d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96d0068510 0x7f96d015f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40498/0 (socket says 172.21.15.61:40498) 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d557d700 1 -- 172.21.15.61:0/897649009 learned_addr learned my addr 172.21.15.61:0/897649009 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d657f700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96d0159a60 0x7f96d009b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d5d7e700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0068140 0x7f96d01445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d557d700 1 -- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0068140 msgr2=0x7f96d01445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d557d700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0068140 0x7f96d01445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d557d700 1 -- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96d0159a60 msgr2=0x7f96d009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d557d700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96d0159a60 0x7f96d009b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d557d700 1 -- 172.21.15.61:0/897649009 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c8009a20 con 0x7f96d0068510 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96d557d700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96d0068510 0x7f96d015f050 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00c7e0 tx=0x7f96cc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96c5ffb700 1 -- 172.21.15.61:0/897649009 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc011590 con 0x7f96d0068510 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.175+0000 7f96c5ffb700 1 -- 172.21.15.61:0/897649009 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96cc011710 con 0x7f96d0068510 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.176+0000 7f96d7fe2700 1 -- 172.21.15.61:0/897649009 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c0009480 con 0x7f96d0068510 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.176+0000 7f96c5ffb700 1 -- 172.21.15.61:0/897649009 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc011ad0 con 0x7f96d0068510 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.176+0000 7f96d7fe2700 1 -- 172.21.15.61:0/897649009 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d016c170 con 0x7f96d0068510 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.177+0000 7f96d7fe2700 1 -- 172.21.15.61:0/897649009 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d006d440 con 0x7f96d0068510 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.177+0000 7f96c5ffb700 1 -- 172.21.15.61:0/897649009 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f96cc01b3b0 con 0x7f96d0068510 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.177+0000 7f96c5ffb700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96b4066f30 0x7f96b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.178+0000 7f96c5ffb700 1 -- 172.21.15.61:0/897649009 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f96cc0836c0 con 0x7f96d0068510 2023-12-24T20:03:40.179 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.178+0000 7f96d5d7e700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96b4066f30 0x7f96b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.178+0000 7f96d5d7e700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96b4066f30 0x7f96b40693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009260 tx=0x7f96c0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:40.182 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.182+0000 7f96c5ffb700 1 -- 172.21.15.61:0/897649009 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96cc050cf0 con 0x7f96d0068510 2023-12-24T20:03:40.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.463+0000 7f96d7fe2700 1 -- 172.21.15.61:0/897649009 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f96d004c3c0 con 0x7f96d0068510 2023-12-24T20:03:40.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.677+0000 7f96c5ffb700 1 -- 172.21.15.61:0/897649009 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v344) v1 ==== 140+0+0 (secure 0 0 0) 0x7f96cc017020 con 0x7f96d0068510 2023-12-24T20:03:40.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 -- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96b4066f30 msgr2=0x7f96b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96b4066f30 0x7f96b40693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f96c0009260 tx=0x7f96c0016000 comp rx=0 tx=0).stop 2023-12-24T20:03:40.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 -- 172.21.15.61:0/897649009 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96d0068510 msgr2=0x7f96d015f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96d0068510 0x7f96d015f050 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00c7e0 tx=0x7f96cc007df0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 -- 172.21.15.61:0/897649009 shutdown_connections 2023-12-24T20:03:40.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f96d0068140 0x7f96d01445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f96b4066f30 0x7f96b40693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96d0159a60 0x7f96d009b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 --2- 172.21.15.61:0/897649009 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f96d0068510 0x7f96d015f050 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 -- 172.21.15.61:0/897649009 >> 172.21.15.61:0/897649009 conn(0x7f96d0097a10 msgr2=0x7f96d006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:40.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 -- 172.21.15.61:0/897649009 shutdown_connections 2023-12-24T20:03:40.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.679+0000 7f96d7fe2700 1 -- 172.21.15.61:0/897649009 wait complete. 2023-12-24T20:03:40.692 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-24T20:03:40.692 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-12-24T20:03:40.692 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-12-24T20:03:40.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.814+0000 7fbe3a3dc700 1 Processor -- start 2023-12-24T20:03:40.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.814+0000 7fbe3a3dc700 1 -- start start 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.815+0000 7fbe3a3dc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbe34159850 0x7fbe34159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.815+0000 7fbe3a3dc700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3406a630 con 0x7fbe340caa80 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.815+0000 7fbe3a3dc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe34069d00 con 0x7fbe3406aac0 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.815+0000 7fbe3a3dc700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe340cccf0 con 0x7fbe34159850 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.815+0000 7fbe33fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbe34159850 0x7fbe34159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.815+0000 7fbe33fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbe34159850 0x7fbe34159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40506/0 (socket says 172.21.15.61:40506) 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.815+0000 7fbe33fff700 1 -- 172.21.15.61:0/3007176174 learned_addr learned my addr 172.21.15.61:0/3007176174 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.815+0000 7fbe38979700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fbe340caa80 0x7fbe340aa880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60698/0 (socket says 172.21.15.61:60698) 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe33fff700 1 -- 172.21.15.61:0/3007176174 >> v1:172.21.15.133:6789/0 conn(0x7fbe3406aac0 legacy=0x7fbe340cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe33fff700 1 -- 172.21.15.61:0/3007176174 >> v1:172.21.15.61:6789/0 conn(0x7fbe340caa80 legacy=0x7fbe340aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe32ffd700 1 -- 172.21.15.61:0/3007176174 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842074984 0 0) 0x7fbe3406a630 con 0x7fbe340caa80 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe33fff700 1 -- 172.21.15.61:0/3007176174 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe34069fe0 con 0x7fbe34159850 2023-12-24T20:03:40.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe33fff700 1 --2- 172.21.15.61:0/3007176174 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe34159850 0x7fbe34159c20 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0099b0 tx=0x7fbe1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5603b005402510eb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:40.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe32ffd700 1 -- 172.21.15.61:0/3007176174 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00b860 con 0x7fbe34159850 2023-12-24T20:03:40.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe32ffd700 1 -- 172.21.15.61:0/3007176174 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c00b9c0 con 0x7fbe34159850 2023-12-24T20:03:40.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe32ffd700 1 -- 172.21.15.61:0/3007176174 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00bd80 con 0x7fbe34159850 2023-12-24T20:03:40.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/3007176174 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe34159850 msgr2=0x7fbe34159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe3a3dc700 1 --2- 172.21.15.61:0/3007176174 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe34159850 0x7fbe34159c20 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0099b0 tx=0x7fbe1c009250 comp rx=0 tx=0).stop 2023-12-24T20:03:40.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/3007176174 shutdown_connections 2023-12-24T20:03:40.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe3a3dc700 1 --2- 172.21.15.61:0/3007176174 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe34159850 0x7fbe34159c20 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/3007176174 >> 172.21.15.61:0/3007176174 conn(0x7fbe340cceb0 msgr2=0x7fbe340cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:40.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.816+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/3007176174 shutdown_connections 2023-12-24T20:03:40.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.817+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/3007176174 wait complete. 2023-12-24T20:03:40.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.818+0000 7fbe3a3dc700 1 Processor -- start 2023-12-24T20:03:40.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.818+0000 7fbe3a3dc700 1 -- start start 2023-12-24T20:03:40.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.818+0000 7fbe3a3dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3406aac0 0x7fbe3415d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.818+0000 7fbe3a3dc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe340caa80 0x7fbe3415acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.818+0000 7fbe3a3dc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe34159850 0x7fbe3414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.818+0000 7fbe3a3dc700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340b0300 con 0x7fbe340caa80 2023-12-24T20:03:40.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.818+0000 7fbe3a3dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3415b3b0 con 0x7fbe3406aac0 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.818+0000 7fbe3a3dc700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3415b690 con 0x7fbe34159850 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe337fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe340caa80 0x7fbe3415acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe337fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe340caa80 0x7fbe3415acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40516/0 (socket says 172.21.15.61:40516) 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe337fe700 1 -- 172.21.15.61:0/1161442390 learned_addr learned my addr 172.21.15.61:0/1161442390 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe33fff700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3406aac0 0x7fbe3415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe38979700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe34159850 0x7fbe3414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe337fe700 1 -- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe34159850 msgr2=0x7fbe3414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe337fe700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe34159850 0x7fbe3414bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe337fe700 1 -- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3406aac0 msgr2=0x7fbe3415d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe337fe700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3406aac0 0x7fbe3415d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe337fe700 1 -- 172.21.15.61:0/1161442390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c0094f0 con 0x7fbe340caa80 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe33fff700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3406aac0 0x7fbe3415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe337fe700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe340caa80 0x7fbe3415acb0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c590 tx=0x7fbe2400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:40.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe2bfff700 1 -- 172.21.15.61:0/1161442390 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24011590 con 0x7fbe340caa80 2023-12-24T20:03:40.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe2bfff700 1 -- 172.21.15.61:0/1161442390 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240116f0 con 0x7fbe340caa80 2023-12-24T20:03:40.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/1161442390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3415b970 con 0x7fbe340caa80 2023-12-24T20:03:40.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe2bfff700 1 -- 172.21.15.61:0/1161442390 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24011ab0 con 0x7fbe340caa80 2023-12-24T20:03:40.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.819+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/1161442390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3414c230 con 0x7fbe340caa80 2023-12-24T20:03:40.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.820+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/1161442390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3404c3c0 con 0x7fbe340caa80 2023-12-24T20:03:40.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.821+0000 7fbe2bfff700 1 -- 172.21.15.61:0/1161442390 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbe2401b3b0 con 0x7fbe340caa80 2023-12-24T20:03:40.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.821+0000 7fbe2bfff700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe14066f30 0x7fbe140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:40.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.821+0000 7fbe2bfff700 1 -- 172.21.15.61:0/1161442390 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbe24083880 con 0x7fbe340caa80 2023-12-24T20:03:40.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.822+0000 7fbe33fff700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe14066f30 0x7fbe140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:40.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.822+0000 7fbe33fff700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe14066f30 0x7fbe140693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0099b0 tx=0x7fbe1c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:40.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:40.826+0000 7fbe2bfff700 1 -- 172.21.15.61:0/1161442390 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe24050d50 con 0x7fbe340caa80 2023-12-24T20:03:41.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.104+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/1161442390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7fbe3406a2c0 con 0x7fbe340caa80 2023-12-24T20:03:41.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.678+0000 7fbe2bfff700 1 -- 172.21.15.61:0/1161442390 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v345) v1 ==== 135+0+0 (secure 0 0 0) 0x7fbe240170c0 con 0x7fbe340caa80 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe14066f30 msgr2=0x7fbe140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe14066f30 0x7fbe140693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0099b0 tx=0x7fbe1c017000 comp rx=0 tx=0).stop 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/1161442390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe340caa80 msgr2=0x7fbe3415acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe340caa80 0x7fbe3415acb0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c590 tx=0x7fbe2400c950 comp rx=0 tx=0).stop 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/1161442390 shutdown_connections 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe34159850 0x7fbe3414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe14066f30 0x7fbe140693e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe3406aac0 0x7fbe3415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 --2- 172.21.15.61:0/1161442390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe340caa80 0x7fbe3415acb0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/1161442390 >> 172.21.15.61:0/1161442390 conn(0x7fbe340cceb0 msgr2=0x7fbe3406d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/1161442390 shutdown_connections 2023-12-24T20:03:41.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.681+0000 7fbe3a3dc700 1 -- 172.21.15.61:0/1161442390 wait complete. 2023-12-24T20:03:41.696 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T20:03:41.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.827+0000 7f1ae3448700 1 Processor -- start 2023-12-24T20:03:41.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.827+0000 7f1ae3448700 1 -- start start 2023-12-24T20:03:41.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.828+0000 7f1ae3448700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1adc1580a0 0x7f1adc0af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:41.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.828+0000 7f1ae3448700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1adc0c9050 0x7f1adc067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:41.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.828+0000 7f1ae3448700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1adc06b080 con 0x7f1adc15a940 2023-12-24T20:03:41.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.828+0000 7f1ae3448700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1adc0b00f0 con 0x7f1adc0c9050 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.828+0000 7f1ae3448700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc15b4c0 con 0x7f1adc1580a0 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.828+0000 7f1ae19e5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1adc0c9050 0x7f1adc067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.828+0000 7f1ae19e5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1adc0c9050 0x7f1adc067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40520/0 (socket says 172.21.15.61:40520) 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.828+0000 7f1ae19e5700 1 -- 172.21.15.61:0/1957073246 learned_addr learned my addr 172.21.15.61:0/1957073246 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.828+0000 7f1ae11e4700 1 --2- 172.21.15.61:0/1957073246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1adc1580a0 0x7f1adc0af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.829+0000 7f1ae19e5700 1 -- 172.21.15.61:0/1957073246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1adc1580a0 msgr2=0x7f1adc0af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.829+0000 7f1ae19e5700 1 --2- 172.21.15.61:0/1957073246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1adc1580a0 0x7f1adc0af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.829+0000 7f1ae19e5700 1 -- 172.21.15.61:0/1957073246 >> v1:172.21.15.133:6789/0 conn(0x7f1adc15a940 legacy=0x7f1adc15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.829+0000 7f1ae19e5700 1 -- 172.21.15.61:0/1957073246 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc15b720 con 0x7f1adc0c9050 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.829+0000 7f1ae19e5700 1 --2- 172.21.15.61:0/1957073246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc0c9050 0x7f1adc067550 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009f20 tx=0x7f1ad4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54609813d1bf8eee server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.829+0000 7f1ad3fff700 1 -- 172.21.15.61:0/1957073246 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40092e0 con 0x7f1adc0c9050 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.829+0000 7f1ad3fff700 1 -- 172.21.15.61:0/1957073246 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad400b9d0 con 0x7f1adc0c9050 2023-12-24T20:03:41.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.829+0000 7f1ad3fff700 1 -- 172.21.15.61:0/1957073246 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad400bd90 con 0x7f1adc0c9050 2023-12-24T20:03:41.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.830+0000 7f1ae3448700 1 -- 172.21.15.61:0/1957073246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc0c9050 msgr2=0x7f1adc067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:41.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.830+0000 7f1ae3448700 1 --2- 172.21.15.61:0/1957073246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc0c9050 0x7f1adc067550 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009f20 tx=0x7f1ad4009840 comp rx=0 tx=0).stop 2023-12-24T20:03:41.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.830+0000 7f1ae3448700 1 -- 172.21.15.61:0/1957073246 shutdown_connections 2023-12-24T20:03:41.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.830+0000 7f1ae3448700 1 --2- 172.21.15.61:0/1957073246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc0c9050 0x7f1adc067550 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:41.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.830+0000 7f1ae3448700 1 --2- 172.21.15.61:0/1957073246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1adc1580a0 0x7f1adc0af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:41.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.830+0000 7f1ae3448700 1 -- 172.21.15.61:0/1957073246 >> 172.21.15.61:0/1957073246 conn(0x7f1adc0ce400 msgr2=0x7f1adc0ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:41.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.830+0000 7f1ae3448700 1 -- 172.21.15.61:0/1957073246 shutdown_connections 2023-12-24T20:03:41.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.830+0000 7f1ae3448700 1 -- 172.21.15.61:0/1957073246 wait complete. 2023-12-24T20:03:41.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.831+0000 7f1ae3448700 1 Processor -- start 2023-12-24T20:03:41.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.831+0000 7f1ae3448700 1 -- start start 2023-12-24T20:03:41.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae3448700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1adc0c9050 0x7f1adc0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:41.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae3448700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc1580a0 0x7f1adc0ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae3448700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1adc15a940 0x7f1adc154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae3448700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc0c5840 con 0x7f1adc1580a0 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae3448700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc0c6700 con 0x7f1adc0c9050 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae3448700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc0ab970 con 0x7f1adc15a940 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae09e3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc1580a0 0x7f1adc0ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae09e3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc1580a0 0x7f1adc0ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40536/0 (socket says 172.21.15.61:40536) 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae09e3700 1 -- 172.21.15.61:0/101052642 learned_addr learned my addr 172.21.15.61:0/101052642 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae11e4700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1adc0c9050 0x7f1adc0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae19e5700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1adc15a940 0x7f1adc154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae09e3700 1 -- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1adc15a940 msgr2=0x7f1adc154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae09e3700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1adc15a940 0x7f1adc154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae09e3700 1 -- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1adc0c9050 msgr2=0x7f1adc0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae09e3700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1adc0c9050 0x7f1adc0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:41.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae09e3700 1 -- 172.21.15.61:0/101052642 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4009ae0 con 0x7f1adc1580a0 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae11e4700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1adc0c9050 0x7f1adc0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.832+0000 7f1ae09e3700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc1580a0 0x7f1adc0ab430 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800c5c0 tx=0x7f1ad800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.833+0000 7f1ad17fa700 1 -- 172.21.15.61:0/101052642 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8011590 con 0x7f1adc1580a0 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.833+0000 7f1ad17fa700 1 -- 172.21.15.61:0/101052642 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad8011710 con 0x7f1adc1580a0 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.833+0000 7f1ae3448700 1 -- 172.21.15.61:0/101052642 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1adc0c5a80 con 0x7f1adc1580a0 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.833+0000 7f1ad17fa700 1 -- 172.21.15.61:0/101052642 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8011ad0 con 0x7f1adc1580a0 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.833+0000 7f1ae3448700 1 -- 172.21.15.61:0/101052642 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1adc0c5e10 con 0x7f1adc1580a0 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.834+0000 7f1ae3448700 1 -- 172.21.15.61:0/101052642 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1adc04c3c0 con 0x7f1adc1580a0 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.834+0000 7f1ad17fa700 1 -- 172.21.15.61:0/101052642 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1ad801b3b0 con 0x7f1adc1580a0 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.834+0000 7f1ad17fa700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ac0066f30 0x7f1ac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.834+0000 7f1ad17fa700 1 -- 172.21.15.61:0/101052642 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1ad80837d0 con 0x7f1adc1580a0 2023-12-24T20:03:41.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.835+0000 7f1ae11e4700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ac0066f30 0x7f1ac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:41.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.835+0000 7f1ae11e4700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ac0066f30 0x7f1ac00693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009d80 tx=0x7f1acc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:41.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:41.839+0000 7f1ad17fa700 1 -- 172.21.15.61:0/101052642 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ad8050d40 con 0x7f1adc1580a0 2023-12-24T20:03:42.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.034+0000 7f1ae3448700 1 -- 172.21.15.61:0/101052642 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1adc0c6840 con 0x7f1adc1580a0 2023-12-24T20:03:42.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.038+0000 7f1ad17fa700 1 -- 172.21.15.61:0/101052642 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1adc0c6840 con 0x7f1adc1580a0 2023-12-24T20:03:42.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 -- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ac0066f30 msgr2=0x7f1ac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ac0066f30 0x7f1ac00693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009d80 tx=0x7f1acc008040 comp rx=0 tx=0).stop 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 -- 172.21.15.61:0/101052642 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc1580a0 msgr2=0x7f1adc0ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc1580a0 0x7f1adc0ab430 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800c5c0 tx=0x7f1ad800c980 comp rx=0 tx=0).stop 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 -- 172.21.15.61:0/101052642 shutdown_connections 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1adc15a940 0x7f1adc154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ac0066f30 0x7f1ac00693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1adc0c9050 0x7f1adc0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 --2- 172.21.15.61:0/101052642 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1adc1580a0 0x7f1adc0ab430 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 -- 172.21.15.61:0/101052642 >> 172.21.15.61:0/101052642 conn(0x7f1adc0ce400 msgr2=0x7f1adc06db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 -- 172.21.15.61:0/101052642 shutdown_connections 2023-12-24T20:03:42.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.040+0000 7f1ae3448700 1 -- 172.21.15.61:0/101052642 wait complete. 2023-12-24T20:03:42.052 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:03:42.053 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:03:42.092 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:03:42.139 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:03:42.139 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T20:03:42.139 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:42.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.260+0000 7fe87c85c700 1 Processor -- start 2023-12-24T20:03:42.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.260+0000 7fe87c85c700 1 -- start start 2023-12-24T20:03:42.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.261+0000 7fe87c85c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe8780b2660 0x7fe87815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.261+0000 7fe87c85c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe87815c470 0x7fe8780b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.261+0000 7fe87c85c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8780b2eb0 con 0x7fe87815bb60 2023-12-24T20:03:42.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.261+0000 7fe87c85c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8780afc20 con 0x7fe8780b2660 2023-12-24T20:03:42.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.261+0000 7fe87c85c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8780b2bd0 con 0x7fe87815c470 2023-12-24T20:03:42.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe875d9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe8780b2660 0x7fe87815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe87659c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe87815bb60 0x7fe878098560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60710/0 (socket says 172.21.15.61:60710) 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe87659c700 1 -- 172.21.15.61:0/280916552 learned_addr learned my addr 172.21.15.61:0/280916552 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe876d9d700 1 --2- 172.21.15.61:0/280916552 >> v2:172.21.15.133:3300/0 conn(0x7fe87815c470 0x7fe8780b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe875d9b700 1 -- 172.21.15.61:0/280916552 >> v2:172.21.15.133:3300/0 conn(0x7fe87815c470 msgr2=0x7fe8780b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe875d9b700 1 --2- 172.21.15.61:0/280916552 >> v2:172.21.15.133:3300/0 conn(0x7fe87815c470 0x7fe8780b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe875d9b700 1 -- 172.21.15.61:0/280916552 >> v1:172.21.15.61:6789/0 conn(0x7fe87815bb60 legacy=0x7fe878098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe875d9b700 1 -- 172.21.15.61:0/280916552 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8780afe10 con 0x7fe8780b2660 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe87559a700 1 -- 172.21.15.61:0/280916552 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885790768 0 0) 0x7fe8780b2eb0 con 0x7fe87815bb60 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe876d9d700 1 --2- 172.21.15.61:0/280916552 >> v2:172.21.15.133:3300/0 conn(0x7fe87815c470 0x7fe8780b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe875d9b700 1 --2- 172.21.15.61:0/280916552 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8780b2660 0x7fe87815bf30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fe8780a9750 tx=0x7fe8680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e2279557a35807 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe87559a700 1 -- 172.21.15.61:0/280916552 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800b6b0 con 0x7fe8780b2660 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe87559a700 1 -- 172.21.15.61:0/280916552 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86800b810 con 0x7fe8780b2660 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.262+0000 7fe87559a700 1 -- 172.21.15.61:0/280916552 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800bbb0 con 0x7fe8780b2660 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.263+0000 7fe87c85c700 1 -- 172.21.15.61:0/280916552 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8780b2660 msgr2=0x7fe87815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.263+0000 7fe87c85c700 1 --2- 172.21.15.61:0/280916552 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8780b2660 0x7fe87815bf30 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fe8780a9750 tx=0x7fe8680091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.263+0000 7fe87c85c700 1 -- 172.21.15.61:0/280916552 shutdown_connections 2023-12-24T20:03:42.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.263+0000 7fe87c85c700 1 --2- 172.21.15.61:0/280916552 >> v2:172.21.15.133:3300/0 conn(0x7fe87815c470 0x7fe8780b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.263+0000 7fe87c85c700 1 --2- 172.21.15.61:0/280916552 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8780b2660 0x7fe87815bf30 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.263+0000 7fe87c85c700 1 -- 172.21.15.61:0/280916552 >> 172.21.15.61:0/280916552 conn(0x7fe878097a10 msgr2=0x7fe8780ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:42.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.263+0000 7fe87c85c700 1 -- 172.21.15.61:0/280916552 shutdown_connections 2023-12-24T20:03:42.265 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.263+0000 7fe87c85c700 1 -- 172.21.15.61:0/280916552 wait complete. 2023-12-24T20:03:42.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.264+0000 7fe87c85c700 1 Processor -- start 2023-12-24T20:03:42.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.264+0000 7fe87c85c700 1 -- start start 2023-12-24T20:03:42.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe87c85c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8780b2660 0x7fe8780688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe87c85c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe87815bb60 0x7fe87809b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe87c85c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe87815c470 0x7fe87809bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe87c85c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878068440 con 0x7fe87815c470 2023-12-24T20:03:42.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe87c85c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe878067550 con 0x7fe8780b2660 2023-12-24T20:03:42.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe87c85c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe878067830 con 0x7fe87815bb60 2023-12-24T20:03:42.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe876d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe87815c470 0x7fe87809bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe876d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe87815c470 0x7fe87809bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40554/0 (socket says 172.21.15.61:40554) 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe876d9d700 1 -- 172.21.15.61:0/4211233940 learned_addr learned my addr 172.21.15.61:0/4211233940 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe87659c700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8780b2660 0x7fe8780688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe875d9b700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe87815bb60 0x7fe87809b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe876d9d700 1 -- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe87815bb60 msgr2=0x7fe87809b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe876d9d700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe87815bb60 0x7fe87809b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe876d9d700 1 -- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8780b2660 msgr2=0x7fe8780688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe876d9d700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8780b2660 0x7fe8780688d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe876d9d700 1 -- 172.21.15.61:0/4211233940 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009420 con 0x7fe87815c470 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe87659c700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8780b2660 0x7fe8780688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe876d9d700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe87815c470 0x7fe87809bba0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fe870009fc0 tx=0x7fe8700099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.265+0000 7fe86e7fc700 1 -- 172.21.15.61:0/4211233940 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000dd40 con 0x7fe87815c470 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.266+0000 7fe86e7fc700 1 -- 172.21.15.61:0/4211233940 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87000f040 con 0x7fe87815c470 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.266+0000 7fe86e7fc700 1 -- 172.21.15.61:0/4211233940 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870015690 con 0x7fe87815c470 2023-12-24T20:03:42.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.266+0000 7fe87c85c700 1 -- 172.21.15.61:0/4211233940 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe878067b10 con 0x7fe87815c470 2023-12-24T20:03:42.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.266+0000 7fe87c85c700 1 -- 172.21.15.61:0/4211233940 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8780680d0 con 0x7fe87815c470 2023-12-24T20:03:42.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.267+0000 7fe87c85c700 1 -- 172.21.15.61:0/4211233940 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87806d440 con 0x7fe87815c470 2023-12-24T20:03:42.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.267+0000 7fe86e7fc700 1 -- 172.21.15.61:0/4211233940 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe87001e3b0 con 0x7fe87815c470 2023-12-24T20:03:42.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.267+0000 7fe86e7fc700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe858066f30 0x7fe8580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.268+0000 7fe86e7fc700 1 -- 172.21.15.61:0/4211233940 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe870084790 con 0x7fe87815c470 2023-12-24T20:03:42.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.268+0000 7fe87659c700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe858066f30 0x7fe8580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.270 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.268+0000 7fe87659c700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe858066f30 0x7fe8580693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe860001360 tx=0x7fe860009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:42.272 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.272+0000 7fe86e7fc700 1 -- 172.21.15.61:0/4211233940 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe870051d00 con 0x7fe87815c470 2023-12-24T20:03:42.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.513+0000 7fe87c85c700 1 -- 172.21.15.61:0/4211233940 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe87804c3c0 con 0x7fe87815c470 2023-12-24T20:03:42.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.513+0000 7fe86e7fc700 1 -- 172.21.15.61:0/4211233940 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fe87001ade0 con 0x7fe87815c470 2023-12-24T20:03:42.514 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:42.514 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3245805399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3245805399},{"type":"v1","addr":"172.21.15.133:6837","nonce":3245805399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/308378866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":308378866},{"type":"v1","addr":"172.21.15.133:6836","nonce":308378866}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":7068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/4168448475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":4168448475},{"type":"v1","addr":"172.21.15.61:6835","nonce":4168448475}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":7071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/1817856586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":1817856586},{"type":"v1","addr":"172.21.15.61:6834","nonce":1817856586}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[]} 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 -- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe858066f30 msgr2=0x7fe8580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe858066f30 0x7fe8580693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe860001360 tx=0x7fe860009040 comp rx=0 tx=0).stop 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 -- 172.21.15.61:0/4211233940 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe87815c470 msgr2=0x7fe87809bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe87815c470 0x7fe87809bba0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fe870009fc0 tx=0x7fe8700099b0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 -- 172.21.15.61:0/4211233940 shutdown_connections 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe858066f30 0x7fe8580693e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe87815c470 0x7fe87809bba0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8780b2660 0x7fe8780688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 --2- 172.21.15.61:0/4211233940 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe87815bb60 0x7fe87809b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 -- 172.21.15.61:0/4211233940 >> 172.21.15.61:0/4211233940 conn(0x7fe878097a10 msgr2=0x7fe8780b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 -- 172.21.15.61:0/4211233940 shutdown_connections 2023-12-24T20:03:42.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.515+0000 7fe87c85c700 1 -- 172.21.15.61:0/4211233940 wait complete. 2023-12-24T20:03:42.517 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 71 2023-12-24T20:03:42.528 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T20:03:42.528 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T20:03:42.529 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:03:42.529 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:03:42.529 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T20:03:42.529 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T20:03:42.529 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:03:42.529 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:03:42.529 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T20:03:42.530 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T20:03:42.530 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:03:42.530 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:03:42.530 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T20:03:42.530 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T20:03:42.530 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:03:42.530 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:03:42.537 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:03:42.537 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T20:03:42.538 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:03:42.538 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T20:03:42.540 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:03:42.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T20:03:42.541 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:03:42.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T20:03:42.579 INFO:tasks.ceph.mds.a:Started 2023-12-24T20:03:42.579 DEBUG:teuthology.parallel:result is None 2023-12-24T20:03:42.580 INFO:tasks.ceph.mds.c:Started 2023-12-24T20:03:42.580 DEBUG:teuthology.parallel:result is None 2023-12-24T20:03:42.583 INFO:tasks.ceph.mds.d:Started 2023-12-24T20:03:42.583 DEBUG:teuthology.parallel:result is None 2023-12-24T20:03:42.583 INFO:tasks.ceph.mds.b:Started 2023-12-24T20:03:42.583 DEBUG:teuthology.parallel:result is None 2023-12-24T20:03:42.584 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T20:03:42.658 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T20:03:42.658 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T20:03:42.664 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T20:03:42.664 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T20:03:42.665 INFO:tasks.ceph.mds.b.smithi133.stderr:2023-12-24T20:03:42.665+0000 7f71d991c700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6835/0: (98) Address already in use 2023-12-24T20:03:42.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.716+0000 7f18476d2700 1 Processor -- start 2023-12-24T20:03:42.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.716+0000 7f18476d2700 1 -- start start 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f18476d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1840159c40 0x7f1840070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f18476d2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f18400c41e0 0x7f18400c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f18476d2700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1840068d10 con 0x7f1840070db0 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f18476d2700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1840067f10 con 0x7f18400c41e0 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f18476d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1840068100 con 0x7f1840159c40 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1845c6f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f18400c41e0 0x7f18400c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1844c6d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1840070db0 0x7f18400c3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60738/0 (socket says 172.21.15.61:60738) 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1845c6f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f18400c41e0 0x7f18400c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40590/0 (socket says 172.21.15.61:40590) 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1844c6d700 1 -- 172.21.15.61:0/1156573087 learned_addr learned my addr 172.21.15.61:0/1156573087 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f184546e700 1 --2- 172.21.15.61:0/1156573087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1840159c40 0x7f1840070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1845c6f700 1 -- 172.21.15.61:0/1156573087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1840159c40 msgr2=0x7f1840070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1845c6f700 1 --2- 172.21.15.61:0/1156573087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1840159c40 0x7f1840070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1845c6f700 1 -- 172.21.15.61:0/1156573087 >> v1:172.21.15.61:6789/0 conn(0x7f1840070db0 legacy=0x7f18400c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1845c6f700 1 -- 172.21.15.61:0/1156573087 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18400683e0 con 0x7f18400c41e0 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1837fff700 1 -- 172.21.15.61:0/1156573087 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577237663 0 0) 0x7f1840068d10 con 0x7f1840070db0 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1845c6f700 1 --2- 172.21.15.61:0/1156573087 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18400c41e0 0x7f18400c7e40 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f1838009e60 tx=0x7f1838009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218a91321a5b3428 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.717+0000 7f1837fff700 1 -- 172.21.15.61:0/1156573087 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800e070 con 0x7f18400c41e0 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.718+0000 7f1837fff700 1 -- 172.21.15.61:0/1156573087 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183800bc30 con 0x7f18400c41e0 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.718+0000 7f1837fff700 1 -- 172.21.15.61:0/1156573087 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1838012430 con 0x7f18400c41e0 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.718+0000 7f18476d2700 1 -- 172.21.15.61:0/1156573087 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18400c41e0 msgr2=0x7f18400c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.718+0000 7f18476d2700 1 --2- 172.21.15.61:0/1156573087 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18400c41e0 0x7f18400c7e40 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f1838009e60 tx=0x7f1838009780 comp rx=0 tx=0).stop 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.718+0000 7f18476d2700 1 -- 172.21.15.61:0/1156573087 shutdown_connections 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.718+0000 7f18476d2700 1 --2- 172.21.15.61:0/1156573087 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1840159c40 0x7f1840070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.718+0000 7f18476d2700 1 --2- 172.21.15.61:0/1156573087 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f18400c41e0 0x7f18400c7e40 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.718+0000 7f18476d2700 1 -- 172.21.15.61:0/1156573087 >> 172.21.15.61:0/1156573087 conn(0x7f18400ce190 msgr2=0x7f18400ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.718+0000 7f18476d2700 1 -- 172.21.15.61:0/1156573087 shutdown_connections 2023-12-24T20:03:42.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.718+0000 7f18476d2700 1 -- 172.21.15.61:0/1156573087 wait complete. 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.720+0000 7f18476d2700 1 Processor -- start 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.720+0000 7f18476d2700 1 -- start start 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f18476d2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1840070db0 0x7f184014c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f18476d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18400c41e0 0x7f184015a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f18476d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1840159c40 0x7f18400b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f18476d2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184014c7c0 con 0x7f1840070db0 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f18476d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1840158c40 con 0x7f18400c41e0 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f18476d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1840169ac0 con 0x7f1840159c40 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f184546e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1840070db0 0x7f184014c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f184546e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1840070db0 0x7f184014c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40596/0 (socket says 172.21.15.61:40596) 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f184546e700 1 -- 172.21.15.61:0/3769911716 learned_addr learned my addr 172.21.15.61:0/3769911716 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:42.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f1844c6d700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18400c41e0 0x7f184015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f1845c6f700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1840159c40 0x7f18400b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f184546e700 1 -- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1840159c40 msgr2=0x7f18400b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f184546e700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1840159c40 0x7f18400b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f184546e700 1 -- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18400c41e0 msgr2=0x7f184015a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f184546e700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18400c41e0 0x7f184015a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f184546e700 1 -- 172.21.15.61:0/3769911716 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1838009a20 con 0x7f1840070db0 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.721+0000 7f184546e700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1840070db0 0x7f184014c280 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f183000d860 tx=0x7f1830008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.722+0000 7f18357fa700 1 -- 172.21.15.61:0/3769911716 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300125f0 con 0x7f1840070db0 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.722+0000 7f18357fa700 1 -- 172.21.15.61:0/3769911716 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830012750 con 0x7f1840070db0 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.722+0000 7f18476d2700 1 -- 172.21.15.61:0/3769911716 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1840169da0 con 0x7f1840070db0 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.722+0000 7f18357fa700 1 -- 172.21.15.61:0/3769911716 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830012b10 con 0x7f1840070db0 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.722+0000 7f18476d2700 1 -- 172.21.15.61:0/3769911716 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184016a360 con 0x7f1840070db0 2023-12-24T20:03:42.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.723+0000 7f18476d2700 1 -- 172.21.15.61:0/3769911716 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184016a6d0 con 0x7f1840070db0 2023-12-24T20:03:42.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.723+0000 7f18357fa700 1 -- 172.21.15.61:0/3769911716 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f183001e460 con 0x7f1840070db0 2023-12-24T20:03:42.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.723+0000 7f18357fa700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1824066f30 0x7f18240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:42.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.723+0000 7f18357fa700 1 -- 172.21.15.61:0/3769911716 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f18300846c0 con 0x7f1840070db0 2023-12-24T20:03:42.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.724+0000 7f1844c6d700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1824066f30 0x7f18240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:42.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.724+0000 7f1844c6d700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1824066f30 0x7f18240693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f18400b35c0 tx=0x7f183c007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:42.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.728+0000 7f18357fa700 1 -- 172.21.15.61:0/3769911716 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f184016a6d0 con 0x7f1840070db0 2023-12-24T20:03:42.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:42.938+0000 7f18476d2700 1 -- 172.21.15.61:0/3769911716 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f184016a6d0 con 0x7f1840070db0 2023-12-24T20:03:43.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.692+0000 7f18357fa700 1 -- 172.21.15.61:0/3769911716 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v147) v1 ==== 97+0+0 (secure 0 0 0) 0x7f184016a6d0 con 0x7f1840070db0 2023-12-24T20:03:43.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.694+0000 7f18476d2700 1 -- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1824066f30 msgr2=0x7f18240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:43.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.694+0000 7f18476d2700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1824066f30 0x7f18240693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f18400b35c0 tx=0x7f183c007f50 comp rx=0 tx=0).stop 2023-12-24T20:03:43.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.694+0000 7f18476d2700 1 -- 172.21.15.61:0/3769911716 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1840070db0 msgr2=0x7f184014c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:43.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.694+0000 7f18476d2700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1840070db0 0x7f184014c280 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f183000d860 tx=0x7f1830008040 comp rx=0 tx=0).stop 2023-12-24T20:03:43.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.695+0000 7f18476d2700 1 -- 172.21.15.61:0/3769911716 shutdown_connections 2023-12-24T20:03:43.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.695+0000 7f18476d2700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1840159c40 0x7f18400b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:43.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.695+0000 7f18476d2700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1824066f30 0x7f18240693e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:43.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.695+0000 7f18476d2700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1840070db0 0x7f184014c280 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:43.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.695+0000 7f18476d2700 1 --2- 172.21.15.61:0/3769911716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18400c41e0 0x7f184015a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:43.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.695+0000 7f18476d2700 1 -- 172.21.15.61:0/3769911716 >> 172.21.15.61:0/3769911716 conn(0x7f18400ce190 msgr2=0x7f1840159090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:43.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.695+0000 7f18476d2700 1 -- 172.21.15.61:0/3769911716 shutdown_connections 2023-12-24T20:03:43.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.695+0000 7f18476d2700 1 -- 172.21.15.61:0/3769911716 wait complete. 2023-12-24T20:03:43.696 INFO:teuthology.orchestra.run.smithi061.stderr: removed all blocklist entries 2023-12-24T20:03:43.710 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T20:03:43.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.838+0000 7f4528d4c700 1 Processor -- start 2023-12-24T20:03:43.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.838+0000 7f4528d4c700 1 -- start start 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f4528d4c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f45240af710 0x7f45240afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f4528d4c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f452415acf0 0x7f4524067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f4528d4c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45240687f0 con 0x7f4524068c80 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f4528d4c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4524067be0 con 0x7f45240af710 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f4528d4c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4524067ec0 con 0x7f452415acf0 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f452259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f45240af710 0x7f45240afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f452259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f45240af710 0x7f45240afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40598/0 (socket says 172.21.15.61:40598) 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f452259c700 1 -- 172.21.15.61:0/3676008089 learned_addr learned my addr 172.21.15.61:0/3676008089 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f4522d9d700 1 --2- 172.21.15.61:0/3676008089 >> v2:172.21.15.133:3300/0 conn(0x7f452415acf0 0x7f4524067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f452259c700 1 -- 172.21.15.61:0/3676008089 >> v2:172.21.15.133:3300/0 conn(0x7f452415acf0 msgr2=0x7f4524067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f452259c700 1 --2- 172.21.15.61:0/3676008089 >> v2:172.21.15.133:3300/0 conn(0x7f452415acf0 0x7f4524067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f452259c700 1 -- 172.21.15.61:0/3676008089 >> v1:172.21.15.133:6789/0 conn(0x7f4524068c80 legacy=0x7f452415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.839+0000 7f452259c700 1 -- 172.21.15.61:0/3676008089 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45240681a0 con 0x7f45240af710 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f452259c700 1 --2- 172.21.15.61:0/3676008089 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f45240af710 0x7f45240afae0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f452415a540 tx=0x7f450c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822d7156e2245793 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f452159a700 1 -- 172.21.15.61:0/3676008089 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00b860 con 0x7f45240af710 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f452159a700 1 -- 172.21.15.61:0/3676008089 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c00b9c0 con 0x7f45240af710 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f452159a700 1 -- 172.21.15.61:0/3676008089 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00bd60 con 0x7f45240af710 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f4528d4c700 1 -- 172.21.15.61:0/3676008089 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f45240af710 msgr2=0x7f45240afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f4528d4c700 1 --2- 172.21.15.61:0/3676008089 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f45240af710 0x7f45240afae0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f452415a540 tx=0x7f450c009250 comp rx=0 tx=0).stop 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f4528d4c700 1 -- 172.21.15.61:0/3676008089 shutdown_connections 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f4528d4c700 1 --2- 172.21.15.61:0/3676008089 >> v2:172.21.15.133:3300/0 conn(0x7f452415acf0 0x7f4524067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f4528d4c700 1 --2- 172.21.15.61:0/3676008089 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f45240af710 0x7f45240afae0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f4528d4c700 1 -- 172.21.15.61:0/3676008089 >> 172.21.15.61:0/3676008089 conn(0x7f45240ca200 msgr2=0x7f45240ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f4528d4c700 1 -- 172.21.15.61:0/3676008089 shutdown_connections 2023-12-24T20:03:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.840+0000 7f4528d4c700 1 -- 172.21.15.61:0/3676008089 wait complete. 2023-12-24T20:03:43.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.841+0000 7f4528d4c700 1 Processor -- start 2023-12-24T20:03:43.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.842+0000 7f4528d4c700 1 -- start start 2023-12-24T20:03:43.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.842+0000 7f4528d4c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4524068c80 0x7f452414a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:43.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.842+0000 7f4528d4c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45240af710 0x7f45240b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.842+0000 7f4528d4c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452415acf0 0x7f45241570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.842+0000 7f4528d4c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240b2820 con 0x7f4524068c80 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.842+0000 7f4528d4c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240ad6f0 con 0x7f45240af710 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.842+0000 7f4528d4c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4524147cb0 con 0x7f452415acf0 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.842+0000 7f452259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4524068c80 0x7f452414a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.842+0000 7f452259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4524068c80 0x7f452414a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40608/0 (socket says 172.21.15.61:40608) 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.842+0000 7f452259c700 1 -- 172.21.15.61:0/935338230 learned_addr learned my addr 172.21.15.61:0/935338230 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f4521d9b700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45240af710 0x7f45240b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f4522d9d700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452415acf0 0x7f45241570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f452259c700 1 -- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452415acf0 msgr2=0x7f45241570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f452259c700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452415acf0 0x7f45241570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f452259c700 1 -- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45240af710 msgr2=0x7f45240b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f452259c700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45240af710 0x7f45240b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f452259c700 1 -- 172.21.15.61:0/935338230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c0094f0 con 0x7f4524068c80 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f4521d9b700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45240af710 0x7f45240b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f452259c700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4524068c80 0x7f452414a510 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f450c006fd0 tx=0x7f450c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f451a7fc700 1 -- 172.21.15.61:0/935338230 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c011e20 con 0x7f4524068c80 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f451a7fc700 1 -- 172.21.15.61:0/935338230 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c01a630 con 0x7f4524068c80 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f4528d4c700 1 -- 172.21.15.61:0/935338230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45240b2260 con 0x7f4524068c80 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f451a7fc700 1 -- 172.21.15.61:0/935338230 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c01a9f0 con 0x7f4524068c80 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.843+0000 7f4528d4c700 1 -- 172.21.15.61:0/935338230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45240ad380 con 0x7f4524068c80 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.844+0000 7f4528d4c700 1 -- 172.21.15.61:0/935338230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452404c3c0 con 0x7f4524068c80 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.844+0000 7f451a7fc700 1 -- 172.21.15.61:0/935338230 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f450c02d440 con 0x7f4524068c80 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.845+0000 7f451a7fc700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.845+0000 7f451a7fc700 1 -- 172.21.15.61:0/935338230 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f450c085d20 con 0x7f4524068c80 2023-12-24T20:03:43.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.845+0000 7f4521d9b700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:43.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.846+0000 7f4521d9b700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4504066f30 0x7f45040693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f45240cbd10 tx=0x7f4514009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:43.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:43.849+0000 7f451a7fc700 1 -- 172.21.15.61:0/935338230 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f450c0532e0 con 0x7f4524068c80 2023-12-24T20:03:44.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.121+0000 7f4528d4c700 1 -- 172.21.15.61:0/935338230 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f452406f110 con 0x7f4524068c80 2023-12-24T20:03:44.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.121+0000 7f451a7fc700 1 -- 172.21.15.61:0/935338230 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f450c056900 con 0x7f4524068c80 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout: "auth_dump": [ 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.a", 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew==", 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:03:44.122 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.b", 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw==", 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.c", 2023-12-24T20:03:44.123 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g==", 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.d", 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg==", 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:03:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.0", 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag==", 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.1", 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw==", 2023-12-24T20:03:44.125 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.2", 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ==", 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.3", 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA==", 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.4", 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ==", 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:03:44.127 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.5", 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w==", 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.6", 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw==", 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.7", 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw==", 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.129 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.0", 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA==", 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow r", 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.130 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.1", 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w==", 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.2", 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg==", 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:03:44.131 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.3", 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g==", 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:03:44.132 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.admin", 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlwF3pGRAA8h0Cld7lwZprlrgMAN7tSg==", 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.x", 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg==", 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.y", 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A==", 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:03:44.134 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:03:44.135 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:03:44.135 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:03:44.135 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.135 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:44.135 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:03:44.135 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:44.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 -- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4504066f30 msgr2=0x7f45040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4504066f30 0x7f45040693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f45240cbd10 tx=0x7f4514009040 comp rx=0 tx=0).stop 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 -- 172.21.15.61:0/935338230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4524068c80 msgr2=0x7f452414a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4524068c80 0x7f452414a510 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f450c006fd0 tx=0x7f450c017000 comp rx=0 tx=0).stop 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 -- 172.21.15.61:0/935338230 shutdown_connections 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452415acf0 0x7f45241570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4504066f30 0x7f45040693e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4524068c80 0x7f452414a510 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 --2- 172.21.15.61:0/935338230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45240af710 0x7f45240b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 -- 172.21.15.61:0/935338230 >> 172.21.15.61:0/935338230 conn(0x7f45240ca200 msgr2=0x7f4524156250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 -- 172.21.15.61:0/935338230 shutdown_connections 2023-12-24T20:03:44.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.123+0000 7f4528d4c700 1 -- 172.21.15.61:0/935338230 wait complete. 2023-12-24T20:03:44.138 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:03:44.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.259+0000 7f2b09c2f700 1 Processor -- start 2023-12-24T20:03:44.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.259+0000 7f2b09c2f700 1 -- start start 2023-12-24T20:03:44.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b09c2f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b04156730 0x7f2b04156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b09c2f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2b040b0830 0x7f2b0406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b09c2f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b04067a60 con 0x7f2b0406de20 2023-12-24T20:03:44.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b09c2f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0406e240 con 0x7f2b040b0830 2023-12-24T20:03:44.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b09c2f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b040c88e0 con 0x7f2b04156730 2023-12-24T20:03:44.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b02ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2b040b0830 0x7f2b0406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b03fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2b0406de20 0x7f2b040c7c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60740/0 (socket says 172.21.15.61:60740) 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b03fff700 1 -- 172.21.15.61:0/1401535495 learned_addr learned my addr 172.21.15.61:0/1401535495 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b037fe700 1 --2- 172.21.15.61:0/1401535495 >> v2:172.21.15.133:3300/0 conn(0x7f2b04156730 0x7f2b04156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b02ffd700 1 -- 172.21.15.61:0/1401535495 >> v2:172.21.15.133:3300/0 conn(0x7f2b04156730 msgr2=0x7f2b04156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b02ffd700 1 --2- 172.21.15.61:0/1401535495 >> v2:172.21.15.133:3300/0 conn(0x7f2b04156730 0x7f2b04156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b02ffd700 1 -- 172.21.15.61:0/1401535495 >> v1:172.21.15.61:6789/0 conn(0x7f2b0406de20 legacy=0x7f2b040c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b02ffd700 1 -- 172.21.15.61:0/1401535495 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b040c8bc0 con 0x7f2b040b0830 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b027fc700 1 -- 172.21.15.61:0/1401535495 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827174208 0 0) 0x7f2b04067a60 con 0x7f2b0406de20 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.260+0000 7f2b037fe700 1 --2- 172.21.15.61:0/1401535495 >> v2:172.21.15.133:3300/0 conn(0x7f2b04156730 0x7f2b04156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b02ffd700 1 --2- 172.21.15.61:0/1401535495 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 0x7f2b0406d8e0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f2b040ca130 tx=0x7f2aec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4369f080b2dd65b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b027fc700 1 -- 172.21.15.61:0/1401535495 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00b6b0 con 0x7f2b040b0830 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b027fc700 1 -- 172.21.15.61:0/1401535495 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00b810 con 0x7f2b040b0830 2023-12-24T20:03:44.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b027fc700 1 -- 172.21.15.61:0/1401535495 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00bbb0 con 0x7f2b040b0830 2023-12-24T20:03:44.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b09c2f700 1 -- 172.21.15.61:0/1401535495 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 msgr2=0x7f2b0406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b09c2f700 1 --2- 172.21.15.61:0/1401535495 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 0x7f2b0406d8e0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f2b040ca130 tx=0x7f2aec0091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b09c2f700 1 -- 172.21.15.61:0/1401535495 shutdown_connections 2023-12-24T20:03:44.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b09c2f700 1 --2- 172.21.15.61:0/1401535495 >> v2:172.21.15.133:3300/0 conn(0x7f2b04156730 0x7f2b04156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b09c2f700 1 --2- 172.21.15.61:0/1401535495 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 0x7f2b0406d8e0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b09c2f700 1 -- 172.21.15.61:0/1401535495 >> 172.21.15.61:0/1401535495 conn(0x7f2b040cd6f0 msgr2=0x7f2b040cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:44.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b09c2f700 1 -- 172.21.15.61:0/1401535495 shutdown_connections 2023-12-24T20:03:44.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.261+0000 7f2b09c2f700 1 -- 172.21.15.61:0/1401535495 wait complete. 2023-12-24T20:03:44.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.263+0000 7f2b09c2f700 1 Processor -- start 2023-12-24T20:03:44.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.263+0000 7f2b09c2f700 1 -- start start 2023-12-24T20:03:44.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b09c2f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b0406de20 0x7f2b040aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b09c2f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 0x7f2b04155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b09c2f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b04156730 0x7f2b041591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b09c2f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b040aaf20 con 0x7f2b040b0830 2023-12-24T20:03:44.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b09c2f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04155f00 con 0x7f2b04156730 2023-12-24T20:03:44.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b09c2f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04158180 con 0x7f2b0406de20 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 0x7f2b04155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b02ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 0x7f2b04155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40626/0 (socket says 172.21.15.61:40626) 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b02ffd700 1 -- 172.21.15.61:0/4247750851 learned_addr learned my addr 172.21.15.61:0/4247750851 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b037fe700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b0406de20 0x7f2b040aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b03fff700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b04156730 0x7f2b041591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b02ffd700 1 -- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b0406de20 msgr2=0x7f2b040aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b02ffd700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b0406de20 0x7f2b040aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b02ffd700 1 -- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b04156730 msgr2=0x7f2b041591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b02ffd700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b04156730 0x7f2b041591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b02ffd700 1 -- 172.21.15.61:0/4247750851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec009420 con 0x7f2b040b0830 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b02ffd700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 0x7f2b04155330 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2aec013000 tx=0x7f2aec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2afb7fe700 1 -- 172.21.15.61:0/4247750851 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00bb90 con 0x7f2b040b0830 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2afb7fe700 1 -- 172.21.15.61:0/4247750851 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec011420 con 0x7f2b040b0830 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b09c2f700 1 -- 172.21.15.61:0/4247750851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b04158460 con 0x7f2b040b0830 2023-12-24T20:03:44.268 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2afb7fe700 1 -- 172.21.15.61:0/4247750851 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec0117a0 con 0x7f2b040b0830 2023-12-24T20:03:44.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.264+0000 7f2b09c2f700 1 -- 172.21.15.61:0/4247750851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b04158a20 con 0x7f2b040b0830 2023-12-24T20:03:44.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.265+0000 7f2b09c2f700 1 -- 172.21.15.61:0/4247750851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b041582c0 con 0x7f2b040b0830 2023-12-24T20:03:44.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.266+0000 7f2afb7fe700 1 -- 172.21.15.61:0/4247750851 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2aec011b90 con 0x7f2b040b0830 2023-12-24T20:03:44.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.266+0000 7f2afb7fe700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ae4066f30 0x7f2ae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.266+0000 7f2afb7fe700 1 -- 172.21.15.61:0/4247750851 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2aec085b00 con 0x7f2b040b0830 2023-12-24T20:03:44.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.266+0000 7f2b037fe700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ae4066f30 0x7f2ae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.269 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.267+0000 7f2b037fe700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ae4066f30 0x7f2ae40693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2af4006f00 tx=0x7f2af4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:44.271 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.271+0000 7f2afb7fe700 1 -- 172.21.15.61:0/4247750851 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b041582c0 con 0x7f2b040b0830 2023-12-24T20:03:44.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.465+0000 7f2b09c2f700 1 -- 172.21.15.61:0/4247750851 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b041582c0 con 0x7f2b040b0830 2023-12-24T20:03:44.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.466+0000 7f2afb7fe700 1 -- 172.21.15.61:0/4247750851 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f2b041582c0 con 0x7f2b040b0830 2023-12-24T20:03:44.466 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:44.467 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":147,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:03:43.689937+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:03:44.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 -- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ae4066f30 msgr2=0x7f2ae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ae4066f30 0x7f2ae40693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2af4006f00 tx=0x7f2af4008040 comp rx=0 tx=0).stop 2023-12-24T20:03:44.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 -- 172.21.15.61:0/4247750851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 msgr2=0x7f2b04155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 0x7f2b04155330 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2aec013000 tx=0x7f2aec017000 comp rx=0 tx=0).stop 2023-12-24T20:03:44.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 -- 172.21.15.61:0/4247750851 shutdown_connections 2023-12-24T20:03:44.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2b0406de20 0x7f2b040aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2ae4066f30 0x7f2ae40693e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b04156730 0x7f2b041591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 --2- 172.21.15.61:0/4247750851 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2b040b0830 0x7f2b04155330 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 -- 172.21.15.61:0/4247750851 >> 172.21.15.61:0/4247750851 conn(0x7f2b040cd6f0 msgr2=0x7f2b0406a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:44.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 -- 172.21.15.61:0/4247750851 shutdown_connections 2023-12-24T20:03:44.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.468+0000 7f2b09c2f700 1 -- 172.21.15.61:0/4247750851 wait complete. 2023-12-24T20:03:44.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T20:03:44.481 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:03:44.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.604+0000 7fd8bc0de700 1 Processor -- start 2023-12-24T20:03:44.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.605+0000 7fd8bc0de700 1 -- start start 2023-12-24T20:03:44.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.605+0000 7fd8bc0de700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd8b4159f10 0x7fd8b4164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.605+0000 7fd8bc0de700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b415d900 con 0x7fd8b406b560 2023-12-24T20:03:44.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8bc0de700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b415e480 con 0x7fd8b40ce030 2023-12-24T20:03:44.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8bc0de700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b415e910 con 0x7fd8b4159f10 2023-12-24T20:03:44.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8b9679700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fd8b406b560 0x7fd8b4159800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60754/0 (socket says 172.21.15.61:60754) 2023-12-24T20:03:44.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8b9679700 1 -- 172.21.15.61:0/4100224165 learned_addr learned my addr 172.21.15.61:0/4100224165 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8ba67b700 1 --2- 172.21.15.61:0/4100224165 >> v2:172.21.15.61:3300/0 conn(0x7fd8b4159f10 0x7fd8b4164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8b8e78700 1 -- 172.21.15.61:0/4100224165 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744138576 0 0) 0x7fd8b415d900 con 0x7fd8b406b560 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8b8e78700 1 -- 172.21.15.61:0/4100224165 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a0003570 con 0x7fd8b406b560 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8ba67b700 1 -- 172.21.15.61:0/4100224165 >> v1:172.21.15.133:6789/0 conn(0x7fd8b40ce030 legacy=0x7fd8b4068df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8ba67b700 1 -- 172.21.15.61:0/4100224165 >> v1:172.21.15.61:6789/0 conn(0x7fd8b406b560 legacy=0x7fd8b4159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8ba67b700 1 -- 172.21.15.61:0/4100224165 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b415db50 con 0x7fd8b4159f10 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8ba67b700 1 --2- 172.21.15.61:0/4100224165 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b4159f10 0x7fd8b4164ca0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009e60 tx=0x7fd8ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359791b18d5eac14 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8b8e78700 1 -- 172.21.15.61:0/4100224165 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac00e070 con 0x7fd8b4159f10 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8b8e78700 1 -- 172.21.15.61:0/4100224165 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac00bb60 con 0x7fd8b4159f10 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.606+0000 7fd8b8e78700 1 -- 172.21.15.61:0/4100224165 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac012430 con 0x7fd8b4159f10 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.607+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4100224165 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b4159f10 msgr2=0x7fd8b4164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.607+0000 7fd8bc0de700 1 --2- 172.21.15.61:0/4100224165 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b4159f10 0x7fd8b4164ca0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009e60 tx=0x7fd8ac009780 comp rx=0 tx=0).stop 2023-12-24T20:03:44.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.607+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4100224165 shutdown_connections 2023-12-24T20:03:44.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.607+0000 7fd8bc0de700 1 --2- 172.21.15.61:0/4100224165 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b4159f10 0x7fd8b4164ca0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.607+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4100224165 >> 172.21.15.61:0/4100224165 conn(0x7fd8b406f810 msgr2=0x7fd8b406ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:44.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.607+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4100224165 shutdown_connections 2023-12-24T20:03:44.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.607+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4100224165 wait complete. 2023-12-24T20:03:44.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.608+0000 7fd8bc0de700 1 Processor -- start 2023-12-24T20:03:44.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.608+0000 7fd8bc0de700 1 -- start start 2023-12-24T20:03:44.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8bc0de700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b406b560 0x7fd8b4155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8bc0de700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b40ce030 0x7fd8b415bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8bc0de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8b4159f10 0x7fd8b41587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8bc0de700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b4155b90 con 0x7fd8b40ce030 2023-12-24T20:03:44.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8bc0de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b416a3c0 con 0x7fd8b4159f10 2023-12-24T20:03:44.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8bc0de700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b416a070 con 0x7fd8b406b560 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8b9679700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b40ce030 0x7fd8b415bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8b9679700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b40ce030 0x7fd8b415bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40642/0 (socket says 172.21.15.61:40642) 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8b9679700 1 -- 172.21.15.61:0/4198389676 learned_addr learned my addr 172.21.15.61:0/4198389676 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8ba67b700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8b4159f10 0x7fd8b41587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8b9e7a700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b406b560 0x7fd8b4155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8b9679700 1 -- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b406b560 msgr2=0x7fd8b4155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8b9679700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b406b560 0x7fd8b4155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8b9679700 1 -- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8b4159f10 msgr2=0x7fd8b41587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8b9679700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8b4159f10 0x7fd8b41587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8b9679700 1 -- 172.21.15.61:0/4198389676 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac009a20 con 0x7fd8b40ce030 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.609+0000 7fd8b9679700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b40ce030 0x7fd8b415bd20 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400c590 tx=0x7fd8a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.610+0000 7fd8a9ffb700 1 -- 172.21.15.61:0/4198389676 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4005b30 con 0x7fd8b40ce030 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.610+0000 7fd8a9ffb700 1 -- 172.21.15.61:0/4198389676 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a4005cb0 con 0x7fd8b40ce030 2023-12-24T20:03:44.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.610+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4198389676 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b415c260 con 0x7fd8b40ce030 2023-12-24T20:03:44.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.610+0000 7fd8a9ffb700 1 -- 172.21.15.61:0/4198389676 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4007320 con 0x7fd8b40ce030 2023-12-24T20:03:44.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.610+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4198389676 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b415c810 con 0x7fd8b40ce030 2023-12-24T20:03:44.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.611+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4198389676 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b404c3c0 con 0x7fd8b40ce030 2023-12-24T20:03:44.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.611+0000 7fd8a9ffb700 1 -- 172.21.15.61:0/4198389676 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd8a401b3b0 con 0x7fd8b40ce030 2023-12-24T20:03:44.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.612+0000 7fd8a9ffb700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd898066f30 0x7fd8980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.612+0000 7fd8a9ffb700 1 -- 172.21.15.61:0/4198389676 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd8a40835f0 con 0x7fd8b40ce030 2023-12-24T20:03:44.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.612+0000 7fd8b9e7a700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd898066f30 0x7fd8980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.612+0000 7fd8b9e7a700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd898066f30 0x7fd8980693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd8b406cab0 tx=0x7fd8b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:44.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.616+0000 7fd8a9ffb700 1 -- 172.21.15.61:0/4198389676 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8a4050bb0 con 0x7fd8b40ce030 2023-12-24T20:03:44.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.815+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4198389676 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8b416a500 con 0x7fd8b40ce030 2023-12-24T20:03:44.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.815+0000 7fd8a9ffb700 1 -- 172.21.15.61:0/4198389676 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8a40170a0 con 0x7fd8b40ce030 2023-12-24T20:03:44.816 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:03:44.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd898066f30 msgr2=0x7fd8980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd898066f30 0x7fd8980693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd8b406cab0 tx=0x7fd8b0009040 comp rx=0 tx=0).stop 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4198389676 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b40ce030 msgr2=0x7fd8b415bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b40ce030 0x7fd8b415bd20 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400c590 tx=0x7fd8a4007e00 comp rx=0 tx=0).stop 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4198389676 shutdown_connections 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd8b406b560 0x7fd8b4155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd898066f30 0x7fd8980693e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8b4159f10 0x7fd8b41587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 --2- 172.21.15.61:0/4198389676 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd8b40ce030 0x7fd8b415bd20 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4198389676 >> 172.21.15.61:0/4198389676 conn(0x7fd8b406f810 msgr2=0x7fd8b40b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4198389676 shutdown_connections 2023-12-24T20:03:44.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.817+0000 7fd8bc0de700 1 -- 172.21.15.61:0/4198389676 wait complete. 2023-12-24T20:03:44.830 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T20:03:44.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.951+0000 7f0bcba85700 1 Processor -- start 2023-12-24T20:03:44.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.951+0000 7f0bcba85700 1 -- start start 2023-12-24T20:03:44.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.952+0000 7f0bcba85700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc40b3d30 0x7f0bc40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.952+0000 7f0bcba85700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc40b2890 con 0x7f0bc4068510 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.952+0000 7f0bcba85700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc40cf630 con 0x7f0bc4068140 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.952+0000 7f0bcba85700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40b2240 con 0x7f0bc40b3d30 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.952+0000 7f0bc9020700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0bc4068510 0x7f0bc4159a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60766/0 (socket says 172.21.15.61:60766) 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.952+0000 7f0bc9020700 1 -- 172.21.15.61:0/2037087350 learned_addr learned my addr 172.21.15.61:0/2037087350 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bca022700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc40b3d30 0x7f0bc40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025005275 0 0) 0x7f0bc40b2890 con 0x7f0bc4068510 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb0003570 con 0x7f0bc4068510 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1414391308 0 0) 0x7f0bb0003570 con 0x7f0bc4068510 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc40b3d30 msgr2=0x7f0bc40cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc40b3d30 0x7f0bc40cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 >> v1:172.21.15.133:6789/0 conn(0x7f0bc4068140 legacy=0x7f0bc40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc40b2520 con 0x7f0bc4068510 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f0bc0001470 con 0x7f0bc4068510 2023-12-24T20:03:44.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 >> v1:172.21.15.61:6789/0 conn(0x7f0bc4068510 legacy=0x7f0bc4159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc40b3d30 0x7f0bb0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bb0003fd0 0x7f0bb0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0004d50 0x7f0bb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40b2240 con 0x7f0bb0003fd0 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb000bb40 con 0x7f0bb0004d50 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb000bd00 con 0x7f0bc40b3d30 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc9020700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bb0003fd0 0x7f0bb0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc9821700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc40b3d30 0x7f0bb0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bca022700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0004d50 0x7f0bb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc9020700 1 -- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc40b3d30 msgr2=0x7f0bb0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc9020700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc40b3d30 0x7f0bb0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc9020700 1 -- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0004d50 msgr2=0x7f0bb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc9020700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0004d50 0x7f0bb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.953+0000 7f0bc9020700 1 -- 172.21.15.61:0/2037087350 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb0003570 con 0x7f0bb0003fd0 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bc9020700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bb0003fd0 0x7f0bb0004810 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c3c0 tx=0x7f0bc0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21acb1a91aff8a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000cc90 con 0x7f0bb0003fd0 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc000cdf0 con 0x7f0bb0003fd0 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bc881f700 1 -- 172.21.15.61:0/2037087350 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0005b70 con 0x7f0bb0003fd0 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bcba85700 1 -- 172.21.15.61:0/2037087350 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bb0003fd0 msgr2=0x7f0bb0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bcba85700 1 --2- 172.21.15.61:0/2037087350 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bb0003fd0 0x7f0bb0004810 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c3c0 tx=0x7f0bc0001e70 comp rx=0 tx=0).stop 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bca022700 1 -- 172.21.15.61:0/2037087350 reap_dead start 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bcba85700 1 -- 172.21.15.61:0/2037087350 shutdown_connections 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bcba85700 1 -- 172.21.15.61:0/2037087350 >> 172.21.15.61:0/2037087350 conn(0x7f0bc4097a10 msgr2=0x7f0bc40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bcba85700 1 -- 172.21.15.61:0/2037087350 shutdown_connections 2023-12-24T20:03:44.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.954+0000 7f0bcba85700 1 -- 172.21.15.61:0/2037087350 wait complete. 2023-12-24T20:03:44.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.955+0000 7f0bcba85700 1 Processor -- start 2023-12-24T20:03:44.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.956+0000 7f0bcba85700 1 -- start start 2023-12-24T20:03:44.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.956+0000 7f0bcba85700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0003fd0 0x7f0bc4099380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.956+0000 7f0bcba85700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bc4098460 0x7f0bc4152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.956+0000 7f0bcba85700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc409b130 0x7f0bc409b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.956+0000 7f0bcba85700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc409aa50 con 0x7f0bc4098460 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.956+0000 7f0bcba85700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc409bad0 con 0x7f0bb0003fd0 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.956+0000 7f0bcba85700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc4159e80 con 0x7f0bc409b130 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.956+0000 7f0bc9020700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bc4098460 0x7f0bc4152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.956+0000 7f0bc9020700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bc4098460 0x7f0bc4152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40666/0 (socket says 172.21.15.61:40666) 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.956+0000 7f0bc9020700 1 -- 172.21.15.61:0/4085683185 learned_addr learned my addr 172.21.15.61:0/4085683185 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bc9821700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0003fd0 0x7f0bc4099380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bca022700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc409b130 0x7f0bc409b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bc9020700 1 -- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc409b130 msgr2=0x7f0bc409b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bc9020700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc409b130 0x7f0bc409b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bc9020700 1 -- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0003fd0 msgr2=0x7f0bc4099380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bc9020700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0003fd0 0x7f0bc4099380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:44.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bc9020700 1 -- 172.21.15.61:0/4085683185 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4099a80 con 0x7f0bc4098460 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bc9821700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0003fd0 0x7f0bc4099380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bc9020700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bc4098460 0x7f0bc4152d70 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c9b0 tx=0x7f0bc0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bb9ffb700 1 -- 172.21.15.61:0/4085683185 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0001710 con 0x7f0bc4098460 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bb9ffb700 1 -- 172.21.15.61:0/4085683185 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc00070d0 con 0x7f0bc4098460 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bcba85700 1 -- 172.21.15.61:0/4085683185 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc4099d60 con 0x7f0bc4098460 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bb9ffb700 1 -- 172.21.15.61:0/4085683185 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0007490 con 0x7f0bc4098460 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.957+0000 7f0bcba85700 1 -- 172.21.15.61:0/4085683185 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc4159b10 con 0x7f0bc4098460 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.958+0000 7f0bcba85700 1 -- 172.21.15.61:0/4085683185 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc406d440 con 0x7f0bc4098460 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.959+0000 7f0bb9ffb700 1 -- 172.21.15.61:0/4085683185 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0bc0019070 con 0x7f0bc4098460 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.959+0000 7f0bb9ffb700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ba8066f30 0x7f0ba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.959+0000 7f0bb9ffb700 1 -- 172.21.15.61:0/4085683185 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0bc0085670 con 0x7f0bc4098460 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.959+0000 7f0bc9821700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ba8066f30 0x7f0ba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:44.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.960+0000 7f0bc9821700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ba8066f30 0x7f0ba80693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4007bf0 tx=0x7f0bb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:44.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:44.963+0000 7f0bb9ffb700 1 -- 172.21.15.61:0/4085683185 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bc0052ce0 con 0x7f0bc4098460 2023-12-24T20:03:45.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.159+0000 7f0bcba85700 1 -- 172.21.15.61:0/4085683185 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0bc404c3c0 con 0x7f0bc4098460 2023-12-24T20:03:45.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.159+0000 7f0bb9ffb700 1 -- 172.21.15.61:0/4085683185 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v147) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0bc0056300 con 0x7f0bc4098460 2023-12-24T20:03:45.160 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:45.160 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T20:03:45.160 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:03:45.160 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T20:03:45.160 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T20:03:45.160 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:45.160 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T20:03:45.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 -- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ba8066f30 msgr2=0x7f0ba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ba8066f30 0x7f0ba80693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4007bf0 tx=0x7f0bb4009040 comp rx=0 tx=0).stop 2023-12-24T20:03:45.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 -- 172.21.15.61:0/4085683185 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bc4098460 msgr2=0x7f0bc4152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bc4098460 0x7f0bc4152d70 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c9b0 tx=0x7f0bc0015000 comp rx=0 tx=0).stop 2023-12-24T20:03:45.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 -- 172.21.15.61:0/4085683185 shutdown_connections 2023-12-24T20:03:45.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bc409b130 0x7f0bc409b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0ba8066f30 0x7f0ba80693e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bb0003fd0 0x7f0bc4099380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 --2- 172.21.15.61:0/4085683185 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bc4098460 0x7f0bc4152d70 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 -- 172.21.15.61:0/4085683185 >> 172.21.15.61:0/4085683185 conn(0x7f0bc4097a10 msgr2=0x7f0bc4154cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:45.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 -- 172.21.15.61:0/4085683185 shutdown_connections 2023-12-24T20:03:45.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.161+0000 7f0bcba85700 1 -- 172.21.15.61:0/4085683185 wait complete. 2023-12-24T20:03:45.174 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T20:03:45.174 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T20:03:45.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.299+0000 7f3bbf0b3700 1 Processor -- start 2023-12-24T20:03:45.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.300+0000 7f3bbf0b3700 1 -- start start 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.300+0000 7f3bbf0b3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bb8069240 0x7f3bb8159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.300+0000 7f3bbf0b3700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb80ca4e0 con 0x7f3bb8159980 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.300+0000 7f3bbf0b3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb80ca1b0 con 0x7f3bb806f940 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.300+0000 7f3bbf0b3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb8068620 con 0x7f3bb8069240 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.300+0000 7f3bbce4f700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3bb8159980 0x7f3bb8067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60772/0 (socket says 172.21.15.61:60772) 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.300+0000 7f3bbce4f700 1 -- 172.21.15.61:0/214618205 learned_addr learned my addr 172.21.15.61:0/214618205 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bbd650700 1 --2- 172.21.15.61:0/214618205 >> v2:172.21.15.133:3300/0 conn(0x7f3bb8069240 0x7f3bb8159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515023800 0 0) 0x7f3bb80ca4e0 con 0x7f3bb8159980 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba8003570 con 0x7f3bb8159980 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2182092496 0 0) 0x7f3ba8003570 con 0x7f3bb8159980 2023-12-24T20:03:45.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 >> v2:172.21.15.133:3300/0 conn(0x7f3bb8069240 msgr2=0x7f3bb8159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 --2- 172.21.15.61:0/214618205 >> v2:172.21.15.133:3300/0 conn(0x7f3bb8069240 0x7f3bb8159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 >> v1:172.21.15.133:6789/0 conn(0x7f3bb806f940 legacy=0x7f3bb8068b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8067d80 con 0x7f3bb8159980 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f3bac001470 con 0x7f3bb8159980 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 >> v1:172.21.15.61:6789/0 conn(0x7f3bb8159980 legacy=0x7f3bb8067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3ba8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba8004810 0x7f3ba8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ba80051c0 0x7f3ba800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb8068620 con 0x7f3ba8003a60 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba800c0d0 con 0x7f3ba8004810 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba800c290 con 0x7f3ba80051c0 2023-12-24T20:03:45.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bbce4f700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3ba8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bb7fff700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba8004810 0x7f3ba8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.301+0000 7f3bbd650700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ba80051c0 0x7f3ba800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbce4f700 1 -- 172.21.15.61:0/214618205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ba80051c0 msgr2=0x7f3ba800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbce4f700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ba80051c0 0x7f3ba800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbce4f700 1 -- 172.21.15.61:0/214618205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba8004810 msgr2=0x7f3ba8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbce4f700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba8004810 0x7f3ba8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbce4f700 1 -- 172.21.15.61:0/214618205 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8003570 con 0x7f3ba8003a60 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbd650700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3ba80051c0 0x7f3ba800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bb7fff700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ba8004810 0x7f3ba8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbd650700 1 -- 172.21.15.61:0/214618205 reap_dead start 2023-12-24T20:03:45.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbce4f700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3ba8003e70 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c3c0 tx=0x7f3bac001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b748fe67555e020 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00cc90 con 0x7f3ba8003a60 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00cdf0 con 0x7f3ba8003a60 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bb77fe700 1 -- 172.21.15.61:0/214618205 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac005b50 con 0x7f3ba8003a60 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/214618205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 msgr2=0x7f3ba8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbf0b3700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3ba8003e70 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c3c0 tx=0x7f3bac001e50 comp rx=0 tx=0).stop 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/214618205 shutdown_connections 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbf0b3700 1 --2- 172.21.15.61:0/214618205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3ba8003e70 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/214618205 >> 172.21.15.61:0/214618205 conn(0x7f3bb8069760 msgr2=0x7f3bb8069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/214618205 shutdown_connections 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.302+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/214618205 wait complete. 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.304+0000 7f3bbf0b3700 1 Processor -- start 2023-12-24T20:03:45.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.304+0000 7f3bbf0b3700 1 -- start start 2023-12-24T20:03:45.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbf0b3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3bb80ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbf0b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bb80c4890 0x7f3bb80c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbf0b3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bb80c4d00 0x7f3bb80c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbf0b3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb8158820 con 0x7f3ba8003a60 2023-12-24T20:03:45.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbf0b3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80ab260 con 0x7f3bb80c4890 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbf0b3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80c8570 con 0x7f3bb80c4d00 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbce4f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3bb80ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbce4f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3bb80ab6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40684/0 (socket says 172.21.15.61:40684) 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbce4f700 1 -- 172.21.15.61:0/2919439991 learned_addr learned my addr 172.21.15.61:0/2919439991 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bb7fff700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bb80c4890 0x7f3bb80c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbd650700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bb80c4d00 0x7f3bb80c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbce4f700 1 -- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bb80c4d00 msgr2=0x7f3bb80c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbce4f700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bb80c4d00 0x7f3bb80c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbce4f700 1 -- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bb80c4890 msgr2=0x7f3bb80c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbce4f700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bb80c4890 0x7f3bb80c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbce4f700 1 -- 172.21.15.61:0/2919439991 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80aa930 con 0x7f3ba8003a60 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bb7fff700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bb80c4890 0x7f3bb80c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbd650700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bb80c4d00 0x7f3bb80c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbce4f700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3bb80ab6f0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c9b0 tx=0x7f3bac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bb4ff9700 1 -- 172.21.15.61:0/2919439991 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac022070 con 0x7f3ba8003a60 2023-12-24T20:03:45.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bb4ff9700 1 -- 172.21.15.61:0/2919439991 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0072e0 con 0x7f3ba8003a60 2023-12-24T20:03:45.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/2919439991 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb80aac10 con 0x7f3ba8003a60 2023-12-24T20:03:45.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bb4ff9700 1 -- 172.21.15.61:0/2919439991 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00cc90 con 0x7f3ba8003a60 2023-12-24T20:03:45.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.305+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/2919439991 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb80b0a40 con 0x7f3ba8003a60 2023-12-24T20:03:45.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.306+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/2919439991 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb804c3c0 con 0x7f3ba8003a60 2023-12-24T20:03:45.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.307+0000 7f3bb4ff9700 1 -- 172.21.15.61:0/2919439991 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3bac01e430 con 0x7f3ba8003a60 2023-12-24T20:03:45.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.307+0000 7f3bb4ff9700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3b9c066f30 0x7f3b9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.307+0000 7f3bb4ff9700 1 -- 172.21.15.61:0/2919439991 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3bac0854a0 con 0x7f3ba8003a60 2023-12-24T20:03:45.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.307+0000 7f3bb7fff700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3b9c066f30 0x7f3b9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.308+0000 7f3bb7fff700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3b9c066f30 0x7f3b9c0693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4007a80 tx=0x7f3ba4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:45.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.311+0000 7f3bb4ff9700 1 -- 172.21.15.61:0/2919439991 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bac052a60 con 0x7f3ba8003a60 2023-12-24T20:03:45.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.507+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/2919439991 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3bb8068060 con 0x7f3ba8003a60 2023-12-24T20:03:45.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.702+0000 7f3bb4ff9700 1 -- 172.21.15.61:0/2919439991 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v148) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3bac0170b0 con 0x7f3ba8003a60 2023-12-24T20:03:45.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.705+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3b9c066f30 msgr2=0x7f3b9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.705+0000 7f3bbf0b3700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3b9c066f30 0x7f3b9c0693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4007a80 tx=0x7f3ba4009040 comp rx=0 tx=0).stop 2023-12-24T20:03:45.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.705+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/2919439991 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 msgr2=0x7f3bb80ab6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.705+0000 7f3bbf0b3700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3bb80ab6f0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c9b0 tx=0x7f3bac015000 comp rx=0 tx=0).stop 2023-12-24T20:03:45.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.706+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/2919439991 shutdown_connections 2023-12-24T20:03:45.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.706+0000 7f3bbf0b3700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bb80c4d00 0x7f3bb80c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.706+0000 7f3bbf0b3700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3b9c066f30 0x7f3b9c0693e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.706+0000 7f3bbf0b3700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3ba8003a60 0x7f3bb80ab6f0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.706+0000 7f3bbf0b3700 1 --2- 172.21.15.61:0/2919439991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bb80c4890 0x7f3bb80c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.706+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/2919439991 >> 172.21.15.61:0/2919439991 conn(0x7f3bb8069760 msgr2=0x7f3bb80ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:45.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.706+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/2919439991 shutdown_connections 2023-12-24T20:03:45.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.706+0000 7f3bbf0b3700 1 -- 172.21.15.61:0/2919439991 wait complete. 2023-12-24T20:03:45.707 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T20:03:45.719 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T20:03:45.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.848+0000 7f3e184ab700 1 Processor -- start 2023-12-24T20:03:45.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.848+0000 7f3e184ab700 1 -- start start 2023-12-24T20:03:45.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.849+0000 7f3e184ab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e100c9db0 0x7f3e10162540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.849+0000 7f3e184ab700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100caf30 con 0x7f3e101578d0 2023-12-24T20:03:45.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.849+0000 7f3e184ab700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100af9f0 con 0x7f3e100af330 2023-12-24T20:03:45.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.849+0000 7f3e184ab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100af7d0 con 0x7f3e100c9db0 2023-12-24T20:03:45.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e16247700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3e101578d0 0x7f3e1006f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60776/0 (socket says 172.21.15.61:60776) 2023-12-24T20:03:45.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e16247700 1 -- 172.21.15.61:0/2431526630 learned_addr learned my addr 172.21.15.61:0/2431526630 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:45.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190512660 0 0) 0x7f3e100caf30 con 0x7f3e101578d0 2023-12-24T20:03:45.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e16a48700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e100c9db0 0x7f3e10162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dfc003570 con 0x7f3e101578d0 2023-12-24T20:03:45.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902338336 0 0) 0x7f3e100af9f0 con 0x7f3e100af330 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e100caf30 con 0x7f3e100af330 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1256918816 0 0) 0x7f3dfc003570 con 0x7f3e101578d0 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e100c9db0 msgr2=0x7f3e10162540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e100c9db0 0x7f3e10162540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 >> v1:172.21.15.133:6789/0 conn(0x7f3e100af330 legacy=0x7f3e1006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e100afcd0 con 0x7f3e101578d0 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f3e00001470 con 0x7f3e101578d0 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 >> v1:172.21.15.61:6789/0 conn(0x7f3e101578d0 legacy=0x7f3e1006f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dfc003c20 0x7f3dfc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e100c9db0 0x7f3dfc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 0x7f3dfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100af7d0 con 0x7f3dfc004d50 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc00bbf0 con 0x7f3dfc003c20 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc00bd60 con 0x7f3e100c9db0 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e16a48700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 0x7f3dfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e16247700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dfc003c20 0x7f3dfc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.850+0000 7f3e15a46700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e100c9db0 0x7f3dfc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e16a48700 1 -- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e100c9db0 msgr2=0x7f3dfc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e16a48700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e100c9db0 0x7f3dfc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e16a48700 1 -- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dfc003c20 msgr2=0x7f3dfc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e16a48700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dfc003c20 0x7f3dfc004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e16a48700 1 -- 172.21.15.61:0/2431526630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc003570 con 0x7f3dfc004d50 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e15a46700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e100c9db0 0x7f3dfc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:45.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e16a48700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 0x7f3dfc0051c0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f3e080094d0 tx=0x7f3e0800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59fc27f20b7ecca server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:45.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800ea60 con 0x7f3dfc004d50 2023-12-24T20:03:45.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0800f040 con 0x7f3dfc004d50 2023-12-24T20:03:45.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e15245700 1 -- 172.21.15.61:0/2431526630 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800edf0 con 0x7f3dfc004d50 2023-12-24T20:03:45.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e184ab700 1 -- 172.21.15.61:0/2431526630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 msgr2=0x7f3dfc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e184ab700 1 --2- 172.21.15.61:0/2431526630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 0x7f3dfc0051c0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f3e080094d0 tx=0x7f3e0800b040 comp rx=0 tx=0).stop 2023-12-24T20:03:45.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.851+0000 7f3e16a48700 1 -- 172.21.15.61:0/2431526630 reap_dead start 2023-12-24T20:03:45.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.852+0000 7f3e184ab700 1 -- 172.21.15.61:0/2431526630 shutdown_connections 2023-12-24T20:03:45.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.852+0000 7f3e184ab700 1 -- 172.21.15.61:0/2431526630 >> 172.21.15.61:0/2431526630 conn(0x7f3e100ce800 msgr2=0x7f3e100cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:45.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.852+0000 7f3e184ab700 1 -- 172.21.15.61:0/2431526630 shutdown_connections 2023-12-24T20:03:45.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.852+0000 7f3e184ab700 1 -- 172.21.15.61:0/2431526630 wait complete. 2023-12-24T20:03:45.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.853+0000 7f3e184ab700 1 Processor -- start 2023-12-24T20:03:45.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.853+0000 7f3e184ab700 1 -- start start 2023-12-24T20:03:45.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.853+0000 7f3e184ab700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 0x7f3e100c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e184ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e100c9150 0x7f3e1015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e184ab700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e1015c180 0x7f3e10157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e184ab700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e10158c90 con 0x7f3dfc004d50 2023-12-24T20:03:45.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e184ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100c4bf0 con 0x7f3e100c9150 2023-12-24T20:03:45.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e184ab700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100c8cc0 con 0x7f3e1015c180 2023-12-24T20:03:45.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e16247700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 0x7f3e100c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e16247700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 0x7f3e100c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40688/0 (socket says 172.21.15.61:40688) 2023-12-24T20:03:45.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e16247700 1 -- 172.21.15.61:0/2476738875 learned_addr learned my addr 172.21.15.61:0/2476738875 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:45.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e15a46700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e100c9150 0x7f3e1015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e16a48700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e1015c180 0x7f3e10157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e16247700 1 -- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e1015c180 msgr2=0x7f3e10157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e16247700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e1015c180 0x7f3e10157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e16247700 1 -- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e100c9150 msgr2=0x7f3e1015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:45.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e16247700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e100c9150 0x7f3e1015bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:45.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e16247700 1 -- 172.21.15.61:0/2476738875 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1015c5f0 con 0x7f3dfc004d50 2023-12-24T20:03:45.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e15a46700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e100c9150 0x7f3e1015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:45.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e16247700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 0x7f3e100c46b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f3e000073c0 tx=0x7f3e00001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:45.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e067fc700 1 -- 172.21.15.61:0/2476738875 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00007780 con 0x7f3dfc004d50 2023-12-24T20:03:45.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e067fc700 1 -- 172.21.15.61:0/2476738875 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0000f850 con 0x7f3dfc004d50 2023-12-24T20:03:45.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e184ab700 1 -- 172.21.15.61:0/2476738875 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e100c83d0 con 0x7f3dfc004d50 2023-12-24T20:03:45.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e067fc700 1 -- 172.21.15.61:0/2476738875 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000fbd0 con 0x7f3dfc004d50 2023-12-24T20:03:45.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.854+0000 7f3e184ab700 1 -- 172.21.15.61:0/2476738875 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e100c8670 con 0x7f3dfc004d50 2023-12-24T20:03:45.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.855+0000 7f3e184ab700 1 -- 172.21.15.61:0/2476738875 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e100c8fa0 con 0x7f3dfc004d50 2023-12-24T20:03:45.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.856+0000 7f3e067fc700 1 -- 172.21.15.61:0/2476738875 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3e000133b0 con 0x7f3dfc004d50 2023-12-24T20:03:45.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.856+0000 7f3e067fc700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3df4066f30 0x7f3df40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:45.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.857+0000 7f3e067fc700 1 -- 172.21.15.61:0/2476738875 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f3e00083be0 con 0x7f3dfc004d50 2023-12-24T20:03:45.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.857+0000 7f3e15a46700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3df4066f30 0x7f3df40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:45.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.857+0000 7f3e15a46700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3df4066f30 0x7f3df40693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c000c00 tx=0x7f3e0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:45.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:45.861+0000 7f3e067fc700 1 -- 172.21.15.61:0/2476738875 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e00051030 con 0x7f3dfc004d50 2023-12-24T20:03:46.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.059+0000 7f3e184ab700 1 -- 172.21.15.61:0/2476738875 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3e1004c3c0 con 0x7f3dfc004d50 2023-12-24T20:03:46.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.708+0000 7f3e067fc700 1 -- 172.21.15.61:0/2476738875 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v149) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3e0001a020 con 0x7f3dfc004d50 2023-12-24T20:03:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.719+0000 7f3e184ab700 1 -- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3df4066f30 msgr2=0x7f3df40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.719+0000 7f3e184ab700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3df4066f30 0x7f3df40693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c000c00 tx=0x7f3e0c009040 comp rx=0 tx=0).stop 2023-12-24T20:03:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.719+0000 7f3e184ab700 1 -- 172.21.15.61:0/2476738875 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 msgr2=0x7f3e100c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.719+0000 7f3e184ab700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 0x7f3e100c46b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f3e000073c0 tx=0x7f3e00001d40 comp rx=0 tx=0).stop 2023-12-24T20:03:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.719+0000 7f3e184ab700 1 -- 172.21.15.61:0/2476738875 shutdown_connections 2023-12-24T20:03:46.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.719+0000 7f3e184ab700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3e1015c180 0x7f3e10157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.719+0000 7f3e184ab700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3df4066f30 0x7f3df40693e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.719+0000 7f3e184ab700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3dfc004d50 0x7f3e100c46b0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.719+0000 7f3e184ab700 1 --2- 172.21.15.61:0/2476738875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e100c9150 0x7f3e1015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.719+0000 7f3e184ab700 1 -- 172.21.15.61:0/2476738875 >> 172.21.15.61:0/2476738875 conn(0x7f3e100ce800 msgr2=0x7f3e100cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.720+0000 7f3e184ab700 1 -- 172.21.15.61:0/2476738875 shutdown_connections 2023-12-24T20:03:46.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.720+0000 7f3e184ab700 1 -- 172.21.15.61:0/2476738875 wait complete. 2023-12-24T20:03:46.722 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T20:03:46.735 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T20:03:46.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.860+0000 7f05d76c9700 1 Processor -- start 2023-12-24T20:03:46.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.860+0000 7f05d76c9700 1 -- start start 2023-12-24T20:03:46.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.861+0000 7f05d76c9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f05d0159a30 0x7f05d015e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:46.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.861+0000 7f05d76c9700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d015e750 con 0x7f05d00c3b80 2023-12-24T20:03:46.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.861+0000 7f05d76c9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d0067550 con 0x7f05d0070d50 2023-12-24T20:03:46.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.861+0000 7f05d76c9700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d0067b10 con 0x7f05d0159a30 2023-12-24T20:03:46.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.861+0000 7f05d5465700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f05d0159a30 0x7f05d015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:46.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.861+0000 7f05d5465700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f05d0159a30 0x7f05d015e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51978/0 (socket says 172.21.15.61:51978) 2023-12-24T20:03:46.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.861+0000 7f05d5465700 1 -- 172.21.15.61:0/2399380845 learned_addr learned my addr 172.21.15.61:0/2399380845 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:46.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.861+0000 7f05d4c64700 1 --1- 172.21.15.61:0/2399380845 >> v1:172.21.15.61:6789/0 conn(0x7f05d00c3b80 0x7f05d0070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40240/0 (socket says 172.21.15.61:40240) 2023-12-24T20:03:46.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05d5465700 1 -- 172.21.15.61:0/2399380845 >> v1:172.21.15.133:6789/0 conn(0x7f05d0070d50 legacy=0x7f05d0067fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:46.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05d5465700 1 -- 172.21.15.61:0/2399380845 >> v1:172.21.15.61:6789/0 conn(0x7f05d00c3b80 legacy=0x7f05d0070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:46.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05d5465700 1 -- 172.21.15.61:0/2399380845 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d0071550 con 0x7f05d0159a30 2023-12-24T20:03:46.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05d5465700 1 --2- 172.21.15.61:0/2399380845 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 0x7f05d015e210 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f05c00099b0 tx=0x7f05c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90bbb33de337a37 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:46.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05c7fff700 1 -- 172.21.15.61:0/2399380845 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000b860 con 0x7f05d0159a30 2023-12-24T20:03:46.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05c7fff700 1 -- 172.21.15.61:0/2399380845 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c000b9c0 con 0x7f05d0159a30 2023-12-24T20:03:46.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05c7fff700 1 -- 172.21.15.61:0/2399380845 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000bd60 con 0x7f05d0159a30 2023-12-24T20:03:46.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05d76c9700 1 -- 172.21.15.61:0/2399380845 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 msgr2=0x7f05d015e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:46.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05d76c9700 1 --2- 172.21.15.61:0/2399380845 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 0x7f05d015e210 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f05c00099b0 tx=0x7f05c0009250 comp rx=0 tx=0).stop 2023-12-24T20:03:46.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05d76c9700 1 -- 172.21.15.61:0/2399380845 shutdown_connections 2023-12-24T20:03:46.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05d76c9700 1 --2- 172.21.15.61:0/2399380845 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 0x7f05d015e210 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:46.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.862+0000 7f05d76c9700 1 -- 172.21.15.61:0/2399380845 >> 172.21.15.61:0/2399380845 conn(0x7f05d00ce1f0 msgr2=0x7f05d00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:46.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.863+0000 7f05d76c9700 1 -- 172.21.15.61:0/2399380845 shutdown_connections 2023-12-24T20:03:46.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.863+0000 7f05d76c9700 1 -- 172.21.15.61:0/2399380845 wait complete. 2023-12-24T20:03:46.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.864+0000 7f05d76c9700 1 Processor -- start 2023-12-24T20:03:46.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.864+0000 7f05d76c9700 1 -- start start 2023-12-24T20:03:46.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.865+0000 7f05d76c9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05d0070d50 0x7f05d0159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:46.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.865+0000 7f05d76c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05d00c3b80 0x7f05d015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:46.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.865+0000 7f05d76c9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 0x7f05d006a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:46.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.865+0000 7f05d76c9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d015dae0 con 0x7f05d0159a30 2023-12-24T20:03:46.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.865+0000 7f05d76c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d015d360 con 0x7f05d00c3b80 2023-12-24T20:03:46.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.865+0000 7f05d76c9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c8630 con 0x7f05d0070d50 2023-12-24T20:03:46.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.865+0000 7f05d5c66700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 0x7f05d006a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:46.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.865+0000 7f05d5c66700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 0x7f05d006a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:51986/0 (socket says 172.21.15.61:51986) 2023-12-24T20:03:46.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.865+0000 7f05d5c66700 1 -- 172.21.15.61:0/2026377243 learned_addr learned my addr 172.21.15.61:0/2026377243 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:46.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d4c64700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05d00c3b80 0x7f05d015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d5465700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05d0070d50 0x7f05d0159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d5c66700 1 -- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05d0070d50 msgr2=0x7f05d0159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d5c66700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05d0070d50 0x7f05d0159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d5c66700 1 -- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05d00c3b80 msgr2=0x7f05d015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d5c66700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05d00c3b80 0x7f05d015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d5c66700 1 -- 172.21.15.61:0/2026377243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00094f0 con 0x7f05d0159a30 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d5465700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05d0070d50 0x7f05d0159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d5c66700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 0x7f05d006a330 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c810 tx=0x7f05c8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05c57fa700 1 -- 172.21.15.61:0/2026377243 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8012630 con 0x7f05d0159a30 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05c57fa700 1 -- 172.21.15.61:0/2026377243 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8012790 con 0x7f05d0159a30 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d76c9700 1 -- 172.21.15.61:0/2026377243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d00c8910 con 0x7f05d0159a30 2023-12-24T20:03:46.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05c57fa700 1 -- 172.21.15.61:0/2026377243 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8012b50 con 0x7f05d0159a30 2023-12-24T20:03:46.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.866+0000 7f05d76c9700 1 -- 172.21.15.61:0/2026377243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d00c8ed0 con 0x7f05d0159a30 2023-12-24T20:03:46.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.867+0000 7f05d76c9700 1 -- 172.21.15.61:0/2026377243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d00c4a00 con 0x7f05d0159a30 2023-12-24T20:03:46.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.868+0000 7f05c57fa700 1 -- 172.21.15.61:0/2026377243 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f05c8003030 con 0x7f05d0159a30 2023-12-24T20:03:46.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.868+0000 7f05c57fa700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f05b4066f30 0x7f05b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:46.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.868+0000 7f05c57fa700 1 -- 172.21.15.61:0/2026377243 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f05c80844b0 con 0x7f05d0159a30 2023-12-24T20:03:46.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.868+0000 7f05d5465700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f05b4066f30 0x7f05b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:46.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.869+0000 7f05d5465700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f05b4066f30 0x7f05b40693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f05c00099b0 tx=0x7f05c0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:46.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:46.873+0000 7f05c57fa700 1 -- 172.21.15.61:0/2026377243 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05c80516e0 con 0x7f05d0159a30 2023-12-24T20:03:47.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.113+0000 7f05d76c9700 1 -- 172.21.15.61:0/2026377243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f05d004c3c0 con 0x7f05d0159a30 2023-12-24T20:03:47.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.713+0000 7f05c57fa700 1 -- 172.21.15.61:0/2026377243 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v73) v1 ==== 174+0+0 (secure 0 0 0) 0x7f05c8054d00 con 0x7f05d0159a30 2023-12-24T20:03:47.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.718+0000 7f05d76c9700 1 -- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f05b4066f30 msgr2=0x7f05b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:47.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.718+0000 7f05d76c9700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f05b4066f30 0x7f05b40693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f05c00099b0 tx=0x7f05c0017000 comp rx=0 tx=0).stop 2023-12-24T20:03:47.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.718+0000 7f05d76c9700 1 -- 172.21.15.61:0/2026377243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 msgr2=0x7f05d006a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:47.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.718+0000 7f05d76c9700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 0x7f05d006a330 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c810 tx=0x7f05c8001650 comp rx=0 tx=0).stop 2023-12-24T20:03:47.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.725+0000 7f05d76c9700 1 -- 172.21.15.61:0/2026377243 shutdown_connections 2023-12-24T20:03:47.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.725+0000 7f05d76c9700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f05d0070d50 0x7f05d0159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:47.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.725+0000 7f05d76c9700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f05b4066f30 0x7f05b40693e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:47.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.725+0000 7f05d76c9700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05d0159a30 0x7f05d006a330 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:47.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.725+0000 7f05d76c9700 1 --2- 172.21.15.61:0/2026377243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05d00c3b80 0x7f05d015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:47.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.725+0000 7f05d76c9700 1 -- 172.21.15.61:0/2026377243 >> 172.21.15.61:0/2026377243 conn(0x7f05d00ce1f0 msgr2=0x7f05d00b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:47.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.725+0000 7f05d76c9700 1 -- 172.21.15.61:0/2026377243 shutdown_connections 2023-12-24T20:03:47.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.726+0000 7f05d76c9700 1 -- 172.21.15.61:0/2026377243 wait complete. 2023-12-24T20:03:47.729 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 18 and data pool 19 2023-12-24T20:03:47.745 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:03:47.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.870+0000 7f686dabf700 1 Processor -- start 2023-12-24T20:03:47.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.870+0000 7f686dabf700 1 -- start start 2023-12-24T20:03:47.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f686dabf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6868069a70 0x7f6868070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:47.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f686dabf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6868070b80 0x7f686815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:47.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f686dabf700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686815b0b0 con 0x7f686806a8f0 2023-12-24T20:03:47.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f686dabf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6868069ef0 con 0x7f6868069a70 2023-12-24T20:03:47.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f686dabf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6868070f90 con 0x7f6868070b80 2023-12-24T20:03:47.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68677fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f686806a8f0 0x7f6868068770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40244/0 (socket says 172.21.15.61:40244) 2023-12-24T20:03:47.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68677fe700 1 -- 172.21.15.61:0/521487205 learned_addr learned my addr 172.21.15.61:0/521487205 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:47.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f6866ffd700 1 --2- 172.21.15.61:0/521487205 >> v2:172.21.15.133:3300/0 conn(0x7f6868069a70 0x7f6868070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f6867fff700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6868070b80 0x7f686815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894813386 0 0) 0x7f686815b0b0 con 0x7f686806a8f0 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6850003570 con 0x7f686806a8f0 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3893255034 0 0) 0x7f6850003570 con 0x7f686806a8f0 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6868070b80 msgr2=0x7f686815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6868070b80 0x7f686815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 >> v2:172.21.15.133:3300/0 conn(0x7f6868069a70 msgr2=0x7f6868070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 --2- 172.21.15.61:0/521487205 >> v2:172.21.15.133:3300/0 conn(0x7f6868069a70 0x7f6868070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686815a4a0 con 0x7f686806a8f0 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f68580015f0 con 0x7f686806a8f0 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 >> v1:172.21.15.61:6789/0 conn(0x7f686806a8f0 legacy=0x7f6868068770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:47.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6850003a60 0x7f6850003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6850004810 0x7f6850004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6868070b80 0x7f68500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6868069ef0 con 0x7f6850003a60 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.871+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6868070f90 con 0x7f6850004810 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685000ba60 con 0x7f6868070b80 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68677fe700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6850003a60 0x7f6850003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f6866ffd700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6850004810 0x7f6850004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f6867fff700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6868070b80 0x7f68500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68677fe700 1 -- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6868070b80 msgr2=0x7f68500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68677fe700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6868070b80 0x7f68500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68677fe700 1 -- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6850004810 msgr2=0x7f6850004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:47.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68677fe700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6850004810 0x7f6850004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68677fe700 1 -- 172.21.15.61:0/521487205 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850003570 con 0x7f6850003a60 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f6866ffd700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6850004810 0x7f6850004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68677fe700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6850003a60 0x7f6850003e70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f685800c3f0 tx=0x7f686815b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47efbe5c79e9ae2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685800cc80 con 0x7f6850003a60 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685800cde0 con 0x7f6850003a60 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.872+0000 7f68667fc700 1 -- 172.21.15.61:0/521487205 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858007320 con 0x7f6850003a60 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.873+0000 7f686dabf700 1 -- 172.21.15.61:0/521487205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6850003a60 msgr2=0x7f6850003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.873+0000 7f686dabf700 1 --2- 172.21.15.61:0/521487205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6850003a60 0x7f6850003e70 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f685800c3f0 tx=0x7f686815b020 comp rx=0 tx=0).stop 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.873+0000 7f6867fff700 1 -- 172.21.15.61:0/521487205 reap_dead start 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.873+0000 7f686dabf700 1 -- 172.21.15.61:0/521487205 shutdown_connections 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.873+0000 7f686dabf700 1 -- 172.21.15.61:0/521487205 >> 172.21.15.61:0/521487205 conn(0x7f68680ce1a0 msgr2=0x7f68680ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:47.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.873+0000 7f686dabf700 1 -- 172.21.15.61:0/521487205 shutdown_connections 2023-12-24T20:03:47.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.873+0000 7f686dabf700 1 -- 172.21.15.61:0/521487205 wait complete. 2023-12-24T20:03:47.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.874+0000 7f686dabf700 1 Processor -- start 2023-12-24T20:03:47.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.874+0000 7f686dabf700 1 -- start start 2023-12-24T20:03:47.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f686dabf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6850003a60 0x7f6868152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:47.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f686dabf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68680aacc0 0x7f6868153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:47.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f686dabf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680c24b0 0x7f68680c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:47.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f686dabf700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68680c2e90 con 0x7f68680aacc0 2023-12-24T20:03:47.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f686dabf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6868169f90 con 0x7f68680c24b0 2023-12-24T20:03:47.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f686dabf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6868154420 con 0x7f6850003a60 2023-12-24T20:03:47.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f6866ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68680aacc0 0x7f6868153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f6866ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68680aacc0 0x7f6868153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52004/0 (socket says 172.21.15.61:52004) 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f6866ffd700 1 -- 172.21.15.61:0/2240688099 learned_addr learned my addr 172.21.15.61:0/2240688099 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f6867fff700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680c24b0 0x7f68680c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f68677fe700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6850003a60 0x7f6868152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f6866ffd700 1 -- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6850003a60 msgr2=0x7f6868152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f6866ffd700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6850003a60 0x7f6868152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f6866ffd700 1 -- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680c24b0 msgr2=0x7f68680c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f6866ffd700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680c24b0 0x7f68680c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f6866ffd700 1 -- 172.21.15.61:0/2240688099 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868154700 con 0x7f68680aacc0 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f6866ffd700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68680aacc0 0x7f6868153ad0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f685c0118e0 tx=0x7f685c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f684f7fe700 1 -- 172.21.15.61:0/2240688099 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c011e80 con 0x7f68680aacc0 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f684f7fe700 1 -- 172.21.15.61:0/2240688099 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c00f860 con 0x7f68680aacc0 2023-12-24T20:03:47.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.875+0000 7f686dabf700 1 -- 172.21.15.61:0/2240688099 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68681549e0 con 0x7f68680aacc0 2023-12-24T20:03:47.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.876+0000 7f684f7fe700 1 -- 172.21.15.61:0/2240688099 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c00fc00 con 0x7f68680aacc0 2023-12-24T20:03:47.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.876+0000 7f686dabf700 1 -- 172.21.15.61:0/2240688099 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6868152690 con 0x7f68680aacc0 2023-12-24T20:03:47.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.876+0000 7f686dabf700 1 -- 172.21.15.61:0/2240688099 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686804c3c0 con 0x7f68680aacc0 2023-12-24T20:03:47.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.877+0000 7f684f7fe700 1 -- 172.21.15.61:0/2240688099 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f685c015460 con 0x7f68680aacc0 2023-12-24T20:03:47.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.877+0000 7f684f7fe700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6854066f30 0x7f68540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:47.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.877+0000 7f684f7fe700 1 -- 172.21.15.61:0/2240688099 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f685c084cb0 con 0x7f68680aacc0 2023-12-24T20:03:47.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.878+0000 7f68677fe700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6854066f30 0x7f68540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:47.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.878+0000 7f68677fe700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6854066f30 0x7f68540693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f685800c390 tx=0x7f6858015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:47.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:47.882+0000 7f684f7fe700 1 -- 172.21.15.61:0/2240688099 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f685c051f20 con 0x7f68680aacc0 2023-12-24T20:03:48.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.078+0000 7f686dabf700 1 -- 172.21.15.61:0/2240688099 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f686815a780 con 0x7f68680aacc0 2023-12-24T20:03:48.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.079+0000 7f684f7fe700 1 -- 172.21.15.61:0/2240688099 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f685c055540 con 0x7f68680aacc0 2023-12-24T20:03:48.079 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:48.079 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":150,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:03:47.114692+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:03:45.538509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-24T20:03:46.090556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:03:48.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 -- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6854066f30 msgr2=0x7f68540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6854066f30 0x7f68540693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f685800c390 tx=0x7f6858015000 comp rx=0 tx=0).stop 2023-12-24T20:03:48.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 -- 172.21.15.61:0/2240688099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68680aacc0 msgr2=0x7f6868153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68680aacc0 0x7f6868153ad0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f685c0118e0 tx=0x7f685c008040 comp rx=0 tx=0).stop 2023-12-24T20:03:48.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 -- 172.21.15.61:0/2240688099 shutdown_connections 2023-12-24T20:03:48.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6850003a60 0x7f6868152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.082 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6854066f30 0x7f68540693e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680c24b0 0x7f68680c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 --2- 172.21.15.61:0/2240688099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f68680aacc0 0x7f6868153ad0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 -- 172.21.15.61:0/2240688099 >> 172.21.15.61:0/2240688099 conn(0x7f68680ce1a0 msgr2=0x7f68680c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:48.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 -- 172.21.15.61:0/2240688099 shutdown_connections 2023-12-24T20:03:48.083 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.081+0000 7f686dabf700 1 -- 172.21.15.61:0/2240688099 wait complete. 2023-12-24T20:03:48.094 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:03:48.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.216+0000 7fc84613a700 1 Processor -- start 2023-12-24T20:03:48.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.216+0000 7fc84613a700 1 -- start start 2023-12-24T20:03:48.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc84613a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840068510 0x7fc8400cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc84613a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc840159a60 0x7fc840159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc84613a700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8400b2890 con 0x7fc840068140 2023-12-24T20:03:48.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc84613a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8400cf630 con 0x7fc840159a60 2023-12-24T20:03:48.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc84613a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400b2240 con 0x7fc840068510 2023-12-24T20:03:48.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc83f7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fc840068140 0x7fc8400b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40252/0 (socket says 172.21.15.61:40252) 2023-12-24T20:03:48.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc83f7fe700 1 -- 172.21.15.61:0/462879966 learned_addr learned my addr 172.21.15.61:0/462879966 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:48.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc83effd700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840068510 0x7fc8400cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152920840 0 0) 0x7fc8400b2890 con 0x7fc840068140 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc83ffff700 1 --2- 172.21.15.61:0/462879966 >> v2:172.21.15.133:3300/0 conn(0x7fc840159a60 0x7fc840159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.217+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc828003570 con 0x7fc840068140 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931598500 0 0) 0x7fc828003570 con 0x7fc840068140 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840068510 msgr2=0x7fc8400cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840068510 0x7fc8400cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 >> v2:172.21.15.133:3300/0 conn(0x7fc840159a60 msgr2=0x7fc840159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 --2- 172.21.15.61:0/462879966 >> v2:172.21.15.133:3300/0 conn(0x7fc840159a60 0x7fc840159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400b2520 con 0x7fc840068140 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fc8300015f0 con 0x7fc840068140 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 >> v1:172.21.15.61:6789/0 conn(0x7fc840068140 legacy=0x7fc8400b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840068510 0x7fc828003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc828003fe0 0x7fc828004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc828004d50 0x7fc8280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400cf630 con 0x7fc828003fe0 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400b2240 con 0x7fc828004d50 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82800ba90 con 0x7fc840068510 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83effd700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc828003fe0 0x7fc828004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83f7fe700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840068510 0x7fc828003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83ffff700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc828004d50 0x7fc8280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83effd700 1 -- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840068510 msgr2=0x7fc828003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83effd700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840068510 0x7fc828003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83effd700 1 -- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc828004d50 msgr2=0x7fc8280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83effd700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc828004d50 0x7fc8280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83effd700 1 -- 172.21.15.61:0/462879966 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828003570 con 0x7fc828003fe0 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83effd700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc828003fe0 0x7fc828004810 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fc834009c00 tx=0x7fc8340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1630c2ed5e10a44 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.218+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400e6b0 con 0x7fc828003fe0 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.219+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400e810 con 0x7fc828003fe0 2023-12-24T20:03:48.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.219+0000 7fc83e7fc700 1 -- 172.21.15.61:0/462879966 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400ebd0 con 0x7fc828003fe0 2023-12-24T20:03:48.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.219+0000 7fc84613a700 1 -- 172.21.15.61:0/462879966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc828003fe0 msgr2=0x7fc828004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.219+0000 7fc84613a700 1 --2- 172.21.15.61:0/462879966 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc828003fe0 0x7fc828004810 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fc834009c00 tx=0x7fc8340091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.219+0000 7fc83ffff700 1 -- 172.21.15.61:0/462879966 reap_dead start 2023-12-24T20:03:48.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.219+0000 7fc84613a700 1 -- 172.21.15.61:0/462879966 shutdown_connections 2023-12-24T20:03:48.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.219+0000 7fc84613a700 1 -- 172.21.15.61:0/462879966 >> 172.21.15.61:0/462879966 conn(0x7fc840097a10 msgr2=0x7fc8400ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:48.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.219+0000 7fc84613a700 1 -- 172.21.15.61:0/462879966 shutdown_connections 2023-12-24T20:03:48.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.219+0000 7fc84613a700 1 -- 172.21.15.61:0/462879966 wait complete. 2023-12-24T20:03:48.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.220+0000 7fc84613a700 1 Processor -- start 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.220+0000 7fc84613a700 1 -- start start 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc84613a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc828003fe0 0x7fc840099380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc84613a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840098460 0x7fc84009be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc84613a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc840152090 0x7fc8401568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc84613a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84015f810 con 0x7fc840152090 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc84613a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84009ba00 con 0x7fc828003fe0 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc84613a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84009ae30 con 0x7fc840098460 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc83ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc840152090 0x7fc8401568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc83ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc840152090 0x7fc8401568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52026/0 (socket says 172.21.15.61:52026) 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc83ffff700 1 -- 172.21.15.61:0/2724258068 learned_addr learned my addr 172.21.15.61:0/2724258068 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc83effd700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840098460 0x7fc84009be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.221+0000 7fc83f7fe700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc828003fe0 0x7fc840099380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc83ffff700 1 -- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840098460 msgr2=0x7fc84009be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc83ffff700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840098460 0x7fc84009be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc83ffff700 1 -- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc828003fe0 msgr2=0x7fc840099380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc83ffff700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc828003fe0 0x7fc840099380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc83ffff700 1 -- 172.21.15.61:0/2724258068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84009b0d0 con 0x7fc840152090 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc83f7fe700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc828003fe0 0x7fc840099380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc83effd700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840098460 0x7fc84009be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc83ffff700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc840152090 0x7fc8401568e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fc84006f030 tx=0x7fc83800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc8277fe700 1 -- 172.21.15.61:0/2724258068 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800e040 con 0x7fc840152090 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc8277fe700 1 -- 172.21.15.61:0/2724258068 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800f040 con 0x7fc840152090 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc84613a700 1 -- 172.21.15.61:0/2724258068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84009b3b0 con 0x7fc840152090 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc8277fe700 1 -- 172.21.15.61:0/2724258068 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800fe20 con 0x7fc840152090 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.222+0000 7fc84613a700 1 -- 172.21.15.61:0/2724258068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84009c3d0 con 0x7fc840152090 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.223+0000 7fc84613a700 1 -- 172.21.15.61:0/2724258068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84009bce0 con 0x7fc840152090 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.224+0000 7fc8277fe700 1 -- 172.21.15.61:0/2724258068 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc838015640 con 0x7fc840152090 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.224+0000 7fc8277fe700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc82c066f30 0x7fc82c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.224+0000 7fc8277fe700 1 -- 172.21.15.61:0/2724258068 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc838084e00 con 0x7fc840152090 2023-12-24T20:03:48.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.224+0000 7fc83f7fe700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc82c066f30 0x7fc82c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.225+0000 7fc83f7fe700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc82c066f30 0x7fc82c0693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc8300017a0 tx=0x7fc830009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:48.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.228+0000 7fc8277fe700 1 -- 172.21.15.61:0/2724258068 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc838052070 con 0x7fc840152090 2023-12-24T20:03:48.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.423+0000 7fc84613a700 1 -- 172.21.15.61:0/2724258068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc84006d440 con 0x7fc840152090 2023-12-24T20:03:48.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.424+0000 7fc8277fe700 1 -- 172.21.15.61:0/2724258068 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fc838013310 con 0x7fc840152090 2023-12-24T20:03:48.424 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:48.424 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":150,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:03:47.114692+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:03:45.538509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-24T20:03:46.090556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:03:48.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 -- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc82c066f30 msgr2=0x7fc82c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc82c066f30 0x7fc82c0693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc8300017a0 tx=0x7fc830009040 comp rx=0 tx=0).stop 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 -- 172.21.15.61:0/2724258068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc840152090 msgr2=0x7fc8401568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc840152090 0x7fc8401568e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fc84006f030 tx=0x7fc83800b040 comp rx=0 tx=0).stop 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 -- 172.21.15.61:0/2724258068 shutdown_connections 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc82c066f30 0x7fc82c0693e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc840152090 0x7fc8401568e0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc828003fe0 0x7fc840099380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 --2- 172.21.15.61:0/2724258068 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc840098460 0x7fc84009be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 -- 172.21.15.61:0/2724258068 >> 172.21.15.61:0/2724258068 conn(0x7fc840097a10 msgr2=0x7fc840153f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 -- 172.21.15.61:0/2724258068 shutdown_connections 2023-12-24T20:03:48.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.426+0000 7fc84613a700 1 -- 172.21.15.61:0/2724258068 wait complete. 2023-12-24T20:03:48.439 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T20:03:48.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.565+0000 7f03b9a34700 1 Processor -- start 2023-12-24T20:03:48.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.565+0000 7f03b9a34700 1 -- start start 2023-12-24T20:03:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b9a34700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03b40b2aa0 0x7f03b4159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b9a34700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b40cbf80 con 0x7f03b41598d0 2023-12-24T20:03:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b9a34700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b40b11c0 con 0x7f03b406e280 2023-12-24T20:03:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b9a34700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b40b2f10 con 0x7f03b40b2aa0 2023-12-24T20:03:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b2ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f03b41598d0 0x7f03b406db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40264/0 (socket says 172.21.15.61:40264) 2023-12-24T20:03:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b2ffd700 1 -- 172.21.15.61:0/1474634076 learned_addr learned my addr 172.21.15.61:0/1474634076 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844943507 0 0) 0x7f03b40cbf80 con 0x7f03b41598d0 2023-12-24T20:03:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03a0003570 con 0x7f03b41598d0 2023-12-24T20:03:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b27fc700 1 --2- 172.21.15.61:0/1474634076 >> v2:172.21.15.133:3300/0 conn(0x7f03b40b2aa0 0x7f03b4159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2899419072 0 0) 0x7f03a0003570 con 0x7f03b41598d0 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 >> v2:172.21.15.133:3300/0 conn(0x7f03b40b2aa0 msgr2=0x7f03b4159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 --2- 172.21.15.61:0/1474634076 >> v2:172.21.15.133:3300/0 conn(0x7f03b40b2aa0 0x7f03b4159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 >> v1:172.21.15.133:6789/0 conn(0x7f03b406e280 legacy=0x7f03b40cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40b14a0 con 0x7f03b41598d0 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f03a4001470 con 0x7f03b41598d0 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 >> v1:172.21.15.61:6789/0 conn(0x7f03b41598d0 legacy=0x7f03b406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03a0003a60 0x7f03a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.566+0000 7f03b1ffb700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03a0004810 0x7f03a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b1ffb700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a00051c0 0x7f03a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40b2f10 con 0x7f03a0003a60 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a000c0d0 con 0x7f03a00051c0 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a000c290 con 0x7f03a0004810 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b2ffd700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03a0003a60 0x7f03a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b27fc700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03a0004810 0x7f03a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b37fe700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a00051c0 0x7f03a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b2ffd700 1 -- 172.21.15.61:0/1474634076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03a0004810 msgr2=0x7f03a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b2ffd700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03a0004810 0x7f03a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b2ffd700 1 -- 172.21.15.61:0/1474634076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a00051c0 msgr2=0x7f03a000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b2ffd700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a00051c0 0x7f03a000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b2ffd700 1 -- 172.21.15.61:0/1474634076 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a0003570 con 0x7f03a0003a60 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b37fe700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03a00051c0 0x7f03a000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b37fe700 1 -- 172.21.15.61:0/1474634076 reap_dead start 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b2ffd700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03a0003a60 0x7f03a0003e70 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f03a400c3c0 tx=0x7f03a4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dca7811b83d06 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400cc90 con 0x7f03a0003a60 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a400cdf0 con 0x7f03a0003a60 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.567+0000 7f03b1ffb700 1 -- 172.21.15.61:0/1474634076 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4005b50 con 0x7f03a0003a60 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.568+0000 7f03b9a34700 1 -- 172.21.15.61:0/1474634076 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03a0003a60 msgr2=0x7f03a0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.568+0000 7f03b9a34700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03a0003a60 0x7f03a0003e70 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f03a400c3c0 tx=0x7f03a4001e50 comp rx=0 tx=0).stop 2023-12-24T20:03:48.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.568+0000 7f03b9a34700 1 -- 172.21.15.61:0/1474634076 shutdown_connections 2023-12-24T20:03:48.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.568+0000 7f03b9a34700 1 --2- 172.21.15.61:0/1474634076 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03a0003a60 0x7f03a0003e70 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.568+0000 7f03b9a34700 1 -- 172.21.15.61:0/1474634076 >> 172.21.15.61:0/1474634076 conn(0x7f03b4067550 msgr2=0x7f03b4067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:48.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.568+0000 7f03b9a34700 1 -- 172.21.15.61:0/1474634076 shutdown_connections 2023-12-24T20:03:48.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.568+0000 7f03b9a34700 1 -- 172.21.15.61:0/1474634076 wait complete. 2023-12-24T20:03:48.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.569+0000 7f03b9a34700 1 Processor -- start 2023-12-24T20:03:48.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.569+0000 7f03b9a34700 1 -- start start 2023-12-24T20:03:48.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b9a34700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03a0003a60 0x7f03b416ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b9a34700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03b40c9a70 0x7f03b40c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b9a34700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03b40a7550 0x7f03b40a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b9a34700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40a8f00 con 0x7f03b40a7550 2023-12-24T20:03:48.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b9a34700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40ca420 con 0x7f03b40c9a70 2023-12-24T20:03:48.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b9a34700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40a8280 con 0x7f03a0003a60 2023-12-24T20:03:48.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03b40a7550 0x7f03b40a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03b40a7550 0x7f03b40a79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52042/0 (socket says 172.21.15.61:52042) 2023-12-24T20:03:48.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b37fe700 1 -- 172.21.15.61:0/1201950665 learned_addr learned my addr 172.21.15.61:0/1201950665 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:48.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b27fc700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03b40c9a70 0x7f03b40c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b2ffd700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03a0003a60 0x7f03b416ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b37fe700 1 -- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03a0003a60 msgr2=0x7f03b416ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b37fe700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03a0003a60 0x7f03b416ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b37fe700 1 -- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03b40c9a70 msgr2=0x7f03b40c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b37fe700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03b40c9a70 0x7f03b40c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b37fe700 1 -- 172.21.15.61:0/1201950665 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40a8560 con 0x7f03b40a7550 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.570+0000 7f03b2ffd700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03a0003a60 0x7f03b416ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.571+0000 7f03b37fe700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03b40a7550 0x7f03b40a79d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f03b40b2330 tx=0x7f03ac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.571+0000 7f03aaffd700 1 -- 172.21.15.61:0/1201950665 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac012590 con 0x7f03b40a7550 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.571+0000 7f03aaffd700 1 -- 172.21.15.61:0/1201950665 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac0126f0 con 0x7f03b40a7550 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.571+0000 7f03b9a34700 1 -- 172.21.15.61:0/1201950665 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b40a8840 con 0x7f03b40a7550 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.571+0000 7f03aaffd700 1 -- 172.21.15.61:0/1201950665 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac012a70 con 0x7f03b40a7550 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.571+0000 7f03b9a34700 1 -- 172.21.15.61:0/1201950665 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b40a7f10 con 0x7f03b40a7550 2023-12-24T20:03:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.572+0000 7f03b9a34700 1 -- 172.21.15.61:0/1201950665 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b4089120 con 0x7f03b40a7550 2023-12-24T20:03:48.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.573+0000 7f03aaffd700 1 -- 172.21.15.61:0/1201950665 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f03ac003030 con 0x7f03b40a7550 2023-12-24T20:03:48.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.573+0000 7f03aaffd700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0394066f30 0x7f03940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:48.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.573+0000 7f03aaffd700 1 -- 172.21.15.61:0/1201950665 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f03ac084300 con 0x7f03b40a7550 2023-12-24T20:03:48.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.573+0000 7f03b2ffd700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0394066f30 0x7f03940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:48.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.574+0000 7f03b2ffd700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0394066f30 0x7f03940693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f03b40b0fc0 tx=0x7f03a4015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:48.580 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.580+0000 7f03aaffd700 1 -- 172.21.15.61:0/1201950665 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03ac055000 con 0x7f03b40a7550 2023-12-24T20:03:48.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:48.825+0000 7f03b9a34700 1 -- 172.21.15.61:0/1201950665 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f03b40a9040 con 0x7f03b40a7550 2023-12-24T20:03:49.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.745+0000 7f03aaffd700 1 -- 172.21.15.61:0/1201950665 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7f03b40a9040 con 0x7f03b40a7550 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 -- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0394066f30 msgr2=0x7f03940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0394066f30 0x7f03940693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f03b40b0fc0 tx=0x7f03a4015000 comp rx=0 tx=0).stop 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 -- 172.21.15.61:0/1201950665 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03b40a7550 msgr2=0x7f03b40a79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03b40a7550 0x7f03b40a79d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f03b40b2330 tx=0x7f03ac009040 comp rx=0 tx=0).stop 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 -- 172.21.15.61:0/1201950665 shutdown_connections 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f03a0003a60 0x7f03b416ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0394066f30 0x7f03940693e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03b40a7550 0x7f03b40a79d0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 --2- 172.21.15.61:0/1201950665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03b40c9a70 0x7f03b40c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 -- 172.21.15.61:0/1201950665 >> 172.21.15.61:0/1201950665 conn(0x7f03b4067550 msgr2=0x7f03b40d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 -- 172.21.15.61:0/1201950665 shutdown_connections 2023-12-24T20:03:49.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.748+0000 7f03b9a34700 1 -- 172.21.15.61:0/1201950665 wait complete. 2023-12-24T20:03:49.764 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T20:03:49.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.895+0000 7f4dd7fe0700 1 Processor -- start 2023-12-24T20:03:49.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.895+0000 7f4dd7fe0700 1 -- start start 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd7fe0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4dd00b3370 0x7f4dd00cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd7fe0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd006a290 con 0x7f4dd00cab60 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd7fe0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd006a4f0 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd7fe0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd00c84d0 con 0x7f4dd00b3370 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd557b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4dd00b3370 0x7f4dd00cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd557b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4dd00b3370 0x7f4dd00cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52052/0 (socket says 172.21.15.61:52052) 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd657d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4dd00cab60 0x7f4dd00c8fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40272/0 (socket says 172.21.15.61:40272) 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd557b700 1 -- 172.21.15.61:0/3971979200 learned_addr learned my addr 172.21.15.61:0/3971979200 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd557b700 1 -- 172.21.15.61:0/3971979200 >> v1:172.21.15.133:6789/0 conn(0x7f4dd00b2fa0 legacy=0x7f4dd0069b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd557b700 1 -- 172.21.15.61:0/3971979200 >> v1:172.21.15.61:6789/0 conn(0x7f4dd00cab60 legacy=0x7f4dd00c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd557b700 1 -- 172.21.15.61:0/3971979200 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd00c87b0 con 0x7f4dd00b3370 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.896+0000 7f4dd4d7a700 1 -- 172.21.15.61:0/3971979200 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046510186 0 0) 0x7f4dd006a290 con 0x7f4dd00cab60 2023-12-24T20:03:49.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.897+0000 7f4dd557b700 1 --2- 172.21.15.61:0/3971979200 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b3370 0x7f4dd00cbc40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0099b0 tx=0x7f4dcc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27abf759f7493a02 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:49.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.897+0000 7f4dd4d7a700 1 -- 172.21.15.61:0/3971979200 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00b860 con 0x7f4dd00b3370 2023-12-24T20:03:49.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.897+0000 7f4dd4d7a700 1 -- 172.21.15.61:0/3971979200 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc00b9c0 con 0x7f4dd00b3370 2023-12-24T20:03:49.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.897+0000 7f4dd4d7a700 1 -- 172.21.15.61:0/3971979200 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00bd60 con 0x7f4dd00b3370 2023-12-24T20:03:49.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.897+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/3971979200 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b3370 msgr2=0x7f4dd00cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:49.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.897+0000 7f4dd7fe0700 1 --2- 172.21.15.61:0/3971979200 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b3370 0x7f4dd00cbc40 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0099b0 tx=0x7f4dcc009250 comp rx=0 tx=0).stop 2023-12-24T20:03:49.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.897+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/3971979200 shutdown_connections 2023-12-24T20:03:49.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.897+0000 7f4dd7fe0700 1 --2- 172.21.15.61:0/3971979200 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b3370 0x7f4dd00cbc40 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:49.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.897+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/3971979200 >> 172.21.15.61:0/3971979200 conn(0x7f4dd00ce170 msgr2=0x7f4dd00ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:49.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.897+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/3971979200 shutdown_connections 2023-12-24T20:03:49.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.898+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/3971979200 wait complete. 2023-12-24T20:03:49.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.899+0000 7f4dd7fe0700 1 Processor -- start 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.899+0000 7f4dd7fe0700 1 -- start start 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.899+0000 7f4dd7fe0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b2fa0 0x7f4dd00c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.899+0000 7f4dd7fe0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4dd00b3370 0x7f4dd01579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.899+0000 7f4dd7fe0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dd00cab60 0x7f4dd0152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.899+0000 7f4dd7fe0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd0157ee0 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.899+0000 7f4dd7fe0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00c2ab0 con 0x7f4dd00cab60 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.899+0000 7f4dd7fe0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00c2d90 con 0x7f4dd00b3370 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.899+0000 7f4dd5d7c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b2fa0 0x7f4dd00c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd5d7c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b2fa0 0x7f4dd00c2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52068/0 (socket says 172.21.15.61:52068) 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd5d7c700 1 -- 172.21.15.61:0/387535058 learned_addr learned my addr 172.21.15.61:0/387535058 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd657d700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dd00cab60 0x7f4dd0152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd5d7c700 1 -- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4dd00b3370 msgr2=0x7f4dd01579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd5d7c700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4dd00b3370 0x7f4dd01579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:49.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd5d7c700 1 -- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dd00cab60 msgr2=0x7f4dd0152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd5d7c700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dd00cab60 0x7f4dd0152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd5d7c700 1 -- 172.21.15.61:0/387535058 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0094f0 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd657d700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dd00cab60 0x7f4dd0152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd5d7c700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b2fa0 0x7f4dd00c2490 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c590 tx=0x7f4dc400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dc1ffb700 1 -- 172.21.15.61:0/387535058 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4012630 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dc1ffb700 1 -- 172.21.15.61:0/387535058 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4012790 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/387535058 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd00c3070 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dc1ffb700 1 -- 172.21.15.61:0/387535058 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4012b50 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.900+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/387535058 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd00c3630 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.901+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/387535058 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd004c3c0 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.902+0000 7f4dc1ffb700 1 -- 172.21.15.61:0/387535058 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4dc401b400 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.902+0000 7f4dc1ffb700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4db4066f30 0x7f4db40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:49.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.902+0000 7f4dc1ffb700 1 -- 172.21.15.61:0/387535058 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4dc4084180 con 0x7f4dd00b2fa0 2023-12-24T20:03:49.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.902+0000 7f4dd557b700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4db4066f30 0x7f4db40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:49.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.903+0000 7f4dd557b700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4db4066f30 0x7f4db40693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0099b0 tx=0x7f4dcc017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:49.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:49.906+0000 7f4dc1ffb700 1 -- 172.21.15.61:0/387535058 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dc40513f0 con 0x7f4dd00b2fa0 2023-12-24T20:03:50.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.147+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/387535058 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4dd00c3820 con 0x7f4dd00b2fa0 2023-12-24T20:03:50.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.752+0000 7f4dc1ffb700 1 -- 172.21.15.61:0/387535058 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4dc4054a10 con 0x7f4dd00b2fa0 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4db4066f30 msgr2=0x7f4db40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4db4066f30 0x7f4db40693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0099b0 tx=0x7f4dcc017000 comp rx=0 tx=0).stop 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/387535058 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b2fa0 msgr2=0x7f4dd00c2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b2fa0 0x7f4dd00c2490 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c590 tx=0x7f4dc400c950 comp rx=0 tx=0).stop 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/387535058 shutdown_connections 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4db4066f30 0x7f4db40693e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dd00cab60 0x7f4dd0152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4dd00b2fa0 0x7f4dd00c2490 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 --2- 172.21.15.61:0/387535058 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4dd00b3370 0x7f4dd01579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/387535058 >> 172.21.15.61:0/387535058 conn(0x7f4dd00ce170 msgr2=0x7f4dd00ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:50.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/387535058 shutdown_connections 2023-12-24T20:03:50.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.754+0000 7f4dd7fe0700 1 -- 172.21.15.61:0/387535058 wait complete. 2023-12-24T20:03:50.768 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:50.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.893+0000 7fa792988700 1 Processor -- start 2023-12-24T20:03:50.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.893+0000 7fa792988700 1 -- start start 2023-12-24T20:03:50.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa792988700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa78c15bb60 0x7fa78c098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:50.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa792988700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c0b2eb0 con 0x7fa78c0b2660 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa792988700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c0b2bd0 con 0x7fa78c098aa0 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa792988700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c0afc20 con 0x7fa78c15bb60 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa78bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa78c15bb60 0x7fa78c098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa790f25700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa78c0b2660 0x7fa78c0b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40274/0 (socket says 172.21.15.61:40274) 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa78bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa78c15bb60 0x7fa78c098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52074/0 (socket says 172.21.15.61:52074) 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa790f25700 1 -- 172.21.15.61:0/2224510254 learned_addr learned my addr 172.21.15.61:0/2224510254 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa78bfff700 1 -- 172.21.15.61:0/2224510254 >> v1:172.21.15.133:6789/0 conn(0x7fa78c098aa0 legacy=0x7fa78c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa78bfff700 1 -- 172.21.15.61:0/2224510254 >> v1:172.21.15.61:6789/0 conn(0x7fa78c0b2660 legacy=0x7fa78c0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa78bfff700 1 -- 172.21.15.61:0/2224510254 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c0afe10 con 0x7fa78c15bb60 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa78affd700 1 -- 172.21.15.61:0/2224510254 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006354466 0 0) 0x7fa78c0b2eb0 con 0x7fa78c0b2660 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa78bfff700 1 --2- 172.21.15.61:0/2224510254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c15bb60 0x7fa78c098560 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0098d0 tx=0x7fa77c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39eb4ce2a65d2154 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa78affd700 1 -- 172.21.15.61:0/2224510254 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c009e70 con 0x7fa78c15bb60 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa78affd700 1 -- 172.21.15.61:0/2224510254 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c005c10 con 0x7fa78c15bb60 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.894+0000 7fa78affd700 1 -- 172.21.15.61:0/2224510254 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c00b650 con 0x7fa78c15bb60 2023-12-24T20:03:50.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.895+0000 7fa792988700 1 -- 172.21.15.61:0/2224510254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c15bb60 msgr2=0x7fa78c098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:50.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.895+0000 7fa792988700 1 --2- 172.21.15.61:0/2224510254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c15bb60 0x7fa78c098560 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0098d0 tx=0x7fa77c009120 comp rx=0 tx=0).stop 2023-12-24T20:03:50.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.895+0000 7fa792988700 1 -- 172.21.15.61:0/2224510254 shutdown_connections 2023-12-24T20:03:50.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.895+0000 7fa792988700 1 --2- 172.21.15.61:0/2224510254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c15bb60 0x7fa78c098560 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:50.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.895+0000 7fa792988700 1 -- 172.21.15.61:0/2224510254 >> 172.21.15.61:0/2224510254 conn(0x7fa78c097a10 msgr2=0x7fa78c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:50.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.895+0000 7fa792988700 1 -- 172.21.15.61:0/2224510254 shutdown_connections 2023-12-24T20:03:50.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.895+0000 7fa792988700 1 -- 172.21.15.61:0/2224510254 wait complete. 2023-12-24T20:03:50.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.896+0000 7fa792988700 1 Processor -- start 2023-12-24T20:03:50.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.896+0000 7fa792988700 1 -- start start 2023-12-24T20:03:50.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa792988700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c098aa0 0x7fa78c154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:50.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa792988700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa78c0b2660 0x7fa78c0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:50.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa792988700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa78c15bb60 0x7fa78c16d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:50.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa792988700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c154e80 con 0x7fa78c098aa0 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa792988700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c168830 con 0x7fa78c0b2660 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa792988700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c167c60 con 0x7fa78c15bb60 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa78bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c098aa0 0x7fa78c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa78bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c098aa0 0x7fa78c154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52080/0 (socket says 172.21.15.61:52080) 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa78bfff700 1 -- 172.21.15.61:0/3626272156 learned_addr learned my addr 172.21.15.61:0/3626272156 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa78b7fe700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa78c0b2660 0x7fa78c0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa78bfff700 1 -- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa78c15bb60 msgr2=0x7fa78c16d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.897+0000 7fa790f25700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa78c15bb60 0x7fa78c16d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa78bfff700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa78c15bb60 0x7fa78c16d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa78bfff700 1 -- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa78c0b2660 msgr2=0x7fa78c0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa78bfff700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa78c0b2660 0x7fa78c0af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa78bfff700 1 -- 172.21.15.61:0/3626272156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c0093c0 con 0x7fa78c098aa0 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa78b7fe700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa78c0b2660 0x7fa78c0af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:50.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa78bfff700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c098aa0 0x7fa78c154940 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009160 tx=0x7fa77c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:50.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa773fff700 1 -- 172.21.15.61:0/3626272156 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c006460 con 0x7fa78c098aa0 2023-12-24T20:03:50.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa773fff700 1 -- 172.21.15.61:0/3626272156 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c0065c0 con 0x7fa78c098aa0 2023-12-24T20:03:50.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa792988700 1 -- 172.21.15.61:0/3626272156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c16b090 con 0x7fa78c098aa0 2023-12-24T20:03:50.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa773fff700 1 -- 172.21.15.61:0/3626272156 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c01a420 con 0x7fa78c098aa0 2023-12-24T20:03:50.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.898+0000 7fa792988700 1 -- 172.21.15.61:0/3626272156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c1681e0 con 0x7fa78c098aa0 2023-12-24T20:03:50.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.899+0000 7fa792988700 1 -- 172.21.15.61:0/3626272156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c06d440 con 0x7fa78c098aa0 2023-12-24T20:03:50.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.899+0000 7fa773fff700 1 -- 172.21.15.61:0/3626272156 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa77c01a790 con 0x7fa78c098aa0 2023-12-24T20:03:50.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.900+0000 7fa773fff700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa778066f30 0x7fa7780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:50.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.900+0000 7fa773fff700 1 -- 172.21.15.61:0/3626272156 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa77c085cd0 con 0x7fa78c098aa0 2023-12-24T20:03:50.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.900+0000 7fa78b7fe700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa778066f30 0x7fa7780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:50.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.900+0000 7fa78b7fe700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa778066f30 0x7fa7780693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa780001840 tx=0x7fa780009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:50.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:50.904+0000 7fa773fff700 1 -- 172.21.15.61:0/3626272156 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa77c052f40 con 0x7fa78c098aa0 2023-12-24T20:03:51.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.145+0000 7fa792988700 1 -- 172.21.15.61:0/3626272156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa78c04c3c0 con 0x7fa78c098aa0 2023-12-24T20:03:51.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.145+0000 7fa773fff700 1 -- 172.21.15.61:0/3626272156 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fa77c056560 con 0x7fa78c098aa0 2023-12-24T20:03:51.146 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:51.146 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3725605380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3725605380},{"type":"v1","addr":"172.21.15.133:6837","nonce":3725605380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":6724,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2558204756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2558204756},{"type":"v1","addr":"172.21.15.133:6836","nonce":2558204756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3124455429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3124455429},{"type":"v1","addr":"172.21.15.61:6834","nonce":3124455429}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:03:47.115082+0000","modified":"2023-12-24T20:03:50.745173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/847871762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":847871762},{"type":"v1","addr":"172.21.15.61:6835","nonce":847871762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T20:03:51.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 -- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa778066f30 msgr2=0x7fa7780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa778066f30 0x7fa7780693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa780001840 tx=0x7fa780009040 comp rx=0 tx=0).stop 2023-12-24T20:03:51.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 -- 172.21.15.61:0/3626272156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c098aa0 msgr2=0x7fa78c154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c098aa0 0x7fa78c154940 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009160 tx=0x7fa77c016000 comp rx=0 tx=0).stop 2023-12-24T20:03:51.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 -- 172.21.15.61:0/3626272156 shutdown_connections 2023-12-24T20:03:51.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa78c15bb60 0x7fa78c16d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa778066f30 0x7fa7780693e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa78c098aa0 0x7fa78c154940 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 --2- 172.21.15.61:0/3626272156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa78c0b2660 0x7fa78c0af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 -- 172.21.15.61:0/3626272156 >> 172.21.15.61:0/3626272156 conn(0x7fa78c097a10 msgr2=0x7fa78c1589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:51.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 -- 172.21.15.61:0/3626272156 shutdown_connections 2023-12-24T20:03:51.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.147+0000 7fa792988700 1 -- 172.21.15.61:0/3626272156 wait complete. 2023-12-24T20:03:51.149 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 76 2023-12-24T20:03:51.160 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:03:51.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.281+0000 7f771d497700 1 Processor -- start 2023-12-24T20:03:51.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.281+0000 7f771d497700 1 -- start start 2023-12-24T20:03:51.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f771d497700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7718159c10 0x7f77180c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f771d497700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7718159fe0 0x7f77180c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f771d497700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f77180cba80 0x7f77180cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f771d497700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77180af880 con 0x7f77180cba80 2023-12-24T20:03:51.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f771d497700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77180cc420 con 0x7f7718159fe0 2023-12-24T20:03:51.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f771d497700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c6fc0 con 0x7f7718159c10 2023-12-24T20:03:51.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77177fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f77180cba80 0x7f77180cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.284 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77177fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f77180cba80 0x7f77180cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52094/0 (socket says 172.21.15.61:52094) 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77177fe700 1 -- 172.21.15.61:0/85575371 learned_addr learned my addr 172.21.15.61:0/85575371 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77167fc700 1 --2- 172.21.15.61:0/85575371 >> v2:172.21.15.133:3300/0 conn(0x7f7718159fe0 0x7f77180c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77177fe700 1 -- 172.21.15.61:0/85575371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7718159c10 msgr2=0x7f77180c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f7716ffd700 1 --2- 172.21.15.61:0/85575371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7718159c10 0x7f77180c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77177fe700 1 --2- 172.21.15.61:0/85575371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7718159c10 0x7f77180c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77177fe700 1 -- 172.21.15.61:0/85575371 >> v2:172.21.15.133:3300/0 conn(0x7f7718159fe0 msgr2=0x7f77180c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77177fe700 1 --2- 172.21.15.61:0/85575371 >> v2:172.21.15.133:3300/0 conn(0x7f7718159fe0 0x7f77180c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77177fe700 1 -- 172.21.15.61:0/85575371 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77180c63b0 con 0x7f77180cba80 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77167fc700 1 --2- 172.21.15.61:0/85575371 >> v2:172.21.15.133:3300/0 conn(0x7f7718159fe0 0x7f77180c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.282+0000 7f77177fe700 1 --2- 172.21.15.61:0/85575371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 0x7f77180cbee0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f771806fb90 tx=0x7f7710009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1118205d498986b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f7715ffb700 1 -- 172.21.15.61:0/85575371 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771000e070 con 0x7f77180cba80 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f7715ffb700 1 -- 172.21.15.61:0/85575371 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771000ba50 con 0x7f77180cba80 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f7715ffb700 1 -- 172.21.15.61:0/85575371 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77100092e0 con 0x7f77180cba80 2023-12-24T20:03:51.285 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f771d497700 1 -- 172.21.15.61:0/85575371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 msgr2=0x7f77180cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f771d497700 1 --2- 172.21.15.61:0/85575371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 0x7f77180cbee0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f771806fb90 tx=0x7f7710009840 comp rx=0 tx=0).stop 2023-12-24T20:03:51.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f771d497700 1 -- 172.21.15.61:0/85575371 shutdown_connections 2023-12-24T20:03:51.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f771d497700 1 --2- 172.21.15.61:0/85575371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 0x7f77180cbee0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f771d497700 1 --2- 172.21.15.61:0/85575371 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7718159c10 0x7f77180c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f771d497700 1 --2- 172.21.15.61:0/85575371 >> v2:172.21.15.133:3300/0 conn(0x7f7718159fe0 0x7f77180c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f771d497700 1 -- 172.21.15.61:0/85575371 >> 172.21.15.61:0/85575371 conn(0x7f771806e640 msgr2=0x7f7718067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:51.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f771d497700 1 -- 172.21.15.61:0/85575371 shutdown_connections 2023-12-24T20:03:51.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.283+0000 7f771d497700 1 -- 172.21.15.61:0/85575371 wait complete. 2023-12-24T20:03:51.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.284+0000 7f771d497700 1 Processor -- start 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.285+0000 7f771d497700 1 -- start start 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.285+0000 7f771d497700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 0x7f77180b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.285+0000 7f771d497700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7718159c10 0x7f77180c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.285+0000 7f771d497700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7718159fe0 0x7f771816cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.285+0000 7f771d497700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c9b10 con 0x7f77180cba80 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.285+0000 7f771d497700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180ca4e0 con 0x7f7718159c10 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.285+0000 7f771d497700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c8f00 con 0x7f7718159fe0 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.285+0000 7f7716ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 0x7f77180b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.285+0000 7f7716ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 0x7f77180b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52102/0 (socket says 172.21.15.61:52102) 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.285+0000 7f7716ffd700 1 -- 172.21.15.61:0/2584037711 learned_addr learned my addr 172.21.15.61:0/2584037711 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f77167fc700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7718159c10 0x7f77180c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f77177fe700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7718159fe0 0x7f771816cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f7716ffd700 1 -- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7718159fe0 msgr2=0x7f771816cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f7716ffd700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7718159fe0 0x7f771816cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f7716ffd700 1 -- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7718159c10 msgr2=0x7f77180c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f7716ffd700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7718159c10 0x7f77180c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f7716ffd700 1 -- 172.21.15.61:0/2584037711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7710009ae0 con 0x7f77180cba80 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f7716ffd700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 0x7f77180b46f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f770c00c7d0 tx=0x7f770c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f76feffd700 1 -- 172.21.15.61:0/2584037711 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c011600 con 0x7f77180cba80 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f76feffd700 1 -- 172.21.15.61:0/2584037711 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c011760 con 0x7f77180cba80 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f76feffd700 1 -- 172.21.15.61:0/2584037711 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c011b20 con 0x7f77180cba80 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f771d497700 1 -- 172.21.15.61:0/2584037711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77180c91e0 con 0x7f77180cba80 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.286+0000 7f771d497700 1 -- 172.21.15.61:0/2584037711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77180c97a0 con 0x7f77180cba80 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.287+0000 7f771d497700 1 -- 172.21.15.61:0/2584037711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77180890b0 con 0x7f77180cba80 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.287+0000 7f76feffd700 1 -- 172.21.15.61:0/2584037711 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f770c0193f0 con 0x7f77180cba80 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.288+0000 7f76feffd700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7704066f30 0x7f77040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.288+0000 7f76feffd700 1 -- 172.21.15.61:0/2584037711 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f770c084930 con 0x7f77180cba80 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.288+0000 7f77167fc700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7704066f30 0x7f77040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.288+0000 7f77167fc700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7704066f30 0x7f77040693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f77180b5370 tx=0x7f7708006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:51.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.292+0000 7f76feffd700 1 -- 172.21.15.61:0/2584037711 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f770c051ba0 con 0x7f77180cba80 2023-12-24T20:03:51.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.487+0000 7f771d497700 1 -- 172.21.15.61:0/2584037711 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77180c9df0 con 0x7f77180cba80 2023-12-24T20:03:51.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.488+0000 7f76feffd700 1 -- 172.21.15.61:0/2584037711 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f770c0551c0 con 0x7f77180cba80 2023-12-24T20:03:51.488 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:51.488 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":151,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:03:48.707931+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:03:45.538509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-24T20:03:46.090556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 -- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7704066f30 msgr2=0x7f77040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7704066f30 0x7f77040693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f77180b5370 tx=0x7f7708006f90 comp rx=0 tx=0).stop 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 -- 172.21.15.61:0/2584037711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 msgr2=0x7f77180b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 0x7f77180b46f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f770c00c7d0 tx=0x7f770c008040 comp rx=0 tx=0).stop 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 -- 172.21.15.61:0/2584037711 shutdown_connections 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7718159fe0 0x7f771816cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7704066f30 0x7f77040693e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f77180cba80 0x7f77180b46f0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 --2- 172.21.15.61:0/2584037711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7718159c10 0x7f77180c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 -- 172.21.15.61:0/2584037711 >> 172.21.15.61:0/2584037711 conn(0x7f771806e640 msgr2=0x7f77180af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 -- 172.21.15.61:0/2584037711 shutdown_connections 2023-12-24T20:03:51.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.490+0000 7f771d497700 1 -- 172.21.15.61:0/2584037711 wait complete. 2023-12-24T20:03:51.503 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T20:03:51.503 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:03:51.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.624+0000 7f5f1cf9f700 1 Processor -- start 2023-12-24T20:03:51.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.625+0000 7f5f1cf9f700 1 -- start start 2023-12-24T20:03:51.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f1cf9f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5f180af3b0 0x7f5f180af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f1cf9f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f180cc800 0x7f5f180ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f1cf9f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 0x7f5f1806ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f1cf9f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f180a8480 con 0x7f5f180af3b0 2023-12-24T20:03:51.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f1cf9f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f180976f0 con 0x7f5f180cc800 2023-12-24T20:03:51.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f1cf9f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180cd390 con 0x7f5f18097290 2023-12-24T20:03:51.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f177fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5f180af3b0 0x7f5f180af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f177fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5f180af3b0 0x7f5f180af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52118/0 (socket says 172.21.15.61:52118) 2023-12-24T20:03:51.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f177fe700 1 -- 172.21.15.61:0/1989470575 learned_addr learned my addr 172.21.15.61:0/1989470575 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:51.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f16ffd700 1 --2- 172.21.15.61:0/1989470575 >> v2:172.21.15.133:3300/0 conn(0x7f5f180cc800 0x7f5f180ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f17fff700 1 --2- 172.21.15.61:0/1989470575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 0x7f5f1806ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f177fe700 1 -- 172.21.15.61:0/1989470575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 msgr2=0x7f5f1806ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f177fe700 1 --2- 172.21.15.61:0/1989470575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 0x7f5f1806ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f177fe700 1 -- 172.21.15.61:0/1989470575 >> v2:172.21.15.133:3300/0 conn(0x7f5f180cc800 msgr2=0x7f5f180ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f177fe700 1 --2- 172.21.15.61:0/1989470575 >> v2:172.21.15.133:3300/0 conn(0x7f5f180cc800 0x7f5f180ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f177fe700 1 -- 172.21.15.61:0/1989470575 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f18068ef0 con 0x7f5f180af3b0 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f16ffd700 1 --2- 172.21.15.61:0/1989470575 >> v2:172.21.15.133:3300/0 conn(0x7f5f180cc800 0x7f5f180ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f17fff700 1 --2- 172.21.15.61:0/1989470575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 0x7f5f1806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f177fe700 1 --2- 172.21.15.61:0/1989470575 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 0x7f5f180af780 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f5f1809b3f0 tx=0x7f5f08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700972253825a8dc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.626+0000 7f5f167fc700 1 -- 172.21.15.61:0/1989470575 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800b860 con 0x7f5f180af3b0 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f167fc700 1 -- 172.21.15.61:0/1989470575 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0800b9c0 con 0x7f5f180af3b0 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f167fc700 1 -- 172.21.15.61:0/1989470575 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800bd80 con 0x7f5f180af3b0 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/1989470575 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 msgr2=0x7f5f180af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f1cf9f700 1 --2- 172.21.15.61:0/1989470575 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 0x7f5f180af780 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f5f1809b3f0 tx=0x7f5f08009250 comp rx=0 tx=0).stop 2023-12-24T20:03:51.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/1989470575 shutdown_connections 2023-12-24T20:03:51.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f1cf9f700 1 --2- 172.21.15.61:0/1989470575 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 0x7f5f1806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f1cf9f700 1 --2- 172.21.15.61:0/1989470575 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 0x7f5f180af780 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f1cf9f700 1 --2- 172.21.15.61:0/1989470575 >> v2:172.21.15.133:3300/0 conn(0x7f5f180cc800 0x7f5f180ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/1989470575 >> 172.21.15.61:0/1989470575 conn(0x7f5f180b0ef0 msgr2=0x7f5f180b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:51.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/1989470575 shutdown_connections 2023-12-24T20:03:51.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.627+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/1989470575 wait complete. 2023-12-24T20:03:51.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.628+0000 7f5f1cf9f700 1 Processor -- start 2023-12-24T20:03:51.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.628+0000 7f5f1cf9f700 1 -- start start 2023-12-24T20:03:51.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f1cf9f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 0x7f5f18154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f1cf9f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 0x7f5f18159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f1cf9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180cc800 0x7f5f18159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f1cf9f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1809a780 con 0x7f5f180af3b0 2023-12-24T20:03:51.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f1cf9f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180998e0 con 0x7f5f180cc800 2023-12-24T20:03:51.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f1cf9f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181546a0 con 0x7f5f18097290 2023-12-24T20:03:51.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f16ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 0x7f5f18159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f16ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 0x7f5f18159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52120/0 (socket says 172.21.15.61:52120) 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f16ffd700 1 -- 172.21.15.61:0/3336324270 learned_addr learned my addr 172.21.15.61:0/3336324270 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f177fe700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 0x7f5f18154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.629+0000 7f5f17fff700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180cc800 0x7f5f18159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5f16ffd700 1 -- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 msgr2=0x7f5f18154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5f16ffd700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 0x7f5f18154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5f16ffd700 1 -- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180cc800 msgr2=0x7f5f18159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5f16ffd700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180cc800 0x7f5f18159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5f16ffd700 1 -- 172.21.15.61:0/3336324270 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f080094f0 con 0x7f5f180af3b0 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5f17fff700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180cc800 0x7f5f18159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5f16ffd700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 0x7f5f18159510 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00c830 tx=0x7f5f0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5eff7fe700 1 -- 172.21.15.61:0/3336324270 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c011600 con 0x7f5f180af3b0 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5eff7fe700 1 -- 172.21.15.61:0/3336324270 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c011760 con 0x7f5f180af3b0 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/3336324270 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f18099b70 con 0x7f5f180af3b0 2023-12-24T20:03:51.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5eff7fe700 1 -- 172.21.15.61:0/3336324270 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c011b20 con 0x7f5f180af3b0 2023-12-24T20:03:51.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.630+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/3336324270 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1809a130 con 0x7f5f180af3b0 2023-12-24T20:03:51.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.631+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/3336324270 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f18067de0 con 0x7f5f180af3b0 2023-12-24T20:03:51.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.632+0000 7f5eff7fe700 1 -- 172.21.15.61:0/3336324270 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5f0c0193b0 con 0x7f5f180af3b0 2023-12-24T20:03:51.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.632+0000 7f5eff7fe700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5f04066f30 0x7f5f040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:51.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.632+0000 7f5eff7fe700 1 -- 172.21.15.61:0/3336324270 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f0c0844d0 con 0x7f5f180af3b0 2023-12-24T20:03:51.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.632+0000 7f5f177fe700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5f04066f30 0x7f5f040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:51.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.633+0000 7f5f177fe700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5f04066f30 0x7f5f040693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5f1809b3f0 tx=0x7f5f08017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:51.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.636+0000 7f5eff7fe700 1 -- 172.21.15.61:0/3336324270 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f0c051740 con 0x7f5f180af3b0 2023-12-24T20:03:51.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.829+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/3336324270 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f1809a8c0 con 0x7f5f04066f30 2023-12-24T20:03:51.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.837+0000 7f5eff7fe700 1 -- 172.21.15.61:0/3336324270 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285501 (secure 0 0 0) 0x7f5f1809a8c0 con 0x7f5f04066f30 2023-12-24T20:03:51.841 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:51.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.840+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5f04066f30 msgr2=0x7f5f040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.840+0000 7f5f1cf9f700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5f04066f30 0x7f5f040693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5f1809b3f0 tx=0x7f5f08017000 comp rx=0 tx=0).stop 2023-12-24T20:03:51.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.840+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/3336324270 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 msgr2=0x7f5f18159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:51.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.840+0000 7f5f1cf9f700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 0x7f5f18159510 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00c830 tx=0x7f5f0c008040 comp rx=0 tx=0).stop 2023-12-24T20:03:51.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.840+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/3336324270 shutdown_connections 2023-12-24T20:03:51.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.840+0000 7f5f1cf9f700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5f18097290 0x7f5f18154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.840+0000 7f5f1cf9f700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5f04066f30 0x7f5f040693e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.840+0000 7f5f1cf9f700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180cc800 0x7f5f18159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.840+0000 7f5f1cf9f700 1 --2- 172.21.15.61:0/3336324270 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5f180af3b0 0x7f5f18159510 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:51.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.840+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/3336324270 >> 172.21.15.61:0/3336324270 conn(0x7f5f180b0ef0 msgr2=0x7f5f1806ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:51.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.841+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/3336324270 shutdown_connections 2023-12-24T20:03:51.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:51.841+0000 7f5f1cf9f700 1 -- 172.21.15.61:0/3336324270 wait complete. 2023-12-24T20:03:51.845 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:03:51.853 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2023-12-24T20:03:50.406682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554789,"statfs":{"total":1600000000,"available":1592104852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.704507"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.732118+0000","last_change":"2023-12-24T20:03:47.732059+0000","last_active":"2023-12-24T20:03:47.732118+0000","last_peered":"2023-12-24T20:03:47.732118+0000","last_clean":"2023-12-24T20:03:47.732118+0000","last_became_active":"2023-12-24T20:03:47.731644+0000","last_became_peered":"2023-12-24T20:03:47.731644+0000","last_unstale":"2023-12-24T20:03:47.732118+0000","last_undegraded":"2023-12-24T20:03:47.732118+0000","last_fullsized":"2023-12-24T20:03:47.732118+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:35:36.114537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.714515+0000","last_change":"2023-12-24T20:03:47.714445+0000","last_active":"2023-12-24T20:03:47.714515+0000","last_peered":"2023-12-24T20:03:47.714515+0000","last_clean":"2023-12-24T20:03:47.714515+0000","last_became_active":"2023-12-24T20:03:47.714108+0000","last_became_peered":"2023-12-24T20:03:47.714108+0000","last_unstale":"2023-12-24T20:03:47.714515+0000","last_undegraded":"2023-12-24T20:03:47.714515+0000","last_fullsized":"2023-12-24T20:03:47.714515+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:31:53.498931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.723971+0000","last_change":"2023-12-24T20:03:47.723745+0000","last_active":"2023-12-24T20:03:47.723971+0000","last_peered":"2023-12-24T20:03:47.723971+0000","last_clean":"2023-12-24T20:03:47.723971+0000","last_became_active":"2023-12-24T20:03:47.723171+0000","last_became_peered":"2023-12-24T20:03:47.723171+0000","last_unstale":"2023-12-24T20:03:47.723971+0000","last_undegraded":"2023-12-24T20:03:47.723971+0000","last_fullsized":"2023-12-24T20:03:47.723971+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:14.882841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731317+0000","last_change":"2023-12-24T20:03:47.731272+0000","last_active":"2023-12-24T20:03:47.731317+0000","last_peered":"2023-12-24T20:03:47.731317+0000","last_clean":"2023-12-24T20:03:47.731317+0000","last_became_active":"2023-12-24T20:03:47.730897+0000","last_became_peered":"2023-12-24T20:03:47.730897+0000","last_unstale":"2023-12-24T20:03:47.731317+0000","last_undegraded":"2023-12-24T20:03:47.731317+0000","last_fullsized":"2023-12-24T20:03:47.731317+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:03:42.017488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.719704+0000","last_change":"2023-12-24T20:03:47.719627+0000","last_active":"2023-12-24T20:03:47.719704+0000","last_peered":"2023-12-24T20:03:47.719704+0000","last_clean":"2023-12-24T20:03:47.719704+0000","last_became_active":"2023-12-24T20:03:47.719387+0000","last_became_peered":"2023-12-24T20:03:47.719387+0000","last_unstale":"2023-12-24T20:03:47.719704+0000","last_undegraded":"2023-12-24T20:03:47.719704+0000","last_fullsized":"2023-12-24T20:03:47.719704+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:32:54.386104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.732726+0000","last_change":"2023-12-24T20:03:47.732609+0000","last_active":"2023-12-24T20:03:47.732726+0000","last_peered":"2023-12-24T20:03:47.732726+0000","last_clean":"2023-12-24T20:03:47.732726+0000","last_became_active":"2023-12-24T20:03:47.732311+0000","last_became_peered":"2023-12-24T20:03:47.732311+0000","last_unstale":"2023-12-24T20:03:47.732726+0000","last_undegraded":"2023-12-24T20:03:47.732726+0000","last_fullsized":"2023-12-24T20:03:47.732726+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:32:54.386104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724529+0000","last_change":"2023-12-24T20:03:47.724091+0000","last_active":"2023-12-24T20:03:47.724529+0000","last_peered":"2023-12-24T20:03:47.724529+0000","last_clean":"2023-12-24T20:03:47.724529+0000","last_became_active":"2023-12-24T20:03:47.722775+0000","last_became_peered":"2023-12-24T20:03:47.722775+0000","last_unstale":"2023-12-24T20:03:47.724529+0000","last_undegraded":"2023-12-24T20:03:47.724529+0000","last_fullsized":"2023-12-24T20:03:47.724529+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:45.724065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730011+0000","last_change":"2023-12-24T20:03:47.728962+0000","last_active":"2023-12-24T20:03:47.730011+0000","last_peered":"2023-12-24T20:03:47.730011+0000","last_clean":"2023-12-24T20:03:47.730011+0000","last_became_active":"2023-12-24T20:03:47.728372+0000","last_became_peered":"2023-12-24T20:03:47.728372+0000","last_unstale":"2023-12-24T20:03:47.730011+0000","last_undegraded":"2023-12-24T20:03:47.730011+0000","last_fullsized":"2023-12-24T20:03:47.730011+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:34:52.795009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.721549+0000","last_change":"2023-12-24T20:03:47.719742+0000","last_active":"2023-12-24T20:03:47.721549+0000","last_peered":"2023-12-24T20:03:47.721549+0000","last_clean":"2023-12-24T20:03:47.721549+0000","last_became_active":"2023-12-24T20:03:47.719494+0000","last_became_peered":"2023-12-24T20:03:47.719494+0000","last_unstale":"2023-12-24T20:03:47.721549+0000","last_undegraded":"2023-12-24T20:03:47.721549+0000","last_fullsized":"2023-12-24T20:03:47.721549+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:04:59.550924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.715325+0000","last_change":"2023-12-24T20:03:47.715220+0000","last_active":"2023-12-24T20:03:47.715325+0000","last_peered":"2023-12-24T20:03:47.715325+0000","last_clean":"2023-12-24T20:03:47.715325+0000","last_became_active":"2023-12-24T20:03:47.714954+0000","last_became_peered":"2023-12-24T20:03:47.714954+0000","last_unstale":"2023-12-24T20:03:47.715325+0000","last_undegraded":"2023-12-24T20:03:47.715325+0000","last_fullsized":"2023-12-24T20:03:47.715325+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:42:33.388573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724389+0000","last_change":"2023-12-24T20:03:47.723977+0000","last_active":"2023-12-24T20:03:47.724389+0000","last_peered":"2023-12-24T20:03:47.724389+0000","last_clean":"2023-12-24T20:03:47.724389+0000","last_became_active":"2023-12-24T20:03:47.723488+0000","last_became_peered":"2023-12-24T20:03:47.723488+0000","last_unstale":"2023-12-24T20:03:47.724389+0000","last_undegraded":"2023-12-24T20:03:47.724389+0000","last_fullsized":"2023-12-24T20:03:47.724389+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:01.101607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.721596+0000","last_change":"2023-12-24T20:03:47.720358+0000","last_active":"2023-12-24T20:03:47.721596+0000","last_peered":"2023-12-24T20:03:47.721596+0000","last_clean":"2023-12-24T20:03:47.721596+0000","last_became_active":"2023-12-24T20:03:47.719967+0000","last_became_peered":"2023-12-24T20:03:47.719967+0000","last_unstale":"2023-12-24T20:03:47.721596+0000","last_undegraded":"2023-12-24T20:03:47.721596+0000","last_fullsized":"2023-12-24T20:03:47.721596+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:22:17.771257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730402+0000","last_change":"2023-12-24T20:03:47.728028+0000","last_active":"2023-12-24T20:03:47.730402+0000","last_peered":"2023-12-24T20:03:47.730402+0000","last_clean":"2023-12-24T20:03:47.730402+0000","last_became_active":"2023-12-24T20:03:47.727253+0000","last_became_peered":"2023-12-24T20:03:47.727253+0000","last_unstale":"2023-12-24T20:03:47.730402+0000","last_undegraded":"2023-12-24T20:03:47.730402+0000","last_fullsized":"2023-12-24T20:03:47.730402+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:12.087412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.729786+0000","last_change":"2023-12-24T20:03:47.729696+0000","last_active":"2023-12-24T20:03:47.729786+0000","last_peered":"2023-12-24T20:03:47.729786+0000","last_clean":"2023-12-24T20:03:47.729786+0000","last_became_active":"2023-12-24T20:03:47.729441+0000","last_became_peered":"2023-12-24T20:03:47.729441+0000","last_unstale":"2023-12-24T20:03:47.729786+0000","last_undegraded":"2023-12-24T20:03:47.729786+0000","last_fullsized":"2023-12-24T20:03:47.729786+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:08.919117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.734175+0000","last_change":"2023-12-24T20:03:47.733978+0000","last_active":"2023-12-24T20:03:47.734175+0000","last_peered":"2023-12-24T20:03:47.734175+0000","last_clean":"2023-12-24T20:03:47.734175+0000","last_became_active":"2023-12-24T20:03:47.732629+0000","last_became_peered":"2023-12-24T20:03:47.732629+0000","last_unstale":"2023-12-24T20:03:47.734175+0000","last_undegraded":"2023-12-24T20:03:47.734175+0000","last_fullsized":"2023-12-24T20:03:47.734175+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:44:06.825151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.734062+0000","last_change":"2023-12-24T20:03:47.734010+0000","last_active":"2023-12-24T20:03:47.734062+0000","last_peered":"2023-12-24T20:03:47.734062+0000","last_clean":"2023-12-24T20:03:47.734062+0000","last_became_active":"2023-12-24T20:03:47.733722+0000","last_became_peered":"2023-12-24T20:03:47.733722+0000","last_unstale":"2023-12-24T20:03:47.734062+0000","last_undegraded":"2023-12-24T20:03:47.734062+0000","last_fullsized":"2023-12-24T20:03:47.734062+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:01.339569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724560+0000","last_change":"2023-12-24T20:03:47.724398+0000","last_active":"2023-12-24T20:03:47.724560+0000","last_peered":"2023-12-24T20:03:47.724560+0000","last_clean":"2023-12-24T20:03:47.724560+0000","last_became_active":"2023-12-24T20:03:47.723832+0000","last_became_peered":"2023-12-24T20:03:47.723832+0000","last_unstale":"2023-12-24T20:03:47.724560+0000","last_undegraded":"2023-12-24T20:03:47.724560+0000","last_fullsized":"2023-12-24T20:03:47.724560+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:50:21.809386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.713460+0000","last_change":"2023-12-24T20:03:47.713217+0000","last_active":"2023-12-24T20:03:47.713460+0000","last_peered":"2023-12-24T20:03:47.713460+0000","last_clean":"2023-12-24T20:03:47.713460+0000","last_became_active":"2023-12-24T20:03:47.712598+0000","last_became_peered":"2023-12-24T20:03:47.712598+0000","last_unstale":"2023-12-24T20:03:47.713460+0000","last_undegraded":"2023-12-24T20:03:47.713460+0000","last_fullsized":"2023-12-24T20:03:47.713460+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:08.518838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.722005+0000","last_change":"2023-12-24T20:03:47.721892+0000","last_active":"2023-12-24T20:03:47.722005+0000","last_peered":"2023-12-24T20:03:47.722005+0000","last_clean":"2023-12-24T20:03:47.722005+0000","last_became_active":"2023-12-24T20:03:47.721581+0000","last_became_peered":"2023-12-24T20:03:47.721581+0000","last_unstale":"2023-12-24T20:03:47.722005+0000","last_undegraded":"2023-12-24T20:03:47.722005+0000","last_fullsized":"2023-12-24T20:03:47.722005+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:35:11.574004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.715400+0000","last_change":"2023-12-24T20:03:47.715300+0000","last_active":"2023-12-24T20:03:47.715400+0000","last_peered":"2023-12-24T20:03:47.715400+0000","last_clean":"2023-12-24T20:03:47.715400+0000","last_became_active":"2023-12-24T20:03:47.715045+0000","last_became_peered":"2023-12-24T20:03:47.715045+0000","last_unstale":"2023-12-24T20:03:47.715400+0000","last_undegraded":"2023-12-24T20:03:47.715400+0000","last_fullsized":"2023-12-24T20:03:47.715400+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:01.384268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.720193+0000","last_change":"2023-12-24T20:03:47.720108+0000","last_active":"2023-12-24T20:03:47.720193+0000","last_peered":"2023-12-24T20:03:47.720193+0000","last_clean":"2023-12-24T20:03:47.720193+0000","last_became_active":"2023-12-24T20:03:47.719692+0000","last_became_peered":"2023-12-24T20:03:47.719692+0000","last_unstale":"2023-12-24T20:03:47.720193+0000","last_undegraded":"2023-12-24T20:03:47.720193+0000","last_fullsized":"2023-12-24T20:03:47.720193+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:29:28.971391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.723824+0000","last_change":"2023-12-24T20:03:47.723759+0000","last_active":"2023-12-24T20:03:47.723824+0000","last_peered":"2023-12-24T20:03:47.723824+0000","last_clean":"2023-12-24T20:03:47.723824+0000","last_became_active":"2023-12-24T20:03:47.723468+0000","last_became_peered":"2023-12-24T20:03:47.723468+0000","last_unstale":"2023-12-24T20:03:47.723824+0000","last_undegraded":"2023-12-24T20:03:47.723824+0000","last_fullsized":"2023-12-24T20:03:47.723824+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:18:41.472224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.723988+0000","last_change":"2023-12-24T20:03:47.723889+0000","last_active":"2023-12-24T20:03:47.723988+0000","last_peered":"2023-12-24T20:03:47.723988+0000","last_clean":"2023-12-24T20:03:47.723988+0000","last_became_active":"2023-12-24T20:03:47.723510+0000","last_became_peered":"2023-12-24T20:03:47.723510+0000","last_unstale":"2023-12-24T20:03:47.723988+0000","last_undegraded":"2023-12-24T20:03:47.723988+0000","last_fullsized":"2023-12-24T20:03:47.723988+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:08.401010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725907+0000","last_change":"2023-12-24T20:03:47.725840+0000","last_active":"2023-12-24T20:03:47.725907+0000","last_peered":"2023-12-24T20:03:47.725907+0000","last_clean":"2023-12-24T20:03:47.725907+0000","last_became_active":"2023-12-24T20:03:47.725527+0000","last_became_peered":"2023-12-24T20:03:47.725527+0000","last_unstale":"2023-12-24T20:03:47.725907+0000","last_undegraded":"2023-12-24T20:03:47.725907+0000","last_fullsized":"2023-12-24T20:03:47.725907+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:03.289216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730087+0000","last_change":"2023-12-24T20:03:47.729992+0000","last_active":"2023-12-24T20:03:47.730087+0000","last_peered":"2023-12-24T20:03:47.730087+0000","last_clean":"2023-12-24T20:03:47.730087+0000","last_became_active":"2023-12-24T20:03:47.724861+0000","last_became_peered":"2023-12-24T20:03:47.724861+0000","last_unstale":"2023-12-24T20:03:47.730087+0000","last_undegraded":"2023-12-24T20:03:47.730087+0000","last_fullsized":"2023-12-24T20:03:47.730087+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:46:26.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.733956+0000","last_change":"2023-12-24T20:03:47.733868+0000","last_active":"2023-12-24T20:03:47.733956+0000","last_peered":"2023-12-24T20:03:47.733956+0000","last_clean":"2023-12-24T20:03:47.733956+0000","last_became_active":"2023-12-24T20:03:47.733475+0000","last_became_peered":"2023-12-24T20:03:47.733475+0000","last_unstale":"2023-12-24T20:03:47.733956+0000","last_undegraded":"2023-12-24T20:03:47.733956+0000","last_fullsized":"2023-12-24T20:03:47.733956+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:51.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730421+0000","last_change":"2023-12-24T20:03:47.727898+0000","last_active":"2023-12-24T20:03:47.730421+0000","last_peered":"2023-12-24T20:03:47.730421+0000","last_clean":"2023-12-24T20:03:47.730421+0000","last_became_active":"2023-12-24T20:03:47.727518+0000","last_became_peered":"2023-12-24T20:03:47.727518+0000","last_unstale":"2023-12-24T20:03:47.730421+0000","last_undegraded":"2023-12-24T20:03:47.730421+0000","last_fullsized":"2023-12-24T20:03:47.730421+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:56.174672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.726868+0000","last_change":"2023-12-24T20:03:47.726686+0000","last_active":"2023-12-24T20:03:47.726868+0000","last_peered":"2023-12-24T20:03:47.726868+0000","last_clean":"2023-12-24T20:03:47.726868+0000","last_became_active":"2023-12-24T20:03:47.726212+0000","last_became_peered":"2023-12-24T20:03:47.726212+0000","last_unstale":"2023-12-24T20:03:47.726868+0000","last_undegraded":"2023-12-24T20:03:47.726868+0000","last_fullsized":"2023-12-24T20:03:47.726868+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:53:44.667229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730549+0000","last_change":"2023-12-24T20:03:47.728667+0000","last_active":"2023-12-24T20:03:47.730549+0000","last_peered":"2023-12-24T20:03:47.730549+0000","last_clean":"2023-12-24T20:03:47.730549+0000","last_became_active":"2023-12-24T20:03:47.728365+0000","last_became_peered":"2023-12-24T20:03:47.728365+0000","last_unstale":"2023-12-24T20:03:47.730549+0000","last_undegraded":"2023-12-24T20:03:47.730549+0000","last_fullsized":"2023-12-24T20:03:47.730549+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:43.813410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.734192+0000","last_change":"2023-12-24T20:03:47.734116+0000","last_active":"2023-12-24T20:03:47.734192+0000","last_peered":"2023-12-24T20:03:47.734192+0000","last_clean":"2023-12-24T20:03:47.734192+0000","last_became_active":"2023-12-24T20:03:47.732851+0000","last_became_peered":"2023-12-24T20:03:47.732851+0000","last_unstale":"2023-12-24T20:03:47.734192+0000","last_undegraded":"2023-12-24T20:03:47.734192+0000","last_fullsized":"2023-12-24T20:03:47.734192+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:36:42.168740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.734185+0000","last_change":"2023-12-24T20:03:47.734109+0000","last_active":"2023-12-24T20:03:47.734185+0000","last_peered":"2023-12-24T20:03:47.734185+0000","last_clean":"2023-12-24T20:03:47.734185+0000","last_became_active":"2023-12-24T20:03:47.733582+0000","last_became_peered":"2023-12-24T20:03:47.733582+0000","last_unstale":"2023-12-24T20:03:47.734185+0000","last_undegraded":"2023-12-24T20:03:47.734185+0000","last_fullsized":"2023-12-24T20:03:47.734185+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:46:19.729523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.713256+0000","last_change":"2023-12-24T20:03:47.713166+0000","last_active":"2023-12-24T20:03:47.713256+0000","last_peered":"2023-12-24T20:03:47.713256+0000","last_clean":"2023-12-24T20:03:47.713256+0000","last_became_active":"2023-12-24T20:03:47.712880+0000","last_became_peered":"2023-12-24T20:03:47.712880+0000","last_unstale":"2023-12-24T20:03:47.713256+0000","last_undegraded":"2023-12-24T20:03:47.713256+0000","last_fullsized":"2023-12-24T20:03:47.713256+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:49.278531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.719474+0000","last_change":"2023-12-24T20:03:47.719406+0000","last_active":"2023-12-24T20:03:47.719474+0000","last_peered":"2023-12-24T20:03:47.719474+0000","last_clean":"2023-12-24T20:03:47.719474+0000","last_became_active":"2023-12-24T20:03:47.719177+0000","last_became_peered":"2023-12-24T20:03:47.719177+0000","last_unstale":"2023-12-24T20:03:47.719474+0000","last_undegraded":"2023-12-24T20:03:47.719474+0000","last_fullsized":"2023-12-24T20:03:47.719474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T08:01:04.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"150'4","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731212+0000","last_change":"2023-12-24T20:03:46.722031+0000","last_active":"2023-12-24T20:03:47.731212+0000","last_peered":"2023-12-24T20:03:47.731212+0000","last_clean":"2023-12-24T20:03:47.731212+0000","last_became_active":"2023-12-24T20:03:46.721791+0000","last_became_peered":"2023-12-24T20:03:46.721791+0000","last_unstale":"2023-12-24T20:03:47.731212+0000","last_undegraded":"2023-12-24T20:03:47.731212+0000","last_fullsized":"2023-12-24T20:03:47.731212+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:19:53.558909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730030+0000","last_change":"2023-12-24T20:03:47.729138+0000","last_active":"2023-12-24T20:03:47.730030+0000","last_peered":"2023-12-24T20:03:47.730030+0000","last_clean":"2023-12-24T20:03:47.730030+0000","last_became_active":"2023-12-24T20:03:47.728711+0000","last_became_peered":"2023-12-24T20:03:47.728711+0000","last_unstale":"2023-12-24T20:03:47.730030+0000","last_undegraded":"2023-12-24T20:03:47.730030+0000","last_fullsized":"2023-12-24T20:03:47.730030+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:41.809796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.726644+0000","last_change":"2023-12-24T20:03:46.716706+0000","last_active":"2023-12-24T20:03:47.726644+0000","last_peered":"2023-12-24T20:03:47.726644+0000","last_clean":"2023-12-24T20:03:47.726644+0000","last_became_active":"2023-12-24T20:03:46.716451+0000","last_became_peered":"2023-12-24T20:03:46.716451+0000","last_unstale":"2023-12-24T20:03:47.726644+0000","last_undegraded":"2023-12-24T20:03:47.726644+0000","last_fullsized":"2023-12-24T20:03:47.726644+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:11.081875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.720070+0000","last_change":"2023-12-24T20:03:47.719951+0000","last_active":"2023-12-24T20:03:47.720070+0000","last_peered":"2023-12-24T20:03:47.720070+0000","last_clean":"2023-12-24T20:03:47.720070+0000","last_became_active":"2023-12-24T20:03:47.719366+0000","last_became_peered":"2023-12-24T20:03:47.719366+0000","last_unstale":"2023-12-24T20:03:47.720070+0000","last_undegraded":"2023-12-24T20:03:47.720070+0000","last_fullsized":"2023-12-24T20:03:47.720070+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:51.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725281+0000","last_change":"2023-12-24T20:03:46.717376+0000","last_active":"2023-12-24T20:03:47.725281+0000","last_peered":"2023-12-24T20:03:47.725281+0000","last_clean":"2023-12-24T20:03:47.725281+0000","last_became_active":"2023-12-24T20:03:46.716842+0000","last_became_peered":"2023-12-24T20:03:46.716842+0000","last_unstale":"2023-12-24T20:03:47.725281+0000","last_undegraded":"2023-12-24T20:03:47.725281+0000","last_fullsized":"2023-12-24T20:03:47.725281+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:18:33.113042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730698+0000","last_change":"2023-12-24T20:03:47.730616+0000","last_active":"2023-12-24T20:03:47.730698+0000","last_peered":"2023-12-24T20:03:47.730698+0000","last_clean":"2023-12-24T20:03:47.730698+0000","last_became_active":"2023-12-24T20:03:47.730315+0000","last_became_peered":"2023-12-24T20:03:47.730315+0000","last_unstale":"2023-12-24T20:03:47.730698+0000","last_undegraded":"2023-12-24T20:03:47.730698+0000","last_fullsized":"2023-12-24T20:03:47.730698+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:12.848225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730166+0000","last_change":"2023-12-24T20:03:46.711165+0000","last_active":"2023-12-24T20:03:47.730166+0000","last_peered":"2023-12-24T20:03:47.730166+0000","last_clean":"2023-12-24T20:03:47.730166+0000","last_became_active":"2023-12-24T20:03:46.710472+0000","last_became_peered":"2023-12-24T20:03:46.710472+0000","last_unstale":"2023-12-24T20:03:47.730166+0000","last_undegraded":"2023-12-24T20:03:47.730166+0000","last_fullsized":"2023-12-24T20:03:47.730166+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:59.172427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.713478+0000","last_change":"2023-12-24T20:03:47.713397+0000","last_active":"2023-12-24T20:03:47.713478+0000","last_peered":"2023-12-24T20:03:47.713478+0000","last_clean":"2023-12-24T20:03:47.713478+0000","last_became_active":"2023-12-24T20:03:47.712943+0000","last_became_peered":"2023-12-24T20:03:47.712943+0000","last_unstale":"2023-12-24T20:03:47.713478+0000","last_undegraded":"2023-12-24T20:03:47.713478+0000","last_fullsized":"2023-12-24T20:03:47.713478+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:02:39.758143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731753+0000","last_change":"2023-12-24T20:03:46.715615+0000","last_active":"2023-12-24T20:03:47.731753+0000","last_peered":"2023-12-24T20:03:47.731753+0000","last_clean":"2023-12-24T20:03:47.731753+0000","last_became_active":"2023-12-24T20:03:46.715401+0000","last_became_peered":"2023-12-24T20:03:46.715401+0000","last_unstale":"2023-12-24T20:03:47.731753+0000","last_undegraded":"2023-12-24T20:03:47.731753+0000","last_fullsized":"2023-12-24T20:03:47.731753+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:05:55.030689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724546+0000","last_change":"2023-12-24T20:03:47.724250+0000","last_active":"2023-12-24T20:03:47.724546+0000","last_peered":"2023-12-24T20:03:47.724546+0000","last_clean":"2023-12-24T20:03:47.724546+0000","last_became_active":"2023-12-24T20:03:47.723515+0000","last_became_peered":"2023-12-24T20:03:47.723515+0000","last_unstale":"2023-12-24T20:03:47.724546+0000","last_undegraded":"2023-12-24T20:03:47.724546+0000","last_fullsized":"2023-12-24T20:03:47.724546+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:47:59.037318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.732055+0000","last_change":"2023-12-24T20:03:46.717589+0000","last_active":"2023-12-24T20:03:47.732055+0000","last_peered":"2023-12-24T20:03:47.732055+0000","last_clean":"2023-12-24T20:03:47.732055+0000","last_became_active":"2023-12-24T20:03:46.717417+0000","last_became_peered":"2023-12-24T20:03:46.717417+0000","last_unstale":"2023-12-24T20:03:47.732055+0000","last_undegraded":"2023-12-24T20:03:47.732055+0000","last_fullsized":"2023-12-24T20:03:47.732055+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:07.395474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.723952+0000","last_change":"2023-12-24T20:03:47.722956+0000","last_active":"2023-12-24T20:03:47.723952+0000","last_peered":"2023-12-24T20:03:47.723952+0000","last_clean":"2023-12-24T20:03:47.723952+0000","last_became_active":"2023-12-24T20:03:47.722689+0000","last_became_peered":"2023-12-24T20:03:47.722689+0000","last_unstale":"2023-12-24T20:03:47.723952+0000","last_undegraded":"2023-12-24T20:03:47.723952+0000","last_fullsized":"2023-12-24T20:03:47.723952+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:11:13.085328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.710564+0000","last_change":"2023-12-24T20:03:46.723043+0000","last_active":"2023-12-24T20:03:47.710564+0000","last_peered":"2023-12-24T20:03:47.710564+0000","last_clean":"2023-12-24T20:03:47.710564+0000","last_became_active":"2023-12-24T20:03:46.722825+0000","last_became_peered":"2023-12-24T20:03:46.722825+0000","last_unstale":"2023-12-24T20:03:47.710564+0000","last_undegraded":"2023-12-24T20:03:47.710564+0000","last_fullsized":"2023-12-24T20:03:47.710564+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:24:35.864498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.714534+0000","last_change":"2023-12-24T20:03:47.714460+0000","last_active":"2023-12-24T20:03:47.714534+0000","last_peered":"2023-12-24T20:03:47.714534+0000","last_clean":"2023-12-24T20:03:47.714534+0000","last_became_active":"2023-12-24T20:03:47.714266+0000","last_became_peered":"2023-12-24T20:03:47.714266+0000","last_unstale":"2023-12-24T20:03:47.714534+0000","last_undegraded":"2023-12-24T20:03:47.714534+0000","last_fullsized":"2023-12-24T20:03:47.714534+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:41.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.714377+0000","last_change":"2023-12-24T20:03:46.718464+0000","last_active":"2023-12-24T20:03:47.714377+0000","last_peered":"2023-12-24T20:03:47.714377+0000","last_clean":"2023-12-24T20:03:47.714377+0000","last_became_active":"2023-12-24T20:03:46.718253+0000","last_became_peered":"2023-12-24T20:03:46.718253+0000","last_unstale":"2023-12-24T20:03:47.714377+0000","last_undegraded":"2023-12-24T20:03:47.714377+0000","last_fullsized":"2023-12-24T20:03:47.714377+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:42.654774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730352+0000","last_change":"2023-12-24T20:03:47.727747+0000","last_active":"2023-12-24T20:03:47.730352+0000","last_peered":"2023-12-24T20:03:47.730352+0000","last_clean":"2023-12-24T20:03:47.730352+0000","last_became_active":"2023-12-24T20:03:47.726987+0000","last_became_peered":"2023-12-24T20:03:47.726987+0000","last_unstale":"2023-12-24T20:03:47.730352+0000","last_undegraded":"2023-12-24T20:03:47.730352+0000","last_fullsized":"2023-12-24T20:03:47.730352+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:43.660311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.715455+0000","last_change":"2023-12-24T20:03:46.717706+0000","last_active":"2023-12-24T20:03:47.715455+0000","last_peered":"2023-12-24T20:03:47.715455+0000","last_clean":"2023-12-24T20:03:47.715455+0000","last_became_active":"2023-12-24T20:03:46.717470+0000","last_became_peered":"2023-12-24T20:03:46.717470+0000","last_unstale":"2023-12-24T20:03:47.715455+0000","last_undegraded":"2023-12-24T20:03:47.715455+0000","last_fullsized":"2023-12-24T20:03:47.715455+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:19.490408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725750+0000","last_change":"2023-12-24T20:03:47.725680+0000","last_active":"2023-12-24T20:03:47.725750+0000","last_peered":"2023-12-24T20:03:47.725750+0000","last_clean":"2023-12-24T20:03:47.725750+0000","last_became_active":"2023-12-24T20:03:47.725462+0000","last_became_peered":"2023-12-24T20:03:47.725462+0000","last_unstale":"2023-12-24T20:03:47.725750+0000","last_undegraded":"2023-12-24T20:03:47.725750+0000","last_fullsized":"2023-12-24T20:03:47.725750+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:08.919117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.711399+0000","last_change":"2023-12-24T20:03:46.718686+0000","last_active":"2023-12-24T20:03:47.711399+0000","last_peered":"2023-12-24T20:03:47.711399+0000","last_clean":"2023-12-24T20:03:47.711399+0000","last_became_active":"2023-12-24T20:03:46.718460+0000","last_became_peered":"2023-12-24T20:03:46.718460+0000","last_unstale":"2023-12-24T20:03:47.711399+0000","last_undegraded":"2023-12-24T20:03:47.711399+0000","last_fullsized":"2023-12-24T20:03:47.711399+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:11:12.079791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724398+0000","last_change":"2023-12-24T20:03:47.721724+0000","last_active":"2023-12-24T20:03:47.724398+0000","last_peered":"2023-12-24T20:03:47.724398+0000","last_clean":"2023-12-24T20:03:47.724398+0000","last_became_active":"2023-12-24T20:03:47.721496+0000","last_became_peered":"2023-12-24T20:03:47.721496+0000","last_unstale":"2023-12-24T20:03:47.724398+0000","last_undegraded":"2023-12-24T20:03:47.724398+0000","last_fullsized":"2023-12-24T20:03:47.724398+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:47:59.037318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"150'3","reported_seq":13,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.726804+0000","last_change":"2023-12-24T20:03:46.718637+0000","last_active":"2023-12-24T20:03:47.726804+0000","last_peered":"2023-12-24T20:03:47.726804+0000","last_clean":"2023-12-24T20:03:47.726804+0000","last_became_active":"2023-12-24T20:03:46.718263+0000","last_became_peered":"2023-12-24T20:03:46.718263+0000","last_unstale":"2023-12-24T20:03:47.726804+0000","last_undegraded":"2023-12-24T20:03:47.726804+0000","last_fullsized":"2023-12-24T20:03:47.726804+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:44:05.819614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725172+0000","last_change":"2023-12-24T20:03:47.725091+0000","last_active":"2023-12-24T20:03:47.725172+0000","last_peered":"2023-12-24T20:03:47.725172+0000","last_clean":"2023-12-24T20:03:47.725172+0000","last_became_active":"2023-12-24T20:03:47.724776+0000","last_became_peered":"2023-12-24T20:03:47.724776+0000","last_unstale":"2023-12-24T20:03:47.725172+0000","last_undegraded":"2023-12-24T20:03:47.725172+0000","last_fullsized":"2023-12-24T20:03:47.725172+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:49.278531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"150'6","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.735077+0000","last_change":"2023-12-24T20:03:46.725307+0000","last_active":"2023-12-24T20:03:47.735077+0000","last_peered":"2023-12-24T20:03:47.735077+0000","last_clean":"2023-12-24T20:03:47.735077+0000","last_became_active":"2023-12-24T20:03:46.725128+0000","last_became_peered":"2023-12-24T20:03:46.725128+0000","last_unstale":"2023-12-24T20:03:47.735077+0000","last_undegraded":"2023-12-24T20:03:47.735077+0000","last_fullsized":"2023-12-24T20:03:47.735077+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:21:27.306334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730639+0000","last_change":"2023-12-24T20:03:47.729151+0000","last_active":"2023-12-24T20:03:47.730639+0000","last_peered":"2023-12-24T20:03:47.730639+0000","last_clean":"2023-12-24T20:03:47.730639+0000","last_became_active":"2023-12-24T20:03:47.727012+0000","last_became_peered":"2023-12-24T20:03:47.727012+0000","last_unstale":"2023-12-24T20:03:47.730639+0000","last_undegraded":"2023-12-24T20:03:47.730639+0000","last_fullsized":"2023-12-24T20:03:47.730639+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:30:45.185366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731498+0000","last_change":"2023-12-24T20:03:46.724850+0000","last_active":"2023-12-24T20:03:47.731498+0000","last_peered":"2023-12-24T20:03:47.731498+0000","last_clean":"2023-12-24T20:03:47.731498+0000","last_became_active":"2023-12-24T20:03:46.724591+0000","last_became_peered":"2023-12-24T20:03:46.724591+0000","last_unstale":"2023-12-24T20:03:47.731498+0000","last_undegraded":"2023-12-24T20:03:47.731498+0000","last_fullsized":"2023-12-24T20:03:47.731498+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:49:45.753536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.729073+0000","last_change":"2023-12-24T20:03:47.728980+0000","last_active":"2023-12-24T20:03:47.729073+0000","last_peered":"2023-12-24T20:03:47.729073+0000","last_clean":"2023-12-24T20:03:47.729073+0000","last_became_active":"2023-12-24T20:03:47.724207+0000","last_became_peered":"2023-12-24T20:03:47.724207+0000","last_unstale":"2023-12-24T20:03:47.729073+0000","last_undegraded":"2023-12-24T20:03:47.729073+0000","last_fullsized":"2023-12-24T20:03:47.729073+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:31:32.890898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.712339+0000","last_change":"2023-12-24T20:03:46.719241+0000","last_active":"2023-12-24T20:03:47.712339+0000","last_peered":"2023-12-24T20:03:47.712339+0000","last_clean":"2023-12-24T20:03:47.712339+0000","last_became_active":"2023-12-24T20:03:46.719009+0000","last_became_peered":"2023-12-24T20:03:46.719009+0000","last_unstale":"2023-12-24T20:03:47.712339+0000","last_undegraded":"2023-12-24T20:03:47.712339+0000","last_fullsized":"2023-12-24T20:03:47.712339+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:46:29.736955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.721567+0000","last_change":"2023-12-24T20:03:47.720206+0000","last_active":"2023-12-24T20:03:47.721567+0000","last_peered":"2023-12-24T20:03:47.721567+0000","last_clean":"2023-12-24T20:03:47.721567+0000","last_became_active":"2023-12-24T20:03:47.719632+0000","last_became_peered":"2023-12-24T20:03:47.719632+0000","last_unstale":"2023-12-24T20:03:47.721567+0000","last_undegraded":"2023-12-24T20:03:47.721567+0000","last_fullsized":"2023-12-24T20:03:47.721567+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:57:32.336949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"150'8","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731387+0000","last_change":"2023-12-24T20:03:46.723544+0000","last_active":"2023-12-24T20:03:47.731387+0000","last_peered":"2023-12-24T20:03:47.731387+0000","last_clean":"2023-12-24T20:03:47.731387+0000","last_became_active":"2023-12-24T20:03:46.722350+0000","last_became_peered":"2023-12-24T20:03:46.722350+0000","last_unstale":"2023-12-24T20:03:47.731387+0000","last_undegraded":"2023-12-24T20:03:47.731387+0000","last_fullsized":"2023-12-24T20:03:47.731387+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:56.483040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730054+0000","last_change":"2023-12-24T20:03:47.729433+0000","last_active":"2023-12-24T20:03:47.730054+0000","last_peered":"2023-12-24T20:03:47.730054+0000","last_clean":"2023-12-24T20:03:47.730054+0000","last_became_active":"2023-12-24T20:03:47.729192+0000","last_became_peered":"2023-12-24T20:03:47.729192+0000","last_unstale":"2023-12-24T20:03:47.730054+0000","last_undegraded":"2023-12-24T20:03:47.730054+0000","last_fullsized":"2023-12-24T20:03:47.730054+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:28.358566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.726060+0000","last_change":"2023-12-24T20:03:46.723958+0000","last_active":"2023-12-24T20:03:47.726060+0000","last_peered":"2023-12-24T20:03:47.726060+0000","last_clean":"2023-12-24T20:03:47.726060+0000","last_became_active":"2023-12-24T20:03:46.723705+0000","last_became_peered":"2023-12-24T20:03:46.723705+0000","last_unstale":"2023-12-24T20:03:47.726060+0000","last_undegraded":"2023-12-24T20:03:47.726060+0000","last_fullsized":"2023-12-24T20:03:47.726060+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:30:44.179829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724416+0000","last_change":"2023-12-24T20:03:47.724102+0000","last_active":"2023-12-24T20:03:47.724416+0000","last_peered":"2023-12-24T20:03:47.724416+0000","last_clean":"2023-12-24T20:03:47.724416+0000","last_became_active":"2023-12-24T20:03:47.723881+0000","last_became_peered":"2023-12-24T20:03:47.723881+0000","last_unstale":"2023-12-24T20:03:47.724416+0000","last_undegraded":"2023-12-24T20:03:47.724416+0000","last_fullsized":"2023-12-24T20:03:47.724416+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:57:37.851759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.726031+0000","last_change":"2023-12-24T20:03:46.717530+0000","last_active":"2023-12-24T20:03:47.726031+0000","last_peered":"2023-12-24T20:03:47.726031+0000","last_clean":"2023-12-24T20:03:47.726031+0000","last_became_active":"2023-12-24T20:03:46.717131+0000","last_became_peered":"2023-12-24T20:03:46.717131+0000","last_unstale":"2023-12-24T20:03:47.726031+0000","last_undegraded":"2023-12-24T20:03:47.726031+0000","last_fullsized":"2023-12-24T20:03:47.726031+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:37.009534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731024+0000","last_change":"2023-12-24T20:03:47.730961+0000","last_active":"2023-12-24T20:03:47.731024+0000","last_peered":"2023-12-24T20:03:47.731024+0000","last_clean":"2023-12-24T20:03:47.731024+0000","last_became_active":"2023-12-24T20:03:47.730718+0000","last_became_peered":"2023-12-24T20:03:47.730718+0000","last_unstale":"2023-12-24T20:03:47.731024+0000","last_undegraded":"2023-12-24T20:03:47.731024+0000","last_fullsized":"2023-12-24T20:03:47.731024+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:29:28.971391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725941+0000","last_change":"2023-12-24T20:03:46.721480+0000","last_active":"2023-12-24T20:03:47.725941+0000","last_peered":"2023-12-24T20:03:47.725941+0000","last_clean":"2023-12-24T20:03:47.725941+0000","last_became_active":"2023-12-24T20:03:46.721210+0000","last_became_peered":"2023-12-24T20:03:46.721210+0000","last_unstale":"2023-12-24T20:03:47.725941+0000","last_undegraded":"2023-12-24T20:03:47.725941+0000","last_fullsized":"2023-12-24T20:03:47.725941+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:30:51.956465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.716357+0000","last_change":"2023-12-24T20:03:47.715844+0000","last_active":"2023-12-24T20:03:47.716357+0000","last_peered":"2023-12-24T20:03:47.716357+0000","last_clean":"2023-12-24T20:03:47.716357+0000","last_became_active":"2023-12-24T20:03:47.715625+0000","last_became_peered":"2023-12-24T20:03:47.715625+0000","last_unstale":"2023-12-24T20:03:47.716357+0000","last_undegraded":"2023-12-24T20:03:47.716357+0000","last_fullsized":"2023-12-24T20:03:47.716357+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:52.114499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.715011+0000","last_change":"2023-12-24T20:03:46.719786+0000","last_active":"2023-12-24T20:03:47.715011+0000","last_peered":"2023-12-24T20:03:47.715011+0000","last_clean":"2023-12-24T20:03:47.715011+0000","last_became_active":"2023-12-24T20:03:46.719274+0000","last_became_peered":"2023-12-24T20:03:46.719274+0000","last_unstale":"2023-12-24T20:03:47.715011+0000","last_undegraded":"2023-12-24T20:03:47.715011+0000","last_fullsized":"2023-12-24T20:03:47.715011+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:59:53.575253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730438+0000","last_change":"2023-12-24T20:03:47.728113+0000","last_active":"2023-12-24T20:03:47.730438+0000","last_peered":"2023-12-24T20:03:47.730438+0000","last_clean":"2023-12-24T20:03:47.730438+0000","last_became_active":"2023-12-24T20:03:47.726948+0000","last_became_peered":"2023-12-24T20:03:47.726948+0000","last_unstale":"2023-12-24T20:03:47.730438+0000","last_undegraded":"2023-12-24T20:03:47.730438+0000","last_fullsized":"2023-12-24T20:03:47.730438+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:59:54.580790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731602+0000","last_change":"2023-12-24T20:03:46.718498+0000","last_active":"2023-12-24T20:03:47.731602+0000","last_peered":"2023-12-24T20:03:47.731602+0000","last_clean":"2023-12-24T20:03:47.731602+0000","last_became_active":"2023-12-24T20:03:46.717854+0000","last_became_peered":"2023-12-24T20:03:46.717854+0000","last_unstale":"2023-12-24T20:03:47.731602+0000","last_undegraded":"2023-12-24T20:03:47.731602+0000","last_fullsized":"2023-12-24T20:03:47.731602+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:36:41.163203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725501+0000","last_change":"2023-12-24T20:03:47.725357+0000","last_active":"2023-12-24T20:03:47.725501+0000","last_peered":"2023-12-24T20:03:47.725501+0000","last_clean":"2023-12-24T20:03:47.725501+0000","last_became_active":"2023-12-24T20:03:47.725070+0000","last_became_peered":"2023-12-24T20:03:47.725070+0000","last_unstale":"2023-12-24T20:03:47.725501+0000","last_undegraded":"2023-12-24T20:03:47.725501+0000","last_fullsized":"2023-12-24T20:03:47.725501+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:46:19.729523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.710614+0000","last_change":"2023-12-24T20:03:46.718678+0000","last_active":"2023-12-24T20:03:47.710614+0000","last_peered":"2023-12-24T20:03:47.710614+0000","last_clean":"2023-12-24T20:03:47.710614+0000","last_became_active":"2023-12-24T20:03:46.718445+0000","last_became_peered":"2023-12-24T20:03:46.718445+0000","last_unstale":"2023-12-24T20:03:47.710614+0000","last_undegraded":"2023-12-24T20:03:47.710614+0000","last_fullsized":"2023-12-24T20:03:47.710614+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:13.877305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.723225+0000","last_change":"2023-12-24T20:03:47.723160+0000","last_active":"2023-12-24T20:03:47.723225+0000","last_peered":"2023-12-24T20:03:47.723225+0000","last_clean":"2023-12-24T20:03:47.723225+0000","last_became_active":"2023-12-24T20:03:47.722939+0000","last_became_peered":"2023-12-24T20:03:47.722939+0000","last_unstale":"2023-12-24T20:03:47.723225+0000","last_undegraded":"2023-12-24T20:03:47.723225+0000","last_fullsized":"2023-12-24T20:03:47.723225+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:17:41.594253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.710380+0000","last_change":"2023-12-24T20:03:46.718942+0000","last_active":"2023-12-24T20:03:47.710380+0000","last_peered":"2023-12-24T20:03:47.710380+0000","last_clean":"2023-12-24T20:03:47.710380+0000","last_became_active":"2023-12-24T20:03:46.718487+0000","last_became_peered":"2023-12-24T20:03:46.718487+0000","last_unstale":"2023-12-24T20:03:47.710380+0000","last_undegraded":"2023-12-24T20:03:47.710380+0000","last_fullsized":"2023-12-24T20:03:47.710380+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:22:16.765720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.729657+0000","last_change":"2023-12-24T20:03:47.729586+0000","last_active":"2023-12-24T20:03:47.729657+0000","last_peered":"2023-12-24T20:03:47.729657+0000","last_clean":"2023-12-24T20:03:47.729657+0000","last_became_active":"2023-12-24T20:03:47.729368+0000","last_became_peered":"2023-12-24T20:03:47.729368+0000","last_unstale":"2023-12-24T20:03:47.729657+0000","last_undegraded":"2023-12-24T20:03:47.729657+0000","last_fullsized":"2023-12-24T20:03:47.729657+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:50:21.809386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.720684+0000","last_change":"2023-12-24T20:03:46.715796+0000","last_active":"2023-12-24T20:03:47.720684+0000","last_peered":"2023-12-24T20:03:47.720684+0000","last_clean":"2023-12-24T20:03:47.720684+0000","last_became_active":"2023-12-24T20:03:46.715555+0000","last_became_peered":"2023-12-24T20:03:46.715555+0000","last_unstale":"2023-12-24T20:03:47.720684+0000","last_undegraded":"2023-12-24T20:03:47.720684+0000","last_fullsized":"2023-12-24T20:03:47.720684+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:44:24.674041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.718875+0000","last_change":"2023-12-24T20:03:47.718738+0000","last_active":"2023-12-24T20:03:47.718875+0000","last_peered":"2023-12-24T20:03:47.718875+0000","last_clean":"2023-12-24T20:03:47.718875+0000","last_became_active":"2023-12-24T20:03:47.718485+0000","last_became_peered":"2023-12-24T20:03:47.718485+0000","last_unstale":"2023-12-24T20:03:47.718875+0000","last_undegraded":"2023-12-24T20:03:47.718875+0000","last_fullsized":"2023-12-24T20:03:47.718875+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:22:15.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730691+0000","last_change":"2023-12-24T20:03:46.718173+0000","last_active":"2023-12-24T20:03:47.730691+0000","last_peered":"2023-12-24T20:03:47.730691+0000","last_clean":"2023-12-24T20:03:47.730691+0000","last_became_active":"2023-12-24T20:03:46.717929+0000","last_became_peered":"2023-12-24T20:03:46.717929+0000","last_unstale":"2023-12-24T20:03:47.730691+0000","last_undegraded":"2023-12-24T20:03:47.730691+0000","last_fullsized":"2023-12-24T20:03:47.730691+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:44:30.276103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730622+0000","last_change":"2023-12-24T20:03:47.729028+0000","last_active":"2023-12-24T20:03:47.730622+0000","last_peered":"2023-12-24T20:03:47.730622+0000","last_clean":"2023-12-24T20:03:47.730622+0000","last_became_active":"2023-12-24T20:03:47.728795+0000","last_became_peered":"2023-12-24T20:03:47.728795+0000","last_unstale":"2023-12-24T20:03:47.730622+0000","last_undegraded":"2023-12-24T20:03:47.730622+0000","last_fullsized":"2023-12-24T20:03:47.730622+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:20.495945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.717943+0000","last_change":"2023-12-24T20:03:46.718564+0000","last_active":"2023-12-24T20:03:47.717943+0000","last_peered":"2023-12-24T20:03:47.717943+0000","last_clean":"2023-12-24T20:03:47.717943+0000","last_became_active":"2023-12-24T20:03:46.718313+0000","last_became_peered":"2023-12-24T20:03:46.718313+0000","last_unstale":"2023-12-24T20:03:47.717943+0000","last_undegraded":"2023-12-24T20:03:47.717943+0000","last_fullsized":"2023-12-24T20:03:47.717943+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:44.077521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.729808+0000","last_change":"2023-12-24T20:03:47.729746+0000","last_active":"2023-12-24T20:03:47.729808+0000","last_peered":"2023-12-24T20:03:47.729808+0000","last_clean":"2023-12-24T20:03:47.729808+0000","last_became_active":"2023-12-24T20:03:47.724555+0000","last_became_peered":"2023-12-24T20:03:47.724555+0000","last_unstale":"2023-12-24T20:03:47.729808+0000","last_undegraded":"2023-12-24T20:03:47.729808+0000","last_fullsized":"2023-12-24T20:03:47.729808+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:59:44.621962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.712396+0000","last_change":"2023-12-24T20:03:46.717302+0000","last_active":"2023-12-24T20:03:47.712396+0000","last_peered":"2023-12-24T20:03:47.712396+0000","last_clean":"2023-12-24T20:03:47.712396+0000","last_became_active":"2023-12-24T20:03:46.717072+0000","last_became_peered":"2023-12-24T20:03:46.717072+0000","last_unstale":"2023-12-24T20:03:47.712396+0000","last_undegraded":"2023-12-24T20:03:47.712396+0000","last_fullsized":"2023-12-24T20:03:47.712396+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:36:46.216020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731843+0000","last_change":"2023-12-24T20:03:47.731791+0000","last_active":"2023-12-24T20:03:47.731843+0000","last_peered":"2023-12-24T20:03:47.731843+0000","last_clean":"2023-12-24T20:03:47.731843+0000","last_became_active":"2023-12-24T20:03:47.731580+0000","last_became_peered":"2023-12-24T20:03:47.731580+0000","last_unstale":"2023-12-24T20:03:47.731843+0000","last_undegraded":"2023-12-24T20:03:47.731843+0000","last_fullsized":"2023-12-24T20:03:47.731843+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:12.848225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.717540+0000","last_change":"2023-12-24T20:03:46.713311+0000","last_active":"2023-12-24T20:03:47.717540+0000","last_peered":"2023-12-24T20:03:47.717540+0000","last_clean":"2023-12-24T20:03:47.717540+0000","last_became_active":"2023-12-24T20:03:46.713147+0000","last_became_peered":"2023-12-24T20:03:46.713147+0000","last_unstale":"2023-12-24T20:03:47.717540+0000","last_undegraded":"2023-12-24T20:03:47.717540+0000","last_fullsized":"2023-12-24T20:03:47.717540+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:14.509222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.727036+0000","last_change":"2023-12-24T20:03:47.726931+0000","last_active":"2023-12-24T20:03:47.727036+0000","last_peered":"2023-12-24T20:03:47.727036+0000","last_clean":"2023-12-24T20:03:47.727036+0000","last_became_active":"2023-12-24T20:03:47.726701+0000","last_became_peered":"2023-12-24T20:03:47.726701+0000","last_unstale":"2023-12-24T20:03:47.727036+0000","last_undegraded":"2023-12-24T20:03:47.727036+0000","last_fullsized":"2023-12-24T20:03:47.727036+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:22:15.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.713249+0000","last_change":"2023-12-24T20:03:46.719997+0000","last_active":"2023-12-24T20:03:47.713249+0000","last_peered":"2023-12-24T20:03:47.713249+0000","last_clean":"2023-12-24T20:03:47.713249+0000","last_became_active":"2023-12-24T20:03:46.719764+0000","last_became_peered":"2023-12-24T20:03:46.719764+0000","last_unstale":"2023-12-24T20:03:47.713249+0000","last_undegraded":"2023-12-24T20:03:47.713249+0000","last_fullsized":"2023-12-24T20:03:47.713249+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:04.130963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.732665+0000","last_change":"2023-12-24T20:03:47.732582+0000","last_active":"2023-12-24T20:03:47.732665+0000","last_peered":"2023-12-24T20:03:47.732665+0000","last_clean":"2023-12-24T20:03:47.732665+0000","last_became_active":"2023-12-24T20:03:47.732336+0000","last_became_peered":"2023-12-24T20:03:47.732336+0000","last_unstale":"2023-12-24T20:03:47.732665+0000","last_undegraded":"2023-12-24T20:03:47.732665+0000","last_fullsized":"2023-12-24T20:03:47.732665+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:41.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.717606+0000","last_change":"2023-12-24T20:03:46.723082+0000","last_active":"2023-12-24T20:03:47.717606+0000","last_peered":"2023-12-24T20:03:47.717606+0000","last_clean":"2023-12-24T20:03:47.717606+0000","last_became_active":"2023-12-24T20:03:46.722467+0000","last_became_peered":"2023-12-24T20:03:46.722467+0000","last_unstale":"2023-12-24T20:03:47.717606+0000","last_undegraded":"2023-12-24T20:03:47.717606+0000","last_fullsized":"2023-12-24T20:03:47.717606+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:47.119055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.722695+0000","last_change":"2023-12-24T20:03:47.722631+0000","last_active":"2023-12-24T20:03:47.722695+0000","last_peered":"2023-12-24T20:03:47.722695+0000","last_clean":"2023-12-24T20:03:47.722695+0000","last_became_active":"2023-12-24T20:03:47.722229+0000","last_became_peered":"2023-12-24T20:03:47.722229+0000","last_unstale":"2023-12-24T20:03:47.722695+0000","last_undegraded":"2023-12-24T20:03:47.722695+0000","last_fullsized":"2023-12-24T20:03:47.722695+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:09.941604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.710971+0000","last_change":"2023-12-24T20:03:46.719764+0000","last_active":"2023-12-24T20:03:47.710971+0000","last_peered":"2023-12-24T20:03:47.710971+0000","last_clean":"2023-12-24T20:03:47.710971+0000","last_became_active":"2023-12-24T20:03:46.719323+0000","last_became_peered":"2023-12-24T20:03:46.719323+0000","last_unstale":"2023-12-24T20:03:47.710971+0000","last_undegraded":"2023-12-24T20:03:47.710971+0000","last_fullsized":"2023-12-24T20:03:47.710971+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:40.804260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.722092+0000","last_change":"2023-12-24T20:03:47.721978+0000","last_active":"2023-12-24T20:03:47.722092+0000","last_peered":"2023-12-24T20:03:47.722092+0000","last_clean":"2023-12-24T20:03:47.722092+0000","last_became_active":"2023-12-24T20:03:47.721746+0000","last_became_peered":"2023-12-24T20:03:47.721746+0000","last_unstale":"2023-12-24T20:03:47.722092+0000","last_undegraded":"2023-12-24T20:03:47.722092+0000","last_fullsized":"2023-12-24T20:03:47.722092+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:53:44.667229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.717086+0000","last_change":"2023-12-24T20:03:46.718122+0000","last_active":"2023-12-24T20:03:47.717086+0000","last_peered":"2023-12-24T20:03:47.717086+0000","last_clean":"2023-12-24T20:03:47.717086+0000","last_became_active":"2023-12-24T20:03:46.717276+0000","last_became_peered":"2023-12-24T20:03:46.717276+0000","last_unstale":"2023-12-24T20:03:47.717086+0000","last_undegraded":"2023-12-24T20:03:47.717086+0000","last_fullsized":"2023-12-24T20:03:47.717086+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:22.193501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.734328+0000","last_change":"2023-12-24T20:03:47.734260+0000","last_active":"2023-12-24T20:03:47.734328+0000","last_peered":"2023-12-24T20:03:47.734328+0000","last_clean":"2023-12-24T20:03:47.734328+0000","last_became_active":"2023-12-24T20:03:47.733881+0000","last_became_peered":"2023-12-24T20:03:47.733881+0000","last_unstale":"2023-12-24T20:03:47.734328+0000","last_undegraded":"2023-12-24T20:03:47.734328+0000","last_fullsized":"2023-12-24T20:03:47.734328+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:45.724065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731081+0000","last_change":"2023-12-24T20:03:46.718848+0000","last_active":"2023-12-24T20:03:47.731081+0000","last_peered":"2023-12-24T20:03:47.731081+0000","last_clean":"2023-12-24T20:03:47.731081+0000","last_became_active":"2023-12-24T20:03:46.718604+0000","last_became_peered":"2023-12-24T20:03:46.718604+0000","last_unstale":"2023-12-24T20:03:47.731081+0000","last_undegraded":"2023-12-24T20:03:47.731081+0000","last_fullsized":"2023-12-24T20:03:47.731081+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:35:10.478911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.715999+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:03:47.715999+0000","last_peered":"2023-12-24T20:03:47.715999+0000","last_clean":"2023-12-24T20:03:47.715999+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:03:47.715999+0000","last_undegraded":"2023-12-24T20:03:47.715999+0000","last_fullsized":"2023-12-24T20:03:47.715999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193914,"statfs":{"total":200000000,"available":198568761,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.443,"5min":0.307,"15min":0.307},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.505},"min":{"1min":0.35899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70799999999999996,"5min":0.754,"15min":0.754},"last":0.60599999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.47099999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.54200000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66200000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.54200000000000004},"min":{"1min":0.439,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76900000000000002,"5min":0.84699999999999998,"15min":0.86899999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.65000000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.49399999999999999,"15min":0.52600000000000002},"min":{"1min":0.311,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.67200000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.77300000000000002,"5min":0.77600000000000002,"15min":0.95699999999999996},"last":0.443}]},{"osd":5,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.56200000000000006},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42899999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57199999999999995,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.622},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.871,"15min":0.873},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":820,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194491,"statfs":{"total":200000000,"available":199159739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55300000000000005,"15min":0.51800000000000002},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65000000000000002,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65800000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73599999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.71499999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68300000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.50900000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.38,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66400000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.64700000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67800000000000005,"5min":1.077,"15min":1.077},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.57699999999999996},"min":{"1min":0.42899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":1.048,"15min":1.048},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.46999999999999997},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70599999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.82899999999999996},"last":0.69399999999999995}]},{"osd":5,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79300000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.72699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63}]},{"osd":7,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.754,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79400000000000004,"5min":0.83199999999999996,"15min":0.88500000000000001},"last":0.75700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194493,"statfs":{"total":200000000,"available":199161275,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34200000000000003,"15min":0.34599999999999997},"min":{"1min":0.22,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47199999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.38},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.372,"15min":0.36199999999999999},"min":{"1min":0.27700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.32200000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"min":{"1min":0.28000000000000003,"5min":0.216,"15min":0.216},"max":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.26900000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.54600000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.29899999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.504,"5min":0.626,"15min":0.626},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.39600000000000002},"min":{"1min":0.28899999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.42099999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.48299999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.443},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53200000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.622},"min":{"1min":0.45900000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85099999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.77100000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51900000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.61499999999999999},"min":{"1min":0.54500000000000004,"5min":0.41999999999999998,"15min":0.39500000000000002},"max":{"1min":0.79500000000000004,"5min":0.878,"15min":0.878},"last":0.48699999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.75900000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.433},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66300000000000003,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82799999999999996,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.5}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1395,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193916,"statfs":{"total":200000000,"available":198570907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.41599999999999998},"min":{"1min":0.23999999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":2.6259999999999999},"last":0.217},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.97999999999999998},"last":0.28100000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.36499999999999999},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.92700000000000005},"last":0.252},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38800000000000001,"15min":0.40000000000000002},"min":{"1min":0.27900000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.503,"5min":0.56899999999999995,"15min":0.93999999999999995},"last":0.35099999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41299999999999998,"15min":0.45900000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":0.55200000000000005,"5min":0.78900000000000003,"15min":2.573},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.28899999999999998},"max":{"1min":0.57799999999999996,"5min":0.628,"15min":0.67600000000000005},"last":0.313}]},{"osd":4,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58699999999999997,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.5},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.67300000000000004},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.754,"5min":0.97499999999999998,"15min":2.7149999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65100000000000002,"15min":0.70799999999999996},"min":{"1min":0.48399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":1.4810000000000001,"15min":2.6859999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.626,"15min":0.624},"min":{"1min":0.46400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79700000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54100000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72999999999999998,"5min":1.655,"15min":1.655},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81200000000000006,"5min":1.036,"15min":1.0489999999999999},"last":0.40400000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88600000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89800000000000002,"5min":1.556,"15min":2.6579999999999999},"last":0.51300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194492,"statfs":{"total":200000000,"available":199160687,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35799999999999998,"15min":0.37},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.504,"5min":0.67700000000000005,"15min":0.78900000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.374,"15min":0.374},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.35599999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.36899999999999999,"15min":0.36299999999999999},"min":{"1min":0.26500000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45500000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.317},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.40300000000000002},"min":{"1min":0.29199999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53000000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38400000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52600000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.37},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.29499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.312}]},{"osd":4,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83799999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77900000000000003,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66800000000000004,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89400000000000002,"5min":3.577,"15min":3.577},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.52300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91200000000000003,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.50800000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86499999999999999,"5min":1.298,"15min":1.298},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.64100000000000001},"min":{"1min":0.51000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.637,"15min":3.637},"last":0.69799999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70299999999999996,"15min":0.66200000000000003},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67300000000000004,"15min":0.68100000000000005},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.93000000000000005,"5min":1.331,"15min":1.331},"last":0.56000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194493,"statfs":{"total":200000000,"available":199161115,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34599999999999997,"15min":0.32800000000000001},"min":{"1min":0.22600000000000001,"5min":0.20100000000000001,"15min":0.182},"max":{"1min":0.47899999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.255},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"min":{"1min":0.27500000000000002,"5min":0.23599999999999999,"15min":0.21099999999999999},"max":{"1min":0.45400000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.28799999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36499999999999999,"15min":0.34699999999999998},"min":{"1min":0.248,"5min":0.223,"15min":0.223},"max":{"1min":0.46700000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.38600000000000001},"min":{"1min":0.28299999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52500000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.307}]},{"osd":2,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.32300000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.55200000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.433,"15min":0.42599999999999999},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33700000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61799999999999999,"15min":0.60299999999999998},"min":{"1min":0.379,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.875,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.626,"15min":0.60399999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":1.337,"15min":1.337},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.63500000000000001,"15min":0.61199999999999999},"min":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80800000000000005,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.92800000000000005,"15min":0.97799999999999998},"last":0.58199999999999996}]},{"osd":6,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.62},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.875,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.66000000000000003,"15min":0.624},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93300000000000005,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65400000000000003,"15min":0.64000000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81399999999999995,"5min":1.006,"15min":1.006},"last":0.64100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194493,"statfs":{"total":200000000,"available":199161205,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56000000000000005,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68899999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68600000000000005}]},{"osd":1,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.70799999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":4.883},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54000000000000004,"15min":0.58699999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":1.544},"last":0.78200000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.39600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65800000000000003,"5min":0.78400000000000003,"15min":0.88},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.58899999999999997},"min":{"1min":0.34999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.41699999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"max":{"1min":0.66000000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.85999999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69299999999999995,"5min":0.77300000000000002,"15min":8.8200000000000003},"last":0.75700000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46600000000000003,"15min":0.51800000000000002},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61399999999999999,"5min":0.79600000000000004,"15min":1.4419999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51700000000000002,"15min":0.63700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":3.8279999999999998},"last":0.48099999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57699999999999996,"15min":0.63100000000000001},"min":{"1min":0.40999999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81200000000000006,"5min":0.88700000000000001,"15min":1.6439999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":1.0249999999999999},"min":{"1min":0.42199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69399999999999995,"5min":0.86499999999999999,"15min":14.039999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.31},"max":{"1min":0.63700000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194493,"statfs":{"total":200000000,"available":199161163,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.51500000000000001},"min":{"1min":0.40799999999999997,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.55400000000000005},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.622}]},{"osd":1,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80200000000000005,"5min":1.847,"15min":1.847},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.56399999999999995},"min":{"1min":0.45300000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.52500000000000002},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.74199999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.54900000000000004},"min":{"1min":0.46999999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.77800000000000002,"5min":1.97,"15min":1.97},"last":0.58499999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.622,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.40000000000000002,"15min":0.38},"max":{"1min":0.82599999999999996,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.83699999999999997},"last":0.60499999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.36299999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.75700000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77000000000000002,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.70499999999999996}]},{"osd":6,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.5,"15min":0.47999999999999998},"min":{"1min":0.40999999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70799999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.34799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78600000000000003,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59099999999999997,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.96899999999999997,"5min":3.766,"15min":3.766},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57299999999999995,"15min":0.55200000000000005},"min":{"1min":0.36199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.64900000000000002}]}]}],"pool_statfs":[]}} 2023-12-24T20:03:51.858 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:03:52.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.014+0000 7f1d84e16700 1 Processor -- start 2023-12-24T20:03:52.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.014+0000 7f1d84e16700 1 -- start start 2023-12-24T20:03:52.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d84e16700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068140 0x7f1d800cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d84e16700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1d80068510 0x7f1d800b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d84e16700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d800b2890 con 0x7f1d80159a60 2023-12-24T20:03:52.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d84e16700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d800b11e0 con 0x7f1d80068510 2023-12-24T20:03:52.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d84e16700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800cf630 con 0x7f1d80068140 2023-12-24T20:03:52.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d7dd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1d80068510 0x7f1d800b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d7ed9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1d80159a60 0x7f1d80159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40282/0 (socket says 172.21.15.61:40282) 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d7dd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1d80068510 0x7f1d800b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52136/0 (socket says 172.21.15.61:52136) 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d7ed9d700 1 -- 172.21.15.61:0/369372795 learned_addr learned my addr 172.21.15.61:0/369372795 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d7e59c700 1 --2- 172.21.15.61:0/369372795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068140 0x7f1d800cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d7dd9b700 1 -- 172.21.15.61:0/369372795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068140 msgr2=0x7f1d800cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d7dd9b700 1 --2- 172.21.15.61:0/369372795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068140 0x7f1d800cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d7dd9b700 1 -- 172.21.15.61:0/369372795 >> v1:172.21.15.61:6789/0 conn(0x7f1d80159a60 legacy=0x7f1d80159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d7dd9b700 1 -- 172.21.15.61:0/369372795 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d800b2240 con 0x7f1d80068510 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.015+0000 7f1d7d59a700 1 -- 172.21.15.61:0/369372795 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238506961 0 0) 0x7f1d800b2890 con 0x7f1d80159a60 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d7e59c700 1 --2- 172.21.15.61:0/369372795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068140 0x7f1d800cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d7dd9b700 1 --2- 172.21.15.61:0/369372795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80068510 0x7f1d800b0ca0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1d700098e0 tx=0x7f1d700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9381b5640352fdc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:52.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d7d59a700 1 -- 172.21.15.61:0/369372795 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70009e80 con 0x7f1d80068510 2023-12-24T20:03:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d7d59a700 1 -- 172.21.15.61:0/369372795 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000b860 con 0x7f1d80068510 2023-12-24T20:03:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d7d59a700 1 -- 172.21.15.61:0/369372795 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000bbe0 con 0x7f1d80068510 2023-12-24T20:03:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d84e16700 1 -- 172.21.15.61:0/369372795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80068510 msgr2=0x7f1d800b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d84e16700 1 --2- 172.21.15.61:0/369372795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80068510 0x7f1d800b0ca0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1d700098e0 tx=0x7f1d700091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d84e16700 1 -- 172.21.15.61:0/369372795 shutdown_connections 2023-12-24T20:03:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d84e16700 1 --2- 172.21.15.61:0/369372795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068140 0x7f1d800cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d84e16700 1 --2- 172.21.15.61:0/369372795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80068510 0x7f1d800b0ca0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.016+0000 7f1d84e16700 1 -- 172.21.15.61:0/369372795 >> 172.21.15.61:0/369372795 conn(0x7f1d80097a10 msgr2=0x7f1d800ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.017+0000 7f1d84e16700 1 -- 172.21.15.61:0/369372795 shutdown_connections 2023-12-24T20:03:52.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.017+0000 7f1d84e16700 1 -- 172.21.15.61:0/369372795 wait complete. 2023-12-24T20:03:52.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.018+0000 7f1d84e16700 1 Processor -- start 2023-12-24T20:03:52.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.018+0000 7f1d84e16700 1 -- start start 2023-12-24T20:03:52.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.018+0000 7f1d84e16700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d80068140 0x7f1d80155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.018+0000 7f1d84e16700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068510 0x7f1d801563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.018+0000 7f1d84e16700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80159a60 0x7f1d8016a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.018+0000 7f1d84e16700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80156fc0 con 0x7f1d80159a60 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.018+0000 7f1d84e16700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8016bc30 con 0x7f1d80068140 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.018+0000 7f1d84e16700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80156ce0 con 0x7f1d80068510 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.018+0000 7f1d7ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80159a60 0x7f1d8016a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d7ed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80159a60 0x7f1d8016a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52152/0 (socket says 172.21.15.61:52152) 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d7ed9d700 1 -- 172.21.15.61:0/2095100214 learned_addr learned my addr 172.21.15.61:0/2095100214 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d7e59c700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d80068140 0x7f1d80155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d7dd9b700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068510 0x7f1d801563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d7ed9d700 1 -- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068510 msgr2=0x7f1d801563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d7ed9d700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068510 0x7f1d801563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d7ed9d700 1 -- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d80068140 msgr2=0x7f1d80155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d7ed9d700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d80068140 0x7f1d80155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d7ed9d700 1 -- 172.21.15.61:0/2095100214 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70009420 con 0x7f1d80159a60 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d7ed9d700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80159a60 0x7f1d8016a320 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800cbf0 tx=0x7f1d780019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d767fc700 1 -- 172.21.15.61:0/2095100214 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800a8b0 con 0x7f1d80159a60 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d767fc700 1 -- 172.21.15.61:0/2095100214 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7800aa30 con 0x7f1d80159a60 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d84e16700 1 -- 172.21.15.61:0/2095100214 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8016b5e0 con 0x7f1d80159a60 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d767fc700 1 -- 172.21.15.61:0/2095100214 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800adf0 con 0x7f1d80159a60 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.019+0000 7f1d84e16700 1 -- 172.21.15.61:0/2095100214 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d801568e0 con 0x7f1d80159a60 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.020+0000 7f1d84e16700 1 -- 172.21.15.61:0/2095100214 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8006d440 con 0x7f1d80159a60 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.021+0000 7f1d767fc700 1 -- 172.21.15.61:0/2095100214 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1d78007300 con 0x7f1d80159a60 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.021+0000 7f1d767fc700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1d60066f30 0x7f1d600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.021+0000 7f1d767fc700 1 -- 172.21.15.61:0/2095100214 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d78084720 con 0x7f1d80159a60 2023-12-24T20:03:52.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.021+0000 7f1d7e59c700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1d60066f30 0x7f1d600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.022+0000 7f1d7e59c700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1d60066f30 0x7f1d600693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1d68006ea0 tx=0x7f1d68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:52.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.026+0000 7f1d767fc700 1 -- 172.21.15.61:0/2095100214 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d78051a10 con 0x7f1d80159a60 2023-12-24T20:03:52.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.217+0000 7f1d84e16700 1 -- 172.21.15.61:0/2095100214 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d8016bda0 con 0x7f1d60066f30 2023-12-24T20:03:52.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.226+0000 7f1d767fc700 1 -- 172.21.15.61:0/2095100214 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285501 (secure 0 0 0) 0x7f1d8016bda0 con 0x7f1d60066f30 2023-12-24T20:03:52.229 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 -- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1d60066f30 msgr2=0x7f1d600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1d60066f30 0x7f1d600693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1d68006ea0 tx=0x7f1d68008040 comp rx=0 tx=0).stop 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 -- 172.21.15.61:0/2095100214 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80159a60 msgr2=0x7f1d8016a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80159a60 0x7f1d8016a320 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800cbf0 tx=0x7f1d780019b0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 -- 172.21.15.61:0/2095100214 shutdown_connections 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1d60066f30 0x7f1d600693e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1d80159a60 0x7f1d8016a320 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d80068140 0x7f1d80155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 --2- 172.21.15.61:0/2095100214 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1d80068510 0x7f1d801563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 -- 172.21.15.61:0/2095100214 >> 172.21.15.61:0/2095100214 conn(0x7f1d80097a10 msgr2=0x7f1d800ae370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 -- 172.21.15.61:0/2095100214 shutdown_connections 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.229+0000 7f1d84e16700 1 -- 172.21.15.61:0/2095100214 wait complete. 2023-12-24T20:03:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:03:52.241 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2023-12-24T20:03:50.406682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554789,"statfs":{"total":1600000000,"available":1592104852,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.704507"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.732118+0000","last_change":"2023-12-24T20:03:47.732059+0000","last_active":"2023-12-24T20:03:47.732118+0000","last_peered":"2023-12-24T20:03:47.732118+0000","last_clean":"2023-12-24T20:03:47.732118+0000","last_became_active":"2023-12-24T20:03:47.731644+0000","last_became_peered":"2023-12-24T20:03:47.731644+0000","last_unstale":"2023-12-24T20:03:47.732118+0000","last_undegraded":"2023-12-24T20:03:47.732118+0000","last_fullsized":"2023-12-24T20:03:47.732118+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:35:36.114537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.714515+0000","last_change":"2023-12-24T20:03:47.714445+0000","last_active":"2023-12-24T20:03:47.714515+0000","last_peered":"2023-12-24T20:03:47.714515+0000","last_clean":"2023-12-24T20:03:47.714515+0000","last_became_active":"2023-12-24T20:03:47.714108+0000","last_became_peered":"2023-12-24T20:03:47.714108+0000","last_unstale":"2023-12-24T20:03:47.714515+0000","last_undegraded":"2023-12-24T20:03:47.714515+0000","last_fullsized":"2023-12-24T20:03:47.714515+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:31:53.498931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.723971+0000","last_change":"2023-12-24T20:03:47.723745+0000","last_active":"2023-12-24T20:03:47.723971+0000","last_peered":"2023-12-24T20:03:47.723971+0000","last_clean":"2023-12-24T20:03:47.723971+0000","last_became_active":"2023-12-24T20:03:47.723171+0000","last_became_peered":"2023-12-24T20:03:47.723171+0000","last_unstale":"2023-12-24T20:03:47.723971+0000","last_undegraded":"2023-12-24T20:03:47.723971+0000","last_fullsized":"2023-12-24T20:03:47.723971+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:14.882841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731317+0000","last_change":"2023-12-24T20:03:47.731272+0000","last_active":"2023-12-24T20:03:47.731317+0000","last_peered":"2023-12-24T20:03:47.731317+0000","last_clean":"2023-12-24T20:03:47.731317+0000","last_became_active":"2023-12-24T20:03:47.730897+0000","last_became_peered":"2023-12-24T20:03:47.730897+0000","last_unstale":"2023-12-24T20:03:47.731317+0000","last_undegraded":"2023-12-24T20:03:47.731317+0000","last_fullsized":"2023-12-24T20:03:47.731317+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:03:42.017488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.719704+0000","last_change":"2023-12-24T20:03:47.719627+0000","last_active":"2023-12-24T20:03:47.719704+0000","last_peered":"2023-12-24T20:03:47.719704+0000","last_clean":"2023-12-24T20:03:47.719704+0000","last_became_active":"2023-12-24T20:03:47.719387+0000","last_became_peered":"2023-12-24T20:03:47.719387+0000","last_unstale":"2023-12-24T20:03:47.719704+0000","last_undegraded":"2023-12-24T20:03:47.719704+0000","last_fullsized":"2023-12-24T20:03:47.719704+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:32:54.386104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.732726+0000","last_change":"2023-12-24T20:03:47.732609+0000","last_active":"2023-12-24T20:03:47.732726+0000","last_peered":"2023-12-24T20:03:47.732726+0000","last_clean":"2023-12-24T20:03:47.732726+0000","last_became_active":"2023-12-24T20:03:47.732311+0000","last_became_peered":"2023-12-24T20:03:47.732311+0000","last_unstale":"2023-12-24T20:03:47.732726+0000","last_undegraded":"2023-12-24T20:03:47.732726+0000","last_fullsized":"2023-12-24T20:03:47.732726+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:32:54.386104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724529+0000","last_change":"2023-12-24T20:03:47.724091+0000","last_active":"2023-12-24T20:03:47.724529+0000","last_peered":"2023-12-24T20:03:47.724529+0000","last_clean":"2023-12-24T20:03:47.724529+0000","last_became_active":"2023-12-24T20:03:47.722775+0000","last_became_peered":"2023-12-24T20:03:47.722775+0000","last_unstale":"2023-12-24T20:03:47.724529+0000","last_undegraded":"2023-12-24T20:03:47.724529+0000","last_fullsized":"2023-12-24T20:03:47.724529+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:45.724065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730011+0000","last_change":"2023-12-24T20:03:47.728962+0000","last_active":"2023-12-24T20:03:47.730011+0000","last_peered":"2023-12-24T20:03:47.730011+0000","last_clean":"2023-12-24T20:03:47.730011+0000","last_became_active":"2023-12-24T20:03:47.728372+0000","last_became_peered":"2023-12-24T20:03:47.728372+0000","last_unstale":"2023-12-24T20:03:47.730011+0000","last_undegraded":"2023-12-24T20:03:47.730011+0000","last_fullsized":"2023-12-24T20:03:47.730011+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:34:52.795009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.721549+0000","last_change":"2023-12-24T20:03:47.719742+0000","last_active":"2023-12-24T20:03:47.721549+0000","last_peered":"2023-12-24T20:03:47.721549+0000","last_clean":"2023-12-24T20:03:47.721549+0000","last_became_active":"2023-12-24T20:03:47.719494+0000","last_became_peered":"2023-12-24T20:03:47.719494+0000","last_unstale":"2023-12-24T20:03:47.721549+0000","last_undegraded":"2023-12-24T20:03:47.721549+0000","last_fullsized":"2023-12-24T20:03:47.721549+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:04:59.550924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.715325+0000","last_change":"2023-12-24T20:03:47.715220+0000","last_active":"2023-12-24T20:03:47.715325+0000","last_peered":"2023-12-24T20:03:47.715325+0000","last_clean":"2023-12-24T20:03:47.715325+0000","last_became_active":"2023-12-24T20:03:47.714954+0000","last_became_peered":"2023-12-24T20:03:47.714954+0000","last_unstale":"2023-12-24T20:03:47.715325+0000","last_undegraded":"2023-12-24T20:03:47.715325+0000","last_fullsized":"2023-12-24T20:03:47.715325+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:42:33.388573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724389+0000","last_change":"2023-12-24T20:03:47.723977+0000","last_active":"2023-12-24T20:03:47.724389+0000","last_peered":"2023-12-24T20:03:47.724389+0000","last_clean":"2023-12-24T20:03:47.724389+0000","last_became_active":"2023-12-24T20:03:47.723488+0000","last_became_peered":"2023-12-24T20:03:47.723488+0000","last_unstale":"2023-12-24T20:03:47.724389+0000","last_undegraded":"2023-12-24T20:03:47.724389+0000","last_fullsized":"2023-12-24T20:03:47.724389+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:01.101607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.721596+0000","last_change":"2023-12-24T20:03:47.720358+0000","last_active":"2023-12-24T20:03:47.721596+0000","last_peered":"2023-12-24T20:03:47.721596+0000","last_clean":"2023-12-24T20:03:47.721596+0000","last_became_active":"2023-12-24T20:03:47.719967+0000","last_became_peered":"2023-12-24T20:03:47.719967+0000","last_unstale":"2023-12-24T20:03:47.721596+0000","last_undegraded":"2023-12-24T20:03:47.721596+0000","last_fullsized":"2023-12-24T20:03:47.721596+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:22:17.771257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730402+0000","last_change":"2023-12-24T20:03:47.728028+0000","last_active":"2023-12-24T20:03:47.730402+0000","last_peered":"2023-12-24T20:03:47.730402+0000","last_clean":"2023-12-24T20:03:47.730402+0000","last_became_active":"2023-12-24T20:03:47.727253+0000","last_became_peered":"2023-12-24T20:03:47.727253+0000","last_unstale":"2023-12-24T20:03:47.730402+0000","last_undegraded":"2023-12-24T20:03:47.730402+0000","last_fullsized":"2023-12-24T20:03:47.730402+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:12.087412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.729786+0000","last_change":"2023-12-24T20:03:47.729696+0000","last_active":"2023-12-24T20:03:47.729786+0000","last_peered":"2023-12-24T20:03:47.729786+0000","last_clean":"2023-12-24T20:03:47.729786+0000","last_became_active":"2023-12-24T20:03:47.729441+0000","last_became_peered":"2023-12-24T20:03:47.729441+0000","last_unstale":"2023-12-24T20:03:47.729786+0000","last_undegraded":"2023-12-24T20:03:47.729786+0000","last_fullsized":"2023-12-24T20:03:47.729786+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:08.919117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.734175+0000","last_change":"2023-12-24T20:03:47.733978+0000","last_active":"2023-12-24T20:03:47.734175+0000","last_peered":"2023-12-24T20:03:47.734175+0000","last_clean":"2023-12-24T20:03:47.734175+0000","last_became_active":"2023-12-24T20:03:47.732629+0000","last_became_peered":"2023-12-24T20:03:47.732629+0000","last_unstale":"2023-12-24T20:03:47.734175+0000","last_undegraded":"2023-12-24T20:03:47.734175+0000","last_fullsized":"2023-12-24T20:03:47.734175+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:44:06.825151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.734062+0000","last_change":"2023-12-24T20:03:47.734010+0000","last_active":"2023-12-24T20:03:47.734062+0000","last_peered":"2023-12-24T20:03:47.734062+0000","last_clean":"2023-12-24T20:03:47.734062+0000","last_became_active":"2023-12-24T20:03:47.733722+0000","last_became_peered":"2023-12-24T20:03:47.733722+0000","last_unstale":"2023-12-24T20:03:47.734062+0000","last_undegraded":"2023-12-24T20:03:47.734062+0000","last_fullsized":"2023-12-24T20:03:47.734062+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:01.339569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724560+0000","last_change":"2023-12-24T20:03:47.724398+0000","last_active":"2023-12-24T20:03:47.724560+0000","last_peered":"2023-12-24T20:03:47.724560+0000","last_clean":"2023-12-24T20:03:47.724560+0000","last_became_active":"2023-12-24T20:03:47.723832+0000","last_became_peered":"2023-12-24T20:03:47.723832+0000","last_unstale":"2023-12-24T20:03:47.724560+0000","last_undegraded":"2023-12-24T20:03:47.724560+0000","last_fullsized":"2023-12-24T20:03:47.724560+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:50:21.809386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.713460+0000","last_change":"2023-12-24T20:03:47.713217+0000","last_active":"2023-12-24T20:03:47.713460+0000","last_peered":"2023-12-24T20:03:47.713460+0000","last_clean":"2023-12-24T20:03:47.713460+0000","last_became_active":"2023-12-24T20:03:47.712598+0000","last_became_peered":"2023-12-24T20:03:47.712598+0000","last_unstale":"2023-12-24T20:03:47.713460+0000","last_undegraded":"2023-12-24T20:03:47.713460+0000","last_fullsized":"2023-12-24T20:03:47.713460+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:08.518838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.722005+0000","last_change":"2023-12-24T20:03:47.721892+0000","last_active":"2023-12-24T20:03:47.722005+0000","last_peered":"2023-12-24T20:03:47.722005+0000","last_clean":"2023-12-24T20:03:47.722005+0000","last_became_active":"2023-12-24T20:03:47.721581+0000","last_became_peered":"2023-12-24T20:03:47.721581+0000","last_unstale":"2023-12-24T20:03:47.722005+0000","last_undegraded":"2023-12-24T20:03:47.722005+0000","last_fullsized":"2023-12-24T20:03:47.722005+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:35:11.574004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.715400+0000","last_change":"2023-12-24T20:03:47.715300+0000","last_active":"2023-12-24T20:03:47.715400+0000","last_peered":"2023-12-24T20:03:47.715400+0000","last_clean":"2023-12-24T20:03:47.715400+0000","last_became_active":"2023-12-24T20:03:47.715045+0000","last_became_peered":"2023-12-24T20:03:47.715045+0000","last_unstale":"2023-12-24T20:03:47.715400+0000","last_undegraded":"2023-12-24T20:03:47.715400+0000","last_fullsized":"2023-12-24T20:03:47.715400+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:51:01.384268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.720193+0000","last_change":"2023-12-24T20:03:47.720108+0000","last_active":"2023-12-24T20:03:47.720193+0000","last_peered":"2023-12-24T20:03:47.720193+0000","last_clean":"2023-12-24T20:03:47.720193+0000","last_became_active":"2023-12-24T20:03:47.719692+0000","last_became_peered":"2023-12-24T20:03:47.719692+0000","last_unstale":"2023-12-24T20:03:47.720193+0000","last_undegraded":"2023-12-24T20:03:47.720193+0000","last_fullsized":"2023-12-24T20:03:47.720193+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:29:28.971391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.723824+0000","last_change":"2023-12-24T20:03:47.723759+0000","last_active":"2023-12-24T20:03:47.723824+0000","last_peered":"2023-12-24T20:03:47.723824+0000","last_clean":"2023-12-24T20:03:47.723824+0000","last_became_active":"2023-12-24T20:03:47.723468+0000","last_became_peered":"2023-12-24T20:03:47.723468+0000","last_unstale":"2023-12-24T20:03:47.723824+0000","last_undegraded":"2023-12-24T20:03:47.723824+0000","last_fullsized":"2023-12-24T20:03:47.723824+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:18:41.472224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.723988+0000","last_change":"2023-12-24T20:03:47.723889+0000","last_active":"2023-12-24T20:03:47.723988+0000","last_peered":"2023-12-24T20:03:47.723988+0000","last_clean":"2023-12-24T20:03:47.723988+0000","last_became_active":"2023-12-24T20:03:47.723510+0000","last_became_peered":"2023-12-24T20:03:47.723510+0000","last_unstale":"2023-12-24T20:03:47.723988+0000","last_undegraded":"2023-12-24T20:03:47.723988+0000","last_fullsized":"2023-12-24T20:03:47.723988+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:08.401010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725907+0000","last_change":"2023-12-24T20:03:47.725840+0000","last_active":"2023-12-24T20:03:47.725907+0000","last_peered":"2023-12-24T20:03:47.725907+0000","last_clean":"2023-12-24T20:03:47.725907+0000","last_became_active":"2023-12-24T20:03:47.725527+0000","last_became_peered":"2023-12-24T20:03:47.725527+0000","last_unstale":"2023-12-24T20:03:47.725907+0000","last_undegraded":"2023-12-24T20:03:47.725907+0000","last_fullsized":"2023-12-24T20:03:47.725907+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:03.289216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730087+0000","last_change":"2023-12-24T20:03:47.729992+0000","last_active":"2023-12-24T20:03:47.730087+0000","last_peered":"2023-12-24T20:03:47.730087+0000","last_clean":"2023-12-24T20:03:47.730087+0000","last_became_active":"2023-12-24T20:03:47.724861+0000","last_became_peered":"2023-12-24T20:03:47.724861+0000","last_unstale":"2023-12-24T20:03:47.730087+0000","last_undegraded":"2023-12-24T20:03:47.730087+0000","last_fullsized":"2023-12-24T20:03:47.730087+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:46:26.394705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.733956+0000","last_change":"2023-12-24T20:03:47.733868+0000","last_active":"2023-12-24T20:03:47.733956+0000","last_peered":"2023-12-24T20:03:47.733956+0000","last_clean":"2023-12-24T20:03:47.733956+0000","last_became_active":"2023-12-24T20:03:47.733475+0000","last_became_peered":"2023-12-24T20:03:47.733475+0000","last_unstale":"2023-12-24T20:03:47.733956+0000","last_undegraded":"2023-12-24T20:03:47.733956+0000","last_fullsized":"2023-12-24T20:03:47.733956+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:51.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730421+0000","last_change":"2023-12-24T20:03:47.727898+0000","last_active":"2023-12-24T20:03:47.730421+0000","last_peered":"2023-12-24T20:03:47.730421+0000","last_clean":"2023-12-24T20:03:47.730421+0000","last_became_active":"2023-12-24T20:03:47.727518+0000","last_became_peered":"2023-12-24T20:03:47.727518+0000","last_unstale":"2023-12-24T20:03:47.730421+0000","last_undegraded":"2023-12-24T20:03:47.730421+0000","last_fullsized":"2023-12-24T20:03:47.730421+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:51:56.174672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.726868+0000","last_change":"2023-12-24T20:03:47.726686+0000","last_active":"2023-12-24T20:03:47.726868+0000","last_peered":"2023-12-24T20:03:47.726868+0000","last_clean":"2023-12-24T20:03:47.726868+0000","last_became_active":"2023-12-24T20:03:47.726212+0000","last_became_peered":"2023-12-24T20:03:47.726212+0000","last_unstale":"2023-12-24T20:03:47.726868+0000","last_undegraded":"2023-12-24T20:03:47.726868+0000","last_fullsized":"2023-12-24T20:03:47.726868+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:53:44.667229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730549+0000","last_change":"2023-12-24T20:03:47.728667+0000","last_active":"2023-12-24T20:03:47.730549+0000","last_peered":"2023-12-24T20:03:47.730549+0000","last_clean":"2023-12-24T20:03:47.730549+0000","last_became_active":"2023-12-24T20:03:47.728365+0000","last_became_peered":"2023-12-24T20:03:47.728365+0000","last_unstale":"2023-12-24T20:03:47.730549+0000","last_undegraded":"2023-12-24T20:03:47.730549+0000","last_fullsized":"2023-12-24T20:03:47.730549+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:43.813410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.734192+0000","last_change":"2023-12-24T20:03:47.734116+0000","last_active":"2023-12-24T20:03:47.734192+0000","last_peered":"2023-12-24T20:03:47.734192+0000","last_clean":"2023-12-24T20:03:47.734192+0000","last_became_active":"2023-12-24T20:03:47.732851+0000","last_became_peered":"2023-12-24T20:03:47.732851+0000","last_unstale":"2023-12-24T20:03:47.734192+0000","last_undegraded":"2023-12-24T20:03:47.734192+0000","last_fullsized":"2023-12-24T20:03:47.734192+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:36:42.168740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.734185+0000","last_change":"2023-12-24T20:03:47.734109+0000","last_active":"2023-12-24T20:03:47.734185+0000","last_peered":"2023-12-24T20:03:47.734185+0000","last_clean":"2023-12-24T20:03:47.734185+0000","last_became_active":"2023-12-24T20:03:47.733582+0000","last_became_peered":"2023-12-24T20:03:47.733582+0000","last_unstale":"2023-12-24T20:03:47.734185+0000","last_undegraded":"2023-12-24T20:03:47.734185+0000","last_fullsized":"2023-12-24T20:03:47.734185+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:46:19.729523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.713256+0000","last_change":"2023-12-24T20:03:47.713166+0000","last_active":"2023-12-24T20:03:47.713256+0000","last_peered":"2023-12-24T20:03:47.713256+0000","last_clean":"2023-12-24T20:03:47.713256+0000","last_became_active":"2023-12-24T20:03:47.712880+0000","last_became_peered":"2023-12-24T20:03:47.712880+0000","last_unstale":"2023-12-24T20:03:47.713256+0000","last_undegraded":"2023-12-24T20:03:47.713256+0000","last_fullsized":"2023-12-24T20:03:47.713256+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:49.278531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.719474+0000","last_change":"2023-12-24T20:03:47.719406+0000","last_active":"2023-12-24T20:03:47.719474+0000","last_peered":"2023-12-24T20:03:47.719474+0000","last_clean":"2023-12-24T20:03:47.719474+0000","last_became_active":"2023-12-24T20:03:47.719177+0000","last_became_peered":"2023-12-24T20:03:47.719177+0000","last_unstale":"2023-12-24T20:03:47.719474+0000","last_undegraded":"2023-12-24T20:03:47.719474+0000","last_fullsized":"2023-12-24T20:03:47.719474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T08:01:04.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"150'4","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731212+0000","last_change":"2023-12-24T20:03:46.722031+0000","last_active":"2023-12-24T20:03:47.731212+0000","last_peered":"2023-12-24T20:03:47.731212+0000","last_clean":"2023-12-24T20:03:47.731212+0000","last_became_active":"2023-12-24T20:03:46.721791+0000","last_became_peered":"2023-12-24T20:03:46.721791+0000","last_unstale":"2023-12-24T20:03:47.731212+0000","last_undegraded":"2023-12-24T20:03:47.731212+0000","last_fullsized":"2023-12-24T20:03:47.731212+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:19:53.558909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730030+0000","last_change":"2023-12-24T20:03:47.729138+0000","last_active":"2023-12-24T20:03:47.730030+0000","last_peered":"2023-12-24T20:03:47.730030+0000","last_clean":"2023-12-24T20:03:47.730030+0000","last_became_active":"2023-12-24T20:03:47.728711+0000","last_became_peered":"2023-12-24T20:03:47.728711+0000","last_unstale":"2023-12-24T20:03:47.730030+0000","last_undegraded":"2023-12-24T20:03:47.730030+0000","last_fullsized":"2023-12-24T20:03:47.730030+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:41.809796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.726644+0000","last_change":"2023-12-24T20:03:46.716706+0000","last_active":"2023-12-24T20:03:47.726644+0000","last_peered":"2023-12-24T20:03:47.726644+0000","last_clean":"2023-12-24T20:03:47.726644+0000","last_became_active":"2023-12-24T20:03:46.716451+0000","last_became_peered":"2023-12-24T20:03:46.716451+0000","last_unstale":"2023-12-24T20:03:47.726644+0000","last_undegraded":"2023-12-24T20:03:47.726644+0000","last_fullsized":"2023-12-24T20:03:47.726644+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:11.081875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.720070+0000","last_change":"2023-12-24T20:03:47.719951+0000","last_active":"2023-12-24T20:03:47.720070+0000","last_peered":"2023-12-24T20:03:47.720070+0000","last_clean":"2023-12-24T20:03:47.720070+0000","last_became_active":"2023-12-24T20:03:47.719366+0000","last_became_peered":"2023-12-24T20:03:47.719366+0000","last_unstale":"2023-12-24T20:03:47.720070+0000","last_undegraded":"2023-12-24T20:03:47.720070+0000","last_fullsized":"2023-12-24T20:03:47.720070+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:51.136739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725281+0000","last_change":"2023-12-24T20:03:46.717376+0000","last_active":"2023-12-24T20:03:47.725281+0000","last_peered":"2023-12-24T20:03:47.725281+0000","last_clean":"2023-12-24T20:03:47.725281+0000","last_became_active":"2023-12-24T20:03:46.716842+0000","last_became_peered":"2023-12-24T20:03:46.716842+0000","last_unstale":"2023-12-24T20:03:47.725281+0000","last_undegraded":"2023-12-24T20:03:47.725281+0000","last_fullsized":"2023-12-24T20:03:47.725281+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:18:33.113042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730698+0000","last_change":"2023-12-24T20:03:47.730616+0000","last_active":"2023-12-24T20:03:47.730698+0000","last_peered":"2023-12-24T20:03:47.730698+0000","last_clean":"2023-12-24T20:03:47.730698+0000","last_became_active":"2023-12-24T20:03:47.730315+0000","last_became_peered":"2023-12-24T20:03:47.730315+0000","last_unstale":"2023-12-24T20:03:47.730698+0000","last_undegraded":"2023-12-24T20:03:47.730698+0000","last_fullsized":"2023-12-24T20:03:47.730698+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:12.848225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730166+0000","last_change":"2023-12-24T20:03:46.711165+0000","last_active":"2023-12-24T20:03:47.730166+0000","last_peered":"2023-12-24T20:03:47.730166+0000","last_clean":"2023-12-24T20:03:47.730166+0000","last_became_active":"2023-12-24T20:03:46.710472+0000","last_became_peered":"2023-12-24T20:03:46.710472+0000","last_unstale":"2023-12-24T20:03:47.730166+0000","last_undegraded":"2023-12-24T20:03:47.730166+0000","last_fullsized":"2023-12-24T20:03:47.730166+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:59.172427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.713478+0000","last_change":"2023-12-24T20:03:47.713397+0000","last_active":"2023-12-24T20:03:47.713478+0000","last_peered":"2023-12-24T20:03:47.713478+0000","last_clean":"2023-12-24T20:03:47.713478+0000","last_became_active":"2023-12-24T20:03:47.712943+0000","last_became_peered":"2023-12-24T20:03:47.712943+0000","last_unstale":"2023-12-24T20:03:47.713478+0000","last_undegraded":"2023-12-24T20:03:47.713478+0000","last_fullsized":"2023-12-24T20:03:47.713478+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:02:39.758143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731753+0000","last_change":"2023-12-24T20:03:46.715615+0000","last_active":"2023-12-24T20:03:47.731753+0000","last_peered":"2023-12-24T20:03:47.731753+0000","last_clean":"2023-12-24T20:03:47.731753+0000","last_became_active":"2023-12-24T20:03:46.715401+0000","last_became_peered":"2023-12-24T20:03:46.715401+0000","last_unstale":"2023-12-24T20:03:47.731753+0000","last_undegraded":"2023-12-24T20:03:47.731753+0000","last_fullsized":"2023-12-24T20:03:47.731753+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:05:55.030689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724546+0000","last_change":"2023-12-24T20:03:47.724250+0000","last_active":"2023-12-24T20:03:47.724546+0000","last_peered":"2023-12-24T20:03:47.724546+0000","last_clean":"2023-12-24T20:03:47.724546+0000","last_became_active":"2023-12-24T20:03:47.723515+0000","last_became_peered":"2023-12-24T20:03:47.723515+0000","last_unstale":"2023-12-24T20:03:47.724546+0000","last_undegraded":"2023-12-24T20:03:47.724546+0000","last_fullsized":"2023-12-24T20:03:47.724546+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:47:59.037318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.732055+0000","last_change":"2023-12-24T20:03:46.717589+0000","last_active":"2023-12-24T20:03:47.732055+0000","last_peered":"2023-12-24T20:03:47.732055+0000","last_clean":"2023-12-24T20:03:47.732055+0000","last_became_active":"2023-12-24T20:03:46.717417+0000","last_became_peered":"2023-12-24T20:03:46.717417+0000","last_unstale":"2023-12-24T20:03:47.732055+0000","last_undegraded":"2023-12-24T20:03:47.732055+0000","last_fullsized":"2023-12-24T20:03:47.732055+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:11:07.395474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.723952+0000","last_change":"2023-12-24T20:03:47.722956+0000","last_active":"2023-12-24T20:03:47.723952+0000","last_peered":"2023-12-24T20:03:47.723952+0000","last_clean":"2023-12-24T20:03:47.723952+0000","last_became_active":"2023-12-24T20:03:47.722689+0000","last_became_peered":"2023-12-24T20:03:47.722689+0000","last_unstale":"2023-12-24T20:03:47.723952+0000","last_undegraded":"2023-12-24T20:03:47.723952+0000","last_fullsized":"2023-12-24T20:03:47.723952+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:11:13.085328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.710564+0000","last_change":"2023-12-24T20:03:46.723043+0000","last_active":"2023-12-24T20:03:47.710564+0000","last_peered":"2023-12-24T20:03:47.710564+0000","last_clean":"2023-12-24T20:03:47.710564+0000","last_became_active":"2023-12-24T20:03:46.722825+0000","last_became_peered":"2023-12-24T20:03:46.722825+0000","last_unstale":"2023-12-24T20:03:47.710564+0000","last_undegraded":"2023-12-24T20:03:47.710564+0000","last_fullsized":"2023-12-24T20:03:47.710564+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:24:35.864498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.714534+0000","last_change":"2023-12-24T20:03:47.714460+0000","last_active":"2023-12-24T20:03:47.714534+0000","last_peered":"2023-12-24T20:03:47.714534+0000","last_clean":"2023-12-24T20:03:47.714534+0000","last_became_active":"2023-12-24T20:03:47.714266+0000","last_became_peered":"2023-12-24T20:03:47.714266+0000","last_unstale":"2023-12-24T20:03:47.714534+0000","last_undegraded":"2023-12-24T20:03:47.714534+0000","last_fullsized":"2023-12-24T20:03:47.714534+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:41.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.714377+0000","last_change":"2023-12-24T20:03:46.718464+0000","last_active":"2023-12-24T20:03:47.714377+0000","last_peered":"2023-12-24T20:03:47.714377+0000","last_clean":"2023-12-24T20:03:47.714377+0000","last_became_active":"2023-12-24T20:03:46.718253+0000","last_became_peered":"2023-12-24T20:03:46.718253+0000","last_unstale":"2023-12-24T20:03:47.714377+0000","last_undegraded":"2023-12-24T20:03:47.714377+0000","last_fullsized":"2023-12-24T20:03:47.714377+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:42.654774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730352+0000","last_change":"2023-12-24T20:03:47.727747+0000","last_active":"2023-12-24T20:03:47.730352+0000","last_peered":"2023-12-24T20:03:47.730352+0000","last_clean":"2023-12-24T20:03:47.730352+0000","last_became_active":"2023-12-24T20:03:47.726987+0000","last_became_peered":"2023-12-24T20:03:47.726987+0000","last_unstale":"2023-12-24T20:03:47.730352+0000","last_undegraded":"2023-12-24T20:03:47.730352+0000","last_fullsized":"2023-12-24T20:03:47.730352+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:44:43.660311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.715455+0000","last_change":"2023-12-24T20:03:46.717706+0000","last_active":"2023-12-24T20:03:47.715455+0000","last_peered":"2023-12-24T20:03:47.715455+0000","last_clean":"2023-12-24T20:03:47.715455+0000","last_became_active":"2023-12-24T20:03:46.717470+0000","last_became_peered":"2023-12-24T20:03:46.717470+0000","last_unstale":"2023-12-24T20:03:47.715455+0000","last_undegraded":"2023-12-24T20:03:47.715455+0000","last_fullsized":"2023-12-24T20:03:47.715455+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:19.490408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725750+0000","last_change":"2023-12-24T20:03:47.725680+0000","last_active":"2023-12-24T20:03:47.725750+0000","last_peered":"2023-12-24T20:03:47.725750+0000","last_clean":"2023-12-24T20:03:47.725750+0000","last_became_active":"2023-12-24T20:03:47.725462+0000","last_became_peered":"2023-12-24T20:03:47.725462+0000","last_unstale":"2023-12-24T20:03:47.725750+0000","last_undegraded":"2023-12-24T20:03:47.725750+0000","last_fullsized":"2023-12-24T20:03:47.725750+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:08.919117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.711399+0000","last_change":"2023-12-24T20:03:46.718686+0000","last_active":"2023-12-24T20:03:47.711399+0000","last_peered":"2023-12-24T20:03:47.711399+0000","last_clean":"2023-12-24T20:03:47.711399+0000","last_became_active":"2023-12-24T20:03:46.718460+0000","last_became_peered":"2023-12-24T20:03:46.718460+0000","last_unstale":"2023-12-24T20:03:47.711399+0000","last_undegraded":"2023-12-24T20:03:47.711399+0000","last_fullsized":"2023-12-24T20:03:47.711399+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:11:12.079791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724398+0000","last_change":"2023-12-24T20:03:47.721724+0000","last_active":"2023-12-24T20:03:47.724398+0000","last_peered":"2023-12-24T20:03:47.724398+0000","last_clean":"2023-12-24T20:03:47.724398+0000","last_became_active":"2023-12-24T20:03:47.721496+0000","last_became_peered":"2023-12-24T20:03:47.721496+0000","last_unstale":"2023-12-24T20:03:47.724398+0000","last_undegraded":"2023-12-24T20:03:47.724398+0000","last_fullsized":"2023-12-24T20:03:47.724398+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:47:59.037318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"150'3","reported_seq":13,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.726804+0000","last_change":"2023-12-24T20:03:46.718637+0000","last_active":"2023-12-24T20:03:47.726804+0000","last_peered":"2023-12-24T20:03:47.726804+0000","last_clean":"2023-12-24T20:03:47.726804+0000","last_became_active":"2023-12-24T20:03:46.718263+0000","last_became_peered":"2023-12-24T20:03:46.718263+0000","last_unstale":"2023-12-24T20:03:47.726804+0000","last_undegraded":"2023-12-24T20:03:47.726804+0000","last_fullsized":"2023-12-24T20:03:47.726804+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:44:05.819614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725172+0000","last_change":"2023-12-24T20:03:47.725091+0000","last_active":"2023-12-24T20:03:47.725172+0000","last_peered":"2023-12-24T20:03:47.725172+0000","last_clean":"2023-12-24T20:03:47.725172+0000","last_became_active":"2023-12-24T20:03:47.724776+0000","last_became_peered":"2023-12-24T20:03:47.724776+0000","last_unstale":"2023-12-24T20:03:47.725172+0000","last_undegraded":"2023-12-24T20:03:47.725172+0000","last_fullsized":"2023-12-24T20:03:47.725172+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:46:49.278531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"150'6","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.735077+0000","last_change":"2023-12-24T20:03:46.725307+0000","last_active":"2023-12-24T20:03:47.735077+0000","last_peered":"2023-12-24T20:03:47.735077+0000","last_clean":"2023-12-24T20:03:47.735077+0000","last_became_active":"2023-12-24T20:03:46.725128+0000","last_became_peered":"2023-12-24T20:03:46.725128+0000","last_unstale":"2023-12-24T20:03:47.735077+0000","last_undegraded":"2023-12-24T20:03:47.735077+0000","last_fullsized":"2023-12-24T20:03:47.735077+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:21:27.306334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730639+0000","last_change":"2023-12-24T20:03:47.729151+0000","last_active":"2023-12-24T20:03:47.730639+0000","last_peered":"2023-12-24T20:03:47.730639+0000","last_clean":"2023-12-24T20:03:47.730639+0000","last_became_active":"2023-12-24T20:03:47.727012+0000","last_became_peered":"2023-12-24T20:03:47.727012+0000","last_unstale":"2023-12-24T20:03:47.730639+0000","last_undegraded":"2023-12-24T20:03:47.730639+0000","last_fullsized":"2023-12-24T20:03:47.730639+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:30:45.185366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731498+0000","last_change":"2023-12-24T20:03:46.724850+0000","last_active":"2023-12-24T20:03:47.731498+0000","last_peered":"2023-12-24T20:03:47.731498+0000","last_clean":"2023-12-24T20:03:47.731498+0000","last_became_active":"2023-12-24T20:03:46.724591+0000","last_became_peered":"2023-12-24T20:03:46.724591+0000","last_unstale":"2023-12-24T20:03:47.731498+0000","last_undegraded":"2023-12-24T20:03:47.731498+0000","last_fullsized":"2023-12-24T20:03:47.731498+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:49:45.753536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.729073+0000","last_change":"2023-12-24T20:03:47.728980+0000","last_active":"2023-12-24T20:03:47.729073+0000","last_peered":"2023-12-24T20:03:47.729073+0000","last_clean":"2023-12-24T20:03:47.729073+0000","last_became_active":"2023-12-24T20:03:47.724207+0000","last_became_peered":"2023-12-24T20:03:47.724207+0000","last_unstale":"2023-12-24T20:03:47.729073+0000","last_undegraded":"2023-12-24T20:03:47.729073+0000","last_fullsized":"2023-12-24T20:03:47.729073+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:31:32.890898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.712339+0000","last_change":"2023-12-24T20:03:46.719241+0000","last_active":"2023-12-24T20:03:47.712339+0000","last_peered":"2023-12-24T20:03:47.712339+0000","last_clean":"2023-12-24T20:03:47.712339+0000","last_became_active":"2023-12-24T20:03:46.719009+0000","last_became_peered":"2023-12-24T20:03:46.719009+0000","last_unstale":"2023-12-24T20:03:47.712339+0000","last_undegraded":"2023-12-24T20:03:47.712339+0000","last_fullsized":"2023-12-24T20:03:47.712339+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:46:29.736955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.721567+0000","last_change":"2023-12-24T20:03:47.720206+0000","last_active":"2023-12-24T20:03:47.721567+0000","last_peered":"2023-12-24T20:03:47.721567+0000","last_clean":"2023-12-24T20:03:47.721567+0000","last_became_active":"2023-12-24T20:03:47.719632+0000","last_became_peered":"2023-12-24T20:03:47.719632+0000","last_unstale":"2023-12-24T20:03:47.721567+0000","last_undegraded":"2023-12-24T20:03:47.721567+0000","last_fullsized":"2023-12-24T20:03:47.721567+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:57:32.336949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"150'8","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731387+0000","last_change":"2023-12-24T20:03:46.723544+0000","last_active":"2023-12-24T20:03:47.731387+0000","last_peered":"2023-12-24T20:03:47.731387+0000","last_clean":"2023-12-24T20:03:47.731387+0000","last_became_active":"2023-12-24T20:03:46.722350+0000","last_became_peered":"2023-12-24T20:03:46.722350+0000","last_unstale":"2023-12-24T20:03:47.731387+0000","last_undegraded":"2023-12-24T20:03:47.731387+0000","last_fullsized":"2023-12-24T20:03:47.731387+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:36:56.483040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730054+0000","last_change":"2023-12-24T20:03:47.729433+0000","last_active":"2023-12-24T20:03:47.730054+0000","last_peered":"2023-12-24T20:03:47.730054+0000","last_clean":"2023-12-24T20:03:47.730054+0000","last_became_active":"2023-12-24T20:03:47.729192+0000","last_became_peered":"2023-12-24T20:03:47.729192+0000","last_unstale":"2023-12-24T20:03:47.730054+0000","last_undegraded":"2023-12-24T20:03:47.730054+0000","last_fullsized":"2023-12-24T20:03:47.730054+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:50:28.358566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.726060+0000","last_change":"2023-12-24T20:03:46.723958+0000","last_active":"2023-12-24T20:03:47.726060+0000","last_peered":"2023-12-24T20:03:47.726060+0000","last_clean":"2023-12-24T20:03:47.726060+0000","last_became_active":"2023-12-24T20:03:46.723705+0000","last_became_peered":"2023-12-24T20:03:46.723705+0000","last_unstale":"2023-12-24T20:03:47.726060+0000","last_undegraded":"2023-12-24T20:03:47.726060+0000","last_fullsized":"2023-12-24T20:03:47.726060+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:30:44.179829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.724416+0000","last_change":"2023-12-24T20:03:47.724102+0000","last_active":"2023-12-24T20:03:47.724416+0000","last_peered":"2023-12-24T20:03:47.724416+0000","last_clean":"2023-12-24T20:03:47.724416+0000","last_became_active":"2023-12-24T20:03:47.723881+0000","last_became_peered":"2023-12-24T20:03:47.723881+0000","last_unstale":"2023-12-24T20:03:47.724416+0000","last_undegraded":"2023-12-24T20:03:47.724416+0000","last_fullsized":"2023-12-24T20:03:47.724416+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:57:37.851759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.726031+0000","last_change":"2023-12-24T20:03:46.717530+0000","last_active":"2023-12-24T20:03:47.726031+0000","last_peered":"2023-12-24T20:03:47.726031+0000","last_clean":"2023-12-24T20:03:47.726031+0000","last_became_active":"2023-12-24T20:03:46.717131+0000","last_became_peered":"2023-12-24T20:03:46.717131+0000","last_unstale":"2023-12-24T20:03:47.726031+0000","last_undegraded":"2023-12-24T20:03:47.726031+0000","last_fullsized":"2023-12-24T20:03:47.726031+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:37.009534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731024+0000","last_change":"2023-12-24T20:03:47.730961+0000","last_active":"2023-12-24T20:03:47.731024+0000","last_peered":"2023-12-24T20:03:47.731024+0000","last_clean":"2023-12-24T20:03:47.731024+0000","last_became_active":"2023-12-24T20:03:47.730718+0000","last_became_peered":"2023-12-24T20:03:47.730718+0000","last_unstale":"2023-12-24T20:03:47.731024+0000","last_undegraded":"2023-12-24T20:03:47.731024+0000","last_fullsized":"2023-12-24T20:03:47.731024+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:29:28.971391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725941+0000","last_change":"2023-12-24T20:03:46.721480+0000","last_active":"2023-12-24T20:03:47.725941+0000","last_peered":"2023-12-24T20:03:47.725941+0000","last_clean":"2023-12-24T20:03:47.725941+0000","last_became_active":"2023-12-24T20:03:46.721210+0000","last_became_peered":"2023-12-24T20:03:46.721210+0000","last_unstale":"2023-12-24T20:03:47.725941+0000","last_undegraded":"2023-12-24T20:03:47.725941+0000","last_fullsized":"2023-12-24T20:03:47.725941+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:30:51.956465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.716357+0000","last_change":"2023-12-24T20:03:47.715844+0000","last_active":"2023-12-24T20:03:47.716357+0000","last_peered":"2023-12-24T20:03:47.716357+0000","last_clean":"2023-12-24T20:03:47.716357+0000","last_became_active":"2023-12-24T20:03:47.715625+0000","last_became_peered":"2023-12-24T20:03:47.715625+0000","last_unstale":"2023-12-24T20:03:47.716357+0000","last_undegraded":"2023-12-24T20:03:47.716357+0000","last_fullsized":"2023-12-24T20:03:47.716357+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:07:52.114499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.715011+0000","last_change":"2023-12-24T20:03:46.719786+0000","last_active":"2023-12-24T20:03:47.715011+0000","last_peered":"2023-12-24T20:03:47.715011+0000","last_clean":"2023-12-24T20:03:47.715011+0000","last_became_active":"2023-12-24T20:03:46.719274+0000","last_became_peered":"2023-12-24T20:03:46.719274+0000","last_unstale":"2023-12-24T20:03:47.715011+0000","last_undegraded":"2023-12-24T20:03:47.715011+0000","last_fullsized":"2023-12-24T20:03:47.715011+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:59:53.575253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730438+0000","last_change":"2023-12-24T20:03:47.728113+0000","last_active":"2023-12-24T20:03:47.730438+0000","last_peered":"2023-12-24T20:03:47.730438+0000","last_clean":"2023-12-24T20:03:47.730438+0000","last_became_active":"2023-12-24T20:03:47.726948+0000","last_became_peered":"2023-12-24T20:03:47.726948+0000","last_unstale":"2023-12-24T20:03:47.730438+0000","last_undegraded":"2023-12-24T20:03:47.730438+0000","last_fullsized":"2023-12-24T20:03:47.730438+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:59:54.580790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731602+0000","last_change":"2023-12-24T20:03:46.718498+0000","last_active":"2023-12-24T20:03:47.731602+0000","last_peered":"2023-12-24T20:03:47.731602+0000","last_clean":"2023-12-24T20:03:47.731602+0000","last_became_active":"2023-12-24T20:03:46.717854+0000","last_became_peered":"2023-12-24T20:03:46.717854+0000","last_unstale":"2023-12-24T20:03:47.731602+0000","last_undegraded":"2023-12-24T20:03:47.731602+0000","last_fullsized":"2023-12-24T20:03:47.731602+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:36:41.163203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.725501+0000","last_change":"2023-12-24T20:03:47.725357+0000","last_active":"2023-12-24T20:03:47.725501+0000","last_peered":"2023-12-24T20:03:47.725501+0000","last_clean":"2023-12-24T20:03:47.725501+0000","last_became_active":"2023-12-24T20:03:47.725070+0000","last_became_peered":"2023-12-24T20:03:47.725070+0000","last_unstale":"2023-12-24T20:03:47.725501+0000","last_undegraded":"2023-12-24T20:03:47.725501+0000","last_fullsized":"2023-12-24T20:03:47.725501+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:46:19.729523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.710614+0000","last_change":"2023-12-24T20:03:46.718678+0000","last_active":"2023-12-24T20:03:47.710614+0000","last_peered":"2023-12-24T20:03:47.710614+0000","last_clean":"2023-12-24T20:03:47.710614+0000","last_became_active":"2023-12-24T20:03:46.718445+0000","last_became_peered":"2023-12-24T20:03:46.718445+0000","last_unstale":"2023-12-24T20:03:47.710614+0000","last_undegraded":"2023-12-24T20:03:47.710614+0000","last_fullsized":"2023-12-24T20:03:47.710614+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:30:13.877305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.723225+0000","last_change":"2023-12-24T20:03:47.723160+0000","last_active":"2023-12-24T20:03:47.723225+0000","last_peered":"2023-12-24T20:03:47.723225+0000","last_clean":"2023-12-24T20:03:47.723225+0000","last_became_active":"2023-12-24T20:03:47.722939+0000","last_became_peered":"2023-12-24T20:03:47.722939+0000","last_unstale":"2023-12-24T20:03:47.723225+0000","last_undegraded":"2023-12-24T20:03:47.723225+0000","last_fullsized":"2023-12-24T20:03:47.723225+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:17:41.594253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.710380+0000","last_change":"2023-12-24T20:03:46.718942+0000","last_active":"2023-12-24T20:03:47.710380+0000","last_peered":"2023-12-24T20:03:47.710380+0000","last_clean":"2023-12-24T20:03:47.710380+0000","last_became_active":"2023-12-24T20:03:46.718487+0000","last_became_peered":"2023-12-24T20:03:46.718487+0000","last_unstale":"2023-12-24T20:03:47.710380+0000","last_undegraded":"2023-12-24T20:03:47.710380+0000","last_fullsized":"2023-12-24T20:03:47.710380+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:22:16.765720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.729657+0000","last_change":"2023-12-24T20:03:47.729586+0000","last_active":"2023-12-24T20:03:47.729657+0000","last_peered":"2023-12-24T20:03:47.729657+0000","last_clean":"2023-12-24T20:03:47.729657+0000","last_became_active":"2023-12-24T20:03:47.729368+0000","last_became_peered":"2023-12-24T20:03:47.729368+0000","last_unstale":"2023-12-24T20:03:47.729657+0000","last_undegraded":"2023-12-24T20:03:47.729657+0000","last_fullsized":"2023-12-24T20:03:47.729657+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:50:21.809386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.720684+0000","last_change":"2023-12-24T20:03:46.715796+0000","last_active":"2023-12-24T20:03:47.720684+0000","last_peered":"2023-12-24T20:03:47.720684+0000","last_clean":"2023-12-24T20:03:47.720684+0000","last_became_active":"2023-12-24T20:03:46.715555+0000","last_became_peered":"2023-12-24T20:03:46.715555+0000","last_unstale":"2023-12-24T20:03:47.720684+0000","last_undegraded":"2023-12-24T20:03:47.720684+0000","last_fullsized":"2023-12-24T20:03:47.720684+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:44:24.674041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.718875+0000","last_change":"2023-12-24T20:03:47.718738+0000","last_active":"2023-12-24T20:03:47.718875+0000","last_peered":"2023-12-24T20:03:47.718875+0000","last_clean":"2023-12-24T20:03:47.718875+0000","last_became_active":"2023-12-24T20:03:47.718485+0000","last_became_peered":"2023-12-24T20:03:47.718485+0000","last_unstale":"2023-12-24T20:03:47.718875+0000","last_undegraded":"2023-12-24T20:03:47.718875+0000","last_fullsized":"2023-12-24T20:03:47.718875+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:22:15.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730691+0000","last_change":"2023-12-24T20:03:46.718173+0000","last_active":"2023-12-24T20:03:47.730691+0000","last_peered":"2023-12-24T20:03:47.730691+0000","last_clean":"2023-12-24T20:03:47.730691+0000","last_became_active":"2023-12-24T20:03:46.717929+0000","last_became_peered":"2023-12-24T20:03:46.717929+0000","last_unstale":"2023-12-24T20:03:47.730691+0000","last_undegraded":"2023-12-24T20:03:47.730691+0000","last_fullsized":"2023-12-24T20:03:47.730691+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:44:30.276103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.730622+0000","last_change":"2023-12-24T20:03:47.729028+0000","last_active":"2023-12-24T20:03:47.730622+0000","last_peered":"2023-12-24T20:03:47.730622+0000","last_clean":"2023-12-24T20:03:47.730622+0000","last_became_active":"2023-12-24T20:03:47.728795+0000","last_became_peered":"2023-12-24T20:03:47.728795+0000","last_unstale":"2023-12-24T20:03:47.730622+0000","last_undegraded":"2023-12-24T20:03:47.730622+0000","last_fullsized":"2023-12-24T20:03:47.730622+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:20.495945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.717943+0000","last_change":"2023-12-24T20:03:46.718564+0000","last_active":"2023-12-24T20:03:47.717943+0000","last_peered":"2023-12-24T20:03:47.717943+0000","last_clean":"2023-12-24T20:03:47.717943+0000","last_became_active":"2023-12-24T20:03:46.718313+0000","last_became_peered":"2023-12-24T20:03:46.718313+0000","last_unstale":"2023-12-24T20:03:47.717943+0000","last_undegraded":"2023-12-24T20:03:47.717943+0000","last_fullsized":"2023-12-24T20:03:47.717943+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:34:44.077521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.729808+0000","last_change":"2023-12-24T20:03:47.729746+0000","last_active":"2023-12-24T20:03:47.729808+0000","last_peered":"2023-12-24T20:03:47.729808+0000","last_clean":"2023-12-24T20:03:47.729808+0000","last_became_active":"2023-12-24T20:03:47.724555+0000","last_became_peered":"2023-12-24T20:03:47.724555+0000","last_unstale":"2023-12-24T20:03:47.729808+0000","last_undegraded":"2023-12-24T20:03:47.729808+0000","last_fullsized":"2023-12-24T20:03:47.729808+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:59:44.621962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.712396+0000","last_change":"2023-12-24T20:03:46.717302+0000","last_active":"2023-12-24T20:03:47.712396+0000","last_peered":"2023-12-24T20:03:47.712396+0000","last_clean":"2023-12-24T20:03:47.712396+0000","last_became_active":"2023-12-24T20:03:46.717072+0000","last_became_peered":"2023-12-24T20:03:46.717072+0000","last_unstale":"2023-12-24T20:03:47.712396+0000","last_undegraded":"2023-12-24T20:03:47.712396+0000","last_fullsized":"2023-12-24T20:03:47.712396+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:36:46.216020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731843+0000","last_change":"2023-12-24T20:03:47.731791+0000","last_active":"2023-12-24T20:03:47.731843+0000","last_peered":"2023-12-24T20:03:47.731843+0000","last_clean":"2023-12-24T20:03:47.731843+0000","last_became_active":"2023-12-24T20:03:47.731580+0000","last_became_peered":"2023-12-24T20:03:47.731580+0000","last_unstale":"2023-12-24T20:03:47.731843+0000","last_undegraded":"2023-12-24T20:03:47.731843+0000","last_fullsized":"2023-12-24T20:03:47.731843+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:20:12.848225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.717540+0000","last_change":"2023-12-24T20:03:46.713311+0000","last_active":"2023-12-24T20:03:47.717540+0000","last_peered":"2023-12-24T20:03:47.717540+0000","last_clean":"2023-12-24T20:03:47.717540+0000","last_became_active":"2023-12-24T20:03:46.713147+0000","last_became_peered":"2023-12-24T20:03:46.713147+0000","last_unstale":"2023-12-24T20:03:47.717540+0000","last_undegraded":"2023-12-24T20:03:47.717540+0000","last_fullsized":"2023-12-24T20:03:47.717540+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:42:14.509222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.727036+0000","last_change":"2023-12-24T20:03:47.726931+0000","last_active":"2023-12-24T20:03:47.727036+0000","last_peered":"2023-12-24T20:03:47.727036+0000","last_clean":"2023-12-24T20:03:47.727036+0000","last_became_active":"2023-12-24T20:03:47.726701+0000","last_became_peered":"2023-12-24T20:03:47.726701+0000","last_unstale":"2023-12-24T20:03:47.727036+0000","last_undegraded":"2023-12-24T20:03:47.727036+0000","last_fullsized":"2023-12-24T20:03:47.727036+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:22:15.012300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.713249+0000","last_change":"2023-12-24T20:03:46.719997+0000","last_active":"2023-12-24T20:03:47.713249+0000","last_peered":"2023-12-24T20:03:47.713249+0000","last_clean":"2023-12-24T20:03:47.713249+0000","last_became_active":"2023-12-24T20:03:46.719764+0000","last_became_peered":"2023-12-24T20:03:46.719764+0000","last_unstale":"2023-12-24T20:03:47.713249+0000","last_undegraded":"2023-12-24T20:03:47.713249+0000","last_fullsized":"2023-12-24T20:03:47.713249+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:04.130963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.732665+0000","last_change":"2023-12-24T20:03:47.732582+0000","last_active":"2023-12-24T20:03:47.732665+0000","last_peered":"2023-12-24T20:03:47.732665+0000","last_clean":"2023-12-24T20:03:47.732665+0000","last_became_active":"2023-12-24T20:03:47.732336+0000","last_became_peered":"2023-12-24T20:03:47.732336+0000","last_unstale":"2023-12-24T20:03:47.732665+0000","last_undegraded":"2023-12-24T20:03:47.732665+0000","last_fullsized":"2023-12-24T20:03:47.732665+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:41.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.717606+0000","last_change":"2023-12-24T20:03:46.723082+0000","last_active":"2023-12-24T20:03:47.717606+0000","last_peered":"2023-12-24T20:03:47.717606+0000","last_clean":"2023-12-24T20:03:47.717606+0000","last_became_active":"2023-12-24T20:03:46.722467+0000","last_became_peered":"2023-12-24T20:03:46.722467+0000","last_unstale":"2023-12-24T20:03:47.717606+0000","last_undegraded":"2023-12-24T20:03:47.717606+0000","last_fullsized":"2023-12-24T20:03:47.717606+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:53:47.119055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.722695+0000","last_change":"2023-12-24T20:03:47.722631+0000","last_active":"2023-12-24T20:03:47.722695+0000","last_peered":"2023-12-24T20:03:47.722695+0000","last_clean":"2023-12-24T20:03:47.722695+0000","last_became_active":"2023-12-24T20:03:47.722229+0000","last_became_peered":"2023-12-24T20:03:47.722229+0000","last_unstale":"2023-12-24T20:03:47.722695+0000","last_undegraded":"2023-12-24T20:03:47.722695+0000","last_fullsized":"2023-12-24T20:03:47.722695+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:28:09.941604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.710971+0000","last_change":"2023-12-24T20:03:46.719764+0000","last_active":"2023-12-24T20:03:47.710971+0000","last_peered":"2023-12-24T20:03:47.710971+0000","last_clean":"2023-12-24T20:03:47.710971+0000","last_became_active":"2023-12-24T20:03:46.719323+0000","last_became_peered":"2023-12-24T20:03:46.719323+0000","last_unstale":"2023-12-24T20:03:47.710971+0000","last_undegraded":"2023-12-24T20:03:47.710971+0000","last_fullsized":"2023-12-24T20:03:47.710971+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:45:40.804260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.722092+0000","last_change":"2023-12-24T20:03:47.721978+0000","last_active":"2023-12-24T20:03:47.722092+0000","last_peered":"2023-12-24T20:03:47.722092+0000","last_clean":"2023-12-24T20:03:47.722092+0000","last_became_active":"2023-12-24T20:03:47.721746+0000","last_became_peered":"2023-12-24T20:03:47.721746+0000","last_unstale":"2023-12-24T20:03:47.722092+0000","last_undegraded":"2023-12-24T20:03:47.722092+0000","last_fullsized":"2023-12-24T20:03:47.722092+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:53:44.667229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.717086+0000","last_change":"2023-12-24T20:03:46.718122+0000","last_active":"2023-12-24T20:03:47.717086+0000","last_peered":"2023-12-24T20:03:47.717086+0000","last_clean":"2023-12-24T20:03:47.717086+0000","last_became_active":"2023-12-24T20:03:46.717276+0000","last_became_peered":"2023-12-24T20:03:46.717276+0000","last_unstale":"2023-12-24T20:03:47.717086+0000","last_undegraded":"2023-12-24T20:03:47.717086+0000","last_fullsized":"2023-12-24T20:03:47.717086+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:11:22.193501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.734328+0000","last_change":"2023-12-24T20:03:47.734260+0000","last_active":"2023-12-24T20:03:47.734328+0000","last_peered":"2023-12-24T20:03:47.734328+0000","last_clean":"2023-12-24T20:03:47.734328+0000","last_became_active":"2023-12-24T20:03:47.733881+0000","last_became_peered":"2023-12-24T20:03:47.733881+0000","last_unstale":"2023-12-24T20:03:47.734328+0000","last_undegraded":"2023-12-24T20:03:47.734328+0000","last_fullsized":"2023-12-24T20:03:47.734328+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:46.701825+0000","last_clean_scrub_stamp":"2023-12-24T20:03:46.701825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:26:45.724065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.731081+0000","last_change":"2023-12-24T20:03:46.718848+0000","last_active":"2023-12-24T20:03:47.731081+0000","last_peered":"2023-12-24T20:03:47.731081+0000","last_clean":"2023-12-24T20:03:47.731081+0000","last_became_active":"2023-12-24T20:03:46.718604+0000","last_became_peered":"2023-12-24T20:03:46.718604+0000","last_unstale":"2023-12-24T20:03:47.731081+0000","last_undegraded":"2023-12-24T20:03:47.731081+0000","last_fullsized":"2023-12-24T20:03:47.731081+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:03:45.696288+0000","last_clean_scrub_stamp":"2023-12-24T20:03:45.696288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:35:10.478911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-12-24T20:03:47.715999+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:03:47.715999+0000","last_peered":"2023-12-24T20:03:47.715999+0000","last_clean":"2023-12-24T20:03:47.715999+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:03:47.715999+0000","last_undegraded":"2023-12-24T20:03:47.715999+0000","last_fullsized":"2023-12-24T20:03:47.715999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1397,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193914,"statfs":{"total":200000000,"available":198568761,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.55600000000000005},"min":{"1min":0.443,"5min":0.307,"15min":0.307},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.505},"min":{"1min":0.35899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70799999999999996,"5min":0.754,"15min":0.754},"last":0.60599999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.47099999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.54200000000000004},"min":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76800000000000002,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66200000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.54200000000000004},"min":{"1min":0.439,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59599999999999997,"15min":0.60199999999999998},"min":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76900000000000002,"5min":0.84699999999999998,"15min":0.86899999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82999999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.65000000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.49399999999999999,"15min":0.52600000000000002},"min":{"1min":0.311,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.67200000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.77300000000000002,"5min":0.77600000000000002,"15min":0.95699999999999996},"last":0.443}]},{"osd":5,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71399999999999997,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.56200000000000006},"min":{"1min":0.37,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72599999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42899999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57199999999999995,"15min":0.59199999999999997},"min":{"1min":0.38300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.622},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76700000000000002,"5min":0.871,"15min":0.873},"last":0.56399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":820,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194491,"statfs":{"total":200000000,"available":199159739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55300000000000005,"15min":0.51800000000000002},"min":{"1min":0.40699999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65000000000000002,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65800000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73599999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56599999999999995,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.71499999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68300000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.50900000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.38,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66400000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33200000000000002},"max":{"1min":0.64700000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.67800000000000005,"5min":1.077,"15min":1.077},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.57699999999999996},"min":{"1min":0.42899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":1.048,"15min":1.048},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.46999999999999997},"min":{"1min":0.307,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70599999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.82899999999999996},"last":0.69399999999999995}]},{"osd":5,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54600000000000004,"15min":0.54000000000000004},"min":{"1min":0.38400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79300000000000004,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.72699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63}]},{"osd":7,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.754,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59199999999999997,"15min":0.60999999999999999},"min":{"1min":0.41999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79400000000000004,"5min":0.83199999999999996,"15min":0.88500000000000001},"last":0.75700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194493,"statfs":{"total":200000000,"available":199161275,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34200000000000003,"15min":0.34599999999999997},"min":{"1min":0.22,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.47199999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.38},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.372,"15min":0.36199999999999999},"min":{"1min":0.27700000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.72699999999999998},"last":0.32200000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"min":{"1min":0.28000000000000003,"5min":0.216,"15min":0.216},"max":{"1min":0.56000000000000005,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.26900000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.54600000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.29899999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.504,"5min":0.626,"15min":0.626},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40600000000000003,"15min":0.39600000000000002},"min":{"1min":0.28899999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.42099999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.59299999999999997},"min":{"1min":0.48299999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.443},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53200000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.628,"15min":0.622},"min":{"1min":0.45900000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85099999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.77100000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51900000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.42599999999999999},"max":{"1min":0.872,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.61499999999999999},"min":{"1min":0.54500000000000004,"5min":0.41999999999999998,"15min":0.39500000000000002},"max":{"1min":0.79500000000000004,"5min":0.878,"15min":0.878},"last":0.48699999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.60799999999999998},"min":{"1min":0.501,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.75900000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.433},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66300000000000003,"15min":0.64300000000000002},"min":{"1min":0.47699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82799999999999996,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.5}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1395,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193916,"statfs":{"total":200000000,"available":198570907,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.41599999999999998},"min":{"1min":0.23999999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.51800000000000002,"5min":0.56100000000000005,"15min":2.6259999999999999},"last":0.217},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.24199999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.97999999999999998},"last":0.28100000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35499999999999998,"15min":0.36499999999999999},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.92700000000000005},"last":0.252},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38800000000000001,"15min":0.40000000000000002},"min":{"1min":0.27900000000000003,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.503,"5min":0.56899999999999995,"15min":0.93999999999999995},"last":0.35099999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41299999999999998,"15min":0.45900000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26200000000000001},"max":{"1min":0.55200000000000005,"5min":0.78900000000000003,"15min":2.573},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.28899999999999998},"max":{"1min":0.57799999999999996,"5min":0.628,"15min":0.67600000000000005},"last":0.313}]},{"osd":4,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58699999999999997,"15min":0.59899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.5},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.67300000000000004},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.754,"5min":0.97499999999999998,"15min":2.7149999999999999},"last":0.42499999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65100000000000002,"15min":0.70799999999999996},"min":{"1min":0.48399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.85499999999999998,"5min":1.4810000000000001,"15min":2.6859999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.626,"15min":0.624},"min":{"1min":0.46400000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79700000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54100000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.72999999999999998,"5min":1.655,"15min":1.655},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64000000000000001,"15min":0.64800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81200000000000006,"5min":1.036,"15min":1.0489999999999999},"last":0.40400000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:03:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88600000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.64000000000000001,"15min":0.71799999999999997},"min":{"1min":0.48699999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.89800000000000002,"5min":1.556,"15min":2.6579999999999999},"last":0.51300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194492,"statfs":{"total":200000000,"available":199160687,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.35799999999999998,"15min":0.37},"min":{"1min":0.22,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.504,"5min":0.67700000000000005,"15min":0.78900000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.374,"15min":0.374},"min":{"1min":0.23599999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.53900000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.35599999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.36899999999999999,"15min":0.36299999999999999},"min":{"1min":0.26500000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45500000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.317},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.40100000000000002,"15min":0.40300000000000002},"min":{"1min":0.29199999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.53000000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.38400000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52600000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.37},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.29499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.312}]},{"osd":4,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61199999999999999,"15min":0.627},"min":{"1min":0.44700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83799999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.47299999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.77900000000000003,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66800000000000004,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89400000000000002,"5min":3.577,"15min":3.577},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.52300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91200000000000003,"5min":7.0220000000000002,"15min":7.0220000000000002},"last":0.50800000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86499999999999999,"5min":1.298,"15min":1.298},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67600000000000005,"15min":0.64100000000000001},"min":{"1min":0.51000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94299999999999995,"5min":3.637,"15min":3.637},"last":0.69799999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.70299999999999996,"15min":0.66200000000000003},"min":{"1min":0.46100000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92000000000000004,"5min":7.0599999999999996,"15min":7.0599999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67300000000000004,"15min":0.68100000000000005},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.93000000000000005,"5min":1.331,"15min":1.331},"last":0.56000000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194493,"statfs":{"total":200000000,"available":199161115,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34599999999999997,"15min":0.32800000000000001},"min":{"1min":0.22600000000000001,"5min":0.20100000000000001,"15min":0.182},"max":{"1min":0.47899999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.255},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.36499999999999999,"15min":0.35399999999999998},"min":{"1min":0.27500000000000002,"5min":0.23599999999999999,"15min":0.21099999999999999},"max":{"1min":0.45400000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.28799999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36499999999999999,"15min":0.34699999999999998},"min":{"1min":0.248,"5min":0.223,"15min":0.223},"max":{"1min":0.46700000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.38600000000000001},"min":{"1min":0.28299999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52500000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.307}]},{"osd":2,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.32300000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.55200000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.433,"15min":0.42599999999999999},"min":{"1min":0.29899999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33700000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61799999999999999,"15min":0.60299999999999998},"min":{"1min":0.379,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.875,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.626,"15min":0.60399999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.73599999999999999,"5min":1.337,"15min":1.337},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.63500000000000001,"15min":0.61199999999999999},"min":{"1min":0.40799999999999997,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.80800000000000005,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.44900000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89900000000000002,"5min":0.92800000000000005,"15min":0.97799999999999998},"last":0.58199999999999996}]},{"osd":6,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63800000000000001,"15min":0.62},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.875,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.66000000000000003,"15min":0.624},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93300000000000005,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:03:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.65400000000000003,"15min":0.64000000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81399999999999995,"5min":1.006,"15min":1.006},"last":0.64100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194493,"statfs":{"total":200000000,"available":199161205,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56000000000000005,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68899999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68600000000000005}]},{"osd":1,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.70799999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":4.883},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54000000000000004,"15min":0.58699999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":1.544},"last":0.78200000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.39600000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65800000000000003,"5min":0.78400000000000003,"15min":0.88},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.58899999999999997},"min":{"1min":0.34999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.41699999999999998,"5min":0.33700000000000002,"15min":0.33300000000000002},"max":{"1min":0.66000000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56399999999999995,"15min":0.85999999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69299999999999995,"5min":0.77300000000000002,"15min":8.8200000000000003},"last":0.75700000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.46600000000000003,"15min":0.51800000000000002},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.61399999999999999,"5min":0.79600000000000004,"15min":1.4419999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51700000000000002,"15min":0.63700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":3.8279999999999998},"last":0.48099999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57699999999999996,"15min":0.63100000000000001},"min":{"1min":0.40999999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81200000000000006,"5min":0.88700000000000001,"15min":1.6439999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":1.0249999999999999},"min":{"1min":0.42199999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69399999999999995,"5min":0.86499999999999999,"15min":14.039999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.31},"max":{"1min":0.63700000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.58799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194493,"statfs":{"total":200000000,"available":199161163,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.51500000000000001},"min":{"1min":0.40799999999999997,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.55400000000000005},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.622}]},{"osd":1,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.80200000000000005,"5min":1.847,"15min":1.847},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60399999999999998,"15min":0.56399999999999995},"min":{"1min":0.45300000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56899999999999995,"15min":0.52500000000000002},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.74199999999999999,"5min":3.8559999999999999,"15min":3.8559999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.54900000000000004},"min":{"1min":0.46999999999999997,"5min":0.37,"15min":0.37},"max":{"1min":0.77800000000000002,"5min":1.97,"15min":1.97},"last":0.58499999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.622,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.40000000000000002,"15min":0.38},"max":{"1min":0.82599999999999996,"5min":3.2850000000000001,"15min":3.2850000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.56799999999999995},"min":{"1min":0.45000000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.83699999999999997},"last":0.60499999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.497,"15min":0.49399999999999999},"min":{"1min":0.36299999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.75700000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.77000000000000002,"5min":4.5330000000000004,"15min":4.5330000000000004},"last":0.70499999999999996}]},{"osd":6,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.5,"15min":0.47999999999999998},"min":{"1min":0.40999999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70799999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.34799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78600000000000003,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Sun Dec 24 20:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59099999999999997,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.96899999999999997,"5min":3.766,"15min":3.766},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57299999999999995,"15min":0.55200000000000005},"min":{"1min":0.36199999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.64900000000000002}]}]}],"pool_statfs":[]}} 2023-12-24T20:03:52.246 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T20:03:52.246 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T20:03:52.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.414+0000 7ff47567e700 1 Processor -- start 2023-12-24T20:03:52.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.414+0000 7ff47567e700 1 -- start start 2023-12-24T20:03:52.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.414+0000 7ff47567e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff47006af80 0x7ff4700c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff47567e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4700c38c0 con 0x7ff470156b60 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff47567e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47006aaf0 con 0x7ff4700c3460 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff47567e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff470069c00 con 0x7ff47006af80 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff46e7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff47006af80 0x7ff4700c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff46effd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff470156b60 0x7ff470067f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40294/0 (socket says 172.21.15.61:40294) 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff46effd700 1 -- 172.21.15.61:0/1621476586 learned_addr learned my addr 172.21.15.61:0/1621476586 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff46e7fc700 1 -- 172.21.15.61:0/1621476586 >> v1:172.21.15.133:6789/0 conn(0x7ff4700c3460 legacy=0x7ff4700c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff46e7fc700 1 -- 172.21.15.61:0/1621476586 >> v1:172.21.15.61:6789/0 conn(0x7ff470156b60 legacy=0x7ff470067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff46e7fc700 1 -- 172.21.15.61:0/1621476586 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470069ee0 con 0x7ff47006af80 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff46e7fc700 1 --2- 172.21.15.61:0/1621476586 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff47006af80 0x7ff4700c2f20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff4640098e0 tx=0x7ff4640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62931253c112d62 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff46dffb700 1 -- 172.21.15.61:0/1621476586 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464009e80 con 0x7ff47006af80 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff46dffb700 1 -- 172.21.15.61:0/1621476586 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400b820 con 0x7ff47006af80 2023-12-24T20:03:52.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.415+0000 7ff46dffb700 1 -- 172.21.15.61:0/1621476586 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400bba0 con 0x7ff47006af80 2023-12-24T20:03:52.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.416+0000 7ff47567e700 1 -- 172.21.15.61:0/1621476586 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff47006af80 msgr2=0x7ff4700c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.416+0000 7ff47567e700 1 --2- 172.21.15.61:0/1621476586 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff47006af80 0x7ff4700c2f20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff4640098e0 tx=0x7ff4640091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.416+0000 7ff47567e700 1 -- 172.21.15.61:0/1621476586 shutdown_connections 2023-12-24T20:03:52.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.416+0000 7ff47567e700 1 --2- 172.21.15.61:0/1621476586 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff47006af80 0x7ff4700c2f20 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.416+0000 7ff47567e700 1 -- 172.21.15.61:0/1621476586 >> 172.21.15.61:0/1621476586 conn(0x7ff4700ce420 msgr2=0x7ff4700ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:52.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.416+0000 7ff47567e700 1 -- 172.21.15.61:0/1621476586 shutdown_connections 2023-12-24T20:03:52.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.416+0000 7ff47567e700 1 -- 172.21.15.61:0/1621476586 wait complete. 2023-12-24T20:03:52.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.417+0000 7ff47567e700 1 Processor -- start 2023-12-24T20:03:52.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.417+0000 7ff47567e700 1 -- start start 2023-12-24T20:03:52.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff47567e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47006af80 0x7ff470166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff47567e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff4700c3460 0x7ff4701596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff47567e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff470156b60 0x7ff4700ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff47567e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700b0b40 con 0x7ff4700c3460 2023-12-24T20:03:52.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff47567e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff470166a20 con 0x7ff47006af80 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff47567e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47016a740 con 0x7ff470156b60 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46e7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff4700c3460 0x7ff4701596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46e7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff4700c3460 0x7ff4701596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52162/0 (socket says 172.21.15.61:52162) 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46e7fc700 1 -- 172.21.15.61:0/2547347570 learned_addr learned my addr 172.21.15.61:0/2547347570 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46effd700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47006af80 0x7ff470166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46f7fe700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff470156b60 0x7ff4700ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46e7fc700 1 -- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff470156b60 msgr2=0x7ff4700ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46e7fc700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff470156b60 0x7ff4700ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46e7fc700 1 -- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47006af80 msgr2=0x7ff470166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46e7fc700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47006af80 0x7ff470166eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46e7fc700 1 -- 172.21.15.61:0/2547347570 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464009420 con 0x7ff4700c3460 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.418+0000 7ff46effd700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47006af80 0x7ff470166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.419+0000 7ff46e7fc700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff4700c3460 0x7ff4701596b0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff47006d300 tx=0x7ff464016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:52.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.419+0000 7ff456ffd700 1 -- 172.21.15.61:0/2547347570 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400bae0 con 0x7ff4700c3460 2023-12-24T20:03:52.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.419+0000 7ff456ffd700 1 -- 172.21.15.61:0/2547347570 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464020070 con 0x7ff4700c3460 2023-12-24T20:03:52.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.419+0000 7ff47567e700 1 -- 172.21.15.61:0/2547347570 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47016a460 con 0x7ff4700c3460 2023-12-24T20:03:52.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.419+0000 7ff456ffd700 1 -- 172.21.15.61:0/2547347570 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46401b6a0 con 0x7ff4700c3460 2023-12-24T20:03:52.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.419+0000 7ff47567e700 1 -- 172.21.15.61:0/2547347570 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4701666b0 con 0x7ff4700c3460 2023-12-24T20:03:52.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.420+0000 7ff47567e700 1 -- 172.21.15.61:0/2547347570 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff470166bd0 con 0x7ff4700c3460 2023-12-24T20:03:52.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.420+0000 7ff456ffd700 1 -- 172.21.15.61:0/2547347570 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff464022030 con 0x7ff4700c3460 2023-12-24T20:03:52.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.421+0000 7ff456ffd700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff45c066f30 0x7ff45c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.421+0000 7ff456ffd700 1 -- 172.21.15.61:0/2547347570 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4640864e0 con 0x7ff4700c3460 2023-12-24T20:03:52.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.421+0000 7ff46effd700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff45c066f30 0x7ff45c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.421+0000 7ff46effd700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff45c066f30 0x7ff45c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff4600018c0 tx=0x7ff460009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:52.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.425+0000 7ff456ffd700 1 -- 172.21.15.61:0/2547347570 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff470166bd0 con 0x7ff4700c3460 2023-12-24T20:03:52.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.696+0000 7ff47567e700 1 -- 172.21.15.61:0/2547347570 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff470166bd0 con 0x7ff4700c3460 2023-12-24T20:03:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.700+0000 7ff456ffd700 1 -- 172.21.15.61:0/2547347570 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff470166bd0 con 0x7ff4700c3460 2023-12-24T20:03:52.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 -- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff45c066f30 msgr2=0x7ff45c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff45c066f30 0x7ff45c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff4600018c0 tx=0x7ff460009040 comp rx=0 tx=0).stop 2023-12-24T20:03:52.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 -- 172.21.15.61:0/2547347570 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff4700c3460 msgr2=0x7ff4701596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff4700c3460 0x7ff4701596b0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7ff47006d300 tx=0x7ff464016000 comp rx=0 tx=0).stop 2023-12-24T20:03:52.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 -- 172.21.15.61:0/2547347570 shutdown_connections 2023-12-24T20:03:52.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff470156b60 0x7ff4700ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff45c066f30 0x7ff45c0693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff47006af80 0x7ff470166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 --2- 172.21.15.61:0/2547347570 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff4700c3460 0x7ff4701596b0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 -- 172.21.15.61:0/2547347570 >> 172.21.15.61:0/2547347570 conn(0x7ff4700ce420 msgr2=0x7ff470151680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:52.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 -- 172.21.15.61:0/2547347570 shutdown_connections 2023-12-24T20:03:52.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.702+0000 7ff47567e700 1 -- 172.21.15.61:0/2547347570 wait complete. 2023-12-24T20:03:52.707 INFO:teuthology.orchestra.run.smithi061.stderr:updated caps for client.0 2023-12-24T20:03:52.715 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:52.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.837+0000 7f8377a14700 1 Processor -- start 2023-12-24T20:03:52.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.837+0000 7f8377a14700 1 -- start start 2023-12-24T20:03:52.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.838+0000 7f8377a14700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83700b2660 0x7f837015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.838+0000 7f8377a14700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700b2eb0 con 0x7f837015bb60 2023-12-24T20:03:52.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.838+0000 7f8377a14700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83700b2bd0 con 0x7f837015c470 2023-12-24T20:03:52.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.838+0000 7f8377a14700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83700afc20 con 0x7f83700b2660 2023-12-24T20:03:52.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.838+0000 7f83757b0700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f837015bb60 0x7f8370098560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40296/0 (socket says 172.21.15.61:40296) 2023-12-24T20:03:52.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.838+0000 7f83757b0700 1 -- 172.21.15.61:0/3889828570 learned_addr learned my addr 172.21.15.61:0/3889828570 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8374faf700 1 --2- 172.21.15.61:0/3889828570 >> v2:172.21.15.133:3300/0 conn(0x7f83700b2660 0x7f837015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146813957 0 0) 0x7f83700b2eb0 con 0x7f837015bb60 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f835c003570 con 0x7f837015bb60 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1120938048 0 0) 0x7f835c003570 con 0x7f837015bb60 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 >> v2:172.21.15.133:3300/0 conn(0x7f83700b2660 msgr2=0x7f837015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 --2- 172.21.15.61:0/3889828570 >> v2:172.21.15.133:3300/0 conn(0x7f83700b2660 0x7f837015bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 >> v1:172.21.15.133:6789/0 conn(0x7f837015c470 legacy=0x7f83700b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700afe10 con 0x7f837015bb60 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f83600015f0 con 0x7f837015bb60 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8374faf700 1 --2- 172.21.15.61:0/3889828570 >> v2:172.21.15.133:3300/0 conn(0x7f83700b2660 0x7f837015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 >> v1:172.21.15.61:6789/0 conn(0x7f837015bb60 legacy=0x7f8370098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f835c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f835c004810 0x7f835c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0051c0 0x7f835c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c00c0a0 con 0x7f835c003a60 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c00c210 con 0x7f835c0051c0 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c00c3d0 con 0x7f835c004810 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f83757b0700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f835c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8375fb1700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0051c0 0x7f835c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8374faf700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f835c004810 0x7f835c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f83757b0700 1 -- 172.21.15.61:0/3889828570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f835c004810 msgr2=0x7f835c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f83757b0700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f835c004810 0x7f835c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f83757b0700 1 -- 172.21.15.61:0/3889828570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0051c0 msgr2=0x7f835c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f83757b0700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0051c0 0x7f835c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f83757b0700 1 -- 172.21.15.61:0/3889828570 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c003570 con 0x7f835c003a60 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8375fb1700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0051c0 0x7f835c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.839+0000 7f8375fb1700 1 -- 172.21.15.61:0/3889828570 reap_dead start 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f83757b0700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f835c003e70 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f836000c3c0 tx=0x7f8360007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e9d3f5331049c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:52.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836000cc90 con 0x7f835c003a60 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836000ce10 con 0x7f835c003a60 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f8367fff700 1 -- 172.21.15.61:0/3889828570 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360007320 con 0x7f835c003a60 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f8377a14700 1 -- 172.21.15.61:0/3889828570 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 msgr2=0x7f835c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f8377a14700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f835c003e70 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f836000c3c0 tx=0x7f8360007920 comp rx=0 tx=0).stop 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f8377a14700 1 -- 172.21.15.61:0/3889828570 shutdown_connections 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f8377a14700 1 --2- 172.21.15.61:0/3889828570 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f835c003e70 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f8377a14700 1 -- 172.21.15.61:0/3889828570 >> 172.21.15.61:0/3889828570 conn(0x7f8370097a10 msgr2=0x7f83700ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f8377a14700 1 -- 172.21.15.61:0/3889828570 shutdown_connections 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.840+0000 7f8377a14700 1 -- 172.21.15.61:0/3889828570 wait complete. 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.841+0000 7f8377a14700 1 Processor -- start 2023-12-24T20:03:52.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.842+0000 7f8377a14700 1 -- start start 2023-12-24T20:03:52.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.842+0000 7f8377a14700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f8370155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.842+0000 7f8377a14700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8370154ba0 0x7f8370155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.842+0000 7f8377a14700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83700acfb0 0x7f83700ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.842+0000 7f8377a14700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8370168fa0 con 0x7f835c003a60 2023-12-24T20:03:52.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.842+0000 7f8377a14700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8370168420 con 0x7f8370154ba0 2023-12-24T20:03:52.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.842+0000 7f8377a14700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8370168700 con 0x7f83700acfb0 2023-12-24T20:03:52.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83757b0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f8370155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83757b0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f8370155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52166/0 (socket says 172.21.15.61:52166) 2023-12-24T20:03:52.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83757b0700 1 -- 172.21.15.61:0/3498375645 learned_addr learned my addr 172.21.15.61:0/3498375645 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:52.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f8374faf700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8370154ba0 0x7f8370155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f8375fb1700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83700acfb0 0x7f83700ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83757b0700 1 -- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83700acfb0 msgr2=0x7f83700ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83757b0700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83700acfb0 0x7f83700ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83757b0700 1 -- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8370154ba0 msgr2=0x7f8370155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83757b0700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8370154ba0 0x7f8370155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83757b0700 1 -- 172.21.15.61:0/3498375645 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83701689e0 con 0x7f835c003a60 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83757b0700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f8370155250 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f836000c9b0 tx=0x7f8360015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83657fa700 1 -- 172.21.15.61:0/3498375645 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360022070 con 0x7f835c003a60 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83657fa700 1 -- 172.21.15.61:0/3498375645 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836000cc90 con 0x7f835c003a60 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f8377a14700 1 -- 172.21.15.61:0/3498375645 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8370168cc0 con 0x7f835c003a60 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f83657fa700 1 -- 172.21.15.61:0/3498375645 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360005c50 con 0x7f835c003a60 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.843+0000 7f8377a14700 1 -- 172.21.15.61:0/3498375645 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83701528f0 con 0x7f835c003a60 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.844+0000 7f8377a14700 1 -- 172.21.15.61:0/3498375645 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837006d440 con 0x7f835c003a60 2023-12-24T20:03:52.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.845+0000 7f83657fa700 1 -- 172.21.15.61:0/3498375645 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f836001e430 con 0x7f835c003a60 2023-12-24T20:03:52.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.845+0000 7f83657fa700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8354066f30 0x7f83540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:52.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.845+0000 7f83657fa700 1 -- 172.21.15.61:0/3498375645 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8360085750 con 0x7f835c003a60 2023-12-24T20:03:52.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.846+0000 7f8374faf700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8354066f30 0x7f83540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:52.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.846+0000 7f8374faf700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8354066f30 0x7f83540693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f836c009f00 tx=0x7f836c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:52.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:52.849+0000 7f83657fa700 1 -- 172.21.15.61:0/3498375645 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8360052a80 con 0x7f835c003a60 2023-12-24T20:03:53.045 INFO:tasks.ceph.mds.c.smithi061.stderr:2023-12-24T20:03:53.045+0000 7fda67320700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:03:53.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.089+0000 7f8377a14700 1 -- 172.21.15.61:0/3498375645 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83700adbb0 con 0x7f835c003a60 2023-12-24T20:03:53.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.089+0000 7f83657fa700 1 -- 172.21.15.61:0/3498375645 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f8360000f70 con 0x7f835c003a60 2023-12-24T20:03:53.089 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:53.090 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3725605380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3725605380},{"type":"v1","addr":"172.21.15.133:6837","nonce":3725605380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":6724,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2558204756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2558204756},{"type":"v1","addr":"172.21.15.133:6836","nonce":2558204756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3124455429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3124455429},{"type":"v1","addr":"172.21.15.61:6834","nonce":3124455429}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:03:47.115082+0000","modified":"2023-12-24T20:03:50.745173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/847871762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":847871762},{"type":"v1","addr":"172.21.15.61:6835","nonce":847871762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 -- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8354066f30 msgr2=0x7f83540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8354066f30 0x7f83540693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f836c009f00 tx=0x7f836c008040 comp rx=0 tx=0).stop 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 -- 172.21.15.61:0/3498375645 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 msgr2=0x7f8370155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f8370155250 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f836000c9b0 tx=0x7f8360015000 comp rx=0 tx=0).stop 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 -- 172.21.15.61:0/3498375645 shutdown_connections 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83700acfb0 0x7f83700ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8354066f30 0x7f83540693e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f835c003a60 0x7f8370155250 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 --2- 172.21.15.61:0/3498375645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8370154ba0 0x7f8370155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 -- 172.21.15.61:0/3498375645 >> 172.21.15.61:0/3498375645 conn(0x7f8370097a10 msgr2=0x7f837006c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 -- 172.21.15.61:0/3498375645 shutdown_connections 2023-12-24T20:03:53.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.091+0000 7f8377a14700 1 -- 172.21.15.61:0/3498375645 wait complete. 2023-12-24T20:03:53.093 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 76 2023-12-24T20:03:53.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T20:03:47.115082+0000', 'modified': '2023-12-24T20:03:50.745173+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7485}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7485': {'gid': 7485, 'name': 'c', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.61:6835/847871762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.61:6832', 'nonce': 847871762}, {'type': 'v1', 'addr': '172.21.15.61:6835', 'nonce': 847871762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T20:03:53.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T20:03:53.508 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-24T20:03:53.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.634+0000 7ff389e2a700 1 Processor -- start 2023-12-24T20:03:53.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.634+0000 7ff389e2a700 1 -- start start 2023-12-24T20:03:53.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.634+0000 7ff389e2a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3840b21c0 0x7ff38415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff389e2a700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38415c410 con 0x7ff384063ba0 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff389e2a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3840adae0 con 0x7ff3840b2590 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff389e2a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840c9a80 con 0x7ff3840b21c0 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff382ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff384063ba0 0x7ff384159020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40310/0 (socket says 172.21.15.61:40310) 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff382ffd700 1 -- 172.21.15.61:0/1455753324 learned_addr learned my addr 172.21.15.61:0/1455753324 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff3837fe700 1 --2- 172.21.15.61:0/1455753324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3840b21c0 0x7ff38415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff3827fc700 1 -- 172.21.15.61:0/1455753324 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852740867 0 0) 0x7ff378001110 con 0x7ff384063ba0 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff3827fc700 1 -- 172.21.15.61:0/1455753324 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff36c003570 con 0x7ff384063ba0 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff3827fc700 1 -- 172.21.15.61:0/1455753324 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637964775 0 0) 0x7ff3840adae0 con 0x7ff3840b2590 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff3827fc700 1 -- 172.21.15.61:0/1455753324 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff378001110 con 0x7ff3840b2590 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff3827fc700 1 -- 172.21.15.61:0/1455753324 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2249136482 0 0) 0x7ff36c003570 con 0x7ff384063ba0 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff3837fe700 1 -- 172.21.15.61:0/1455753324 >> v1:172.21.15.133:6789/0 conn(0x7ff3840b2590 legacy=0x7ff384159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff3837fe700 1 -- 172.21.15.61:0/1455753324 >> v1:172.21.15.61:6789/0 conn(0x7ff384063ba0 legacy=0x7ff384159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.635+0000 7ff3837fe700 1 -- 172.21.15.61:0/1455753324 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3840addc0 con 0x7ff3840b21c0 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff3837fe700 1 --2- 172.21.15.61:0/1455753324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3840b21c0 0x7ff38415bed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff374009910 tx=0x7ff3740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64075a8f2d79092f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff3827fc700 1 -- 172.21.15.61:0/1455753324 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378001600 con 0x7ff3840b21c0 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff3827fc700 1 -- 172.21.15.61:0/1455753324 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374011420 con 0x7ff3840b21c0 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff3827fc700 1 -- 172.21.15.61:0/1455753324 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740117c0 con 0x7ff3840b21c0 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff389e2a700 1 -- 172.21.15.61:0/1455753324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3840b21c0 msgr2=0x7ff38415bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff389e2a700 1 --2- 172.21.15.61:0/1455753324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3840b21c0 0x7ff38415bed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff374009910 tx=0x7ff3740091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff389e2a700 1 -- 172.21.15.61:0/1455753324 shutdown_connections 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff389e2a700 1 --2- 172.21.15.61:0/1455753324 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff3840b21c0 0x7ff38415bed0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff389e2a700 1 -- 172.21.15.61:0/1455753324 >> 172.21.15.61:0/1455753324 conn(0x7ff384068020 msgr2=0x7ff3840cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff389e2a700 1 -- 172.21.15.61:0/1455753324 shutdown_connections 2023-12-24T20:03:53.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.636+0000 7ff389e2a700 1 -- 172.21.15.61:0/1455753324 wait complete. 2023-12-24T20:03:53.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff389e2a700 1 Processor -- start 2023-12-24T20:03:53.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff389e2a700 1 -- start start 2023-12-24T20:03:53.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff389e2a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff384063ba0 0x7ff384168a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff389e2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3840b21c0 0x7ff3840c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff389e2a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3840b2590 0x7ff384158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff389e2a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840c6d40 con 0x7ff3840b2590 2023-12-24T20:03:53.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff389e2a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841690a0 con 0x7ff3840b21c0 2023-12-24T20:03:53.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff389e2a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840c6f50 con 0x7ff384063ba0 2023-12-24T20:03:53.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff383fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3840b2590 0x7ff384158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff383fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3840b2590 0x7ff384158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52178/0 (socket says 172.21.15.61:52178) 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.638+0000 7ff383fff700 1 -- 172.21.15.61:0/3520765053 learned_addr learned my addr 172.21.15.61:0/3520765053 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff382ffd700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3840b21c0 0x7ff3840c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff3837fe700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff384063ba0 0x7ff384168a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff383fff700 1 -- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff384063ba0 msgr2=0x7ff384168a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff383fff700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff384063ba0 0x7ff384168a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff383fff700 1 -- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3840b21c0 msgr2=0x7ff3840c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff383fff700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3840b21c0 0x7ff3840c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff383fff700 1 -- 172.21.15.61:0/3520765053 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374009420 con 0x7ff3840b2590 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff382ffd700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3840b21c0 0x7ff3840c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff383fff700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3840b2590 0x7ff384158d00 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00c910 tx=0x7ff37c0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff36b7fe700 1 -- 172.21.15.61:0/3520765053 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c00a7e0 con 0x7ff3840b2590 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff36b7fe700 1 -- 172.21.15.61:0/3520765053 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c00a960 con 0x7ff3840b2590 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff389e2a700 1 -- 172.21.15.61:0/3520765053 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3840c7230 con 0x7ff3840b2590 2023-12-24T20:03:53.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff36b7fe700 1 -- 172.21.15.61:0/3520765053 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c00ad20 con 0x7ff3840b2590 2023-12-24T20:03:53.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.639+0000 7ff389e2a700 1 -- 172.21.15.61:0/3520765053 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3840c77f0 con 0x7ff3840b2590 2023-12-24T20:03:53.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.640+0000 7ff36b7fe700 1 -- 172.21.15.61:0/3520765053 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff37c012630 con 0x7ff3840b2590 2023-12-24T20:03:53.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.641+0000 7ff36b7fe700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff370066f30 0x7ff3700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.641+0000 7ff36b7fe700 1 -- 172.21.15.61:0/3520765053 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff37c084a30 con 0x7ff3840b2590 2023-12-24T20:03:53.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.641+0000 7ff3837fe700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff370066f30 0x7ff3700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.642+0000 7ff3837fe700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff370066f30 0x7ff3700693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff38416b430 tx=0x7ff374016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:53.644 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.643+0000 7ff39312ab80 1 Processor -- start 2023-12-24T20:03:53.644 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.643+0000 7ff39312ab80 1 -- start start 2023-12-24T20:03:53.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1236d020 0x563c1236d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b4d0 0x563c12385360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123858a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff39312ab80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c122973e0 con 0x563c1238b940 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff39312ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c12294be0 con 0x563c1236d020 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff39312ab80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c122909d0 con 0x563c1238b4d0 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff383fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123858a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff383fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123858a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52184/0 (socket says 172.21.15.61:52184) 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff383fff700 1 -- 172.21.15.61:0/3437602922 learned_addr learned my addr 172.21.15.61:0/3437602922 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff3837fe700 1 --2- 172.21.15.61:0/3437602922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1236d020 0x563c1236d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff382ffd700 1 --2- 172.21.15.61:0/3437602922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b4d0 0x563c12385360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff383fff700 1 -- 172.21.15.61:0/3437602922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b4d0 msgr2=0x563c12385360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff383fff700 1 --2- 172.21.15.61:0/3437602922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b4d0 0x563c12385360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff383fff700 1 -- 172.21.15.61:0/3437602922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1236d020 msgr2=0x563c1236d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff383fff700 1 --2- 172.21.15.61:0/3437602922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1236d020 0x563c1236d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff383fff700 1 -- 172.21.15.61:0/3437602922 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c12124360 con 0x563c1238b940 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.644+0000 7ff383fff700 1 --2- 172.21.15.61:0/3437602922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123858a0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff37c082e80 tx=0x7ff37c082e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e96cebdc364c704 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff368ff9700 1 -- 172.21.15.61:0/3437602922 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c0558c0 con 0x563c1238b940 2023-12-24T20:03:53.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff368ff9700 1 -- 172.21.15.61:0/3437602922 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c058b10 con 0x563c1238b940 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff368ff9700 1 -- 172.21.15.61:0/3437602922 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c05c860 con 0x563c1238b940 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff39312ab80 1 -- 172.21.15.61:0/3437602922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 msgr2=0x563c123858a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff39312ab80 1 --2- 172.21.15.61:0/3437602922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123858a0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff37c082e80 tx=0x7ff37c082e10 comp rx=0 tx=0).stop 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff39312ab80 1 -- 172.21.15.61:0/3437602922 shutdown_connections 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff39312ab80 1 --2- 172.21.15.61:0/3437602922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123858a0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff39312ab80 1 --2- 172.21.15.61:0/3437602922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1236d020 0x563c1236d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff39312ab80 1 --2- 172.21.15.61:0/3437602922 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b4d0 0x563c12385360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff39312ab80 1 -- 172.21.15.61:0/3437602922 >> 172.21.15.61:0/3437602922 conn(0x563c1233f440 msgr2=0x563c1238adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff39312ab80 1 -- 172.21.15.61:0/3437602922 shutdown_connections 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.645+0000 7ff39312ab80 1 -- 172.21.15.61:0/3437602922 wait complete. 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.646+0000 7ff39312ab80 1 -- start start 2023-12-24T20:03:53.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.646+0000 7ff39312ab80 1 Processor -- start 2023-12-24T20:03:53.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c12364140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b4d0 0x563c1236f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b940 0x563c1236bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff39312ab80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1223d1b0 con 0x563c1236d020 2023-12-24T20:03:53.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff39312ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1223ce50 con 0x563c1238b940 2023-12-24T20:03:53.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff39312ab80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c12189e40 con 0x563c1238b4d0 2023-12-24T20:03:53.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff39312ab80 10 client.0 _ll_register_callbacks cb 0x563c1218c7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:03:53.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff3837fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c12364140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff3837fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c12364140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52196/0 (socket says 172.21.15.61:52196) 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff3837fe700 1 -- 172.21.15.61:0/1689917507 learned_addr learned my addr 172.21.15.61:0/1689917507 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff383fff700 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b940 0x563c1236bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff382ffd700 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b4d0 0x563c1236f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff3837fe700 1 -- 172.21.15.61:0/1689917507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b4d0 msgr2=0x563c1236f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff3837fe700 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b4d0 0x563c1236f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff3837fe700 1 -- 172.21.15.61:0/1689917507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b940 msgr2=0x563c1236bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff3837fe700 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b940 0x563c1236bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff3837fe700 1 -- 172.21.15.61:0/1689917507 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3840c77f0 con 0x563c1236d020 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff3837fe700 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c12364140 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff38406f9a0 tx=0x7ff37401f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315e1567ea271e00 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.647+0000 7ff361ffb700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff361ffb700 1 -- 172.21.15.61:0/1689917507 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37401d950 con 0x563c1236d020 2023-12-24T20:03:53.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff361ffb700 1 -- 172.21.15.61:0/1689917507 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff37401dab0 con 0x563c1236d020 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff39312ab80 1 -- 172.21.15.61:0/1689917507 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c12311eb0 con 0x563c1236d020 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff361ffb700 1 -- 172.21.15.61:0/1689917507 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff37401dea0 con 0x563c1236d020 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff39312ab80 10 client.7644 fetch_fsmap learned FSMap version 76 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff39312ab80 1 -- 172.21.15.61:0/1689917507 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x563c120d0b10 con 0x563c1236d020 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff361ffb700 1 -- 172.21.15.61:0/1689917507 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c12311eb0 con 0x563c1236d020 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff361ffb700 1 -- 172.21.15.61:0/1689917507 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 76) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff374033480 con 0x563c1236d020 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff39312ab80 10 client.7644 fetch_fsmap finished waiting for FSMap version 76 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff39312ab80 10 client.7644 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff39312ab80 20 client.7644 populate_metadata read hostname 'smithi061' 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff39312ab80 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.61:6832/847871762,v1:172.21.15.61:6835/847871762] conn(0x563c12369690 0x563c12369a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff39312ab80 4 client.7644 mds_command: new command op to 7485 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff39312ab80 1 -- 172.21.15.61:0/1689917507 --> [v2:172.21.15.61:6832/847871762,v1:172.21.15.61:6835/847871762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c12267880 con 0x563c12369690 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff382ffd700 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.61:6832/847871762,v1:172.21.15.61:6835/847871762] conn(0x563c12369690 0x563c12369a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff382ffd700 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.61:6832/847871762,v1:172.21.15.61:6835/847871762] conn(0x563c12369690 0x563c12369a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7e33eef70e7898b server_cookie=8f2959238a934d27 in_seq=0 out_seq=0 2023-12-24T20:03:53.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.648+0000 7ff361ffb700 10 client.7644 ms_handle_connect on v2:172.21.15.61:6832/847871762 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff361ffb700 1 -- 172.21.15.61:0/1689917507 <== mds.0 v2:172.21.15.61:6832/847871762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563c12267880 con 0x563c12369690 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff361ffb700 10 client.7644 handle_command_reply: tid=0 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 client.7644 shutdown 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 -- 172.21.15.61:0/1689917507 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 msgr2=0x563c12364140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c12364140 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff38406f9a0 tx=0x7ff37401f040 comp rx=0 tx=0).stop 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 -- 172.21.15.61:0/1689917507 shutdown_connections 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.61:6832/847871762,v1:172.21.15.61:6835/847871762] conn(0x563c12369690 0x563c12369a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b940 0x563c1236bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c12364140 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 --2- 172.21.15.61:0/1689917507 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b4d0 0x563c1236f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff361ffb700 0 client.7644 ms_handle_reset on v2:172.21.15.61:6832/847871762 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 -- 172.21.15.61:0/1689917507 >> 172.21.15.61:0/1689917507 conn(0x563c1233f440 msgr2=0x563c123877c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 -- 172.21.15.61:0/1689917507 shutdown_connections 2023-12-24T20:03:53.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 1 -- 172.21.15.61:0/1689917507 wait complete. 2023-12-24T20:03:53.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.649+0000 7ff39312ab80 20 client.7644 trim_cache size 0 max 16384 2023-12-24T20:03:53.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.666+0000 7ff39312ab80 1 Processor -- start 2023-12-24T20:03:53.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.666+0000 7ff39312ab80 1 -- start start 2023-12-24T20:03:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1236d020 0x563c12342e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b4d0 0x563c12384f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123854d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff39312ab80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1233fac0 con 0x563c1238b940 2023-12-24T20:03:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff39312ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c123417c0 con 0x563c1238b4d0 2023-12-24T20:03:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff39312ab80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c12369ba0 con 0x563c1236d020 2023-12-24T20:03:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff383fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123854d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff383fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123854d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52198/0 (socket says 172.21.15.61:52198) 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff383fff700 1 -- 172.21.15.61:0/3825286454 learned_addr learned my addr 172.21.15.61:0/3825286454 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff382ffd700 1 --2- 172.21.15.61:0/3825286454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b4d0 0x563c12384f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff3837fe700 1 --2- 172.21.15.61:0/3825286454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1236d020 0x563c12342e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.667+0000 7ff383fff700 1 -- 172.21.15.61:0/3825286454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1236d020 msgr2=0x563c12342e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff383fff700 1 --2- 172.21.15.61:0/3825286454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1236d020 0x563c12342e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff383fff700 1 -- 172.21.15.61:0/3825286454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b4d0 msgr2=0x563c12384f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff383fff700 1 --2- 172.21.15.61:0/3825286454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b4d0 0x563c12384f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff383fff700 1 -- 172.21.15.61:0/3825286454 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c1225f290 con 0x563c1238b940 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff383fff700 1 --2- 172.21.15.61:0/3825286454 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123854d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff37c010020 tx=0x7ff37c06d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541c380bc0d7b458 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff3697fa700 1 -- 172.21.15.61:0/3825286454 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c058b10 con 0x563c1238b940 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff3697fa700 1 -- 172.21.15.61:0/3825286454 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c081070 con 0x563c1238b940 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff3697fa700 1 -- 172.21.15.61:0/3825286454 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c0558c0 con 0x563c1238b940 2023-12-24T20:03:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff39312ab80 1 -- 172.21.15.61:0/3825286454 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 msgr2=0x563c123854d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff39312ab80 1 --2- 172.21.15.61:0/3825286454 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123854d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ff37c010020 tx=0x7ff37c06d000 comp rx=0 tx=0).stop 2023-12-24T20:03:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff39312ab80 1 -- 172.21.15.61:0/3825286454 shutdown_connections 2023-12-24T20:03:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff39312ab80 1 --2- 172.21.15.61:0/3825286454 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1236d020 0x563c12342e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff39312ab80 1 --2- 172.21.15.61:0/3825286454 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1238b940 0x563c123854d0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff39312ab80 1 --2- 172.21.15.61:0/3825286454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b4d0 0x563c12384f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff39312ab80 1 -- 172.21.15.61:0/3825286454 >> 172.21.15.61:0/3825286454 conn(0x563c1233f440 msgr2=0x563c1233cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff39312ab80 1 -- 172.21.15.61:0/3825286454 shutdown_connections 2023-12-24T20:03:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.668+0000 7ff39312ab80 1 -- 172.21.15.61:0/3825286454 wait complete. 2023-12-24T20:03:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.669+0000 7ff39312ab80 1 -- start start 2023-12-24T20:03:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.669+0000 7ff39312ab80 1 Processor -- start 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c123f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b4d0 0x563c12383de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff39312ab80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b940 0x563c12384320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff39312ab80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c12386420 con 0x563c1236d020 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff39312ab80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1236a6c0 con 0x563c1238b4d0 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff39312ab80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c123f0a20 con 0x563c1238b940 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff39312ab80 10 client.0 _ll_register_callbacks cb 0x7ff374011820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff3837fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c123f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff3837fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c123f04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52214/0 (socket says 172.21.15.61:52214) 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff3837fe700 1 -- 172.21.15.61:0/491529629 learned_addr learned my addr 172.21.15.61:0/491529629 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff383fff700 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b940 0x563c12384320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff382ffd700 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b4d0 0x563c12383de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff3837fe700 1 -- 172.21.15.61:0/491529629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b940 msgr2=0x563c12384320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff3837fe700 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b940 0x563c12384320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff3837fe700 1 -- 172.21.15.61:0/491529629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b4d0 msgr2=0x563c12383de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff3837fe700 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b4d0 0x563c12383de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff3837fe700 1 -- 172.21.15.61:0/491529629 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c12124360 con 0x563c1236d020 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff3837fe700 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c123f04e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff374009190 tx=0x7ff37402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7015d7a193e42c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff361ffb700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff361ffb700 1 -- 172.21.15.61:0/491529629 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374033a60 con 0x563c1236d020 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff361ffb700 1 -- 172.21.15.61:0/491529629 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff374033480 con 0x563c1236d020 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.670+0000 7ff39312ab80 1 -- 172.21.15.61:0/491529629 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c12335490 con 0x563c1236d020 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff361ffb700 1 -- 172.21.15.61:0/491529629 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff37403f690 con 0x563c1236d020 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff39312ab80 10 client.7650 fetch_fsmap learned FSMap version 76 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff39312ab80 1 -- 172.21.15.61:0/491529629 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x563c12128c80 con 0x563c1236d020 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff361ffb700 1 -- 172.21.15.61:0/491529629 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c12335490 con 0x563c1236d020 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff361ffb700 1 -- 172.21.15.61:0/491529629 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 76) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff37403f7f0 con 0x563c1236d020 2023-12-24T20:03:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff39312ab80 10 client.7650 fetch_fsmap finished waiting for FSMap version 76 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff39312ab80 10 client.7650 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff39312ab80 20 client.7650 populate_metadata read hostname 'smithi061' 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff39312ab80 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.61:6832/847871762,v1:172.21.15.61:6835/847871762] conn(0x563c12387b10 0x563c12387ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff39312ab80 4 client.7650 mds_command: new command op to 7485 tid=0[{"prefix": "status"}] 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff39312ab80 1 -- 172.21.15.61:0/491529629 --> [v2:172.21.15.61:6832/847871762,v1:172.21.15.61:6835/847871762] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563c12233910 con 0x563c12387b10 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff382ffd700 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.61:6832/847871762,v1:172.21.15.61:6835/847871762] conn(0x563c12387b10 0x563c12387ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff361ffb700 10 client.7650 ms_handle_connect on v2:172.21.15.61:6832/847871762 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff382ffd700 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.61:6832/847871762,v1:172.21.15.61:6835/847871762] conn(0x563c12387b10 0x563c12387ee0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f11d17ef95ac4330 server_cookie=e90037557664805a in_seq=0 out_seq=0 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff361ffb700 1 -- 172.21.15.61:0/491529629 <== mds.0 v2:172.21.15.61:6832/847871762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x563c12233910 con 0x563c12387b10 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff361ffb700 10 client.7650 handle_command_reply: tid=0 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.671+0000 7ff39312ab80 1 client.7650 shutdown 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 1 -- 172.21.15.61:0/491529629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 msgr2=0x563c123f04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c123f04e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff374009190 tx=0x7ff37402c040 comp rx=0 tx=0).stop 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 1 -- 172.21.15.61:0/491529629 shutdown_connections 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.61:6832/847871762,v1:172.21.15.61:6835/847871762] conn(0x563c12387b10 0x563c12387ee0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c1238b940 0x563c12384320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x563c1236d020 0x563c123f04e0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff361ffb700 0 client.7650 ms_handle_reset on v2:172.21.15.61:6832/847871762 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 1 --2- 172.21.15.61:0/491529629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x563c1238b4d0 0x563c12383de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 1 -- 172.21.15.61:0/491529629 >> 172.21.15.61:0/491529629 conn(0x563c1233f440 msgr2=0x563c1238ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 1 -- 172.21.15.61:0/491529629 shutdown_connections 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 1 -- 172.21.15.61:0/491529629 wait complete. 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff39312ab80 20 client.7650 trim_cache size 0 max 16384 2023-12-24T20:03:53.678 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 7485, 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 5.9643716290000004, 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 76, 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 151, 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 151, 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 11.0120082 2023-12-24T20:03:53.679 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:53.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 -- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff370066f30 msgr2=0x7ff3700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff370066f30 0x7ff3700693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff38416b430 tx=0x7ff374016000 comp rx=0 tx=0).stop 2023-12-24T20:03:53.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 -- 172.21.15.61:0/3520765053 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3840b2590 msgr2=0x7ff384158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3840b2590 0x7ff384158d00 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00c910 tx=0x7ff37c0027a0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 -- 172.21.15.61:0/3520765053 shutdown_connections 2023-12-24T20:03:53.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff384063ba0 0x7ff384168a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff370066f30 0x7ff3700693e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff3840b2590 0x7ff384158d00 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 --2- 172.21.15.61:0/3520765053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3840b21c0 0x7ff3840c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 -- 172.21.15.61:0/3520765053 >> 172.21.15.61:0/3520765053 conn(0x7ff384068020 msgr2=0x7ff38415a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:53.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 -- 172.21.15.61:0/3520765053 shutdown_connections 2023-12-24T20:03:53.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.672+0000 7ff389e2a700 1 -- 172.21.15.61:0/3520765053 wait complete. 2023-12-24T20:03:53.685 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:03:53.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.806+0000 7fcf57ec4700 1 Processor -- start 2023-12-24T20:03:53.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.806+0000 7fcf57ec4700 1 -- start start 2023-12-24T20:03:53.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.807+0000 7fcf57ec4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcf50068140 0x7fcf500cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.807+0000 7fcf57ec4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50159a60 0x7fcf50159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.807+0000 7fcf57ec4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500b2890 con 0x7fcf50068510 2023-12-24T20:03:53.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.807+0000 7fcf57ec4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500cf630 con 0x7fcf50068140 2023-12-24T20:03:53.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.807+0000 7fcf57ec4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500b2240 con 0x7fcf50159a60 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.807+0000 7fcf55c60700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcf50068140 0x7fcf500cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.807+0000 7fcf56461700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50159a60 0x7fcf50159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.807+0000 7fcf5545f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcf50068510 0x7fcf500b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:59446/0 (socket says 172.21.15.61:59446) 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.807+0000 7fcf5545f700 1 -- 172.21.15.61:0/2001612467 learned_addr learned my addr 172.21.15.61:0/2001612467 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf54c5e700 1 -- 172.21.15.61:0/2001612467 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174889041 0 0) 0x7fcf500b2890 con 0x7fcf50068510 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf54c5e700 1 -- 172.21.15.61:0/2001612467 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf3c003570 con 0x7fcf50068510 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf55c60700 1 -- 172.21.15.61:0/2001612467 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50159a60 msgr2=0x7fcf50159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf55c60700 1 --2- 172.21.15.61:0/2001612467 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50159a60 0x7fcf50159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf55c60700 1 -- 172.21.15.61:0/2001612467 >> v1:172.21.15.133:6789/0 conn(0x7fcf50068510 legacy=0x7fcf500b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf55c60700 1 -- 172.21.15.61:0/2001612467 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500b2520 con 0x7fcf50068140 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf56461700 1 --2- 172.21.15.61:0/2001612467 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50159a60 0x7fcf50159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:03:53.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf55c60700 1 --2- 172.21.15.61:0/2001612467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf50068140 0x7fcf500cefa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0098d0 tx=0x7fcf4c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cf1f4686e02e185 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf54c5e700 1 -- 172.21.15.61:0/2001612467 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c005c10 con 0x7fcf50068140 2023-12-24T20:03:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf54c5e700 1 -- 172.21.15.61:0/2001612467 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c005d70 con 0x7fcf50068140 2023-12-24T20:03:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.808+0000 7fcf54c5e700 1 -- 172.21.15.61:0/2001612467 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c006280 con 0x7fcf50068140 2023-12-24T20:03:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.809+0000 7fcf57ec4700 1 -- 172.21.15.61:0/2001612467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf50068140 msgr2=0x7fcf500cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.809+0000 7fcf57ec4700 1 --2- 172.21.15.61:0/2001612467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf50068140 0x7fcf500cefa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0098d0 tx=0x7fcf4c009120 comp rx=0 tx=0).stop 2023-12-24T20:03:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.809+0000 7fcf57ec4700 1 -- 172.21.15.61:0/2001612467 shutdown_connections 2023-12-24T20:03:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.809+0000 7fcf57ec4700 1 --2- 172.21.15.61:0/2001612467 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50159a60 0x7fcf50159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.809+0000 7fcf57ec4700 1 --2- 172.21.15.61:0/2001612467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf50068140 0x7fcf500cefa0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.809+0000 7fcf57ec4700 1 -- 172.21.15.61:0/2001612467 >> 172.21.15.61:0/2001612467 conn(0x7fcf50097a10 msgr2=0x7fcf500ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:53.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.809+0000 7fcf57ec4700 1 -- 172.21.15.61:0/2001612467 shutdown_connections 2023-12-24T20:03:53.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.809+0000 7fcf57ec4700 1 -- 172.21.15.61:0/2001612467 wait complete. 2023-12-24T20:03:53.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.810+0000 7fcf57ec4700 1 Processor -- start 2023-12-24T20:03:53.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.810+0000 7fcf57ec4700 1 -- start start 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf57ec4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcf50068140 0x7fcf501558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf57ec4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50068510 0x7fcf5016a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf57ec4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf50159a60 0x7fcf5015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf57ec4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50155df0 con 0x7fcf50068140 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf57ec4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5009af20 con 0x7fcf50159a60 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf57ec4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5009a5f0 con 0x7fcf50068510 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf55c60700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcf50068140 0x7fcf501558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf55c60700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcf50068140 0x7fcf501558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52220/0 (socket says 172.21.15.61:52220) 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf55c60700 1 -- 172.21.15.61:0/746921130 learned_addr learned my addr 172.21.15.61:0/746921130 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf5545f700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50068510 0x7fcf5016a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf56461700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf50159a60 0x7fcf5015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf55c60700 1 -- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50068510 msgr2=0x7fcf5016a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf55c60700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50068510 0x7fcf5016a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf55c60700 1 -- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf50159a60 msgr2=0x7fcf5015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf55c60700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf50159a60 0x7fcf5015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf55c60700 1 -- 172.21.15.61:0/746921130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48009a20 con 0x7fcf50068140 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.811+0000 7fcf55c60700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcf50068140 0x7fcf501558b0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fcf5006d8b0 tx=0x7fcf4c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.812+0000 7fcf45ffb700 1 -- 172.21.15.61:0/746921130 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c005c10 con 0x7fcf50068140 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.812+0000 7fcf45ffb700 1 -- 172.21.15.61:0/746921130 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c01d6b0 con 0x7fcf50068140 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.812+0000 7fcf57ec4700 1 -- 172.21.15.61:0/746921130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c0093c0 con 0x7fcf50068140 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.812+0000 7fcf45ffb700 1 -- 172.21.15.61:0/746921130 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c01da90 con 0x7fcf50068140 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.812+0000 7fcf57ec4700 1 -- 172.21.15.61:0/746921130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5009abb0 con 0x7fcf50068140 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.813+0000 7fcf57ec4700 1 -- 172.21.15.61:0/746921130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5009b200 con 0x7fcf50068140 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.813+0000 7fcf45ffb700 1 -- 172.21.15.61:0/746921130 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcf4c01a420 con 0x7fcf50068140 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.813+0000 7fcf45ffb700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcf34066f30 0x7fcf340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:53.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.814+0000 7fcf45ffb700 1 -- 172.21.15.61:0/746921130 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf4c085f10 con 0x7fcf50068140 2023-12-24T20:03:53.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.814+0000 7fcf5545f700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcf34066f30 0x7fcf340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:53.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.814+0000 7fcf5545f700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcf34066f30 0x7fcf340693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcf5015b080 tx=0x7fcf40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:53.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:53.818+0000 7fcf45ffb700 1 -- 172.21.15.61:0/746921130 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf4c053240 con 0x7fcf50068140 2023-12-24T20:03:54.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.057+0000 7fcf57ec4700 1 -- 172.21.15.61:0/746921130 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcf5006d440 con 0x7fcf50068140 2023-12-24T20:03:54.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.057+0000 7fcf45ffb700 1 -- 172.21.15.61:0/746921130 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcf4c056860 con 0x7fcf50068140 2023-12-24T20:03:54.058 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 -- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcf34066f30 msgr2=0x7fcf340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcf34066f30 0x7fcf340693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcf5015b080 tx=0x7fcf40009040 comp rx=0 tx=0).stop 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 -- 172.21.15.61:0/746921130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcf50068140 msgr2=0x7fcf501558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcf50068140 0x7fcf501558b0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fcf5006d8b0 tx=0x7fcf4c016000 comp rx=0 tx=0).stop 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 -- 172.21.15.61:0/746921130 shutdown_connections 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcf34066f30 0x7fcf340693e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf50159a60 0x7fcf5015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcf50068140 0x7fcf501558b0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 --2- 172.21.15.61:0/746921130 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcf50068510 0x7fcf5016a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 -- 172.21.15.61:0/746921130 >> 172.21.15.61:0/746921130 conn(0x7fcf50097a10 msgr2=0x7fcf5006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 -- 172.21.15.61:0/746921130 shutdown_connections 2023-12-24T20:03:54.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:54.059+0000 7fcf57ec4700 1 -- 172.21.15.61:0/746921130 wait complete. 2023-12-24T20:03:54.071 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:03:54.071 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:03:54.071 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T20:03:54.071 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T20:03:54.071 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:54.071 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:03:54.072 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:03:54.072 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:03:54.072 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:03:54.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:54.072 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T20:03:54.090 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:03:54.090 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:03:54.090 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:03:54.090 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:54.090 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42131sec preferred_lft 42131sec 2023-12-24T20:03:54.091 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 12:83:d1:9f:62:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:03:54.092 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1083:d1ff:fe9f:62aa/64 scope link 2023-12-24T20:03:54.093 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:54.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:54.093 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:03:54.156 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T20:03:54.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:54.157 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T20:03:54.217 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T20:03:54.217 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:03:54.217 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:03:54.217 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:03:54.217 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:03:54.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:54.218 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T20:03:54.218 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T20:03:54.218 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:03:54.218 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:03:54.218 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:03:54.218 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T20:03:54.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:54.325 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T20:03:54.344 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:03:54.344 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:03:54.345 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:03:54.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:54.345 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T20:03:54.412 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T20:03:54.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:03:54.412 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:54.469 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:03:54.470 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:03:54.470 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:54.527 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:03:54.595 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:03:54.595 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:03:54.662 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:03:54.662 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:03:54.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:54.663 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:03:54.721 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:03:54.721 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T20:03:54.763 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:03:54.791 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:03:54.791 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:03:54.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T20:03:54.850+0000 7fcbe322c540 -1 init, newargv = 0x563090af3390 newargc=15 2023-12-24T20:03:54.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[70299]: starting ceph client 2023-12-24T20:03:54.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[70299]: starting fuse 2023-12-24T20:03:54.860 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:03:54.862 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:03:54.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:54.862 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:03:54.919 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T20:03:54.920 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:03:54.920 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:03:54.921 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:03:55.045 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.70299.asok 2023-12-24T20:03:55.228 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.70299.asok 2023-12-24T20:03:55.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:55.228 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.70299.asok status 2023-12-24T20:03:55.385 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "70299", 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 7659, 2023-12-24T20:03:55.386 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 7659 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 1905061989 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 1905061989 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:03:55.387 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.7659 192.168.0.1:0/1905061989", 2023-12-24T20:03:55.388 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/1905061989", 2023-12-24T20:03:55.388 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T20:03:55.388 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 76, 2023-12-24T20:03:55.388 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 151, 2023-12-24T20:03:55.388 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:03:55.388 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:03:55.388 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:03:55.388 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:03:55.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:55.396 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T20:03:55.396 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:55.413 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T20:03:55.413 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:55.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:55.414 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:03:55.482 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:03:55.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.642+0000 7f99863a1700 1 Processor -- start 2023-12-24T20:03:55.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.643+0000 7f99863a1700 1 -- start start 2023-12-24T20:03:55.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.643+0000 7f99863a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99800b0980 0x7f99800ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:55.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.643+0000 7f99863a1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f99800b0d50 0x7f99800b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:55.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.643+0000 7f99863a1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99800c99e0 con 0x7f99800b3290 2023-12-24T20:03:55.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.643+0000 7f99863a1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998015a520 con 0x7f99800b0d50 2023-12-24T20:03:55.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f99863a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99800cd0f0 con 0x7f99800b0980 2023-12-24T20:03:55.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9984b9e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f99800b0d50 0x7f99800b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9984b9e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f99800b0d50 0x7f99800b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52232/0 (socket says 172.21.15.61:52232) 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9984b9e700 1 -- 172.21.15.61:0/2249029096 learned_addr learned my addr 172.21.15.61:0/2249029096 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f998539f700 1 --2- 172.21.15.61:0/2249029096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99800b0980 0x7f99800ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9984b9e700 1 -- 172.21.15.61:0/2249029096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99800b0980 msgr2=0x7f99800ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9984b9e700 1 --2- 172.21.15.61:0/2249029096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99800b0980 0x7f99800ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9984b9e700 1 -- 172.21.15.61:0/2249029096 >> v1:172.21.15.133:6789/0 conn(0x7f99800b3290 legacy=0x7f998015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9984b9e700 1 -- 172.21.15.61:0/2249029096 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99800c96b0 con 0x7f99800b0d50 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9984b9e700 1 --2- 172.21.15.61:0/2249029096 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0d50 0x7f99800b2d50 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f99700099e0 tx=0x7f9970009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce58c4b31285157 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9977fff700 1 -- 172.21.15.61:0/2249029096 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000b820 con 0x7f99800b0d50 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9977fff700 1 -- 172.21.15.61:0/2249029096 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997000b980 con 0x7f99800b0d50 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.644+0000 7f9977fff700 1 -- 172.21.15.61:0/2249029096 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000bd20 con 0x7f99800b0d50 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.645+0000 7f99863a1700 1 -- 172.21.15.61:0/2249029096 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0d50 msgr2=0x7f99800b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.645+0000 7f99863a1700 1 --2- 172.21.15.61:0/2249029096 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0d50 0x7f99800b2d50 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f99700099e0 tx=0x7f9970009250 comp rx=0 tx=0).stop 2023-12-24T20:03:55.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.645+0000 7f99863a1700 1 -- 172.21.15.61:0/2249029096 shutdown_connections 2023-12-24T20:03:55.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.645+0000 7f99863a1700 1 --2- 172.21.15.61:0/2249029096 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99800b0980 0x7f99800ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:55.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.645+0000 7f99863a1700 1 --2- 172.21.15.61:0/2249029096 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0d50 0x7f99800b2d50 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:55.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.645+0000 7f99863a1700 1 -- 172.21.15.61:0/2249029096 >> 172.21.15.61:0/2249029096 conn(0x7f99800b14f0 msgr2=0x7f99800b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:55.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.645+0000 7f99863a1700 1 -- 172.21.15.61:0/2249029096 shutdown_connections 2023-12-24T20:03:55.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.645+0000 7f99863a1700 1 -- 172.21.15.61:0/2249029096 wait complete. 2023-12-24T20:03:55.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.646+0000 7f99863a1700 1 Processor -- start 2023-12-24T20:03:55.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.646+0000 7f99863a1700 1 -- start start 2023-12-24T20:03:55.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f99863a1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0980 0x7f998009bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:55.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f99863a1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99800b0d50 0x7f99800c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:55.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f99863a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99800b3290 0x7f998015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:55.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f99863a1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99801590b0 con 0x7f99800b0980 2023-12-24T20:03:55.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f99863a1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998016a850 con 0x7f99800b3290 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f99863a1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998016ab10 con 0x7f99800b0d50 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f998539f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0980 0x7f998009bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f998539f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0980 0x7f998009bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:52242/0 (socket says 172.21.15.61:52242) 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f998539f700 1 -- 172.21.15.61:0/579764436 learned_addr learned my addr 172.21.15.61:0/579764436 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f998539f700 1 -- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99800b0d50 msgr2=0x7f99800c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f998539f700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99800b0d50 0x7f99800c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f9985ba0700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99800b3290 0x7f998015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f998539f700 1 -- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99800b3290 msgr2=0x7f998015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f998539f700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99800b3290 0x7f998015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f998539f700 1 -- 172.21.15.61:0/579764436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99700094f0 con 0x7f99800b0980 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.647+0000 7f9985ba0700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99800b3290 0x7f998015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.648+0000 7f998539f700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0980 0x7f998009bdb0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f997c00d840 tx=0x7f997c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.648+0000 7f99757fa700 1 -- 172.21.15.61:0/579764436 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c014620 con 0x7f99800b0980 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.648+0000 7f99757fa700 1 -- 172.21.15.61:0/579764436 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c014780 con 0x7f99800b0980 2023-12-24T20:03:55.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.648+0000 7f99863a1700 1 -- 172.21.15.61:0/579764436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998016adf0 con 0x7f99800b0980 2023-12-24T20:03:55.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.648+0000 7f99757fa700 1 -- 172.21.15.61:0/579764436 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c014b40 con 0x7f99800b0980 2023-12-24T20:03:55.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.648+0000 7f99863a1700 1 -- 172.21.15.61:0/579764436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998016b3b0 con 0x7f99800b0980 2023-12-24T20:03:55.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.649+0000 7f99863a1700 1 -- 172.21.15.61:0/579764436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99800982a0 con 0x7f99800b0980 2023-12-24T20:03:55.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.649+0000 7f99757fa700 1 -- 172.21.15.61:0/579764436 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f997c01d400 con 0x7f99800b0980 2023-12-24T20:03:55.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.650+0000 7f99757fa700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9964066f30 0x7f99640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:55.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.650+0000 7f99757fa700 1 -- 172.21.15.61:0/579764436 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f997c084da0 con 0x7f99800b0980 2023-12-24T20:03:55.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.650+0000 7f9984b9e700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9964066f30 0x7f99640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:55.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.651+0000 7f9984b9e700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9964066f30 0x7f99640693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f99700099e0 tx=0x7f9970017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:55.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.654+0000 7f99757fa700 1 -- 172.21.15.61:0/579764436 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f997c052010 con 0x7f99800b0980 2023-12-24T20:03:55.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.897+0000 7f99863a1700 1 -- 172.21.15.61:0/579764436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f998006d1f0 con 0x7f99800b0980 2023-12-24T20:03:55.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.897+0000 7f99757fa700 1 -- 172.21.15.61:0/579764436 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7f997c055630 con 0x7f99800b0980 2023-12-24T20:03:55.898 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:03:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.899+0000 7f99863a1700 1 -- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9964066f30 msgr2=0x7f99640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.899+0000 7f99863a1700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9964066f30 0x7f99640693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f99700099e0 tx=0x7f9970017000 comp rx=0 tx=0).stop 2023-12-24T20:03:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.899+0000 7f99863a1700 1 -- 172.21.15.61:0/579764436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0980 msgr2=0x7f998009bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.899+0000 7f99863a1700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0980 0x7f998009bdb0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f997c00d840 tx=0x7f997c008040 comp rx=0 tx=0).stop 2023-12-24T20:03:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.899+0000 7f99863a1700 1 -- 172.21.15.61:0/579764436 shutdown_connections 2023-12-24T20:03:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.899+0000 7f99863a1700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9964066f30 0x7f99640693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.899+0000 7f99863a1700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99800b3290 0x7f998015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.899+0000 7f99863a1700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f99800b0980 0x7f998009bdb0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.899+0000 7f99863a1700 1 --2- 172.21.15.61:0/579764436 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f99800b0d50 0x7f99800c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.899+0000 7f99863a1700 1 -- 172.21.15.61:0/579764436 >> 172.21.15.61:0/579764436 conn(0x7f99800b14f0 msgr2=0x7f99800cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.900+0000 7f99863a1700 1 -- 172.21.15.61:0/579764436 shutdown_connections 2023-12-24T20:03:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:55.900+0000 7f99863a1700 1 -- 172.21.15.61:0/579764436 wait complete. 2023-12-24T20:03:55.912 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:03:55.912 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:03:55.912 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T20:03:55.912 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T20:03:55.912 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:55.912 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:03:55.912 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:03:55.912 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:03:55.912 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:03:55.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:55.912 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T20:03:55.934 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:03:55.934 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:03:55.934 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:03:55.934 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42137sec preferred_lft 42137sec 2023-12-24T20:03:55.935 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::accb:c5ff:feae:915/64 scope link 2023-12-24T20:03:55.936 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:03:55.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:55.937 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:03:56.005 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T20:03:56.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:56.007 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T20:03:56.068 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T20:03:56.069 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:03:56.069 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:03:56.069 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:03:56.069 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:03:56.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:56.069 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T20:03:56.069 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T20:03:56.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:03:56.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:03:56.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:03:56.070 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T20:03:56.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:56.180 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T20:03:56.197 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T20:03:56.197 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T20:03:56.198 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:03:56.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:03:56.198 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T20:03:56.265 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T20:03:56.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:03:56.265 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:56.322 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:03:56.323 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:03:56.323 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:56.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:03:56.446 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:03:56.446 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:03:56.513 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:03:56.514 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:03:56.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:56.515 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:03:56.572 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:03:56.572 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T20:03:56.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:03:56.640 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:03:56.640 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:03:56.697 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T20:03:56.697+0000 7f9fd9b4a540 -1 init, newargv = 0x5572e21b7360 newargc=15 2023-12-24T20:03:56.697 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[47912]: starting ceph client 2023-12-24T20:03:56.702 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[47912]: starting fuse 2023-12-24T20:03:56.710 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:03:56.711 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:03:56.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:56.712 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:03:56.769 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T20:03:56.769 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T20:03:56.769 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:03:56.769 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T20:03:56.770 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T20:03:56.771 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T20:03:56.892 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.47912.asok 2023-12-24T20:03:57.074 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.47912.asok 2023-12-24T20:03:57.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:57.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.47912.asok status 2023-12-24T20:03:57.227 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T20:03:57.227 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T20:03:57.227 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:03:57.227 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "47912", 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6847, 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T20:03:57.228 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 6847 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 442879456 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 442879456 2023-12-24T20:03:57.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:03:57.230 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.6847 192.168.0.1:0/442879456", 2023-12-24T20:03:57.230 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/442879456", 2023-12-24T20:03:57.230 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T20:03:57.230 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 76, 2023-12-24T20:03:57.230 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 151, 2023-12-24T20:03:57.230 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:03:57.230 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T20:03:57.230 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T20:03:57.230 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T20:03:57.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:57.237 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T20:03:57.237 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:57.255 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T20:03:57.255 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:57.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:03:57.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:03:57.322 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:03:57.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.458+0000 7f42dc3d3700 1 Processor -- start 2023-12-24T20:03:57.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.458+0000 7f42dc3d3700 1 -- start start 2023-12-24T20:03:57.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42dc3d3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42d415bb60 0x7f42d4098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:57.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42dc3d3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f42d4098aa0 0x7f42d415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:57.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42dc3d3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d40b2eb0 con 0x7f42d415c470 2023-12-24T20:03:57.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42dc3d3700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40afc20 con 0x7f42d4098aa0 2023-12-24T20:03:57.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42dc3d3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40b2bd0 con 0x7f42d415bb60 2023-12-24T20:03:57.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42d996e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f42d4098aa0 0x7f42d415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:57.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42d996e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f42d4098aa0 0x7f42d415bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:58812/0 (socket says 172.21.15.61:58812) 2023-12-24T20:03:57.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42d996e700 1 -- 172.21.15.61:0/163157023 learned_addr learned my addr 172.21.15.61:0/163157023 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:57.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42da16f700 1 --2- 172.21.15.61:0/163157023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42d415bb60 0x7f42d4098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:57.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42d996e700 1 -- 172.21.15.61:0/163157023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42d415bb60 msgr2=0x7f42d4098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:57.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42d996e700 1 --2- 172.21.15.61:0/163157023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42d415bb60 0x7f42d4098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:57.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42d996e700 1 -- 172.21.15.61:0/163157023 >> v1:172.21.15.133:6789/0 conn(0x7f42d415c470 legacy=0x7f42d40b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:57.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42d996e700 1 -- 172.21.15.61:0/163157023 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40afe10 con 0x7f42d4098aa0 2023-12-24T20:03:57.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.459+0000 7f42d996e700 1 --2- 172.21.15.61:0/163157023 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d4098aa0 0x7f42d415bf30 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f42c40099b0 tx=0x7f42c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42bff76387493d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:57.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42d916d700 1 -- 172.21.15.61:0/163157023 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c400b860 con 0x7f42d4098aa0 2023-12-24T20:03:57.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42d916d700 1 -- 172.21.15.61:0/163157023 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c400b9c0 con 0x7f42d4098aa0 2023-12-24T20:03:57.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42d916d700 1 -- 172.21.15.61:0/163157023 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c400bd60 con 0x7f42d4098aa0 2023-12-24T20:03:57.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42dc3d3700 1 -- 172.21.15.61:0/163157023 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d4098aa0 msgr2=0x7f42d415bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42dc3d3700 1 --2- 172.21.15.61:0/163157023 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d4098aa0 0x7f42d415bf30 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f42c40099b0 tx=0x7f42c4009250 comp rx=0 tx=0).stop 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42dc3d3700 1 -- 172.21.15.61:0/163157023 shutdown_connections 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42dc3d3700 1 --2- 172.21.15.61:0/163157023 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42d415bb60 0x7f42d4098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42dc3d3700 1 --2- 172.21.15.61:0/163157023 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d4098aa0 0x7f42d415bf30 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42dc3d3700 1 -- 172.21.15.61:0/163157023 >> 172.21.15.61:0/163157023 conn(0x7f42d4097a10 msgr2=0x7f42d40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42dc3d3700 1 -- 172.21.15.61:0/163157023 shutdown_connections 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.460+0000 7f42dc3d3700 1 -- 172.21.15.61:0/163157023 wait complete. 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.461+0000 7f42dc3d3700 1 Processor -- start 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.462+0000 7f42dc3d3700 1 -- start start 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.462+0000 7f42dc3d3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42d4098aa0 0x7f42d4168a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.462+0000 7f42dc3d3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d415bb60 0x7f42d4151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.462+0000 7f42dc3d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d415c470 0x7f42d4151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.462+0000 7f42dc3d3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d409ab60 con 0x7f42d415bb60 2023-12-24T20:03:57.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.462+0000 7f42dc3d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d41525f0 con 0x7f42d415c470 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.462+0000 7f42dc3d3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4168fc0 con 0x7f42d4098aa0 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.462+0000 7f42d996e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d415bb60 0x7f42d4151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.462+0000 7f42d996e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d415bb60 0x7f42d4151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:58820/0 (socket says 172.21.15.61:58820) 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.462+0000 7f42d996e700 1 -- 172.21.15.61:0/2601677149 learned_addr learned my addr 172.21.15.61:0/2601677149 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42da16f700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42d4098aa0 0x7f42d4168a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42da970700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d415c470 0x7f42d4151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42d996e700 1 -- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42d4098aa0 msgr2=0x7f42d4168a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42d996e700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42d4098aa0 0x7f42d4168a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42d996e700 1 -- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d415c470 msgr2=0x7f42d4151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42d996e700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d415c470 0x7f42d4151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42d996e700 1 -- 172.21.15.61:0/2601677149 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40094f0 con 0x7f42d415bb60 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42da970700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d415c470 0x7f42d4151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42d996e700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d415bb60 0x7f42d4151a50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f42d406d8b0 tx=0x7f42c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42ca7fc700 1 -- 172.21.15.61:0/2601677149 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4024440 con 0x7f42d415bb60 2023-12-24T20:03:57.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42ca7fc700 1 -- 172.21.15.61:0/2601677149 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c40245c0 con 0x7f42d415bb60 2023-12-24T20:03:57.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42ca7fc700 1 -- 172.21.15.61:0/2601677149 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4024980 con 0x7f42d415bb60 2023-12-24T20:03:57.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42dc3d3700 1 -- 172.21.15.61:0/2601677149 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d409a230 con 0x7f42d415bb60 2023-12-24T20:03:57.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.463+0000 7f42dc3d3700 1 -- 172.21.15.61:0/2601677149 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d409a7f0 con 0x7f42d415bb60 2023-12-24T20:03:57.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.464+0000 7f42dc3d3700 1 -- 172.21.15.61:0/2601677149 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d409a9b0 con 0x7f42d415bb60 2023-12-24T20:03:57.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.465+0000 7f42ca7fc700 1 -- 172.21.15.61:0/2601677149 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f42c401a420 con 0x7f42d415bb60 2023-12-24T20:03:57.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.465+0000 7f42ca7fc700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f42b8066f30 0x7f42b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:57.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.465+0000 7f42ca7fc700 1 -- 172.21.15.61:0/2601677149 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f42c4086250 con 0x7f42d415bb60 2023-12-24T20:03:57.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.465+0000 7f42da16f700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f42b8066f30 0x7f42b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:57.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.466+0000 7f42da16f700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f42b8066f30 0x7f42b80693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f42d409bc60 tx=0x7f42d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:57.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.469+0000 7f42ca7fc700 1 -- 172.21.15.61:0/2601677149 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42c4053480 con 0x7f42d415bb60 2023-12-24T20:03:57.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.708+0000 7f42dc3d3700 1 -- 172.21.15.61:0/2601677149 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42d406d440 con 0x7f42d415bb60 2023-12-24T20:03:57.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.709+0000 7f42ca7fc700 1 -- 172.21.15.61:0/2601677149 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f42c4056aa0 con 0x7f42d415bb60 2023-12-24T20:03:57.709 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:03:57.709 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3725605380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3725605380},{"type":"v1","addr":"172.21.15.133:6837","nonce":3725605380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":6724,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2558204756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2558204756},{"type":"v1","addr":"172.21.15.133:6836","nonce":2558204756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3124455429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3124455429},{"type":"v1","addr":"172.21.15.61:6834","nonce":3124455429}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:03:47.115082+0000","modified":"2023-12-24T20:03:50.745173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/847871762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":847871762},{"type":"v1","addr":"172.21.15.61:6835","nonce":847871762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T20:03:57.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 -- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f42b8066f30 msgr2=0x7f42b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:57.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f42b8066f30 0x7f42b80693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f42d409bc60 tx=0x7f42d0008040 comp rx=0 tx=0).stop 2023-12-24T20:03:57.711 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 -- 172.21.15.61:0/2601677149 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d415bb60 msgr2=0x7f42d4151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:57.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d415bb60 0x7f42d4151a50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f42d406d8b0 tx=0x7f42c4017000 comp rx=0 tx=0).stop 2023-12-24T20:03:57.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 -- 172.21.15.61:0/2601677149 shutdown_connections 2023-12-24T20:03:57.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f42d4098aa0 0x7f42d4168a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:57.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f42b8066f30 0x7f42b80693e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:57.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d415c470 0x7f42d4151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:57.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 --2- 172.21.15.61:0/2601677149 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f42d415bb60 0x7f42d4151a50 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:57.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 -- 172.21.15.61:0/2601677149 >> 172.21.15.61:0/2601677149 conn(0x7f42d4097a10 msgr2=0x7f42d40a8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:57.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 -- 172.21.15.61:0/2601677149 shutdown_connections 2023-12-24T20:03:57.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.711+0000 7f42dc3d3700 1 -- 172.21.15.61:0/2601677149 wait complete. 2023-12-24T20:03:57.712 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 76 2023-12-24T20:03:57.723 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-24T20:03:57.868 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":7485,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.150436564,"mdsmap_epoch":76,"osdmap_epoch":153,"osdmap_epoch_barrier":151,"uptime":15.198073807} 2023-12-24T20:03:57.869 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 7485, "mdsmap_epoch": 76, "osdmap_epoch": 153, "osdmap_epoch_barrier": 151, "rank_uptime": 10.150436564, "state": "up:active", "uptime": 15.198073807, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:03:57.869 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-24T20:03:57.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.994+0000 7faa5a8f5700 1 Processor -- start 2023-12-24T20:03:57.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.994+0000 7faa5a8f5700 1 -- start start 2023-12-24T20:03:57.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.994+0000 7faa5a8f5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faa5406b2c0 0x7faa5406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.994+0000 7faa5a8f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa54158be0 0x7faa5415b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.994+0000 7faa5a8f5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa54157ec0 con 0x7faa5406f540 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.994+0000 7faa5a8f5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa540b03a0 con 0x7faa5406b2c0 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.994+0000 7faa5a8f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5415c1b0 con 0x7faa54158be0 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa537fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faa5406b2c0 0x7faa5406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa53fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7faa5406f540 0x7faa5406abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44066/0 (socket says 172.21.15.61:44066) 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa53fff700 1 -- 172.21.15.61:0/527890012 learned_addr learned my addr 172.21.15.61:0/527890012 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa58e92700 1 --2- 172.21.15.61:0/527890012 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa54158be0 0x7faa5415b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa537fe700 1 -- 172.21.15.61:0/527890012 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa54158be0 msgr2=0x7faa5415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa537fe700 1 --2- 172.21.15.61:0/527890012 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa54158be0 0x7faa5415b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:57.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa537fe700 1 -- 172.21.15.61:0/527890012 >> v1:172.21.15.61:6789/0 conn(0x7faa5406f540 legacy=0x7faa5406abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:57.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa537fe700 1 -- 172.21.15.61:0/527890012 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54158100 con 0x7faa5406b2c0 2023-12-24T20:03:57.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa52ffd700 1 -- 172.21.15.61:0/527890012 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416435176 0 0) 0x7faa44001110 con 0x7faa5406f540 2023-12-24T20:03:57.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa537fe700 1 --2- 172.21.15.61:0/527890012 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa5406b2c0 0x7faa5406f910 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7faa480098e0 tx=0x7faa480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0031ec559a96bdc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:57.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa52ffd700 1 -- 172.21.15.61:0/527890012 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800b640 con 0x7faa5406b2c0 2023-12-24T20:03:57.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa52ffd700 1 -- 172.21.15.61:0/527890012 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4800b7a0 con 0x7faa5406b2c0 2023-12-24T20:03:57.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.995+0000 7faa52ffd700 1 -- 172.21.15.61:0/527890012 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800bb40 con 0x7faa5406b2c0 2023-12-24T20:03:58.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.996+0000 7faa5a8f5700 1 -- 172.21.15.61:0/527890012 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa5406b2c0 msgr2=0x7faa5406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:58.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.996+0000 7faa5a8f5700 1 --2- 172.21.15.61:0/527890012 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa5406b2c0 0x7faa5406f910 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7faa480098e0 tx=0x7faa480091a0 comp rx=0 tx=0).stop 2023-12-24T20:03:58.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.996+0000 7faa5a8f5700 1 -- 172.21.15.61:0/527890012 shutdown_connections 2023-12-24T20:03:58.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.996+0000 7faa5a8f5700 1 --2- 172.21.15.61:0/527890012 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa54158be0 0x7faa5415b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:58.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.996+0000 7faa5a8f5700 1 --2- 172.21.15.61:0/527890012 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa5406b2c0 0x7faa5406f910 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:58.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.996+0000 7faa5a8f5700 1 -- 172.21.15.61:0/527890012 >> 172.21.15.61:0/527890012 conn(0x7faa540ce7d0 msgr2=0x7faa540cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:58.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.996+0000 7faa5a8f5700 1 -- 172.21.15.61:0/527890012 shutdown_connections 2023-12-24T20:03:58.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.996+0000 7faa5a8f5700 1 -- 172.21.15.61:0/527890012 wait complete. 2023-12-24T20:03:58.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.997+0000 7faa5a8f5700 1 Processor -- start 2023-12-24T20:03:58.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.997+0000 7faa5a8f5700 1 -- start start 2023-12-24T20:03:58.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa5a8f5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa5406b2c0 0x7faa5414ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:58.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa5a8f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa5406f540 0x7faa540b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:58.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa5a8f5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa54158be0 0x7faa540af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:58.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa5a8f5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa54152f00 con 0x7faa54158be0 2023-12-24T20:03:58.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa5a8f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa540b2e70 con 0x7faa5406f540 2023-12-24T20:03:58.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa5a8f5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa540b3150 con 0x7faa5406b2c0 2023-12-24T20:03:58.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa53fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa5406b2c0 0x7faa5414ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:58.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa58e92700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa54158be0 0x7faa540af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:58.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa53fff700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa5406b2c0 0x7faa5414ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:50974/0 (socket says 172.21.15.61:50974) 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa58e92700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa54158be0 0x7faa540af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:58842/0 (socket says 172.21.15.61:58842) 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa53fff700 1 -- 172.21.15.61:0/1475065020 learned_addr learned my addr 172.21.15.61:0/1475065020 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa537fe700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa5406f540 0x7faa540b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa53fff700 1 -- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa5406f540 msgr2=0x7faa540b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa53fff700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa5406f540 0x7faa540b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa53fff700 1 -- 172.21.15.61:0/1475065020 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa54158be0 msgr2=0x7faa540af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa53fff700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa54158be0 0x7faa540af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa53fff700 1 -- 172.21.15.61:0/1475065020 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48009420 con 0x7faa5406b2c0 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.998+0000 7faa58e92700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa54158be0 0x7faa540af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.999+0000 7faa53fff700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa5406b2c0 0x7faa5414ad30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faa4400c810 tx=0x7faa44007c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:58.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.999+0000 7faa3bfff700 1 -- 172.21.15.61:0/1475065020 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44005b30 con 0x7faa5406b2c0 2023-12-24T20:03:58.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.999+0000 7faa3bfff700 1 -- 172.21.15.61:0/1475065020 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44005c90 con 0x7faa5406b2c0 2023-12-24T20:03:58.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.999+0000 7faa5a8f5700 1 -- 172.21.15.61:0/1475065020 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa540b3430 con 0x7faa5406b2c0 2023-12-24T20:03:58.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.999+0000 7faa3bfff700 1 -- 172.21.15.61:0/1475065020 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44007300 con 0x7faa5406b2c0 2023-12-24T20:03:58.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:57.999+0000 7faa5a8f5700 1 -- 172.21.15.61:0/1475065020 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5414b270 con 0x7faa5406b2c0 2023-12-24T20:03:58.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.000+0000 7faa5a8f5700 1 -- 172.21.15.61:0/1475065020 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5404c3c0 con 0x7faa5406b2c0 2023-12-24T20:03:58.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.000+0000 7faa3bfff700 1 -- 172.21.15.61:0/1475065020 <== mon.2 v2:172.21.15.133:3301/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7faa4401b3b0 con 0x7faa5406b2c0 2023-12-24T20:03:58.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.001+0000 7faa3bfff700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa40066f30 0x7faa400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:03:58.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.001+0000 7faa3bfff700 1 -- 172.21.15.61:0/1475065020 <== mon.2 v2:172.21.15.133:3301/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5763+0+0 (secure 0 0 0) 0x7faa44083980 con 0x7faa5406b2c0 2023-12-24T20:03:58.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.001+0000 7faa537fe700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa40066f30 0x7faa400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:03:58.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.001+0000 7faa537fe700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa40066f30 0x7faa400693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faa5406b6c0 tx=0x7faa48017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:03:58.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.005+0000 7faa3bfff700 1 -- 172.21.15.61:0/1475065020 <== mon.2 v2:172.21.15.133:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa44050b90 con 0x7faa5406b2c0 2023-12-24T20:03:58.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.204+0000 7faa5a8f5700 1 -- 172.21.15.61:0/1475065020 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7faa54157ec0 con 0x7faa5406b2c0 2023-12-24T20:03:58.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.798+0000 7faa3bfff700 1 -- 172.21.15.61:0/1475065020 <== mon.2 v2:172.21.15.133:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v154) v1 ==== 181+0+0 (secure 0 0 0) 0x7faa54157ec0 con 0x7faa5406b2c0 2023-12-24T20:03:58.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 -- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa40066f30 msgr2=0x7faa400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:58.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa40066f30 0x7faa400693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7faa5406b6c0 tx=0x7faa48017000 comp rx=0 tx=0).stop 2023-12-24T20:03:58.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 -- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa5406b2c0 msgr2=0x7faa5414ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:03:58.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa5406b2c0 0x7faa5414ad30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faa4400c810 tx=0x7faa44007c50 comp rx=0 tx=0).stop 2023-12-24T20:03:58.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 -- 172.21.15.61:0/1475065020 shutdown_connections 2023-12-24T20:03:58.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faa5406b2c0 0x7faa5414ad30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:58.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faa40066f30 0x7faa400693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:58.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faa54158be0 0x7faa540af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:58.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 --2- 172.21.15.61:0/1475065020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa5406f540 0x7faa540b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:03:58.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 -- 172.21.15.61:0/1475065020 >> 172.21.15.61:0/1475065020 conn(0x7faa540ce7d0 msgr2=0x7faa54152580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:03:58.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 -- 172.21.15.61:0/1475065020 shutdown_connections 2023-12-24T20:03:58.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:03:58.801+0000 7faa5a8f5700 1 -- 172.21.15.61:0/1475065020 wait complete. 2023-12-24T20:03:58.802 INFO:teuthology.orchestra.run.smithi061.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-24T20:03:58.816 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-24T20:03:58.959 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_mon_report_interval":"5"} 2023-12-24T20:03:58.959 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-24T20:03:58.960 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-24T20:03:59.089 INFO:teuthology.orchestra.run.smithi061.stdout:{"mon_tick_interval":"5"} 2023-12-24T20:03:59.089 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-24T20:03:59.090 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> import time 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> import datetime 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> # Write some buffered data through before going full, all should be well 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> print("writing some data through which we expect to succeed") 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> bytes = 0 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-12-24T20:03:59.090 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(f) 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> # buffered IO, the error should always only appear from fsync and not 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> # from write 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> full = False 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> for n in range(0, int(32 * 0.9)): 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> print("done writing {0} bytes".format(bytes)) 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> # OK, now we should sneak in under the full condition 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> # due to the time it takes the OSDs to report to the 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> # mons, and get a successful fsync on our full-making data 2023-12-24T20:03:59.091 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(f) 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> # buffered write, add more dirty data to the buffer 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> print("starting buffered write") 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> try: 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> for n in range(0, int(32 * 0.2)): 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> time.sleep(15.0) 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> except OSError: 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> pass; 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> # Wait long enough for a background flush that should fail 2023-12-24T20:03:59.092 DEBUG:teuthology.orchestra.run.smithi061:> time.sleep(30) 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> if True: 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> # ...and check that the failed background flush is reflected in fclose 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> try: 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> os.close(f) 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> except OSError: 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> print("close() returned an error as expected") 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> else: 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("close() failed to raise error") 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> else: 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> # The kernel cephfs client does not raise errors on fclose 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> os.close(f) 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-24T20:03:59.093 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:04:06.440 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:04:06.443 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:04:36.509 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:04:36.513 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:05:06.582 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:05:06.585 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:05:36.672 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:05:36.675 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:05:47.871 INFO:teuthology.orchestra.run.smithi061.stdout:writing some data through which we expect to succeed 2023-12-24T20:05:47.871 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-24T20:05:47.871 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-12-24T20:05:47.871 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-12-24T20:05:47.871 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-12-24T20:05:47.872 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:done writing 29884416 bytes 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:successfully fsync'ed prior to getting full state reported 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:starting buffered write 2023-12-24T20:05:47.873 INFO:teuthology.orchestra.run.smithi061.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-24T20:05:47.874 INFO:teuthology.orchestra.run.smithi061.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-24T20:05:47.874 INFO:teuthology.orchestra.run.smithi061.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-24T20:05:47.874 INFO:teuthology.orchestra.run.smithi061.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-24T20:05:47.874 INFO:teuthology.orchestra.run.smithi061.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-24T20:05:47.874 INFO:teuthology.orchestra.run.smithi061.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-12-24T20:05:47.874 INFO:teuthology.orchestra.run.smithi061.stdout:close() returned an error as expected 2023-12-24T20:05:47.919 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:05:47.919 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:05:47.973 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:05:48.025 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:05:48.025 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T20:05:48.026 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:05:48.026 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T20:05:48.079 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[70299]: fuse finished with error 0 and tester_r 0 2023-12-24T20:05:48.080 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:05:48.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:05:48.081 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:05:48.209 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T20:05:48.209 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:05:48.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T20:05:48.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[47912]: fuse finished with error 0 and tester_r 0 2023-12-24T20:05:48.257 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:05:48.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:05:48.257 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T20:05:48.388 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:05:48.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:05:48.388 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T20:05:48.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:05:48.410 INFO:teuthology.orchestra.run.smithi061.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-24T20:05:48.410 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:05:48.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:05:48.410 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T20:05:48.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:05:48.447 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-24T20:05:48.448 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:05:48.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.584+0000 7faf0cbda700 1 Processor -- start 2023-12-24T20:05:48.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.584+0000 7faf0cbda700 1 -- start start 2023-12-24T20:05:48.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.585+0000 7faf0cbda700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faf0815bb60 0x7faf08098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.585+0000 7faf0cbda700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf080b2660 0x7faf080b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.585+0000 7faf0cbda700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf080b2eb0 con 0x7faf08098aa0 2023-12-24T20:05:48.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.585+0000 7faf0cbda700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080afc20 con 0x7faf0815bb60 2023-12-24T20:05:48.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.585+0000 7faf0cbda700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080b2bd0 con 0x7faf080b2660 2023-12-24T20:05:48.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0659c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faf0815bb60 0x7faf08098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:48.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0659c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faf0815bb60 0x7faf08098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35014/0 (socket says 172.21.15.61:35014) 2023-12-24T20:05:48.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0659c700 1 -- 172.21.15.61:0/2724528039 learned_addr learned my addr 172.21.15.61:0/2724528039 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf06d9d700 1 --2- 172.21.15.61:0/2724528039 >> v2:172.21.15.133:3300/0 conn(0x7faf080b2660 0x7faf080b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0659c700 1 -- 172.21.15.61:0/2724528039 >> v2:172.21.15.133:3300/0 conn(0x7faf080b2660 msgr2=0x7faf080b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0659c700 1 --2- 172.21.15.61:0/2724528039 >> v2:172.21.15.133:3300/0 conn(0x7faf080b2660 0x7faf080b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0659c700 1 -- 172.21.15.61:0/2724528039 >> v1:172.21.15.133:6789/0 conn(0x7faf08098aa0 legacy=0x7faf0815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0659c700 1 -- 172.21.15.61:0/2724528039 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf080afe10 con 0x7faf0815bb60 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0659c700 1 --2- 172.21.15.61:0/2724528039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 0x7faf08098560 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7faf080a9750 tx=0x7faef0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe43558df47dfd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0559a700 1 -- 172.21.15.61:0/2724528039 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0005c10 con 0x7faf0815bb60 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0559a700 1 -- 172.21.15.61:0/2724528039 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef0005d70 con 0x7faf0815bb60 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.586+0000 7faf0559a700 1 -- 172.21.15.61:0/2724528039 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef000b880 con 0x7faf0815bb60 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.587+0000 7faf0cbda700 1 -- 172.21.15.61:0/2724528039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 msgr2=0x7faf08098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:48.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.587+0000 7faf0cbda700 1 --2- 172.21.15.61:0/2724528039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 0x7faf08098560 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7faf080a9750 tx=0x7faef0009220 comp rx=0 tx=0).stop 2023-12-24T20:05:48.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.587+0000 7faf0cbda700 1 -- 172.21.15.61:0/2724528039 shutdown_connections 2023-12-24T20:05:48.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.587+0000 7faf0cbda700 1 --2- 172.21.15.61:0/2724528039 >> v2:172.21.15.133:3300/0 conn(0x7faf080b2660 0x7faf080b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.587+0000 7faf0cbda700 1 --2- 172.21.15.61:0/2724528039 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 0x7faf08098560 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.587+0000 7faf0cbda700 1 -- 172.21.15.61:0/2724528039 >> 172.21.15.61:0/2724528039 conn(0x7faf08097a10 msgr2=0x7faf080ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:48.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.587+0000 7faf0cbda700 1 -- 172.21.15.61:0/2724528039 shutdown_connections 2023-12-24T20:05:48.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.587+0000 7faf0cbda700 1 -- 172.21.15.61:0/2724528039 wait complete. 2023-12-24T20:05:48.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.588+0000 7faf0cbda700 1 Processor -- start 2023-12-24T20:05:48.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.588+0000 7faf0cbda700 1 -- start start 2023-12-24T20:05:48.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf0cbda700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf08098aa0 0x7faf0814ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf0cbda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080b2660 0x7faf0815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf0cbda700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 0x7faf0815c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf0cbda700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0816a740 con 0x7faf0815bb60 2023-12-24T20:05:48.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf0cbda700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf08068e80 con 0x7faf080b2660 2023-12-24T20:05:48.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf0cbda700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0815d340 con 0x7faf08098aa0 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf06d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 0x7faf0815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf06d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 0x7faf0815c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35020/0 (socket says 172.21.15.61:35020) 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf06d9d700 1 -- 172.21.15.61:0/1440388559 learned_addr learned my addr 172.21.15.61:0/1440388559 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf05d9b700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080b2660 0x7faf0815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf0659c700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf08098aa0 0x7faf0814ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf06d9d700 1 -- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf08098aa0 msgr2=0x7faf0814ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf06d9d700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf08098aa0 0x7faf0814ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf06d9d700 1 -- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080b2660 msgr2=0x7faf0815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf06d9d700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080b2660 0x7faf0815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.589+0000 7faf06d9d700 1 -- 172.21.15.61:0/1440388559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef0009480 con 0x7faf0815bb60 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.590+0000 7faf0659c700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf08098aa0 0x7faf0814ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.590+0000 7faf05d9b700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080b2660 0x7faf0815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:48.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.590+0000 7faf06d9d700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 0x7faf0815c470 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7faf00009fd0 tx=0x7faf00009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.590+0000 7faefe7fc700 1 -- 172.21.15.61:0/1440388559 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000ed50 con 0x7faf0815bb60 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.590+0000 7faefe7fc700 1 -- 172.21.15.61:0/1440388559 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000eeb0 con 0x7faf0815bb60 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.590+0000 7faefe7fc700 1 -- 172.21.15.61:0/1440388559 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00014650 con 0x7faf0815bb60 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.590+0000 7faf0cbda700 1 -- 172.21.15.61:0/1440388559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0815caa0 con 0x7faf0815bb60 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.590+0000 7faf0cbda700 1 -- 172.21.15.61:0/1440388559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0815d060 con 0x7faf0815bb60 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.591+0000 7faf0cbda700 1 -- 172.21.15.61:0/1440388559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0806d440 con 0x7faf0815bb60 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.592+0000 7faefe7fc700 1 -- 172.21.15.61:0/1440388559 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7faf00014a00 con 0x7faf0815bb60 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.592+0000 7faefe7fc700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faee8066f30 0x7faee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.592+0000 7faefe7fc700 1 -- 172.21.15.61:0/1440388559 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7faf00084c80 con 0x7faf0815bb60 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.592+0000 7faefe7fc700 1 -- 172.21.15.61:0/1440388559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7faee806eb10 con 0x7faf0815bb60 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.592+0000 7faf0659c700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faee8066f30 0x7faee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:48.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.593+0000 7faf0659c700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faee8066f30 0x7faee80693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faef0009260 tx=0x7faef0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:48.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.596+0000 7faefe7fc700 1 -- 172.21.15.61:0/1440388559 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf00051eb0 con 0x7faf0815bb60 2023-12-24T20:05:48.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.840+0000 7faf0cbda700 1 -- 172.21.15.61:0/1440388559 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf0804c3c0 con 0x7faf0815bb60 2023-12-24T20:05:48.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.841+0000 7faefe7fc700 1 -- 172.21.15.61:0/1440388559 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4602 (secure 0 0 0) 0x7faf00009990 con 0x7faf0815bb60 2023-12-24T20:05:48.841 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:05:48.841 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3725605380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3725605380},{"type":"v1","addr":"172.21.15.133:6837","nonce":3725605380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":6724,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2558204756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2558204756},{"type":"v1","addr":"172.21.15.133:6836","nonce":2558204756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3124455429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3124455429},{"type":"v1","addr":"172.21.15.61:6834","nonce":3124455429}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:03:47.115082+0000","modified":"2023-12-24T20:03:50.745173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/847871762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":847871762},{"type":"v1","addr":"172.21.15.61:6835","nonce":847871762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T20:05:48.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 -- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faee8066f30 msgr2=0x7faee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:48.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faee8066f30 0x7faee80693e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7faef0009260 tx=0x7faef0016000 comp rx=0 tx=0).stop 2023-12-24T20:05:48.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 -- 172.21.15.61:0/1440388559 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 msgr2=0x7faf0815c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:48.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 0x7faf0815c470 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7faf00009fd0 tx=0x7faf00009900 comp rx=0 tx=0).stop 2023-12-24T20:05:48.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 -- 172.21.15.61:0/1440388559 shutdown_connections 2023-12-24T20:05:48.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7faf08098aa0 0x7faf0814ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7faee8066f30 0x7faee80693e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faf0815bb60 0x7faf0815c470 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 --2- 172.21.15.61:0/1440388559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf080b2660 0x7faf0815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 -- 172.21.15.61:0/1440388559 >> 172.21.15.61:0/1440388559 conn(0x7faf08097a10 msgr2=0x7faf0806b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:48.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 -- 172.21.15.61:0/1440388559 shutdown_connections 2023-12-24T20:05:48.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.843+0000 7faf0cbda700 1 -- 172.21.15.61:0/1440388559 wait complete. 2023-12-24T20:05:48.844 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 76 2023-12-24T20:05:48.856 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:05:48.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.986+0000 7f4532c71700 1 Processor -- start 2023-12-24T20:05:48.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.986+0000 7f4532c71700 1 -- start start 2023-12-24T20:05:48.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.987+0000 7f4532c71700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c159850 0x7f452c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.987+0000 7f4532c71700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452c06a630 con 0x7f452c0caa80 2023-12-24T20:05:48.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.987+0000 7f4532c71700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452c069d00 con 0x7f452c06aac0 2023-12-24T20:05:48.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.987+0000 7f4532c71700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0cccf0 con 0x7f452c159850 2023-12-24T20:05:48.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.987+0000 7f453120e700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f452c0caa80 0x7f452c0aa880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:54850/0 (socket says 172.21.15.61:54850) 2023-12-24T20:05:48.995 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.987+0000 7f453120e700 1 -- 172.21.15.61:0/3883402112 learned_addr learned my addr 172.21.15.61:0/3883402112 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:48.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f4530a0d700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c159850 0x7f452c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:48.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177964218 0 0) 0x7f452c06a630 con 0x7f452c0caa80 2023-12-24T20:05:48.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f451c003570 con 0x7f452c0caa80 2023-12-24T20:05:48.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3047434037 0 0) 0x7f451c003570 con 0x7f452c0caa80 2023-12-24T20:05:48.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c159850 msgr2=0x7f452c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:48.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c159850 0x7f452c159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 >> v1:172.21.15.133:6789/0 conn(0x7f452c06aac0 legacy=0x7f452c0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:48.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c069fe0 con 0x7f452c0caa80 2023-12-24T20:05:48.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f45240017f0 con 0x7f452c0caa80 2023-12-24T20:05:48.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 >> v1:172.21.15.61:6789/0 conn(0x7f452c0caa80 legacy=0x7f452c0aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c159850 0x7f451c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f451c003fd0 0x7f451c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f451c004d50 0x7f451c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0cccf0 con 0x7f451c004d50 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c00bb40 con 0x7f451c003fd0 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c00bd00 con 0x7f452c159850 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f453120e700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f451c004d50 0x7f451c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f4530a0d700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c159850 0x7f451c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.988+0000 7f452bfff700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f451c003fd0 0x7f451c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f453120e700 1 -- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c159850 msgr2=0x7f451c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:48.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f453120e700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c159850 0x7f451c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f453120e700 1 -- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f451c003fd0 msgr2=0x7f451c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:48.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f453120e700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f451c003fd0 0x7f451c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f453120e700 1 -- 172.21.15.61:0/3883402112 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c003570 con 0x7f451c004d50 2023-12-24T20:05:48.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f453120e700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f451c004d50 0x7f451c0051c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f452400a920 tx=0x7f45240021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883f63e2d2721e45 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:48.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45240070d0 con 0x7f451c004d50 2023-12-24T20:05:48.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4524007230 con 0x7f451c004d50 2023-12-24T20:05:48.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f452b7fe700 1 -- 172.21.15.61:0/3883402112 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45240075f0 con 0x7f451c004d50 2023-12-24T20:05:48.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f4532c71700 1 -- 172.21.15.61:0/3883402112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f451c004d50 msgr2=0x7f451c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f4532c71700 1 --2- 172.21.15.61:0/3883402112 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f451c004d50 0x7f451c0051c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f452400a920 tx=0x7f45240021f0 comp rx=0 tx=0).stop 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f453120e700 1 -- 172.21.15.61:0/3883402112 reap_dead start 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f4532c71700 1 -- 172.21.15.61:0/3883402112 shutdown_connections 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f4532c71700 1 -- 172.21.15.61:0/3883402112 >> 172.21.15.61:0/3883402112 conn(0x7f452c0cceb0 msgr2=0x7f452c0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f4532c71700 1 -- 172.21.15.61:0/3883402112 shutdown_connections 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.989+0000 7f4532c71700 1 -- 172.21.15.61:0/3883402112 wait complete. 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.991+0000 7f4532c71700 1 Processor -- start 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.991+0000 7f4532c71700 1 -- start start 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.991+0000 7f4532c71700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c0b1ba0 0x7f452c0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.991+0000 7f4532c71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f452c169b10 0x7f452c16d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:48.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.991+0000 7f4532c71700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f452c16d650 0x7f452c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.991+0000 7f4532c71700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0ac8b0 con 0x7f452c16d650 2023-12-24T20:05:49.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.991+0000 7f4532c71700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0ace00 con 0x7f452c169b10 2023-12-24T20:05:49.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.991+0000 7f4532c71700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c16db90 con 0x7f452c0b1ba0 2023-12-24T20:05:49.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f453120e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f452c16d650 0x7f452c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f453120e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f452c16d650 0x7f452c154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35030/0 (socket says 172.21.15.61:35030) 2023-12-24T20:05:49.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f453120e700 1 -- 172.21.15.61:0/4250546190 learned_addr learned my addr 172.21.15.61:0/4250546190 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:49.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f4530a0d700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c0b1ba0 0x7f452c0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f452bfff700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f452c169b10 0x7f452c16d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f453120e700 1 -- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c0b1ba0 msgr2=0x7f452c0b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f453120e700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c0b1ba0 0x7f452c0b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f453120e700 1 -- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f452c169b10 msgr2=0x7f452c16d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f453120e700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f452c169b10 0x7f452c16d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f453120e700 1 -- 172.21.15.61:0/4250546190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c16de70 con 0x7f452c16d650 2023-12-24T20:05:49.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f453120e700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f452c16d650 0x7f452c154180 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f452400a410 tx=0x7f4524015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:49.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f4528ff9700 1 -- 172.21.15.61:0/4250546190 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524023070 con 0x7f452c16d650 2023-12-24T20:05:49.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f4528ff9700 1 -- 172.21.15.61:0/4250546190 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452401e450 con 0x7f452c16d650 2023-12-24T20:05:49.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f4532c71700 1 -- 172.21.15.61:0/4250546190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452c0aca90 con 0x7f452c16d650 2023-12-24T20:05:49.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f4528ff9700 1 -- 172.21.15.61:0/4250546190 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452401e810 con 0x7f452c16d650 2023-12-24T20:05:49.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.992+0000 7f4532c71700 1 -- 172.21.15.61:0/4250546190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c169f80 con 0x7f452c16d650 2023-12-24T20:05:49.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.993+0000 7f4532c71700 1 -- 172.21.15.61:0/4250546190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452c0acfb0 con 0x7f452c16d650 2023-12-24T20:05:49.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.994+0000 7f4528ff9700 1 -- 172.21.15.61:0/4250546190 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f452401ebc0 con 0x7f452c16d650 2023-12-24T20:05:49.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.994+0000 7f4528ff9700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4510066f30 0x7f45100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.994+0000 7f4528ff9700 1 -- 172.21.15.61:0/4250546190 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f4524086620 con 0x7f452c16d650 2023-12-24T20:05:49.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.994+0000 7f4528ff9700 1 -- 172.21.15.61:0/4250546190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f451006eb10 con 0x7f452c16d650 2023-12-24T20:05:49.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.994+0000 7f4530a0d700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4510066f30 0x7f45100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.995+0000 7f4530a0d700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4510066f30 0x7f45100693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4520006f00 tx=0x7f4520008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:49.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:48.998+0000 7f4528ff9700 1 -- 172.21.15.61:0/4250546190 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f452c0acfb0 con 0x7f452c16d650 2023-12-24T20:05:49.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.193+0000 7f4532c71700 1 -- 172.21.15.61:0/4250546190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f452c0acf70 con 0x7f452c16d650 2023-12-24T20:05:49.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.194+0000 7f4528ff9700 1 -- 172.21.15.61:0/4250546190 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+15488 (secure 0 0 0) 0x7f4524053850 con 0x7f452c16d650 2023-12-24T20:05:49.194 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:05:49.194 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":155,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:04:58.587541+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:03:45.538509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-24T20:03:46.090556+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.a","mappings":[{"from":2,"to":0}]},{"pgid":"19.16","mappings":[{"from":2,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:05:49.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 -- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4510066f30 msgr2=0x7f45100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4510066f30 0x7f45100693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4520006f00 tx=0x7f4520008040 comp rx=0 tx=0).stop 2023-12-24T20:05:49.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 -- 172.21.15.61:0/4250546190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f452c16d650 msgr2=0x7f452c154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f452c16d650 0x7f452c154180 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f452400a410 tx=0x7f4524015000 comp rx=0 tx=0).stop 2023-12-24T20:05:49.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 -- 172.21.15.61:0/4250546190 shutdown_connections 2023-12-24T20:05:49.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f452c0b1ba0 0x7f452c0b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4510066f30 0x7f45100693e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f452c16d650 0x7f452c154180 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 --2- 172.21.15.61:0/4250546190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f452c169b10 0x7f452c16d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 -- 172.21.15.61:0/4250546190 >> 172.21.15.61:0/4250546190 conn(0x7f452c0cceb0 msgr2=0x7f452c1563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:49.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 -- 172.21.15.61:0/4250546190 shutdown_connections 2023-12-24T20:05:49.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.196+0000 7f4532c71700 1 -- 172.21.15.61:0/4250546190 wait complete. 2023-12-24T20:05:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T20:03:45.538509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T20:03:46.090556+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:05:49.210 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:05:49.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.335+0000 7f7e1fe78700 1 Processor -- start 2023-12-24T20:05:49.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.335+0000 7f7e1fe78700 1 -- start start 2023-12-24T20:05:49.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.336+0000 7f7e1fe78700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 0x7f7e180cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.336+0000 7f7e1fe78700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e180d0200 con 0x7f7e180cbab0 2023-12-24T20:05:49.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.336+0000 7f7e1fe78700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e180b04c0 con 0x7f7e180b1be0 2023-12-24T20:05:49.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.336+0000 7f7e1fe78700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180d0690 con 0x7f7e180cd600 2023-12-24T20:05:49.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.336+0000 7f7e1d413700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7e180cbab0 0x7f7e180ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:54858/0 (socket says 172.21.15.61:54858) 2023-12-24T20:05:49.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.336+0000 7f7e1d413700 1 -- 172.21.15.61:0/2540064640 learned_addr learned my addr 172.21.15.61:0/2540064640 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:49.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.336+0000 7f7e1dc14700 1 --2- 172.21.15.61:0/2540064640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 0x7f7e180cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.336+0000 7f7e1cc12700 1 -- 172.21.15.61:0/2540064640 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471516111 0 0) 0x7f7e180d0200 con 0x7f7e180cbab0 2023-12-24T20:05:49.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.336+0000 7f7e1cc12700 1 -- 172.21.15.61:0/2540064640 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e00003570 con 0x7f7e180cbab0 2023-12-24T20:05:49.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.337+0000 7f7e1cc12700 1 -- 172.21.15.61:0/2540064640 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227749940 0 0) 0x7f7e180b04c0 con 0x7f7e180b1be0 2023-12-24T20:05:49.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.337+0000 7f7e1cc12700 1 -- 172.21.15.61:0/2540064640 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e180d0200 con 0x7f7e180b1be0 2023-12-24T20:05:49.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.337+0000 7f7e1dc14700 1 -- 172.21.15.61:0/2540064640 >> v1:172.21.15.133:6789/0 conn(0x7f7e180b1be0 legacy=0x7f7e180cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.337+0000 7f7e1dc14700 1 -- 172.21.15.61:0/2540064640 >> v1:172.21.15.61:6789/0 conn(0x7f7e180cbab0 legacy=0x7f7e180ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.337+0000 7f7e1cc12700 1 -- 172.21.15.61:0/2540064640 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1505780392 0 0) 0x7f7e00003570 con 0x7f7e180cbab0 2023-12-24T20:05:49.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.337+0000 7f7e1dc14700 1 -- 172.21.15.61:0/2540064640 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e180cf640 con 0x7f7e180cd600 2023-12-24T20:05:49.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.337+0000 7f7e1dc14700 1 --2- 172.21.15.61:0/2540064640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 0x7f7e180cd9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009910 tx=0x7f7e100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e4e272bc0a43e0d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:49.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.337+0000 7f7e1cc12700 1 -- 172.21.15.61:0/2540064640 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c001470 con 0x7f7e180cd600 2023-12-24T20:05:49.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.337+0000 7f7e1cc12700 1 -- 172.21.15.61:0/2540064640 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e10011420 con 0x7f7e180cd600 2023-12-24T20:05:49.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.337+0000 7f7e1cc12700 1 -- 172.21.15.61:0/2540064640 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100117c0 con 0x7f7e180cd600 2023-12-24T20:05:49.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.338+0000 7f7e1fe78700 1 -- 172.21.15.61:0/2540064640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 msgr2=0x7f7e180cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.338+0000 7f7e1fe78700 1 --2- 172.21.15.61:0/2540064640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 0x7f7e180cd9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009910 tx=0x7f7e100091a0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.338+0000 7f7e1fe78700 1 -- 172.21.15.61:0/2540064640 shutdown_connections 2023-12-24T20:05:49.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.338+0000 7f7e1fe78700 1 --2- 172.21.15.61:0/2540064640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 0x7f7e180cd9d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.338+0000 7f7e1fe78700 1 -- 172.21.15.61:0/2540064640 >> 172.21.15.61:0/2540064640 conn(0x7f7e1806e600 msgr2=0x7f7e18067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:49.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.338+0000 7f7e1fe78700 1 -- 172.21.15.61:0/2540064640 shutdown_connections 2023-12-24T20:05:49.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.338+0000 7f7e1fe78700 1 -- 172.21.15.61:0/2540064640 wait complete. 2023-12-24T20:05:49.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.339+0000 7f7e1fe78700 1 Processor -- start 2023-12-24T20:05:49.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.339+0000 7f7e1fe78700 1 -- start start 2023-12-24T20:05:49.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.340+0000 7f7e1fe78700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7e180b1be0 0x7f7e181559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.340+0000 7f7e1fe78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e180cbab0 0x7f7e180b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.340+0000 7f7e1fe78700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 0x7f7e180c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.340+0000 7f7e1fe78700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180c80e0 con 0x7f7e180b1be0 2023-12-24T20:05:49.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.340+0000 7f7e1fe78700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e18155f30 con 0x7f7e180cbab0 2023-12-24T20:05:49.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.340+0000 7f7e1fe78700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e180b3df0 con 0x7f7e180cd600 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.340+0000 7f7e1dc14700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7e180b1be0 0x7f7e181559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.340+0000 7f7e1dc14700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7e180b1be0 0x7f7e181559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35038/0 (socket says 172.21.15.61:35038) 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.340+0000 7f7e1dc14700 1 -- 172.21.15.61:0/364597953 learned_addr learned my addr 172.21.15.61:0/364597953 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e1d413700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e180cbab0 0x7f7e180b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e1e415700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 0x7f7e180c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e1dc14700 1 -- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 msgr2=0x7f7e180c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e1dc14700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 0x7f7e180c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e1dc14700 1 -- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e180cbab0 msgr2=0x7f7e180b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e1dc14700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e180cbab0 0x7f7e180b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e1dc14700 1 -- 172.21.15.61:0/364597953 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10009420 con 0x7f7e180b1be0 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e1dc14700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7e180b1be0 0x7f7e181559f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009860 tx=0x7f7e10016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e15ffb700 1 -- 172.21.15.61:0/364597953 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1001cc90 con 0x7f7e180b1be0 2023-12-24T20:05:49.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e15ffb700 1 -- 172.21.15.61:0/364597953 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1001cdf0 con 0x7f7e180b1be0 2023-12-24T20:05:49.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e1fe78700 1 -- 172.21.15.61:0/364597953 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e180b40d0 con 0x7f7e180b1be0 2023-12-24T20:05:49.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e15ffb700 1 -- 172.21.15.61:0/364597953 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1001a6a0 con 0x7f7e180b1be0 2023-12-24T20:05:49.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.341+0000 7f7e1fe78700 1 -- 172.21.15.61:0/364597953 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e180b4690 con 0x7f7e180b1be0 2023-12-24T20:05:49.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.342+0000 7f7e1fe78700 1 -- 172.21.15.61:0/364597953 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e18089040 con 0x7f7e180b1be0 2023-12-24T20:05:49.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.343+0000 7f7e15ffb700 1 -- 172.21.15.61:0/364597953 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7e1001aad0 con 0x7f7e180b1be0 2023-12-24T20:05:49.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.343+0000 7f7e15ffb700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7e04066f30 0x7f7e040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.343+0000 7f7e15ffb700 1 -- 172.21.15.61:0/364597953 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7e10086360 con 0x7f7e180b1be0 2023-12-24T20:05:49.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.343+0000 7f7e15ffb700 1 -- 172.21.15.61:0/364597953 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f7e0406eb10 con 0x7f7e180b1be0 2023-12-24T20:05:49.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.343+0000 7f7e1d413700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7e04066f30 0x7f7e040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.344+0000 7f7e1d413700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7e04066f30 0x7f7e040693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7e180ca200 tx=0x7f7e0c0015c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:49.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.348+0000 7f7e15ffb700 1 -- 172.21.15.61:0/364597953 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e10053590 con 0x7f7e180b1be0 2023-12-24T20:05:49.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.539+0000 7f7e1fe78700 1 -- 172.21.15.61:0/364597953 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e180b4ce0 con 0x7f7e180b1be0 2023-12-24T20:05:49.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.540+0000 7f7e15ffb700 1 -- 172.21.15.61:0/364597953 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e10056bb0 con 0x7f7e180b1be0 2023-12-24T20:05:49.542 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:05:49.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.541+0000 7f7e1fe78700 1 -- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7e04066f30 msgr2=0x7f7e040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.541+0000 7f7e1fe78700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7e04066f30 0x7f7e040693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7e180ca200 tx=0x7f7e0c0015c0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.541+0000 7f7e1fe78700 1 -- 172.21.15.61:0/364597953 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7e180b1be0 msgr2=0x7f7e181559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.541+0000 7f7e1fe78700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7e180b1be0 0x7f7e181559f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009860 tx=0x7f7e10016000 comp rx=0 tx=0).stop 2023-12-24T20:05:49.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.542+0000 7f7e1fe78700 1 -- 172.21.15.61:0/364597953 shutdown_connections 2023-12-24T20:05:49.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.542+0000 7f7e1fe78700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7e180cd600 0x7f7e180c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.542+0000 7f7e1fe78700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7e04066f30 0x7f7e040693e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.542+0000 7f7e1fe78700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7e180b1be0 0x7f7e181559f0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.542+0000 7f7e1fe78700 1 --2- 172.21.15.61:0/364597953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e180cbab0 0x7f7e180b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.542+0000 7f7e1fe78700 1 -- 172.21.15.61:0/364597953 >> 172.21.15.61:0/364597953 conn(0x7f7e1806e600 msgr2=0x7f7e181587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:49.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.542+0000 7f7e1fe78700 1 -- 172.21.15.61:0/364597953 shutdown_connections 2023-12-24T20:05:49.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.542+0000 7f7e1fe78700 1 -- 172.21.15.61:0/364597953 wait complete. 2023-12-24T20:05:49.554 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:05:49.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.678+0000 7f7799e57700 1 Processor -- start 2023-12-24T20:05:49.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.679+0000 7f7799e57700 1 -- start start 2023-12-24T20:05:49.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.679+0000 7f7799e57700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7794159df0 0x7f77940cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.679+0000 7f7799e57700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77940cc0e0 0x7f77940cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.679+0000 7f7799e57700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77940cf150 con 0x7f779415a1c0 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.679+0000 7f7799e57700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77940cc5f0 con 0x7f77940cc0e0 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.679+0000 7f7799e57700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77940ce820 con 0x7f7794159df0 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.680+0000 7f77937fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7794159df0 0x7f77940cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.680+0000 7f77937fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7794159df0 0x7f77940cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:45476/0 (socket says 172.21.15.61:45476) 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.680+0000 7f77937fe700 1 -- 172.21.15.61:0/2451151305 learned_addr learned my addr 172.21.15.61:0/2451151305 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.680+0000 7f7793fff700 1 --2- 172.21.15.61:0/2451151305 >> v2:172.21.15.133:3300/0 conn(0x7f77940cc0e0 0x7f77940cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.680+0000 7f77937fe700 1 -- 172.21.15.61:0/2451151305 >> v2:172.21.15.133:3300/0 conn(0x7f77940cc0e0 msgr2=0x7f77940cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.680+0000 7f77937fe700 1 --2- 172.21.15.61:0/2451151305 >> v2:172.21.15.133:3300/0 conn(0x7f77940cc0e0 0x7f77940cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.680+0000 7f77937fe700 1 -- 172.21.15.61:0/2451151305 >> v1:172.21.15.133:6789/0 conn(0x7f779415a1c0 legacy=0x7f77940cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.680+0000 7f77937fe700 1 -- 172.21.15.61:0/2451151305 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77940ceb00 con 0x7f7794159df0 2023-12-24T20:05:49.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.680+0000 7f77937fe700 1 --2- 172.21.15.61:0/2451151305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7794159df0 0x7f77940cbba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f77840099b0 tx=0x7f7784009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5195868599108d5f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:49.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f77927fc700 1 -- 172.21.15.61:0/2451151305 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784009ea0 con 0x7f7794159df0 2023-12-24T20:05:49.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f77927fc700 1 -- 172.21.15.61:0/2451151305 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778400b860 con 0x7f7794159df0 2023-12-24T20:05:49.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f77927fc700 1 -- 172.21.15.61:0/2451151305 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400bc00 con 0x7f7794159df0 2023-12-24T20:05:49.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f7799e57700 1 -- 172.21.15.61:0/2451151305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7794159df0 msgr2=0x7f77940cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f7799e57700 1 --2- 172.21.15.61:0/2451151305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7794159df0 0x7f77940cbba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f77840099b0 tx=0x7f7784009250 comp rx=0 tx=0).stop 2023-12-24T20:05:49.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f7799e57700 1 -- 172.21.15.61:0/2451151305 shutdown_connections 2023-12-24T20:05:49.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f7799e57700 1 --2- 172.21.15.61:0/2451151305 >> v2:172.21.15.133:3300/0 conn(0x7f77940cc0e0 0x7f77940cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f7799e57700 1 --2- 172.21.15.61:0/2451151305 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7794159df0 0x7f77940cbba0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f7799e57700 1 -- 172.21.15.61:0/2451151305 >> 172.21.15.61:0/2451151305 conn(0x7f779406e600 msgr2=0x7f7794067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:49.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f7799e57700 1 -- 172.21.15.61:0/2451151305 shutdown_connections 2023-12-24T20:05:49.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.681+0000 7f7799e57700 1 -- 172.21.15.61:0/2451151305 wait complete. 2023-12-24T20:05:49.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.682+0000 7f7799e57700 1 Processor -- start 2023-12-24T20:05:49.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.683+0000 7f7799e57700 1 -- start start 2023-12-24T20:05:49.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.683+0000 7f7799e57700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77940cc0e0 0x7f7794142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.683+0000 7f7799e57700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7794159df0 0x7f77940b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.683+0000 7f7799e57700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f779415a1c0 0x7f77940b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.683+0000 7f7799e57700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77940b4a90 con 0x7f779415a1c0 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.683+0000 7f7799e57700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77940b4600 con 0x7f7794159df0 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.683+0000 7f7799e57700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77940b39f0 con 0x7f77940cc0e0 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.683+0000 7f7793fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f779415a1c0 0x7f77940b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.683+0000 7f7793fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f779415a1c0 0x7f77940b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35046/0 (socket says 172.21.15.61:35046) 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.683+0000 7f7793fff700 1 -- 172.21.15.61:0/2211197831 learned_addr learned my addr 172.21.15.61:0/2211197831 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f77937fe700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77940cc0e0 0x7f7794142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f7792ffd700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7794159df0 0x7f77940b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f7793fff700 1 -- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77940cc0e0 msgr2=0x7f7794142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f7793fff700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77940cc0e0 0x7f7794142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f7793fff700 1 -- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7794159df0 msgr2=0x7f77940b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f7793fff700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7794159df0 0x7f77940b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f7793fff700 1 -- 172.21.15.61:0/2211197831 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77840094f0 con 0x7f779415a1c0 2023-12-24T20:05:49.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f7792ffd700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7794159df0 0x7f77940b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:49.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f7793fff700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f779415a1c0 0x7f77940b20e0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f778c009ec0 tx=0x7f778c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:49.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f778b7fe700 1 -- 172.21.15.61:0/2211197831 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c00cc20 con 0x7f779415a1c0 2023-12-24T20:05:49.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f778b7fe700 1 -- 172.21.15.61:0/2211197831 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778c00f040 con 0x7f779415a1c0 2023-12-24T20:05:49.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f778b7fe700 1 -- 172.21.15.61:0/2211197831 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778c014480 con 0x7f779415a1c0 2023-12-24T20:05:49.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f7799e57700 1 -- 172.21.15.61:0/2211197831 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77940b3cd0 con 0x7f779415a1c0 2023-12-24T20:05:49.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.684+0000 7f7799e57700 1 -- 172.21.15.61:0/2211197831 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77940b4290 con 0x7f779415a1c0 2023-12-24T20:05:49.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.685+0000 7f7799e57700 1 -- 172.21.15.61:0/2211197831 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7794089040 con 0x7f779415a1c0 2023-12-24T20:05:49.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.685+0000 7f778b7fe700 1 -- 172.21.15.61:0/2211197831 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f778c014810 con 0x7f779415a1c0 2023-12-24T20:05:49.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.686+0000 7f778b7fe700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7774066f30 0x7f77740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:49.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.686+0000 7f778b7fe700 1 -- 172.21.15.61:0/2211197831 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f778c0850c0 con 0x7f779415a1c0 2023-12-24T20:05:49.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.686+0000 7f778b7fe700 1 -- 172.21.15.61:0/2211197831 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f777406eb10 con 0x7f779415a1c0 2023-12-24T20:05:49.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.686+0000 7f77937fe700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7774066f30 0x7f77740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:49.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.687+0000 7f77937fe700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7774066f30 0x7f77740693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f77840099b0 tx=0x7f7784017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:49.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.690+0000 7f778b7fe700 1 -- 172.21.15.61:0/2211197831 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f778c018060 con 0x7f779415a1c0 2023-12-24T20:05:49.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.889+0000 7f7799e57700 1 -- 172.21.15.61:0/2211197831 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f779404c3c0 con 0x7f779415a1c0 2023-12-24T20:05:49.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.889+0000 7f778b7fe700 1 -- 172.21.15.61:0/2211197831 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+11 (secure 0 0 0) 0x7f778c052250 con 0x7f779415a1c0 2023-12-24T20:05:49.890 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T20:05:49.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.891+0000 7f7799e57700 1 -- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7774066f30 msgr2=0x7f77740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.891+0000 7f7799e57700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7774066f30 0x7f77740693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f77840099b0 tx=0x7f7784017000 comp rx=0 tx=0).stop 2023-12-24T20:05:49.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.891+0000 7f7799e57700 1 -- 172.21.15.61:0/2211197831 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f779415a1c0 msgr2=0x7f77940b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:49.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.891+0000 7f7799e57700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f779415a1c0 0x7f77940b20e0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f778c009ec0 tx=0x7f778c00b040 comp rx=0 tx=0).stop 2023-12-24T20:05:49.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.892+0000 7f7799e57700 1 -- 172.21.15.61:0/2211197831 shutdown_connections 2023-12-24T20:05:49.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.892+0000 7f7799e57700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f77940cc0e0 0x7f7794142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.892+0000 7f7799e57700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7774066f30 0x7f77740693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.892+0000 7f7799e57700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f779415a1c0 0x7f77940b20e0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.892+0000 7f7799e57700 1 --2- 172.21.15.61:0/2211197831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7794159df0 0x7f77940b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:49.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.892+0000 7f7799e57700 1 -- 172.21.15.61:0/2211197831 >> 172.21.15.61:0/2211197831 conn(0x7f779406e600 msgr2=0x7f77940c6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:49.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.892+0000 7f7799e57700 1 -- 172.21.15.61:0/2211197831 shutdown_connections 2023-12-24T20:05:49.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:49.892+0000 7f7799e57700 1 -- 172.21.15.61:0/2211197831 wait complete. 2023-12-24T20:05:49.904 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:05:50.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.028+0000 7f22496d2700 1 Processor -- start 2023-12-24T20:05:50.029 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.028+0000 7f22496d2700 1 -- start start 2023-12-24T20:05:50.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.029+0000 7f22496d2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2244157820 0x7f22440cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.029+0000 7f22496d2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f22440aa880 0x7f22440aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.029+0000 7f22496d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244069610 0x7f2244069a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.029+0000 7f22496d2700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224415a290 con 0x7f22440aa880 2023-12-24T20:05:50.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.029+0000 7f22496d2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440ab240 con 0x7f2244157820 2023-12-24T20:05:50.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.029+0000 7f22496d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224415b0b0 con 0x7f2244069610 2023-12-24T20:05:50.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.029+0000 7f22427fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f22440aa880 0x7f22440aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.029+0000 7f22427fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f22440aa880 0x7f22440aad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35054/0 (socket says 172.21.15.61:35054) 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.029+0000 7f22427fc700 1 -- 172.21.15.61:0/2488555050 learned_addr learned my addr 172.21.15.61:0/2488555050 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f2242ffd700 1 --2- 172.21.15.61:0/2488555050 >> v2:172.21.15.133:3300/0 conn(0x7f2244157820 0x7f22440cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f22437fe700 1 --2- 172.21.15.61:0/2488555050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244069610 0x7f2244069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f22427fc700 1 -- 172.21.15.61:0/2488555050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244069610 msgr2=0x7f2244069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f22427fc700 1 --2- 172.21.15.61:0/2488555050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244069610 0x7f2244069a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f22427fc700 1 -- 172.21.15.61:0/2488555050 >> v2:172.21.15.133:3300/0 conn(0x7f2244157820 msgr2=0x7f22440cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f22427fc700 1 --2- 172.21.15.61:0/2488555050 >> v2:172.21.15.133:3300/0 conn(0x7f2244157820 0x7f22440cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f22427fc700 1 -- 172.21.15.61:0/2488555050 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224415a4a0 con 0x7f22440aa880 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f2242ffd700 1 --2- 172.21.15.61:0/2488555050 >> v2:172.21.15.133:3300/0 conn(0x7f2244157820 0x7f22440cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f22437fe700 1 --2- 172.21.15.61:0/2488555050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244069610 0x7f2244069a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f22427fc700 1 --2- 172.21.15.61:0/2488555050 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22440aa880 0x7f22440aad00 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f22440cd010 tx=0x7f2234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef5bc15f24b7805 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f2241ffb700 1 -- 172.21.15.61:0/2488555050 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400b820 con 0x7f22440aa880 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f2241ffb700 1 -- 172.21.15.61:0/2488555050 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223400b980 con 0x7f22440aa880 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f2241ffb700 1 -- 172.21.15.61:0/2488555050 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400bd20 con 0x7f22440aa880 2023-12-24T20:05:50.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f22496d2700 1 -- 172.21.15.61:0/2488555050 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22440aa880 msgr2=0x7f22440aad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.030+0000 7f22496d2700 1 --2- 172.21.15.61:0/2488555050 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22440aa880 0x7f22440aad00 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f22440cd010 tx=0x7f2234009250 comp rx=0 tx=0).stop 2023-12-24T20:05:50.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.031+0000 7f22496d2700 1 -- 172.21.15.61:0/2488555050 shutdown_connections 2023-12-24T20:05:50.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.031+0000 7f22496d2700 1 --2- 172.21.15.61:0/2488555050 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244069610 0x7f2244069a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.031+0000 7f22496d2700 1 --2- 172.21.15.61:0/2488555050 >> v2:172.21.15.133:3300/0 conn(0x7f2244157820 0x7f22440cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.031+0000 7f22496d2700 1 --2- 172.21.15.61:0/2488555050 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f22440aa880 0x7f22440aad00 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.031+0000 7f22496d2700 1 -- 172.21.15.61:0/2488555050 >> 172.21.15.61:0/2488555050 conn(0x7f2244068020 msgr2=0x7f22440cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:50.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.031+0000 7f22496d2700 1 -- 172.21.15.61:0/2488555050 shutdown_connections 2023-12-24T20:05:50.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.031+0000 7f22496d2700 1 -- 172.21.15.61:0/2488555050 wait complete. 2023-12-24T20:05:50.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.032+0000 7f22496d2700 1 Processor -- start 2023-12-24T20:05:50.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.032+0000 7f22496d2700 1 -- start start 2023-12-24T20:05:50.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.032+0000 7f22496d2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2244069610 0x7f22441548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22496d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22440aa880 0x7f224414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22496d2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244157820 0x7f2244158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22496d2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440c2590 con 0x7f2244069610 2023-12-24T20:05:50.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22496d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440b07f0 con 0x7f22440aa880 2023-12-24T20:05:50.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22496d2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22440c1f80 con 0x7f2244157820 2023-12-24T20:05:50.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f2242ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2244069610 0x7f22441548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f2242ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2244069610 0x7f22441548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35062/0 (socket says 172.21.15.61:35062) 2023-12-24T20:05:50.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f2242ffd700 1 -- 172.21.15.61:0/1668278079 learned_addr learned my addr 172.21.15.61:0/1668278079 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:50.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22427fc700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22440aa880 0x7f224414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f2242ffd700 1 -- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244157820 msgr2=0x7f2244158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22437fe700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244157820 0x7f2244158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f2242ffd700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244157820 0x7f2244158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f2242ffd700 1 -- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22440aa880 msgr2=0x7f224414fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f2242ffd700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22440aa880 0x7f224414fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f2242ffd700 1 -- 172.21.15.61:0/1668278079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22340094f0 con 0x7f2244069610 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22427fc700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22440aa880 0x7f224414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22437fe700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244157820 0x7f2244158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f2242ffd700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2244069610 0x7f22441548b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f222c00c850 tx=0x7f222c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f223affd700 1 -- 172.21.15.61:0/1668278079 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c011600 con 0x7f2244069610 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f223affd700 1 -- 172.21.15.61:0/1668278079 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c011760 con 0x7f2244069610 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22496d2700 1 -- 172.21.15.61:0/1668278079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2244155220 con 0x7f2244069610 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f223affd700 1 -- 172.21.15.61:0/1668278079 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c011b00 con 0x7f2244069610 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.033+0000 7f22496d2700 1 -- 172.21.15.61:0/1668278079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22440c22d0 con 0x7f2244069610 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.034+0000 7f22496d2700 1 -- 172.21.15.61:0/1668278079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224404c3c0 con 0x7f2244069610 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.035+0000 7f223affd700 1 -- 172.21.15.61:0/1668278079 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f222c0073b0 con 0x7f2244069610 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.035+0000 7f223affd700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2224066f30 0x7f22240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.035+0000 7f223affd700 1 -- 172.21.15.61:0/1668278079 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f222c084610 con 0x7f2244069610 2023-12-24T20:05:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.036+0000 7f22427fc700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2224066f30 0x7f22240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.036+0000 7f223affd700 1 -- 172.21.15.61:0/1668278079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f222406eb10 con 0x7f2244069610 2023-12-24T20:05:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.036+0000 7f22427fc700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2224066f30 0x7f22240693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f22440cd010 tx=0x7f2234017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:50.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.040+0000 7f223affd700 1 -- 172.21.15.61:0/1668278079 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f222c0517a0 con 0x7f2244069610 2023-12-24T20:05:50.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.233+0000 7f22496d2700 1 -- 172.21.15.61:0/1668278079 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f224415a780 con 0x7f2244069610 2023-12-24T20:05:50.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.233+0000 7f223affd700 1 -- 172.21.15.61:0/1668278079 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+11 (secure 0 0 0) 0x7f222c054dc0 con 0x7f2244069610 2023-12-24T20:05:50.234 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T20:05:50.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.235+0000 7f22496d2700 1 -- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2224066f30 msgr2=0x7f22240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2224066f30 0x7f22240693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f22440cd010 tx=0x7f2234017000 comp rx=0 tx=0).stop 2023-12-24T20:05:50.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 -- 172.21.15.61:0/1668278079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2244069610 msgr2=0x7f22441548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2244069610 0x7f22441548b0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f222c00c850 tx=0x7f222c008040 comp rx=0 tx=0).stop 2023-12-24T20:05:50.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 -- 172.21.15.61:0/1668278079 shutdown_connections 2023-12-24T20:05:50.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2244157820 0x7f2244158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2224066f30 0x7f22240693e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2244069610 0x7f22441548b0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 --2- 172.21.15.61:0/1668278079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22440aa880 0x7f224414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 -- 172.21.15.61:0/1668278079 >> 172.21.15.61:0/1668278079 conn(0x7f2244068020 msgr2=0x7f2244063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:50.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 -- 172.21.15.61:0/1668278079 shutdown_connections 2023-12-24T20:05:50.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.236+0000 7f22496d2700 1 -- 172.21.15.61:0/1668278079 wait complete. 2023-12-24T20:05:50.248 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:05:50.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.370+0000 7ff034d41700 1 Processor -- start 2023-12-24T20:05:50.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.370+0000 7ff034d41700 1 -- start start 2023-12-24T20:05:50.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.371+0000 7ff034d41700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 0x7ff030067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.371+0000 7ff034d41700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0300af7d0 0x7ff0300afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.371+0000 7ff034d41700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0300a84d0 con 0x7ff030070640 2023-12-24T20:05:50.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.371+0000 7ff034d41700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0300b0180 con 0x7ff0300af7d0 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.371+0000 7ff034d41700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300a7620 con 0x7ff030159b00 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.371+0000 7ff02e59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 0x7ff030067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.371+0000 7ff02e59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 0x7ff030067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:45516/0 (socket says 172.21.15.61:45516) 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.371+0000 7ff02e59c700 1 -- 172.21.15.61:0/2861868899 learned_addr learned my addr 172.21.15.61:0/2861868899 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.371+0000 7ff02dd9b700 1 --2- 172.21.15.61:0/2861868899 >> v2:172.21.15.133:3300/0 conn(0x7ff0300af7d0 0x7ff0300afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.372+0000 7ff02d59a700 1 -- 172.21.15.61:0/2861868899 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196375190 0 0) 0x7ff0300a84d0 con 0x7ff030070640 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.372+0000 7ff02e59c700 1 -- 172.21.15.61:0/2861868899 >> v2:172.21.15.133:3300/0 conn(0x7ff0300af7d0 msgr2=0x7ff0300afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.372+0000 7ff02e59c700 1 --2- 172.21.15.61:0/2861868899 >> v2:172.21.15.133:3300/0 conn(0x7ff0300af7d0 0x7ff0300afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.372+0000 7ff02e59c700 1 -- 172.21.15.61:0/2861868899 >> v1:172.21.15.133:6789/0 conn(0x7ff030070640 legacy=0x7ff03015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.372+0000 7ff02e59c700 1 -- 172.21.15.61:0/2861868899 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300a78c0 con 0x7ff030159b00 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.372+0000 7ff02e59c700 1 --2- 172.21.15.61:0/2861868899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 0x7ff030067550 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0240099b0 tx=0x7ff024009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14b305119757c271 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.372+0000 7ff02d59a700 1 -- 172.21.15.61:0/2861868899 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024009ea0 con 0x7ff030159b00 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.372+0000 7ff02d59a700 1 -- 172.21.15.61:0/2861868899 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02400b860 con 0x7ff030159b00 2023-12-24T20:05:50.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.372+0000 7ff02d59a700 1 -- 172.21.15.61:0/2861868899 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02400bc00 con 0x7ff030159b00 2023-12-24T20:05:50.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.373+0000 7ff034d41700 1 -- 172.21.15.61:0/2861868899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 msgr2=0x7ff030067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.373+0000 7ff034d41700 1 --2- 172.21.15.61:0/2861868899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 0x7ff030067550 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0240099b0 tx=0x7ff024009250 comp rx=0 tx=0).stop 2023-12-24T20:05:50.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.373+0000 7ff034d41700 1 -- 172.21.15.61:0/2861868899 shutdown_connections 2023-12-24T20:05:50.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.373+0000 7ff034d41700 1 --2- 172.21.15.61:0/2861868899 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 0x7ff030067550 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.373+0000 7ff034d41700 1 --2- 172.21.15.61:0/2861868899 >> v2:172.21.15.133:3300/0 conn(0x7ff0300af7d0 0x7ff0300afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.373+0000 7ff034d41700 1 -- 172.21.15.61:0/2861868899 >> 172.21.15.61:0/2861868899 conn(0x7ff0300ca200 msgr2=0x7ff0300ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:50.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.373+0000 7ff034d41700 1 -- 172.21.15.61:0/2861868899 shutdown_connections 2023-12-24T20:05:50.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.373+0000 7ff034d41700 1 -- 172.21.15.61:0/2861868899 wait complete. 2023-12-24T20:05:50.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.374+0000 7ff034d41700 1 Processor -- start 2023-12-24T20:05:50.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.374+0000 7ff034d41700 1 -- start start 2023-12-24T20:05:50.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff034d41700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070640 0x7ff0300b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff034d41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0300af7d0 0x7ff030155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff034d41700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 0x7ff0300b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff034d41700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300b3420 con 0x7ff030070640 2023-12-24T20:05:50.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff034d41700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300ad9f0 con 0x7ff0300af7d0 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff034d41700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff030156340 con 0x7ff030159b00 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070640 0x7ff0300b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070640 0x7ff0300b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35076/0 (socket says 172.21.15.61:35076) 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02e59c700 1 -- 172.21.15.61:0/4207850152 learned_addr learned my addr 172.21.15.61:0/4207850152 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02dd9b700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0300af7d0 0x7ff030155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02ed9d700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 0x7ff0300b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02e59c700 1 -- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 msgr2=0x7ff0300b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02e59c700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 0x7ff0300b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02e59c700 1 -- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0300af7d0 msgr2=0x7ff030155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02e59c700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0300af7d0 0x7ff030155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02e59c700 1 -- 172.21.15.61:0/4207850152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240094f0 con 0x7ff030070640 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.375+0000 7ff02e59c700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070640 0x7ff0300b2d40 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7ff02400b3c0 tx=0x7ff024017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:50.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.376+0000 7ff01e7fc700 1 -- 172.21.15.61:0/4207850152 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024000d10 con 0x7ff030070640 2023-12-24T20:05:50.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.376+0000 7ff01e7fc700 1 -- 172.21.15.61:0/4207850152 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02400bbe0 con 0x7ff030070640 2023-12-24T20:05:50.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.376+0000 7ff034d41700 1 -- 172.21.15.61:0/4207850152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0300b0a70 con 0x7ff030070640 2023-12-24T20:05:50.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.376+0000 7ff01e7fc700 1 -- 172.21.15.61:0/4207850152 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02401a6c0 con 0x7ff030070640 2023-12-24T20:05:50.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.376+0000 7ff034d41700 1 -- 172.21.15.61:0/4207850152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0300ad3a0 con 0x7ff030070640 2023-12-24T20:05:50.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.377+0000 7ff034d41700 1 -- 172.21.15.61:0/4207850152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03004c3c0 con 0x7ff030070640 2023-12-24T20:05:50.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.377+0000 7ff01e7fc700 1 -- 172.21.15.61:0/4207850152 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff02401aa70 con 0x7ff030070640 2023-12-24T20:05:50.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.377+0000 7ff01e7fc700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff010066f30 0x7ff0100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.377+0000 7ff01e7fc700 1 -- 172.21.15.61:0/4207850152 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7ff024085e80 con 0x7ff030070640 2023-12-24T20:05:50.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.378+0000 7ff01e7fc700 1 -- 172.21.15.61:0/4207850152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7ff01006eb10 con 0x7ff030070640 2023-12-24T20:05:50.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.378+0000 7ff02dd9b700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff010066f30 0x7ff0100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.378+0000 7ff02dd9b700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff010066f30 0x7ff0100693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff03016d220 tx=0x7ff0200091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:50.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.382+0000 7ff01e7fc700 1 -- 172.21.15.61:0/4207850152 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0240530b0 con 0x7ff030070640 2023-12-24T20:05:50.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.620+0000 7ff034d41700 1 -- 172.21.15.61:0/4207850152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0300af3a0 con 0x7ff030070640 2023-12-24T20:05:50.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.620+0000 7ff01e7fc700 1 -- 172.21.15.61:0/4207850152 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4602 (secure 0 0 0) 0x7ff024029090 con 0x7ff030070640 2023-12-24T20:05:50.621 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:05:50.621 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3725605380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3725605380},{"type":"v1","addr":"172.21.15.133:6837","nonce":3725605380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":6724,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2558204756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2558204756},{"type":"v1","addr":"172.21.15.133:6836","nonce":2558204756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3124455429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3124455429},{"type":"v1","addr":"172.21.15.61:6834","nonce":3124455429}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:03:47.115082+0000","modified":"2023-12-24T20:03:50.745173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/847871762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":847871762},{"type":"v1","addr":"172.21.15.61:6835","nonce":847871762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T20:05:50.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 -- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff010066f30 msgr2=0x7ff0100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff010066f30 0x7ff0100693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff03016d220 tx=0x7ff0200091a0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 -- 172.21.15.61:0/4207850152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070640 msgr2=0x7ff0300b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070640 0x7ff0300b2d40 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7ff02400b3c0 tx=0x7ff024017000 comp rx=0 tx=0).stop 2023-12-24T20:05:50.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 -- 172.21.15.61:0/4207850152 shutdown_connections 2023-12-24T20:05:50.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff030159b00 0x7ff0300b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff010066f30 0x7ff0100693e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff030070640 0x7ff0300b2d40 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 --2- 172.21.15.61:0/4207850152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0300af7d0 0x7ff030155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.624 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 -- 172.21.15.61:0/4207850152 >> 172.21.15.61:0/4207850152 conn(0x7ff0300ca200 msgr2=0x7ff03006de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:50.624 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 -- 172.21.15.61:0/4207850152 shutdown_connections 2023-12-24T20:05:50.624 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.622+0000 7ff034d41700 1 -- 172.21.15.61:0/4207850152 wait complete. 2023-12-24T20:05:50.624 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 76 2023-12-24T20:05:50.635 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:05:50.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.757+0000 7f3a032ea700 1 Processor -- start 2023-12-24T20:05:50.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.757+0000 7f3a032ea700 1 -- start start 2023-12-24T20:05:50.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f3a032ea700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f39fc15bb60 0x7f39fc098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f3a032ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc098aa0 0x7f39fc15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f3a032ea700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39fc0b2eb0 con 0x7f39fc15c470 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f3a032ea700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39fc0afc20 con 0x7f39fc15bb60 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f3a032ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc0b2bd0 con 0x7f39fc098aa0 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f3a01887700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f39fc15c470 0x7f39fc0b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:54870/0 (socket says 172.21.15.61:54870) 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f3a01887700 1 -- 172.21.15.61:0/1181398856 learned_addr learned my addr 172.21.15.61:0/1181398856 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f3a01086700 1 --2- 172.21.15.61:0/1181398856 >> v2:172.21.15.133:3300/0 conn(0x7f39fc15bb60 0x7f39fc098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f3a00885700 1 --2- 172.21.15.61:0/1181398856 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc098aa0 0x7f39fc15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f39f3fff700 1 -- 172.21.15.61:0/1181398856 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762672535 0 0) 0x7f39fc0b2eb0 con 0x7f39fc15c470 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.758+0000 7f39f3fff700 1 -- 172.21.15.61:0/1181398856 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e8003570 con 0x7f39fc15c470 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.759+0000 7f39f3fff700 1 -- 172.21.15.61:0/1181398856 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924924316 0 0) 0x7f39e8003570 con 0x7f39fc15c470 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.759+0000 7f3a00885700 1 -- 172.21.15.61:0/1181398856 >> v2:172.21.15.133:3300/0 conn(0x7f39fc15bb60 msgr2=0x7f39fc098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.759+0000 7f3a00885700 1 --2- 172.21.15.61:0/1181398856 >> v2:172.21.15.133:3300/0 conn(0x7f39fc15bb60 0x7f39fc098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.759+0000 7f3a00885700 1 -- 172.21.15.61:0/1181398856 >> v1:172.21.15.61:6789/0 conn(0x7f39fc15c470 legacy=0x7f39fc0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.759+0000 7f3a00885700 1 -- 172.21.15.61:0/1181398856 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc0afe10 con 0x7f39fc098aa0 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.759+0000 7f3a01086700 1 --2- 172.21.15.61:0/1181398856 >> v2:172.21.15.133:3300/0 conn(0x7f39fc15bb60 0x7f39fc098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:05:50.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.759+0000 7f3a00885700 1 --2- 172.21.15.61:0/1181398856 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc098aa0 0x7f39fc15bf30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39f80098e0 tx=0x7f39f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e4420b8dc74fe1 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.759+0000 7f39f3fff700 1 -- 172.21.15.61:0/1181398856 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f40017f0 con 0x7f39fc098aa0 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.759+0000 7f39f3fff700 1 -- 172.21.15.61:0/1181398856 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f8011420 con 0x7f39fc098aa0 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.759+0000 7f39f3fff700 1 -- 172.21.15.61:0/1181398856 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80117c0 con 0x7f39fc098aa0 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.760+0000 7f3a032ea700 1 -- 172.21.15.61:0/1181398856 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc098aa0 msgr2=0x7f39fc15bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.760+0000 7f3a032ea700 1 --2- 172.21.15.61:0/1181398856 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc098aa0 0x7f39fc15bf30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39f80098e0 tx=0x7f39f80091a0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.760+0000 7f3a032ea700 1 -- 172.21.15.61:0/1181398856 shutdown_connections 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.760+0000 7f3a032ea700 1 --2- 172.21.15.61:0/1181398856 >> v2:172.21.15.133:3300/0 conn(0x7f39fc15bb60 0x7f39fc098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.760+0000 7f3a032ea700 1 --2- 172.21.15.61:0/1181398856 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc098aa0 0x7f39fc15bf30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.760+0000 7f3a032ea700 1 -- 172.21.15.61:0/1181398856 >> 172.21.15.61:0/1181398856 conn(0x7f39fc097a10 msgr2=0x7f39fc0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.760+0000 7f3a032ea700 1 -- 172.21.15.61:0/1181398856 shutdown_connections 2023-12-24T20:05:50.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.760+0000 7f3a032ea700 1 -- 172.21.15.61:0/1181398856 wait complete. 2023-12-24T20:05:50.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.761+0000 7f3a032ea700 1 Processor -- start 2023-12-24T20:05:50.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.761+0000 7f3a032ea700 1 -- start start 2023-12-24T20:05:50.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a032ea700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39fc098aa0 0x7f39fc0ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a032ea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc15bb60 0x7f39fc0aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a032ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39fc15c470 0x7f39fc156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a032ea700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc0aac80 con 0x7f39fc098aa0 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a032ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc0ac380 con 0x7f39fc15c470 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a032ea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc0ab770 con 0x7f39fc15bb60 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a01086700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39fc098aa0 0x7f39fc0ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a01086700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39fc098aa0 0x7f39fc0ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35078/0 (socket says 172.21.15.61:35078) 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a01086700 1 -- 172.21.15.61:0/1396399433 learned_addr learned my addr 172.21.15.61:0/1396399433 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a00885700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc15bb60 0x7f39fc0aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a01887700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39fc15c470 0x7f39fc156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a01086700 1 -- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc15bb60 msgr2=0x7f39fc0aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a01086700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc15bb60 0x7f39fc0aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a01086700 1 -- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39fc15c470 msgr2=0x7f39fc156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a01086700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39fc15c470 0x7f39fc156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.762+0000 7f3a01086700 1 -- 172.21.15.61:0/1396399433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec0093c0 con 0x7f39fc098aa0 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.763+0000 7f3a01086700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39fc098aa0 0x7f39fc0ab090 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00ec80 tx=0x7f39ec009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:50.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.763+0000 7f39f17fa700 1 -- 172.21.15.61:0/1396399433 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec005a00 con 0x7f39fc098aa0 2023-12-24T20:05:50.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.763+0000 7f39f17fa700 1 -- 172.21.15.61:0/1396399433 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec005b60 con 0x7f39fc098aa0 2023-12-24T20:05:50.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.763+0000 7f39f17fa700 1 -- 172.21.15.61:0/1396399433 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00c9d0 con 0x7f39fc098aa0 2023-12-24T20:05:50.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.763+0000 7f3a032ea700 1 -- 172.21.15.61:0/1396399433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f8009420 con 0x7f39fc098aa0 2023-12-24T20:05:50.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.763+0000 7f3a032ea700 1 -- 172.21.15.61:0/1396399433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc0abd30 con 0x7f39fc098aa0 2023-12-24T20:05:50.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.764+0000 7f3a032ea700 1 -- 172.21.15.61:0/1396399433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39fc06d440 con 0x7f39fc098aa0 2023-12-24T20:05:50.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.764+0000 7f39f17fa700 1 -- 172.21.15.61:0/1396399433 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f39ec00cd40 con 0x7f39fc098aa0 2023-12-24T20:05:50.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.765+0000 7f39f17fa700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39e0066f30 0x7f39e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:50.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.765+0000 7f39f17fa700 1 -- 172.21.15.61:0/1396399433 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f39ec084bb0 con 0x7f39fc098aa0 2023-12-24T20:05:50.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.765+0000 7f39f17fa700 1 -- 172.21.15.61:0/1396399433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f39e006eb10 con 0x7f39fc098aa0 2023-12-24T20:05:50.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.765+0000 7f3a00885700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39e0066f30 0x7f39e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:50.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.765+0000 7f3a00885700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39e0066f30 0x7f39e00693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f39f80030c0 tx=0x7f39f8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:50.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.769+0000 7f39f17fa700 1 -- 172.21.15.61:0/1396399433 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39ec020020 con 0x7f39fc098aa0 2023-12-24T20:05:50.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.966+0000 7f3a032ea700 1 -- 172.21.15.61:0/1396399433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39fc04c3c0 con 0x7f39fc098aa0 2023-12-24T20:05:50.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.967+0000 7f39f17fa700 1 -- 172.21.15.61:0/1396399433 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+15488 (secure 0 0 0) 0x7f39ec055870 con 0x7f39fc098aa0 2023-12-24T20:05:50.967 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:05:50.967 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":155,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:04:58.587541+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:03:45.538509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-24T20:03:46.090556+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.a","mappings":[{"from":2,"to":0}]},{"pgid":"19.16","mappings":[{"from":2,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:05:50.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 -- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39e0066f30 msgr2=0x7f39e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39e0066f30 0x7f39e00693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f39f80030c0 tx=0x7f39f8016000 comp rx=0 tx=0).stop 2023-12-24T20:05:50.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 -- 172.21.15.61:0/1396399433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39fc098aa0 msgr2=0x7f39fc0ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:50.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39fc098aa0 0x7f39fc0ab090 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00ec80 tx=0x7f39ec009120 comp rx=0 tx=0).stop 2023-12-24T20:05:50.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 -- 172.21.15.61:0/1396399433 shutdown_connections 2023-12-24T20:05:50.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39e0066f30 0x7f39e00693e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39fc15c470 0x7f39fc156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39fc098aa0 0x7f39fc0ab090 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 --2- 172.21.15.61:0/1396399433 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39fc15bb60 0x7f39fc0aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:50.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 -- 172.21.15.61:0/1396399433 >> 172.21.15.61:0/1396399433 conn(0x7f39fc097a10 msgr2=0x7f39fc15d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:50.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 -- 172.21.15.61:0/1396399433 shutdown_connections 2023-12-24T20:05:50.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:50.969+0000 7f3a032ea700 1 -- 172.21.15.61:0/1396399433 wait complete. 2023-12-24T20:05:50.982 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:05:50.982 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:05:51.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.103+0000 7f41c6f98700 1 Processor -- start 2023-12-24T20:05:51.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.103+0000 7f41c6f98700 1 -- start start 2023-12-24T20:05:51.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.104+0000 7f41c6f98700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f41c00afee0 0x7f41c0067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.104+0000 7f41c6f98700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f41c0070640 0x7f41c0070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.104+0000 7f41c6f98700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c00a84d0 con 0x7f41c0159b00 2023-12-24T20:05:51.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.104+0000 7f41c6f98700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c0070fd0 con 0x7f41c0070640 2023-12-24T20:05:51.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.104+0000 7f41c6f98700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c00a7620 con 0x7f41c00afee0 2023-12-24T20:05:51.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.104+0000 7f41c5535700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f41c0070640 0x7f41c0070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.104+0000 7f41c5535700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f41c0070640 0x7f41c0070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35088/0 (socket says 172.21.15.61:35088) 2023-12-24T20:05:51.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.104+0000 7f41c5535700 1 -- 172.21.15.61:0/823228017 learned_addr learned my addr 172.21.15.61:0/823228017 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:51.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.104+0000 7f41bffff700 1 --2- 172.21.15.61:0/823228017 >> v2:172.21.15.133:3300/0 conn(0x7f41c00afee0 0x7f41c0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c5535700 1 -- 172.21.15.61:0/823228017 >> v2:172.21.15.133:3300/0 conn(0x7f41c00afee0 msgr2=0x7f41c0067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:51.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c5535700 1 --2- 172.21.15.61:0/823228017 >> v2:172.21.15.133:3300/0 conn(0x7f41c00afee0 0x7f41c0067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c5535700 1 -- 172.21.15.61:0/823228017 >> v1:172.21.15.133:6789/0 conn(0x7f41c0159b00 legacy=0x7f41c00af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:51.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c5535700 1 -- 172.21.15.61:0/823228017 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c00a78c0 con 0x7f41c0070640 2023-12-24T20:05:51.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c5535700 1 --2- 172.21.15.61:0/823228017 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c0070640 0x7f41c0070a90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f41c00cd6c0 tx=0x7f41b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c05c4c4ad5d2559 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:51.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41bf7fe700 1 -- 172.21.15.61:0/823228017 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b800e070 con 0x7f41c0070640 2023-12-24T20:05:51.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41bf7fe700 1 -- 172.21.15.61:0/823228017 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b800ba10 con 0x7f41c0070640 2023-12-24T20:05:51.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41bf7fe700 1 -- 172.21.15.61:0/823228017 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b80092e0 con 0x7f41c0070640 2023-12-24T20:05:51.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c6f98700 1 -- 172.21.15.61:0/823228017 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c0070640 msgr2=0x7f41c0070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c6f98700 1 --2- 172.21.15.61:0/823228017 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c0070640 0x7f41c0070a90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f41c00cd6c0 tx=0x7f41b8009840 comp rx=0 tx=0).stop 2023-12-24T20:05:51.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c6f98700 1 -- 172.21.15.61:0/823228017 shutdown_connections 2023-12-24T20:05:51.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c6f98700 1 --2- 172.21.15.61:0/823228017 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c0070640 0x7f41c0070a90 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c6f98700 1 --2- 172.21.15.61:0/823228017 >> v2:172.21.15.133:3300/0 conn(0x7f41c00afee0 0x7f41c0067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.105+0000 7f41c6f98700 1 -- 172.21.15.61:0/823228017 >> 172.21.15.61:0/823228017 conn(0x7f41c00ca200 msgr2=0x7f41c00ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.106+0000 7f41c6f98700 1 -- 172.21.15.61:0/823228017 shutdown_connections 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.106+0000 7f41c6f98700 1 -- 172.21.15.61:0/823228017 wait complete. 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.107+0000 7f41c6f98700 1 Processor -- start 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.107+0000 7f41c6f98700 1 -- start start 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c6f98700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41c0070640 0x7f41c0152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c6f98700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c00afee0 0x7f41c0152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c6f98700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41c0159b00 0x7f41c00ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c6f98700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c0157eb0 con 0x7f41c00afee0 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c6f98700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015edb0 con 0x7f41c0159b00 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c6f98700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015f430 con 0x7f41c0070640 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c00afee0 0x7f41c0152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c00afee0 0x7f41c0152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35100/0 (socket says 172.21.15.61:35100) 2023-12-24T20:05:51.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bffff700 1 -- 172.21.15.61:0/3631788827 learned_addr learned my addr 172.21.15.61:0/3631788827 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c5535700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41c0159b00 0x7f41c00ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bffff700 1 -- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41c0070640 msgr2=0x7f41c0152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c4d34700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41c0070640 0x7f41c0152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bffff700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41c0070640 0x7f41c0152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bffff700 1 -- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41c0159b00 msgr2=0x7f41c00ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bffff700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41c0159b00 0x7f41c00ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bffff700 1 -- 172.21.15.61:0/3631788827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b8009ae0 con 0x7f41c00afee0 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c5535700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41c0159b00 0x7f41c00ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c4d34700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41c0070640 0x7f41c0152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bffff700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c00afee0 0x7f41c0152730 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00d890 tx=0x7f41ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bcff9700 1 -- 172.21.15.61:0/3631788827 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac012630 con 0x7f41c00afee0 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bcff9700 1 -- 172.21.15.61:0/3631788827 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac012790 con 0x7f41c00afee0 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41c6f98700 1 -- 172.21.15.61:0/3631788827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c016d480 con 0x7f41c00afee0 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.108+0000 7f41bcff9700 1 -- 172.21.15.61:0/3631788827 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac012b50 con 0x7f41c00afee0 2023-12-24T20:05:51.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.109+0000 7f41c6f98700 1 -- 172.21.15.61:0/3631788827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c015ead0 con 0x7f41c00afee0 2023-12-24T20:05:51.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.109+0000 7f41c6f98700 1 -- 172.21.15.61:0/3631788827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c016d610 con 0x7f41c00afee0 2023-12-24T20:05:51.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.110+0000 7f41bcff9700 1 -- 172.21.15.61:0/3631788827 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f41ac01d400 con 0x7f41c00afee0 2023-12-24T20:05:51.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.110+0000 7f41bcff9700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41a4066f30 0x7f41a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.110+0000 7f41bcff9700 1 -- 172.21.15.61:0/3631788827 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f41ac0849b0 con 0x7f41c00afee0 2023-12-24T20:05:51.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.110+0000 7f41bcff9700 1 -- 172.21.15.61:0/3631788827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f41a406eb10 con 0x7f41c00afee0 2023-12-24T20:05:51.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.110+0000 7f41c4d34700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41a4066f30 0x7f41a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.111+0000 7f41c4d34700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41a4066f30 0x7f41a40693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f41b4006fd0 tx=0x7f41b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:51.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.115+0000 7f41bcff9700 1 -- 172.21.15.61:0/3631788827 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41ac051be0 con 0x7f41c00afee0 2023-12-24T20:05:51.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.354+0000 7f41c6f98700 1 -- 172.21.15.61:0/3631788827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41c004c3c0 con 0x7f41c00afee0 2023-12-24T20:05:51.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.354+0000 7f41bcff9700 1 -- 172.21.15.61:0/3631788827 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f41ac055200 con 0x7f41c00afee0 2023-12-24T20:05:51.355 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:05:51.355 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3725605380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3725605380},{"type":"v1","addr":"172.21.15.133:6837","nonce":3725605380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":6724,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2558204756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2558204756},{"type":"v1","addr":"172.21.15.133:6836","nonce":2558204756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3124455429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3124455429},{"type":"v1","addr":"172.21.15.61:6834","nonce":3124455429}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:03:47.115082+0000","modified":"2023-12-24T20:03:50.745173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/847871762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":847871762},{"type":"v1","addr":"172.21.15.61:6835","nonce":847871762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T20:05:51.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 -- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41a4066f30 msgr2=0x7f41a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41a4066f30 0x7f41a40693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f41b4006fd0 tx=0x7f41b4008040 comp rx=0 tx=0).stop 2023-12-24T20:05:51.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 -- 172.21.15.61:0/3631788827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c00afee0 msgr2=0x7f41c0152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c00afee0 0x7f41c0152730 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00d890 tx=0x7f41ac008040 comp rx=0 tx=0).stop 2023-12-24T20:05:51.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 -- 172.21.15.61:0/3631788827 shutdown_connections 2023-12-24T20:05:51.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f41c0070640 0x7f41c0152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f41a4066f30 0x7f41a40693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41c0159b00 0x7f41c00ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 --2- 172.21.15.61:0/3631788827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f41c00afee0 0x7f41c0152730 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 -- 172.21.15.61:0/3631788827 >> 172.21.15.61:0/3631788827 conn(0x7f41c00ca200 msgr2=0x7f41c00677a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:51.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 -- 172.21.15.61:0/3631788827 shutdown_connections 2023-12-24T20:05:51.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.357+0000 7f41c6f98700 1 -- 172.21.15.61:0/3631788827 wait complete. 2023-12-24T20:05:51.358 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 76 2023-12-24T20:05:51.370 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:05:51.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.493+0000 7f80d4fea700 1 Processor -- start 2023-12-24T20:05:51.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.493+0000 7f80d4fea700 1 -- start start 2023-12-24T20:05:51.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80d4fea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d015bb60 0x7f80d0098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80d4fea700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d00b2eb0 con 0x7f80d00b2660 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80d4fea700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d00b2bd0 con 0x7f80d0098aa0 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80d4fea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00afc20 con 0x7f80d015bb60 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80ced9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f80d00b2660 0x7f80d00b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:54884/0 (socket says 172.21.15.61:54884) 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80ced9d700 1 -- 172.21.15.61:0/510899146 learned_addr learned my addr 172.21.15.61:0/510899146 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80ce59c700 1 --2- 172.21.15.61:0/510899146 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d015bb60 0x7f80d0098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80cd59a700 1 -- 172.21.15.61:0/510899146 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152802945 0 0) 0x7f80d00b2eb0 con 0x7f80d00b2660 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80cd59a700 1 -- 172.21.15.61:0/510899146 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80b8003570 con 0x7f80d00b2660 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80cd59a700 1 -- 172.21.15.61:0/510899146 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231391191 0 0) 0x7f80d00b2bd0 con 0x7f80d0098aa0 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80cd59a700 1 -- 172.21.15.61:0/510899146 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80d00b2eb0 con 0x7f80d0098aa0 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80ce59c700 1 -- 172.21.15.61:0/510899146 >> v1:172.21.15.133:6789/0 conn(0x7f80d0098aa0 legacy=0x7f80d015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80ce59c700 1 -- 172.21.15.61:0/510899146 >> v1:172.21.15.61:6789/0 conn(0x7f80d00b2660 legacy=0x7f80d00b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80ce59c700 1 -- 172.21.15.61:0/510899146 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d00afe10 con 0x7f80d015bb60 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.494+0000 7f80ce59c700 1 --2- 172.21.15.61:0/510899146 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d015bb60 0x7f80d0098560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009900 tx=0x7f80c0009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58393398c5f19652 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:51.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.495+0000 7f80cd59a700 1 -- 172.21.15.61:0/510899146 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0005c10 con 0x7f80d015bb60 2023-12-24T20:05:51.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.495+0000 7f80cd59a700 1 -- 172.21.15.61:0/510899146 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c0005d70 con 0x7f80d015bb60 2023-12-24T20:05:51.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.495+0000 7f80cd59a700 1 -- 172.21.15.61:0/510899146 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0006260 con 0x7f80d015bb60 2023-12-24T20:05:51.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.495+0000 7f80d4fea700 1 -- 172.21.15.61:0/510899146 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d015bb60 msgr2=0x7f80d0098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.495+0000 7f80d4fea700 1 --2- 172.21.15.61:0/510899146 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d015bb60 0x7f80d0098560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009900 tx=0x7f80c0009120 comp rx=0 tx=0).stop 2023-12-24T20:05:51.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.495+0000 7f80d4fea700 1 -- 172.21.15.61:0/510899146 shutdown_connections 2023-12-24T20:05:51.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.495+0000 7f80d4fea700 1 --2- 172.21.15.61:0/510899146 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d015bb60 0x7f80d0098560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.495+0000 7f80d4fea700 1 -- 172.21.15.61:0/510899146 >> 172.21.15.61:0/510899146 conn(0x7f80d0097a10 msgr2=0x7f80d00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:51.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.495+0000 7f80d4fea700 1 -- 172.21.15.61:0/510899146 shutdown_connections 2023-12-24T20:05:51.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.495+0000 7f80d4fea700 1 -- 172.21.15.61:0/510899146 wait complete. 2023-12-24T20:05:51.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.497+0000 7f80d4fea700 1 Processor -- start 2023-12-24T20:05:51.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.497+0000 7f80d4fea700 1 -- start start 2023-12-24T20:05:51.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80d4fea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80d0098aa0 0x7f80d00ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80d4fea700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d00b2660 0x7f80d0168710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80d4fea700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80d015bb60 0x7f80d0168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80d4fea700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0169190 con 0x7f80d015bb60 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80d4fea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00aa670 con 0x7f80d0098aa0 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80d4fea700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d00aa950 con 0x7f80d00b2660 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80ced9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80d015bb60 0x7f80d0168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80ced9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80d015bb60 0x7f80d0168c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35104/0 (socket says 172.21.15.61:35104) 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80ced9d700 1 -- 172.21.15.61:0/2815966698 learned_addr learned my addr 172.21.15.61:0/2815966698 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80ce59c700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80d0098aa0 0x7f80d00ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80cdd9b700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d00b2660 0x7f80d0168710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80ced9d700 1 -- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d00b2660 msgr2=0x7f80d0168710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80ced9d700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d00b2660 0x7f80d0168710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80ced9d700 1 -- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80d0098aa0 msgr2=0x7f80d00ac400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80ced9d700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80d0098aa0 0x7f80d00ac400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80ced9d700 1 -- 172.21.15.61:0/2815966698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00093c0 con 0x7f80d015bb60 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.498+0000 7f80ced9d700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80d015bb60 0x7f80d0168c50 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f80c800cc60 tx=0x7f80c8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:51.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.499+0000 7f80be7fc700 1 -- 172.21.15.61:0/2815966698 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800a8b0 con 0x7f80d015bb60 2023-12-24T20:05:51.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.499+0000 7f80be7fc700 1 -- 172.21.15.61:0/2815966698 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c800aa30 con 0x7f80d015bb60 2023-12-24T20:05:51.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.499+0000 7f80d4fea700 1 -- 172.21.15.61:0/2815966698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d00aac30 con 0x7f80d015bb60 2023-12-24T20:05:51.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.499+0000 7f80be7fc700 1 -- 172.21.15.61:0/2815966698 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800adf0 con 0x7f80d015bb60 2023-12-24T20:05:51.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.499+0000 7f80d4fea700 1 -- 172.21.15.61:0/2815966698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d00ac940 con 0x7f80d015bb60 2023-12-24T20:05:51.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.500+0000 7f80d4fea700 1 -- 172.21.15.61:0/2815966698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d00c3840 con 0x7f80d015bb60 2023-12-24T20:05:51.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.500+0000 7f80be7fc700 1 -- 172.21.15.61:0/2815966698 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f80c8007300 con 0x7f80d015bb60 2023-12-24T20:05:51.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.500+0000 7f80be7fc700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80b0066f30 0x7f80b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.500+0000 7f80be7fc700 1 -- 172.21.15.61:0/2815966698 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f80c80848a0 con 0x7f80d015bb60 2023-12-24T20:05:51.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.501+0000 7f80be7fc700 1 -- 172.21.15.61:0/2815966698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f80b006eb10 con 0x7f80d015bb60 2023-12-24T20:05:51.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.501+0000 7f80ce59c700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80b0066f30 0x7f80b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.501+0000 7f80ce59c700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80b0066f30 0x7f80b00693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009390 tx=0x7f80c0016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:51.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.505+0000 7f80be7fc700 1 -- 172.21.15.61:0/2815966698 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80c80555e0 con 0x7f80d015bb60 2023-12-24T20:05:51.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.742+0000 7f80d4fea700 1 -- 172.21.15.61:0/2815966698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80d00ab150 con 0x7f80d015bb60 2023-12-24T20:05:51.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.742+0000 7f80be7fc700 1 -- 172.21.15.61:0/2815966698 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f80d00ab150 con 0x7f80d015bb60 2023-12-24T20:05:51.743 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:05:51.743 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":76,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3725605380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3725605380},{"type":"v1","addr":"172.21.15.133:6837","nonce":3725605380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":6724,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2558204756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2558204756},{"type":"v1","addr":"172.21.15.133:6836","nonce":2558204756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3124455429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3124455429},{"type":"v1","addr":"172.21.15.61:6834","nonce":3124455429}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:03:47.115082+0000","modified":"2023-12-24T20:03:50.745173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7485},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7485":{"gid":7485,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/847871762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":847871762},{"type":"v1","addr":"172.21.15.61:6835","nonce":847871762}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-12-24T20:05:51.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.744+0000 7f80d4fea700 1 -- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80b0066f30 msgr2=0x7f80b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.744+0000 7f80d4fea700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80b0066f30 0x7f80b00693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009390 tx=0x7f80c0016000 comp rx=0 tx=0).stop 2023-12-24T20:05:51.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.744+0000 7f80d4fea700 1 -- 172.21.15.61:0/2815966698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80d015bb60 msgr2=0x7f80d0168c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.744+0000 7f80d4fea700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80d015bb60 0x7f80d0168c50 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f80c800cc60 tx=0x7f80c8001ae0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.745+0000 7f80d4fea700 1 -- 172.21.15.61:0/2815966698 shutdown_connections 2023-12-24T20:05:51.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.745+0000 7f80d4fea700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f80b0066f30 0x7f80b00693e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.745+0000 7f80d4fea700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f80d015bb60 0x7f80d0168c50 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.745+0000 7f80d4fea700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80d0098aa0 0x7f80d00ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.745+0000 7f80d4fea700 1 --2- 172.21.15.61:0/2815966698 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f80d00b2660 0x7f80d0168710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.745+0000 7f80d4fea700 1 -- 172.21.15.61:0/2815966698 >> 172.21.15.61:0/2815966698 conn(0x7f80d0097a10 msgr2=0x7f80d009ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:51.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.745+0000 7f80d4fea700 1 -- 172.21.15.61:0/2815966698 shutdown_connections 2023-12-24T20:05:51.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.745+0000 7f80d4fea700 1 -- 172.21.15.61:0/2815966698 wait complete. 2023-12-24T20:05:51.746 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 76 2023-12-24T20:05:51.757 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:05:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.878+0000 7f8b0247a700 1 Processor -- start 2023-12-24T20:05:51.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.878+0000 7f8b0247a700 1 -- start start 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8b0247a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8afc06b630 0x7f8afc15c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8b0247a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc070640 0x7f8afc070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8b0247a700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8afc15bcd0 con 0x7f8afc06b260 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8b0247a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8afc070fc0 con 0x7f8afc06b630 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8b0247a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0cafb0 con 0x7f8afc070640 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8afbfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8afc06b260 0x7f8afc067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:54890/0 (socket says 172.21.15.61:54890) 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8afbfff700 1 -- 172.21.15.61:0/1628839020 learned_addr learned my addr 172.21.15.61:0/1628839020 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8afb7fe700 1 --2- 172.21.15.61:0/1628839020 >> v2:172.21.15.133:3300/0 conn(0x7f8afc06b630 0x7f8afc15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8b00a17700 1 --2- 172.21.15.61:0/1628839020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc070640 0x7f8afc070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8afaffd700 1 -- 172.21.15.61:0/1628839020 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763682498 0 0) 0x7f8afc15bcd0 con 0x7f8afc06b260 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8afaffd700 1 -- 172.21.15.61:0/1628839020 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae4003570 con 0x7f8afc06b260 2023-12-24T20:05:51.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8afb7fe700 1 -- 172.21.15.61:0/1628839020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc070640 msgr2=0x7f8afc070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8afb7fe700 1 --2- 172.21.15.61:0/1628839020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc070640 0x7f8afc070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.879+0000 7f8afb7fe700 1 -- 172.21.15.61:0/1628839020 >> v1:172.21.15.61:6789/0 conn(0x7f8afc06b260 legacy=0x7f8afc067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.880+0000 7f8afb7fe700 1 -- 172.21.15.61:0/1628839020 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc0683a0 con 0x7f8afc06b630 2023-12-24T20:05:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.880+0000 7f8b00a17700 1 --2- 172.21.15.61:0/1628839020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc070640 0x7f8afc070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:05:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.880+0000 7f8afb7fe700 1 --2- 172.21.15.61:0/1628839020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8afc06b630 0x7f8afc15c160 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0098e0 tx=0x7f8aec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fefb5bc554a26f46 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.880+0000 7f8afaffd700 1 -- 172.21.15.61:0/1628839020 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec011630 con 0x7f8afc06b630 2023-12-24T20:05:51.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.880+0000 7f8afaffd700 1 -- 172.21.15.61:0/1628839020 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec011790 con 0x7f8afc06b630 2023-12-24T20:05:51.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.880+0000 7f8afaffd700 1 -- 172.21.15.61:0/1628839020 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec011b30 con 0x7f8afc06b630 2023-12-24T20:05:51.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.880+0000 7f8b0247a700 1 -- 172.21.15.61:0/1628839020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8afc06b630 msgr2=0x7f8afc15c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.880+0000 7f8b0247a700 1 --2- 172.21.15.61:0/1628839020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8afc06b630 0x7f8afc15c160 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0098e0 tx=0x7f8aec0091a0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.881+0000 7f8b0247a700 1 -- 172.21.15.61:0/1628839020 shutdown_connections 2023-12-24T20:05:51.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.881+0000 7f8b0247a700 1 --2- 172.21.15.61:0/1628839020 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc070640 0x7f8afc070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.881+0000 7f8b0247a700 1 --2- 172.21.15.61:0/1628839020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8afc06b630 0x7f8afc15c160 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.881+0000 7f8b0247a700 1 -- 172.21.15.61:0/1628839020 >> 172.21.15.61:0/1628839020 conn(0x7f8afc0ca200 msgr2=0x7f8afc0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:51.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.881+0000 7f8b0247a700 1 -- 172.21.15.61:0/1628839020 shutdown_connections 2023-12-24T20:05:51.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.881+0000 7f8b0247a700 1 -- 172.21.15.61:0/1628839020 wait complete. 2023-12-24T20:05:51.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.882+0000 7f8b0247a700 1 Processor -- start 2023-12-24T20:05:51.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.882+0000 7f8b0247a700 1 -- start start 2023-12-24T20:05:51.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8b0247a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc06b260 0x7f8afc14a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8b0247a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8afc06b630 0x7f8afc16a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8b0247a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8afc070640 0x7f8afc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8b0247a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0b1500 con 0x7f8afc06b630 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8b0247a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc16ae10 con 0x7f8afc070640 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8b0247a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0b08f0 con 0x7f8afc06b260 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8afb7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8afc06b630 0x7f8afc16a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8afb7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8afc06b630 0x7f8afc16a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35108/0 (socket says 172.21.15.61:35108) 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8afb7fe700 1 -- 172.21.15.61:0/4149942706 learned_addr learned my addr 172.21.15.61:0/4149942706 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8afbfff700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc06b260 0x7f8afc14a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8b00a17700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8afc070640 0x7f8afc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8afb7fe700 1 -- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc06b260 msgr2=0x7f8afc14a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8afb7fe700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc06b260 0x7f8afc14a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8afb7fe700 1 -- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8afc070640 msgr2=0x7f8afc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8afb7fe700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8afc070640 0x7f8afc0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:51.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8afb7fe700 1 -- 172.21.15.61:0/4149942706 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af4009a20 con 0x7f8afc06b630 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8afb7fe700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8afc06b630 0x7f8afc16a8d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8afc06c7f0 tx=0x7f8aec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8ae3fff700 1 -- 172.21.15.61:0/4149942706 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec011b10 con 0x7f8afc06b630 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8ae3fff700 1 -- 172.21.15.61:0/4149942706 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec000cc0 con 0x7f8afc06b630 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8ae3fff700 1 -- 172.21.15.61:0/4149942706 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec025620 con 0x7f8afc06b630 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8b0247a700 1 -- 172.21.15.61:0/4149942706 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec009420 con 0x7f8afc06b630 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.883+0000 7f8b0247a700 1 -- 172.21.15.61:0/4149942706 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8afc0b0eb0 con 0x7f8afc06b630 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.884+0000 7f8b0247a700 1 -- 172.21.15.61:0/4149942706 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8afc0c2530 con 0x7f8afc06b630 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.885+0000 7f8ae3fff700 1 -- 172.21.15.61:0/4149942706 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8aec025a10 con 0x7f8afc06b630 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.885+0000 7f8ae3fff700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ae8066f30 0x7f8ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.885+0000 7f8ae3fff700 1 -- 172.21.15.61:0/4149942706 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8aec085d20 con 0x7f8afc06b630 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.885+0000 7f8ae3fff700 1 -- 172.21.15.61:0/4149942706 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f8ae806eb10 con 0x7f8afc06b630 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.886+0000 7f8afbfff700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ae8066f30 0x7f8ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:51.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.886+0000 7f8afbfff700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ae8066f30 0x7f8ae80693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8af0007fd0 tx=0x7f8af0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:51.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:51.890+0000 7f8ae3fff700 1 -- 172.21.15.61:0/4149942706 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8afc0c2530 con 0x7f8afc06b630 2023-12-24T20:05:52.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.085+0000 7f8b0247a700 1 -- 172.21.15.61:0/4149942706 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8afc0c2530 con 0x7f8afc06b630 2023-12-24T20:05:52.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.085+0000 7f8ae3fff700 1 -- 172.21.15.61:0/4149942706 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+15488 (secure 0 0 0) 0x7f8afc0c2530 con 0x7f8afc06b630 2023-12-24T20:05:52.086 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:05:52.086 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":155,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:04:58.587541+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:03:45.538509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-24T20:03:46.090556+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.a","mappings":[{"from":2,"to":0}]},{"pgid":"19.16","mappings":[{"from":2,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:05:52.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 -- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ae8066f30 msgr2=0x7f8ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ae8066f30 0x7f8ae80693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8af0007fd0 tx=0x7f8af0009040 comp rx=0 tx=0).stop 2023-12-24T20:05:52.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 -- 172.21.15.61:0/4149942706 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8afc06b630 msgr2=0x7f8afc16a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8afc06b630 0x7f8afc16a8d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8afc06c7f0 tx=0x7f8aec017000 comp rx=0 tx=0).stop 2023-12-24T20:05:52.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 -- 172.21.15.61:0/4149942706 shutdown_connections 2023-12-24T20:05:52.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8afc06b260 0x7f8afc14a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8ae8066f30 0x7f8ae80693e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8afc070640 0x7f8afc0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 --2- 172.21.15.61:0/4149942706 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8afc06b630 0x7f8afc16a8d0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 -- 172.21.15.61:0/4149942706 >> 172.21.15.61:0/4149942706 conn(0x7f8afc0ca200 msgr2=0x7f8afc0af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:52.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 -- 172.21.15.61:0/4149942706 shutdown_connections 2023-12-24T20:05:52.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.088+0000 7f8b0247a700 1 -- 172.21.15.61:0/4149942706 wait complete. 2023-12-24T20:05:52.100 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:05:52.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.222+0000 7f1acbb03700 1 Processor -- start 2023-12-24T20:05:52.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.223+0000 7f1acbb03700 1 -- start start 2023-12-24T20:05:52.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1acbb03700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1ac4068ac0 0x7f1ac4070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1acbb03700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac406b320 con 0x7f1ac4159920 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1acbb03700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac406aff0 con 0x7f1ac4159cf0 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1acbb03700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac4068f60 con 0x7f1ac4068ac0 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1aca0a0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1ac4068ac0 0x7f1ac4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1ac989f700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1ac4159920 0x7f1ac4067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:54900/0 (socket says 172.21.15.61:54900) 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1ac989f700 1 -- 172.21.15.61:0/2346499381 learned_addr learned my addr 172.21.15.61:0/2346499381 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1aca0a0700 1 -- 172.21.15.61:0/2346499381 >> v1:172.21.15.133:6789/0 conn(0x7f1ac4159cf0 legacy=0x7f1ac406b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1aca0a0700 1 -- 172.21.15.61:0/2346499381 >> v1:172.21.15.61:6789/0 conn(0x7f1ac4159920 legacy=0x7f1ac4067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1aca0a0700 1 -- 172.21.15.61:0/2346499381 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac406bec0 con 0x7f1ac4068ac0 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1ac889d700 1 -- 172.21.15.61:0/2346499381 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378812892 0 0) 0x7f1ac406b320 con 0x7f1ac4159920 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1aca0a0700 1 --2- 172.21.15.61:0/2346499381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4068ac0 0x7f1ac4070640 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009e60 tx=0x7f1abc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520ac56c3a24f19e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1ac889d700 1 -- 172.21.15.61:0/2346499381 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00e070 con 0x7f1ac4068ac0 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1ac889d700 1 -- 172.21.15.61:0/2346499381 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00bc30 con 0x7f1ac4068ac0 2023-12-24T20:05:52.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.224+0000 7f1ac889d700 1 -- 172.21.15.61:0/2346499381 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc012430 con 0x7f1ac4068ac0 2023-12-24T20:05:52.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.225+0000 7f1acbb03700 1 -- 172.21.15.61:0/2346499381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4068ac0 msgr2=0x7f1ac4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.225+0000 7f1acbb03700 1 --2- 172.21.15.61:0/2346499381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4068ac0 0x7f1ac4070640 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009e60 tx=0x7f1abc009780 comp rx=0 tx=0).stop 2023-12-24T20:05:52.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.225+0000 7f1acbb03700 1 -- 172.21.15.61:0/2346499381 shutdown_connections 2023-12-24T20:05:52.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.225+0000 7f1acbb03700 1 --2- 172.21.15.61:0/2346499381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4068ac0 0x7f1ac4070640 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.225+0000 7f1acbb03700 1 -- 172.21.15.61:0/2346499381 >> 172.21.15.61:0/2346499381 conn(0x7f1ac40ce220 msgr2=0x7f1ac40af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:52.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.225+0000 7f1acbb03700 1 -- 172.21.15.61:0/2346499381 shutdown_connections 2023-12-24T20:05:52.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.225+0000 7f1acbb03700 1 -- 172.21.15.61:0/2346499381 wait complete. 2023-12-24T20:05:52.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.226+0000 7f1acbb03700 1 Processor -- start 2023-12-24T20:05:52.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.226+0000 7f1acbb03700 1 -- start start 2023-12-24T20:05:52.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1acbb03700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ac4068ac0 0x7f1ac4152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1acbb03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ac4159920 0x7f1ac40b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1acbb03700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4159cf0 0x7f1ac415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1acbb03700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac415bcb0 con 0x7f1ac4159cf0 2023-12-24T20:05:52.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1acbb03700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac415b6a0 con 0x7f1ac4159920 2023-12-24T20:05:52.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1acbb03700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40b1da0 con 0x7f1ac4068ac0 2023-12-24T20:05:52.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1aca0a0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4159cf0 0x7f1ac415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1aca0a0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4159cf0 0x7f1ac415d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35112/0 (socket says 172.21.15.61:35112) 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1aca0a0700 1 -- 172.21.15.61:0/2027859164 learned_addr learned my addr 172.21.15.61:0/2027859164 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1ac909e700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ac4159920 0x7f1ac40b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1ac989f700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ac4068ac0 0x7f1ac4152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1aca0a0700 1 -- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ac4068ac0 msgr2=0x7f1ac4152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1aca0a0700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ac4068ac0 0x7f1ac4152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1aca0a0700 1 -- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ac4159920 msgr2=0x7f1ac40b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1aca0a0700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ac4159920 0x7f1ac40b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.227+0000 7f1aca0a0700 1 -- 172.21.15.61:0/2027859164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc009a20 con 0x7f1ac4159cf0 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.228+0000 7f1aca0a0700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4159cf0 0x7f1ac415d6b0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1ac406d740 tx=0x7f1abc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.228+0000 7f1ab9ffb700 1 -- 172.21.15.61:0/2027859164 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc01b420 con 0x7f1ac4159cf0 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.228+0000 7f1ab9ffb700 1 -- 172.21.15.61:0/2027859164 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc01b580 con 0x7f1ac4159cf0 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.228+0000 7f1ab9ffb700 1 -- 172.21.15.61:0/2027859164 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc01b920 con 0x7f1ac4159cf0 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.228+0000 7f1acbb03700 1 -- 172.21.15.61:0/2027859164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac40b1ac0 con 0x7f1ac4159cf0 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.228+0000 7f1acbb03700 1 -- 172.21.15.61:0/2027859164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac41529b0 con 0x7f1ac4159cf0 2023-12-24T20:05:52.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.229+0000 7f1acbb03700 1 -- 172.21.15.61:0/2027859164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac415b500 con 0x7f1ac4159cf0 2023-12-24T20:05:52.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.229+0000 7f1ab9ffb700 1 -- 172.21.15.61:0/2027859164 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1abc01bcd0 con 0x7f1ac4159cf0 2023-12-24T20:05:52.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.230+0000 7f1ab9ffb700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa8066f30 0x7f1aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.230+0000 7f1ab9ffb700 1 -- 172.21.15.61:0/2027859164 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1abc0863b0 con 0x7f1ac4159cf0 2023-12-24T20:05:52.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.230+0000 7f1ab9ffb700 1 -- 172.21.15.61:0/2027859164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f1aa806eb10 con 0x7f1ac4159cf0 2023-12-24T20:05:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.230+0000 7f1ac989f700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa8066f30 0x7f1aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.231+0000 7f1ac989f700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa8066f30 0x7f1aa80693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0007fd0 tx=0x7f1ac0007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:52.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.234+0000 7f1ab9ffb700 1 -- 172.21.15.61:0/2027859164 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ac415b500 con 0x7f1ac4159cf0 2023-12-24T20:05:52.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.472+0000 7f1acbb03700 1 -- 172.21.15.61:0/2027859164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1ac415b500 con 0x7f1ac4159cf0 2023-12-24T20:05:52.472 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:05:52.472+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:05:52.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.474+0000 7f1ab9ffb700 1 -- 172.21.15.61:0/2027859164 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(156..156 src has 1..156) v4 ==== 366+0+0 (secure 0 0 0) 0x7f1abc0579a0 con 0x7f1ac4159cf0 2023-12-24T20:05:52.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.474+0000 7f1ab9ffb700 1 -- 172.21.15.61:0/2027859164 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f1aa806f460 con 0x7f1ac4159cf0 2023-12-24T20:05:52.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.477+0000 7f1ab9ffb700 1 -- 172.21.15.61:0/2027859164 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1ac415b500 con 0x7f1ac4159cf0 2023-12-24T20:05:52.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.479+0000 7f1acbb03700 1 -- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa8066f30 msgr2=0x7f1aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.479+0000 7f1acbb03700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa8066f30 0x7f1aa80693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0007fd0 tx=0x7f1ac0007d30 comp rx=0 tx=0).stop 2023-12-24T20:05:52.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.479+0000 7f1acbb03700 1 -- 172.21.15.61:0/2027859164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4159cf0 msgr2=0x7f1ac415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.479+0000 7f1acbb03700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4159cf0 0x7f1ac415d6b0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1ac406d740 tx=0x7f1abc019000 comp rx=0 tx=0).stop 2023-12-24T20:05:52.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.479+0000 7f1acbb03700 1 -- 172.21.15.61:0/2027859164 shutdown_connections 2023-12-24T20:05:52.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.479+0000 7f1acbb03700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ac4068ac0 0x7f1ac4152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.479+0000 7f1acbb03700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa8066f30 0x7f1aa80693e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.479+0000 7f1acbb03700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ac4159cf0 0x7f1ac415d6b0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.479+0000 7f1acbb03700 1 --2- 172.21.15.61:0/2027859164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ac4159920 0x7f1ac40b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.480+0000 7f1acbb03700 1 -- 172.21.15.61:0/2027859164 >> 172.21.15.61:0/2027859164 conn(0x7f1ac40ce220 msgr2=0x7f1ac4153190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:52.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.480+0000 7f1acbb03700 1 -- 172.21.15.61:0/2027859164 shutdown_connections 2023-12-24T20:05:52.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.480+0000 7f1acbb03700 1 -- 172.21.15.61:0/2027859164 wait complete. 2023-12-24T20:05:52.481 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:05:52.481 INFO:tasks.ceph.mds.c.smithi061.stderr: -8717> 2023-12-24T20:03:53.045+0000 7fda67320700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:05:52.492 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:05:52.511 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T20:05:52.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.617+0000 7f89b46e7700 1 Processor -- start 2023-12-24T20:05:52.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.617+0000 7f89b46e7700 1 -- start start 2023-12-24T20:05:52.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b46e7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89ac1578d0 0x7f89ac0af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b46e7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f89ac06f6e0 0x7f89ac06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b46e7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89ac06b150 0x7f89ac06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b46e7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac0caf30 con 0x7f89ac06f6e0 2023-12-24T20:05:52.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b46e7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac06b590 con 0x7f89ac1578d0 2023-12-24T20:05:52.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b46e7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0af9f0 con 0x7f89ac06b150 2023-12-24T20:05:52.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b1c82700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f89ac06f6e0 0x7f89ac06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b1c82700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f89ac06f6e0 0x7f89ac06ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35132/0 (socket says 172.21.15.61:35132) 2023-12-24T20:05:52.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b1c82700 1 -- 172.21.15.61:0/4143297752 learned_addr learned my addr 172.21.15.61:0/4143297752 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:52.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b2483700 1 --2- 172.21.15.61:0/4143297752 >> v2:172.21.15.133:3300/0 conn(0x7f89ac1578d0 0x7f89ac0af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b2c84700 1 --2- 172.21.15.61:0/4143297752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89ac06b150 0x7f89ac06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b1c82700 1 -- 172.21.15.61:0/4143297752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89ac06b150 msgr2=0x7f89ac06c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:52.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b1c82700 1 --2- 172.21.15.61:0/4143297752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89ac06b150 0x7f89ac06c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b1c82700 1 -- 172.21.15.61:0/4143297752 >> v2:172.21.15.133:3300/0 conn(0x7f89ac1578d0 msgr2=0x7f89ac0af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:52.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b1c82700 1 --2- 172.21.15.61:0/4143297752 >> v2:172.21.15.133:3300/0 conn(0x7f89ac1578d0 0x7f89ac0af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b1c82700 1 -- 172.21.15.61:0/4143297752 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0afcd0 con 0x7f89ac06f6e0 2023-12-24T20:05:52.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.618+0000 7f89b1c82700 1 --2- 172.21.15.61:0/4143297752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06f6e0 0x7f89ac06ac10 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f89ac06e260 tx=0x7f899c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffc4332754ef89e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:52.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b1481700 1 -- 172.21.15.61:0/4143297752 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c00b860 con 0x7f89ac06f6e0 2023-12-24T20:05:52.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b1481700 1 -- 172.21.15.61:0/4143297752 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c00b9c0 con 0x7f89ac06f6e0 2023-12-24T20:05:52.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b1481700 1 -- 172.21.15.61:0/4143297752 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c00bd60 con 0x7f89ac06f6e0 2023-12-24T20:05:52.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b46e7700 1 -- 172.21.15.61:0/4143297752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06f6e0 msgr2=0x7f89ac06ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b46e7700 1 --2- 172.21.15.61:0/4143297752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06f6e0 0x7f89ac06ac10 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f89ac06e260 tx=0x7f899c009250 comp rx=0 tx=0).stop 2023-12-24T20:05:52.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b46e7700 1 -- 172.21.15.61:0/4143297752 shutdown_connections 2023-12-24T20:05:52.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b46e7700 1 --2- 172.21.15.61:0/4143297752 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89ac06b150 0x7f89ac06c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b46e7700 1 --2- 172.21.15.61:0/4143297752 >> v2:172.21.15.133:3300/0 conn(0x7f89ac1578d0 0x7f89ac0af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b46e7700 1 --2- 172.21.15.61:0/4143297752 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06f6e0 0x7f89ac06ac10 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b46e7700 1 -- 172.21.15.61:0/4143297752 >> 172.21.15.61:0/4143297752 conn(0x7f89ac0ce800 msgr2=0x7f89ac0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b46e7700 1 -- 172.21.15.61:0/4143297752 shutdown_connections 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.619+0000 7f89b46e7700 1 -- 172.21.15.61:0/4143297752 wait complete. 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.620+0000 7f89b46e7700 1 Processor -- start 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.620+0000 7f89b46e7700 1 -- start start 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.621+0000 7f89b46e7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06b150 0x7f89ac155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.621+0000 7f89b46e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89ac06f6e0 0x7f89ac0c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.621+0000 7f89b46e7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89ac1578d0 0x7f89ac0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.621+0000 7f89b46e7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0ca140 con 0x7f89ac06b150 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.621+0000 7f89b46e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0c5a40 con 0x7f89ac06f6e0 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.621+0000 7f89b46e7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0c98a0 con 0x7f89ac1578d0 2023-12-24T20:05:52.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.621+0000 7f89b2483700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06b150 0x7f89ac155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.621+0000 7f89b2483700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06b150 0x7f89ac155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35138/0 (socket says 172.21.15.61:35138) 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.621+0000 7f89b2483700 1 -- 172.21.15.61:0/1728883904 learned_addr learned my addr 172.21.15.61:0/1728883904 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89b1c82700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89ac06f6e0 0x7f89ac0c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89b2483700 1 -- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89ac1578d0 msgr2=0x7f89ac0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89b2483700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89ac1578d0 0x7f89ac0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89b2483700 1 -- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89ac06f6e0 msgr2=0x7f89ac0c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89b2483700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89ac06f6e0 0x7f89ac0c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89b2483700 1 -- 172.21.15.61:0/1728883904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0094f0 con 0x7f89ac06b150 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89b2483700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06b150 0x7f89ac155eb0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f89a800d860 tx=0x7f89a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89a27fc700 1 -- 172.21.15.61:0/1728883904 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8009610 con 0x7f89ac06b150 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89a27fc700 1 -- 172.21.15.61:0/1728883904 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a8009770 con 0x7f89ac06b150 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89b46e7700 1 -- 172.21.15.61:0/1728883904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac0c9b80 con 0x7f89ac06b150 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89a27fc700 1 -- 172.21.15.61:0/1728883904 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8009b30 con 0x7f89ac06b150 2023-12-24T20:05:52.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.622+0000 7f89b46e7700 1 -- 172.21.15.61:0/1728883904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac1563f0 con 0x7f89ac06b150 2023-12-24T20:05:52.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.623+0000 7f89b46e7700 1 -- 172.21.15.61:0/1728883904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac1565e0 con 0x7f89ac06b150 2023-12-24T20:05:52.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.623+0000 7f89a27fc700 1 -- 172.21.15.61:0/1728883904 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f89a801e460 con 0x7f89ac06b150 2023-12-24T20:05:52.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.624+0000 7f89a27fc700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8990066f30 0x7f89900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:52.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.624+0000 7f89a27fc700 1 -- 172.21.15.61:0/1728883904 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f89a8084c30 con 0x7f89ac06b150 2023-12-24T20:05:52.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.624+0000 7f89a27fc700 1 -- 172.21.15.61:0/1728883904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7f899006ebb0 con 0x7f89ac06b150 2023-12-24T20:05:52.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.624+0000 7f89b1c82700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8990066f30 0x7f89900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:52.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.625+0000 7f89b1c82700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8990066f30 0x7f89900693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f89ac06e260 tx=0x7f899c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:52.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.628+0000 7f89a27fc700 1 -- 172.21.15.61:0/1728883904 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89a8051e10 con 0x7f89ac06b150 2023-12-24T20:05:52.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:52.868+0000 7f89b46e7700 1 -- 172.21.15.61:0/1728883904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f89ac04c3c0 con 0x7f89ac06b150 2023-12-24T20:05:53.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.477+0000 7f89a27fc700 1 -- 172.21.15.61:0/1728883904 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7f89a8055430 con 0x7f89ac06b150 2023-12-24T20:05:53.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 -- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8990066f30 msgr2=0x7f89900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:53.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8990066f30 0x7f89900693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f89ac06e260 tx=0x7f899c017000 comp rx=0 tx=0).stop 2023-12-24T20:05:53.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 -- 172.21.15.61:0/1728883904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06b150 msgr2=0x7f89ac155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:53.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06b150 0x7f89ac155eb0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f89a800d860 tx=0x7f89a8008040 comp rx=0 tx=0).stop 2023-12-24T20:05:53.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 -- 172.21.15.61:0/1728883904 shutdown_connections 2023-12-24T20:05:53.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f89ac1578d0 0x7f89ac0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:53.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8990066f30 0x7f89900693e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:53.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f89ac06b150 0x7f89ac155eb0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:53.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 --2- 172.21.15.61:0/1728883904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89ac06f6e0 0x7f89ac0c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:53.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 -- 172.21.15.61:0/1728883904 >> 172.21.15.61:0/1728883904 conn(0x7f89ac0ce800 msgr2=0x7f89ac156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:53.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.479+0000 7f89b46e7700 1 -- 172.21.15.61:0/1728883904 shutdown_connections 2023-12-24T20:05:53.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.480+0000 7f89b46e7700 1 -- 172.21.15.61:0/1728883904 wait complete. 2023-12-24T20:05:53.494 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:05:53.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.665+0000 7f8a3ed8f700 1 Processor -- start 2023-12-24T20:05:53.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.665+0000 7f8a3ed8f700 1 -- start start 2023-12-24T20:05:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.666+0000 7f8a3ed8f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a380acb10 0x7f8a380af360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.666+0000 7f8a3ed8f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3806ec00 con 0x7f8a38159960 2023-12-24T20:05:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.666+0000 7f8a3ed8f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3806f4a0 con 0x7f8a38063ef0 2023-12-24T20:05:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.666+0000 7f8a3ed8f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380acf80 con 0x7f8a380acb10 2023-12-24T20:05:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.666+0000 7f8a3cb2b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8a38159960 0x7f8a380ad260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:54910/0 (socket says 172.21.15.61:54910) 2023-12-24T20:05:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.666+0000 7f8a3cb2b700 1 -- 172.21.15.61:0/1662917175 learned_addr learned my addr 172.21.15.61:0/1662917175 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.666+0000 7f8a37fff700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a380acb10 0x7f8a380af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.666+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314742868 0 0) 0x7f8a3806ec00 con 0x7f8a38159960 2023-12-24T20:05:53.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.666+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a28003570 con 0x7f8a38159960 2023-12-24T20:05:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161100903 0 0) 0x7f8a3806f4a0 con 0x7f8a38063ef0 2023-12-24T20:05:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a3806ec00 con 0x7f8a38063ef0 2023-12-24T20:05:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2992367562 0 0) 0x7f8a28003570 con 0x7f8a38159960 2023-12-24T20:05:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a380acb10 msgr2=0x7f8a380af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a380acb10 0x7f8a380af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 >> v1:172.21.15.133:6789/0 conn(0x7f8a38063ef0 legacy=0x7f8a380afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3806ee50 con 0x7f8a38159960 2023-12-24T20:05:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f8a2c001470 con 0x7f8a38159960 2023-12-24T20:05:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 >> v1:172.21.15.61:6789/0 conn(0x7f8a38159960 legacy=0x7f8a380ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:53.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a28003c20 0x7f8a28004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a28004810 0x7f8a28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a380acb10 0x7f8a280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380acf80 con 0x7f8a28003c20 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2800bb40 con 0x7f8a28004810 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2800bd00 con 0x7f8a380acb10 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a3cb2b700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a28003c20 0x7f8a28004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a37fff700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a28004810 0x7f8a28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a3d32c700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a380acb10 0x7f8a280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a37fff700 1 -- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a380acb10 msgr2=0x7f8a280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a37fff700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a380acb10 0x7f8a280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a37fff700 1 -- 172.21.15.61:0/1662917175 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a28003c20 msgr2=0x7f8a28004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:53.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a37fff700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a28003c20 0x7f8a28004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.667+0000 7f8a37fff700 1 -- 172.21.15.61:0/1662917175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a28003570 con 0x7f8a28004810 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a37fff700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a28004810 0x7f8a28004c80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009c00 tx=0x7f8a240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=494d75f7d3c6675 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400e710 con 0x7f8a28004810 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2400e870 con 0x7f8a28004810 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a377fe700 1 -- 172.21.15.61:0/1662917175 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400ec30 con 0x7f8a28004810 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a28004810 msgr2=0x7f8a28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a3ed8f700 1 --2- 172.21.15.61:0/1662917175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a28004810 0x7f8a28004c80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009c00 tx=0x7f8a240091a0 comp rx=0 tx=0).stop 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a3d32c700 1 -- 172.21.15.61:0/1662917175 reap_dead start 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/1662917175 shutdown_connections 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/1662917175 >> 172.21.15.61:0/1662917175 conn(0x7f8a380ccea0 msgr2=0x7f8a380cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/1662917175 shutdown_connections 2023-12-24T20:05:53.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.668+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/1662917175 wait complete. 2023-12-24T20:05:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.669+0000 7f8a3ed8f700 1 Processor -- start 2023-12-24T20:05:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.670+0000 7f8a3ed8f700 1 -- start start 2023-12-24T20:05:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.670+0000 7f8a3ed8f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a28004810 0x7f8a3815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.670+0000 7f8a3ed8f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a3815a960 0x7f8a38169dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:53.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.670+0000 7f8a3ed8f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3816a310 0x7f8a3816a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.670+0000 7f8a3ed8f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3816acd0 con 0x7f8a3816a310 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.670+0000 7f8a3ed8f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3815aee0 con 0x7f8a3815a960 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.670+0000 7f8a3ed8f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3815b1c0 con 0x7f8a28004810 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.670+0000 7f8a3d32c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3816a310 0x7f8a3816a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3d32c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3816a310 0x7f8a3816a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35162/0 (socket says 172.21.15.61:35162) 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3d32c700 1 -- 172.21.15.61:0/3147029102 learned_addr learned my addr 172.21.15.61:0/3147029102 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3cb2b700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a28004810 0x7f8a3815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a37fff700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a3815a960 0x7f8a38169dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3d32c700 1 -- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a28004810 msgr2=0x7f8a3815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3d32c700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a28004810 0x7f8a3815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3d32c700 1 -- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a3815a960 msgr2=0x7f8a38169dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3d32c700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a3815a960 0x7f8a38169dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3d32c700 1 -- 172.21.15.61:0/3147029102 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3815b4a0 con 0x7f8a3816a310 2023-12-24T20:05:53.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3d32c700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3816a310 0x7f8a3816a790 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f8a3806ce40 tx=0x7f8a300017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a34ff9700 1 -- 172.21.15.61:0/3147029102 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30019070 con 0x7f8a3816a310 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a34ff9700 1 -- 172.21.15.61:0/3147029102 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a30006ba0 con 0x7f8a3816a310 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/3147029102 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3815b780 con 0x7f8a3816a310 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a34ff9700 1 -- 172.21.15.61:0/3147029102 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3000c8d0 con 0x7f8a3816a310 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.671+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/3147029102 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a38155560 con 0x7f8a3816a310 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.672+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/3147029102 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3815bdd0 con 0x7f8a3816a310 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.672+0000 7f8a34ff9700 1 -- 172.21.15.61:0/3147029102 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8a3000cc80 con 0x7f8a3816a310 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.673+0000 7f8a34ff9700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a1c066f30 0x7f8a1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.673+0000 7f8a34ff9700 1 -- 172.21.15.61:0/3147029102 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f8a30084870 con 0x7f8a3816a310 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.673+0000 7f8a3cb2b700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a1c066f30 0x7f8a1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:53.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.674+0000 7f8a3cb2b700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a1c066f30 0x7f8a1c0693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c001ca0 tx=0x7f8a2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:53.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.677+0000 7f8a34ff9700 1 -- 172.21.15.61:0/3147029102 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a30051a50 con 0x7f8a3816a310 2023-12-24T20:05:53.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:53.872+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/3147029102 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a3804c3c0 con 0x7f8a3816a310 2023-12-24T20:05:54.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.734+0000 7f8a34ff9700 1 -- 172.21.15.61:0/3147029102 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v158) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8a30055070 con 0x7f8a3816a310 2023-12-24T20:05:54.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.739+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a1c066f30 msgr2=0x7f8a1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:54.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.739+0000 7f8a3ed8f700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a1c066f30 0x7f8a1c0693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c001ca0 tx=0x7f8a2c009040 comp rx=0 tx=0).stop 2023-12-24T20:05:54.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.739+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/3147029102 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3816a310 msgr2=0x7f8a3816a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:54.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.739+0000 7f8a3ed8f700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3816a310 0x7f8a3816a790 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f8a3806ce40 tx=0x7f8a300017a0 comp rx=0 tx=0).stop 2023-12-24T20:05:54.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.741+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/3147029102 shutdown_connections 2023-12-24T20:05:54.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.741+0000 7f8a3ed8f700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a28004810 0x7f8a3815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:54.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.741+0000 7f8a3ed8f700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a1c066f30 0x7f8a1c0693e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:54.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.741+0000 7f8a3ed8f700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3816a310 0x7f8a3816a790 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:54.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.741+0000 7f8a3ed8f700 1 --2- 172.21.15.61:0/3147029102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a3815a960 0x7f8a38169dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:54.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.741+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/3147029102 >> 172.21.15.61:0/3147029102 conn(0x7f8a380ccea0 msgr2=0x7f8a38157700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:54.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.742+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/3147029102 shutdown_connections 2023-12-24T20:05:54.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.742+0000 7f8a3ed8f700 1 -- 172.21.15.61:0/3147029102 wait complete. 2023-12-24T20:05:54.743 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:05:54.757 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:05:54.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.890+0000 7f045d60b700 1 Processor -- start 2023-12-24T20:05:54.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.890+0000 7f045d60b700 1 -- start start 2023-12-24T20:05:54.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.891+0000 7f045d60b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f045806f540 0x7f045806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:54.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.891+0000 7f045d60b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0458157ec0 con 0x7f045806b2c0 2023-12-24T20:05:54.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.891+0000 7f045d60b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045815c1b0 con 0x7f0458158be0 2023-12-24T20:05:54.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.891+0000 7f045d60b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04580b03a0 con 0x7f045806f540 2023-12-24T20:05:54.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.891+0000 7f0456ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f045806f540 0x7f045806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:54.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.891+0000 7f04577fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f045806b2c0 0x7f045815b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:54920/0 (socket says 172.21.15.61:54920) 2023-12-24T20:05:54.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.891+0000 7f04577fe700 1 -- 172.21.15.61:0/1530118150 learned_addr learned my addr 172.21.15.61:0/1530118150 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.892+0000 7f0456ffd700 1 -- 172.21.15.61:0/1530118150 >> v1:172.21.15.133:6789/0 conn(0x7f0458158be0 legacy=0x7f045806abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.892+0000 7f0456ffd700 1 -- 172.21.15.61:0/1530118150 >> v1:172.21.15.61:6789/0 conn(0x7f045806b2c0 legacy=0x7f045815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.892+0000 7f0456ffd700 1 -- 172.21.15.61:0/1530118150 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458158100 con 0x7f045806f540 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.892+0000 7f0455ffb700 1 -- 172.21.15.61:0/1530118150 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557698231 0 0) 0x7f0450001490 con 0x7f045806b2c0 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.892+0000 7f0456ffd700 1 --2- 172.21.15.61:0/1530118150 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f045806f540 0x7f045806f910 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f044c0098e0 tx=0x7f044c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecd88e75478cd23 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.892+0000 7f0455ffb700 1 -- 172.21.15.61:0/1530118150 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c009e80 con 0x7f045806f540 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.892+0000 7f0455ffb700 1 -- 172.21.15.61:0/1530118150 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c00b820 con 0x7f045806f540 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.892+0000 7f0455ffb700 1 -- 172.21.15.61:0/1530118150 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00bba0 con 0x7f045806f540 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.892+0000 7f045d60b700 1 -- 172.21.15.61:0/1530118150 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f045806f540 msgr2=0x7f045806f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.892+0000 7f045d60b700 1 --2- 172.21.15.61:0/1530118150 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f045806f540 0x7f045806f910 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f044c0098e0 tx=0x7f044c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.893+0000 7f045d60b700 1 -- 172.21.15.61:0/1530118150 shutdown_connections 2023-12-24T20:05:54.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.893+0000 7f045d60b700 1 --2- 172.21.15.61:0/1530118150 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f045806f540 0x7f045806f910 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:54.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.893+0000 7f045d60b700 1 -- 172.21.15.61:0/1530118150 >> 172.21.15.61:0/1530118150 conn(0x7f04580ce7d0 msgr2=0x7f04580cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:54.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.893+0000 7f045d60b700 1 -- 172.21.15.61:0/1530118150 shutdown_connections 2023-12-24T20:05:54.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.893+0000 7f045d60b700 1 -- 172.21.15.61:0/1530118150 wait complete. 2023-12-24T20:05:54.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.894+0000 7f045d60b700 1 Processor -- start 2023-12-24T20:05:54.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.894+0000 7f045d60b700 1 -- start start 2023-12-24T20:05:54.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f045d60b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f045806b2c0 0x7f0458151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:54.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f045d60b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045806f540 0x7f045815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:54.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f045d60b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0458158be0 0x7f045815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:54.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f045d60b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04580688b0 con 0x7f0458158be0 2023-12-24T20:05:54.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f045d60b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0458154280 con 0x7f045806f540 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f045d60b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0458154560 con 0x7f045806b2c0 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f04577fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0458158be0 0x7f045815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f04577fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0458158be0 0x7f045815dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35176/0 (socket says 172.21.15.61:35176) 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f04577fe700 1 -- 172.21.15.61:0/892407529 learned_addr learned my addr 172.21.15.61:0/892407529 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f04567fc700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045806f540 0x7f045815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f0456ffd700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f045806b2c0 0x7f0458151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f04577fe700 1 -- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f045806b2c0 msgr2=0x7f0458151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f04577fe700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f045806b2c0 0x7f0458151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f04577fe700 1 -- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045806f540 msgr2=0x7f045815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f04577fe700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045806f540 0x7f045815d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f04577fe700 1 -- 172.21.15.61:0/892407529 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c009420 con 0x7f0458158be0 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f04577fe700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0458158be0 0x7f045815dbe0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f045000cc70 tx=0x7f0450001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f043effd700 1 -- 172.21.15.61:0/892407529 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000ce80 con 0x7f0458158be0 2023-12-24T20:05:54.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f043effd700 1 -- 172.21.15.61:0/892407529 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0450004bb0 con 0x7f0458158be0 2023-12-24T20:05:54.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f045d60b700 1 -- 172.21.15.61:0/892407529 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0458154840 con 0x7f0458158be0 2023-12-24T20:05:54.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.895+0000 7f043effd700 1 -- 172.21.15.61:0/892407529 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000ab70 con 0x7f0458158be0 2023-12-24T20:05:54.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.896+0000 7f045d60b700 1 -- 172.21.15.61:0/892407529 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04580aab70 con 0x7f0458158be0 2023-12-24T20:05:54.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.896+0000 7f045d60b700 1 -- 172.21.15.61:0/892407529 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045806b9d0 con 0x7f0458158be0 2023-12-24T20:05:54.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.897+0000 7f043effd700 1 -- 172.21.15.61:0/892407529 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f04500070f0 con 0x7f0458158be0 2023-12-24T20:05:54.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.897+0000 7f043effd700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0444066f30 0x7f04440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:54.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.897+0000 7f043effd700 1 -- 172.21.15.61:0/892407529 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5411+0+0 (secure 0 0 0) 0x7f0450084170 con 0x7f0458158be0 2023-12-24T20:05:54.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.897+0000 7f0456ffd700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0444066f30 0x7f04440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:54.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.898+0000 7f0456ffd700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0444066f30 0x7f04440693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f044c0030c0 tx=0x7f044c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:54.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:54.901+0000 7f043effd700 1 -- 172.21.15.61:0/892407529 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0450051580 con 0x7f0458158be0 2023-12-24T20:05:55.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.098+0000 7f045d60b700 1 -- 172.21.15.61:0/892407529 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0458157ec0 con 0x7f0458158be0 2023-12-24T20:05:55.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.740+0000 7f043effd700 1 -- 172.21.15.61:0/892407529 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v159) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0458157ec0 con 0x7f0458158be0 2023-12-24T20:05:55.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 -- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0444066f30 msgr2=0x7f04440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:55.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0444066f30 0x7f04440693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f044c0030c0 tx=0x7f044c016000 comp rx=0 tx=0).stop 2023-12-24T20:05:55.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 -- 172.21.15.61:0/892407529 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0458158be0 msgr2=0x7f045815dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:55.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0458158be0 0x7f045815dbe0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f045000cc70 tx=0x7f0450001a30 comp rx=0 tx=0).stop 2023-12-24T20:05:55.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 -- 172.21.15.61:0/892407529 shutdown_connections 2023-12-24T20:05:55.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f045806b2c0 0x7f0458151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:55.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0444066f30 0x7f04440693e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:55.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0458158be0 0x7f045815dbe0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:55.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 --2- 172.21.15.61:0/892407529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045806f540 0x7f045815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:55.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 -- 172.21.15.61:0/892407529 >> 172.21.15.61:0/892407529 conn(0x7f04580ce7d0 msgr2=0x7f0458154c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:55.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 -- 172.21.15.61:0/892407529 shutdown_connections 2023-12-24T20:05:55.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.743+0000 7f045d60b700 1 -- 172.21.15.61:0/892407529 wait complete. 2023-12-24T20:05:55.745 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T20:05:55.758 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:05:55.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.885+0000 7f3ce27a0700 1 Processor -- start 2023-12-24T20:05:55.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.886+0000 7f3ce27a0700 1 -- start start 2023-12-24T20:05:55.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.886+0000 7f3ce27a0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3cdc0c9db0 0x7f3cdc162540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:55.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.886+0000 7f3ce27a0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc0caf30 con 0x7f3cdc1578d0 2023-12-24T20:05:55.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.886+0000 7f3ce27a0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc0af9f0 con 0x7f3cdc0af330 2023-12-24T20:05:55.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.886+0000 7f3ce27a0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc0af7d0 con 0x7f3cdc0c9db0 2023-12-24T20:05:55.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.886+0000 7f3cdbfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3cdc1578d0 0x7f3cdc06f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:54928/0 (socket says 172.21.15.61:54928) 2023-12-24T20:05:55.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.886+0000 7f3cdbfff700 1 -- 172.21.15.61:0/1163250959 learned_addr learned my addr 172.21.15.61:0/1163250959 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:55.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3ce0d3d700 1 --2- 172.21.15.61:0/1163250959 >> v2:172.21.15.133:3300/0 conn(0x7f3cdc0c9db0 0x7f3cdc162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:55.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732042036 0 0) 0x7f3cdc0caf30 con 0x7f3cdc1578d0 2023-12-24T20:05:55.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cc8003570 con 0x7f3cdc1578d0 2023-12-24T20:05:55.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 815088266 0 0) 0x7f3cc8003570 con 0x7f3cdc1578d0 2023-12-24T20:05:55.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 >> v2:172.21.15.133:3300/0 conn(0x7f3cdc0c9db0 msgr2=0x7f3cdc162540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:55.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 --2- 172.21.15.61:0/1163250959 >> v2:172.21.15.133:3300/0 conn(0x7f3cdc0c9db0 0x7f3cdc162540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 >> v1:172.21.15.133:6789/0 conn(0x7f3cdc0af330 legacy=0x7f3cdc06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc0afcd0 con 0x7f3cdc1578d0 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f3ccc001470 con 0x7f3cdc1578d0 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 >> v1:172.21.15.61:6789/0 conn(0x7f3cdc1578d0 legacy=0x7f3cdc06f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cc8003a60 0x7f3cc8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3cc8004810 0x7f3cc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc80051c0 0x7f3cc800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0af7d0 con 0x7f3cc8003a60 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc800c050 con 0x7f3cc80051c0 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc800c210 con 0x7f3cc8004810 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3ce0d3d700 1 --2- 172.21.15.61:0/1163250959 >> v2:172.21.15.133:3300/0 conn(0x7f3cdc0c9db0 0x7f3cdc162540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:05:55.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdbfff700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cc8003a60 0x7f3cc8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3ce0d3d700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc80051c0 0x7f3cc800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.887+0000 7f3cdb7fe700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3cc8004810 0x7f3cc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3cdbfff700 1 -- 172.21.15.61:0/1163250959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3cc8004810 msgr2=0x7f3cc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3cdbfff700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3cc8004810 0x7f3cc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3cdbfff700 1 -- 172.21.15.61:0/1163250959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc80051c0 msgr2=0x7f3cc800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3cdbfff700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc80051c0 0x7f3cc800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3cdbfff700 1 -- 172.21.15.61:0/1163250959 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8003570 con 0x7f3cc8003a60 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3ce0d3d700 1 -- 172.21.15.61:0/1163250959 reap_dead start 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3cdbfff700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cc8003a60 0x7f3cc8003e30 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00c3c0 tx=0x7f3ccc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156c5dada5433447 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc00cc50 con 0x7f3cc8003a60 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc00cdb0 con 0x7f3cc8003a60 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3cdaffd700 1 -- 172.21.15.61:0/1163250959 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc005b70 con 0x7f3cc8003a60 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3ce27a0700 1 -- 172.21.15.61:0/1163250959 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cc8003a60 msgr2=0x7f3cc8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3ce27a0700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cc8003a60 0x7f3cc8003e30 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00c3c0 tx=0x7f3ccc001e70 comp rx=0 tx=0).stop 2023-12-24T20:05:55.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3ce27a0700 1 -- 172.21.15.61:0/1163250959 shutdown_connections 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3ce27a0700 1 --2- 172.21.15.61:0/1163250959 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cc8003a60 0x7f3cc8003e30 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3ce27a0700 1 -- 172.21.15.61:0/1163250959 >> 172.21.15.61:0/1163250959 conn(0x7f3cdc0ce800 msgr2=0x7f3cdc0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.888+0000 7f3ce27a0700 1 -- 172.21.15.61:0/1163250959 shutdown_connections 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.889+0000 7f3ce27a0700 1 -- 172.21.15.61:0/1163250959 wait complete. 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.890+0000 7f3ce27a0700 1 Processor -- start 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.890+0000 7f3ce27a0700 1 -- start start 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3ce27a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a60 0x7f3cdc154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3ce27a0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cdc0b1620 0x7f3cdc0b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3ce27a0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3cdc0b3270 0x7f3cdc0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3ce27a0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc15cf30 con 0x7f3cdc0b1620 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3ce27a0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1583c0 con 0x7f3cc8003a60 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3ce27a0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1586a0 con 0x7f3cdc0b3270 2023-12-24T20:05:55.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3cdb7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cdc0b1620 0x7f3cdc0b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3cdb7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cdc0b1620 0x7f3cdc0b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35200/0 (socket says 172.21.15.61:35200) 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3cdb7fe700 1 -- 172.21.15.61:0/863418190 learned_addr learned my addr 172.21.15.61:0/863418190 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3cdbfff700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a60 0x7f3cdc154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.891+0000 7f3ce0d3d700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3cdc0b3270 0x7f3cdc0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3cdb7fe700 1 -- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3cdc0b3270 msgr2=0x7f3cdc0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3cdb7fe700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3cdc0b3270 0x7f3cdc0b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3cdb7fe700 1 -- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a60 msgr2=0x7f3cdc154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3cdb7fe700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a60 0x7f3cdc154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3cdb7fe700 1 -- 172.21.15.61:0/863418190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc158980 con 0x7f3cdc0b1620 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3ce0d3d700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3cdc0b3270 0x7f3cdc0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3cdbfff700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a60 0x7f3cdc154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3cdb7fe700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cdc0b1620 0x7f3cdc0b1a90 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400e890 tx=0x7f3cc4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:55.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3cd3fff700 1 -- 172.21.15.61:0/863418190 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4013630 con 0x7f3cdc0b1620 2023-12-24T20:05:55.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3cd3fff700 1 -- 172.21.15.61:0/863418190 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40137b0 con 0x7f3cdc0b1620 2023-12-24T20:05:55.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3cd3fff700 1 -- 172.21.15.61:0/863418190 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4013b70 con 0x7f3cdc0b1620 2023-12-24T20:05:55.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3ce27a0700 1 -- 172.21.15.61:0/863418190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc158c60 con 0x7f3cdc0b1620 2023-12-24T20:05:55.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.892+0000 7f3ce27a0700 1 -- 172.21.15.61:0/863418190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc1551f0 con 0x7f3cdc0b1620 2023-12-24T20:05:55.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.893+0000 7f3ce27a0700 1 -- 172.21.15.61:0/863418190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc04c3c0 con 0x7f3cdc0b1620 2023-12-24T20:05:55.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.893+0000 7f3cd3fff700 1 -- 172.21.15.61:0/863418190 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3cc401c400 con 0x7f3cdc0b1620 2023-12-24T20:05:55.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.894+0000 7f3cd3fff700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3cbc066f30 0x7f3cbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:55.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.894+0000 7f3cd3fff700 1 -- 172.21.15.61:0/863418190 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3cc4084900 con 0x7f3cdc0b1620 2023-12-24T20:05:55.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.894+0000 7f3cdbfff700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3cbc066f30 0x7f3cbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:55.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.895+0000 7f3cdbfff700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3cbc066f30 0x7f3cbc0693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00c1a0 tx=0x7f3ccc015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:55.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:55.898+0000 7f3cd3fff700 1 -- 172.21.15.61:0/863418190 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cc4051dd0 con 0x7f3cdc0b1620 2023-12-24T20:05:56.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.094+0000 7f3ce27a0700 1 -- 172.21.15.61:0/863418190 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3cdc159180 con 0x7f3cdc0b1620 2023-12-24T20:05:56.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.098+0000 7f3cd3fff700 1 -- 172.21.15.61:0/863418190 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3cc40170a0 con 0x7f3cdc0b1620 2023-12-24T20:05:56.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 -- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3cbc066f30 msgr2=0x7f3cbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3cbc066f30 0x7f3cbc0693e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00c1a0 tx=0x7f3ccc015000 comp rx=0 tx=0).stop 2023-12-24T20:05:56.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 -- 172.21.15.61:0/863418190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cdc0b1620 msgr2=0x7f3cdc0b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cdc0b1620 0x7f3cdc0b1a90 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400e890 tx=0x7f3cc4009040 comp rx=0 tx=0).stop 2023-12-24T20:05:56.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 -- 172.21.15.61:0/863418190 shutdown_connections 2023-12-24T20:05:56.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3cdc0b3270 0x7f3cdc0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3cbc066f30 0x7f3cbc0693e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cc8003a60 0x7f3cdc154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 --2- 172.21.15.61:0/863418190 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3cdc0b1620 0x7f3cdc0b1a90 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 -- 172.21.15.61:0/863418190 >> 172.21.15.61:0/863418190 conn(0x7f3cdc0ce800 msgr2=0x7f3cdc156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:56.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 -- 172.21.15.61:0/863418190 shutdown_connections 2023-12-24T20:05:56.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.100+0000 7f3ce27a0700 1 -- 172.21.15.61:0/863418190 wait complete. 2023-12-24T20:05:56.112 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-12-24T20:05:56.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.234+0000 7f0bf2f9e700 1 Processor -- start 2023-12-24T20:05:56.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.234+0000 7f0bf2f9e700 1 -- start start 2023-12-24T20:05:56.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.235+0000 7f0bf2f9e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0bec0af3b0 0x7f0bec0ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.235+0000 7f0bf2f9e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0bec0cc790 0x7f0bec0af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.235+0000 7f0bf2f9e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bec0cd340 con 0x7f0bec0679a0 2023-12-24T20:05:56.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.235+0000 7f0bf2f9e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec0a8460 con 0x7f0bec0cc790 2023-12-24T20:05:56.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.235+0000 7f0bf2f9e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec067550 con 0x7f0bec0af3b0 2023-12-24T20:05:56.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.235+0000 7f0bf279d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0bec0cc790 0x7f0bec0af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.235+0000 7f0bf179b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0bec0679a0 0x7f0bec0c96e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:54944/0 (socket says 172.21.15.61:54944) 2023-12-24T20:05:56.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.235+0000 7f0bf279d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0bec0cc790 0x7f0bec0af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35214/0 (socket says 172.21.15.61:35214) 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.235+0000 7f0bf179b700 1 -- 172.21.15.61:0/609865109 learned_addr learned my addr 172.21.15.61:0/609865109 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.236+0000 7f0bf1f9c700 1 --2- 172.21.15.61:0/609865109 >> v2:172.21.15.133:3300/0 conn(0x7f0bec0af3b0 0x7f0bec0ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.236+0000 7f0bf279d700 1 -- 172.21.15.61:0/609865109 >> v2:172.21.15.133:3300/0 conn(0x7f0bec0af3b0 msgr2=0x7f0bec0ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.236+0000 7f0bf279d700 1 --2- 172.21.15.61:0/609865109 >> v2:172.21.15.133:3300/0 conn(0x7f0bec0af3b0 0x7f0bec0ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.236+0000 7f0bf279d700 1 -- 172.21.15.61:0/609865109 >> v1:172.21.15.61:6789/0 conn(0x7f0bec0679a0 legacy=0x7f0bec0c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.236+0000 7f0bf279d700 1 -- 172.21.15.61:0/609865109 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec0c9df0 con 0x7f0bec0cc790 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.236+0000 7f0bf0f9a700 1 -- 172.21.15.61:0/609865109 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600488497 0 0) 0x7f0bec0cd340 con 0x7f0bec0679a0 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.236+0000 7f0bf279d700 1 --2- 172.21.15.61:0/609865109 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0cc790 0x7f0bec0af780 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009e60 tx=0x7f0be4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf919d55039d5ef9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.236+0000 7f0bf0f9a700 1 -- 172.21.15.61:0/609865109 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400e070 con 0x7f0bec0cc790 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.236+0000 7f0bf0f9a700 1 -- 172.21.15.61:0/609865109 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be400bbf0 con 0x7f0bec0cc790 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.236+0000 7f0bf0f9a700 1 -- 172.21.15.61:0/609865109 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4012430 con 0x7f0bec0cc790 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.237+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/609865109 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0cc790 msgr2=0x7f0bec0af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.237+0000 7f0bf2f9e700 1 --2- 172.21.15.61:0/609865109 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0cc790 0x7f0bec0af780 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009e60 tx=0x7f0be4009780 comp rx=0 tx=0).stop 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.237+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/609865109 shutdown_connections 2023-12-24T20:05:56.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.237+0000 7f0bf2f9e700 1 --2- 172.21.15.61:0/609865109 >> v2:172.21.15.133:3300/0 conn(0x7f0bec0af3b0 0x7f0bec0ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.237+0000 7f0bf2f9e700 1 --2- 172.21.15.61:0/609865109 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0cc790 0x7f0bec0af780 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.237+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/609865109 >> 172.21.15.61:0/609865109 conn(0x7f0bec0b0ef0 msgr2=0x7f0bec0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:56.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.237+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/609865109 shutdown_connections 2023-12-24T20:05:56.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.237+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/609865109 wait complete. 2023-12-24T20:05:56.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.238+0000 7f0bf2f9e700 1 Processor -- start 2023-12-24T20:05:56.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.238+0000 7f0bf2f9e700 1 -- start start 2023-12-24T20:05:56.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.238+0000 7f0bf2f9e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0679a0 0x7f0bec158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.238+0000 7f0bf2f9e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bec0af3b0 0x7f0bec09a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.238+0000 7f0bf2f9e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bec0cc790 0x7f0bec09a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.238+0000 7f0bf2f9e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0acf50 con 0x7f0bec0679a0 2023-12-24T20:05:56.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf2f9e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0990b0 con 0x7f0bec0cc790 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf2f9e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec099390 con 0x7f0bec0af3b0 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf1f9c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0679a0 0x7f0bec158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf1f9c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0679a0 0x7f0bec158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35228/0 (socket says 172.21.15.61:35228) 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf1f9c700 1 -- 172.21.15.61:0/3442372372 learned_addr learned my addr 172.21.15.61:0/3442372372 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf1f9c700 1 -- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bec0af3b0 msgr2=0x7f0bec09a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf1f9c700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bec0af3b0 0x7f0bec09a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf1f9c700 1 -- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bec0cc790 msgr2=0x7f0bec09a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf279d700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bec0cc790 0x7f0bec09a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf1f9c700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bec0cc790 0x7f0bec09a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf1f9c700 1 -- 172.21.15.61:0/3442372372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4009a20 con 0x7f0bec0679a0 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf1f9c700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0679a0 0x7f0bec158600 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00d890 tx=0x7f0bdc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0be1ffb700 1 -- 172.21.15.61:0/3442372372 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc00b600 con 0x7f0bec0679a0 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0be1ffb700 1 -- 172.21.15.61:0/3442372372 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc00b760 con 0x7f0bec0679a0 2023-12-24T20:05:56.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/3442372372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bec099670 con 0x7f0bec0679a0 2023-12-24T20:05:56.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0be1ffb700 1 -- 172.21.15.61:0/3442372372 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc00bae0 con 0x7f0bec0679a0 2023-12-24T20:05:56.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.239+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/3442372372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec158b40 con 0x7f0bec0679a0 2023-12-24T20:05:56.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.240+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/3442372372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bec0ad1f0 con 0x7f0bec0679a0 2023-12-24T20:05:56.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.241+0000 7f0be1ffb700 1 -- 172.21.15.61:0/3442372372 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0bdc01e460 con 0x7f0bec0679a0 2023-12-24T20:05:56.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.241+0000 7f0be1ffb700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bd0066f30 0x7f0bd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.241+0000 7f0be1ffb700 1 -- 172.21.15.61:0/3442372372 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0bdc084910 con 0x7f0bec0679a0 2023-12-24T20:05:56.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.241+0000 7f0bf179b700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bd0066f30 0x7f0bd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.242+0000 7f0bf179b700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bd0066f30 0x7f0bd00693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0bec16cfb0 tx=0x7f0be8007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:56.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.245+0000 7f0be1ffb700 1 -- 172.21.15.61:0/3442372372 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bdc051e80 con 0x7f0bec0679a0 2023-12-24T20:05:56.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.522+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/3442372372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f0bec04bb80 con 0x7f0bec0679a0 2023-12-24T20:05:56.740 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.739+0000 7f0be1ffb700 1 -- 172.21.15.61:0/3442372372 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v426) v1 ==== 132+0+0 (secure 0 0 0) 0x7f0bdc0554a0 con 0x7f0bec0679a0 2023-12-24T20:05:56.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bd0066f30 msgr2=0x7f0bd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bd0066f30 0x7f0bd00693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0bec16cfb0 tx=0x7f0be8007bd0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/3442372372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0679a0 msgr2=0x7f0bec158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0679a0 0x7f0bec158600 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00d890 tx=0x7f0bdc008040 comp rx=0 tx=0).stop 2023-12-24T20:05:56.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/3442372372 shutdown_connections 2023-12-24T20:05:56.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0bd0066f30 0x7f0bd00693e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bec0cc790 0x7f0bec09a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0bec0679a0 0x7f0bec158600 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 --2- 172.21.15.61:0/3442372372 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0bec0af3b0 0x7f0bec09a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/3442372372 >> 172.21.15.61:0/3442372372 conn(0x7f0bec0b0ef0 msgr2=0x7f0bec06b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:56.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/3442372372 shutdown_connections 2023-12-24T20:05:56.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.742+0000 7f0bf2f9e700 1 -- 172.21.15.61:0/3442372372 wait complete. 2023-12-24T20:05:56.755 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-24T20:05:56.755 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-12-24T20:05:56.755 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-12-24T20:05:56.755 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-12-24T20:05:56.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.878+0000 7f000b785700 1 Processor -- start 2023-12-24T20:05:56.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.878+0000 7f000b785700 1 -- start start 2023-12-24T20:05:56.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f000b785700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 0x7f000415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f000b785700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0004068dd0 0x7f000415e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f000b785700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000415a780 con 0x7f000415ac10 2023-12-24T20:05:56.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f000b785700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0004069570 con 0x7f0004068dd0 2023-12-24T20:05:56.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f000b785700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000415a170 con 0x7f000415d800 2023-12-24T20:05:56.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f0008d20700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0004068dd0 0x7f000415e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f0008d20700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0004068dd0 0x7f000415e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33700/0 (socket says 172.21.15.61:33700) 2023-12-24T20:05:56.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f0008d20700 1 -- 172.21.15.61:0/2852201562 learned_addr learned my addr 172.21.15.61:0/2852201562 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f0009521700 1 --2- 172.21.15.61:0/2852201562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 0x7f000415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f0008d20700 1 -- 172.21.15.61:0/2852201562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 msgr2=0x7f000415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f0008d20700 1 --2- 172.21.15.61:0/2852201562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 0x7f000415dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f0008d20700 1 -- 172.21.15.61:0/2852201562 >> v1:172.21.15.133:6789/0 conn(0x7f000415ac10 legacy=0x7f000406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f0008d20700 1 -- 172.21.15.61:0/2852201562 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040b17f0 con 0x7f0004068dd0 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.879+0000 7f0008d20700 1 --2- 172.21.15.61:0/2852201562 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0004068dd0 0x7f000415e110 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7efff40099b0 tx=0x7efff4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef9e8d9f66862b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7efffbfff700 1 -- 172.21.15.61:0/2852201562 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400b860 con 0x7f0004068dd0 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7efffbfff700 1 -- 172.21.15.61:0/2852201562 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400b9c0 con 0x7f0004068dd0 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7efffbfff700 1 -- 172.21.15.61:0/2852201562 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400bd60 con 0x7f0004068dd0 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7f000b785700 1 -- 172.21.15.61:0/2852201562 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0004068dd0 msgr2=0x7f000415e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7f000b785700 1 --2- 172.21.15.61:0/2852201562 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0004068dd0 0x7f000415e110 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7efff40099b0 tx=0x7efff4009250 comp rx=0 tx=0).stop 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7f000b785700 1 -- 172.21.15.61:0/2852201562 shutdown_connections 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7f000b785700 1 --2- 172.21.15.61:0/2852201562 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 0x7f000415dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7f000b785700 1 --2- 172.21.15.61:0/2852201562 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0004068dd0 0x7f000415e110 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7f000b785700 1 -- 172.21.15.61:0/2852201562 >> 172.21.15.61:0/2852201562 conn(0x7f000406b650 msgr2=0x7f00040b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:56.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7f000b785700 1 -- 172.21.15.61:0/2852201562 shutdown_connections 2023-12-24T20:05:56.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.880+0000 7f000b785700 1 -- 172.21.15.61:0/2852201562 wait complete. 2023-12-24T20:05:56.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.882+0000 7f000b785700 1 Processor -- start 2023-12-24T20:05:56.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.882+0000 7f000b785700 1 -- start start 2023-12-24T20:05:56.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f000b785700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0004068dd0 0x7f00040ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f000b785700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000415ac10 0x7f000416a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f000b785700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 0x7f0004151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f000b785700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040aa880 con 0x7f000415ac10 2023-12-24T20:05:56.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f000b785700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000416a710 con 0x7f0004068dd0 2023-12-24T20:05:56.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f000b785700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0004152270 con 0x7f000415d800 2023-12-24T20:05:56.885 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0008d20700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000415ac10 0x7f000416a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0008d20700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000415ac10 0x7f000416a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33714/0 (socket says 172.21.15.61:33714) 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0008d20700 1 -- 172.21.15.61:0/1474365865 learned_addr learned my addr 172.21.15.61:0/1474365865 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0009521700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0004068dd0 0x7f00040ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0009d22700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 0x7f0004151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0008d20700 1 -- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 msgr2=0x7f0004151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0008d20700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 0x7f0004151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0008d20700 1 -- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0004068dd0 msgr2=0x7f00040ad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0008d20700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0004068dd0 0x7f00040ad340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0008d20700 1 -- 172.21.15.61:0/1474365865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff40094f0 con 0x7f000415ac10 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.883+0000 7f0009d22700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 0x7f0004151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:56.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.884+0000 7f0008d20700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000415ac10 0x7f000416a1d0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f000406a960 tx=0x7efff4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:56.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.884+0000 7efff97fa700 1 -- 172.21.15.61:0/1474365865 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4024440 con 0x7f000415ac10 2023-12-24T20:05:56.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.884+0000 7efff97fa700 1 -- 172.21.15.61:0/1474365865 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff40245c0 con 0x7f000415ac10 2023-12-24T20:05:56.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.884+0000 7f000b785700 1 -- 172.21.15.61:0/1474365865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00040aaad0 con 0x7f000415ac10 2023-12-24T20:05:56.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.884+0000 7efff97fa700 1 -- 172.21.15.61:0/1474365865 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4024980 con 0x7f000415ac10 2023-12-24T20:05:56.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.884+0000 7f000b785700 1 -- 172.21.15.61:0/1474365865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040ab090 con 0x7f000415ac10 2023-12-24T20:05:56.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.885+0000 7f000b785700 1 -- 172.21.15.61:0/1474365865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000404c3c0 con 0x7f000415ac10 2023-12-24T20:05:56.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.885+0000 7efff97fa700 1 -- 172.21.15.61:0/1474365865 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7efff401a420 con 0x7f000415ac10 2023-12-24T20:05:56.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.885+0000 7efff97fa700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe8066fb0 0x7effe8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:56.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.886+0000 7efff97fa700 1 -- 172.21.15.61:0/1474365865 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efff4085f70 con 0x7f000415ac10 2023-12-24T20:05:56.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.886+0000 7f0009521700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe8066fb0 0x7effe8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:56.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.886+0000 7f0009521700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe8066fb0 0x7effe8069460 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0000006fd0 tx=0x7f0000008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:56.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:56.890+0000 7efff97fa700 1 -- 172.21.15.61:0/1474365865 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efff4053440 con 0x7f000415ac10 2023-12-24T20:05:57.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.164+0000 7f000b785700 1 -- 172.21.15.61:0/1474365865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f0004069290 con 0x7f000415ac10 2023-12-24T20:05:57.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.741+0000 7efff97fa700 1 -- 172.21.15.61:0/1474365865 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v427) v1 ==== 134+0+0 (secure 0 0 0) 0x7efff4056a60 con 0x7f000415ac10 2023-12-24T20:05:57.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 -- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe8066fb0 msgr2=0x7effe8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:57.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe8066fb0 0x7effe8069460 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0000006fd0 tx=0x7f0000008040 comp rx=0 tx=0).stop 2023-12-24T20:05:57.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 -- 172.21.15.61:0/1474365865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000415ac10 msgr2=0x7f000416a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:57.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000415ac10 0x7f000416a1d0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f000406a960 tx=0x7efff4017000 comp rx=0 tx=0).stop 2023-12-24T20:05:57.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 -- 172.21.15.61:0/1474365865 shutdown_connections 2023-12-24T20:05:57.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f000415d800 0x7f0004151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:57.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7effe8066fb0 0x7effe8069460 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:57.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0004068dd0 0x7f00040ad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:57.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 --2- 172.21.15.61:0/1474365865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f000415ac10 0x7f000416a1d0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:57.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 -- 172.21.15.61:0/1474365865 >> 172.21.15.61:0/1474365865 conn(0x7f000406b650 msgr2=0x7f000415b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:57.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 -- 172.21.15.61:0/1474365865 shutdown_connections 2023-12-24T20:05:57.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.744+0000 7f000b785700 1 -- 172.21.15.61:0/1474365865 wait complete. 2023-12-24T20:05:57.758 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T20:05:57.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.886+0000 7f063bfa5700 1 Processor -- start 2023-12-24T20:05:57.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.886+0000 7f063bfa5700 1 -- start start 2023-12-24T20:05:57.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f063bfa5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06340af330 0x7f063406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:57.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f063bfa5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340caf30 con 0x7f06341578d0 2023-12-24T20:05:57.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f063bfa5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063406b570 con 0x7f063406b150 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f063bfa5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06340af7d0 con 0x7f06340af330 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f0639d41700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f06341578d0 0x7f063406f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33360/0 (socket says 172.21.15.61:33360) 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f0639d41700 1 -- 172.21.15.61:0/1773579848 learned_addr learned my addr 172.21.15.61:0/1773579848 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f0639540700 1 --2- 172.21.15.61:0/1773579848 >> v2:172.21.15.133:3300/0 conn(0x7f06340af330 0x7f063406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f0638d3f700 1 -- 172.21.15.61:0/1773579848 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165876445 0 0) 0x7f06340caf30 con 0x7f06341578d0 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f0638d3f700 1 -- 172.21.15.61:0/1773579848 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0620003570 con 0x7f06341578d0 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f0639540700 1 -- 172.21.15.61:0/1773579848 >> v1:172.21.15.133:6789/0 conn(0x7f063406b150 legacy=0x7f06340c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f0638d3f700 1 -- 172.21.15.61:0/1773579848 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2586669505 0 0) 0x7f0620003570 con 0x7f06341578d0 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f0639540700 1 -- 172.21.15.61:0/1773579848 >> v1:172.21.15.61:6789/0 conn(0x7f06341578d0 legacy=0x7f063406f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.887+0000 7f0639540700 1 -- 172.21.15.61:0/1773579848 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340af9f0 con 0x7f06340af330 2023-12-24T20:05:57.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.888+0000 7f0639540700 1 --2- 172.21.15.61:0/1773579848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06340af330 0x7f063406ac10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f06240098e0 tx=0x7f06240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4889bd52f3b383ff server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:57.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.888+0000 7f0638d3f700 1 -- 172.21.15.61:0/1773579848 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630001470 con 0x7f06340af330 2023-12-24T20:05:57.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.888+0000 7f0638d3f700 1 -- 172.21.15.61:0/1773579848 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624011420 con 0x7f06340af330 2023-12-24T20:05:57.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.888+0000 7f0638d3f700 1 -- 172.21.15.61:0/1773579848 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06240117c0 con 0x7f06340af330 2023-12-24T20:05:57.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.888+0000 7f063bfa5700 1 -- 172.21.15.61:0/1773579848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06340af330 msgr2=0x7f063406ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:57.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.888+0000 7f063bfa5700 1 --2- 172.21.15.61:0/1773579848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06340af330 0x7f063406ac10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f06240098e0 tx=0x7f06240091a0 comp rx=0 tx=0).stop 2023-12-24T20:05:57.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.888+0000 7f063bfa5700 1 -- 172.21.15.61:0/1773579848 shutdown_connections 2023-12-24T20:05:57.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.888+0000 7f063bfa5700 1 --2- 172.21.15.61:0/1773579848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06340af330 0x7f063406ac10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:57.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.888+0000 7f063bfa5700 1 -- 172.21.15.61:0/1773579848 >> 172.21.15.61:0/1773579848 conn(0x7f06340ce800 msgr2=0x7f06340cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:57.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.889+0000 7f063bfa5700 1 -- 172.21.15.61:0/1773579848 shutdown_connections 2023-12-24T20:05:57.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.889+0000 7f063bfa5700 1 -- 172.21.15.61:0/1773579848 wait complete. 2023-12-24T20:05:57.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.890+0000 7f063bfa5700 1 Processor -- start 2023-12-24T20:05:57.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.890+0000 7f063bfa5700 1 -- start start 2023-12-24T20:05:57.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.890+0000 7f063bfa5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f063406b150 0x7f063414bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:57.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.890+0000 7f063bfa5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06340af330 0x7f06340c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:57.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.890+0000 7f063bfa5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06341578d0 0x7f06340cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:57.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.890+0000 7f063bfa5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06341594d0 con 0x7f06341578d0 2023-12-24T20:05:57.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.890+0000 7f063bfa5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c6440 con 0x7f06340af330 2023-12-24T20:05:57.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.890+0000 7f063bfa5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340c9460 con 0x7f063406b150 2023-12-24T20:05:57.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.890+0000 7f063a542700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06341578d0 0x7f06340cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:57.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f063a542700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06341578d0 0x7f06340cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33720/0 (socket says 172.21.15.61:33720) 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f063a542700 1 -- 172.21.15.61:0/2571441606 learned_addr learned my addr 172.21.15.61:0/2571441606 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f0639540700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06340af330 0x7f06340c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f0639d41700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f063406b150 0x7f063414bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f063a542700 1 -- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f063406b150 msgr2=0x7f063414bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f063a542700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f063406b150 0x7f063414bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f063a542700 1 -- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06340af330 msgr2=0x7f06340c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f063a542700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06340af330 0x7f06340c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f063a542700 1 -- 172.21.15.61:0/2571441606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0624009420 con 0x7f06341578d0 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f0639540700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06340af330 0x7f06340c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f063a542700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06341578d0 0x7f06340cb270 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f062c00c980 tx=0x7f062c001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f0629ffb700 1 -- 172.21.15.61:0/2571441606 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00a7e0 con 0x7f06341578d0 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f0629ffb700 1 -- 172.21.15.61:0/2571441606 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c00a940 con 0x7f06341578d0 2023-12-24T20:05:57.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f063bfa5700 1 -- 172.21.15.61:0/2571441606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0634158e80 con 0x7f06341578d0 2023-12-24T20:05:57.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f0629ffb700 1 -- 172.21.15.61:0/2571441606 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00ad00 con 0x7f06341578d0 2023-12-24T20:05:57.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.891+0000 7f063bfa5700 1 -- 172.21.15.61:0/2571441606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063414c220 con 0x7f06341578d0 2023-12-24T20:05:57.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.892+0000 7f063bfa5700 1 -- 172.21.15.61:0/2571441606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0634159680 con 0x7f06341578d0 2023-12-24T20:05:57.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.893+0000 7f0629ffb700 1 -- 172.21.15.61:0/2571441606 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f062c003030 con 0x7f06341578d0 2023-12-24T20:05:57.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.893+0000 7f0629ffb700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0618066f30 0x7f06180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:57.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.893+0000 7f0629ffb700 1 -- 172.21.15.61:0/2571441606 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f062c084340 con 0x7f06341578d0 2023-12-24T20:05:57.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.893+0000 7f0639d41700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0618066f30 0x7f06180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:57.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.894+0000 7f0639d41700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0618066f30 0x7f06180693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f06300015a0 tx=0x7f0630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:57.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:57.898+0000 7f0629ffb700 1 -- 172.21.15.61:0/2571441606 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0634159680 con 0x7f06341578d0 2023-12-24T20:05:58.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.093+0000 7f063bfa5700 1 -- 172.21.15.61:0/2571441606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f063404c3c0 con 0x7f06341578d0 2023-12-24T20:05:58.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.096+0000 7f0629ffb700 1 -- 172.21.15.61:0/2571441606 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f062c055340 con 0x7f06341578d0 2023-12-24T20:05:58.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 -- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0618066f30 msgr2=0x7f06180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0618066f30 0x7f06180693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f06300015a0 tx=0x7f0630009040 comp rx=0 tx=0).stop 2023-12-24T20:05:58.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 -- 172.21.15.61:0/2571441606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06341578d0 msgr2=0x7f06340cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06341578d0 0x7f06340cb270 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f062c00c980 tx=0x7f062c001770 comp rx=0 tx=0).stop 2023-12-24T20:05:58.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 -- 172.21.15.61:0/2571441606 shutdown_connections 2023-12-24T20:05:58.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f063406b150 0x7f063414bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0618066f30 0x7f06180693e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f06341578d0 0x7f06340cb270 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 --2- 172.21.15.61:0/2571441606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06340af330 0x7f06340c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 -- 172.21.15.61:0/2571441606 >> 172.21.15.61:0/2571441606 conn(0x7f06340ce800 msgr2=0x7f06340c2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:58.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 -- 172.21.15.61:0/2571441606 shutdown_connections 2023-12-24T20:05:58.100 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.098+0000 7f063bfa5700 1 -- 172.21.15.61:0/2571441606 wait complete. 2023-12-24T20:05:58.111 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:05:58.111 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:05:58.164 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:05:58.216 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:05:58.216 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T20:05:58.216 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:05:58.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.338+0000 7fe0bb281700 1 Processor -- start 2023-12-24T20:05:58.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.338+0000 7fe0bb281700 1 -- start start 2023-12-24T20:05:58.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.339+0000 7fe0bb281700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159c10 0x7fe0b40c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.339+0000 7fe0bb281700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0b40cc190 0x7fe0b40c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.339+0000 7fe0bb281700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b40af880 con 0x7fe0b4159fe0 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.339+0000 7fe0bb281700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b40c6fc0 con 0x7fe0b40cc190 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.339+0000 7fe0bb281700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40c63b0 con 0x7fe0b4159c10 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.339+0000 7fe0b881c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe0b4159fe0 0x7fe0b40cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33364/0 (socket says 172.21.15.61:33364) 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0b881c700 1 -- 172.21.15.61:0/601638970 learned_addr learned my addr 172.21.15.61:0/601638970 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0b981e700 1 --2- 172.21.15.61:0/601638970 >> v2:172.21.15.133:3300/0 conn(0x7fe0b40cc190 0x7fe0b40c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0b901d700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159c10 0x7fe0b40c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888931051 0 0) 0x7fe0b40af880 con 0x7fe0b4159fe0 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a0003570 con 0x7fe0b4159fe0 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4140853403 0 0) 0x7fe0a0003570 con 0x7fe0b4159fe0 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159c10 msgr2=0x7fe0b40c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159c10 0x7fe0b40c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 >> v2:172.21.15.133:3300/0 conn(0x7fe0b40cc190 msgr2=0x7fe0b40c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:58.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 --2- 172.21.15.61:0/601638970 >> v2:172.21.15.133:3300/0 conn(0x7fe0b40cc190 0x7fe0b40c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b40c6690 con 0x7fe0b4159fe0 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fe0b0001470 con 0x7fe0b4159fe0 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 >> v1:172.21.15.61:6789/0 conn(0x7fe0b4159fe0 legacy=0x7fe0b40cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a0003a60 0x7fe0a0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 0x7fe0a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159c10 0x7fe0a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40c6fc0 con 0x7fe0a0004810 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40c63b0 con 0x7fe0a0003a60 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a000ba60 con 0x7fe0b4159c10 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0b881c700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 0x7fe0a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0b901d700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a0003a60 0x7fe0a0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.350 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.340+0000 7fe0b981e700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159c10 0x7fe0a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0b881c700 1 -- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159c10 msgr2=0x7fe0a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0b881c700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b4159c10 0x7fe0a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0b881c700 1 -- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a0003a60 msgr2=0x7fe0a0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0b881c700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a0003a60 0x7fe0a0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0b881c700 1 -- 172.21.15.61:0/601638970 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0003570 con 0x7fe0a0004810 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0b901d700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a0003a60 0x7fe0a0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0b881c700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 0x7fe0a0004c80 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c3f0 tx=0x7fe0b40c7100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fab3eb668cfde3 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000cc80 con 0x7fe0a0004810 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000cde0 con 0x7fe0a0004810 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0abfff700 1 -- 172.21.15.61:0/601638970 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0005b70 con 0x7fe0a0004810 2023-12-24T20:05:58.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0bb281700 1 -- 172.21.15.61:0/601638970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 msgr2=0x7fe0a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0bb281700 1 --2- 172.21.15.61:0/601638970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 0x7fe0a0004c80 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c3f0 tx=0x7fe0b40c7100 comp rx=0 tx=0).stop 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0b981e700 1 -- 172.21.15.61:0/601638970 reap_dead start 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0bb281700 1 -- 172.21.15.61:0/601638970 shutdown_connections 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0bb281700 1 -- 172.21.15.61:0/601638970 >> 172.21.15.61:0/601638970 conn(0x7fe0b406e640 msgr2=0x7fe0b4067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.341+0000 7fe0bb281700 1 -- 172.21.15.61:0/601638970 shutdown_connections 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.342+0000 7fe0bb281700 1 -- 172.21.15.61:0/601638970 wait complete. 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.343+0000 7fe0bb281700 1 Processor -- start 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.343+0000 7fe0bb281700 1 -- start start 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.344+0000 7fe0bb281700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 0x7fe0b40b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.344+0000 7fe0bb281700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b40b6430 0x7fe0b41537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.344+0000 7fe0bb281700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b40c8400 0x7fe0b41551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.344+0000 7fe0bb281700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b415f660 con 0x7fe0a0004810 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.344+0000 7fe0bb281700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4153ce0 con 0x7fe0b40c8400 2023-12-24T20:05:58.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.344+0000 7fe0bb281700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40c8900 con 0x7fe0b40b6430 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.344+0000 7fe0b901d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 0x7fe0b40b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.344+0000 7fe0b901d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 0x7fe0b40b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33734/0 (socket says 172.21.15.61:33734) 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.344+0000 7fe0b901d700 1 -- 172.21.15.61:0/415459539 learned_addr learned my addr 172.21.15.61:0/415459539 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0b981e700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b40c8400 0x7fe0b41551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0b881c700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b40b6430 0x7fe0b41537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0b901d700 1 -- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b40b6430 msgr2=0x7fe0b41537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0b901d700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b40b6430 0x7fe0b41537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0b901d700 1 -- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b40c8400 msgr2=0x7fe0b41551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0b901d700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b40c8400 0x7fe0b41551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0b901d700 1 -- 172.21.15.61:0/415459539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b415f010 con 0x7fe0a0004810 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0b901d700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 0x7fe0b40b4950 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4011910 tx=0x7fe0a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0a97fa700 1 -- 172.21.15.61:0/415459539 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4011eb0 con 0x7fe0a0004810 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0a97fa700 1 -- 172.21.15.61:0/415459539 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a400f860 con 0x7fe0a0004810 2023-12-24T20:05:58.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0bb281700 1 -- 172.21.15.61:0/415459539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b415f2f0 con 0x7fe0a0004810 2023-12-24T20:05:58.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0a97fa700 1 -- 172.21.15.61:0/415459539 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a400fc00 con 0x7fe0a0004810 2023-12-24T20:05:58.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.345+0000 7fe0bb281700 1 -- 172.21.15.61:0/415459539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b40cacb0 con 0x7fe0a0004810 2023-12-24T20:05:58.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.346+0000 7fe0bb281700 1 -- 172.21.15.61:0/415459539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b40890b0 con 0x7fe0a0004810 2023-12-24T20:05:58.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.346+0000 7fe0a97fa700 1 -- 172.21.15.61:0/415459539 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe0a4015460 con 0x7fe0a0004810 2023-12-24T20:05:58.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.347+0000 7fe0a97fa700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 0x7fe0980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.347+0000 7fe0a97fa700 1 -- 172.21.15.61:0/415459539 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe0a40849c0 con 0x7fe0a0004810 2023-12-24T20:05:58.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.347+0000 7fe0b881c700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 0x7fe0980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.348+0000 7fe0b881c700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 0x7fe0980693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c310 tx=0x7fe0b0015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:58.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.351+0000 7fe0a97fa700 1 -- 172.21.15.61:0/415459539 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0a4051f30 con 0x7fe0a0004810 2023-12-24T20:05:58.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.595+0000 7fe0bb281700 1 -- 172.21.15.61:0/415459539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0b404c3c0 con 0x7fe0a0004810 2023-12-24T20:05:58.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.595+0000 7fe0a97fa700 1 -- 172.21.15.61:0/415459539 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fe0a4022de0 con 0x7fe0a0004810 2023-12-24T20:05:58.596 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:05:58.596 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3725605380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3725605380},{"type":"v1","addr":"172.21.15.133:6837","nonce":3725605380}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":6724,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2558204756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2558204756},{"type":"v1","addr":"172.21.15.133:6836","nonce":2558204756}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7482,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3124455429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":3124455429},{"type":"v1","addr":"172.21.15.61:6834","nonce":3124455429}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7755,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/495515764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":495515764},{"type":"v1","addr":"172.21.15.61:6835","nonce":495515764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[]} 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 -- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 msgr2=0x7fe0980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 0x7fe0980693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c310 tx=0x7fe0b0015000 comp rx=0 tx=0).stop 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 -- 172.21.15.61:0/415459539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 msgr2=0x7fe0b40b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 0x7fe0b40b4950 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4011910 tx=0x7fe0a4008040 comp rx=0 tx=0).stop 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 -- 172.21.15.61:0/415459539 shutdown_connections 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe098066f30 0x7fe0980693e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0b40c8400 0x7fe0b41551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe0a0004810 0x7fe0b40b4950 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 --2- 172.21.15.61:0/415459539 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe0b40b6430 0x7fe0b41537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 -- 172.21.15.61:0/415459539 >> 172.21.15.61:0/415459539 conn(0x7fe0b406e640 msgr2=0x7fe0b40d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 -- 172.21.15.61:0/415459539 shutdown_connections 2023-12-24T20:05:58.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.597+0000 7fe0bb281700 1 -- 172.21.15.61:0/415459539 wait complete. 2023-12-24T20:05:58.599 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 78 2023-12-24T20:05:58.610 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T20:05:58.611 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T20:05:58.611 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:05:58.611 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:05:58.611 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T20:05:58.611 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T20:05:58.611 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:05:58.612 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:05:58.612 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T20:05:58.612 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T20:05:58.612 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:05:58.612 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:05:58.612 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T20:05:58.612 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T20:05:58.613 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:05:58.613 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:05:58.620 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:05:58.621 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T20:05:58.621 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:05:58.622 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T20:05:58.627 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:05:58.627 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T20:05:58.628 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:05:58.628 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T20:05:58.663 INFO:tasks.ceph.mds.a:Started 2023-12-24T20:05:58.664 DEBUG:teuthology.parallel:result is None 2023-12-24T20:05:58.664 INFO:tasks.ceph.mds.c:Started 2023-12-24T20:05:58.664 DEBUG:teuthology.parallel:result is None 2023-12-24T20:05:58.670 INFO:tasks.ceph.mds.b:Started 2023-12-24T20:05:58.670 DEBUG:teuthology.parallel:result is None 2023-12-24T20:05:58.670 INFO:tasks.ceph.mds.d:Started 2023-12-24T20:05:58.671 DEBUG:teuthology.parallel:result is None 2023-12-24T20:05:58.671 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T20:05:58.742 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T20:05:58.743 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T20:05:58.755 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T20:05:58.755 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T20:05:58.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.800+0000 7f39953d9700 1 Processor -- start 2023-12-24T20:05:58.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.800+0000 7f39953d9700 1 -- start start 2023-12-24T20:05:58.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.801+0000 7f39953d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 0x7f39900ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.801+0000 7f39953d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3990069f00 0x7f39900cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.801+0000 7f39953d9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3990158350 con 0x7f39900ce3e0 2023-12-24T20:05:58.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.801+0000 7f39953d9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3990158ef0 con 0x7f3990069f00 2023-12-24T20:05:58.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.801+0000 7f39953d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39900ca740 con 0x7f39900ce010 2023-12-24T20:05:58.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.801+0000 7f398f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3990069f00 0x7f39900cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.801+0000 7f398effd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 0x7f39900ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.801+0000 7f398e7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f39900ce3e0 0x7f39901587e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:38956/0 (socket says 172.21.15.61:38956) 2023-12-24T20:05:58.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.801+0000 7f398e7fc700 1 -- 172.21.15.61:0/1471479471 learned_addr learned my addr 172.21.15.61:0/1471479471 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:05:58.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398dffb700 1 -- 172.21.15.61:0/1471479471 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745785535 0 0) 0x7f3990158350 con 0x7f39900ce3e0 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398dffb700 1 -- 172.21.15.61:0/1471479471 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c003570 con 0x7f39900ce3e0 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398f7fe700 1 -- 172.21.15.61:0/1471479471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 msgr2=0x7f39900ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398f7fe700 1 --2- 172.21.15.61:0/1471479471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 0x7f39900ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398f7fe700 1 -- 172.21.15.61:0/1471479471 >> v1:172.21.15.133:6789/0 conn(0x7f39900ce3e0 legacy=0x7f39901587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398f7fe700 1 -- 172.21.15.61:0/1471479471 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39900b1120 con 0x7f3990069f00 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398effd700 1 --2- 172.21.15.61:0/1471479471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 0x7f39900ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398f7fe700 1 --2- 172.21.15.61:0/1471479471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3990069f00 0x7f39900cb210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f39880098e0 tx=0x7f39880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=549fedeeccfd717d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398dffb700 1 -- 172.21.15.61:0/1471479471 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3988011630 con 0x7f3990069f00 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398dffb700 1 -- 172.21.15.61:0/1471479471 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3988011790 con 0x7f3990069f00 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.802+0000 7f398dffb700 1 -- 172.21.15.61:0/1471479471 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3988011b30 con 0x7f3990069f00 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.803+0000 7f39953d9700 1 -- 172.21.15.61:0/1471479471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3990069f00 msgr2=0x7f39900cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.803+0000 7f39953d9700 1 --2- 172.21.15.61:0/1471479471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3990069f00 0x7f39900cb210 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f39880098e0 tx=0x7f39880091a0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.803+0000 7f39953d9700 1 -- 172.21.15.61:0/1471479471 shutdown_connections 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.803+0000 7f39953d9700 1 --2- 172.21.15.61:0/1471479471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3990069f00 0x7f39900cb210 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.803+0000 7f39953d9700 1 --2- 172.21.15.61:0/1471479471 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 0x7f39900ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.803+0000 7f39953d9700 1 -- 172.21.15.61:0/1471479471 >> 172.21.15.61:0/1471479471 conn(0x7f399006b790 msgr2=0x7f3990069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:05:58.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.803+0000 7f39953d9700 1 -- 172.21.15.61:0/1471479471 shutdown_connections 2023-12-24T20:05:58.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.803+0000 7f39953d9700 1 -- 172.21.15.61:0/1471479471 wait complete. 2023-12-24T20:05:58.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.804+0000 7f39953d9700 1 Processor -- start 2023-12-24T20:05:58.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.804+0000 7f39953d9700 1 -- start start 2023-12-24T20:05:58.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f39953d9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3990069f00 0x7f39901504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f39953d9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 0x7f399015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f39953d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39900ce3e0 0x7f399015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f39953d9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900aa880 con 0x7f3990069f00 2023-12-24T20:05:58.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f39953d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3990068bb0 con 0x7f39900ce3e0 2023-12-24T20:05:58.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f39953d9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3990068310 con 0x7f39900ce010 2023-12-24T20:05:58.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3990069f00 0x7f39901504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3990069f00 0x7f39901504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33780/0 (socket says 172.21.15.61:33780) 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398effd700 1 -- 172.21.15.61:0/2646298640 learned_addr learned my addr 172.21.15.61:0/2646298640 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398e7fc700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 0x7f399015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398f7fe700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39900ce3e0 0x7f399015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398effd700 1 -- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 msgr2=0x7f399015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398effd700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 0x7f399015f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398effd700 1 -- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39900ce3e0 msgr2=0x7f399015fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398effd700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39900ce3e0 0x7f399015fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398effd700 1 -- 172.21.15.61:0/2646298640 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980009a20 con 0x7f3990069f00 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f398effd700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3990069f00 0x7f39901504f0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f398000c170 tx=0x7f398000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f3986ffd700 1 -- 172.21.15.61:0/2646298640 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398000ccb0 con 0x7f3990069f00 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f3986ffd700 1 -- 172.21.15.61:0/2646298640 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398000f040 con 0x7f3990069f00 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f39953d9700 1 -- 172.21.15.61:0/2646298640 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3988009420 con 0x7f3990069f00 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.805+0000 7f3986ffd700 1 -- 172.21.15.61:0/2646298640 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980014480 con 0x7f3990069f00 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.806+0000 7f39953d9700 1 -- 172.21.15.61:0/2646298640 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39900688d0 con 0x7f3990069f00 2023-12-24T20:05:58.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.806+0000 7f39953d9700 1 -- 172.21.15.61:0/2646298640 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399004c3c0 con 0x7f3990069f00 2023-12-24T20:05:58.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.807+0000 7f3986ffd700 1 -- 172.21.15.61:0/2646298640 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f39800147f0 con 0x7f3990069f00 2023-12-24T20:05:58.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.807+0000 7f3986ffd700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3970066f30 0x7f39700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:05:58.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.807+0000 7f3986ffd700 1 -- 172.21.15.61:0/2646298640 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3980084cb0 con 0x7f3990069f00 2023-12-24T20:05:58.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.808+0000 7f398e7fc700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3970066f30 0x7f39700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:05:58.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.808+0000 7f398e7fc700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3970066f30 0x7f39700693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3990069730 tx=0x7f3978009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:05:58.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:58.812+0000 7f3986ffd700 1 -- 172.21.15.61:0/2646298640 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3980052220 con 0x7f3990069f00 2023-12-24T20:05:59.022 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:05:59.022+0000 7f39953d9700 1 -- 172.21.15.61:0/2646298640 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f39900b4600 con 0x7f3990069f00 2023-12-24T20:06:00.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.110+0000 7f3986ffd700 1 -- 172.21.15.61:0/2646298640 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v164) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3980055840 con 0x7f3990069f00 2023-12-24T20:06:00.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 -- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3970066f30 msgr2=0x7f39700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3970066f30 0x7f39700693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3990069730 tx=0x7f3978009040 comp rx=0 tx=0).stop 2023-12-24T20:06:00.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 -- 172.21.15.61:0/2646298640 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3990069f00 msgr2=0x7f39901504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3990069f00 0x7f39901504f0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f398000c170 tx=0x7f398000b040 comp rx=0 tx=0).stop 2023-12-24T20:06:00.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 -- 172.21.15.61:0/2646298640 shutdown_connections 2023-12-24T20:06:00.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3970066f30 0x7f39700693e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39900ce3e0 0x7f399015fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3990069f00 0x7f39901504f0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 --2- 172.21.15.61:0/2646298640 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39900ce010 0x7f399015f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 -- 172.21.15.61:0/2646298640 >> 172.21.15.61:0/2646298640 conn(0x7f399006b790 msgr2=0x7f39901587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:00.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 -- 172.21.15.61:0/2646298640 shutdown_connections 2023-12-24T20:06:00.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.113+0000 7f39953d9700 1 -- 172.21.15.61:0/2646298640 wait complete. 2023-12-24T20:06:00.116 INFO:teuthology.orchestra.run.smithi061.stderr: removed all blocklist entries 2023-12-24T20:06:00.130 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T20:06:00.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.262+0000 7ff7ecf16700 1 Processor -- start 2023-12-24T20:06:00.274 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.262+0000 7ff7ecf16700 1 -- start start 2023-12-24T20:06:00.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.263+0000 7ff7ecf16700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7e8068140 0x7ff7e80cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.263+0000 7ff7ecf16700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff7e8159a60 0x7ff7e8159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.263+0000 7ff7ecf16700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e80b2890 con 0x7ff7e8068510 2023-12-24T20:06:00.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.263+0000 7ff7ecf16700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e80cf630 con 0x7ff7e8159a60 2023-12-24T20:06:00.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.263+0000 7ff7ecf16700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e80b2240 con 0x7ff7e8068140 2023-12-24T20:06:00.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.263+0000 7ff7e6d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff7e8159a60 0x7ff7e8159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e6d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff7e8159a60 0x7ff7e8159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33792/0 (socket says 172.21.15.61:33792) 2023-12-24T20:06:00.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e6d9d700 1 -- 172.21.15.61:0/223065595 learned_addr learned my addr 172.21.15.61:0/223065595 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:00.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e659c700 1 --2- 172.21.15.61:0/223065595 >> v2:172.21.15.133:3300/0 conn(0x7ff7e8068140 0x7ff7e80cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.275 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e6d9d700 1 -- 172.21.15.61:0/223065595 >> v2:172.21.15.133:3300/0 conn(0x7ff7e8068140 msgr2=0x7ff7e80cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:00.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e6d9d700 1 --2- 172.21.15.61:0/223065595 >> v2:172.21.15.133:3300/0 conn(0x7ff7e8068140 0x7ff7e80cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e6d9d700 1 -- 172.21.15.61:0/223065595 >> v1:172.21.15.133:6789/0 conn(0x7ff7e8068510 legacy=0x7ff7e80b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e6d9d700 1 -- 172.21.15.61:0/223065595 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e80b2520 con 0x7ff7e8159a60 2023-12-24T20:06:00.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e659c700 1 --2- 172.21.15.61:0/223065595 >> v2:172.21.15.133:3300/0 conn(0x7ff7e8068140 0x7ff7e80cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:00.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e6d9d700 1 --2- 172.21.15.61:0/223065595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8159a60 0x7ff7e8159ee0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7ff7e806e290 tx=0x7ff7e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f20c726056308af server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:00.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e559a700 1 -- 172.21.15.61:0/223065595 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000e070 con 0x7ff7e8159a60 2023-12-24T20:06:00.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e559a700 1 -- 172.21.15.61:0/223065595 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e000ba50 con 0x7ff7e8159a60 2023-12-24T20:06:00.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.264+0000 7ff7e559a700 1 -- 172.21.15.61:0/223065595 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00092e0 con 0x7ff7e8159a60 2023-12-24T20:06:00.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.265+0000 7ff7ecf16700 1 -- 172.21.15.61:0/223065595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8159a60 msgr2=0x7ff7e8159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.265+0000 7ff7ecf16700 1 --2- 172.21.15.61:0/223065595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8159a60 0x7ff7e8159ee0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7ff7e806e290 tx=0x7ff7e0009840 comp rx=0 tx=0).stop 2023-12-24T20:06:00.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.265+0000 7ff7ecf16700 1 -- 172.21.15.61:0/223065595 shutdown_connections 2023-12-24T20:06:00.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.265+0000 7ff7ecf16700 1 --2- 172.21.15.61:0/223065595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8159a60 0x7ff7e8159ee0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.265+0000 7ff7ecf16700 1 --2- 172.21.15.61:0/223065595 >> v2:172.21.15.133:3300/0 conn(0x7ff7e8068140 0x7ff7e80cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.265+0000 7ff7ecf16700 1 -- 172.21.15.61:0/223065595 >> 172.21.15.61:0/223065595 conn(0x7ff7e8097a10 msgr2=0x7ff7e80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:00.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.265+0000 7ff7ecf16700 1 -- 172.21.15.61:0/223065595 shutdown_connections 2023-12-24T20:06:00.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.265+0000 7ff7ecf16700 1 -- 172.21.15.61:0/223065595 wait complete. 2023-12-24T20:06:00.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.266+0000 7ff7ecf16700 1 Processor -- start 2023-12-24T20:06:00.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.266+0000 7ff7ecf16700 1 -- start start 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7ecf16700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8068140 0x7ff7e815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7ecf16700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff7e8068510 0x7ff7e815d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7ecf16700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e8159a60 0x7ff7e816d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7ecf16700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e815b060 con 0x7ff7e8068140 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7ecf16700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e815b340 con 0x7ff7e8159a60 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7ecf16700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e815b620 con 0x7ff7e8068510 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7e659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8068140 0x7ff7e815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7e659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8068140 0x7ff7e815c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33808/0 (socket says 172.21.15.61:33808) 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7e659c700 1 -- 172.21.15.61:0/482214389 learned_addr learned my addr 172.21.15.61:0/482214389 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7e5d9b700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff7e8068510 0x7ff7e815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.278 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7e6d9d700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e8159a60 0x7ff7e816d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7e659c700 1 -- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff7e8068510 msgr2=0x7ff7e815d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7e659c700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff7e8068510 0x7ff7e815d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7e659c700 1 -- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e8159a60 msgr2=0x7ff7e816d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7e659c700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e8159a60 0x7ff7e816d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.267+0000 7ff7e659c700 1 -- 172.21.15.61:0/482214389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e0009ae0 con 0x7ff7e8068140 2023-12-24T20:06:00.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.268+0000 7ff7e659c700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8068140 0x7ff7e815c100 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000e920 tx=0x7ff7d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:00.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.268+0000 7ff7de7fc700 1 -- 172.21.15.61:0/482214389 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0005a00 con 0x7ff7e8068140 2023-12-24T20:06:00.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.268+0000 7ff7de7fc700 1 -- 172.21.15.61:0/482214389 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d0005b60 con 0x7ff7e8068140 2023-12-24T20:06:00.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.268+0000 7ff7ecf16700 1 -- 172.21.15.61:0/482214389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e815b900 con 0x7ff7e8068140 2023-12-24T20:06:00.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.268+0000 7ff7de7fc700 1 -- 172.21.15.61:0/482214389 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0006020 con 0x7ff7e8068140 2023-12-24T20:06:00.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.268+0000 7ff7ecf16700 1 -- 172.21.15.61:0/482214389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e815acf0 con 0x7ff7e8068140 2023-12-24T20:06:00.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.269+0000 7ff7ecf16700 1 -- 172.21.15.61:0/482214389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e815bda0 con 0x7ff7e8068140 2023-12-24T20:06:00.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.269+0000 7ff7de7fc700 1 -- 172.21.15.61:0/482214389 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff7d00063d0 con 0x7ff7e8068140 2023-12-24T20:06:00.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.269+0000 7ff7de7fc700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff7c8066f30 0x7ff7c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.270+0000 7ff7de7fc700 1 -- 172.21.15.61:0/482214389 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff7d00841e0 con 0x7ff7e8068140 2023-12-24T20:06:00.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.270+0000 7ff7e5d9b700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff7c8066f30 0x7ff7c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.270+0000 7ff7e5d9b700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff7c8066f30 0x7ff7c80693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8157e20 tx=0x7ff7d8007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:00.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.274+0000 7ff7de7fc700 1 -- 172.21.15.61:0/482214389 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7d0051850 con 0x7ff7e8068140 2023-12-24T20:06:00.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.547+0000 7ff7ecf16700 1 -- 172.21.15.61:0/482214389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff7e806d440 con 0x7ff7e8068140 2023-12-24T20:06:00.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.548+0000 7ff7de7fc700 1 -- 172.21.15.61:0/482214389 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff7d0054e70 con 0x7ff7e8068140 2023-12-24T20:06:00.548 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:00.548 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:06:00.548 INFO:teuthology.orchestra.run.smithi061.stdout: "auth_dump": [ 2023-12-24T20:06:00.548 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.548 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.a", 2023-12-24T20:06:00.548 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew==", 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.b", 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw==", 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:06:00.549 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.c", 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g==", 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.550 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.d", 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg==", 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.0", 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag==", 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:06:00.551 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.1", 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw==", 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.2", 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ==", 2023-12-24T20:06:00.552 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.3", 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA==", 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.553 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.4", 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ==", 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.5", 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w==", 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:06:00.554 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.6", 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw==", 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.7", 2023-12-24T20:06:00.555 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw==", 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.0", 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA==", 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow r", 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.556 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.1", 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w==", 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.2", 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg==", 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:06:00.557 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.3", 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g==", 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.558 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.admin", 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlwF3pGRAA8h0Cld7lwZprlrgMAN7tSg==", 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.x", 2023-12-24T20:06:00.559 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg==", 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.y", 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A==", 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:00.560 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:06:00.561 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:06:00.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.549+0000 7ff7ecf16700 1 -- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff7c8066f30 msgr2=0x7ff7c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.549+0000 7ff7ecf16700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff7c8066f30 0x7ff7c80693e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8157e20 tx=0x7ff7d8007ec0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.549+0000 7ff7ecf16700 1 -- 172.21.15.61:0/482214389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8068140 msgr2=0x7ff7e815c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.549+0000 7ff7ecf16700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8068140 0x7ff7e815c100 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000e920 tx=0x7ff7d0008040 comp rx=0 tx=0).stop 2023-12-24T20:06:00.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.550+0000 7ff7ecf16700 1 -- 172.21.15.61:0/482214389 shutdown_connections 2023-12-24T20:06:00.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.550+0000 7ff7ecf16700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff7c8066f30 0x7ff7c80693e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.550+0000 7ff7ecf16700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e8159a60 0x7ff7e816d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.550+0000 7ff7ecf16700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff7e8068140 0x7ff7e815c100 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.550+0000 7ff7ecf16700 1 --2- 172.21.15.61:0/482214389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff7e8068510 0x7ff7e815d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.550+0000 7ff7ecf16700 1 -- 172.21.15.61:0/482214389 >> 172.21.15.61:0/482214389 conn(0x7ff7e8097a10 msgr2=0x7ff7e8156900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:00.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.550+0000 7ff7ecf16700 1 -- 172.21.15.61:0/482214389 shutdown_connections 2023-12-24T20:06:00.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.550+0000 7ff7ecf16700 1 -- 172.21.15.61:0/482214389 wait complete. 2023-12-24T20:06:00.563 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:06:00.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.685+0000 7fb303614700 1 Processor -- start 2023-12-24T20:06:00.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.685+0000 7fb303614700 1 -- start start 2023-12-24T20:06:00.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb303614700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb2fc159a90 0x7fb2fc070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb303614700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 0x7fb2fc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb303614700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2fc06a090 con 0x7fb2fc0b04c0 2023-12-24T20:06:00.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb303614700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2fc06ac10 con 0x7fb2fc159a90 2023-12-24T20:06:00.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb303614700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc06a2e0 con 0x7fb2fc159e60 2023-12-24T20:06:00.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb3013b0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb2fc159a90 0x7fb2fc070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb301bb1700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb2fc0b04c0 0x7fb2fc0c93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33396/0 (socket says 172.21.15.61:33396) 2023-12-24T20:06:00.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb301bb1700 1 -- 172.21.15.61:0/3208399073 learned_addr learned my addr 172.21.15.61:0/3208399073 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:00.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb300baf700 1 --2- 172.21.15.61:0/3208399073 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 0x7fb2fc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb3013b0700 1 -- 172.21.15.61:0/3208399073 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 msgr2=0x7fb2fc070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:00.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb3013b0700 1 --2- 172.21.15.61:0/3208399073 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 0x7fb2fc070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb3013b0700 1 -- 172.21.15.61:0/3208399073 >> v1:172.21.15.61:6789/0 conn(0x7fb2fc0b04c0 legacy=0x7fb2fc0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb2f3fff700 1 -- 172.21.15.61:0/3208399073 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172504632 0 0) 0x7fb2fc06a090 con 0x7fb2fc0b04c0 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb3013b0700 1 -- 172.21.15.61:0/3208399073 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2fc06a5c0 con 0x7fb2fc159a90 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.686+0000 7fb3013b0700 1 --2- 172.21.15.61:0/3208399073 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 0x7fb2fc070640 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80098e0 tx=0x7fb2f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6945b08b193d5a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb2f3fff700 1 -- 172.21.15.61:0/3208399073 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8009e80 con 0x7fb2fc159a90 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb2f3fff700 1 -- 172.21.15.61:0/3208399073 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f800b860 con 0x7fb2fc159a90 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb2f3fff700 1 -- 172.21.15.61:0/3208399073 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800bbe0 con 0x7fb2fc159a90 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb303614700 1 -- 172.21.15.61:0/3208399073 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 msgr2=0x7fb2fc070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb303614700 1 --2- 172.21.15.61:0/3208399073 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 0x7fb2fc070640 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80098e0 tx=0x7fb2f80091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb303614700 1 -- 172.21.15.61:0/3208399073 shutdown_connections 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb303614700 1 --2- 172.21.15.61:0/3208399073 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 0x7fb2fc070640 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb303614700 1 --2- 172.21.15.61:0/3208399073 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 0x7fb2fc070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb303614700 1 -- 172.21.15.61:0/3208399073 >> 172.21.15.61:0/3208399073 conn(0x7fb2fc0cd6f0 msgr2=0x7fb2fc0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:00.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb303614700 1 -- 172.21.15.61:0/3208399073 shutdown_connections 2023-12-24T20:06:00.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.687+0000 7fb303614700 1 -- 172.21.15.61:0/3208399073 wait complete. 2023-12-24T20:06:00.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.688+0000 7fb303614700 1 Processor -- start 2023-12-24T20:06:00.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.688+0000 7fb303614700 1 -- start start 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb303614700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2fc0b04c0 0x7fb2fc154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb303614700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 0x7fb2fc15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb303614700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 0x7fb2fc15da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb303614700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0c21b0 con 0x7fb2fc159a90 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb303614700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc1552e0 con 0x7fb2fc0b04c0 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb303614700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc15bf40 con 0x7fb2fc159e60 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb300baf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 0x7fb2fc15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb300baf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 0x7fb2fc15cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33832/0 (socket says 172.21.15.61:33832) 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb300baf700 1 -- 172.21.15.61:0/4188304152 learned_addr learned my addr 172.21.15.61:0/4188304152 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb301bb1700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 0x7fb2fc15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.689+0000 7fb3013b0700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2fc0b04c0 0x7fb2fc154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb300baf700 1 -- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 msgr2=0x7fb2fc15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb300baf700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 0x7fb2fc15da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb300baf700 1 -- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2fc0b04c0 msgr2=0x7fb2fc154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb300baf700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2fc0b04c0 0x7fb2fc154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb300baf700 1 -- 172.21.15.61:0/4188304152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8009420 con 0x7fb2fc159a90 2023-12-24T20:06:00.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb301bb1700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 0x7fb2fc15da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:00.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb300baf700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 0x7fb2fc15cb50 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00d860 tx=0x7fb2ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:00.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb2f17fa700 1 -- 172.21.15.61:0/4188304152 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec012630 con 0x7fb2fc159a90 2023-12-24T20:06:00.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb2f17fa700 1 -- 172.21.15.61:0/4188304152 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec012790 con 0x7fb2fc159a90 2023-12-24T20:06:00.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb303614700 1 -- 172.21.15.61:0/4188304152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc15d090 con 0x7fb2fc159a90 2023-12-24T20:06:00.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb2f17fa700 1 -- 172.21.15.61:0/4188304152 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec012b50 con 0x7fb2fc159a90 2023-12-24T20:06:00.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.690+0000 7fb303614700 1 -- 172.21.15.61:0/4188304152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc0c1880 con 0x7fb2fc159a90 2023-12-24T20:06:00.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.691+0000 7fb303614700 1 -- 172.21.15.61:0/4188304152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc0c2320 con 0x7fb2fc159a90 2023-12-24T20:06:00.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.691+0000 7fb2f17fa700 1 -- 172.21.15.61:0/4188304152 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb2ec01d400 con 0x7fb2fc159a90 2023-12-24T20:06:00.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.692+0000 7fb2f17fa700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb2e0066f30 0x7fb2e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:00.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.692+0000 7fb2f17fa700 1 -- 172.21.15.61:0/4188304152 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb2ec0845b0 con 0x7fb2fc159a90 2023-12-24T20:06:00.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.692+0000 7fb3013b0700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb2e0066f30 0x7fb2e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:00.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.693+0000 7fb3013b0700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb2e0066f30 0x7fb2e00693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80091e0 tx=0x7fb2f8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:00.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.696+0000 7fb2f17fa700 1 -- 172.21.15.61:0/4188304152 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2ec051b70 con 0x7fb2fc159a90 2023-12-24T20:06:00.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.893+0000 7fb303614700 1 -- 172.21.15.61:0/4188304152 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2fc04c3c0 con 0x7fb2fc159a90 2023-12-24T20:06:00.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.894+0000 7fb2f17fa700 1 -- 172.21.15.61:0/4188304152 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+12145 (secure 0 0 0) 0x7fb2ec055190 con 0x7fb2fc159a90 2023-12-24T20:06:00.894 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:00.894 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":164,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:06:00.107501+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 -- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb2e0066f30 msgr2=0x7fb2e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb2e0066f30 0x7fb2e00693e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80091e0 tx=0x7fb2f8017000 comp rx=0 tx=0).stop 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 -- 172.21.15.61:0/4188304152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 msgr2=0x7fb2fc15cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 0x7fb2fc15cb50 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec00d860 tx=0x7fb2ec008040 comp rx=0 tx=0).stop 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 -- 172.21.15.61:0/4188304152 shutdown_connections 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb2fc159e60 0x7fb2fc15da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb2e0066f30 0x7fb2e00693e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2fc0b04c0 0x7fb2fc154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 --2- 172.21.15.61:0/4188304152 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb2fc159a90 0x7fb2fc15cb50 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 -- 172.21.15.61:0/4188304152 >> 172.21.15.61:0/4188304152 conn(0x7fb2fc0cd6f0 msgr2=0x7fb2fc0c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 -- 172.21.15.61:0/4188304152 shutdown_connections 2023-12-24T20:06:00.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:00.896+0000 7fb303614700 1 -- 172.21.15.61:0/4188304152 wait complete. 2023-12-24T20:06:00.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T20:06:00.912 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:06:01.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.037+0000 7fee72551700 1 Processor -- start 2023-12-24T20:06:01.037 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.037+0000 7fee72551700 1 -- start start 2023-12-24T20:06:01.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee72551700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 0x7fee6c0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee72551700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fee6c0b0130 0x7fee6c070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee72551700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee6c0688b0 0x7fee6c070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee72551700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6c15e470 con 0x7fee6c0b0130 2023-12-24T20:06:01.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee72551700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6c068db0 con 0x7fee6c0688b0 2023-12-24T20:06:01.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee72551700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c15db40 con 0x7fee6c0afd60 2023-12-24T20:06:01.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee6b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fee6c0b0130 0x7fee6c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee6b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fee6c0b0130 0x7fee6c070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33848/0 (socket says 172.21.15.61:33848) 2023-12-24T20:06:01.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee6b7fe700 1 -- 172.21.15.61:0/3834224571 learned_addr learned my addr 172.21.15.61:0/3834224571 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:01.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee70aee700 1 --2- 172.21.15.61:0/3834224571 >> v2:172.21.15.133:3300/0 conn(0x7fee6c0688b0 0x7fee6c070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee6bfff700 1 --2- 172.21.15.61:0/3834224571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 0x7fee6c0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee6b7fe700 1 -- 172.21.15.61:0/3834224571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 msgr2=0x7fee6c0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:01.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee6b7fe700 1 --2- 172.21.15.61:0/3834224571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 0x7fee6c0cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee6b7fe700 1 -- 172.21.15.61:0/3834224571 >> v2:172.21.15.133:3300/0 conn(0x7fee6c0688b0 msgr2=0x7fee6c070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:01.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee6b7fe700 1 --2- 172.21.15.61:0/3834224571 >> v2:172.21.15.133:3300/0 conn(0x7fee6c0688b0 0x7fee6c070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee6b7fe700 1 -- 172.21.15.61:0/3834224571 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c15de20 con 0x7fee6c0b0130 2023-12-24T20:06:01.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee70aee700 1 --2- 172.21.15.61:0/3834224571 >> v2:172.21.15.133:3300/0 conn(0x7fee6c0688b0 0x7fee6c070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:06:01.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.038+0000 7fee6bfff700 1 --2- 172.21.15.61:0/3834224571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 0x7fee6c0cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:06:01.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee6b7fe700 1 --2- 172.21.15.61:0/3834224571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c0b0130 0x7fee6c070640 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fee6c15a5c0 tx=0x7fee54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a873617bbc602ee server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee6affd700 1 -- 172.21.15.61:0/3834224571 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400b860 con 0x7fee6c0b0130 2023-12-24T20:06:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee6affd700 1 -- 172.21.15.61:0/3834224571 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5400b9c0 con 0x7fee6c0b0130 2023-12-24T20:06:01.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee6affd700 1 -- 172.21.15.61:0/3834224571 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400bd60 con 0x7fee6c0b0130 2023-12-24T20:06:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee72551700 1 -- 172.21.15.61:0/3834224571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c0b0130 msgr2=0x7fee6c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee72551700 1 --2- 172.21.15.61:0/3834224571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c0b0130 0x7fee6c070640 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fee6c15a5c0 tx=0x7fee54009250 comp rx=0 tx=0).stop 2023-12-24T20:06:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee72551700 1 -- 172.21.15.61:0/3834224571 shutdown_connections 2023-12-24T20:06:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee72551700 1 --2- 172.21.15.61:0/3834224571 >> v2:172.21.15.133:3300/0 conn(0x7fee6c0688b0 0x7fee6c070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee72551700 1 --2- 172.21.15.61:0/3834224571 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 0x7fee6c0cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee72551700 1 --2- 172.21.15.61:0/3834224571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c0b0130 0x7fee6c070640 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee72551700 1 -- 172.21.15.61:0/3834224571 >> 172.21.15.61:0/3834224571 conn(0x7fee6c0ce400 msgr2=0x7fee6c0ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:01.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee72551700 1 -- 172.21.15.61:0/3834224571 shutdown_connections 2023-12-24T20:06:01.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.039+0000 7fee72551700 1 -- 172.21.15.61:0/3834224571 wait complete. 2023-12-24T20:06:01.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.041+0000 7fee72551700 1 Processor -- start 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.041+0000 7fee72551700 1 -- start start 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee72551700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0688b0 0x7fee6c157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee72551700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 0x7fee6c0c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee72551700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c15bfd0 0x7fee6c0c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee72551700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c15cfc0 con 0x7fee6c15bfd0 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee72551700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c157890 con 0x7fee6c0688b0 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee72551700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0c4d80 con 0x7fee6c0afd60 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee70aee700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c15bfd0 0x7fee6c0c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee70aee700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c15bfd0 0x7fee6c0c39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33852/0 (socket says 172.21.15.61:33852) 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee70aee700 1 -- 172.21.15.61:0/2108522519 learned_addr learned my addr 172.21.15.61:0/2108522519 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee6b7fe700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 0x7fee6c0c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.042+0000 7fee6bfff700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0688b0 0x7fee6c157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee70aee700 1 -- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 msgr2=0x7fee6c0c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee70aee700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 0x7fee6c0c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee70aee700 1 -- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0688b0 msgr2=0x7fee6c157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee70aee700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0688b0 0x7fee6c157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee70aee700 1 -- 172.21.15.61:0/2108522519 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540094f0 con 0x7fee6c15bfd0 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee6bfff700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0688b0 0x7fee6c157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee70aee700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c15bfd0 0x7fee6c0c39a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fee6400cf60 tx=0x7fee64007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee63fff700 1 -- 172.21.15.61:0/2108522519 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64015440 con 0x7fee6c15bfd0 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee63fff700 1 -- 172.21.15.61:0/2108522519 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee640155a0 con 0x7fee6c15bfd0 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee63fff700 1 -- 172.21.15.61:0/2108522519 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64015960 con 0x7fee6c15bfd0 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee72551700 1 -- 172.21.15.61:0/2108522519 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c15c440 con 0x7fee6c15bfd0 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.043+0000 7fee72551700 1 -- 172.21.15.61:0/2108522519 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c15ca00 con 0x7fee6c15bfd0 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.044+0000 7fee72551700 1 -- 172.21.15.61:0/2108522519 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c0c6430 con 0x7fee6c15bfd0 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.044+0000 7fee63fff700 1 -- 172.21.15.61:0/2108522519 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fee64015d50 con 0x7fee6c15bfd0 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.045+0000 7fee63fff700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee4c066f30 0x7fee4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.045+0000 7fee63fff700 1 -- 172.21.15.61:0/2108522519 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fee64084be0 con 0x7fee6c15bfd0 2023-12-24T20:06:01.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.045+0000 7fee6bfff700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee4c066f30 0x7fee4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.045+0000 7fee6bfff700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee4c066f30 0x7fee4c0693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fee5c008b20 tx=0x7fee5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:01.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.049+0000 7fee63fff700 1 -- 172.21.15.61:0/2108522519 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee640521a0 con 0x7fee6c15bfd0 2023-12-24T20:06:01.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.246+0000 7fee72551700 1 -- 172.21.15.61:0/2108522519 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee6c04c3c0 con 0x7fee6c15bfd0 2023-12-24T20:06:01.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.246+0000 7fee63fff700 1 -- 172.21.15.61:0/2108522519 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v164) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee640557c0 con 0x7fee6c15bfd0 2023-12-24T20:06:01.246 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:06:01.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 -- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee4c066f30 msgr2=0x7fee4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee4c066f30 0x7fee4c0693e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fee5c008b20 tx=0x7fee5c008040 comp rx=0 tx=0).stop 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 -- 172.21.15.61:0/2108522519 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c15bfd0 msgr2=0x7fee6c0c39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c15bfd0 0x7fee6c0c39a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fee6400cf60 tx=0x7fee64007870 comp rx=0 tx=0).stop 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 -- 172.21.15.61:0/2108522519 shutdown_connections 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fee4c066f30 0x7fee4c0693e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fee6c15bfd0 0x7fee6c0c39a0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0688b0 0x7fee6c157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 --2- 172.21.15.61:0/2108522519 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fee6c0afd60 0x7fee6c0c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 -- 172.21.15.61:0/2108522519 >> 172.21.15.61:0/2108522519 conn(0x7fee6c0ce400 msgr2=0x7fee6c157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 -- 172.21.15.61:0/2108522519 shutdown_connections 2023-12-24T20:06:01.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.248+0000 7fee72551700 1 -- 172.21.15.61:0/2108522519 wait complete. 2023-12-24T20:06:01.261 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T20:06:01.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.382+0000 7f0e8dd67700 1 Processor -- start 2023-12-24T20:06:01.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.382+0000 7f0e8dd67700 1 -- start start 2023-12-24T20:06:01.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.383+0000 7f0e8dd67700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0e8815bb60 0x7f0e88098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.383+0000 7f0e8dd67700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e880b2eb0 con 0x7f0e88098aa0 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.383+0000 7f0e8dd67700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e880b2bd0 con 0x7f0e880b2660 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.383+0000 7f0e8dd67700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880afc20 con 0x7f0e8815bb60 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.383+0000 7f0e877fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0e8815bb60 0x7f0e88098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.383+0000 7f0e86ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0e88098aa0 0x7f0e8815bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33404/0 (socket says 172.21.15.61:33404) 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.383+0000 7f0e86ffd700 1 -- 172.21.15.61:0/14002902 learned_addr learned my addr 172.21.15.61:0/14002902 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.384+0000 7f0e877fe700 1 -- 172.21.15.61:0/14002902 >> v1:172.21.15.133:6789/0 conn(0x7f0e880b2660 legacy=0x7f0e880b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.384+0000 7f0e877fe700 1 -- 172.21.15.61:0/14002902 >> v1:172.21.15.61:6789/0 conn(0x7f0e88098aa0 legacy=0x7f0e8815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.384+0000 7f0e877fe700 1 -- 172.21.15.61:0/14002902 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880afe10 con 0x7f0e8815bb60 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.384+0000 7f0e867fc700 1 -- 172.21.15.61:0/14002902 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095535144 0 0) 0x7f0e880b2eb0 con 0x7f0e88098aa0 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.384+0000 7f0e877fe700 1 --2- 172.21.15.61:0/14002902 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e8815bb60 0x7f0e88098560 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0e780098d0 tx=0x7f0e78009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334b6be66c051dc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.384+0000 7f0e867fc700 1 -- 172.21.15.61:0/14002902 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78009e70 con 0x7f0e8815bb60 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.384+0000 7f0e867fc700 1 -- 172.21.15.61:0/14002902 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e78005c10 con 0x7f0e8815bb60 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.384+0000 7f0e867fc700 1 -- 172.21.15.61:0/14002902 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800b650 con 0x7f0e8815bb60 2023-12-24T20:06:01.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.385+0000 7f0e8dd67700 1 -- 172.21.15.61:0/14002902 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e8815bb60 msgr2=0x7f0e88098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.385+0000 7f0e8dd67700 1 --2- 172.21.15.61:0/14002902 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e8815bb60 0x7f0e88098560 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f0e780098d0 tx=0x7f0e78009120 comp rx=0 tx=0).stop 2023-12-24T20:06:01.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.385+0000 7f0e8dd67700 1 -- 172.21.15.61:0/14002902 shutdown_connections 2023-12-24T20:06:01.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.385+0000 7f0e8dd67700 1 --2- 172.21.15.61:0/14002902 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e8815bb60 0x7f0e88098560 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.385+0000 7f0e8dd67700 1 -- 172.21.15.61:0/14002902 >> 172.21.15.61:0/14002902 conn(0x7f0e88097a10 msgr2=0x7f0e880ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:01.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.385+0000 7f0e8dd67700 1 -- 172.21.15.61:0/14002902 shutdown_connections 2023-12-24T20:06:01.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.385+0000 7f0e8dd67700 1 -- 172.21.15.61:0/14002902 wait complete. 2023-12-24T20:06:01.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.386+0000 7f0e8dd67700 1 Processor -- start 2023-12-24T20:06:01.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.386+0000 7f0e8dd67700 1 -- start start 2023-12-24T20:06:01.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e8dd67700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e88098aa0 0x7f0e8815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e8dd67700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e880b2660 0x7f0e88157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e8dd67700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8815bb60 0x7f0e880aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e8dd67700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8815e320 con 0x7f0e880b2660 2023-12-24T20:06:01.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e8dd67700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8815d440 con 0x7f0e8815bb60 2023-12-24T20:06:01.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e8dd67700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8815d710 con 0x7f0e88098aa0 2023-12-24T20:06:01.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e86ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e880b2660 0x7f0e88157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e86ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e880b2660 0x7f0e88157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33874/0 (socket says 172.21.15.61:33874) 2023-12-24T20:06:01.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e86ffd700 1 -- 172.21.15.61:0/1893062903 learned_addr learned my addr 172.21.15.61:0/1893062903 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e877fe700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e88098aa0 0x7f0e8815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e87fff700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8815bb60 0x7f0e880aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e86ffd700 1 -- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e88098aa0 msgr2=0x7f0e8815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e86ffd700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e88098aa0 0x7f0e8815cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e86ffd700 1 -- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8815bb60 msgr2=0x7f0e880aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e86ffd700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8815bb60 0x7f0e880aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e86ffd700 1 -- 172.21.15.61:0/1893062903 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e780093c0 con 0x7f0e880b2660 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e86ffd700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e880b2660 0x7f0e88157e60 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c810 tx=0x7f0e70007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.387+0000 7f0e7f7fe700 1 -- 172.21.15.61:0/1893062903 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70005c00 con 0x7f0e880b2660 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.388+0000 7f0e7f7fe700 1 -- 172.21.15.61:0/1893062903 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e70005d60 con 0x7f0e880b2660 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.388+0000 7f0e8dd67700 1 -- 172.21.15.61:0/1893062903 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8815d9f0 con 0x7f0e880b2660 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.388+0000 7f0e7f7fe700 1 -- 172.21.15.61:0/1893062903 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70007320 con 0x7f0e880b2660 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.388+0000 7f0e8dd67700 1 -- 172.21.15.61:0/1893062903 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8815dfb0 con 0x7f0e880b2660 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.388+0000 7f0e8dd67700 1 -- 172.21.15.61:0/1893062903 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8806d440 con 0x7f0e880b2660 2023-12-24T20:06:01.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.389+0000 7f0e7f7fe700 1 -- 172.21.15.61:0/1893062903 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0e7001b3b0 con 0x7f0e880b2660 2023-12-24T20:06:01.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.389+0000 7f0e7f7fe700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e68066f30 0x7f0e680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.389+0000 7f0e7f7fe700 1 -- 172.21.15.61:0/1893062903 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0e70083630 con 0x7f0e880b2660 2023-12-24T20:06:01.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.390+0000 7f0e877fe700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e68066f30 0x7f0e680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.390+0000 7f0e877fe700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e68066f30 0x7f0e680693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009160 tx=0x7f0e78016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:01.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.394+0000 7f0e7f7fe700 1 -- 172.21.15.61:0/1893062903 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e70050bf0 con 0x7f0e880b2660 2023-12-24T20:06:01.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.592+0000 7f0e8dd67700 1 -- 172.21.15.61:0/1893062903 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0e8804c3c0 con 0x7f0e880b2660 2023-12-24T20:06:01.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.592+0000 7f0e7f7fe700 1 -- 172.21.15.61:0/1893062903 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v164) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0e70017090 con 0x7f0e880b2660 2023-12-24T20:06:01.592 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:01.593 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T20:06:01.593 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:06:01.593 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T20:06:01.593 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T20:06:01.593 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:01.593 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 -- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e68066f30 msgr2=0x7f0e680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e68066f30 0x7f0e680693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009160 tx=0x7f0e78016000 comp rx=0 tx=0).stop 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 -- 172.21.15.61:0/1893062903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e880b2660 msgr2=0x7f0e88157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e880b2660 0x7f0e88157e60 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c810 tx=0x7f0e70007d90 comp rx=0 tx=0).stop 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 -- 172.21.15.61:0/1893062903 shutdown_connections 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e88098aa0 0x7f0e8815cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e68066f30 0x7f0e680693e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e8815bb60 0x7f0e880aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 --2- 172.21.15.61:0/1893062903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e880b2660 0x7f0e88157e60 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 -- 172.21.15.61:0/1893062903 >> 172.21.15.61:0/1893062903 conn(0x7f0e88097a10 msgr2=0x7f0e8806c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 -- 172.21.15.61:0/1893062903 shutdown_connections 2023-12-24T20:06:01.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.594+0000 7f0e8dd67700 1 -- 172.21.15.61:0/1893062903 wait complete. 2023-12-24T20:06:01.607 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T20:06:01.607 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T20:06:01.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.733+0000 7f43f4d10700 1 Processor -- start 2023-12-24T20:06:01.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.733+0000 7f43f4d10700 1 -- start start 2023-12-24T20:06:01.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.734+0000 7f43f4d10700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f43f006f540 0x7f43f006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.734+0000 7f43f4d10700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f006b2c0 0x7f43f015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.734+0000 7f43f4d10700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f0157ec0 con 0x7f43f0158be0 2023-12-24T20:06:01.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.734+0000 7f43f4d10700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f00b03a0 con 0x7f43f006f540 2023-12-24T20:06:01.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.734+0000 7f43f4d10700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f015c1b0 con 0x7f43f006b2c0 2023-12-24T20:06:01.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.734+0000 7f43ee59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f43f006f540 0x7f43f006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.734+0000 7f43ee59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f43f006f540 0x7f43f006f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33880/0 (socket says 172.21.15.61:33880) 2023-12-24T20:06:01.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.734+0000 7f43ee59c700 1 -- 172.21.15.61:0/765638606 learned_addr learned my addr 172.21.15.61:0/765638606 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:01.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.734+0000 7f43eed9d700 1 --2- 172.21.15.61:0/765638606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f006b2c0 0x7f43f015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.735+0000 7f43ee59c700 1 -- 172.21.15.61:0/765638606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f006b2c0 msgr2=0x7f43f015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:01.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.735+0000 7f43ee59c700 1 --2- 172.21.15.61:0/765638606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f006b2c0 0x7f43f015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.735+0000 7f43ee59c700 1 -- 172.21.15.61:0/765638606 >> v1:172.21.15.133:6789/0 conn(0x7f43f0158be0 legacy=0x7f43f006abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.735+0000 7f43ee59c700 1 -- 172.21.15.61:0/765638606 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0158100 con 0x7f43f006f540 2023-12-24T20:06:01.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.735+0000 7f43ee59c700 1 --2- 172.21.15.61:0/765638606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006f540 0x7f43f006f910 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f43e00099b0 tx=0x7f43e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8359ebfeff9865 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:01.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.735+0000 7f43ed59a700 1 -- 172.21.15.61:0/765638606 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0009ea0 con 0x7f43f006f540 2023-12-24T20:06:01.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.735+0000 7f43ed59a700 1 -- 172.21.15.61:0/765638606 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e000b860 con 0x7f43f006f540 2023-12-24T20:06:01.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.735+0000 7f43ed59a700 1 -- 172.21.15.61:0/765638606 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e000bc00 con 0x7f43f006f540 2023-12-24T20:06:01.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.736+0000 7f43f4d10700 1 -- 172.21.15.61:0/765638606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006f540 msgr2=0x7f43f006f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.736+0000 7f43f4d10700 1 --2- 172.21.15.61:0/765638606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006f540 0x7f43f006f910 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f43e00099b0 tx=0x7f43e0009250 comp rx=0 tx=0).stop 2023-12-24T20:06:01.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.736+0000 7f43f4d10700 1 -- 172.21.15.61:0/765638606 shutdown_connections 2023-12-24T20:06:01.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.736+0000 7f43f4d10700 1 --2- 172.21.15.61:0/765638606 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f006b2c0 0x7f43f015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.736+0000 7f43f4d10700 1 --2- 172.21.15.61:0/765638606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006f540 0x7f43f006f910 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.736+0000 7f43f4d10700 1 -- 172.21.15.61:0/765638606 >> 172.21.15.61:0/765638606 conn(0x7f43f00ce7d0 msgr2=0x7f43f00cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:01.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.736+0000 7f43f4d10700 1 -- 172.21.15.61:0/765638606 shutdown_connections 2023-12-24T20:06:01.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.736+0000 7f43f4d10700 1 -- 172.21.15.61:0/765638606 wait complete. 2023-12-24T20:06:01.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.737+0000 7f43f4d10700 1 Processor -- start 2023-12-24T20:06:01.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.737+0000 7f43f4d10700 1 -- start start 2023-12-24T20:06:01.742 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.738+0000 7f43f4d10700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006b2c0 0x7f43f0152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.738+0000 7f43f4d10700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f006f540 0x7f43f00c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.738+0000 7f43f4d10700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f0158be0 0x7f43f00cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.738+0000 7f43f4d10700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00c69b0 con 0x7f43f006b2c0 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.738+0000 7f43f4d10700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f0159020 con 0x7f43f006f540 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.738+0000 7f43f4d10700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00c66d0 con 0x7f43f0158be0 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.738+0000 7f43ee59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006b2c0 0x7f43f0152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.738+0000 7f43ee59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006b2c0 0x7f43f0152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33892/0 (socket says 172.21.15.61:33892) 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.738+0000 7f43ee59c700 1 -- 172.21.15.61:0/33356616 learned_addr learned my addr 172.21.15.61:0/33356616 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43eed9d700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f0158be0 0x7f43f00cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43ee59c700 1 -- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f0158be0 msgr2=0x7f43f00cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43edd9b700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f006f540 0x7f43f00c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43ee59c700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f0158be0 0x7f43f00cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43ee59c700 1 -- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f006f540 msgr2=0x7f43f00c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43ee59c700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f006f540 0x7f43f00c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:01.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43ee59c700 1 -- 172.21.15.61:0/33356616 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00094f0 con 0x7f43f006b2c0 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43eed9d700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f0158be0 0x7f43f00cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43edd9b700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f006f540 0x7f43f00c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43ee59c700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006b2c0 0x7f43f0152850 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f43f006e610 tx=0x7f43e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43de7fc700 1 -- 172.21.15.61:0/33356616 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e000bbe0 con 0x7f43f006b2c0 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43de7fc700 1 -- 172.21.15.61:0/33356616 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e0011420 con 0x7f43f006b2c0 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43f4d10700 1 -- 172.21.15.61:0/33356616 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f00b2130 con 0x7f43f006b2c0 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43de7fc700 1 -- 172.21.15.61:0/33356616 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e00117c0 con 0x7f43f006b2c0 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.739+0000 7f43f4d10700 1 -- 172.21.15.61:0/33356616 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f00b26f0 con 0x7f43f006b2c0 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.740+0000 7f43f4d10700 1 -- 172.21.15.61:0/33356616 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f00b1f90 con 0x7f43f006b2c0 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.740+0000 7f43de7fc700 1 -- 172.21.15.61:0/33356616 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f43e0011bf0 con 0x7f43f006b2c0 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.741+0000 7f43de7fc700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43d0066f30 0x7f43d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:01.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.741+0000 7f43de7fc700 1 -- 172.21.15.61:0/33356616 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f43e0085b90 con 0x7f43f006b2c0 2023-12-24T20:06:01.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.741+0000 7f43edd9b700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43d0066f30 0x7f43d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:01.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.741+0000 7f43edd9b700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43d0066f30 0x7f43d00693e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f43f00ce120 tx=0x7f43e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:01.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.745+0000 7f43de7fc700 1 -- 172.21.15.61:0/33356616 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43f00b1f90 con 0x7f43f006b2c0 2023-12-24T20:06:01.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:01.940+0000 7f43f4d10700 1 -- 172.21.15.61:0/33356616 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f43f00b1f90 con 0x7f43f006b2c0 2023-12-24T20:06:02.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.756+0000 7f43de7fc700 1 -- 172.21.15.61:0/33356616 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v165) v1 ==== 138+0+0 (secure 0 0 0) 0x7f43f00b1f90 con 0x7f43f006b2c0 2023-12-24T20:06:02.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 -- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43d0066f30 msgr2=0x7f43d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:02.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43d0066f30 0x7f43d00693e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f43f00ce120 tx=0x7f43e4009040 comp rx=0 tx=0).stop 2023-12-24T20:06:02.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 -- 172.21.15.61:0/33356616 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006b2c0 msgr2=0x7f43f0152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:02.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006b2c0 0x7f43f0152850 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f43f006e610 tx=0x7f43e0017000 comp rx=0 tx=0).stop 2023-12-24T20:06:02.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 -- 172.21.15.61:0/33356616 shutdown_connections 2023-12-24T20:06:02.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f43f0158be0 0x7f43f00cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:02.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f43d0066f30 0x7f43d00693e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:02.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f43f006b2c0 0x7f43f0152850 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:02.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 --2- 172.21.15.61:0/33356616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f006f540 0x7f43f00c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:02.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 -- 172.21.15.61:0/33356616 >> 172.21.15.61:0/33356616 conn(0x7f43f00ce7d0 msgr2=0x7f43f00ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:02.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 -- 172.21.15.61:0/33356616 shutdown_connections 2023-12-24T20:06:02.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.761+0000 7f43f4d10700 1 -- 172.21.15.61:0/33356616 wait complete. 2023-12-24T20:06:02.764 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T20:06:02.777 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T20:06:02.913 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.913+0000 7fddc2396700 1 Processor -- start 2023-12-24T20:06:02.914 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.913+0000 7fddc2396700 1 -- start start 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddc2396700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fddbc157840 0x7fddbc069b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddc2396700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddbc157c10 0x7fddbc0679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddc2396700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddbc06a460 con 0x7fddbc0706b0 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddc2396700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddbc067550 con 0x7fddbc157840 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddc2396700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc06a740 con 0x7fddbc157c10 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddbbfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fddbc157840 0x7fddbc069b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddbbfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fddbc157840 0x7fddbc069b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33896/0 (socket says 172.21.15.61:33896) 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddbbfff700 1 -- 172.21.15.61:0/3020057396 learned_addr learned my addr 172.21.15.61:0/3020057396 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddc0933700 1 --2- 172.21.15.61:0/3020057396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddbc157c10 0x7fddbc0679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddbbfff700 1 -- 172.21.15.61:0/3020057396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddbc157c10 msgr2=0x7fddbc0679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddbbfff700 1 --2- 172.21.15.61:0/3020057396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddbc157c10 0x7fddbc0679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddbbfff700 1 -- 172.21.15.61:0/3020057396 >> v1:172.21.15.133:6789/0 conn(0x7fddbc0706b0 legacy=0x7fddbc0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.914+0000 7fddbbfff700 1 -- 172.21.15.61:0/3020057396 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc06aa20 con 0x7fddbc157840 2023-12-24T20:06:02.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddbbfff700 1 --2- 172.21.15.61:0/3020057396 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc157840 0x7fddbc069b60 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fdda40099b0 tx=0x7fdda4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc210853c8ddbca server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddbaffd700 1 -- 172.21.15.61:0/3020057396 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda400b860 con 0x7fddbc157840 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddbaffd700 1 -- 172.21.15.61:0/3020057396 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda400b9c0 con 0x7fddbc157840 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddbaffd700 1 -- 172.21.15.61:0/3020057396 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda400bd60 con 0x7fddbc157840 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddc2396700 1 -- 172.21.15.61:0/3020057396 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc157840 msgr2=0x7fddbc069b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddc2396700 1 --2- 172.21.15.61:0/3020057396 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc157840 0x7fddbc069b60 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fdda40099b0 tx=0x7fdda4009250 comp rx=0 tx=0).stop 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddc2396700 1 -- 172.21.15.61:0/3020057396 shutdown_connections 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddc2396700 1 --2- 172.21.15.61:0/3020057396 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddbc157c10 0x7fddbc0679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddc2396700 1 --2- 172.21.15.61:0/3020057396 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc157840 0x7fddbc069b60 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddc2396700 1 -- 172.21.15.61:0/3020057396 >> 172.21.15.61:0/3020057396 conn(0x7fddbc0ce1f0 msgr2=0x7fddbc0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddc2396700 1 -- 172.21.15.61:0/3020057396 shutdown_connections 2023-12-24T20:06:02.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.915+0000 7fddc2396700 1 -- 172.21.15.61:0/3020057396 wait complete. 2023-12-24T20:06:02.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.916+0000 7fddc2396700 1 Processor -- start 2023-12-24T20:06:02.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.917+0000 7fddc2396700 1 -- start start 2023-12-24T20:06:02.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.917+0000 7fddc2396700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc0706b0 0x7fddbc0c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:02.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.917+0000 7fddc2396700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddbc157840 0x7fddbc0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.917+0000 7fddc2396700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddbc157c10 0x7fddbc15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.917+0000 7fddc2396700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0c2cb0 con 0x7fddbc0706b0 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.917+0000 7fddc2396700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0b2440 con 0x7fddbc157840 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.917+0000 7fddc2396700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0c2660 con 0x7fddbc157c10 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddbbfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc0706b0 0x7fddbc0c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddbbfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc0706b0 0x7fddbc0c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33910/0 (socket says 172.21.15.61:33910) 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddbbfff700 1 -- 172.21.15.61:0/469098742 learned_addr learned my addr 172.21.15.61:0/469098742 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddc0933700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddbc157c10 0x7fddbc15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddbbfff700 1 -- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddbc157c10 msgr2=0x7fddbc15a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddbbfff700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddbc157c10 0x7fddbc15a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:02.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddbbfff700 1 -- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddbc157840 msgr2=0x7fddbc0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:02.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddbb7fe700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddbc157840 0x7fddbc0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:02.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddbbfff700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddbc157840 0x7fddbc0aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:02.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddbbfff700 1 -- 172.21.15.61:0/469098742 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40094f0 con 0x7fddbc0706b0 2023-12-24T20:06:02.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddbbfff700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc0706b0 0x7fddbc0c47d0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fddbc06c9e0 tx=0x7fdda4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:02.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddb3fff700 1 -- 172.21.15.61:0/469098742 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4024440 con 0x7fddbc0706b0 2023-12-24T20:06:02.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddb3fff700 1 -- 172.21.15.61:0/469098742 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda40245c0 con 0x7fddbc0706b0 2023-12-24T20:06:02.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddc2396700 1 -- 172.21.15.61:0/469098742 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc0c2940 con 0x7fddbc0706b0 2023-12-24T20:06:02.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddb3fff700 1 -- 172.21.15.61:0/469098742 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4024980 con 0x7fddbc0706b0 2023-12-24T20:06:02.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.918+0000 7fddc2396700 1 -- 172.21.15.61:0/469098742 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc15a9b0 con 0x7fddbc0706b0 2023-12-24T20:06:02.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.919+0000 7fddc2396700 1 -- 172.21.15.61:0/469098742 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddbc0c24c0 con 0x7fddbc0706b0 2023-12-24T20:06:02.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.920+0000 7fddb3fff700 1 -- 172.21.15.61:0/469098742 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdda401a420 con 0x7fddbc0706b0 2023-12-24T20:06:02.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.920+0000 7fddb3fff700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd9c066f30 0x7fdd9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:02.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.920+0000 7fddb3fff700 1 -- 172.21.15.61:0/469098742 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fdda40861e0 con 0x7fddbc0706b0 2023-12-24T20:06:02.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.921+0000 7fddbb7fe700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd9c066f30 0x7fdd9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:02.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.921+0000 7fddbb7fe700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd9c066f30 0x7fdd9c0693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fddbc150350 tx=0x7fddac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:02.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:02.925+0000 7fddb3fff700 1 -- 172.21.15.61:0/469098742 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddbc0c24c0 con 0x7fddbc0706b0 2023-12-24T20:06:03.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.121+0000 7fddc2396700 1 -- 172.21.15.61:0/469098742 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fddbc0c24c0 con 0x7fddbc0706b0 2023-12-24T20:06:03.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.765+0000 7fddb3fff700 1 -- 172.21.15.61:0/469098742 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v166) v1 ==== 170+0+0 (secure 0 0 0) 0x7fddbc0c24c0 con 0x7fddbc0706b0 2023-12-24T20:06:03.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.770+0000 7fddc2396700 1 -- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd9c066f30 msgr2=0x7fdd9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:03.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.770+0000 7fddc2396700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd9c066f30 0x7fdd9c0693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fddbc150350 tx=0x7fddac009040 comp rx=0 tx=0).stop 2023-12-24T20:06:03.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.770+0000 7fddc2396700 1 -- 172.21.15.61:0/469098742 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc0706b0 msgr2=0x7fddbc0c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:03.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.770+0000 7fddc2396700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc0706b0 0x7fddbc0c47d0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fddbc06c9e0 tx=0x7fdda4017000 comp rx=0 tx=0).stop 2023-12-24T20:06:03.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.771+0000 7fddc2396700 1 -- 172.21.15.61:0/469098742 shutdown_connections 2023-12-24T20:06:03.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.771+0000 7fddc2396700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fddbc157c10 0x7fddbc15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:03.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.771+0000 7fddc2396700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd9c066f30 0x7fdd9c0693e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:03.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.771+0000 7fddc2396700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fddbc0706b0 0x7fddbc0c47d0 secure :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fddbc06c9e0 tx=0x7fdda4017000 comp rx=0 tx=0).stop 2023-12-24T20:06:03.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.771+0000 7fddc2396700 1 --2- 172.21.15.61:0/469098742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddbc157840 0x7fddbc0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:03.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.771+0000 7fddc2396700 1 -- 172.21.15.61:0/469098742 >> 172.21.15.61:0/469098742 conn(0x7fddbc0ce1f0 msgr2=0x7fddbc0cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:03.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.775+0000 7fddc2396700 1 -- 172.21.15.61:0/469098742 shutdown_connections 2023-12-24T20:06:03.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.775+0000 7fddc2396700 1 -- 172.21.15.61:0/469098742 wait complete. 2023-12-24T20:06:03.776 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T20:06:03.790 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T20:06:03.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.920+0000 7f0ea57a2700 1 Processor -- start 2023-12-24T20:06:03.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.920+0000 7f0ea57a2700 1 -- start start 2023-12-24T20:06:03.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0ea57a2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ea01598d0 0x7f0ea00b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:03.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0ea57a2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0159ca0 0x7f0ea006db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:03.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0ea57a2700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea00cbf80 con 0x7f0ea006e0b0 2023-12-24T20:06:03.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0ea57a2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea015a110 con 0x7f0ea01598d0 2023-12-24T20:06:03.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0ea57a2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00b11c0 con 0x7f0ea0159ca0 2023-12-24T20:06:03.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0e9f7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0ea006e0b0 0x7f0ea015d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33412/0 (socket says 172.21.15.61:33412) 2023-12-24T20:06:03.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0e9f7fe700 1 -- 172.21.15.61:0/585829381 learned_addr learned my addr 172.21.15.61:0/585829381 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:03.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0e9e7fc700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0159ca0 0x7f0ea006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:03.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0e9effd700 1 --2- 172.21.15.61:0/585829381 >> v2:172.21.15.133:3300/0 conn(0x7f0ea01598d0 0x7f0ea00b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:03.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671557990 0 0) 0x7f0ea00cbf80 con 0x7f0ea006e0b0 2023-12-24T20:06:03.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.921+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e88003570 con 0x7f0ea006e0b0 2023-12-24T20:06:03.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1707868832 0 0) 0x7f0e88003570 con 0x7f0ea006e0b0 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0159ca0 msgr2=0x7f0ea006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0159ca0 0x7f0ea006db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 >> v2:172.21.15.133:3300/0 conn(0x7f0ea01598d0 msgr2=0x7f0ea00b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 --2- 172.21.15.61:0/585829381 >> v2:172.21.15.133:3300/0 conn(0x7f0ea01598d0 0x7f0ea00b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea00b14a0 con 0x7f0ea006e0b0 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f0e980017f0 con 0x7f0ea006e0b0 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 >> v1:172.21.15.61:6789/0 conn(0x7f0ea006e0b0 legacy=0x7f0ea015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0159ca0 0x7f0e88003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 0x7f0e88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e88004d50 0x7f0e880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015a110 con 0x7f0e88003fe0 2023-12-24T20:06:03.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea00b11c0 con 0x7f0e88004d50 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8800ba90 con 0x7f0ea0159ca0 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9e7fc700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 0x7f0e88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9effd700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0159ca0 0x7f0e88003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9f7fe700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e88004d50 0x7f0e880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9e7fc700 1 -- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0159ca0 msgr2=0x7f0e88003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9e7fc700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0159ca0 0x7f0e88003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9e7fc700 1 -- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e88004d50 msgr2=0x7f0e880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9e7fc700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e88004d50 0x7f0e880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9e7fc700 1 -- 172.21.15.61:0/585829381 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88003570 con 0x7f0e88003fe0 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9f7fe700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e88004d50 0x7f0e880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9e7fc700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 0x7f0e88004810 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009c00 tx=0x7f0e900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf155e35cb664284 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000e6b0 con 0x7f0e88003fe0 2023-12-24T20:06:03.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9000e810 con 0x7f0e88003fe0 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.922+0000 7f0e9dffb700 1 -- 172.21.15.61:0/585829381 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000ebd0 con 0x7f0e88003fe0 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.923+0000 7f0ea57a2700 1 -- 172.21.15.61:0/585829381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 msgr2=0x7f0e88004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.923+0000 7f0ea57a2700 1 --2- 172.21.15.61:0/585829381 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 0x7f0e88004810 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009c00 tx=0x7f0e900091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.923+0000 7f0e9f7fe700 1 -- 172.21.15.61:0/585829381 reap_dead start 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.923+0000 7f0ea57a2700 1 -- 172.21.15.61:0/585829381 shutdown_connections 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.923+0000 7f0ea57a2700 1 -- 172.21.15.61:0/585829381 >> 172.21.15.61:0/585829381 conn(0x7f0ea0067550 msgr2=0x7f0ea0067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.923+0000 7f0ea57a2700 1 -- 172.21.15.61:0/585829381 shutdown_connections 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.923+0000 7f0ea57a2700 1 -- 172.21.15.61:0/585829381 wait complete. 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.924+0000 7f0ea57a2700 1 Processor -- start 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.924+0000 7f0ea57a2700 1 -- start start 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0ea57a2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 0x7f0ea015dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0ea57a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea016df80 0x7f0ea01571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:03.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0ea57a2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0157730 0x7f0ea0169df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0ea57a2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea0157ba0 con 0x7f0e88003fe0 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0ea57a2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea016ace0 con 0x7f0ea016df80 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0ea57a2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea016daf0 con 0x7f0ea0157730 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0e9effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 0x7f0ea015dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0e9effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 0x7f0ea015dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33932/0 (socket says 172.21.15.61:33932) 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0e9effd700 1 -- 172.21.15.61:0/818994382 learned_addr learned my addr 172.21.15.61:0/818994382 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0e9e7fc700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea016df80 0x7f0ea01571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0e9f7fe700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0157730 0x7f0ea0169df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0e9effd700 1 -- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0157730 msgr2=0x7f0ea0169df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0e9effd700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0157730 0x7f0ea0169df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0e9effd700 1 -- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea016df80 msgr2=0x7f0ea01571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:03.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.925+0000 7f0e9effd700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea016df80 0x7f0ea01571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.926+0000 7f0e9effd700 1 -- 172.21.15.61:0/818994382 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea01547a0 con 0x7f0e88003fe0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.926+0000 7f0e9f7fe700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0157730 0x7f0ea0169df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.926+0000 7f0e9effd700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 0x7f0ea015dc60 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f0e94011d70 tx=0x7f0e940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.926+0000 7f0e86ffd700 1 -- 172.21.15.61:0/818994382 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400fac0 con 0x7f0e88003fe0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.926+0000 7f0e86ffd700 1 -- 172.21.15.61:0/818994382 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9400fc20 con 0x7f0e88003fe0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.926+0000 7f0ea57a2700 1 -- 172.21.15.61:0/818994382 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea016aa00 con 0x7f0e88003fe0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.926+0000 7f0e86ffd700 1 -- 172.21.15.61:0/818994382 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94014440 con 0x7f0e88003fe0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.926+0000 7f0ea57a2700 1 -- 172.21.15.61:0/818994382 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea016d780 con 0x7f0e88003fe0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.927+0000 7f0ea57a2700 1 -- 172.21.15.61:0/818994382 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea0089120 con 0x7f0e88003fe0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.927+0000 7f0e86ffd700 1 -- 172.21.15.61:0/818994382 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0e94027480 con 0x7f0e88003fe0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.928+0000 7f0e86ffd700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e8c066fb0 0x7f0e8c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.928+0000 7f0e86ffd700 1 -- 172.21.15.61:0/818994382 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f0e94018030 con 0x7f0e88003fe0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.928+0000 7f0e9e7fc700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e8c066fb0 0x7f0e8c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:03.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.929+0000 7f0e9e7fc700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e8c066fb0 0x7f0e8c069460 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0e900091e0 tx=0x7f0e9001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:03.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:03.932+0000 7f0e86ffd700 1 -- 172.21.15.61:0/818994382 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e940527b0 con 0x7f0e88003fe0 2023-12-24T20:06:04.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.173+0000 7f0ea57a2700 1 -- 172.21.15.61:0/818994382 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0ea004c3c0 con 0x7f0e88003fe0 2023-12-24T20:06:04.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.783+0000 7f0e86ffd700 1 -- 172.21.15.61:0/818994382 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v80) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0e94055dd0 con 0x7f0e88003fe0 2023-12-24T20:06:04.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.787+0000 7f0ea57a2700 1 -- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e8c066fb0 msgr2=0x7f0e8c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:04.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.787+0000 7f0ea57a2700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e8c066fb0 0x7f0e8c069460 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0e900091e0 tx=0x7f0e9001a000 comp rx=0 tx=0).stop 2023-12-24T20:06:04.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.787+0000 7f0ea57a2700 1 -- 172.21.15.61:0/818994382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 msgr2=0x7f0ea015dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:04.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.787+0000 7f0ea57a2700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 0x7f0ea015dc60 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f0e94011d70 tx=0x7f0e940091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.789+0000 7f0ea57a2700 1 -- 172.21.15.61:0/818994382 shutdown_connections 2023-12-24T20:06:04.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.789+0000 7f0ea57a2700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0ea0157730 0x7f0ea0169df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.789+0000 7f0ea57a2700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e8c066fb0 0x7f0e8c069460 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.789+0000 7f0ea57a2700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e88003fe0 0x7f0ea015dc60 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.789+0000 7f0ea57a2700 1 --2- 172.21.15.61:0/818994382 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ea016df80 0x7f0ea01571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.789+0000 7f0ea57a2700 1 -- 172.21.15.61:0/818994382 >> 172.21.15.61:0/818994382 conn(0x7f0ea0067550 msgr2=0x7f0ea00b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:04.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.789+0000 7f0ea57a2700 1 -- 172.21.15.61:0/818994382 shutdown_connections 2023-12-24T20:06:04.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.789+0000 7f0ea57a2700 1 -- 172.21.15.61:0/818994382 wait complete. 2023-12-24T20:06:04.791 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 20 and data pool 21 2023-12-24T20:06:04.805 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:06:04.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.933+0000 7fad839a6700 1 Processor -- start 2023-12-24T20:06:04.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.934+0000 7fad839a6700 1 -- start start 2023-12-24T20:06:04.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.934+0000 7fad839a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad7c15bb60 0x7fad7c098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:04.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.934+0000 7fad839a6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7c0b2eb0 con 0x7fad7c0b2660 2023-12-24T20:06:04.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.934+0000 7fad839a6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7c0b2bd0 con 0x7fad7c098aa0 2023-12-24T20:06:04.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.934+0000 7fad839a6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c0afc20 con 0x7fad7c15bb60 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad81f43700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fad7c0b2660 0x7fad7c0b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33428/0 (socket says 172.21.15.61:33428) 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad81f43700 1 -- 172.21.15.61:0/3680707827 learned_addr learned my addr 172.21.15.61:0/3680707827 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333595102 0 0) 0x7fad7c0b2eb0 con 0x7fad7c0b2660 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad81742700 1 --2- 172.21.15.61:0/3680707827 >> v2:172.21.15.133:3300/0 conn(0x7fad7c15bb60 0x7fad7c098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad68003570 con 0x7fad7c0b2660 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1818386302 0 0) 0x7fad68003570 con 0x7fad7c0b2660 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 >> v2:172.21.15.133:3300/0 conn(0x7fad7c15bb60 msgr2=0x7fad7c098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 --2- 172.21.15.61:0/3680707827 >> v2:172.21.15.133:3300/0 conn(0x7fad7c15bb60 0x7fad7c098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 >> v1:172.21.15.133:6789/0 conn(0x7fad7c098aa0 legacy=0x7fad7c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c0afe10 con 0x7fad7c0b2660 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fad740017f0 con 0x7fad7c0b2660 2023-12-24T20:06:04.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 >> v1:172.21.15.61:6789/0 conn(0x7fad7c0b2660 legacy=0x7fad7c0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad68003a60 0x7fad68003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad68004810 0x7fad68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad680051c0 0x7fad6800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6800c130 con 0x7fad680051c0 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6800c2a0 con 0x7fad68003a60 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6800c460 con 0x7fad68004810 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad81f43700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad680051c0 0x7fad6800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad81742700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad68003a60 0x7fad68003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.935+0000 7fad80f41700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad68004810 0x7fad68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad81f43700 1 -- 172.21.15.61:0/3680707827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad68004810 msgr2=0x7fad68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad81f43700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad68004810 0x7fad68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad81f43700 1 -- 172.21.15.61:0/3680707827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad68003a60 msgr2=0x7fad68003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:04.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad81f43700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad68003a60 0x7fad68003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad81f43700 1 -- 172.21.15.61:0/3680707827 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad68003570 con 0x7fad680051c0 2023-12-24T20:06:04.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad81742700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad68003a60 0x7fad68003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:06:04.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad81f43700 1 -- 172.21.15.61:0/3680707827 reap_dead start 2023-12-24T20:06:04.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad81f43700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad680051c0 0x7fad6800ba60 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fad7400a930 tx=0x7fad740021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99163c8b216b4b66 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:04.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740070d0 con 0x7fad680051c0 2023-12-24T20:06:04.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad74007230 con 0x7fad680051c0 2023-12-24T20:06:04.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad73fff700 1 -- 172.21.15.61:0/3680707827 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740075d0 con 0x7fad680051c0 2023-12-24T20:06:04.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad839a6700 1 -- 172.21.15.61:0/3680707827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad680051c0 msgr2=0x7fad6800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:04.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.936+0000 7fad839a6700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad680051c0 0x7fad6800ba60 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fad7400a930 tx=0x7fad740021d0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.937+0000 7fad839a6700 1 -- 172.21.15.61:0/3680707827 shutdown_connections 2023-12-24T20:06:04.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.937+0000 7fad839a6700 1 --2- 172.21.15.61:0/3680707827 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad680051c0 0x7fad6800ba60 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.937+0000 7fad839a6700 1 -- 172.21.15.61:0/3680707827 >> 172.21.15.61:0/3680707827 conn(0x7fad7c097a10 msgr2=0x7fad7c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:04.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.937+0000 7fad839a6700 1 -- 172.21.15.61:0/3680707827 shutdown_connections 2023-12-24T20:06:04.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.937+0000 7fad839a6700 1 -- 172.21.15.61:0/3680707827 wait complete. 2023-12-24T20:06:04.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.938+0000 7fad839a6700 1 Processor -- start 2023-12-24T20:06:04.943 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.938+0000 7fad839a6700 1 -- start start 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad839a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad680051c0 0x7fad7c168fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad839a6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad7c157ff0 0x7fad7c0acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad839a6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad7c158460 0x7fad7c0ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad839a6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c168e10 con 0x7fad7c157ff0 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad839a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0aa930 con 0x7fad680051c0 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad839a6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0aac10 con 0x7fad7c158460 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad80f41700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad7c157ff0 0x7fad7c0acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad80f41700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad7c157ff0 0x7fad7c0acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33956/0 (socket says 172.21.15.61:33956) 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad80f41700 1 -- 172.21.15.61:0/556841778 learned_addr learned my addr 172.21.15.61:0/556841778 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad81f43700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad7c158460 0x7fad7c0ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:04.946 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad81742700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad680051c0 0x7fad7c168fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad80f41700 1 -- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad7c158460 msgr2=0x7fad7c0ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad80f41700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad7c158460 0x7fad7c0ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad80f41700 1 -- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad680051c0 msgr2=0x7fad7c168fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad80f41700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad680051c0 0x7fad7c168fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad80f41700 1 -- 172.21.15.61:0/556841778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c0aaef0 con 0x7fad7c157ff0 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad81f43700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad7c158460 0x7fad7c0ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad81742700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad680051c0 0x7fad7c168fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad80f41700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad7c157ff0 0x7fad7c0acad0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fad6c002950 tx=0x7fad6c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad717fa700 1 -- 172.21.15.61:0/556841778 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c002e90 con 0x7fad7c157ff0 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad717fa700 1 -- 172.21.15.61:0/556841778 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c00f8d0 con 0x7fad7c157ff0 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad839a6700 1 -- 172.21.15.61:0/556841778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c0ab1d0 con 0x7fad7c157ff0 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.939+0000 7fad717fa700 1 -- 172.21.15.61:0/556841778 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00fc90 con 0x7fad7c157ff0 2023-12-24T20:06:04.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.940+0000 7fad839a6700 1 -- 172.21.15.61:0/556841778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c0ab6f0 con 0x7fad7c157ff0 2023-12-24T20:06:04.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.941+0000 7fad839a6700 1 -- 172.21.15.61:0/556841778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c06d440 con 0x7fad7c157ff0 2023-12-24T20:06:04.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.941+0000 7fad717fa700 1 -- 172.21.15.61:0/556841778 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fad6c006820 con 0x7fad7c157ff0 2023-12-24T20:06:04.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.941+0000 7fad717fa700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad60066f30 0x7fad600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:04.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.941+0000 7fad717fa700 1 -- 172.21.15.61:0/556841778 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad6c0846f0 con 0x7fad7c157ff0 2023-12-24T20:06:04.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.942+0000 7fad81742700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad60066f30 0x7fad600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:04.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.942+0000 7fad81742700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad60066f30 0x7fad600693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fad78006e50 tx=0x7fad78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:04.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:04.946+0000 7fad717fa700 1 -- 172.21.15.61:0/556841778 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad6c051960 con 0x7fad7c157ff0 2023-12-24T20:06:05.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.140+0000 7fad839a6700 1 -- 172.21.15.61:0/556841778 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad7c0ab360 con 0x7fad7c157ff0 2023-12-24T20:06:05.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.141+0000 7fad717fa700 1 -- 172.21.15.61:0/556841778 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fad6c054f80 con 0x7fad7c157ff0 2023-12-24T20:06:05.141 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:05.141 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":167,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:06:04.174371+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:06:01.971715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-24T20:06:03.153177+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:06:05.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 -- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad60066f30 msgr2=0x7fad600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad60066f30 0x7fad600693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fad78006e50 tx=0x7fad78008040 comp rx=0 tx=0).stop 2023-12-24T20:06:05.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 -- 172.21.15.61:0/556841778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad7c157ff0 msgr2=0x7fad7c0acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad7c157ff0 0x7fad7c0acad0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fad6c002950 tx=0x7fad6c007d30 comp rx=0 tx=0).stop 2023-12-24T20:06:05.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 -- 172.21.15.61:0/556841778 shutdown_connections 2023-12-24T20:06:05.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fad7c158460 0x7fad7c0ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fad60066f30 0x7fad600693e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad680051c0 0x7fad7c168fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 --2- 172.21.15.61:0/556841778 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fad7c157ff0 0x7fad7c0acad0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 -- 172.21.15.61:0/556841778 >> 172.21.15.61:0/556841778 conn(0x7fad7c097a10 msgr2=0x7fad7c15a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:05.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 -- 172.21.15.61:0/556841778 shutdown_connections 2023-12-24T20:06:05.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.143+0000 7fad839a6700 1 -- 172.21.15.61:0/556841778 wait complete. 2023-12-24T20:06:05.156 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:06:05.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.277+0000 7f1b9b2df700 1 Processor -- start 2023-12-24T20:06:05.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.277+0000 7f1b9b2df700 1 -- start start 2023-12-24T20:06:05.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.278+0000 7f1b9b2df700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 0x7f1b94159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.278+0000 7f1b9b2df700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9406a630 con 0x7f1b940caa80 2023-12-24T20:06:05.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.278+0000 7f1b9b2df700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b94069d00 con 0x7f1b9406aac0 2023-12-24T20:06:05.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.278+0000 7f1b9b2df700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940cccf0 con 0x7f1b94159850 2023-12-24T20:06:05.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.278+0000 7f1b9987c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1b940caa80 0x7f1b940aa880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33438/0 (socket says 172.21.15.61:33438) 2023-12-24T20:06:05.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.278+0000 7f1b9987c700 1 -- 172.21.15.61:0/867444312 learned_addr learned my addr 172.21.15.61:0/867444312 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:05.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.278+0000 7f1b9907b700 1 --2- 172.21.15.61:0/867444312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 0x7f1b94159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.278+0000 7f1b8bfff700 1 -- 172.21.15.61:0/867444312 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421061084 0 0) 0x7f1b9406a630 con 0x7f1b940caa80 2023-12-24T20:06:05.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.278+0000 7f1b8bfff700 1 -- 172.21.15.61:0/867444312 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b80003570 con 0x7f1b940caa80 2023-12-24T20:06:05.281 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.278+0000 7f1b8bfff700 1 -- 172.21.15.61:0/867444312 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711181516 0 0) 0x7f1b94069d00 con 0x7f1b9406aac0 2023-12-24T20:06:05.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.279+0000 7f1b8bfff700 1 -- 172.21.15.61:0/867444312 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b9406a630 con 0x7f1b9406aac0 2023-12-24T20:06:05.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.279+0000 7f1b9907b700 1 -- 172.21.15.61:0/867444312 >> v1:172.21.15.133:6789/0 conn(0x7f1b9406aac0 legacy=0x7f1b940cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.279+0000 7f1b9907b700 1 -- 172.21.15.61:0/867444312 >> v1:172.21.15.61:6789/0 conn(0x7f1b940caa80 legacy=0x7f1b940aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.279+0000 7f1b8bfff700 1 -- 172.21.15.61:0/867444312 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1106605025 0 0) 0x7f1b80003570 con 0x7f1b940caa80 2023-12-24T20:06:05.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.279+0000 7f1b9907b700 1 -- 172.21.15.61:0/867444312 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94069fe0 con 0x7f1b94159850 2023-12-24T20:06:05.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.279+0000 7f1b9907b700 1 --2- 172.21.15.61:0/867444312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 0x7f1b94159c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009910 tx=0x7f1b840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c397b7fc2d047bf6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:05.282 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.279+0000 7f1b8bfff700 1 -- 172.21.15.61:0/867444312 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c0017f0 con 0x7f1b94159850 2023-12-24T20:06:05.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.279+0000 7f1b8bfff700 1 -- 172.21.15.61:0/867444312 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b84011420 con 0x7f1b94159850 2023-12-24T20:06:05.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.279+0000 7f1b8bfff700 1 -- 172.21.15.61:0/867444312 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b840117c0 con 0x7f1b94159850 2023-12-24T20:06:05.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.280+0000 7f1b9b2df700 1 -- 172.21.15.61:0/867444312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 msgr2=0x7f1b94159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.280+0000 7f1b9b2df700 1 --2- 172.21.15.61:0/867444312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 0x7f1b94159c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009910 tx=0x7f1b840091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.280+0000 7f1b9b2df700 1 -- 172.21.15.61:0/867444312 shutdown_connections 2023-12-24T20:06:05.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.280+0000 7f1b9b2df700 1 --2- 172.21.15.61:0/867444312 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 0x7f1b94159c20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.280+0000 7f1b9b2df700 1 -- 172.21.15.61:0/867444312 >> 172.21.15.61:0/867444312 conn(0x7f1b940cceb0 msgr2=0x7f1b940cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:05.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.280+0000 7f1b9b2df700 1 -- 172.21.15.61:0/867444312 shutdown_connections 2023-12-24T20:06:05.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.280+0000 7f1b9b2df700 1 -- 172.21.15.61:0/867444312 wait complete. 2023-12-24T20:06:05.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.281+0000 7f1b9b2df700 1 Processor -- start 2023-12-24T20:06:05.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.281+0000 7f1b9b2df700 1 -- start start 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.282+0000 7f1b9b2df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b9406aac0 0x7f1b9414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.282+0000 7f1b9b2df700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b940caa80 0x7f1b9414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.282+0000 7f1b9b2df700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 0x7f1b940c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.282+0000 7f1b9b2df700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94151c50 con 0x7f1b940caa80 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.282+0000 7f1b9b2df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9416ac20 con 0x7f1b9406aac0 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.282+0000 7f1b9b2df700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94151ea0 con 0x7f1b94159850 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.282+0000 7f1b9887a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b940caa80 0x7f1b9414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9887a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b940caa80 0x7f1b9414e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33968/0 (socket says 172.21.15.61:33968) 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9887a700 1 -- 172.21.15.61:0/2789486143 learned_addr learned my addr 172.21.15.61:0/2789486143 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9987c700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 0x7f1b940c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9907b700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b9406aac0 0x7f1b9414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9887a700 1 -- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 msgr2=0x7f1b940c2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9887a700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 0x7f1b940c2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9887a700 1 -- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b9406aac0 msgr2=0x7f1b9414e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9887a700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b9406aac0 0x7f1b9414e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9887a700 1 -- 172.21.15.61:0/2789486143 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b84009420 con 0x7f1b940caa80 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9887a700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b940caa80 0x7f1b9414e650 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c790 tx=0x7f1b90007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b897fa700 1 -- 172.21.15.61:0/2789486143 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90010510 con 0x7f1b940caa80 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b897fa700 1 -- 172.21.15.61:0/2789486143 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b90010670 con 0x7f1b940caa80 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b897fa700 1 -- 172.21.15.61:0/2789486143 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90010a10 con 0x7f1b940caa80 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9b2df700 1 -- 172.21.15.61:0/2789486143 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b94152180 con 0x7f1b940caa80 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.283+0000 7f1b9b2df700 1 -- 172.21.15.61:0/2789486143 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b94152980 con 0x7f1b940caa80 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.284+0000 7f1b9b2df700 1 -- 172.21.15.61:0/2789486143 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9404c3c0 con 0x7f1b940caa80 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.285+0000 7f1b897fa700 1 -- 172.21.15.61:0/2789486143 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1b9001b400 con 0x7f1b940caa80 2023-12-24T20:06:05.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.285+0000 7f1b897fa700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b78066f30 0x7f1b780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.285+0000 7f1b897fa700 1 -- 172.21.15.61:0/2789486143 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b90084300 con 0x7f1b940caa80 2023-12-24T20:06:05.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.285+0000 7f1b9907b700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b78066f30 0x7f1b780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.286+0000 7f1b9907b700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b78066f30 0x7f1b780693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1b840030c0 tx=0x7f1b84016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:05.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.289+0000 7f1b897fa700 1 -- 172.21.15.61:0/2789486143 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b90051570 con 0x7f1b940caa80 2023-12-24T20:06:05.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.487+0000 7f1b9b2df700 1 -- 172.21.15.61:0/2789486143 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b9406a2c0 con 0x7f1b940caa80 2023-12-24T20:06:05.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.488+0000 7f1b897fa700 1 -- 172.21.15.61:0/2789486143 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f1b90054b90 con 0x7f1b940caa80 2023-12-24T20:06:05.490 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:05.490 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":167,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:06:04.174371+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:06:01.971715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-24T20:06:03.153177+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:06:05.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.490+0000 7f1b9b2df700 1 -- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b78066f30 msgr2=0x7f1b780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.490+0000 7f1b9b2df700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b78066f30 0x7f1b780693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1b840030c0 tx=0x7f1b84016000 comp rx=0 tx=0).stop 2023-12-24T20:06:05.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.490+0000 7f1b9b2df700 1 -- 172.21.15.61:0/2789486143 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b940caa80 msgr2=0x7f1b9414e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.490+0000 7f1b9b2df700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b940caa80 0x7f1b9414e650 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c790 tx=0x7f1b90007e10 comp rx=0 tx=0).stop 2023-12-24T20:06:05.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.491+0000 7f1b9b2df700 1 -- 172.21.15.61:0/2789486143 shutdown_connections 2023-12-24T20:06:05.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.491+0000 7f1b9b2df700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1b94159850 0x7f1b940c2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.491+0000 7f1b9b2df700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1b78066f30 0x7f1b780693e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.491+0000 7f1b9b2df700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b9406aac0 0x7f1b9414e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.491+0000 7f1b9b2df700 1 --2- 172.21.15.61:0/2789486143 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1b940caa80 0x7f1b9414e650 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.491+0000 7f1b9b2df700 1 -- 172.21.15.61:0/2789486143 >> 172.21.15.61:0/2789486143 conn(0x7f1b940cceb0 msgr2=0x7f1b9414f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:05.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.491+0000 7f1b9b2df700 1 -- 172.21.15.61:0/2789486143 shutdown_connections 2023-12-24T20:06:05.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.491+0000 7f1b9b2df700 1 -- 172.21.15.61:0/2789486143 wait complete. 2023-12-24T20:06:05.504 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T20:06:05.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.628+0000 7fb01e36f700 1 Processor -- start 2023-12-24T20:06:05.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.628+0000 7fb01e36f700 1 -- start start 2023-12-24T20:06:05.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.629+0000 7fb01e36f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0181578d0 0x7fb0180af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.629+0000 7fb01e36f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01806f6e0 0x7fb01806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.629+0000 7fb01e36f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180caf30 con 0x7fb01806b150 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.629+0000 7fb01e36f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01806b560 con 0x7fb0181578d0 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.629+0000 7fb01e36f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180af9f0 con 0x7fb01806f6e0 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.629+0000 7fb01c90c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb01806b150 0x7fb01806c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:33446/0 (socket says 172.21.15.61:33446) 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.629+0000 7fb01c90c700 1 -- 172.21.15.61:0/762297914 learned_addr learned my addr 172.21.15.61:0/762297914 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb0177fe700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01806f6e0 0x7fb01806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846204716 0 0) 0x7fb0180caf30 con 0x7fb01806b150 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb017fff700 1 --2- 172.21.15.61:0/762297914 >> v2:172.21.15.133:3300/0 conn(0x7fb0181578d0 0x7fb0180af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb000003570 con 0x7fb01806b150 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 49061062 0 0) 0x7fb000003570 con 0x7fb01806b150 2023-12-24T20:06:05.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01806f6e0 msgr2=0x7fb01806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01806f6e0 0x7fb01806ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 >> v2:172.21.15.133:3300/0 conn(0x7fb0181578d0 msgr2=0x7fb0180af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 --2- 172.21.15.61:0/762297914 >> v2:172.21.15.133:3300/0 conn(0x7fb0181578d0 0x7fb0180af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180afcd0 con 0x7fb01806b150 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fb0100017f0 con 0x7fb01806b150 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 >> v1:172.21.15.61:6789/0 conn(0x7fb01806b150 legacy=0x7fb01806c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01806f6e0 0x7fb000003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb000003fe0 0x7fb000004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb000004d50 0x7fb0000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01806b560 con 0x7fb000004d50 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180af9f0 con 0x7fb000003fe0 2023-12-24T20:06:05.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00000ba90 con 0x7fb01806f6e0 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb01c90c700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb000004d50 0x7fb0000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb017fff700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01806f6e0 0x7fb000003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb0177fe700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb000003fe0 0x7fb000004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb01c90c700 1 -- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01806f6e0 msgr2=0x7fb000003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb01c90c700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01806f6e0 0x7fb000003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb01c90c700 1 -- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb000003fe0 msgr2=0x7fb000004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb01c90c700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb000003fe0 0x7fb000004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.630+0000 7fb01c90c700 1 -- 172.21.15.61:0/762297914 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb000003570 con 0x7fb000004d50 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb01c90c700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb000004d50 0x7fb0000051c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fb01000a970 tx=0x7fb010002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e452c5835b02dd34 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010012440 con 0x7fb000004d50 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0100125c0 con 0x7fb000004d50 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb016ffd700 1 -- 172.21.15.61:0/762297914 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010012980 con 0x7fb000004d50 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb01e36f700 1 -- 172.21.15.61:0/762297914 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb000004d50 msgr2=0x7fb0000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb01e36f700 1 --2- 172.21.15.61:0/762297914 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb000004d50 0x7fb0000051c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fb01000a970 tx=0x7fb010002210 comp rx=0 tx=0).stop 2023-12-24T20:06:05.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb01c90c700 1 -- 172.21.15.61:0/762297914 reap_dead start 2023-12-24T20:06:05.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb01e36f700 1 -- 172.21.15.61:0/762297914 shutdown_connections 2023-12-24T20:06:05.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb01e36f700 1 -- 172.21.15.61:0/762297914 >> 172.21.15.61:0/762297914 conn(0x7fb0180ce800 msgr2=0x7fb0180cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:05.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb01e36f700 1 -- 172.21.15.61:0/762297914 shutdown_connections 2023-12-24T20:06:05.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.631+0000 7fb01e36f700 1 -- 172.21.15.61:0/762297914 wait complete. 2023-12-24T20:06:05.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.633+0000 7fb01e36f700 1 Processor -- start 2023-12-24T20:06:05.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.633+0000 7fb01e36f700 1 -- start start 2023-12-24T20:06:05.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb01e36f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01815b6e0 0x7fb0180c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb01e36f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb01815bab0 0x7fb018168d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb01e36f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0180ac710 0x7fb0180acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb01e36f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01816c270 con 0x7fb01815bab0 2023-12-24T20:06:05.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb01e36f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180ad0a0 con 0x7fb0180ac710 2023-12-24T20:06:05.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb01e36f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01816c700 con 0x7fb01815b6e0 2023-12-24T20:06:05.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb0177fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb01815bab0 0x7fb018168d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb0177fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb01815bab0 0x7fb018168d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:33986/0 (socket says 172.21.15.61:33986) 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb0177fe700 1 -- 172.21.15.61:0/2921691263 learned_addr learned my addr 172.21.15.61:0/2921691263 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb017fff700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01815b6e0 0x7fb0180c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.634+0000 7fb01c90c700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0180ac710 0x7fb0180acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7fb0177fe700 1 -- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01815b6e0 msgr2=0x7fb0180c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7fb0177fe700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01815b6e0 0x7fb0180c6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7fb0177fe700 1 -- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0180ac710 msgr2=0x7fb0180acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7fb0177fe700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0180ac710 0x7fb0180acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7fb0177fe700 1 -- 172.21.15.61:0/2921691263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180c6ef0 con 0x7fb01815bab0 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7fb0177fe700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb01815bab0 0x7fb018168d20 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fb00c006ac0 tx=0x7fb00c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7faffffff700 1 -- 172.21.15.61:0/2921691263 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00f940 con 0x7fb01815bab0 2023-12-24T20:06:05.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7faffffff700 1 -- 172.21.15.61:0/2921691263 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00faa0 con 0x7fb01815bab0 2023-12-24T20:06:05.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7faffffff700 1 -- 172.21.15.61:0/2921691263 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00fe20 con 0x7fb01815bab0 2023-12-24T20:06:05.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7fb01e36f700 1 -- 172.21.15.61:0/2921691263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01816b940 con 0x7fb01815bab0 2023-12-24T20:06:05.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.635+0000 7fb01e36f700 1 -- 172.21.15.61:0/2921691263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01816bf00 con 0x7fb01815bab0 2023-12-24T20:06:05.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.636+0000 7fb01e36f700 1 -- 172.21.15.61:0/2921691263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01816c420 con 0x7fb01815bab0 2023-12-24T20:06:05.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.637+0000 7faffffff700 1 -- 172.21.15.61:0/2921691263 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb00c014650 con 0x7fb01815bab0 2023-12-24T20:06:05.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.637+0000 7faffffff700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb004066f30 0x7fb0040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:05.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.637+0000 7faffffff700 1 -- 172.21.15.61:0/2921691263 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb00c018030 con 0x7fb01815bab0 2023-12-24T20:06:05.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.637+0000 7fb017fff700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb004066f30 0x7fb0040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:05.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.638+0000 7fb017fff700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb004066f30 0x7fb0040693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb008006f00 tx=0x7fb0080091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:05.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.641+0000 7faffffff700 1 -- 172.21.15.61:0/2921691263 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb01816c420 con 0x7fb01815bab0 2023-12-24T20:06:05.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:05.890+0000 7fb01e36f700 1 -- 172.21.15.61:0/2921691263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb01804c3c0 con 0x7fb01815bab0 2023-12-24T20:06:06.753 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:06:06.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:06:06.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.800+0000 7faffffff700 1 -- 172.21.15.61:0/2921691263 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb00c0220b0 con 0x7fb01815bab0 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 -- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb004066f30 msgr2=0x7fb0040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb004066f30 0x7fb0040693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb008006f00 tx=0x7fb0080091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 -- 172.21.15.61:0/2921691263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb01815bab0 msgr2=0x7fb018168d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb01815bab0 0x7fb018168d20 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fb00c006ac0 tx=0x7fb00c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 -- 172.21.15.61:0/2921691263 shutdown_connections 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb01815b6e0 0x7fb0180c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb004066f30 0x7fb0040693e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0180ac710 0x7fb0180acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 --2- 172.21.15.61:0/2921691263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb01815bab0 0x7fb018168d20 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 -- 172.21.15.61:0/2921691263 >> 172.21.15.61:0/2921691263 conn(0x7fb0180ce800 msgr2=0x7fb018155740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.802+0000 7fb01e36f700 1 -- 172.21.15.61:0/2921691263 shutdown_connections 2023-12-24T20:06:06.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.803+0000 7fb01e36f700 1 -- 172.21.15.61:0/2921691263 wait complete. 2023-12-24T20:06:06.817 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T20:06:06.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.947+0000 7f8a3714b700 1 Processor -- start 2023-12-24T20:06:06.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.948+0000 7f8a3714b700 1 -- start start 2023-12-24T20:06:06.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.948+0000 7f8a3714b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8a3006b560 0x7f8a30159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:06.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.948+0000 7f8a3714b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8a300ce400 0x7f8a30159d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:06.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.948+0000 7f8a3714b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3015d900 con 0x7f8a300ce030 2023-12-24T20:06:06.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.948+0000 7f8a3714b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3015e910 con 0x7f8a3006b560 2023-12-24T20:06:06.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.948+0000 7f8a3714b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3015e480 con 0x7f8a300ce400 2023-12-24T20:06:06.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8a3006b560 0x7f8a30159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:06.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8a3006b560 0x7f8a30159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35250/0 (socket says 172.21.15.61:35250) 2023-12-24T20:06:06.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2ffff700 1 -- 172.21.15.61:0/1218250286 learned_addr learned my addr 172.21.15.61:0/1218250286 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:06.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a356e8700 1 --2- 172.21.15.61:0/1218250286 >> v2:172.21.15.133:3300/0 conn(0x7f8a300ce400 0x7f8a30159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2ffff700 1 -- 172.21.15.61:0/1218250286 >> v2:172.21.15.133:3300/0 conn(0x7f8a300ce400 msgr2=0x7f8a30159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2ffff700 1 --2- 172.21.15.61:0/1218250286 >> v2:172.21.15.133:3300/0 conn(0x7f8a300ce400 0x7f8a30159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2ffff700 1 -- 172.21.15.61:0/1218250286 >> v1:172.21.15.133:6789/0 conn(0x7f8a300ce030 legacy=0x7f8a30068df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2ffff700 1 -- 172.21.15.61:0/1218250286 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3015db50 con 0x7f8a3006b560 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2ffff700 1 --2- 172.21.15.61:0/1218250286 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3006b560 0x7f8a30159800 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f8a3015d840 tx=0x7f8a1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8de39cee7d511c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2f7fe700 1 -- 172.21.15.61:0/1218250286 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00b860 con 0x7f8a3006b560 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2f7fe700 1 -- 172.21.15.61:0/1218250286 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c00b9c0 con 0x7f8a3006b560 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.949+0000 7f8a2f7fe700 1 -- 172.21.15.61:0/1218250286 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00bd60 con 0x7f8a3006b560 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.950+0000 7f8a3714b700 1 -- 172.21.15.61:0/1218250286 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3006b560 msgr2=0x7f8a30159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.950+0000 7f8a3714b700 1 --2- 172.21.15.61:0/1218250286 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3006b560 0x7f8a30159800 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f8a3015d840 tx=0x7f8a1c009250 comp rx=0 tx=0).stop 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.950+0000 7f8a3714b700 1 -- 172.21.15.61:0/1218250286 shutdown_connections 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.950+0000 7f8a3714b700 1 --2- 172.21.15.61:0/1218250286 >> v2:172.21.15.133:3300/0 conn(0x7f8a300ce400 0x7f8a30159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.950+0000 7f8a3714b700 1 --2- 172.21.15.61:0/1218250286 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a3006b560 0x7f8a30159800 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.950+0000 7f8a3714b700 1 -- 172.21.15.61:0/1218250286 >> 172.21.15.61:0/1218250286 conn(0x7f8a3006f810 msgr2=0x7f8a3006ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.950+0000 7f8a3714b700 1 -- 172.21.15.61:0/1218250286 shutdown_connections 2023-12-24T20:06:06.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.950+0000 7f8a3714b700 1 -- 172.21.15.61:0/1218250286 wait complete. 2023-12-24T20:06:06.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.951+0000 7f8a3714b700 1 Processor -- start 2023-12-24T20:06:06.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.951+0000 7f8a3714b700 1 -- start start 2023-12-24T20:06:06.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a3714b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a3006b560 0x7f8a3014b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:06.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a3714b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a300ce030 0x7f8a300b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a3714b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a300ce400 0x7f8a300b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a3714b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300b47f0 con 0x7f8a300ce030 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a3714b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a30150e70 con 0x7f8a3006b560 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a3714b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3016a330 con 0x7f8a300ce400 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a2ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a300ce030 0x7f8a300b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a2ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a300ce030 0x7f8a300b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35264/0 (socket says 172.21.15.61:35264) 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a2ffff700 1 -- 172.21.15.61:0/2863861525 learned_addr learned my addr 172.21.15.61:0/2863861525 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a34ee7700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a3006b560 0x7f8a3014b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a356e8700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a300ce400 0x7f8a300b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a2ffff700 1 -- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a300ce400 msgr2=0x7f8a300b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a2ffff700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a300ce400 0x7f8a300b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a2ffff700 1 -- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a3006b560 msgr2=0x7f8a3014b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a2ffff700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a3006b560 0x7f8a3014b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a2ffff700 1 -- 172.21.15.61:0/2863861525 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c0094f0 con 0x7f8a300ce030 2023-12-24T20:06:06.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.952+0000 7f8a2ffff700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a300ce030 0x7f8a300b3930 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f8a3006e760 tx=0x7f8a1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:06.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.953+0000 7f8a2cff9700 1 -- 172.21.15.61:0/2863861525 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c024440 con 0x7f8a300ce030 2023-12-24T20:06:06.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.953+0000 7f8a2cff9700 1 -- 172.21.15.61:0/2863861525 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c0245a0 con 0x7f8a300ce030 2023-12-24T20:06:06.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.953+0000 7f8a2cff9700 1 -- 172.21.15.61:0/2863861525 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c024960 con 0x7f8a300ce030 2023-12-24T20:06:06.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.953+0000 7f8a3714b700 1 -- 172.21.15.61:0/2863861525 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3016abd0 con 0x7f8a300ce030 2023-12-24T20:06:06.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.953+0000 7f8a3714b700 1 -- 172.21.15.61:0/2863861525 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a300b4510 con 0x7f8a300ce030 2023-12-24T20:06:06.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.954+0000 7f8a3714b700 1 -- 172.21.15.61:0/2863861525 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3016ad60 con 0x7f8a300ce030 2023-12-24T20:06:06.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.954+0000 7f8a2cff9700 1 -- 172.21.15.61:0/2863861525 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8a1c024d50 con 0x7f8a300ce030 2023-12-24T20:06:06.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.955+0000 7f8a2cff9700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a14066f30 0x7f8a140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:06.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.955+0000 7f8a2cff9700 1 -- 172.21.15.61:0/2863861525 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a1c086130 con 0x7f8a300ce030 2023-12-24T20:06:06.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.955+0000 7f8a34ee7700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a14066f30 0x7f8a140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:06.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.955+0000 7f8a34ee7700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a14066f30 0x7f8a140693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8a24003a80 tx=0x7f8a24007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:06.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:06.959+0000 7f8a2cff9700 1 -- 172.21.15.61:0/2863861525 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a1c053380 con 0x7f8a300ce030 2023-12-24T20:06:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.197+0000 7f8a3714b700 1 -- 172.21.15.61:0/2863861525 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8a3004c3c0 con 0x7f8a300ce030 2023-12-24T20:06:07.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.801+0000 7f8a2cff9700 1 -- 172.21.15.61:0/2863861525 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8a1c02b340 con 0x7f8a300ce030 2023-12-24T20:06:07.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 -- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a14066f30 msgr2=0x7f8a140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a14066f30 0x7f8a140693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8a24003a80 tx=0x7f8a24007ec0 comp rx=0 tx=0).stop 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 -- 172.21.15.61:0/2863861525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a300ce030 msgr2=0x7f8a300b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a300ce030 0x7f8a300b3930 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f8a3006e760 tx=0x7f8a1c017000 comp rx=0 tx=0).stop 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 -- 172.21.15.61:0/2863861525 shutdown_connections 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8a300ce400 0x7f8a300b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8a14066f30 0x7f8a140693e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a3006b560 0x7f8a3014b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 --2- 172.21.15.61:0/2863861525 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8a300ce030 0x7f8a300b3930 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 -- 172.21.15.61:0/2863861525 >> 172.21.15.61:0/2863861525 conn(0x7f8a3006f810 msgr2=0x7f8a300c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 -- 172.21.15.61:0/2863861525 shutdown_connections 2023-12-24T20:06:07.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.804+0000 7f8a3714b700 1 -- 172.21.15.61:0/2863861525 wait complete. 2023-12-24T20:06:07.820 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:06:07.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.948+0000 7f9584ef7700 1 Processor -- start 2023-12-24T20:06:07.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.948+0000 7f9584ef7700 1 -- start start 2023-12-24T20:06:07.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.949+0000 7f9584ef7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9580159b00 0x7f9580067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:07.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.949+0000 7f9584ef7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95800af7d0 0x7f95800afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:07.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.949+0000 7f9584ef7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95800a84d0 con 0x7f9580070640 2023-12-24T20:06:07.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.949+0000 7f9584ef7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95800b0180 con 0x7f9580159b00 2023-12-24T20:06:07.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.949+0000 7f9584ef7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95800a7620 con 0x7f95800af7d0 2023-12-24T20:06:07.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.949+0000 7f957e59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9580159b00 0x7f9580067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:07.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.949+0000 7f957e59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9580159b00 0x7f9580067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35280/0 (socket says 172.21.15.61:35280) 2023-12-24T20:06:07.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.949+0000 7f957e59c700 1 -- 172.21.15.61:0/2010953052 learned_addr learned my addr 172.21.15.61:0/2010953052 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:07.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.949+0000 7f957dd9b700 1 --2- 172.21.15.61:0/2010953052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95800af7d0 0x7f95800afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:07.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.950+0000 7f957e59c700 1 -- 172.21.15.61:0/2010953052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95800af7d0 msgr2=0x7f95800afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:07.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.950+0000 7f957e59c700 1 --2- 172.21.15.61:0/2010953052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95800af7d0 0x7f95800afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:07.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.950+0000 7f957e59c700 1 -- 172.21.15.61:0/2010953052 >> v1:172.21.15.133:6789/0 conn(0x7f9580070640 legacy=0x7f958015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:07.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.950+0000 7f957e59c700 1 -- 172.21.15.61:0/2010953052 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95800a78c0 con 0x7f9580159b00 2023-12-24T20:06:07.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.950+0000 7f957e59c700 1 --2- 172.21.15.61:0/2010953052 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9580159b00 0x7f9580067550 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f95740099b0 tx=0x7f9574009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113ae6bd1f19bcf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:07.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.950+0000 7f957d59a700 1 -- 172.21.15.61:0/2010953052 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957400b820 con 0x7f9580159b00 2023-12-24T20:06:07.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.950+0000 7f957d59a700 1 -- 172.21.15.61:0/2010953052 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957400b980 con 0x7f9580159b00 2023-12-24T20:06:07.951 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.950+0000 7f957d59a700 1 -- 172.21.15.61:0/2010953052 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957400bd20 con 0x7f9580159b00 2023-12-24T20:06:07.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.950+0000 7f9584ef7700 1 -- 172.21.15.61:0/2010953052 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9580159b00 msgr2=0x7f9580067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:07.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.950+0000 7f9584ef7700 1 --2- 172.21.15.61:0/2010953052 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9580159b00 0x7f9580067550 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f95740099b0 tx=0x7f9574009250 comp rx=0 tx=0).stop 2023-12-24T20:06:07.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.951+0000 7f9584ef7700 1 -- 172.21.15.61:0/2010953052 shutdown_connections 2023-12-24T20:06:07.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.951+0000 7f9584ef7700 1 --2- 172.21.15.61:0/2010953052 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9580159b00 0x7f9580067550 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:07.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.951+0000 7f9584ef7700 1 --2- 172.21.15.61:0/2010953052 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f95800af7d0 0x7f95800afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:07.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.951+0000 7f9584ef7700 1 -- 172.21.15.61:0/2010953052 >> 172.21.15.61:0/2010953052 conn(0x7f95800ca200 msgr2=0x7f95800ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:07.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.951+0000 7f9584ef7700 1 -- 172.21.15.61:0/2010953052 shutdown_connections 2023-12-24T20:06:07.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.951+0000 7f9584ef7700 1 -- 172.21.15.61:0/2010953052 wait complete. 2023-12-24T20:06:07.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.952+0000 7f9584ef7700 1 Processor -- start 2023-12-24T20:06:07.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.952+0000 7f9584ef7700 1 -- start start 2023-12-24T20:06:07.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f9584ef7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9580070640 0x7f958015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:07.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f9584ef7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95800af7d0 0x7f9580151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:07.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f9584ef7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9580159b00 0x7f9580152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f9584ef7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95800b0a80 con 0x7f95800af7d0 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f9584ef7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9580154d80 con 0x7f9580159b00 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f9584ef7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9580152980 con 0x7f9580070640 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95800af7d0 0x7f9580151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95800af7d0 0x7f9580151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35290/0 (socket says 172.21.15.61:35290) 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957dd9b700 1 -- 172.21.15.61:0/2715138243 learned_addr learned my addr 172.21.15.61:0/2715138243 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957e59c700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9580070640 0x7f958015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957ed9d700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9580159b00 0x7f9580152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957dd9b700 1 -- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9580070640 msgr2=0x7f958015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957dd9b700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9580070640 0x7f958015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957dd9b700 1 -- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9580159b00 msgr2=0x7f9580152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957dd9b700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9580159b00 0x7f9580152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957dd9b700 1 -- 172.21.15.61:0/2715138243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95740094f0 con 0x7f95800af7d0 2023-12-24T20:06:07.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957ed9d700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9580159b00 0x7f9580152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f957dd9b700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95800af7d0 0x7f9580151f00 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f957000d8c0 tx=0x7f9570008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f956e7fc700 1 -- 172.21.15.61:0/2715138243 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700125f0 con 0x7f95800af7d0 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f956e7fc700 1 -- 172.21.15.61:0/2715138243 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9570012750 con 0x7f95800af7d0 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f9584ef7700 1 -- 172.21.15.61:0/2715138243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9580154260 con 0x7f95800af7d0 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.953+0000 7f956e7fc700 1 -- 172.21.15.61:0/2715138243 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570012af0 con 0x7f95800af7d0 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.954+0000 7f9584ef7700 1 -- 172.21.15.61:0/2715138243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9580154aa0 con 0x7f95800af7d0 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.954+0000 7f9584ef7700 1 -- 172.21.15.61:0/2715138243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958004c3c0 con 0x7f95800af7d0 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.955+0000 7f956e7fc700 1 -- 172.21.15.61:0/2715138243 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f957001e460 con 0x7f95800af7d0 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.955+0000 7f956e7fc700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.955+0000 7f956e7fc700 1 -- 172.21.15.61:0/2715138243 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9570084ad0 con 0x7f95800af7d0 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.955+0000 7f957e59c700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:07.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.956+0000 7f957e59c700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9560066f30 0x7f95600693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f95740099b0 tx=0x7f9574016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:07.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:07.959+0000 7f956e7fc700 1 -- 172.21.15.61:0/2715138243 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9570051d40 con 0x7f95800af7d0 2023-12-24T20:06:08.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.199+0000 7f9584ef7700 1 -- 172.21.15.61:0/2715138243 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95800af3a0 con 0x7f95800af7d0 2023-12-24T20:06:08.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.200+0000 7f956e7fc700 1 -- 172.21.15.61:0/2715138243 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f9570055360 con 0x7f95800af7d0 2023-12-24T20:06:08.200 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:08.200 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/534815426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":534815426},{"type":"v1","addr":"172.21.15.133:6836","nonce":534815426}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1994792297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1994792297},{"type":"v1","addr":"172.21.15.133:6837","nonce":1994792297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7818,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3942988503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3942988503},{"type":"v1","addr":"172.21.15.61:6834","nonce":3942988503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:06:04.174684+0000","modified":"2023-12-24T20:06:07.799428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/764589487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":764589487},{"type":"v1","addr":"172.21.15.61:6835","nonce":764589487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:06:08.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 -- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9560066f30 msgr2=0x7f95600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9560066f30 0x7f95600693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f95740099b0 tx=0x7f9574016000 comp rx=0 tx=0).stop 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 -- 172.21.15.61:0/2715138243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95800af7d0 msgr2=0x7f9580151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95800af7d0 0x7f9580151f00 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f957000d8c0 tx=0x7f9570008040 comp rx=0 tx=0).stop 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 -- 172.21.15.61:0/2715138243 shutdown_connections 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9580070640 0x7f958015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9560066f30 0x7f95600693e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9580159b00 0x7f9580152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 --2- 172.21.15.61:0/2715138243 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95800af7d0 0x7f9580151f00 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 -- 172.21.15.61:0/2715138243 >> 172.21.15.61:0/2715138243 conn(0x7f95800ca200 msgr2=0x7f9580067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 -- 172.21.15.61:0/2715138243 shutdown_connections 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.202+0000 7f9584ef7700 1 -- 172.21.15.61:0/2715138243 wait complete. 2023-12-24T20:06:08.203 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 84 2023-12-24T20:06:08.216 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:06:08.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.337+0000 7f114c537700 1 Processor -- start 2023-12-24T20:06:08.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.337+0000 7f114c537700 1 -- start start 2023-12-24T20:06:08.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.338+0000 7f114c537700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1144070d50 0x7f1144067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.338+0000 7f114c537700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11440a84d0 con 0x7f1144159b00 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.338+0000 7f114c537700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11440a7620 con 0x7f11440afee0 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.338+0000 7f114c537700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11440a78c0 con 0x7f1144070d50 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f114a2d3700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1144159b00 0x7f11440af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51926/0 (socket says 172.21.15.61:51926) 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f114a2d3700 1 -- 172.21.15.61:0/3519933393 learned_addr learned my addr 172.21.15.61:0/3519933393 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f114aad4700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1144070d50 0x7f1144067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236899680 0 0) 0x7f11440a84d0 con 0x7f1144159b00 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1130003570 con 0x7f1144159b00 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 986677519 0 0) 0x7f1130003570 con 0x7f1144159b00 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1144070d50 msgr2=0x7f1144067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1144070d50 0x7f1144067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 >> v1:172.21.15.133:6789/0 conn(0x7f11440afee0 legacy=0x7f1144070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440a7ba0 con 0x7f1144159b00 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f1140001470 con 0x7f1144159b00 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 >> v1:172.21.15.61:6789/0 conn(0x7f1144159b00 legacy=0x7f11440af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1144070d50 0x7f1130003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1130004010 0x7f1130004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130004d50 0x7f11300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440a78c0 con 0x7f1130004010 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113000bbf0 con 0x7f1130004d50 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113000bdb0 con 0x7f1144070d50 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f1149ad2700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1130004010 0x7f1130004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.339+0000 7f114a2d3700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1144070d50 0x7f1130003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.340+0000 7f114aad4700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130004d50 0x7f11300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.340+0000 7f1149ad2700 1 -- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1144070d50 msgr2=0x7f1130003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:08.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.340+0000 7f1149ad2700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1144070d50 0x7f1130003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.340+0000 7f1149ad2700 1 -- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130004d50 msgr2=0x7f11300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:08.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.340+0000 7f1149ad2700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130004d50 0x7f11300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.340+0000 7f1149ad2700 1 -- 172.21.15.61:0/3519933393 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1130003570 con 0x7f1130004010 2023-12-24T20:06:08.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.340+0000 7f1149ad2700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1130004010 0x7f1130004810 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f114406ec10 tx=0x7f1134007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507521f1b23bbd6f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:08.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.340+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134012420 con 0x7f1130004010 2023-12-24T20:06:08.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.340+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1134012580 con 0x7f1130004010 2023-12-24T20:06:08.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.340+0000 7f11492d1700 1 -- 172.21.15.61:0/3519933393 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134012920 con 0x7f1130004010 2023-12-24T20:06:08.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.341+0000 7f114c537700 1 -- 172.21.15.61:0/3519933393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1130004010 msgr2=0x7f1130004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.341+0000 7f114c537700 1 --2- 172.21.15.61:0/3519933393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1130004010 0x7f1130004810 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f114406ec10 tx=0x7f1134007d30 comp rx=0 tx=0).stop 2023-12-24T20:06:08.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.341+0000 7f114aad4700 1 -- 172.21.15.61:0/3519933393 reap_dead start 2023-12-24T20:06:08.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.341+0000 7f114c537700 1 -- 172.21.15.61:0/3519933393 shutdown_connections 2023-12-24T20:06:08.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.341+0000 7f114c537700 1 -- 172.21.15.61:0/3519933393 >> 172.21.15.61:0/3519933393 conn(0x7f11440ca200 msgr2=0x7f11440ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:08.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.341+0000 7f114c537700 1 -- 172.21.15.61:0/3519933393 shutdown_connections 2023-12-24T20:06:08.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.341+0000 7f114c537700 1 -- 172.21.15.61:0/3519933393 wait complete. 2023-12-24T20:06:08.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.342+0000 7f114c537700 1 Processor -- start 2023-12-24T20:06:08.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.342+0000 7f114c537700 1 -- start start 2023-12-24T20:06:08.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114c537700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130004010 0x7f11440b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114c537700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f114414bd50 0x7f11440b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114c537700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f114416f0a0 0x7f11440b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114c537700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114415e6d0 con 0x7f114416f0a0 2023-12-24T20:06:08.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114c537700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440cbba0 con 0x7f1130004010 2023-12-24T20:06:08.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114c537700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11440b0a70 con 0x7f114414bd50 2023-12-24T20:06:08.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114aad4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f114416f0a0 0x7f11440b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114aad4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f114416f0a0 0x7f11440b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35312/0 (socket says 172.21.15.61:35312) 2023-12-24T20:06:08.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114aad4700 1 -- 172.21.15.61:0/2552803337 learned_addr learned my addr 172.21.15.61:0/2552803337 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:08.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f1149ad2700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f114414bd50 0x7f11440b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114a2d3700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130004010 0x7f11440b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114aad4700 1 -- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f114414bd50 msgr2=0x7f11440b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114aad4700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f114414bd50 0x7f11440b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114aad4700 1 -- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130004010 msgr2=0x7f11440b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114aad4700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130004010 0x7f11440b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114aad4700 1 -- 172.21.15.61:0/2552803337 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114415e110 con 0x7f114416f0a0 2023-12-24T20:06:08.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114aad4700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f114416f0a0 0x7f11440b1a70 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f113c0094d0 tx=0x7f113c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:08.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f113a7fc700 1 -- 172.21.15.61:0/2552803337 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c00e040 con 0x7f114416f0a0 2023-12-24T20:06:08.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f113a7fc700 1 -- 172.21.15.61:0/2552803337 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c00f040 con 0x7f114416f0a0 2023-12-24T20:06:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f113a7fc700 1 -- 172.21.15.61:0/2552803337 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c00fd90 con 0x7f114416f0a0 2023-12-24T20:06:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114c537700 1 -- 172.21.15.61:0/2552803337 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114415e3f0 con 0x7f114416f0a0 2023-12-24T20:06:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.343+0000 7f114c537700 1 -- 172.21.15.61:0/2552803337 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114416f610 con 0x7f114416f0a0 2023-12-24T20:06:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.344+0000 7f114c537700 1 -- 172.21.15.61:0/2552803337 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11440cb690 con 0x7f114416f0a0 2023-12-24T20:06:08.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.345+0000 7f113a7fc700 1 -- 172.21.15.61:0/2552803337 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f113c015640 con 0x7f114416f0a0 2023-12-24T20:06:08.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.345+0000 7f113a7fc700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1128066f30 0x7f11280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.345+0000 7f113a7fc700 1 -- 172.21.15.61:0/2552803337 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f113c084f10 con 0x7f114416f0a0 2023-12-24T20:06:08.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.345+0000 7f114a2d3700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1128066f30 0x7f11280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.346+0000 7f114a2d3700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1128066f30 0x7f11280693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1140000e50 tx=0x7f1140001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:08.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.350+0000 7f113a7fc700 1 -- 172.21.15.61:0/2552803337 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11440cb690 con 0x7f114416f0a0 2023-12-24T20:06:08.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.546+0000 7f114c537700 1 -- 172.21.15.61:0/2552803337 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11440cb690 con 0x7f114416f0a0 2023-12-24T20:06:08.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.547+0000 7f113a7fc700 1 -- 172.21.15.61:0/2552803337 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f11440cb690 con 0x7f114416f0a0 2023-12-24T20:06:08.547 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:08.547 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":168,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:06:05.761738+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:06:01.971715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-24T20:06:03.153177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 -- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1128066f30 msgr2=0x7f11280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1128066f30 0x7f11280693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1140000e50 tx=0x7f1140001e50 comp rx=0 tx=0).stop 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 -- 172.21.15.61:0/2552803337 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f114416f0a0 msgr2=0x7f11440b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f114416f0a0 0x7f11440b1a70 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f113c0094d0 tx=0x7f113c00b040 comp rx=0 tx=0).stop 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 -- 172.21.15.61:0/2552803337 shutdown_connections 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1128066f30 0x7f11280693e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f114416f0a0 0x7f11440b1a70 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1130004010 0x7f11440b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 --2- 172.21.15.61:0/2552803337 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f114414bd50 0x7f11440b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 -- 172.21.15.61:0/2552803337 >> 172.21.15.61:0/2552803337 conn(0x7f11440ca200 msgr2=0x7f11440682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 -- 172.21.15.61:0/2552803337 shutdown_connections 2023-12-24T20:06:08.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.549+0000 7f114c537700 1 -- 172.21.15.61:0/2552803337 wait complete. 2023-12-24T20:06:08.562 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T20:06:08.563 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:06:08.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.685+0000 7fc051cc5700 1 Processor -- start 2023-12-24T20:06:08.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.685+0000 7fc051cc5700 1 -- start start 2023-12-24T20:06:08.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc051cc5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc04c06f040 0x7fc04c0ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc051cc5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c06c300 con 0x7fc04c06ec70 2023-12-24T20:06:08.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc051cc5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c06ce80 con 0x7fc04c159cf0 2023-12-24T20:06:08.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc051cc5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c06f480 con 0x7fc04c06f040 2023-12-24T20:06:08.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04b7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fc04c06ec70 0x7fc04c1595e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51936/0 (socket says 172.21.15.61:51936) 2023-12-24T20:06:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04b7fe700 1 -- 172.21.15.61:0/168926039 learned_addr learned my addr 172.21.15.61:0/168926039 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04bfff700 1 --2- 172.21.15.61:0/168926039 >> v2:172.21.15.133:3300/0 conn(0x7fc04c06f040 0x7fc04c0ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04a7fc700 1 -- 172.21.15.61:0/168926039 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994511641 0 0) 0x7fc04c06c300 con 0x7fc04c06ec70 2023-12-24T20:06:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04a7fc700 1 -- 172.21.15.61:0/168926039 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc038003570 con 0x7fc04c06ec70 2023-12-24T20:06:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04a7fc700 1 -- 172.21.15.61:0/168926039 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205385911 0 0) 0x7fc04c06ce80 con 0x7fc04c159cf0 2023-12-24T20:06:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04a7fc700 1 -- 172.21.15.61:0/168926039 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc04c06c300 con 0x7fc04c159cf0 2023-12-24T20:06:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04bfff700 1 -- 172.21.15.61:0/168926039 >> v1:172.21.15.133:6789/0 conn(0x7fc04c159cf0 legacy=0x7fc04c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04a7fc700 1 -- 172.21.15.61:0/168926039 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 619641195 0 0) 0x7fc038003570 con 0x7fc04c06ec70 2023-12-24T20:06:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04bfff700 1 -- 172.21.15.61:0/168926039 >> v1:172.21.15.61:6789/0 conn(0x7fc04c06ec70 legacy=0x7fc04c1595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.686+0000 7fc04bfff700 1 -- 172.21.15.61:0/168926039 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c068560 con 0x7fc04c06f040 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc04bfff700 1 --2- 172.21.15.61:0/168926039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc04c06f040 0x7fc04c0ce0d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc044009e60 tx=0x7fc044009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b630c781a18eaf server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc04a7fc700 1 -- 172.21.15.61:0/168926039 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04400e070 con 0x7fc04c06f040 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc04a7fc700 1 -- 172.21.15.61:0/168926039 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04400b7a0 con 0x7fc04c06f040 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc04a7fc700 1 -- 172.21.15.61:0/168926039 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c001470 con 0x7fc04c06f040 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc051cc5700 1 -- 172.21.15.61:0/168926039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc04c06f040 msgr2=0x7fc04c0ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc051cc5700 1 --2- 172.21.15.61:0/168926039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc04c06f040 0x7fc04c0ce0d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc044009e60 tx=0x7fc044009780 comp rx=0 tx=0).stop 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc051cc5700 1 -- 172.21.15.61:0/168926039 shutdown_connections 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc051cc5700 1 --2- 172.21.15.61:0/168926039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc04c06f040 0x7fc04c0ce0d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc051cc5700 1 -- 172.21.15.61:0/168926039 >> 172.21.15.61:0/168926039 conn(0x7fc04c06b650 msgr2=0x7fc04c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc051cc5700 1 -- 172.21.15.61:0/168926039 shutdown_connections 2023-12-24T20:06:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.687+0000 7fc051cc5700 1 -- 172.21.15.61:0/168926039 wait complete. 2023-12-24T20:06:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.689+0000 7fc051cc5700 1 Processor -- start 2023-12-24T20:06:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.689+0000 7fc051cc5700 1 -- start start 2023-12-24T20:06:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.689+0000 7fc051cc5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc04c06ec70 0x7fc04c0aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.689+0000 7fc051cc5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc04c06f040 0x7fc04c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.689+0000 7fc051cc5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc04c159cf0 0x7fc04c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.689+0000 7fc051cc5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c14dc20 con 0x7fc04c06ec70 2023-12-24T20:06:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.689+0000 7fc051cc5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c14d530 con 0x7fc04c06f040 2023-12-24T20:06:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.689+0000 7fc051cc5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c0b2e50 con 0x7fc04c159cf0 2023-12-24T20:06:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc04c06ec70 0x7fc04c0aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc04c06ec70 0x7fc04c0aa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35324/0 (socket says 172.21.15.61:35324) 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04b7fe700 1 -- 172.21.15.61:0/698528870 learned_addr learned my addr 172.21.15.61:0/698528870 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04bfff700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc04c159cf0 0x7fc04c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04affd700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc04c06f040 0x7fc04c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04b7fe700 1 -- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc04c159cf0 msgr2=0x7fc04c152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04b7fe700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc04c159cf0 0x7fc04c152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04b7fe700 1 -- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc04c06f040 msgr2=0x7fc04c152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04b7fe700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc04c06f040 0x7fc04c152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04b7fe700 1 -- 172.21.15.61:0/698528870 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044009a20 con 0x7fc04c06ec70 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc04b7fe700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc04c06ec70 0x7fc04c0aa880 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00cb60 tx=0x7fc03c001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc0437fe700 1 -- 172.21.15.61:0/698528870 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c007e90 con 0x7fc04c06ec70 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc0437fe700 1 -- 172.21.15.61:0/698528870 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c007360 con 0x7fc04c06ec70 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc051cc5700 1 -- 172.21.15.61:0/698528870 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c0b3130 con 0x7fc04c06ec70 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc0437fe700 1 -- 172.21.15.61:0/698528870 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c004830 con 0x7fc04c06ec70 2023-12-24T20:06:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.690+0000 7fc051cc5700 1 -- 172.21.15.61:0/698528870 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04c1522f0 con 0x7fc04c06ec70 2023-12-24T20:06:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.691+0000 7fc051cc5700 1 -- 172.21.15.61:0/698528870 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04c152120 con 0x7fc04c06ec70 2023-12-24T20:06:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.692+0000 7fc0437fe700 1 -- 172.21.15.61:0/698528870 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc03c004ba0 con 0x7fc04c06ec70 2023-12-24T20:06:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.692+0000 7fc0437fe700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc02c066f30 0x7fc02c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.692+0000 7fc0437fe700 1 -- 172.21.15.61:0/698528870 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc03c0839e0 con 0x7fc04c06ec70 2023-12-24T20:06:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.692+0000 7fc04affd700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc02c066f30 0x7fc02c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.693+0000 7fc04affd700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc02c066f30 0x7fc02c0693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0c5850 tx=0x7fc034009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:08.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.696+0000 7fc0437fe700 1 -- 172.21.15.61:0/698528870 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc03c050c50 con 0x7fc04c06ec70 2023-12-24T20:06:08.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.888+0000 7fc051cc5700 1 -- 172.21.15.61:0/698528870 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc04c04c430 con 0x7fc02c066f30 2023-12-24T20:06:08.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.897+0000 7fc0437fe700 1 -- 172.21.15.61:0/698528870 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285338 (secure 0 0 0) 0x7fc04c04c430 con 0x7fc02c066f30 2023-12-24T20:06:08.901 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:08.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 -- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc02c066f30 msgr2=0x7fc02c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc02c066f30 0x7fc02c0693e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0c5850 tx=0x7fc034009040 comp rx=0 tx=0).stop 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 -- 172.21.15.61:0/698528870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc04c06ec70 msgr2=0x7fc04c0aa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc04c06ec70 0x7fc04c0aa880 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00cb60 tx=0x7fc03c001ad0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 -- 172.21.15.61:0/698528870 shutdown_connections 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc04c159cf0 0x7fc04c152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc02c066f30 0x7fc02c0693e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc04c06ec70 0x7fc04c0aa880 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 --2- 172.21.15.61:0/698528870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc04c06f040 0x7fc04c152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 -- 172.21.15.61:0/698528870 >> 172.21.15.61:0/698528870 conn(0x7fc04c06b650 msgr2=0x7fc04c0c3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 -- 172.21.15.61:0/698528870 shutdown_connections 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:08.900+0000 7fc051cc5700 1 -- 172.21.15.61:0/698528870 wait complete. 2023-12-24T20:06:08.904 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:06:08.913 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":435,"stamp":"2023-12-24T20:06:08.442342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554089,"statfs":{"total":1600000000,"available":1591387482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.683667"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777764+0000","last_change":"2023-12-24T20:06:04.777764+0000","last_active":"2023-12-24T20:06:04.777764+0000","last_peered":"2023-12-24T20:06:04.777764+0000","last_clean":"2023-12-24T20:06:04.777764+0000","last_became_active":"2023-12-24T20:06:04.776749+0000","last_became_peered":"2023-12-24T20:06:04.776749+0000","last_unstale":"2023-12-24T20:06:04.777764+0000","last_undegraded":"2023-12-24T20:06:04.777764+0000","last_fullsized":"2023-12-24T20:06:04.777764+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:18:12.508908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.771847+0000","last_change":"2023-12-24T20:06:04.771847+0000","last_active":"2023-12-24T20:06:04.771847+0000","last_peered":"2023-12-24T20:06:04.771847+0000","last_clean":"2023-12-24T20:06:04.771847+0000","last_became_active":"2023-12-24T20:06:04.771608+0000","last_became_peered":"2023-12-24T20:06:04.771608+0000","last_unstale":"2023-12-24T20:06:04.771847+0000","last_undegraded":"2023-12-24T20:06:04.771847+0000","last_fullsized":"2023-12-24T20:06:04.771847+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:51:12.919665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772532+0000","last_change":"2023-12-24T20:06:04.772532+0000","last_active":"2023-12-24T20:06:04.772532+0000","last_peered":"2023-12-24T20:06:04.772532+0000","last_clean":"2023-12-24T20:06:04.772532+0000","last_became_active":"2023-12-24T20:06:04.772163+0000","last_became_peered":"2023-12-24T20:06:04.772163+0000","last_unstale":"2023-12-24T20:06:04.772532+0000","last_undegraded":"2023-12-24T20:06:04.772532+0000","last_fullsized":"2023-12-24T20:06:04.772532+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:06.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780764+0000","last_change":"2023-12-24T20:06:04.780764+0000","last_active":"2023-12-24T20:06:04.780764+0000","last_peered":"2023-12-24T20:06:04.780764+0000","last_clean":"2023-12-24T20:06:04.780764+0000","last_became_active":"2023-12-24T20:06:04.780374+0000","last_became_peered":"2023-12-24T20:06:04.780374+0000","last_unstale":"2023-12-24T20:06:04.780764+0000","last_undegraded":"2023-12-24T20:06:04.780764+0000","last_fullsized":"2023-12-24T20:06:04.780764+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:18.110635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775383+0000","last_change":"2023-12-24T20:06:04.775383+0000","last_active":"2023-12-24T20:06:04.775383+0000","last_peered":"2023-12-24T20:06:04.775383+0000","last_clean":"2023-12-24T20:06:04.775383+0000","last_became_active":"2023-12-24T20:06:04.775009+0000","last_became_peered":"2023-12-24T20:06:04.775009+0000","last_unstale":"2023-12-24T20:06:04.775383+0000","last_undegraded":"2023-12-24T20:06:04.775383+0000","last_fullsized":"2023-12-24T20:06:04.775383+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:00.466664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777611+0000","last_change":"2023-12-24T20:06:04.777611+0000","last_active":"2023-12-24T20:06:04.777611+0000","last_peered":"2023-12-24T20:06:04.777611+0000","last_clean":"2023-12-24T20:06:04.777611+0000","last_became_active":"2023-12-24T20:06:04.776129+0000","last_became_peered":"2023-12-24T20:06:04.776129+0000","last_unstale":"2023-12-24T20:06:04.777611+0000","last_undegraded":"2023-12-24T20:06:04.777611+0000","last_fullsized":"2023-12-24T20:06:04.777611+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:59:43.530403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.779392+0000","last_change":"2023-12-24T20:06:04.779392+0000","last_active":"2023-12-24T20:06:04.779392+0000","last_peered":"2023-12-24T20:06:04.779392+0000","last_clean":"2023-12-24T20:06:04.779392+0000","last_became_active":"2023-12-24T20:06:04.779083+0000","last_became_peered":"2023-12-24T20:06:04.779083+0000","last_unstale":"2023-12-24T20:06:04.779392+0000","last_undegraded":"2023-12-24T20:06:04.779392+0000","last_fullsized":"2023-12-24T20:06:04.779392+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:23.083762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.767732+0000","last_change":"2023-12-24T20:06:04.767732+0000","last_active":"2023-12-24T20:06:04.767732+0000","last_peered":"2023-12-24T20:06:04.767732+0000","last_clean":"2023-12-24T20:06:04.767732+0000","last_became_active":"2023-12-24T20:06:04.767420+0000","last_became_peered":"2023-12-24T20:06:04.767420+0000","last_unstale":"2023-12-24T20:06:04.767732+0000","last_undegraded":"2023-12-24T20:06:04.767732+0000","last_fullsized":"2023-12-24T20:06:04.767732+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:26.260139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775315+0000","last_change":"2023-12-24T20:06:04.775315+0000","last_active":"2023-12-24T20:06:04.775315+0000","last_peered":"2023-12-24T20:06:04.775315+0000","last_clean":"2023-12-24T20:06:04.775315+0000","last_became_active":"2023-12-24T20:06:04.775032+0000","last_became_peered":"2023-12-24T20:06:04.775032+0000","last_unstale":"2023-12-24T20:06:04.775315+0000","last_undegraded":"2023-12-24T20:06:04.775315+0000","last_fullsized":"2023-12-24T20:06:04.775315+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:14.550410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.779632+0000","last_change":"2023-12-24T20:06:04.779632+0000","last_active":"2023-12-24T20:06:04.779632+0000","last_peered":"2023-12-24T20:06:04.779632+0000","last_clean":"2023-12-24T20:06:04.779632+0000","last_became_active":"2023-12-24T20:06:04.778406+0000","last_became_peered":"2023-12-24T20:06:04.778406+0000","last_unstale":"2023-12-24T20:06:04.779632+0000","last_undegraded":"2023-12-24T20:06:04.779632+0000","last_fullsized":"2023-12-24T20:06:04.779632+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:44:26.864125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.768081+0000","last_change":"2023-12-24T20:06:04.768081+0000","last_active":"2023-12-24T20:06:04.768081+0000","last_peered":"2023-12-24T20:06:04.768081+0000","last_clean":"2023-12-24T20:06:04.768081+0000","last_became_active":"2023-12-24T20:06:04.767823+0000","last_became_peered":"2023-12-24T20:06:04.767823+0000","last_unstale":"2023-12-24T20:06:04.768081+0000","last_undegraded":"2023-12-24T20:06:04.768081+0000","last_fullsized":"2023-12-24T20:06:04.768081+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:52:21.962533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772598+0000","last_change":"2023-12-24T20:06:04.772598+0000","last_active":"2023-12-24T20:06:04.772598+0000","last_peered":"2023-12-24T20:06:04.772598+0000","last_clean":"2023-12-24T20:06:04.772598+0000","last_became_active":"2023-12-24T20:06:04.772404+0000","last_became_peered":"2023-12-24T20:06:04.772404+0000","last_unstale":"2023-12-24T20:06:04.772598+0000","last_undegraded":"2023-12-24T20:06:04.772598+0000","last_fullsized":"2023-12-24T20:06:04.772598+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:45.217479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774816+0000","last_change":"2023-12-24T20:06:04.774816+0000","last_active":"2023-12-24T20:06:04.774816+0000","last_peered":"2023-12-24T20:06:04.774816+0000","last_clean":"2023-12-24T20:06:04.774816+0000","last_became_active":"2023-12-24T20:06:04.773928+0000","last_became_peered":"2023-12-24T20:06:04.773928+0000","last_unstale":"2023-12-24T20:06:04.774816+0000","last_undegraded":"2023-12-24T20:06:04.774816+0000","last_fullsized":"2023-12-24T20:06:04.774816+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:05.636519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777400+0000","last_change":"2023-12-24T20:06:04.777400+0000","last_active":"2023-12-24T20:06:04.777400+0000","last_peered":"2023-12-24T20:06:04.777400+0000","last_clean":"2023-12-24T20:06:04.777400+0000","last_became_active":"2023-12-24T20:06:04.777040+0000","last_became_peered":"2023-12-24T20:06:04.777040+0000","last_unstale":"2023-12-24T20:06:04.777400+0000","last_undegraded":"2023-12-24T20:06:04.777400+0000","last_fullsized":"2023-12-24T20:06:04.777400+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:38:38.335652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.779959+0000","last_change":"2023-12-24T20:06:04.779959+0000","last_active":"2023-12-24T20:06:04.779959+0000","last_peered":"2023-12-24T20:06:04.779959+0000","last_clean":"2023-12-24T20:06:04.779959+0000","last_became_active":"2023-12-24T20:06:04.779165+0000","last_became_peered":"2023-12-24T20:06:04.779165+0000","last_unstale":"2023-12-24T20:06:04.779959+0000","last_undegraded":"2023-12-24T20:06:04.779959+0000","last_fullsized":"2023-12-24T20:06:04.779959+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:55.837764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.773489+0000","last_change":"2023-12-24T20:06:04.773489+0000","last_active":"2023-12-24T20:06:04.773489+0000","last_peered":"2023-12-24T20:06:04.773489+0000","last_clean":"2023-12-24T20:06:04.773489+0000","last_became_active":"2023-12-24T20:06:04.773149+0000","last_became_peered":"2023-12-24T20:06:04.773149+0000","last_unstale":"2023-12-24T20:06:04.773489+0000","last_undegraded":"2023-12-24T20:06:04.773489+0000","last_fullsized":"2023-12-24T20:06:04.773489+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:02:35.043187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775823+0000","last_change":"2023-12-24T20:06:04.775823+0000","last_active":"2023-12-24T20:06:04.775823+0000","last_peered":"2023-12-24T20:06:04.775823+0000","last_clean":"2023-12-24T20:06:04.775823+0000","last_became_active":"2023-12-24T20:06:04.775577+0000","last_became_peered":"2023-12-24T20:06:04.775577+0000","last_unstale":"2023-12-24T20:06:04.775823+0000","last_undegraded":"2023-12-24T20:06:04.775823+0000","last_fullsized":"2023-12-24T20:06:04.775823+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:14.278700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772392+0000","last_change":"2023-12-24T20:06:04.772392+0000","last_active":"2023-12-24T20:06:04.772392+0000","last_peered":"2023-12-24T20:06:04.772392+0000","last_clean":"2023-12-24T20:06:04.772392+0000","last_became_active":"2023-12-24T20:06:04.771837+0000","last_became_peered":"2023-12-24T20:06:04.771837+0000","last_unstale":"2023-12-24T20:06:04.772392+0000","last_undegraded":"2023-12-24T20:06:04.772392+0000","last_fullsized":"2023-12-24T20:06:04.772392+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:34:56.560519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776569+0000","last_change":"2023-12-24T20:06:04.776569+0000","last_active":"2023-12-24T20:06:04.776569+0000","last_peered":"2023-12-24T20:06:04.776569+0000","last_clean":"2023-12-24T20:06:04.776569+0000","last_became_active":"2023-12-24T20:06:04.776323+0000","last_became_peered":"2023-12-24T20:06:04.776323+0000","last_unstale":"2023-12-24T20:06:04.776569+0000","last_undegraded":"2023-12-24T20:06:04.776569+0000","last_fullsized":"2023-12-24T20:06:04.776569+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:35.608952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776670+0000","last_change":"2023-12-24T20:06:04.776670+0000","last_active":"2023-12-24T20:06:04.776670+0000","last_peered":"2023-12-24T20:06:04.776670+0000","last_clean":"2023-12-24T20:06:04.776670+0000","last_became_active":"2023-12-24T20:06:04.776402+0000","last_became_peered":"2023-12-24T20:06:04.776402+0000","last_unstale":"2023-12-24T20:06:04.776670+0000","last_undegraded":"2023-12-24T20:06:04.776670+0000","last_fullsized":"2023-12-24T20:06:04.776670+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:44:49.085676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776589+0000","last_change":"2023-12-24T20:06:04.776589+0000","last_active":"2023-12-24T20:06:04.776589+0000","last_peered":"2023-12-24T20:06:04.776589+0000","last_clean":"2023-12-24T20:06:04.776589+0000","last_became_active":"2023-12-24T20:06:04.776334+0000","last_became_peered":"2023-12-24T20:06:04.776334+0000","last_unstale":"2023-12-24T20:06:04.776589+0000","last_undegraded":"2023-12-24T20:06:04.776589+0000","last_fullsized":"2023-12-24T20:06:04.776589+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:46:47.163421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.781114+0000","last_change":"2023-12-24T20:06:04.781114+0000","last_active":"2023-12-24T20:06:04.781114+0000","last_peered":"2023-12-24T20:06:04.781114+0000","last_clean":"2023-12-24T20:06:04.781114+0000","last_became_active":"2023-12-24T20:06:04.780218+0000","last_became_peered":"2023-12-24T20:06:04.780218+0000","last_unstale":"2023-12-24T20:06:04.781114+0000","last_undegraded":"2023-12-24T20:06:04.781114+0000","last_fullsized":"2023-12-24T20:06:04.781114+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:34:56.560519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.781132+0000","last_change":"2023-12-24T20:06:04.781132+0000","last_active":"2023-12-24T20:06:04.781132+0000","last_peered":"2023-12-24T20:06:04.781132+0000","last_clean":"2023-12-24T20:06:04.781132+0000","last_became_active":"2023-12-24T20:06:04.780472+0000","last_became_peered":"2023-12-24T20:06:04.780472+0000","last_unstale":"2023-12-24T20:06:04.781132+0000","last_undegraded":"2023-12-24T20:06:04.781132+0000","last_fullsized":"2023-12-24T20:06:04.781132+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:35.526313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780319+0000","last_change":"2023-12-24T20:06:04.780319+0000","last_active":"2023-12-24T20:06:04.780319+0000","last_peered":"2023-12-24T20:06:04.780319+0000","last_clean":"2023-12-24T20:06:04.780319+0000","last_became_active":"2023-12-24T20:06:04.780097+0000","last_became_peered":"2023-12-24T20:06:04.780097+0000","last_unstale":"2023-12-24T20:06:04.780319+0000","last_undegraded":"2023-12-24T20:06:04.780319+0000","last_fullsized":"2023-12-24T20:06:04.780319+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:20.823581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775894+0000","last_change":"2023-12-24T20:06:04.775894+0000","last_active":"2023-12-24T20:06:04.775894+0000","last_peered":"2023-12-24T20:06:04.775894+0000","last_clean":"2023-12-24T20:06:04.775894+0000","last_became_active":"2023-12-24T20:06:04.775637+0000","last_became_peered":"2023-12-24T20:06:04.775637+0000","last_unstale":"2023-12-24T20:06:04.775894+0000","last_undegraded":"2023-12-24T20:06:04.775894+0000","last_fullsized":"2023-12-24T20:06:04.775894+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:36:54.731492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.773949+0000","last_change":"2023-12-24T20:06:04.773949+0000","last_active":"2023-12-24T20:06:04.773949+0000","last_peered":"2023-12-24T20:06:04.773949+0000","last_clean":"2023-12-24T20:06:04.773949+0000","last_became_active":"2023-12-24T20:06:04.773710+0000","last_became_peered":"2023-12-24T20:06:04.773710+0000","last_unstale":"2023-12-24T20:06:04.773949+0000","last_undegraded":"2023-12-24T20:06:04.773949+0000","last_fullsized":"2023-12-24T20:06:04.773949+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:59:39.822638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774133+0000","last_change":"2023-12-24T20:06:04.774133+0000","last_active":"2023-12-24T20:06:04.774133+0000","last_peered":"2023-12-24T20:06:04.774133+0000","last_clean":"2023-12-24T20:06:04.774133+0000","last_became_active":"2023-12-24T20:06:04.773913+0000","last_became_peered":"2023-12-24T20:06:04.773913+0000","last_unstale":"2023-12-24T20:06:04.774133+0000","last_undegraded":"2023-12-24T20:06:04.774133+0000","last_fullsized":"2023-12-24T20:06:04.774133+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:40:35.912407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774454+0000","last_change":"2023-12-24T20:06:04.774454+0000","last_active":"2023-12-24T20:06:04.774454+0000","last_peered":"2023-12-24T20:06:04.774454+0000","last_clean":"2023-12-24T20:06:04.774454+0000","last_became_active":"2023-12-24T20:06:04.773738+0000","last_became_peered":"2023-12-24T20:06:04.773738+0000","last_unstale":"2023-12-24T20:06:04.774454+0000","last_undegraded":"2023-12-24T20:06:04.774454+0000","last_fullsized":"2023-12-24T20:06:04.774454+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:06.541160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.770956+0000","last_change":"2023-12-24T20:06:04.770956+0000","last_active":"2023-12-24T20:06:04.770956+0000","last_peered":"2023-12-24T20:06:04.770956+0000","last_clean":"2023-12-24T20:06:04.770956+0000","last_became_active":"2023-12-24T20:06:04.770175+0000","last_became_peered":"2023-12-24T20:06:04.770175+0000","last_unstale":"2023-12-24T20:06:04.770956+0000","last_undegraded":"2023-12-24T20:06:04.770956+0000","last_fullsized":"2023-12-24T20:06:04.770956+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:57.185392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774493+0000","last_change":"2023-12-24T20:06:04.774493+0000","last_active":"2023-12-24T20:06:04.774493+0000","last_peered":"2023-12-24T20:06:04.774493+0000","last_clean":"2023-12-24T20:06:04.774493+0000","last_became_active":"2023-12-24T20:06:04.774216+0000","last_became_peered":"2023-12-24T20:06:04.774216+0000","last_unstale":"2023-12-24T20:06:04.774493+0000","last_undegraded":"2023-12-24T20:06:04.774493+0000","last_fullsized":"2023-12-24T20:06:04.774493+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:06.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776098+0000","last_change":"2023-12-24T20:06:04.776098+0000","last_active":"2023-12-24T20:06:04.776098+0000","last_peered":"2023-12-24T20:06:04.776098+0000","last_clean":"2023-12-24T20:06:04.776098+0000","last_became_active":"2023-12-24T20:06:04.775854+0000","last_became_peered":"2023-12-24T20:06:04.775854+0000","last_unstale":"2023-12-24T20:06:04.776098+0000","last_undegraded":"2023-12-24T20:06:04.776098+0000","last_fullsized":"2023-12-24T20:06:04.776098+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:12:56.733517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776823+0000","last_change":"2023-12-24T20:06:04.776823+0000","last_active":"2023-12-24T20:06:04.776823+0000","last_peered":"2023-12-24T20:06:04.776823+0000","last_clean":"2023-12-24T20:06:04.776823+0000","last_became_active":"2023-12-24T20:06:04.776202+0000","last_became_peered":"2023-12-24T20:06:04.776202+0000","last_unstale":"2023-12-24T20:06:04.776823+0000","last_undegraded":"2023-12-24T20:06:04.776823+0000","last_fullsized":"2023-12-24T20:06:04.776823+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:05:40.633066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.778221+0000","last_change":"2023-12-24T20:06:04.778221+0000","last_active":"2023-12-24T20:06:04.778221+0000","last_peered":"2023-12-24T20:06:04.778221+0000","last_clean":"2023-12-24T20:06:04.778221+0000","last_became_active":"2023-12-24T20:06:04.777492+0000","last_became_peered":"2023-12-24T20:06:04.777492+0000","last_unstale":"2023-12-24T20:06:04.778221+0000","last_undegraded":"2023-12-24T20:06:04.778221+0000","last_fullsized":"2023-12-24T20:06:04.778221+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:05.983460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"167'4","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.788937+0000","last_change":"2023-12-24T20:06:03.774915+0000","last_active":"2023-12-24T20:06:04.788937+0000","last_peered":"2023-12-24T20:06:04.788937+0000","last_clean":"2023-12-24T20:06:04.788937+0000","last_became_active":"2023-12-24T20:06:03.774550+0000","last_became_peered":"2023-12-24T20:06:03.774550+0000","last_unstale":"2023-12-24T20:06:04.788937+0000","last_undegraded":"2023-12-24T20:06:04.788937+0000","last_fullsized":"2023-12-24T20:06:04.788937+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:56.385401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775137+0000","last_change":"2023-12-24T20:06:04.775137+0000","last_active":"2023-12-24T20:06:04.775137+0000","last_peered":"2023-12-24T20:06:04.775137+0000","last_clean":"2023-12-24T20:06:04.775137+0000","last_became_active":"2023-12-24T20:06:04.774123+0000","last_became_peered":"2023-12-24T20:06:04.774123+0000","last_unstale":"2023-12-24T20:06:04.775137+0000","last_undegraded":"2023-12-24T20:06:04.775137+0000","last_fullsized":"2023-12-24T20:06:04.775137+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:56:20.915108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.769209+0000","last_change":"2023-12-24T20:06:03.771244+0000","last_active":"2023-12-24T20:06:04.769209+0000","last_peered":"2023-12-24T20:06:04.769209+0000","last_clean":"2023-12-24T20:06:04.769209+0000","last_became_active":"2023-12-24T20:06:03.770880+0000","last_became_peered":"2023-12-24T20:06:03.770880+0000","last_unstale":"2023-12-24T20:06:04.769209+0000","last_undegraded":"2023-12-24T20:06:04.769209+0000","last_fullsized":"2023-12-24T20:06:04.769209+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:21.246343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777934+0000","last_change":"2023-12-24T20:06:04.777934+0000","last_active":"2023-12-24T20:06:04.777934+0000","last_peered":"2023-12-24T20:06:04.777934+0000","last_clean":"2023-12-24T20:06:04.777934+0000","last_became_active":"2023-12-24T20:06:04.777162+0000","last_became_peered":"2023-12-24T20:06:04.777162+0000","last_unstale":"2023-12-24T20:06:04.777934+0000","last_undegraded":"2023-12-24T20:06:04.777934+0000","last_fullsized":"2023-12-24T20:06:04.777934+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:42.721234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.788034+0000","last_change":"2023-12-24T20:06:03.764490+0000","last_active":"2023-12-24T20:06:04.788034+0000","last_peered":"2023-12-24T20:06:04.788034+0000","last_clean":"2023-12-24T20:06:04.788034+0000","last_became_active":"2023-12-24T20:06:03.764245+0000","last_became_peered":"2023-12-24T20:06:03.764245+0000","last_unstale":"2023-12-24T20:06:04.788034+0000","last_undegraded":"2023-12-24T20:06:04.788034+0000","last_fullsized":"2023-12-24T20:06:04.788034+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:09.686324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.779797+0000","last_change":"2023-12-24T20:06:04.779797+0000","last_active":"2023-12-24T20:06:04.779797+0000","last_peered":"2023-12-24T20:06:04.779797+0000","last_clean":"2023-12-24T20:06:04.779797+0000","last_became_active":"2023-12-24T20:06:04.778850+0000","last_became_peered":"2023-12-24T20:06:04.778850+0000","last_unstale":"2023-12-24T20:06:04.779797+0000","last_undegraded":"2023-12-24T20:06:04.779797+0000","last_fullsized":"2023-12-24T20:06:04.779797+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:56:20.915108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.787568+0000","last_change":"2023-12-24T20:06:03.768790+0000","last_active":"2023-12-24T20:06:04.787568+0000","last_peered":"2023-12-24T20:06:04.787568+0000","last_clean":"2023-12-24T20:06:04.787568+0000","last_became_active":"2023-12-24T20:06:03.768061+0000","last_became_peered":"2023-12-24T20:06:03.768061+0000","last_unstale":"2023-12-24T20:06:04.787568+0000","last_undegraded":"2023-12-24T20:06:04.787568+0000","last_fullsized":"2023-12-24T20:06:04.787568+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:09:23.541886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775321+0000","last_change":"2023-12-24T20:06:04.775321+0000","last_active":"2023-12-24T20:06:04.775321+0000","last_peered":"2023-12-24T20:06:04.775321+0000","last_clean":"2023-12-24T20:06:04.775321+0000","last_became_active":"2023-12-24T20:06:04.774898+0000","last_became_peered":"2023-12-24T20:06:04.774898+0000","last_unstale":"2023-12-24T20:06:04.775321+0000","last_undegraded":"2023-12-24T20:06:04.775321+0000","last_fullsized":"2023-12-24T20:06:04.775321+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:48.634929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772134+0000","last_change":"2023-12-24T20:06:03.775762+0000","last_active":"2023-12-24T20:06:04.772134+0000","last_peered":"2023-12-24T20:06:04.772134+0000","last_clean":"2023-12-24T20:06:04.772134+0000","last_became_active":"2023-12-24T20:06:03.775064+0000","last_became_peered":"2023-12-24T20:06:03.775064+0000","last_unstale":"2023-12-24T20:06:04.772134+0000","last_undegraded":"2023-12-24T20:06:04.772134+0000","last_fullsized":"2023-12-24T20:06:04.772134+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:46:40.923067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.781814+0000","last_change":"2023-12-24T20:06:04.781814+0000","last_active":"2023-12-24T20:06:04.781814+0000","last_peered":"2023-12-24T20:06:04.781814+0000","last_clean":"2023-12-24T20:06:04.781814+0000","last_became_active":"2023-12-24T20:06:04.780582+0000","last_became_peered":"2023-12-24T20:06:04.780582+0000","last_unstale":"2023-12-24T20:06:04.781814+0000","last_undegraded":"2023-12-24T20:06:04.781814+0000","last_fullsized":"2023-12-24T20:06:04.781814+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:28.956306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.765981+0000","last_change":"2023-12-24T20:06:03.771825+0000","last_active":"2023-12-24T20:06:04.765981+0000","last_peered":"2023-12-24T20:06:04.765981+0000","last_clean":"2023-12-24T20:06:04.765981+0000","last_became_active":"2023-12-24T20:06:03.771584+0000","last_became_peered":"2023-12-24T20:06:03.771584+0000","last_unstale":"2023-12-24T20:06:04.765981+0000","last_undegraded":"2023-12-24T20:06:04.765981+0000","last_fullsized":"2023-12-24T20:06:04.765981+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:54.413899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.773226+0000","last_change":"2023-12-24T20:06:04.773226+0000","last_active":"2023-12-24T20:06:04.773226+0000","last_peered":"2023-12-24T20:06:04.773226+0000","last_clean":"2023-12-24T20:06:04.773226+0000","last_became_active":"2023-12-24T20:06:04.772962+0000","last_became_peered":"2023-12-24T20:06:04.772962+0000","last_unstale":"2023-12-24T20:06:04.773226+0000","last_undegraded":"2023-12-24T20:06:04.773226+0000","last_fullsized":"2023-12-24T20:06:04.773226+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:11:06.009265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.771867+0000","last_change":"2023-12-24T20:06:03.771798+0000","last_active":"2023-12-24T20:06:03.771867+0000","last_peered":"2023-12-24T20:06:03.771867+0000","last_clean":"2023-12-24T20:06:03.771867+0000","last_became_active":"2023-12-24T20:06:03.771359+0000","last_became_peered":"2023-12-24T20:06:03.771359+0000","last_unstale":"2023-12-24T20:06:03.771867+0000","last_undegraded":"2023-12-24T20:06:03.771867+0000","last_fullsized":"2023-12-24T20:06:03.771867+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:27.527241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772402+0000","last_change":"2023-12-24T20:06:04.772402+0000","last_active":"2023-12-24T20:06:04.772402+0000","last_peered":"2023-12-24T20:06:04.772402+0000","last_clean":"2023-12-24T20:06:04.772402+0000","last_became_active":"2023-12-24T20:06:04.772178+0000","last_became_peered":"2023-12-24T20:06:04.772178+0000","last_unstale":"2023-12-24T20:06:04.772402+0000","last_undegraded":"2023-12-24T20:06:04.772402+0000","last_fullsized":"2023-12-24T20:06:04.772402+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:56:22.067809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.770950+0000","last_change":"2023-12-24T20:06:03.770832+0000","last_active":"2023-12-24T20:06:03.770950+0000","last_peered":"2023-12-24T20:06:03.770950+0000","last_clean":"2023-12-24T20:06:03.770950+0000","last_became_active":"2023-12-24T20:06:03.770604+0000","last_became_peered":"2023-12-24T20:06:03.770604+0000","last_unstale":"2023-12-24T20:06:03.770950+0000","last_undegraded":"2023-12-24T20:06:03.770950+0000","last_fullsized":"2023-12-24T20:06:03.770950+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:56.385401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775510+0000","last_change":"2023-12-24T20:06:04.775510+0000","last_active":"2023-12-24T20:06:04.775510+0000","last_peered":"2023-12-24T20:06:04.775510+0000","last_clean":"2023-12-24T20:06:04.775510+0000","last_became_active":"2023-12-24T20:06:04.775275+0000","last_became_peered":"2023-12-24T20:06:04.775275+0000","last_unstale":"2023-12-24T20:06:04.775510+0000","last_undegraded":"2023-12-24T20:06:04.775510+0000","last_fullsized":"2023-12-24T20:06:04.775510+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:42.721234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.765572+0000","last_change":"2023-12-24T20:06:03.765283+0000","last_active":"2023-12-24T20:06:03.765572+0000","last_peered":"2023-12-24T20:06:03.765572+0000","last_clean":"2023-12-24T20:06:03.765572+0000","last_became_active":"2023-12-24T20:06:03.765041+0000","last_became_peered":"2023-12-24T20:06:03.765041+0000","last_unstale":"2023-12-24T20:06:03.765572+0000","last_undegraded":"2023-12-24T20:06:03.765572+0000","last_fullsized":"2023-12-24T20:06:03.765572+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:17:36.914572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775362+0000","last_change":"2023-12-24T20:06:04.775362+0000","last_active":"2023-12-24T20:06:04.775362+0000","last_peered":"2023-12-24T20:06:04.775362+0000","last_clean":"2023-12-24T20:06:04.775362+0000","last_became_active":"2023-12-24T20:06:04.775105+0000","last_became_peered":"2023-12-24T20:06:04.775105+0000","last_unstale":"2023-12-24T20:06:04.775362+0000","last_undegraded":"2023-12-24T20:06:04.775362+0000","last_fullsized":"2023-12-24T20:06:04.775362+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:17:37.919892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.774280+0000","last_change":"2023-12-24T20:06:03.774222+0000","last_active":"2023-12-24T20:06:03.774280+0000","last_peered":"2023-12-24T20:06:03.774280+0000","last_clean":"2023-12-24T20:06:03.774280+0000","last_became_active":"2023-12-24T20:06:03.773986+0000","last_became_peered":"2023-12-24T20:06:03.773986+0000","last_unstale":"2023-12-24T20:06:03.774280+0000","last_undegraded":"2023-12-24T20:06:03.774280+0000","last_fullsized":"2023-12-24T20:06:03.774280+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:09:23.541886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.778549+0000","last_change":"2023-12-24T20:06:04.778549+0000","last_active":"2023-12-24T20:06:04.778549+0000","last_peered":"2023-12-24T20:06:04.778549+0000","last_clean":"2023-12-24T20:06:04.778549+0000","last_became_active":"2023-12-24T20:06:04.778169+0000","last_became_peered":"2023-12-24T20:06:04.778169+0000","last_unstale":"2023-12-24T20:06:04.778549+0000","last_undegraded":"2023-12-24T20:06:04.778549+0000","last_fullsized":"2023-12-24T20:06:04.778549+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:50.512926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"167'6","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.791288+0000","last_change":"2023-12-24T20:06:03.770742+0000","last_active":"2023-12-24T20:06:04.791288+0000","last_peered":"2023-12-24T20:06:04.791288+0000","last_clean":"2023-12-24T20:06:04.791288+0000","last_became_active":"2023-12-24T20:06:03.770503+0000","last_became_peered":"2023-12-24T20:06:03.770503+0000","last_unstale":"2023-12-24T20:06:04.791288+0000","last_undegraded":"2023-12-24T20:06:04.791288+0000","last_fullsized":"2023-12-24T20:06:04.791288+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:12:55.728197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.781514+0000","last_change":"2023-12-24T20:06:04.781514+0000","last_active":"2023-12-24T20:06:04.781514+0000","last_peered":"2023-12-24T20:06:04.781514+0000","last_clean":"2023-12-24T20:06:04.781514+0000","last_became_active":"2023-12-24T20:06:04.781258+0000","last_became_peered":"2023-12-24T20:06:04.781258+0000","last_unstale":"2023-12-24T20:06:04.781514+0000","last_undegraded":"2023-12-24T20:06:04.781514+0000","last_fullsized":"2023-12-24T20:06:04.781514+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:43:59.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.790583+0000","last_change":"2023-12-24T20:06:03.775501+0000","last_active":"2023-12-24T20:06:04.790583+0000","last_peered":"2023-12-24T20:06:04.790583+0000","last_clean":"2023-12-24T20:06:04.790583+0000","last_became_active":"2023-12-24T20:06:03.775278+0000","last_became_peered":"2023-12-24T20:06:03.775278+0000","last_unstale":"2023-12-24T20:06:04.790583+0000","last_undegraded":"2023-12-24T20:06:04.790583+0000","last_fullsized":"2023-12-24T20:06:04.790583+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:51:09.386508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772593+0000","last_change":"2023-12-24T20:06:04.772593+0000","last_active":"2023-12-24T20:06:04.772593+0000","last_peered":"2023-12-24T20:06:04.772593+0000","last_clean":"2023-12-24T20:06:04.772593+0000","last_became_active":"2023-12-24T20:06:04.772374+0000","last_became_peered":"2023-12-24T20:06:04.772374+0000","last_unstale":"2023-12-24T20:06:04.772593+0000","last_undegraded":"2023-12-24T20:06:04.772593+0000","last_fullsized":"2023-12-24T20:06:04.772593+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:45.217479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.773120+0000","last_change":"2023-12-24T20:06:03.771334+0000","last_active":"2023-12-24T20:06:03.773120+0000","last_peered":"2023-12-24T20:06:03.773120+0000","last_clean":"2023-12-24T20:06:03.773120+0000","last_became_active":"2023-12-24T20:06:03.771035+0000","last_became_peered":"2023-12-24T20:06:03.771035+0000","last_unstale":"2023-12-24T20:06:03.773120+0000","last_undegraded":"2023-12-24T20:06:03.773120+0000","last_fullsized":"2023-12-24T20:06:03.773120+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:57:52.129814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775097+0000","last_change":"2023-12-24T20:06:04.775097+0000","last_active":"2023-12-24T20:06:04.775097+0000","last_peered":"2023-12-24T20:06:04.775097+0000","last_clean":"2023-12-24T20:06:04.775097+0000","last_became_active":"2023-12-24T20:06:04.774577+0000","last_became_peered":"2023-12-24T20:06:04.774577+0000","last_unstale":"2023-12-24T20:06:04.775097+0000","last_undegraded":"2023-12-24T20:06:04.775097+0000","last_fullsized":"2023-12-24T20:06:04.775097+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:52:52.983186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.766244+0000","last_change":"2023-12-24T20:06:03.765891+0000","last_active":"2023-12-24T20:06:03.766244+0000","last_peered":"2023-12-24T20:06:03.766244+0000","last_clean":"2023-12-24T20:06:03.766244+0000","last_became_active":"2023-12-24T20:06:03.765651+0000","last_became_peered":"2023-12-24T20:06:03.765651+0000","last_unstale":"2023-12-24T20:06:03.766244+0000","last_undegraded":"2023-12-24T20:06:03.766244+0000","last_fullsized":"2023-12-24T20:06:03.766244+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:35:21.266143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777230+0000","last_change":"2023-12-24T20:06:04.777230+0000","last_active":"2023-12-24T20:06:04.777230+0000","last_peered":"2023-12-24T20:06:04.777230+0000","last_clean":"2023-12-24T20:06:04.777230+0000","last_became_active":"2023-12-24T20:06:04.776827+0000","last_became_peered":"2023-12-24T20:06:04.776827+0000","last_unstale":"2023-12-24T20:06:04.777230+0000","last_undegraded":"2023-12-24T20:06:04.777230+0000","last_fullsized":"2023-12-24T20:06:04.777230+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:17:37.919892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"167'8","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.792111+0000","last_change":"2023-12-24T20:06:03.774156+0000","last_active":"2023-12-24T20:06:04.792111+0000","last_peered":"2023-12-24T20:06:04.792111+0000","last_clean":"2023-12-24T20:06:04.792111+0000","last_became_active":"2023-12-24T20:06:03.773901+0000","last_became_peered":"2023-12-24T20:06:03.773901+0000","last_unstale":"2023-12-24T20:06:04.792111+0000","last_undegraded":"2023-12-24T20:06:04.792111+0000","last_fullsized":"2023-12-24T20:06:04.792111+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:31.728625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780117+0000","last_change":"2023-12-24T20:06:04.780117+0000","last_active":"2023-12-24T20:06:04.780117+0000","last_peered":"2023-12-24T20:06:04.780117+0000","last_clean":"2023-12-24T20:06:04.780117+0000","last_became_active":"2023-12-24T20:06:04.779409+0000","last_became_peered":"2023-12-24T20:06:04.779409+0000","last_unstale":"2023-12-24T20:06:04.780117+0000","last_undegraded":"2023-12-24T20:06:04.780117+0000","last_fullsized":"2023-12-24T20:06:04.780117+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:17.563280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.765189+0000","last_change":"2023-12-24T20:06:03.774094+0000","last_active":"2023-12-24T20:06:04.765189+0000","last_peered":"2023-12-24T20:06:04.765189+0000","last_clean":"2023-12-24T20:06:04.765189+0000","last_became_active":"2023-12-24T20:06:03.773854+0000","last_became_peered":"2023-12-24T20:06:03.773854+0000","last_unstale":"2023-12-24T20:06:04.765189+0000","last_undegraded":"2023-12-24T20:06:04.765189+0000","last_fullsized":"2023-12-24T20:06:04.765189+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:13:15.931368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775274+0000","last_change":"2023-12-24T20:06:04.775274+0000","last_active":"2023-12-24T20:06:04.775274+0000","last_peered":"2023-12-24T20:06:04.775274+0000","last_clean":"2023-12-24T20:06:04.775274+0000","last_became_active":"2023-12-24T20:06:04.774999+0000","last_became_peered":"2023-12-24T20:06:04.774999+0000","last_unstale":"2023-12-24T20:06:04.775274+0000","last_undegraded":"2023-12-24T20:06:04.775274+0000","last_fullsized":"2023-12-24T20:06:04.775274+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:42:44.204616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.789312+0000","last_change":"2023-12-24T20:06:03.774286+0000","last_active":"2023-12-24T20:06:04.789312+0000","last_peered":"2023-12-24T20:06:04.789312+0000","last_clean":"2023-12-24T20:06:04.789312+0000","last_became_active":"2023-12-24T20:06:03.774059+0000","last_became_peered":"2023-12-24T20:06:03.774059+0000","last_unstale":"2023-12-24T20:06:04.789312+0000","last_undegraded":"2023-12-24T20:06:04.789312+0000","last_fullsized":"2023-12-24T20:06:04.789312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:27.950986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.782590+0000","last_change":"2023-12-24T20:06:04.782590+0000","last_active":"2023-12-24T20:06:04.782590+0000","last_peered":"2023-12-24T20:06:04.782590+0000","last_clean":"2023-12-24T20:06:04.782590+0000","last_became_active":"2023-12-24T20:06:04.781705+0000","last_became_peered":"2023-12-24T20:06:04.781705+0000","last_unstale":"2023-12-24T20:06:04.782590+0000","last_undegraded":"2023-12-24T20:06:04.782590+0000","last_fullsized":"2023-12-24T20:06:04.782590+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:49:41.482585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772082+0000","last_change":"2023-12-24T20:06:03.772721+0000","last_active":"2023-12-24T20:06:04.772082+0000","last_peered":"2023-12-24T20:06:04.772082+0000","last_clean":"2023-12-24T20:06:04.772082+0000","last_became_active":"2023-12-24T20:06:03.772169+0000","last_became_peered":"2023-12-24T20:06:03.772169+0000","last_unstale":"2023-12-24T20:06:04.772082+0000","last_undegraded":"2023-12-24T20:06:04.772082+0000","last_fullsized":"2023-12-24T20:06:04.772082+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:16.312598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777458+0000","last_change":"2023-12-24T20:06:04.777458+0000","last_active":"2023-12-24T20:06:04.777458+0000","last_peered":"2023-12-24T20:06:04.777458+0000","last_clean":"2023-12-24T20:06:04.777458+0000","last_became_active":"2023-12-24T20:06:04.775823+0000","last_became_peered":"2023-12-24T20:06:04.775823+0000","last_unstale":"2023-12-24T20:06:04.777458+0000","last_undegraded":"2023-12-24T20:06:04.777458+0000","last_fullsized":"2023-12-24T20:06:04.777458+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:26:48.087191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.773399+0000","last_change":"2023-12-24T20:06:03.773326+0000","last_active":"2023-12-24T20:06:03.773399+0000","last_peered":"2023-12-24T20:06:03.773399+0000","last_clean":"2023-12-24T20:06:03.773399+0000","last_became_active":"2023-12-24T20:06:03.773090+0000","last_became_peered":"2023-12-24T20:06:03.773090+0000","last_unstale":"2023-12-24T20:06:03.773399+0000","last_undegraded":"2023-12-24T20:06:03.773399+0000","last_fullsized":"2023-12-24T20:06:03.773399+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:34.520993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777265+0000","last_change":"2023-12-24T20:06:04.777265+0000","last_active":"2023-12-24T20:06:04.777265+0000","last_peered":"2023-12-24T20:06:04.777265+0000","last_clean":"2023-12-24T20:06:04.777265+0000","last_became_active":"2023-12-24T20:06:04.776790+0000","last_became_peered":"2023-12-24T20:06:04.776790+0000","last_unstale":"2023-12-24T20:06:04.777265+0000","last_undegraded":"2023-12-24T20:06:04.777265+0000","last_fullsized":"2023-12-24T20:06:04.777265+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:17:37.919892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.789104+0000","last_change":"2023-12-24T20:06:03.775367+0000","last_active":"2023-12-24T20:06:04.789104+0000","last_peered":"2023-12-24T20:06:04.789104+0000","last_clean":"2023-12-24T20:06:04.789104+0000","last_became_active":"2023-12-24T20:06:03.775127+0000","last_became_peered":"2023-12-24T20:06:03.775127+0000","last_unstale":"2023-12-24T20:06:04.789104+0000","last_undegraded":"2023-12-24T20:06:04.789104+0000","last_fullsized":"2023-12-24T20:06:04.789104+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:10:57.083499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780053+0000","last_change":"2023-12-24T20:06:04.780053+0000","last_active":"2023-12-24T20:06:04.780053+0000","last_peered":"2023-12-24T20:06:04.780053+0000","last_clean":"2023-12-24T20:06:04.780053+0000","last_became_active":"2023-12-24T20:06:04.779749+0000","last_became_peered":"2023-12-24T20:06:04.779749+0000","last_unstale":"2023-12-24T20:06:04.780053+0000","last_undegraded":"2023-12-24T20:06:04.780053+0000","last_fullsized":"2023-12-24T20:06:04.780053+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:19:48.503550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.775007+0000","last_change":"2023-12-24T20:06:03.774485+0000","last_active":"2023-12-24T20:06:03.775007+0000","last_peered":"2023-12-24T20:06:03.775007+0000","last_clean":"2023-12-24T20:06:03.775007+0000","last_became_active":"2023-12-24T20:06:03.773871+0000","last_became_peered":"2023-12-24T20:06:03.773871+0000","last_unstale":"2023-12-24T20:06:03.775007+0000","last_undegraded":"2023-12-24T20:06:03.775007+0000","last_fullsized":"2023-12-24T20:06:03.775007+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:09.686324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780998+0000","last_change":"2023-12-24T20:06:04.780998+0000","last_active":"2023-12-24T20:06:04.780998+0000","last_peered":"2023-12-24T20:06:04.780998+0000","last_clean":"2023-12-24T20:06:04.780998+0000","last_became_active":"2023-12-24T20:06:04.780780+0000","last_became_peered":"2023-12-24T20:06:04.780780+0000","last_unstale":"2023-12-24T20:06:04.780998+0000","last_undegraded":"2023-12-24T20:06:04.780998+0000","last_fullsized":"2023-12-24T20:06:04.780998+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:22.251663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.775026+0000","last_change":"2023-12-24T20:06:03.774949+0000","last_active":"2023-12-24T20:06:03.775026+0000","last_peered":"2023-12-24T20:06:03.775026+0000","last_clean":"2023-12-24T20:06:03.775026+0000","last_became_active":"2023-12-24T20:06:03.774726+0000","last_became_peered":"2023-12-24T20:06:03.774726+0000","last_unstale":"2023-12-24T20:06:03.775026+0000","last_undegraded":"2023-12-24T20:06:03.775026+0000","last_fullsized":"2023-12-24T20:06:03.775026+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:27:46.563951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.779416+0000","last_change":"2023-12-24T20:06:04.779416+0000","last_active":"2023-12-24T20:06:04.779416+0000","last_peered":"2023-12-24T20:06:04.779416+0000","last_clean":"2023-12-24T20:06:04.779416+0000","last_became_active":"2023-12-24T20:06:04.779172+0000","last_became_peered":"2023-12-24T20:06:04.779172+0000","last_unstale":"2023-12-24T20:06:04.779416+0000","last_undegraded":"2023-12-24T20:06:04.779416+0000","last_fullsized":"2023-12-24T20:06:04.779416+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:50:18.741848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.773176+0000","last_change":"2023-12-24T20:06:03.771901+0000","last_active":"2023-12-24T20:06:03.773176+0000","last_peered":"2023-12-24T20:06:03.773176+0000","last_clean":"2023-12-24T20:06:03.773176+0000","last_became_active":"2023-12-24T20:06:03.771640+0000","last_became_peered":"2023-12-24T20:06:03.771640+0000","last_unstale":"2023-12-24T20:06:03.773176+0000","last_undegraded":"2023-12-24T20:06:03.773176+0000","last_fullsized":"2023-12-24T20:06:03.773176+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:56.385401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774959+0000","last_change":"2023-12-24T20:06:04.774959+0000","last_active":"2023-12-24T20:06:04.774959+0000","last_peered":"2023-12-24T20:06:04.774959+0000","last_clean":"2023-12-24T20:06:04.774959+0000","last_became_active":"2023-12-24T20:06:04.774252+0000","last_became_peered":"2023-12-24T20:06:04.774252+0000","last_unstale":"2023-12-24T20:06:04.774959+0000","last_undegraded":"2023-12-24T20:06:04.774959+0000","last_fullsized":"2023-12-24T20:06:04.774959+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:28.754953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.788712+0000","last_change":"2023-12-24T20:06:03.775911+0000","last_active":"2023-12-24T20:06:04.788712+0000","last_peered":"2023-12-24T20:06:04.788712+0000","last_clean":"2023-12-24T20:06:04.788712+0000","last_became_active":"2023-12-24T20:06:03.775256+0000","last_became_peered":"2023-12-24T20:06:03.775256+0000","last_unstale":"2023-12-24T20:06:04.788712+0000","last_undegraded":"2023-12-24T20:06:04.788712+0000","last_fullsized":"2023-12-24T20:06:04.788712+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:05:54.829653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.782781+0000","last_change":"2023-12-24T20:06:04.782781+0000","last_active":"2023-12-24T20:06:04.782781+0000","last_peered":"2023-12-24T20:06:04.782781+0000","last_clean":"2023-12-24T20:06:04.782781+0000","last_became_active":"2023-12-24T20:06:04.782280+0000","last_became_peered":"2023-12-24T20:06:04.782280+0000","last_unstale":"2023-12-24T20:06:04.782781+0000","last_undegraded":"2023-12-24T20:06:04.782781+0000","last_fullsized":"2023-12-24T20:06:04.782781+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:30:48.692125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.771278+0000","last_change":"2023-12-24T20:06:03.771202+0000","last_active":"2023-12-24T20:06:03.771278+0000","last_peered":"2023-12-24T20:06:03.771278+0000","last_clean":"2023-12-24T20:06:03.771278+0000","last_became_active":"2023-12-24T20:06:03.770921+0000","last_became_peered":"2023-12-24T20:06:03.770921+0000","last_unstale":"2023-12-24T20:06:03.771278+0000","last_undegraded":"2023-12-24T20:06:03.771278+0000","last_fullsized":"2023-12-24T20:06:03.771278+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:58:49.749013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.781798+0000","last_change":"2023-12-24T20:06:04.781798+0000","last_active":"2023-12-24T20:06:04.781798+0000","last_peered":"2023-12-24T20:06:04.781798+0000","last_clean":"2023-12-24T20:06:04.781798+0000","last_became_active":"2023-12-24T20:06:04.781557+0000","last_became_peered":"2023-12-24T20:06:04.781557+0000","last_unstale":"2023-12-24T20:06:04.781798+0000","last_undegraded":"2023-12-24T20:06:04.781798+0000","last_fullsized":"2023-12-24T20:06:04.781798+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:05.983460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.772861+0000","last_change":"2023-12-24T20:06:03.772635+0000","last_active":"2023-12-24T20:06:03.772861+0000","last_peered":"2023-12-24T20:06:03.772861+0000","last_clean":"2023-12-24T20:06:03.772861+0000","last_became_active":"2023-12-24T20:06:03.771941+0000","last_became_peered":"2023-12-24T20:06:03.771941+0000","last_unstale":"2023-12-24T20:06:03.772861+0000","last_undegraded":"2023-12-24T20:06:03.772861+0000","last_fullsized":"2023-12-24T20:06:03.772861+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:54.413899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780448+0000","last_change":"2023-12-24T20:06:04.780448+0000","last_active":"2023-12-24T20:06:04.780448+0000","last_peered":"2023-12-24T20:06:04.780448+0000","last_clean":"2023-12-24T20:06:04.780448+0000","last_became_active":"2023-12-24T20:06:04.780206+0000","last_became_peered":"2023-12-24T20:06:04.780206+0000","last_unstale":"2023-12-24T20:06:04.780448+0000","last_undegraded":"2023-12-24T20:06:04.780448+0000","last_fullsized":"2023-12-24T20:06:04.780448+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:36:54.731492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.773407+0000","last_change":"2023-12-24T20:06:03.773250+0000","last_active":"2023-12-24T20:06:03.773407+0000","last_peered":"2023-12-24T20:06:03.773407+0000","last_clean":"2023-12-24T20:06:03.773407+0000","last_became_active":"2023-12-24T20:06:03.772991+0000","last_became_peered":"2023-12-24T20:06:03.772991+0000","last_unstale":"2023-12-24T20:06:03.773407+0000","last_undegraded":"2023-12-24T20:06:03.773407+0000","last_fullsized":"2023-12-24T20:06:03.773407+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:34.162171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776519+0000","last_change":"2023-12-24T20:06:04.776519+0000","last_active":"2023-12-24T20:06:04.776519+0000","last_peered":"2023-12-24T20:06:04.776519+0000","last_clean":"2023-12-24T20:06:04.776519+0000","last_became_active":"2023-12-24T20:06:04.775767+0000","last_became_peered":"2023-12-24T20:06:04.775767+0000","last_unstale":"2023-12-24T20:06:04.776519+0000","last_undegraded":"2023-12-24T20:06:04.776519+0000","last_fullsized":"2023-12-24T20:06:04.776519+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:47:43.878475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.765314+0000","last_change":"2023-12-24T20:06:03.765230+0000","last_active":"2023-12-24T20:06:03.765314+0000","last_peered":"2023-12-24T20:06:03.765314+0000","last_clean":"2023-12-24T20:06:03.765314+0000","last_became_active":"2023-12-24T20:06:03.764980+0000","last_became_peered":"2023-12-24T20:06:03.764980+0000","last_unstale":"2023-12-24T20:06:03.765314+0000","last_undegraded":"2023-12-24T20:06:03.765314+0000","last_fullsized":"2023-12-24T20:06:03.765314+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:47.629609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774393+0000","last_change":"2023-12-24T20:06:04.774393+0000","last_active":"2023-12-24T20:06:04.774393+0000","last_peered":"2023-12-24T20:06:04.774393+0000","last_clean":"2023-12-24T20:06:04.774393+0000","last_became_active":"2023-12-24T20:06:04.774158+0000","last_became_peered":"2023-12-24T20:06:04.774158+0000","last_unstale":"2023-12-24T20:06:04.774393+0000","last_undegraded":"2023-12-24T20:06:04.774393+0000","last_fullsized":"2023-12-24T20:06:04.774393+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:35.608952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.776125+0000","last_change":"2023-12-24T20:06:03.776061+0000","last_active":"2023-12-24T20:06:03.776125+0000","last_peered":"2023-12-24T20:06:03.776125+0000","last_clean":"2023-12-24T20:06:03.776125+0000","last_became_active":"2023-12-24T20:06:03.775607+0000","last_became_peered":"2023-12-24T20:06:03.775607+0000","last_unstale":"2023-12-24T20:06:03.776125+0000","last_undegraded":"2023-12-24T20:06:03.776125+0000","last_fullsized":"2023-12-24T20:06:03.776125+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:20:36.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.778392+0000","last_change":"2023-12-24T20:06:04.778392+0000","last_active":"2023-12-24T20:06:04.778392+0000","last_peered":"2023-12-24T20:06:04.778392+0000","last_clean":"2023-12-24T20:06:04.778392+0000","last_became_active":"2023-12-24T20:06:04.778011+0000","last_became_peered":"2023-12-24T20:06:04.778011+0000","last_unstale":"2023-12-24T20:06:04.778392+0000","last_undegraded":"2023-12-24T20:06:04.778392+0000","last_fullsized":"2023-12-24T20:06:04.778392+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:58.121829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.773207+0000","last_change":"2023-12-24T20:06:03.772919+0000","last_active":"2023-12-24T20:06:03.773207+0000","last_peered":"2023-12-24T20:06:03.773207+0000","last_clean":"2023-12-24T20:06:03.773207+0000","last_became_active":"2023-12-24T20:06:03.771489+0000","last_became_peered":"2023-12-24T20:06:03.771489+0000","last_unstale":"2023-12-24T20:06:03.773207+0000","last_undegraded":"2023-12-24T20:06:03.773207+0000","last_fullsized":"2023-12-24T20:06:03.773207+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:58:51.170260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777930+0000","last_change":"2023-12-24T20:06:04.777930+0000","last_active":"2023-12-24T20:06:04.777930+0000","last_peered":"2023-12-24T20:06:04.777930+0000","last_clean":"2023-12-24T20:06:04.777930+0000","last_became_active":"2023-12-24T20:06:04.775370+0000","last_became_peered":"2023-12-24T20:06:04.775370+0000","last_unstale":"2023-12-24T20:06:04.777930+0000","last_undegraded":"2023-12-24T20:06:04.777930+0000","last_fullsized":"2023-12-24T20:06:04.777930+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:40:35.912407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.771170+0000","last_change":"2023-12-24T20:06:03.771104+0000","last_active":"2023-12-24T20:06:03.771170+0000","last_peered":"2023-12-24T20:06:03.771170+0000","last_clean":"2023-12-24T20:06:03.771170+0000","last_became_active":"2023-12-24T20:06:03.770555+0000","last_became_peered":"2023-12-24T20:06:03.770555+0000","last_unstale":"2023-12-24T20:06:03.771170+0000","last_undegraded":"2023-12-24T20:06:03.771170+0000","last_fullsized":"2023-12-24T20:06:03.771170+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:38:37.330332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780548+0000","last_change":"2023-12-24T20:06:04.780548+0000","last_active":"2023-12-24T20:06:04.780548+0000","last_peered":"2023-12-24T20:06:04.780548+0000","last_clean":"2023-12-24T20:06:04.780548+0000","last_became_active":"2023-12-24T20:06:04.780273+0000","last_became_peered":"2023-12-24T20:06:04.780273+0000","last_unstale":"2023-12-24T20:06:04.780548+0000","last_undegraded":"2023-12-24T20:06:04.780548+0000","last_fullsized":"2023-12-24T20:06:04.780548+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:09.569359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"167'3","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.789952+0000","last_change":"2023-12-24T20:06:03.773177+0000","last_active":"2023-12-24T20:06:04.789952+0000","last_peered":"2023-12-24T20:06:04.789952+0000","last_clean":"2023-12-24T20:06:04.789952+0000","last_became_active":"2023-12-24T20:06:03.772271+0000","last_became_peered":"2023-12-24T20:06:03.772271+0000","last_unstale":"2023-12-24T20:06:04.789952+0000","last_undegraded":"2023-12-24T20:06:04.789952+0000","last_fullsized":"2023-12-24T20:06:04.789952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:09.686324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":289,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.769094+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:06:03.769094+0000","last_peered":"2023-12-24T20:06:03.769094+0000","last_clean":"2023-12-24T20:06:03.769094+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:06:03.769094+0000","last_undegraded":"2023-12-24T20:06:03.769094+0000","last_fullsized":"2023-12-24T20:06:03.769094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1487,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193825,"statfs":{"total":200000000,"available":198477012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.47699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.81200000000000006,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.754},"last":0.755}]},{"osd":1,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78900000000000003,"5min":0.872,"15min":0.872},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56599999999999995,"15min":0.54700000000000004},"min":{"1min":0.46700000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.72099999999999997}]},{"osd":2,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58399999999999996,"15min":0.55100000000000005},"min":{"1min":0.432,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":0.76700000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.437,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.73799999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.47599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.751,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47499999999999998,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.82799999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.499,"15min":0.56200000000000006},"min":{"1min":0.316,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":0.95699999999999996},"last":0.45400000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71499999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51800000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55300000000000005,"15min":0.58299999999999996},"min":{"1min":0.39600000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68700000000000006,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.61399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75600000000000001,"5min":0.82599999999999996,"15min":0.873},"last":0.54000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":910,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194402,"statfs":{"total":200000000,"available":199067788,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.84899999999999998,"15min":1.0309999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77700000000000002,"5min":0.79400000000000004,"15min":0.82499999999999996},"last":0.44600000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.47399999999999998,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":0.80900000000000005,"15min":0.95799999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.32700000000000001,"15min":0.30499999999999999},"max":{"1min":0.72099999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.5}]},{"osd":2,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.53600000000000003},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.33200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":1.0640000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.45300000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"max":{"1min":0.72599999999999998,"5min":0.83399999999999996,"15min":1.077},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.58699999999999997},"min":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.372},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.048},"last":0.623}]},{"osd":4,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65400000000000003,"5min":0.72499999999999998,"15min":0.78600000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.36899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69899999999999995,"5min":0.76800000000000002,"15min":0.82899999999999996},"last":0.67900000000000005}]},{"osd":5,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.86499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50900000000000001,"15min":0.503},"min":{"1min":0.35899999999999999,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.64100000000000001,"5min":0.72699999999999998,"15min":0.84699999999999998},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64500000000000002,"5min":0.79900000000000004,"15min":0.83999999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.46200000000000002,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":0.75600000000000001,"5min":0.82499999999999996,"15min":0.88500000000000001},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074697,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.28000000000000003,"5min":0.187,"15min":0.187},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.316},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.39600000000000002,"15min":0.372},"min":{"1min":0.28899999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.39900000000000002,"15min":0.377},"min":{"1min":0.309,"5min":0.216,"15min":0.216},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.374},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.371},"min":{"1min":0.28999999999999998,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.28899999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.41699999999999998},"min":{"1min":0.34000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41899999999999998,"15min":0.40300000000000002},"min":{"1min":0.33700000000000002,"5min":0.28899999999999998,"15min":0.25},"max":{"1min":0.59799999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.60199999999999998},"min":{"1min":0.47899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.871,"15min":0.871},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.58799999999999997},"min":{"1min":0.50700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93300000000000005,"5min":1.014,"15min":1.014},"last":0.51900000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.49399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98799999999999999,"5min":1.04,"15min":1.04},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63500000000000001,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61599999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.65600000000000003,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96999999999999997,"5min":1.012,"15min":1.012},"last":0.626},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67000000000000004,"15min":0.63},"min":{"1min":0.48199999999999998,"5min":0.41999999999999998,"15min":0.39500000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.65400000000000003},"min":{"1min":0.53000000000000003,"5min":0.47599999999999998,"15min":0.46300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1486,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193825,"statfs":{"total":200000000,"available":198477566,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35399999999999998,"15min":0.40600000000000003},"min":{"1min":0.26500000000000001,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.28100000000000003,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.97999999999999998},"last":0.29999999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.48599999999999999,"5min":0.59799999999999998,"15min":0.92700000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40200000000000002},"min":{"1min":0.30599999999999999,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.93999999999999995},"last":0.34000000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42499999999999999,"15min":0.45300000000000001},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63300000000000001,"5min":0.70199999999999996,"15min":2.573},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45000000000000001,"15min":0.42999999999999999},"min":{"1min":0.376,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.67600000000000005},"last":0.379}]},{"osd":4,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.872,"5min":0.93700000000000006,"15min":1.3500000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.66400000000000003},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":2.7149999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.70099999999999996},"min":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.372},"max":{"1min":0.89100000000000001,"5min":1.01,"15min":2.6859999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":0.90800000000000003,"15min":0.93000000000000005},"last":0.67300000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.60999999999999999},"min":{"1min":0.496,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91100000000000003,"5min":0.97499999999999998,"15min":1.0489999999999999},"last":0.55400000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.52500000000000002,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":1.5429999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66200000000000003,"15min":0.70999999999999996},"min":{"1min":0.58499999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.70799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":911,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199066328,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.28199999999999997,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.61599999999999999,"5min":0.67700000000000005,"15min":0.78900000000000003},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.39000000000000001,"15min":0.378},"min":{"1min":0.311,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":0.65600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.254}]},{"osd":1,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.29099999999999998,"5min":0.23899999999999999,"15min":0.20200000000000001},"max":{"1min":0.54400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41699999999999998,"15min":0.40799999999999997},"min":{"1min":0.27700000000000002,"5min":0.27500000000000002,"15min":0.27200000000000002},"max":{"1min":0.59199999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.28699999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.435,"15min":0.42599999999999999},"min":{"1min":0.35999999999999999,"5min":0.29599999999999999,"15min":0.27200000000000002},"max":{"1min":0.65100000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.41699999999999998},"min":{"1min":0.33600000000000002,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.55400000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.308}]},{"osd":4,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.48399999999999999,"5min":0.375,"15min":0.35999999999999999},"max":{"1min":0.84299999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.625,"15min":0.62},"min":{"1min":0.47499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94999999999999996,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86899999999999999,"5min":1.1559999999999999,"15min":3.577},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.65900000000000003},"min":{"1min":0.53900000000000003,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":1.2809999999999999,"15min":7.0220000000000002},"last":0.35999999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85199999999999998,"5min":1.298,"15min":1.298},"last":0.377},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85199999999999998,"5min":1.111,"15min":3.637},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.57999999999999996,"5min":0.45300000000000001,"15min":0.42699999999999999},"max":{"1min":0.98099999999999998,"5min":1.141,"15min":7.0599999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67100000000000004,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.89700000000000002,"5min":1.232,"15min":1.331},"last":0.51600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074697,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.371,"15min":0.33700000000000002},"min":{"1min":0.29999999999999999,"5min":0.22600000000000001,"15min":0.182},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.35999999999999999},"min":{"1min":0.32200000000000001,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.60499999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.27200000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.223},"max":{"1min":0.55800000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.254},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.32700000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.41099999999999998},"min":{"1min":0.36099999999999999,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.66500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.35099999999999998,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":0.623,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35899999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61499999999999999,"15min":0.60399999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.92100000000000004,"5min":0.94999999999999996,"15min":1.337},"last":0.88700000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.45700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81699999999999995,"5min":0.92400000000000004,"15min":1.2010000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.50900000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83099999999999996,"5min":0.89900000000000002,"15min":0.97799999999999998},"last":0.80300000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64900000000000002,"15min":0.625},"min":{"1min":0.48799999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.1699999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65800000000000003,"15min":0.63},"min":{"1min":0.42599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86799999999999999,"5min":0.999,"15min":1.4570000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66900000000000004,"15min":0.64500000000000002},"min":{"1min":0.51900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.91900000000000004,"5min":1.0149999999999999,"15min":1.3779999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.54500000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.006},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074697,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.44700000000000001,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.752,"5min":0.77300000000000002,"15min":0.82199999999999995},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57399999999999995,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":4.883},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.78200000000000003,"15min":1.544},"last":0.503}]},{"osd":2,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.45800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.88},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.502,"5min":0.38600000000000001,"15min":0.33300000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.441},{"interface":"front","average":{"1min":0.62,"5min":0.57299999999999995,"15min":0.80700000000000005},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.72999999999999998,"5min":0.77300000000000002,"15min":8.8200000000000003},"last":0.52100000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45000000000000001,"15min":0.503},"min":{"1min":0.34000000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.745,"15min":1.4419999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.60499999999999998},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80300000000000005,"15min":3.8279999999999998},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.504,"15min":0.52700000000000002},"min":{"1min":0.35199999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.61499999999999999},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.33800000000000002},"max":{"1min":0.72399999999999998,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.63}]},{"osd":7,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53200000000000003,"15min":0.92400000000000004},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.65800000000000003,"5min":0.75600000000000001,"15min":14.039999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.54500000000000004},"min":{"1min":0.375,"5min":0.36599999999999999,"15min":0.31},"max":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.78300000000000003},"last":0.60599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074697,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.52500000000000002},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.74299999999999999,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.79100000000000004,"5min":0.83299999999999996,"15min":4.6059999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.50600000000000001,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.847},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.35599999999999998},"max":{"1min":0.72799999999999998,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.66900000000000004}]},{"osd":2,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.53700000000000003},"min":{"1min":0.46899999999999997,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58899999999999997,"15min":0.55600000000000005},"min":{"1min":0.51000000000000001,"5min":0.371,"15min":0.37},"max":{"1min":0.70199999999999996,"5min":0.79100000000000004,"15min":1.97},"last":0.89800000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.621,"15min":0.58599999999999997},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.38},"max":{"1min":0.82099999999999995,"5min":0.82599999999999996,"15min":3.2850000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.62,"15min":0.57699999999999996},"min":{"1min":0.498,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.83699999999999997},"last":0.877}]},{"osd":4,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.31900000000000001,"5min":0.312,"15min":0.252},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":1.3320000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.373,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.751,"5min":0.77000000000000002,"15min":4.5330000000000004},"last":1.0589999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.30299999999999999},"max":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.79000000000000004},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.29499999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.78600000000000003,"15min":1.8839999999999999},"last":0.96499999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81799999999999995,"5min":0.96899999999999997,"15min":3.766},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.55500000000000005},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.93000000000000005}]}]}],"pool_statfs":[]}} 2023-12-24T20:06:08.918 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:06:09.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.091+0000 7f885b1fd700 1 Processor -- start 2023-12-24T20:06:09.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.091+0000 7f885b1fd700 1 -- start start 2023-12-24T20:06:09.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.092+0000 7f885b1fd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8854157780 0x7f885406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.092+0000 7f885b1fd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f885406c840 0x7f885415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.092+0000 7f885b1fd700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88540ca6f0 con 0x7f88540ca270 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.092+0000 7f885b1fd700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88540ca9d0 con 0x7f8854157780 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.092+0000 7f885b1fd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88540cacb0 con 0x7f885406c840 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.092+0000 7f8858f99700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8854157780 0x7f885406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.092+0000 7f8853fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f88540ca270 0x7f88540cdbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51950/0 (socket says 172.21.15.61:51950) 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.092+0000 7f8853fff700 1 -- 172.21.15.61:0/1194575140 learned_addr learned my addr 172.21.15.61:0/1194575140 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.092+0000 7f885979a700 1 --2- 172.21.15.61:0/1194575140 >> v2:172.21.15.133:3300/0 conn(0x7f885406c840 0x7f885415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f8858f99700 1 -- 172.21.15.61:0/1194575140 >> v2:172.21.15.133:3300/0 conn(0x7f885406c840 msgr2=0x7f885415ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f8858f99700 1 --2- 172.21.15.61:0/1194575140 >> v2:172.21.15.133:3300/0 conn(0x7f885406c840 0x7f885415ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f8858f99700 1 -- 172.21.15.61:0/1194575140 >> v1:172.21.15.61:6789/0 conn(0x7f88540ca270 legacy=0x7f88540cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.096 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f8858f99700 1 -- 172.21.15.61:0/1194575140 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540caf90 con 0x7f8854157780 2023-12-24T20:06:09.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f88537fe700 1 -- 172.21.15.61:0/1194575140 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672794583 0 0) 0x7f88540ca6f0 con 0x7f88540ca270 2023-12-24T20:06:09.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f8858f99700 1 --2- 172.21.15.61:0/1194575140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 0x7f885406c300 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f8854071f60 tx=0x7f88480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51aaeaa611b3847 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:09.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f88537fe700 1 -- 172.21.15.61:0/1194575140 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800b6b0 con 0x7f8854157780 2023-12-24T20:06:09.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f88537fe700 1 -- 172.21.15.61:0/1194575140 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884800b810 con 0x7f8854157780 2023-12-24T20:06:09.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f88537fe700 1 -- 172.21.15.61:0/1194575140 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800bbb0 con 0x7f8854157780 2023-12-24T20:06:09.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f885b1fd700 1 -- 172.21.15.61:0/1194575140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 msgr2=0x7f885406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.093+0000 7f885b1fd700 1 --2- 172.21.15.61:0/1194575140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 0x7f885406c300 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f8854071f60 tx=0x7f88480091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.094+0000 7f885b1fd700 1 -- 172.21.15.61:0/1194575140 shutdown_connections 2023-12-24T20:06:09.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.094+0000 7f885b1fd700 1 --2- 172.21.15.61:0/1194575140 >> v2:172.21.15.133:3300/0 conn(0x7f885406c840 0x7f885415ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.094+0000 7f885b1fd700 1 --2- 172.21.15.61:0/1194575140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 0x7f885406c300 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.094+0000 7f885b1fd700 1 -- 172.21.15.61:0/1194575140 >> 172.21.15.61:0/1194575140 conn(0x7f885406b650 msgr2=0x7f88540ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:09.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.094+0000 7f885b1fd700 1 -- 172.21.15.61:0/1194575140 shutdown_connections 2023-12-24T20:06:09.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.094+0000 7f885b1fd700 1 -- 172.21.15.61:0/1194575140 wait complete. 2023-12-24T20:06:09.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.095+0000 7f885b1fd700 1 Processor -- start 2023-12-24T20:06:09.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.095+0000 7f885b1fd700 1 -- start start 2023-12-24T20:06:09.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f885b1fd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f885406c840 0x7f8854156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f885b1fd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 0x7f88540b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f885b1fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88540c5ea0 0x7f885414e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f885b1fd700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885416bee0 con 0x7f8854157780 2023-12-24T20:06:09.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f885b1fd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8854156160 con 0x7f88540c5ea0 2023-12-24T20:06:09.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f885b1fd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8854157030 con 0x7f885406c840 2023-12-24T20:06:09.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8853fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 0x7f88540b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8853fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 0x7f88540b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35344/0 (socket says 172.21.15.61:35344) 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8853fff700 1 -- 172.21.15.61:0/599278850 learned_addr learned my addr 172.21.15.61:0/599278850 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8858f99700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f885406c840 0x7f8854156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f885979a700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88540c5ea0 0x7f885414e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8853fff700 1 -- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f885406c840 msgr2=0x7f8854156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8853fff700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f885406c840 0x7f8854156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8853fff700 1 -- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88540c5ea0 msgr2=0x7f885414e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8853fff700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88540c5ea0 0x7f885414e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8853fff700 1 -- 172.21.15.61:0/599278850 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848009420 con 0x7f8854157780 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8853fff700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 0x7f88540b0980 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f884000c7e0 tx=0x7f8840007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8850ff9700 1 -- 172.21.15.61:0/599278850 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840005b30 con 0x7f8854157780 2023-12-24T20:06:09.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8850ff9700 1 -- 172.21.15.61:0/599278850 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8840005c90 con 0x7f8854157780 2023-12-24T20:06:09.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f885b1fd700 1 -- 172.21.15.61:0/599278850 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885416b360 con 0x7f8854157780 2023-12-24T20:06:09.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f8850ff9700 1 -- 172.21.15.61:0/599278850 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840007300 con 0x7f8854157780 2023-12-24T20:06:09.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.096+0000 7f885b1fd700 1 -- 172.21.15.61:0/599278850 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885416b920 con 0x7f8854157780 2023-12-24T20:06:09.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.097+0000 7f885b1fd700 1 -- 172.21.15.61:0/599278850 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88540b1680 con 0x7f8854157780 2023-12-24T20:06:09.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.098+0000 7f8850ff9700 1 -- 172.21.15.61:0/599278850 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f88400076b0 con 0x7f8854157780 2023-12-24T20:06:09.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.098+0000 7f8850ff9700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.098+0000 7f8850ff9700 1 -- 172.21.15.61:0/599278850 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8840084050 con 0x7f8854157780 2023-12-24T20:06:09.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.098+0000 7f8858f99700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.099+0000 7f8858f99700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8838066f30 0x7f88380693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f88480093f0 tx=0x7f8848017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:09.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.102+0000 7f8850ff9700 1 -- 172.21.15.61:0/599278850 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8840051340 con 0x7f8854157780 2023-12-24T20:06:09.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.293+0000 7f885b1fd700 1 -- 172.21.15.61:0/599278850 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f885404c3c0 con 0x7f8838066f30 2023-12-24T20:06:09.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.301+0000 7f8850ff9700 1 -- 172.21.15.61:0/599278850 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285338 (secure 0 0 0) 0x7f885404c3c0 con 0x7f8838066f30 2023-12-24T20:06:09.306 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:09.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 -- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8838066f30 msgr2=0x7f88380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8838066f30 0x7f88380693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f88480093f0 tx=0x7f8848017000 comp rx=0 tx=0).stop 2023-12-24T20:06:09.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 -- 172.21.15.61:0/599278850 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 msgr2=0x7f88540b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 0x7f88540b0980 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f884000c7e0 tx=0x7f8840007df0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 -- 172.21.15.61:0/599278850 shutdown_connections 2023-12-24T20:06:09.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f885406c840 0x7f8854156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88540c5ea0 0x7f885414e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 --2- 172.21.15.61:0/599278850 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8854157780 0x7f88540b0980 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 -- 172.21.15.61:0/599278850 >> 172.21.15.61:0/599278850 conn(0x7f885406b650 msgr2=0x7f8854157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:09.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 -- 172.21.15.61:0/599278850 shutdown_connections 2023-12-24T20:06:09.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.304+0000 7f885b1fd700 1 -- 172.21.15.61:0/599278850 wait complete. 2023-12-24T20:06:09.311 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:06:09.320 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":435,"stamp":"2023-12-24T20:06:08.442342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554089,"statfs":{"total":1600000000,"available":1591387482,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.683667"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777764+0000","last_change":"2023-12-24T20:06:04.777764+0000","last_active":"2023-12-24T20:06:04.777764+0000","last_peered":"2023-12-24T20:06:04.777764+0000","last_clean":"2023-12-24T20:06:04.777764+0000","last_became_active":"2023-12-24T20:06:04.776749+0000","last_became_peered":"2023-12-24T20:06:04.776749+0000","last_unstale":"2023-12-24T20:06:04.777764+0000","last_undegraded":"2023-12-24T20:06:04.777764+0000","last_fullsized":"2023-12-24T20:06:04.777764+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:18:12.508908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.771847+0000","last_change":"2023-12-24T20:06:04.771847+0000","last_active":"2023-12-24T20:06:04.771847+0000","last_peered":"2023-12-24T20:06:04.771847+0000","last_clean":"2023-12-24T20:06:04.771847+0000","last_became_active":"2023-12-24T20:06:04.771608+0000","last_became_peered":"2023-12-24T20:06:04.771608+0000","last_unstale":"2023-12-24T20:06:04.771847+0000","last_undegraded":"2023-12-24T20:06:04.771847+0000","last_fullsized":"2023-12-24T20:06:04.771847+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:51:12.919665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772532+0000","last_change":"2023-12-24T20:06:04.772532+0000","last_active":"2023-12-24T20:06:04.772532+0000","last_peered":"2023-12-24T20:06:04.772532+0000","last_clean":"2023-12-24T20:06:04.772532+0000","last_became_active":"2023-12-24T20:06:04.772163+0000","last_became_peered":"2023-12-24T20:06:04.772163+0000","last_unstale":"2023-12-24T20:06:04.772532+0000","last_undegraded":"2023-12-24T20:06:04.772532+0000","last_fullsized":"2023-12-24T20:06:04.772532+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:06.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780764+0000","last_change":"2023-12-24T20:06:04.780764+0000","last_active":"2023-12-24T20:06:04.780764+0000","last_peered":"2023-12-24T20:06:04.780764+0000","last_clean":"2023-12-24T20:06:04.780764+0000","last_became_active":"2023-12-24T20:06:04.780374+0000","last_became_peered":"2023-12-24T20:06:04.780374+0000","last_unstale":"2023-12-24T20:06:04.780764+0000","last_undegraded":"2023-12-24T20:06:04.780764+0000","last_fullsized":"2023-12-24T20:06:04.780764+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:32:18.110635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775383+0000","last_change":"2023-12-24T20:06:04.775383+0000","last_active":"2023-12-24T20:06:04.775383+0000","last_peered":"2023-12-24T20:06:04.775383+0000","last_clean":"2023-12-24T20:06:04.775383+0000","last_became_active":"2023-12-24T20:06:04.775009+0000","last_became_peered":"2023-12-24T20:06:04.775009+0000","last_unstale":"2023-12-24T20:06:04.775383+0000","last_undegraded":"2023-12-24T20:06:04.775383+0000","last_fullsized":"2023-12-24T20:06:04.775383+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:57:00.466664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777611+0000","last_change":"2023-12-24T20:06:04.777611+0000","last_active":"2023-12-24T20:06:04.777611+0000","last_peered":"2023-12-24T20:06:04.777611+0000","last_clean":"2023-12-24T20:06:04.777611+0000","last_became_active":"2023-12-24T20:06:04.776129+0000","last_became_peered":"2023-12-24T20:06:04.776129+0000","last_unstale":"2023-12-24T20:06:04.777611+0000","last_undegraded":"2023-12-24T20:06:04.777611+0000","last_fullsized":"2023-12-24T20:06:04.777611+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:59:43.530403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.779392+0000","last_change":"2023-12-24T20:06:04.779392+0000","last_active":"2023-12-24T20:06:04.779392+0000","last_peered":"2023-12-24T20:06:04.779392+0000","last_clean":"2023-12-24T20:06:04.779392+0000","last_became_active":"2023-12-24T20:06:04.779083+0000","last_became_peered":"2023-12-24T20:06:04.779083+0000","last_unstale":"2023-12-24T20:06:04.779392+0000","last_undegraded":"2023-12-24T20:06:04.779392+0000","last_fullsized":"2023-12-24T20:06:04.779392+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:52:23.083762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.767732+0000","last_change":"2023-12-24T20:06:04.767732+0000","last_active":"2023-12-24T20:06:04.767732+0000","last_peered":"2023-12-24T20:06:04.767732+0000","last_clean":"2023-12-24T20:06:04.767732+0000","last_became_active":"2023-12-24T20:06:04.767420+0000","last_became_peered":"2023-12-24T20:06:04.767420+0000","last_unstale":"2023-12-24T20:06:04.767732+0000","last_undegraded":"2023-12-24T20:06:04.767732+0000","last_fullsized":"2023-12-24T20:06:04.767732+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:26.260139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775315+0000","last_change":"2023-12-24T20:06:04.775315+0000","last_active":"2023-12-24T20:06:04.775315+0000","last_peered":"2023-12-24T20:06:04.775315+0000","last_clean":"2023-12-24T20:06:04.775315+0000","last_became_active":"2023-12-24T20:06:04.775032+0000","last_became_peered":"2023-12-24T20:06:04.775032+0000","last_unstale":"2023-12-24T20:06:04.775315+0000","last_undegraded":"2023-12-24T20:06:04.775315+0000","last_fullsized":"2023-12-24T20:06:04.775315+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:34:14.550410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.779632+0000","last_change":"2023-12-24T20:06:04.779632+0000","last_active":"2023-12-24T20:06:04.779632+0000","last_peered":"2023-12-24T20:06:04.779632+0000","last_clean":"2023-12-24T20:06:04.779632+0000","last_became_active":"2023-12-24T20:06:04.778406+0000","last_became_peered":"2023-12-24T20:06:04.778406+0000","last_unstale":"2023-12-24T20:06:04.779632+0000","last_undegraded":"2023-12-24T20:06:04.779632+0000","last_fullsized":"2023-12-24T20:06:04.779632+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:44:26.864125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.768081+0000","last_change":"2023-12-24T20:06:04.768081+0000","last_active":"2023-12-24T20:06:04.768081+0000","last_peered":"2023-12-24T20:06:04.768081+0000","last_clean":"2023-12-24T20:06:04.768081+0000","last_became_active":"2023-12-24T20:06:04.767823+0000","last_became_peered":"2023-12-24T20:06:04.767823+0000","last_unstale":"2023-12-24T20:06:04.768081+0000","last_undegraded":"2023-12-24T20:06:04.768081+0000","last_fullsized":"2023-12-24T20:06:04.768081+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:52:21.962533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772598+0000","last_change":"2023-12-24T20:06:04.772598+0000","last_active":"2023-12-24T20:06:04.772598+0000","last_peered":"2023-12-24T20:06:04.772598+0000","last_clean":"2023-12-24T20:06:04.772598+0000","last_became_active":"2023-12-24T20:06:04.772404+0000","last_became_peered":"2023-12-24T20:06:04.772404+0000","last_unstale":"2023-12-24T20:06:04.772598+0000","last_undegraded":"2023-12-24T20:06:04.772598+0000","last_fullsized":"2023-12-24T20:06:04.772598+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:45.217479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774816+0000","last_change":"2023-12-24T20:06:04.774816+0000","last_active":"2023-12-24T20:06:04.774816+0000","last_peered":"2023-12-24T20:06:04.774816+0000","last_clean":"2023-12-24T20:06:04.774816+0000","last_became_active":"2023-12-24T20:06:04.773928+0000","last_became_peered":"2023-12-24T20:06:04.773928+0000","last_unstale":"2023-12-24T20:06:04.774816+0000","last_undegraded":"2023-12-24T20:06:04.774816+0000","last_fullsized":"2023-12-24T20:06:04.774816+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:05.636519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777400+0000","last_change":"2023-12-24T20:06:04.777400+0000","last_active":"2023-12-24T20:06:04.777400+0000","last_peered":"2023-12-24T20:06:04.777400+0000","last_clean":"2023-12-24T20:06:04.777400+0000","last_became_active":"2023-12-24T20:06:04.777040+0000","last_became_peered":"2023-12-24T20:06:04.777040+0000","last_unstale":"2023-12-24T20:06:04.777400+0000","last_undegraded":"2023-12-24T20:06:04.777400+0000","last_fullsized":"2023-12-24T20:06:04.777400+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:38:38.335652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.779959+0000","last_change":"2023-12-24T20:06:04.779959+0000","last_active":"2023-12-24T20:06:04.779959+0000","last_peered":"2023-12-24T20:06:04.779959+0000","last_clean":"2023-12-24T20:06:04.779959+0000","last_became_active":"2023-12-24T20:06:04.779165+0000","last_became_peered":"2023-12-24T20:06:04.779165+0000","last_unstale":"2023-12-24T20:06:04.779959+0000","last_undegraded":"2023-12-24T20:06:04.779959+0000","last_fullsized":"2023-12-24T20:06:04.779959+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:15:55.837764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.773489+0000","last_change":"2023-12-24T20:06:04.773489+0000","last_active":"2023-12-24T20:06:04.773489+0000","last_peered":"2023-12-24T20:06:04.773489+0000","last_clean":"2023-12-24T20:06:04.773489+0000","last_became_active":"2023-12-24T20:06:04.773149+0000","last_became_peered":"2023-12-24T20:06:04.773149+0000","last_unstale":"2023-12-24T20:06:04.773489+0000","last_undegraded":"2023-12-24T20:06:04.773489+0000","last_fullsized":"2023-12-24T20:06:04.773489+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:02:35.043187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775823+0000","last_change":"2023-12-24T20:06:04.775823+0000","last_active":"2023-12-24T20:06:04.775823+0000","last_peered":"2023-12-24T20:06:04.775823+0000","last_clean":"2023-12-24T20:06:04.775823+0000","last_became_active":"2023-12-24T20:06:04.775577+0000","last_became_peered":"2023-12-24T20:06:04.775577+0000","last_unstale":"2023-12-24T20:06:04.775823+0000","last_undegraded":"2023-12-24T20:06:04.775823+0000","last_fullsized":"2023-12-24T20:06:04.775823+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:11:14.278700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772392+0000","last_change":"2023-12-24T20:06:04.772392+0000","last_active":"2023-12-24T20:06:04.772392+0000","last_peered":"2023-12-24T20:06:04.772392+0000","last_clean":"2023-12-24T20:06:04.772392+0000","last_became_active":"2023-12-24T20:06:04.771837+0000","last_became_peered":"2023-12-24T20:06:04.771837+0000","last_unstale":"2023-12-24T20:06:04.772392+0000","last_undegraded":"2023-12-24T20:06:04.772392+0000","last_fullsized":"2023-12-24T20:06:04.772392+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:34:56.560519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776569+0000","last_change":"2023-12-24T20:06:04.776569+0000","last_active":"2023-12-24T20:06:04.776569+0000","last_peered":"2023-12-24T20:06:04.776569+0000","last_clean":"2023-12-24T20:06:04.776569+0000","last_became_active":"2023-12-24T20:06:04.776323+0000","last_became_peered":"2023-12-24T20:06:04.776323+0000","last_unstale":"2023-12-24T20:06:04.776569+0000","last_undegraded":"2023-12-24T20:06:04.776569+0000","last_fullsized":"2023-12-24T20:06:04.776569+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:35.608952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776670+0000","last_change":"2023-12-24T20:06:04.776670+0000","last_active":"2023-12-24T20:06:04.776670+0000","last_peered":"2023-12-24T20:06:04.776670+0000","last_clean":"2023-12-24T20:06:04.776670+0000","last_became_active":"2023-12-24T20:06:04.776402+0000","last_became_peered":"2023-12-24T20:06:04.776402+0000","last_unstale":"2023-12-24T20:06:04.776670+0000","last_undegraded":"2023-12-24T20:06:04.776670+0000","last_fullsized":"2023-12-24T20:06:04.776670+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:44:49.085676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776589+0000","last_change":"2023-12-24T20:06:04.776589+0000","last_active":"2023-12-24T20:06:04.776589+0000","last_peered":"2023-12-24T20:06:04.776589+0000","last_clean":"2023-12-24T20:06:04.776589+0000","last_became_active":"2023-12-24T20:06:04.776334+0000","last_became_peered":"2023-12-24T20:06:04.776334+0000","last_unstale":"2023-12-24T20:06:04.776589+0000","last_undegraded":"2023-12-24T20:06:04.776589+0000","last_fullsized":"2023-12-24T20:06:04.776589+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:46:47.163421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.781114+0000","last_change":"2023-12-24T20:06:04.781114+0000","last_active":"2023-12-24T20:06:04.781114+0000","last_peered":"2023-12-24T20:06:04.781114+0000","last_clean":"2023-12-24T20:06:04.781114+0000","last_became_active":"2023-12-24T20:06:04.780218+0000","last_became_peered":"2023-12-24T20:06:04.780218+0000","last_unstale":"2023-12-24T20:06:04.781114+0000","last_undegraded":"2023-12-24T20:06:04.781114+0000","last_fullsized":"2023-12-24T20:06:04.781114+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:34:56.560519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.781132+0000","last_change":"2023-12-24T20:06:04.781132+0000","last_active":"2023-12-24T20:06:04.781132+0000","last_peered":"2023-12-24T20:06:04.781132+0000","last_clean":"2023-12-24T20:06:04.781132+0000","last_became_active":"2023-12-24T20:06:04.780472+0000","last_became_peered":"2023-12-24T20:06:04.780472+0000","last_unstale":"2023-12-24T20:06:04.781132+0000","last_undegraded":"2023-12-24T20:06:04.781132+0000","last_fullsized":"2023-12-24T20:06:04.781132+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:35.526313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780319+0000","last_change":"2023-12-24T20:06:04.780319+0000","last_active":"2023-12-24T20:06:04.780319+0000","last_peered":"2023-12-24T20:06:04.780319+0000","last_clean":"2023-12-24T20:06:04.780319+0000","last_became_active":"2023-12-24T20:06:04.780097+0000","last_became_peered":"2023-12-24T20:06:04.780097+0000","last_unstale":"2023-12-24T20:06:04.780319+0000","last_undegraded":"2023-12-24T20:06:04.780319+0000","last_fullsized":"2023-12-24T20:06:04.780319+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:33:20.823581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775894+0000","last_change":"2023-12-24T20:06:04.775894+0000","last_active":"2023-12-24T20:06:04.775894+0000","last_peered":"2023-12-24T20:06:04.775894+0000","last_clean":"2023-12-24T20:06:04.775894+0000","last_became_active":"2023-12-24T20:06:04.775637+0000","last_became_peered":"2023-12-24T20:06:04.775637+0000","last_unstale":"2023-12-24T20:06:04.775894+0000","last_undegraded":"2023-12-24T20:06:04.775894+0000","last_fullsized":"2023-12-24T20:06:04.775894+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:36:54.731492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.773949+0000","last_change":"2023-12-24T20:06:04.773949+0000","last_active":"2023-12-24T20:06:04.773949+0000","last_peered":"2023-12-24T20:06:04.773949+0000","last_clean":"2023-12-24T20:06:04.773949+0000","last_became_active":"2023-12-24T20:06:04.773710+0000","last_became_peered":"2023-12-24T20:06:04.773710+0000","last_unstale":"2023-12-24T20:06:04.773949+0000","last_undegraded":"2023-12-24T20:06:04.773949+0000","last_fullsized":"2023-12-24T20:06:04.773949+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:59:39.822638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774133+0000","last_change":"2023-12-24T20:06:04.774133+0000","last_active":"2023-12-24T20:06:04.774133+0000","last_peered":"2023-12-24T20:06:04.774133+0000","last_clean":"2023-12-24T20:06:04.774133+0000","last_became_active":"2023-12-24T20:06:04.773913+0000","last_became_peered":"2023-12-24T20:06:04.773913+0000","last_unstale":"2023-12-24T20:06:04.774133+0000","last_undegraded":"2023-12-24T20:06:04.774133+0000","last_fullsized":"2023-12-24T20:06:04.774133+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:40:35.912407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774454+0000","last_change":"2023-12-24T20:06:04.774454+0000","last_active":"2023-12-24T20:06:04.774454+0000","last_peered":"2023-12-24T20:06:04.774454+0000","last_clean":"2023-12-24T20:06:04.774454+0000","last_became_active":"2023-12-24T20:06:04.773738+0000","last_became_peered":"2023-12-24T20:06:04.773738+0000","last_unstale":"2023-12-24T20:06:04.774454+0000","last_undegraded":"2023-12-24T20:06:04.774454+0000","last_fullsized":"2023-12-24T20:06:04.774454+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:39:06.541160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.770956+0000","last_change":"2023-12-24T20:06:04.770956+0000","last_active":"2023-12-24T20:06:04.770956+0000","last_peered":"2023-12-24T20:06:04.770956+0000","last_clean":"2023-12-24T20:06:04.770956+0000","last_became_active":"2023-12-24T20:06:04.770175+0000","last_became_peered":"2023-12-24T20:06:04.770175+0000","last_unstale":"2023-12-24T20:06:04.770956+0000","last_undegraded":"2023-12-24T20:06:04.770956+0000","last_fullsized":"2023-12-24T20:06:04.770956+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:57.185392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774493+0000","last_change":"2023-12-24T20:06:04.774493+0000","last_active":"2023-12-24T20:06:04.774493+0000","last_peered":"2023-12-24T20:06:04.774493+0000","last_clean":"2023-12-24T20:06:04.774493+0000","last_became_active":"2023-12-24T20:06:04.774216+0000","last_became_peered":"2023-12-24T20:06:04.774216+0000","last_unstale":"2023-12-24T20:06:04.774493+0000","last_undegraded":"2023-12-24T20:06:04.774493+0000","last_fullsized":"2023-12-24T20:06:04.774493+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:00:06.482119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776098+0000","last_change":"2023-12-24T20:06:04.776098+0000","last_active":"2023-12-24T20:06:04.776098+0000","last_peered":"2023-12-24T20:06:04.776098+0000","last_clean":"2023-12-24T20:06:04.776098+0000","last_became_active":"2023-12-24T20:06:04.775854+0000","last_became_peered":"2023-12-24T20:06:04.775854+0000","last_unstale":"2023-12-24T20:06:04.776098+0000","last_undegraded":"2023-12-24T20:06:04.776098+0000","last_fullsized":"2023-12-24T20:06:04.776098+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:12:56.733517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776823+0000","last_change":"2023-12-24T20:06:04.776823+0000","last_active":"2023-12-24T20:06:04.776823+0000","last_peered":"2023-12-24T20:06:04.776823+0000","last_clean":"2023-12-24T20:06:04.776823+0000","last_became_active":"2023-12-24T20:06:04.776202+0000","last_became_peered":"2023-12-24T20:06:04.776202+0000","last_unstale":"2023-12-24T20:06:04.776823+0000","last_undegraded":"2023-12-24T20:06:04.776823+0000","last_fullsized":"2023-12-24T20:06:04.776823+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:05:40.633066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.778221+0000","last_change":"2023-12-24T20:06:04.778221+0000","last_active":"2023-12-24T20:06:04.778221+0000","last_peered":"2023-12-24T20:06:04.778221+0000","last_clean":"2023-12-24T20:06:04.778221+0000","last_became_active":"2023-12-24T20:06:04.777492+0000","last_became_peered":"2023-12-24T20:06:04.777492+0000","last_unstale":"2023-12-24T20:06:04.778221+0000","last_undegraded":"2023-12-24T20:06:04.778221+0000","last_fullsized":"2023-12-24T20:06:04.778221+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:05.983460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"167'4","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.788937+0000","last_change":"2023-12-24T20:06:03.774915+0000","last_active":"2023-12-24T20:06:04.788937+0000","last_peered":"2023-12-24T20:06:04.788937+0000","last_clean":"2023-12-24T20:06:04.788937+0000","last_became_active":"2023-12-24T20:06:03.774550+0000","last_became_peered":"2023-12-24T20:06:03.774550+0000","last_unstale":"2023-12-24T20:06:04.788937+0000","last_undegraded":"2023-12-24T20:06:04.788937+0000","last_fullsized":"2023-12-24T20:06:04.788937+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:56.385401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775137+0000","last_change":"2023-12-24T20:06:04.775137+0000","last_active":"2023-12-24T20:06:04.775137+0000","last_peered":"2023-12-24T20:06:04.775137+0000","last_clean":"2023-12-24T20:06:04.775137+0000","last_became_active":"2023-12-24T20:06:04.774123+0000","last_became_peered":"2023-12-24T20:06:04.774123+0000","last_unstale":"2023-12-24T20:06:04.775137+0000","last_undegraded":"2023-12-24T20:06:04.775137+0000","last_fullsized":"2023-12-24T20:06:04.775137+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:56:20.915108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.769209+0000","last_change":"2023-12-24T20:06:03.771244+0000","last_active":"2023-12-24T20:06:04.769209+0000","last_peered":"2023-12-24T20:06:04.769209+0000","last_clean":"2023-12-24T20:06:04.769209+0000","last_became_active":"2023-12-24T20:06:03.770880+0000","last_became_peered":"2023-12-24T20:06:03.770880+0000","last_unstale":"2023-12-24T20:06:04.769209+0000","last_undegraded":"2023-12-24T20:06:04.769209+0000","last_fullsized":"2023-12-24T20:06:04.769209+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:21.246343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777934+0000","last_change":"2023-12-24T20:06:04.777934+0000","last_active":"2023-12-24T20:06:04.777934+0000","last_peered":"2023-12-24T20:06:04.777934+0000","last_clean":"2023-12-24T20:06:04.777934+0000","last_became_active":"2023-12-24T20:06:04.777162+0000","last_became_peered":"2023-12-24T20:06:04.777162+0000","last_unstale":"2023-12-24T20:06:04.777934+0000","last_undegraded":"2023-12-24T20:06:04.777934+0000","last_fullsized":"2023-12-24T20:06:04.777934+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:42.721234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.788034+0000","last_change":"2023-12-24T20:06:03.764490+0000","last_active":"2023-12-24T20:06:04.788034+0000","last_peered":"2023-12-24T20:06:04.788034+0000","last_clean":"2023-12-24T20:06:04.788034+0000","last_became_active":"2023-12-24T20:06:03.764245+0000","last_became_peered":"2023-12-24T20:06:03.764245+0000","last_unstale":"2023-12-24T20:06:04.788034+0000","last_undegraded":"2023-12-24T20:06:04.788034+0000","last_fullsized":"2023-12-24T20:06:04.788034+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:09.686324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.779797+0000","last_change":"2023-12-24T20:06:04.779797+0000","last_active":"2023-12-24T20:06:04.779797+0000","last_peered":"2023-12-24T20:06:04.779797+0000","last_clean":"2023-12-24T20:06:04.779797+0000","last_became_active":"2023-12-24T20:06:04.778850+0000","last_became_peered":"2023-12-24T20:06:04.778850+0000","last_unstale":"2023-12-24T20:06:04.779797+0000","last_undegraded":"2023-12-24T20:06:04.779797+0000","last_fullsized":"2023-12-24T20:06:04.779797+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:56:20.915108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.787568+0000","last_change":"2023-12-24T20:06:03.768790+0000","last_active":"2023-12-24T20:06:04.787568+0000","last_peered":"2023-12-24T20:06:04.787568+0000","last_clean":"2023-12-24T20:06:04.787568+0000","last_became_active":"2023-12-24T20:06:03.768061+0000","last_became_peered":"2023-12-24T20:06:03.768061+0000","last_unstale":"2023-12-24T20:06:04.787568+0000","last_undegraded":"2023-12-24T20:06:04.787568+0000","last_fullsized":"2023-12-24T20:06:04.787568+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:09:23.541886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775321+0000","last_change":"2023-12-24T20:06:04.775321+0000","last_active":"2023-12-24T20:06:04.775321+0000","last_peered":"2023-12-24T20:06:04.775321+0000","last_clean":"2023-12-24T20:06:04.775321+0000","last_became_active":"2023-12-24T20:06:04.774898+0000","last_became_peered":"2023-12-24T20:06:04.774898+0000","last_unstale":"2023-12-24T20:06:04.775321+0000","last_undegraded":"2023-12-24T20:06:04.775321+0000","last_fullsized":"2023-12-24T20:06:04.775321+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:48.634929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772134+0000","last_change":"2023-12-24T20:06:03.775762+0000","last_active":"2023-12-24T20:06:04.772134+0000","last_peered":"2023-12-24T20:06:04.772134+0000","last_clean":"2023-12-24T20:06:04.772134+0000","last_became_active":"2023-12-24T20:06:03.775064+0000","last_became_peered":"2023-12-24T20:06:03.775064+0000","last_unstale":"2023-12-24T20:06:04.772134+0000","last_undegraded":"2023-12-24T20:06:04.772134+0000","last_fullsized":"2023-12-24T20:06:04.772134+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:46:40.923067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.781814+0000","last_change":"2023-12-24T20:06:04.781814+0000","last_active":"2023-12-24T20:06:04.781814+0000","last_peered":"2023-12-24T20:06:04.781814+0000","last_clean":"2023-12-24T20:06:04.781814+0000","last_became_active":"2023-12-24T20:06:04.780582+0000","last_became_peered":"2023-12-24T20:06:04.780582+0000","last_unstale":"2023-12-24T20:06:04.781814+0000","last_undegraded":"2023-12-24T20:06:04.781814+0000","last_fullsized":"2023-12-24T20:06:04.781814+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:28.956306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.765981+0000","last_change":"2023-12-24T20:06:03.771825+0000","last_active":"2023-12-24T20:06:04.765981+0000","last_peered":"2023-12-24T20:06:04.765981+0000","last_clean":"2023-12-24T20:06:04.765981+0000","last_became_active":"2023-12-24T20:06:03.771584+0000","last_became_peered":"2023-12-24T20:06:03.771584+0000","last_unstale":"2023-12-24T20:06:04.765981+0000","last_undegraded":"2023-12-24T20:06:04.765981+0000","last_fullsized":"2023-12-24T20:06:04.765981+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:54.413899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.773226+0000","last_change":"2023-12-24T20:06:04.773226+0000","last_active":"2023-12-24T20:06:04.773226+0000","last_peered":"2023-12-24T20:06:04.773226+0000","last_clean":"2023-12-24T20:06:04.773226+0000","last_became_active":"2023-12-24T20:06:04.772962+0000","last_became_peered":"2023-12-24T20:06:04.772962+0000","last_unstale":"2023-12-24T20:06:04.773226+0000","last_undegraded":"2023-12-24T20:06:04.773226+0000","last_fullsized":"2023-12-24T20:06:04.773226+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:11:06.009265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.771867+0000","last_change":"2023-12-24T20:06:03.771798+0000","last_active":"2023-12-24T20:06:03.771867+0000","last_peered":"2023-12-24T20:06:03.771867+0000","last_clean":"2023-12-24T20:06:03.771867+0000","last_became_active":"2023-12-24T20:06:03.771359+0000","last_became_peered":"2023-12-24T20:06:03.771359+0000","last_unstale":"2023-12-24T20:06:03.771867+0000","last_undegraded":"2023-12-24T20:06:03.771867+0000","last_fullsized":"2023-12-24T20:06:03.771867+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:27.527241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772402+0000","last_change":"2023-12-24T20:06:04.772402+0000","last_active":"2023-12-24T20:06:04.772402+0000","last_peered":"2023-12-24T20:06:04.772402+0000","last_clean":"2023-12-24T20:06:04.772402+0000","last_became_active":"2023-12-24T20:06:04.772178+0000","last_became_peered":"2023-12-24T20:06:04.772178+0000","last_unstale":"2023-12-24T20:06:04.772402+0000","last_undegraded":"2023-12-24T20:06:04.772402+0000","last_fullsized":"2023-12-24T20:06:04.772402+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:56:22.067809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.770950+0000","last_change":"2023-12-24T20:06:03.770832+0000","last_active":"2023-12-24T20:06:03.770950+0000","last_peered":"2023-12-24T20:06:03.770950+0000","last_clean":"2023-12-24T20:06:03.770950+0000","last_became_active":"2023-12-24T20:06:03.770604+0000","last_became_peered":"2023-12-24T20:06:03.770604+0000","last_unstale":"2023-12-24T20:06:03.770950+0000","last_undegraded":"2023-12-24T20:06:03.770950+0000","last_fullsized":"2023-12-24T20:06:03.770950+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:56.385401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775510+0000","last_change":"2023-12-24T20:06:04.775510+0000","last_active":"2023-12-24T20:06:04.775510+0000","last_peered":"2023-12-24T20:06:04.775510+0000","last_clean":"2023-12-24T20:06:04.775510+0000","last_became_active":"2023-12-24T20:06:04.775275+0000","last_became_peered":"2023-12-24T20:06:04.775275+0000","last_unstale":"2023-12-24T20:06:04.775510+0000","last_undegraded":"2023-12-24T20:06:04.775510+0000","last_fullsized":"2023-12-24T20:06:04.775510+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:58:42.721234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.765572+0000","last_change":"2023-12-24T20:06:03.765283+0000","last_active":"2023-12-24T20:06:03.765572+0000","last_peered":"2023-12-24T20:06:03.765572+0000","last_clean":"2023-12-24T20:06:03.765572+0000","last_became_active":"2023-12-24T20:06:03.765041+0000","last_became_peered":"2023-12-24T20:06:03.765041+0000","last_unstale":"2023-12-24T20:06:03.765572+0000","last_undegraded":"2023-12-24T20:06:03.765572+0000","last_fullsized":"2023-12-24T20:06:03.765572+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:17:36.914572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775362+0000","last_change":"2023-12-24T20:06:04.775362+0000","last_active":"2023-12-24T20:06:04.775362+0000","last_peered":"2023-12-24T20:06:04.775362+0000","last_clean":"2023-12-24T20:06:04.775362+0000","last_became_active":"2023-12-24T20:06:04.775105+0000","last_became_peered":"2023-12-24T20:06:04.775105+0000","last_unstale":"2023-12-24T20:06:04.775362+0000","last_undegraded":"2023-12-24T20:06:04.775362+0000","last_fullsized":"2023-12-24T20:06:04.775362+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:17:37.919892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.774280+0000","last_change":"2023-12-24T20:06:03.774222+0000","last_active":"2023-12-24T20:06:03.774280+0000","last_peered":"2023-12-24T20:06:03.774280+0000","last_clean":"2023-12-24T20:06:03.774280+0000","last_became_active":"2023-12-24T20:06:03.773986+0000","last_became_peered":"2023-12-24T20:06:03.773986+0000","last_unstale":"2023-12-24T20:06:03.774280+0000","last_undegraded":"2023-12-24T20:06:03.774280+0000","last_fullsized":"2023-12-24T20:06:03.774280+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:09:23.541886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.778549+0000","last_change":"2023-12-24T20:06:04.778549+0000","last_active":"2023-12-24T20:06:04.778549+0000","last_peered":"2023-12-24T20:06:04.778549+0000","last_clean":"2023-12-24T20:06:04.778549+0000","last_became_active":"2023-12-24T20:06:04.778169+0000","last_became_peered":"2023-12-24T20:06:04.778169+0000","last_unstale":"2023-12-24T20:06:04.778549+0000","last_undegraded":"2023-12-24T20:06:04.778549+0000","last_fullsized":"2023-12-24T20:06:04.778549+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:50.512926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"167'6","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.791288+0000","last_change":"2023-12-24T20:06:03.770742+0000","last_active":"2023-12-24T20:06:04.791288+0000","last_peered":"2023-12-24T20:06:04.791288+0000","last_clean":"2023-12-24T20:06:04.791288+0000","last_became_active":"2023-12-24T20:06:03.770503+0000","last_became_peered":"2023-12-24T20:06:03.770503+0000","last_unstale":"2023-12-24T20:06:04.791288+0000","last_undegraded":"2023-12-24T20:06:04.791288+0000","last_fullsized":"2023-12-24T20:06:04.791288+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:12:55.728197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.781514+0000","last_change":"2023-12-24T20:06:04.781514+0000","last_active":"2023-12-24T20:06:04.781514+0000","last_peered":"2023-12-24T20:06:04.781514+0000","last_clean":"2023-12-24T20:06:04.781514+0000","last_became_active":"2023-12-24T20:06:04.781258+0000","last_became_peered":"2023-12-24T20:06:04.781258+0000","last_unstale":"2023-12-24T20:06:04.781514+0000","last_undegraded":"2023-12-24T20:06:04.781514+0000","last_fullsized":"2023-12-24T20:06:04.781514+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:43:59.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.790583+0000","last_change":"2023-12-24T20:06:03.775501+0000","last_active":"2023-12-24T20:06:04.790583+0000","last_peered":"2023-12-24T20:06:04.790583+0000","last_clean":"2023-12-24T20:06:04.790583+0000","last_became_active":"2023-12-24T20:06:03.775278+0000","last_became_peered":"2023-12-24T20:06:03.775278+0000","last_unstale":"2023-12-24T20:06:04.790583+0000","last_undegraded":"2023-12-24T20:06:04.790583+0000","last_fullsized":"2023-12-24T20:06:04.790583+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:51:09.386508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772593+0000","last_change":"2023-12-24T20:06:04.772593+0000","last_active":"2023-12-24T20:06:04.772593+0000","last_peered":"2023-12-24T20:06:04.772593+0000","last_clean":"2023-12-24T20:06:04.772593+0000","last_became_active":"2023-12-24T20:06:04.772374+0000","last_became_peered":"2023-12-24T20:06:04.772374+0000","last_unstale":"2023-12-24T20:06:04.772593+0000","last_undegraded":"2023-12-24T20:06:04.772593+0000","last_fullsized":"2023-12-24T20:06:04.772593+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:07:45.217479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.773120+0000","last_change":"2023-12-24T20:06:03.771334+0000","last_active":"2023-12-24T20:06:03.773120+0000","last_peered":"2023-12-24T20:06:03.773120+0000","last_clean":"2023-12-24T20:06:03.773120+0000","last_became_active":"2023-12-24T20:06:03.771035+0000","last_became_peered":"2023-12-24T20:06:03.771035+0000","last_unstale":"2023-12-24T20:06:03.773120+0000","last_undegraded":"2023-12-24T20:06:03.773120+0000","last_fullsized":"2023-12-24T20:06:03.773120+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:57:52.129814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775097+0000","last_change":"2023-12-24T20:06:04.775097+0000","last_active":"2023-12-24T20:06:04.775097+0000","last_peered":"2023-12-24T20:06:04.775097+0000","last_clean":"2023-12-24T20:06:04.775097+0000","last_became_active":"2023-12-24T20:06:04.774577+0000","last_became_peered":"2023-12-24T20:06:04.774577+0000","last_unstale":"2023-12-24T20:06:04.775097+0000","last_undegraded":"2023-12-24T20:06:04.775097+0000","last_fullsized":"2023-12-24T20:06:04.775097+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:52:52.983186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.766244+0000","last_change":"2023-12-24T20:06:03.765891+0000","last_active":"2023-12-24T20:06:03.766244+0000","last_peered":"2023-12-24T20:06:03.766244+0000","last_clean":"2023-12-24T20:06:03.766244+0000","last_became_active":"2023-12-24T20:06:03.765651+0000","last_became_peered":"2023-12-24T20:06:03.765651+0000","last_unstale":"2023-12-24T20:06:03.766244+0000","last_undegraded":"2023-12-24T20:06:03.766244+0000","last_fullsized":"2023-12-24T20:06:03.766244+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:35:21.266143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777230+0000","last_change":"2023-12-24T20:06:04.777230+0000","last_active":"2023-12-24T20:06:04.777230+0000","last_peered":"2023-12-24T20:06:04.777230+0000","last_clean":"2023-12-24T20:06:04.777230+0000","last_became_active":"2023-12-24T20:06:04.776827+0000","last_became_peered":"2023-12-24T20:06:04.776827+0000","last_unstale":"2023-12-24T20:06:04.777230+0000","last_undegraded":"2023-12-24T20:06:04.777230+0000","last_fullsized":"2023-12-24T20:06:04.777230+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:17:37.919892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"167'8","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.792111+0000","last_change":"2023-12-24T20:06:03.774156+0000","last_active":"2023-12-24T20:06:04.792111+0000","last_peered":"2023-12-24T20:06:04.792111+0000","last_clean":"2023-12-24T20:06:04.792111+0000","last_became_active":"2023-12-24T20:06:03.773901+0000","last_became_peered":"2023-12-24T20:06:03.773901+0000","last_unstale":"2023-12-24T20:06:04.792111+0000","last_undegraded":"2023-12-24T20:06:04.792111+0000","last_fullsized":"2023-12-24T20:06:04.792111+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:24:31.728625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780117+0000","last_change":"2023-12-24T20:06:04.780117+0000","last_active":"2023-12-24T20:06:04.780117+0000","last_peered":"2023-12-24T20:06:04.780117+0000","last_clean":"2023-12-24T20:06:04.780117+0000","last_became_active":"2023-12-24T20:06:04.779409+0000","last_became_peered":"2023-12-24T20:06:04.779409+0000","last_unstale":"2023-12-24T20:06:04.780117+0000","last_undegraded":"2023-12-24T20:06:04.780117+0000","last_fullsized":"2023-12-24T20:06:04.780117+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:36:17.563280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.765189+0000","last_change":"2023-12-24T20:06:03.774094+0000","last_active":"2023-12-24T20:06:04.765189+0000","last_peered":"2023-12-24T20:06:04.765189+0000","last_clean":"2023-12-24T20:06:04.765189+0000","last_became_active":"2023-12-24T20:06:03.773854+0000","last_became_peered":"2023-12-24T20:06:03.773854+0000","last_unstale":"2023-12-24T20:06:04.765189+0000","last_undegraded":"2023-12-24T20:06:04.765189+0000","last_fullsized":"2023-12-24T20:06:04.765189+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:13:15.931368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.775274+0000","last_change":"2023-12-24T20:06:04.775274+0000","last_active":"2023-12-24T20:06:04.775274+0000","last_peered":"2023-12-24T20:06:04.775274+0000","last_clean":"2023-12-24T20:06:04.775274+0000","last_became_active":"2023-12-24T20:06:04.774999+0000","last_became_peered":"2023-12-24T20:06:04.774999+0000","last_unstale":"2023-12-24T20:06:04.775274+0000","last_undegraded":"2023-12-24T20:06:04.775274+0000","last_fullsized":"2023-12-24T20:06:04.775274+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:42:44.204616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.789312+0000","last_change":"2023-12-24T20:06:03.774286+0000","last_active":"2023-12-24T20:06:04.789312+0000","last_peered":"2023-12-24T20:06:04.789312+0000","last_clean":"2023-12-24T20:06:04.789312+0000","last_became_active":"2023-12-24T20:06:03.774059+0000","last_became_peered":"2023-12-24T20:06:03.774059+0000","last_unstale":"2023-12-24T20:06:04.789312+0000","last_undegraded":"2023-12-24T20:06:04.789312+0000","last_fullsized":"2023-12-24T20:06:04.789312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:00:27.950986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.782590+0000","last_change":"2023-12-24T20:06:04.782590+0000","last_active":"2023-12-24T20:06:04.782590+0000","last_peered":"2023-12-24T20:06:04.782590+0000","last_clean":"2023-12-24T20:06:04.782590+0000","last_became_active":"2023-12-24T20:06:04.781705+0000","last_became_peered":"2023-12-24T20:06:04.781705+0000","last_unstale":"2023-12-24T20:06:04.782590+0000","last_undegraded":"2023-12-24T20:06:04.782590+0000","last_fullsized":"2023-12-24T20:06:04.782590+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:49:41.482585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.772082+0000","last_change":"2023-12-24T20:06:03.772721+0000","last_active":"2023-12-24T20:06:04.772082+0000","last_peered":"2023-12-24T20:06:04.772082+0000","last_clean":"2023-12-24T20:06:04.772082+0000","last_became_active":"2023-12-24T20:06:03.772169+0000","last_became_peered":"2023-12-24T20:06:03.772169+0000","last_unstale":"2023-12-24T20:06:04.772082+0000","last_undegraded":"2023-12-24T20:06:04.772082+0000","last_fullsized":"2023-12-24T20:06:04.772082+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:58:16.312598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777458+0000","last_change":"2023-12-24T20:06:04.777458+0000","last_active":"2023-12-24T20:06:04.777458+0000","last_peered":"2023-12-24T20:06:04.777458+0000","last_clean":"2023-12-24T20:06:04.777458+0000","last_became_active":"2023-12-24T20:06:04.775823+0000","last_became_peered":"2023-12-24T20:06:04.775823+0000","last_unstale":"2023-12-24T20:06:04.777458+0000","last_undegraded":"2023-12-24T20:06:04.777458+0000","last_fullsized":"2023-12-24T20:06:04.777458+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:26:48.087191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.773399+0000","last_change":"2023-12-24T20:06:03.773326+0000","last_active":"2023-12-24T20:06:03.773399+0000","last_peered":"2023-12-24T20:06:03.773399+0000","last_clean":"2023-12-24T20:06:03.773399+0000","last_became_active":"2023-12-24T20:06:03.773090+0000","last_became_peered":"2023-12-24T20:06:03.773090+0000","last_unstale":"2023-12-24T20:06:03.773399+0000","last_undegraded":"2023-12-24T20:06:03.773399+0000","last_fullsized":"2023-12-24T20:06:03.773399+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:27:34.520993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777265+0000","last_change":"2023-12-24T20:06:04.777265+0000","last_active":"2023-12-24T20:06:04.777265+0000","last_peered":"2023-12-24T20:06:04.777265+0000","last_clean":"2023-12-24T20:06:04.777265+0000","last_became_active":"2023-12-24T20:06:04.776790+0000","last_became_peered":"2023-12-24T20:06:04.776790+0000","last_unstale":"2023-12-24T20:06:04.777265+0000","last_undegraded":"2023-12-24T20:06:04.777265+0000","last_fullsized":"2023-12-24T20:06:04.777265+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:17:37.919892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.789104+0000","last_change":"2023-12-24T20:06:03.775367+0000","last_active":"2023-12-24T20:06:04.789104+0000","last_peered":"2023-12-24T20:06:04.789104+0000","last_clean":"2023-12-24T20:06:04.789104+0000","last_became_active":"2023-12-24T20:06:03.775127+0000","last_became_peered":"2023-12-24T20:06:03.775127+0000","last_unstale":"2023-12-24T20:06:04.789104+0000","last_undegraded":"2023-12-24T20:06:04.789104+0000","last_fullsized":"2023-12-24T20:06:04.789104+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:10:57.083499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780053+0000","last_change":"2023-12-24T20:06:04.780053+0000","last_active":"2023-12-24T20:06:04.780053+0000","last_peered":"2023-12-24T20:06:04.780053+0000","last_clean":"2023-12-24T20:06:04.780053+0000","last_became_active":"2023-12-24T20:06:04.779749+0000","last_became_peered":"2023-12-24T20:06:04.779749+0000","last_unstale":"2023-12-24T20:06:04.780053+0000","last_undegraded":"2023-12-24T20:06:04.780053+0000","last_fullsized":"2023-12-24T20:06:04.780053+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:19:48.503550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.775007+0000","last_change":"2023-12-24T20:06:03.774485+0000","last_active":"2023-12-24T20:06:03.775007+0000","last_peered":"2023-12-24T20:06:03.775007+0000","last_clean":"2023-12-24T20:06:03.775007+0000","last_became_active":"2023-12-24T20:06:03.773871+0000","last_became_peered":"2023-12-24T20:06:03.773871+0000","last_unstale":"2023-12-24T20:06:03.775007+0000","last_undegraded":"2023-12-24T20:06:03.775007+0000","last_fullsized":"2023-12-24T20:06:03.775007+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:09.686324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780998+0000","last_change":"2023-12-24T20:06:04.780998+0000","last_active":"2023-12-24T20:06:04.780998+0000","last_peered":"2023-12-24T20:06:04.780998+0000","last_clean":"2023-12-24T20:06:04.780998+0000","last_became_active":"2023-12-24T20:06:04.780780+0000","last_became_peered":"2023-12-24T20:06:04.780780+0000","last_unstale":"2023-12-24T20:06:04.780998+0000","last_undegraded":"2023-12-24T20:06:04.780998+0000","last_fullsized":"2023-12-24T20:06:04.780998+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:38:22.251663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.775026+0000","last_change":"2023-12-24T20:06:03.774949+0000","last_active":"2023-12-24T20:06:03.775026+0000","last_peered":"2023-12-24T20:06:03.775026+0000","last_clean":"2023-12-24T20:06:03.775026+0000","last_became_active":"2023-12-24T20:06:03.774726+0000","last_became_peered":"2023-12-24T20:06:03.774726+0000","last_unstale":"2023-12-24T20:06:03.775026+0000","last_undegraded":"2023-12-24T20:06:03.775026+0000","last_fullsized":"2023-12-24T20:06:03.775026+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:27:46.563951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.779416+0000","last_change":"2023-12-24T20:06:04.779416+0000","last_active":"2023-12-24T20:06:04.779416+0000","last_peered":"2023-12-24T20:06:04.779416+0000","last_clean":"2023-12-24T20:06:04.779416+0000","last_became_active":"2023-12-24T20:06:04.779172+0000","last_became_peered":"2023-12-24T20:06:04.779172+0000","last_unstale":"2023-12-24T20:06:04.779416+0000","last_undegraded":"2023-12-24T20:06:04.779416+0000","last_fullsized":"2023-12-24T20:06:04.779416+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:50:18.741848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.773176+0000","last_change":"2023-12-24T20:06:03.771901+0000","last_active":"2023-12-24T20:06:03.773176+0000","last_peered":"2023-12-24T20:06:03.773176+0000","last_clean":"2023-12-24T20:06:03.773176+0000","last_became_active":"2023-12-24T20:06:03.771640+0000","last_became_peered":"2023-12-24T20:06:03.771640+0000","last_unstale":"2023-12-24T20:06:03.773176+0000","last_undegraded":"2023-12-24T20:06:03.773176+0000","last_fullsized":"2023-12-24T20:06:03.773176+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:43:56.385401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774959+0000","last_change":"2023-12-24T20:06:04.774959+0000","last_active":"2023-12-24T20:06:04.774959+0000","last_peered":"2023-12-24T20:06:04.774959+0000","last_clean":"2023-12-24T20:06:04.774959+0000","last_became_active":"2023-12-24T20:06:04.774252+0000","last_became_peered":"2023-12-24T20:06:04.774252+0000","last_unstale":"2023-12-24T20:06:04.774959+0000","last_undegraded":"2023-12-24T20:06:04.774959+0000","last_fullsized":"2023-12-24T20:06:04.774959+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:16:28.754953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.788712+0000","last_change":"2023-12-24T20:06:03.775911+0000","last_active":"2023-12-24T20:06:04.788712+0000","last_peered":"2023-12-24T20:06:04.788712+0000","last_clean":"2023-12-24T20:06:04.788712+0000","last_became_active":"2023-12-24T20:06:03.775256+0000","last_became_peered":"2023-12-24T20:06:03.775256+0000","last_unstale":"2023-12-24T20:06:04.788712+0000","last_undegraded":"2023-12-24T20:06:04.788712+0000","last_fullsized":"2023-12-24T20:06:04.788712+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:05:54.829653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.782781+0000","last_change":"2023-12-24T20:06:04.782781+0000","last_active":"2023-12-24T20:06:04.782781+0000","last_peered":"2023-12-24T20:06:04.782781+0000","last_clean":"2023-12-24T20:06:04.782781+0000","last_became_active":"2023-12-24T20:06:04.782280+0000","last_became_peered":"2023-12-24T20:06:04.782280+0000","last_unstale":"2023-12-24T20:06:04.782781+0000","last_undegraded":"2023-12-24T20:06:04.782781+0000","last_fullsized":"2023-12-24T20:06:04.782781+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:30:48.692125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.771278+0000","last_change":"2023-12-24T20:06:03.771202+0000","last_active":"2023-12-24T20:06:03.771278+0000","last_peered":"2023-12-24T20:06:03.771278+0000","last_clean":"2023-12-24T20:06:03.771278+0000","last_became_active":"2023-12-24T20:06:03.770921+0000","last_became_peered":"2023-12-24T20:06:03.770921+0000","last_unstale":"2023-12-24T20:06:03.771278+0000","last_undegraded":"2023-12-24T20:06:03.771278+0000","last_fullsized":"2023-12-24T20:06:03.771278+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:58:49.749013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.781798+0000","last_change":"2023-12-24T20:06:04.781798+0000","last_active":"2023-12-24T20:06:04.781798+0000","last_peered":"2023-12-24T20:06:04.781798+0000","last_clean":"2023-12-24T20:06:04.781798+0000","last_became_active":"2023-12-24T20:06:04.781557+0000","last_became_peered":"2023-12-24T20:06:04.781557+0000","last_unstale":"2023-12-24T20:06:04.781798+0000","last_undegraded":"2023-12-24T20:06:04.781798+0000","last_fullsized":"2023-12-24T20:06:04.781798+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:29:05.983460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.772861+0000","last_change":"2023-12-24T20:06:03.772635+0000","last_active":"2023-12-24T20:06:03.772861+0000","last_peered":"2023-12-24T20:06:03.772861+0000","last_clean":"2023-12-24T20:06:03.772861+0000","last_became_active":"2023-12-24T20:06:03.771941+0000","last_became_peered":"2023-12-24T20:06:03.771941+0000","last_unstale":"2023-12-24T20:06:03.772861+0000","last_undegraded":"2023-12-24T20:06:03.772861+0000","last_fullsized":"2023-12-24T20:06:03.772861+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:34:54.413899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780448+0000","last_change":"2023-12-24T20:06:04.780448+0000","last_active":"2023-12-24T20:06:04.780448+0000","last_peered":"2023-12-24T20:06:04.780448+0000","last_clean":"2023-12-24T20:06:04.780448+0000","last_became_active":"2023-12-24T20:06:04.780206+0000","last_became_peered":"2023-12-24T20:06:04.780206+0000","last_unstale":"2023-12-24T20:06:04.780448+0000","last_undegraded":"2023-12-24T20:06:04.780448+0000","last_fullsized":"2023-12-24T20:06:04.780448+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:36:54.731492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.773407+0000","last_change":"2023-12-24T20:06:03.773250+0000","last_active":"2023-12-24T20:06:03.773407+0000","last_peered":"2023-12-24T20:06:03.773407+0000","last_clean":"2023-12-24T20:06:03.773407+0000","last_became_active":"2023-12-24T20:06:03.772991+0000","last_became_peered":"2023-12-24T20:06:03.772991+0000","last_unstale":"2023-12-24T20:06:03.773407+0000","last_undegraded":"2023-12-24T20:06:03.773407+0000","last_fullsized":"2023-12-24T20:06:03.773407+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:17:34.162171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.776519+0000","last_change":"2023-12-24T20:06:04.776519+0000","last_active":"2023-12-24T20:06:04.776519+0000","last_peered":"2023-12-24T20:06:04.776519+0000","last_clean":"2023-12-24T20:06:04.776519+0000","last_became_active":"2023-12-24T20:06:04.775767+0000","last_became_peered":"2023-12-24T20:06:04.775767+0000","last_unstale":"2023-12-24T20:06:04.776519+0000","last_undegraded":"2023-12-24T20:06:04.776519+0000","last_fullsized":"2023-12-24T20:06:04.776519+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:47:43.878475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.765314+0000","last_change":"2023-12-24T20:06:03.765230+0000","last_active":"2023-12-24T20:06:03.765314+0000","last_peered":"2023-12-24T20:06:03.765314+0000","last_clean":"2023-12-24T20:06:03.765314+0000","last_became_active":"2023-12-24T20:06:03.764980+0000","last_became_peered":"2023-12-24T20:06:03.764980+0000","last_unstale":"2023-12-24T20:06:03.765314+0000","last_undegraded":"2023-12-24T20:06:03.765314+0000","last_fullsized":"2023-12-24T20:06:03.765314+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:48:47.629609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.774393+0000","last_change":"2023-12-24T20:06:04.774393+0000","last_active":"2023-12-24T20:06:04.774393+0000","last_peered":"2023-12-24T20:06:04.774393+0000","last_clean":"2023-12-24T20:06:04.774393+0000","last_became_active":"2023-12-24T20:06:04.774158+0000","last_became_peered":"2023-12-24T20:06:04.774158+0000","last_unstale":"2023-12-24T20:06:04.774393+0000","last_undegraded":"2023-12-24T20:06:04.774393+0000","last_fullsized":"2023-12-24T20:06:04.774393+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:44:35.608952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.776125+0000","last_change":"2023-12-24T20:06:03.776061+0000","last_active":"2023-12-24T20:06:03.776125+0000","last_peered":"2023-12-24T20:06:03.776125+0000","last_clean":"2023-12-24T20:06:03.776125+0000","last_became_active":"2023-12-24T20:06:03.775607+0000","last_became_peered":"2023-12-24T20:06:03.775607+0000","last_unstale":"2023-12-24T20:06:03.776125+0000","last_undegraded":"2023-12-24T20:06:03.776125+0000","last_fullsized":"2023-12-24T20:06:03.776125+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:20:36.834618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.778392+0000","last_change":"2023-12-24T20:06:04.778392+0000","last_active":"2023-12-24T20:06:04.778392+0000","last_peered":"2023-12-24T20:06:04.778392+0000","last_clean":"2023-12-24T20:06:04.778392+0000","last_became_active":"2023-12-24T20:06:04.778011+0000","last_became_peered":"2023-12-24T20:06:04.778011+0000","last_unstale":"2023-12-24T20:06:04.778392+0000","last_undegraded":"2023-12-24T20:06:04.778392+0000","last_fullsized":"2023-12-24T20:06:04.778392+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:52:58.121829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.773207+0000","last_change":"2023-12-24T20:06:03.772919+0000","last_active":"2023-12-24T20:06:03.773207+0000","last_peered":"2023-12-24T20:06:03.773207+0000","last_clean":"2023-12-24T20:06:03.773207+0000","last_became_active":"2023-12-24T20:06:03.771489+0000","last_became_peered":"2023-12-24T20:06:03.771489+0000","last_unstale":"2023-12-24T20:06:03.773207+0000","last_undegraded":"2023-12-24T20:06:03.773207+0000","last_fullsized":"2023-12-24T20:06:03.773207+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:58:51.170260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.777930+0000","last_change":"2023-12-24T20:06:04.777930+0000","last_active":"2023-12-24T20:06:04.777930+0000","last_peered":"2023-12-24T20:06:04.777930+0000","last_clean":"2023-12-24T20:06:04.777930+0000","last_became_active":"2023-12-24T20:06:04.775370+0000","last_became_peered":"2023-12-24T20:06:04.775370+0000","last_unstale":"2023-12-24T20:06:04.777930+0000","last_undegraded":"2023-12-24T20:06:04.777930+0000","last_fullsized":"2023-12-24T20:06:04.777930+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:40:35.912407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.771170+0000","last_change":"2023-12-24T20:06:03.771104+0000","last_active":"2023-12-24T20:06:03.771170+0000","last_peered":"2023-12-24T20:06:03.771170+0000","last_clean":"2023-12-24T20:06:03.771170+0000","last_became_active":"2023-12-24T20:06:03.770555+0000","last_became_peered":"2023-12-24T20:06:03.770555+0000","last_unstale":"2023-12-24T20:06:03.771170+0000","last_undegraded":"2023-12-24T20:06:03.771170+0000","last_fullsized":"2023-12-24T20:06:03.771170+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:38:37.330332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.780548+0000","last_change":"2023-12-24T20:06:04.780548+0000","last_active":"2023-12-24T20:06:04.780548+0000","last_peered":"2023-12-24T20:06:04.780548+0000","last_clean":"2023-12-24T20:06:04.780548+0000","last_became_active":"2023-12-24T20:06:04.780273+0000","last_became_peered":"2023-12-24T20:06:04.780273+0000","last_unstale":"2023-12-24T20:06:04.780548+0000","last_undegraded":"2023-12-24T20:06:04.780548+0000","last_fullsized":"2023-12-24T20:06:04.780548+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:03.755419+0000","last_clean_scrub_stamp":"2023-12-24T20:06:03.755419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:23:09.569359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"167'3","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-12-24T20:06:04.789952+0000","last_change":"2023-12-24T20:06:03.773177+0000","last_active":"2023-12-24T20:06:04.789952+0000","last_peered":"2023-12-24T20:06:04.789952+0000","last_clean":"2023-12-24T20:06:04.789952+0000","last_became_active":"2023-12-24T20:06:03.772271+0000","last_became_peered":"2023-12-24T20:06:03.772271+0000","last_unstale":"2023-12-24T20:06:04.789952+0000","last_undegraded":"2023-12-24T20:06:04.789952+0000","last_fullsized":"2023-12-24T20:06:04.789952+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:06:02.750099+0000","last_clean_scrub_stamp":"2023-12-24T20:06:02.750099+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:28:09.686324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":289,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-12-24T20:06:03.769094+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:06:03.769094+0000","last_peered":"2023-12-24T20:06:03.769094+0000","last_clean":"2023-12-24T20:06:03.769094+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:06:03.769094+0000","last_undegraded":"2023-12-24T20:06:03.769094+0000","last_fullsized":"2023-12-24T20:06:03.769094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1487,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193825,"statfs":{"total":200000000,"available":198477012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.47699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.81200000000000006,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55000000000000004,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.754},"last":0.755}]},{"osd":1,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57899999999999996,"15min":0.56399999999999995},"min":{"1min":0.39000000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78900000000000003,"5min":0.872,"15min":0.872},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56599999999999995,"15min":0.54700000000000004},"min":{"1min":0.46700000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.72099999999999997}]},{"osd":2,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58399999999999996,"15min":0.55100000000000005},"min":{"1min":0.432,"5min":0.36099999999999999,"15min":0.34100000000000003},"max":{"1min":0.76700000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.437,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.73799999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58699999999999997,"15min":0.57799999999999996},"min":{"1min":0.47599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60999999999999999,"15min":0.621},"min":{"1min":0.439,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.751,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47499999999999998,"15min":0.51600000000000001},"min":{"1min":0.29099999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.82799999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.499,"15min":0.56200000000000006},"min":{"1min":0.316,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":0.95699999999999996},"last":0.45400000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68700000000000006,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52500000000000002,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71499999999999997,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51800000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55300000000000005,"15min":0.58299999999999996},"min":{"1min":0.39600000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68700000000000006,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58899999999999997,"15min":0.61399999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.75600000000000001,"5min":0.82599999999999996,"15min":0.873},"last":0.54000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":910,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194402,"statfs":{"total":200000000,"available":199067788,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.54700000000000004,"15min":0.52800000000000002},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.32600000000000001},"max":{"1min":0.74099999999999999,"5min":0.84899999999999998,"15min":1.0309999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77700000000000002,"5min":0.79400000000000004,"15min":0.82499999999999996},"last":0.44600000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.47399999999999998,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.73699999999999999,"5min":0.80900000000000005,"15min":0.95799999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.32700000000000001,"15min":0.30499999999999999},"max":{"1min":0.72099999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.5}]},{"osd":2,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57699999999999996,"15min":0.55500000000000005},"min":{"1min":0.42899999999999999,"5min":0.34499999999999997,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.53600000000000003},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.33200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":1.0640000000000001},"last":0.55500000000000005}]},{"osd":3,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.45300000000000001,"5min":0.38900000000000001,"15min":0.38200000000000001},"max":{"1min":0.72599999999999998,"5min":0.83399999999999996,"15min":1.077},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.58699999999999997},"min":{"1min":0.51400000000000001,"5min":0.42899999999999999,"15min":0.372},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.048},"last":0.623}]},{"osd":4,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48399999999999999,"15min":0.47399999999999998},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65400000000000003,"5min":0.72499999999999998,"15min":0.78600000000000003},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.36899999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69899999999999995,"5min":0.76800000000000002,"15min":0.82899999999999996},"last":0.67900000000000005}]},{"osd":5,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.86499999999999999},"last":0.745},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50900000000000001,"15min":0.503},"min":{"1min":0.35899999999999999,"5min":0.33000000000000002,"15min":0.254},"max":{"1min":0.64100000000000001,"5min":0.72699999999999998,"15min":0.84699999999999998},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:05:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54100000000000004,"15min":0.54300000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64500000000000002,"5min":0.79900000000000004,"15min":0.83999999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.60899999999999999},"min":{"1min":0.46200000000000002,"5min":0.373,"15min":0.35099999999999998},"max":{"1min":0.75600000000000001,"5min":0.82499999999999996,"15min":0.88500000000000001},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074697,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.36099999999999999,"15min":0.35099999999999998},"min":{"1min":0.28000000000000003,"5min":0.187,"15min":0.187},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.316},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.39600000000000002,"15min":0.372},"min":{"1min":0.28899999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.39900000000000002,"15min":0.377},"min":{"1min":0.309,"5min":0.216,"15min":0.216},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.374},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.371},"min":{"1min":0.28999999999999998,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.28899999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.41699999999999998},"min":{"1min":0.34000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41899999999999998,"15min":0.40300000000000002},"min":{"1min":0.33700000000000002,"5min":0.28899999999999998,"15min":0.25},"max":{"1min":0.59799999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.622,"15min":0.60199999999999998},"min":{"1min":0.47899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.82499999999999996,"5min":0.871,"15min":0.871},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.626,"15min":0.58799999999999997},"min":{"1min":0.50700000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.93300000000000005,"5min":1.014,"15min":1.014},"last":0.51900000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.49399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98799999999999999,"5min":1.04,"15min":1.04},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.63500000000000001,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61599999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.65600000000000003,"15min":0.61899999999999999},"min":{"1min":0.46800000000000003,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96999999999999997,"5min":1.012,"15min":1.012},"last":0.626},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67000000000000004,"15min":0.63},"min":{"1min":0.48199999999999998,"5min":0.41999999999999998,"15min":0.39500000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.65400000000000003},"min":{"1min":0.53000000000000003,"5min":0.47599999999999998,"15min":0.46300000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1486,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193825,"statfs":{"total":200000000,"available":198477566,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35399999999999998,"15min":0.40600000000000003},"min":{"1min":0.26500000000000001,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.39700000000000002,"15min":0.374},"min":{"1min":0.28100000000000003,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.97999999999999998},"last":0.29999999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.48599999999999999,"5min":0.59799999999999998,"15min":0.92700000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40200000000000002},"min":{"1min":0.30599999999999999,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.93999999999999995},"last":0.34000000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42499999999999999,"15min":0.45300000000000001},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63300000000000001,"5min":0.70199999999999996,"15min":2.573},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.45000000000000001,"15min":0.42999999999999999},"min":{"1min":0.376,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.60599999999999998,"5min":0.64000000000000001,"15min":0.67600000000000005},"last":0.379}]},{"osd":4,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.872,"5min":0.93700000000000006,"15min":1.3500000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61899999999999999,"15min":0.66400000000000003},"min":{"1min":0.5,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.78200000000000003,"5min":0.97499999999999998,"15min":2.7149999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.70099999999999996},"min":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.372},"max":{"1min":0.89100000000000001,"5min":1.01,"15min":2.6859999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":0.90800000000000003,"15min":0.93000000000000005},"last":0.67300000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.60999999999999999},"min":{"1min":0.496,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79400000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91100000000000003,"5min":0.97499999999999998,"15min":1.0489999999999999},"last":0.55400000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:05:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.52500000000000002,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.877,"5min":0.96599999999999997,"15min":1.5429999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66200000000000003,"15min":0.70999999999999996},"min":{"1min":0.58499999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.70799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":911,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199066328,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.28199999999999997,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.61599999999999999,"5min":0.67700000000000005,"15min":0.78900000000000003},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.39000000000000001,"15min":0.378},"min":{"1min":0.311,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":0.65600000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.254}]},{"osd":1,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.29099999999999998,"5min":0.23899999999999999,"15min":0.20200000000000001},"max":{"1min":0.54400000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.41699999999999998,"15min":0.40799999999999997},"min":{"1min":0.27700000000000002,"5min":0.27500000000000002,"15min":0.27200000000000002},"max":{"1min":0.59199999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.28699999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.435,"15min":0.42599999999999999},"min":{"1min":0.35999999999999999,"5min":0.29599999999999999,"15min":0.27200000000000002},"max":{"1min":0.65100000000000002,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.41699999999999998},"min":{"1min":0.33600000000000002,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.55400000000000005,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.308}]},{"osd":4,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.621,"15min":0.624},"min":{"1min":0.48399999999999999,"5min":0.375,"15min":0.35999999999999999},"max":{"1min":0.84299999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.625,"15min":0.62},"min":{"1min":0.47499999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94999999999999996,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.47999999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.63300000000000001},"min":{"1min":0.44900000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86899999999999999,"5min":1.1559999999999999,"15min":3.577},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.65900000000000003},"min":{"1min":0.53900000000000003,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":1.2809999999999999,"15min":7.0220000000000002},"last":0.35999999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.52600000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85199999999999998,"5min":1.298,"15min":1.298},"last":0.377},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.497,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85199999999999998,"5min":1.111,"15min":3.637},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:05:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66000000000000003,"15min":0.66400000000000003},"min":{"1min":0.57999999999999996,"5min":0.45300000000000001,"15min":0.42699999999999999},"max":{"1min":0.98099999999999998,"5min":1.141,"15min":7.0599999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67100000000000004,"15min":0.68000000000000005},"min":{"1min":0.501,"5min":0.439,"15min":0.439},"max":{"1min":0.89700000000000002,"5min":1.232,"15min":1.331},"last":0.51600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074697,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.371,"15min":0.33700000000000002},"min":{"1min":0.29999999999999999,"5min":0.22600000000000001,"15min":0.182},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.35999999999999999},"min":{"1min":0.32200000000000001,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.60499999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.27200000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.223},"max":{"1min":0.55800000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.254},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42399999999999999,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.32700000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.42799999999999999,"15min":0.41099999999999998},"min":{"1min":0.36099999999999999,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.66500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.45100000000000001,"15min":0.42999999999999999},"min":{"1min":0.35099999999999998,"5min":0.29399999999999998,"15min":0.27300000000000002},"max":{"1min":0.623,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35899999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61499999999999999,"15min":0.60399999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63,"15min":0.60999999999999999},"min":{"1min":0.39500000000000002,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.92100000000000004,"5min":0.94999999999999996,"15min":1.337},"last":0.88700000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.63600000000000001,"15min":0.61599999999999999},"min":{"1min":0.45700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81699999999999995,"5min":0.92400000000000004,"15min":1.2010000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.50900000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83099999999999996,"5min":0.89900000000000002,"15min":0.97799999999999998},"last":0.80300000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64900000000000002,"15min":0.625},"min":{"1min":0.48799999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.1699999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.65800000000000003,"15min":0.63},"min":{"1min":0.42599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86799999999999999,"5min":0.999,"15min":1.4570000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66900000000000004,"15min":0.64500000000000002},"min":{"1min":0.51900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.91900000000000004,"5min":1.0149999999999999,"15min":1.3779999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67400000000000004,"15min":0.64600000000000002},"min":{"1min":0.54500000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.006},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074697,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.44700000000000001,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71799999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.752,"5min":0.77300000000000002,"15min":0.82199999999999995},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57399999999999995,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":4.883},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55400000000000005,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.69199999999999995,"5min":0.78200000000000003,"15min":1.544},"last":0.503}]},{"osd":2,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.45800000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.88},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.44600000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79100000000000004,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.502,"5min":0.38600000000000001,"15min":0.33300000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.441},{"interface":"front","average":{"1min":0.62,"5min":0.57299999999999995,"15min":0.80700000000000005},"min":{"1min":0.439,"5min":0.374,"15min":0.374},"max":{"1min":0.72999999999999998,"5min":0.77300000000000002,"15min":8.8200000000000003},"last":0.52100000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45000000000000001,"15min":0.503},"min":{"1min":0.34000000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59199999999999997,"5min":0.745,"15min":1.4419999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.498,"15min":0.60499999999999998},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70799999999999996,"5min":0.80300000000000005,"15min":3.8279999999999998},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.504,"15min":0.52700000000000002},"min":{"1min":0.35199999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.61499999999999999},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.33800000000000002},"max":{"1min":0.72399999999999998,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.63}]},{"osd":7,"last update":"Sun Dec 24 20:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53200000000000003,"15min":0.92400000000000004},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.65800000000000003,"5min":0.75600000000000001,"15min":14.039999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.54500000000000004},"min":{"1min":0.375,"5min":0.36599999999999999,"15min":0.31},"max":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.78300000000000003},"last":0.60599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074697,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.52500000000000002},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.74299999999999999,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58899999999999997,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.79100000000000004,"5min":0.83299999999999996,"15min":4.6059999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.50600000000000001,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":1.847},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.35599999999999998},"max":{"1min":0.72799999999999998,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.66900000000000004}]},{"osd":2,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56799999999999995,"15min":0.53700000000000003},"min":{"1min":0.46899999999999997,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58899999999999997,"15min":0.55600000000000005},"min":{"1min":0.51000000000000001,"5min":0.371,"15min":0.37},"max":{"1min":0.70199999999999996,"5min":0.79100000000000004,"15min":1.97},"last":0.89800000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.621,"15min":0.58599999999999997},"min":{"1min":0.50700000000000001,"5min":0.41599999999999998,"15min":0.38},"max":{"1min":0.82099999999999995,"5min":0.82599999999999996,"15min":3.2850000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.62,"15min":0.57699999999999996},"min":{"1min":0.498,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.83699999999999997},"last":0.877}]},{"osd":4,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48999999999999999,"15min":0.49099999999999999},"min":{"1min":0.31900000000000001,"5min":0.312,"15min":0.252},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":1.3320000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.373,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.751,"5min":0.77000000000000002,"15min":4.5330000000000004},"last":1.0589999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.48099999999999998},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.30299999999999999},"max":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.79000000000000004},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.29499999999999998,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.78600000000000003,"15min":1.8839999999999999},"last":0.96499999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56599999999999995,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.81799999999999995,"5min":0.96899999999999997,"15min":3.766},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57699999999999996,"15min":0.55500000000000005},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.73999999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.93000000000000005}]}]}],"pool_statfs":[]}} 2023-12-24T20:06:09.325 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T20:06:09.325 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T20:06:09.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.490+0000 7f1110f91700 1 Processor -- start 2023-12-24T20:06:09.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.490+0000 7f1110f91700 1 -- start start 2023-12-24T20:06:09.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.491+0000 7f1110f91700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c0ce030 0x7f110c068df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.491+0000 7f1110f91700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f110c159f10 0x7f110c067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.491+0000 7f1110f91700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c15d900 con 0x7f110c06b560 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.491+0000 7f1110f91700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c15e910 con 0x7f110c159f10 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.491+0000 7f1110f91700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c15e480 con 0x7f110c0ce030 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.491+0000 7f110a59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c0ce030 0x7f110c068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.491+0000 7f110ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f110c159f10 0x7f110c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f110c159f10 0x7f110c067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:49990/0 (socket says 172.21.15.61:49990) 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110a59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c0ce030 0x7f110c068df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:41280/0 (socket says 172.21.15.61:41280) 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110ad9d700 1 -- 172.21.15.61:0/81875368 learned_addr learned my addr 172.21.15.61:0/81875368 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110a59c700 1 -- 172.21.15.61:0/81875368 >> v2:172.21.15.133:3300/0 conn(0x7f110c159f10 msgr2=0x7f110c067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110a59c700 1 --2- 172.21.15.61:0/81875368 >> v2:172.21.15.133:3300/0 conn(0x7f110c159f10 0x7f110c067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110a59c700 1 -- 172.21.15.61:0/81875368 >> v1:172.21.15.133:6789/0 conn(0x7f110c06b560 legacy=0x7f110c159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110a59c700 1 -- 172.21.15.61:0/81875368 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c15db50 con 0x7f110c0ce030 2023-12-24T20:06:09.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110959a700 1 -- 172.21.15.61:0/81875368 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353294355 0 0) 0x7f110c15d900 con 0x7f110c06b560 2023-12-24T20:06:09.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110ad9d700 1 --2- 172.21.15.61:0/81875368 >> v2:172.21.15.133:3300/0 conn(0x7f110c159f10 0x7f110c067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:06:09.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110a59c700 1 --2- 172.21.15.61:0/81875368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c0ce030 0x7f110c068df0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f11000098e0 tx=0x7f11000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c364fe7c296e5cc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:09.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110959a700 1 -- 172.21.15.61:0/81875368 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000b640 con 0x7f110c0ce030 2023-12-24T20:06:09.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110959a700 1 -- 172.21.15.61:0/81875368 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110000b7a0 con 0x7f110c0ce030 2023-12-24T20:06:09.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.492+0000 7f110959a700 1 -- 172.21.15.61:0/81875368 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000bb40 con 0x7f110c0ce030 2023-12-24T20:06:09.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.493+0000 7f1110f91700 1 -- 172.21.15.61:0/81875368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c0ce030 msgr2=0x7f110c068df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.493+0000 7f1110f91700 1 --2- 172.21.15.61:0/81875368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c0ce030 0x7f110c068df0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f11000098e0 tx=0x7f11000091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.493+0000 7f1110f91700 1 -- 172.21.15.61:0/81875368 shutdown_connections 2023-12-24T20:06:09.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.493+0000 7f1110f91700 1 --2- 172.21.15.61:0/81875368 >> v2:172.21.15.133:3300/0 conn(0x7f110c159f10 0x7f110c067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.493+0000 7f1110f91700 1 --2- 172.21.15.61:0/81875368 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c0ce030 0x7f110c068df0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.493+0000 7f1110f91700 1 -- 172.21.15.61:0/81875368 >> 172.21.15.61:0/81875368 conn(0x7f110c06f810 msgr2=0x7f110c06ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:09.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.493+0000 7f1110f91700 1 -- 172.21.15.61:0/81875368 shutdown_connections 2023-12-24T20:06:09.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.493+0000 7f1110f91700 1 -- 172.21.15.61:0/81875368 wait complete. 2023-12-24T20:06:09.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.494+0000 7f1110f91700 1 Processor -- start 2023-12-24T20:06:09.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.494+0000 7f1110f91700 1 -- start start 2023-12-24T20:06:09.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f1110f91700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c06b560 0x7f110c0c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f1110f91700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0ce030 0x7f110c156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f1110f91700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f110c159f10 0x7f110c15cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f1110f91700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c156cd0 con 0x7f110c159f10 2023-12-24T20:06:09.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f1110f91700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c15d140 con 0x7f110c0ce030 2023-12-24T20:06:09.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f1110f91700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0c9140 con 0x7f110c06b560 2023-12-24T20:06:09.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f110ad9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f110c159f10 0x7f110c15cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f110ad9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f110c159f10 0x7f110c15cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35346/0 (socket says 172.21.15.61:35346) 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f110ad9d700 1 -- 172.21.15.61:0/657701819 learned_addr learned my addr 172.21.15.61:0/657701819 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f110a59c700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c06b560 0x7f110c0c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f1109d9b700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0ce030 0x7f110c156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f110ad9d700 1 -- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c06b560 msgr2=0x7f110c0c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f110ad9d700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c06b560 0x7f110c0c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f110ad9d700 1 -- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0ce030 msgr2=0x7f110c156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f110ad9d700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0ce030 0x7f110c156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f110ad9d700 1 -- 172.21.15.61:0/657701819 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104009ae0 con 0x7f110c159f10 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.495+0000 7f110ad9d700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f110c159f10 0x7f110c15cc00 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f1104009fd0 tx=0x7f110400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.496+0000 7f10fa7fc700 1 -- 172.21.15.61:0/657701819 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104018070 con 0x7f110c159f10 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.496+0000 7f10fa7fc700 1 -- 172.21.15.61:0/657701819 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110400f040 con 0x7f110c159f10 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.496+0000 7f10fa7fc700 1 -- 172.21.15.61:0/657701819 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400cbd0 con 0x7f110c159f10 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.496+0000 7f1110f91700 1 -- 172.21.15.61:0/657701819 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1100009420 con 0x7f110c159f10 2023-12-24T20:06:09.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.496+0000 7f1110f91700 1 -- 172.21.15.61:0/657701819 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c0c9700 con 0x7f110c159f10 2023-12-24T20:06:09.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.497+0000 7f1110f91700 1 -- 172.21.15.61:0/657701819 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c04c3c0 con 0x7f110c159f10 2023-12-24T20:06:09.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.497+0000 7f10fa7fc700 1 -- 172.21.15.61:0/657701819 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1104003020 con 0x7f110c159f10 2023-12-24T20:06:09.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.497+0000 7f10fa7fc700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10ec066f30 0x7f10ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.497+0000 7f10fa7fc700 1 -- 172.21.15.61:0/657701819 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1104084a00 con 0x7f110c159f10 2023-12-24T20:06:09.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.498+0000 7f110a59c700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10ec066f30 0x7f10ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.498+0000 7f110a59c700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10ec066f30 0x7f10ec0693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f11000091e0 tx=0x7f1100017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:09.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.502+0000 7f10fa7fc700 1 -- 172.21.15.61:0/657701819 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1104051c70 con 0x7f110c159f10 2023-12-24T20:06:09.752 INFO:tasks.ceph.mds.a.smithi061.stderr:2023-12-24T20:06:09.752+0000 7fa905b7b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:06:09.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.781+0000 7f1110f91700 1 -- 172.21.15.61:0/657701819 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f110c15de30 con 0x7f110c159f10 2023-12-24T20:06:09.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.785+0000 7f10fa7fc700 1 -- 172.21.15.61:0/657701819 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1104055290 con 0x7f110c159f10 2023-12-24T20:06:09.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 -- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10ec066f30 msgr2=0x7f10ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10ec066f30 0x7f10ec0693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f11000091e0 tx=0x7f1100017000 comp rx=0 tx=0).stop 2023-12-24T20:06:09.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 -- 172.21.15.61:0/657701819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f110c159f10 msgr2=0x7f110c15cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f110c159f10 0x7f110c15cc00 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f1104009fd0 tx=0x7f110400b040 comp rx=0 tx=0).stop 2023-12-24T20:06:09.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 -- 172.21.15.61:0/657701819 shutdown_connections 2023-12-24T20:06:09.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f110c06b560 0x7f110c0c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f10ec066f30 0x7f10ec0693e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f110c159f10 0x7f110c15cc00 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 --2- 172.21.15.61:0/657701819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0ce030 0x7f110c156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 -- 172.21.15.61:0/657701819 >> 172.21.15.61:0/657701819 conn(0x7f110c06f810 msgr2=0x7f110c0c4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:09.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 -- 172.21.15.61:0/657701819 shutdown_connections 2023-12-24T20:06:09.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.787+0000 7f1110f91700 1 -- 172.21.15.61:0/657701819 wait complete. 2023-12-24T20:06:09.789 INFO:teuthology.orchestra.run.smithi061.stderr:updated caps for client.0 2023-12-24T20:06:09.800 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:06:09.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.921+0000 7fc5a7dd3700 1 Processor -- start 2023-12-24T20:06:09.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.922+0000 7fc5a7dd3700 1 -- start start 2023-12-24T20:06:09.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.922+0000 7fc5a7dd3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5a0159e60 0x7fc5a00c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.922+0000 7fc5a7dd3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a0070d50 0x7fc5a00c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.922+0000 7fc5a7dd3700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a006a090 con 0x7fc5a0159a90 2023-12-24T20:06:09.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.922+0000 7fc5a7dd3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a006ac10 con 0x7fc5a0159e60 2023-12-24T20:06:09.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.922+0000 7fc5a7dd3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00c9e40 con 0x7fc5a0070d50 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a5b6f700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fc5a0159a90 0x7fc5a0070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51958/0 (socket says 172.21.15.61:51958) 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a5b6f700 1 -- 172.21.15.61:0/159614269 learned_addr learned my addr 172.21.15.61:0/159614269 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a6370700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a0070d50 0x7fc5a00c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a536e700 1 --2- 172.21.15.61:0/159614269 >> v2:172.21.15.133:3300/0 conn(0x7fc5a0159e60 0x7fc5a00c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558390046 0 0) 0x7fc5a006a090 con 0x7fc5a0159a90 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc58c003570 con 0x7fc5a0159a90 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 952906341 0 0) 0x7fc58c003570 con 0x7fc5a0159a90 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a0070d50 msgr2=0x7fc5a00c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a0070d50 0x7fc5a00c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 >> v2:172.21.15.133:3300/0 conn(0x7fc5a0159e60 msgr2=0x7fc5a00c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 --2- 172.21.15.61:0/159614269 >> v2:172.21.15.133:3300/0 conn(0x7fc5a0159e60 0x7fc5a00c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a006a2e0 con 0x7fc5a0159a90 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fc59c001470 con 0x7fc5a0159a90 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 >> v1:172.21.15.61:6789/0 conn(0x7fc5a0159a90 legacy=0x7fc5a0070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 0x7fc58c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a0070d50 0x7fc58c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc58c004d50 0x7fc58c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a006ac10 con 0x7fc58c003ae0 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a00c9e40 con 0x7fc58c004d50 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c00bb40 con 0x7fc5a0070d50 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a5b6f700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 0x7fc58c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a536e700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a0070d50 0x7fc58c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.923+0000 7fc5a6370700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc58c004d50 0x7fc58c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a5b6f700 1 -- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a0070d50 msgr2=0x7fc58c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a5b6f700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a0070d50 0x7fc58c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a5b6f700 1 -- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc58c004d50 msgr2=0x7fc58c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a5b6f700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc58c004d50 0x7fc58c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a5b6f700 1 -- 172.21.15.61:0/159614269 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c003570 con 0x7fc58c003ae0 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a536e700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a0070d50 0x7fc58c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:09.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a5b6f700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 0x7fc58c003ef0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00c2d0 tx=0x7fc59c001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3f84fdb76ce599 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c00cb40 con 0x7fc58c003ae0 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c00ccc0 con 0x7fc58c003ae0 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a4b6d700 1 -- 172.21.15.61:0/159614269 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c005b70 con 0x7fc58c003ae0 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/159614269 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 msgr2=0x7fc58c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a7dd3700 1 --2- 172.21.15.61:0/159614269 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 0x7fc58c003ef0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00c2d0 tx=0x7fc59c001dc0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a6370700 1 -- 172.21.15.61:0/159614269 reap_dead start 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/159614269 shutdown_connections 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.924+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/159614269 >> 172.21.15.61:0/159614269 conn(0x7fc5a00cd6f0 msgr2=0x7fc5a00cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.925+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/159614269 shutdown_connections 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.925+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/159614269 wait complete. 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.926+0000 7fc5a7dd3700 1 Processor -- start 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.926+0000 7fc5a7dd3700 1 -- start start 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.926+0000 7fc5a7dd3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 0x7fc5a0151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.926+0000 7fc5a7dd3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a00b1220 0x7fc5a00b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.926+0000 7fc5a7dd3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5a0155fa0 0x7fc5a0156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.926+0000 7fc5a7dd3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a0156980 con 0x7fc58c003ae0 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.926+0000 7fc5a7dd3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a015a260 con 0x7fc5a0155fa0 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.926+0000 7fc5a7dd3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a01521a0 con 0x7fc5a00b1220 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a5b6f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 0x7fc5a0151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a5b6f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 0x7fc5a0151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35374/0 (socket says 172.21.15.61:35374) 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a5b6f700 1 -- 172.21.15.61:0/1237369762 learned_addr learned my addr 172.21.15.61:0/1237369762 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a536e700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a00b1220 0x7fc5a00b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a6370700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5a0155fa0 0x7fc5a0156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a5b6f700 1 -- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a00b1220 msgr2=0x7fc5a00b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a5b6f700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a00b1220 0x7fc5a00b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a5b6f700 1 -- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5a0155fa0 msgr2=0x7fc5a0156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a5b6f700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5a0155fa0 0x7fc5a0156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a5b6f700 1 -- 172.21.15.61:0/1237369762 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a00b2160 con 0x7fc58c003ae0 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a536e700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a00b1220 0x7fc5a00b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a5b6f700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 0x7fc5a0151c60 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fc58c004730 tx=0x7fc59c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:09.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc595ffb700 1 -- 172.21.15.61:0/1237369762 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c001700 con 0x7fc58c003ae0 2023-12-24T20:06:09.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc595ffb700 1 -- 172.21.15.61:0/1237369762 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c0070d0 con 0x7fc58c003ae0 2023-12-24T20:06:09.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/1237369762 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a00b2440 con 0x7fc58c003ae0 2023-12-24T20:06:09.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc595ffb700 1 -- 172.21.15.61:0/1237369762 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c007470 con 0x7fc58c003ae0 2023-12-24T20:06:09.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.927+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/1237369762 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a00b2a00 con 0x7fc58c003ae0 2023-12-24T20:06:09.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.928+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/1237369762 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a004c3c0 con 0x7fc58c003ae0 2023-12-24T20:06:09.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.929+0000 7fc595ffb700 1 -- 172.21.15.61:0/1237369762 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc59c019030 con 0x7fc58c003ae0 2023-12-24T20:06:09.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.929+0000 7fc595ffb700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc584066f30 0x7fc5840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:09.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.929+0000 7fc595ffb700 1 -- 172.21.15.61:0/1237369762 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc59c0854e0 con 0x7fc58c003ae0 2023-12-24T20:06:09.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.930+0000 7fc5a536e700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc584066f30 0x7fc5840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:09.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.930+0000 7fc5a536e700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc584066f30 0x7fc5840693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc590006da0 tx=0x7fc590008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:09.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:09.934+0000 7fc595ffb700 1 -- 172.21.15.61:0/1237369762 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc59c0526b0 con 0x7fc58c003ae0 2023-12-24T20:06:10.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.171+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/1237369762 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5a006a5c0 con 0x7fc58c003ae0 2023-12-24T20:06:10.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.171+0000 7fc595ffb700 1 -- 172.21.15.61:0/1237369762 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fc59c055cd0 con 0x7fc58c003ae0 2023-12-24T20:06:10.172 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:10.172 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/534815426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":534815426},{"type":"v1","addr":"172.21.15.133:6836","nonce":534815426}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1994792297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1994792297},{"type":"v1","addr":"172.21.15.133:6837","nonce":1994792297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7818,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3942988503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3942988503},{"type":"v1","addr":"172.21.15.61:6834","nonce":3942988503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:06:04.174684+0000","modified":"2023-12-24T20:06:07.799428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/764589487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":764589487},{"type":"v1","addr":"172.21.15.61:6835","nonce":764589487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc584066f30 msgr2=0x7fc5840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc584066f30 0x7fc5840693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc590006da0 tx=0x7fc590008040 comp rx=0 tx=0).stop 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/1237369762 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 msgr2=0x7fc5a0151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 0x7fc5a0151c60 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fc58c004730 tx=0x7fc59c012000 comp rx=0 tx=0).stop 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/1237369762 shutdown_connections 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc584066f30 0x7fc5840693e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5a0155fa0 0x7fc5a0156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc58c003ae0 0x7fc5a0151c60 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 --2- 172.21.15.61:0/1237369762 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc5a00b1220 0x7fc5a00b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/1237369762 >> 172.21.15.61:0/1237369762 conn(0x7fc5a00cd6f0 msgr2=0x7fc5a0070640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:10.174 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/1237369762 shutdown_connections 2023-12-24T20:06:10.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.173+0000 7fc5a7dd3700 1 -- 172.21.15.61:0/1237369762 wait complete. 2023-12-24T20:06:10.175 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 84 2023-12-24T20:06:10.588 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T20:06:04.174684+0000', 'modified': '2023-12-24T20:06:07.799428+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7821}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7821': {'gid': 7821, 'name': 'a', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.61:6835/764589487', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.61:6833', 'nonce': 764589487}, {'type': 'v1', 'addr': '172.21.15.61:6835', 'nonce': 764589487}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T20:06:10.588 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T20:06:10.589 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-24T20:06:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.715+0000 7fbdd9754700 1 Processor -- start 2023-12-24T20:06:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.715+0000 7fbdd9754700 1 -- start start 2023-12-24T20:06:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.716+0000 7fbdd9754700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbdd415df60 0x7fbdd40d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.716+0000 7fbdd9754700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd40d0bb0 con 0x7fbdd41437b0 2023-12-24T20:06:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.716+0000 7fbdd9754700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd40d0e90 con 0x7fbdd41433e0 2023-12-24T20:06:10.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.716+0000 7fbdd9754700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd415b550 con 0x7fbdd415df60 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.716+0000 7fbdd27fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fbdd41437b0 0x7fbdd40cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51968/0 (socket says 172.21.15.61:51968) 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.716+0000 7fbdd27fc700 1 -- 172.21.15.61:0/1289372961 learned_addr learned my addr 172.21.15.61:0/1289372961 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.716+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/1289372961 >> v2:172.21.15.133:3300/0 conn(0x7fbdd415df60 0x7fbdd40d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.716+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19477746 0 0) 0x7fbdd40d0bb0 con 0x7fbdd41437b0 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.716+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdbc003570 con 0x7fbdd41437b0 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3344877891 0 0) 0x7fbdbc003570 con 0x7fbdd41437b0 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 >> v2:172.21.15.133:3300/0 conn(0x7fbdd415df60 msgr2=0x7fbdd40d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 --2- 172.21.15.61:0/1289372961 >> v2:172.21.15.133:3300/0 conn(0x7fbdd415df60 0x7fbdd40d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 >> v1:172.21.15.133:6789/0 conn(0x7fbdd41433e0 legacy=0x7fbdd415d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd40d1170 con 0x7fbdd41437b0 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fbdc4001470 con 0x7fbdd41437b0 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 >> v1:172.21.15.61:6789/0 conn(0x7fbdd41437b0 legacy=0x7fbdd40cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdbc003a60 0x7fbdbc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdbc004810 0x7fbdbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdbc0051c0 0x7fbdbc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd415b550 con 0x7fbdbc0051c0 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc00c050 con 0x7fbdbc004810 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc00c210 con 0x7fbdbc003a60 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdbc0051c0 0x7fbdbc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd27fc700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdbc004810 0x7fbdbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdbc003a60 0x7fbdbc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd37fe700 1 -- 172.21.15.61:0/1289372961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdbc003a60 msgr2=0x7fbdbc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdbc003a60 0x7fbdbc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd37fe700 1 -- 172.21.15.61:0/1289372961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdbc004810 msgr2=0x7fbdbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdbc004810 0x7fbdbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd37fe700 1 -- 172.21.15.61:0/1289372961 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc003570 con 0x7fbdbc0051c0 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd37fe700 1 -- 172.21.15.61:0/1289372961 reap_dead start 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdbc0051c0 0x7fbdbc00ba60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fbdd415e360 tx=0x7fbdcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ab7fb659ef1140 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc00ea90 con 0x7fbdbc0051c0 2023-12-24T20:06:10.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc00f040 con 0x7fbdbc0051c0 2023-12-24T20:06:10.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.717+0000 7fbdd1ffb700 1 -- 172.21.15.61:0/1289372961 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc00ee20 con 0x7fbdbc0051c0 2023-12-24T20:06:10.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.718+0000 7fbdd9754700 1 -- 172.21.15.61:0/1289372961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdbc0051c0 msgr2=0x7fbdbc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.718+0000 7fbdd9754700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdbc0051c0 0x7fbdbc00ba60 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fbdd415e360 tx=0x7fbdcc00b040 comp rx=0 tx=0).stop 2023-12-24T20:06:10.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.718+0000 7fbdd9754700 1 -- 172.21.15.61:0/1289372961 shutdown_connections 2023-12-24T20:06:10.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.718+0000 7fbdd9754700 1 --2- 172.21.15.61:0/1289372961 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdbc0051c0 0x7fbdbc00ba60 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.718+0000 7fbdd9754700 1 -- 172.21.15.61:0/1289372961 >> 172.21.15.61:0/1289372961 conn(0x7fbdd406e640 msgr2=0x7fbdd4067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:10.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.718+0000 7fbdd9754700 1 -- 172.21.15.61:0/1289372961 shutdown_connections 2023-12-24T20:06:10.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.718+0000 7fbdd9754700 1 -- 172.21.15.61:0/1289372961 wait complete. 2023-12-24T20:06:10.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.719+0000 7fbdd9754700 1 Processor -- start 2023-12-24T20:06:10.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.719+0000 7fbdd9754700 1 -- start start 2023-12-24T20:06:10.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd9754700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdbc0051c0 0x7fbdd416dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd9754700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdd40b5b80 0x7fbdd415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd9754700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdd40b5ff0 0x7fbdd415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd9754700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd413ca70 con 0x7fbdd40b5ff0 2023-12-24T20:06:10.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd9754700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd416e530 con 0x7fbdbc0051c0 2023-12-24T20:06:10.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd9754700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd415abc0 con 0x7fbdd40b5b80 2023-12-24T20:06:10.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdd40b5ff0 0x7fbdd415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdd40b5ff0 0x7fbdd415a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35394/0 (socket says 172.21.15.61:35394) 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd37fe700 1 -- 172.21.15.61:0/626827245 learned_addr learned my addr 172.21.15.61:0/626827245 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd27fc700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdd40b5b80 0x7fbdd415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.720+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdbc0051c0 0x7fbdd416dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdd37fe700 1 -- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdd40b5b80 msgr2=0x7fbdd415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdd40b5b80 0x7fbdd415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdd37fe700 1 -- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdbc0051c0 msgr2=0x7fbdd416dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdbc0051c0 0x7fbdd416dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdd37fe700 1 -- 172.21.15.61:0/626827245 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd413bb80 con 0x7fbdd40b5ff0 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdd40b5ff0 0x7fbdd415a680 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40afa20 tx=0x7fbdcc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdbaffd700 1 -- 172.21.15.61:0/626827245 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc022070 con 0x7fbdd40b5ff0 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdbaffd700 1 -- 172.21.15.61:0/626827245 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc00ee90 con 0x7fbdd40b5ff0 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdd9754700 1 -- 172.21.15.61:0/626827245 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd413be60 con 0x7fbdd40b5ff0 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdbaffd700 1 -- 172.21.15.61:0/626827245 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc028670 con 0x7fbdd40b5ff0 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.721+0000 7fbdd9754700 1 -- 172.21.15.61:0/626827245 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd413c420 con 0x7fbdd40b5ff0 2023-12-24T20:06:10.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.723+0000 7fbdbaffd700 1 -- 172.21.15.61:0/626827245 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbdcc026070 con 0x7fbdd40b5ff0 2023-12-24T20:06:10.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.723+0000 7fbdbaffd700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbdc0066f30 0x7fbdc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.723+0000 7fbdbaffd700 1 -- 172.21.15.61:0/626827245 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdcc085f90 con 0x7fbdd40b5ff0 2023-12-24T20:06:10.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.723+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbdc0066f30 0x7fbdc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.724+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbdc0066f30 0x7fbdc00693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8000c00 tx=0x7fbdc8007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:10.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.725+0000 7fbde2a54b80 1 Processor -- start 2023-12-24T20:06:10.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.725+0000 7fbde2a54b80 1 -- start start 2023-12-24T20:06:10.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.725+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 0x55adc7dfe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfe8b0 0x55adc7df9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfa170 0x55adc7e1a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adc7d2c3e0 con 0x55adc7dfa170 2023-12-24T20:06:10.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adc7d29be0 con 0x55adc7dfdfa0 2023-12-24T20:06:10.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adc7d259d0 con 0x55adc7dfe8b0 2023-12-24T20:06:10.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfa170 0x55adc7e1a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfa170 0x55adc7e1a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35408/0 (socket says 172.21.15.61:35408) 2023-12-24T20:06:10.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd37fe700 1 -- 172.21.15.61:0/2054953726 learned_addr learned my addr 172.21.15.61:0/2054953726 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:10.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/2054953726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 0x55adc7dfe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd27fc700 1 --2- 172.21.15.61:0/2054953726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfe8b0 0x55adc7df9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd37fe700 1 -- 172.21.15.61:0/2054953726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfe8b0 msgr2=0x55adc7df9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/2054953726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfe8b0 0x55adc7df9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd37fe700 1 -- 172.21.15.61:0/2054953726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 msgr2=0x55adc7dfe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/2054953726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 0x55adc7dfe370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd37fe700 1 -- 172.21.15.61:0/2054953726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adc7bb9360 con 0x55adc7dfa170 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/2054953726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 0x55adc7dfe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/2054953726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfa170 0x55adc7e1a360 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00afd0 tx=0x7fbdcc05c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9374553f27424401 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdb3fff700 1 -- 172.21.15.61:0/2054953726 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc057680 con 0x55adc7dfa170 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdb3fff700 1 -- 172.21.15.61:0/2054953726 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc056f80 con 0x55adc7dfa170 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.726+0000 7fbdb3fff700 1 -- 172.21.15.61:0/2054953726 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc05a1d0 con 0x55adc7dfa170 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.727+0000 7fbde2a54b80 1 -- 172.21.15.61:0/2054953726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfa170 msgr2=0x55adc7e1a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.727+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/2054953726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfa170 0x55adc7e1a360 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00afd0 tx=0x7fbdcc05c040 comp rx=0 tx=0).stop 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.727+0000 7fbde2a54b80 1 -- 172.21.15.61:0/2054953726 shutdown_connections 2023-12-24T20:06:10.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.727+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/2054953726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfa170 0x55adc7e1a360 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.727+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/2054953726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 0x55adc7dfe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.727+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/2054953726 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfe8b0 0x55adc7df9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.727+0000 7fbde2a54b80 1 -- 172.21.15.61:0/2054953726 >> 172.21.15.61:0/2054953726 conn(0x55adc7dd4440 msgr2=0x55adc7e1fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.727+0000 7fbde2a54b80 1 -- 172.21.15.61:0/2054953726 shutdown_connections 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.727+0000 7fbde2a54b80 1 -- 172.21.15.61:0/2054953726 wait complete. 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.728+0000 7fbde2a54b80 1 -- start start 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.728+0000 7fbde2a54b80 1 Processor -- start 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfa170 0x55adc7df92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 0x55adc7e13890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e1fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adc7cd21b0 con 0x55adc7dfe8b0 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adc7cd1e50 con 0x55adc7dfdfa0 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adc7c1ee40 con 0x55adc7dfa170 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbde2a54b80 10 client.0 _ll_register_callbacks cb 0x55adc7c217b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:06:10.735 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e1fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e1fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35420/0 (socket says 172.21.15.61:35420) 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd37fe700 1 -- 172.21.15.61:0/1495683918 learned_addr learned my addr 172.21.15.61:0/1495683918 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfa170 0x55adc7df92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd27fc700 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 0x55adc7e13890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd37fe700 1 -- 172.21.15.61:0/1495683918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfa170 msgr2=0x55adc7df92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfa170 0x55adc7df92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd37fe700 1 -- 172.21.15.61:0/1495683918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 msgr2=0x55adc7e13890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 0x55adc7e13890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd37fe700 1 -- 172.21.15.61:0/1495683918 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd413c420 con 0x55adc7dfe8b0 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e1fdc0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc056ec0 tx=0x7fbdcc059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695595143e080812 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdb17fa700 1 -- 172.21.15.61:0/1495683918 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc057680 con 0x55adc7dfe8b0 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbdb17fa700 1 -- 172.21.15.61:0/1495683918 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdcc05df20 con 0x55adc7dfe8b0 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.729+0000 7fbde2a54b80 1 -- 172.21.15.61:0/1495683918 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adc7da6eb0 con 0x55adc7dfe8b0 2023-12-24T20:06:10.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbdb17fa700 1 -- 172.21.15.61:0/1495683918 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdcc084250 con 0x55adc7dfe8b0 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbde2a54b80 10 client.7956 fetch_fsmap learned FSMap version 84 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbde2a54b80 1 -- 172.21.15.61:0/1495683918 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x55adc7b65b10 con 0x55adc7dfe8b0 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbdb17fa700 1 -- 172.21.15.61:0/1495683918 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55adc7da6eb0 con 0x55adc7dfe8b0 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbdb17fa700 1 -- 172.21.15.61:0/1495683918 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 84) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbdcc05da90 con 0x55adc7dfe8b0 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbde2a54b80 10 client.7956 fetch_fsmap finished waiting for FSMap version 84 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbde2a54b80 10 client.7956 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbde2a54b80 20 client.7956 populate_metadata read hostname 'smithi061' 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.61:6833/764589487,v1:172.21.15.61:6835/764589487] conn(0x55adc7e1c7f0 0x55adc7e1cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbde2a54b80 4 client.7956 mds_command: new command op to 7821 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbde2a54b80 1 -- 172.21.15.61:0/1495683918 --> [v2:172.21.15.61:6833/764589487,v1:172.21.15.61:6835/764589487] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55adc7cfc880 con 0x55adc7e1c7f0 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.61:6833/764589487,v1:172.21.15.61:6835/764589487] conn(0x55adc7e1c7f0 0x55adc7e1cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbdb17fa700 10 client.7956 ms_handle_connect on v2:172.21.15.61:6833/764589487 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.730+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.61:6833/764589487,v1:172.21.15.61:6835/764589487] conn(0x55adc7e1c7f0 0x55adc7e1cbc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af38a0caa0b4e87 server_cookie=e38d7990ac1dd0d1 in_seq=0 out_seq=0 2023-12-24T20:06:10.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbdb17fa700 1 -- 172.21.15.61:0/1495683918 <== mds.0 v2:172.21.15.61:6833/764589487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55adc7cfc880 con 0x55adc7e1c7f0 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbdb17fa700 10 client.7956 handle_command_reply: tid=0 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 client.7956 shutdown 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 -- 172.21.15.61:0/1495683918 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 msgr2=0x55adc7e1fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e1fdc0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc056ec0 tx=0x7fbdcc059000 comp rx=0 tx=0).stop 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 -- 172.21.15.61:0/1495683918 shutdown_connections 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.61:6833/764589487,v1:172.21.15.61:6835/764589487] conn(0x55adc7e1c7f0 0x55adc7e1cbc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfa170 0x55adc7df92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e1fdc0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbdb17fa700 0 client.7956 ms_handle_reset on v2:172.21.15.61:6833/764589487 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/1495683918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfdfa0 0x55adc7e13890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 -- 172.21.15.61:0/1495683918 >> 172.21.15.61:0/1495683918 conn(0x55adc7dd4440 msgr2=0x55adc7dd25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 -- 172.21.15.61:0/1495683918 shutdown_connections 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 1 -- 172.21.15.61:0/1495683918 wait complete. 2023-12-24T20:06:10.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.731+0000 7fbde2a54b80 20 client.7956 trim_cache size 0 max 16384 2023-12-24T20:06:10.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.748+0000 7fbde2a54b80 1 Processor -- start 2023-12-24T20:06:10.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.748+0000 7fbde2a54b80 1 -- start start 2023-12-24T20:06:10.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfa170 0x55adc7e15600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfdfa0 0x55adc7e15b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfe8b0 0x55adc7e13170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adc7e14320 con 0x55adc7dfdfa0 2023-12-24T20:06:10.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adc7dd5880 con 0x55adc7dfe8b0 2023-12-24T20:06:10.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adc7dcccf0 con 0x55adc7dfa170 2023-12-24T20:06:10.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbdd2ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfa170 0x55adc7e15600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbdd27fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfdfa0 0x55adc7e15b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbdd27fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfdfa0 0x55adc7e15b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35424/0 (socket says 172.21.15.61:35424) 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbdd27fc700 1 -- 172.21.15.61:0/655624149 learned_addr learned my addr 172.21.15.61:0/655624149 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.749+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/655624149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfe8b0 0x55adc7e13170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.750+0000 7fbdd27fc700 1 -- 172.21.15.61:0/655624149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfa170 msgr2=0x55adc7e15600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.750+0000 7fbdd27fc700 1 --2- 172.21.15.61:0/655624149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfa170 0x55adc7e15600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.750+0000 7fbdd27fc700 1 -- 172.21.15.61:0/655624149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfe8b0 msgr2=0x55adc7e13170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.750+0000 7fbdd27fc700 1 --2- 172.21.15.61:0/655624149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfe8b0 0x55adc7e13170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.750+0000 7fbdd27fc700 1 -- 172.21.15.61:0/655624149 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adc7cf4290 con 0x55adc7dfdfa0 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.750+0000 7fbdd27fc700 1 --2- 172.21.15.61:0/655624149 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfdfa0 0x55adc7e15b40 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4004980 tx=0x7fbdc4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa46d045150f55cd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.750+0000 7fbdb8ff9700 1 -- 172.21.15.61:0/655624149 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4007550 con 0x55adc7dfdfa0 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.750+0000 7fbdb8ff9700 1 -- 172.21.15.61:0/655624149 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc40076b0 con 0x55adc7dfdfa0 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.750+0000 7fbdb8ff9700 1 -- 172.21.15.61:0/655624149 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4016650 con 0x55adc7dfdfa0 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 -- 172.21.15.61:0/655624149 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfdfa0 msgr2=0x55adc7e15b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/655624149 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfdfa0 0x55adc7e15b40 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4004980 tx=0x7fbdc4009040 comp rx=0 tx=0).stop 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 -- 172.21.15.61:0/655624149 shutdown_connections 2023-12-24T20:06:10.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/655624149 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfa170 0x55adc7e15600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/655624149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfe8b0 0x55adc7e13170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/655624149 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfdfa0 0x55adc7e15b40 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 -- 172.21.15.61:0/655624149 >> 172.21.15.61:0/655624149 conn(0x55adc7dd4440 msgr2=0x55adc7dcb700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:10.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 -- 172.21.15.61:0/655624149 shutdown_connections 2023-12-24T20:06:10.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 -- 172.21.15.61:0/655624149 wait complete. 2023-12-24T20:06:10.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 -- start start 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.751+0000 7fbde2a54b80 1 Processor -- start 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfa170 0x55adc7e802d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfdfa0 0x55adc7dfcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbde2a54b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e17ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adc7dd2fe0 con 0x55adc7dfe8b0 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adc7e18ae0 con 0x55adc7dfa170 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbde2a54b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x55adc7e1bb70 con 0x55adc7dfdfa0 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbde2a54b80 10 client.0 _ll_register_callbacks cb 0x7fbdcc056ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbdd37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e17ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbdd37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e17ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35428/0 (socket says 172.21.15.61:35428) 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbdd37fe700 1 -- 172.21.15.61:0/3791414523 learned_addr learned my addr 172.21.15.61:0/3791414523 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:10.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbdd27fc700 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfdfa0 0x55adc7dfcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.752+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfa170 0x55adc7e802d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdd37fe700 1 -- 172.21.15.61:0/3791414523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfdfa0 msgr2=0x55adc7dfcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfdfa0 0x55adc7dfcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdd37fe700 1 -- 172.21.15.61:0/3791414523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfa170 msgr2=0x55adc7e802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfa170 0x55adc7e802d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdd37fe700 1 -- 172.21.15.61:0/3791414523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd40d1170 con 0x55adc7dfe8b0 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdd37fe700 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e17ed0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc084480 tx=0x7fbdcc070070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22a3cb1fd4754fc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdb17fa700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdb17fa700 1 -- 172.21.15.61:0/3791414523 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc05a220 con 0x55adc7dfe8b0 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdb17fa700 1 -- 172.21.15.61:0/3791414523 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdcc084250 con 0x55adc7dfe8b0 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbde2a54b80 1 -- 172.21.15.61:0/3791414523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adc7dca490 con 0x55adc7dfe8b0 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdb17fa700 1 -- 172.21.15.61:0/3791414523 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdcc057680 con 0x55adc7dfe8b0 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbde2a54b80 10 client.7962 fetch_fsmap learned FSMap version 84 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbde2a54b80 1 -- 172.21.15.61:0/3791414523 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x55adc7bbdc80 con 0x55adc7dfe8b0 2023-12-24T20:06:10.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdb17fa700 1 -- 172.21.15.61:0/3791414523 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55adc7dca490 con 0x55adc7dfe8b0 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbdb17fa700 1 -- 172.21.15.61:0/3791414523 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 84) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbdcc05da90 con 0x55adc7dfe8b0 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.753+0000 7fbde2a54b80 10 client.7962 fetch_fsmap finished waiting for FSMap version 84 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 10 client.7962 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 20 client.7962 populate_metadata read hostname 'smithi061' 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.61:6833/764589487,v1:172.21.15.61:6835/764589487] conn(0x55adc7dcbee0 0x55adc7e1cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 4 client.7962 mds_command: new command op to 7821 tid=0[{"prefix": "status"}] 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 -- 172.21.15.61:0/3791414523 --> [v2:172.21.15.61:6833/764589487,v1:172.21.15.61:6835/764589487] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55adc7cc8910 con 0x55adc7dcbee0 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.61:6833/764589487,v1:172.21.15.61:6835/764589487] conn(0x55adc7dcbee0 0x55adc7e1cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbdd2ffd700 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.61:6833/764589487,v1:172.21.15.61:6835/764589487] conn(0x55adc7dcbee0 0x55adc7e1cbc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f70778b03b14f9 server_cookie=c6c77add098bf745 in_seq=0 out_seq=0 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbdb17fa700 10 client.7962 ms_handle_connect on v2:172.21.15.61:6833/764589487 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbdb17fa700 1 -- 172.21.15.61:0/3791414523 <== mds.0 v2:172.21.15.61:6833/764589487 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55adc7cc8910 con 0x55adc7dcbee0 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbdb17fa700 10 client.7962 handle_command_reply: tid=0 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 client.7962 shutdown 2023-12-24T20:06:10.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 -- 172.21.15.61:0/3791414523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 msgr2=0x55adc7e17ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e17ed0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc084480 tx=0x7fbdcc070070 comp rx=0 tx=0).stop 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 -- 172.21.15.61:0/3791414523 shutdown_connections 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55adc7dfe8b0 0x55adc7e17ed0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55adc7dfa170 0x55adc7e802d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.61:6833/764589487,v1:172.21.15.61:6835/764589487] conn(0x55adc7dcbee0 0x55adc7e1cbc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 --2- 172.21.15.61:0/3791414523 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x55adc7dfdfa0 0x55adc7dfcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbdb17fa700 0 client.7962 ms_handle_reset on v2:172.21.15.61:6833/764589487 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 -- 172.21.15.61:0/3791414523 >> 172.21.15.61:0/3791414523 conn(0x55adc7dd4440 msgr2=0x55adc7e1fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 -- 172.21.15.61:0/3791414523 shutdown_connections 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.754+0000 7fbde2a54b80 1 -- 172.21.15.61:0/3791414523 wait complete. 2023-12-24T20:06:10.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbde2a54b80 20 client.7962 trim_cache size 0 max 16384 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 7821, 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 5.9756472069999997, 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 84, 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 168, 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 168, 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 12.010076096000001 2023-12-24T20:06:10.762 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:06:10.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 -- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbdc0066f30 msgr2=0x7fbdc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbdc0066f30 0x7fbdc00693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8000c00 tx=0x7fbdc8007d30 comp rx=0 tx=0).stop 2023-12-24T20:06:10.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 -- 172.21.15.61:0/626827245 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdd40b5ff0 msgr2=0x7fbdd415a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdd40b5ff0 0x7fbdd415a680 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40afa20 tx=0x7fbdcc01a000 comp rx=0 tx=0).stop 2023-12-24T20:06:10.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 -- 172.21.15.61:0/626827245 shutdown_connections 2023-12-24T20:06:10.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbdc0066f30 0x7fbdc00693e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdd40b5ff0 0x7fbdd415a680 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdbc0051c0 0x7fbdd416dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 --2- 172.21.15.61:0/626827245 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbdd40b5b80 0x7fbdd415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 -- 172.21.15.61:0/626827245 >> 172.21.15.61:0/626827245 conn(0x7fbdd406e640 msgr2=0x7fbdd415d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:10.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 -- 172.21.15.61:0/626827245 shutdown_connections 2023-12-24T20:06:10.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.755+0000 7fbdd9754700 1 -- 172.21.15.61:0/626827245 wait complete. 2023-12-24T20:06:10.768 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:06:10.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.891+0000 7f872a5c4700 1 Processor -- start 2023-12-24T20:06:10.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.892+0000 7f872a5c4700 1 -- start start 2023-12-24T20:06:10.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.892+0000 7f872a5c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f872406aac0 0x7f8724159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.892+0000 7f872a5c4700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872406a630 con 0x7f8724159850 2023-12-24T20:06:10.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.892+0000 7f872a5c4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8724069d00 con 0x7f87240caa80 2023-12-24T20:06:10.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.892+0000 7f872a5c4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87240cccf0 con 0x7f872406aac0 2023-12-24T20:06:10.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.892+0000 7f8723fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8724159850 0x7f87240cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51974/0 (socket says 172.21.15.61:51974) 2023-12-24T20:06:10.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8723fff700 1 -- 172.21.15.61:0/2679292538 learned_addr learned my addr 172.21.15.61:0/2679292538 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:10.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f87237fe700 1 --2- 172.21.15.61:0/2679292538 >> v2:172.21.15.133:3300/0 conn(0x7f872406aac0 0x7f8724159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214044229 0 0) 0x7f872406a630 con 0x7f8724159850 2023-12-24T20:06:10.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f870c003570 con 0x7f8724159850 2023-12-24T20:06:10.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767941283 0 0) 0x7f8724069d00 con 0x7f87240caa80 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f872406a630 con 0x7f87240caa80 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1351608746 0 0) 0x7f870c003570 con 0x7f8724159850 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 >> v2:172.21.15.133:3300/0 conn(0x7f872406aac0 msgr2=0x7f8724159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 --2- 172.21.15.61:0/2679292538 >> v2:172.21.15.133:3300/0 conn(0x7f872406aac0 0x7f8724159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 >> v1:172.21.15.133:6789/0 conn(0x7f87240caa80 legacy=0x7f87240aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724069fe0 con 0x7f8724159850 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f8714001470 con 0x7f8724159850 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 >> v1:172.21.15.61:6789/0 conn(0x7f8724159850 legacy=0x7f87240cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f870c003bf0 0x7f870c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f870c004810 0x7f870c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f870c005230 0x7f870c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240cccf0 con 0x7f870c004810 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c00c200 con 0x7f870c003bf0 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c00c3c0 con 0x7f870c005230 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f87237fe700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f870c004810 0x7f870c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8723fff700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f870c003bf0 0x7f870c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f8728b61700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f870c005230 0x7f870c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f87237fe700 1 -- 172.21.15.61:0/2679292538 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f870c005230 msgr2=0x7f870c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.893+0000 7f87237fe700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f870c005230 0x7f870c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f87237fe700 1 -- 172.21.15.61:0/2679292538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f870c003bf0 msgr2=0x7f870c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f87237fe700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f870c003bf0 0x7f870c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f87237fe700 1 -- 172.21.15.61:0/2679292538 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c003570 con 0x7f870c004810 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f8728b61700 1 -- 172.21.15.61:0/2679292538 reap_dead start 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f8723fff700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f870c003bf0 0x7f870c003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f87237fe700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f870c004810 0x7f870c004c80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f8718009be0 tx=0x7f87180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c591fd60d0e770f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:10.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871800e710 con 0x7f870c004810 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871800e870 con 0x7f870c004810 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f8722ffd700 1 -- 172.21.15.61:0/2679292538 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871800ec30 con 0x7f870c004810 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f872a5c4700 1 -- 172.21.15.61:0/2679292538 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f870c004810 msgr2=0x7f870c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f872a5c4700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f870c004810 0x7f870c004c80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f8718009be0 tx=0x7f87180091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f872a5c4700 1 -- 172.21.15.61:0/2679292538 shutdown_connections 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f872a5c4700 1 --2- 172.21.15.61:0/2679292538 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f870c004810 0x7f870c004c80 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f872a5c4700 1 -- 172.21.15.61:0/2679292538 >> 172.21.15.61:0/2679292538 conn(0x7f87240cceb0 msgr2=0x7f87240cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f872a5c4700 1 -- 172.21.15.61:0/2679292538 shutdown_connections 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.894+0000 7f872a5c4700 1 -- 172.21.15.61:0/2679292538 wait complete. 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.895+0000 7f872a5c4700 1 Processor -- start 2023-12-24T20:06:10.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.896+0000 7f872a5c4700 1 -- start start 2023-12-24T20:06:10.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.896+0000 7f872a5c4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f870c004810 0x7f87241577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.896+0000 7f872a5c4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f87241464f0 0x7f8724146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.896+0000 7f872a5c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f872415a260 0x7f872415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.896+0000 7f872a5c4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872415b3d0 con 0x7f87241464f0 2023-12-24T20:06:10.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.896+0000 7f872a5c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8724146ea0 con 0x7f872415a260 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.896+0000 7f872a5c4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872415afd0 con 0x7f870c004810 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.896+0000 7f87237fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f87241464f0 0x7f8724146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f87237fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f87241464f0 0x7f8724146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35456/0 (socket says 172.21.15.61:35456) 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f87237fe700 1 -- 172.21.15.61:0/1829148837 learned_addr learned my addr 172.21.15.61:0/1829148837 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f8723fff700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f870c004810 0x7f87241577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f87237fe700 1 -- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f870c004810 msgr2=0x7f87241577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f87237fe700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f870c004810 0x7f87241577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f87237fe700 1 -- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f872415a260 msgr2=0x7f872415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f87237fe700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f872415a260 0x7f872415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f87237fe700 1 -- 172.21.15.61:0/1829148837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872415b620 con 0x7f87241464f0 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f8723fff700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f870c004810 0x7f87241577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f87237fe700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f87241464f0 0x7f8724146960 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f871800ede0 tx=0x7f8718019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f870bfff700 1 -- 172.21.15.61:0/1829148837 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871800e710 con 0x7f87241464f0 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f870bfff700 1 -- 172.21.15.61:0/1829148837 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8718021040 con 0x7f87241464f0 2023-12-24T20:06:10.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f872a5c4700 1 -- 172.21.15.61:0/1829148837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872415b900 con 0x7f87241464f0 2023-12-24T20:06:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f870bfff700 1 -- 172.21.15.61:0/1829148837 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871801b850 con 0x7f87241464f0 2023-12-24T20:06:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.897+0000 7f872a5c4700 1 -- 172.21.15.61:0/1829148837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872415ac20 con 0x7f87241464f0 2023-12-24T20:06:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.898+0000 7f872a5c4700 1 -- 172.21.15.61:0/1829148837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872404c3c0 con 0x7f87241464f0 2023-12-24T20:06:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.899+0000 7f870bfff700 1 -- 172.21.15.61:0/1829148837 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f871801bc40 con 0x7f87241464f0 2023-12-24T20:06:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.899+0000 7f870bfff700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8710066f30 0x7f87100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.899+0000 7f870bfff700 1 -- 172.21.15.61:0/1829148837 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8718086120 con 0x7f87241464f0 2023-12-24T20:06:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.900+0000 7f8723fff700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8710066f30 0x7f87100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.900+0000 7f8723fff700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8710066f30 0x7f87100693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8714000e10 tx=0x7f872406a5a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:10.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:10.903+0000 7f870bfff700 1 -- 172.21.15.61:0/1829148837 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8718053370 con 0x7f87241464f0 2023-12-24T20:06:11.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.143+0000 7f872a5c4700 1 -- 172.21.15.61:0/1829148837 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f872406a2c0 con 0x7f87241464f0 2023-12-24T20:06:11.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.143+0000 7f870bfff700 1 -- 172.21.15.61:0/1829148837 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8718056990 con 0x7f87241464f0 2023-12-24T20:06:11.144 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:06:11.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.145+0000 7f872a5c4700 1 -- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8710066f30 msgr2=0x7f87100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:11.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.145+0000 7f872a5c4700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8710066f30 0x7f87100693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8714000e10 tx=0x7f872406a5a0 comp rx=0 tx=0).stop 2023-12-24T20:06:11.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.145+0000 7f872a5c4700 1 -- 172.21.15.61:0/1829148837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f87241464f0 msgr2=0x7f8724146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:11.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.145+0000 7f872a5c4700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f87241464f0 0x7f8724146960 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f871800ede0 tx=0x7f8718019000 comp rx=0 tx=0).stop 2023-12-24T20:06:11.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.145+0000 7f872a5c4700 1 -- 172.21.15.61:0/1829148837 shutdown_connections 2023-12-24T20:06:11.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.145+0000 7f872a5c4700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f870c004810 0x7f87241577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:11.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.145+0000 7f872a5c4700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8710066f30 0x7f87100693e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:11.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.145+0000 7f872a5c4700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f872415a260 0x7f872415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:11.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.145+0000 7f872a5c4700 1 --2- 172.21.15.61:0/1829148837 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f87241464f0 0x7f8724146960 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:11.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.145+0000 7f872a5c4700 1 -- 172.21.15.61:0/1829148837 >> 172.21.15.61:0/1829148837 conn(0x7f87240cceb0 msgr2=0x7f87240c3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:11.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.146+0000 7f872a5c4700 1 -- 172.21.15.61:0/1829148837 shutdown_connections 2023-12-24T20:06:11.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:11.146+0000 7f872a5c4700 1 -- 172.21.15.61:0/1829148837 wait complete. 2023-12-24T20:06:11.158 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:06:11.158 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:06:11.158 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T20:06:11.158 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T20:06:11.158 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T20:06:11.158 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:06:11.158 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:06:11.158 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:06:11.158 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:06:11.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:11.159 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T20:06:11.177 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:06:11.177 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:06:11.177 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:06:11.177 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:11.177 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T20:06:11.177 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:11.177 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 41994sec preferred_lft 41994sec 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:06:11.178 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 12:83:d1:9f:62:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1083:d1ff:fe9f:62aa/64 scope link 2023-12-24T20:06:11.179 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:11.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:11.180 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:06:11.243 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T20:06:11.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:11.245 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T20:06:11.304 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T20:06:11.304 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:06:11.304 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:06:11.304 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:06:11.305 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:06:11.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:11.305 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T20:06:11.305 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T20:06:11.305 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:06:11.305 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:06:11.305 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:06:11.305 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T20:06:11.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:11.413 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T20:06:11.430 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:06:11.430 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:06:11.431 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:06:11.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:11.431 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T20:06:11.499 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T20:06:11.499 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:06:11.499 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T20:06:11.556 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:06:11.557 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:06:11.557 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:06:11.614 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:06:11.682 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:06:11.682 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:06:11.754 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:06:11.755 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:06:11.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:06:11.755 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:06:11.814 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:06:11.814 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T20:06:11.856 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:06:11.885 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:06:11.885 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:06:11.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T20:06:11.945+0000 7f22cd185540 -1 init, newargv = 0x55c1ecdd21b0 newargc=15 2023-12-24T20:06:11.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[73157]: starting ceph client 2023-12-24T20:06:11.949 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[73157]: starting fuse 2023-12-24T20:06:11.958 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:06:11.959 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:06:11.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:06:11.959 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:06:12.018 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T20:06:12.018 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T20:06:12.018 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:06:12.018 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:06:12.018 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:06:12.018 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:06:12.018 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:06:12.018 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:12.018 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:06:12.019 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:06:12.020 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:12.020 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:06:12.020 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:06:12.143 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.73157.asok 2023-12-24T20:06:12.325 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.73157.asok 2023-12-24T20:06:12.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:06:12.325 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.73157.asok status 2023-12-24T20:06:12.482 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:06:12.482 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:06:12.482 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "73157", 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 7974, 2023-12-24T20:06:12.483 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 7974 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2688159445 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:06:12.484 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2688159445 2023-12-24T20:06:12.485 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:06:12.485 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.7974 192.168.0.1:0/2688159445", 2023-12-24T20:06:12.485 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2688159445", 2023-12-24T20:06:12.485 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T20:06:12.485 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 84, 2023-12-24T20:06:12.485 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 168, 2023-12-24T20:06:12.485 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:06:12.485 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:06:12.485 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:06:12.485 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:06:12.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:06:12.492 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T20:06:12.492 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T20:06:12.510 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T20:06:12.510 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T20:06:12.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:06:12.511 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:06:12.579 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:06:12.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.740+0000 7fc9d41b9700 1 Processor -- start 2023-12-24T20:06:12.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.741+0000 7fc9d41b9700 1 -- start start 2023-12-24T20:06:12.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.741+0000 7fc9d41b9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9cc1599e0 0x7fc9cc15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:12.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.741+0000 7fc9d41b9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc9cc0cdb80 0x7fc9cc0cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:12.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.741+0000 7fc9d41b9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9cc0cc2a0 con 0x7fc9cc0cbac0 2023-12-24T20:06:12.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.741+0000 7fc9d41b9700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9cc0cedc0 con 0x7fc9cc0cdb80 2023-12-24T20:06:12.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.741+0000 7fc9d41b9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc067f60 con 0x7fc9cc1599e0 2023-12-24T20:06:12.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d2756700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc9cc0cdb80 0x7fc9cc0cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d2756700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc9cc0cdb80 0x7fc9cc0cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35464/0 (socket says 172.21.15.61:35464) 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d2756700 1 -- 172.21.15.61:0/3974733877 learned_addr learned my addr 172.21.15.61:0/3974733877 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d1f55700 1 --2- 172.21.15.61:0/3974733877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9cc1599e0 0x7fc9cc15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d2756700 1 -- 172.21.15.61:0/3974733877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9cc1599e0 msgr2=0x7fc9cc15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d2756700 1 --2- 172.21.15.61:0/3974733877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9cc1599e0 0x7fc9cc15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d2756700 1 -- 172.21.15.61:0/3974733877 >> v1:172.21.15.133:6789/0 conn(0x7fc9cc0cbac0 legacy=0x7fc9cc0cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d2756700 1 -- 172.21.15.61:0/3974733877 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc15b040 con 0x7fc9cc0cdb80 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d2756700 1 --2- 172.21.15.61:0/3974733877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc0cdb80 0x7fc9cc0cf250 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009f20 tx=0x7fc9c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e85243df40efe2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d0f53700 1 -- 172.21.15.61:0/3974733877 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c400e070 con 0x7fc9cc0cdb80 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d0f53700 1 -- 172.21.15.61:0/3974733877 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c400b9d0 con 0x7fc9cc0cdb80 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.742+0000 7fc9d0f53700 1 -- 172.21.15.61:0/3974733877 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40092e0 con 0x7fc9cc0cdb80 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.743+0000 7fc9d41b9700 1 -- 172.21.15.61:0/3974733877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc0cdb80 msgr2=0x7fc9cc0cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.743+0000 7fc9d41b9700 1 --2- 172.21.15.61:0/3974733877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc0cdb80 0x7fc9cc0cf250 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009f20 tx=0x7fc9c4009840 comp rx=0 tx=0).stop 2023-12-24T20:06:12.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.743+0000 7fc9d41b9700 1 -- 172.21.15.61:0/3974733877 shutdown_connections 2023-12-24T20:06:12.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.743+0000 7fc9d41b9700 1 --2- 172.21.15.61:0/3974733877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc0cdb80 0x7fc9cc0cf250 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:12.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.743+0000 7fc9d41b9700 1 --2- 172.21.15.61:0/3974733877 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9cc1599e0 0x7fc9cc15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:12.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.743+0000 7fc9d41b9700 1 -- 172.21.15.61:0/3974733877 >> 172.21.15.61:0/3974733877 conn(0x7fc9cc06e640 msgr2=0x7fc9cc067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:12.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.743+0000 7fc9d41b9700 1 -- 172.21.15.61:0/3974733877 shutdown_connections 2023-12-24T20:06:12.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.743+0000 7fc9d41b9700 1 -- 172.21.15.61:0/3974733877 wait complete. 2023-12-24T20:06:12.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.744+0000 7fc9d41b9700 1 Processor -- start 2023-12-24T20:06:12.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.744+0000 7fc9d41b9700 1 -- start start 2023-12-24T20:06:12.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d41b9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9cc0cbac0 0x7fc9cc155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d41b9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9cc0cdb80 0x7fc9cc155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d41b9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc1599e0 0x7fc9cc16aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d41b9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc0b61f0 con 0x7fc9cc1599e0 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d41b9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc156f40 con 0x7fc9cc0cdb80 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d41b9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc157220 con 0x7fc9cc0cbac0 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d2756700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc1599e0 0x7fc9cc16aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d2756700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc1599e0 0x7fc9cc16aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35476/0 (socket says 172.21.15.61:35476) 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d2756700 1 -- 172.21.15.61:0/1231742974 learned_addr learned my addr 172.21.15.61:0/1231742974 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d1f55700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9cc0cbac0 0x7fc9cc155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d1754700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9cc0cdb80 0x7fc9cc155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d2756700 1 -- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9cc0cbac0 msgr2=0x7fc9cc155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d2756700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9cc0cbac0 0x7fc9cc155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d2756700 1 -- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9cc0cdb80 msgr2=0x7fc9cc155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d2756700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9cc0cdb80 0x7fc9cc155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d2756700 1 -- 172.21.15.61:0/1231742974 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c4009ae0 con 0x7fc9cc1599e0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9d2756700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc1599e0 0x7fc9cc16aad0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4012000 tx=0x7fc9c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.745+0000 7fc9c1ffb700 1 -- 172.21.15.61:0/1231742974 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4008b10 con 0x7fc9cc1599e0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.746+0000 7fc9c1ffb700 1 -- 172.21.15.61:0/1231742974 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c4008cb0 con 0x7fc9cc1599e0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.746+0000 7fc9d41b9700 1 -- 172.21.15.61:0/1231742974 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc157500 con 0x7fc9cc1599e0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.746+0000 7fc9c1ffb700 1 -- 172.21.15.61:0/1231742974 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40266b0 con 0x7fc9cc1599e0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.746+0000 7fc9d41b9700 1 -- 172.21.15.61:0/1231742974 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc157ac0 con 0x7fc9cc1599e0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.747+0000 7fc9d41b9700 1 -- 172.21.15.61:0/1231742974 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc04c3c0 con 0x7fc9cc1599e0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.747+0000 7fc9c1ffb700 1 -- 172.21.15.61:0/1231742974 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc9c4003040 con 0x7fc9cc1599e0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.747+0000 7fc9c1ffb700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc9b0066f30 0x7fc9b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.748+0000 7fc9c1ffb700 1 -- 172.21.15.61:0/1231742974 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9c40863d0 con 0x7fc9cc1599e0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.748+0000 7fc9d1f55700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc9b0066f30 0x7fc9b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.748+0000 7fc9d1f55700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc9b0066f30 0x7fc9b00693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc158420 tx=0x7fc9c80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.752+0000 7fc9c1ffb700 1 -- 172.21.15.61:0/1231742974 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9c4053640 con 0x7fc9cc1599e0 2023-12-24T20:06:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.995+0000 7fc9d41b9700 1 -- 172.21.15.61:0/1231742974 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc9cc0cbfc0 con 0x7fc9cc1599e0 2023-12-24T20:06:12.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.996+0000 7fc9c1ffb700 1 -- 172.21.15.61:0/1231742974 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc9c4056c60 con 0x7fc9cc1599e0 2023-12-24T20:06:12.996 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:06:12.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.997+0000 7fc9d41b9700 1 -- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc9b0066f30 msgr2=0x7fc9b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:12.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc9b0066f30 0x7fc9b00693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc158420 tx=0x7fc9c80091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:12.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 -- 172.21.15.61:0/1231742974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc1599e0 msgr2=0x7fc9cc16aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:12.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc1599e0 0x7fc9cc16aad0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4012000 tx=0x7fc9c4018000 comp rx=0 tx=0).stop 2023-12-24T20:06:12.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 -- 172.21.15.61:0/1231742974 shutdown_connections 2023-12-24T20:06:12.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc9cc0cbac0 0x7fc9cc155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:12.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc9b0066f30 0x7fc9b00693e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:12.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc9cc1599e0 0x7fc9cc16aad0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:12.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 --2- 172.21.15.61:0/1231742974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9cc0cdb80 0x7fc9cc155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:12.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 -- 172.21.15.61:0/1231742974 >> 172.21.15.61:0/1231742974 conn(0x7fc9cc06e640 msgr2=0x7fc9cc0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:12.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 -- 172.21.15.61:0/1231742974 shutdown_connections 2023-12-24T20:06:12.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:12.998+0000 7fc9d41b9700 1 -- 172.21.15.61:0/1231742974 wait complete. 2023-12-24T20:06:13.010 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:06:13.011 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:06:13.011 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T20:06:13.011 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T20:06:13.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T20:06:13.011 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:06:13.011 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:06:13.011 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:06:13.011 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:06:13.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:13.011 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41999sec preferred_lft 41999sec 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T20:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T20:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link 2023-12-24T20:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T20:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::accb:c5ff:feae:915/64 scope link 2023-12-24T20:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:06:13.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:13.036 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:06:13.105 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T20:06:13.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:13.108 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T20:06:13.169 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T20:06:13.169 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:06:13.169 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:06:13.169 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:06:13.169 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:06:13.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:13.170 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T20:06:13.170 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T20:06:13.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:06:13.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:06:13.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:06:13.170 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T20:06:13.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:13.281 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T20:06:13.298 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T20:06:13.298 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T20:06:13.298 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:06:13.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:06:13.299 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T20:06:13.366 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T20:06:13.366 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:06:13.366 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T20:06:13.424 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:06:13.424 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:06:13.424 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:06:13.481 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:06:13.550 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:06:13.550 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:06:13.616 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:06:13.618 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:06:13.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:06:13.618 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:06:13.675 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:06:13.675 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T20:06:13.719 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:06:13.745 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:06:13.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:06:13.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T20:06:13.803+0000 7f7d9a21b540 -1 init, newargv = 0x55e4e13b53a0 newargc=15 2023-12-24T20:06:13.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[48686]: starting ceph client 2023-12-24T20:06:13.807 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[48686]: starting fuse 2023-12-24T20:06:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:06:13.816 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:06:13.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:06:13.817 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:06:13.874 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T20:06:13.874 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T20:06:13.874 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:06:13.875 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T20:06:13.876 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:06:13.876 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:06:13.876 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:06:13.876 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T20:06:13.876 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T20:06:13.876 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T20:06:13.876 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:06:13.876 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:06:13.876 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T20:06:13.876 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T20:06:13.997 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.48686.asok 2023-12-24T20:06:14.179 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.48686.asok 2023-12-24T20:06:14.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:06:14.180 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.48686.asok status 2023-12-24T20:06:14.333 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T20:06:14.333 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T20:06:14.333 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:06:14.333 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:06:14.333 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T20:06:14.333 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T20:06:14.333 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T20:06:14.333 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "48686", 2023-12-24T20:06:14.334 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T20:06:14.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:06:14.334 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T20:06:14.334 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T20:06:14.334 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 7114, 2023-12-24T20:06:14.334 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T20:06:14.334 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T20:06:14.334 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T20:06:14.334 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 7114 2023-12-24T20:06:14.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:06:14.335 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:06:14.335 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:06:14.335 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:06:14.335 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 2898644022 2023-12-24T20:06:14.335 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T20:06:14.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:06:14.335 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:06:14.335 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 2898644022 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.7114 192.168.0.1:0/2898644022", 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/2898644022", 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 84, 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 168, 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T20:06:14.336 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T20:06:14.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:06:14.343 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T20:06:14.343 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T20:06:14.366 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T20:06:14.366 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T20:06:14.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:06:14.366 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:06:14.435 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:06:14.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.580+0000 7f13d9da6700 1 Processor -- start 2023-12-24T20:06:14.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.580+0000 7f13d9da6700 1 -- start start 2023-12-24T20:06:14.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.581+0000 7f13d9da6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13d406aa70 0x7f13d406ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:14.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.581+0000 7f13d9da6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f13d4151080 0x7f13d406db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:14.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.581+0000 7f13d9da6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d406f440 con 0x7f13d4150cb0 2023-12-24T20:06:14.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.581+0000 7f13d9da6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d4064000 con 0x7f13d4151080 2023-12-24T20:06:14.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.581+0000 7f13d9da6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d41573b0 con 0x7f13d406aa70 2023-12-24T20:06:14.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.581+0000 7f13d3fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f13d4151080 0x7f13d406db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:14.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.581+0000 7f13d3fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f13d4151080 0x7f13d406db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35480/0 (socket says 172.21.15.61:35480) 2023-12-24T20:06:14.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.581+0000 7f13d3fff700 1 -- 172.21.15.61:0/4073395595 learned_addr learned my addr 172.21.15.61:0/4073395595 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:14.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.581+0000 7f13d2ffd700 1 --2- 172.21.15.61:0/4073395595 >> v2:172.21.15.133:3300/0 conn(0x7f13d406aa70 0x7f13d406ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.582+0000 7f13d3fff700 1 -- 172.21.15.61:0/4073395595 >> v2:172.21.15.133:3300/0 conn(0x7f13d406aa70 msgr2=0x7f13d406ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.582+0000 7f13d3fff700 1 --2- 172.21.15.61:0/4073395595 >> v2:172.21.15.133:3300/0 conn(0x7f13d406aa70 0x7f13d406ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.582+0000 7f13d3fff700 1 -- 172.21.15.61:0/4073395595 >> v1:172.21.15.133:6789/0 conn(0x7f13d4150cb0 legacy=0x7f13d406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.582+0000 7f13d3fff700 1 -- 172.21.15.61:0/4073395595 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4157690 con 0x7f13d4151080 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.582+0000 7f13d3fff700 1 --2- 172.21.15.61:0/4073395595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 0x7f13d406db10 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f13d4064320 tx=0x7f13cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddca233f8c7b647e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.582+0000 7f13d27fc700 1 -- 172.21.15.61:0/4073395595 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00e070 con 0x7f13d4151080 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.582+0000 7f13d27fc700 1 -- 172.21.15.61:0/4073395595 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc00ba20 con 0x7f13d4151080 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.582+0000 7f13d27fc700 1 -- 172.21.15.61:0/4073395595 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc0092e0 con 0x7f13d4151080 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.582+0000 7f13d9da6700 1 -- 172.21.15.61:0/4073395595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 msgr2=0x7f13d406db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.582+0000 7f13d9da6700 1 --2- 172.21.15.61:0/4073395595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 0x7f13d406db10 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f13d4064320 tx=0x7f13cc009840 comp rx=0 tx=0).stop 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.583+0000 7f13d9da6700 1 -- 172.21.15.61:0/4073395595 shutdown_connections 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.583+0000 7f13d9da6700 1 --2- 172.21.15.61:0/4073395595 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 0x7f13d406db10 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.583+0000 7f13d9da6700 1 --2- 172.21.15.61:0/4073395595 >> v2:172.21.15.133:3300/0 conn(0x7f13d406aa70 0x7f13d406ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.583+0000 7f13d9da6700 1 -- 172.21.15.61:0/4073395595 >> 172.21.15.61:0/4073395595 conn(0x7f13d40cceb0 msgr2=0x7f13d40cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:14.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.583+0000 7f13d9da6700 1 -- 172.21.15.61:0/4073395595 shutdown_connections 2023-12-24T20:06:14.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.583+0000 7f13d9da6700 1 -- 172.21.15.61:0/4073395595 wait complete. 2023-12-24T20:06:14.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.584+0000 7f13d9da6700 1 Processor -- start 2023-12-24T20:06:14.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.584+0000 7f13d9da6700 1 -- start start 2023-12-24T20:06:14.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d9da6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13d406aa70 0x7f13d40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d9da6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d4150cb0 0x7f13d4156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d9da6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 0x7f13d41455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d9da6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40c6e40 con 0x7f13d4151080 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d9da6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40c69b0 con 0x7f13d406aa70 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d9da6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40c5da0 con 0x7f13d4150cb0 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 0x7f13d41455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 0x7f13d41455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35484/0 (socket says 172.21.15.61:35484) 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d3fff700 1 -- 172.21.15.61:0/4124328710 learned_addr learned my addr 172.21.15.61:0/4124328710 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d37fe700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13d406aa70 0x7f13d40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d2ffd700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d4150cb0 0x7f13d4156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d3fff700 1 -- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d4150cb0 msgr2=0x7f13d4156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:14.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d3fff700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d4150cb0 0x7f13d4156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:14.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d3fff700 1 -- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13d406aa70 msgr2=0x7f13d40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:14.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d3fff700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13d406aa70 0x7f13d40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:14.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d3fff700 1 -- 172.21.15.61:0/4124328710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc009ae0 con 0x7f13d4151080 2023-12-24T20:06:14.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d2ffd700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d4150cb0 0x7f13d4156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:06:14.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d3fff700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 0x7f13d41455e0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009880 tx=0x7f13cc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:14.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13bb7fe700 1 -- 172.21.15.61:0/4124328710 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc008be0 con 0x7f13d4151080 2023-12-24T20:06:14.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13bb7fe700 1 -- 172.21.15.61:0/4124328710 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc008d60 con 0x7f13d4151080 2023-12-24T20:06:14.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13bb7fe700 1 -- 172.21.15.61:0/4124328710 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc01c660 con 0x7f13d4151080 2023-12-24T20:06:14.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.585+0000 7f13d9da6700 1 -- 172.21.15.61:0/4124328710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d40c6080 con 0x7f13d4151080 2023-12-24T20:06:14.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.586+0000 7f13d9da6700 1 -- 172.21.15.61:0/4124328710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d40c6640 con 0x7f13d4151080 2023-12-24T20:06:14.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.587+0000 7f13d9da6700 1 -- 172.21.15.61:0/4124328710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d40c6b40 con 0x7f13d4151080 2023-12-24T20:06:14.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.587+0000 7f13bb7fe700 1 -- 172.21.15.61:0/4124328710 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f13cc003040 con 0x7f13d4151080 2023-12-24T20:06:14.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.587+0000 7f13bb7fe700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f13c0066f30 0x7f13c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:14.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.588+0000 7f13bb7fe700 1 -- 172.21.15.61:0/4124328710 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f13cc085ed0 con 0x7f13d4151080 2023-12-24T20:06:14.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.588+0000 7f13d37fe700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f13c0066f30 0x7f13c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:14.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.588+0000 7f13d37fe700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f13c0066f30 0x7f13c00693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f13c4003860 tx=0x7f13c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:14.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.592+0000 7f13bb7fe700 1 -- 172.21.15.61:0/4124328710 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13cc0530a0 con 0x7f13d4151080 2023-12-24T20:06:14.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.833+0000 7f13d9da6700 1 -- 172.21.15.61:0/4124328710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13d404c3c0 con 0x7f13d4151080 2023-12-24T20:06:14.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.833+0000 7f13bb7fe700 1 -- 172.21.15.61:0/4124328710 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f13cc0566c0 con 0x7f13d4151080 2023-12-24T20:06:14.834 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:06:14.834 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/534815426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":534815426},{"type":"v1","addr":"172.21.15.133:6836","nonce":534815426}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1994792297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1994792297},{"type":"v1","addr":"172.21.15.133:6837","nonce":1994792297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7818,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3942988503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3942988503},{"type":"v1","addr":"172.21.15.61:6834","nonce":3942988503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:06:04.174684+0000","modified":"2023-12-24T20:06:07.799428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/764589487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":764589487},{"type":"v1","addr":"172.21.15.61:6835","nonce":764589487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:06:14.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 -- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f13c0066f30 msgr2=0x7f13c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:14.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f13c0066f30 0x7f13c00693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f13c4003860 tx=0x7f13c4009040 comp rx=0 tx=0).stop 2023-12-24T20:06:14.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 -- 172.21.15.61:0/4124328710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 msgr2=0x7f13d41455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:14.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 0x7f13d41455e0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009880 tx=0x7f13cc018000 comp rx=0 tx=0).stop 2023-12-24T20:06:14.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 -- 172.21.15.61:0/4124328710 shutdown_connections 2023-12-24T20:06:14.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f13c0066f30 0x7f13c00693e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:14.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f13d4151080 0x7f13d41455e0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:14.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13d406aa70 0x7f13d40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:14.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 --2- 172.21.15.61:0/4124328710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f13d4150cb0 0x7f13d4156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:14.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 -- 172.21.15.61:0/4124328710 >> 172.21.15.61:0/4124328710 conn(0x7f13d40cceb0 msgr2=0x7f13d40cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:14.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 -- 172.21.15.61:0/4124328710 shutdown_connections 2023-12-24T20:06:14.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:14.835+0000 7f13d9da6700 1 -- 172.21.15.61:0/4124328710 wait complete. 2023-12-24T20:06:14.837 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 84 2023-12-24T20:06:14.848 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-24T20:06:14.989 INFO:teuthology.orchestra.run.smithi061.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":7821,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":10.200273514999999,"mdsmap_epoch":84,"osdmap_epoch":168,"osdmap_epoch_barrier":168,"uptime":16.234703889999999} 2023-12-24T20:06:14.990 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 7821, "mdsmap_epoch": 84, "osdmap_epoch": 168, "osdmap_epoch_barrier": 168, "rank_uptime": 10.200273515, "state": "up:active", "uptime": 16.23470389, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:06:14.990 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-24T20:06:15.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.115+0000 7f01de374700 1 Processor -- start 2023-12-24T20:06:15.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.115+0000 7f01de374700 1 -- start start 2023-12-24T20:06:15.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.116+0000 7f01de374700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01d806a190 0x7f01d806a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.116+0000 7f01de374700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d8156d80 con 0x7f01d81569b0 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.116+0000 7f01de374700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d8067680 con 0x7f01d80ca8f0 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.116+0000 7f01de374700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d806adb0 con 0x7f01d806a190 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.116+0000 7f01d7fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f01d81569b0 0x7f01d8069a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51980/0 (socket says 172.21.15.61:51980) 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.116+0000 7f01d7fff700 1 -- 172.21.15.61:0/154109380 learned_addr learned my addr 172.21.15.61:0/154109380 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.117+0000 7f01d77fe700 1 --2- 172.21.15.61:0/154109380 >> v2:172.21.15.133:3300/0 conn(0x7f01d806a190 0x7f01d806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.117+0000 7f01d6ffd700 1 -- 172.21.15.61:0/154109380 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035090506 0 0) 0x7f01d8156d80 con 0x7f01d81569b0 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.117+0000 7f01d6ffd700 1 -- 172.21.15.61:0/154109380 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01c0003570 con 0x7f01d81569b0 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.117+0000 7f01d77fe700 1 -- 172.21.15.61:0/154109380 >> v1:172.21.15.133:6789/0 conn(0x7f01d80ca8f0 legacy=0x7f01d8067b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.117+0000 7f01d77fe700 1 -- 172.21.15.61:0/154109380 >> v1:172.21.15.61:6789/0 conn(0x7f01d81569b0 legacy=0x7f01d8069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.117+0000 7f01d77fe700 1 -- 172.21.15.61:0/154109380 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80c8bd0 con 0x7f01d806a190 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.117+0000 7f01d77fe700 1 --2- 172.21.15.61:0/154109380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d806a190 0x7f01d806a870 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0098e0 tx=0x7f01cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6943ba7a96024b21 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:15.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.117+0000 7f01d6ffd700 1 -- 172.21.15.61:0/154109380 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00b640 con 0x7f01d806a190 2023-12-24T20:06:15.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.117+0000 7f01d6ffd700 1 -- 172.21.15.61:0/154109380 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc00b7a0 con 0x7f01d806a190 2023-12-24T20:06:15.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.117+0000 7f01d6ffd700 1 -- 172.21.15.61:0/154109380 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc00bb20 con 0x7f01d806a190 2023-12-24T20:06:15.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.118+0000 7f01de374700 1 -- 172.21.15.61:0/154109380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d806a190 msgr2=0x7f01d806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:15.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.118+0000 7f01de374700 1 --2- 172.21.15.61:0/154109380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d806a190 0x7f01d806a870 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0098e0 tx=0x7f01cc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:06:15.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.118+0000 7f01de374700 1 -- 172.21.15.61:0/154109380 shutdown_connections 2023-12-24T20:06:15.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.118+0000 7f01de374700 1 --2- 172.21.15.61:0/154109380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d806a190 0x7f01d806a870 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:15.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.118+0000 7f01de374700 1 -- 172.21.15.61:0/154109380 >> 172.21.15.61:0/154109380 conn(0x7f01d80ce180 msgr2=0x7f01d80ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:15.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.118+0000 7f01de374700 1 -- 172.21.15.61:0/154109380 shutdown_connections 2023-12-24T20:06:15.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.118+0000 7f01de374700 1 -- 172.21.15.61:0/154109380 wait complete. 2023-12-24T20:06:15.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.119+0000 7f01de374700 1 Processor -- start 2023-12-24T20:06:15.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.119+0000 7f01de374700 1 -- start start 2023-12-24T20:06:15.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.120+0000 7f01de374700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d806a190 0x7f01d81420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:15.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.120+0000 7f01de374700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01d80ca8f0 0x7f01d80b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:15.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.120+0000 7f01de374700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01d81569b0 0x7f01d8070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:15.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.120+0000 7f01de374700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d8154df0 con 0x7f01d81569b0 2023-12-24T20:06:15.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.120+0000 7f01de374700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d81541e0 con 0x7f01d806a190 2023-12-24T20:06:15.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.120+0000 7f01de374700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d81544c0 con 0x7f01d80ca8f0 2023-12-24T20:06:15.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.120+0000 7f01dc911700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01d81569b0 0x7f01d8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:15.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.120+0000 7f01dc911700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01d81569b0 0x7f01d8070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35500/0 (socket says 172.21.15.61:35500) 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.120+0000 7f01dc911700 1 -- 172.21.15.61:0/2565265590 learned_addr learned my addr 172.21.15.61:0/2565265590 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01d7fff700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d806a190 0x7f01d81420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01d77fe700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01d80ca8f0 0x7f01d80b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01dc911700 1 -- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01d80ca8f0 msgr2=0x7f01d80b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01dc911700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01d80ca8f0 0x7f01d80b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01dc911700 1 -- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d806a190 msgr2=0x7f01d81420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01dc911700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d806a190 0x7f01d81420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01dc911700 1 -- 172.21.15.61:0/2565265590 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc009420 con 0x7f01d81569b0 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01dc911700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01d81569b0 0x7f01d8070640 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f01d000c8e0 tx=0x7f01d0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01bffff700 1 -- 172.21.15.61:0/2565265590 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d000ce80 con 0x7f01d81569b0 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01bffff700 1 -- 172.21.15.61:0/2565265590 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d000a7e0 con 0x7f01d81569b0 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01bffff700 1 -- 172.21.15.61:0/2565265590 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d000ab80 con 0x7f01d81569b0 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01de374700 1 -- 172.21.15.61:0/2565265590 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d81547a0 con 0x7f01d81569b0 2023-12-24T20:06:15.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.121+0000 7f01de374700 1 -- 172.21.15.61:0/2565265590 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d8142620 con 0x7f01d81569b0 2023-12-24T20:06:15.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.122+0000 7f01de374700 1 -- 172.21.15.61:0/2565265590 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d8154f60 con 0x7f01d81569b0 2023-12-24T20:06:15.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.123+0000 7f01bffff700 1 -- 172.21.15.61:0/2565265590 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f01d0012420 con 0x7f01d81569b0 2023-12-24T20:06:15.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.123+0000 7f01bffff700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f01c4066f30 0x7f01c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:06:15.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.123+0000 7f01bffff700 1 -- 172.21.15.61:0/2565265590 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01d0084820 con 0x7f01d81569b0 2023-12-24T20:06:15.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.123+0000 7f01d7fff700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f01c4066f30 0x7f01c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:06:15.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.124+0000 7f01d7fff700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f01c4066f30 0x7f01c40693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f01c80058d0 tx=0x7f01c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:06:15.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.127+0000 7f01bffff700 1 -- 172.21.15.61:0/2565265590 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01d0051a90 con 0x7f01d81569b0 2023-12-24T20:06:15.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.321+0000 7f01de374700 1 -- 172.21.15.61:0/2565265590 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f01d804c3c0 con 0x7f01d81569b0 2023-12-24T20:06:15.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.826+0000 7f01bffff700 1 -- 172.21.15.61:0/2565265590 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v169) v1 ==== 181+0+0 (secure 0 0 0) 0x7f01d00550b0 con 0x7f01d81569b0 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 -- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f01c4066f30 msgr2=0x7f01c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f01c4066f30 0x7f01c40693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f01c80058d0 tx=0x7f01c8009040 comp rx=0 tx=0).stop 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 -- 172.21.15.61:0/2565265590 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01d81569b0 msgr2=0x7f01d8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01d81569b0 0x7f01d8070640 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f01d000c8e0 tx=0x7f01d0001710 comp rx=0 tx=0).stop 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 -- 172.21.15.61:0/2565265590 shutdown_connections 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f01c4066f30 0x7f01c40693e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01d81569b0 0x7f01d8070640 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d806a190 0x7f01d81420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 --2- 172.21.15.61:0/2565265590 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f01d80ca8f0 0x7f01d80b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 -- 172.21.15.61:0/2565265590 >> 172.21.15.61:0/2565265590 conn(0x7f01d80ce180 msgr2=0x7f01d81526f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 -- 172.21.15.61:0/2565265590 shutdown_connections 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:06:15.829+0000 7f01de374700 1 -- 172.21.15.61:0/2565265590 wait complete. 2023-12-24T20:06:15.830 INFO:teuthology.orchestra.run.smithi061.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-24T20:06:15.843 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-24T20:06:15.981 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_mon_report_interval":"5"} 2023-12-24T20:06:15.981 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-24T20:06:15.981 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-24T20:06:16.114 INFO:teuthology.orchestra.run.smithi061.stdout:{"mon_tick_interval":"5"} 2023-12-24T20:06:16.114 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-24T20:06:16.114 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-12-24T20:06:16.114 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:06:16.114 DEBUG:teuthology.orchestra.run.smithi061:> import time 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> import datetime 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> # Write some buffered data through before going full, all should be well 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> print("writing some data through which we expect to succeed") 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> bytes = 0 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(f) 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> # buffered IO, the error should always only appear from fsync and not 2023-12-24T20:06:16.115 DEBUG:teuthology.orchestra.run.smithi061:> # from write 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> full = False 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> for n in range(0, int(32 * 1.1)): 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> try: 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> print("wrote bytes via buffered write, moving on to fsync") 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> except OSError as e: 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> if True: 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> raise 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> else: 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> full = True 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> break 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> try: 2023-12-24T20:06:16.116 DEBUG:teuthology.orchestra.run.smithi061:> os.fsync(f) 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> print("fsync'"'"'ed successfully") 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> except OSError as e: 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> full = True 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> break 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> else: 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> if n > 32 * 0.9: 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> # Be cautious in the last region where we expect to hit 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> time.sleep(15.0) 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> if not full: 2023-12-24T20:06:16.117 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-12-24T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi061:> # close() should not raise an error because we already caught it in 2023-12-24T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi061:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-12-24T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi061:> # since then because all IOs got cancelled on the full flag. 2023-12-24T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi061:> print("calling close") 2023-12-24T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi061:> os.close(f) 2023-12-24T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi061:> print("close() did not raise error") 2023-12-24T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi061:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-24T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:06:36.841 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:06:36.844 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:07:03.966 INFO:teuthology.orchestra.run.smithi061.stdout:writing some data through which we expect to succeed 2023-12-24T20:07:03.966 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-24T20:07:03.966 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.966 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.966 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 1.00 MB 2023-12-24T20:07:03.966 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.966 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.966 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 2.00 MB 2023-12-24T20:07:03.966 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 3.00 MB 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 4.00 MB 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 5.00 MB 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 6.00 MB 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.967 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 7.00 MB 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 8.00 MB 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 9.00 MB 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 10.00 MB 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.968 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.969 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 11.00 MB 2023-12-24T20:07:03.969 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.969 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.969 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 12.00 MB 2023-12-24T20:07:03.969 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.969 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.969 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 13.00 MB 2023-12-24T20:07:03.969 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 14.00 MB 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 15.00 MB 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 16.00 MB 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 17.00 MB 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.970 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 18.00 MB 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 19.00 MB 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 20.00 MB 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 21.00 MB 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 22.00 MB 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.971 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 23.00 MB 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 24.00 MB 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 25.00 MB 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 26.00 MB 2023-12-24T20:07:03.972 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 27.00 MB 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 28.00 MB 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 29.00 MB 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 30.00 MB 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.973 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.974 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 31.00 MB 2023-12-24T20:07:03.974 INFO:teuthology.orchestra.run.smithi061.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-24T20:07:03.974 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.974 INFO:teuthology.orchestra.run.smithi061.stdout:fsync'ed successfully 2023-12-24T20:07:03.974 INFO:teuthology.orchestra.run.smithi061.stdout:Not full yet after 32.00 MB 2023-12-24T20:07:03.974 INFO:teuthology.orchestra.run.smithi061.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-24T20:07:03.974 INFO:teuthology.orchestra.run.smithi061.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-24T20:07:03.974 INFO:teuthology.orchestra.run.smithi061.stdout:Reached fullness after 33.00 MB 2023-12-24T20:07:03.975 INFO:teuthology.orchestra.run.smithi061.stdout:calling close 2023-12-24T20:07:03.975 INFO:teuthology.orchestra.run.smithi061.stdout:close() did not raise error 2023-12-24T20:07:04.046 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:07:04.047 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:07:04.097 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:07:04.156 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:07:04.156 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T20:07:04.156 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:07:04.156 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T20:07:04.201 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[73157]: fuse finished with error 0 and tester_r 0 2023-12-24T20:07:04.202 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:07:04.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:04.203 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:07:04.332 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T20:07:04.333 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:07:04.333 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T20:07:04.381 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[48686]: fuse finished with error 0 and tester_r 0 2023-12-24T20:07:04.383 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:07:04.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:04.383 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T20:07:04.469 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:07:04.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:04.470 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T20:07:04.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:07:04.490 INFO:teuthology.orchestra.run.smithi061.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-24T20:07:04.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:07:04.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:04.490 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T20:07:04.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:07:04.510 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-24T20:07:04.511 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:07:04.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.657+0000 7f88e4311700 1 Processor -- start 2023-12-24T20:07:04.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.657+0000 7f88e4311700 1 -- start start 2023-12-24T20:07:04.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e4311700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88dc159b00 0x7f88dc067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:04.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e4311700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc0a84d0 con 0x7f88dc070d50 2023-12-24T20:07:04.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e4311700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc0a7620 con 0x7f88dc0af7d0 2023-12-24T20:07:04.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e4311700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc0a78c0 con 0x7f88dc159b00 2023-12-24T20:07:04.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e28ae700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f88dc070d50 0x7f88dc15a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:55704/0 (socket says 172.21.15.61:55704) 2023-12-24T20:07:04.661 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e28ae700 1 -- 172.21.15.61:0/1052518602 learned_addr learned my addr 172.21.15.61:0/1052518602 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e20ad700 1 --2- 172.21.15.61:0/1052518602 >> v2:172.21.15.133:3300/0 conn(0x7f88dc159b00 0x7f88dc067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101318882 0 0) 0x7f88dc0a84d0 con 0x7f88dc070d50 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88c8003570 con 0x7f88dc070d50 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030239343 0 0) 0x7f88dc0a7620 con 0x7f88dc0af7d0 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88dc0a84d0 con 0x7f88dc0af7d0 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3809077121 0 0) 0x7f88c8003570 con 0x7f88dc070d50 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 >> v2:172.21.15.133:3300/0 conn(0x7f88dc159b00 msgr2=0x7f88dc067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 --2- 172.21.15.61:0/1052518602 >> v2:172.21.15.133:3300/0 conn(0x7f88dc159b00 0x7f88dc067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 >> v1:172.21.15.133:6789/0 conn(0x7f88dc0af7d0 legacy=0x7f88dc070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0a7ba0 con 0x7f88dc070d50 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f88d40017f0 con 0x7f88dc070d50 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 >> v1:172.21.15.61:6789/0 conn(0x7f88dc070d50 legacy=0x7f88dc15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88c8004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c8004810 0x7f88c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:04.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c8005210 0x7f88c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0a78c0 con 0x7f88c8003c40 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c800c130 con 0x7f88c8005210 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.658+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c800c2c0 con 0x7f88c8004810 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e20ad700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88c8004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e28ae700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c8005210 0x7f88c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e18ac700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c8004810 0x7f88c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e20ad700 1 -- 172.21.15.61:0/1052518602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c8004810 msgr2=0x7f88c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e20ad700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88c8004810 0x7f88c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e20ad700 1 -- 172.21.15.61:0/1052518602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c8005210 msgr2=0x7f88c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e20ad700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c8005210 0x7f88c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e20ad700 1 -- 172.21.15.61:0/1052518602 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8003570 con 0x7f88c8003c40 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e28ae700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c8005210 0x7f88c800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e28ae700 1 -- 172.21.15.61:0/1052518602 reap_dead start 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e20ad700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88c8004030 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009c30 tx=0x7f88d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33dc2e50a98ddf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:04.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80095b0 con 0x7f88c8003c40 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d800e710 con 0x7f88c8003c40 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.659+0000 7f88e10ab700 1 -- 172.21.15.61:0/1052518602 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d800ead0 con 0x7f88c8003c40 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.660+0000 7f88e4311700 1 -- 172.21.15.61:0/1052518602 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 msgr2=0x7f88c8004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.660+0000 7f88e4311700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88c8004030 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009c30 tx=0x7f88d80091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.660+0000 7f88e4311700 1 -- 172.21.15.61:0/1052518602 shutdown_connections 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.660+0000 7f88e4311700 1 --2- 172.21.15.61:0/1052518602 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88c8004030 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.660+0000 7f88e4311700 1 -- 172.21.15.61:0/1052518602 >> 172.21.15.61:0/1052518602 conn(0x7f88dc0ca200 msgr2=0x7f88dc0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.660+0000 7f88e4311700 1 -- 172.21.15.61:0/1052518602 shutdown_connections 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.660+0000 7f88e4311700 1 -- 172.21.15.61:0/1052518602 wait complete. 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.661+0000 7f88e4311700 1 Processor -- start 2023-12-24T20:07:04.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.661+0000 7f88e4311700 1 -- start start 2023-12-24T20:07:04.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e4311700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88dc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:04.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e4311700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88dc15eff0 0x7f88dc0ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:04.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e4311700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88dc15f460 0x7f88dc144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:04.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e4311700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc16a360 con 0x7f88c8003c40 2023-12-24T20:07:04.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e4311700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc16a640 con 0x7f88dc15eff0 2023-12-24T20:07:04.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e4311700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc16a920 con 0x7f88dc15f460 2023-12-24T20:07:04.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e20ad700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88dc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:04.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e20ad700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88dc0b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36726/0 (socket says 172.21.15.61:36726) 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e20ad700 1 -- 172.21.15.61:0/1341899447 learned_addr learned my addr 172.21.15.61:0/1341899447 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e18ac700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88dc15eff0 0x7f88dc0ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e28ae700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88dc15f460 0x7f88dc144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e20ad700 1 -- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88dc15f460 msgr2=0x7f88dc144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e20ad700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88dc15f460 0x7f88dc144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e20ad700 1 -- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88dc15eff0 msgr2=0x7f88dc0ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e20ad700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88dc15eff0 0x7f88dc0ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.662+0000 7f88e20ad700 1 -- 172.21.15.61:0/1341899447 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc16ac00 con 0x7f88c8003c40 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.663+0000 7f88e20ad700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88dc0b0530 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f88c80057b0 tx=0x7f88d801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.663+0000 7f88d27fc700 1 -- 172.21.15.61:0/1341899447 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8022070 con 0x7f88c8003c40 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.663+0000 7f88d27fc700 1 -- 172.21.15.61:0/1341899447 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d800e880 con 0x7f88c8003c40 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.663+0000 7f88e4311700 1 -- 172.21.15.61:0/1341899447 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc16a360 con 0x7f88c8003c40 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.663+0000 7f88d27fc700 1 -- 172.21.15.61:0/1341899447 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8027470 con 0x7f88c8003c40 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.663+0000 7f88e4311700 1 -- 172.21.15.61:0/1341899447 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc169f30 con 0x7f88c8003c40 2023-12-24T20:07:04.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.664+0000 7f88e4311700 1 -- 172.21.15.61:0/1341899447 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc16ad90 con 0x7f88c8003c40 2023-12-24T20:07:04.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.665+0000 7f88d27fc700 1 -- 172.21.15.61:0/1341899447 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f88d801c450 con 0x7f88c8003c40 2023-12-24T20:07:04.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.665+0000 7f88d27fc700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88c0066f30 0x7f88c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:04.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.665+0000 7f88d27fc700 1 -- 172.21.15.61:0/1341899447 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f88d8086150 con 0x7f88c8003c40 2023-12-24T20:07:04.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.665+0000 7f88d27fc700 1 -- 172.21.15.61:0/1341899447 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f88c006eab0 con 0x7f88c8003c40 2023-12-24T20:07:04.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.665+0000 7f88e18ac700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88c0066f30 0x7f88c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:04.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.666+0000 7f88e18ac700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88c0066f30 0x7f88c00693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f88dc064d70 tx=0x7f88cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:04.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.669+0000 7f88d27fc700 1 -- 172.21.15.61:0/1341899447 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88d80533e0 con 0x7f88c8003c40 2023-12-24T20:07:04.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.916+0000 7f88e4311700 1 -- 172.21.15.61:0/1341899447 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88dc16d740 con 0x7f88c8003c40 2023-12-24T20:07:04.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.916+0000 7f88d27fc700 1 -- 172.21.15.61:0/1341899447 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f88d8017090 con 0x7f88c8003c40 2023-12-24T20:07:04.917 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:04.917 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/534815426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":534815426},{"type":"v1","addr":"172.21.15.133:6836","nonce":534815426}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1994792297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1994792297},{"type":"v1","addr":"172.21.15.133:6837","nonce":1994792297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7818,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3942988503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3942988503},{"type":"v1","addr":"172.21.15.61:6834","nonce":3942988503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:06:04.174684+0000","modified":"2023-12-24T20:06:07.799428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/764589487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":764589487},{"type":"v1","addr":"172.21.15.61:6835","nonce":764589487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:07:04.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 -- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88c0066f30 msgr2=0x7f88c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:04.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88c0066f30 0x7f88c00693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f88dc064d70 tx=0x7f88cc009040 comp rx=0 tx=0).stop 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 -- 172.21.15.61:0/1341899447 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 msgr2=0x7f88dc0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88dc0b0530 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f88c80057b0 tx=0x7f88d801a000 comp rx=0 tx=0).stop 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 -- 172.21.15.61:0/1341899447 shutdown_connections 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f88dc15f460 0x7f88dc144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f88c0066f30 0x7f88c00693e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f88c8003c40 0x7f88dc0b0530 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 --2- 172.21.15.61:0/1341899447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88dc15eff0 0x7f88dc0ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 -- 172.21.15.61:0/1341899447 >> 172.21.15.61:0/1341899447 conn(0x7f88dc0ca200 msgr2=0x7f88dc0afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 -- 172.21.15.61:0/1341899447 shutdown_connections 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:04.919+0000 7f88e4311700 1 -- 172.21.15.61:0/1341899447 wait complete. 2023-12-24T20:07:04.920 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 84 2023-12-24T20:07:04.932 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:07:05.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.053+0000 7f39c9a20700 1 Processor -- start 2023-12-24T20:07:05.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.053+0000 7f39c9a20700 1 -- start start 2023-12-24T20:07:05.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.054+0000 7f39c9a20700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39c413faa0 0x7f39c40c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.054+0000 7f39c9a20700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f39c406a310 0x7f39c406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.054+0000 7f39c9a20700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c413fe70 con 0x7f39c40c7a30 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.054+0000 7f39c9a20700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c40cbdc0 con 0x7f39c406a310 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.054+0000 7f39c9a20700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c406d640 con 0x7f39c413faa0 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.054+0000 7f39c27fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f39c40c7a30 0x7f39c4069c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:55720/0 (socket says 172.21.15.61:55720) 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.054+0000 7f39c27fc700 1 -- 172.21.15.61:0/4078863550 learned_addr learned my addr 172.21.15.61:0/4078863550 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.054+0000 7f39c37fe700 1 --2- 172.21.15.61:0/4078863550 >> v2:172.21.15.61:3300/0 conn(0x7f39c406a310 0x7f39c406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c2ffd700 1 --2- 172.21.15.61:0/4078863550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39c413faa0 0x7f39c40c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c1ffb700 1 -- 172.21.15.61:0/4078863550 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820245492 0 0) 0x7f39b4001110 con 0x7f39c40c7a30 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c1ffb700 1 -- 172.21.15.61:0/4078863550 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39ac004680 con 0x7f39c40c7a30 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c37fe700 1 -- 172.21.15.61:0/4078863550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39c413faa0 msgr2=0x7f39c40c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:05.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c37fe700 1 --2- 172.21.15.61:0/4078863550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39c413faa0 0x7f39c40c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c37fe700 1 -- 172.21.15.61:0/4078863550 >> v1:172.21.15.61:6789/0 conn(0x7f39c40c7a30 legacy=0x7f39c4069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c37fe700 1 -- 172.21.15.61:0/4078863550 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c40c7e80 con 0x7f39c406a310 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c37fe700 1 --2- 172.21.15.61:0/4078863550 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c406a310 0x7f39c406dad0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009e60 tx=0x7f39bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a8df90ad382ac9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c1ffb700 1 -- 172.21.15.61:0/4078863550 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00e070 con 0x7f39c406a310 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c1ffb700 1 -- 172.21.15.61:0/4078863550 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc00bab0 con 0x7f39c406a310 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.055+0000 7f39c1ffb700 1 -- 172.21.15.61:0/4078863550 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00be30 con 0x7f39c406a310 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.056+0000 7f39c9a20700 1 -- 172.21.15.61:0/4078863550 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c406a310 msgr2=0x7f39c406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.056+0000 7f39c9a20700 1 --2- 172.21.15.61:0/4078863550 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c406a310 0x7f39c406dad0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009e60 tx=0x7f39bc009780 comp rx=0 tx=0).stop 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.056+0000 7f39c9a20700 1 -- 172.21.15.61:0/4078863550 shutdown_connections 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.056+0000 7f39c9a20700 1 --2- 172.21.15.61:0/4078863550 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39c413faa0 0x7f39c40c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.056+0000 7f39c9a20700 1 --2- 172.21.15.61:0/4078863550 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c406a310 0x7f39c406dad0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.056+0000 7f39c9a20700 1 -- 172.21.15.61:0/4078863550 >> 172.21.15.61:0/4078863550 conn(0x7f39c40cceb0 msgr2=0x7f39c40cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:05.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.056+0000 7f39c9a20700 1 -- 172.21.15.61:0/4078863550 shutdown_connections 2023-12-24T20:07:05.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.056+0000 7f39c9a20700 1 -- 172.21.15.61:0/4078863550 wait complete. 2023-12-24T20:07:05.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.057+0000 7f39c9a20700 1 Processor -- start 2023-12-24T20:07:05.060 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.057+0000 7f39c9a20700 1 -- start start 2023-12-24T20:07:05.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c9a20700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39c406a310 0x7f39c4168ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c9a20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39c40c7a30 0x7f39c413b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c9a20700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c413faa0 0x7f39c413be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c9a20700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c413c3c0 con 0x7f39c413faa0 2023-12-24T20:07:05.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c9a20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c40c2af0 con 0x7f39c40c7a30 2023-12-24T20:07:05.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c9a20700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c40c2dd0 con 0x7f39c406a310 2023-12-24T20:07:05.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c413faa0 0x7f39c413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c413faa0 0x7f39c413be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36744/0 (socket says 172.21.15.61:36744) 2023-12-24T20:07:05.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c37fe700 1 -- 172.21.15.61:0/4126360876 learned_addr learned my addr 172.21.15.61:0/4126360876 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c2ffd700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39c406a310 0x7f39c4168ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c27fc700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39c40c7a30 0x7f39c413b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c37fe700 1 -- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39c406a310 msgr2=0x7f39c4168ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c37fe700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39c406a310 0x7f39c4168ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c37fe700 1 -- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39c40c7a30 msgr2=0x7f39c413b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c37fe700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39c40c7a30 0x7f39c413b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c37fe700 1 -- 172.21.15.61:0/4126360876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc009a20 con 0x7f39c413faa0 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.058+0000 7f39c37fe700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c413faa0 0x7f39c413be80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f39c406c4b0 tx=0x7f39bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.059+0000 7f39aaffd700 1 -- 172.21.15.61:0/4126360876 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc012e30 con 0x7f39c413faa0 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.059+0000 7f39aaffd700 1 -- 172.21.15.61:0/4126360876 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc027470 con 0x7f39c413faa0 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.059+0000 7f39c9a20700 1 -- 172.21.15.61:0/4126360876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c40c30b0 con 0x7f39c413faa0 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.059+0000 7f39aaffd700 1 -- 172.21.15.61:0/4126360876 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc027830 con 0x7f39c413faa0 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.059+0000 7f39c9a20700 1 -- 172.21.15.61:0/4126360876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c4169410 con 0x7f39c413faa0 2023-12-24T20:07:05.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.060+0000 7f39c9a20700 1 -- 172.21.15.61:0/4126360876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c404c3c0 con 0x7f39c413faa0 2023-12-24T20:07:05.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.061+0000 7f39aaffd700 1 -- 172.21.15.61:0/4126360876 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f39bc024070 con 0x7f39c413faa0 2023-12-24T20:07:05.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.061+0000 7f39aaffd700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b0066f30 0x7f39b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.061+0000 7f39aaffd700 1 -- 172.21.15.61:0/4126360876 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f39bc086ec0 con 0x7f39c413faa0 2023-12-24T20:07:05.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.061+0000 7f39aaffd700 1 -- 172.21.15.61:0/4126360876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f39b006eab0 con 0x7f39c413faa0 2023-12-24T20:07:05.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.061+0000 7f39c2ffd700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b0066f30 0x7f39b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.062+0000 7f39c2ffd700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b0066f30 0x7f39b00693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009d10 tx=0x7f39b80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:05.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.064+0000 7f39aaffd700 1 -- 172.21.15.61:0/4126360876 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39bc02c020 con 0x7f39c413faa0 2023-12-24T20:07:05.260 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.260+0000 7f39c9a20700 1 -- 172.21.15.61:0/4126360876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39c406a8b0 con 0x7f39c413faa0 2023-12-24T20:07:05.261 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.261+0000 7f39aaffd700 1 -- 172.21.15.61:0/4126360876 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+15441 (secure 0 0 0) 0x7f39bc058e60 con 0x7f39c413faa0 2023-12-24T20:07:05.261 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:05.261 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":172,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:06:58.646798+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:06:01.971715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-24T20:06:03.153177+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:07:05.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 -- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b0066f30 msgr2=0x7f39b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b0066f30 0x7f39b00693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009d10 tx=0x7f39b80091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 -- 172.21.15.61:0/4126360876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c413faa0 msgr2=0x7f39c413be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c413faa0 0x7f39c413be80 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f39c406c4b0 tx=0x7f39bc019000 comp rx=0 tx=0).stop 2023-12-24T20:07:05.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 -- 172.21.15.61:0/4126360876 shutdown_connections 2023-12-24T20:07:05.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39c406a310 0x7f39c4168ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f39b0066f30 0x7f39b00693e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39c413faa0 0x7f39c413be80 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 --2- 172.21.15.61:0/4126360876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39c40c7a30 0x7f39c413b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 -- 172.21.15.61:0/4126360876 >> 172.21.15.61:0/4126360876 conn(0x7f39c40cceb0 msgr2=0x7f39c406eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:05.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 -- 172.21.15.61:0/4126360876 shutdown_connections 2023-12-24T20:07:05.264 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.263+0000 7f39c9a20700 1 -- 172.21.15.61:0/4126360876 wait complete. 2023-12-24T20:07:05.276 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T20:06:01.971715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T20:06:03.153177+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '170', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:07:05.276 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:07:05.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.400+0000 7f3bc45ec700 1 Processor -- start 2023-12-24T20:07:05.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.400+0000 7f3bc45ec700 1 -- start start 2023-12-24T20:07:05.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc45ec700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 0x7f3bbc0c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc45ec700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3bbc0c7c30 0x7f3bbc0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc45ec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bbc15afd0 0x7f3bbc0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc45ec700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c8c30 con 0x7f3bbc0c7c30 2023-12-24T20:07:05.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc45ec700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c80b0 con 0x7f3bbc15afd0 2023-12-24T20:07:05.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc45ec700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c8390 con 0x7f3bbc15ac00 2023-12-24T20:07:05.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc1b87700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3bbc0c7c30 0x7f3bbc0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc1b87700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3bbc0c7c30 0x7f3bbc0cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36756/0 (socket says 172.21.15.61:36756) 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc1b87700 1 -- 172.21.15.61:0/573491103 learned_addr learned my addr 172.21.15.61:0/573491103 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc2388700 1 --2- 172.21.15.61:0/573491103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 0x7f3bbc0c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc2b89700 1 --2- 172.21.15.61:0/573491103 >> v2:172.21.15.133:3300/0 conn(0x7f3bbc15afd0 0x7f3bbc0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc1b87700 1 -- 172.21.15.61:0/573491103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 msgr2=0x7f3bbc0c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc1b87700 1 --2- 172.21.15.61:0/573491103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 0x7f3bbc0c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc1b87700 1 -- 172.21.15.61:0/573491103 >> v2:172.21.15.133:3300/0 conn(0x7f3bbc15afd0 msgr2=0x7f3bbc0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc1b87700 1 --2- 172.21.15.61:0/573491103 >> v2:172.21.15.133:3300/0 conn(0x7f3bbc15afd0 0x7f3bbc0cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc1b87700 1 -- 172.21.15.61:0/573491103 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0c8670 con 0x7f3bbc0c7c30 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc2b89700 1 --2- 172.21.15.61:0/573491103 >> v2:172.21.15.133:3300/0 conn(0x7f3bbc15afd0 0x7f3bbc0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc2388700 1 --2- 172.21.15.61:0/573491103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 0x7f3bbc0c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.401+0000 7f3bc1b87700 1 --2- 172.21.15.61:0/573491103 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc0c7c30 0x7f3bbc0cae90 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc06f880 tx=0x7f3bb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e14c420b29276a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc1386700 1 -- 172.21.15.61:0/573491103 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800b860 con 0x7f3bbc0c7c30 2023-12-24T20:07:05.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc1386700 1 -- 172.21.15.61:0/573491103 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb800b9c0 con 0x7f3bbc0c7c30 2023-12-24T20:07:05.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc1386700 1 -- 172.21.15.61:0/573491103 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800bd60 con 0x7f3bbc0c7c30 2023-12-24T20:07:05.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc45ec700 1 -- 172.21.15.61:0/573491103 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc0c7c30 msgr2=0x7f3bbc0cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc45ec700 1 --2- 172.21.15.61:0/573491103 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc0c7c30 0x7f3bbc0cae90 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc06f880 tx=0x7f3bb8009250 comp rx=0 tx=0).stop 2023-12-24T20:07:05.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc45ec700 1 -- 172.21.15.61:0/573491103 shutdown_connections 2023-12-24T20:07:05.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc45ec700 1 --2- 172.21.15.61:0/573491103 >> v2:172.21.15.133:3300/0 conn(0x7f3bbc15afd0 0x7f3bbc0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc45ec700 1 --2- 172.21.15.61:0/573491103 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 0x7f3bbc0c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc45ec700 1 --2- 172.21.15.61:0/573491103 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc0c7c30 0x7f3bbc0cae90 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc45ec700 1 -- 172.21.15.61:0/573491103 >> 172.21.15.61:0/573491103 conn(0x7f3bbc0cd0b0 msgr2=0x7f3bbc0cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:05.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc45ec700 1 -- 172.21.15.61:0/573491103 shutdown_connections 2023-12-24T20:07:05.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.402+0000 7f3bc45ec700 1 -- 172.21.15.61:0/573491103 wait complete. 2023-12-24T20:07:05.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.403+0000 7f3bc45ec700 1 Processor -- start 2023-12-24T20:07:05.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.404+0000 7f3bc45ec700 1 -- start start 2023-12-24T20:07:05.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.404+0000 7f3bc45ec700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 0x7f3bbc0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.404+0000 7f3bc45ec700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc15afd0 0x7f3bbc0af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.404+0000 7f3bc45ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bbc0ae920 0x7f3bbc151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.404+0000 7f3bc45ec700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0afe50 con 0x7f3bbc15afd0 2023-12-24T20:07:05.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.404+0000 7f3bc45ec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0b09d0 con 0x7f3bbc0ae920 2023-12-24T20:07:05.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.404+0000 7f3bc45ec700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc151fd0 con 0x7f3bbc15ac00 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.404+0000 7f3bc1b87700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc15afd0 0x7f3bbc0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.404+0000 7f3bc1b87700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc15afd0 0x7f3bbc0af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36758/0 (socket says 172.21.15.61:36758) 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.404+0000 7f3bc1b87700 1 -- 172.21.15.61:0/171423906 learned_addr learned my addr 172.21.15.61:0/171423906 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc2388700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 0x7f3bbc0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc2b89700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bbc0ae920 0x7f3bbc151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc1b87700 1 -- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 msgr2=0x7f3bbc0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc1b87700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 0x7f3bbc0b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc1b87700 1 -- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bbc0ae920 msgr2=0x7f3bbc151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc1b87700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bbc0ae920 0x7f3bbc151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc1b87700 1 -- 172.21.15.61:0/171423906 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80094f0 con 0x7f3bbc15afd0 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc2388700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 0x7f3bbc0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc1b87700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc15afd0 0x7f3bbc0af360 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0c4040 tx=0x7f3bb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bb27fc700 1 -- 172.21.15.61:0/171423906 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb801a450 con 0x7f3bbc15afd0 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bb27fc700 1 -- 172.21.15.61:0/171423906 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb801a5b0 con 0x7f3bbc15afd0 2023-12-24T20:07:05.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc45ec700 1 -- 172.21.15.61:0/171423906 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc0b00a0 con 0x7f3bbc15afd0 2023-12-24T20:07:05.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bb27fc700 1 -- 172.21.15.61:0/171423906 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb801a970 con 0x7f3bbc15afd0 2023-12-24T20:07:05.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.405+0000 7f3bc45ec700 1 -- 172.21.15.61:0/171423906 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc0b0660 con 0x7f3bbc15afd0 2023-12-24T20:07:05.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.406+0000 7f3bc45ec700 1 -- 172.21.15.61:0/171423906 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc04c3c0 con 0x7f3bbc15afd0 2023-12-24T20:07:05.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.406+0000 7f3bb27fc700 1 -- 172.21.15.61:0/171423906 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3bb801ad20 con 0x7f3bbc15afd0 2023-12-24T20:07:05.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.407+0000 7f3bb27fc700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ba0066f30 0x7f3ba00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.407+0000 7f3bb27fc700 1 -- 172.21.15.61:0/171423906 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f3bb8085c40 con 0x7f3bbc15afd0 2023-12-24T20:07:05.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.407+0000 7f3bb27fc700 1 -- 172.21.15.61:0/171423906 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f3ba006eab0 con 0x7f3bbc15afd0 2023-12-24T20:07:05.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.407+0000 7f3bc2388700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ba0066f30 0x7f3ba00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.407+0000 7f3bc2388700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ba0066f30 0x7f3ba00693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3bac006ea0 tx=0x7f3bac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:05.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.411+0000 7f3bb27fc700 1 -- 172.21.15.61:0/171423906 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bb8015060 con 0x7f3bbc15afd0 2023-12-24T20:07:05.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.602+0000 7f3bc45ec700 1 -- 172.21.15.61:0/171423906 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bbc0c8950 con 0x7f3bbc15afd0 2023-12-24T20:07:05.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.602+0000 7f3bb27fc700 1 -- 172.21.15.61:0/171423906 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v172) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bb802a030 con 0x7f3bbc15afd0 2023-12-24T20:07:05.603 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:07:05.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 -- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ba0066f30 msgr2=0x7f3ba00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ba0066f30 0x7f3ba00693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3bac006ea0 tx=0x7f3bac008040 comp rx=0 tx=0).stop 2023-12-24T20:07:05.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 -- 172.21.15.61:0/171423906 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc15afd0 msgr2=0x7f3bbc0af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc15afd0 0x7f3bbc0af360 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0c4040 tx=0x7f3bb8017000 comp rx=0 tx=0).stop 2023-12-24T20:07:05.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 -- 172.21.15.61:0/171423906 shutdown_connections 2023-12-24T20:07:05.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3bbc15ac00 0x7f3bbc0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3ba0066f30 0x7f3ba00693e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bbc0ae920 0x7f3bbc151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 --2- 172.21.15.61:0/171423906 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3bbc15afd0 0x7f3bbc0af360 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 -- 172.21.15.61:0/171423906 >> 172.21.15.61:0/171423906 conn(0x7f3bbc0cd0b0 msgr2=0x7f3bbc0c3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:05.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 -- 172.21.15.61:0/171423906 shutdown_connections 2023-12-24T20:07:05.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.604+0000 7f3bc45ec700 1 -- 172.21.15.61:0/171423906 wait complete. 2023-12-24T20:07:05.618 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:07:05.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.743+0000 7f19d8bf7700 1 Processor -- start 2023-12-24T20:07:05.743 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.743+0000 7f19d8bf7700 1 -- start start 2023-12-24T20:07:05.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d8bf7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f19d415ac00 0x7f19d40c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d8bf7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19d40cb5a0 0x7f19d40aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d8bf7700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d40c8c30 con 0x7f19d40c7c30 2023-12-24T20:07:05.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d8bf7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d40c80b0 con 0x7f19d415ac00 2023-12-24T20:07:05.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d8bf7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d40c8390 con 0x7f19d40cb5a0 2023-12-24T20:07:05.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f19d415ac00 0x7f19d40c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d1d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f19d40c7c30 0x7f19d40cae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:55728/0 (socket says 172.21.15.61:55728) 2023-12-24T20:07:05.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d1d9b700 1 -- 172.21.15.61:0/2436888018 learned_addr learned my addr 172.21.15.61:0/2436888018 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:05.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d2d9d700 1 --2- 172.21.15.61:0/2436888018 >> v2:172.21.15.133:3300/0 conn(0x7f19d40cb5a0 0x7f19d40aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d259c700 1 -- 172.21.15.61:0/2436888018 >> v2:172.21.15.133:3300/0 conn(0x7f19d40cb5a0 msgr2=0x7f19d40aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:05.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d259c700 1 --2- 172.21.15.61:0/2436888018 >> v2:172.21.15.133:3300/0 conn(0x7f19d40cb5a0 0x7f19d40aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d259c700 1 -- 172.21.15.61:0/2436888018 >> v1:172.21.15.61:6789/0 conn(0x7f19d40c7c30 legacy=0x7f19d40cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d259c700 1 -- 172.21.15.61:0/2436888018 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d40c8670 con 0x7f19d415ac00 2023-12-24T20:07:05.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.744+0000 7f19d259c700 1 --2- 172.21.15.61:0/2436888018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d415ac00 0x7f19d40c76f0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f19d415a2f0 tx=0x7f19c4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92b1711b345fe65 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:05.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d159a700 1 -- 172.21.15.61:0/2436888018 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4005c10 con 0x7f19d415ac00 2023-12-24T20:07:05.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d159a700 1 -- 172.21.15.61:0/2436888018 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c4005d70 con 0x7f19d415ac00 2023-12-24T20:07:05.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d159a700 1 -- 172.21.15.61:0/2436888018 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4006260 con 0x7f19d415ac00 2023-12-24T20:07:05.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2436888018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d415ac00 msgr2=0x7f19d40c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d8bf7700 1 --2- 172.21.15.61:0/2436888018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d415ac00 0x7f19d40c76f0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f19d415a2f0 tx=0x7f19c4009120 comp rx=0 tx=0).stop 2023-12-24T20:07:05.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2436888018 shutdown_connections 2023-12-24T20:07:05.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d8bf7700 1 --2- 172.21.15.61:0/2436888018 >> v2:172.21.15.133:3300/0 conn(0x7f19d40cb5a0 0x7f19d40aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d8bf7700 1 --2- 172.21.15.61:0/2436888018 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d415ac00 0x7f19d40c76f0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2436888018 >> 172.21.15.61:0/2436888018 conn(0x7f19d40cd0b0 msgr2=0x7f19d40cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:05.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2436888018 shutdown_connections 2023-12-24T20:07:05.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.745+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2436888018 wait complete. 2023-12-24T20:07:05.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.746+0000 7f19d8bf7700 1 Processor -- start 2023-12-24T20:07:05.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.746+0000 7f19d8bf7700 1 -- start start 2023-12-24T20:07:05.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d8bf7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d40cb5a0 0x7f19d40c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d8bf7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d415ac00 0x7f19d40b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d8bf7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19d40c4bb0 0x7f19d40c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d8bf7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d416ae50 con 0x7f19d40cb5a0 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d8bf7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40c5570 con 0x7f19d40c4bb0 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d8bf7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4169f50 con 0x7f19d415ac00 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d40cb5a0 0x7f19d40c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d40cb5a0 0x7f19d40c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36772/0 (socket says 172.21.15.61:36772) 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d259c700 1 -- 172.21.15.61:0/2086676881 learned_addr learned my addr 172.21.15.61:0/2086676881 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d1d9b700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d415ac00 0x7f19d40b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d2d9d700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19d40c4bb0 0x7f19d40c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d259c700 1 -- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d415ac00 msgr2=0x7f19d40b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d259c700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d415ac00 0x7f19d40b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d259c700 1 -- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19d40c4bb0 msgr2=0x7f19d40c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d259c700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19d40c4bb0 0x7f19d40c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d259c700 1 -- 172.21.15.61:0/2086676881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40093c0 con 0x7f19d40cb5a0 2023-12-24T20:07:05.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d2d9d700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19d40c4bb0 0x7f19d40c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:05.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.747+0000 7f19d1d9b700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d415ac00 0x7f19d40b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:05.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.748+0000 7f19d259c700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d40cb5a0 0x7f19d40c4160 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f19c400b0e0 tx=0x7f19c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:05.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.748+0000 7f19c27fc700 1 -- 172.21.15.61:0/2086676881 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c400bce0 con 0x7f19d40cb5a0 2023-12-24T20:07:05.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.748+0000 7f19c27fc700 1 -- 172.21.15.61:0/2086676881 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c400be60 con 0x7f19d40cb5a0 2023-12-24T20:07:05.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.748+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2086676881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d416a1d0 con 0x7f19d40cb5a0 2023-12-24T20:07:05.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.748+0000 7f19c27fc700 1 -- 172.21.15.61:0/2086676881 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c401a670 con 0x7f19d40cb5a0 2023-12-24T20:07:05.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.748+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2086676881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d416a790 con 0x7f19d40cb5a0 2023-12-24T20:07:05.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.749+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2086676881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d404c3c0 con 0x7f19d40cb5a0 2023-12-24T20:07:05.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.750+0000 7f19c27fc700 1 -- 172.21.15.61:0/2086676881 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f19c401a9e0 con 0x7f19d40cb5a0 2023-12-24T20:07:05.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.750+0000 7f19c27fc700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19b4066f30 0x7f19b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:05.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.750+0000 7f19c27fc700 1 -- 172.21.15.61:0/2086676881 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f19c4085e40 con 0x7f19d40cb5a0 2023-12-24T20:07:05.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.750+0000 7f19c27fc700 1 -- 172.21.15.61:0/2086676881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f19b406eab0 con 0x7f19d40cb5a0 2023-12-24T20:07:05.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.750+0000 7f19d1d9b700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19b4066f30 0x7f19b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:05.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.751+0000 7f19d1d9b700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19b4066f30 0x7f19b40693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f19d40b0640 tx=0x7f19c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:05.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.754+0000 7f19c27fc700 1 -- 172.21.15.61:0/2086676881 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19c402b060 con 0x7f19d40cb5a0 2023-12-24T20:07:05.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.950+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2086676881 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19d40c8950 con 0x7f19d40cb5a0 2023-12-24T20:07:05.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.950+0000 7f19c27fc700 1 -- 172.21.15.61:0/2086676881 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v172) v1 ==== 104+0+11 (secure 0 0 0) 0x7f19c4053090 con 0x7f19d40cb5a0 2023-12-24T20:07:05.950 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T20:07:05.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19b4066f30 msgr2=0x7f19b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19b4066f30 0x7f19b40693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f19d40b0640 tx=0x7f19c8009040 comp rx=0 tx=0).stop 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2086676881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d40cb5a0 msgr2=0x7f19d40c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d40cb5a0 0x7f19d40c4160 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f19c400b0e0 tx=0x7f19c4016000 comp rx=0 tx=0).stop 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2086676881 shutdown_connections 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f19b4066f30 0x7f19b40693e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19d40c4bb0 0x7f19d40c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f19d40cb5a0 0x7f19d40c4160 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 --2- 172.21.15.61:0/2086676881 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f19d415ac00 0x7f19d40b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2086676881 >> 172.21.15.61:0/2086676881 conn(0x7f19d40cd0b0 msgr2=0x7f19d406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2086676881 shutdown_connections 2023-12-24T20:07:05.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:05.952+0000 7f19d8bf7700 1 -- 172.21.15.61:0/2086676881 wait complete. 2023-12-24T20:07:05.965 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:07:06.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.089+0000 7f29e4d5f700 1 Processor -- start 2023-12-24T20:07:06.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.090+0000 7f29e4d5f700 1 -- start start 2023-12-24T20:07:06.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29e4d5f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29e015ac00 0x7f29e00c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29e4d5f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f29e00c7c30 0x7f29e00cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29e4d5f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e00c8c30 con 0x7f29e015afd0 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29e4d5f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e00c80b0 con 0x7f29e00c7c30 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29e4d5f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e00c8390 con 0x7f29e015ac00 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29ddd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f29e00c7c30 0x7f29e00cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29ddd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f29e00c7c30 0x7f29e00cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36776/0 (socket says 172.21.15.61:36776) 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29ddd9b700 1 -- 172.21.15.61:0/2757653274 learned_addr learned my addr 172.21.15.61:0/2757653274 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29de59c700 1 --2- 172.21.15.61:0/2757653274 >> v2:172.21.15.133:3300/0 conn(0x7f29e015ac00 0x7f29e00c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29ddd9b700 1 -- 172.21.15.61:0/2757653274 >> v2:172.21.15.133:3300/0 conn(0x7f29e015ac00 msgr2=0x7f29e00c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29ddd9b700 1 --2- 172.21.15.61:0/2757653274 >> v2:172.21.15.133:3300/0 conn(0x7f29e015ac00 0x7f29e00c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29ddd9b700 1 -- 172.21.15.61:0/2757653274 >> v1:172.21.15.133:6789/0 conn(0x7f29e015afd0 legacy=0x7f29e015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29ddd9b700 1 -- 172.21.15.61:0/2757653274 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00c8670 con 0x7f29e00c7c30 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29ddd9b700 1 --2- 172.21.15.61:0/2757653274 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e00c7c30 0x7f29e00cae90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f29e006cf70 tx=0x7f29d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be326ebd4941cb90 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29dd59a700 1 -- 172.21.15.61:0/2757653274 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4009e70 con 0x7f29e00c7c30 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29dd59a700 1 -- 172.21.15.61:0/2757653274 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d400b860 con 0x7f29e00c7c30 2023-12-24T20:07:06.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.091+0000 7f29dd59a700 1 -- 172.21.15.61:0/2757653274 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400bc00 con 0x7f29e00c7c30 2023-12-24T20:07:06.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.092+0000 7f29e4d5f700 1 -- 172.21.15.61:0/2757653274 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e00c7c30 msgr2=0x7f29e00cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.092+0000 7f29e4d5f700 1 --2- 172.21.15.61:0/2757653274 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e00c7c30 0x7f29e00cae90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f29e006cf70 tx=0x7f29d4009250 comp rx=0 tx=0).stop 2023-12-24T20:07:06.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.092+0000 7f29e4d5f700 1 -- 172.21.15.61:0/2757653274 shutdown_connections 2023-12-24T20:07:06.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.092+0000 7f29e4d5f700 1 --2- 172.21.15.61:0/2757653274 >> v2:172.21.15.133:3300/0 conn(0x7f29e015ac00 0x7f29e00c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.092+0000 7f29e4d5f700 1 --2- 172.21.15.61:0/2757653274 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e00c7c30 0x7f29e00cae90 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.092+0000 7f29e4d5f700 1 -- 172.21.15.61:0/2757653274 >> 172.21.15.61:0/2757653274 conn(0x7f29e00cd0b0 msgr2=0x7f29e00cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:06.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.092+0000 7f29e4d5f700 1 -- 172.21.15.61:0/2757653274 shutdown_connections 2023-12-24T20:07:06.094 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.092+0000 7f29e4d5f700 1 -- 172.21.15.61:0/2757653274 wait complete. 2023-12-24T20:07:06.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.093+0000 7f29e4d5f700 1 Processor -- start 2023-12-24T20:07:06.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.093+0000 7f29e4d5f700 1 -- start start 2023-12-24T20:07:06.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29e4d5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e015ac00 0x7f29e0153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29e4d5f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e015afd0 0x7f29e0152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29e4d5f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29e016e220 0x7f29e00ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29e4d5f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00acff0 con 0x7f29e015afd0 2023-12-24T20:07:06.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29e4d5f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e016e6a0 con 0x7f29e015ac00 2023-12-24T20:07:06.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29e4d5f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00ac9e0 con 0x7f29e016e220 2023-12-24T20:07:06.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29ddd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e015afd0 0x7f29e0152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29ddd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e015afd0 0x7f29e0152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:36778/0 (socket says 172.21.15.61:36778) 2023-12-24T20:07:06.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29ddd9b700 1 -- 172.21.15.61:0/100727772 learned_addr learned my addr 172.21.15.61:0/100727772 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:06.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29de59c700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e015ac00 0x7f29e0153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29ded9d700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29e016e220 0x7f29e00ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29ddd9b700 1 -- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29e016e220 msgr2=0x7f29e00ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29ddd9b700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29e016e220 0x7f29e00ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29ddd9b700 1 -- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e015ac00 msgr2=0x7f29e0153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29ddd9b700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e015ac00 0x7f29e0153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29ddd9b700 1 -- 172.21.15.61:0/100727772 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40094f0 con 0x7f29e015afd0 2023-12-24T20:07:06.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.094+0000 7f29ded9d700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29e016e220 0x7f29e00ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:06.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.095+0000 7f29ddd9b700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e015afd0 0x7f29e0152d50 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f29e00c4040 tx=0x7f29d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:06.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.095+0000 7f29ce7fc700 1 -- 172.21.15.61:0/100727772 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400b9d0 con 0x7f29e015afd0 2023-12-24T20:07:06.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.095+0000 7f29ce7fc700 1 -- 172.21.15.61:0/100727772 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d400bb30 con 0x7f29e015afd0 2023-12-24T20:07:06.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.095+0000 7f29e4d5f700 1 -- 172.21.15.61:0/100727772 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e00ae670 con 0x7f29e015afd0 2023-12-24T20:07:06.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.095+0000 7f29ce7fc700 1 -- 172.21.15.61:0/100727772 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4025670 con 0x7f29e015afd0 2023-12-24T20:07:06.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.095+0000 7f29e4d5f700 1 -- 172.21.15.61:0/100727772 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e00ae950 con 0x7f29e015afd0 2023-12-24T20:07:06.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.096+0000 7f29e4d5f700 1 -- 172.21.15.61:0/100727772 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e00ad160 con 0x7f29e015afd0 2023-12-24T20:07:06.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.096+0000 7f29ce7fc700 1 -- 172.21.15.61:0/100727772 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f29d4023070 con 0x7f29e015afd0 2023-12-24T20:07:06.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.097+0000 7f29ce7fc700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29c0066f30 0x7f29c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.097+0000 7f29ce7fc700 1 -- 172.21.15.61:0/100727772 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f29d4085950 con 0x7f29e015afd0 2023-12-24T20:07:06.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.097+0000 7f29ce7fc700 1 -- 172.21.15.61:0/100727772 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f29c006eab0 con 0x7f29e015afd0 2023-12-24T20:07:06.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.097+0000 7f29de59c700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29c0066f30 0x7f29c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.098+0000 7f29de59c700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29c0066f30 0x7f29c00693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009da0 tx=0x7f29d0009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:06.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.101+0000 7f29ce7fc700 1 -- 172.21.15.61:0/100727772 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29d4052ba0 con 0x7f29e015afd0 2023-12-24T20:07:06.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.295+0000 7f29e4d5f700 1 -- 172.21.15.61:0/100727772 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29e004c3c0 con 0x7f29e015afd0 2023-12-24T20:07:06.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.296+0000 7f29ce7fc700 1 -- 172.21.15.61:0/100727772 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v172) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29d4015030 con 0x7f29e015afd0 2023-12-24T20:07:06.296 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T20:07:06.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 -- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29c0066f30 msgr2=0x7f29c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29c0066f30 0x7f29c00693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009da0 tx=0x7f29d0009120 comp rx=0 tx=0).stop 2023-12-24T20:07:06.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 -- 172.21.15.61:0/100727772 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e015afd0 msgr2=0x7f29e0152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e015afd0 0x7f29e0152d50 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f29e00c4040 tx=0x7f29d4017000 comp rx=0 tx=0).stop 2023-12-24T20:07:06.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 -- 172.21.15.61:0/100727772 shutdown_connections 2023-12-24T20:07:06.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f29e016e220 0x7f29e00ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f29c0066f30 0x7f29c00693e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29e015ac00 0x7f29e0153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 --2- 172.21.15.61:0/100727772 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f29e015afd0 0x7f29e0152d50 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 -- 172.21.15.61:0/100727772 >> 172.21.15.61:0/100727772 conn(0x7f29e00cd0b0 msgr2=0x7f29e0153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:06.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 -- 172.21.15.61:0/100727772 shutdown_connections 2023-12-24T20:07:06.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.298+0000 7f29e4d5f700 1 -- 172.21.15.61:0/100727772 wait complete. 2023-12-24T20:07:06.310 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:07:06.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.433+0000 7fb06df6e700 1 Processor -- start 2023-12-24T20:07:06.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.433+0000 7fb06df6e700 1 -- start start 2023-12-24T20:07:06.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb06df6e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb068068510 0x7fb0680cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb06df6e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb068159a60 0x7fb068159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb06df6e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0680b2890 con 0x7fb068068140 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb06df6e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680cf630 con 0x7fb068068510 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb06df6e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680b2240 con 0x7fb068159a60 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb066ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb068068510 0x7fb0680cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb0677fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb068068140 0x7fb0680b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:47664/0 (socket says 172.21.15.61:47664) 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb0677fe700 1 -- 172.21.15.61:0/2605516652 learned_addr learned my addr 172.21.15.61:0/2605516652 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb067fff700 1 --2- 172.21.15.61:0/2605516652 >> v2:172.21.15.133:3300/0 conn(0x7fb068159a60 0x7fb068159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb066ffd700 1 -- 172.21.15.61:0/2605516652 >> v2:172.21.15.133:3300/0 conn(0x7fb068159a60 msgr2=0x7fb068159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb066ffd700 1 --2- 172.21.15.61:0/2605516652 >> v2:172.21.15.133:3300/0 conn(0x7fb068159a60 0x7fb068159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb066ffd700 1 -- 172.21.15.61:0/2605516652 >> v1:172.21.15.61:6789/0 conn(0x7fb068068140 legacy=0x7fb0680b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.434+0000 7fb066ffd700 1 -- 172.21.15.61:0/2605516652 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680b2520 con 0x7fb068068510 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb066ffd700 1 --2- 172.21.15.61:0/2605516652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 0x7fb0680cefa0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fb06806eaf0 tx=0x7fb0500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894dbff979b88301 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb0667fc700 1 -- 172.21.15.61:0/2605516652 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000b6b0 con 0x7fb068068510 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb0667fc700 1 -- 172.21.15.61:0/2605516652 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05000b810 con 0x7fb068068510 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb0667fc700 1 -- 172.21.15.61:0/2605516652 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000bbb0 con 0x7fb068068510 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb06df6e700 1 -- 172.21.15.61:0/2605516652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 msgr2=0x7fb0680cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb06df6e700 1 --2- 172.21.15.61:0/2605516652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 0x7fb0680cefa0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fb06806eaf0 tx=0x7fb0500091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb06df6e700 1 -- 172.21.15.61:0/2605516652 shutdown_connections 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb06df6e700 1 --2- 172.21.15.61:0/2605516652 >> v2:172.21.15.133:3300/0 conn(0x7fb068159a60 0x7fb068159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb06df6e700 1 --2- 172.21.15.61:0/2605516652 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 0x7fb0680cefa0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb06df6e700 1 -- 172.21.15.61:0/2605516652 >> 172.21.15.61:0/2605516652 conn(0x7fb068097a10 msgr2=0x7fb0680ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:06.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb06df6e700 1 -- 172.21.15.61:0/2605516652 shutdown_connections 2023-12-24T20:07:06.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.435+0000 7fb06df6e700 1 -- 172.21.15.61:0/2605516652 wait complete. 2023-12-24T20:07:06.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb06df6e700 1 Processor -- start 2023-12-24T20:07:06.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb06df6e700 1 -- start start 2023-12-24T20:07:06.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb06df6e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb068068140 0x7fb068142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb06df6e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 0x7fb068099920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb06df6e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb068159a60 0x7fb0681569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb06df6e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06809af80 con 0x7fb068068510 2023-12-24T20:07:06.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb06df6e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068143320 con 0x7fb068068140 2023-12-24T20:07:06.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb06df6e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06809a370 con 0x7fb068159a60 2023-12-24T20:07:06.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb066ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 0x7fb068099920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb066ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 0x7fb068099920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40948/0 (socket says 172.21.15.61:40948) 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.437+0000 7fb066ffd700 1 -- 172.21.15.61:0/2115066177 learned_addr learned my addr 172.21.15.61:0/2115066177 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb067fff700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb068159a60 0x7fb0681569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb0677fe700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb068068140 0x7fb068142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb066ffd700 1 -- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb068159a60 msgr2=0x7fb0681569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb066ffd700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb068159a60 0x7fb0681569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb066ffd700 1 -- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb068068140 msgr2=0x7fb068142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb066ffd700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb068068140 0x7fb068142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb066ffd700 1 -- 172.21.15.61:0/2115066177 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050009420 con 0x7fb068068510 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb0677fe700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb068068140 0x7fb068142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:06.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb066ffd700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 0x7fb068099920 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fb06806d8b0 tx=0x7fb050017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb05f7fe700 1 -- 172.21.15.61:0/2115066177 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000bb90 con 0x7fb068068510 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb05f7fe700 1 -- 172.21.15.61:0/2115066177 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb050011420 con 0x7fb068068510 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb05f7fe700 1 -- 172.21.15.61:0/2115066177 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500117e0 con 0x7fb068068510 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb06df6e700 1 -- 172.21.15.61:0/2115066177 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06809a650 con 0x7fb068068510 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.438+0000 7fb06df6e700 1 -- 172.21.15.61:0/2115066177 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06809ac10 con 0x7fb068068510 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.439+0000 7fb06df6e700 1 -- 172.21.15.61:0/2115066177 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06806d440 con 0x7fb068068510 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.440+0000 7fb05f7fe700 1 -- 172.21.15.61:0/2115066177 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb050011bd0 con 0x7fb068068510 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.440+0000 7fb05f7fe700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb048066f30 0x7fb0480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.440+0000 7fb05f7fe700 1 -- 172.21.15.61:0/2115066177 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fb050085b10 con 0x7fb068068510 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.440+0000 7fb05f7fe700 1 -- 172.21.15.61:0/2115066177 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7fb04806eab0 con 0x7fb068068510 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.440+0000 7fb0677fe700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb048066f30 0x7fb0480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.441+0000 7fb0677fe700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb048066f30 0x7fb0480693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb0580010e0 tx=0x7fb058009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:06.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.444+0000 7fb05f7fe700 1 -- 172.21.15.61:0/2115066177 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb050052de0 con 0x7fb068068510 2023-12-24T20:07:06.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.687+0000 7fb06df6e700 1 -- 172.21.15.61:0/2115066177 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb06804c3c0 con 0x7fb068068510 2023-12-24T20:07:06.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.688+0000 7fb05f7fe700 1 -- 172.21.15.61:0/2115066177 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fb050028070 con 0x7fb068068510 2023-12-24T20:07:06.688 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:06.688 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/534815426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":534815426},{"type":"v1","addr":"172.21.15.133:6836","nonce":534815426}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1994792297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1994792297},{"type":"v1","addr":"172.21.15.133:6837","nonce":1994792297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7818,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3942988503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3942988503},{"type":"v1","addr":"172.21.15.61:6834","nonce":3942988503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:06:04.174684+0000","modified":"2023-12-24T20:06:07.799428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/764589487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":764589487},{"type":"v1","addr":"172.21.15.61:6835","nonce":764589487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:07:06.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 -- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb048066f30 msgr2=0x7fb0480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb048066f30 0x7fb0480693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb0580010e0 tx=0x7fb058009040 comp rx=0 tx=0).stop 2023-12-24T20:07:06.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 -- 172.21.15.61:0/2115066177 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 msgr2=0x7fb068099920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 0x7fb068099920 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fb06806d8b0 tx=0x7fb050017000 comp rx=0 tx=0).stop 2023-12-24T20:07:06.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 -- 172.21.15.61:0/2115066177 shutdown_connections 2023-12-24T20:07:06.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb068159a60 0x7fb0681569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb048066f30 0x7fb0480693e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb068068140 0x7fb068142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 --2- 172.21.15.61:0/2115066177 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb068068510 0x7fb068099920 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 -- 172.21.15.61:0/2115066177 >> 172.21.15.61:0/2115066177 conn(0x7fb068097a10 msgr2=0x7fb068154190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:06.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 -- 172.21.15.61:0/2115066177 shutdown_connections 2023-12-24T20:07:06.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.690+0000 7fb06df6e700 1 -- 172.21.15.61:0/2115066177 wait complete. 2023-12-24T20:07:06.691 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 84 2023-12-24T20:07:06.702 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:07:06.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.825+0000 7f1ce5830700 1 Processor -- start 2023-12-24T20:07:06.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.825+0000 7f1ce5830700 1 -- start start 2023-12-24T20:07:06.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1ce5830700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1ce0156ab0 0x7f1ce00cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1ce5830700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 0x7f1ce00c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1ce5830700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ce00ca180 0x7f1ce015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1ce5830700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce00ca5e0 con 0x7f1ce0156ab0 2023-12-24T20:07:06.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1ce5830700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce0157e30 con 0x7f1ce00ca180 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1ce5830700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce0158160 con 0x7f1ce0157920 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cdeffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1ce0156ab0 0x7f1ce00cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cdeffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1ce0156ab0 0x7f1ce00cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40954/0 (socket says 172.21.15.61:40954) 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cdeffd700 1 -- 172.21.15.61:0/1227284430 learned_addr learned my addr 172.21.15.61:0/1227284430 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cde7fc700 1 --2- 172.21.15.61:0/1227284430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 0x7f1ce00c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cdf7fe700 1 --2- 172.21.15.61:0/1227284430 >> v2:172.21.15.133:3300/0 conn(0x7f1ce00ca180 0x7f1ce015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cdeffd700 1 -- 172.21.15.61:0/1227284430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 msgr2=0x7f1ce00c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cdeffd700 1 --2- 172.21.15.61:0/1227284430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 0x7f1ce00c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cdeffd700 1 -- 172.21.15.61:0/1227284430 >> v2:172.21.15.133:3300/0 conn(0x7f1ce00ca180 msgr2=0x7f1ce015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cdeffd700 1 --2- 172.21.15.61:0/1227284430 >> v2:172.21.15.133:3300/0 conn(0x7f1ce00ca180 0x7f1ce015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cdeffd700 1 -- 172.21.15.61:0/1227284430 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0158440 con 0x7f1ce0156ab0 2023-12-24T20:07:06.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cdeffd700 1 --2- 172.21.15.61:0/1227284430 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce0156ab0 0x7f1ce00cbc70 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00c95d0 tx=0x7f1cd000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92818f1225abf306 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:06.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cddffb700 1 -- 172.21.15.61:0/1227284430 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000dc50 con 0x7f1ce0156ab0 2023-12-24T20:07:06.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cddffb700 1 -- 172.21.15.61:0/1227284430 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd000ddb0 con 0x7f1ce0156ab0 2023-12-24T20:07:06.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.826+0000 7f1cddffb700 1 -- 172.21.15.61:0/1227284430 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00196b0 con 0x7f1ce0156ab0 2023-12-24T20:07:06.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.827+0000 7f1ce5830700 1 -- 172.21.15.61:0/1227284430 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce0156ab0 msgr2=0x7f1ce00cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.827+0000 7f1ce5830700 1 --2- 172.21.15.61:0/1227284430 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce0156ab0 0x7f1ce00cbc70 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00c95d0 tx=0x7f1cd000b4f0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.827+0000 7f1ce5830700 1 -- 172.21.15.61:0/1227284430 shutdown_connections 2023-12-24T20:07:06.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.827+0000 7f1ce5830700 1 --2- 172.21.15.61:0/1227284430 >> v2:172.21.15.133:3300/0 conn(0x7f1ce00ca180 0x7f1ce015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.827+0000 7f1ce5830700 1 --2- 172.21.15.61:0/1227284430 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce0156ab0 0x7f1ce00cbc70 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.827+0000 7f1ce5830700 1 --2- 172.21.15.61:0/1227284430 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 0x7f1ce00c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.827+0000 7f1ce5830700 1 -- 172.21.15.61:0/1227284430 >> 172.21.15.61:0/1227284430 conn(0x7f1ce0067fe0 msgr2=0x7f1ce00cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:06.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.827+0000 7f1ce5830700 1 -- 172.21.15.61:0/1227284430 shutdown_connections 2023-12-24T20:07:06.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.827+0000 7f1ce5830700 1 -- 172.21.15.61:0/1227284430 wait complete. 2023-12-24T20:07:06.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.829+0000 7f1ce5830700 1 Processor -- start 2023-12-24T20:07:06.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.829+0000 7f1ce5830700 1 -- start start 2023-12-24T20:07:06.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1ce5830700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce00ca180 0x7f1ce0149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1ce5830700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ce0156ab0 0x7f1ce00ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1ce5830700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 0x7f1ce00ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1ce5830700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00a8ac0 con 0x7f1ce00ca180 2023-12-24T20:07:06.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1ce5830700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce0149ec0 con 0x7f1ce0156ab0 2023-12-24T20:07:06.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1ce5830700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00a72a0 con 0x7f1ce0157920 2023-12-24T20:07:06.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce00ca180 0x7f1ce0149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce00ca180 0x7f1ce0149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40958/0 (socket says 172.21.15.61:40958) 2023-12-24T20:07:06.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdeffd700 1 -- 172.21.15.61:0/2629667403 learned_addr learned my addr 172.21.15.61:0/2629667403 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:06.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdf7fe700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 0x7f1ce00ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cde7fc700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ce0156ab0 0x7f1ce00ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdeffd700 1 -- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 msgr2=0x7f1ce00ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdeffd700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 0x7f1ce00ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdeffd700 1 -- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ce0156ab0 msgr2=0x7f1ce00ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdeffd700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ce0156ab0 0x7f1ce00ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdeffd700 1 -- 172.21.15.61:0/2629667403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd000b790 con 0x7f1ce00ca180 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdf7fe700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 0x7f1ce00ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cde7fc700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ce0156ab0 0x7f1ce00ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cdeffd700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce00ca180 0x7f1ce0149980 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f1ce006c2d0 tx=0x7f1cd001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cc6ffd700 1 -- 172.21.15.61:0/2629667403 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00104f0 con 0x7f1ce00ca180 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.830+0000 7f1cc6ffd700 1 -- 172.21.15.61:0/2629667403 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd0010650 con 0x7f1ce00ca180 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.831+0000 7f1ce5830700 1 -- 172.21.15.61:0/2629667403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce00a8190 con 0x7f1ce00ca180 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.831+0000 7f1cc6ffd700 1 -- 172.21.15.61:0/2629667403 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0010a10 con 0x7f1ce00ca180 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.831+0000 7f1ce5830700 1 -- 172.21.15.61:0/2629667403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce00a8750 con 0x7f1ce00ca180 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.832+0000 7f1ce5830700 1 -- 172.21.15.61:0/2629667403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce004c3c0 con 0x7f1ce00ca180 2023-12-24T20:07:06.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.832+0000 7f1cc6ffd700 1 -- 172.21.15.61:0/2629667403 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1cd0022030 con 0x7f1ce00ca180 2023-12-24T20:07:06.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.832+0000 7f1cc6ffd700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ccc066f30 0x7f1ccc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:06.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.833+0000 7f1cc6ffd700 1 -- 172.21.15.61:0/2629667403 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f1cd0014070 con 0x7f1ce00ca180 2023-12-24T20:07:06.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.833+0000 7f1cc6ffd700 1 -- 172.21.15.61:0/2629667403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f1ccc06eab0 con 0x7f1ce00ca180 2023-12-24T20:07:06.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.833+0000 7f1cde7fc700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ccc066f30 0x7f1ccc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:06.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.833+0000 7f1cde7fc700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ccc066f30 0x7f1ccc0693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00aa1f0 tx=0x7f1cd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:06.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:06.837+0000 7f1cc6ffd700 1 -- 172.21.15.61:0/2629667403 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cd00557a0 con 0x7f1ce00ca180 2023-12-24T20:07:06.922 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:07:06.929 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:07:07.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.038+0000 7f1ce5830700 1 -- 172.21.15.61:0/2629667403 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ce0158720 con 0x7f1ce00ca180 2023-12-24T20:07:07.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.039+0000 7f1cc6ffd700 1 -- 172.21.15.61:0/2629667403 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+15441 (secure 0 0 0) 0x7f1cd000b5a0 con 0x7f1ce00ca180 2023-12-24T20:07:07.039 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:07.039 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":172,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:06:58.646798+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:06:01.971715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-24T20:06:03.153177+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.040+0000 7f1ce5830700 1 -- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ccc066f30 msgr2=0x7f1ccc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.040+0000 7f1ce5830700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ccc066f30 0x7f1ccc0693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00aa1f0 tx=0x7f1cd4008040 comp rx=0 tx=0).stop 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.041+0000 7f1ce5830700 1 -- 172.21.15.61:0/2629667403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce00ca180 msgr2=0x7f1ce0149980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.041+0000 7f1ce5830700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce00ca180 0x7f1ce0149980 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f1ce006c2d0 tx=0x7f1cd001b000 comp rx=0 tx=0).stop 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.041+0000 7f1ce5830700 1 -- 172.21.15.61:0/2629667403 shutdown_connections 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.041+0000 7f1ce5830700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ce0157920 0x7f1ce00ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.041+0000 7f1ce5830700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ccc066f30 0x7f1ccc0693e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.041+0000 7f1ce5830700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce00ca180 0x7f1ce0149980 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.041+0000 7f1ce5830700 1 --2- 172.21.15.61:0/2629667403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ce0156ab0 0x7f1ce00ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.041+0000 7f1ce5830700 1 -- 172.21.15.61:0/2629667403 >> 172.21.15.61:0/2629667403 conn(0x7f1ce0067fe0 msgr2=0x7f1ce00af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.041+0000 7f1ce5830700 1 -- 172.21.15.61:0/2629667403 shutdown_connections 2023-12-24T20:07:07.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.041+0000 7f1ce5830700 1 -- 172.21.15.61:0/2629667403 wait complete. 2023-12-24T20:07:07.058 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:07:07.058 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:07:07.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.184+0000 7fe56d1a4700 1 Processor -- start 2023-12-24T20:07:07.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.184+0000 7fe56d1a4700 1 -- start start 2023-12-24T20:07:07.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe56d1a4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe56815bb60 0x7fe568098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe56d1a4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe568098aa0 0x7fe56815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe56d1a4700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5680b2eb0 con 0x7fe56815c470 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe56d1a4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5680afc20 con 0x7fe568098aa0 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe56d1a4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680b2bd0 con 0x7fe56815bb60 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe56759e700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe56815c470 0x7fe5680b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:47676/0 (socket says 172.21.15.61:47676) 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe56759e700 1 -- 172.21.15.61:0/2255506389 learned_addr learned my addr 172.21.15.61:0/2255506389 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233085888 0 0) 0x7fe5680b2eb0 con 0x7fe56815c470 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe550003570 con 0x7fe56815c470 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe566d9d700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe56815bb60 0x7fe568098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe56659c700 1 --2- 172.21.15.61:0/2255506389 >> v2:172.21.15.133:3300/0 conn(0x7fe568098aa0 0x7fe56815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1758987659 0 0) 0x7fe550003570 con 0x7fe56815c470 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe56815bb60 msgr2=0x7fe568098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe56815bb60 0x7fe568098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 >> v2:172.21.15.133:3300/0 conn(0x7fe568098aa0 msgr2=0x7fe56815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 --2- 172.21.15.61:0/2255506389 >> v2:172.21.15.133:3300/0 conn(0x7fe568098aa0 0x7fe56815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680afe10 con 0x7fe56815c470 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fe5600017f0 con 0x7fe56815c470 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 >> v1:172.21.15.61:6789/0 conn(0x7fe56815c470 legacy=0x7fe5680b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe550003ae0 0x7fe550003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.185+0000 7fe565d9b700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe56815bb60 0x7fe550004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe565d9b700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe550004d50 0x7fe5500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680b2bd0 con 0x7fe550003ae0 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55000bb10 con 0x7fe550004d50 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55000bc50 con 0x7fe56815bb60 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe566d9d700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe550003ae0 0x7fe550003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe56659c700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe56815bb60 0x7fe550004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe56759e700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe550004d50 0x7fe5500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe566d9d700 1 -- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe56815bb60 msgr2=0x7fe550004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe566d9d700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe56815bb60 0x7fe550004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe566d9d700 1 -- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe550004d50 msgr2=0x7fe5500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:07.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe566d9d700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe550004d50 0x7fe5500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe566d9d700 1 -- 172.21.15.61:0/2255506389 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550003570 con 0x7fe550003ae0 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe566d9d700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe550003ae0 0x7fe550003ef0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009c20 tx=0x7fe55c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf256b0166cd29f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c005a00 con 0x7fe550003ae0 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c005b60 con 0x7fe550003ae0 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.186+0000 7fe565d9b700 1 -- 172.21.15.61:0/2255506389 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00e710 con 0x7fe550003ae0 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.187+0000 7fe56d1a4700 1 -- 172.21.15.61:0/2255506389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe550003ae0 msgr2=0x7fe550003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.187+0000 7fe56d1a4700 1 --2- 172.21.15.61:0/2255506389 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe550003ae0 0x7fe550003ef0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009c20 tx=0x7fe55c009120 comp rx=0 tx=0).stop 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.187+0000 7fe56759e700 1 -- 172.21.15.61:0/2255506389 reap_dead start 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.187+0000 7fe56d1a4700 1 -- 172.21.15.61:0/2255506389 shutdown_connections 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.187+0000 7fe56d1a4700 1 -- 172.21.15.61:0/2255506389 >> 172.21.15.61:0/2255506389 conn(0x7fe568097a10 msgr2=0x7fe5680ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:07.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.187+0000 7fe56d1a4700 1 -- 172.21.15.61:0/2255506389 shutdown_connections 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.187+0000 7fe56d1a4700 1 -- 172.21.15.61:0/2255506389 wait complete. 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.188+0000 7fe56d1a4700 1 Processor -- start 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.188+0000 7fe56d1a4700 1 -- start start 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe56d1a4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe550003ae0 0x7fe5680c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe56d1a4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5681682f0 0x7fe568156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe56d1a4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5680ae120 0x7fe5680ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe56d1a4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe568169310 con 0x7fe5680ae120 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe56d1a4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680aeb00 con 0x7fe5681682f0 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe56d1a4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5681694f0 con 0x7fe550003ae0 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe56759e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5680ae120 0x7fe5680ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe56759e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5680ae120 0x7fe5680ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40972/0 (socket says 172.21.15.61:40972) 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe56759e700 1 -- 172.21.15.61:0/3235151865 learned_addr learned my addr 172.21.15.61:0/3235151865 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe566d9d700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe550003ae0 0x7fe5680c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.189+0000 7fe56659c700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5681682f0 0x7fe568156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe56759e700 1 -- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe550003ae0 msgr2=0x7fe5680c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe56759e700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe550003ae0 0x7fe5680c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe56759e700 1 -- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5681682f0 msgr2=0x7fe568156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe56759e700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5681682f0 0x7fe568156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe56759e700 1 -- 172.21.15.61:0/3235151865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680ab3b0 con 0x7fe5680ae120 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe56659c700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5681682f0 0x7fe568156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe56759e700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5680ae120 0x7fe5680ae5c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fe560001350 tx=0x7fe5600018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe54effd700 1 -- 172.21.15.61:0/3235151865 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000ebc0 con 0x7fe5680ae120 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe54effd700 1 -- 172.21.15.61:0/3235151865 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56000ed20 con 0x7fe5680ae120 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe56d1a4700 1 -- 172.21.15.61:0/3235151865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe568168a70 con 0x7fe5680ae120 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe54effd700 1 -- 172.21.15.61:0/3235151865 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560013670 con 0x7fe5680ae120 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.190+0000 7fe56d1a4700 1 -- 172.21.15.61:0/3235151865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe568169030 con 0x7fe5680ae120 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.191+0000 7fe56d1a4700 1 -- 172.21.15.61:0/3235151865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5680ce8f0 con 0x7fe5680ae120 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.191+0000 7fe54effd700 1 -- 172.21.15.61:0/3235151865 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe560013a60 con 0x7fe5680ae120 2023-12-24T20:07:07.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.192+0000 7fe54effd700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe554066f30 0x7fe5540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.192+0000 7fe54effd700 1 -- 172.21.15.61:0/3235151865 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fe560084a80 con 0x7fe5680ae120 2023-12-24T20:07:07.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.192+0000 7fe54effd700 1 -- 172.21.15.61:0/3235151865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7fe55406eab0 con 0x7fe5680ae120 2023-12-24T20:07:07.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.192+0000 7fe566d9d700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe554066f30 0x7fe5540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.192+0000 7fe566d9d700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe554066f30 0x7fe5540693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe5680aed40 tx=0x7fe55c019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:07.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.196+0000 7fe54effd700 1 -- 172.21.15.61:0/3235151865 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe560051cd0 con 0x7fe5680ae120 2023-12-24T20:07:07.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.439+0000 7fe56d1a4700 1 -- 172.21.15.61:0/3235151865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe56806d440 con 0x7fe5680ae120 2023-12-24T20:07:07.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.439+0000 7fe54effd700 1 -- 172.21.15.61:0/3235151865 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fe5600552f0 con 0x7fe5680ae120 2023-12-24T20:07:07.440 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:07.440 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/534815426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":534815426},{"type":"v1","addr":"172.21.15.133:6836","nonce":534815426}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1994792297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1994792297},{"type":"v1","addr":"172.21.15.133:6837","nonce":1994792297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7818,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3942988503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3942988503},{"type":"v1","addr":"172.21.15.61:6834","nonce":3942988503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:06:04.174684+0000","modified":"2023-12-24T20:06:07.799428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/764589487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":764589487},{"type":"v1","addr":"172.21.15.61:6835","nonce":764589487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:07:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 -- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe554066f30 msgr2=0x7fe5540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe554066f30 0x7fe5540693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe5680aed40 tx=0x7fe55c019000 comp rx=0 tx=0).stop 2023-12-24T20:07:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 -- 172.21.15.61:0/3235151865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5680ae120 msgr2=0x7fe5680ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5680ae120 0x7fe5680ae5c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fe560001350 tx=0x7fe5600018b0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 -- 172.21.15.61:0/3235151865 shutdown_connections 2023-12-24T20:07:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe550003ae0 0x7fe5680c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe554066f30 0x7fe5540693e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe5680ae120 0x7fe5680ae5c0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 --2- 172.21.15.61:0/3235151865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5681682f0 0x7fe568156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 -- 172.21.15.61:0/3235151865 >> 172.21.15.61:0/3235151865 conn(0x7fe568097a10 msgr2=0x7fe56806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 -- 172.21.15.61:0/3235151865 shutdown_connections 2023-12-24T20:07:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.442+0000 7fe56d1a4700 1 -- 172.21.15.61:0/3235151865 wait complete. 2023-12-24T20:07:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 84 2023-12-24T20:07:07.455 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:07:07.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.577+0000 7f8f72216700 1 Processor -- start 2023-12-24T20:07:07.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.577+0000 7f8f72216700 1 -- start start 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f72216700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f6c068510 0x7f8f6c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f72216700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8f6c159a60 0x7f8f6c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f72216700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c0b2890 con 0x7f8f6c068140 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f72216700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c0cf630 con 0x7f8f6c159a60 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f72216700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c0b2240 con 0x7f8f6c068510 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6bfff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8f6c159a60 0x7f8f6c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6b7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8f6c068140 0x7f8f6c0b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:47686/0 (socket says 172.21.15.61:47686) 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6b7fe700 1 -- 172.21.15.61:0/536177671 learned_addr learned my addr 172.21.15.61:0/536177671 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6bfff700 1 --2- 172.21.15.61:0/536177671 >> v2:172.21.15.61:3300/0 conn(0x7f8f6c159a60 0x7f8f6c159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40984/0 (socket says 172.21.15.61:40984) 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6affd700 1 --2- 172.21.15.61:0/536177671 >> v2:172.21.15.133:3300/0 conn(0x7f8f6c068510 0x7f8f6c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.581 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6bfff700 1 -- 172.21.15.61:0/536177671 >> v2:172.21.15.133:3300/0 conn(0x7f8f6c068510 msgr2=0x7f8f6c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6bfff700 1 --2- 172.21.15.61:0/536177671 >> v2:172.21.15.133:3300/0 conn(0x7f8f6c068510 0x7f8f6c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6bfff700 1 -- 172.21.15.61:0/536177671 >> v1:172.21.15.61:6789/0 conn(0x7f8f6c068140 legacy=0x7f8f6c0b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6bfff700 1 -- 172.21.15.61:0/536177671 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c0b2520 con 0x7f8f6c159a60 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6affd700 1 --2- 172.21.15.61:0/536177671 >> v2:172.21.15.133:3300/0 conn(0x7f8f6c068510 0x7f8f6c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.578+0000 7f8f6a7fc700 1 -- 172.21.15.61:0/536177671 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395993748 0 0) 0x7f8f6c0b2890 con 0x7f8f6c068140 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f6bfff700 1 --2- 172.21.15.61:0/536177671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 0x7f8f6c159ea0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c06d800 tx=0x7f8f64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6c89148186e54c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f6a7fc700 1 -- 172.21.15.61:0/536177671 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6400e070 con 0x7f8f6c159a60 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f6a7fc700 1 -- 172.21.15.61:0/536177671 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6400bc30 con 0x7f8f6c159a60 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f6a7fc700 1 -- 172.21.15.61:0/536177671 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64012430 con 0x7f8f6c159a60 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f72216700 1 -- 172.21.15.61:0/536177671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 msgr2=0x7f8f6c159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f72216700 1 --2- 172.21.15.61:0/536177671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 0x7f8f6c159ea0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c06d800 tx=0x7f8f64009780 comp rx=0 tx=0).stop 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f72216700 1 -- 172.21.15.61:0/536177671 shutdown_connections 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f72216700 1 --2- 172.21.15.61:0/536177671 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 0x7f8f6c159ea0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f72216700 1 --2- 172.21.15.61:0/536177671 >> v2:172.21.15.133:3300/0 conn(0x7f8f6c068510 0x7f8f6c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.582 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f72216700 1 -- 172.21.15.61:0/536177671 >> 172.21.15.61:0/536177671 conn(0x7f8f6c097a10 msgr2=0x7f8f6c0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:07.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f72216700 1 -- 172.21.15.61:0/536177671 shutdown_connections 2023-12-24T20:07:07.583 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.579+0000 7f8f72216700 1 -- 172.21.15.61:0/536177671 wait complete. 2023-12-24T20:07:07.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.581+0000 7f8f72216700 1 Processor -- start 2023-12-24T20:07:07.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.581+0000 7f8f72216700 1 -- start start 2023-12-24T20:07:07.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f72216700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6c068140 0x7f8f6c156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f72216700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f6c068510 0x7f8f6c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f72216700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 0x7f8f6c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f72216700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c15b4c0 con 0x7f8f6c159a60 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f72216700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c15a660 con 0x7f8f6c068510 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f72216700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c15a8b0 con 0x7f8f6c068140 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f6bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 0x7f8f6c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f6bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 0x7f8f6c15f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40992/0 (socket says 172.21.15.61:40992) 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f6bfff700 1 -- 172.21.15.61:0/2323619481 learned_addr learned my addr 172.21.15.61:0/2323619481 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f6b7fe700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6c068140 0x7f8f6c156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.582+0000 7f8f6affd700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f6c068510 0x7f8f6c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f6bfff700 1 -- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6c068140 msgr2=0x7f8f6c156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f6bfff700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6c068140 0x7f8f6c156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f6bfff700 1 -- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f6c068510 msgr2=0x7f8f6c15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f6bfff700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f6c068510 0x7f8f6c15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.586 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f6bfff700 1 -- 172.21.15.61:0/2323619481 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64009a20 con 0x7f8f6c159a60 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f6bfff700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 0x7f8f6c15f190 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c06d8b0 tx=0x7f8f64019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f637fe700 1 -- 172.21.15.61:0/2323619481 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64012e10 con 0x7f8f6c159a60 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f637fe700 1 -- 172.21.15.61:0/2323619481 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6401d630 con 0x7f8f6c159a60 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f72216700 1 -- 172.21.15.61:0/2323619481 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c15ab90 con 0x7f8f6c159a60 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f637fe700 1 -- 172.21.15.61:0/2323619481 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6401d9f0 con 0x7f8f6c159a60 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.583+0000 7f8f72216700 1 -- 172.21.15.61:0/2323619481 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c15b150 con 0x7f8f6c159a60 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.584+0000 7f8f72216700 1 -- 172.21.15.61:0/2323619481 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c06d440 con 0x7f8f6c159a60 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.584+0000 7f8f637fe700 1 -- 172.21.15.61:0/2323619481 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8f64024070 con 0x7f8f6c159a60 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.585+0000 7f8f637fe700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f4c066f30 0x7f8f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.585+0000 7f8f637fe700 1 -- 172.21.15.61:0/2323619481 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f8f64086cc0 con 0x7f8f6c159a60 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.585+0000 7f8f637fe700 1 -- 172.21.15.61:0/2323619481 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f8f4c06eab0 con 0x7f8f6c159a60 2023-12-24T20:07:07.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.585+0000 7f8f6b7fe700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f4c066f30 0x7f8f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.586+0000 7f8f6b7fe700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f4c066f30 0x7f8f4c0693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c001360 tx=0x7f8f5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:07.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.589+0000 7f8f637fe700 1 -- 172.21.15.61:0/2323619481 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f64053f10 con 0x7f8f6c159a60 2023-12-24T20:07:07.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.834+0000 7f8f72216700 1 -- 172.21.15.61:0/2323619481 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f6c04c3c0 con 0x7f8f6c159a60 2023-12-24T20:07:07.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.834+0000 7f8f637fe700 1 -- 172.21.15.61:0/2323619481 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f8f6402c020 con 0x7f8f6c159a60 2023-12-24T20:07:07.835 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:07.835 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":84,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/534815426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":534815426},{"type":"v1","addr":"172.21.15.133:6836","nonce":534815426}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1994792297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1994792297},{"type":"v1","addr":"172.21.15.133:6837","nonce":1994792297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7818,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3942988503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3942988503},{"type":"v1","addr":"172.21.15.61:6834","nonce":3942988503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:06:04.174684+0000","modified":"2023-12-24T20:06:07.799428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7821},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7821":{"gid":7821,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6835/764589487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":764589487},{"type":"v1","addr":"172.21.15.61:6835","nonce":764589487}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-12-24T20:07:07.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 -- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f4c066f30 msgr2=0x7f8f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f4c066f30 0x7f8f4c0693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c001360 tx=0x7f8f5c009040 comp rx=0 tx=0).stop 2023-12-24T20:07:07.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 -- 172.21.15.61:0/2323619481 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 msgr2=0x7f8f6c15f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 0x7f8f6c15f190 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c06d8b0 tx=0x7f8f64019000 comp rx=0 tx=0).stop 2023-12-24T20:07:07.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 -- 172.21.15.61:0/2323619481 shutdown_connections 2023-12-24T20:07:07.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8f6c068140 0x7f8f6c156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8f4c066f30 0x7f8f4c0693e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f6c159a60 0x7f8f6c15f190 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 --2- 172.21.15.61:0/2323619481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f6c068510 0x7f8f6c15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 -- 172.21.15.61:0/2323619481 >> 172.21.15.61:0/2323619481 conn(0x7f8f6c097a10 msgr2=0x7f8f6c09be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:07.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 -- 172.21.15.61:0/2323619481 shutdown_connections 2023-12-24T20:07:07.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.836+0000 7f8f72216700 1 -- 172.21.15.61:0/2323619481 wait complete. 2023-12-24T20:07:07.838 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 84 2023-12-24T20:07:07.850 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:07:07.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.972+0000 7fab673f1700 1 Processor -- start 2023-12-24T20:07:07.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.972+0000 7fab673f1700 1 -- start start 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab673f1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fab6015bb60 0x7fab60098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab673f1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab60098aa0 0x7fab6015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab673f1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab600b2eb0 con 0x7fab6015c470 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab673f1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab600afc20 con 0x7fab6015bb60 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab673f1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600b2bd0 con 0x7fab60098aa0 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab6518d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fab6015bb60 0x7fab60098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab6518d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fab6015bb60 0x7fab60098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41004/0 (socket says 172.21.15.61:41004) 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab6518d700 1 -- 172.21.15.61:0/2466954315 learned_addr learned my addr 172.21.15.61:0/2466954315 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab6498c700 1 --2- 172.21.15.61:0/2466954315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab60098aa0 0x7fab6015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab6518d700 1 -- 172.21.15.61:0/2466954315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab60098aa0 msgr2=0x7fab6015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab6518d700 1 --2- 172.21.15.61:0/2466954315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab60098aa0 0x7fab6015bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab6518d700 1 -- 172.21.15.61:0/2466954315 >> v1:172.21.15.133:6789/0 conn(0x7fab6015c470 legacy=0x7fab600b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.973+0000 7fab6518d700 1 -- 172.21.15.61:0/2466954315 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab600afe10 con 0x7fab6015bb60 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab6518d700 1 --2- 172.21.15.61:0/2466954315 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015bb60 0x7fab60098560 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009990 tx=0x7fab5c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f94b6755a8393c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab57fff700 1 -- 172.21.15.61:0/2466954315 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c009e80 con 0x7fab6015bb60 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab57fff700 1 -- 172.21.15.61:0/2466954315 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c005c10 con 0x7fab6015bb60 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab57fff700 1 -- 172.21.15.61:0/2466954315 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c00b650 con 0x7fab6015bb60 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab673f1700 1 -- 172.21.15.61:0/2466954315 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015bb60 msgr2=0x7fab60098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab673f1700 1 --2- 172.21.15.61:0/2466954315 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015bb60 0x7fab60098560 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009990 tx=0x7fab5c009220 comp rx=0 tx=0).stop 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab673f1700 1 -- 172.21.15.61:0/2466954315 shutdown_connections 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab673f1700 1 --2- 172.21.15.61:0/2466954315 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015bb60 0x7fab60098560 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab673f1700 1 --2- 172.21.15.61:0/2466954315 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab60098aa0 0x7fab6015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab673f1700 1 -- 172.21.15.61:0/2466954315 >> 172.21.15.61:0/2466954315 conn(0x7fab60097a10 msgr2=0x7fab600ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab673f1700 1 -- 172.21.15.61:0/2466954315 shutdown_connections 2023-12-24T20:07:07.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.974+0000 7fab673f1700 1 -- 172.21.15.61:0/2466954315 wait complete. 2023-12-24T20:07:07.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.975+0000 7fab673f1700 1 Processor -- start 2023-12-24T20:07:07.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.976+0000 7fab673f1700 1 -- start start 2023-12-24T20:07:07.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.976+0000 7fab673f1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab60098aa0 0x7fab600ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.976+0000 7fab673f1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab6015bb60 0x7fab600c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.976+0000 7fab673f1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015c470 0x7fab600acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.976+0000 7fab673f1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab600a97c0 con 0x7fab6015c470 2023-12-24T20:07:07.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.976+0000 7fab673f1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab600a9aa0 con 0x7fab60098aa0 2023-12-24T20:07:07.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.976+0000 7fab673f1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c4530 con 0x7fab6015bb60 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6598e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015c470 0x7fab600acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6598e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015c470 0x7fab600acc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41010/0 (socket says 172.21.15.61:41010) 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6598e700 1 -- 172.21.15.61:0/2207563520 learned_addr learned my addr 172.21.15.61:0/2207563520 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6498c700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab6015bb60 0x7fab600c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6518d700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab60098aa0 0x7fab600ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6598e700 1 -- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab6015bb60 msgr2=0x7fab600c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6598e700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab6015bb60 0x7fab600c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6598e700 1 -- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab60098aa0 msgr2=0x7fab600ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6598e700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab60098aa0 0x7fab600ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6598e700 1 -- 172.21.15.61:0/2207563520 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5c009480 con 0x7fab6015c470 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab6598e700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015c470 0x7fab600acc00 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c870 tx=0x7fab58001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab557fa700 1 -- 172.21.15.61:0/2207563520 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58012630 con 0x7fab6015c470 2023-12-24T20:07:07.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab557fa700 1 -- 172.21.15.61:0/2207563520 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab580127b0 con 0x7fab6015c470 2023-12-24T20:07:07.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab673f1700 1 -- 172.21.15.61:0/2207563520 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab600c47b0 con 0x7fab6015c470 2023-12-24T20:07:07.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab557fa700 1 -- 172.21.15.61:0/2207563520 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58012b70 con 0x7fab6015c470 2023-12-24T20:07:07.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.977+0000 7fab673f1700 1 -- 172.21.15.61:0/2207563520 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab600c4d70 con 0x7fab6015c470 2023-12-24T20:07:07.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.978+0000 7fab673f1700 1 -- 172.21.15.61:0/2207563520 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6006d440 con 0x7fab6015c470 2023-12-24T20:07:07.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.979+0000 7fab557fa700 1 -- 172.21.15.61:0/2207563520 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fab58003030 con 0x7fab6015c470 2023-12-24T20:07:07.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.979+0000 7fab557fa700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab44066f30 0x7fab440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:07.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.979+0000 7fab557fa700 1 -- 172.21.15.61:0/2207563520 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7fab58084310 con 0x7fab6015c470 2023-12-24T20:07:07.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.979+0000 7fab557fa700 1 -- 172.21.15.61:0/2207563520 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7fab4406eab0 con 0x7fab6015c470 2023-12-24T20:07:07.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.979+0000 7fab6518d700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab44066f30 0x7fab440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:07.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.980+0000 7fab6518d700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab44066f30 0x7fab440693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009260 tx=0x7fab5c016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:07.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:07.983+0000 7fab557fa700 1 -- 172.21.15.61:0/2207563520 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab58051560 con 0x7fab6015c470 2023-12-24T20:07:08.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.179+0000 7fab673f1700 1 -- 172.21.15.61:0/2207563520 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab6004c3c0 con 0x7fab6015c470 2023-12-24T20:07:08.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.180+0000 7fab557fa700 1 -- 172.21.15.61:0/2207563520 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+15441 (secure 0 0 0) 0x7fab58054b80 con 0x7fab6015c470 2023-12-24T20:07:08.181 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:08.181 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":172,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:06:58.646798+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:06:01.971715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-24T20:06:03.153177+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.1b","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 -- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab44066f30 msgr2=0x7fab440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab44066f30 0x7fab440693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009260 tx=0x7fab5c016000 comp rx=0 tx=0).stop 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 -- 172.21.15.61:0/2207563520 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015c470 msgr2=0x7fab600acc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015c470 0x7fab600acc00 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c870 tx=0x7fab58001670 comp rx=0 tx=0).stop 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 -- 172.21.15.61:0/2207563520 shutdown_connections 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fab44066f30 0x7fab440693e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fab6015c470 0x7fab600acc00 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab60098aa0 0x7fab600ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 --2- 172.21.15.61:0/2207563520 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fab6015bb60 0x7fab600c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 -- 172.21.15.61:0/2207563520 >> 172.21.15.61:0/2207563520 conn(0x7fab60097a10 msgr2=0x7fab6006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 -- 172.21.15.61:0/2207563520 shutdown_connections 2023-12-24T20:07:08.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.183+0000 7fab673f1700 1 -- 172.21.15.61:0/2207563520 wait complete. 2023-12-24T20:07:08.195 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:07:08.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.318+0000 7f8516997700 1 Processor -- start 2023-12-24T20:07:08.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.318+0000 7f8516997700 1 -- start start 2023-12-24T20:07:08.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.318+0000 7f8516997700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f85101576a0 0x7f8510157a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.318+0000 7f8516997700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85100cba70 0x7f85100cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.318+0000 7f8516997700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8510158430 con 0x7f85101588c0 2023-12-24T20:07:08.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.318+0000 7f8516997700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85100cc430 con 0x7f85101576a0 2023-12-24T20:07:08.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f8516997700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8510158100 con 0x7f85100cba70 2023-12-24T20:07:08.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f85101576a0 0x7f8510157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f85101576a0 0x7f8510157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41016/0 (socket says 172.21.15.61:41016) 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850ffff700 1 -- 172.21.15.61:0/1303489407 learned_addr learned my addr 172.21.15.61:0/1303489407 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f8514f34700 1 --2- 172.21.15.61:0/1303489407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85100cba70 0x7f85100cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850ffff700 1 -- 172.21.15.61:0/1303489407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85100cba70 msgr2=0x7f85100cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850ffff700 1 --2- 172.21.15.61:0/1303489407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85100cba70 0x7f85100cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850ffff700 1 -- 172.21.15.61:0/1303489407 >> v1:172.21.15.133:6789/0 conn(0x7f85101588c0 legacy=0x7f8510063ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850ffff700 1 -- 172.21.15.61:0/1303489407 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8510069a40 con 0x7f85101576a0 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850ffff700 1 --2- 172.21.15.61:0/1303489407 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101576a0 0x7f8510157a70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f85000099b0 tx=0x7f8500009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f03ffd7a314f4e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850effd700 1 -- 172.21.15.61:0/1303489407 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850000b820 con 0x7f85101576a0 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850effd700 1 -- 172.21.15.61:0/1303489407 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850000b980 con 0x7f85101576a0 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.319+0000 7f850effd700 1 -- 172.21.15.61:0/1303489407 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850000bd20 con 0x7f85101576a0 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.320+0000 7f8516997700 1 -- 172.21.15.61:0/1303489407 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101576a0 msgr2=0x7f8510157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.320+0000 7f8516997700 1 --2- 172.21.15.61:0/1303489407 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101576a0 0x7f8510157a70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f85000099b0 tx=0x7f8500009250 comp rx=0 tx=0).stop 2023-12-24T20:07:08.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.320+0000 7f8516997700 1 -- 172.21.15.61:0/1303489407 shutdown_connections 2023-12-24T20:07:08.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.320+0000 7f8516997700 1 --2- 172.21.15.61:0/1303489407 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85100cba70 0x7f85100cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.320+0000 7f8516997700 1 --2- 172.21.15.61:0/1303489407 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101576a0 0x7f8510157a70 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.320+0000 7f8516997700 1 -- 172.21.15.61:0/1303489407 >> 172.21.15.61:0/1303489407 conn(0x7f85100ca3c0 msgr2=0x7f8510067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:08.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.320+0000 7f8516997700 1 -- 172.21.15.61:0/1303489407 shutdown_connections 2023-12-24T20:07:08.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.320+0000 7f8516997700 1 -- 172.21.15.61:0/1303489407 wait complete. 2023-12-24T20:07:08.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.321+0000 7f8516997700 1 Processor -- start 2023-12-24T20:07:08.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.322+0000 7f8516997700 1 -- start start 2023-12-24T20:07:08.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8516997700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85100cba70 0x7f8510143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8516997700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85101576a0 0x7f85100ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8516997700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101588c0 0x7f85100aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8516997700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85100c8180 con 0x7f85101588c0 2023-12-24T20:07:08.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8516997700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85100c7570 con 0x7f85101576a0 2023-12-24T20:07:08.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8516997700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85100c7850 con 0x7f85100cba70 2023-12-24T20:07:08.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8514f34700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101588c0 0x7f85100aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8514f34700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101588c0 0x7f85100aed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41018/0 (socket says 172.21.15.61:41018) 2023-12-24T20:07:08.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8514f34700 1 -- 172.21.15.61:0/42880895 learned_addr learned my addr 172.21.15.61:0/42880895 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:08.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f850ffff700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85100cba70 0x7f8510143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f850f7fe700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85101576a0 0x7f85100ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8514f34700 1 -- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85100cba70 msgr2=0x7f8510143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8514f34700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85100cba70 0x7f8510143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8514f34700 1 -- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85101576a0 msgr2=0x7f85100ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8514f34700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85101576a0 0x7f85100ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8514f34700 1 -- 172.21.15.61:0/42880895 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85000094f0 con 0x7f85101588c0 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8514f34700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101588c0 0x7f85100aed70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f850800cdb0 tx=0x7f85080077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f84f7fff700 1 -- 172.21.15.61:0/42880895 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850800a9d0 con 0x7f85101588c0 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f84f7fff700 1 -- 172.21.15.61:0/42880895 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850800ab30 con 0x7f85101588c0 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8516997700 1 -- 172.21.15.61:0/42880895 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85100c7b30 con 0x7f85101588c0 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f84f7fff700 1 -- 172.21.15.61:0/42880895 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8508017430 con 0x7f85101588c0 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.323+0000 7f8516997700 1 -- 172.21.15.61:0/42880895 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8510144000 con 0x7f85101588c0 2023-12-24T20:07:08.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.324+0000 7f8516997700 1 -- 172.21.15.61:0/42880895 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851004c3c0 con 0x7f85101588c0 2023-12-24T20:07:08.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.325+0000 7f84f7fff700 1 -- 172.21.15.61:0/42880895 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f8508003020 con 0x7f85101588c0 2023-12-24T20:07:08.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.325+0000 7f84f7fff700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f84fc066f30 0x7f84fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.325+0000 7f84f7fff700 1 -- 172.21.15.61:0/42880895 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5734+0+0 (secure 0 0 0) 0x7f8508013070 con 0x7f85101588c0 2023-12-24T20:07:08.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.325+0000 7f84f7fff700 1 -- 172.21.15.61:0/42880895 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=173}) v3 -- 0x7f84fc06eab0 con 0x7f85101588c0 2023-12-24T20:07:08.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.325+0000 7f850ffff700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f84fc066f30 0x7f84fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.326+0000 7f850ffff700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f84fc066f30 0x7f84fc0693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f85000099b0 tx=0x7f8500016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:08.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.330+0000 7f84f7fff700 1 -- 172.21.15.61:0/42880895 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f850801c020 con 0x7f85101588c0 2023-12-24T20:07:08.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.567+0000 7f8516997700 1 -- 172.21.15.61:0/42880895 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f85100c82c0 con 0x7f85101588c0 2023-12-24T20:07:08.569 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:07:08.568+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:07:08.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.570+0000 7f84f7fff700 1 -- 172.21.15.61:0/42880895 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(173..173 src has 1..173) v4 ==== 366+0+0 (secure 0 0 0) 0x7f8508058770 con 0x7f85101588c0 2023-12-24T20:07:08.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.570+0000 7f84f7fff700 1 -- 172.21.15.61:0/42880895 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f84fc06f400 con 0x7f85101588c0 2023-12-24T20:07:08.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.573+0000 7f84f7fff700 1 -- 172.21.15.61:0/42880895 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8508051910 con 0x7f85101588c0 2023-12-24T20:07:08.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 -- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f84fc066f30 msgr2=0x7f84fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f84fc066f30 0x7f84fc0693e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f85000099b0 tx=0x7f8500016000 comp rx=0 tx=0).stop 2023-12-24T20:07:08.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 -- 172.21.15.61:0/42880895 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101588c0 msgr2=0x7f85100aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101588c0 0x7f85100aed70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f850800cdb0 tx=0x7f85080077d0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 -- 172.21.15.61:0/42880895 shutdown_connections 2023-12-24T20:07:08.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f85100cba70 0x7f8510143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f84fc066f30 0x7f84fc0693e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f85101588c0 0x7f85100aed70 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 --2- 172.21.15.61:0/42880895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85101576a0 0x7f85100ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 -- 172.21.15.61:0/42880895 >> 172.21.15.61:0/42880895 conn(0x7f85100ca3c0 msgr2=0x7f851006d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:08.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 -- 172.21.15.61:0/42880895 shutdown_connections 2023-12-24T20:07:08.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.575+0000 7f8516997700 1 -- 172.21.15.61:0/42880895 wait complete. 2023-12-24T20:07:08.577 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:07:08.577 INFO:tasks.ceph.mds.a.smithi061.stderr: -7817> 2023-12-24T20:06:09.752+0000 7fa905b7b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:07:08.589 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:07:08.606 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T20:07:08.714 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.714+0000 7fccb9563700 1 Processor -- start 2023-12-24T20:07:08.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.714+0000 7fccb9563700 1 -- start start 2023-12-24T20:07:08.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb9563700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fccb40cdf90 0x7fccb406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb9563700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fccb4158c50 0x7fccb40cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb9563700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb4159090 con 0x7fccb40ce360 2023-12-24T20:07:08.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb9563700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb415bad0 con 0x7fccb4158c50 2023-12-24T20:07:08.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb9563700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb415bdb0 con 0x7fccb40cdf90 2023-12-24T20:07:08.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb37fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fccb4158c50 0x7fccb40cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb37fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fccb4158c50 0x7fccb40cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41034/0 (socket says 172.21.15.61:41034) 2023-12-24T20:07:08.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb37fe700 1 -- 172.21.15.61:0/3689914457 learned_addr learned my addr 172.21.15.61:0/3689914457 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb27fc700 1 --1- 172.21.15.61:0/3689914457 >> v1:172.21.15.61:6789/0 conn(0x7fccb40ce360 0x7fccb4158540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:47694/0 (socket says 172.21.15.61:47694) 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb2ffd700 1 --2- 172.21.15.61:0/3689914457 >> v2:172.21.15.133:3300/0 conn(0x7fccb40cdf90 0x7fccb406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb37fe700 1 -- 172.21.15.61:0/3689914457 >> v2:172.21.15.133:3300/0 conn(0x7fccb40cdf90 msgr2=0x7fccb406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb37fe700 1 --2- 172.21.15.61:0/3689914457 >> v2:172.21.15.133:3300/0 conn(0x7fccb40cdf90 0x7fccb406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb37fe700 1 -- 172.21.15.61:0/3689914457 >> v1:172.21.15.61:6789/0 conn(0x7fccb40ce360 legacy=0x7fccb4158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb37fe700 1 -- 172.21.15.61:0/3689914457 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb415c090 con 0x7fccb4158c50 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.715+0000 7fccb1ffb700 1 -- 172.21.15.61:0/3689914457 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416456153 0 0) 0x7fccb4159090 con 0x7fccb40ce360 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb37fe700 1 --2- 172.21.15.61:0/3689914457 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb4158c50 0x7fccb40cc990 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fccb40ce9b0 tx=0x7fccac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51125a36d37992a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb1ffb700 1 -- 172.21.15.61:0/3689914457 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccac00b860 con 0x7fccb4158c50 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb1ffb700 1 -- 172.21.15.61:0/3689914457 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccac00b9c0 con 0x7fccb4158c50 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb1ffb700 1 -- 172.21.15.61:0/3689914457 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccac00bd60 con 0x7fccb4158c50 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb9563700 1 -- 172.21.15.61:0/3689914457 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb4158c50 msgr2=0x7fccb40cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb9563700 1 --2- 172.21.15.61:0/3689914457 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb4158c50 0x7fccb40cc990 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fccb40ce9b0 tx=0x7fccac009250 comp rx=0 tx=0).stop 2023-12-24T20:07:08.718 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb9563700 1 -- 172.21.15.61:0/3689914457 shutdown_connections 2023-12-24T20:07:08.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb9563700 1 --2- 172.21.15.61:0/3689914457 >> v2:172.21.15.133:3300/0 conn(0x7fccb40cdf90 0x7fccb406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb9563700 1 --2- 172.21.15.61:0/3689914457 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb4158c50 0x7fccb40cc990 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb9563700 1 -- 172.21.15.61:0/3689914457 >> 172.21.15.61:0/3689914457 conn(0x7fccb406f810 msgr2=0x7fccb406ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:08.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb9563700 1 -- 172.21.15.61:0/3689914457 shutdown_connections 2023-12-24T20:07:08.719 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.716+0000 7fccb9563700 1 -- 172.21.15.61:0/3689914457 wait complete. 2023-12-24T20:07:08.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.718+0000 7fccb9563700 1 Processor -- start 2023-12-24T20:07:08.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.718+0000 7fccb9563700 1 -- start start 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb9563700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb40cdf90 0x7fccb416ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb9563700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccb40ce360 0x7fccb40ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb9563700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb4158c50 0x7fccb41550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb9563700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb40ac7f0 con 0x7fccb40cdf90 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb9563700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb40acad0 con 0x7fccb4158c50 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb9563700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb40acdb0 con 0x7fccb40ce360 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb40cdf90 0x7fccb416ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb40cdf90 0x7fccb416ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41042/0 (socket says 172.21.15.61:41042) 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb2ffd700 1 -- 172.21.15.61:0/281695721 learned_addr learned my addr 172.21.15.61:0/281695721 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb27fc700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccb40ce360 0x7fccb40ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.719+0000 7fccb37fe700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb4158c50 0x7fccb41550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccb2ffd700 1 -- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccb40ce360 msgr2=0x7fccb40ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccb2ffd700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccb40ce360 0x7fccb40ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccb2ffd700 1 -- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb4158c50 msgr2=0x7fccb41550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccb2ffd700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb4158c50 0x7fccb41550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccb2ffd700 1 -- 172.21.15.61:0/281695721 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0094f0 con 0x7fccb40cdf90 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccb2ffd700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb40cdf90 0x7fccb416ac70 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009fa0 tx=0x7fcca4009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccaaffd700 1 -- 172.21.15.61:0/281695721 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca400ebc0 con 0x7fccb40cdf90 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccaaffd700 1 -- 172.21.15.61:0/281695721 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca400ed20 con 0x7fccb40cdf90 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccb9563700 1 -- 172.21.15.61:0/281695721 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb40ad090 con 0x7fccb40cdf90 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccaaffd700 1 -- 172.21.15.61:0/281695721 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4014670 con 0x7fccb40cdf90 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.720+0000 7fccb9563700 1 -- 172.21.15.61:0/281695721 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb416b1b0 con 0x7fccb40cdf90 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.721+0000 7fccb9563700 1 -- 172.21.15.61:0/281695721 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb404c3c0 con 0x7fccb40cdf90 2023-12-24T20:07:08.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.721+0000 7fccaaffd700 1 -- 172.21.15.61:0/281695721 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcca40149e0 con 0x7fccb40cdf90 2023-12-24T20:07:08.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.722+0000 7fccaaffd700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc94066f30 0x7fcc940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:08.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.722+0000 7fccaaffd700 1 -- 172.21.15.61:0/281695721 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5820+0+0 (secure 0 0 0) 0x7fcca4084bb0 con 0x7fccb40cdf90 2023-12-24T20:07:08.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.722+0000 7fccb27fc700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc94066f30 0x7fcc940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:08.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.722+0000 7fccb27fc700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc94066f30 0x7fcc940693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c007180 tx=0x7fcc9c007ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:08.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.726+0000 7fccaaffd700 1 -- 172.21.15.61:0/281695721 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcca4051db0 con 0x7fccb40cdf90 2023-12-24T20:07:08.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:08.968+0000 7fccb9563700 1 -- 172.21.15.61:0/281695721 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fccb415b460 con 0x7fccb40cdf90 2023-12-24T20:07:09.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.624+0000 7fccaaffd700 1 -- 172.21.15.61:0/281695721 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v86) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcca40099c0 con 0x7fccb40cdf90 2023-12-24T20:07:09.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.627+0000 7fccb9563700 1 -- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc94066f30 msgr2=0x7fcc940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:09.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.627+0000 7fccb9563700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc94066f30 0x7fcc940693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c007180 tx=0x7fcc9c007ef0 comp rx=0 tx=0).stop 2023-12-24T20:07:09.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.627+0000 7fccb9563700 1 -- 172.21.15.61:0/281695721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb40cdf90 msgr2=0x7fccb416ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:09.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.627+0000 7fccb9563700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb40cdf90 0x7fccb416ac70 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009fa0 tx=0x7fcca4009880 comp rx=0 tx=0).stop 2023-12-24T20:07:09.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.628+0000 7fccb9563700 1 -- 172.21.15.61:0/281695721 shutdown_connections 2023-12-24T20:07:09.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.628+0000 7fccb9563700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc94066f30 0x7fcc940693e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:09.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.628+0000 7fccb9563700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fccb4158c50 0x7fccb41550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:09.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.628+0000 7fccb9563700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fccb40cdf90 0x7fccb416ac70 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:09.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.628+0000 7fccb9563700 1 --2- 172.21.15.61:0/281695721 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fccb40ce360 0x7fccb40ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:09.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.628+0000 7fccb9563700 1 -- 172.21.15.61:0/281695721 >> 172.21.15.61:0/281695721 conn(0x7fccb406f810 msgr2=0x7fccb4157440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:09.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.628+0000 7fccb9563700 1 -- 172.21.15.61:0/281695721 shutdown_connections 2023-12-24T20:07:09.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.628+0000 7fccb9563700 1 -- 172.21.15.61:0/281695721 wait complete. 2023-12-24T20:07:09.643 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:07:09.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.816+0000 7f0f697fe700 1 Processor -- start 2023-12-24T20:07:09.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.817+0000 7f0f697fe700 1 -- start start 2023-12-24T20:07:09.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.817+0000 7f0f697fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f6415b690 0x7f0f640ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:09.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.817+0000 7f0f697fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 0x7f0f64157440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:09.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.817+0000 7f0f697fe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f640cf090 con 0x7f0f640ce780 2023-12-24T20:07:09.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.817+0000 7f0f697fe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6415bc50 con 0x7f0f6415b690 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.817+0000 7f0f697fe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6415bf30 con 0x7f0f640af3b0 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f637fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 0x7f0f64157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f627fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f6415b690 0x7f0f640ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f637fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 0x7f0f64157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:50546/0 (socket says 172.21.15.61:50546) 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f627fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f6415b690 0x7f0f640ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:57966/0 (socket says 172.21.15.61:57966) 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f637fe700 1 -- 172.21.15.61:0/668691860 learned_addr learned my addr 172.21.15.61:0/668691860 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f62ffd700 1 --1- 172.21.15.61:0/668691860 >> v1:172.21.15.133:6789/0 conn(0x7f0f640ce780 0x7f0f6406f6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:58908/0 (socket says 172.21.15.61:58908) 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f637fe700 1 -- 172.21.15.61:0/668691860 >> v2:172.21.15.133:3300/0 conn(0x7f0f6415b690 msgr2=0x7f0f640ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f637fe700 1 --2- 172.21.15.61:0/668691860 >> v2:172.21.15.133:3300/0 conn(0x7f0f6415b690 0x7f0f640ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f637fe700 1 -- 172.21.15.61:0/668691860 >> v1:172.21.15.133:6789/0 conn(0x7f0f640ce780 legacy=0x7f0f6406f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f637fe700 1 -- 172.21.15.61:0/668691860 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6415c210 con 0x7f0f640af3b0 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f627fc700 1 --2- 172.21.15.61:0/668691860 >> v2:172.21.15.133:3300/0 conn(0x7f0f6415b690 0x7f0f640ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.818+0000 7f0f637fe700 1 --2- 172.21.15.61:0/668691860 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 0x7f0f64157440 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009f20 tx=0x7f0f5c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a705d7e84551b9d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f61ffb700 1 -- 172.21.15.61:0/668691860 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00e070 con 0x7f0f640af3b0 2023-12-24T20:07:09.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f61ffb700 1 -- 172.21.15.61:0/668691860 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00b9d0 con 0x7f0f640af3b0 2023-12-24T20:07:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f61ffb700 1 -- 172.21.15.61:0/668691860 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0092e0 con 0x7f0f640af3b0 2023-12-24T20:07:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f697fe700 1 -- 172.21.15.61:0/668691860 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 msgr2=0x7f0f64157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f697fe700 1 --2- 172.21.15.61:0/668691860 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 0x7f0f64157440 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009f20 tx=0x7f0f5c009840 comp rx=0 tx=0).stop 2023-12-24T20:07:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f697fe700 1 -- 172.21.15.61:0/668691860 shutdown_connections 2023-12-24T20:07:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f697fe700 1 --2- 172.21.15.61:0/668691860 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 0x7f0f64157440 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f697fe700 1 --2- 172.21.15.61:0/668691860 >> v2:172.21.15.133:3300/0 conn(0x7f0f6415b690 0x7f0f640ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f697fe700 1 -- 172.21.15.61:0/668691860 >> 172.21.15.61:0/668691860 conn(0x7f0f64069760 msgr2=0x7f0f64069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f697fe700 1 -- 172.21.15.61:0/668691860 shutdown_connections 2023-12-24T20:07:09.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.819+0000 7f0f697fe700 1 -- 172.21.15.61:0/668691860 wait complete. 2023-12-24T20:07:09.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.820+0000 7f0f697fe700 1 Processor -- start 2023-12-24T20:07:09.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.820+0000 7f0f697fe700 1 -- start start 2023-12-24T20:07:09.823 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f697fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 0x7f0f64157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:09.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f697fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f640ce780 0x7f0f640c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:09.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f697fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6415b690 0x7f0f640c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:09.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f697fe700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6415e3e0 con 0x7f0f640ce780 2023-12-24T20:07:09.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f697fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640c6bd0 con 0x7f0f6415b690 2023-12-24T20:07:09.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f697fe700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640c62a0 con 0x7f0f640af3b0 2023-12-24T20:07:09.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f627fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f640ce780 0x7f0f640c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:09.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f627fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f640ce780 0x7f0f640c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41048/0 (socket says 172.21.15.61:41048) 2023-12-24T20:07:09.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f627fc700 1 -- 172.21.15.61:0/3894000770 learned_addr learned my addr 172.21.15.61:0/3894000770 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:09.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f62ffd700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 0x7f0f64157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:09.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.821+0000 7f0f637fe700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6415b690 0x7f0f640c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:09.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f627fc700 1 -- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 msgr2=0x7f0f64157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:09.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f627fc700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 0x7f0f64157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:09.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f627fc700 1 -- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6415b690 msgr2=0x7f0f640c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:09.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f627fc700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6415b690 0x7f0f640c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:09.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f627fc700 1 -- 172.21.15.61:0/3894000770 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54009420 con 0x7f0f640ce780 2023-12-24T20:07:09.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f627fc700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f640ce780 0x7f0f640c7060 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400ecb0 tx=0x7f0f540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:09.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f5affd700 1 -- 172.21.15.61:0/3894000770 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400c850 con 0x7f0f640ce780 2023-12-24T20:07:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f5affd700 1 -- 172.21.15.61:0/3894000770 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400c9b0 con 0x7f0f640ce780 2023-12-24T20:07:09.826 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f697fe700 1 -- 172.21.15.61:0/3894000770 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c009ae0 con 0x7f0f640ce780 2023-12-24T20:07:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f5affd700 1 -- 172.21.15.61:0/3894000770 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400cd50 con 0x7f0f640ce780 2023-12-24T20:07:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.822+0000 7f0f697fe700 1 -- 172.21.15.61:0/3894000770 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f640c6860 con 0x7f0f640ce780 2023-12-24T20:07:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.823+0000 7f0f697fe700 1 -- 172.21.15.61:0/3894000770 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6404c3c0 con 0x7f0f640ce780 2023-12-24T20:07:09.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.823+0000 7f0f5affd700 1 -- 172.21.15.61:0/3894000770 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0f54013680 con 0x7f0f640ce780 2023-12-24T20:07:09.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.824+0000 7f0f5affd700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f44066f30 0x7f0f440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:09.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.824+0000 7f0f5affd700 1 -- 172.21.15.61:0/3894000770 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5820+0+0 (secure 0 0 0) 0x7f0f54084820 con 0x7f0f640ce780 2023-12-24T20:07:09.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.824+0000 7f0f62ffd700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f44066f30 0x7f0f440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:09.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.824+0000 7f0f62ffd700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f44066f30 0x7f0f440693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0f640cb960 tx=0x7f0f4c007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:09.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:09.828+0000 7f0f5affd700 1 -- 172.21.15.61:0/3894000770 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f54051a20 con 0x7f0f640ce780 2023-12-24T20:07:10.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.023+0000 7f0f697fe700 1 -- 172.21.15.61:0/3894000770 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0f640c6d10 con 0x7f0f640ce780 2023-12-24T20:07:10.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.691+0000 7f0f5affd700 1 -- 172.21.15.61:0/3894000770 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v175) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0f540170d0 con 0x7f0f640ce780 2023-12-24T20:07:10.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 -- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f44066f30 msgr2=0x7f0f440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:10.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f44066f30 0x7f0f440693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0f640cb960 tx=0x7f0f4c007eb0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 -- 172.21.15.61:0/3894000770 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f640ce780 msgr2=0x7f0f640c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:10.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f640ce780 0x7f0f640c7060 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400ecb0 tx=0x7f0f540091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 -- 172.21.15.61:0/3894000770 shutdown_connections 2023-12-24T20:07:10.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0f640af3b0 0x7f0f64157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0f44066f30 0x7f0f440693e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f6415b690 0x7f0f640c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 --2- 172.21.15.61:0/3894000770 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0f640ce780 0x7f0f640c7060 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 -- 172.21.15.61:0/3894000770 >> 172.21.15.61:0/3894000770 conn(0x7f0f64069760 msgr2=0x7f0f64069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:10.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 -- 172.21.15.61:0/3894000770 shutdown_connections 2023-12-24T20:07:10.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.694+0000 7f0f697fe700 1 -- 172.21.15.61:0/3894000770 wait complete. 2023-12-24T20:07:10.695 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:07:10.709 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:07:10.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.839+0000 7f086fa75700 1 Processor -- start 2023-12-24T20:07:10.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.839+0000 7f086fa75700 1 -- start start 2023-12-24T20:07:10.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.840+0000 7f086fa75700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0868156a90 0x7f0868156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:10.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.840+0000 7f086fa75700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0868068ee0 con 0x7f0868157420 2023-12-24T20:07:10.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.840+0000 7f086fa75700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0868157830 con 0x7f08681566c0 2023-12-24T20:07:10.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.840+0000 7f086fa75700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0868157da0 con 0x7f0868156a90 2023-12-24T20:07:10.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.840+0000 7f086e012700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0868157420 0x7f08680c2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:47706/0 (socket says 172.21.15.61:47706) 2023-12-24T20:07:10.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.840+0000 7f086e012700 1 -- 172.21.15.61:0/572426140 learned_addr learned my addr 172.21.15.61:0/572426140 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:10.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086d010700 1 --2- 172.21.15.61:0/572426140 >> v2:172.21.15.133:3300/0 conn(0x7f0868156a90 0x7f0868156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659683605 0 0) 0x7f0868068ee0 con 0x7f0868157420 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0854003570 con 0x7f0868157420 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858948437 0 0) 0x7f0868157830 con 0x7f08681566c0 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0868068ee0 con 0x7f08681566c0 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 251470808 0 0) 0x7f0854003570 con 0x7f0868157420 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 >> v2:172.21.15.133:3300/0 conn(0x7f0868156a90 msgr2=0x7f0868156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 --2- 172.21.15.61:0/572426140 >> v2:172.21.15.133:3300/0 conn(0x7f0868156a90 0x7f0868156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 >> v1:172.21.15.133:6789/0 conn(0x7f08681566c0 legacy=0x7f08680cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08680682d0 con 0x7f0868157420 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f08600017f0 con 0x7f0868157420 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 >> v1:172.21.15.61:6789/0 conn(0x7f0868157420 legacy=0x7f08680c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f0854003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:10.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0854004810 0x7f0854004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08540051c0 0x7f085400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085400c080 con 0x7f0854003bf0 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085400c1f0 con 0x7f08540051c0 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085400e5c0 con 0x7f0854004810 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086d811700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f0854003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086d010700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0854004810 0x7f0854004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086e012700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08540051c0 0x7f085400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086d811700 1 -- 172.21.15.61:0/572426140 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0854004810 msgr2=0x7f0854004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086d811700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0854004810 0x7f0854004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086d811700 1 -- 172.21.15.61:0/572426140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08540051c0 msgr2=0x7f085400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086d811700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08540051c0 0x7f085400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086d811700 1 -- 172.21.15.61:0/572426140 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854003570 con 0x7f0854003bf0 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.841+0000 7f086e012700 1 -- 172.21.15.61:0/572426140 reap_dead start 2023-12-24T20:07:10.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086d811700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f0854003fe0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f0858001a10 tx=0x7f0858007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fbc52a8eae2640 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085800c5d0 con 0x7f0854003bf0 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085800c730 con 0x7f0854003bf0 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086c80f700 1 -- 172.21.15.61:0/572426140 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085800cad0 con 0x7f0854003bf0 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086fa75700 1 -- 172.21.15.61:0/572426140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 msgr2=0x7f0854003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086fa75700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f0854003fe0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f0858001a10 tx=0x7f0858007d30 comp rx=0 tx=0).stop 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086fa75700 1 -- 172.21.15.61:0/572426140 shutdown_connections 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086fa75700 1 --2- 172.21.15.61:0/572426140 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f0854003fe0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086fa75700 1 -- 172.21.15.61:0/572426140 >> 172.21.15.61:0/572426140 conn(0x7f08680ca1e0 msgr2=0x7f08680ca5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086fa75700 1 -- 172.21.15.61:0/572426140 shutdown_connections 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.842+0000 7f086fa75700 1 -- 172.21.15.61:0/572426140 wait complete. 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.843+0000 7f086fa75700 1 Processor -- start 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.844+0000 7f086fa75700 1 -- start start 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.844+0000 7f086fa75700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f086814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:10.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.844+0000 7f086fa75700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0868157fc0 0x7f0868158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.844+0000 7f086fa75700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08680c9540 0x7f08680c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.844+0000 7f086fa75700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0868158970 con 0x7f0854003bf0 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.844+0000 7f086fa75700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086816b7a0 con 0x7f08680c9540 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.844+0000 7f086fa75700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086816ab90 con 0x7f0868157fc0 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.844+0000 7f086d811700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f086814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.844+0000 7f086d811700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f086814d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41058/0 (socket says 172.21.15.61:41058) 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.844+0000 7f086d811700 1 -- 172.21.15.61:0/2940086984 learned_addr learned my addr 172.21.15.61:0/2940086984 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f086d811700 1 -- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0868157fc0 msgr2=0x7f0868158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f086d811700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0868157fc0 0x7f0868158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f086d811700 1 -- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08680c9540 msgr2=0x7f08680c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f086d811700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08680c9540 0x7f08680c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f086d811700 1 -- 172.21.15.61:0/2940086984 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086816ae70 con 0x7f0854003bf0 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f086d811700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f086814d170 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f085800c3c0 tx=0x7f0858015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:10.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f085dffb700 1 -- 172.21.15.61:0/2940086984 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085800c5d0 con 0x7f0854003bf0 2023-12-24T20:07:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f085dffb700 1 -- 172.21.15.61:0/2940086984 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085800ce80 con 0x7f0854003bf0 2023-12-24T20:07:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f086fa75700 1 -- 172.21.15.61:0/2940086984 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086816b150 con 0x7f0854003bf0 2023-12-24T20:07:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f085dffb700 1 -- 172.21.15.61:0/2940086984 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858007b10 con 0x7f0854003bf0 2023-12-24T20:07:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.845+0000 7f086fa75700 1 -- 172.21.15.61:0/2940086984 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0868167560 con 0x7f0854003bf0 2023-12-24T20:07:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.846+0000 7f086fa75700 1 -- 172.21.15.61:0/2940086984 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086804c3c0 con 0x7f0854003bf0 2023-12-24T20:07:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.846+0000 7f085dffb700 1 -- 172.21.15.61:0/2940086984 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0858019070 con 0x7f0854003bf0 2023-12-24T20:07:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.847+0000 7f085dffb700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f084c066f30 0x7f084c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.847+0000 7f085dffb700 1 -- 172.21.15.61:0/2940086984 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0858085240 con 0x7f0854003bf0 2023-12-24T20:07:10.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.847+0000 7f086d010700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f084c066f30 0x7f084c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:10.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.848+0000 7f086d010700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f084c066f30 0x7f084c0693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0868158c10 tx=0x7f08640091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:10.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:10.851+0000 7f085dffb700 1 -- 172.21.15.61:0/2940086984 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08580525f0 con 0x7f0854003bf0 2023-12-24T20:07:11.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.045+0000 7f086fa75700 1 -- 172.21.15.61:0/2940086984 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f08680685b0 con 0x7f0854003bf0 2023-12-24T20:07:11.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.689+0000 7f085dffb700 1 -- 172.21.15.61:0/2940086984 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v176) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0858055c10 con 0x7f0854003bf0 2023-12-24T20:07:11.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.693+0000 7f086fa75700 1 -- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f084c066f30 msgr2=0x7f084c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:11.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.693+0000 7f086fa75700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f084c066f30 0x7f084c0693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0868158c10 tx=0x7f08640091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.693+0000 7f086fa75700 1 -- 172.21.15.61:0/2940086984 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 msgr2=0x7f086814d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:11.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.693+0000 7f086fa75700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f086814d170 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f085800c3c0 tx=0x7f0858015000 comp rx=0 tx=0).stop 2023-12-24T20:07:11.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.694+0000 7f086fa75700 1 -- 172.21.15.61:0/2940086984 shutdown_connections 2023-12-24T20:07:11.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.694+0000 7f086fa75700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f084c066f30 0x7f084c0693e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.694+0000 7f086fa75700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08680c9540 0x7f08680c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.694+0000 7f086fa75700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0854003bf0 0x7f086814d170 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.694+0000 7f086fa75700 1 --2- 172.21.15.61:0/2940086984 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0868157fc0 0x7f0868158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.694+0000 7f086fa75700 1 -- 172.21.15.61:0/2940086984 >> 172.21.15.61:0/2940086984 conn(0x7f08680ca1e0 msgr2=0x7f0868069c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:11.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.694+0000 7f086fa75700 1 -- 172.21.15.61:0/2940086984 shutdown_connections 2023-12-24T20:07:11.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.694+0000 7f086fa75700 1 -- 172.21.15.61:0/2940086984 wait complete. 2023-12-24T20:07:11.696 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T20:07:11.710 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:07:11.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.843+0000 7fb15e02c700 1 Processor -- start 2023-12-24T20:07:11.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.843+0000 7fb15e02c700 1 -- start start 2023-12-24T20:07:11.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb15e02c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb158156b60 0x7fb15806af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:11.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb15e02c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb158067f10 0x7fb1580c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:11.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb15e02c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb15806aaf0 con 0x7fb1580c3460 2023-12-24T20:07:11.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb15e02c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1580c38a0 con 0x7fb158067f10 2023-12-24T20:07:11.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb15e02c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb158069c00 con 0x7fb158156b60 2023-12-24T20:07:11.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb156ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb158067f10 0x7fb1580c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:11.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb157fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb1580c3460 0x7fb1580c8690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:47722/0 (socket says 172.21.15.61:47722) 2023-12-24T20:07:11.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb157fff700 1 -- 172.21.15.61:0/2273508205 learned_addr learned my addr 172.21.15.61:0/2273508205 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:11.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb156ffd700 1 -- 172.21.15.61:0/2273508205 >> v2:172.21.15.133:3300/0 conn(0x7fb158156b60 msgr2=0x7fb15806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:11.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb156ffd700 1 --2- 172.21.15.61:0/2273508205 >> v2:172.21.15.133:3300/0 conn(0x7fb158156b60 0x7fb15806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb156ffd700 1 -- 172.21.15.61:0/2273508205 >> v1:172.21.15.61:6789/0 conn(0x7fb1580c3460 legacy=0x7fb1580c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:11.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb156ffd700 1 -- 172.21.15.61:0/2273508205 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb158069ee0 con 0x7fb158067f10 2023-12-24T20:07:11.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.844+0000 7fb1567fc700 1 -- 172.21.15.61:0/2273508205 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781657244 0 0) 0x7fb15806aaf0 con 0x7fb1580c3460 2023-12-24T20:07:11.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb156ffd700 1 --2- 172.21.15.61:0/2273508205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb158067f10 0x7fb1580c2f20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fb15806cf20 tx=0x7fb1480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a92f2a580d784d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb1567fc700 1 -- 172.21.15.61:0/2273508205 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14800b6b0 con 0x7fb158067f10 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb1567fc700 1 -- 172.21.15.61:0/2273508205 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14800b810 con 0x7fb158067f10 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb1567fc700 1 -- 172.21.15.61:0/2273508205 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14800bbb0 con 0x7fb158067f10 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb15e02c700 1 -- 172.21.15.61:0/2273508205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb158067f10 msgr2=0x7fb1580c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb15e02c700 1 --2- 172.21.15.61:0/2273508205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb158067f10 0x7fb1580c2f20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fb15806cf20 tx=0x7fb1480091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb15e02c700 1 -- 172.21.15.61:0/2273508205 shutdown_connections 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb15e02c700 1 --2- 172.21.15.61:0/2273508205 >> v2:172.21.15.133:3300/0 conn(0x7fb158156b60 0x7fb15806af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb15e02c700 1 --2- 172.21.15.61:0/2273508205 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb158067f10 0x7fb1580c2f20 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb15e02c700 1 -- 172.21.15.61:0/2273508205 >> 172.21.15.61:0/2273508205 conn(0x7fb1580ce420 msgr2=0x7fb1580ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb15e02c700 1 -- 172.21.15.61:0/2273508205 shutdown_connections 2023-12-24T20:07:11.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.845+0000 7fb15e02c700 1 -- 172.21.15.61:0/2273508205 wait complete. 2023-12-24T20:07:11.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.847+0000 7fb15e02c700 1 Processor -- start 2023-12-24T20:07:11.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.847+0000 7fb15e02c700 1 -- start start 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.847+0000 7fb15e02c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb158067f10 0x7fb15815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.847+0000 7fb15e02c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1580c3460 0x7fb15816df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.847+0000 7fb15e02c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb158156b60 0x7fb15816e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.847+0000 7fb15e02c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580c79c0 con 0x7fb1580c3460 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.847+0000 7fb15e02c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580c9410 con 0x7fb158156b60 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.847+0000 7fb15e02c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580c96f0 con 0x7fb158067f10 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb156ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1580c3460 0x7fb15816df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb156ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1580c3460 0x7fb15816df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41076/0 (socket says 172.21.15.61:41076) 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb156ffd700 1 -- 172.21.15.61:0/945790699 learned_addr learned my addr 172.21.15.61:0/945790699 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb1577fe700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb158067f10 0x7fb15815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb157fff700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb158156b60 0x7fb15816e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb156ffd700 1 -- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb158067f10 msgr2=0x7fb15815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb156ffd700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb158067f10 0x7fb15815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb156ffd700 1 -- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb158156b60 msgr2=0x7fb15816e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb156ffd700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb158156b60 0x7fb15816e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb156ffd700 1 -- 172.21.15.61:0/945790699 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb148009420 con 0x7fb1580c3460 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb157fff700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb158156b60 0x7fb15816e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb156ffd700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1580c3460 0x7fb15816df30 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fb15806d300 tx=0x7fb148017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb14f7fe700 1 -- 172.21.15.61:0/945790699 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148011420 con 0x7fb1580c3460 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb14f7fe700 1 -- 172.21.15.61:0/945790699 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148011580 con 0x7fb1580c3460 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb15e02c700 1 -- 172.21.15.61:0/945790699 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1580c99d0 con 0x7fb1580c3460 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb14f7fe700 1 -- 172.21.15.61:0/945790699 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148011940 con 0x7fb1580c3460 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.848+0000 7fb15e02c700 1 -- 172.21.15.61:0/945790699 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1580c9f90 con 0x7fb1580c3460 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.849+0000 7fb15e02c700 1 -- 172.21.15.61:0/945790699 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb158068350 con 0x7fb1580c3460 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.850+0000 7fb14f7fe700 1 -- 172.21.15.61:0/945790699 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb148011cb0 con 0x7fb1580c3460 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.850+0000 7fb14f7fe700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb138066f30 0x7fb1380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.850+0000 7fb14f7fe700 1 -- 172.21.15.61:0/945790699 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb148085cf0 con 0x7fb1580c3460 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.851+0000 7fb1577fe700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb138066f30 0x7fb1380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:11.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.851+0000 7fb1577fe700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb138066f30 0x7fb1380693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb140006fd0 tx=0x7fb140008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:11.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:11.855+0000 7fb14f7fe700 1 -- 172.21.15.61:0/945790699 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb14808a070 con 0x7fb1580c3460 2023-12-24T20:07:12.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.049+0000 7fb15e02c700 1 -- 172.21.15.61:0/945790699 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb1580ca180 con 0x7fb1580c3460 2023-12-24T20:07:12.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.053+0000 7fb14f7fe700 1 -- 172.21.15.61:0/945790699 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb148053260 con 0x7fb1580c3460 2023-12-24T20:07:12.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 -- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb138066f30 msgr2=0x7fb1380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb138066f30 0x7fb1380693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb140006fd0 tx=0x7fb140008040 comp rx=0 tx=0).stop 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 -- 172.21.15.61:0/945790699 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1580c3460 msgr2=0x7fb15816df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1580c3460 0x7fb15816df30 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fb15806d300 tx=0x7fb148017000 comp rx=0 tx=0).stop 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 -- 172.21.15.61:0/945790699 shutdown_connections 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb158067f10 0x7fb15815a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb138066f30 0x7fb1380693e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb158156b60 0x7fb15816e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 --2- 172.21.15.61:0/945790699 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1580c3460 0x7fb15816df30 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 -- 172.21.15.61:0/945790699 >> 172.21.15.61:0/945790699 conn(0x7fb1580ce420 msgr2=0x7fb1581522f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 -- 172.21.15.61:0/945790699 shutdown_connections 2023-12-24T20:07:12.056 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.055+0000 7fb15e02c700 1 -- 172.21.15.61:0/945790699 wait complete. 2023-12-24T20:07:12.068 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-12-24T20:07:12.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.190+0000 7f59802f0700 1 Processor -- start 2023-12-24T20:07:12.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.190+0000 7f59802f0700 1 -- start start 2023-12-24T20:07:12.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f59802f0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5978159a90 0x7f5978070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f59802f0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59780b04c0 0x7f59780c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f59802f0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597806a090 con 0x7f5978159e60 2023-12-24T20:07:12.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f59802f0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597806ac10 con 0x7f5978159a90 2023-12-24T20:07:12.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f59802f0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597806a2e0 con 0x7f59780b04c0 2023-12-24T20:07:12.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597e08c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5978159a90 0x7f5978070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597d88b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f5978159e60 0x7f59780c93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:47736/0 (socket says 172.21.15.61:47736) 2023-12-24T20:07:12.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597e08c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5978159a90 0x7f5978070640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41086/0 (socket says 172.21.15.61:41086) 2023-12-24T20:07:12.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597d88b700 1 -- 172.21.15.61:0/964107781 learned_addr learned my addr 172.21.15.61:0/964107781 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597e88d700 1 --2- 172.21.15.61:0/964107781 >> v2:172.21.15.133:3300/0 conn(0x7f59780b04c0 0x7f59780c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597e08c700 1 -- 172.21.15.61:0/964107781 >> v2:172.21.15.133:3300/0 conn(0x7f59780b04c0 msgr2=0x7f59780c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597e08c700 1 --2- 172.21.15.61:0/964107781 >> v2:172.21.15.133:3300/0 conn(0x7f59780b04c0 0x7f59780c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597e08c700 1 -- 172.21.15.61:0/964107781 >> v1:172.21.15.61:6789/0 conn(0x7f5978159e60 legacy=0x7f59780c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597e08c700 1 -- 172.21.15.61:0/964107781 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597806a5c0 con 0x7f5978159a90 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597e88d700 1 --2- 172.21.15.61:0/964107781 >> v2:172.21.15.133:3300/0 conn(0x7f59780b04c0 0x7f59780c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.191+0000 7f597d08a700 1 -- 172.21.15.61:0/964107781 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933052229 0 0) 0x7f597806a090 con 0x7f5978159e60 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f597e08c700 1 --2- 172.21.15.61:0/964107781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5978159a90 0x7f5978070640 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f59780b37a0 tx=0x7f59740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d4bd6ae06ef9a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f597d08a700 1 -- 172.21.15.61:0/964107781 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400b6b0 con 0x7f5978159a90 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f597d08a700 1 -- 172.21.15.61:0/964107781 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597400b810 con 0x7f5978159a90 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f597d08a700 1 -- 172.21.15.61:0/964107781 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400bbb0 con 0x7f5978159a90 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f59802f0700 1 -- 172.21.15.61:0/964107781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5978159a90 msgr2=0x7f5978070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f59802f0700 1 --2- 172.21.15.61:0/964107781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5978159a90 0x7f5978070640 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f59780b37a0 tx=0x7f59740091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f59802f0700 1 -- 172.21.15.61:0/964107781 shutdown_connections 2023-12-24T20:07:12.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f59802f0700 1 --2- 172.21.15.61:0/964107781 >> v2:172.21.15.133:3300/0 conn(0x7f59780b04c0 0x7f59780c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f59802f0700 1 --2- 172.21.15.61:0/964107781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5978159a90 0x7f5978070640 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f59802f0700 1 -- 172.21.15.61:0/964107781 >> 172.21.15.61:0/964107781 conn(0x7f59780cd6f0 msgr2=0x7f59780cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:12.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f59802f0700 1 -- 172.21.15.61:0/964107781 shutdown_connections 2023-12-24T20:07:12.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.192+0000 7f59802f0700 1 -- 172.21.15.61:0/964107781 wait complete. 2023-12-24T20:07:12.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.193+0000 7f59802f0700 1 Processor -- start 2023-12-24T20:07:12.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.194+0000 7f59802f0700 1 -- start start 2023-12-24T20:07:12.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.194+0000 7f59802f0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59780b04c0 0x7f59780c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.194+0000 7f59802f0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5978159a90 0x7f5978169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.194+0000 7f59802f0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5978159e60 0x7f5978157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.194+0000 7f59802f0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597816a0e0 con 0x7f59780b04c0 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.194+0000 7f59802f0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597816a3c0 con 0x7f5978159a90 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.194+0000 7f59802f0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597816a6a0 con 0x7f5978159e60 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.194+0000 7f597e08c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59780b04c0 0x7f59780c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.194+0000 7f597e08c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59780b04c0 0x7f59780c2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41092/0 (socket says 172.21.15.61:41092) 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.194+0000 7f597e08c700 1 -- 172.21.15.61:0/2060750227 learned_addr learned my addr 172.21.15.61:0/2060750227 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f597e08c700 1 -- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5978159e60 msgr2=0x7f5978157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f597e08c700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5978159e60 0x7f5978157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f597e08c700 1 -- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5978159a90 msgr2=0x7f5978169870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f597e08c700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5978159a90 0x7f5978169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f597e08c700 1 -- 172.21.15.61:0/2060750227 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974009420 con 0x7f59780b04c0 2023-12-24T20:07:12.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f597e08c700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59780b04c0 0x7f59780c2620 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f59740091e0 tx=0x7f5974017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f596e7fc700 1 -- 172.21.15.61:0/2060750227 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400bb50 con 0x7f59780b04c0 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f596e7fc700 1 -- 172.21.15.61:0/2060750227 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5974025420 con 0x7f59780b04c0 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f59802f0700 1 -- 172.21.15.61:0/2060750227 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59780c4700 con 0x7f59780b04c0 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f596e7fc700 1 -- 172.21.15.61:0/2060750227 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740257e0 con 0x7f59780b04c0 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.195+0000 7f59802f0700 1 -- 172.21.15.61:0/2060750227 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5978169db0 con 0x7f59780b04c0 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.196+0000 7f59802f0700 1 -- 172.21.15.61:0/2060750227 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597804c3c0 con 0x7f59780b04c0 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.196+0000 7f596e7fc700 1 -- 172.21.15.61:0/2060750227 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5974023070 con 0x7f59780b04c0 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.197+0000 7f596e7fc700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f595c066f30 0x7f595c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.197+0000 7f596e7fc700 1 -- 172.21.15.61:0/2060750227 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5974085a20 con 0x7f59780b04c0 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.197+0000 7f597d88b700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f595c066f30 0x7f595c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.197+0000 7f597d88b700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f595c066f30 0x7f595c0693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f597815d280 tx=0x7f5968007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:12.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.201+0000 7f596e7fc700 1 -- 172.21.15.61:0/2060750227 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5974052f90 con 0x7f59780b04c0 2023-12-24T20:07:12.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.476+0000 7f59802f0700 1 -- 172.21.15.61:0/2060750227 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f597806a8a0 con 0x7f59780b04c0 2023-12-24T20:07:12.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.695+0000 7f596e7fc700 1 -- 172.21.15.61:0/2060750227 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v477) v1 ==== 131+0+0 (secure 0 0 0) 0x7f59740565b0 con 0x7f59780b04c0 2023-12-24T20:07:12.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 -- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f595c066f30 msgr2=0x7f595c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f595c066f30 0x7f595c0693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f597815d280 tx=0x7f5968007bd0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 -- 172.21.15.61:0/2060750227 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59780b04c0 msgr2=0x7f59780c2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59780b04c0 0x7f59780c2620 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f59740091e0 tx=0x7f5974017000 comp rx=0 tx=0).stop 2023-12-24T20:07:12.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 -- 172.21.15.61:0/2060750227 shutdown_connections 2023-12-24T20:07:12.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5978159e60 0x7f5978157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f595c066f30 0x7f595c0693e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59780b04c0 0x7f59780c2620 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 --2- 172.21.15.61:0/2060750227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5978159a90 0x7f5978169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 -- 172.21.15.61:0/2060750227 >> 172.21.15.61:0/2060750227 conn(0x7f59780cd6f0 msgr2=0x7f5978158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:12.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 -- 172.21.15.61:0/2060750227 shutdown_connections 2023-12-24T20:07:12.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.697+0000 7f59802f0700 1 -- 172.21.15.61:0/2060750227 wait complete. 2023-12-24T20:07:12.710 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-12-24T20:07:12.710 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-12-24T20:07:12.711 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-12-24T20:07:12.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.833+0000 7f1eb48cd700 1 Processor -- start 2023-12-24T20:07:12.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.833+0000 7f1eb48cd700 1 -- start start 2023-12-24T20:07:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1eb48cd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1eb00b08f0 0x7f1eb00b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1eb48cd700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb00b2eb0 con 0x7f1eb00b2660 2023-12-24T20:07:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1eb48cd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb00b2bd0 con 0x7f1eb015bb60 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1eb48cd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb00afc20 con 0x7f1eb00b08f0 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1eadd9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1eb00b2660 0x7f1eb015bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:47742/0 (socket says 172.21.15.61:47742) 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1eadd9b700 1 -- 172.21.15.61:0/1537864728 learned_addr learned my addr 172.21.15.61:0/1537864728 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1eaed9d700 1 --2- 172.21.15.61:0/1537864728 >> v2:172.21.15.133:3300/0 conn(0x7f1eb00b08f0 0x7f1eb00b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733439030 0 0) 0x7f1eb00b2eb0 con 0x7f1eb00b2660 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e98003570 con 0x7f1eb00b2660 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044543842 0 0) 0x7f1eb00b2bd0 con 0x7f1eb015bb60 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb00b2eb0 con 0x7f1eb015bb60 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2151682830 0 0) 0x7f1e98003570 con 0x7f1eb00b2660 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 >> v2:172.21.15.133:3300/0 conn(0x7f1eb00b08f0 msgr2=0x7f1eb00b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 --2- 172.21.15.61:0/1537864728 >> v2:172.21.15.133:3300/0 conn(0x7f1eb00b08f0 0x7f1eb00b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 >> v1:172.21.15.133:6789/0 conn(0x7f1eb015bb60 legacy=0x7f1eb0098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb00afe10 con 0x7f1eb00b2660 2023-12-24T20:07:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f1ea40013f0 con 0x7f1eb00b2660 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.834+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 >> v1:172.21.15.61:6789/0 conn(0x7f1eb00b2660 legacy=0x7f1eb015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1ead59a700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e98003c40 0x7f1e98004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1ead59a700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e98004810 0x7f1e98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1ead59a700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e98005210 0x7f1e9800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9800c130 con 0x7f1e98004810 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9800c270 con 0x7f1e98003c40 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9800c400 con 0x7f1e98005210 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1eadd9b700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e98004810 0x7f1e98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1eae59c700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e98003c40 0x7f1e98004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1eaed9d700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e98005210 0x7f1e9800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1eadd9b700 1 -- 172.21.15.61:0/1537864728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e98005210 msgr2=0x7f1e9800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1eadd9b700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1e98005210 0x7f1e9800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1eadd9b700 1 -- 172.21.15.61:0/1537864728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e98003c40 msgr2=0x7f1e98004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1eadd9b700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e98003c40 0x7f1e98004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1eadd9b700 1 -- 172.21.15.61:0/1537864728 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e98003570 con 0x7f1e98004810 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1eaed9d700 1 -- 172.21.15.61:0/1537864728 reap_dead start 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1eadd9b700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e98004810 0x7f1e98004c80 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c190 tx=0x7f1ea4001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97e75f7d4eecd26 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400ca40 con 0x7f1e98004810 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea400cbe0 con 0x7f1e98004810 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.835+0000 7f1ead59a700 1 -- 172.21.15.61:0/1537864728 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4005920 con 0x7f1e98004810 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.836+0000 7f1eb48cd700 1 -- 172.21.15.61:0/1537864728 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e98004810 msgr2=0x7f1e98004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.836+0000 7f1eb48cd700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e98004810 0x7f1e98004c80 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c190 tx=0x7f1ea4001cc0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.836+0000 7f1eb48cd700 1 -- 172.21.15.61:0/1537864728 shutdown_connections 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.836+0000 7f1eb48cd700 1 --2- 172.21.15.61:0/1537864728 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e98004810 0x7f1e98004c80 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.836+0000 7f1eb48cd700 1 -- 172.21.15.61:0/1537864728 >> 172.21.15.61:0/1537864728 conn(0x7f1eb0097a10 msgr2=0x7f1eb00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.836+0000 7f1eb48cd700 1 -- 172.21.15.61:0/1537864728 shutdown_connections 2023-12-24T20:07:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.836+0000 7f1eb48cd700 1 -- 172.21.15.61:0/1537864728 wait complete. 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.837+0000 7f1eb48cd700 1 Processor -- start 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.838+0000 7f1eb48cd700 1 -- start start 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.838+0000 7f1eb48cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e98004810 0x7f1eb0155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.838+0000 7f1eb48cd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb00abf40 0x7f1eb00ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.838+0000 7f1eb48cd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb016b680 0x7f1eb016bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.838+0000 7f1eb48cd700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb016c060 con 0x7f1eb00abf40 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.838+0000 7f1eb48cd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb00ad5a0 con 0x7f1e98004810 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.838+0000 7f1eb48cd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb00ac990 con 0x7f1eb016b680 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eadd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb00abf40 0x7f1eb00ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eadd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb00abf40 0x7f1eb00ac3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41116/0 (socket says 172.21.15.61:41116) 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eadd9b700 1 -- 172.21.15.61:0/2203320741 learned_addr learned my addr 172.21.15.61:0/2203320741 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:12.843 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eaed9d700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb016b680 0x7f1eb016bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eadd9b700 1 -- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb016b680 msgr2=0x7f1eb016bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eae59c700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e98004810 0x7f1eb0155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eadd9b700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb016b680 0x7f1eb016bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eadd9b700 1 -- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e98004810 msgr2=0x7f1eb0155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eadd9b700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e98004810 0x7f1eb0155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eadd9b700 1 -- 172.21.15.61:0/2203320741 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb00acc70 con 0x7f1eb00abf40 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eadd9b700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb00abf40 0x7f1eb00ac3b0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4008fd0 tx=0x7f1ea4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1e9e7fc700 1 -- 172.21.15.61:0/2203320741 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40072e0 con 0x7f1eb00abf40 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1e9e7fc700 1 -- 172.21.15.61:0/2203320741 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea4007480 con 0x7f1eb00abf40 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1e9e7fc700 1 -- 172.21.15.61:0/2203320741 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4007840 con 0x7f1eb00abf40 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eb48cd700 1 -- 172.21.15.61:0/2203320741 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb00acf50 con 0x7f1eb00abf40 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.839+0000 7f1eb48cd700 1 -- 172.21.15.61:0/2203320741 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb00a9d80 con 0x7f1eb00abf40 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.840+0000 7f1eb48cd700 1 -- 172.21.15.61:0/2203320741 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb00a9fa0 con 0x7f1eb00abf40 2023-12-24T20:07:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.841+0000 7f1e9e7fc700 1 -- 172.21.15.61:0/2203320741 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1ea401d630 con 0x7f1eb00abf40 2023-12-24T20:07:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.841+0000 7f1e9e7fc700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e90066f30 0x7f1e900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.841+0000 7f1e9e7fc700 1 -- 172.21.15.61:0/2203320741 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1ea40856d0 con 0x7f1eb00abf40 2023-12-24T20:07:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.841+0000 7f1eae59c700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e90066f30 0x7f1e900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.842+0000 7f1eae59c700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e90066f30 0x7f1e900693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0000c00 tx=0x7f1ea0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:12.845+0000 7f1e9e7fc700 1 -- 172.21.15.61:0/2203320741 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1eb00a9fa0 con 0x7f1eb00abf40 2023-12-24T20:07:13.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.121+0000 7f1eb48cd700 1 -- 172.21.15.61:0/2203320741 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f1eb00a9fa0 con 0x7f1eb00abf40 2023-12-24T20:07:13.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.696+0000 7f1e9e7fc700 1 -- 172.21.15.61:0/2203320741 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v478) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1eb00a9fa0 con 0x7f1eb00abf40 2023-12-24T20:07:13.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 -- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e90066f30 msgr2=0x7f1e900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:13.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e90066f30 0x7f1e900693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0000c00 tx=0x7f1ea0009040 comp rx=0 tx=0).stop 2023-12-24T20:07:13.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 -- 172.21.15.61:0/2203320741 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb00abf40 msgr2=0x7f1eb00ac3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:13.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb00abf40 0x7f1eb00ac3b0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4008fd0 tx=0x7f1ea4015000 comp rx=0 tx=0).stop 2023-12-24T20:07:13.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 -- 172.21.15.61:0/2203320741 shutdown_connections 2023-12-24T20:07:13.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1eb016b680 0x7f1eb016bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:13.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1e90066f30 0x7f1e900693e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:13.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e98004810 0x7f1eb0155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:13.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 --2- 172.21.15.61:0/2203320741 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1eb00abf40 0x7f1eb00ac3b0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:13.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 -- 172.21.15.61:0/2203320741 >> 172.21.15.61:0/2203320741 conn(0x7f1eb0097a10 msgr2=0x7f1eb006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:13.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 -- 172.21.15.61:0/2203320741 shutdown_connections 2023-12-24T20:07:13.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.699+0000 7f1eb48cd700 1 -- 172.21.15.61:0/2203320741 wait complete. 2023-12-24T20:07:13.714 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-24T20:07:13.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.843+0000 7f667ca4b700 1 Processor -- start 2023-12-24T20:07:13.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.844+0000 7f667ca4b700 1 -- start start 2023-12-24T20:07:13.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.844+0000 7f667ca4b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f667806af80 0x7f66780c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:13.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.844+0000 7f667ca4b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66780c3460 0x7f66780c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:13.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.844+0000 7f667ca4b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667806aaf0 con 0x7f6678156b60 2023-12-24T20:07:13.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.844+0000 7f667ca4b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667806b3f0 con 0x7f66780c3460 2023-12-24T20:07:13.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.844+0000 7f667ca4b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66780c38e0 con 0x7f667806af80 2023-12-24T20:07:13.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f6675d9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f667806af80 0x7f66780c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f667659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6678156b60 0x7f6678067f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:58942/0 (socket says 172.21.15.61:58942) 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f667659c700 1 -- 172.21.15.61:0/157750950 learned_addr learned my addr 172.21.15.61:0/157750950 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f6676d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66780c3460 0x7f66780c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f667559a700 1 -- 172.21.15.61:0/157750950 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167435546 0 0) 0x7f667806aaf0 con 0x7f6678156b60 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f667559a700 1 -- 172.21.15.61:0/157750950 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6660003570 con 0x7f6678156b60 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f6676d9d700 1 -- 172.21.15.61:0/157750950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f667806af80 msgr2=0x7f66780c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f6676d9d700 1 --2- 172.21.15.61:0/157750950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f667806af80 0x7f66780c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f6676d9d700 1 -- 172.21.15.61:0/157750950 >> v1:172.21.15.133:6789/0 conn(0x7f6678156b60 legacy=0x7f6678067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f6676d9d700 1 -- 172.21.15.61:0/157750950 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678069c00 con 0x7f66780c3460 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.845+0000 7f6675d9b700 1 --2- 172.21.15.61:0/157750950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f667806af80 0x7f66780c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f6676d9d700 1 --2- 172.21.15.61:0/157750950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66780c3460 0x7f66780c8690 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6670009e60 tx=0x7f6670009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbd92c840e91cbbe server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667559a700 1 -- 172.21.15.61:0/157750950 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667000e070 con 0x7f66780c3460 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667559a700 1 -- 172.21.15.61:0/157750950 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667000bab0 con 0x7f66780c3460 2023-12-24T20:07:13.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667559a700 1 -- 172.21.15.61:0/157750950 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667000be70 con 0x7f66780c3460 2023-12-24T20:07:13.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667ca4b700 1 -- 172.21.15.61:0/157750950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66780c3460 msgr2=0x7f66780c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:13.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667ca4b700 1 --2- 172.21.15.61:0/157750950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66780c3460 0x7f66780c8690 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6670009e60 tx=0x7f6670009780 comp rx=0 tx=0).stop 2023-12-24T20:07:13.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667ca4b700 1 -- 172.21.15.61:0/157750950 shutdown_connections 2023-12-24T20:07:13.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667ca4b700 1 --2- 172.21.15.61:0/157750950 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66780c3460 0x7f66780c8690 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:13.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667ca4b700 1 --2- 172.21.15.61:0/157750950 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f667806af80 0x7f66780c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:13.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667ca4b700 1 -- 172.21.15.61:0/157750950 >> 172.21.15.61:0/157750950 conn(0x7f66780ce420 msgr2=0x7f66780ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:13.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667ca4b700 1 -- 172.21.15.61:0/157750950 shutdown_connections 2023-12-24T20:07:13.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.846+0000 7f667ca4b700 1 -- 172.21.15.61:0/157750950 wait complete. 2023-12-24T20:07:13.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.847+0000 7f667ca4b700 1 Processor -- start 2023-12-24T20:07:13.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.847+0000 7f667ca4b700 1 -- start start 2023-12-24T20:07:13.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.848+0000 7f667ca4b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f667806af80 0x7f66781413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:13.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.848+0000 7f667ca4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66780c3460 0x7f66780c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:13.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.848+0000 7f667ca4b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6678156b60 0x7f6678154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:13.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.848+0000 7f667ca4b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66780c5ff0 con 0x7f667806af80 2023-12-24T20:07:13.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.848+0000 7f667ca4b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66781418f0 con 0x7f66780c3460 2023-12-24T20:07:13.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.848+0000 7f667ca4b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66780c53e0 con 0x7f6678156b60 2023-12-24T20:07:13.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.848+0000 7f667659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f667806af80 0x7f66781413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:13.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.848+0000 7f667659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f667806af80 0x7f66781413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41122/0 (socket says 172.21.15.61:41122) 2023-12-24T20:07:13.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.848+0000 7f667659c700 1 -- 172.21.15.61:0/3534150904 learned_addr learned my addr 172.21.15.61:0/3534150904 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:13.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f6675d9b700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66780c3460 0x7f66780c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:13.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f6676d9d700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6678156b60 0x7f6678154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f667659c700 1 -- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6678156b60 msgr2=0x7f6678154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f667659c700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6678156b60 0x7f6678154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f667659c700 1 -- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66780c3460 msgr2=0x7f66780c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f667659c700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66780c3460 0x7f66780c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f667659c700 1 -- 172.21.15.61:0/3534150904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009420 con 0x7f667806af80 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f667659c700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f667806af80 0x7f66781413b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f666800c7f0 tx=0x7f6668007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f66667fc700 1 -- 172.21.15.61:0/3534150904 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668005b30 con 0x7f667806af80 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f66667fc700 1 -- 172.21.15.61:0/3534150904 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668005c90 con 0x7f667806af80 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f667ca4b700 1 -- 172.21.15.61:0/3534150904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6670009a20 con 0x7f667806af80 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f66667fc700 1 -- 172.21.15.61:0/3534150904 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668007340 con 0x7f667806af80 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.849+0000 7f667ca4b700 1 -- 172.21.15.61:0/3534150904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66780c59a0 con 0x7f667806af80 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.850+0000 7f667ca4b700 1 -- 172.21.15.61:0/3534150904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667804c3c0 con 0x7f667806af80 2023-12-24T20:07:13.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.850+0000 7f66667fc700 1 -- 172.21.15.61:0/3534150904 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f666801b400 con 0x7f667806af80 2023-12-24T20:07:13.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.851+0000 7f66667fc700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6658066f30 0x7f66580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:13.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.851+0000 7f66667fc700 1 -- 172.21.15.61:0/3534150904 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6668083d30 con 0x7f667806af80 2023-12-24T20:07:13.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.851+0000 7f6675d9b700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6658066f30 0x7f66580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:13.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.851+0000 7f6675d9b700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6658066f30 0x7f66580693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f666c0093f0 tx=0x7f666c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:13.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:13.855+0000 7f66667fc700 1 -- 172.21.15.61:0/3534150904 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66680513d0 con 0x7f667806af80 2023-12-24T20:07:14.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.052+0000 7f667ca4b700 1 -- 172.21.15.61:0/3534150904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f66780c3b90 con 0x7f667806af80 2023-12-24T20:07:14.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.055+0000 7f66667fc700 1 -- 172.21.15.61:0/3534150904 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f66680076f0 con 0x7f667806af80 2023-12-24T20:07:14.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.057+0000 7f667ca4b700 1 -- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6658066f30 msgr2=0x7f66580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.057+0000 7f667ca4b700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6658066f30 0x7f66580693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f666c0093f0 tx=0x7f666c008040 comp rx=0 tx=0).stop 2023-12-24T20:07:14.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.057+0000 7f667ca4b700 1 -- 172.21.15.61:0/3534150904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f667806af80 msgr2=0x7f66781413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.057+0000 7f667ca4b700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f667806af80 0x7f66781413b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f666800c7f0 tx=0x7f6668007e00 comp rx=0 tx=0).stop 2023-12-24T20:07:14.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.057+0000 7f667ca4b700 1 -- 172.21.15.61:0/3534150904 shutdown_connections 2023-12-24T20:07:14.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.057+0000 7f667ca4b700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6678156b60 0x7f6678154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.057+0000 7f667ca4b700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f6658066f30 0x7f66580693e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.057+0000 7f667ca4b700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f667806af80 0x7f66781413b0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.057+0000 7f667ca4b700 1 --2- 172.21.15.61:0/3534150904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66780c3460 0x7f66780c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.057+0000 7f667ca4b700 1 -- 172.21.15.61:0/3534150904 >> 172.21.15.61:0/3534150904 conn(0x7f66780ce420 msgr2=0x7f667806e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:14.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.058+0000 7f667ca4b700 1 -- 172.21.15.61:0/3534150904 shutdown_connections 2023-12-24T20:07:14.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.058+0000 7f667ca4b700 1 -- 172.21.15.61:0/3534150904 wait complete. 2023-12-24T20:07:14.070 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:07:14.070 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:07:14.124 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:07:14.180 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:07:14.180 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-24T20:07:14.180 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:07:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.302+0000 7fdd9de50700 1 Processor -- start 2023-12-24T20:07:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.302+0000 7fdd9de50700 1 -- start start 2023-12-24T20:07:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.303+0000 7fdd9de50700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 0x7fdd98067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.303+0000 7fdd9de50700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd98070640 0x7fdd98070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.303+0000 7fdd9de50700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd980a84d0 con 0x7fdd98159b00 2023-12-24T20:07:14.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.303+0000 7fdd9de50700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd98070fe0 con 0x7fdd98070640 2023-12-24T20:07:14.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.303+0000 7fdd9de50700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd980a7620 con 0x7fdd980afee0 2023-12-24T20:07:14.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.303+0000 7fdd97fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd98070640 0x7fdd98070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.303+0000 7fdd96ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 0x7fdd98067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.303+0000 7fdd977fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdd98159b00 0x7fdd980af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:58954/0 (socket says 172.21.15.61:58954) 2023-12-24T20:07:14.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.303+0000 7fdd977fe700 1 -- 172.21.15.61:0/3230682974 learned_addr learned my addr 172.21.15.61:0/3230682974 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.304+0000 7fdd97fff700 1 -- 172.21.15.61:0/3230682974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 msgr2=0x7fdd98067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.304+0000 7fdd97fff700 1 --2- 172.21.15.61:0/3230682974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 0x7fdd98067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.304+0000 7fdd97fff700 1 -- 172.21.15.61:0/3230682974 >> v1:172.21.15.133:6789/0 conn(0x7fdd98159b00 legacy=0x7fdd980af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.304+0000 7fdd97fff700 1 -- 172.21.15.61:0/3230682974 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd980a78c0 con 0x7fdd98070640 2023-12-24T20:07:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.304+0000 7fdd967fc700 1 -- 172.21.15.61:0/3230682974 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644731900 0 0) 0x7fdd980a84d0 con 0x7fdd98159b00 2023-12-24T20:07:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.304+0000 7fdd96ffd700 1 --2- 172.21.15.61:0/3230682974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 0x7fdd98067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:07:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.304+0000 7fdd97fff700 1 --2- 172.21.15.61:0/3230682974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd98070640 0x7fdd98070aa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009e60 tx=0x7fdd90009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb4f436994a423e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.304+0000 7fdd967fc700 1 -- 172.21.15.61:0/3230682974 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9000e070 con 0x7fdd98070640 2023-12-24T20:07:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.304+0000 7fdd967fc700 1 -- 172.21.15.61:0/3230682974 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9000bb60 con 0x7fdd98070640 2023-12-24T20:07:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.304+0000 7fdd967fc700 1 -- 172.21.15.61:0/3230682974 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90012430 con 0x7fdd98070640 2023-12-24T20:07:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.305+0000 7fdd9de50700 1 -- 172.21.15.61:0/3230682974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd98070640 msgr2=0x7fdd98070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.305+0000 7fdd9de50700 1 --2- 172.21.15.61:0/3230682974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd98070640 0x7fdd98070aa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009e60 tx=0x7fdd90009780 comp rx=0 tx=0).stop 2023-12-24T20:07:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.305+0000 7fdd9de50700 1 -- 172.21.15.61:0/3230682974 shutdown_connections 2023-12-24T20:07:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.305+0000 7fdd9de50700 1 --2- 172.21.15.61:0/3230682974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd98070640 0x7fdd98070aa0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.305+0000 7fdd9de50700 1 --2- 172.21.15.61:0/3230682974 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 0x7fdd98067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.305+0000 7fdd9de50700 1 -- 172.21.15.61:0/3230682974 >> 172.21.15.61:0/3230682974 conn(0x7fdd980ca200 msgr2=0x7fdd980ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.305+0000 7fdd9de50700 1 -- 172.21.15.61:0/3230682974 shutdown_connections 2023-12-24T20:07:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.305+0000 7fdd9de50700 1 -- 172.21.15.61:0/3230682974 wait complete. 2023-12-24T20:07:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.306+0000 7fdd9de50700 1 Processor -- start 2023-12-24T20:07:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.306+0000 7fdd9de50700 1 -- start start 2023-12-24T20:07:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd9de50700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd98070640 0x7fdd9815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd9de50700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 0x7fdd9815e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd9de50700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdd98159b00 0x7fdd980ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd9de50700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9815e730 con 0x7fdd98159b00 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd9de50700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9815f390 con 0x7fdd98070640 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd9de50700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd98158d20 con 0x7fdd980afee0 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd97fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdd98159b00 0x7fdd980ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd97fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdd98159b00 0x7fdd980ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41136/0 (socket says 172.21.15.61:41136) 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd97fff700 1 -- 172.21.15.61:0/4081944745 learned_addr learned my addr 172.21.15.61:0/4081944745 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd96ffd700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 0x7fdd9815e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd977fe700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd98070640 0x7fdd9815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd97fff700 1 -- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 msgr2=0x7fdd9815e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd97fff700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 0x7fdd9815e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd97fff700 1 -- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd98070640 msgr2=0x7fdd9815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd97fff700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd98070640 0x7fdd9815d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.307+0000 7fdd97fff700 1 -- 172.21.15.61:0/4081944745 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80009420 con 0x7fdd98159b00 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.308+0000 7fdd97fff700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdd98159b00 0x7fdd980ae070 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fdd9806c750 tx=0x7fdd90019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.308+0000 7fdd8f7fe700 1 -- 172.21.15.61:0/4081944745 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90012ea0 con 0x7fdd98159b00 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.308+0000 7fdd8f7fe700 1 -- 172.21.15.61:0/4081944745 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd90027470 con 0x7fdd98159b00 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.308+0000 7fdd9de50700 1 -- 172.21.15.61:0/4081944745 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd90009a20 con 0x7fdd98159b00 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.308+0000 7fdd8f7fe700 1 -- 172.21.15.61:0/4081944745 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90027830 con 0x7fdd98159b00 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.308+0000 7fdd9de50700 1 -- 172.21.15.61:0/4081944745 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd981592e0 con 0x7fdd98159b00 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.309+0000 7fdd9de50700 1 -- 172.21.15.61:0/4081944745 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd98158b80 con 0x7fdd98159b00 2023-12-24T20:07:14.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.309+0000 7fdd8f7fe700 1 -- 172.21.15.61:0/4081944745 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdd90024070 con 0x7fdd98159b00 2023-12-24T20:07:14.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.310+0000 7fdd8f7fe700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd78066f30 0x7fdd780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.310+0000 7fdd8f7fe700 1 -- 172.21.15.61:0/4081944745 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdd90086a20 con 0x7fdd98159b00 2023-12-24T20:07:14.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.310+0000 7fdd977fe700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd78066f30 0x7fdd780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.311+0000 7fdd977fe700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd78066f30 0x7fdd780693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdd88007160 tx=0x7fdd88007f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:14.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.314+0000 7fdd8f7fe700 1 -- 172.21.15.61:0/4081944745 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd98158b80 con 0x7fdd98159b00 2023-12-24T20:07:14.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.554+0000 7fdd9de50700 1 -- 172.21.15.61:0/4081944745 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd98158b80 con 0x7fdd98159b00 2023-12-24T20:07:14.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.554+0000 7fdd8f7fe700 1 -- 172.21.15.61:0/4081944745 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fdd98158b80 con 0x7fdd98159b00 2023-12-24T20:07:14.557 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:14.557 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":86,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/534815426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":534815426},{"type":"v1","addr":"172.21.15.133:6836","nonce":534815426}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6350,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1994792297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1994792297},{"type":"v1","addr":"172.21.15.133:6837","nonce":1994792297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":7818,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/3942988503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":3942988503},{"type":"v1","addr":"172.21.15.61:6834","nonce":3942988503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":8076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/897033055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":897033055},{"type":"v1","addr":"172.21.15.61:6835","nonce":897033055}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[]} 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 -- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd78066f30 msgr2=0x7fdd780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd78066f30 0x7fdd780693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdd88007160 tx=0x7fdd88007f50 comp rx=0 tx=0).stop 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 -- 172.21.15.61:0/4081944745 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdd98159b00 msgr2=0x7fdd980ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdd98159b00 0x7fdd980ae070 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fdd9806c750 tx=0x7fdd90019000 comp rx=0 tx=0).stop 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 -- 172.21.15.61:0/4081944745 shutdown_connections 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdd78066f30 0x7fdd780693e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdd98159b00 0x7fdd980ae070 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd98070640 0x7fdd9815d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 --2- 172.21.15.61:0/4081944745 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdd980afee0 0x7fdd9815e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 -- 172.21.15.61:0/4081944745 >> 172.21.15.61:0/4081944745 conn(0x7fdd980ca200 msgr2=0x7fdd98156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:14.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 -- 172.21.15.61:0/4081944745 shutdown_connections 2023-12-24T20:07:14.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.556+0000 7fdd9de50700 1 -- 172.21.15.61:0/4081944745 wait complete. 2023-12-24T20:07:14.559 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 86 2023-12-24T20:07:14.569 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-24T20:07:14.569 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-24T20:07:14.570 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:07:14.570 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:07:14.570 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-24T20:07:14.570 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-24T20:07:14.570 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:07:14.570 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:07:14.570 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-24T20:07:14.571 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-24T20:07:14.571 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:07:14.571 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:07:14.571 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-24T20:07:14.571 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-24T20:07:14.571 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:07:14.571 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:07:14.580 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:07:14.580 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-24T20:07:14.581 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:07:14.581 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-24T20:07:14.582 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:07:14.582 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-24T20:07:14.583 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:07:14.583 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-24T20:07:14.622 INFO:tasks.ceph.mds.a:Started 2023-12-24T20:07:14.623 DEBUG:teuthology.parallel:result is None 2023-12-24T20:07:14.624 INFO:tasks.ceph.mds.c:Started 2023-12-24T20:07:14.624 DEBUG:teuthology.parallel:result is None 2023-12-24T20:07:14.625 INFO:tasks.ceph.mds.d:Started 2023-12-24T20:07:14.625 DEBUG:teuthology.parallel:result is None 2023-12-24T20:07:14.625 INFO:tasks.ceph.mds.b:Started 2023-12-24T20:07:14.626 DEBUG:teuthology.parallel:result is None 2023-12-24T20:07:14.626 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-24T20:07:14.702 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-12-24T20:07:14.703 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-12-24T20:07:14.708 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T20:07:14.708 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-12-24T20:07:14.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.754+0000 7f2657144700 1 Processor -- start 2023-12-24T20:07:14.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.754+0000 7f2657144700 1 -- start start 2023-12-24T20:07:14.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f2657144700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f26501433e0 0x7f265015d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f2657144700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26500d0560 0x7f265015dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f2657144700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26500d0960 con 0x7f26501437b0 2023-12-24T20:07:14.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f2657144700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265015b550 con 0x7f26501433e0 2023-12-24T20:07:14.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f2657144700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26500d0bb0 con 0x7f26500d0560 2023-12-24T20:07:14.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f2654ee0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f26501433e0 0x7f265015d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f264ffff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f26501437b0 0x7f26500cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:47754/0 (socket says 172.21.15.61:47754) 2023-12-24T20:07:14.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f264ffff700 1 -- 172.21.15.61:0/3958186775 learned_addr learned my addr 172.21.15.61:0/3958186775 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:14.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f26556e1700 1 --2- 172.21.15.61:0/3958186775 >> v2:172.21.15.133:3300/0 conn(0x7f26500d0560 0x7f265015dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f2654ee0700 1 -- 172.21.15.61:0/3958186775 >> v2:172.21.15.133:3300/0 conn(0x7f26500d0560 msgr2=0x7f265015dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f2654ee0700 1 --2- 172.21.15.61:0/3958186775 >> v2:172.21.15.133:3300/0 conn(0x7f26500d0560 0x7f265015dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f2654ee0700 1 -- 172.21.15.61:0/3958186775 >> v1:172.21.15.61:6789/0 conn(0x7f26501437b0 legacy=0x7f26500cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f2654ee0700 1 -- 172.21.15.61:0/3958186775 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26500d0e90 con 0x7f26501433e0 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.755+0000 7f264f7fe700 1 -- 172.21.15.61:0/3958186775 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180962370 0 0) 0x7f26500d0960 con 0x7f26501437b0 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f2654ee0700 1 --2- 172.21.15.61:0/3958186775 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26501433e0 0x7f265015d850 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f265015b4c0 tx=0x7f26440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a990c3bf98064efa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f264f7fe700 1 -- 172.21.15.61:0/3958186775 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400b6b0 con 0x7f26501433e0 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f264f7fe700 1 -- 172.21.15.61:0/3958186775 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264400b810 con 0x7f26501433e0 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f264f7fe700 1 -- 172.21.15.61:0/3958186775 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400bbb0 con 0x7f26501433e0 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f2657144700 1 -- 172.21.15.61:0/3958186775 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26501433e0 msgr2=0x7f265015d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f2657144700 1 --2- 172.21.15.61:0/3958186775 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26501433e0 0x7f265015d850 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f265015b4c0 tx=0x7f26440091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f2657144700 1 -- 172.21.15.61:0/3958186775 shutdown_connections 2023-12-24T20:07:14.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f2657144700 1 --2- 172.21.15.61:0/3958186775 >> v2:172.21.15.133:3300/0 conn(0x7f26500d0560 0x7f265015dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f2657144700 1 --2- 172.21.15.61:0/3958186775 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26501433e0 0x7f265015d850 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f2657144700 1 -- 172.21.15.61:0/3958186775 >> 172.21.15.61:0/3958186775 conn(0x7f265006e640 msgr2=0x7f2650067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:14.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f2657144700 1 -- 172.21.15.61:0/3958186775 shutdown_connections 2023-12-24T20:07:14.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.756+0000 7f2657144700 1 -- 172.21.15.61:0/3958186775 wait complete. 2023-12-24T20:07:14.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.757+0000 7f2657144700 1 Processor -- start 2023-12-24T20:07:14.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.758+0000 7f2657144700 1 -- start start 2023-12-24T20:07:14.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.758+0000 7f2657144700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26500d0560 0x7f26500c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.758+0000 7f2657144700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26501433e0 0x7f265015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.758+0000 7f2657144700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26501437b0 0x7f265015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.758+0000 7f2657144700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265013bf70 con 0x7f26500d0560 2023-12-24T20:07:14.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.758+0000 7f2657144700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265013c250 con 0x7f26501437b0 2023-12-24T20:07:14.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.758+0000 7f2657144700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265013c530 con 0x7f26501433e0 2023-12-24T20:07:14.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.758+0000 7f2654ee0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26500d0560 0x7f26500c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.758+0000 7f2654ee0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26500d0560 0x7f26500c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41196/0 (socket says 172.21.15.61:41196) 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.758+0000 7f2654ee0700 1 -- 172.21.15.61:0/2930736705 learned_addr learned my addr 172.21.15.61:0/2930736705 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f26556e1700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26501437b0 0x7f265015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f264ffff700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26501433e0 0x7f265015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f2654ee0700 1 -- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26501433e0 msgr2=0x7f265015a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f2654ee0700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26501433e0 0x7f265015a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f2654ee0700 1 -- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26501437b0 msgr2=0x7f265015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f2654ee0700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26501437b0 0x7f265015a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f2654ee0700 1 -- 172.21.15.61:0/2930736705 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644009420 con 0x7f26500d0560 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f264ffff700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26501433e0 0x7f265015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f2654ee0700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26500d0560 0x7f26500c5a10 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f2650064b10 tx=0x7f2644017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f264cff9700 1 -- 172.21.15.61:0/2930736705 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400bb90 con 0x7f26500d0560 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f264cff9700 1 -- 172.21.15.61:0/2930736705 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2644011420 con 0x7f26500d0560 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f264cff9700 1 -- 172.21.15.61:0/2930736705 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440117c0 con 0x7f26500d0560 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f2657144700 1 -- 172.21.15.61:0/2930736705 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265013c810 con 0x7f26500d0560 2023-12-24T20:07:14.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.759+0000 7f2657144700 1 -- 172.21.15.61:0/2930736705 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26500c5f50 con 0x7f26500d0560 2023-12-24T20:07:14.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.760+0000 7f2657144700 1 -- 172.21.15.61:0/2930736705 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2650089190 con 0x7f26500d0560 2023-12-24T20:07:14.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.760+0000 7f264cff9700 1 -- 172.21.15.61:0/2930736705 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2644011bf0 con 0x7f26500d0560 2023-12-24T20:07:14.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.761+0000 7f264cff9700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:14.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.761+0000 7f264cff9700 1 -- 172.21.15.61:0/2930736705 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2644085b80 con 0x7f26500d0560 2023-12-24T20:07:14.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.761+0000 7f264ffff700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:14.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.761+0000 7f264ffff700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2634066f30 0x7f26340693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f26500af870 tx=0x7f263c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:14.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.765+0000 7f264cff9700 1 -- 172.21.15.61:0/2930736705 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26440530f0 con 0x7f26500d0560 2023-12-24T20:07:14.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:14.975+0000 7f2657144700 1 -- 172.21.15.61:0/2930736705 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f265013cd30 con 0x7f26500d0560 2023-12-24T20:07:16.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.073+0000 7f264cff9700 1 -- 172.21.15.61:0/2930736705 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v181) v1 ==== 97+0+0 (secure 0 0 0) 0x7f265013cd30 con 0x7f26500d0560 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 -- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2634066f30 msgr2=0x7f26340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2634066f30 0x7f26340693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f26500af870 tx=0x7f263c009040 comp rx=0 tx=0).stop 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 -- 172.21.15.61:0/2930736705 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26500d0560 msgr2=0x7f26500c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26500d0560 0x7f26500c5a10 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f2650064b10 tx=0x7f2644017000 comp rx=0 tx=0).stop 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 -- 172.21.15.61:0/2930736705 shutdown_connections 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2634066f30 0x7f26340693e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26501437b0 0x7f265015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26500d0560 0x7f26500c5a10 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 --2- 172.21.15.61:0/2930736705 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f26501433e0 0x7f265015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 -- 172.21.15.61:0/2930736705 >> 172.21.15.61:0/2930736705 conn(0x7f265006e640 msgr2=0x7f26500b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:16.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.076+0000 7f2657144700 1 -- 172.21.15.61:0/2930736705 shutdown_connections 2023-12-24T20:07:16.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.077+0000 7f2657144700 1 -- 172.21.15.61:0/2930736705 wait complete. 2023-12-24T20:07:16.078 INFO:teuthology.orchestra.run.smithi061.stderr: removed all blocklist entries 2023-12-24T20:07:16.092 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-24T20:07:16.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.221+0000 7f00cd274700 1 Processor -- start 2023-12-24T20:07:16.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.221+0000 7f00cd274700 1 -- start start 2023-12-24T20:07:16.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.221+0000 7f00cd274700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c8070d50 0x7f00c815c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.221+0000 7f00cd274700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c815bcd0 con 0x7f00c806b260 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.221+0000 7f00cd274700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c80cafb0 con 0x7f00c806b630 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.221+0000 7f00cd274700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80683a0 con 0x7f00c8070d50 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c6ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f00c806b260 0x7f00c8067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:47766/0 (socket says 172.21.15.61:47766) 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c6ffd700 1 -- 172.21.15.61:0/3704178463 learned_addr learned my addr 172.21.15.61:0/3704178463 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c77fe700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c8070d50 0x7f00c815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067939415 0 0) 0x7f00c815bcd0 con 0x7f00c806b260 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b4003570 con 0x7f00c806b260 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650635216 0 0) 0x7f00c80cafb0 con 0x7f00c806b630 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c815bcd0 con 0x7f00c806b630 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476934920 0 0) 0x7f00b4003570 con 0x7f00c806b260 2023-12-24T20:07:16.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c8070d50 msgr2=0x7f00c815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:16.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c8070d50 0x7f00c815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 >> v1:172.21.15.133:6789/0 conn(0x7f00c806b630 legacy=0x7f00c8070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80680c0 con 0x7f00c806b260 2023-12-24T20:07:16.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f00b8001470 con 0x7f00c806b260 2023-12-24T20:07:16.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 >> v1:172.21.15.61:6789/0 conn(0x7f00c806b260 legacy=0x7f00c8067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c8070d50 0x7f00b4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00b40041d0 0x7f00b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00b4004d50 0x7f00b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80683a0 con 0x7f00b40041d0 2023-12-24T20:07:16.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b400bbf0 con 0x7f00b4004d50 2023-12-24T20:07:16.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b400bdb0 con 0x7f00c8070d50 2023-12-24T20:07:16.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c67fc700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00b40041d0 0x7f00b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c6ffd700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c8070d50 0x7f00b4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.222+0000 7f00c77fe700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00b4004d50 0x7f00b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00c67fc700 1 -- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c8070d50 msgr2=0x7f00b4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:16.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00c67fc700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c8070d50 0x7f00b4003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00c67fc700 1 -- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00b4004d50 msgr2=0x7f00b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:16.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00c67fc700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00b4004d50 0x7f00b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00c67fc700 1 -- 172.21.15.61:0/3704178463 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4003570 con 0x7f00b40041d0 2023-12-24T20:07:16.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00c67fc700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00b40041d0 0x7f00b4004810 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f00b0001a10 tx=0x7f00b0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2c7f003ddcc7e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:16.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b000c5d0 con 0x7f00b40041d0 2023-12-24T20:07:16.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b000c730 con 0x7f00b40041d0 2023-12-24T20:07:16.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00c5ffb700 1 -- 172.21.15.61:0/3704178463 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b000cad0 con 0x7f00b40041d0 2023-12-24T20:07:16.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00cd274700 1 -- 172.21.15.61:0/3704178463 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00b40041d0 msgr2=0x7f00b4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00cd274700 1 --2- 172.21.15.61:0/3704178463 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00b40041d0 0x7f00b4004810 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f00b0001a10 tx=0x7f00b0007d30 comp rx=0 tx=0).stop 2023-12-24T20:07:16.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00c77fe700 1 -- 172.21.15.61:0/3704178463 reap_dead start 2023-12-24T20:07:16.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00cd274700 1 -- 172.21.15.61:0/3704178463 shutdown_connections 2023-12-24T20:07:16.232 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.223+0000 7f00cd274700 1 -- 172.21.15.61:0/3704178463 >> 172.21.15.61:0/3704178463 conn(0x7f00c80ca200 msgr2=0x7f00c80ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:16.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.224+0000 7f00cd274700 1 -- 172.21.15.61:0/3704178463 shutdown_connections 2023-12-24T20:07:16.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.224+0000 7f00cd274700 1 -- 172.21.15.61:0/3704178463 wait complete. 2023-12-24T20:07:16.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.225+0000 7f00cd274700 1 Processor -- start 2023-12-24T20:07:16.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.225+0000 7f00cd274700 1 -- start start 2023-12-24T20:07:16.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.225+0000 7f00cd274700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00b40041d0 0x7f00c80a7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.225+0000 7f00cd274700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c80c7350 0x7f00c80c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00cd274700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00c80cb8e0 0x7f00c814cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00cd274700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80c9630 con 0x7f00c80cb8e0 2023-12-24T20:07:16.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00cd274700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80a78d0 con 0x7f00b40041d0 2023-12-24T20:07:16.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00cd274700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80a6610 con 0x7f00c80c7350 2023-12-24T20:07:16.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00c80cb8e0 0x7f00c814cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00c80cb8e0 0x7f00c814cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41208/0 (socket says 172.21.15.61:41208) 2023-12-24T20:07:16.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c77fe700 1 -- 172.21.15.61:0/4253298982 learned_addr learned my addr 172.21.15.61:0/4253298982 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:16.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c6ffd700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00b40041d0 0x7f00c80a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c67fc700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c80c7350 0x7f00c80c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c77fe700 1 -- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c80c7350 msgr2=0x7f00c80c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c77fe700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c80c7350 0x7f00c80c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c77fe700 1 -- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00b40041d0 msgr2=0x7f00c80a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c77fe700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00b40041d0 0x7f00c80a7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c77fe700 1 -- 172.21.15.61:0/4253298982 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80a68b0 con 0x7f00c80cb8e0 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c6ffd700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00b40041d0 0x7f00c80a7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c67fc700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c80c7350 0x7f00c80c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00c77fe700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00c80cb8e0 0x7f00c814cca0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f00c8071150 tx=0x7f00c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00beffd700 1 -- 172.21.15.61:0/4253298982 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c000e040 con 0x7f00c80cb8e0 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00beffd700 1 -- 172.21.15.61:0/4253298982 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c000f040 con 0x7f00c80cb8e0 2023-12-24T20:07:16.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00cd274700 1 -- 172.21.15.61:0/4253298982 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c80a6b90 con 0x7f00c80cb8e0 2023-12-24T20:07:16.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00beffd700 1 -- 172.21.15.61:0/4253298982 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c000fe20 con 0x7f00c80cb8e0 2023-12-24T20:07:16.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.226+0000 7f00cd274700 1 -- 172.21.15.61:0/4253298982 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c80c9220 con 0x7f00c80cb8e0 2023-12-24T20:07:16.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.227+0000 7f00cd274700 1 -- 172.21.15.61:0/4253298982 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c804c3c0 con 0x7f00c80cb8e0 2023-12-24T20:07:16.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.228+0000 7f00beffd700 1 -- 172.21.15.61:0/4253298982 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f00c0015640 con 0x7f00c80cb8e0 2023-12-24T20:07:16.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.228+0000 7f00beffd700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 0x7f00a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.228+0000 7f00beffd700 1 -- 172.21.15.61:0/4253298982 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f00c0084a80 con 0x7f00c80cb8e0 2023-12-24T20:07:16.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.228+0000 7f00c6ffd700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 0x7f00a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.229+0000 7f00c6ffd700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 0x7f00a80693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f00b8001200 tx=0x7f00b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:16.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.233+0000 7f00beffd700 1 -- 172.21.15.61:0/4253298982 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00c0052040 con 0x7f00c80cb8e0 2023-12-24T20:07:16.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.509+0000 7f00cd274700 1 -- 172.21.15.61:0/4253298982 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f00c806f110 con 0x7f00c80cb8e0 2023-12-24T20:07:16.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.509+0000 7f00beffd700 1 -- 172.21.15.61:0/4253298982 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f00c0055660 con 0x7f00c80cb8e0 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: "auth_dump": [ 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.a", 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlblL9NhAALp71L4aijTq8W2sxO5c9ew==", 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.510 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.b", 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlAc94BxAASb//Jc7AhHghLrSkmErXAw==", 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.c", 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlY0KsAhAAa65CfrmXNxDgRuQWOUfz/g==", 2023-12-24T20:07:16.511 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mds.d", 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlMiiTDhAAHlKm7o5BSRYoZwPVtnRIRg==", 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.512 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.0", 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlx3+sKxAACvY0RhsSgOZa4d5Qt17Bag==", 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.1", 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlKZt9MxAAHKhbAwcRlDl/UiKR4s8agw==", 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:07:16.513 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.2", 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD5jIhlPIWWOhAAdQtYb1kkt5Cwx93J79FDpQ==", 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.3", 2023-12-24T20:07:16.514 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD6jIhl8XAjBhAAVV+9tBCU3Rcs5teZFR+ulA==", 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.4", 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlZvzWEBAA0MRdSZVTgywCI1BjTtcOaQ==", 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.515 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.516 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.516 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.5", 2023-12-24T20:07:16.516 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhlm2FtGBAARJirv1+bLQ54PgLjN1lr7w==", 2023-12-24T20:07:16.516 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.516 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:07:16.516 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.6", 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhltzVZHxAA4tl6UwTBP8ZIzkqI34+Obw==", 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "osd.7", 2023-12-24T20:07:16.517 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD9jIhl1CPEKBAAGq3xF8UI3gvra9Ovtfc3Gw==", 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow profile osd", 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile osd", 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.0", 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhl/RfGEhAAAM66w8NoFVgdtr3tmpaPGA==", 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow r", 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.518 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.1", 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlXmeRGxAALyFh3/qdeSqNabJtV5FA4w==", 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.2", 2023-12-24T20:07:16.519 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlovVkGBAAziyZhVz/huHpE/ApOfCUgg==", 2023-12-24T20:07:16.520 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.520 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:07:16.520 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:07:16.520 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:07:16.520 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:07:16.521 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.521 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.521 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.3", 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD2jIhlyVQaIRAA9d0Fi4MVe8rdkRikDjsx+g==", 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow", 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow r", 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow rw", 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow rwx" 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "client.admin", 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlwF3pGRAA8h0Cld7lwZprlrgMAN7tSg==", 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": "allow *", 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow *", 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.x", 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlKai0MxAAQHYmAB2l/HOYkBesdoluXg==", 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: "entity": "mgr.y", 2023-12-24T20:07:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: "key": "AQD1jIhlOXqfLxAAakTSSzR38+3Zf7QH/kWJ6A==", 2023-12-24T20:07:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: "caps": { 2023-12-24T20:07:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": "allow *", 2023-12-24T20:07:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": "allow profile mgr", 2023-12-24T20:07:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": "allow *" 2023-12-24T20:07:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:16.524 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:07:16.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 -- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 msgr2=0x7f00a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 0x7f00a80693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f00b8001200 tx=0x7f00b8009040 comp rx=0 tx=0).stop 2023-12-24T20:07:16.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 -- 172.21.15.61:0/4253298982 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00c80cb8e0 msgr2=0x7f00c814cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00c80cb8e0 0x7f00c814cca0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f00c8071150 tx=0x7f00c000b040 comp rx=0 tx=0).stop 2023-12-24T20:07:16.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 -- 172.21.15.61:0/4253298982 shutdown_connections 2023-12-24T20:07:16.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f00a8066f30 0x7f00a80693e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f00c80cb8e0 0x7f00c814cca0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00b40041d0 0x7f00c80a7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 --2- 172.21.15.61:0/4253298982 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f00c80c7350 0x7f00c80c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 -- 172.21.15.61:0/4253298982 >> 172.21.15.61:0/4253298982 conn(0x7f00c80ca200 msgr2=0x7f00c80aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:16.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 -- 172.21.15.61:0/4253298982 shutdown_connections 2023-12-24T20:07:16.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.511+0000 7f00cd274700 1 -- 172.21.15.61:0/4253298982 wait complete. 2023-12-24T20:07:16.529 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:07:16.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.649+0000 7f747cbd3700 1 Processor -- start 2023-12-24T20:07:16.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.649+0000 7f747cbd3700 1 -- start start 2023-12-24T20:07:16.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.650+0000 7f747cbd3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74780b2660 0x7f747815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.650+0000 7f747cbd3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 0x7f74780b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.650+0000 7f747cbd3700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74780b2eb0 con 0x7f747815bb60 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.650+0000 7f747cbd3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74780afc20 con 0x7f74780b2660 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.650+0000 7f747cbd3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74780b2bd0 con 0x7f747815c470 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f747659c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f747815bb60 0x7f7478098560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40376/0 (socket says 172.21.15.61:40376) 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f747659c700 1 -- 172.21.15.61:0/4062640195 learned_addr learned my addr 172.21.15.61:0/4062640195 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f7476d9d700 1 --2- 172.21.15.61:0/4062640195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 0x7f74780b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f7475d9b700 1 --2- 172.21.15.61:0/4062640195 >> v2:172.21.15.133:3300/0 conn(0x7f74780b2660 0x7f747815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f747559a700 1 -- 172.21.15.61:0/4062640195 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361692470 0 0) 0x7f74780b2eb0 con 0x7f747815bb60 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f747559a700 1 -- 172.21.15.61:0/4062640195 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7460003570 con 0x7f747815bb60 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f747559a700 1 -- 172.21.15.61:0/4062640195 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4289160773 0 0) 0x7f7460003570 con 0x7f747815bb60 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f7476d9d700 1 -- 172.21.15.61:0/4062640195 >> v2:172.21.15.133:3300/0 conn(0x7f74780b2660 msgr2=0x7f747815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f7476d9d700 1 --2- 172.21.15.61:0/4062640195 >> v2:172.21.15.133:3300/0 conn(0x7f74780b2660 0x7f747815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f7476d9d700 1 -- 172.21.15.61:0/4062640195 >> v1:172.21.15.61:6789/0 conn(0x7f747815bb60 legacy=0x7f7478098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f7476d9d700 1 -- 172.21.15.61:0/4062640195 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74780afe10 con 0x7f747815c470 2023-12-24T20:07:16.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f7475d9b700 1 --2- 172.21.15.61:0/4062640195 >> v2:172.21.15.133:3300/0 conn(0x7f74780b2660 0x7f747815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f7476d9d700 1 --2- 172.21.15.61:0/4062640195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 0x7f74780b08f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7470009e60 tx=0x7f7470009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93a57d195cdc98dd server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.651+0000 7f747559a700 1 -- 172.21.15.61:0/4062640195 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000e070 con 0x7f747815c470 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.652+0000 7f747559a700 1 -- 172.21.15.61:0/4062640195 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747000b7a0 con 0x7f747815c470 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.652+0000 7f747559a700 1 -- 172.21.15.61:0/4062640195 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74680015f0 con 0x7f747815c470 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.652+0000 7f747cbd3700 1 -- 172.21.15.61:0/4062640195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 msgr2=0x7f74780b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.652+0000 7f747cbd3700 1 --2- 172.21.15.61:0/4062640195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 0x7f74780b08f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7470009e60 tx=0x7f7470009780 comp rx=0 tx=0).stop 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.652+0000 7f747cbd3700 1 -- 172.21.15.61:0/4062640195 shutdown_connections 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.652+0000 7f747cbd3700 1 --2- 172.21.15.61:0/4062640195 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 0x7f74780b08f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.652+0000 7f747cbd3700 1 --2- 172.21.15.61:0/4062640195 >> v2:172.21.15.133:3300/0 conn(0x7f74780b2660 0x7f747815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.652+0000 7f747cbd3700 1 -- 172.21.15.61:0/4062640195 >> 172.21.15.61:0/4062640195 conn(0x7f7478097a10 msgr2=0x7f74780ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.652+0000 7f747cbd3700 1 -- 172.21.15.61:0/4062640195 shutdown_connections 2023-12-24T20:07:16.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.652+0000 7f747cbd3700 1 -- 172.21.15.61:0/4062640195 wait complete. 2023-12-24T20:07:16.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.654+0000 7f747cbd3700 1 Processor -- start 2023-12-24T20:07:16.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.654+0000 7f747cbd3700 1 -- start start 2023-12-24T20:07:16.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f747cbd3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74780b2660 0x7f7478168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f747cbd3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f747815bb60 0x7f7478159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f747cbd3700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 0x7f74781564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f747cbd3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7478157420 con 0x7f747815bb60 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f747cbd3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74780a9cd0 con 0x7f74780b2660 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f747cbd3700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74780a9fb0 con 0x7f747815c470 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f747815bb60 0x7f7478159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7475d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f747815bb60 0x7f7478159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40970/0 (socket says 172.21.15.61:40970) 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7475d9b700 1 -- 172.21.15.61:0/922015336 learned_addr learned my addr 172.21.15.61:0/922015336 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f747659c700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74780b2660 0x7f7478168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7476d9d700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 0x7f74781564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7475d9b700 1 -- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 msgr2=0x7f74781564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7475d9b700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 0x7f74781564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7475d9b700 1 -- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74780b2660 msgr2=0x7f7478168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7475d9b700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74780b2660 0x7f7478168c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7475d9b700 1 -- 172.21.15.61:0/922015336 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c009420 con 0x7f747815bb60 2023-12-24T20:07:16.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7476d9d700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 0x7f74781564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:16.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f7475d9b700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f747815bb60 0x7f7478159c40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f746c00ec80 tx=0x7f746c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:16.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.655+0000 7f74667fc700 1 -- 172.21.15.61:0/922015336 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c00c8f0 con 0x7f747815bb60 2023-12-24T20:07:16.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.656+0000 7f74667fc700 1 -- 172.21.15.61:0/922015336 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c00ca50 con 0x7f747815bb60 2023-12-24T20:07:16.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.656+0000 7f747cbd3700 1 -- 172.21.15.61:0/922015336 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7470009a20 con 0x7f747815bb60 2023-12-24T20:07:16.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.656+0000 7f74667fc700 1 -- 172.21.15.61:0/922015336 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c00cdd0 con 0x7f747815bb60 2023-12-24T20:07:16.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.656+0000 7f747cbd3700 1 -- 172.21.15.61:0/922015336 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74780aa570 con 0x7f747815bb60 2023-12-24T20:07:16.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.657+0000 7f747cbd3700 1 -- 172.21.15.61:0/922015336 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747806d440 con 0x7f747815bb60 2023-12-24T20:07:16.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.657+0000 7f74667fc700 1 -- 172.21.15.61:0/922015336 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f746c013680 con 0x7f747815bb60 2023-12-24T20:07:16.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.657+0000 7f74667fc700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7458066f30 0x7f74580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:16.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.658+0000 7f74667fc700 1 -- 172.21.15.61:0/922015336 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f746c084650 con 0x7f747815bb60 2023-12-24T20:07:16.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.658+0000 7f747659c700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7458066f30 0x7f74580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:16.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.658+0000 7f747659c700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7458066f30 0x7f74580693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f74680015b0 tx=0x7f7468001540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:16.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.662+0000 7f74667fc700 1 -- 172.21.15.61:0/922015336 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f746c051c10 con 0x7f747815bb60 2023-12-24T20:07:16.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.858+0000 7f747cbd3700 1 -- 172.21.15.61:0/922015336 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f747804c3c0 con 0x7f747815bb60 2023-12-24T20:07:16.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.859+0000 7f74667fc700 1 -- 172.21.15.61:0/922015336 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+12145 (secure 0 0 0) 0x7f746c055230 con 0x7f747815bb60 2023-12-24T20:07:16.859 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:16.859 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":181,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:07:16.070231+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 -- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7458066f30 msgr2=0x7f74580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7458066f30 0x7f74580693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f74680015b0 tx=0x7f7468001540 comp rx=0 tx=0).stop 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 -- 172.21.15.61:0/922015336 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f747815bb60 msgr2=0x7f7478159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f747815bb60 0x7f7478159c40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f746c00ec80 tx=0x7f746c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 -- 172.21.15.61:0/922015336 shutdown_connections 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f747815c470 0x7f74781564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7458066f30 0x7f74580693e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74780b2660 0x7f7478168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 --2- 172.21.15.61:0/922015336 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f747815bb60 0x7f7478159c40 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 -- 172.21.15.61:0/922015336 >> 172.21.15.61:0/922015336 conn(0x7f7478097a10 msgr2=0x7f7478157810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:16.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 -- 172.21.15.61:0/922015336 shutdown_connections 2023-12-24T20:07:16.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.861+0000 7f747cbd3700 1 -- 172.21.15.61:0/922015336 wait complete. 2023-12-24T20:07:16.874 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-24T20:07:16.874 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:07:16.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.998+0000 7f51badb9700 1 Processor -- start 2023-12-24T20:07:16.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.998+0000 7f51badb9700 1 -- start start 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51badb9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b40cdf90 0x7f51b406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51badb9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51b40ce360 0x7f51b4158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51badb9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b415bad0 con 0x7f51b4158a80 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51badb9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b415bdb0 con 0x7f51b40ce360 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51badb9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b415c090 con 0x7f51b40cdf90 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51b8b55700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b40cdf90 0x7f51b406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51b3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51b40ce360 0x7f51b4158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51b9356700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f51b4158a80 0x7f51b406c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:60092/0 (socket says 172.21.15.61:60092) 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51b8b55700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b40cdf90 0x7f51b406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:53074/0 (socket says 172.21.15.61:53074) 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51b3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51b40ce360 0x7f51b4158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:52732/0 (socket says 172.21.15.61:52732) 2023-12-24T20:07:17.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:16.999+0000 7f51b9356700 1 -- 172.21.15.61:0/2662461276 learned_addr learned my addr 172.21.15.61:0/2662461276 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:17.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.000+0000 7f51b3fff700 1 -- 172.21.15.61:0/2662461276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b40cdf90 msgr2=0x7f51b406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:17.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.000+0000 7f51b3fff700 1 --2- 172.21.15.61:0/2662461276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b40cdf90 0x7f51b406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.000+0000 7f51b3fff700 1 -- 172.21.15.61:0/2662461276 >> v1:172.21.15.133:6789/0 conn(0x7f51b4158a80 legacy=0x7f51b406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.000+0000 7f51b3fff700 1 -- 172.21.15.61:0/2662461276 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b415c370 con 0x7f51b40ce360 2023-12-24T20:07:17.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.000+0000 7f51b3fff700 1 --2- 172.21.15.61:0/2662461276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b40ce360 0x7f51b4158540 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f51a00098e0 tx=0x7f51a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e787091f06b73f96 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:17.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.000+0000 7f51b37fe700 1 -- 172.21.15.61:0/2662461276 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000b640 con 0x7f51b40ce360 2023-12-24T20:07:17.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.000+0000 7f51b37fe700 1 -- 172.21.15.61:0/2662461276 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a000b7a0 con 0x7f51b40ce360 2023-12-24T20:07:17.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.000+0000 7f51b37fe700 1 -- 172.21.15.61:0/2662461276 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000bb40 con 0x7f51b40ce360 2023-12-24T20:07:17.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.001+0000 7f51badb9700 1 -- 172.21.15.61:0/2662461276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b40ce360 msgr2=0x7f51b4158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.001+0000 7f51badb9700 1 --2- 172.21.15.61:0/2662461276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b40ce360 0x7f51b4158540 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f51a00098e0 tx=0x7f51a00091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.001+0000 7f51badb9700 1 -- 172.21.15.61:0/2662461276 shutdown_connections 2023-12-24T20:07:17.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.001+0000 7f51badb9700 1 --2- 172.21.15.61:0/2662461276 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b40cdf90 0x7f51b406b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.001+0000 7f51badb9700 1 --2- 172.21.15.61:0/2662461276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b40ce360 0x7f51b4158540 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.001+0000 7f51badb9700 1 -- 172.21.15.61:0/2662461276 >> 172.21.15.61:0/2662461276 conn(0x7f51b406f810 msgr2=0x7f51b406ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:17.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.001+0000 7f51badb9700 1 -- 172.21.15.61:0/2662461276 shutdown_connections 2023-12-24T20:07:17.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.001+0000 7f51badb9700 1 -- 172.21.15.61:0/2662461276 wait complete. 2023-12-24T20:07:17.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.002+0000 7f51badb9700 1 Processor -- start 2023-12-24T20:07:17.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.002+0000 7f51badb9700 1 -- start start 2023-12-24T20:07:17.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51badb9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51b40cdf90 0x7f51b4068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51badb9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b40ce360 0x7f51b40ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51badb9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b4158a80 0x7f51b40ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51badb9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b4069230 con 0x7f51b40cdf90 2023-12-24T20:07:17.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51badb9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40ab490 con 0x7f51b40ce360 2023-12-24T20:07:17.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51badb9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40aa880 con 0x7f51b4158a80 2023-12-24T20:07:17.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b8b55700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51b40cdf90 0x7f51b4068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b8b55700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51b40cdf90 0x7f51b4068cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40980/0 (socket says 172.21.15.61:40980) 2023-12-24T20:07:17.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b8b55700 1 -- 172.21.15.61:0/3662114136 learned_addr learned my addr 172.21.15.61:0/3662114136 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b3fff700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b40ce360 0x7f51b40ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b9356700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b4158a80 0x7f51b40ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b8b55700 1 -- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b4158a80 msgr2=0x7f51b40ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b8b55700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b4158a80 0x7f51b40ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b8b55700 1 -- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b40ce360 msgr2=0x7f51b40ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b8b55700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b40ce360 0x7f51b40ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b8b55700 1 -- 172.21.15.61:0/3662114136 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a0009420 con 0x7f51b40cdf90 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.003+0000 7f51b8b55700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51b40cdf90 0x7f51b4068cf0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f51a800e930 tx=0x7f51a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.004+0000 7f51b0ff9700 1 -- 172.21.15.61:0/3662114136 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8013680 con 0x7f51b40cdf90 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.004+0000 7f51b0ff9700 1 -- 172.21.15.61:0/3662114136 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a80137e0 con 0x7f51b40cdf90 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.004+0000 7f51badb9700 1 -- 172.21.15.61:0/3662114136 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b40aab60 con 0x7f51b40cdf90 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.004+0000 7f51b0ff9700 1 -- 172.21.15.61:0/3662114136 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8013b80 con 0x7f51b40cdf90 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.004+0000 7f51badb9700 1 -- 172.21.15.61:0/3662114136 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b40ab1a0 con 0x7f51b40cdf90 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.005+0000 7f51badb9700 1 -- 172.21.15.61:0/3662114136 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b40b0fe0 con 0x7f51b40cdf90 2023-12-24T20:07:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.005+0000 7f51b0ff9700 1 -- 172.21.15.61:0/3662114136 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f51a800c3e0 con 0x7f51b40cdf90 2023-12-24T20:07:17.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.005+0000 7f51b0ff9700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 0x7f51980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.006+0000 7f51b0ff9700 1 -- 172.21.15.61:0/3662114136 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f51a8084310 con 0x7f51b40cdf90 2023-12-24T20:07:17.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.006+0000 7f51b3fff700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 0x7f51980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.006+0000 7f51b3fff700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 0x7f51980693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f51a00093f0 tx=0x7f51a0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:17.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.010+0000 7f51b0ff9700 1 -- 172.21.15.61:0/3662114136 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51a80518d0 con 0x7f51b40cdf90 2023-12-24T20:07:17.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.206+0000 7f51badb9700 1 -- 172.21.15.61:0/3662114136 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51b404c3c0 con 0x7f51b40cdf90 2023-12-24T20:07:17.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.206+0000 7f51b0ff9700 1 -- 172.21.15.61:0/3662114136 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v181) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51a8054ef0 con 0x7f51b40cdf90 2023-12-24T20:07:17.206 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:07:17.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 -- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 msgr2=0x7f51980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 0x7f51980693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f51a00093f0 tx=0x7f51a0017000 comp rx=0 tx=0).stop 2023-12-24T20:07:17.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 -- 172.21.15.61:0/3662114136 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51b40cdf90 msgr2=0x7f51b4068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51b40cdf90 0x7f51b4068cf0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f51a800e930 tx=0x7f51a80091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 -- 172.21.15.61:0/3662114136 shutdown_connections 2023-12-24T20:07:17.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51b4158a80 0x7f51b40ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 0x7f51980693e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51b40cdf90 0x7f51b4068cf0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 --2- 172.21.15.61:0/3662114136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51b40ce360 0x7f51b40ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 -- 172.21.15.61:0/3662114136 >> 172.21.15.61:0/3662114136 conn(0x7f51b406f810 msgr2=0x7f51b415a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:17.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 -- 172.21.15.61:0/3662114136 shutdown_connections 2023-12-24T20:07:17.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.208+0000 7f51badb9700 1 -- 172.21.15.61:0/3662114136 wait complete. 2023-12-24T20:07:17.221 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-24T20:07:17.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.343+0000 7f0e9c747700 1 Processor -- start 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.343+0000 7f0e9c747700 1 -- start start 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.344+0000 7f0e9c747700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94070d50 0x7f0e94067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.344+0000 7f0e9c747700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e940a84d0 con 0x7f0e94159b00 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.344+0000 7f0e9c747700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e940a7620 con 0x7f0e940afee0 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.344+0000 7f0e9c747700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940a78c0 con 0x7f0e94070d50 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.344+0000 7f0e9a4e3700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f0e94159b00 0x7f0e940af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40378/0 (socket says 172.21.15.61:40378) 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.344+0000 7f0e9a4e3700 1 -- 172.21.15.61:0/360892301 learned_addr learned my addr 172.21.15.61:0/360892301 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e9ace4700 1 --2- 172.21.15.61:0/360892301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94070d50 0x7f0e94067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e994e1700 1 -- 172.21.15.61:0/360892301 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021066080 0 0) 0x7f0e940a84d0 con 0x7f0e94159b00 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e994e1700 1 -- 172.21.15.61:0/360892301 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e80003570 con 0x7f0e94159b00 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e994e1700 1 -- 172.21.15.61:0/360892301 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674685439 0 0) 0x7f0e940a7620 con 0x7f0e940afee0 2023-12-24T20:07:17.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e994e1700 1 -- 172.21.15.61:0/360892301 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e940a84d0 con 0x7f0e940afee0 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e994e1700 1 -- 172.21.15.61:0/360892301 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4159344342 0 0) 0x7f0e80003570 con 0x7f0e94159b00 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e9ace4700 1 -- 172.21.15.61:0/360892301 >> v1:172.21.15.133:6789/0 conn(0x7f0e940afee0 legacy=0x7f0e94070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e9ace4700 1 -- 172.21.15.61:0/360892301 >> v1:172.21.15.61:6789/0 conn(0x7f0e94159b00 legacy=0x7f0e940af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e9ace4700 1 -- 172.21.15.61:0/360892301 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940a7ba0 con 0x7f0e94070d50 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e9ace4700 1 --2- 172.21.15.61:0/360892301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94070d50 0x7f0e94067550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009e90 tx=0x7f0e8c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4c1dcf6341f6d7b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e994e1700 1 -- 172.21.15.61:0/360892301 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00e070 con 0x7f0e94070d50 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e994e1700 1 -- 172.21.15.61:0/360892301 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c00b870 con 0x7f0e94070d50 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.345+0000 7f0e994e1700 1 -- 172.21.15.61:0/360892301 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84001470 con 0x7f0e94070d50 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.346+0000 7f0e9c747700 1 -- 172.21.15.61:0/360892301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94070d50 msgr2=0x7f0e94067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.346+0000 7f0e9c747700 1 --2- 172.21.15.61:0/360892301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94070d50 0x7f0e94067550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009e90 tx=0x7f0e8c009780 comp rx=0 tx=0).stop 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.346+0000 7f0e9c747700 1 -- 172.21.15.61:0/360892301 shutdown_connections 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.346+0000 7f0e9c747700 1 --2- 172.21.15.61:0/360892301 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94070d50 0x7f0e94067550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.346+0000 7f0e9c747700 1 -- 172.21.15.61:0/360892301 >> 172.21.15.61:0/360892301 conn(0x7f0e940ca200 msgr2=0x7f0e940ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:17.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.346+0000 7f0e9c747700 1 -- 172.21.15.61:0/360892301 shutdown_connections 2023-12-24T20:07:17.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.346+0000 7f0e9c747700 1 -- 172.21.15.61:0/360892301 wait complete. 2023-12-24T20:07:17.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.347+0000 7f0e9c747700 1 Processor -- start 2023-12-24T20:07:17.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.347+0000 7f0e9c747700 1 -- start start 2023-12-24T20:07:17.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9c747700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e94070d50 0x7f0e94148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9c747700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e940afee0 0x7f0e9415ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9c747700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94159b00 0x7f0e940adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9c747700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e941487a0 con 0x7f0e94070d50 2023-12-24T20:07:17.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9c747700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940b0da0 con 0x7f0e940afee0 2023-12-24T20:07:17.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9c747700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940b1080 con 0x7f0e94159b00 2023-12-24T20:07:17.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9a4e3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e94070d50 0x7f0e94148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9a4e3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e94070d50 0x7f0e94148260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:40982/0 (socket says 172.21.15.61:40982) 2023-12-24T20:07:17.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9a4e3700 1 -- 172.21.15.61:0/1758270913 learned_addr learned my addr 172.21.15.61:0/1758270913 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:17.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e99ce2700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e940afee0 0x7f0e9415ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9ace4700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94159b00 0x7f0e940adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9a4e3700 1 -- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94159b00 msgr2=0x7f0e940adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9a4e3700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94159b00 0x7f0e940adff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9a4e3700 1 -- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e940afee0 msgr2=0x7f0e9415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9a4e3700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e940afee0 0x7f0e9415ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.348+0000 7f0e9a4e3700 1 -- 172.21.15.61:0/1758270913 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c009a20 con 0x7f0e94070d50 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.349+0000 7f0e9a4e3700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e94070d50 0x7f0e94148260 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400cb70 tx=0x7f0e84001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.349+0000 7f0e8a7fc700 1 -- 172.21.15.61:0/1758270913 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84001d20 con 0x7f0e94070d50 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.349+0000 7f0e8a7fc700 1 -- 172.21.15.61:0/1758270913 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e84007360 con 0x7f0e94070d50 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.349+0000 7f0e9c747700 1 -- 172.21.15.61:0/1758270913 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e940b1360 con 0x7f0e94070d50 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.349+0000 7f0e8a7fc700 1 -- 172.21.15.61:0/1758270913 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84004830 con 0x7f0e94070d50 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.349+0000 7f0e9c747700 1 -- 172.21.15.61:0/1758270913 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e940b0a00 con 0x7f0e94070d50 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.350+0000 7f0e9c747700 1 -- 172.21.15.61:0/1758270913 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e940b19b0 con 0x7f0e94070d50 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.350+0000 7f0e8a7fc700 1 -- 172.21.15.61:0/1758270913 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0e84004ba0 con 0x7f0e94070d50 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.351+0000 7f0e8a7fc700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e78066f30 0x7f0e780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.351+0000 7f0e8a7fc700 1 -- 172.21.15.61:0/1758270913 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0e84083930 con 0x7f0e94070d50 2023-12-24T20:07:17.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.351+0000 7f0e99ce2700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e78066f30 0x7f0e780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.351+0000 7f0e99ce2700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e78066f30 0x7f0e780693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0e940b0550 tx=0x7f0e90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:17.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.355+0000 7f0e8a7fc700 1 -- 172.21.15.61:0/1758270913 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e84050f70 con 0x7f0e94070d50 2023-12-24T20:07:17.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.552+0000 7f0e9c747700 1 -- 172.21.15.61:0/1758270913 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0e9404c3c0 con 0x7f0e94070d50 2023-12-24T20:07:17.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.553+0000 7f0e8a7fc700 1 -- 172.21.15.61:0/1758270913 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v181) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0e84018090 con 0x7f0e94070d50 2023-12-24T20:07:17.554 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:17.554 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-12-24T20:07:17.554 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:17.554 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-12-24T20:07:17.554 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-12-24T20:07:17.555 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:17.555 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 -- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e78066f30 msgr2=0x7f0e780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e78066f30 0x7f0e780693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0e940b0550 tx=0x7f0e90009040 comp rx=0 tx=0).stop 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 -- 172.21.15.61:0/1758270913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e94070d50 msgr2=0x7f0e94148260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e94070d50 0x7f0e94148260 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400cb70 tx=0x7f0e84001ab0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 -- 172.21.15.61:0/1758270913 shutdown_connections 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0e94159b00 0x7f0e940adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0e78066f30 0x7f0e780693e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0e94070d50 0x7f0e94148260 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 --2- 172.21.15.61:0/1758270913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e940afee0 0x7f0e9415ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 -- 172.21.15.61:0/1758270913 >> 172.21.15.61:0/1758270913 conn(0x7f0e940ca200 msgr2=0x7f0e94067f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 -- 172.21.15.61:0/1758270913 shutdown_connections 2023-12-24T20:07:17.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.555+0000 7f0e9c747700 1 -- 172.21.15.61:0/1758270913 wait complete. 2023-12-24T20:07:17.567 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-24T20:07:17.568 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-24T20:07:17.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.694+0000 7f913f9ee700 1 Processor -- start 2023-12-24T20:07:17.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.694+0000 7f913f9ee700 1 -- start start 2023-12-24T20:07:17.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f913f9ee700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380cb420 0x7f91380cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f913f9ee700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91380ca3c0 con 0x7f91381579b0 2023-12-24T20:07:17.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f913f9ee700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91380ca660 con 0x7f91380cdb00 2023-12-24T20:07:17.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f913f9ee700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913806b7d0 con 0x7f91380cb420 2023-12-24T20:07:17.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f913d78a700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f91381579b0 0x7f91380b15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40380/0 (socket says 172.21.15.61:40380) 2023-12-24T20:07:17.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f913d78a700 1 -- 172.21.15.61:0/1591125743 learned_addr learned my addr 172.21.15.61:0/1591125743 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:17.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f913cf89700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380cb420 0x7f91380cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812419040 0 0) 0x7f91380ca3c0 con 0x7f91381579b0 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9124003570 con 0x7f91381579b0 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918504476 0 0) 0x7f91380ca660 con 0x7f91380cdb00 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91380ca3c0 con 0x7f91380cdb00 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 491546320 0 0) 0x7f9124003570 con 0x7f91381579b0 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380cb420 msgr2=0x7f91380cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380cb420 0x7f91380cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 >> v1:172.21.15.133:6789/0 conn(0x7f91380cdb00 legacy=0x7f91380ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91380ca940 con 0x7f91381579b0 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f9134001470 con 0x7f91381579b0 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.695+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 >> v1:172.21.15.61:6789/0 conn(0x7f91381579b0 legacy=0x7f91380b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f912ffff700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 0x7f9124004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f912ffff700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380cb420 0x7f9124004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f912ffff700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9124004d50 0x7f91240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913806b7d0 con 0x7f9124003c20 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912400bbf0 con 0x7f9124004d50 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912400bd60 con 0x7f91380cb420 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f913d78a700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 0x7f9124004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f913cf89700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380cb420 0x7f9124004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f913df8b700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9124004d50 0x7f91240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f913d78a700 1 -- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380cb420 msgr2=0x7f9124004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f913d78a700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380cb420 0x7f9124004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f913d78a700 1 -- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9124004d50 msgr2=0x7f91240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f913d78a700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9124004d50 0x7f91240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f913d78a700 1 -- 172.21.15.61:0/1591125743 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124003570 con 0x7f9124003c20 2023-12-24T20:07:17.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f913df8b700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9124004d50 0x7f91240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f913d78a700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 0x7f9124004010 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f9134007fd0 tx=0x7f9134001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b7e9efede13165 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400cae0 con 0x7f9124003c20 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913400cc60 con 0x7f9124003c20 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.696+0000 7f912ffff700 1 -- 172.21.15.61:0/1591125743 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134005920 con 0x7f9124003c20 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.697+0000 7f913f9ee700 1 -- 172.21.15.61:0/1591125743 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 msgr2=0x7f9124004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.697+0000 7f913f9ee700 1 --2- 172.21.15.61:0/1591125743 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 0x7f9124004010 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f9134007fd0 tx=0x7f9134001d40 comp rx=0 tx=0).stop 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.697+0000 7f913df8b700 1 -- 172.21.15.61:0/1591125743 reap_dead start 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.697+0000 7f913f9ee700 1 -- 172.21.15.61:0/1591125743 shutdown_connections 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.697+0000 7f913f9ee700 1 -- 172.21.15.61:0/1591125743 >> 172.21.15.61:0/1591125743 conn(0x7f913806a1f0 msgr2=0x7f913806ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.697+0000 7f913f9ee700 1 -- 172.21.15.61:0/1591125743 shutdown_connections 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.697+0000 7f913f9ee700 1 -- 172.21.15.61:0/1591125743 wait complete. 2023-12-24T20:07:17.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.698+0000 7f913f9ee700 1 Processor -- start 2023-12-24T20:07:17.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.698+0000 7f913f9ee700 1 -- start start 2023-12-24T20:07:17.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913f9ee700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 0x7f913815e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913f9ee700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380b15d0 0x7f913814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913f9ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380b2ae0 0x7f91380b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913f9ee700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913814d810 con 0x7f9124003c20 2023-12-24T20:07:17.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913f9ee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91380b1a40 con 0x7f91380b2ae0 2023-12-24T20:07:17.706 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913f9ee700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91380b1d20 con 0x7f91380b15d0 2023-12-24T20:07:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913d78a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 0x7f913815e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913d78a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 0x7f913815e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41008/0 (socket says 172.21.15.61:41008) 2023-12-24T20:07:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913d78a700 1 -- 172.21.15.61:0/2536427280 learned_addr learned my addr 172.21.15.61:0/2536427280 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913cf89700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380b15d0 0x7f913814d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913df8b700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380b2ae0 0x7f91380b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913d78a700 1 -- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380b15d0 msgr2=0x7f913814d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913d78a700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380b15d0 0x7f913814d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913d78a700 1 -- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380b2ae0 msgr2=0x7f91380b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913d78a700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380b2ae0 0x7f91380b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.699+0000 7f913d78a700 1 -- 172.21.15.61:0/2536427280 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91380b2000 con 0x7f9124003c20 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.700+0000 7f913d78a700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 0x7f913815e300 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f913400c7a0 tx=0x7f9134015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.700+0000 7f912d7fa700 1 -- 172.21.15.61:0/2536427280 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134024070 con 0x7f9124003c20 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.700+0000 7f912d7fa700 1 -- 172.21.15.61:0/2536427280 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9134000bc0 con 0x7f9124003c20 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.700+0000 7f913f9ee700 1 -- 172.21.15.61:0/2536427280 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91380b22e0 con 0x7f9124003c20 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.700+0000 7f912d7fa700 1 -- 172.21.15.61:0/2536427280 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134005cd0 con 0x7f9124003c20 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.700+0000 7f913f9ee700 1 -- 172.21.15.61:0/2536427280 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913815aab0 con 0x7f9124003c20 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.701+0000 7f913f9ee700 1 -- 172.21.15.61:0/2536427280 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913814d950 con 0x7f9124003c20 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.701+0000 7f912d7fa700 1 -- 172.21.15.61:0/2536427280 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9134004a40 con 0x7f9124003c20 2023-12-24T20:07:17.708 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.701+0000 7f912d7fa700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f911c066f30 0x7f911c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:17.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.702+0000 7f912d7fa700 1 -- 172.21.15.61:0/2536427280 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9134084fd0 con 0x7f9124003c20 2023-12-24T20:07:17.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.702+0000 7f913cf89700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f911c066f30 0x7f911c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:17.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.702+0000 7f913cf89700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f911c066f30 0x7f911c0693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f91380c4f00 tx=0x7f91280091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:17.709 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.706+0000 7f912d7fa700 1 -- 172.21.15.61:0/2536427280 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9134052660 con 0x7f9124003c20 2023-12-24T20:07:17.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:17.899+0000 7f913f9ee700 1 -- 172.21.15.61:0/2536427280 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f913804c3c0 con 0x7f9124003c20 2023-12-24T20:07:18.717 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.716+0000 7f912d7fa700 1 -- 172.21.15.61:0/2536427280 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v182) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9134055c80 con 0x7f9124003c20 2023-12-24T20:07:18.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 -- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f911c066f30 msgr2=0x7f911c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f911c066f30 0x7f911c0693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f91380c4f00 tx=0x7f91280091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 -- 172.21.15.61:0/2536427280 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 msgr2=0x7f913815e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 0x7f913815e300 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f913400c7a0 tx=0x7f9134015000 comp rx=0 tx=0).stop 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 -- 172.21.15.61:0/2536427280 shutdown_connections 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f911c066f30 0x7f911c0693e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380b2ae0 0x7f91380b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9124003c20 0x7f913815e300 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 --2- 172.21.15.61:0/2536427280 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91380b15d0 0x7f913814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 -- 172.21.15.61:0/2536427280 >> 172.21.15.61:0/2536427280 conn(0x7f913806a1f0 msgr2=0x7f91380cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 -- 172.21.15.61:0/2536427280 shutdown_connections 2023-12-24T20:07:18.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.720+0000 7f913f9ee700 1 -- 172.21.15.61:0/2536427280 wait complete. 2023-12-24T20:07:18.722 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-12-24T20:07:18.735 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-24T20:07:18.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.869+0000 7f941f42b700 1 Processor -- start 2023-12-24T20:07:18.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.869+0000 7f941f42b700 1 -- start start 2023-12-24T20:07:18.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941f42b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9418157b70 0x7f94180af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:18.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941f42b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9418068980 0x7f9418070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:18.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941f42b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94180b03a0 con 0x7f9418070b80 2023-12-24T20:07:18.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941f42b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941815bcb0 con 0x7f9418157b70 2023-12-24T20:07:18.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941f42b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9418070fc0 con 0x7f9418068980 2023-12-24T20:07:18.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941d1c7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9418157b70 0x7f94180af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:18.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941d1c7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9418157b70 0x7f94180af7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41012/0 (socket says 172.21.15.61:41012) 2023-12-24T20:07:18.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941d1c7700 1 -- 172.21.15.61:0/2917898135 learned_addr learned my addr 172.21.15.61:0/2917898135 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941c9c6700 1 --2- 172.21.15.61:0/2917898135 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9418068980 0x7f9418070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941d1c7700 1 -- 172.21.15.61:0/2917898135 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9418068980 msgr2=0x7f9418070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941d1c7700 1 --2- 172.21.15.61:0/2917898135 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9418068980 0x7f9418070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941d1c7700 1 -- 172.21.15.61:0/2917898135 >> v1:172.21.15.133:6789/0 conn(0x7f9418070b80 legacy=0x7f9418067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.870+0000 7f941d1c7700 1 -- 172.21.15.61:0/2917898135 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94180afde0 con 0x7f9418157b70 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f941d1c7700 1 --2- 172.21.15.61:0/2917898135 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 0x7f94180af7b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f94140099b0 tx=0x7f9414009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19efa858a26c90fc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f940ffff700 1 -- 172.21.15.61:0/2917898135 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400b860 con 0x7f9418157b70 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f940ffff700 1 -- 172.21.15.61:0/2917898135 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400b9c0 con 0x7f9418157b70 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f940ffff700 1 -- 172.21.15.61:0/2917898135 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400bd80 con 0x7f9418157b70 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f941f42b700 1 -- 172.21.15.61:0/2917898135 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 msgr2=0x7f94180af7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f941f42b700 1 --2- 172.21.15.61:0/2917898135 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 0x7f94180af7b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f94140099b0 tx=0x7f9414009250 comp rx=0 tx=0).stop 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f941f42b700 1 -- 172.21.15.61:0/2917898135 shutdown_connections 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f941f42b700 1 --2- 172.21.15.61:0/2917898135 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 0x7f94180af7b0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:18.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f941f42b700 1 --2- 172.21.15.61:0/2917898135 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9418068980 0x7f9418070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:18.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f941f42b700 1 -- 172.21.15.61:0/2917898135 >> 172.21.15.61:0/2917898135 conn(0x7f94180ce420 msgr2=0x7f94180ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:18.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f941f42b700 1 -- 172.21.15.61:0/2917898135 shutdown_connections 2023-12-24T20:07:18.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.871+0000 7f941f42b700 1 -- 172.21.15.61:0/2917898135 wait complete. 2023-12-24T20:07:18.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.872+0000 7f941f42b700 1 Processor -- start 2023-12-24T20:07:18.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.872+0000 7f941f42b700 1 -- start start 2023-12-24T20:07:18.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.873+0000 7f941f42b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9418068980 0x7f941816a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.873+0000 7f941f42b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9418070b80 0x7f94180c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.873+0000 7f941f42b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 0x7f9418152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.873+0000 7f941f42b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94180c3a90 con 0x7f9418157b70 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.873+0000 7f941f42b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94180c3600 con 0x7f9418070b80 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.873+0000 7f941f42b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941816af20 con 0x7f9418068980 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.873+0000 7f941d9c8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 0x7f9418152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941d9c8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 0x7f9418152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41020/0 (socket says 172.21.15.61:41020) 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941d9c8700 1 -- 172.21.15.61:0/2399389962 learned_addr learned my addr 172.21.15.61:0/2399389962 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941d9c8700 1 -- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9418068980 msgr2=0x7f941816a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941d1c7700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9418068980 0x7f941816a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941c9c6700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9418070b80 0x7f94180c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941d9c8700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9418068980 0x7f941816a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941d9c8700 1 -- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9418070b80 msgr2=0x7f94180c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:18.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941d9c8700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9418070b80 0x7f94180c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941d9c8700 1 -- 172.21.15.61:0/2399389962 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140094f0 con 0x7f9418157b70 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941d9c8700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 0x7f9418152240 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f941000c8e0 tx=0x7f9410001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f940d7fa700 1 -- 172.21.15.61:0/2399389962 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000ce80 con 0x7f9418157b70 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f940d7fa700 1 -- 172.21.15.61:0/2399389962 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941000a7e0 con 0x7f9418157b70 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941f42b700 1 -- 172.21.15.61:0/2399389962 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94180c2710 con 0x7f9418157b70 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f940d7fa700 1 -- 172.21.15.61:0/2399389962 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941000ab80 con 0x7f9418157b70 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.874+0000 7f941f42b700 1 -- 172.21.15.61:0/2399389962 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94180c2cd0 con 0x7f9418157b70 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.875+0000 7f941f42b700 1 -- 172.21.15.61:0/2399389962 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94180c37b0 con 0x7f9418157b70 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.876+0000 7f940d7fa700 1 -- 172.21.15.61:0/2399389962 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9410012420 con 0x7f9418157b70 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.876+0000 7f940d7fa700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f93fc066f30 0x7f93fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.876+0000 7f940d7fa700 1 -- 172.21.15.61:0/2399389962 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f9410084600 con 0x7f9418157b70 2023-12-24T20:07:18.878 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.876+0000 7f941d1c7700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f93fc066f30 0x7f93fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:18.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.877+0000 7f941d1c7700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f93fc066f30 0x7f93fc0693e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f94140099b0 tx=0x7f9414017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:18.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:18.881+0000 7f940d7fa700 1 -- 172.21.15.61:0/2399389962 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94180c37b0 con 0x7f9418157b70 2023-12-24T20:07:19.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.074+0000 7f941f42b700 1 -- 172.21.15.61:0/2399389962 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f941815b570 con 0x7f9418157b70 2023-12-24T20:07:19.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.720+0000 7f940d7fa700 1 -- 172.21.15.61:0/2399389962 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v183) v1 ==== 170+0+0 (secure 0 0 0) 0x7f94100554e0 con 0x7f9418157b70 2023-12-24T20:07:19.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.732+0000 7f941f42b700 1 -- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f93fc066f30 msgr2=0x7f93fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:19.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.732+0000 7f941f42b700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f93fc066f30 0x7f93fc0693e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f94140099b0 tx=0x7f9414017000 comp rx=0 tx=0).stop 2023-12-24T20:07:19.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.732+0000 7f941f42b700 1 -- 172.21.15.61:0/2399389962 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 msgr2=0x7f9418152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:19.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.732+0000 7f941f42b700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 0x7f9418152240 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f941000c8e0 tx=0x7f9410001710 comp rx=0 tx=0).stop 2023-12-24T20:07:19.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.733+0000 7f941f42b700 1 -- 172.21.15.61:0/2399389962 shutdown_connections 2023-12-24T20:07:19.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.733+0000 7f941f42b700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9418068980 0x7f941816a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:19.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.733+0000 7f941f42b700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f93fc066f30 0x7f93fc0693e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:19.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.733+0000 7f941f42b700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9418157b70 0x7f9418152240 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:19.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.733+0000 7f941f42b700 1 --2- 172.21.15.61:0/2399389962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9418070b80 0x7f94180c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:19.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.733+0000 7f941f42b700 1 -- 172.21.15.61:0/2399389962 >> 172.21.15.61:0/2399389962 conn(0x7f94180ce420 msgr2=0x7f94181589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:19.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.733+0000 7f941f42b700 1 -- 172.21.15.61:0/2399389962 shutdown_connections 2023-12-24T20:07:19.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.733+0000 7f941f42b700 1 -- 172.21.15.61:0/2399389962 wait complete. 2023-12-24T20:07:19.734 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-12-24T20:07:19.750 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-24T20:07:19.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.883+0000 7fe8044e8700 1 Processor -- start 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.883+0000 7fe8044e8700 1 -- start start 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe8044e8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe7fc15ac00 0x7fe7fc0c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe8044e8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7fc0c7c30 0x7fe7fc0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe8044e8700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0c8c30 con 0x7fe7fc15afd0 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe8044e8700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc0c80b0 con 0x7fe7fc15ac00 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe8044e8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc0c8390 con 0x7fe7fc0c7c30 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe802284700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fe7fc15ac00 0x7fe7fc0c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe802a85700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe7fc15afd0 0x7fe7fc15d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40392/0 (socket says 172.21.15.61:40392) 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe802a85700 1 -- 172.21.15.61:0/3959578340 learned_addr learned my addr 172.21.15.61:0/3959578340 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe801a83700 1 --2- 172.21.15.61:0/3959578340 >> v2:172.21.15.133:3300/0 conn(0x7fe7fc0c7c30 0x7fe7fc0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe802284700 1 -- 172.21.15.61:0/3959578340 >> v2:172.21.15.133:3300/0 conn(0x7fe7fc0c7c30 msgr2=0x7fe7fc0cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:19.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe802284700 1 --2- 172.21.15.61:0/3959578340 >> v2:172.21.15.133:3300/0 conn(0x7fe7fc0c7c30 0x7fe7fc0cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe802284700 1 -- 172.21.15.61:0/3959578340 >> v1:172.21.15.61:6789/0 conn(0x7fe7fc15afd0 legacy=0x7fe7fc15d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe802284700 1 -- 172.21.15.61:0/3959578340 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc0c8670 con 0x7fe7fc15ac00 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe801282700 1 -- 172.21.15.61:0/3959578340 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11007913 0 0) 0x7fe7fc0c8c30 con 0x7fe7fc15afd0 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.884+0000 7fe802284700 1 --2- 172.21.15.61:0/3959578340 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc15ac00 0x7fe7fc0c76f0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0c9ab0 tx=0x7fe7f8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a534ebc6d5f57187 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe801282700 1 -- 172.21.15.61:0/3959578340 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8005c10 con 0x7fe7fc15ac00 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe801282700 1 -- 172.21.15.61:0/3959578340 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f8005d70 con 0x7fe7fc15ac00 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe801282700 1 -- 172.21.15.61:0/3959578340 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8006260 con 0x7fe7fc15ac00 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe8044e8700 1 -- 172.21.15.61:0/3959578340 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc15ac00 msgr2=0x7fe7fc0c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe8044e8700 1 --2- 172.21.15.61:0/3959578340 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc15ac00 0x7fe7fc0c76f0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0c9ab0 tx=0x7fe7f8009120 comp rx=0 tx=0).stop 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe8044e8700 1 -- 172.21.15.61:0/3959578340 shutdown_connections 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe8044e8700 1 --2- 172.21.15.61:0/3959578340 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc15ac00 0x7fe7fc0c76f0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe8044e8700 1 --2- 172.21.15.61:0/3959578340 >> v2:172.21.15.133:3300/0 conn(0x7fe7fc0c7c30 0x7fe7fc0cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe8044e8700 1 -- 172.21.15.61:0/3959578340 >> 172.21.15.61:0/3959578340 conn(0x7fe7fc0cd0b0 msgr2=0x7fe7fc0cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe8044e8700 1 -- 172.21.15.61:0/3959578340 shutdown_connections 2023-12-24T20:07:19.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.885+0000 7fe8044e8700 1 -- 172.21.15.61:0/3959578340 wait complete. 2023-12-24T20:07:19.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.886+0000 7fe8044e8700 1 Processor -- start 2023-12-24T20:07:19.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.886+0000 7fe8044e8700 1 -- start start 2023-12-24T20:07:19.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.887+0000 7fe8044e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7fc15ac00 0x7fe7fc151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.887+0000 7fe8044e8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7fc15afd0 0x7fe7fc0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.887+0000 7fe8044e8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc0af330 0x7fe7fc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.887+0000 7fe8044e8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0c4660 con 0x7fe7fc0af330 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.887+0000 7fe8044e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0ae030 con 0x7fe7fc15ac00 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.887+0000 7fe8044e8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0ae310 con 0x7fe7fc15afd0 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.887+0000 7fe802a85700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc0af330 0x7fe7fc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.887+0000 7fe802a85700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc0af330 0x7fe7fc06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41046/0 (socket says 172.21.15.61:41046) 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.887+0000 7fe802a85700 1 -- 172.21.15.61:0/1695421678 learned_addr learned my addr 172.21.15.61:0/1695421678 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe802284700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7fc15ac00 0x7fe7fc151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe801a83700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7fc15afd0 0x7fe7fc0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe802a85700 1 -- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7fc15afd0 msgr2=0x7fe7fc0aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe802a85700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7fc15afd0 0x7fe7fc0aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:19.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe802a85700 1 -- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7fc15ac00 msgr2=0x7fe7fc151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe802a85700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7fc15ac00 0x7fe7fc151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe802a85700 1 -- 172.21.15.61:0/1695421678 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f80093c0 con 0x7fe7fc0af330 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe802284700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7fc15ac00 0x7fe7fc151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe802a85700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc0af330 0x7fe7fc06d5b0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400ccc0 tx=0x7fe7f4001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe7f27fc700 1 -- 172.21.15.61:0/1695421678 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f400ab10 con 0x7fe7fc0af330 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe7f27fc700 1 -- 172.21.15.61:0/1695421678 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f400ac70 con 0x7fe7fc0af330 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe8044e8700 1 -- 172.21.15.61:0/1695421678 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc0ae5f0 con 0x7fe7fc0af330 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe7f27fc700 1 -- 172.21.15.61:0/1695421678 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40070f0 con 0x7fe7fc0af330 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.888+0000 7fe8044e8700 1 -- 172.21.15.61:0/1695421678 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc152030 con 0x7fe7fc0af330 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.889+0000 7fe8044e8700 1 -- 172.21.15.61:0/1695421678 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc152250 con 0x7fe7fc0af330 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.889+0000 7fe7f27fc700 1 -- 172.21.15.61:0/1695421678 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe7f4007520 con 0x7fe7fc0af330 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.890+0000 7fe7f27fc700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7e0066f30 0x7fe7e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.890+0000 7fe7f27fc700 1 -- 172.21.15.61:0/1695421678 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fe7f4084940 con 0x7fe7fc0af330 2023-12-24T20:07:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.890+0000 7fe802284700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7e0066f30 0x7fe7e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.891+0000 7fe802284700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7e0066f30 0x7fe7e00693e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0c9ab0 tx=0x7fe7f8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:19.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:19.895+0000 7fe7f27fc700 1 -- 172.21.15.61:0/1695421678 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7f4051c90 con 0x7fe7fc0af330 2023-12-24T20:07:20.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.137+0000 7fe8044e8700 1 -- 172.21.15.61:0/1695421678 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe7fc04c3c0 con 0x7fe7fc0af330 2023-12-24T20:07:20.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.743+0000 7fe7f27fc700 1 -- 172.21.15.61:0/1695421678 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v88) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe7f40552b0 con 0x7fe7fc0af330 2023-12-24T20:07:20.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.749+0000 7fe8044e8700 1 -- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7e0066f30 msgr2=0x7fe7e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:20.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.749+0000 7fe8044e8700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7e0066f30 0x7fe7e00693e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0c9ab0 tx=0x7fe7f8016000 comp rx=0 tx=0).stop 2023-12-24T20:07:20.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.749+0000 7fe8044e8700 1 -- 172.21.15.61:0/1695421678 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc0af330 msgr2=0x7fe7fc06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:20.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.749+0000 7fe8044e8700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc0af330 0x7fe7fc06d5b0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400ccc0 tx=0x7fe7f4001a20 comp rx=0 tx=0).stop 2023-12-24T20:07:20.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.751+0000 7fe8044e8700 1 -- 172.21.15.61:0/1695421678 shutdown_connections 2023-12-24T20:07:20.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.751+0000 7fe8044e8700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe7e0066f30 0x7fe7e00693e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.751+0000 7fe8044e8700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7fc0af330 0x7fe7fc06d5b0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.751+0000 7fe8044e8700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7fc15ac00 0x7fe7fc151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.751+0000 7fe8044e8700 1 --2- 172.21.15.61:0/1695421678 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7fc15afd0 0x7fe7fc0aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.751+0000 7fe8044e8700 1 -- 172.21.15.61:0/1695421678 >> 172.21.15.61:0/1695421678 conn(0x7fe7fc0cd0b0 msgr2=0x7fe7fc0c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:20.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.755+0000 7fe8044e8700 1 -- 172.21.15.61:0/1695421678 shutdown_connections 2023-12-24T20:07:20.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.755+0000 7fe8044e8700 1 -- 172.21.15.61:0/1695421678 wait complete. 2023-12-24T20:07:20.759 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 22 and data pool 23 2023-12-24T20:07:20.773 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:07:20.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.896+0000 7f1af8621700 1 Processor -- start 2023-12-24T20:07:20.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.896+0000 7f1af8621700 1 -- start start 2023-12-24T20:07:20.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af8621700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1af0157780 0x7f1af006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:20.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af8621700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af00ca270 0x7f1af00cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:20.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af8621700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1af006c840 0x7f1af00ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:20.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af8621700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af00ca6f0 con 0x7f1af006c840 2023-12-24T20:07:20.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af8621700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af00ca9d0 con 0x7f1af0157780 2023-12-24T20:07:20.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af8621700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00cacb0 con 0x7f1af00ca270 2023-12-24T20:07:20.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af6bbe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1af006c840 0x7f1af00ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:20.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af6bbe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1af006c840 0x7f1af00ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41052/0 (socket says 172.21.15.61:41052) 2023-12-24T20:07:20.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af6bbe700 1 -- 172.21.15.61:0/1286362193 learned_addr learned my addr 172.21.15.61:0/1286362193 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:20.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af63bd700 1 --2- 172.21.15.61:0/1286362193 >> v2:172.21.15.133:3300/0 conn(0x7f1af0157780 0x7f1af006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af5bbc700 1 --2- 172.21.15.61:0/1286362193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af00ca270 0x7f1af00cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af6bbe700 1 -- 172.21.15.61:0/1286362193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af00ca270 msgr2=0x7f1af00cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af6bbe700 1 --2- 172.21.15.61:0/1286362193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af00ca270 0x7f1af00cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af6bbe700 1 -- 172.21.15.61:0/1286362193 >> v2:172.21.15.133:3300/0 conn(0x7f1af0157780 msgr2=0x7f1af006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af6bbe700 1 --2- 172.21.15.61:0/1286362193 >> v2:172.21.15.133:3300/0 conn(0x7f1af0157780 0x7f1af006c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af6bbe700 1 -- 172.21.15.61:0/1286362193 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af00caf90 con 0x7f1af006c840 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af5bbc700 1 --2- 172.21.15.61:0/1286362193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af00ca270 0x7f1af00cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af6bbe700 1 --2- 172.21.15.61:0/1286362193 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af006c840 0x7f1af00ce0f0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f1af00cc2b0 tx=0x7f1ae8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925a706815ac17ba server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af53bb700 1 -- 172.21.15.61:0/1286362193 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae800e070 con 0x7f1af006c840 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af53bb700 1 -- 172.21.15.61:0/1286362193 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae800ba50 con 0x7f1af006c840 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.897+0000 7f1af53bb700 1 -- 172.21.15.61:0/1286362193 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae80092e0 con 0x7f1af006c840 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.898+0000 7f1af8621700 1 -- 172.21.15.61:0/1286362193 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af006c840 msgr2=0x7f1af00ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.898+0000 7f1af8621700 1 --2- 172.21.15.61:0/1286362193 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af006c840 0x7f1af00ce0f0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f1af00cc2b0 tx=0x7f1ae8009840 comp rx=0 tx=0).stop 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.898+0000 7f1af8621700 1 -- 172.21.15.61:0/1286362193 shutdown_connections 2023-12-24T20:07:20.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.898+0000 7f1af8621700 1 --2- 172.21.15.61:0/1286362193 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af006c840 0x7f1af00ce0f0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.898+0000 7f1af8621700 1 --2- 172.21.15.61:0/1286362193 >> v2:172.21.15.133:3300/0 conn(0x7f1af0157780 0x7f1af006c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.898+0000 7f1af8621700 1 --2- 172.21.15.61:0/1286362193 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af00ca270 0x7f1af00cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.898+0000 7f1af8621700 1 -- 172.21.15.61:0/1286362193 >> 172.21.15.61:0/1286362193 conn(0x7f1af006b650 msgr2=0x7f1af00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:20.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.898+0000 7f1af8621700 1 -- 172.21.15.61:0/1286362193 shutdown_connections 2023-12-24T20:07:20.901 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.898+0000 7f1af8621700 1 -- 172.21.15.61:0/1286362193 wait complete. 2023-12-24T20:07:20.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.899+0000 7f1af8621700 1 Processor -- start 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.899+0000 7f1af8621700 1 -- start start 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af8621700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af006c840 0x7f1af015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af8621700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af0157780 0x7f1af00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af8621700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af014f790 0x7f1af00cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af8621700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0068270 con 0x7f1af014f790 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af8621700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af01589b0 con 0x7f1af006c840 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af8621700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af0067660 con 0x7f1af0157780 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af6bbe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af014f790 0x7f1af00cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af6bbe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af014f790 0x7f1af00cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41060/0 (socket says 172.21.15.61:41060) 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af6bbe700 1 -- 172.21.15.61:0/1696649246 learned_addr learned my addr 172.21.15.61:0/1696649246 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af63bd700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af006c840 0x7f1af015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af5bbc700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af0157780 0x7f1af00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af6bbe700 1 -- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af0157780 msgr2=0x7f1af00cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:20.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af6bbe700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af0157780 0x7f1af00cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af6bbe700 1 -- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af006c840 msgr2=0x7f1af015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af6bbe700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af006c840 0x7f1af015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.900+0000 7f1af6bbe700 1 -- 172.21.15.61:0/1696649246 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae8009ae0 con 0x7f1af014f790 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.901+0000 7f1af5bbc700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af0157780 0x7f1af00cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.901+0000 7f1af6bbe700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af014f790 0x7f1af00cde60 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8012000 tx=0x7f1ae8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.901+0000 7f1ae67fc700 1 -- 172.21.15.61:0/1696649246 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae80032f0 con 0x7f1af014f790 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.901+0000 7f1ae67fc700 1 -- 172.21.15.61:0/1696649246 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae8008dd0 con 0x7f1af014f790 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.901+0000 7f1af8621700 1 -- 172.21.15.61:0/1696649246 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af0067940 con 0x7f1af014f790 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.901+0000 7f1ae67fc700 1 -- 172.21.15.61:0/1696649246 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae80266b0 con 0x7f1af014f790 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.901+0000 7f1af8621700 1 -- 172.21.15.61:0/1696649246 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af0067f00 con 0x7f1af014f790 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.902+0000 7f1af8621700 1 -- 172.21.15.61:0/1696649246 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af004c3c0 con 0x7f1af014f790 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.902+0000 7f1ae67fc700 1 -- 172.21.15.61:0/1696649246 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1ae8003040 con 0x7f1af014f790 2023-12-24T20:07:20.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.903+0000 7f1ae67fc700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ad4066f30 0x7f1ad40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:20.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.903+0000 7f1ae67fc700 1 -- 172.21.15.61:0/1696649246 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ae80864e0 con 0x7f1af014f790 2023-12-24T20:07:20.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.903+0000 7f1af63bd700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ad4066f30 0x7f1ad40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:20.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.903+0000 7f1af63bd700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ad4066f30 0x7f1ad40693e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1aec006fd0 tx=0x7f1aec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:20.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:20.907+0000 7f1ae67fc700 1 -- 172.21.15.61:0/1696649246 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ae8053750 con 0x7f1af014f790 2023-12-24T20:07:21.102 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.102+0000 7f1af8621700 1 -- 172.21.15.61:0/1696649246 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1af015b560 con 0x7f1af014f790 2023-12-24T20:07:21.103 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.103+0000 7f1ae67fc700 1 -- 172.21.15.61:0/1696649246 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+15378 (secure 0 0 0) 0x7f1ae8009940 con 0x7f1af014f790 2023-12-24T20:07:21.103 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:21.103 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":184,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:07:20.138829+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:07:17.930601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-24T20:07:19.106020+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 -- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ad4066f30 msgr2=0x7f1ad40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ad4066f30 0x7f1ad40693e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1aec006fd0 tx=0x7f1aec008040 comp rx=0 tx=0).stop 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 -- 172.21.15.61:0/1696649246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af014f790 msgr2=0x7f1af00cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af014f790 0x7f1af00cde60 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8012000 tx=0x7f1ae8018000 comp rx=0 tx=0).stop 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 -- 172.21.15.61:0/1696649246 shutdown_connections 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1ad4066f30 0x7f1ad40693e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1af014f790 0x7f1af00cde60 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af006c840 0x7f1af015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 --2- 172.21.15.61:0/1696649246 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1af0157780 0x7f1af00cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 -- 172.21.15.61:0/1696649246 >> 172.21.15.61:0/1696649246 conn(0x7f1af006b650 msgr2=0x7f1af0153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 -- 172.21.15.61:0/1696649246 shutdown_connections 2023-12-24T20:07:21.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.105+0000 7f1af8621700 1 -- 172.21.15.61:0/1696649246 wait complete. 2023-12-24T20:07:21.118 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:07:21.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.239+0000 7fe235e6e700 1 Processor -- start 2023-12-24T20:07:21.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.239+0000 7fe235e6e700 1 -- start start 2023-12-24T20:07:21.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.240+0000 7fe235e6e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe230070800 0x7fe230070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.240+0000 7fe235e6e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe2300af9e0 0x7fe230157580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.240+0000 7fe235e6e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23006e790 con 0x7fe2300afe50 2023-12-24T20:07:21.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.240+0000 7fe235e6e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23006d8e0 con 0x7fe2300af9e0 2023-12-24T20:07:21.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.240+0000 7fe235e6e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23015c500 con 0x7fe230070800 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.240+0000 7fe22ffff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe2300afe50 0x7fe230069b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40404/0 (socket says 172.21.15.61:40404) 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.240+0000 7fe22ffff700 1 -- 172.21.15.61:0/2946014499 learned_addr learned my addr 172.21.15.61:0/2946014499 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22effd700 1 --2- 172.21.15.61:0/2946014499 >> v2:172.21.15.133:3300/0 conn(0x7fe2300af9e0 0x7fe230157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22f7fe700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe230070800 0x7fe230070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962921671 0 0) 0x7fe23006e790 con 0x7fe2300afe50 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe218003570 con 0x7fe2300afe50 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 571251963 0 0) 0x7fe218003570 con 0x7fe2300afe50 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe230070800 msgr2=0x7fe230070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe230070800 0x7fe230070bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 >> v2:172.21.15.133:3300/0 conn(0x7fe2300af9e0 msgr2=0x7fe230157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 --2- 172.21.15.61:0/2946014499 >> v2:172.21.15.133:3300/0 conn(0x7fe2300af9e0 0x7fe230157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23006db80 con 0x7fe2300afe50 2023-12-24T20:07:21.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fe2280017f0 con 0x7fe2300afe50 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 >> v1:172.21.15.61:6789/0 conn(0x7fe2300afe50 legacy=0x7fe230069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe230070800 0x7fe218003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe218003fe0 0x7fe218004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe218004d50 0x7fe2180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23006d8e0 con 0x7fe218004d50 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23015c500 con 0x7fe218003fe0 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21800ba90 con 0x7fe230070800 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22ffff700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe218004d50 0x7fe2180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22effd700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe218003fe0 0x7fe218004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22f7fe700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe230070800 0x7fe218003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22ffff700 1 -- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe230070800 msgr2=0x7fe218003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22ffff700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe230070800 0x7fe218003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22ffff700 1 -- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe218003fe0 msgr2=0x7fe218004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22ffff700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe218003fe0 0x7fe218004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.241+0000 7fe22ffff700 1 -- 172.21.15.61:0/2946014499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe218003570 con 0x7fe218004d50 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe22ffff700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe218004d50 0x7fe2180051c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fe22800a970 tx=0x7fe228002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4682ed0b61c0d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228012440 con 0x7fe218004d50 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2280125c0 con 0x7fe218004d50 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe22e7fc700 1 -- 172.21.15.61:0/2946014499 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228012980 con 0x7fe218004d50 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe235e6e700 1 -- 172.21.15.61:0/2946014499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe218004d50 msgr2=0x7fe2180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe235e6e700 1 --2- 172.21.15.61:0/2946014499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe218004d50 0x7fe2180051c0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fe22800a970 tx=0x7fe228002210 comp rx=0 tx=0).stop 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe22ffff700 1 -- 172.21.15.61:0/2946014499 reap_dead start 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe235e6e700 1 -- 172.21.15.61:0/2946014499 shutdown_connections 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe235e6e700 1 -- 172.21.15.61:0/2946014499 >> 172.21.15.61:0/2946014499 conn(0x7fe2300cd6f0 msgr2=0x7fe2300cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe235e6e700 1 -- 172.21.15.61:0/2946014499 shutdown_connections 2023-12-24T20:07:21.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.242+0000 7fe235e6e700 1 -- 172.21.15.61:0/2946014499 wait complete. 2023-12-24T20:07:21.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.244+0000 7fe235e6e700 1 Processor -- start 2023-12-24T20:07:21.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.244+0000 7fe235e6e700 1 -- start start 2023-12-24T20:07:21.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe235e6e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2300c6b60 0x7fe2300c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe235e6e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2300c6f30 0x7fe2300c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe235e6e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe230156ad0 0x7fe230156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe235e6e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe230157480 con 0x7fe230156ad0 2023-12-24T20:07:21.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe235e6e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23015a9e0 con 0x7fe2300c6f30 2023-12-24T20:07:21.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe235e6e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2300c5250 con 0x7fe2300c6b60 2023-12-24T20:07:21.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe22ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe230156ad0 0x7fe230156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe22ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe230156ad0 0x7fe230156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41072/0 (socket says 172.21.15.61:41072) 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe22ffff700 1 -- 172.21.15.61:0/278442486 learned_addr learned my addr 172.21.15.61:0/278442486 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe22f7fe700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2300c6b60 0x7fe2300c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe22effd700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2300c6f30 0x7fe2300c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe22ffff700 1 -- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2300c6b60 msgr2=0x7fe2300c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe22ffff700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2300c6b60 0x7fe2300c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe22ffff700 1 -- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2300c6f30 msgr2=0x7fe2300c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.245+0000 7fe22ffff700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2300c6f30 0x7fe2300c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.246+0000 7fe22ffff700 1 -- 172.21.15.61:0/278442486 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2300c5530 con 0x7fe230156ad0 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.246+0000 7fe22f7fe700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2300c6b60 0x7fe2300c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.246+0000 7fe22effd700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2300c6f30 0x7fe2300c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.246+0000 7fe22ffff700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe230156ad0 0x7fe230156f40 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe218004730 tx=0x7fe228015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.246+0000 7fe2177fe700 1 -- 172.21.15.61:0/278442486 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228023070 con 0x7fe230156ad0 2023-12-24T20:07:21.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.246+0000 7fe2177fe700 1 -- 172.21.15.61:0/278442486 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2280017b0 con 0x7fe230156ad0 2023-12-24T20:07:21.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.246+0000 7fe2177fe700 1 -- 172.21.15.61:0/278442486 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228007300 con 0x7fe230156ad0 2023-12-24T20:07:21.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.246+0000 7fe235e6e700 1 -- 172.21.15.61:0/278442486 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2300c5810 con 0x7fe230156ad0 2023-12-24T20:07:21.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.246+0000 7fe235e6e700 1 -- 172.21.15.61:0/278442486 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2300c5dd0 con 0x7fe230156ad0 2023-12-24T20:07:21.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.247+0000 7fe235e6e700 1 -- 172.21.15.61:0/278442486 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23004c3c0 con 0x7fe230156ad0 2023-12-24T20:07:21.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.247+0000 7fe2177fe700 1 -- 172.21.15.61:0/278442486 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe228019030 con 0x7fe230156ad0 2023-12-24T20:07:21.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.248+0000 7fe2177fe700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe21c066f30 0x7fe21c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.248+0000 7fe2177fe700 1 -- 172.21.15.61:0/278442486 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe228085f60 con 0x7fe230156ad0 2023-12-24T20:07:21.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.248+0000 7fe22f7fe700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe21c066f30 0x7fe21c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.248+0000 7fe22f7fe700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe21c066f30 0x7fe21c0693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe220006f00 tx=0x7fe220008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:21.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.252+0000 7fe2177fe700 1 -- 172.21.15.61:0/278442486 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2280531d0 con 0x7fe230156ad0 2023-12-24T20:07:21.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.449+0000 7fe235e6e700 1 -- 172.21.15.61:0/278442486 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe23006de60 con 0x7fe230156ad0 2023-12-24T20:07:21.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.449+0000 7fe2177fe700 1 -- 172.21.15.61:0/278442486 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+15378 (secure 0 0 0) 0x7fe2280567f0 con 0x7fe230156ad0 2023-12-24T20:07:21.450 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:21.450 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":184,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:07:20.138829+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:07:17.930601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-24T20:07:19.106020+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:07:21.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.451+0000 7fe235e6e700 1 -- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe21c066f30 msgr2=0x7fe21c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.451+0000 7fe235e6e700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe21c066f30 0x7fe21c0693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe220006f00 tx=0x7fe220008040 comp rx=0 tx=0).stop 2023-12-24T20:07:21.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.451+0000 7fe235e6e700 1 -- 172.21.15.61:0/278442486 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe230156ad0 msgr2=0x7fe230156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.451+0000 7fe235e6e700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe230156ad0 0x7fe230156f40 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe218004730 tx=0x7fe228015000 comp rx=0 tx=0).stop 2023-12-24T20:07:21.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.451+0000 7fe235e6e700 1 -- 172.21.15.61:0/278442486 shutdown_connections 2023-12-24T20:07:21.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.451+0000 7fe235e6e700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe2300c6b60 0x7fe2300c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.451+0000 7fe235e6e700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe21c066f30 0x7fe21c0693e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.451+0000 7fe235e6e700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe230156ad0 0x7fe230156f40 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.451+0000 7fe235e6e700 1 --2- 172.21.15.61:0/278442486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2300c6f30 0x7fe2300c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.451+0000 7fe235e6e700 1 -- 172.21.15.61:0/278442486 >> 172.21.15.61:0/278442486 conn(0x7fe2300cd6f0 msgr2=0x7fe2300b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:21.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.452+0000 7fe235e6e700 1 -- 172.21.15.61:0/278442486 shutdown_connections 2023-12-24T20:07:21.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.452+0000 7fe235e6e700 1 -- 172.21.15.61:0/278442486 wait complete. 2023-12-24T20:07:21.464 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-24T20:07:21.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.589+0000 7f4d875cf700 1 Processor -- start 2023-12-24T20:07:21.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.589+0000 7f4d875cf700 1 -- start start 2023-12-24T20:07:21.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d875cf700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d8015ac00 0x7f4d800c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d875cf700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d800c8c30 con 0x7f4d800c7c30 2023-12-24T20:07:21.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d875cf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d800c80b0 con 0x7f4d800cb5a0 2023-12-24T20:07:21.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d875cf700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d800c8390 con 0x7f4d8015ac00 2023-12-24T20:07:21.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d8536b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d8015ac00 0x7f4d800c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d84b6a700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4d800c7c30 0x7f4d800cae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40416/0 (socket says 172.21.15.61:40416) 2023-12-24T20:07:21.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d84b6a700 1 -- 172.21.15.61:0/3015552201 learned_addr learned my addr 172.21.15.61:0/3015552201 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:21.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d8536b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d8015ac00 0x7f4d800c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41078/0 (socket says 172.21.15.61:41078) 2023-12-24T20:07:21.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d8536b700 1 -- 172.21.15.61:0/3015552201 >> v1:172.21.15.133:6789/0 conn(0x7f4d800cb5a0 legacy=0x7f4d800aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:21.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d8536b700 1 -- 172.21.15.61:0/3015552201 >> v1:172.21.15.61:6789/0 conn(0x7f4d800c7c30 legacy=0x7f4d800cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d8536b700 1 -- 172.21.15.61:0/3015552201 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d800c8670 con 0x7f4d8015ac00 2023-12-24T20:07:21.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d8536b700 1 --2- 172.21.15.61:0/3015552201 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d8015ac00 0x7f4d800c76f0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0098d0 tx=0x7f4d7c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b502d79cc729ee0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:21.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.590+0000 7f4d77fff700 1 -- 172.21.15.61:0/3015552201 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c009e70 con 0x7f4d8015ac00 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.591+0000 7f4d77fff700 1 -- 172.21.15.61:0/3015552201 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c005c10 con 0x7f4d8015ac00 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.591+0000 7f4d77fff700 1 -- 172.21.15.61:0/3015552201 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00b610 con 0x7f4d8015ac00 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.591+0000 7f4d875cf700 1 -- 172.21.15.61:0/3015552201 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d8015ac00 msgr2=0x7f4d800c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.591+0000 7f4d875cf700 1 --2- 172.21.15.61:0/3015552201 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d8015ac00 0x7f4d800c76f0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0098d0 tx=0x7f4d7c009120 comp rx=0 tx=0).stop 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.591+0000 7f4d875cf700 1 -- 172.21.15.61:0/3015552201 shutdown_connections 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.591+0000 7f4d875cf700 1 --2- 172.21.15.61:0/3015552201 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d8015ac00 0x7f4d800c76f0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.591+0000 7f4d875cf700 1 -- 172.21.15.61:0/3015552201 >> 172.21.15.61:0/3015552201 conn(0x7f4d800cd0b0 msgr2=0x7f4d800cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.591+0000 7f4d875cf700 1 -- 172.21.15.61:0/3015552201 shutdown_connections 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.591+0000 7f4d875cf700 1 -- 172.21.15.61:0/3015552201 wait complete. 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.592+0000 7f4d875cf700 1 Processor -- start 2023-12-24T20:07:21.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.592+0000 7f4d875cf700 1 -- start start 2023-12-24T20:07:21.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d875cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d800cb5a0 0x7f4d800afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d875cf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8015ac00 0x7f4d80151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d875cf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d801525c0 0x7f4d800b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d875cf700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800c4a00 con 0x7f4d801525c0 2023-12-24T20:07:21.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d875cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d80152de0 con 0x7f4d800cb5a0 2023-12-24T20:07:21.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d875cf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d800b0430 con 0x7f4d8015ac00 2023-12-24T20:07:21.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d85b6c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d801525c0 0x7f4d800b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d85b6c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d801525c0 0x7f4d800b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41090/0 (socket says 172.21.15.61:41090) 2023-12-24T20:07:21.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d85b6c700 1 -- 172.21.15.61:0/1978553904 learned_addr learned my addr 172.21.15.61:0/1978553904 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:21.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d8536b700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d800cb5a0 0x7f4d800afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.593+0000 7f4d84b6a700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8015ac00 0x7f4d80151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d85b6c700 1 -- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8015ac00 msgr2=0x7f4d80151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d85b6c700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8015ac00 0x7f4d80151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d85b6c700 1 -- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d800cb5a0 msgr2=0x7f4d800afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:21.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d85b6c700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d800cb5a0 0x7f4d800afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:21.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d85b6c700 1 -- 172.21.15.61:0/1978553904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0093c0 con 0x7f4d801525c0 2023-12-24T20:07:21.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d84b6a700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8015ac00 0x7f4d80151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:21.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d85b6c700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d801525c0 0x7f4d800b1090 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c890 tx=0x7f4d780026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:21.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d757fa700 1 -- 172.21.15.61:0/1978553904 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78012630 con 0x7f4d801525c0 2023-12-24T20:07:21.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d757fa700 1 -- 172.21.15.61:0/1978553904 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78012790 con 0x7f4d801525c0 2023-12-24T20:07:21.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d757fa700 1 -- 172.21.15.61:0/1978553904 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78012b50 con 0x7f4d801525c0 2023-12-24T20:07:21.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d875cf700 1 -- 172.21.15.61:0/1978553904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d800b0710 con 0x7f4d801525c0 2023-12-24T20:07:21.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.594+0000 7f4d875cf700 1 -- 172.21.15.61:0/1978553904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d800b0cd0 con 0x7f4d801525c0 2023-12-24T20:07:21.599 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.595+0000 7f4d875cf700 1 -- 172.21.15.61:0/1978553904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d800c4b70 con 0x7f4d801525c0 2023-12-24T20:07:21.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.595+0000 7f4d757fa700 1 -- 172.21.15.61:0/1978553904 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4d7801b400 con 0x7f4d801525c0 2023-12-24T20:07:21.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.596+0000 7f4d757fa700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d64066f30 0x7f4d640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:21.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.596+0000 7f4d757fa700 1 -- 172.21.15.61:0/1978553904 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d78084850 con 0x7f4d801525c0 2023-12-24T20:07:21.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.596+0000 7f4d8536b700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d64066f30 0x7f4d640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:21.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.596+0000 7f4d8536b700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d64066f30 0x7f4d640693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009160 tx=0x7f4d7c015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:21.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.600+0000 7f4d757fa700 1 -- 172.21.15.61:0/1978553904 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d800c4b70 con 0x7f4d801525c0 2023-12-24T20:07:21.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:21.845+0000 7f4d875cf700 1 -- 172.21.15.61:0/1978553904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4d800c4b40 con 0x7f4d801525c0 2023-12-24T20:07:22.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.771+0000 7f4d757fa700 1 -- 172.21.15.61:0/1978553904 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4d78051b70 con 0x7f4d801525c0 2023-12-24T20:07:22.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 -- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d64066f30 msgr2=0x7f4d640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d64066f30 0x7f4d640693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009160 tx=0x7f4d7c015000 comp rx=0 tx=0).stop 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 -- 172.21.15.61:0/1978553904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d801525c0 msgr2=0x7f4d800b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d801525c0 0x7f4d800b1090 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c890 tx=0x7f4d780026a0 comp rx=0 tx=0).stop 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 -- 172.21.15.61:0/1978553904 shutdown_connections 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4d64066f30 0x7f4d640693e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d801525c0 0x7f4d800b1090 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d800cb5a0 0x7f4d800afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 --2- 172.21.15.61:0/1978553904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4d8015ac00 0x7f4d80151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 -- 172.21.15.61:0/1978553904 >> 172.21.15.61:0/1978553904 conn(0x7f4d800cd0b0 msgr2=0x7f4d8006dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 -- 172.21.15.61:0/1978553904 shutdown_connections 2023-12-24T20:07:22.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.774+0000 7f4d875cf700 1 -- 172.21.15.61:0/1978553904 wait complete. 2023-12-24T20:07:22.789 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-24T20:07:22.921 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.921+0000 7f4c2f73e700 1 Processor -- start 2023-12-24T20:07:22.922 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.921+0000 7f4c2f73e700 1 -- start start 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.922+0000 7f4c2f73e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c28156830 0x7f4c280c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.922+0000 7f4c2f73e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4c28156c00 0x7f4c280c3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.922+0000 7f4c2f73e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c280c8690 con 0x7f4c280cac50 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.922+0000 7f4c2f73e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c280c3870 con 0x7f4c28156c00 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.922+0000 7f4c2f73e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c28069f00 con 0x7f4c28156830 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.922+0000 7f4c2ccd9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4c28156c00 0x7f4c280c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.922+0000 7f4c2ccd9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4c28156c00 0x7f4c280c3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41096/0 (socket says 172.21.15.61:41096) 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.922+0000 7f4c2ccd9700 1 -- 172.21.15.61:0/577003941 learned_addr learned my addr 172.21.15.61:0/577003941 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2d4da700 1 --2- 172.21.15.61:0/577003941 >> v2:172.21.15.133:3300/0 conn(0x7f4c28156830 0x7f4c280c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2ccd9700 1 -- 172.21.15.61:0/577003941 >> v2:172.21.15.133:3300/0 conn(0x7f4c28156830 msgr2=0x7f4c280c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:22.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2ccd9700 1 --2- 172.21.15.61:0/577003941 >> v2:172.21.15.133:3300/0 conn(0x7f4c28156830 0x7f4c280c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2ccd9700 1 -- 172.21.15.61:0/577003941 >> v1:172.21.15.133:6789/0 conn(0x7f4c280cac50 legacy=0x7f4c28067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2ccd9700 1 -- 172.21.15.61:0/577003941 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2806a1e0 con 0x7f4c28156c00 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2d4da700 1 --2- 172.21.15.61:0/577003941 >> v2:172.21.15.133:3300/0 conn(0x7f4c28156830 0x7f4c280c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2ccd9700 1 --2- 172.21.15.61:0/577003941 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 0x7f4c280c3330 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f4c28064820 tx=0x7f4c24009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e92b1daa76c4462 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c1ffff700 1 -- 172.21.15.61:0/577003941 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c24005c10 con 0x7f4c28156c00 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c1ffff700 1 -- 172.21.15.61:0/577003941 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c24005d70 con 0x7f4c28156c00 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c1ffff700 1 -- 172.21.15.61:0/577003941 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2400b860 con 0x7f4c28156c00 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2f73e700 1 -- 172.21.15.61:0/577003941 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 msgr2=0x7f4c280c3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2f73e700 1 --2- 172.21.15.61:0/577003941 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 0x7f4c280c3330 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f4c28064820 tx=0x7f4c24009220 comp rx=0 tx=0).stop 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2f73e700 1 -- 172.21.15.61:0/577003941 shutdown_connections 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.923+0000 7f4c2f73e700 1 --2- 172.21.15.61:0/577003941 >> v2:172.21.15.133:3300/0 conn(0x7f4c28156830 0x7f4c280c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.924+0000 7f4c2f73e700 1 --2- 172.21.15.61:0/577003941 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 0x7f4c280c3330 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.924+0000 7f4c2f73e700 1 -- 172.21.15.61:0/577003941 >> 172.21.15.61:0/577003941 conn(0x7f4c280ce1f0 msgr2=0x7f4c280ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:22.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.924+0000 7f4c2f73e700 1 -- 172.21.15.61:0/577003941 shutdown_connections 2023-12-24T20:07:22.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.924+0000 7f4c2f73e700 1 -- 172.21.15.61:0/577003941 wait complete. 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.925+0000 7f4c2f73e700 1 Processor -- start 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.925+0000 7f4c2f73e700 1 -- start start 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2f73e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c280cac50 0x7f4c28158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2f73e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c28156830 0x7f4c280c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2f73e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 0x7f4c280cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2f73e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28159180 con 0x7f4c28156c00 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2f73e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28167910 con 0x7f4c280cac50 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2f73e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28166aa0 con 0x7f4c28156830 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2dcdb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 0x7f4c280cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2dcdb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 0x7f4c280cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41110/0 (socket says 172.21.15.61:41110) 2023-12-24T20:07:22.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2dcdb700 1 -- 172.21.15.61:0/2557772689 learned_addr learned my addr 172.21.15.61:0/2557772689 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:22.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2d4da700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c280cac50 0x7f4c28158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:22.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2ccd9700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c28156830 0x7f4c280c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:22.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2dcdb700 1 -- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c28156830 msgr2=0x7f4c280c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:22.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2dcdb700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c28156830 0x7f4c280c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:22.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2dcdb700 1 -- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c280cac50 msgr2=0x7f4c28158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:22.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2dcdb700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c280cac50 0x7f4c28158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:22.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2dcdb700 1 -- 172.21.15.61:0/2557772689 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24009480 con 0x7f4c28156c00 2023-12-24T20:07:22.929 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.926+0000 7f4c2dcdb700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 0x7f4c280cb7b0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000bda0 tx=0x7f4c2000ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:22.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.927+0000 7f4c1d7fa700 1 -- 172.21.15.61:0/2557772689 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2000b2e0 con 0x7f4c28156c00 2023-12-24T20:07:22.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.927+0000 7f4c1d7fa700 1 -- 172.21.15.61:0/2557772689 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2000b440 con 0x7f4c28156c00 2023-12-24T20:07:22.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.927+0000 7f4c2f73e700 1 -- 172.21.15.61:0/2557772689 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c28166d00 con 0x7f4c28156c00 2023-12-24T20:07:22.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.927+0000 7f4c1d7fa700 1 -- 172.21.15.61:0/2557772689 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2000ebe0 con 0x7f4c28156c00 2023-12-24T20:07:22.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.927+0000 7f4c2f73e700 1 -- 172.21.15.61:0/2557772689 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c281672c0 con 0x7f4c28156c00 2023-12-24T20:07:22.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.928+0000 7f4c2f73e700 1 -- 172.21.15.61:0/2557772689 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2804c3c0 con 0x7f4c28156c00 2023-12-24T20:07:22.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.928+0000 7f4c1d7fa700 1 -- 172.21.15.61:0/2557772689 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4c20014070 con 0x7f4c28156c00 2023-12-24T20:07:22.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.929+0000 7f4c1d7fa700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c0c066f60 0x7f4c0c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:22.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.929+0000 7f4c1d7fa700 1 -- 172.21.15.61:0/2557772689 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c200862c0 con 0x7f4c28156c00 2023-12-24T20:07:22.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.929+0000 7f4c2d4da700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c0c066f60 0x7f4c0c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:22.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.929+0000 7f4c2d4da700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c0c066f60 0x7f4c0c069410 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800ac00 tx=0x7f4c18006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:22.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:22.933+0000 7f4c1d7fa700 1 -- 172.21.15.61:0/2557772689 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c20053530 con 0x7f4c28156c00 2023-12-24T20:07:23.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.173+0000 7f4c2f73e700 1 -- 172.21.15.61:0/2557772689 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4c280c9180 con 0x7f4c28156c00 2023-12-24T20:07:23.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.775+0000 7f4c1d7fa700 1 -- 172.21.15.61:0/2557772689 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v92) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4c20056b50 con 0x7f4c28156c00 2023-12-24T20:07:23.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 -- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c0c066f60 msgr2=0x7f4c0c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:23.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c0c066f60 0x7f4c0c069410 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800ac00 tx=0x7f4c18006f90 comp rx=0 tx=0).stop 2023-12-24T20:07:23.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 -- 172.21.15.61:0/2557772689 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 msgr2=0x7f4c280cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:23.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 0x7f4c280cb7b0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000bda0 tx=0x7f4c2000ba30 comp rx=0 tx=0).stop 2023-12-24T20:07:23.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 -- 172.21.15.61:0/2557772689 shutdown_connections 2023-12-24T20:07:23.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4c0c066f60 0x7f4c0c069410 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:23.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4c28156c00 0x7f4c280cb7b0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:23.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c280cac50 0x7f4c28158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:23.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 --2- 172.21.15.61:0/2557772689 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4c28156830 0x7f4c280c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:23.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 -- 172.21.15.61:0/2557772689 >> 172.21.15.61:0/2557772689 conn(0x7f4c280ce1f0 msgr2=0x7f4c28155ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:23.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 -- 172.21.15.61:0/2557772689 shutdown_connections 2023-12-24T20:07:23.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.778+0000 7f4c2f73e700 1 -- 172.21.15.61:0/2557772689 wait complete. 2023-12-24T20:07:23.792 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:07:23.930 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.918+0000 7f2889af1700 1 Processor -- start 2023-12-24T20:07:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.919+0000 7f2889af1700 1 -- start start 2023-12-24T20:07:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.919+0000 7f2889af1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2884150cb0 0x7f288406ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.919+0000 7f2889af1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2884151080 0x7f288406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.919+0000 7f2889af1700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288406f440 con 0x7f2884156e40 2023-12-24T20:07:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.919+0000 7f2889af1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2884064000 con 0x7f2884150cb0 2023-12-24T20:07:23.931 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.919+0000 7f2889af1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28841573b0 con 0x7f2884151080 2023-12-24T20:07:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.919+0000 7f28837fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2884150cb0 0x7f288406ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f2883fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2884156e40 0x7f288415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40424/0 (socket says 172.21.15.61:40424) 2023-12-24T20:07:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f28837fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2884150cb0 0x7f288406ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41124/0 (socket says 172.21.15.61:41124) 2023-12-24T20:07:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f2883fff700 1 -- 172.21.15.61:0/1799142452 learned_addr learned my addr 172.21.15.61:0/1799142452 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f2882ffd700 1 --2- 172.21.15.61:0/1799142452 >> v2:172.21.15.133:3300/0 conn(0x7f2884151080 0x7f288406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f28837fe700 1 -- 172.21.15.61:0/1799142452 >> v2:172.21.15.133:3300/0 conn(0x7f2884151080 msgr2=0x7f288406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f28837fe700 1 --2- 172.21.15.61:0/1799142452 >> v2:172.21.15.133:3300/0 conn(0x7f2884151080 0x7f288406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:23.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f28837fe700 1 -- 172.21.15.61:0/1799142452 >> v1:172.21.15.61:6789/0 conn(0x7f2884156e40 legacy=0x7f288415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f28837fe700 1 -- 172.21.15.61:0/1799142452 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2884157690 con 0x7f2884150cb0 2023-12-24T20:07:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f28827fc700 1 -- 172.21.15.61:0/1799142452 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233172420 0 0) 0x7f287c001490 con 0x7f2884156e40 2023-12-24T20:07:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f2882ffd700 1 --2- 172.21.15.61:0/1799142452 >> v2:172.21.15.133:3300/0 conn(0x7f2884151080 0x7f288406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:23.933 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f28837fe700 1 --2- 172.21.15.61:0/1799142452 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884150cb0 0x7f288406ef00 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f2884064320 tx=0x7f28740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2080bedbc6e22296 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f28827fc700 1 -- 172.21.15.61:0/1799142452 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400b6b0 con 0x7f2884150cb0 2023-12-24T20:07:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f28827fc700 1 -- 172.21.15.61:0/1799142452 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400b810 con 0x7f2884150cb0 2023-12-24T20:07:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.920+0000 7f28827fc700 1 -- 172.21.15.61:0/1799142452 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400bbb0 con 0x7f2884150cb0 2023-12-24T20:07:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.921+0000 7f2889af1700 1 -- 172.21.15.61:0/1799142452 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884150cb0 msgr2=0x7f288406ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.921+0000 7f2889af1700 1 --2- 172.21.15.61:0/1799142452 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884150cb0 0x7f288406ef00 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f2884064320 tx=0x7f28740091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:23.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.921+0000 7f2889af1700 1 -- 172.21.15.61:0/1799142452 shutdown_connections 2023-12-24T20:07:23.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.921+0000 7f2889af1700 1 --2- 172.21.15.61:0/1799142452 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884150cb0 0x7f288406ef00 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:23.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.921+0000 7f2889af1700 1 --2- 172.21.15.61:0/1799142452 >> v2:172.21.15.133:3300/0 conn(0x7f2884151080 0x7f288406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:23.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.921+0000 7f2889af1700 1 -- 172.21.15.61:0/1799142452 >> 172.21.15.61:0/1799142452 conn(0x7f28840cceb0 msgr2=0x7f28840cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:23.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.921+0000 7f2889af1700 1 -- 172.21.15.61:0/1799142452 shutdown_connections 2023-12-24T20:07:23.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.921+0000 7f2889af1700 1 -- 172.21.15.61:0/1799142452 wait complete. 2023-12-24T20:07:23.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.922+0000 7f2889af1700 1 Processor -- start 2023-12-24T20:07:23.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.922+0000 7f2889af1700 1 -- start start 2023-12-24T20:07:23.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2889af1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2884150cb0 0x7f28840b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:23.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2889af1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2884151080 0x7f28840afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:23.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2889af1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884156e40 0x7f2884158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:23.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2889af1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840b2bb0 con 0x7f2884156e40 2023-12-24T20:07:23.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2889af1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840b1d50 con 0x7f2884151080 2023-12-24T20:07:23.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2889af1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28840b02c0 con 0x7f2884150cb0 2023-12-24T20:07:23.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2883fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884156e40 0x7f2884158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:23.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2883fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884156e40 0x7f2884158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41134/0 (socket says 172.21.15.61:41134) 2023-12-24T20:07:23.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2883fff700 1 -- 172.21.15.61:0/1871505597 learned_addr learned my addr 172.21.15.61:0/1871505597 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f28837fe700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2884150cb0 0x7f28840b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2882ffd700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2884151080 0x7f28840afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2883fff700 1 -- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2884150cb0 msgr2=0x7f28840b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2883fff700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2884150cb0 0x7f28840b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2883fff700 1 -- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2884151080 msgr2=0x7f28840afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2883fff700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2884151080 0x7f28840afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2883fff700 1 -- 172.21.15.61:0/1871505597 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874009420 con 0x7f2884156e40 2023-12-24T20:07:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.923+0000 7f2882ffd700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2884151080 0x7f28840afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.924+0000 7f2883fff700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884156e40 0x7f2884158690 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f287c00ccf0 tx=0x7f287c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:23.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.924+0000 7f286b7fe700 1 -- 172.21.15.61:0/1871505597 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00a920 con 0x7f2884156e40 2023-12-24T20:07:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.924+0000 7f286b7fe700 1 -- 172.21.15.61:0/1871505597 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c00aaa0 con 0x7f2884156e40 2023-12-24T20:07:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.924+0000 7f2889af1700 1 -- 172.21.15.61:0/1871505597 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28840b1fa0 con 0x7f2884156e40 2023-12-24T20:07:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.924+0000 7f286b7fe700 1 -- 172.21.15.61:0/1871505597 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00ae60 con 0x7f2884156e40 2023-12-24T20:07:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.924+0000 7f2889af1700 1 -- 172.21.15.61:0/1871505597 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28840b2560 con 0x7f2884156e40 2023-12-24T20:07:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.925+0000 7f2889af1700 1 -- 172.21.15.61:0/1871505597 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288404c3c0 con 0x7f2884156e40 2023-12-24T20:07:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.925+0000 7f286b7fe700 1 -- 172.21.15.61:0/1871505597 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f287c007300 con 0x7f2884156e40 2023-12-24T20:07:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.925+0000 7f286b7fe700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2870066f30 0x7f28700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:23.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.926+0000 7f286b7fe700 1 -- 172.21.15.61:0/1871505597 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f287c084840 con 0x7f2884156e40 2023-12-24T20:07:23.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.926+0000 7f28837fe700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2870066f30 0x7f28700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:23.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.926+0000 7f28837fe700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2870066f30 0x7f28700693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f28740093f0 tx=0x7f2874017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:23.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:23.930+0000 7f286b7fe700 1 -- 172.21.15.61:0/1871505597 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f287c051aa0 con 0x7f2884156e40 2023-12-24T20:07:24.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.170+0000 7f2889af1700 1 -- 172.21.15.61:0/1871505597 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f288406f440 con 0x7f2884156e40 2023-12-24T20:07:24.170 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.170+0000 7f286b7fe700 1 -- 172.21.15.61:0/1871505597 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f288406f440 con 0x7f2884156e40 2023-12-24T20:07:24.171 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:24.171 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1018177900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1018177900},{"type":"v1","addr":"172.21.15.133:6836","nonce":1018177900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2332940307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2332940307},{"type":"v1","addr":"172.21.15.61:6834","nonce":2332940307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/784121250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":784121250},{"type":"v1","addr":"172.21.15.61:6835","nonce":784121250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:07:20.139140+0000","modified":"2023-12-24T20:07:23.769968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8145":{"gid":8145,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2891152875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2891152875},{"type":"v1","addr":"172.21.15.133:6837","nonce":2891152875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 -- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2870066f30 msgr2=0x7f28700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2870066f30 0x7f28700693e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f28740093f0 tx=0x7f2874017000 comp rx=0 tx=0).stop 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 -- 172.21.15.61:0/1871505597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884156e40 msgr2=0x7f2884158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884156e40 0x7f2884158690 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f287c00ccf0 tx=0x7f287c001a10 comp rx=0 tx=0).stop 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 -- 172.21.15.61:0/1871505597 shutdown_connections 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2884150cb0 0x7f28840b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2870066f30 0x7f28700693e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2884156e40 0x7f2884158690 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 --2- 172.21.15.61:0/1871505597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2884151080 0x7f28840afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 -- 172.21.15.61:0/1871505597 >> 172.21.15.61:0/1871505597 conn(0x7f28840cceb0 msgr2=0x7f2884155c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.172+0000 7f2889af1700 1 -- 172.21.15.61:0/1871505597 shutdown_connections 2023-12-24T20:07:24.173 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.173+0000 7f2889af1700 1 -- 172.21.15.61:0/1871505597 wait complete. 2023-12-24T20:07:24.174 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 92 2023-12-24T20:07:24.185 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:07:24.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.306+0000 7f1f569cd700 1 Processor -- start 2023-12-24T20:07:24.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.306+0000 7f1f569cd700 1 -- start start 2023-12-24T20:07:24.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.307+0000 7f1f569cd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f5015bb60 0x7f1f50098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.307+0000 7f1f569cd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 0x7f1f500b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.307+0000 7f1f569cd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f500b2eb0 con 0x7f1f50098aa0 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.307+0000 7f1f569cd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f500afc20 con 0x7f1f5015bb60 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.307+0000 7f1f569cd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500b2bd0 con 0x7f1f500b2660 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f54f6a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 0x7f1f500b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f5015bb60 0x7f1f50098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1f50098aa0 0x7f1f5015bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:60140/0 (socket says 172.21.15.61:60140) 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4f7fe700 1 -- 172.21.15.61:0/3305568677 learned_addr learned my addr 172.21.15.61:0/3305568677 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4effd700 1 -- 172.21.15.61:0/3305568677 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324726990 0 0) 0x7f1f500b2eb0 con 0x7f1f50098aa0 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4effd700 1 -- 172.21.15.61:0/3305568677 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f38003570 con 0x7f1f50098aa0 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4ffff700 1 -- 172.21.15.61:0/3305568677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 msgr2=0x7f1f500b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4ffff700 1 --2- 172.21.15.61:0/3305568677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 0x7f1f500b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4ffff700 1 -- 172.21.15.61:0/3305568677 >> v1:172.21.15.133:6789/0 conn(0x7f1f50098aa0 legacy=0x7f1f5015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4ffff700 1 -- 172.21.15.61:0/3305568677 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500afe10 con 0x7f1f5015bb60 2023-12-24T20:07:24.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f54f6a700 1 --2- 172.21.15.61:0/3305568677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 0x7f1f500b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4ffff700 1 --2- 172.21.15.61:0/3305568677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5015bb60 0x7f1f50098560 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1f400098d0 tx=0x7f1f40009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f84a90e0edb4d4dc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4effd700 1 -- 172.21.15.61:0/3305568677 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40005c10 con 0x7f1f5015bb60 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4effd700 1 -- 172.21.15.61:0/3305568677 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40005d70 con 0x7f1f5015bb60 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.308+0000 7f1f4effd700 1 -- 172.21.15.61:0/3305568677 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40006260 con 0x7f1f5015bb60 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.309+0000 7f1f569cd700 1 -- 172.21.15.61:0/3305568677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5015bb60 msgr2=0x7f1f50098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.309+0000 7f1f569cd700 1 --2- 172.21.15.61:0/3305568677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5015bb60 0x7f1f50098560 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1f400098d0 tx=0x7f1f40009120 comp rx=0 tx=0).stop 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.309+0000 7f1f569cd700 1 -- 172.21.15.61:0/3305568677 shutdown_connections 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.309+0000 7f1f569cd700 1 --2- 172.21.15.61:0/3305568677 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 0x7f1f500b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.309+0000 7f1f569cd700 1 --2- 172.21.15.61:0/3305568677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5015bb60 0x7f1f50098560 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.309+0000 7f1f569cd700 1 -- 172.21.15.61:0/3305568677 >> 172.21.15.61:0/3305568677 conn(0x7f1f50097a10 msgr2=0x7f1f500ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.309+0000 7f1f569cd700 1 -- 172.21.15.61:0/3305568677 shutdown_connections 2023-12-24T20:07:24.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.309+0000 7f1f569cd700 1 -- 172.21.15.61:0/3305568677 wait complete. 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.310+0000 7f1f569cd700 1 Processor -- start 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.311+0000 7f1f569cd700 1 -- start start 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f569cd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1f50098aa0 0x7f1f500aa190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f569cd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 0x7f1f500aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f569cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5015bb60 0x7f1f50168320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f569cd700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500abc40 con 0x7f1f50098aa0 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f569cd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500a9a80 con 0x7f1f5015bb60 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f569cd700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500ad2e0 con 0x7f1f500b2660 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f4ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1f50098aa0 0x7f1f500aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f4ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1f50098aa0 0x7f1f500aa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41138/0 (socket says 172.21.15.61:41138) 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f4ffff700 1 -- 172.21.15.61:0/381290330 learned_addr learned my addr 172.21.15.61:0/381290330 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:24.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f4f7fe700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 0x7f1f500aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f54f6a700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5015bb60 0x7f1f50168320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f4ffff700 1 -- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 msgr2=0x7f1f500aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f4ffff700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 0x7f1f500aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f4ffff700 1 -- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5015bb60 msgr2=0x7f1f50168320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f4ffff700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5015bb60 0x7f1f50168320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f4ffff700 1 -- 172.21.15.61:0/381290330 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48009a20 con 0x7f1f50098aa0 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f4ffff700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1f50098aa0 0x7f1f500aa190 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006360 tx=0x7f1f40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.312+0000 7f1f37fff700 1 -- 172.21.15.61:0/381290330 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4001d980 con 0x7f1f50098aa0 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.313+0000 7f1f37fff700 1 -- 172.21.15.61:0/381290330 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4001dae0 con 0x7f1f50098aa0 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.313+0000 7f1f569cd700 1 -- 172.21.15.61:0/381290330 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f400093c0 con 0x7f1f50098aa0 2023-12-24T20:07:24.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.313+0000 7f1f37fff700 1 -- 172.21.15.61:0/381290330 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4001dea0 con 0x7f1f50098aa0 2023-12-24T20:07:24.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.313+0000 7f1f569cd700 1 -- 172.21.15.61:0/381290330 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f500ac9b0 con 0x7f1f50098aa0 2023-12-24T20:07:24.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.314+0000 7f1f569cd700 1 -- 172.21.15.61:0/381290330 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5006d440 con 0x7f1f50098aa0 2023-12-24T20:07:24.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.314+0000 7f1f37fff700 1 -- 172.21.15.61:0/381290330 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1f4001b690 con 0x7f1f50098aa0 2023-12-24T20:07:24.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.314+0000 7f1f37fff700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1f3c066f30 0x7f1f3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.314+0000 7f1f37fff700 1 -- 172.21.15.61:0/381290330 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f40086510 con 0x7f1f50098aa0 2023-12-24T20:07:24.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.315+0000 7f1f4f7fe700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1f3c066f30 0x7f1f3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.315+0000 7f1f4f7fe700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1f3c066f30 0x7f1f3c0693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1f500a94f0 tx=0x7f1f44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:24.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.318+0000 7f1f37fff700 1 -- 172.21.15.61:0/381290330 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f40053780 con 0x7f1f50098aa0 2023-12-24T20:07:24.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.516+0000 7f1f569cd700 1 -- 172.21.15.61:0/381290330 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f5004c3c0 con 0x7f1f50098aa0 2023-12-24T20:07:24.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.517+0000 7f1f37fff700 1 -- 172.21.15.61:0/381290330 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+15365 (secure 0 0 0) 0x7f1f40056da0 con 0x7f1f50098aa0 2023-12-24T20:07:24.517 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:24.517 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":185,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:07:21.739877+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:07:17.930601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-24T20:07:19.106020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:07:24.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 -- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1f3c066f30 msgr2=0x7f1f3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1f3c066f30 0x7f1f3c0693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1f500a94f0 tx=0x7f1f44009040 comp rx=0 tx=0).stop 2023-12-24T20:07:24.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 -- 172.21.15.61:0/381290330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1f50098aa0 msgr2=0x7f1f500aa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1f50098aa0 0x7f1f500aa190 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006360 tx=0x7f1f40016000 comp rx=0 tx=0).stop 2023-12-24T20:07:24.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 -- 172.21.15.61:0/381290330 shutdown_connections 2023-12-24T20:07:24.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1f3c066f30 0x7f1f3c0693e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f5015bb60 0x7f1f50168320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1f50098aa0 0x7f1f500aa190 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 --2- 172.21.15.61:0/381290330 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1f500b2660 0x7f1f500aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 -- 172.21.15.61:0/381290330 >> 172.21.15.61:0/381290330 conn(0x7f1f50097a10 msgr2=0x7f1f500ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:24.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 -- 172.21.15.61:0/381290330 shutdown_connections 2023-12-24T20:07:24.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.519+0000 7f1f569cd700 1 -- 172.21.15.61:0/381290330 wait complete. 2023-12-24T20:07:24.532 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-24T20:07:24.532 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:07:24.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.653+0000 7f759d542700 1 Processor -- start 2023-12-24T20:07:24.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.654+0000 7f759d542700 1 -- start start 2023-12-24T20:07:24.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.654+0000 7f759d542700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7598159c10 0x7f75980c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.654+0000 7f759d542700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75980af880 con 0x7f7598159fe0 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.654+0000 7f759d542700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75980c6fc0 con 0x7f75980cc190 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.654+0000 7f759d542700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75980c63b0 con 0x7f7598159c10 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.654+0000 7f75967fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7598159fe0 0x7f75980cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40428/0 (socket says 172.21.15.61:40428) 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f75967fc700 1 -- 172.21.15.61:0/1414809302 learned_addr learned my addr 172.21.15.61:0/1414809302 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7596ffd700 1 --2- 172.21.15.61:0/1414809302 >> v2:172.21.15.133:3300/0 conn(0x7f7598159c10 0x7f75980c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7595ffb700 1 -- 172.21.15.61:0/1414809302 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168799608 0 0) 0x7f75980af880 con 0x7f7598159fe0 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7595ffb700 1 -- 172.21.15.61:0/1414809302 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7584003570 con 0x7f7598159fe0 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7595ffb700 1 -- 172.21.15.61:0/1414809302 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794875807 0 0) 0x7f75980c6fc0 con 0x7f75980cc190 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7595ffb700 1 -- 172.21.15.61:0/1414809302 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75980af880 con 0x7f75980cc190 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7595ffb700 1 -- 172.21.15.61:0/1414809302 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535707433 0 0) 0x7f7584003570 con 0x7f7598159fe0 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7596ffd700 1 -- 172.21.15.61:0/1414809302 >> v1:172.21.15.133:6789/0 conn(0x7f75980cc190 legacy=0x7f75980b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7596ffd700 1 -- 172.21.15.61:0/1414809302 >> v1:172.21.15.61:6789/0 conn(0x7f7598159fe0 legacy=0x7f75980cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7596ffd700 1 -- 172.21.15.61:0/1414809302 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75980c6690 con 0x7f7598159c10 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7596ffd700 1 --2- 172.21.15.61:0/1414809302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7598159c10 0x7f75980c57d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7588009910 tx=0x7f75880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a861649482a1ca55 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:24.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.655+0000 7f7595ffb700 1 -- 172.21.15.61:0/1414809302 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580001470 con 0x7f7598159c10 2023-12-24T20:07:24.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.656+0000 7f7595ffb700 1 -- 172.21.15.61:0/1414809302 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7588011420 con 0x7f7598159c10 2023-12-24T20:07:24.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.656+0000 7f7595ffb700 1 -- 172.21.15.61:0/1414809302 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75880117c0 con 0x7f7598159c10 2023-12-24T20:07:24.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.656+0000 7f759d542700 1 -- 172.21.15.61:0/1414809302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7598159c10 msgr2=0x7f75980c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.656+0000 7f759d542700 1 --2- 172.21.15.61:0/1414809302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7598159c10 0x7f75980c57d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7588009910 tx=0x7f75880091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.656+0000 7f759d542700 1 -- 172.21.15.61:0/1414809302 shutdown_connections 2023-12-24T20:07:24.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.656+0000 7f759d542700 1 --2- 172.21.15.61:0/1414809302 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7598159c10 0x7f75980c57d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.656+0000 7f759d542700 1 -- 172.21.15.61:0/1414809302 >> 172.21.15.61:0/1414809302 conn(0x7f759806e640 msgr2=0x7f7598067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:24.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.656+0000 7f759d542700 1 -- 172.21.15.61:0/1414809302 shutdown_connections 2023-12-24T20:07:24.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.656+0000 7f759d542700 1 -- 172.21.15.61:0/1414809302 wait complete. 2023-12-24T20:07:24.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.658+0000 7f759d542700 1 Processor -- start 2023-12-24T20:07:24.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.658+0000 7f759d542700 1 -- start start 2023-12-24T20:07:24.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f759d542700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f75980cc190 0x7f759814e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f759d542700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7598159c10 0x7f75980c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f759d542700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7598159fe0 0x7f75980cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f759d542700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75981525e0 con 0x7f75980cc190 2023-12-24T20:07:24.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f759d542700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759814ee10 con 0x7f7598159c10 2023-12-24T20:07:24.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f759d542700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75980b4620 con 0x7f7598159fe0 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f7596ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f75980cc190 0x7f759814e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f7596ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f75980cc190 0x7f759814e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41142/0 (socket says 172.21.15.61:41142) 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f7596ffd700 1 -- 172.21.15.61:0/2037120460 learned_addr learned my addr 172.21.15.61:0/2037120460 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f75967fc700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7598159c10 0x7f75980c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f75977fe700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7598159fe0 0x7f75980cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f7596ffd700 1 -- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7598159fe0 msgr2=0x7f75980cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f7596ffd700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7598159fe0 0x7f75980cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f7596ffd700 1 -- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7598159c10 msgr2=0x7f75980c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f7596ffd700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7598159c10 0x7f75980c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f7596ffd700 1 -- 172.21.15.61:0/2037120460 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7588009420 con 0x7f75980cc190 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f75967fc700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7598159c10 0x7f75980c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.659+0000 7f7596ffd700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f75980cc190 0x7f759814e8d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f75880093f0 tx=0x7f7588016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.660+0000 7f758effd700 1 -- 172.21.15.61:0/2037120460 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758801bc80 con 0x7f75980cc190 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.660+0000 7f758effd700 1 -- 172.21.15.61:0/2037120460 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758801bde0 con 0x7f75980cc190 2023-12-24T20:07:24.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.660+0000 7f759d542700 1 -- 172.21.15.61:0/2037120460 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7598152880 con 0x7f75980cc190 2023-12-24T20:07:24.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.660+0000 7f758effd700 1 -- 172.21.15.61:0/2037120460 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758801c660 con 0x7f75980cc190 2023-12-24T20:07:24.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.660+0000 7f759d542700 1 -- 172.21.15.61:0/2037120460 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7598152e40 con 0x7f75980cc190 2023-12-24T20:07:24.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.661+0000 7f759d542700 1 -- 172.21.15.61:0/2037120460 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75980890b0 con 0x7f75980cc190 2023-12-24T20:07:24.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.661+0000 7f758effd700 1 -- 172.21.15.61:0/2037120460 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f758801ca90 con 0x7f75980cc190 2023-12-24T20:07:24.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.661+0000 7f758effd700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7578066f30 0x7f75780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:24.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.661+0000 7f758effd700 1 -- 172.21.15.61:0/2037120460 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7588085be0 con 0x7f75980cc190 2023-12-24T20:07:24.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.662+0000 7f75967fc700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7578066f30 0x7f75780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:24.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.662+0000 7f75967fc700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7578066f30 0x7f75780693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f75800015a0 tx=0x7f7580009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:24.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.666+0000 7f758effd700 1 -- 172.21.15.61:0/2037120460 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7588052e50 con 0x7f75980cc190 2023-12-24T20:07:24.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.861+0000 7f759d542700 1 -- 172.21.15.61:0/2037120460 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f759804c3c0 con 0x7f7578066f30 2023-12-24T20:07:24.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.869+0000 7f758effd700 1 -- 172.21.15.61:0/2037120460 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281977 (secure 0 0 0) 0x7f759804c3c0 con 0x7f7578066f30 2023-12-24T20:07:24.873 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:24.875 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 -- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7578066f30 msgr2=0x7f75780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7578066f30 0x7f75780693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f75800015a0 tx=0x7f7580009040 comp rx=0 tx=0).stop 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 -- 172.21.15.61:0/2037120460 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f75980cc190 msgr2=0x7f759814e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f75980cc190 0x7f759814e8d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f75880093f0 tx=0x7f7588016000 comp rx=0 tx=0).stop 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 -- 172.21.15.61:0/2037120460 shutdown_connections 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7598159fe0 0x7f75980cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7578066f30 0x7f75780693e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f75980cc190 0x7f759814e8d0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 --2- 172.21.15.61:0/2037120460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7598159c10 0x7f75980c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 -- 172.21.15.61:0/2037120460 >> 172.21.15.61:0/2037120460 conn(0x7f759806e640 msgr2=0x7f759815e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 -- 172.21.15.61:0/2037120460 shutdown_connections 2023-12-24T20:07:24.876 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:24.872+0000 7f759d542700 1 -- 172.21.15.61:0/2037120460 wait complete. 2023-12-24T20:07:24.877 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:07:24.885 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2023-12-24T20:07:24.461406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553366,"statfs":{"total":1600000000,"available":1590647380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.743744"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724162+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:55:52.727956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736480+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:57:31.019587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728167+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:25:19.425730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722624+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:27:58.612009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.737507+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:26:51.747403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736490+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:20.653180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724421+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:46:48.438634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736358+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:55:36.913522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736358+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:06.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735315+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:54.406795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735354+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:09.684018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735765+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:55.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727450+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:55:49.272602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728704+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:26.340636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723433+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:09.480440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.726044+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:36:59.743099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735983+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:46.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723172+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:28:56.813064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736021+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:02.416698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725677+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:04.294798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736004+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:04.294798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735424+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:43.933103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.739318+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:29.832230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735310+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:54:17.156416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.726478+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:20.653180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723804+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:01:24.163148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725704+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:46.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723863+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:41.519358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728332+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:34.166856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.737113+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:26:51.747403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736474+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:41:37.645101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724819+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:21.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724739+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:29:03.643933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729857+0000","last_change":"2023-12-24T20:07:19.729857+0000","last_active":"2023-12-24T20:07:19.729857+0000","last_peered":"2023-12-24T20:07:19.729857+0000","last_clean":"2023-12-24T20:07:19.729857+0000","last_became_active":"2023-12-24T20:07:19.729631+0000","last_became_peered":"2023-12-24T20:07:19.729631+0000","last_unstale":"2023-12-24T20:07:19.729857+0000","last_undegraded":"2023-12-24T20:07:19.729857+0000","last_fullsized":"2023-12-24T20:07:19.729857+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:32.809199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735813+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:18:51.365236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726003+0000","last_change":"2023-12-24T20:07:19.726003+0000","last_active":"2023-12-24T20:07:19.726003+0000","last_peered":"2023-12-24T20:07:19.726003+0000","last_clean":"2023-12-24T20:07:19.726003+0000","last_became_active":"2023-12-24T20:07:19.725772+0000","last_became_peered":"2023-12-24T20:07:19.725772+0000","last_unstale":"2023-12-24T20:07:19.726003+0000","last_undegraded":"2023-12-24T20:07:19.726003+0000","last_fullsized":"2023-12-24T20:07:19.726003+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:46.115708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735570+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:03:40.424326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726181+0000","last_change":"2023-12-24T20:07:19.726181+0000","last_active":"2023-12-24T20:07:19.726181+0000","last_peered":"2023-12-24T20:07:19.726181+0000","last_clean":"2023-12-24T20:07:19.726181+0000","last_became_active":"2023-12-24T20:07:19.725910+0000","last_became_peered":"2023-12-24T20:07:19.725910+0000","last_unstale":"2023-12-24T20:07:19.726181+0000","last_undegraded":"2023-12-24T20:07:19.726181+0000","last_fullsized":"2023-12-24T20:07:19.726181+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:28.825227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724797+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:54.958356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728483+0000","last_change":"2023-12-24T20:07:19.728483+0000","last_active":"2023-12-24T20:07:19.728483+0000","last_peered":"2023-12-24T20:07:19.728483+0000","last_clean":"2023-12-24T20:07:19.728483+0000","last_became_active":"2023-12-24T20:07:19.728165+0000","last_became_peered":"2023-12-24T20:07:19.728165+0000","last_unstale":"2023-12-24T20:07:19.728483+0000","last_undegraded":"2023-12-24T20:07:19.728483+0000","last_fullsized":"2023-12-24T20:07:19.728483+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.159853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723300+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:16.384382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726579+0000","last_change":"2023-12-24T20:07:19.726579+0000","last_active":"2023-12-24T20:07:19.726579+0000","last_peered":"2023-12-24T20:07:19.726579+0000","last_clean":"2023-12-24T20:07:19.726579+0000","last_became_active":"2023-12-24T20:07:19.726241+0000","last_became_peered":"2023-12-24T20:07:19.726241+0000","last_unstale":"2023-12-24T20:07:19.726579+0000","last_undegraded":"2023-12-24T20:07:19.726579+0000","last_fullsized":"2023-12-24T20:07:19.726579+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:49.634096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724414+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:37:47.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727911+0000","last_change":"2023-12-24T20:07:19.727911+0000","last_active":"2023-12-24T20:07:19.727911+0000","last_peered":"2023-12-24T20:07:19.727911+0000","last_clean":"2023-12-24T20:07:19.727911+0000","last_became_active":"2023-12-24T20:07:19.727639+0000","last_became_peered":"2023-12-24T20:07:19.727639+0000","last_unstale":"2023-12-24T20:07:19.727911+0000","last_undegraded":"2023-12-24T20:07:19.727911+0000","last_fullsized":"2023-12-24T20:07:19.727911+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:52:52.161095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723713+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:40:16.482454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726790+0000","last_change":"2023-12-24T20:07:19.726790+0000","last_active":"2023-12-24T20:07:19.726790+0000","last_peered":"2023-12-24T20:07:19.726790+0000","last_clean":"2023-12-24T20:07:19.726790+0000","last_became_active":"2023-12-24T20:07:19.726577+0000","last_became_peered":"2023-12-24T20:07:19.726577+0000","last_unstale":"2023-12-24T20:07:19.726790+0000","last_undegraded":"2023-12-24T20:07:19.726790+0000","last_fullsized":"2023-12-24T20:07:19.726790+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:40.906179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735584+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:54.958356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727460+0000","last_change":"2023-12-24T20:07:19.727460+0000","last_active":"2023-12-24T20:07:19.727460+0000","last_peered":"2023-12-24T20:07:19.727460+0000","last_clean":"2023-12-24T20:07:19.727460+0000","last_became_active":"2023-12-24T20:07:19.727198+0000","last_became_peered":"2023-12-24T20:07:19.727198+0000","last_unstale":"2023-12-24T20:07:19.727460+0000","last_undegraded":"2023-12-24T20:07:19.727460+0000","last_fullsized":"2023-12-24T20:07:19.727460+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:58.364787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722061+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:59.371790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730168+0000","last_change":"2023-12-24T20:07:19.730168+0000","last_active":"2023-12-24T20:07:19.730168+0000","last_peered":"2023-12-24T20:07:19.730168+0000","last_clean":"2023-12-24T20:07:19.730168+0000","last_became_active":"2023-12-24T20:07:19.729898+0000","last_became_peered":"2023-12-24T20:07:19.729898+0000","last_unstale":"2023-12-24T20:07:19.730168+0000","last_undegraded":"2023-12-24T20:07:19.730168+0000","last_fullsized":"2023-12-24T20:07:19.730168+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:49.634096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722350+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:32:06.062978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729270+0000","last_change":"2023-12-24T20:07:19.729270+0000","last_active":"2023-12-24T20:07:19.729270+0000","last_peered":"2023-12-24T20:07:19.729270+0000","last_clean":"2023-12-24T20:07:19.729270+0000","last_became_active":"2023-12-24T20:07:19.729021+0000","last_became_peered":"2023-12-24T20:07:19.729021+0000","last_unstale":"2023-12-24T20:07:19.729270+0000","last_undegraded":"2023-12-24T20:07:19.729270+0000","last_fullsized":"2023-12-24T20:07:19.729270+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:15.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735343+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:57:31.019587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733162+0000","last_change":"2023-12-24T20:07:19.733162+0000","last_active":"2023-12-24T20:07:19.733162+0000","last_peered":"2023-12-24T20:07:19.733162+0000","last_clean":"2023-12-24T20:07:19.733162+0000","last_became_active":"2023-12-24T20:07:19.727678+0000","last_became_peered":"2023-12-24T20:07:19.727678+0000","last_unstale":"2023-12-24T20:07:19.733162+0000","last_undegraded":"2023-12-24T20:07:19.733162+0000","last_fullsized":"2023-12-24T20:07:19.733162+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:54.337829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721651+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:15.951001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.725269+0000","last_change":"2023-12-24T20:07:19.725269+0000","last_active":"2023-12-24T20:07:19.725269+0000","last_peered":"2023-12-24T20:07:19.725269+0000","last_clean":"2023-12-24T20:07:19.725269+0000","last_became_active":"2023-12-24T20:07:19.725000+0000","last_became_peered":"2023-12-24T20:07:19.725000+0000","last_unstale":"2023-12-24T20:07:19.725269+0000","last_undegraded":"2023-12-24T20:07:19.725269+0000","last_fullsized":"2023-12-24T20:07:19.725269+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:52:32.810420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722533+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:40.754652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728699+0000","last_change":"2023-12-24T20:07:19.728699+0000","last_active":"2023-12-24T20:07:19.728699+0000","last_peered":"2023-12-24T20:07:19.728699+0000","last_clean":"2023-12-24T20:07:19.728699+0000","last_became_active":"2023-12-24T20:07:19.726901+0000","last_became_peered":"2023-12-24T20:07:19.726901+0000","last_unstale":"2023-12-24T20:07:19.728699+0000","last_undegraded":"2023-12-24T20:07:19.728699+0000","last_fullsized":"2023-12-24T20:07:19.728699+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:32:13.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723462+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:01.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729904+0000","last_change":"2023-12-24T20:07:19.729904+0000","last_active":"2023-12-24T20:07:19.729904+0000","last_peered":"2023-12-24T20:07:19.729904+0000","last_clean":"2023-12-24T20:07:19.729904+0000","last_became_active":"2023-12-24T20:07:19.727729+0000","last_became_peered":"2023-12-24T20:07:19.727729+0000","last_unstale":"2023-12-24T20:07:19.729904+0000","last_undegraded":"2023-12-24T20:07:19.729904+0000","last_fullsized":"2023-12-24T20:07:19.729904+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:33:35.721912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725333+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:02.416698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729342+0000","last_change":"2023-12-24T20:07:19.729342+0000","last_active":"2023-12-24T20:07:19.729342+0000","last_peered":"2023-12-24T20:07:19.729342+0000","last_clean":"2023-12-24T20:07:19.729342+0000","last_became_active":"2023-12-24T20:07:19.727563+0000","last_became_peered":"2023-12-24T20:07:19.727563+0000","last_unstale":"2023-12-24T20:07:19.729342+0000","last_undegraded":"2023-12-24T20:07:19.729342+0000","last_fullsized":"2023-12-24T20:07:19.729342+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:06.349039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723040+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:24.246867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733087+0000","last_change":"2023-12-24T20:07:19.733087+0000","last_active":"2023-12-24T20:07:19.733087+0000","last_peered":"2023-12-24T20:07:19.733087+0000","last_clean":"2023-12-24T20:07:19.733087+0000","last_became_active":"2023-12-24T20:07:19.732832+0000","last_became_peered":"2023-12-24T20:07:19.732832+0000","last_unstale":"2023-12-24T20:07:19.733087+0000","last_undegraded":"2023-12-24T20:07:19.733087+0000","last_fullsized":"2023-12-24T20:07:19.733087+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:26.589177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721906+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:31:39.286031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.731693+0000","last_change":"2023-12-24T20:07:19.731693+0000","last_active":"2023-12-24T20:07:19.731693+0000","last_peered":"2023-12-24T20:07:19.731693+0000","last_clean":"2023-12-24T20:07:19.731693+0000","last_became_active":"2023-12-24T20:07:19.729784+0000","last_became_peered":"2023-12-24T20:07:19.729784+0000","last_unstale":"2023-12-24T20:07:19.731693+0000","last_undegraded":"2023-12-24T20:07:19.731693+0000","last_fullsized":"2023-12-24T20:07:19.731693+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:55:13.212890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723984+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:30:58.392159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.732110+0000","last_change":"2023-12-24T20:07:19.732110+0000","last_active":"2023-12-24T20:07:19.732110+0000","last_peered":"2023-12-24T20:07:19.732110+0000","last_clean":"2023-12-24T20:07:19.732110+0000","last_became_active":"2023-12-24T20:07:19.731518+0000","last_became_peered":"2023-12-24T20:07:19.731518+0000","last_unstale":"2023-12-24T20:07:19.732110+0000","last_undegraded":"2023-12-24T20:07:19.732110+0000","last_fullsized":"2023-12-24T20:07:19.732110+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:11.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722355+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:46.553351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730514+0000","last_change":"2023-12-24T20:07:19.730514+0000","last_active":"2023-12-24T20:07:19.730514+0000","last_peered":"2023-12-24T20:07:19.730514+0000","last_clean":"2023-12-24T20:07:19.730514+0000","last_became_active":"2023-12-24T20:07:19.730254+0000","last_became_peered":"2023-12-24T20:07:19.730254+0000","last_unstale":"2023-12-24T20:07:19.730514+0000","last_undegraded":"2023-12-24T20:07:19.730514+0000","last_fullsized":"2023-12-24T20:07:19.730514+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:08:33.502883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727632+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:04:03.611978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729132+0000","last_change":"2023-12-24T20:07:19.729132+0000","last_active":"2023-12-24T20:07:19.729132+0000","last_peered":"2023-12-24T20:07:19.729132+0000","last_clean":"2023-12-24T20:07:19.729132+0000","last_became_active":"2023-12-24T20:07:19.728856+0000","last_became_peered":"2023-12-24T20:07:19.728856+0000","last_unstale":"2023-12-24T20:07:19.729132+0000","last_undegraded":"2023-12-24T20:07:19.729132+0000","last_fullsized":"2023-12-24T20:07:19.729132+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:23.868047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722903+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:21.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.731937+0000","last_change":"2023-12-24T20:07:19.731937+0000","last_active":"2023-12-24T20:07:19.731937+0000","last_peered":"2023-12-24T20:07:19.731937+0000","last_clean":"2023-12-24T20:07:19.731937+0000","last_became_active":"2023-12-24T20:07:19.731703+0000","last_became_peered":"2023-12-24T20:07:19.731703+0000","last_unstale":"2023-12-24T20:07:19.731937+0000","last_undegraded":"2023-12-24T20:07:19.731937+0000","last_fullsized":"2023-12-24T20:07:19.731937+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:19:28.971138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723749+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:14:56.314102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728748+0000","last_change":"2023-12-24T20:07:19.728748+0000","last_active":"2023-12-24T20:07:19.728748+0000","last_peered":"2023-12-24T20:07:19.728748+0000","last_clean":"2023-12-24T20:07:19.728748+0000","last_became_active":"2023-12-24T20:07:19.728485+0000","last_became_peered":"2023-12-24T20:07:19.728485+0000","last_unstale":"2023-12-24T20:07:19.728748+0000","last_undegraded":"2023-12-24T20:07:19.728748+0000","last_fullsized":"2023-12-24T20:07:19.728748+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:25:18.418726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735389+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:35:50.190261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.734498+0000","last_change":"2023-12-24T20:07:19.734498+0000","last_active":"2023-12-24T20:07:19.734498+0000","last_peered":"2023-12-24T20:07:19.734498+0000","last_clean":"2023-12-24T20:07:19.734498+0000","last_became_active":"2023-12-24T20:07:19.731867+0000","last_became_peered":"2023-12-24T20:07:19.731867+0000","last_unstale":"2023-12-24T20:07:19.734498+0000","last_undegraded":"2023-12-24T20:07:19.734498+0000","last_fullsized":"2023-12-24T20:07:19.734498+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:59:31.647812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722648+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:46.553351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729541+0000","last_change":"2023-12-24T20:07:19.729541+0000","last_active":"2023-12-24T20:07:19.729541+0000","last_peered":"2023-12-24T20:07:19.729541+0000","last_clean":"2023-12-24T20:07:19.729541+0000","last_became_active":"2023-12-24T20:07:19.729312+0000","last_became_peered":"2023-12-24T20:07:19.729312+0000","last_unstale":"2023-12-24T20:07:19.729541+0000","last_undegraded":"2023-12-24T20:07:19.729541+0000","last_fullsized":"2023-12-24T20:07:19.729541+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:08.473437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722438+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:28:56.813064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.734185+0000","last_change":"2023-12-24T20:07:19.734185+0000","last_active":"2023-12-24T20:07:19.734185+0000","last_peered":"2023-12-24T20:07:19.734185+0000","last_clean":"2023-12-24T20:07:19.734185+0000","last_became_active":"2023-12-24T20:07:19.733672+0000","last_became_peered":"2023-12-24T20:07:19.733672+0000","last_unstale":"2023-12-24T20:07:19.734185+0000","last_undegraded":"2023-12-24T20:07:19.734185+0000","last_fullsized":"2023-12-24T20:07:19.734185+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:16.540761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735084+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:55:14.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729035+0000","last_change":"2023-12-24T20:07:19.729035+0000","last_active":"2023-12-24T20:07:19.729035+0000","last_peered":"2023-12-24T20:07:19.729035+0000","last_clean":"2023-12-24T20:07:19.729035+0000","last_became_active":"2023-12-24T20:07:19.728769+0000","last_became_peered":"2023-12-24T20:07:19.728769+0000","last_unstale":"2023-12-24T20:07:19.729035+0000","last_undegraded":"2023-12-24T20:07:19.729035+0000","last_fullsized":"2023-12-24T20:07:19.729035+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:05.266214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721475+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:23:37.173750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727957+0000","last_change":"2023-12-24T20:07:19.727957+0000","last_active":"2023-12-24T20:07:19.727957+0000","last_peered":"2023-12-24T20:07:19.727957+0000","last_clean":"2023-12-24T20:07:19.727957+0000","last_became_active":"2023-12-24T20:07:19.727670+0000","last_became_peered":"2023-12-24T20:07:19.727670+0000","last_unstale":"2023-12-24T20:07:19.727957+0000","last_undegraded":"2023-12-24T20:07:19.727957+0000","last_fullsized":"2023-12-24T20:07:19.727957+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:14:55.307099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724045+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:40.754652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730892+0000","last_change":"2023-12-24T20:07:19.730892+0000","last_active":"2023-12-24T20:07:19.730892+0000","last_peered":"2023-12-24T20:07:19.730892+0000","last_clean":"2023-12-24T20:07:19.730892+0000","last_became_active":"2023-12-24T20:07:19.730467+0000","last_became_peered":"2023-12-24T20:07:19.730467+0000","last_unstale":"2023-12-24T20:07:19.730892+0000","last_undegraded":"2023-12-24T20:07:19.730892+0000","last_fullsized":"2023-12-24T20:07:19.730892+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:05.967669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735708+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:17:06.685281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730112+0000","last_change":"2023-12-24T20:07:19.730112+0000","last_active":"2023-12-24T20:07:19.730112+0000","last_peered":"2023-12-24T20:07:19.730112+0000","last_clean":"2023-12-24T20:07:19.730112+0000","last_became_active":"2023-12-24T20:07:19.729114+0000","last_became_peered":"2023-12-24T20:07:19.729114+0000","last_unstale":"2023-12-24T20:07:19.730112+0000","last_undegraded":"2023-12-24T20:07:19.730112+0000","last_fullsized":"2023-12-24T20:07:19.730112+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:25.333632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722776+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:01:36.522227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728441+0000","last_change":"2023-12-24T20:07:19.728441+0000","last_active":"2023-12-24T20:07:19.728441+0000","last_peered":"2023-12-24T20:07:19.728441+0000","last_clean":"2023-12-24T20:07:19.728441+0000","last_became_active":"2023-12-24T20:07:19.728198+0000","last_became_peered":"2023-12-24T20:07:19.728198+0000","last_unstale":"2023-12-24T20:07:19.728441+0000","last_undegraded":"2023-12-24T20:07:19.728441+0000","last_fullsized":"2023-12-24T20:07:19.728441+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:38.344997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727046+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:36:22.904751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733303+0000","last_change":"2023-12-24T20:07:19.733303+0000","last_active":"2023-12-24T20:07:19.733303+0000","last_peered":"2023-12-24T20:07:19.733303+0000","last_clean":"2023-12-24T20:07:19.733303+0000","last_became_active":"2023-12-24T20:07:19.732962+0000","last_became_peered":"2023-12-24T20:07:19.732962+0000","last_unstale":"2023-12-24T20:07:19.733303+0000","last_undegraded":"2023-12-24T20:07:19.733303+0000","last_fullsized":"2023-12-24T20:07:19.733303+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:53.399792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724428+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:01:36.522227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730699+0000","last_change":"2023-12-24T20:07:19.730699+0000","last_active":"2023-12-24T20:07:19.730699+0000","last_peered":"2023-12-24T20:07:19.730699+0000","last_clean":"2023-12-24T20:07:19.730699+0000","last_became_active":"2023-12-24T20:07:19.730166+0000","last_became_peered":"2023-12-24T20:07:19.730166+0000","last_unstale":"2023-12-24T20:07:19.730699+0000","last_undegraded":"2023-12-24T20:07:19.730699+0000","last_fullsized":"2023-12-24T20:07:19.730699+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:42.926099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":304,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-12-24T20:07:18.720765+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:07:18.720765+0000","last_peered":"2023-12-24T20:07:18.720765+0000","last_clean":"2023-12-24T20:07:18.720765+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:07:18.720765+0000","last_undegraded":"2023-12-24T20:07:18.720765+0000","last_fullsized":"2023-12-24T20:07:18.720765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1577,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193735,"statfs":{"total":200000000,"available":198385015,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.308,"15min":0.307},"max":{"1min":0.80200000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.56999999999999995},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.872,"15min":0.872},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.39400000000000002,"15min":0.34100000000000003},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.623},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.82799999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.312},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.95699999999999996},"last":0.505}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.379,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.81499999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.752,"15min":0.80000000000000004},"last":0.499}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.79100000000000004,"15min":0.83699999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.873},"last":0.65700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194311,"statfs":{"total":200000000,"available":198975383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.0309999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.45700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":0.80200000000000005,"15min":0.95799999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.27000000000000002},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.44,"5min":0.378,"15min":0.33200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0640000000000001},"last":0.57599999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.077},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.372},"max":{"1min":0.79100000000000004,"5min":0.877,"15min":1.048},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.86499999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.254},"max":{"1min":0.628,"5min":0.748,"15min":0.84699999999999998},"last":0.45100000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.372,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.31},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40799999999999997,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.54800000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33300000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.432},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.35199999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.80900000000000005,"5min":0.871,"15min":0.871},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.59799999999999998},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.94299999999999995,"5min":1.014,"15min":1.014},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.04},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86199999999999999,"5min":0.998,"15min":0.998},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.63},"min":{"1min":0.437,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.64300000000000002},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.39500000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.57199999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.629},"min":{"1min":0.501,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69399999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":1.0109999999999999,"5min":1.03,"15min":1.03},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1577,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193735,"statfs":{"total":200000000,"available":198385015,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36499999999999999,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.45800000000000002,"5min":0.70799999999999996,"15min":0.97999999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.439,"5min":0.65400000000000003,"15min":0.92700000000000005},"last":0.31},{"interface":"front","average":{"1min":0.435,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.93999999999999995},"last":0.376}]},{"osd":3,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56699999999999995,"5min":0.70199999999999996,"15min":2.573},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":1.073,"15min":1.3500000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.65200000000000002},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":2.7149999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.372},"max":{"1min":0.94599999999999995,"5min":1.0569999999999999,"15min":2.6859999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.006},"last":0.77300000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":1.0489999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":1.5429999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.69999999999999996},"min":{"1min":0.58699999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.249,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.50800000000000001,"5min":0.61599999999999999,"15min":0.78900000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.72299999999999998},"last":0.307}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38100000000000001,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.77700000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.82799999999999996},"last":0.38700000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.84699999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.88900000000000001},"last":0.34699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.97999999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.2649999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":3.577},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":1.052,"15min":7.0220000000000002},"last":0.63}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.075,"5min":1.075,"15min":1.298},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":3.637},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.014,"15min":7.0599999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.55400000000000005,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.331},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.373,"15min":0.34599999999999997},"min":{"1min":0.26000000000000001,"5min":0.22600000000000001,"15min":0.182},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.66500000000000004},"last":0.31900000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.371,"15min":0.35899999999999999},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59399999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35199999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.66500000000000004,"15min":0.79500000000000004},"last":0.377},{"interface":"front","average":{"1min":0.496,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.27800000000000002,"15min":0.27300000000000002},"max":{"1min":0.64400000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.30199999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.55300000000000005,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.90600000000000003,"5min":0.92100000000000004,"15min":1.337},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.622},"min":{"1min":0.48699999999999999,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":1.038,"15min":1.2010000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53900000000000003,"5min":0.44900000000000001,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89900000000000002,"15min":0.97799999999999998},"last":0.66500000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.024,"15min":1.1699999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":1.4570000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.65300000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.879,"5min":1.02,"15min":1.3779999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.54200000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.004,"15min":1.006},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.44,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74099999999999999,"5min":0.752,"15min":0.82199999999999995},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":4.883},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":1.544},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32100000000000001},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33300000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.75},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.52,"5min":1.52,"15min":8.8200000000000003},"last":0.48299999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.49099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":1.4419999999999999},"last":0.378},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.57799999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":3.8279999999999998},"last":0.313}]},{"osd":6,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.54800000000000004}]},{"osd":7,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.82999999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.33500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":14.039999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.375,"15min":0.31},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194311,"statfs":{"total":200000000,"available":198975383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":4.6059999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":1.847},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.63600000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.623},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":1.97},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":3.2850000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.877,"15min":0.877},"last":0.67400000000000004}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":1.0289999999999999,"15min":1.3320000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.0589999999999999,"15min":4.5330000000000004},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.48599999999999999},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.498},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78700000000000003,"5min":0.96499999999999997,"15min":1.8839999999999999},"last":0.46700000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.98799999999999999,"15min":3.766},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56799999999999995}]}]}],"pool_statfs":[]}} 2023-12-24T20:07:24.890 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:07:25.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.047+0000 7f4efe174700 1 Processor -- start 2023-12-24T20:07:25.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.047+0000 7f4efe174700 1 -- start start 2023-12-24T20:07:25.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4efe174700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4ef8157780 0x7f4ef806c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4efe174700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80ca6f0 con 0x7f4ef806c840 2023-12-24T20:07:25.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4efe174700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef80ca9d0 con 0x7f4ef80ca270 2023-12-24T20:07:25.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4efe174700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80cacb0 con 0x7f4ef8157780 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4ef77fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4ef8157780 0x7f4ef806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4ef7fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4ef806c840 0x7f4ef815ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40432/0 (socket says 172.21.15.61:40432) 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4ef7fff700 1 -- 172.21.15.61:0/3884625769 learned_addr learned my addr 172.21.15.61:0/3884625769 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4ef77fe700 1 -- 172.21.15.61:0/3884625769 >> v1:172.21.15.133:6789/0 conn(0x7f4ef80ca270 legacy=0x7f4ef80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4ef77fe700 1 -- 172.21.15.61:0/3884625769 >> v1:172.21.15.61:6789/0 conn(0x7f4ef806c840 legacy=0x7f4ef815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4ef77fe700 1 -- 172.21.15.61:0/3884625769 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80caf90 con 0x7f4ef8157780 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4ef77fe700 1 --2- 172.21.15.61:0/3884625769 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef8157780 0x7f4ef806c300 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80098e0 tx=0x7f4ee80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b945d0e548169e13 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4ef67fc700 1 -- 172.21.15.61:0/3884625769 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8009e80 con 0x7f4ef8157780 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4ef67fc700 1 -- 172.21.15.61:0/3884625769 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800b860 con 0x7f4ef8157780 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.048+0000 7f4ef67fc700 1 -- 172.21.15.61:0/3884625769 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800bbe0 con 0x7f4ef8157780 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.049+0000 7f4efe174700 1 -- 172.21.15.61:0/3884625769 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef8157780 msgr2=0x7f4ef806c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.049+0000 7f4efe174700 1 --2- 172.21.15.61:0/3884625769 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef8157780 0x7f4ef806c300 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80098e0 tx=0x7f4ee80091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.049+0000 7f4efe174700 1 -- 172.21.15.61:0/3884625769 shutdown_connections 2023-12-24T20:07:25.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.049+0000 7f4efe174700 1 --2- 172.21.15.61:0/3884625769 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef8157780 0x7f4ef806c300 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.049+0000 7f4efe174700 1 -- 172.21.15.61:0/3884625769 >> 172.21.15.61:0/3884625769 conn(0x7f4ef806b650 msgr2=0x7f4ef80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:25.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.049+0000 7f4efe174700 1 -- 172.21.15.61:0/3884625769 shutdown_connections 2023-12-24T20:07:25.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.049+0000 7f4efe174700 1 -- 172.21.15.61:0/3884625769 wait complete. 2023-12-24T20:07:25.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.051+0000 7f4efe174700 1 Processor -- start 2023-12-24T20:07:25.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.051+0000 7f4efe174700 1 -- start start 2023-12-24T20:07:25.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4efe174700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ef806c840 0x7f4ef8159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4efe174700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef8157780 0x7f4ef8152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4efe174700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef815a050 0x7f4ef8152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4efe174700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef814fe90 con 0x7f4ef815a050 2023-12-24T20:07:25.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4efe174700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef814f210 con 0x7f4ef8157780 2023-12-24T20:07:25.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4efe174700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef814f4f0 con 0x7f4ef806c840 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef815a050 0x7f4ef8152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef815a050 0x7f4ef8152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41172/0 (socket says 172.21.15.61:41172) 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef7fff700 1 -- 172.21.15.61:0/1605310907 learned_addr learned my addr 172.21.15.61:0/1605310907 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef6ffd700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef8157780 0x7f4ef8152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef77fe700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ef806c840 0x7f4ef8159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef7fff700 1 -- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ef806c840 msgr2=0x7f4ef8159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef7fff700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ef806c840 0x7f4ef8159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef7fff700 1 -- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef8157780 msgr2=0x7f4ef8152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef7fff700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef8157780 0x7f4ef8152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef7fff700 1 -- 172.21.15.61:0/1605310907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee8009420 con 0x7f4ef815a050 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef6ffd700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef8157780 0x7f4ef8152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef77fe700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ef806c840 0x7f4ef8159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4ef7fff700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef815a050 0x7f4ef8152540 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000cc40 tx=0x7f4ef0001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4edf7fe700 1 -- 172.21.15.61:0/1605310907 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000a9c0 con 0x7f4ef815a050 2023-12-24T20:07:25.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4edf7fe700 1 -- 172.21.15.61:0/1605310907 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef000ab20 con 0x7f4ef815a050 2023-12-24T20:07:25.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.052+0000 7f4efe174700 1 -- 172.21.15.61:0/1605310907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef814f7d0 con 0x7f4ef815a050 2023-12-24T20:07:25.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.053+0000 7f4edf7fe700 1 -- 172.21.15.61:0/1605310907 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef00070f0 con 0x7f4ef815a050 2023-12-24T20:07:25.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.053+0000 7f4efe174700 1 -- 172.21.15.61:0/1605310907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef814aa10 con 0x7f4ef815a050 2023-12-24T20:07:25.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.053+0000 7f4efe174700 1 -- 172.21.15.61:0/1605310907 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef804c3c0 con 0x7f4ef815a050 2023-12-24T20:07:25.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.054+0000 7f4edf7fe700 1 -- 172.21.15.61:0/1605310907 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4ef00074e0 con 0x7f4ef815a050 2023-12-24T20:07:25.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.054+0000 7f4edf7fe700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4ee4066f30 0x7f4ee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.054+0000 7f4edf7fe700 1 -- 172.21.15.61:0/1605310907 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ef0084950 con 0x7f4ef815a050 2023-12-24T20:07:25.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.055+0000 7f4ef77fe700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4ee4066f30 0x7f4ee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.055+0000 7f4ef77fe700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4ee4066f30 0x7f4ee40693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80093f0 tx=0x7f4ee8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:25.059 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.059+0000 7f4edf7fe700 1 -- 172.21.15.61:0/1605310907 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ef0051c40 con 0x7f4ef815a050 2023-12-24T20:07:25.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.247+0000 7f4efe174700 1 -- 172.21.15.61:0/1605310907 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ef815b560 con 0x7f4ee4066f30 2023-12-24T20:07:25.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.255+0000 7f4edf7fe700 1 -- 172.21.15.61:0/1605310907 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281977 (secure 0 0 0) 0x7f4ef815b560 con 0x7f4ee4066f30 2023-12-24T20:07:25.259 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:25.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.258+0000 7f4efe174700 1 -- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4ee4066f30 msgr2=0x7f4ee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.258+0000 7f4efe174700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4ee4066f30 0x7f4ee40693e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80093f0 tx=0x7f4ee8017000 comp rx=0 tx=0).stop 2023-12-24T20:07:25.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.258+0000 7f4efe174700 1 -- 172.21.15.61:0/1605310907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef815a050 msgr2=0x7f4ef8152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.258+0000 7f4efe174700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef815a050 0x7f4ef8152540 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000cc40 tx=0x7f4ef0001a50 comp rx=0 tx=0).stop 2023-12-24T20:07:25.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.259+0000 7f4efe174700 1 -- 172.21.15.61:0/1605310907 shutdown_connections 2023-12-24T20:07:25.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.259+0000 7f4efe174700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4ef806c840 0x7f4ef8159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.259+0000 7f4efe174700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4ee4066f30 0x7f4ee40693e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.259+0000 7f4efe174700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4ef815a050 0x7f4ef8152540 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.259+0000 7f4efe174700 1 --2- 172.21.15.61:0/1605310907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ef8157780 0x7f4ef8152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.259+0000 7f4efe174700 1 -- 172.21.15.61:0/1605310907 >> 172.21.15.61:0/1605310907 conn(0x7f4ef806b650 msgr2=0x7f4ef80cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:25.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.259+0000 7f4efe174700 1 -- 172.21.15.61:0/1605310907 shutdown_connections 2023-12-24T20:07:25.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.259+0000 7f4efe174700 1 -- 172.21.15.61:0/1605310907 wait complete. 2023-12-24T20:07:25.263 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:07:25.271 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2023-12-24T20:07:24.461406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553366,"statfs":{"total":1600000000,"available":1590647380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.743744"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724162+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:55:52.727956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736480+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:57:31.019587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728167+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:25:19.425730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722624+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:27:58.612009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.737507+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:26:51.747403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736490+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:20.653180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724421+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:46:48.438634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736358+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:55:36.913522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736358+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:06.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735315+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:54.406795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735354+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:09.684018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735765+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:55.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727450+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:55:49.272602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728704+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:26.340636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723433+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:09.480440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.726044+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:36:59.743099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735983+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:46.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723172+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:28:56.813064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736021+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:02.416698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725677+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:04.294798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736004+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:04.294798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735424+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:43.933103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.739318+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:29.832230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735310+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:54:17.156416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.726478+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:20.653180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723804+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:01:24.163148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725704+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:46.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723863+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:41.519358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728332+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:34.166856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.737113+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:26:51.747403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736474+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:41:37.645101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724819+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:21.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724739+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:29:03.643933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729857+0000","last_change":"2023-12-24T20:07:19.729857+0000","last_active":"2023-12-24T20:07:19.729857+0000","last_peered":"2023-12-24T20:07:19.729857+0000","last_clean":"2023-12-24T20:07:19.729857+0000","last_became_active":"2023-12-24T20:07:19.729631+0000","last_became_peered":"2023-12-24T20:07:19.729631+0000","last_unstale":"2023-12-24T20:07:19.729857+0000","last_undegraded":"2023-12-24T20:07:19.729857+0000","last_fullsized":"2023-12-24T20:07:19.729857+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:32.809199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735813+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:18:51.365236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726003+0000","last_change":"2023-12-24T20:07:19.726003+0000","last_active":"2023-12-24T20:07:19.726003+0000","last_peered":"2023-12-24T20:07:19.726003+0000","last_clean":"2023-12-24T20:07:19.726003+0000","last_became_active":"2023-12-24T20:07:19.725772+0000","last_became_peered":"2023-12-24T20:07:19.725772+0000","last_unstale":"2023-12-24T20:07:19.726003+0000","last_undegraded":"2023-12-24T20:07:19.726003+0000","last_fullsized":"2023-12-24T20:07:19.726003+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:46.115708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735570+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:03:40.424326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726181+0000","last_change":"2023-12-24T20:07:19.726181+0000","last_active":"2023-12-24T20:07:19.726181+0000","last_peered":"2023-12-24T20:07:19.726181+0000","last_clean":"2023-12-24T20:07:19.726181+0000","last_became_active":"2023-12-24T20:07:19.725910+0000","last_became_peered":"2023-12-24T20:07:19.725910+0000","last_unstale":"2023-12-24T20:07:19.726181+0000","last_undegraded":"2023-12-24T20:07:19.726181+0000","last_fullsized":"2023-12-24T20:07:19.726181+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:28.825227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724797+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:54.958356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728483+0000","last_change":"2023-12-24T20:07:19.728483+0000","last_active":"2023-12-24T20:07:19.728483+0000","last_peered":"2023-12-24T20:07:19.728483+0000","last_clean":"2023-12-24T20:07:19.728483+0000","last_became_active":"2023-12-24T20:07:19.728165+0000","last_became_peered":"2023-12-24T20:07:19.728165+0000","last_unstale":"2023-12-24T20:07:19.728483+0000","last_undegraded":"2023-12-24T20:07:19.728483+0000","last_fullsized":"2023-12-24T20:07:19.728483+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.159853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723300+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:16.384382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726579+0000","last_change":"2023-12-24T20:07:19.726579+0000","last_active":"2023-12-24T20:07:19.726579+0000","last_peered":"2023-12-24T20:07:19.726579+0000","last_clean":"2023-12-24T20:07:19.726579+0000","last_became_active":"2023-12-24T20:07:19.726241+0000","last_became_peered":"2023-12-24T20:07:19.726241+0000","last_unstale":"2023-12-24T20:07:19.726579+0000","last_undegraded":"2023-12-24T20:07:19.726579+0000","last_fullsized":"2023-12-24T20:07:19.726579+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:49.634096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724414+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:37:47.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727911+0000","last_change":"2023-12-24T20:07:19.727911+0000","last_active":"2023-12-24T20:07:19.727911+0000","last_peered":"2023-12-24T20:07:19.727911+0000","last_clean":"2023-12-24T20:07:19.727911+0000","last_became_active":"2023-12-24T20:07:19.727639+0000","last_became_peered":"2023-12-24T20:07:19.727639+0000","last_unstale":"2023-12-24T20:07:19.727911+0000","last_undegraded":"2023-12-24T20:07:19.727911+0000","last_fullsized":"2023-12-24T20:07:19.727911+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:52:52.161095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723713+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:40:16.482454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726790+0000","last_change":"2023-12-24T20:07:19.726790+0000","last_active":"2023-12-24T20:07:19.726790+0000","last_peered":"2023-12-24T20:07:19.726790+0000","last_clean":"2023-12-24T20:07:19.726790+0000","last_became_active":"2023-12-24T20:07:19.726577+0000","last_became_peered":"2023-12-24T20:07:19.726577+0000","last_unstale":"2023-12-24T20:07:19.726790+0000","last_undegraded":"2023-12-24T20:07:19.726790+0000","last_fullsized":"2023-12-24T20:07:19.726790+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:40.906179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735584+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:54.958356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727460+0000","last_change":"2023-12-24T20:07:19.727460+0000","last_active":"2023-12-24T20:07:19.727460+0000","last_peered":"2023-12-24T20:07:19.727460+0000","last_clean":"2023-12-24T20:07:19.727460+0000","last_became_active":"2023-12-24T20:07:19.727198+0000","last_became_peered":"2023-12-24T20:07:19.727198+0000","last_unstale":"2023-12-24T20:07:19.727460+0000","last_undegraded":"2023-12-24T20:07:19.727460+0000","last_fullsized":"2023-12-24T20:07:19.727460+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:58.364787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722061+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:59.371790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730168+0000","last_change":"2023-12-24T20:07:19.730168+0000","last_active":"2023-12-24T20:07:19.730168+0000","last_peered":"2023-12-24T20:07:19.730168+0000","last_clean":"2023-12-24T20:07:19.730168+0000","last_became_active":"2023-12-24T20:07:19.729898+0000","last_became_peered":"2023-12-24T20:07:19.729898+0000","last_unstale":"2023-12-24T20:07:19.730168+0000","last_undegraded":"2023-12-24T20:07:19.730168+0000","last_fullsized":"2023-12-24T20:07:19.730168+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:49.634096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722350+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:32:06.062978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729270+0000","last_change":"2023-12-24T20:07:19.729270+0000","last_active":"2023-12-24T20:07:19.729270+0000","last_peered":"2023-12-24T20:07:19.729270+0000","last_clean":"2023-12-24T20:07:19.729270+0000","last_became_active":"2023-12-24T20:07:19.729021+0000","last_became_peered":"2023-12-24T20:07:19.729021+0000","last_unstale":"2023-12-24T20:07:19.729270+0000","last_undegraded":"2023-12-24T20:07:19.729270+0000","last_fullsized":"2023-12-24T20:07:19.729270+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:15.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735343+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:57:31.019587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733162+0000","last_change":"2023-12-24T20:07:19.733162+0000","last_active":"2023-12-24T20:07:19.733162+0000","last_peered":"2023-12-24T20:07:19.733162+0000","last_clean":"2023-12-24T20:07:19.733162+0000","last_became_active":"2023-12-24T20:07:19.727678+0000","last_became_peered":"2023-12-24T20:07:19.727678+0000","last_unstale":"2023-12-24T20:07:19.733162+0000","last_undegraded":"2023-12-24T20:07:19.733162+0000","last_fullsized":"2023-12-24T20:07:19.733162+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:54.337829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721651+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:15.951001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.725269+0000","last_change":"2023-12-24T20:07:19.725269+0000","last_active":"2023-12-24T20:07:19.725269+0000","last_peered":"2023-12-24T20:07:19.725269+0000","last_clean":"2023-12-24T20:07:19.725269+0000","last_became_active":"2023-12-24T20:07:19.725000+0000","last_became_peered":"2023-12-24T20:07:19.725000+0000","last_unstale":"2023-12-24T20:07:19.725269+0000","last_undegraded":"2023-12-24T20:07:19.725269+0000","last_fullsized":"2023-12-24T20:07:19.725269+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:52:32.810420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722533+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:40.754652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728699+0000","last_change":"2023-12-24T20:07:19.728699+0000","last_active":"2023-12-24T20:07:19.728699+0000","last_peered":"2023-12-24T20:07:19.728699+0000","last_clean":"2023-12-24T20:07:19.728699+0000","last_became_active":"2023-12-24T20:07:19.726901+0000","last_became_peered":"2023-12-24T20:07:19.726901+0000","last_unstale":"2023-12-24T20:07:19.728699+0000","last_undegraded":"2023-12-24T20:07:19.728699+0000","last_fullsized":"2023-12-24T20:07:19.728699+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:32:13.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723462+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:01.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729904+0000","last_change":"2023-12-24T20:07:19.729904+0000","last_active":"2023-12-24T20:07:19.729904+0000","last_peered":"2023-12-24T20:07:19.729904+0000","last_clean":"2023-12-24T20:07:19.729904+0000","last_became_active":"2023-12-24T20:07:19.727729+0000","last_became_peered":"2023-12-24T20:07:19.727729+0000","last_unstale":"2023-12-24T20:07:19.729904+0000","last_undegraded":"2023-12-24T20:07:19.729904+0000","last_fullsized":"2023-12-24T20:07:19.729904+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:33:35.721912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725333+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:02.416698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729342+0000","last_change":"2023-12-24T20:07:19.729342+0000","last_active":"2023-12-24T20:07:19.729342+0000","last_peered":"2023-12-24T20:07:19.729342+0000","last_clean":"2023-12-24T20:07:19.729342+0000","last_became_active":"2023-12-24T20:07:19.727563+0000","last_became_peered":"2023-12-24T20:07:19.727563+0000","last_unstale":"2023-12-24T20:07:19.729342+0000","last_undegraded":"2023-12-24T20:07:19.729342+0000","last_fullsized":"2023-12-24T20:07:19.729342+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:06.349039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723040+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:24.246867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733087+0000","last_change":"2023-12-24T20:07:19.733087+0000","last_active":"2023-12-24T20:07:19.733087+0000","last_peered":"2023-12-24T20:07:19.733087+0000","last_clean":"2023-12-24T20:07:19.733087+0000","last_became_active":"2023-12-24T20:07:19.732832+0000","last_became_peered":"2023-12-24T20:07:19.732832+0000","last_unstale":"2023-12-24T20:07:19.733087+0000","last_undegraded":"2023-12-24T20:07:19.733087+0000","last_fullsized":"2023-12-24T20:07:19.733087+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:26.589177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721906+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:31:39.286031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.731693+0000","last_change":"2023-12-24T20:07:19.731693+0000","last_active":"2023-12-24T20:07:19.731693+0000","last_peered":"2023-12-24T20:07:19.731693+0000","last_clean":"2023-12-24T20:07:19.731693+0000","last_became_active":"2023-12-24T20:07:19.729784+0000","last_became_peered":"2023-12-24T20:07:19.729784+0000","last_unstale":"2023-12-24T20:07:19.731693+0000","last_undegraded":"2023-12-24T20:07:19.731693+0000","last_fullsized":"2023-12-24T20:07:19.731693+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:55:13.212890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723984+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:30:58.392159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.732110+0000","last_change":"2023-12-24T20:07:19.732110+0000","last_active":"2023-12-24T20:07:19.732110+0000","last_peered":"2023-12-24T20:07:19.732110+0000","last_clean":"2023-12-24T20:07:19.732110+0000","last_became_active":"2023-12-24T20:07:19.731518+0000","last_became_peered":"2023-12-24T20:07:19.731518+0000","last_unstale":"2023-12-24T20:07:19.732110+0000","last_undegraded":"2023-12-24T20:07:19.732110+0000","last_fullsized":"2023-12-24T20:07:19.732110+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:11.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722355+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:46.553351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730514+0000","last_change":"2023-12-24T20:07:19.730514+0000","last_active":"2023-12-24T20:07:19.730514+0000","last_peered":"2023-12-24T20:07:19.730514+0000","last_clean":"2023-12-24T20:07:19.730514+0000","last_became_active":"2023-12-24T20:07:19.730254+0000","last_became_peered":"2023-12-24T20:07:19.730254+0000","last_unstale":"2023-12-24T20:07:19.730514+0000","last_undegraded":"2023-12-24T20:07:19.730514+0000","last_fullsized":"2023-12-24T20:07:19.730514+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:08:33.502883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727632+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:04:03.611978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729132+0000","last_change":"2023-12-24T20:07:19.729132+0000","last_active":"2023-12-24T20:07:19.729132+0000","last_peered":"2023-12-24T20:07:19.729132+0000","last_clean":"2023-12-24T20:07:19.729132+0000","last_became_active":"2023-12-24T20:07:19.728856+0000","last_became_peered":"2023-12-24T20:07:19.728856+0000","last_unstale":"2023-12-24T20:07:19.729132+0000","last_undegraded":"2023-12-24T20:07:19.729132+0000","last_fullsized":"2023-12-24T20:07:19.729132+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:23.868047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722903+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:21.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.731937+0000","last_change":"2023-12-24T20:07:19.731937+0000","last_active":"2023-12-24T20:07:19.731937+0000","last_peered":"2023-12-24T20:07:19.731937+0000","last_clean":"2023-12-24T20:07:19.731937+0000","last_became_active":"2023-12-24T20:07:19.731703+0000","last_became_peered":"2023-12-24T20:07:19.731703+0000","last_unstale":"2023-12-24T20:07:19.731937+0000","last_undegraded":"2023-12-24T20:07:19.731937+0000","last_fullsized":"2023-12-24T20:07:19.731937+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:19:28.971138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723749+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:14:56.314102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728748+0000","last_change":"2023-12-24T20:07:19.728748+0000","last_active":"2023-12-24T20:07:19.728748+0000","last_peered":"2023-12-24T20:07:19.728748+0000","last_clean":"2023-12-24T20:07:19.728748+0000","last_became_active":"2023-12-24T20:07:19.728485+0000","last_became_peered":"2023-12-24T20:07:19.728485+0000","last_unstale":"2023-12-24T20:07:19.728748+0000","last_undegraded":"2023-12-24T20:07:19.728748+0000","last_fullsized":"2023-12-24T20:07:19.728748+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:25:18.418726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735389+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:35:50.190261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.734498+0000","last_change":"2023-12-24T20:07:19.734498+0000","last_active":"2023-12-24T20:07:19.734498+0000","last_peered":"2023-12-24T20:07:19.734498+0000","last_clean":"2023-12-24T20:07:19.734498+0000","last_became_active":"2023-12-24T20:07:19.731867+0000","last_became_peered":"2023-12-24T20:07:19.731867+0000","last_unstale":"2023-12-24T20:07:19.734498+0000","last_undegraded":"2023-12-24T20:07:19.734498+0000","last_fullsized":"2023-12-24T20:07:19.734498+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:59:31.647812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722648+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:46.553351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729541+0000","last_change":"2023-12-24T20:07:19.729541+0000","last_active":"2023-12-24T20:07:19.729541+0000","last_peered":"2023-12-24T20:07:19.729541+0000","last_clean":"2023-12-24T20:07:19.729541+0000","last_became_active":"2023-12-24T20:07:19.729312+0000","last_became_peered":"2023-12-24T20:07:19.729312+0000","last_unstale":"2023-12-24T20:07:19.729541+0000","last_undegraded":"2023-12-24T20:07:19.729541+0000","last_fullsized":"2023-12-24T20:07:19.729541+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:08.473437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722438+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:28:56.813064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.734185+0000","last_change":"2023-12-24T20:07:19.734185+0000","last_active":"2023-12-24T20:07:19.734185+0000","last_peered":"2023-12-24T20:07:19.734185+0000","last_clean":"2023-12-24T20:07:19.734185+0000","last_became_active":"2023-12-24T20:07:19.733672+0000","last_became_peered":"2023-12-24T20:07:19.733672+0000","last_unstale":"2023-12-24T20:07:19.734185+0000","last_undegraded":"2023-12-24T20:07:19.734185+0000","last_fullsized":"2023-12-24T20:07:19.734185+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:16.540761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735084+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:55:14.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729035+0000","last_change":"2023-12-24T20:07:19.729035+0000","last_active":"2023-12-24T20:07:19.729035+0000","last_peered":"2023-12-24T20:07:19.729035+0000","last_clean":"2023-12-24T20:07:19.729035+0000","last_became_active":"2023-12-24T20:07:19.728769+0000","last_became_peered":"2023-12-24T20:07:19.728769+0000","last_unstale":"2023-12-24T20:07:19.729035+0000","last_undegraded":"2023-12-24T20:07:19.729035+0000","last_fullsized":"2023-12-24T20:07:19.729035+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:05.266214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721475+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:23:37.173750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727957+0000","last_change":"2023-12-24T20:07:19.727957+0000","last_active":"2023-12-24T20:07:19.727957+0000","last_peered":"2023-12-24T20:07:19.727957+0000","last_clean":"2023-12-24T20:07:19.727957+0000","last_became_active":"2023-12-24T20:07:19.727670+0000","last_became_peered":"2023-12-24T20:07:19.727670+0000","last_unstale":"2023-12-24T20:07:19.727957+0000","last_undegraded":"2023-12-24T20:07:19.727957+0000","last_fullsized":"2023-12-24T20:07:19.727957+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:14:55.307099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724045+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:40.754652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730892+0000","last_change":"2023-12-24T20:07:19.730892+0000","last_active":"2023-12-24T20:07:19.730892+0000","last_peered":"2023-12-24T20:07:19.730892+0000","last_clean":"2023-12-24T20:07:19.730892+0000","last_became_active":"2023-12-24T20:07:19.730467+0000","last_became_peered":"2023-12-24T20:07:19.730467+0000","last_unstale":"2023-12-24T20:07:19.730892+0000","last_undegraded":"2023-12-24T20:07:19.730892+0000","last_fullsized":"2023-12-24T20:07:19.730892+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:05.967669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735708+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:17:06.685281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730112+0000","last_change":"2023-12-24T20:07:19.730112+0000","last_active":"2023-12-24T20:07:19.730112+0000","last_peered":"2023-12-24T20:07:19.730112+0000","last_clean":"2023-12-24T20:07:19.730112+0000","last_became_active":"2023-12-24T20:07:19.729114+0000","last_became_peered":"2023-12-24T20:07:19.729114+0000","last_unstale":"2023-12-24T20:07:19.730112+0000","last_undegraded":"2023-12-24T20:07:19.730112+0000","last_fullsized":"2023-12-24T20:07:19.730112+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:25.333632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722776+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:01:36.522227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728441+0000","last_change":"2023-12-24T20:07:19.728441+0000","last_active":"2023-12-24T20:07:19.728441+0000","last_peered":"2023-12-24T20:07:19.728441+0000","last_clean":"2023-12-24T20:07:19.728441+0000","last_became_active":"2023-12-24T20:07:19.728198+0000","last_became_peered":"2023-12-24T20:07:19.728198+0000","last_unstale":"2023-12-24T20:07:19.728441+0000","last_undegraded":"2023-12-24T20:07:19.728441+0000","last_fullsized":"2023-12-24T20:07:19.728441+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:38.344997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727046+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:36:22.904751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733303+0000","last_change":"2023-12-24T20:07:19.733303+0000","last_active":"2023-12-24T20:07:19.733303+0000","last_peered":"2023-12-24T20:07:19.733303+0000","last_clean":"2023-12-24T20:07:19.733303+0000","last_became_active":"2023-12-24T20:07:19.732962+0000","last_became_peered":"2023-12-24T20:07:19.732962+0000","last_unstale":"2023-12-24T20:07:19.733303+0000","last_undegraded":"2023-12-24T20:07:19.733303+0000","last_fullsized":"2023-12-24T20:07:19.733303+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:53.399792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724428+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:01:36.522227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730699+0000","last_change":"2023-12-24T20:07:19.730699+0000","last_active":"2023-12-24T20:07:19.730699+0000","last_peered":"2023-12-24T20:07:19.730699+0000","last_clean":"2023-12-24T20:07:19.730699+0000","last_became_active":"2023-12-24T20:07:19.730166+0000","last_became_peered":"2023-12-24T20:07:19.730166+0000","last_unstale":"2023-12-24T20:07:19.730699+0000","last_undegraded":"2023-12-24T20:07:19.730699+0000","last_fullsized":"2023-12-24T20:07:19.730699+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:42.926099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":304,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-12-24T20:07:18.720765+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:07:18.720765+0000","last_peered":"2023-12-24T20:07:18.720765+0000","last_clean":"2023-12-24T20:07:18.720765+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:07:18.720765+0000","last_undegraded":"2023-12-24T20:07:18.720765+0000","last_fullsized":"2023-12-24T20:07:18.720765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1577,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193735,"statfs":{"total":200000000,"available":198385015,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.308,"15min":0.307},"max":{"1min":0.80200000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.56999999999999995},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.872,"15min":0.872},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.39400000000000002,"15min":0.34100000000000003},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.623},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.82799999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.312},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.95699999999999996},"last":0.505}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.379,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.81499999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.752,"15min":0.80000000000000004},"last":0.499}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.79100000000000004,"15min":0.83699999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.873},"last":0.65700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194311,"statfs":{"total":200000000,"available":198975383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.0309999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.45700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":0.80200000000000005,"15min":0.95799999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.27000000000000002},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.44,"5min":0.378,"15min":0.33200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0640000000000001},"last":0.57599999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.077},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.372},"max":{"1min":0.79100000000000004,"5min":0.877,"15min":1.048},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.86499999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.254},"max":{"1min":0.628,"5min":0.748,"15min":0.84699999999999998},"last":0.45100000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.372,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.31},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40799999999999997,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.54800000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33300000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.432},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.35199999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.80900000000000005,"5min":0.871,"15min":0.871},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.59799999999999998},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.94299999999999995,"5min":1.014,"15min":1.014},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.04},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86199999999999999,"5min":0.998,"15min":0.998},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.63},"min":{"1min":0.437,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.64300000000000002},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.39500000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.57199999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.629},"min":{"1min":0.501,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69399999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":1.0109999999999999,"5min":1.03,"15min":1.03},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1577,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193735,"statfs":{"total":200000000,"available":198385015,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36499999999999999,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.45800000000000002,"5min":0.70799999999999996,"15min":0.97999999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.439,"5min":0.65400000000000003,"15min":0.92700000000000005},"last":0.31},{"interface":"front","average":{"1min":0.435,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.93999999999999995},"last":0.376}]},{"osd":3,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56699999999999995,"5min":0.70199999999999996,"15min":2.573},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":1.073,"15min":1.3500000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.65200000000000002},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":2.7149999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.372},"max":{"1min":0.94599999999999995,"5min":1.0569999999999999,"15min":2.6859999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.006},"last":0.77300000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":1.0489999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":1.5429999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.69999999999999996},"min":{"1min":0.58699999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.249,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.50800000000000001,"5min":0.61599999999999999,"15min":0.78900000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.72299999999999998},"last":0.307}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38100000000000001,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.77700000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.82799999999999996},"last":0.38700000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.84699999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.88900000000000001},"last":0.34699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.97999999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.2649999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":3.577},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":1.052,"15min":7.0220000000000002},"last":0.63}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.075,"5min":1.075,"15min":1.298},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":3.637},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.014,"15min":7.0599999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.55400000000000005,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.331},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.373,"15min":0.34599999999999997},"min":{"1min":0.26000000000000001,"5min":0.22600000000000001,"15min":0.182},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.66500000000000004},"last":0.31900000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.371,"15min":0.35899999999999999},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59399999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35199999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.66500000000000004,"15min":0.79500000000000004},"last":0.377},{"interface":"front","average":{"1min":0.496,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.27800000000000002,"15min":0.27300000000000002},"max":{"1min":0.64400000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.30199999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.55300000000000005,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.90600000000000003,"5min":0.92100000000000004,"15min":1.337},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.622},"min":{"1min":0.48699999999999999,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":1.038,"15min":1.2010000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53900000000000003,"5min":0.44900000000000001,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89900000000000002,"15min":0.97799999999999998},"last":0.66500000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.024,"15min":1.1699999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":1.4570000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.65300000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.879,"5min":1.02,"15min":1.3779999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.54200000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.004,"15min":1.006},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.44,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74099999999999999,"5min":0.752,"15min":0.82199999999999995},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":4.883},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":1.544},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32100000000000001},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33300000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.75},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.52,"5min":1.52,"15min":8.8200000000000003},"last":0.48299999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.49099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":1.4419999999999999},"last":0.378},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.57799999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":3.8279999999999998},"last":0.313}]},{"osd":6,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.54800000000000004}]},{"osd":7,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.82999999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.33500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":14.039999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.375,"15min":0.31},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194311,"statfs":{"total":200000000,"available":198975383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":4.6059999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":1.847},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.63600000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.623},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":1.97},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":3.2850000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.877,"15min":0.877},"last":0.67400000000000004}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":1.0289999999999999,"15min":1.3320000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.0589999999999999,"15min":4.5330000000000004},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.48599999999999999},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.498},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78700000000000003,"5min":0.96499999999999997,"15min":1.8839999999999999},"last":0.46700000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.98799999999999999,"15min":3.766},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56799999999999995}]}]}],"pool_statfs":[]}} 2023-12-24T20:07:25.277 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:07:25.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.433+0000 7fdfc358c700 1 Processor -- start 2023-12-24T20:07:25.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.433+0000 7fdfc358c700 1 -- start start 2023-12-24T20:07:25.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.434+0000 7fdfc358c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 0x7fdfbc0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.434+0000 7fdfc358c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdfbc068c80 0x7fdfbc067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.434+0000 7fdfc358c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc0687f0 con 0x7fdfbc0a6c80 2023-12-24T20:07:25.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.434+0000 7fdfc358c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc0a7100 con 0x7fdfbc068c80 2023-12-24T20:07:25.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.434+0000 7fdfc358c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc067be0 con 0x7fdfbc0af710 2023-12-24T20:07:25.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.434+0000 7fdfc0b27700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdfbc068c80 0x7fdfbc067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfc0b27700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdfbc068c80 0x7fdfbc067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41180/0 (socket says 172.21.15.61:41180) 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfc0b27700 1 -- 172.21.15.61:0/2512853532 learned_addr learned my addr 172.21.15.61:0/2512853532 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfc1328700 1 --2- 172.21.15.61:0/2512853532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 0x7fdfbc0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfc0b27700 1 -- 172.21.15.61:0/2512853532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 msgr2=0x7fdfbc0afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfc0b27700 1 --2- 172.21.15.61:0/2512853532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 0x7fdfbc0afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfc0b27700 1 -- 172.21.15.61:0/2512853532 >> v1:172.21.15.133:6789/0 conn(0x7fdfbc0a6c80 legacy=0x7fdfbc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfc0b27700 1 -- 172.21.15.61:0/2512853532 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc067ec0 con 0x7fdfbc068c80 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfc0b27700 1 --2- 172.21.15.61:0/2512853532 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 0x7fdfbc067550 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800bc50 tx=0x7fdfb800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12aaa43db75f88b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfb3fff700 1 -- 172.21.15.61:0/2512853532 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800dbf0 con 0x7fdfbc068c80 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfb3fff700 1 -- 172.21.15.61:0/2512853532 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb800dd50 con 0x7fdfbc068c80 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.435+0000 7fdfb3fff700 1 -- 172.21.15.61:0/2512853532 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80196b0 con 0x7fdfbc068c80 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.436+0000 7fdfc358c700 1 -- 172.21.15.61:0/2512853532 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 msgr2=0x7fdfbc067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.436+0000 7fdfc358c700 1 --2- 172.21.15.61:0/2512853532 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 0x7fdfbc067550 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800bc50 tx=0x7fdfb800b4f0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.436+0000 7fdfc358c700 1 -- 172.21.15.61:0/2512853532 shutdown_connections 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.436+0000 7fdfc358c700 1 --2- 172.21.15.61:0/2512853532 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 0x7fdfbc0afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.436+0000 7fdfc358c700 1 --2- 172.21.15.61:0/2512853532 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 0x7fdfbc067550 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.436+0000 7fdfc358c700 1 -- 172.21.15.61:0/2512853532 >> 172.21.15.61:0/2512853532 conn(0x7fdfbc0ca200 msgr2=0x7fdfbc0ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:25.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.436+0000 7fdfc358c700 1 -- 172.21.15.61:0/2512853532 shutdown_connections 2023-12-24T20:07:25.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.436+0000 7fdfc358c700 1 -- 172.21.15.61:0/2512853532 wait complete. 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.437+0000 7fdfc358c700 1 Processor -- start 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.437+0000 7fdfc358c700 1 -- start start 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc358c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 0x7fdfbc16b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc358c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfbc0a6c80 0x7fdfbc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc358c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 0x7fdfbc169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc358c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0b0a70 con 0x7fdfbc068c80 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc358c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0b18b0 con 0x7fdfbc0a6c80 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc358c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0b0ca0 con 0x7fdfbc0af710 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc1328700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 0x7fdfbc16b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc1328700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 0x7fdfbc16b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41190/0 (socket says 172.21.15.61:41190) 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc1328700 1 -- 172.21.15.61:0/2977593416 learned_addr learned my addr 172.21.15.61:0/2977593416 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:25.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc0b27700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfbc0a6c80 0x7fdfbc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc1b29700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 0x7fdfbc169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc1328700 1 -- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 msgr2=0x7fdfbc169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc1328700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 0x7fdfbc169de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc1328700 1 -- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfbc0a6c80 msgr2=0x7fdfbc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc1328700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfbc0a6c80 0x7fdfbc0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc1328700 1 -- 172.21.15.61:0/2977593416 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb800b790 con 0x7fdfbc068c80 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.438+0000 7fdfc1b29700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 0x7fdfbc169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.439+0000 7fdfc1328700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 0x7fdfbc16b0b0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00ec80 tx=0x7fdfac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.439+0000 7fdfb17fa700 1 -- 172.21.15.61:0/2977593416 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00c850 con 0x7fdfbc068c80 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.439+0000 7fdfb17fa700 1 -- 172.21.15.61:0/2977593416 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac00c9b0 con 0x7fdfbc068c80 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.439+0000 7fdfc358c700 1 -- 172.21.15.61:0/2977593416 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc0b0f80 con 0x7fdfbc068c80 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.439+0000 7fdfb17fa700 1 -- 172.21.15.61:0/2977593416 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00cd50 con 0x7fdfbc068c80 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.439+0000 7fdfc358c700 1 -- 172.21.15.61:0/2977593416 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc0b1540 con 0x7fdfbc068c80 2023-12-24T20:07:25.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.440+0000 7fdfc358c700 1 -- 172.21.15.61:0/2977593416 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc04c3c0 con 0x7fdfbc068c80 2023-12-24T20:07:25.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.440+0000 7fdfb17fa700 1 -- 172.21.15.61:0/2977593416 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdfac013680 con 0x7fdfbc068c80 2023-12-24T20:07:25.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.441+0000 7fdfb17fa700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.441+0000 7fdfb17fa700 1 -- 172.21.15.61:0/2977593416 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdfac084890 con 0x7fdfbc068c80 2023-12-24T20:07:25.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.441+0000 7fdfc0b27700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.441+0000 7fdfc0b27700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdfa0066f30 0x7fdfa00693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800bc50 tx=0x7fdfb801b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:25.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.445+0000 7fdfb17fa700 1 -- 172.21.15.61:0/2977593416 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfac051a60 con 0x7fdfbc068c80 2023-12-24T20:07:25.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.639+0000 7fdfc358c700 1 -- 172.21.15.61:0/2977593416 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfbc15a100 con 0x7fdfa0066f30 2023-12-24T20:07:25.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.647+0000 7fdfb17fa700 1 -- 172.21.15.61:0/2977593416 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281977 (secure 0 0 0) 0x7fdfbc15a100 con 0x7fdfa0066f30 2023-12-24T20:07:25.651 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:25.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 -- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdfa0066f30 msgr2=0x7fdfa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdfa0066f30 0x7fdfa00693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800bc50 tx=0x7fdfb801b000 comp rx=0 tx=0).stop 2023-12-24T20:07:25.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 -- 172.21.15.61:0/2977593416 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 msgr2=0x7fdfbc16b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 0x7fdfbc16b0b0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00ec80 tx=0x7fdfac0091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 -- 172.21.15.61:0/2977593416 shutdown_connections 2023-12-24T20:07:25.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdfbc0af710 0x7fdfbc169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdfa0066f30 0x7fdfa00693e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdfbc068c80 0x7fdfbc16b0b0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 --2- 172.21.15.61:0/2977593416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfbc0a6c80 0x7fdfbc0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 -- 172.21.15.61:0/2977593416 >> 172.21.15.61:0/2977593416 conn(0x7fdfbc0ca200 msgr2=0x7fdfbc063440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:25.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 -- 172.21.15.61:0/2977593416 shutdown_connections 2023-12-24T20:07:25.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.650+0000 7fdfc358c700 1 -- 172.21.15.61:0/2977593416 wait complete. 2023-12-24T20:07:25.654 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:07:25.663 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2023-12-24T20:07:24.461406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553366,"statfs":{"total":1600000000,"available":1590647380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.743744"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724162+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:55:52.727956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736480+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:57:31.019587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728167+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:25:19.425730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722624+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:27:58.612009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.737507+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:26:51.747403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736490+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:20.653180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724421+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:46:48.438634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736358+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:55:36.913522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736358+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:06.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735315+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:54.406795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735354+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:09.684018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735765+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:55.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727450+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:55:49.272602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728704+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:26.340636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723433+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:09.480440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.726044+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:36:59.743099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735983+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:46.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723172+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:28:56.813064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736021+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:02.416698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725677+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:04.294798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736004+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:04.294798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735424+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:43.933103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.739318+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:29.832230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735310+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:54:17.156416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.726478+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:20.653180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723804+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:01:24.163148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725704+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:46.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723863+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:41.519358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728332+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:34.166856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.737113+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:26:51.747403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736474+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:41:37.645101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724819+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:21.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724739+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:29:03.643933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729857+0000","last_change":"2023-12-24T20:07:19.729857+0000","last_active":"2023-12-24T20:07:19.729857+0000","last_peered":"2023-12-24T20:07:19.729857+0000","last_clean":"2023-12-24T20:07:19.729857+0000","last_became_active":"2023-12-24T20:07:19.729631+0000","last_became_peered":"2023-12-24T20:07:19.729631+0000","last_unstale":"2023-12-24T20:07:19.729857+0000","last_undegraded":"2023-12-24T20:07:19.729857+0000","last_fullsized":"2023-12-24T20:07:19.729857+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:32.809199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735813+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:18:51.365236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726003+0000","last_change":"2023-12-24T20:07:19.726003+0000","last_active":"2023-12-24T20:07:19.726003+0000","last_peered":"2023-12-24T20:07:19.726003+0000","last_clean":"2023-12-24T20:07:19.726003+0000","last_became_active":"2023-12-24T20:07:19.725772+0000","last_became_peered":"2023-12-24T20:07:19.725772+0000","last_unstale":"2023-12-24T20:07:19.726003+0000","last_undegraded":"2023-12-24T20:07:19.726003+0000","last_fullsized":"2023-12-24T20:07:19.726003+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:46.115708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735570+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:03:40.424326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726181+0000","last_change":"2023-12-24T20:07:19.726181+0000","last_active":"2023-12-24T20:07:19.726181+0000","last_peered":"2023-12-24T20:07:19.726181+0000","last_clean":"2023-12-24T20:07:19.726181+0000","last_became_active":"2023-12-24T20:07:19.725910+0000","last_became_peered":"2023-12-24T20:07:19.725910+0000","last_unstale":"2023-12-24T20:07:19.726181+0000","last_undegraded":"2023-12-24T20:07:19.726181+0000","last_fullsized":"2023-12-24T20:07:19.726181+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:28.825227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724797+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:54.958356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728483+0000","last_change":"2023-12-24T20:07:19.728483+0000","last_active":"2023-12-24T20:07:19.728483+0000","last_peered":"2023-12-24T20:07:19.728483+0000","last_clean":"2023-12-24T20:07:19.728483+0000","last_became_active":"2023-12-24T20:07:19.728165+0000","last_became_peered":"2023-12-24T20:07:19.728165+0000","last_unstale":"2023-12-24T20:07:19.728483+0000","last_undegraded":"2023-12-24T20:07:19.728483+0000","last_fullsized":"2023-12-24T20:07:19.728483+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.159853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723300+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:16.384382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726579+0000","last_change":"2023-12-24T20:07:19.726579+0000","last_active":"2023-12-24T20:07:19.726579+0000","last_peered":"2023-12-24T20:07:19.726579+0000","last_clean":"2023-12-24T20:07:19.726579+0000","last_became_active":"2023-12-24T20:07:19.726241+0000","last_became_peered":"2023-12-24T20:07:19.726241+0000","last_unstale":"2023-12-24T20:07:19.726579+0000","last_undegraded":"2023-12-24T20:07:19.726579+0000","last_fullsized":"2023-12-24T20:07:19.726579+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:49.634096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724414+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:37:47.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727911+0000","last_change":"2023-12-24T20:07:19.727911+0000","last_active":"2023-12-24T20:07:19.727911+0000","last_peered":"2023-12-24T20:07:19.727911+0000","last_clean":"2023-12-24T20:07:19.727911+0000","last_became_active":"2023-12-24T20:07:19.727639+0000","last_became_peered":"2023-12-24T20:07:19.727639+0000","last_unstale":"2023-12-24T20:07:19.727911+0000","last_undegraded":"2023-12-24T20:07:19.727911+0000","last_fullsized":"2023-12-24T20:07:19.727911+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:52:52.161095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723713+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:40:16.482454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726790+0000","last_change":"2023-12-24T20:07:19.726790+0000","last_active":"2023-12-24T20:07:19.726790+0000","last_peered":"2023-12-24T20:07:19.726790+0000","last_clean":"2023-12-24T20:07:19.726790+0000","last_became_active":"2023-12-24T20:07:19.726577+0000","last_became_peered":"2023-12-24T20:07:19.726577+0000","last_unstale":"2023-12-24T20:07:19.726790+0000","last_undegraded":"2023-12-24T20:07:19.726790+0000","last_fullsized":"2023-12-24T20:07:19.726790+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:40.906179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735584+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:54.958356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727460+0000","last_change":"2023-12-24T20:07:19.727460+0000","last_active":"2023-12-24T20:07:19.727460+0000","last_peered":"2023-12-24T20:07:19.727460+0000","last_clean":"2023-12-24T20:07:19.727460+0000","last_became_active":"2023-12-24T20:07:19.727198+0000","last_became_peered":"2023-12-24T20:07:19.727198+0000","last_unstale":"2023-12-24T20:07:19.727460+0000","last_undegraded":"2023-12-24T20:07:19.727460+0000","last_fullsized":"2023-12-24T20:07:19.727460+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:58.364787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722061+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:59.371790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730168+0000","last_change":"2023-12-24T20:07:19.730168+0000","last_active":"2023-12-24T20:07:19.730168+0000","last_peered":"2023-12-24T20:07:19.730168+0000","last_clean":"2023-12-24T20:07:19.730168+0000","last_became_active":"2023-12-24T20:07:19.729898+0000","last_became_peered":"2023-12-24T20:07:19.729898+0000","last_unstale":"2023-12-24T20:07:19.730168+0000","last_undegraded":"2023-12-24T20:07:19.730168+0000","last_fullsized":"2023-12-24T20:07:19.730168+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:49.634096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722350+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:32:06.062978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729270+0000","last_change":"2023-12-24T20:07:19.729270+0000","last_active":"2023-12-24T20:07:19.729270+0000","last_peered":"2023-12-24T20:07:19.729270+0000","last_clean":"2023-12-24T20:07:19.729270+0000","last_became_active":"2023-12-24T20:07:19.729021+0000","last_became_peered":"2023-12-24T20:07:19.729021+0000","last_unstale":"2023-12-24T20:07:19.729270+0000","last_undegraded":"2023-12-24T20:07:19.729270+0000","last_fullsized":"2023-12-24T20:07:19.729270+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:15.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735343+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:57:31.019587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733162+0000","last_change":"2023-12-24T20:07:19.733162+0000","last_active":"2023-12-24T20:07:19.733162+0000","last_peered":"2023-12-24T20:07:19.733162+0000","last_clean":"2023-12-24T20:07:19.733162+0000","last_became_active":"2023-12-24T20:07:19.727678+0000","last_became_peered":"2023-12-24T20:07:19.727678+0000","last_unstale":"2023-12-24T20:07:19.733162+0000","last_undegraded":"2023-12-24T20:07:19.733162+0000","last_fullsized":"2023-12-24T20:07:19.733162+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:54.337829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721651+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:15.951001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.725269+0000","last_change":"2023-12-24T20:07:19.725269+0000","last_active":"2023-12-24T20:07:19.725269+0000","last_peered":"2023-12-24T20:07:19.725269+0000","last_clean":"2023-12-24T20:07:19.725269+0000","last_became_active":"2023-12-24T20:07:19.725000+0000","last_became_peered":"2023-12-24T20:07:19.725000+0000","last_unstale":"2023-12-24T20:07:19.725269+0000","last_undegraded":"2023-12-24T20:07:19.725269+0000","last_fullsized":"2023-12-24T20:07:19.725269+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:52:32.810420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722533+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:40.754652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728699+0000","last_change":"2023-12-24T20:07:19.728699+0000","last_active":"2023-12-24T20:07:19.728699+0000","last_peered":"2023-12-24T20:07:19.728699+0000","last_clean":"2023-12-24T20:07:19.728699+0000","last_became_active":"2023-12-24T20:07:19.726901+0000","last_became_peered":"2023-12-24T20:07:19.726901+0000","last_unstale":"2023-12-24T20:07:19.728699+0000","last_undegraded":"2023-12-24T20:07:19.728699+0000","last_fullsized":"2023-12-24T20:07:19.728699+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:32:13.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723462+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:01.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729904+0000","last_change":"2023-12-24T20:07:19.729904+0000","last_active":"2023-12-24T20:07:19.729904+0000","last_peered":"2023-12-24T20:07:19.729904+0000","last_clean":"2023-12-24T20:07:19.729904+0000","last_became_active":"2023-12-24T20:07:19.727729+0000","last_became_peered":"2023-12-24T20:07:19.727729+0000","last_unstale":"2023-12-24T20:07:19.729904+0000","last_undegraded":"2023-12-24T20:07:19.729904+0000","last_fullsized":"2023-12-24T20:07:19.729904+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:33:35.721912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725333+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:02.416698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729342+0000","last_change":"2023-12-24T20:07:19.729342+0000","last_active":"2023-12-24T20:07:19.729342+0000","last_peered":"2023-12-24T20:07:19.729342+0000","last_clean":"2023-12-24T20:07:19.729342+0000","last_became_active":"2023-12-24T20:07:19.727563+0000","last_became_peered":"2023-12-24T20:07:19.727563+0000","last_unstale":"2023-12-24T20:07:19.729342+0000","last_undegraded":"2023-12-24T20:07:19.729342+0000","last_fullsized":"2023-12-24T20:07:19.729342+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:06.349039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723040+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:24.246867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733087+0000","last_change":"2023-12-24T20:07:19.733087+0000","last_active":"2023-12-24T20:07:19.733087+0000","last_peered":"2023-12-24T20:07:19.733087+0000","last_clean":"2023-12-24T20:07:19.733087+0000","last_became_active":"2023-12-24T20:07:19.732832+0000","last_became_peered":"2023-12-24T20:07:19.732832+0000","last_unstale":"2023-12-24T20:07:19.733087+0000","last_undegraded":"2023-12-24T20:07:19.733087+0000","last_fullsized":"2023-12-24T20:07:19.733087+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:26.589177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721906+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:31:39.286031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.731693+0000","last_change":"2023-12-24T20:07:19.731693+0000","last_active":"2023-12-24T20:07:19.731693+0000","last_peered":"2023-12-24T20:07:19.731693+0000","last_clean":"2023-12-24T20:07:19.731693+0000","last_became_active":"2023-12-24T20:07:19.729784+0000","last_became_peered":"2023-12-24T20:07:19.729784+0000","last_unstale":"2023-12-24T20:07:19.731693+0000","last_undegraded":"2023-12-24T20:07:19.731693+0000","last_fullsized":"2023-12-24T20:07:19.731693+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:55:13.212890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723984+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:30:58.392159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.732110+0000","last_change":"2023-12-24T20:07:19.732110+0000","last_active":"2023-12-24T20:07:19.732110+0000","last_peered":"2023-12-24T20:07:19.732110+0000","last_clean":"2023-12-24T20:07:19.732110+0000","last_became_active":"2023-12-24T20:07:19.731518+0000","last_became_peered":"2023-12-24T20:07:19.731518+0000","last_unstale":"2023-12-24T20:07:19.732110+0000","last_undegraded":"2023-12-24T20:07:19.732110+0000","last_fullsized":"2023-12-24T20:07:19.732110+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:11.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722355+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:46.553351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730514+0000","last_change":"2023-12-24T20:07:19.730514+0000","last_active":"2023-12-24T20:07:19.730514+0000","last_peered":"2023-12-24T20:07:19.730514+0000","last_clean":"2023-12-24T20:07:19.730514+0000","last_became_active":"2023-12-24T20:07:19.730254+0000","last_became_peered":"2023-12-24T20:07:19.730254+0000","last_unstale":"2023-12-24T20:07:19.730514+0000","last_undegraded":"2023-12-24T20:07:19.730514+0000","last_fullsized":"2023-12-24T20:07:19.730514+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:08:33.502883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727632+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:04:03.611978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729132+0000","last_change":"2023-12-24T20:07:19.729132+0000","last_active":"2023-12-24T20:07:19.729132+0000","last_peered":"2023-12-24T20:07:19.729132+0000","last_clean":"2023-12-24T20:07:19.729132+0000","last_became_active":"2023-12-24T20:07:19.728856+0000","last_became_peered":"2023-12-24T20:07:19.728856+0000","last_unstale":"2023-12-24T20:07:19.729132+0000","last_undegraded":"2023-12-24T20:07:19.729132+0000","last_fullsized":"2023-12-24T20:07:19.729132+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:23.868047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722903+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:21.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.731937+0000","last_change":"2023-12-24T20:07:19.731937+0000","last_active":"2023-12-24T20:07:19.731937+0000","last_peered":"2023-12-24T20:07:19.731937+0000","last_clean":"2023-12-24T20:07:19.731937+0000","last_became_active":"2023-12-24T20:07:19.731703+0000","last_became_peered":"2023-12-24T20:07:19.731703+0000","last_unstale":"2023-12-24T20:07:19.731937+0000","last_undegraded":"2023-12-24T20:07:19.731937+0000","last_fullsized":"2023-12-24T20:07:19.731937+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:19:28.971138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723749+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:14:56.314102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728748+0000","last_change":"2023-12-24T20:07:19.728748+0000","last_active":"2023-12-24T20:07:19.728748+0000","last_peered":"2023-12-24T20:07:19.728748+0000","last_clean":"2023-12-24T20:07:19.728748+0000","last_became_active":"2023-12-24T20:07:19.728485+0000","last_became_peered":"2023-12-24T20:07:19.728485+0000","last_unstale":"2023-12-24T20:07:19.728748+0000","last_undegraded":"2023-12-24T20:07:19.728748+0000","last_fullsized":"2023-12-24T20:07:19.728748+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:25:18.418726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735389+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:35:50.190261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.734498+0000","last_change":"2023-12-24T20:07:19.734498+0000","last_active":"2023-12-24T20:07:19.734498+0000","last_peered":"2023-12-24T20:07:19.734498+0000","last_clean":"2023-12-24T20:07:19.734498+0000","last_became_active":"2023-12-24T20:07:19.731867+0000","last_became_peered":"2023-12-24T20:07:19.731867+0000","last_unstale":"2023-12-24T20:07:19.734498+0000","last_undegraded":"2023-12-24T20:07:19.734498+0000","last_fullsized":"2023-12-24T20:07:19.734498+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:59:31.647812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722648+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:46.553351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729541+0000","last_change":"2023-12-24T20:07:19.729541+0000","last_active":"2023-12-24T20:07:19.729541+0000","last_peered":"2023-12-24T20:07:19.729541+0000","last_clean":"2023-12-24T20:07:19.729541+0000","last_became_active":"2023-12-24T20:07:19.729312+0000","last_became_peered":"2023-12-24T20:07:19.729312+0000","last_unstale":"2023-12-24T20:07:19.729541+0000","last_undegraded":"2023-12-24T20:07:19.729541+0000","last_fullsized":"2023-12-24T20:07:19.729541+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:08.473437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722438+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:28:56.813064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.734185+0000","last_change":"2023-12-24T20:07:19.734185+0000","last_active":"2023-12-24T20:07:19.734185+0000","last_peered":"2023-12-24T20:07:19.734185+0000","last_clean":"2023-12-24T20:07:19.734185+0000","last_became_active":"2023-12-24T20:07:19.733672+0000","last_became_peered":"2023-12-24T20:07:19.733672+0000","last_unstale":"2023-12-24T20:07:19.734185+0000","last_undegraded":"2023-12-24T20:07:19.734185+0000","last_fullsized":"2023-12-24T20:07:19.734185+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:16.540761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735084+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:55:14.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729035+0000","last_change":"2023-12-24T20:07:19.729035+0000","last_active":"2023-12-24T20:07:19.729035+0000","last_peered":"2023-12-24T20:07:19.729035+0000","last_clean":"2023-12-24T20:07:19.729035+0000","last_became_active":"2023-12-24T20:07:19.728769+0000","last_became_peered":"2023-12-24T20:07:19.728769+0000","last_unstale":"2023-12-24T20:07:19.729035+0000","last_undegraded":"2023-12-24T20:07:19.729035+0000","last_fullsized":"2023-12-24T20:07:19.729035+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:05.266214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721475+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:23:37.173750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727957+0000","last_change":"2023-12-24T20:07:19.727957+0000","last_active":"2023-12-24T20:07:19.727957+0000","last_peered":"2023-12-24T20:07:19.727957+0000","last_clean":"2023-12-24T20:07:19.727957+0000","last_became_active":"2023-12-24T20:07:19.727670+0000","last_became_peered":"2023-12-24T20:07:19.727670+0000","last_unstale":"2023-12-24T20:07:19.727957+0000","last_undegraded":"2023-12-24T20:07:19.727957+0000","last_fullsized":"2023-12-24T20:07:19.727957+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:14:55.307099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724045+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:40.754652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730892+0000","last_change":"2023-12-24T20:07:19.730892+0000","last_active":"2023-12-24T20:07:19.730892+0000","last_peered":"2023-12-24T20:07:19.730892+0000","last_clean":"2023-12-24T20:07:19.730892+0000","last_became_active":"2023-12-24T20:07:19.730467+0000","last_became_peered":"2023-12-24T20:07:19.730467+0000","last_unstale":"2023-12-24T20:07:19.730892+0000","last_undegraded":"2023-12-24T20:07:19.730892+0000","last_fullsized":"2023-12-24T20:07:19.730892+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:05.967669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735708+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:17:06.685281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730112+0000","last_change":"2023-12-24T20:07:19.730112+0000","last_active":"2023-12-24T20:07:19.730112+0000","last_peered":"2023-12-24T20:07:19.730112+0000","last_clean":"2023-12-24T20:07:19.730112+0000","last_became_active":"2023-12-24T20:07:19.729114+0000","last_became_peered":"2023-12-24T20:07:19.729114+0000","last_unstale":"2023-12-24T20:07:19.730112+0000","last_undegraded":"2023-12-24T20:07:19.730112+0000","last_fullsized":"2023-12-24T20:07:19.730112+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:25.333632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722776+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:01:36.522227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728441+0000","last_change":"2023-12-24T20:07:19.728441+0000","last_active":"2023-12-24T20:07:19.728441+0000","last_peered":"2023-12-24T20:07:19.728441+0000","last_clean":"2023-12-24T20:07:19.728441+0000","last_became_active":"2023-12-24T20:07:19.728198+0000","last_became_peered":"2023-12-24T20:07:19.728198+0000","last_unstale":"2023-12-24T20:07:19.728441+0000","last_undegraded":"2023-12-24T20:07:19.728441+0000","last_fullsized":"2023-12-24T20:07:19.728441+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:38.344997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727046+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:36:22.904751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733303+0000","last_change":"2023-12-24T20:07:19.733303+0000","last_active":"2023-12-24T20:07:19.733303+0000","last_peered":"2023-12-24T20:07:19.733303+0000","last_clean":"2023-12-24T20:07:19.733303+0000","last_became_active":"2023-12-24T20:07:19.732962+0000","last_became_peered":"2023-12-24T20:07:19.732962+0000","last_unstale":"2023-12-24T20:07:19.733303+0000","last_undegraded":"2023-12-24T20:07:19.733303+0000","last_fullsized":"2023-12-24T20:07:19.733303+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:53.399792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724428+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:01:36.522227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730699+0000","last_change":"2023-12-24T20:07:19.730699+0000","last_active":"2023-12-24T20:07:19.730699+0000","last_peered":"2023-12-24T20:07:19.730699+0000","last_clean":"2023-12-24T20:07:19.730699+0000","last_became_active":"2023-12-24T20:07:19.730166+0000","last_became_peered":"2023-12-24T20:07:19.730166+0000","last_unstale":"2023-12-24T20:07:19.730699+0000","last_undegraded":"2023-12-24T20:07:19.730699+0000","last_fullsized":"2023-12-24T20:07:19.730699+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:42.926099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":304,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-12-24T20:07:18.720765+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:07:18.720765+0000","last_peered":"2023-12-24T20:07:18.720765+0000","last_clean":"2023-12-24T20:07:18.720765+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:07:18.720765+0000","last_undegraded":"2023-12-24T20:07:18.720765+0000","last_fullsized":"2023-12-24T20:07:18.720765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1577,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193735,"statfs":{"total":200000000,"available":198385015,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.308,"15min":0.307},"max":{"1min":0.80200000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.56999999999999995},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.872,"15min":0.872},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.39400000000000002,"15min":0.34100000000000003},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.623},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.82799999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.312},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.95699999999999996},"last":0.505}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.379,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.81499999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.752,"15min":0.80000000000000004},"last":0.499}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.79100000000000004,"15min":0.83699999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.873},"last":0.65700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194311,"statfs":{"total":200000000,"available":198975383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.0309999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.45700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":0.80200000000000005,"15min":0.95799999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.27000000000000002},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.44,"5min":0.378,"15min":0.33200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0640000000000001},"last":0.57599999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.077},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.372},"max":{"1min":0.79100000000000004,"5min":0.877,"15min":1.048},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.86499999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.254},"max":{"1min":0.628,"5min":0.748,"15min":0.84699999999999998},"last":0.45100000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.372,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.31},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40799999999999997,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.54800000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33300000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.432},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.35199999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.80900000000000005,"5min":0.871,"15min":0.871},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.59799999999999998},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.94299999999999995,"5min":1.014,"15min":1.014},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.04},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86199999999999999,"5min":0.998,"15min":0.998},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.63},"min":{"1min":0.437,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.64300000000000002},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.39500000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.57199999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.629},"min":{"1min":0.501,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69399999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":1.0109999999999999,"5min":1.03,"15min":1.03},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1577,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193735,"statfs":{"total":200000000,"available":198385015,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36499999999999999,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.45800000000000002,"5min":0.70799999999999996,"15min":0.97999999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.439,"5min":0.65400000000000003,"15min":0.92700000000000005},"last":0.31},{"interface":"front","average":{"1min":0.435,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.93999999999999995},"last":0.376}]},{"osd":3,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56699999999999995,"5min":0.70199999999999996,"15min":2.573},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":1.073,"15min":1.3500000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.65200000000000002},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":2.7149999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.372},"max":{"1min":0.94599999999999995,"5min":1.0569999999999999,"15min":2.6859999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.006},"last":0.77300000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":1.0489999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":1.5429999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.69999999999999996},"min":{"1min":0.58699999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.249,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.50800000000000001,"5min":0.61599999999999999,"15min":0.78900000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.72299999999999998},"last":0.307}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38100000000000001,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.77700000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.82799999999999996},"last":0.38700000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.84699999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.88900000000000001},"last":0.34699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.97999999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.2649999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":3.577},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":1.052,"15min":7.0220000000000002},"last":0.63}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.075,"5min":1.075,"15min":1.298},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":3.637},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.014,"15min":7.0599999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.55400000000000005,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.331},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.373,"15min":0.34599999999999997},"min":{"1min":0.26000000000000001,"5min":0.22600000000000001,"15min":0.182},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.66500000000000004},"last":0.31900000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.371,"15min":0.35899999999999999},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59399999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35199999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.66500000000000004,"15min":0.79500000000000004},"last":0.377},{"interface":"front","average":{"1min":0.496,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.27800000000000002,"15min":0.27300000000000002},"max":{"1min":0.64400000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.30199999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.55300000000000005,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.90600000000000003,"5min":0.92100000000000004,"15min":1.337},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.622},"min":{"1min":0.48699999999999999,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":1.038,"15min":1.2010000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53900000000000003,"5min":0.44900000000000001,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89900000000000002,"15min":0.97799999999999998},"last":0.66500000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.024,"15min":1.1699999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":1.4570000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.65300000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.879,"5min":1.02,"15min":1.3779999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.54200000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.004,"15min":1.006},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.44,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74099999999999999,"5min":0.752,"15min":0.82199999999999995},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":4.883},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":1.544},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32100000000000001},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33300000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.75},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.52,"5min":1.52,"15min":8.8200000000000003},"last":0.48299999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.49099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":1.4419999999999999},"last":0.378},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.57799999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":3.8279999999999998},"last":0.313}]},{"osd":6,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.54800000000000004}]},{"osd":7,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.82999999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.33500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":14.039999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.375,"15min":0.31},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194311,"statfs":{"total":200000000,"available":198975383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":4.6059999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":1.847},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.63600000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.623},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":1.97},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":3.2850000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.877,"15min":0.877},"last":0.67400000000000004}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":1.0289999999999999,"15min":1.3320000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.0589999999999999,"15min":4.5330000000000004},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.48599999999999999},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.498},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78700000000000003,"5min":0.96499999999999997,"15min":1.8839999999999999},"last":0.46700000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.98799999999999999,"15min":3.766},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56799999999999995}]}]}],"pool_statfs":[]}} 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3f is not active+clean 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.724162+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:55:52.727956+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3e is not active+clean 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.736480+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:57:31.019587+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3d is not active+clean 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.728167+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T21:25:19.425730+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3c is not active+clean 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.722624+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T23:27:58.612009+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3b is not active+clean 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.737507+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:26:51.747403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:07:25.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3a is not active+clean 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.736490+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T05:05:20.653180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.39 is not active+clean 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.724421+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T21:46:48.438634+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.38 is not active+clean 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.736358+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:55:36.913522+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.37 is not active+clean 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.736358+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:59:06.974673+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.36 is not active+clean 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735315+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T23:40:54.406795+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.35 is not active+clean 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735354+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T05:05:09.684018+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:07:25.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.34 is not active+clean 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735765+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:38:55.344833+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.33 is not active+clean 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.727450+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T05:55:49.272602+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.32 is not active+clean 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.728704+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:51:26.340636+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.31 is not active+clean 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.723433+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:53:09.480440+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.30 is not active+clean 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.726044+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:36:59.743099+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2f is not active+clean 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735983+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:44:46.491809+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:07:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2e is not active+clean 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.723172+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T21:28:56.813064+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2d is not active+clean 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.736021+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T23:33:02.416698+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2c is not active+clean 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.725677+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T05:48:04.294798+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2b is not active+clean 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.736004+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T05:48:04.294798+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2a is not active+clean 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735424+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:31:43.933103+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.29 is not active+clean 2023-12-24T20:07:25.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.739318+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:23:29.832230+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:07:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.28 is not active+clean 2023-12-24T20:07:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735310+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:54:17.156416+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-24T20:07:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.27 is not active+clean 2023-12-24T20:07:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.726478+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T05:05:20.653180+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.26 is not active+clean 2023-12-24T20:07:25.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.723804+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T02:01:24.163148+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:07:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.25 is not active+clean 2023-12-24T20:07:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.725704+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:44:46.491809+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.24 is not active+clean 2023-12-24T20:07:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.723863+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T02:13:41.519358+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:07:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.23 is not active+clean 2023-12-24T20:07:25.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.728332+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:30:34.166856+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.22 is not active+clean 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.737113+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:26:51.747403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.21 is not active+clean 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.736474+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T01:41:37.645101+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.20 is not active+clean 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.724819+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:53:21.031025+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1e is not active+clean 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.724739+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T05:29:03.643933+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1f is not active+clean 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735813+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:18:51.365236+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:07:25.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1c is not active+clean 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735570+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T21:03:40.424326+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1d is not active+clean 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.724797+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:35:54.958356+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1a is not active+clean 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.723300+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:37:16.384382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1b is not active+clean 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.724414+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T06:37:47.408431+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.18 is not active+clean 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.723713+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:40:16.482454+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.19 is not active+clean 2023-12-24T20:07:25.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735584+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T07:35:54.958356+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.17 is not active+clean 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.722061+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:41:59.371790+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.14 is not active+clean 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.722350+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:32:06.062978+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.15 is not active+clean 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735343+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:57:31.019587+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.12 is not active+clean 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.721651+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T06:39:15.951001+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.13 is not active+clean 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.722533+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:05:40.754652+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.10 is not active+clean 2023-12-24T20:07:25.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.723462+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T01:40:01.111225+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.11 is not active+clean 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.725333+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T23:33:02.416698+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.e is not active+clean 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.723040+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:56:24.246867+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.f is not active+clean 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.721906+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T21:31:39.286031+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.c is not active+clean 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.723984+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:30:58.392159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.d is not active+clean 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.722355+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:03:46.553351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.a is not active+clean 2023-12-24T20:07:25.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.727632+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:04:03.611978+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.b is not active+clean 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.722903+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T20:53:21.031025+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.8 is not active+clean 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.723749+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T21:14:56.314102+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.9 is not active+clean 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735389+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:35:50.190261+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.6 is not active+clean 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.722648+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:03:46.553351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.7 is not active+clean 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.722438+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T21:28:56.813064+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.4 is not active+clean 2023-12-24T20:07:25.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735084+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T06:55:14.219893+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.5 is not active+clean 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.721475+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T03:23:37.173750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2 is not active+clean 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.724045+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T04:05:40.754652+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3 is not active+clean 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.735708+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T22:17:06.685281+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.0 is not active+clean 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.722776+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:01:36.522227+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1 is not active+clean 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.727046+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-25T21:36:22.904751+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-24T20:07:25.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.16 is not active+clean 2023-12-24T20:07:25.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-12-24T20:07:19.715122+0000', 'last_change': '2023-12-24T20:07:19.724428+0000', 'last_active': '2023-12-24T20:07:19.715122+0000', 'last_peered': '2023-12-24T20:07:19.715122+0000', 'last_clean': '2023-12-24T20:07:19.715122+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-24T20:07:19.715122+0000', 'last_undegraded': '2023-12-24T20:07:19.715122+0000', 'last_fullsized': '2023-12-24T20:07:19.715122+0000', 'mapping_epoch': 183, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 183, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'last_clean_scrub_stamp': '2023-12-24T20:07:19.715122+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-26T00:01:36.522227+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-24T20:07:25.682 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-24T20:07:25.711 INFO:tasks.ceph.mds.d.smithi133.stderr:2023-12-24T20:07:25.710+0000 7f3c91603700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:07:25.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.824+0000 7f1ecf39d700 1 Processor -- start 2023-12-24T20:07:25.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.824+0000 7f1ecf39d700 1 -- start start 2023-12-24T20:07:25.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.825+0000 7f1ecf39d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1ec80b0980 0x7f1ec80ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.825+0000 7f1ecf39d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ec80b0d50 0x7f1ec80b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.825+0000 7f1ecf39d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec80c99e0 con 0x7f1ec80b3290 2023-12-24T20:07:25.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.825+0000 7f1ecf39d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec815a520 con 0x7f1ec80b0980 2023-12-24T20:07:25.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.825+0000 7f1ecf39d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec80cd0f0 con 0x7f1ec80b0d50 2023-12-24T20:07:25.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ece39b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1ec80b0980 0x7f1ec80ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1eceb9c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1ec80b3290 0x7f1ec815db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40438/0 (socket says 172.21.15.61:40438) 2023-12-24T20:07:25.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1eceb9c700 1 -- 172.21.15.61:0/3279362957 learned_addr learned my addr 172.21.15.61:0/3279362957 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:25.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ecdb9a700 1 --2- 172.21.15.61:0/3279362957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ec80b0d50 0x7f1ec80b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ece39b700 1 -- 172.21.15.61:0/3279362957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ec80b0d50 msgr2=0x7f1ec80b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:25.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ece39b700 1 --2- 172.21.15.61:0/3279362957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ec80b0d50 0x7f1ec80b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ece39b700 1 -- 172.21.15.61:0/3279362957 >> v1:172.21.15.61:6789/0 conn(0x7f1ec80b3290 legacy=0x7f1ec815db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.828 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ece39b700 1 -- 172.21.15.61:0/3279362957 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec80c96b0 con 0x7f1ec80b0980 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ecd399700 1 -- 172.21.15.61:0/3279362957 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512116283 0 0) 0x7f1ec80c99e0 con 0x7f1ec80b3290 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ece39b700 1 --2- 172.21.15.61:0/3279362957 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 0x7f1ec80ccbb0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009900 tx=0x7f1ec4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c405d917aa7607 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ecd399700 1 -- 172.21.15.61:0/3279362957 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4009ea0 con 0x7f1ec80b0980 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ecd399700 1 -- 172.21.15.61:0/3279362957 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4005c10 con 0x7f1ec80b0980 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.826+0000 7f1ecd399700 1 -- 172.21.15.61:0/3279362957 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec400b610 con 0x7f1ec80b0980 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.827+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3279362957 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 msgr2=0x7f1ec80ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.827+0000 7f1ecf39d700 1 --2- 172.21.15.61:0/3279362957 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 0x7f1ec80ccbb0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009900 tx=0x7f1ec4009120 comp rx=0 tx=0).stop 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.827+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3279362957 shutdown_connections 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.827+0000 7f1ecf39d700 1 --2- 172.21.15.61:0/3279362957 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 0x7f1ec80ccbb0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.827+0000 7f1ecf39d700 1 --2- 172.21.15.61:0/3279362957 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ec80b0d50 0x7f1ec80b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.827+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3279362957 >> 172.21.15.61:0/3279362957 conn(0x7f1ec80b14f0 msgr2=0x7f1ec80b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.827+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3279362957 shutdown_connections 2023-12-24T20:07:25.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.827+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3279362957 wait complete. 2023-12-24T20:07:25.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.828+0000 7f1ecf39d700 1 Processor -- start 2023-12-24T20:07:25.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.828+0000 7f1ecf39d700 1 -- start start 2023-12-24T20:07:25.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ecf39d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 0x7f1ec815c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ecf39d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ec80b0d50 0x7f1ec815a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ecf39d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ec80b3290 0x7f1ec815f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ecf39d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec815aba0 con 0x7f1ec80b0980 2023-12-24T20:07:25.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ecf39d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec815ae20 con 0x7f1ec80b3290 2023-12-24T20:07:25.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ecf39d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec815b100 con 0x7f1ec80b0d50 2023-12-24T20:07:25.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ece39b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 0x7f1ec815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ece39b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 0x7f1ec815c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41200/0 (socket says 172.21.15.61:41200) 2023-12-24T20:07:25.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ece39b700 1 -- 172.21.15.61:0/3497728470 learned_addr learned my addr 172.21.15.61:0/3497728470 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:25.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1eceb9c700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ec80b3290 0x7f1ec815f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ecdb9a700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ec80b0d50 0x7f1ec815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ece39b700 1 -- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ec80b0d50 msgr2=0x7f1ec815a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ece39b700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ec80b0d50 0x7f1ec815a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ece39b700 1 -- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ec80b3290 msgr2=0x7f1ec815f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:25.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ece39b700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ec80b3290 0x7f1ec815f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:25.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ece39b700 1 -- 172.21.15.61:0/3497728470 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec40093c0 con 0x7f1ec80b0980 2023-12-24T20:07:25.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ece39b700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 0x7f1ec815c180 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f1ec806d660 tx=0x7f1ec4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:25.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.829+0000 7f1ebe7fc700 1 -- 172.21.15.61:0/3497728470 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4006210 con 0x7f1ec80b0980 2023-12-24T20:07:25.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.830+0000 7f1ebe7fc700 1 -- 172.21.15.61:0/3497728470 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4006390 con 0x7f1ec80b0980 2023-12-24T20:07:25.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.830+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3497728470 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec815b3e0 con 0x7f1ec80b0980 2023-12-24T20:07:25.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.830+0000 7f1ebe7fc700 1 -- 172.21.15.61:0/3497728470 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4006750 con 0x7f1ec80b0980 2023-12-24T20:07:25.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.830+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3497728470 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec815f550 con 0x7f1ec80b0980 2023-12-24T20:07:25.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.830+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3497728470 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec816a680 con 0x7f1ec80b0980 2023-12-24T20:07:25.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.831+0000 7f1ebe7fc700 1 -- 172.21.15.61:0/3497728470 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1ec401b690 con 0x7f1ec80b0980 2023-12-24T20:07:25.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.831+0000 7f1ebe7fc700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:25.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.831+0000 7f1ebe7fc700 1 -- 172.21.15.61:0/3497728470 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ec40865c0 con 0x7f1ec80b0980 2023-12-24T20:07:25.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.832+0000 7f1ecdb9a700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:25.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.832+0000 7f1ecdb9a700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1eac066f30 0x7f1eac0693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80cf740 tx=0x7f1eb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:25.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:25.836+0000 7f1ebe7fc700 1 -- 172.21.15.61:0/3497728470 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ec4053830 con 0x7f1ec80b0980 2023-12-24T20:07:26.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.111+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3497728470 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1ec80c9aa0 con 0x7f1ec80b0980 2023-12-24T20:07:26.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.111+0000 7f1ebe7fc700 1 -- 172.21.15.61:0/3497728470 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1193 (secure 0 0 0) 0x7f1ec4056e50 con 0x7f1ec80b0980 2023-12-24T20:07:26.112 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:26.112 INFO:teuthology.orchestra.run.smithi061.stdout:{"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":637,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":185,"num_osds":8,"num_up_osds":8,"osd_up_since":1703447814,"num_in_osds":8,"osd_in_since":1703447811,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":9352620,"bytes_avail":1590647380,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":92,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":8145}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-12-24T20:07:00.455519+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-24T20:07:26.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1eac066f30 msgr2=0x7f1eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:26.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1eac066f30 0x7f1eac0693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80cf740 tx=0x7f1eb8008040 comp rx=0 tx=0).stop 2023-12-24T20:07:26.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3497728470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 msgr2=0x7f1ec815c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:26.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 0x7f1ec815c180 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f1ec806d660 tx=0x7f1ec4016000 comp rx=0 tx=0).stop 2023-12-24T20:07:26.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3497728470 shutdown_connections 2023-12-24T20:07:26.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1eac066f30 0x7f1eac0693e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ec80b3290 0x7f1ec815f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ec80b0980 0x7f1ec815c180 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 --2- 172.21.15.61:0/3497728470 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ec80b0d50 0x7f1ec815a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3497728470 >> 172.21.15.61:0/3497728470 conn(0x7f1ec80b14f0 msgr2=0x7f1ec80cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:26.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3497728470 shutdown_connections 2023-12-24T20:07:26.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.114+0000 7f1ecf39d700 1 -- 172.21.15.61:0/3497728470 wait complete. 2023-12-24T20:07:26.126 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-24T20:07:26.126 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:07:26.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.247+0000 7f7a74c78700 1 Processor -- start 2023-12-24T20:07:26.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.247+0000 7f7a74c78700 1 -- start start 2023-12-24T20:07:26.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a74c78700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7a70068c80 0x7f7a700afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:26.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a74c78700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a7015acf0 0x7f7a70067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:26.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a74c78700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a700687f0 con 0x7f7a700af710 2023-12-24T20:07:26.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a74c78700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a70067be0 con 0x7f7a70068c80 2023-12-24T20:07:26.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a74c78700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a70067ec0 con 0x7f7a7015acf0 2023-12-24T20:07:26.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a6dd9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7a70068c80 0x7f7a700afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:26.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a6e59c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7a700af710 0x7f7a7015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40450/0 (socket says 172.21.15.61:40450) 2023-12-24T20:07:26.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a6e59c700 1 -- 172.21.15.61:0/3595719913 learned_addr learned my addr 172.21.15.61:0/3595719913 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:26.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a6ed9d700 1 --2- 172.21.15.61:0/3595719913 >> v2:172.21.15.133:3300/0 conn(0x7f7a7015acf0 0x7f7a70067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:26.251 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a6dd9b700 1 -- 172.21.15.61:0/3595719913 >> v2:172.21.15.133:3300/0 conn(0x7f7a7015acf0 msgr2=0x7f7a70067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a6dd9b700 1 --2- 172.21.15.61:0/3595719913 >> v2:172.21.15.133:3300/0 conn(0x7f7a7015acf0 0x7f7a70067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a6dd9b700 1 -- 172.21.15.61:0/3595719913 >> v1:172.21.15.61:6789/0 conn(0x7f7a700af710 legacy=0x7f7a7015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a6dd9b700 1 -- 172.21.15.61:0/3595719913 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700681a0 con 0x7f7a70068c80 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a6ed9d700 1 --2- 172.21.15.61:0/3595719913 >> v2:172.21.15.133:3300/0 conn(0x7f7a7015acf0 0x7f7a70067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.248+0000 7f7a6d59a700 1 -- 172.21.15.61:0/3595719913 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913485404 0 0) 0x7f7a700687f0 con 0x7f7a700af710 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a6dd9b700 1 --2- 172.21.15.61:0/3595719913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a70068c80 0x7f7a700afae0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f7a7015a540 tx=0x7f7a640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c4838ac62190f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a6d59a700 1 -- 172.21.15.61:0/3595719913 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400b6b0 con 0x7f7a70068c80 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a6d59a700 1 -- 172.21.15.61:0/3595719913 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6400b810 con 0x7f7a70068c80 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a6d59a700 1 -- 172.21.15.61:0/3595719913 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400bbb0 con 0x7f7a70068c80 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a74c78700 1 -- 172.21.15.61:0/3595719913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a70068c80 msgr2=0x7f7a700afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a74c78700 1 --2- 172.21.15.61:0/3595719913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a70068c80 0x7f7a700afae0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f7a7015a540 tx=0x7f7a640091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a74c78700 1 -- 172.21.15.61:0/3595719913 shutdown_connections 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a74c78700 1 --2- 172.21.15.61:0/3595719913 >> v2:172.21.15.133:3300/0 conn(0x7f7a7015acf0 0x7f7a70067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a74c78700 1 --2- 172.21.15.61:0/3595719913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a70068c80 0x7f7a700afae0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a74c78700 1 -- 172.21.15.61:0/3595719913 >> 172.21.15.61:0/3595719913 conn(0x7f7a700ca200 msgr2=0x7f7a700ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:26.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a74c78700 1 -- 172.21.15.61:0/3595719913 shutdown_connections 2023-12-24T20:07:26.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.249+0000 7f7a74c78700 1 -- 172.21.15.61:0/3595719913 wait complete. 2023-12-24T20:07:26.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.250+0000 7f7a74c78700 1 Processor -- start 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.250+0000 7f7a74c78700 1 -- start start 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.251+0000 7f7a74c78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a70068c80 0x7f7a700c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.251+0000 7f7a74c78700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a700af710 0x7f7a70168d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.251+0000 7f7a74c78700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a7015acf0 0x7f7a701544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.251+0000 7f7a74c78700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700c9e30 con 0x7f7a700af710 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.251+0000 7f7a74c78700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a70158410 con 0x7f7a70068c80 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.251+0000 7f7a74c78700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7016ba70 con 0x7f7a7015acf0 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.251+0000 7f7a6dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a700af710 0x7f7a70168d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.251+0000 7f7a6dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a700af710 0x7f7a70168d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41232/0 (socket says 172.21.15.61:41232) 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.251+0000 7f7a6dd9b700 1 -- 172.21.15.61:0/2927107318 learned_addr learned my addr 172.21.15.61:0/2927107318 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a6e59c700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a70068c80 0x7f7a700c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a6dd9b700 1 -- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a7015acf0 msgr2=0x7f7a701544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a6ed9d700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a7015acf0 0x7f7a701544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:26.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a6dd9b700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a7015acf0 0x7f7a701544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a6dd9b700 1 -- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a70068c80 msgr2=0x7f7a700c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a6dd9b700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a70068c80 0x7f7a700c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a6dd9b700 1 -- 172.21.15.61:0/2927107318 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a64009420 con 0x7f7a700af710 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a6e59c700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a70068c80 0x7f7a700c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a6dd9b700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a700af710 0x7f7a70168d00 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f7a7006c9e0 tx=0x7f7a64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a5e7fc700 1 -- 172.21.15.61:0/2927107318 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400bb90 con 0x7f7a700af710 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a5e7fc700 1 -- 172.21.15.61:0/2927107318 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a64011420 con 0x7f7a700af710 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a74c78700 1 -- 172.21.15.61:0/2927107318 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a70169240 con 0x7f7a700af710 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a5e7fc700 1 -- 172.21.15.61:0/2927107318 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640117a0 con 0x7f7a700af710 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.252+0000 7f7a74c78700 1 -- 172.21.15.61:0/2927107318 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a70158130 con 0x7f7a700af710 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.253+0000 7f7a74c78700 1 -- 172.21.15.61:0/2927107318 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7004c3c0 con 0x7f7a700af710 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.254+0000 7f7a5e7fc700 1 -- 172.21.15.61:0/2927107318 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7a64011b90 con 0x7f7a700af710 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.254+0000 7f7a5e7fc700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a50066f30 0x7f7a500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.254+0000 7f7a5e7fc700 1 -- 172.21.15.61:0/2927107318 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a64085d70 con 0x7f7a700af710 2023-12-24T20:07:26.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.254+0000 7f7a6e59c700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a50066f30 0x7f7a500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:26.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.255+0000 7f7a6e59c700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a50066f30 0x7f7a500693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7a60001810 tx=0x7f7a60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:26.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.258+0000 7f7a5e7fc700 1 -- 172.21.15.61:0/2927107318 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a64052fe0 con 0x7f7a700af710 2023-12-24T20:07:26.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.449+0000 7f7a74c78700 1 -- 172.21.15.61:0/2927107318 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a7016bbb0 con 0x7f7a50066f30 2023-12-24T20:07:26.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.457+0000 7f7a5e7fc700 1 -- 172.21.15.61:0/2927107318 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281977 (secure 0 0 0) 0x7f7a7016bbb0 con 0x7f7a50066f30 2023-12-24T20:07:26.462 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.460+0000 7f7a74c78700 1 -- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a50066f30 msgr2=0x7f7a500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.460+0000 7f7a74c78700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a50066f30 0x7f7a500693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7a60001810 tx=0x7f7a60009040 comp rx=0 tx=0).stop 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.460+0000 7f7a74c78700 1 -- 172.21.15.61:0/2927107318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a700af710 msgr2=0x7f7a70168d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.460+0000 7f7a74c78700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a700af710 0x7f7a70168d00 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f7a7006c9e0 tx=0x7f7a64017000 comp rx=0 tx=0).stop 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.461+0000 7f7a74c78700 1 -- 172.21.15.61:0/2927107318 shutdown_connections 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.461+0000 7f7a74c78700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7a7015acf0 0x7f7a701544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.461+0000 7f7a74c78700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7a50066f30 0x7f7a500693e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.461+0000 7f7a74c78700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a70068c80 0x7f7a700c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.461+0000 7f7a74c78700 1 --2- 172.21.15.61:0/2927107318 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7a700af710 0x7f7a70168d00 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.461+0000 7f7a74c78700 1 -- 172.21.15.61:0/2927107318 >> 172.21.15.61:0/2927107318 conn(0x7f7a700ca200 msgr2=0x7f7a70154eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:26.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.461+0000 7f7a74c78700 1 -- 172.21.15.61:0/2927107318 shutdown_connections 2023-12-24T20:07:26.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:26.461+0000 7f7a74c78700 1 -- 172.21.15.61:0/2927107318 wait complete. 2023-12-24T20:07:26.466 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:07:26.480 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2023-12-24T20:07:24.461406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":78,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553366,"statfs":{"total":1600000000,"available":1590647380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.743744"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724162+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:55:52.727956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736480+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:57:31.019587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728167+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:25:19.425730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722624+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:27:58.612009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.737507+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:26:51.747403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736490+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:20.653180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724421+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:46:48.438634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736358+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:55:36.913522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736358+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:06.974673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735315+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:54.406795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735354+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:09.684018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735765+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:55.344833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727450+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:55:49.272602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728704+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:26.340636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723433+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:09.480440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.726044+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:36:59.743099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735983+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:46.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723172+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:28:56.813064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736021+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:02.416698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725677+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:04.294798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736004+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:48:04.294798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735424+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:43.933103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.739318+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:29.832230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735310+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:54:17.156416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.726478+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:05:20.653180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723804+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:01:24.163148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725704+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:44:46.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723863+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:13:41.519358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.728332+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:34.166856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.737113+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:26:51.747403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.736474+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:41:37.645101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724819+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:21.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724739+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:29:03.643933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729857+0000","last_change":"2023-12-24T20:07:19.729857+0000","last_active":"2023-12-24T20:07:19.729857+0000","last_peered":"2023-12-24T20:07:19.729857+0000","last_clean":"2023-12-24T20:07:19.729857+0000","last_became_active":"2023-12-24T20:07:19.729631+0000","last_became_peered":"2023-12-24T20:07:19.729631+0000","last_unstale":"2023-12-24T20:07:19.729857+0000","last_undegraded":"2023-12-24T20:07:19.729857+0000","last_fullsized":"2023-12-24T20:07:19.729857+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:32.809199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735813+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:18:51.365236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726003+0000","last_change":"2023-12-24T20:07:19.726003+0000","last_active":"2023-12-24T20:07:19.726003+0000","last_peered":"2023-12-24T20:07:19.726003+0000","last_clean":"2023-12-24T20:07:19.726003+0000","last_became_active":"2023-12-24T20:07:19.725772+0000","last_became_peered":"2023-12-24T20:07:19.725772+0000","last_unstale":"2023-12-24T20:07:19.726003+0000","last_undegraded":"2023-12-24T20:07:19.726003+0000","last_fullsized":"2023-12-24T20:07:19.726003+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:46.115708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735570+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:03:40.424326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726181+0000","last_change":"2023-12-24T20:07:19.726181+0000","last_active":"2023-12-24T20:07:19.726181+0000","last_peered":"2023-12-24T20:07:19.726181+0000","last_clean":"2023-12-24T20:07:19.726181+0000","last_became_active":"2023-12-24T20:07:19.725910+0000","last_became_peered":"2023-12-24T20:07:19.725910+0000","last_unstale":"2023-12-24T20:07:19.726181+0000","last_undegraded":"2023-12-24T20:07:19.726181+0000","last_fullsized":"2023-12-24T20:07:19.726181+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:28.825227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724797+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:54.958356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728483+0000","last_change":"2023-12-24T20:07:19.728483+0000","last_active":"2023-12-24T20:07:19.728483+0000","last_peered":"2023-12-24T20:07:19.728483+0000","last_clean":"2023-12-24T20:07:19.728483+0000","last_became_active":"2023-12-24T20:07:19.728165+0000","last_became_peered":"2023-12-24T20:07:19.728165+0000","last_unstale":"2023-12-24T20:07:19.728483+0000","last_undegraded":"2023-12-24T20:07:19.728483+0000","last_fullsized":"2023-12-24T20:07:19.728483+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.159853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723300+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:16.384382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726579+0000","last_change":"2023-12-24T20:07:19.726579+0000","last_active":"2023-12-24T20:07:19.726579+0000","last_peered":"2023-12-24T20:07:19.726579+0000","last_clean":"2023-12-24T20:07:19.726579+0000","last_became_active":"2023-12-24T20:07:19.726241+0000","last_became_peered":"2023-12-24T20:07:19.726241+0000","last_unstale":"2023-12-24T20:07:19.726579+0000","last_undegraded":"2023-12-24T20:07:19.726579+0000","last_fullsized":"2023-12-24T20:07:19.726579+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:49.634096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724414+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:37:47.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727911+0000","last_change":"2023-12-24T20:07:19.727911+0000","last_active":"2023-12-24T20:07:19.727911+0000","last_peered":"2023-12-24T20:07:19.727911+0000","last_clean":"2023-12-24T20:07:19.727911+0000","last_became_active":"2023-12-24T20:07:19.727639+0000","last_became_peered":"2023-12-24T20:07:19.727639+0000","last_unstale":"2023-12-24T20:07:19.727911+0000","last_undegraded":"2023-12-24T20:07:19.727911+0000","last_fullsized":"2023-12-24T20:07:19.727911+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:52:52.161095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723713+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:40:16.482454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.726790+0000","last_change":"2023-12-24T20:07:19.726790+0000","last_active":"2023-12-24T20:07:19.726790+0000","last_peered":"2023-12-24T20:07:19.726790+0000","last_clean":"2023-12-24T20:07:19.726790+0000","last_became_active":"2023-12-24T20:07:19.726577+0000","last_became_peered":"2023-12-24T20:07:19.726577+0000","last_unstale":"2023-12-24T20:07:19.726790+0000","last_undegraded":"2023-12-24T20:07:19.726790+0000","last_fullsized":"2023-12-24T20:07:19.726790+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:40.906179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735584+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:35:54.958356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727460+0000","last_change":"2023-12-24T20:07:19.727460+0000","last_active":"2023-12-24T20:07:19.727460+0000","last_peered":"2023-12-24T20:07:19.727460+0000","last_clean":"2023-12-24T20:07:19.727460+0000","last_became_active":"2023-12-24T20:07:19.727198+0000","last_became_peered":"2023-12-24T20:07:19.727198+0000","last_unstale":"2023-12-24T20:07:19.727460+0000","last_undegraded":"2023-12-24T20:07:19.727460+0000","last_fullsized":"2023-12-24T20:07:19.727460+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:58.364787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722061+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:59.371790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730168+0000","last_change":"2023-12-24T20:07:19.730168+0000","last_active":"2023-12-24T20:07:19.730168+0000","last_peered":"2023-12-24T20:07:19.730168+0000","last_clean":"2023-12-24T20:07:19.730168+0000","last_became_active":"2023-12-24T20:07:19.729898+0000","last_became_peered":"2023-12-24T20:07:19.729898+0000","last_unstale":"2023-12-24T20:07:19.730168+0000","last_undegraded":"2023-12-24T20:07:19.730168+0000","last_fullsized":"2023-12-24T20:07:19.730168+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:49.634096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722350+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:32:06.062978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729270+0000","last_change":"2023-12-24T20:07:19.729270+0000","last_active":"2023-12-24T20:07:19.729270+0000","last_peered":"2023-12-24T20:07:19.729270+0000","last_clean":"2023-12-24T20:07:19.729270+0000","last_became_active":"2023-12-24T20:07:19.729021+0000","last_became_peered":"2023-12-24T20:07:19.729021+0000","last_unstale":"2023-12-24T20:07:19.729270+0000","last_undegraded":"2023-12-24T20:07:19.729270+0000","last_fullsized":"2023-12-24T20:07:19.729270+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:15.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735343+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:57:31.019587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733162+0000","last_change":"2023-12-24T20:07:19.733162+0000","last_active":"2023-12-24T20:07:19.733162+0000","last_peered":"2023-12-24T20:07:19.733162+0000","last_clean":"2023-12-24T20:07:19.733162+0000","last_became_active":"2023-12-24T20:07:19.727678+0000","last_became_peered":"2023-12-24T20:07:19.727678+0000","last_unstale":"2023-12-24T20:07:19.733162+0000","last_undegraded":"2023-12-24T20:07:19.733162+0000","last_fullsized":"2023-12-24T20:07:19.733162+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:54.337829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721651+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:15.951001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.725269+0000","last_change":"2023-12-24T20:07:19.725269+0000","last_active":"2023-12-24T20:07:19.725269+0000","last_peered":"2023-12-24T20:07:19.725269+0000","last_clean":"2023-12-24T20:07:19.725269+0000","last_became_active":"2023-12-24T20:07:19.725000+0000","last_became_peered":"2023-12-24T20:07:19.725000+0000","last_unstale":"2023-12-24T20:07:19.725269+0000","last_undegraded":"2023-12-24T20:07:19.725269+0000","last_fullsized":"2023-12-24T20:07:19.725269+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:52:32.810420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722533+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:40.754652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728699+0000","last_change":"2023-12-24T20:07:19.728699+0000","last_active":"2023-12-24T20:07:19.728699+0000","last_peered":"2023-12-24T20:07:19.728699+0000","last_clean":"2023-12-24T20:07:19.728699+0000","last_became_active":"2023-12-24T20:07:19.726901+0000","last_became_peered":"2023-12-24T20:07:19.726901+0000","last_unstale":"2023-12-24T20:07:19.728699+0000","last_undegraded":"2023-12-24T20:07:19.728699+0000","last_fullsized":"2023-12-24T20:07:19.728699+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:32:13.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723462+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:01.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729904+0000","last_change":"2023-12-24T20:07:19.729904+0000","last_active":"2023-12-24T20:07:19.729904+0000","last_peered":"2023-12-24T20:07:19.729904+0000","last_clean":"2023-12-24T20:07:19.729904+0000","last_became_active":"2023-12-24T20:07:19.727729+0000","last_became_peered":"2023-12-24T20:07:19.727729+0000","last_unstale":"2023-12-24T20:07:19.729904+0000","last_undegraded":"2023-12-24T20:07:19.729904+0000","last_fullsized":"2023-12-24T20:07:19.729904+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:33:35.721912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.725333+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:33:02.416698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729342+0000","last_change":"2023-12-24T20:07:19.729342+0000","last_active":"2023-12-24T20:07:19.729342+0000","last_peered":"2023-12-24T20:07:19.729342+0000","last_clean":"2023-12-24T20:07:19.729342+0000","last_became_active":"2023-12-24T20:07:19.727563+0000","last_became_peered":"2023-12-24T20:07:19.727563+0000","last_unstale":"2023-12-24T20:07:19.729342+0000","last_undegraded":"2023-12-24T20:07:19.729342+0000","last_fullsized":"2023-12-24T20:07:19.729342+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:06.349039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723040+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:24.246867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733087+0000","last_change":"2023-12-24T20:07:19.733087+0000","last_active":"2023-12-24T20:07:19.733087+0000","last_peered":"2023-12-24T20:07:19.733087+0000","last_clean":"2023-12-24T20:07:19.733087+0000","last_became_active":"2023-12-24T20:07:19.732832+0000","last_became_peered":"2023-12-24T20:07:19.732832+0000","last_unstale":"2023-12-24T20:07:19.733087+0000","last_undegraded":"2023-12-24T20:07:19.733087+0000","last_fullsized":"2023-12-24T20:07:19.733087+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:26.589177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721906+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:31:39.286031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.731693+0000","last_change":"2023-12-24T20:07:19.731693+0000","last_active":"2023-12-24T20:07:19.731693+0000","last_peered":"2023-12-24T20:07:19.731693+0000","last_clean":"2023-12-24T20:07:19.731693+0000","last_became_active":"2023-12-24T20:07:19.729784+0000","last_became_peered":"2023-12-24T20:07:19.729784+0000","last_unstale":"2023-12-24T20:07:19.731693+0000","last_undegraded":"2023-12-24T20:07:19.731693+0000","last_fullsized":"2023-12-24T20:07:19.731693+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:55:13.212890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723984+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:30:58.392159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.732110+0000","last_change":"2023-12-24T20:07:19.732110+0000","last_active":"2023-12-24T20:07:19.732110+0000","last_peered":"2023-12-24T20:07:19.732110+0000","last_clean":"2023-12-24T20:07:19.732110+0000","last_became_active":"2023-12-24T20:07:19.731518+0000","last_became_peered":"2023-12-24T20:07:19.731518+0000","last_unstale":"2023-12-24T20:07:19.732110+0000","last_undegraded":"2023-12-24T20:07:19.732110+0000","last_fullsized":"2023-12-24T20:07:19.732110+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:11.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722355+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:46.553351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730514+0000","last_change":"2023-12-24T20:07:19.730514+0000","last_active":"2023-12-24T20:07:19.730514+0000","last_peered":"2023-12-24T20:07:19.730514+0000","last_clean":"2023-12-24T20:07:19.730514+0000","last_became_active":"2023-12-24T20:07:19.730254+0000","last_became_peered":"2023-12-24T20:07:19.730254+0000","last_unstale":"2023-12-24T20:07:19.730514+0000","last_undegraded":"2023-12-24T20:07:19.730514+0000","last_fullsized":"2023-12-24T20:07:19.730514+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:08:33.502883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727632+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:04:03.611978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729132+0000","last_change":"2023-12-24T20:07:19.729132+0000","last_active":"2023-12-24T20:07:19.729132+0000","last_peered":"2023-12-24T20:07:19.729132+0000","last_clean":"2023-12-24T20:07:19.729132+0000","last_became_active":"2023-12-24T20:07:19.728856+0000","last_became_peered":"2023-12-24T20:07:19.728856+0000","last_unstale":"2023-12-24T20:07:19.729132+0000","last_undegraded":"2023-12-24T20:07:19.729132+0000","last_fullsized":"2023-12-24T20:07:19.729132+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:23.868047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722903+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:53:21.031025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.731937+0000","last_change":"2023-12-24T20:07:19.731937+0000","last_active":"2023-12-24T20:07:19.731937+0000","last_peered":"2023-12-24T20:07:19.731937+0000","last_clean":"2023-12-24T20:07:19.731937+0000","last_became_active":"2023-12-24T20:07:19.731703+0000","last_became_peered":"2023-12-24T20:07:19.731703+0000","last_unstale":"2023-12-24T20:07:19.731937+0000","last_undegraded":"2023-12-24T20:07:19.731937+0000","last_fullsized":"2023-12-24T20:07:19.731937+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:19:28.971138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.723749+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:14:56.314102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728748+0000","last_change":"2023-12-24T20:07:19.728748+0000","last_active":"2023-12-24T20:07:19.728748+0000","last_peered":"2023-12-24T20:07:19.728748+0000","last_clean":"2023-12-24T20:07:19.728748+0000","last_became_active":"2023-12-24T20:07:19.728485+0000","last_became_peered":"2023-12-24T20:07:19.728485+0000","last_unstale":"2023-12-24T20:07:19.728748+0000","last_undegraded":"2023-12-24T20:07:19.728748+0000","last_fullsized":"2023-12-24T20:07:19.728748+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:25:18.418726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735389+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:35:50.190261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.734498+0000","last_change":"2023-12-24T20:07:19.734498+0000","last_active":"2023-12-24T20:07:19.734498+0000","last_peered":"2023-12-24T20:07:19.734498+0000","last_clean":"2023-12-24T20:07:19.734498+0000","last_became_active":"2023-12-24T20:07:19.731867+0000","last_became_peered":"2023-12-24T20:07:19.731867+0000","last_unstale":"2023-12-24T20:07:19.734498+0000","last_undegraded":"2023-12-24T20:07:19.734498+0000","last_fullsized":"2023-12-24T20:07:19.734498+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:59:31.647812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722648+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:03:46.553351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729541+0000","last_change":"2023-12-24T20:07:19.729541+0000","last_active":"2023-12-24T20:07:19.729541+0000","last_peered":"2023-12-24T20:07:19.729541+0000","last_clean":"2023-12-24T20:07:19.729541+0000","last_became_active":"2023-12-24T20:07:19.729312+0000","last_became_peered":"2023-12-24T20:07:19.729312+0000","last_unstale":"2023-12-24T20:07:19.729541+0000","last_undegraded":"2023-12-24T20:07:19.729541+0000","last_fullsized":"2023-12-24T20:07:19.729541+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:08.473437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722438+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:28:56.813064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.734185+0000","last_change":"2023-12-24T20:07:19.734185+0000","last_active":"2023-12-24T20:07:19.734185+0000","last_peered":"2023-12-24T20:07:19.734185+0000","last_clean":"2023-12-24T20:07:19.734185+0000","last_became_active":"2023-12-24T20:07:19.733672+0000","last_became_peered":"2023-12-24T20:07:19.733672+0000","last_unstale":"2023-12-24T20:07:19.734185+0000","last_undegraded":"2023-12-24T20:07:19.734185+0000","last_fullsized":"2023-12-24T20:07:19.734185+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:16.540761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735084+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:55:14.219893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.729035+0000","last_change":"2023-12-24T20:07:19.729035+0000","last_active":"2023-12-24T20:07:19.729035+0000","last_peered":"2023-12-24T20:07:19.729035+0000","last_clean":"2023-12-24T20:07:19.729035+0000","last_became_active":"2023-12-24T20:07:19.728769+0000","last_became_peered":"2023-12-24T20:07:19.728769+0000","last_unstale":"2023-12-24T20:07:19.729035+0000","last_undegraded":"2023-12-24T20:07:19.729035+0000","last_fullsized":"2023-12-24T20:07:19.729035+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:05.266214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.721475+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:23:37.173750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.727957+0000","last_change":"2023-12-24T20:07:19.727957+0000","last_active":"2023-12-24T20:07:19.727957+0000","last_peered":"2023-12-24T20:07:19.727957+0000","last_clean":"2023-12-24T20:07:19.727957+0000","last_became_active":"2023-12-24T20:07:19.727670+0000","last_became_peered":"2023-12-24T20:07:19.727670+0000","last_unstale":"2023-12-24T20:07:19.727957+0000","last_undegraded":"2023-12-24T20:07:19.727957+0000","last_fullsized":"2023-12-24T20:07:19.727957+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:14:55.307099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724045+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:05:40.754652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730892+0000","last_change":"2023-12-24T20:07:19.730892+0000","last_active":"2023-12-24T20:07:19.730892+0000","last_peered":"2023-12-24T20:07:19.730892+0000","last_clean":"2023-12-24T20:07:19.730892+0000","last_became_active":"2023-12-24T20:07:19.730467+0000","last_became_peered":"2023-12-24T20:07:19.730467+0000","last_unstale":"2023-12-24T20:07:19.730892+0000","last_undegraded":"2023-12-24T20:07:19.730892+0000","last_fullsized":"2023-12-24T20:07:19.730892+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:05.967669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.735708+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:17:06.685281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730112+0000","last_change":"2023-12-24T20:07:19.730112+0000","last_active":"2023-12-24T20:07:19.730112+0000","last_peered":"2023-12-24T20:07:19.730112+0000","last_clean":"2023-12-24T20:07:19.730112+0000","last_became_active":"2023-12-24T20:07:19.729114+0000","last_became_peered":"2023-12-24T20:07:19.729114+0000","last_unstale":"2023-12-24T20:07:19.730112+0000","last_undegraded":"2023-12-24T20:07:19.730112+0000","last_fullsized":"2023-12-24T20:07:19.730112+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:25.333632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.722776+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:01:36.522227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.728441+0000","last_change":"2023-12-24T20:07:19.728441+0000","last_active":"2023-12-24T20:07:19.728441+0000","last_peered":"2023-12-24T20:07:19.728441+0000","last_clean":"2023-12-24T20:07:19.728441+0000","last_became_active":"2023-12-24T20:07:19.728198+0000","last_became_peered":"2023-12-24T20:07:19.728198+0000","last_unstale":"2023-12-24T20:07:19.728441+0000","last_undegraded":"2023-12-24T20:07:19.728441+0000","last_fullsized":"2023-12-24T20:07:19.728441+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:38.344997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.727046+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:36:22.904751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.733303+0000","last_change":"2023-12-24T20:07:19.733303+0000","last_active":"2023-12-24T20:07:19.733303+0000","last_peered":"2023-12-24T20:07:19.733303+0000","last_clean":"2023-12-24T20:07:19.733303+0000","last_became_active":"2023-12-24T20:07:19.732962+0000","last_became_peered":"2023-12-24T20:07:19.732962+0000","last_unstale":"2023-12-24T20:07:19.733303+0000","last_undegraded":"2023-12-24T20:07:19.733303+0000","last_fullsized":"2023-12-24T20:07:19.733303+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:53.399792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-12-24T20:07:19.715122+0000","last_change":"2023-12-24T20:07:19.724428+0000","last_active":"2023-12-24T20:07:19.715122+0000","last_peered":"2023-12-24T20:07:19.715122+0000","last_clean":"2023-12-24T20:07:19.715122+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-24T20:07:19.715122+0000","last_undegraded":"2023-12-24T20:07:19.715122+0000","last_fullsized":"2023-12-24T20:07:19.715122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:01:36.522227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-12-24T20:07:19.730699+0000","last_change":"2023-12-24T20:07:19.730699+0000","last_active":"2023-12-24T20:07:19.730699+0000","last_peered":"2023-12-24T20:07:19.730699+0000","last_clean":"2023-12-24T20:07:19.730699+0000","last_became_active":"2023-12-24T20:07:19.730166+0000","last_became_peered":"2023-12-24T20:07:19.730166+0000","last_unstale":"2023-12-24T20:07:19.730699+0000","last_undegraded":"2023-12-24T20:07:19.730699+0000","last_fullsized":"2023-12-24T20:07:19.730699+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:42.926099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":304,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-12-24T20:07:18.720765+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:07:18.720765+0000","last_peered":"2023-12-24T20:07:18.720765+0000","last_clean":"2023-12-24T20:07:18.720765+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:07:18.720765+0000","last_undegraded":"2023-12-24T20:07:18.720765+0000","last_fullsized":"2023-12-24T20:07:18.720765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1577,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193735,"statfs":{"total":200000000,"available":198385015,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.308,"15min":0.307},"max":{"1min":0.80200000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.56999999999999995},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.872,"15min":0.872},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.39400000000000002,"15min":0.34100000000000003},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.623},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.82799999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.312},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.95699999999999996},"last":0.505}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.379,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.81499999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.752,"15min":0.80000000000000004},"last":0.499}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.79100000000000004,"15min":0.83699999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.873},"last":0.65700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194311,"statfs":{"total":200000000,"available":198975383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.0309999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.45700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":0.80200000000000005,"15min":0.95799999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.27000000000000002},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.44,"5min":0.378,"15min":0.33200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0640000000000001},"last":0.57599999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.077},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.372},"max":{"1min":0.79100000000000004,"5min":0.877,"15min":1.048},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.86499999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.254},"max":{"1min":0.628,"5min":0.748,"15min":0.84699999999999998},"last":0.45100000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.372,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.31},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40799999999999997,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.54800000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.33300000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.432},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.35199999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.80900000000000005,"5min":0.871,"15min":0.871},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.59799999999999998},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.94299999999999995,"5min":1.014,"15min":1.014},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.04},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86199999999999999,"5min":0.998,"15min":0.998},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.63},"min":{"1min":0.437,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.64300000000000002},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.39500000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.57199999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.629},"min":{"1min":0.501,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69399999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":1.0109999999999999,"5min":1.03,"15min":1.03},"last":0.621}]}]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1577,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193735,"statfs":{"total":200000000,"available":198385015,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36499999999999999,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.45800000000000002,"5min":0.70799999999999996,"15min":0.97999999999999998},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.439,"5min":0.65400000000000003,"15min":0.92700000000000005},"last":0.31},{"interface":"front","average":{"1min":0.435,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.93999999999999995},"last":0.376}]},{"osd":3,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56699999999999995,"5min":0.70199999999999996,"15min":2.573},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":1.073,"15min":1.3500000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.65200000000000002},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":2.7149999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.372},"max":{"1min":0.94599999999999995,"5min":1.0569999999999999,"15min":2.6859999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.006},"last":0.77300000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":1.0489999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":1.5429999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.69999999999999996},"min":{"1min":0.58699999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.249,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.50800000000000001,"5min":0.61599999999999999,"15min":0.78900000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.72299999999999998},"last":0.307}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38100000000000001,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.77700000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.82799999999999996},"last":0.38700000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.84699999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.88900000000000001},"last":0.34699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.97999999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.2649999999999999},"last":0.64600000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":3.577},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":1.052,"15min":7.0220000000000002},"last":0.63}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.075,"5min":1.075,"15min":1.298},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":3.637},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.014,"15min":7.0599999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.55400000000000005,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.331},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574975,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.373,"15min":0.34599999999999997},"min":{"1min":0.26000000000000001,"5min":0.22600000000000001,"15min":0.182},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.66500000000000004},"last":0.31900000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.371,"15min":0.35899999999999999},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59399999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35199999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.66500000000000004,"15min":0.79500000000000004},"last":0.377},{"interface":"front","average":{"1min":0.496,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.27800000000000002,"15min":0.27300000000000002},"max":{"1min":0.64400000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.30199999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.55300000000000005,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.90600000000000003,"5min":0.92100000000000004,"15min":1.337},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.622},"min":{"1min":0.48699999999999999,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":1.038,"15min":1.2010000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53900000000000003,"5min":0.44900000000000001,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89900000000000002,"15min":0.97799999999999998},"last":0.66500000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.024,"15min":1.1699999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":1.4570000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.65300000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.879,"5min":1.02,"15min":1.3779999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.54200000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.004,"15min":1.006},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574975,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":994,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194318,"statfs":{"total":200000000,"available":198981646,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.44,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74099999999999999,"5min":0.752,"15min":0.82199999999999995},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":4.883},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":1.544},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32100000000000001},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33300000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.75},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.52,"5min":1.52,"15min":8.8200000000000003},"last":0.48299999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.49099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":1.4419999999999999},"last":0.378},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.57799999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":3.8279999999999998},"last":0.313}]},{"osd":6,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.54800000000000004}]},{"osd":7,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.82999999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.33500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":14.039999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.375,"15min":0.31},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.52400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194311,"statfs":{"total":200000000,"available":198975383,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":4.6059999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":1.847},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.63600000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.623},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":1.97},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":3.2850000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.877,"15min":0.877},"last":0.67400000000000004}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":1.0289999999999999,"15min":1.3320000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.0589999999999999,"15min":4.5330000000000004},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.48599999999999999},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.498},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78700000000000003,"5min":0.96499999999999997,"15min":1.8839999999999999},"last":0.46700000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.98799999999999999,"15min":3.766},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56799999999999995}]}]}],"pool_statfs":[]}} 2023-12-24T20:07:29.537 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:07:29.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.672+0000 7f2d938a5700 1 Processor -- start 2023-12-24T20:07:29.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.672+0000 7f2d938a5700 1 -- start start 2023-12-24T20:07:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d938a5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d8c156730 0x7f2d8c156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d938a5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c0b0830 0x7f2d8c06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d938a5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2d8c06de20 0x7f2d8c0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d938a5700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c067a60 con 0x7f2d8c06de20 2023-12-24T20:07:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d938a5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c06e280 con 0x7f2d8c156730 2023-12-24T20:07:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d938a5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0c88e0 con 0x7f2d8c0b0830 2023-12-24T20:07:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d91e42700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2d8c06de20 0x7f2d8c0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d91e42700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2d8c06de20 0x7f2d8c0c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48500/0 (socket says 172.21.15.61:48500) 2023-12-24T20:07:29.676 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d91e42700 1 -- 172.21.15.61:0/4265201307 learned_addr learned my addr 172.21.15.61:0/4265201307 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d91641700 1 --2- 172.21.15.61:0/4265201307 >> v2:172.21.15.133:3300/0 conn(0x7f2d8c156730 0x7f2d8c156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d90e40700 1 --2- 172.21.15.61:0/4265201307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c0b0830 0x7f2d8c06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d91e42700 1 -- 172.21.15.61:0/4265201307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c0b0830 msgr2=0x7f2d8c06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.673+0000 7f2d91e42700 1 --2- 172.21.15.61:0/4265201307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c0b0830 0x7f2d8c06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d91e42700 1 -- 172.21.15.61:0/4265201307 >> v2:172.21.15.133:3300/0 conn(0x7f2d8c156730 msgr2=0x7f2d8c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d91e42700 1 --2- 172.21.15.61:0/4265201307 >> v2:172.21.15.133:3300/0 conn(0x7f2d8c156730 0x7f2d8c156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d91e42700 1 -- 172.21.15.61:0/4265201307 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0c8bc0 con 0x7f2d8c06de20 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d91641700 1 --2- 172.21.15.61:0/4265201307 >> v2:172.21.15.133:3300/0 conn(0x7f2d8c156730 0x7f2d8c156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d91e42700 1 --2- 172.21.15.61:0/4265201307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c06de20 0x7f2d8c0c7c90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0ca130 tx=0x7f2d8400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721d0b0fd9101fec server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d83fff700 1 -- 172.21.15.61:0/4265201307 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84010070 con 0x7f2d8c06de20 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d83fff700 1 -- 172.21.15.61:0/4265201307 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8400de90 con 0x7f2d8c06de20 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d83fff700 1 -- 172.21.15.61:0/4265201307 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8400b320 con 0x7f2d8c06de20 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d938a5700 1 -- 172.21.15.61:0/4265201307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c06de20 msgr2=0x7f2d8c0c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:29.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d938a5700 1 --2- 172.21.15.61:0/4265201307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c06de20 0x7f2d8c0c7c90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c0ca130 tx=0x7f2d8400ba50 comp rx=0 tx=0).stop 2023-12-24T20:07:29.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d938a5700 1 -- 172.21.15.61:0/4265201307 shutdown_connections 2023-12-24T20:07:29.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d938a5700 1 --2- 172.21.15.61:0/4265201307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c06de20 0x7f2d8c0c7c90 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d938a5700 1 --2- 172.21.15.61:0/4265201307 >> v2:172.21.15.133:3300/0 conn(0x7f2d8c156730 0x7f2d8c156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d938a5700 1 --2- 172.21.15.61:0/4265201307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c0b0830 0x7f2d8c06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.674+0000 7f2d938a5700 1 -- 172.21.15.61:0/4265201307 >> 172.21.15.61:0/4265201307 conn(0x7f2d8c0cd6f0 msgr2=0x7f2d8c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:29.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.675+0000 7f2d938a5700 1 -- 172.21.15.61:0/4265201307 shutdown_connections 2023-12-24T20:07:29.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.675+0000 7f2d938a5700 1 -- 172.21.15.61:0/4265201307 wait complete. 2023-12-24T20:07:29.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.676+0000 7f2d938a5700 1 Processor -- start 2023-12-24T20:07:29.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.676+0000 7f2d938a5700 1 -- start start 2023-12-24T20:07:29.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d938a5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c06de20 0x7f2d8c0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:29.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d938a5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c0b0830 0x7f2d8c148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:29.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d938a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c156730 0x7f2d8c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:29.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d938a5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c165d20 con 0x7f2d8c0b0830 2023-12-24T20:07:29.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d938a5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0c58d0 con 0x7f2d8c156730 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d938a5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0ccf80 con 0x7f2d8c06de20 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d90e40700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c0b0830 0x7f2d8c148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d90e40700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c0b0830 0x7f2d8c148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48510/0 (socket says 172.21.15.61:48510) 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d90e40700 1 -- 172.21.15.61:0/1586693516 learned_addr learned my addr 172.21.15.61:0/1586693516 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d91e42700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c156730 0x7f2d8c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d91641700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c06de20 0x7f2d8c0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d90e40700 1 -- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c06de20 msgr2=0x7f2d8c0cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d90e40700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c06de20 0x7f2d8c0cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d90e40700 1 -- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c156730 msgr2=0x7f2d8c1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d90e40700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c156730 0x7f2d8c1555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d90e40700 1 -- 172.21.15.61:0/1586693516 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8400bcf0 con 0x7f2d8c0b0830 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d91e42700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c156730 0x7f2d8c1555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d91641700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c06de20 0x7f2d8c0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d90e40700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c0b0830 0x7f2d8c148b40 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800d8c0 tx=0x7f2d88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:29.682 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d817fa700 1 -- 172.21.15.61:0/1586693516 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800de60 con 0x7f2d8c0b0830 2023-12-24T20:07:29.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d817fa700 1 -- 172.21.15.61:0/1586693516 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8800b780 con 0x7f2d8c0b0830 2023-12-24T20:07:29.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d817fa700 1 -- 172.21.15.61:0/1586693516 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800bb20 con 0x7f2d8c0b0830 2023-12-24T20:07:29.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d938a5700 1 -- 172.21.15.61:0/1586693516 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c149080 con 0x7f2d8c0b0830 2023-12-24T20:07:29.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.677+0000 7f2d938a5700 1 -- 172.21.15.61:0/1586693516 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c0c4fa0 con 0x7f2d8c0b0830 2023-12-24T20:07:29.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.679+0000 7f2d938a5700 1 -- 172.21.15.61:0/1586693516 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c0c5a40 con 0x7f2d8c0b0830 2023-12-24T20:07:29.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.679+0000 7f2d817fa700 1 -- 172.21.15.61:0/1586693516 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f2d8801e460 con 0x7f2d8c0b0830 2023-12-24T20:07:29.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.679+0000 7f2d817fa700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d70066f30 0x7f2d700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:29.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.679+0000 7f2d817fa700 1 -- 172.21.15.61:0/1586693516 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d88084be0 con 0x7f2d8c0b0830 2023-12-24T20:07:29.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.680+0000 7f2d91641700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d70066f30 0x7f2d700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:29.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.680+0000 7f2d91641700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d70066f30 0x7f2d700693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c006f00 tx=0x7f2d7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:29.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.684+0000 7f2d817fa700 1 -- 172.21.15.61:0/1586693516 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d88051e50 con 0x7f2d8c0b0830 2023-12-24T20:07:29.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.877+0000 7f2d938a5700 1 -- 172.21.15.61:0/1586693516 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d8c04c3c0 con 0x7f2d70066f30 2023-12-24T20:07:29.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.886+0000 7f2d817fa700 1 -- 172.21.15.61:0/1586693516 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284994 (secure 0 0 0) 0x7f2d8c04c3c0 con 0x7f2d70066f30 2023-12-24T20:07:29.891 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 -- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d70066f30 msgr2=0x7f2d700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d70066f30 0x7f2d700693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c006f00 tx=0x7f2d7c008040 comp rx=0 tx=0).stop 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 -- 172.21.15.61:0/1586693516 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c0b0830 msgr2=0x7f2d8c148b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c0b0830 0x7f2d8c148b40 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800d8c0 tx=0x7f2d88008040 comp rx=0 tx=0).stop 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 -- 172.21.15.61:0/1586693516 shutdown_connections 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2d8c06de20 0x7f2d8c0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2d70066f30 0x7f2d700693e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c156730 0x7f2d8c1555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 --2- 172.21.15.61:0/1586693516 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d8c0b0830 0x7f2d8c148b40 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 -- 172.21.15.61:0/1586693516 >> 172.21.15.61:0/1586693516 conn(0x7f2d8c0cd6f0 msgr2=0x7f2d8c067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:29.895 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 -- 172.21.15.61:0/1586693516 shutdown_connections 2023-12-24T20:07:29.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:29.889+0000 7f2d938a5700 1 -- 172.21.15.61:0/1586693516 wait complete. 2023-12-24T20:07:29.896 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:07:29.906 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":492,"stamp":"2023-12-24T20:07:28.462507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9264,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553235,"statfs":{"total":1600000000,"available":1590513308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002289"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.759300+0000","last_change":"2023-12-24T20:07:20.759232+0000","last_active":"2023-12-24T20:07:20.759300+0000","last_peered":"2023-12-24T20:07:20.759300+0000","last_clean":"2023-12-24T20:07:20.759300+0000","last_became_active":"2023-12-24T20:07:20.758997+0000","last_became_peered":"2023-12-24T20:07:20.758997+0000","last_unstale":"2023-12-24T20:07:20.759300+0000","last_undegraded":"2023-12-24T20:07:20.759300+0000","last_fullsized":"2023-12-24T20:07:20.759300+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:39:15.951001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.762997+0000","last_change":"2023-12-24T20:07:20.762930+0000","last_active":"2023-12-24T20:07:20.762997+0000","last_peered":"2023-12-24T20:07:20.762997+0000","last_clean":"2023-12-24T20:07:20.762997+0000","last_became_active":"2023-12-24T20:07:20.762440+0000","last_became_peered":"2023-12-24T20:07:20.762440+0000","last_unstale":"2023-12-24T20:07:20.762997+0000","last_undegraded":"2023-12-24T20:07:20.762997+0000","last_fullsized":"2023-12-24T20:07:20.762997+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:18:51.365236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.764895+0000","last_change":"2023-12-24T20:07:20.764840+0000","last_active":"2023-12-24T20:07:20.764895+0000","last_peered":"2023-12-24T20:07:20.764895+0000","last_clean":"2023-12-24T20:07:20.764895+0000","last_became_active":"2023-12-24T20:07:20.764157+0000","last_became_peered":"2023-12-24T20:07:20.764157+0000","last_unstale":"2023-12-24T20:07:20.764895+0000","last_undegraded":"2023-12-24T20:07:20.764895+0000","last_fullsized":"2023-12-24T20:07:20.764895+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:40:01.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.753080+0000","last_change":"2023-12-24T20:07:20.750262+0000","last_active":"2023-12-24T20:07:20.753080+0000","last_peered":"2023-12-24T20:07:20.753080+0000","last_clean":"2023-12-24T20:07:20.753080+0000","last_became_active":"2023-12-24T20:07:20.749579+0000","last_became_peered":"2023-12-24T20:07:20.749579+0000","last_unstale":"2023-12-24T20:07:20.753080+0000","last_undegraded":"2023-12-24T20:07:20.753080+0000","last_fullsized":"2023-12-24T20:07:20.753080+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:41.913183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.762694+0000","last_change":"2023-12-24T20:07:20.762502+0000","last_active":"2023-12-24T20:07:20.762694+0000","last_peered":"2023-12-24T20:07:20.762694+0000","last_clean":"2023-12-24T20:07:20.762694+0000","last_became_active":"2023-12-24T20:07:20.761389+0000","last_became_peered":"2023-12-24T20:07:20.761389+0000","last_unstale":"2023-12-24T20:07:20.762694+0000","last_undegraded":"2023-12-24T20:07:20.762694+0000","last_fullsized":"2023-12-24T20:07:20.762694+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:19:29.978141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.757045+0000","last_change":"2023-12-24T20:07:20.756973+0000","last_active":"2023-12-24T20:07:20.757045+0000","last_peered":"2023-12-24T20:07:20.757045+0000","last_clean":"2023-12-24T20:07:20.757045+0000","last_became_active":"2023-12-24T20:07:20.756712+0000","last_became_peered":"2023-12-24T20:07:20.756712+0000","last_unstale":"2023-12-24T20:07:20.757045+0000","last_undegraded":"2023-12-24T20:07:20.757045+0000","last_fullsized":"2023-12-24T20:07:20.757045+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:55:49.272602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.754996+0000","last_change":"2023-12-24T20:07:20.754475+0000","last_active":"2023-12-24T20:07:20.754996+0000","last_peered":"2023-12-24T20:07:20.754996+0000","last_clean":"2023-12-24T20:07:20.754996+0000","last_became_active":"2023-12-24T20:07:20.754253+0000","last_became_peered":"2023-12-24T20:07:20.754253+0000","last_unstale":"2023-12-24T20:07:20.754996+0000","last_undegraded":"2023-12-24T20:07:20.754996+0000","last_fullsized":"2023-12-24T20:07:20.754996+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:23:02.645033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.761191+0000","last_change":"2023-12-24T20:07:20.761029+0000","last_active":"2023-12-24T20:07:20.761191+0000","last_peered":"2023-12-24T20:07:20.761191+0000","last_clean":"2023-12-24T20:07:20.761191+0000","last_became_active":"2023-12-24T20:07:20.760137+0000","last_became_peered":"2023-12-24T20:07:20.760137+0000","last_unstale":"2023-12-24T20:07:20.761191+0000","last_undegraded":"2023-12-24T20:07:20.761191+0000","last_fullsized":"2023-12-24T20:07:20.761191+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:56.525165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.764044+0000","last_change":"2023-12-24T20:07:20.763986+0000","last_active":"2023-12-24T20:07:20.764044+0000","last_peered":"2023-12-24T20:07:20.764044+0000","last_clean":"2023-12-24T20:07:20.764044+0000","last_became_active":"2023-12-24T20:07:20.763729+0000","last_became_peered":"2023-12-24T20:07:20.763729+0000","last_unstale":"2023-12-24T20:07:20.764044+0000","last_undegraded":"2023-12-24T20:07:20.764044+0000","last_fullsized":"2023-12-24T20:07:20.764044+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:41:37.645101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.762706+0000","last_change":"2023-12-24T20:07:20.762601+0000","last_active":"2023-12-24T20:07:20.762706+0000","last_peered":"2023-12-24T20:07:20.762706+0000","last_clean":"2023-12-24T20:07:20.762706+0000","last_became_active":"2023-12-24T20:07:20.762344+0000","last_became_peered":"2023-12-24T20:07:20.762344+0000","last_unstale":"2023-12-24T20:07:20.762706+0000","last_undegraded":"2023-12-24T20:07:20.762706+0000","last_fullsized":"2023-12-24T20:07:20.762706+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:33.816202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.759315+0000","last_change":"2023-12-24T20:07:20.758753+0000","last_active":"2023-12-24T20:07:20.759315+0000","last_peered":"2023-12-24T20:07:20.759315+0000","last_clean":"2023-12-24T20:07:20.759315+0000","last_became_active":"2023-12-24T20:07:20.758501+0000","last_became_peered":"2023-12-24T20:07:20.758501+0000","last_unstale":"2023-12-24T20:07:20.759315+0000","last_undegraded":"2023-12-24T20:07:20.759315+0000","last_fullsized":"2023-12-24T20:07:20.759315+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:33:16.802409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.763119+0000","last_change":"2023-12-24T20:07:20.763066+0000","last_active":"2023-12-24T20:07:20.763119+0000","last_peered":"2023-12-24T20:07:20.763119+0000","last_clean":"2023-12-24T20:07:20.763119+0000","last_became_active":"2023-12-24T20:07:20.762728+0000","last_became_peered":"2023-12-24T20:07:20.762728+0000","last_unstale":"2023-12-24T20:07:20.763119+0000","last_undegraded":"2023-12-24T20:07:20.763119+0000","last_fullsized":"2023-12-24T20:07:20.763119+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:17:06.685281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.764611+0000","last_change":"2023-12-24T20:07:20.764545+0000","last_active":"2023-12-24T20:07:20.764611+0000","last_peered":"2023-12-24T20:07:20.764611+0000","last_clean":"2023-12-24T20:07:20.764611+0000","last_became_active":"2023-12-24T20:07:20.763384+0000","last_became_peered":"2023-12-24T20:07:20.763384+0000","last_unstale":"2023-12-24T20:07:20.764611+0000","last_undegraded":"2023-12-24T20:07:20.764611+0000","last_fullsized":"2023-12-24T20:07:20.764611+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:56:24.246867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.756879+0000","last_change":"2023-12-24T20:07:20.756598+0000","last_active":"2023-12-24T20:07:20.756879+0000","last_peered":"2023-12-24T20:07:20.756879+0000","last_clean":"2023-12-24T20:07:20.756879+0000","last_became_active":"2023-12-24T20:07:20.756375+0000","last_became_peered":"2023-12-24T20:07:20.756375+0000","last_unstale":"2023-12-24T20:07:20.756879+0000","last_undegraded":"2023-12-24T20:07:20.756879+0000","last_fullsized":"2023-12-24T20:07:20.756879+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:40:00.622555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.752761+0000","last_change":"2023-12-24T20:07:20.752644+0000","last_active":"2023-12-24T20:07:20.752761+0000","last_peered":"2023-12-24T20:07:20.752761+0000","last_clean":"2023-12-24T20:07:20.752761+0000","last_became_active":"2023-12-24T20:07:20.752416+0000","last_became_peered":"2023-12-24T20:07:20.752416+0000","last_unstale":"2023-12-24T20:07:20.752761+0000","last_undegraded":"2023-12-24T20:07:20.752761+0000","last_fullsized":"2023-12-24T20:07:20.752761+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:23:37.173750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.753501+0000","last_change":"2023-12-24T20:07:20.751805+0000","last_active":"2023-12-24T20:07:20.753501+0000","last_peered":"2023-12-24T20:07:20.753501+0000","last_clean":"2023-12-24T20:07:20.753501+0000","last_became_active":"2023-12-24T20:07:20.751548+0000","last_became_peered":"2023-12-24T20:07:20.751548+0000","last_unstale":"2023-12-24T20:07:20.753501+0000","last_undegraded":"2023-12-24T20:07:20.753501+0000","last_fullsized":"2023-12-24T20:07:20.753501+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:30:49.705339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.755313+0000","last_change":"2023-12-24T20:07:20.754325+0000","last_active":"2023-12-24T20:07:20.755313+0000","last_peered":"2023-12-24T20:07:20.755313+0000","last_clean":"2023-12-24T20:07:20.755313+0000","last_became_active":"2023-12-24T20:07:20.754092+0000","last_became_peered":"2023-12-24T20:07:20.754092+0000","last_unstale":"2023-12-24T20:07:20.755313+0000","last_undegraded":"2023-12-24T20:07:20.755313+0000","last_fullsized":"2023-12-24T20:07:20.755313+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:34.166856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.756608+0000","last_change":"2023-12-24T20:07:20.756465+0000","last_active":"2023-12-24T20:07:20.756608+0000","last_peered":"2023-12-24T20:07:20.756608+0000","last_clean":"2023-12-24T20:07:20.756608+0000","last_became_active":"2023-12-24T20:07:20.756032+0000","last_became_peered":"2023-12-24T20:07:20.756032+0000","last_unstale":"2023-12-24T20:07:20.756608+0000","last_undegraded":"2023-12-24T20:07:20.756608+0000","last_fullsized":"2023-12-24T20:07:20.756608+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:29:03.643933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.752796+0000","last_change":"2023-12-24T20:07:20.752265+0000","last_active":"2023-12-24T20:07:20.752796+0000","last_peered":"2023-12-24T20:07:20.752796+0000","last_clean":"2023-12-24T20:07:20.752796+0000","last_became_active":"2023-12-24T20:07:20.752029+0000","last_became_peered":"2023-12-24T20:07:20.752029+0000","last_unstale":"2023-12-24T20:07:20.752796+0000","last_undegraded":"2023-12-24T20:07:20.752796+0000","last_fullsized":"2023-12-24T20:07:20.752796+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:04:03.611978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.756861+0000","last_change":"2023-12-24T20:07:20.756521+0000","last_active":"2023-12-24T20:07:20.756861+0000","last_peered":"2023-12-24T20:07:20.756861+0000","last_clean":"2023-12-24T20:07:20.756861+0000","last_became_active":"2023-12-24T20:07:20.756286+0000","last_became_peered":"2023-12-24T20:07:20.756286+0000","last_unstale":"2023-12-24T20:07:20.756861+0000","last_undegraded":"2023-12-24T20:07:20.756861+0000","last_fullsized":"2023-12-24T20:07:20.756861+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:09:17.387167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.755817+0000","last_change":"2023-12-24T20:07:20.755759+0000","last_active":"2023-12-24T20:07:20.755817+0000","last_peered":"2023-12-24T20:07:20.755817+0000","last_clean":"2023-12-24T20:07:20.755817+0000","last_became_active":"2023-12-24T20:07:20.755536+0000","last_became_peered":"2023-12-24T20:07:20.755536+0000","last_unstale":"2023-12-24T20:07:20.755817+0000","last_undegraded":"2023-12-24T20:07:20.755817+0000","last_fullsized":"2023-12-24T20:07:20.755817+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:25:19.425730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.759365+0000","last_change":"2023-12-24T20:07:20.759213+0000","last_active":"2023-12-24T20:07:20.759365+0000","last_peered":"2023-12-24T20:07:20.759365+0000","last_clean":"2023-12-24T20:07:20.759365+0000","last_became_active":"2023-12-24T20:07:20.758833+0000","last_became_peered":"2023-12-24T20:07:20.758833+0000","last_unstale":"2023-12-24T20:07:20.759365+0000","last_undegraded":"2023-12-24T20:07:20.759365+0000","last_fullsized":"2023-12-24T20:07:20.759365+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:47.122711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.761936+0000","last_change":"2023-12-24T20:07:20.761864+0000","last_active":"2023-12-24T20:07:20.761936+0000","last_peered":"2023-12-24T20:07:20.761936+0000","last_clean":"2023-12-24T20:07:20.761936+0000","last_became_active":"2023-12-24T20:07:20.761649+0000","last_became_peered":"2023-12-24T20:07:20.761649+0000","last_unstale":"2023-12-24T20:07:20.761936+0000","last_undegraded":"2023-12-24T20:07:20.761936+0000","last_fullsized":"2023-12-24T20:07:20.761936+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:24.875050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.759856+0000","last_change":"2023-12-24T20:07:20.759695+0000","last_active":"2023-12-24T20:07:20.759856+0000","last_peered":"2023-12-24T20:07:20.759856+0000","last_clean":"2023-12-24T20:07:20.759856+0000","last_became_active":"2023-12-24T20:07:20.759231+0000","last_became_peered":"2023-12-24T20:07:20.759231+0000","last_unstale":"2023-12-24T20:07:20.759856+0000","last_undegraded":"2023-12-24T20:07:20.759856+0000","last_fullsized":"2023-12-24T20:07:20.759856+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:07.356043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.756767+0000","last_change":"2023-12-24T20:07:20.755357+0000","last_active":"2023-12-24T20:07:20.756767+0000","last_peered":"2023-12-24T20:07:20.756767+0000","last_clean":"2023-12-24T20:07:20.756767+0000","last_became_active":"2023-12-24T20:07:20.755104+0000","last_became_peered":"2023-12-24T20:07:20.755104+0000","last_unstale":"2023-12-24T20:07:20.756767+0000","last_undegraded":"2023-12-24T20:07:20.756767+0000","last_fullsized":"2023-12-24T20:07:20.756767+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:27:31.344942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.748575+0000","last_change":"2023-12-24T20:07:20.745388+0000","last_active":"2023-12-24T20:07:20.748575+0000","last_peered":"2023-12-24T20:07:20.748575+0000","last_clean":"2023-12-24T20:07:20.748575+0000","last_became_active":"2023-12-24T20:07:20.745064+0000","last_became_peered":"2023-12-24T20:07:20.745064+0000","last_unstale":"2023-12-24T20:07:20.748575+0000","last_undegraded":"2023-12-24T20:07:20.748575+0000","last_fullsized":"2023-12-24T20:07:20.748575+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:04:47.701358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.755583+0000","last_change":"2023-12-24T20:07:20.754886+0000","last_active":"2023-12-24T20:07:20.755583+0000","last_peered":"2023-12-24T20:07:20.755583+0000","last_clean":"2023-12-24T20:07:20.755583+0000","last_became_active":"2023-12-24T20:07:20.754526+0000","last_became_peered":"2023-12-24T20:07:20.754526+0000","last_unstale":"2023-12-24T20:07:20.755583+0000","last_undegraded":"2023-12-24T20:07:20.755583+0000","last_fullsized":"2023-12-24T20:07:20.755583+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:24.875050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.750371+0000","last_change":"2023-12-24T20:07:20.746562+0000","last_active":"2023-12-24T20:07:20.750371+0000","last_peered":"2023-12-24T20:07:20.750371+0000","last_clean":"2023-12-24T20:07:20.750371+0000","last_became_active":"2023-12-24T20:07:20.746340+0000","last_became_peered":"2023-12-24T20:07:20.746340+0000","last_unstale":"2023-12-24T20:07:20.750371+0000","last_undegraded":"2023-12-24T20:07:20.750371+0000","last_fullsized":"2023-12-24T20:07:20.750371+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:06.273218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.756842+0000","last_change":"2023-12-24T20:07:20.756126+0000","last_active":"2023-12-24T20:07:20.756842+0000","last_peered":"2023-12-24T20:07:20.756842+0000","last_clean":"2023-12-24T20:07:20.756842+0000","last_became_active":"2023-12-24T20:07:20.755878+0000","last_became_peered":"2023-12-24T20:07:20.755878+0000","last_unstale":"2023-12-24T20:07:20.756842+0000","last_undegraded":"2023-12-24T20:07:20.756842+0000","last_fullsized":"2023-12-24T20:07:20.756842+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:33:36.728915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.749107+0000","last_change":"2023-12-24T20:07:20.749003+0000","last_active":"2023-12-24T20:07:20.749107+0000","last_peered":"2023-12-24T20:07:20.749107+0000","last_clean":"2023-12-24T20:07:20.749107+0000","last_became_active":"2023-12-24T20:07:20.748776+0000","last_became_peered":"2023-12-24T20:07:20.748776+0000","last_unstale":"2023-12-24T20:07:20.749107+0000","last_undegraded":"2023-12-24T20:07:20.749107+0000","last_fullsized":"2023-12-24T20:07:20.749107+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:59:32.654816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.755833+0000","last_change":"2023-12-24T20:07:20.755497+0000","last_active":"2023-12-24T20:07:20.755833+0000","last_peered":"2023-12-24T20:07:20.755833+0000","last_clean":"2023-12-24T20:07:20.755833+0000","last_became_active":"2023-12-24T20:07:20.755118+0000","last_became_peered":"2023-12-24T20:07:20.755118+0000","last_unstale":"2023-12-24T20:07:20.755833+0000","last_undegraded":"2023-12-24T20:07:20.755833+0000","last_fullsized":"2023-12-24T20:07:20.755833+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:33.816202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.753849+0000","last_change":"2023-12-24T20:07:20.753425+0000","last_active":"2023-12-24T20:07:20.753849+0000","last_peered":"2023-12-24T20:07:20.753849+0000","last_clean":"2023-12-24T20:07:20.753849+0000","last_became_active":"2023-12-24T20:07:20.753008+0000","last_became_peered":"2023-12-24T20:07:20.753008+0000","last_unstale":"2023-12-24T20:07:20.753849+0000","last_undegraded":"2023-12-24T20:07:20.753849+0000","last_fullsized":"2023-12-24T20:07:20.753849+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:11:17.673078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.758438+0000","last_change":"2023-12-24T20:07:20.758325+0000","last_active":"2023-12-24T20:07:20.758438+0000","last_peered":"2023-12-24T20:07:20.758438+0000","last_clean":"2023-12-24T20:07:20.758438+0000","last_became_active":"2023-12-24T20:07:20.757892+0000","last_became_peered":"2023-12-24T20:07:20.757892+0000","last_unstale":"2023-12-24T20:07:20.758438+0000","last_undegraded":"2023-12-24T20:07:20.758438+0000","last_fullsized":"2023-12-24T20:07:20.758438+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:50.614092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"184'4","reported_seq":14,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.757994+0000","last_change":"2023-12-24T20:07:19.729857+0000","last_active":"2023-12-24T20:07:20.757994+0000","last_peered":"2023-12-24T20:07:20.757994+0000","last_clean":"2023-12-24T20:07:20.757994+0000","last_became_active":"2023-12-24T20:07:19.729631+0000","last_became_peered":"2023-12-24T20:07:19.729631+0000","last_unstale":"2023-12-24T20:07:20.757994+0000","last_undegraded":"2023-12-24T20:07:20.757994+0000","last_fullsized":"2023-12-24T20:07:20.757994+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:59:32.809199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.752864+0000","last_change":"2023-12-24T20:07:20.752794+0000","last_active":"2023-12-24T20:07:20.752864+0000","last_peered":"2023-12-24T20:07:20.752864+0000","last_clean":"2023-12-24T20:07:20.752864+0000","last_became_active":"2023-12-24T20:07:20.752030+0000","last_became_peered":"2023-12-24T20:07:20.752030+0000","last_unstale":"2023-12-24T20:07:20.752864+0000","last_undegraded":"2023-12-24T20:07:20.752864+0000","last_fullsized":"2023-12-24T20:07:20.752864+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:33:56.525165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.765119+0000","last_change":"2023-12-24T20:07:19.726003+0000","last_active":"2023-12-24T20:07:20.765119+0000","last_peered":"2023-12-24T20:07:20.765119+0000","last_clean":"2023-12-24T20:07:20.765119+0000","last_became_active":"2023-12-24T20:07:19.725772+0000","last_became_peered":"2023-12-24T20:07:19.725772+0000","last_unstale":"2023-12-24T20:07:20.765119+0000","last_undegraded":"2023-12-24T20:07:20.765119+0000","last_fullsized":"2023-12-24T20:07:20.765119+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:00:46.115708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.752814+0000","last_change":"2023-12-24T20:07:20.752732+0000","last_active":"2023-12-24T20:07:20.752814+0000","last_peered":"2023-12-24T20:07:20.752814+0000","last_clean":"2023-12-24T20:07:20.752814+0000","last_became_active":"2023-12-24T20:07:20.752501+0000","last_became_peered":"2023-12-24T20:07:20.752501+0000","last_unstale":"2023-12-24T20:07:20.752814+0000","last_undegraded":"2023-12-24T20:07:20.752814+0000","last_fullsized":"2023-12-24T20:07:20.752814+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:27:31.344942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.763686+0000","last_change":"2023-12-24T20:07:19.726181+0000","last_active":"2023-12-24T20:07:20.763686+0000","last_peered":"2023-12-24T20:07:20.763686+0000","last_clean":"2023-12-24T20:07:20.763686+0000","last_became_active":"2023-12-24T20:07:19.725910+0000","last_became_peered":"2023-12-24T20:07:19.725910+0000","last_unstale":"2023-12-24T20:07:20.763686+0000","last_undegraded":"2023-12-24T20:07:20.763686+0000","last_fullsized":"2023-12-24T20:07:20.763686+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:28.825227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.753597+0000","last_change":"2023-12-24T20:07:20.753419+0000","last_active":"2023-12-24T20:07:20.753597+0000","last_peered":"2023-12-24T20:07:20.753597+0000","last_clean":"2023-12-24T20:07:20.753597+0000","last_became_active":"2023-12-24T20:07:20.753169+0000","last_became_peered":"2023-12-24T20:07:20.753169+0000","last_unstale":"2023-12-24T20:07:20.753597+0000","last_undegraded":"2023-12-24T20:07:20.753597+0000","last_fullsized":"2023-12-24T20:07:20.753597+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:52:53.168098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.754328+0000","last_change":"2023-12-24T20:07:19.728483+0000","last_active":"2023-12-24T20:07:20.754328+0000","last_peered":"2023-12-24T20:07:20.754328+0000","last_clean":"2023-12-24T20:07:20.754328+0000","last_became_active":"2023-12-24T20:07:19.728165+0000","last_became_peered":"2023-12-24T20:07:19.728165+0000","last_unstale":"2023-12-24T20:07:20.754328+0000","last_undegraded":"2023-12-24T20:07:20.754328+0000","last_fullsized":"2023-12-24T20:07:20.754328+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:30:33.159853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.756011+0000","last_change":"2023-12-24T20:07:20.755949+0000","last_active":"2023-12-24T20:07:20.756011+0000","last_peered":"2023-12-24T20:07:20.756011+0000","last_clean":"2023-12-24T20:07:20.756011+0000","last_became_active":"2023-12-24T20:07:20.755698+0000","last_became_peered":"2023-12-24T20:07:20.755698+0000","last_unstale":"2023-12-24T20:07:20.756011+0000","last_undegraded":"2023-12-24T20:07:20.756011+0000","last_fullsized":"2023-12-24T20:07:20.756011+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:57:01.802459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.761107+0000","last_change":"2023-12-24T20:07:19.726579+0000","last_active":"2023-12-24T20:07:20.761107+0000","last_peered":"2023-12-24T20:07:20.761107+0000","last_clean":"2023-12-24T20:07:20.761107+0000","last_became_active":"2023-12-24T20:07:19.726241+0000","last_became_peered":"2023-12-24T20:07:19.726241+0000","last_unstale":"2023-12-24T20:07:20.761107+0000","last_undegraded":"2023-12-24T20:07:20.761107+0000","last_fullsized":"2023-12-24T20:07:20.761107+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:49.634096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.753104+0000","last_change":"2023-12-24T20:07:20.751606+0000","last_active":"2023-12-24T20:07:20.753104+0000","last_peered":"2023-12-24T20:07:20.753104+0000","last_clean":"2023-12-24T20:07:20.753104+0000","last_became_active":"2023-12-24T20:07:20.751103+0000","last_became_peered":"2023-12-24T20:07:20.751103+0000","last_unstale":"2023-12-24T20:07:20.753104+0000","last_undegraded":"2023-12-24T20:07:20.753104+0000","last_fullsized":"2023-12-24T20:07:20.753104+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:54:17.156416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.758364+0000","last_change":"2023-12-24T20:07:19.727911+0000","last_active":"2023-12-24T20:07:20.758364+0000","last_peered":"2023-12-24T20:07:20.758364+0000","last_clean":"2023-12-24T20:07:20.758364+0000","last_became_active":"2023-12-24T20:07:19.727639+0000","last_became_peered":"2023-12-24T20:07:19.727639+0000","last_unstale":"2023-12-24T20:07:20.758364+0000","last_undegraded":"2023-12-24T20:07:20.758364+0000","last_fullsized":"2023-12-24T20:07:20.758364+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:52:52.161095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.753035+0000","last_change":"2023-12-24T20:07:20.749675+0000","last_active":"2023-12-24T20:07:20.753035+0000","last_peered":"2023-12-24T20:07:20.753035+0000","last_clean":"2023-12-24T20:07:20.753035+0000","last_became_active":"2023-12-24T20:07:20.749432+0000","last_became_peered":"2023-12-24T20:07:20.749432+0000","last_unstale":"2023-12-24T20:07:20.753035+0000","last_undegraded":"2023-12-24T20:07:20.753035+0000","last_fullsized":"2023-12-24T20:07:20.753035+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:00:09.827120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.747434+0000","last_change":"2023-12-24T20:07:19.726790+0000","last_active":"2023-12-24T20:07:20.747434+0000","last_peered":"2023-12-24T20:07:20.747434+0000","last_clean":"2023-12-24T20:07:20.747434+0000","last_became_active":"2023-12-24T20:07:19.726577+0000","last_became_peered":"2023-12-24T20:07:19.726577+0000","last_unstale":"2023-12-24T20:07:20.747434+0000","last_undegraded":"2023-12-24T20:07:20.747434+0000","last_fullsized":"2023-12-24T20:07:20.747434+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:25:40.906179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.757062+0000","last_change":"2023-12-24T20:07:20.757011+0000","last_active":"2023-12-24T20:07:20.757062+0000","last_peered":"2023-12-24T20:07:20.757062+0000","last_clean":"2023-12-24T20:07:20.757062+0000","last_became_active":"2023-12-24T20:07:20.756792+0000","last_became_peered":"2023-12-24T20:07:20.756792+0000","last_unstale":"2023-12-24T20:07:20.757062+0000","last_undegraded":"2023-12-24T20:07:20.757062+0000","last_fullsized":"2023-12-24T20:07:20.757062+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:09:17.387167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.744739+0000","last_change":"2023-12-24T20:07:19.727460+0000","last_active":"2023-12-24T20:07:20.744739+0000","last_peered":"2023-12-24T20:07:20.744739+0000","last_clean":"2023-12-24T20:07:20.744739+0000","last_became_active":"2023-12-24T20:07:19.727198+0000","last_became_peered":"2023-12-24T20:07:19.727198+0000","last_unstale":"2023-12-24T20:07:20.744739+0000","last_undegraded":"2023-12-24T20:07:20.744739+0000","last_fullsized":"2023-12-24T20:07:20.744739+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:41:58.364787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.751231+0000","last_change":"2023-12-24T20:07:20.751164+0000","last_active":"2023-12-24T20:07:20.751231+0000","last_peered":"2023-12-24T20:07:20.751231+0000","last_clean":"2023-12-24T20:07:20.751231+0000","last_became_active":"2023-12-24T20:07:20.750939+0000","last_became_peered":"2023-12-24T20:07:20.750939+0000","last_unstale":"2023-12-24T20:07:20.751231+0000","last_undegraded":"2023-12-24T20:07:20.751231+0000","last_fullsized":"2023-12-24T20:07:20.751231+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:46:48.438634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.748280+0000","last_change":"2023-12-24T20:07:19.730168+0000","last_active":"2023-12-24T20:07:20.748280+0000","last_peered":"2023-12-24T20:07:20.748280+0000","last_clean":"2023-12-24T20:07:20.748280+0000","last_became_active":"2023-12-24T20:07:19.729898+0000","last_became_peered":"2023-12-24T20:07:19.729898+0000","last_unstale":"2023-12-24T20:07:20.748280+0000","last_undegraded":"2023-12-24T20:07:20.748280+0000","last_fullsized":"2023-12-24T20:07:20.748280+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:04:49.634096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.758275+0000","last_change":"2023-12-24T20:07:20.758155+0000","last_active":"2023-12-24T20:07:20.758275+0000","last_peered":"2023-12-24T20:07:20.758275+0000","last_clean":"2023-12-24T20:07:20.758275+0000","last_became_active":"2023-12-24T20:07:20.757908+0000","last_became_peered":"2023-12-24T20:07:20.757908+0000","last_unstale":"2023-12-24T20:07:20.758275+0000","last_undegraded":"2023-12-24T20:07:20.758275+0000","last_fullsized":"2023-12-24T20:07:20.758275+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:36:59.743099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"184'3","reported_seq":13,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.757457+0000","last_change":"2023-12-24T20:07:19.729270+0000","last_active":"2023-12-24T20:07:20.757457+0000","last_peered":"2023-12-24T20:07:20.757457+0000","last_clean":"2023-12-24T20:07:20.757457+0000","last_became_active":"2023-12-24T20:07:19.729021+0000","last_became_peered":"2023-12-24T20:07:19.729021+0000","last_unstale":"2023-12-24T20:07:20.757457+0000","last_undegraded":"2023-12-24T20:07:20.757457+0000","last_fullsized":"2023-12-24T20:07:20.757457+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:58:15.989073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.757918+0000","last_change":"2023-12-24T20:07:20.757852+0000","last_active":"2023-12-24T20:07:20.757918+0000","last_peered":"2023-12-24T20:07:20.757918+0000","last_clean":"2023-12-24T20:07:20.757918+0000","last_became_active":"2023-12-24T20:07:20.757554+0000","last_became_peered":"2023-12-24T20:07:20.757554+0000","last_unstale":"2023-12-24T20:07:20.757918+0000","last_undegraded":"2023-12-24T20:07:20.757918+0000","last_fullsized":"2023-12-24T20:07:20.757918+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:19:29.978141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"184'6","reported_seq":16,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.766970+0000","last_change":"2023-12-24T20:07:19.733162+0000","last_active":"2023-12-24T20:07:20.766970+0000","last_peered":"2023-12-24T20:07:20.766970+0000","last_clean":"2023-12-24T20:07:20.766970+0000","last_became_active":"2023-12-24T20:07:19.727678+0000","last_became_peered":"2023-12-24T20:07:19.727678+0000","last_unstale":"2023-12-24T20:07:20.766970+0000","last_undegraded":"2023-12-24T20:07:20.766970+0000","last_fullsized":"2023-12-24T20:07:20.766970+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:38:54.337829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.759103+0000","last_change":"2023-12-24T20:07:20.759010+0000","last_active":"2023-12-24T20:07:20.759103+0000","last_peered":"2023-12-24T20:07:20.759103+0000","last_clean":"2023-12-24T20:07:20.759103+0000","last_became_active":"2023-12-24T20:07:20.758767+0000","last_became_peered":"2023-12-24T20:07:20.758767+0000","last_unstale":"2023-12-24T20:07:20.759103+0000","last_undegraded":"2023-12-24T20:07:20.759103+0000","last_fullsized":"2023-12-24T20:07:20.759103+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:38:50.614092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.760192+0000","last_change":"2023-12-24T20:07:19.725269+0000","last_active":"2023-12-24T20:07:20.760192+0000","last_peered":"2023-12-24T20:07:20.760192+0000","last_clean":"2023-12-24T20:07:20.760192+0000","last_became_active":"2023-12-24T20:07:19.725000+0000","last_became_peered":"2023-12-24T20:07:19.725000+0000","last_unstale":"2023-12-24T20:07:20.760192+0000","last_undegraded":"2023-12-24T20:07:20.760192+0000","last_fullsized":"2023-12-24T20:07:20.760192+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:52:32.810420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.754018+0000","last_change":"2023-12-24T20:07:20.753966+0000","last_active":"2023-12-24T20:07:20.754018+0000","last_peered":"2023-12-24T20:07:20.754018+0000","last_clean":"2023-12-24T20:07:20.754018+0000","last_became_active":"2023-12-24T20:07:20.753710+0000","last_became_peered":"2023-12-24T20:07:20.753710+0000","last_unstale":"2023-12-24T20:07:20.754018+0000","last_undegraded":"2023-12-24T20:07:20.754018+0000","last_fullsized":"2023-12-24T20:07:20.754018+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:40:00.084685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.743576+0000","last_change":"2023-12-24T20:07:19.728699+0000","last_active":"2023-12-24T20:07:20.743576+0000","last_peered":"2023-12-24T20:07:20.743576+0000","last_clean":"2023-12-24T20:07:20.743576+0000","last_became_active":"2023-12-24T20:07:19.726901+0000","last_became_peered":"2023-12-24T20:07:19.726901+0000","last_unstale":"2023-12-24T20:07:20.743576+0000","last_undegraded":"2023-12-24T20:07:20.743576+0000","last_fullsized":"2023-12-24T20:07:20.743576+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:32:13.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.759015+0000","last_change":"2023-12-24T20:07:20.758968+0000","last_active":"2023-12-24T20:07:20.759015+0000","last_peered":"2023-12-24T20:07:20.759015+0000","last_clean":"2023-12-24T20:07:20.759015+0000","last_became_active":"2023-12-24T20:07:20.758684+0000","last_became_peered":"2023-12-24T20:07:20.758684+0000","last_unstale":"2023-12-24T20:07:20.759015+0000","last_undegraded":"2023-12-24T20:07:20.759015+0000","last_fullsized":"2023-12-24T20:07:20.759015+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:54.406795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.741585+0000","last_change":"2023-12-24T20:07:19.729904+0000","last_active":"2023-12-24T20:07:20.741585+0000","last_peered":"2023-12-24T20:07:20.741585+0000","last_clean":"2023-12-24T20:07:20.741585+0000","last_became_active":"2023-12-24T20:07:19.727729+0000","last_became_peered":"2023-12-24T20:07:19.727729+0000","last_unstale":"2023-12-24T20:07:20.741585+0000","last_undegraded":"2023-12-24T20:07:20.741585+0000","last_fullsized":"2023-12-24T20:07:20.741585+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:33:35.721912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.755564+0000","last_change":"2023-12-24T20:07:20.754742+0000","last_active":"2023-12-24T20:07:20.755564+0000","last_peered":"2023-12-24T20:07:20.755564+0000","last_clean":"2023-12-24T20:07:20.755564+0000","last_became_active":"2023-12-24T20:07:20.753780+0000","last_became_peered":"2023-12-24T20:07:20.753780+0000","last_unstale":"2023-12-24T20:07:20.755564+0000","last_undegraded":"2023-12-24T20:07:20.755564+0000","last_fullsized":"2023-12-24T20:07:20.755564+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:23:29.832230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"184'8","reported_seq":18,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.764904+0000","last_change":"2023-12-24T20:07:19.729342+0000","last_active":"2023-12-24T20:07:20.764904+0000","last_peered":"2023-12-24T20:07:20.764904+0000","last_clean":"2023-12-24T20:07:20.764904+0000","last_became_active":"2023-12-24T20:07:19.727563+0000","last_became_peered":"2023-12-24T20:07:19.727563+0000","last_unstale":"2023-12-24T20:07:20.764904+0000","last_undegraded":"2023-12-24T20:07:20.764904+0000","last_fullsized":"2023-12-24T20:07:20.764904+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:07:06.349039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.757913+0000","last_change":"2023-12-24T20:07:20.754642+0000","last_active":"2023-12-24T20:07:20.757913+0000","last_peered":"2023-12-24T20:07:20.757913+0000","last_clean":"2023-12-24T20:07:20.757913+0000","last_became_active":"2023-12-24T20:07:20.754182+0000","last_became_peered":"2023-12-24T20:07:20.754182+0000","last_unstale":"2023-12-24T20:07:20.757913+0000","last_undegraded":"2023-12-24T20:07:20.757913+0000","last_fullsized":"2023-12-24T20:07:20.757913+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:39.352000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.763081+0000","last_change":"2023-12-24T20:07:19.733087+0000","last_active":"2023-12-24T20:07:20.763081+0000","last_peered":"2023-12-24T20:07:20.763081+0000","last_clean":"2023-12-24T20:07:20.763081+0000","last_became_active":"2023-12-24T20:07:19.732832+0000","last_became_peered":"2023-12-24T20:07:19.732832+0000","last_unstale":"2023-12-24T20:07:20.763081+0000","last_undegraded":"2023-12-24T20:07:20.763081+0000","last_fullsized":"2023-12-24T20:07:20.763081+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:19:26.589177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.749197+0000","last_change":"2023-12-24T20:07:20.749118+0000","last_active":"2023-12-24T20:07:20.749197+0000","last_peered":"2023-12-24T20:07:20.749197+0000","last_clean":"2023-12-24T20:07:20.749197+0000","last_became_active":"2023-12-24T20:07:20.748858+0000","last_became_peered":"2023-12-24T20:07:20.748858+0000","last_unstale":"2023-12-24T20:07:20.749197+0000","last_undegraded":"2023-12-24T20:07:20.749197+0000","last_fullsized":"2023-12-24T20:07:20.749197+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T02:01:24.163148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.757962+0000","last_change":"2023-12-24T20:07:19.731693+0000","last_active":"2023-12-24T20:07:20.757962+0000","last_peered":"2023-12-24T20:07:20.757962+0000","last_clean":"2023-12-24T20:07:20.757962+0000","last_became_active":"2023-12-24T20:07:19.729784+0000","last_became_peered":"2023-12-24T20:07:19.729784+0000","last_unstale":"2023-12-24T20:07:20.757962+0000","last_undegraded":"2023-12-24T20:07:20.757962+0000","last_fullsized":"2023-12-24T20:07:20.757962+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:55:13.212890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.753133+0000","last_change":"2023-12-24T20:07:20.751719+0000","last_active":"2023-12-24T20:07:20.753133+0000","last_peered":"2023-12-24T20:07:20.753133+0000","last_clean":"2023-12-24T20:07:20.753133+0000","last_became_active":"2023-12-24T20:07:20.751425+0000","last_became_peered":"2023-12-24T20:07:20.751425+0000","last_unstale":"2023-12-24T20:07:20.753133+0000","last_undegraded":"2023-12-24T20:07:20.753133+0000","last_fullsized":"2023-12-24T20:07:20.753133+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:39:26.982422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"184'1","reported_seq":11,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.750976+0000","last_change":"2023-12-24T20:07:19.732110+0000","last_active":"2023-12-24T20:07:20.750976+0000","last_peered":"2023-12-24T20:07:20.750976+0000","last_clean":"2023-12-24T20:07:20.750976+0000","last_became_active":"2023-12-24T20:07:19.731518+0000","last_became_peered":"2023-12-24T20:07:19.731518+0000","last_unstale":"2023-12-24T20:07:20.750976+0000","last_undegraded":"2023-12-24T20:07:20.750976+0000","last_fullsized":"2023-12-24T20:07:20.750976+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:11.706105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.753999+0000","last_change":"2023-12-24T20:07:20.753907+0000","last_active":"2023-12-24T20:07:20.753999+0000","last_peered":"2023-12-24T20:07:20.753999+0000","last_clean":"2023-12-24T20:07:20.753999+0000","last_became_active":"2023-12-24T20:07:20.753243+0000","last_became_peered":"2023-12-24T20:07:20.753243+0000","last_unstale":"2023-12-24T20:07:20.753999+0000","last_undegraded":"2023-12-24T20:07:20.753999+0000","last_fullsized":"2023-12-24T20:07:20.753999+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:27:49.821665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.746284+0000","last_change":"2023-12-24T20:07:19.730514+0000","last_active":"2023-12-24T20:07:20.746284+0000","last_peered":"2023-12-24T20:07:20.746284+0000","last_clean":"2023-12-24T20:07:20.746284+0000","last_became_active":"2023-12-24T20:07:19.730254+0000","last_became_peered":"2023-12-24T20:07:19.730254+0000","last_unstale":"2023-12-24T20:07:20.746284+0000","last_undegraded":"2023-12-24T20:07:20.746284+0000","last_fullsized":"2023-12-24T20:07:20.746284+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T03:08:33.502883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.752456+0000","last_change":"2023-12-24T20:07:20.752389+0000","last_active":"2023-12-24T20:07:20.752456+0000","last_peered":"2023-12-24T20:07:20.752456+0000","last_clean":"2023-12-24T20:07:20.752456+0000","last_became_active":"2023-12-24T20:07:20.752162+0000","last_became_peered":"2023-12-24T20:07:20.752162+0000","last_unstale":"2023-12-24T20:07:20.752456+0000","last_undegraded":"2023-12-24T20:07:20.752456+0000","last_fullsized":"2023-12-24T20:07:20.752456+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:52:33.817424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.761601+0000","last_change":"2023-12-24T20:07:19.729132+0000","last_active":"2023-12-24T20:07:20.761601+0000","last_peered":"2023-12-24T20:07:20.761601+0000","last_clean":"2023-12-24T20:07:20.761601+0000","last_became_active":"2023-12-24T20:07:19.728856+0000","last_became_peered":"2023-12-24T20:07:19.728856+0000","last_unstale":"2023-12-24T20:07:20.761601+0000","last_undegraded":"2023-12-24T20:07:20.761601+0000","last_fullsized":"2023-12-24T20:07:20.761601+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:22:23.868047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.753479+0000","last_change":"2023-12-24T20:07:20.751799+0000","last_active":"2023-12-24T20:07:20.753479+0000","last_peered":"2023-12-24T20:07:20.753479+0000","last_clean":"2023-12-24T20:07:20.753479+0000","last_became_active":"2023-12-24T20:07:20.751561+0000","last_became_peered":"2023-12-24T20:07:20.751561+0000","last_unstale":"2023-12-24T20:07:20.753479+0000","last_undegraded":"2023-12-24T20:07:20.753479+0000","last_fullsized":"2023-12-24T20:07:20.753479+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:41.361528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.747799+0000","last_change":"2023-12-24T20:07:19.731937+0000","last_active":"2023-12-24T20:07:20.747799+0000","last_peered":"2023-12-24T20:07:20.747799+0000","last_clean":"2023-12-24T20:07:20.747799+0000","last_became_active":"2023-12-24T20:07:19.731703+0000","last_became_peered":"2023-12-24T20:07:19.731703+0000","last_unstale":"2023-12-24T20:07:20.747799+0000","last_undegraded":"2023-12-24T20:07:20.747799+0000","last_fullsized":"2023-12-24T20:07:20.747799+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:19:28.971138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.762659+0000","last_change":"2023-12-24T20:07:20.761681+0000","last_active":"2023-12-24T20:07:20.762659+0000","last_peered":"2023-12-24T20:07:20.762659+0000","last_clean":"2023-12-24T20:07:20.762659+0000","last_became_active":"2023-12-24T20:07:20.761472+0000","last_became_peered":"2023-12-24T20:07:20.761472+0000","last_unstale":"2023-12-24T20:07:20.762659+0000","last_undegraded":"2023-12-24T20:07:20.762659+0000","last_fullsized":"2023-12-24T20:07:20.762659+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:31:39.286031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.741963+0000","last_change":"2023-12-24T20:07:19.728748+0000","last_active":"2023-12-24T20:07:20.741963+0000","last_peered":"2023-12-24T20:07:20.741963+0000","last_clean":"2023-12-24T20:07:20.741963+0000","last_became_active":"2023-12-24T20:07:19.728485+0000","last_became_peered":"2023-12-24T20:07:19.728485+0000","last_unstale":"2023-12-24T20:07:20.741963+0000","last_undegraded":"2023-12-24T20:07:20.741963+0000","last_fullsized":"2023-12-24T20:07:20.741963+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:25:18.418726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.763943+0000","last_change":"2023-12-24T20:07:20.763849+0000","last_active":"2023-12-24T20:07:20.763943+0000","last_peered":"2023-12-24T20:07:20.763943+0000","last_clean":"2023-12-24T20:07:20.763943+0000","last_became_active":"2023-12-24T20:07:20.763623+0000","last_became_peered":"2023-12-24T20:07:20.763623+0000","last_unstale":"2023-12-24T20:07:20.763943+0000","last_undegraded":"2023-12-24T20:07:20.763943+0000","last_fullsized":"2023-12-24T20:07:20.763943+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:26.340636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.749361+0000","last_change":"2023-12-24T20:07:19.734498+0000","last_active":"2023-12-24T20:07:20.749361+0000","last_peered":"2023-12-24T20:07:20.749361+0000","last_clean":"2023-12-24T20:07:20.749361+0000","last_became_active":"2023-12-24T20:07:19.731867+0000","last_became_peered":"2023-12-24T20:07:19.731867+0000","last_unstale":"2023-12-24T20:07:20.749361+0000","last_undegraded":"2023-12-24T20:07:20.749361+0000","last_fullsized":"2023-12-24T20:07:20.749361+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:59:31.647812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.756541+0000","last_change":"2023-12-24T20:07:20.755379+0000","last_active":"2023-12-24T20:07:20.756541+0000","last_peered":"2023-12-24T20:07:20.756541+0000","last_clean":"2023-12-24T20:07:20.756541+0000","last_became_active":"2023-12-24T20:07:20.753596+0000","last_became_peered":"2023-12-24T20:07:20.753596+0000","last_unstale":"2023-12-24T20:07:20.756541+0000","last_undegraded":"2023-12-24T20:07:20.756541+0000","last_fullsized":"2023-12-24T20:07:20.756541+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T01:49:41.361528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"184'2","reported_seq":12,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.759644+0000","last_change":"2023-12-24T20:07:19.729541+0000","last_active":"2023-12-24T20:07:20.759644+0000","last_peered":"2023-12-24T20:07:20.759644+0000","last_clean":"2023-12-24T20:07:20.759644+0000","last_became_active":"2023-12-24T20:07:19.729312+0000","last_became_peered":"2023-12-24T20:07:19.729312+0000","last_unstale":"2023-12-24T20:07:20.759644+0000","last_undegraded":"2023-12-24T20:07:20.759644+0000","last_fullsized":"2023-12-24T20:07:20.759644+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:53:08.473437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.759175+0000","last_change":"2023-12-24T20:07:20.759111+0000","last_active":"2023-12-24T20:07:20.759175+0000","last_peered":"2023-12-24T20:07:20.759175+0000","last_clean":"2023-12-24T20:07:20.759175+0000","last_became_active":"2023-12-24T20:07:20.758884+0000","last_became_peered":"2023-12-24T20:07:20.758884+0000","last_unstale":"2023-12-24T20:07:20.759175+0000","last_undegraded":"2023-12-24T20:07:20.759175+0000","last_fullsized":"2023-12-24T20:07:20.759175+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:11:17.673078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-12-24T20:07:22.370093+0000","last_change":"2023-12-24T20:07:19.734185+0000","last_active":"2023-12-24T20:07:22.370093+0000","last_peered":"2023-12-24T20:07:22.370093+0000","last_clean":"2023-12-24T20:07:22.370093+0000","last_became_active":"2023-12-24T20:07:19.733672+0000","last_became_peered":"2023-12-24T20:07:19.733672+0000","last_unstale":"2023-12-24T20:07:22.370093+0000","last_undegraded":"2023-12-24T20:07:22.370093+0000","last_fullsized":"2023-12-24T20:07:22.370093+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:25:16.540761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.758686+0000","last_change":"2023-12-24T20:07:20.758618+0000","last_active":"2023-12-24T20:07:20.758686+0000","last_peered":"2023-12-24T20:07:20.758686+0000","last_clean":"2023-12-24T20:07:20.758686+0000","last_became_active":"2023-12-24T20:07:20.758285+0000","last_became_peered":"2023-12-24T20:07:20.758285+0000","last_unstale":"2023-12-24T20:07:20.758686+0000","last_undegraded":"2023-12-24T20:07:20.758686+0000","last_fullsized":"2023-12-24T20:07:20.758686+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:36:22.904751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.747532+0000","last_change":"2023-12-24T20:07:19.729035+0000","last_active":"2023-12-24T20:07:20.747532+0000","last_peered":"2023-12-24T20:07:20.747532+0000","last_clean":"2023-12-24T20:07:20.747532+0000","last_became_active":"2023-12-24T20:07:19.728769+0000","last_became_peered":"2023-12-24T20:07:19.728769+0000","last_unstale":"2023-12-24T20:07:20.747532+0000","last_undegraded":"2023-12-24T20:07:20.747532+0000","last_fullsized":"2023-12-24T20:07:20.747532+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T00:43:05.266214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.750933+0000","last_change":"2023-12-24T20:07:20.750827+0000","last_active":"2023-12-24T20:07:20.750933+0000","last_peered":"2023-12-24T20:07:20.750933+0000","last_clean":"2023-12-24T20:07:20.750933+0000","last_became_active":"2023-12-24T20:07:20.750366+0000","last_became_peered":"2023-12-24T20:07:20.750366+0000","last_unstale":"2023-12-24T20:07:20.750933+0000","last_undegraded":"2023-12-24T20:07:20.750933+0000","last_fullsized":"2023-12-24T20:07:20.750933+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:37:16.384382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.743708+0000","last_change":"2023-12-24T20:07:19.727957+0000","last_active":"2023-12-24T20:07:20.743708+0000","last_peered":"2023-12-24T20:07:20.743708+0000","last_clean":"2023-12-24T20:07:20.743708+0000","last_became_active":"2023-12-24T20:07:19.727670+0000","last_became_peered":"2023-12-24T20:07:19.727670+0000","last_unstale":"2023-12-24T20:07:20.743708+0000","last_undegraded":"2023-12-24T20:07:20.743708+0000","last_fullsized":"2023-12-24T20:07:20.743708+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T21:14:55.307099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.753345+0000","last_change":"2023-12-24T20:07:20.753269+0000","last_active":"2023-12-24T20:07:20.753345+0000","last_peered":"2023-12-24T20:07:20.753345+0000","last_clean":"2023-12-24T20:07:20.753345+0000","last_became_active":"2023-12-24T20:07:20.752677+0000","last_became_peered":"2023-12-24T20:07:20.752677+0000","last_unstale":"2023-12-24T20:07:20.753345+0000","last_undegraded":"2023-12-24T20:07:20.753345+0000","last_fullsized":"2023-12-24T20:07:20.753345+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:01:13.011642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.746424+0000","last_change":"2023-12-24T20:07:19.730892+0000","last_active":"2023-12-24T20:07:20.746424+0000","last_peered":"2023-12-24T20:07:20.746424+0000","last_clean":"2023-12-24T20:07:20.746424+0000","last_became_active":"2023-12-24T20:07:19.730467+0000","last_became_peered":"2023-12-24T20:07:19.730467+0000","last_unstale":"2023-12-24T20:07:20.746424+0000","last_undegraded":"2023-12-24T20:07:20.746424+0000","last_fullsized":"2023-12-24T20:07:20.746424+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T20:59:05.967669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.755553+0000","last_change":"2023-12-24T20:07:20.755360+0000","last_active":"2023-12-24T20:07:20.755553+0000","last_peered":"2023-12-24T20:07:20.755553+0000","last_clean":"2023-12-24T20:07:20.755553+0000","last_became_active":"2023-12-24T20:07:20.754768+0000","last_became_peered":"2023-12-24T20:07:20.754768+0000","last_unstale":"2023-12-24T20:07:20.755553+0000","last_undegraded":"2023-12-24T20:07:20.755553+0000","last_fullsized":"2023-12-24T20:07:20.755553+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:33:16.802409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.741678+0000","last_change":"2023-12-24T20:07:19.730112+0000","last_active":"2023-12-24T20:07:20.741678+0000","last_peered":"2023-12-24T20:07:20.741678+0000","last_clean":"2023-12-24T20:07:20.741678+0000","last_became_active":"2023-12-24T20:07:19.729114+0000","last_became_peered":"2023-12-24T20:07:19.729114+0000","last_unstale":"2023-12-24T20:07:20.741678+0000","last_undegraded":"2023-12-24T20:07:20.741678+0000","last_fullsized":"2023-12-24T20:07:20.741678+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:51:25.333632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.750385+0000","last_change":"2023-12-24T20:07:20.749897+0000","last_active":"2023-12-24T20:07:20.750385+0000","last_peered":"2023-12-24T20:07:20.750385+0000","last_clean":"2023-12-24T20:07:20.750385+0000","last_became_active":"2023-12-24T20:07:20.749649+0000","last_became_peered":"2023-12-24T20:07:20.749649+0000","last_unstale":"2023-12-24T20:07:20.750385+0000","last_undegraded":"2023-12-24T20:07:20.750385+0000","last_fullsized":"2023-12-24T20:07:20.750385+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T06:01:13.011642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.747244+0000","last_change":"2023-12-24T20:07:19.728441+0000","last_active":"2023-12-24T20:07:20.747244+0000","last_peered":"2023-12-24T20:07:20.747244+0000","last_clean":"2023-12-24T20:07:20.747244+0000","last_became_active":"2023-12-24T20:07:19.728198+0000","last_became_peered":"2023-12-24T20:07:19.728198+0000","last_unstale":"2023-12-24T20:07:20.747244+0000","last_undegraded":"2023-12-24T20:07:20.747244+0000","last_fullsized":"2023-12-24T20:07:20.747244+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T05:31:38.344997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.764730+0000","last_change":"2023-12-24T20:07:20.764683+0000","last_active":"2023-12-24T20:07:20.764730+0000","last_peered":"2023-12-24T20:07:20.764730+0000","last_clean":"2023-12-24T20:07:20.764730+0000","last_became_active":"2023-12-24T20:07:20.763677+0000","last_became_peered":"2023-12-24T20:07:20.763677+0000","last_unstale":"2023-12-24T20:07:20.764730+0000","last_undegraded":"2023-12-24T20:07:20.764730+0000","last_fullsized":"2023-12-24T20:07:20.764730+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:27:58.612009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.744143+0000","last_change":"2023-12-24T20:07:19.733303+0000","last_active":"2023-12-24T20:07:20.744143+0000","last_peered":"2023-12-24T20:07:20.744143+0000","last_clean":"2023-12-24T20:07:20.744143+0000","last_became_active":"2023-12-24T20:07:19.732962+0000","last_became_peered":"2023-12-24T20:07:19.732962+0000","last_unstale":"2023-12-24T20:07:20.744143+0000","last_undegraded":"2023-12-24T20:07:20.744143+0000","last_fullsized":"2023-12-24T20:07:20.744143+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T23:40:53.399792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.754605+0000","last_change":"2023-12-24T20:07:20.754464+0000","last_active":"2023-12-24T20:07:20.754605+0000","last_peered":"2023-12-24T20:07:20.754605+0000","last_clean":"2023-12-24T20:07:20.754605+0000","last_became_active":"2023-12-24T20:07:20.753686+0000","last_became_peered":"2023-12-24T20:07:20.753686+0000","last_unstale":"2023-12-24T20:07:20.754605+0000","last_undegraded":"2023-12-24T20:07:20.754605+0000","last_fullsized":"2023-12-24T20:07:20.754605+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:19.715122+0000","last_clean_scrub_stamp":"2023-12-24T20:07:19.715122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-25T22:04:47.701358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.746517+0000","last_change":"2023-12-24T20:07:19.730699+0000","last_active":"2023-12-24T20:07:20.746517+0000","last_peered":"2023-12-24T20:07:20.746517+0000","last_clean":"2023-12-24T20:07:20.746517+0000","last_became_active":"2023-12-24T20:07:19.730166+0000","last_became_peered":"2023-12-24T20:07:19.730166+0000","last_unstale":"2023-12-24T20:07:20.746517+0000","last_undegraded":"2023-12-24T20:07:20.746517+0000","last_fullsized":"2023-12-24T20:07:20.746517+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T20:07:18.708118+0000","last_clean_scrub_stamp":"2023-12-24T20:07:18.708118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T07:31:42.926099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":306,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-12-24T20:07:20.747865+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:07:20.747865+0000","last_peered":"2023-12-24T20:07:20.747865+0000","last_clean":"2023-12-24T20:07:20.747865+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:07:20.747865+0000","last_undegraded":"2023-12-24T20:07:20.747865+0000","last_fullsized":"2023-12-24T20:07:20.747865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1592,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193720,"statfs":{"total":200000000,"available":198369714,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.308,"15min":0.307},"max":{"1min":0.80200000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.629},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.47199999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.56999999999999995},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.872,"15min":0.872},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.39400000000000002,"15min":0.34100000000000003},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.57599999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.623},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.66200000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.82799999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.312},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.95699999999999996},"last":0.52700000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.379,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.81499999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.752,"15min":0.80000000000000004},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.79100000000000004,"15min":0.83699999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.873},"last":0.67200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962310,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.0309999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.45700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":0.80200000000000005,"15min":0.95799999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.27000000000000002},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.44,"5min":0.378,"15min":0.33200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0640000000000001},"last":0.57599999999999996}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.077},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.372},"max":{"1min":0.79100000000000004,"5min":0.877,"15min":1.048},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.86499999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.254},"max":{"1min":0.628,"5min":0.748,"15min":0.84699999999999998},"last":0.45100000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962298,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.372,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40799999999999997,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.54800000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.35799999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.51000000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.80900000000000005,"5min":0.871,"15min":0.871},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.59799999999999998},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.94299999999999995,"5min":1.014,"15min":1.014},"last":0.40300000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.04},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86199999999999999,"5min":0.998,"15min":0.998},"last":0.41899999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.63},"min":{"1min":0.437,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.64300000000000002},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.39500000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.48599999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.629},"min":{"1min":0.501,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69399999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":1.0109999999999999,"5min":1.03,"15min":1.03},"last":0.76200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1589,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193722,"statfs":{"total":200000000,"available":198371964,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36499999999999999,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.45800000000000002,"5min":0.70799999999999996,"15min":0.97999999999999998},"last":0.37}]},{"osd":2,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.439,"5min":0.65400000000000003,"15min":0.92700000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.93999999999999995},"last":0.29599999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56699999999999995,"5min":0.70199999999999996,"15min":2.573},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48999999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":1.073,"15min":1.3500000000000001},"last":0.438},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.65200000000000002},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":2.7149999999999999},"last":0.38800000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.372},"max":{"1min":0.94599999999999995,"5min":1.0569999999999999,"15min":2.6859999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.006},"last":0.51700000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":1.0489999999999999},"last":0.57299999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":1.5429999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.69999999999999996},"min":{"1min":0.58699999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.47399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962242,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.249,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.50800000000000001,"5min":0.61599999999999999,"15min":0.78900000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.72299999999999998},"last":0.34599999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38100000000000001,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.77700000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.82799999999999996},"last":0.374}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.84699999999999998},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.88900000000000001},"last":0.35199999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.97999999999999998},"last":0.436},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.2649999999999999},"last":0.443}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":3.577},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":1.052,"15min":7.0220000000000002},"last":0.47799999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.075,"5min":1.075,"15min":1.298},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":3.637},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.014,"15min":7.0599999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.55400000000000005,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.331},"last":0.48899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962298,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.373,"15min":0.34599999999999997},"min":{"1min":0.26000000000000001,"5min":0.22600000000000001,"15min":0.182},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.66500000000000004},"last":0.32300000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.371,"15min":0.35899999999999999},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59399999999999997},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39900000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.66500000000000004,"15min":0.79500000000000004},"last":0.377},{"interface":"front","average":{"1min":0.496,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.27800000000000002,"15min":0.27300000000000002},"max":{"1min":0.64400000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35499999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.55300000000000005,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.90600000000000003,"5min":0.92100000000000004,"15min":1.337},"last":0.45000000000000001}]},{"osd":5,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.622},"min":{"1min":0.48699999999999999,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":1.038,"15min":1.2010000000000001},"last":0.432},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53900000000000003,"5min":0.44900000000000001,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89900000000000002,"15min":0.97799999999999998},"last":0.49099999999999999}]},{"osd":6,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.024,"15min":1.1699999999999999},"last":0.624},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":1.4570000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.65300000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.879,"5min":1.02,"15min":1.3779999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.54200000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.004,"15min":1.006},"last":0.65600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198960726,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.44,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74099999999999999,"5min":0.752,"15min":0.82199999999999995},"last":0.60899999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":4.883},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":1.544},"last":0.55900000000000005}]},{"osd":2,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.625},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32100000000000001},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33300000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.75},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.52,"5min":1.52,"15min":8.8200000000000003},"last":0.58299999999999996}]},{"osd":5,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.49099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":1.4419999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.57799999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":3.8279999999999998},"last":0.52200000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.82999999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.33500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":14.039999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.375,"15min":0.31},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.54300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198961756,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":4.6059999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":1.847},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.56499999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":1.97},"last":0.626}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":3.2850000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.877,"15min":0.877},"last":0.48299999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":1.0289999999999999,"15min":1.3320000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.0589999999999999,"15min":4.5330000000000004},"last":0.46000000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.48599999999999999},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78700000000000003,"5min":0.96499999999999997,"15min":1.8839999999999999},"last":0.497}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.98799999999999999,"15min":3.766},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.433}]}]}],"pool_statfs":[]}} 2023-12-24T20:07:29.918 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-24T20:07:29.918 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-24T20:07:30.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.076+0000 7f740ce65700 1 Processor -- start 2023-12-24T20:07:30.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.076+0000 7f740ce65700 1 -- start start 2023-12-24T20:07:30.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740ce65700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f740806a7e0 0x7f74080c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740ce65700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740815bec0 con 0x7f74080b2ec0 2023-12-24T20:07:30.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740ce65700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740815b590 con 0x7f74080c9850 2023-12-24T20:07:30.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740ce65700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7408068ee0 con 0x7f740806a7e0 2023-12-24T20:07:30.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740659c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f74080b2ec0 0x7f74080685d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60838/0 (socket says 172.21.15.61:60838) 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740659c700 1 -- 172.21.15.61:0/662107809 learned_addr learned my addr 172.21.15.61:0/662107809 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f7405d9b700 1 --2- 172.21.15.61:0/662107809 >> v2:172.21.15.133:3300/0 conn(0x7f740806a7e0 0x7f74080c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040593058 0 0) 0x7f740815bec0 con 0x7f74080b2ec0 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73f4003570 con 0x7f74080b2ec0 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054639221 0 0) 0x7f740815b590 con 0x7f74080c9850 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f740815bec0 con 0x7f74080c9850 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1121382891 0 0) 0x7f73f4003570 con 0x7f74080b2ec0 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 >> v2:172.21.15.133:3300/0 conn(0x7f740806a7e0 msgr2=0x7f74080c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740559a700 1 --2- 172.21.15.61:0/662107809 >> v2:172.21.15.133:3300/0 conn(0x7f740806a7e0 0x7f74080c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 >> v1:172.21.15.133:6789/0 conn(0x7f74080c9850 legacy=0x7f7408070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740815b870 con 0x7f74080b2ec0 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.077+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f73f00013f0 con 0x7f74080b2ec0 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 >> v1:172.21.15.61:6789/0 conn(0x7f74080b2ec0 legacy=0x7f74080685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740559a700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73f4003c40 0x7f73f4004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740559a700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73f4004810 0x7f73f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740559a700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f73f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408068ee0 con 0x7f73f4005210 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f400c1b0 con 0x7f73f4004810 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f400c370 con 0x7f73f4003c40 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f7406d9d700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f73f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f7405d9b700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73f4004810 0x7f73f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740659c700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73f4003c40 0x7f73f4004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f7406d9d700 1 -- 172.21.15.61:0/662107809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73f4003c40 msgr2=0x7f73f4004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f7406d9d700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f73f4003c40 0x7f73f4004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f7406d9d700 1 -- 172.21.15.61:0/662107809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73f4004810 msgr2=0x7f73f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f7406d9d700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73f4004810 0x7f73f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.089 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f7406d9d700 1 -- 172.21.15.61:0/662107809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f4003570 con 0x7f73f4005210 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f7406d9d700 1 -- 172.21.15.61:0/662107809 reap_dead start 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f7406d9d700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f73f400ba60 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f74000020f0 tx=0x7f74000017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0e9f03d59c6809 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400001ab0 con 0x7f73f4005210 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740000c8b0 con 0x7f73f4005210 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.078+0000 7f740559a700 1 -- 172.21.15.61:0/662107809 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000cc50 con 0x7f73f4005210 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.079+0000 7f740ce65700 1 -- 172.21.15.61:0/662107809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 msgr2=0x7f73f400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.079+0000 7f740ce65700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f73f400ba60 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f74000020f0 tx=0x7f74000017a0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.079+0000 7f740ce65700 1 -- 172.21.15.61:0/662107809 shutdown_connections 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.079+0000 7f740ce65700 1 --2- 172.21.15.61:0/662107809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f73f400ba60 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.079+0000 7f740ce65700 1 -- 172.21.15.61:0/662107809 >> 172.21.15.61:0/662107809 conn(0x7f74080ce170 msgr2=0x7f74080ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.079+0000 7f740ce65700 1 -- 172.21.15.61:0/662107809 shutdown_connections 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.079+0000 7f740ce65700 1 -- 172.21.15.61:0/662107809 wait complete. 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.080+0000 7f740ce65700 1 Processor -- start 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.080+0000 7f740ce65700 1 -- start start 2023-12-24T20:07:30.090 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740ce65700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f7408144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740ce65700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408141bb0 0x7f74080c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740ce65700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7408154260 0x7f74081546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740ce65700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74080c4a40 con 0x7f73f4005210 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740ce65700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74081594e0 con 0x7f7408141bb0 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740ce65700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7408159aa0 con 0x7f7408154260 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f7408144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740659c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f7408144690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48524/0 (socket says 172.21.15.61:48524) 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740659c700 1 -- 172.21.15.61:0/3321823531 learned_addr learned my addr 172.21.15.61:0/3321823531 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f7405d9b700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408141bb0 0x7f74080c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f7406d9d700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7408154260 0x7f74081546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740659c700 1 -- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7408154260 msgr2=0x7f74081546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740659c700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7408154260 0x7f74081546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.091 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740659c700 1 -- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408141bb0 msgr2=0x7f74080c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740659c700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408141bb0 0x7f74080c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740659c700 1 -- 172.21.15.61:0/3321823531 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408154be0 con 0x7f73f4005210 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.081+0000 7f740659c700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f7408144690 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f73f0001100 tx=0x7f73f0001ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.082+0000 7f73fe7fc700 1 -- 172.21.15.61:0/3321823531 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0011590 con 0x7f73f4005210 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.082+0000 7f73fe7fc700 1 -- 172.21.15.61:0/3321823531 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f0011710 con 0x7f73f4005210 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.082+0000 7f73fe7fc700 1 -- 172.21.15.61:0/3321823531 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0011ad0 con 0x7f73f4005210 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.082+0000 7f740ce65700 1 -- 172.21.15.61:0/3321823531 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7408158c20 con 0x7f73f4005210 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.082+0000 7f740ce65700 1 -- 172.21.15.61:0/3321823531 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7408159730 con 0x7f73f4005210 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.083+0000 7f740ce65700 1 -- 172.21.15.61:0/3321823531 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74081598c0 con 0x7f73f4005210 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.083+0000 7f73fe7fc700 1 -- 172.21.15.61:0/3321823531 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f73f001d460 con 0x7f73f4005210 2023-12-24T20:07:30.092 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.084+0000 7f73fe7fc700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f73e8066f30 0x7f73e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.084+0000 7f73fe7fc700 1 -- 172.21.15.61:0/3321823531 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73f0084600 con 0x7f73f4005210 2023-12-24T20:07:30.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.084+0000 7f7405d9b700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f73e8066f30 0x7f73e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.084+0000 7f7405d9b700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f73e8066f30 0x7f73e80693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f740816b410 tx=0x7f73f80091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:30.093 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.088+0000 7f73fe7fc700 1 -- 172.21.15.61:0/3321823531 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73f0051870 con 0x7f73f4005210 2023-12-24T20:07:30.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.362+0000 7f740ce65700 1 -- 172.21.15.61:0/3321823531 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f740804c3c0 con 0x7f73f4005210 2023-12-24T20:07:30.367 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.365+0000 7f73fe7fc700 1 -- 172.21.15.61:0/3321823531 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7f73f0054e90 con 0x7f73f4005210 2023-12-24T20:07:30.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 -- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f73e8066f30 msgr2=0x7f73e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f73e8066f30 0x7f73e80693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f740816b410 tx=0x7f73f80091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 -- 172.21.15.61:0/3321823531 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 msgr2=0x7f7408144690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f7408144690 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f73f0001100 tx=0x7f73f0001ca0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 -- 172.21.15.61:0/3321823531 shutdown_connections 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7408154260 0x7f74081546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f73e8066f30 0x7f73e80693e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73f4005210 0x7f7408144690 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 --2- 172.21.15.61:0/3321823531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408141bb0 0x7f74080c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 -- 172.21.15.61:0/3321823531 >> 172.21.15.61:0/3321823531 conn(0x7f74080ce170 msgr2=0x7f74080b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 -- 172.21.15.61:0/3321823531 shutdown_connections 2023-12-24T20:07:30.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.368+0000 7f740ce65700 1 -- 172.21.15.61:0/3321823531 wait complete. 2023-12-24T20:07:30.371 INFO:teuthology.orchestra.run.smithi061.stderr:updated caps for client.0 2023-12-24T20:07:30.381 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:07:30.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.502+0000 7f97f497d700 1 Processor -- start 2023-12-24T20:07:30.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.502+0000 7f97f497d700 1 -- start start 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.503+0000 7f97f497d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068140 0x7f97f00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.503+0000 7f97f497d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f97f0159a60 0x7f97f0159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.503+0000 7f97f497d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f00b2890 con 0x7f97f0068510 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.503+0000 7f97f497d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f00cf630 con 0x7f97f0159a60 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.503+0000 7f97f497d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00b2240 con 0x7f97f0068140 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97eed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f97f0159a60 0x7f97f0159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97edd9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f97f0068510 0x7f97f00b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60846/0 (socket says 172.21.15.61:60846) 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97edd9b700 1 -- 172.21.15.61:0/3601727273 learned_addr learned my addr 172.21.15.61:0/3601727273 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97eed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f97f0159a60 0x7f97f0159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48530/0 (socket says 172.21.15.61:48530) 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97ee59c700 1 --2- 172.21.15.61:0/3601727273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068140 0x7f97f00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97eed9d700 1 -- 172.21.15.61:0/3601727273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068140 msgr2=0x7f97f00cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:30.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97eed9d700 1 --2- 172.21.15.61:0/3601727273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068140 0x7f97f00cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97eed9d700 1 -- 172.21.15.61:0/3601727273 >> v1:172.21.15.61:6789/0 conn(0x7f97f0068510 legacy=0x7f97f00b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97eed9d700 1 -- 172.21.15.61:0/3601727273 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00b2520 con 0x7f97f0159a60 2023-12-24T20:07:30.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97ed59a700 1 -- 172.21.15.61:0/3601727273 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023453594 0 0) 0x7f97f00b2890 con 0x7f97f0068510 2023-12-24T20:07:30.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97eed9d700 1 --2- 172.21.15.61:0/3601727273 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0159a60 0x7f97f0159f00 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f97e8009e60 tx=0x7f97e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d98957d02c2bf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:30.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97ed59a700 1 -- 172.21.15.61:0/3601727273 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800e070 con 0x7f97f0159a60 2023-12-24T20:07:30.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97ed59a700 1 -- 172.21.15.61:0/3601727273 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e800bb60 con 0x7f97f0159a60 2023-12-24T20:07:30.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.504+0000 7f97ed59a700 1 -- 172.21.15.61:0/3601727273 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8012430 con 0x7f97f0159a60 2023-12-24T20:07:30.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.505+0000 7f97f497d700 1 -- 172.21.15.61:0/3601727273 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0159a60 msgr2=0x7f97f0159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.505+0000 7f97f497d700 1 --2- 172.21.15.61:0/3601727273 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0159a60 0x7f97f0159f00 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f97e8009e60 tx=0x7f97e8009780 comp rx=0 tx=0).stop 2023-12-24T20:07:30.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.505+0000 7f97f497d700 1 -- 172.21.15.61:0/3601727273 shutdown_connections 2023-12-24T20:07:30.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.505+0000 7f97f497d700 1 --2- 172.21.15.61:0/3601727273 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068140 0x7f97f00cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.505+0000 7f97f497d700 1 --2- 172.21.15.61:0/3601727273 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0159a60 0x7f97f0159f00 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.505+0000 7f97f497d700 1 -- 172.21.15.61:0/3601727273 >> 172.21.15.61:0/3601727273 conn(0x7f97f0097a10 msgr2=0x7f97f00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:30.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.505+0000 7f97f497d700 1 -- 172.21.15.61:0/3601727273 shutdown_connections 2023-12-24T20:07:30.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.505+0000 7f97f497d700 1 -- 172.21.15.61:0/3601727273 wait complete. 2023-12-24T20:07:30.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.506+0000 7f97f497d700 1 Processor -- start 2023-12-24T20:07:30.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.506+0000 7f97f497d700 1 -- start start 2023-12-24T20:07:30.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97f497d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0068140 0x7f97f0146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97f497d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068510 0x7f97f00b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97f497d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f0159a60 0x7f97f00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97f497d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f016ac30 con 0x7f97f0068140 2023-12-24T20:07:30.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97f497d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f015c3f0 con 0x7f97f0159a60 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97f497d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f016aed0 con 0x7f97f0068510 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97ee59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0068140 0x7f97f0146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97ee59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0068140 0x7f97f0146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48542/0 (socket says 172.21.15.61:48542) 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97ee59c700 1 -- 172.21.15.61:0/2484138795 learned_addr learned my addr 172.21.15.61:0/2484138795 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97eed9d700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f0159a60 0x7f97f00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97edd9b700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068510 0x7f97f00b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97ee59c700 1 -- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068510 msgr2=0x7f97f00b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97ee59c700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068510 0x7f97f00b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97ee59c700 1 -- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f0159a60 msgr2=0x7f97f00b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97ee59c700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f0159a60 0x7f97f00b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97ee59c700 1 -- 172.21.15.61:0/2484138795 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e8009a20 con 0x7f97f0068140 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97eed9d700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f0159a60 0x7f97f00b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97edd9b700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068510 0x7f97f00b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.507+0000 7f97ee59c700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0068140 0x7f97f0146bb0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f97e000ec80 tx=0x7f97e0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.508+0000 7f97de7fc700 1 -- 172.21.15.61:0/2484138795 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e000c9d0 con 0x7f97f0068140 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.508+0000 7f97de7fc700 1 -- 172.21.15.61:0/2484138795 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e000cb30 con 0x7f97f0068140 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.508+0000 7f97f497d700 1 -- 172.21.15.61:0/2484138795 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f016b1b0 con 0x7f97f0068140 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.508+0000 7f97de7fc700 1 -- 172.21.15.61:0/2484138795 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0013470 con 0x7f97f0068140 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.508+0000 7f97f497d700 1 -- 172.21.15.61:0/2484138795 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f01470f0 con 0x7f97f0068140 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.509+0000 7f97f497d700 1 -- 172.21.15.61:0/2484138795 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f006d440 con 0x7f97f0068140 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.509+0000 7f97de7fc700 1 -- 172.21.15.61:0/2484138795 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f97e0013860 con 0x7f97f0068140 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.509+0000 7f97de7fc700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f97d0066f30 0x7f97d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:30.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.509+0000 7f97de7fc700 1 -- 172.21.15.61:0/2484138795 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97e0084d10 con 0x7f97f0068140 2023-12-24T20:07:30.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.510+0000 7f97edd9b700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f97d0066f30 0x7f97d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:30.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.510+0000 7f97edd9b700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f97d0066f30 0x7f97d00693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f97f00b2cd0 tx=0x7f97e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:30.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.514+0000 7f97de7fc700 1 -- 172.21.15.61:0/2484138795 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97e008a020 con 0x7f97f0068140 2023-12-24T20:07:30.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.753+0000 7f97f497d700 1 -- 172.21.15.61:0/2484138795 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97f004c3c0 con 0x7f97f0068140 2023-12-24T20:07:30.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.753+0000 7f97de7fc700 1 -- 172.21.15.61:0/2484138795 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f97e0017090 con 0x7f97f0068140 2023-12-24T20:07:30.755 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:30.755 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1018177900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1018177900},{"type":"v1","addr":"172.21.15.133:6836","nonce":1018177900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2332940307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2332940307},{"type":"v1","addr":"172.21.15.61:6834","nonce":2332940307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/784121250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":784121250},{"type":"v1","addr":"172.21.15.61:6835","nonce":784121250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:07:20.139140+0000","modified":"2023-12-24T20:07:23.769968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8145":{"gid":8145,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2891152875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2891152875},{"type":"v1","addr":"172.21.15.133:6837","nonce":2891152875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:07:30.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 -- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f97d0066f30 msgr2=0x7f97d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f97d0066f30 0x7f97d00693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f97f00b2cd0 tx=0x7f97e4009040 comp rx=0 tx=0).stop 2023-12-24T20:07:30.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 -- 172.21.15.61:0/2484138795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0068140 msgr2=0x7f97f0146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:30.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0068140 0x7f97f0146bb0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f97e000ec80 tx=0x7f97e0009120 comp rx=0 tx=0).stop 2023-12-24T20:07:30.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 -- 172.21.15.61:0/2484138795 shutdown_connections 2023-12-24T20:07:30.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f97d0066f30 0x7f97d00693e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97f0159a60 0x7f97f00b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97f0068140 0x7f97f0146bb0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 --2- 172.21.15.61:0/2484138795 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97f0068510 0x7f97f00b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:30.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 -- 172.21.15.61:0/2484138795 >> 172.21.15.61:0/2484138795 conn(0x7f97f0097a10 msgr2=0x7f97f0158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:30.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 -- 172.21.15.61:0/2484138795 shutdown_connections 2023-12-24T20:07:30.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:30.755+0000 7f97f497d700 1 -- 172.21.15.61:0/2484138795 wait complete. 2023-12-24T20:07:30.758 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 92 2023-12-24T20:07:31.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-24T20:07:20.139140+0000', 'modified': '2023-12-24T20:07:23.769968+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8145}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8145': {'gid': 8145, 'name': 'd', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2891152875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 2891152875}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2891152875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-12-24T20:07:31.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-24T20:07:31.171 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-24T20:07:31.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.295+0000 7ff0bef57700 1 Processor -- start 2023-12-24T20:07:31.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.295+0000 7ff0bef57700 1 -- start start 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.296+0000 7ff0bef57700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b815df60 0x7ff0b80d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.296+0000 7ff0bef57700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b80d0bb0 con 0x7ff0b81437b0 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.296+0000 7ff0bef57700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b80d0e90 con 0x7ff0b81433e0 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.296+0000 7ff0bef57700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b815b550 con 0x7ff0b815df60 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.296+0000 7ff0b7fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff0b81437b0 0x7ff0b80cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60856/0 (socket says 172.21.15.61:60856) 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.296+0000 7ff0b7fff700 1 -- 172.21.15.61:0/4159866980 learned_addr learned my addr 172.21.15.61:0/4159866980 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b815df60 0x7ff0b80d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956964525 0 0) 0x7ff0b80d0bb0 con 0x7ff0b81437b0 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a8003570 con 0x7ff0b81437b0 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 355499262 0 0) 0x7ff0a8003570 con 0x7ff0b81437b0 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b815df60 msgr2=0x7ff0b80d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b815df60 0x7ff0b80d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 >> v1:172.21.15.133:6789/0 conn(0x7ff0b81433e0 legacy=0x7ff0b815d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b80d1170 con 0x7ff0b81437b0 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7ff0a4001470 con 0x7ff0b81437b0 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 >> v1:172.21.15.61:6789/0 conn(0x7ff0b81437b0 legacy=0x7ff0b80cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0a8003a90 0x7ff0a8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b815df60 0x7ff0a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0a8004d50 0x7ff0a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b815b550 con 0x7ff0a8004d50 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a800bb10 con 0x7ff0a8003a90 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a800bcd0 con 0x7ff0b815df60 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0a8004d50 0x7ff0a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b815df60 0x7ff0a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0a8003a90 0x7ff0a8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b815df60 msgr2=0x7ff0a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b815df60 0x7ff0a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0a8003a90 msgr2=0x7ff0a8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0a8003a90 0x7ff0a8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.297+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/4159866980 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8003570 con 0x7ff0a8004d50 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0a8004d50 0x7ff0a80051c0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7ff0b815e360 tx=0x7ff0b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7dbf5dc3468b79e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000ea90 con 0x7ff0a8004d50 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b000f040 con 0x7ff0a8004d50 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0b77fe700 1 -- 172.21.15.61:0/4159866980 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b000ee40 con 0x7ff0a8004d50 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0bef57700 1 -- 172.21.15.61:0/4159866980 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0a8004d50 msgr2=0x7ff0a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0bef57700 1 --2- 172.21.15.61:0/4159866980 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0a8004d50 0x7ff0a80051c0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7ff0b815e360 tx=0x7ff0b000b040 comp rx=0 tx=0).stop 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/4159866980 reap_dead start 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0bef57700 1 -- 172.21.15.61:0/4159866980 shutdown_connections 2023-12-24T20:07:31.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0bef57700 1 -- 172.21.15.61:0/4159866980 >> 172.21.15.61:0/4159866980 conn(0x7ff0b806e640 msgr2=0x7ff0b8067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:31.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0bef57700 1 -- 172.21.15.61:0/4159866980 shutdown_connections 2023-12-24T20:07:31.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.298+0000 7ff0bef57700 1 -- 172.21.15.61:0/4159866980 wait complete. 2023-12-24T20:07:31.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.299+0000 7ff0bef57700 1 Processor -- start 2023-12-24T20:07:31.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.300+0000 7ff0bef57700 1 -- start start 2023-12-24T20:07:31.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.300+0000 7ff0bef57700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b8140280 0x7ff0b80cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.300+0000 7ff0bef57700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b8169b50 0x7ff0b8169fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.300+0000 7ff0bef57700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0b80c8450 0x7ff0b80c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.300+0000 7ff0bef57700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b80cd850 con 0x7ff0b80c8450 2023-12-24T20:07:31.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.300+0000 7ff0bef57700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b80cbf50 con 0x7ff0b8169b50 2023-12-24T20:07:31.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.300+0000 7ff0bef57700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b8140650 con 0x7ff0b8140280 2023-12-24T20:07:31.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.300+0000 7ff0bd4f4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0b80c8450 0x7ff0b80c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bd4f4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0b80c8450 0x7ff0b80c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48560/0 (socket says 172.21.15.61:48560) 2023-12-24T20:07:31.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/3482562823 learned_addr learned my addr 172.21.15.61:0/3482562823 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b8169b50 0x7ff0b8169fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b8140280 0x7ff0b80cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b8140280 msgr2=0x7ff0b80cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b8140280 0x7ff0b80cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b8169b50 msgr2=0x7ff0b8169fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b8169b50 0x7ff0b8169fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/3482562823 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b80cc960 con 0x7ff0b80c8450 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b8140280 0x7ff0b80cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0b80c8450 0x7ff0b80c88c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000afd0 tx=0x7ff0b001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0b4ff9700 1 -- 172.21.15.61:0/3482562823 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b001e640 con 0x7ff0b80c8450 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0b4ff9700 1 -- 172.21.15.61:0/3482562823 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b0022070 con 0x7ff0b80c8450 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bef57700 1 -- 172.21.15.61:0/3482562823 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b80ccc40 con 0x7ff0b80c8450 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0b4ff9700 1 -- 172.21.15.61:0/3482562823 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b001e9f0 con 0x7ff0b80c8450 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.301+0000 7ff0bef57700 1 -- 172.21.15.61:0/3482562823 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b80cd200 con 0x7ff0b80c8450 2023-12-24T20:07:31.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.303+0000 7ff0b4ff9700 1 -- 172.21.15.61:0/3482562823 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff0b0003040 con 0x7ff0b80c8450 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.303+0000 7ff0b4ff9700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff09c066f30 0x7ff09c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.303+0000 7ff0b4ff9700 1 -- 172.21.15.61:0/3482562823 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0b0024070 con 0x7ff0b80c8450 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.303+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff09c066f30 0x7ff09c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.304+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff09c066f30 0x7ff09c0693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac000c00 tx=0x7ff0ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.305+0000 7ff0c8257b80 1 Processor -- start 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.305+0000 7ff0c8257b80 1 -- start start 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103dd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 0x562a103d8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103f9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a1030b3e0 con 0x562a103dcfa0 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a10308be0 con 0x562a103dd8b0 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a103049d0 con 0x562a103d9170 2023-12-24T20:07:31.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bccf3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103dd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bccf3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103dd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48574/0 (socket says 172.21.15.61:48574) 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bccf3700 1 -- 172.21.15.61:0/3447183117 learned_addr learned my addr 172.21.15.61:0/3447183117 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 0x562a103d8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bccf3700 1 -- 172.21.15.61:0/3447183117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 msgr2=0x562a103f9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103f9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bccf3700 1 -- 172.21.15.61:0/3447183117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 msgr2=0x562a103d8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 0x562a103d8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bccf3700 1 -- 172.21.15.61:0/3447183117 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a10198360 con 0x562a103dcfa0 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 0x562a103d8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103dd370 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac011cd0 tx=0x7ff0ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162baae6c113f42b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0a1ffb700 1 -- 172.21.15.61:0/3447183117 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac015c50 con 0x562a103dcfa0 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0a1ffb700 1 -- 172.21.15.61:0/3447183117 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac015db0 con 0x562a103dcfa0 2023-12-24T20:07:31.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.306+0000 7ff0a1ffb700 1 -- 172.21.15.61:0/3447183117 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac021660 con 0x562a103dcfa0 2023-12-24T20:07:31.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.307+0000 7ff0c8257b80 1 -- 172.21.15.61:0/3447183117 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 msgr2=0x562a103dd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.307+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103dd370 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac011cd0 tx=0x7ff0ac017000 comp rx=0 tx=0).stop 2023-12-24T20:07:31.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.307+0000 7ff0c8257b80 1 -- 172.21.15.61:0/3447183117 shutdown_connections 2023-12-24T20:07:31.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.307+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.307+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103dd370 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.307+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/3447183117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 0x562a103d8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.307+0000 7ff0c8257b80 1 -- 172.21.15.61:0/3447183117 >> 172.21.15.61:0/3447183117 conn(0x562a103b3440 msgr2=0x562a103fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:31.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.307+0000 7ff0c8257b80 1 -- 172.21.15.61:0/3447183117 shutdown_connections 2023-12-24T20:07:31.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.307+0000 7ff0c8257b80 1 -- 172.21.15.61:0/3447183117 wait complete. 2023-12-24T20:07:31.313 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.308+0000 7ff0c8257b80 1 -- start start 2023-12-24T20:07:31.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.308+0000 7ff0c8257b80 1 Processor -- start 2023-12-24T20:07:31.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103da7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 0x562a103d8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dd8b0 0x562a103dbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a102b11b0 con 0x562a103dd8b0 2023-12-24T20:07:31.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a102b0e50 con 0x562a103dcfa0 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a101fde40 con 0x562a103d9170 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0c8257b80 10 client.0 _ll_register_callbacks cb 0x562a102007b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bd4f4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dd8b0 0x562a103dbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bd4f4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dd8b0 0x562a103dbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48584/0 (socket says 172.21.15.61:48584) 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/445794876 learned_addr learned my addr 172.21.15.61:0/445794876 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 0x562a103d8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103da7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 msgr2=0x562a103da7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103da7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 msgr2=0x562a103d8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 0x562a103d8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bd4f4700 1 -- 172.21.15.61:0/445794876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ac0118a0 con 0x562a103dd8b0 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103da7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:31.319 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dd8b0 0x562a103dbcd0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00577d0 tx=0x7ff0b0020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107a53e1dc4937e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff096ffd700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff096ffd700 1 -- 172.21.15.61:0/445794876 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b006c070 con 0x562a103dd8b0 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff096ffd700 1 -- 172.21.15.61:0/445794876 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0b0057f40 con 0x562a103dd8b0 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.309+0000 7ff0c8257b80 1 -- 172.21.15.61:0/445794876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a10385eb0 con 0x562a103dd8b0 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff096ffd700 1 -- 172.21.15.61:0/445794876 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0b00098a0 con 0x562a103dd8b0 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff0c8257b80 10 client.8310 fetch_fsmap learned FSMap version 92 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff0c8257b80 1 -- 172.21.15.61:0/445794876 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x562a10144b10 con 0x562a103dd8b0 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff096ffd700 1 -- 172.21.15.61:0/445794876 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a10385eb0 con 0x562a103dd8b0 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff096ffd700 1 -- 172.21.15.61:0/445794876 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 92) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff0b00732a0 con 0x562a103dd8b0 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff0c8257b80 10 client.8310 fetch_fsmap finished waiting for FSMap version 92 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff0c8257b80 10 client.8310 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff0c8257b80 20 client.8310 populate_metadata read hostname 'smithi061' 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:6835/2891152875,v1:172.21.15.133:6837/2891152875] conn(0x562a1040e110 0x562a1040e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff0c8257b80 4 client.8310 mds_command: new command op to 8145 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-24T20:07:31.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff0c8257b80 1 -- 172.21.15.61:0/445794876 --> [v2:172.21.15.133:6835/2891152875,v1:172.21.15.133:6837/2891152875] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a102db880 con 0x562a1040e110 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:6835/2891152875,v1:172.21.15.133:6837/2891152875] conn(0x562a1040e110 0x562a1040e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff096ffd700 10 client.8310 ms_handle_connect on v2:172.21.15.133:6835/2891152875 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.310+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:6835/2891152875,v1:172.21.15.133:6837/2891152875] conn(0x562a1040e110 0x562a1040e4e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae1478c24bb92f7a server_cookie=6eb51933ac405d30 in_seq=0 out_seq=0 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff096ffd700 1 -- 172.21.15.61:0/445794876 <== mds.0 v2:172.21.15.133:6835/2891152875 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562a102db880 con 0x562a1040e110 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff096ffd700 10 client.8310 handle_command_reply: tid=0 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff0c8257b80 1 client.8310 shutdown 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff0c8257b80 1 -- 172.21.15.61:0/445794876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dd8b0 msgr2=0x562a103dbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dd8b0 0x562a103dbcd0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00577d0 tx=0x7ff0b0020040 comp rx=0 tx=0).stop 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff0c8257b80 1 -- 172.21.15.61:0/445794876 shutdown_connections 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:6835/2891152875,v1:172.21.15.133:6837/2891152875] conn(0x562a1040e110 0x562a1040e4e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103da7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dd8b0 0x562a103dbcd0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/445794876 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 0x562a103d8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff096ffd700 0 client.8310 ms_handle_reset on v2:172.21.15.133:6835/2891152875 2023-12-24T20:07:31.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.311+0000 7ff0c8257b80 1 -- 172.21.15.61:0/445794876 >> 172.21.15.61:0/445794876 conn(0x562a103b3440 msgr2=0x562a103d88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:31.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.312+0000 7ff0c8257b80 1 -- 172.21.15.61:0/445794876 shutdown_connections 2023-12-24T20:07:31.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.312+0000 7ff0c8257b80 1 -- 172.21.15.61:0/445794876 wait complete. 2023-12-24T20:07:31.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.312+0000 7ff0c8257b80 20 client.8310 trim_cache size 0 max 16384 2023-12-24T20:07:31.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.328+0000 7ff0c8257b80 1 Processor -- start 2023-12-24T20:07:31.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.329+0000 7ff0c8257b80 1 -- start start 2023-12-24T20:07:31.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.329+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.329+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103d7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.329+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 0x562a103b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.329+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a103de110 con 0x562a103dcfa0 2023-12-24T20:07:31.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.329+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a103ff670 con 0x562a103dd8b0 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.329+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a103b4870 con 0x562a103d9170 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.329+0000 7ff0b7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103d7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.329+0000 7ff0b7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103d7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48600/0 (socket says 172.21.15.61:48600) 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.329+0000 7ff0b7fff700 1 -- 172.21.15.61:0/2913752338 learned_addr learned my addr 172.21.15.61:0/2913752338 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0b7fff700 1 -- 172.21.15.61:0/2913752338 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 msgr2=0x562a103aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/2913752338 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/2913752338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 0x562a103b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/2913752338 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103aa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0b7fff700 1 -- 172.21.15.61:0/2913752338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 msgr2=0x562a103b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/2913752338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 0x562a103b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0b7fff700 1 -- 172.21.15.61:0/2913752338 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a102d3290 con 0x562a103dcfa0 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/2913752338 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103d7640 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80c5e50 tx=0x7ff0a4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120a2311e6e0ad5c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0a27fc700 1 -- 172.21.15.61:0/2913752338 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40073a0 con 0x562a103dcfa0 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0a27fc700 1 -- 172.21.15.61:0/2913752338 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a4007520 con 0x562a103dcfa0 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0a27fc700 1 -- 172.21.15.61:0/2913752338 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40076d0 con 0x562a103dcfa0 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0c8257b80 1 -- 172.21.15.61:0/2913752338 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 msgr2=0x562a103d7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/2913752338 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103d7640 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80c5e50 tx=0x7ff0a4009040 comp rx=0 tx=0).stop 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0c8257b80 1 -- 172.21.15.61:0/2913752338 shutdown_connections 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/2913752338 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103d9170 0x562a103aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/2913752338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dd8b0 0x562a103b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/2913752338 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103dcfa0 0x562a103d7640 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.330+0000 7ff0c8257b80 1 -- 172.21.15.61:0/2913752338 >> 172.21.15.61:0/2913752338 conn(0x562a103b3440 msgr2=0x562a103d8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.331+0000 7ff0c8257b80 1 -- 172.21.15.61:0/2913752338 shutdown_connections 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.331+0000 7ff0c8257b80 1 -- 172.21.15.61:0/2913752338 wait complete. 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.331+0000 7ff0c8257b80 1 -- start start 2023-12-24T20:07:31.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.331+0000 7ff0c8257b80 1 Processor -- start 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103d9170 0x562a103db700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 0x562a103dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0c8257b80 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103dd8b0 0x562a104604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a103b65e0 con 0x562a103d9170 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a103abc50 con 0x562a103dcfa0 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0c8257b80 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a103ab080 con 0x562a103dd8b0 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0c8257b80 10 client.0 _ll_register_callbacks cb 0x7ff0b0057380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0bccf3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103d9170 0x562a103db700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0bccf3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103d9170 0x562a103db700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48610/0 (socket says 172.21.15.61:48610) 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0bccf3700 1 -- 172.21.15.61:0/276166546 learned_addr learned my addr 172.21.15.61:0/276166546 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:31.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 0x562a103dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0bd4f4700 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103dd8b0 0x562a104604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0bccf3700 1 -- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103dd8b0 msgr2=0x562a104604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103dd8b0 0x562a104604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0bccf3700 1 -- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 msgr2=0x562a103dbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 0x562a103dbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0bccf3700 1 -- 172.21.15.61:0/276166546 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b80d1170 con 0x562a103d9170 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 0x562a103dbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0bccf3700 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103d9170 0x562a103db700 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009010 tx=0x7ff0ac034250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4c8ecf3935d83d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff096ffd700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff096ffd700 1 -- 172.21.15.61:0/276166546 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac033070 con 0x562a103d9170 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff096ffd700 1 -- 172.21.15.61:0/276166546 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0ac01a030 con 0x562a103d9170 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.333+0000 7ff0c8257b80 1 -- 172.21.15.61:0/276166546 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a103a9490 con 0x562a103d9170 2023-12-24T20:07:31.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff096ffd700 1 -- 172.21.15.61:0/276166546 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0ac015d60 con 0x562a103d9170 2023-12-24T20:07:31.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff0c8257b80 10 client.8316 fetch_fsmap learned FSMap version 92 2023-12-24T20:07:31.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff0c8257b80 1 -- 172.21.15.61:0/276166546 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x562a1019cc80 con 0x562a103d9170 2023-12-24T20:07:31.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff096ffd700 1 -- 172.21.15.61:0/276166546 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a103a9490 con 0x562a103d9170 2023-12-24T20:07:31.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff096ffd700 1 -- 172.21.15.61:0/276166546 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 92) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff0ac021a90 con 0x562a103d9170 2023-12-24T20:07:31.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff0c8257b80 10 client.8316 fetch_fsmap finished waiting for FSMap version 92 2023-12-24T20:07:31.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff0c8257b80 10 client.8316 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-24T20:07:31.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff0c8257b80 20 client.8316 populate_metadata read hostname 'smithi061' 2023-12-24T20:07:31.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:6835/2891152875,v1:172.21.15.133:6837/2891152875] conn(0x562a104609f0 0x562a103f1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff0c8257b80 4 client.8316 mds_command: new command op to 8145 tid=0[{"prefix": "status"}] 2023-12-24T20:07:31.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff0c8257b80 1 -- 172.21.15.61:0/276166546 --> [v2:172.21.15.133:6835/2891152875,v1:172.21.15.133:6837/2891152875] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562a102a7910 con 0x562a104609f0 2023-12-24T20:07:31.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:6835/2891152875,v1:172.21.15.133:6837/2891152875] conn(0x562a104609f0 0x562a103f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff096ffd700 10 client.8316 ms_handle_connect on v2:172.21.15.133:6835/2891152875 2023-12-24T20:07:31.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.334+0000 7ff0b7fff700 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:6835/2891152875,v1:172.21.15.133:6837/2891152875] conn(0x562a104609f0 0x562a103f1160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a0325d5c145de9b server_cookie=1db356175ae54969 in_seq=0 out_seq=0 2023-12-24T20:07:31.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff096ffd700 1 -- 172.21.15.61:0/276166546 <== mds.0 v2:172.21.15.133:6835/2891152875 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562a102a7910 con 0x562a104609f0 2023-12-24T20:07:31.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff096ffd700 10 client.8316 handle_command_reply: tid=0 2023-12-24T20:07:31.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 client.8316 shutdown 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 -- 172.21.15.61:0/276166546 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103d9170 msgr2=0x562a103db700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103d9170 0x562a103db700 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009010 tx=0x7ff0ac034250 comp rx=0 tx=0).stop 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 -- 172.21.15.61:0/276166546 shutdown_connections 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:6835/2891152875,v1:172.21.15.133:6837/2891152875] conn(0x562a104609f0 0x562a103f1160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x562a103dd8b0 0x562a104604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562a103d9170 0x562a103db700 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff096ffd700 0 client.8316 ms_handle_reset on v2:172.21.15.133:6835/2891152875 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 --2- 172.21.15.61:0/276166546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x562a103dcfa0 0x562a103dbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 -- 172.21.15.61:0/276166546 >> 172.21.15.61:0/276166546 conn(0x562a103b3440 msgr2=0x562a103d7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 -- 172.21.15.61:0/276166546 shutdown_connections 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 1 -- 172.21.15.61:0/276166546 wait complete. 2023-12-24T20:07:31.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.335+0000 7ff0c8257b80 20 client.8316 trim_cache size 0 max 16384 2023-12-24T20:07:31.348 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:07:31.348 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:07:31.348 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-12-24T20:07:31.348 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 8145, 2023-12-24T20:07:31.348 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-12-24T20:07:31.348 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-12-24T20:07:31.348 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-12-24T20:07:31.348 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 10.596490337000001, 2023-12-24T20:07:31.348 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 92, 2023-12-24T20:07:31.349 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 185, 2023-12-24T20:07:31.349 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 185, 2023-12-24T20:07:31.349 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 16.626563499 2023-12-24T20:07:31.349 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:07:31.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 -- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff09c066f30 msgr2=0x7ff09c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff09c066f30 0x7ff09c0693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac000c00 tx=0x7ff0ac009040 comp rx=0 tx=0).stop 2023-12-24T20:07:31.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 -- 172.21.15.61:0/3482562823 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0b80c8450 msgr2=0x7ff0b80c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0b80c8450 0x7ff0b80c88c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000afd0 tx=0x7ff0b001a000 comp rx=0 tx=0).stop 2023-12-24T20:07:31.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 -- 172.21.15.61:0/3482562823 shutdown_connections 2023-12-24T20:07:31.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff0b8140280 0x7ff0b80cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff09c066f30 0x7ff09c0693e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff0b80c8450 0x7ff0b80c88c0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 --2- 172.21.15.61:0/3482562823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0b8169b50 0x7ff0b8169fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 -- 172.21.15.61:0/3482562823 >> 172.21.15.61:0/3482562823 conn(0x7ff0b806e640 msgr2=0x7ff0b80b5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:31.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 -- 172.21.15.61:0/3482562823 shutdown_connections 2023-12-24T20:07:31.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.336+0000 7ff0bef57700 1 -- 172.21.15.61:0/3482562823 wait complete. 2023-12-24T20:07:31.352 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:07:31.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.473+0000 7f978eed2700 1 Processor -- start 2023-12-24T20:07:31.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.473+0000 7f978eed2700 1 -- start start 2023-12-24T20:07:31.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.474+0000 7f978eed2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9788159a90 0x7f9788070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.474+0000 7f978eed2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9788159e60 0x7f9788070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.474+0000 7f978eed2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97880b04c0 0x7f97880c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.474+0000 7f978eed2700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978806a090 con 0x7f9788159e60 2023-12-24T20:07:31.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.474+0000 7f978eed2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978806ac10 con 0x7f9788159a90 2023-12-24T20:07:31.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.474+0000 7f978eed2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978806a2e0 con 0x7f97880b04c0 2023-12-24T20:07:31.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.474+0000 7f9787fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9788159e60 0x7f9788070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.474+0000 7f9787fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9788159e60 0x7f9788070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48612/0 (socket says 172.21.15.61:48612) 2023-12-24T20:07:31.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.474+0000 7f9787fff700 1 -- 172.21.15.61:0/2348762249 learned_addr learned my addr 172.21.15.61:0/2348762249 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:31.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f978d46f700 1 --2- 172.21.15.61:0/2348762249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97880b04c0 0x7f97880c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f978cc6e700 1 --2- 172.21.15.61:0/2348762249 >> v2:172.21.15.133:3300/0 conn(0x7f9788159a90 0x7f9788070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f9787fff700 1 -- 172.21.15.61:0/2348762249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97880b04c0 msgr2=0x7f97880c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f9787fff700 1 --2- 172.21.15.61:0/2348762249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97880b04c0 0x7f97880c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f9787fff700 1 -- 172.21.15.61:0/2348762249 >> v2:172.21.15.133:3300/0 conn(0x7f9788159a90 msgr2=0x7f9788070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:31.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f9787fff700 1 --2- 172.21.15.61:0/2348762249 >> v2:172.21.15.133:3300/0 conn(0x7f9788159a90 0x7f9788070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f9787fff700 1 -- 172.21.15.61:0/2348762249 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978806a5c0 con 0x7f9788159e60 2023-12-24T20:07:31.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f978cc6e700 1 --2- 172.21.15.61:0/2348762249 >> v2:172.21.15.133:3300/0 conn(0x7f9788159a90 0x7f9788070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f9787fff700 1 --2- 172.21.15.61:0/2348762249 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159e60 0x7f9788070b80 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f978806d110 tx=0x7f9774009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a154acb6f7bf6c server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f97877fe700 1 -- 172.21.15.61:0/2348762249 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400b860 con 0x7f9788159e60 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f97877fe700 1 -- 172.21.15.61:0/2348762249 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400b9c0 con 0x7f9788159e60 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f97877fe700 1 -- 172.21.15.61:0/2348762249 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400bd60 con 0x7f9788159e60 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f978eed2700 1 -- 172.21.15.61:0/2348762249 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159e60 msgr2=0x7f9788070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f978eed2700 1 --2- 172.21.15.61:0/2348762249 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159e60 0x7f9788070b80 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f978806d110 tx=0x7f9774009250 comp rx=0 tx=0).stop 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f978eed2700 1 -- 172.21.15.61:0/2348762249 shutdown_connections 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f978eed2700 1 --2- 172.21.15.61:0/2348762249 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f97880b04c0 0x7f97880c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f978eed2700 1 --2- 172.21.15.61:0/2348762249 >> v2:172.21.15.133:3300/0 conn(0x7f9788159a90 0x7f9788070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f978eed2700 1 --2- 172.21.15.61:0/2348762249 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159e60 0x7f9788070b80 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.475+0000 7f978eed2700 1 -- 172.21.15.61:0/2348762249 >> 172.21.15.61:0/2348762249 conn(0x7f97880cd6f0 msgr2=0x7f97880cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:31.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.476+0000 7f978eed2700 1 -- 172.21.15.61:0/2348762249 shutdown_connections 2023-12-24T20:07:31.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.476+0000 7f978eed2700 1 -- 172.21.15.61:0/2348762249 wait complete. 2023-12-24T20:07:31.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.477+0000 7f978eed2700 1 Processor -- start 2023-12-24T20:07:31.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.477+0000 7f978eed2700 1 -- start start 2023-12-24T20:07:31.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.477+0000 7f978eed2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97880b04c0 0x7f97881587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.477+0000 7f978eed2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159a90 0x7f9788169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f978eed2700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9788159e60 0x7f978815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f978eed2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880c1120 con 0x7f9788159a90 2023-12-24T20:07:31.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f978eed2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788158d20 con 0x7f97880b04c0 2023-12-24T20:07:31.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f978eed2700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978815eb70 con 0x7f9788159e60 2023-12-24T20:07:31.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9787fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159a90 0x7f9788169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9787fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159a90 0x7f9788169f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48616/0 (socket says 172.21.15.61:48616) 2023-12-24T20:07:31.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9787fff700 1 -- 172.21.15.61:0/3014992355 learned_addr learned my addr 172.21.15.61:0/3014992355 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:31.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f978cc6e700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97880b04c0 0x7f97881587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f978d46f700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9788159e60 0x7f978815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9787fff700 1 -- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9788159e60 msgr2=0x7f978815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9787fff700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9788159e60 0x7f978815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9787fff700 1 -- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97880b04c0 msgr2=0x7f97881587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9787fff700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97880b04c0 0x7f97881587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9787fff700 1 -- 172.21.15.61:0/3014992355 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740094f0 con 0x7f9788159a90 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9787fff700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159a90 0x7f9788169f60 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f97880cd230 tx=0x7f9774017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9784ff9700 1 -- 172.21.15.61:0/3014992355 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774011dc0 con 0x7f9788159a90 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9784ff9700 1 -- 172.21.15.61:0/3014992355 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9774024440 con 0x7f9788159a90 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f978eed2700 1 -- 172.21.15.61:0/3014992355 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978815ee50 con 0x7f9788159a90 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f9784ff9700 1 -- 172.21.15.61:0/3014992355 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774024800 con 0x7f9788159a90 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.478+0000 7f978eed2700 1 -- 172.21.15.61:0/3014992355 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978815f410 con 0x7f9788159a90 2023-12-24T20:07:31.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.479+0000 7f978eed2700 1 -- 172.21.15.61:0/3014992355 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978804c3c0 con 0x7f9788159a90 2023-12-24T20:07:31.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.480+0000 7f9784ff9700 1 -- 172.21.15.61:0/3014992355 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f977401a420 con 0x7f9788159a90 2023-12-24T20:07:31.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.480+0000 7f9784ff9700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f976c066f30 0x7f976c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:31.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.480+0000 7f9784ff9700 1 -- 172.21.15.61:0/3014992355 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97740863a0 con 0x7f9788159a90 2023-12-24T20:07:31.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.481+0000 7f978cc6e700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f976c066f30 0x7f976c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:31.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.481+0000 7f978cc6e700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f976c066f30 0x7f976c0693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f977c00adc0 tx=0x7f977c006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:31.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.485+0000 7f9784ff9700 1 -- 172.21.15.61:0/3014992355 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9774053610 con 0x7f9788159a90 2023-12-24T20:07:31.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.727+0000 7f978eed2700 1 -- 172.21.15.61:0/3014992355 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f978806a8a0 con 0x7f9788159a90 2023-12-24T20:07:31.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.728+0000 7f9784ff9700 1 -- 172.21.15.61:0/3014992355 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9774056c30 con 0x7f9788159a90 2023-12-24T20:07:31.730 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.729+0000 7f978eed2700 1 -- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f976c066f30 msgr2=0x7f976c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.729+0000 7f978eed2700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f976c066f30 0x7f976c0693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f977c00adc0 tx=0x7f977c006f90 comp rx=0 tx=0).stop 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.729+0000 7f978eed2700 1 -- 172.21.15.61:0/3014992355 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159a90 msgr2=0x7f9788169f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.729+0000 7f978eed2700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159a90 0x7f9788169f60 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f97880cd230 tx=0x7f9774017000 comp rx=0 tx=0).stop 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.729+0000 7f978eed2700 1 -- 172.21.15.61:0/3014992355 shutdown_connections 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.729+0000 7f978eed2700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9788159e60 0x7f978815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.729+0000 7f978eed2700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f976c066f30 0x7f976c0693e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.729+0000 7f978eed2700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97880b04c0 0x7f97881587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.729+0000 7f978eed2700 1 --2- 172.21.15.61:0/3014992355 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9788159a90 0x7f9788169f60 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.730+0000 7f978eed2700 1 -- 172.21.15.61:0/3014992355 >> 172.21.15.61:0/3014992355 conn(0x7f97880cd6f0 msgr2=0x7f97880b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.730+0000 7f978eed2700 1 -- 172.21.15.61:0/3014992355 shutdown_connections 2023-12-24T20:07:31.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:31.730+0000 7f978eed2700 1 -- 172.21.15.61:0/3014992355 wait complete. 2023-12-24T20:07:31.743 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:07:31.743 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:07:31.743 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-12-24T20:07:31.743 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-24T20:07:31.743 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-24T20:07:31.744 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:07:31.744 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:07:31.744 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:07:31.744 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:07:31.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:31.744 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-12-24T20:07:31.763 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:07:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:07:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:07:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-12-24T20:07:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:31.763 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:07:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f0 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: altname enp7s0f1 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 41914sec preferred_lft 41914sec 2023-12-24T20:07:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::58b9:28e2:3d0f:428c/64 scope link noprefixroute 2023-12-24T20:07:31.765 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:31.765 INFO:teuthology.orchestra.run.smithi061.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:07:31.765 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:07:31.765 INFO:teuthology.orchestra.run.smithi061.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:07:31.765 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:31.765 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1836:c4ff:fef5:d9ce/64 scope link 2023-12-24T20:07:31.765 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:31.765 INFO:teuthology.orchestra.run.smithi061.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:07:31.765 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0e:4c:cb:6b:f2:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:07:31.766 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::c4c:cbff:fe6b:f205/64 scope link 2023-12-24T20:07:31.766 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:31.766 INFO:teuthology.orchestra.run.smithi061.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:07:31.766 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 12:83:d1:9f:62:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:07:31.766 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::1083:d1ff:fe9f:62aa/64 scope link 2023-12-24T20:07:31.766 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:31.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:31.767 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:07:31.829 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-12-24T20:07:31.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:31.831 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-12-24T20:07:31.890 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-12-24T20:07:31.890 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:07:31.890 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:07:31.890 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:07:31.890 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:07:31.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:31.891 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-12-24T20:07:31.891 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-12-24T20:07:31.891 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:07:31.891 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:07:31.891 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:07:31.891 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-12-24T20:07:31.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:31.999 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T20:07:32.016 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:07:32.017 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:07:32.017 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:07:32.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:32.017 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-12-24T20:07:32.085 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-24T20:07:32.085 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:07:32.085 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-24T20:07:32.143 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-24T20:07:32.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:07:32.143 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:07:32.201 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:07:32.269 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:07:32.269 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:07:32.335 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:07:32.336 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:07:32.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:32.337 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:07:32.394 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:07:32.394 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-24T20:07:32.436 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-12-24T20:07:32.464 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:07:32.464 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:07:32.522 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-12-24T20:07:32.521+0000 7feec80d2540 -1 init, newargv = 0x5584bdcfc060 newargc=15 2023-12-24T20:07:32.523 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[76110]: starting ceph client 2023-12-24T20:07:32.527 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[76110]: starting fuse 2023-12-24T20:07:32.534 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:07:32.535 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:07:32.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:32.535 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-12-24T20:07:32.593 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-12-24T20:07:32.593 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-12-24T20:07:32.594 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-12-24T20:07:32.595 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-12-24T20:07:32.720 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.76110.asok 2023-12-24T20:07:32.902 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76110.asok 2023-12-24T20:07:32.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:32.902 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76110.asok status 2023-12-24T20:07:33.059 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:07:33.059 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-12-24T20:07:33.059 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:07:33.059 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "76110", 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 8328, 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 8328 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:07:33.060 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2684967925 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 2684967925 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.8328 192.168.0.1:0/2684967925", 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/2684967925", 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 92, 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 185, 2023-12-24T20:07:33.061 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:07:33.062 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-12-24T20:07:33.062 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-12-24T20:07:33.062 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:07:33.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:33.071 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-12-24T20:07:33.071 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-24T20:07:33.089 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-12-24T20:07:33.089 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-24T20:07:33.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:33.090 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-24T20:07:33.159 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-24T20:07:33.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.320+0000 7fbe26cda700 1 Processor -- start 2023-12-24T20:07:33.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.320+0000 7fbe26cda700 1 -- start start 2023-12-24T20:07:33.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe26cda700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbe20159c10 0x7fbe200c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe26cda700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbe20159fe0 0x7fbe200c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe26cda700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe200cba80 0x7fbe200cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe26cda700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe200cc440 con 0x7fbe20159fe0 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe26cda700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe200af880 con 0x7fbe20159c10 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe26cda700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200c6fc0 con 0x7fbe200cba80 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe1ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbe20159fe0 0x7fbe200c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe1ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbe20159fe0 0x7fbe200c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48630/0 (socket says 172.21.15.61:48630) 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe1ffff700 1 -- 172.21.15.61:0/3246829339 learned_addr learned my addr 172.21.15.61:0/3246829339 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe24a76700 1 --2- 172.21.15.61:0/3246829339 >> v2:172.21.15.133:3300/0 conn(0x7fbe20159c10 0x7fbe200c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe25277700 1 --2- 172.21.15.61:0/3246829339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe200cba80 0x7fbe200cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe1ffff700 1 -- 172.21.15.61:0/3246829339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe200cba80 msgr2=0x7fbe200cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe1ffff700 1 --2- 172.21.15.61:0/3246829339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe200cba80 0x7fbe200cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe1ffff700 1 -- 172.21.15.61:0/3246829339 >> v2:172.21.15.133:3300/0 conn(0x7fbe20159c10 msgr2=0x7fbe200c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe1ffff700 1 --2- 172.21.15.61:0/3246829339 >> v2:172.21.15.133:3300/0 conn(0x7fbe20159c10 0x7fbe200c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe1ffff700 1 -- 172.21.15.61:0/3246829339 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe200c63b0 con 0x7fbe20159fe0 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe25277700 1 --2- 172.21.15.61:0/3246829339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe200cba80 0x7fbe200cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.321+0000 7fbe1ffff700 1 --2- 172.21.15.61:0/3246829339 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe20159fe0 0x7fbe200c5d10 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fbe200d0990 tx=0x7fbe0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c340b8ca93c17 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe1f7fe700 1 -- 172.21.15.61:0/3246829339 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c009ea0 con 0x7fbe20159fe0 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe1f7fe700 1 -- 172.21.15.61:0/3246829339 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c00b820 con 0x7fbe20159fe0 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe1f7fe700 1 -- 172.21.15.61:0/3246829339 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00bbc0 con 0x7fbe20159fe0 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe26cda700 1 -- 172.21.15.61:0/3246829339 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe20159fe0 msgr2=0x7fbe200c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe26cda700 1 --2- 172.21.15.61:0/3246829339 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe20159fe0 0x7fbe200c5d10 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fbe200d0990 tx=0x7fbe0c009250 comp rx=0 tx=0).stop 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe26cda700 1 -- 172.21.15.61:0/3246829339 shutdown_connections 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe26cda700 1 --2- 172.21.15.61:0/3246829339 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe200cba80 0x7fbe200cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe26cda700 1 --2- 172.21.15.61:0/3246829339 >> v2:172.21.15.133:3300/0 conn(0x7fbe20159c10 0x7fbe200c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe26cda700 1 --2- 172.21.15.61:0/3246829339 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe20159fe0 0x7fbe200c5d10 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe26cda700 1 -- 172.21.15.61:0/3246829339 >> 172.21.15.61:0/3246829339 conn(0x7fbe2006e640 msgr2=0x7fbe20067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:33.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe26cda700 1 -- 172.21.15.61:0/3246829339 shutdown_connections 2023-12-24T20:07:33.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.322+0000 7fbe26cda700 1 -- 172.21.15.61:0/3246829339 wait complete. 2023-12-24T20:07:33.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.323+0000 7fbe26cda700 1 Processor -- start 2023-12-24T20:07:33.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.324+0000 7fbe26cda700 1 -- start start 2023-12-24T20:07:33.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.324+0000 7fbe26cda700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe200cba80 0x7fbe200b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:33.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.324+0000 7fbe26cda700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe20159c10 0x7fbe201547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:33.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.324+0000 7fbe26cda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe20159fe0 0x7fbe20156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:33.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.324+0000 7fbe26cda700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200c8560 con 0x7fbe200cba80 2023-12-24T20:07:33.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.324+0000 7fbe26cda700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200b3d10 con 0x7fbe20159fe0 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.324+0000 7fbe26cda700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200c86f0 con 0x7fbe20159c10 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.324+0000 7fbe24a76700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe200cba80 0x7fbe200b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.324+0000 7fbe24a76700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe200cba80 0x7fbe200b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48634/0 (socket says 172.21.15.61:48634) 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.324+0000 7fbe24a76700 1 -- 172.21.15.61:0/587873287 learned_addr learned my addr 172.21.15.61:0/587873287 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe25277700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe20159fe0 0x7fbe20156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe1ffff700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe20159c10 0x7fbe201547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe24a76700 1 -- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe20159c10 msgr2=0x7fbe201547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe24a76700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe20159c10 0x7fbe201547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe24a76700 1 -- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe20159fe0 msgr2=0x7fbe20156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe24a76700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe20159fe0 0x7fbe20156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe24a76700 1 -- 172.21.15.61:0/587873287 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0094f0 con 0x7fbe200cba80 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe1ffff700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe20159c10 0x7fbe201547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe24a76700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe200cba80 0x7fbe200b37d0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400ec80 tx=0x7fbe140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe1cff9700 1 -- 172.21.15.61:0/587873287 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400c9d0 con 0x7fbe200cba80 2023-12-24T20:07:33.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe1cff9700 1 -- 172.21.15.61:0/587873287 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1400cb30 con 0x7fbe200cba80 2023-12-24T20:07:33.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe26cda700 1 -- 172.21.15.61:0/587873287 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe200b3f40 con 0x7fbe200cba80 2023-12-24T20:07:33.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe1cff9700 1 -- 172.21.15.61:0/587873287 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14013470 con 0x7fbe200cba80 2023-12-24T20:07:33.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.325+0000 7fbe26cda700 1 -- 172.21.15.61:0/587873287 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe200b4500 con 0x7fbe200cba80 2023-12-24T20:07:33.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.326+0000 7fbe26cda700 1 -- 172.21.15.61:0/587873287 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe200890b0 con 0x7fbe200cba80 2023-12-24T20:07:33.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.327+0000 7fbe1cff9700 1 -- 172.21.15.61:0/587873287 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbe14013820 con 0x7fbe200cba80 2023-12-24T20:07:33.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.327+0000 7fbe1cff9700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe04066f30 0x7fbe040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:33.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.327+0000 7fbe1cff9700 1 -- 172.21.15.61:0/587873287 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe140848c0 con 0x7fbe200cba80 2023-12-24T20:07:33.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.327+0000 7fbe1ffff700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe04066f30 0x7fbe040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:33.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.328+0000 7fbe1ffff700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe04066f30 0x7fbe040693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbe20089d80 tx=0x7fbe0c017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:33.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.332+0000 7fbe1cff9700 1 -- 172.21.15.61:0/587873287 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe14051b30 con 0x7fbe200cba80 2023-12-24T20:07:33.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.573+0000 7fbe26cda700 1 -- 172.21.15.61:0/587873287 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbe2004c3c0 con 0x7fbe200cba80 2023-12-24T20:07:33.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.574+0000 7fbe1cff9700 1 -- 172.21.15.61:0/587873287 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbe14055150 con 0x7fbe200cba80 2023-12-24T20:07:33.575 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-24T20:07:33.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.575+0000 7fbe26cda700 1 -- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe04066f30 msgr2=0x7fbe040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:33.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.575+0000 7fbe26cda700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe04066f30 0x7fbe040693e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbe20089d80 tx=0x7fbe0c017000 comp rx=0 tx=0).stop 2023-12-24T20:07:33.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.575+0000 7fbe26cda700 1 -- 172.21.15.61:0/587873287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe200cba80 msgr2=0x7fbe200b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:33.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.575+0000 7fbe26cda700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe200cba80 0x7fbe200b37d0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400ec80 tx=0x7fbe140091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.576+0000 7fbe26cda700 1 -- 172.21.15.61:0/587873287 shutdown_connections 2023-12-24T20:07:33.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.576+0000 7fbe26cda700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbe04066f30 0x7fbe040693e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.576+0000 7fbe26cda700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe20159fe0 0x7fbe20156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.576+0000 7fbe26cda700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbe200cba80 0x7fbe200b37d0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.576+0000 7fbe26cda700 1 --2- 172.21.15.61:0/587873287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbe20159c10 0x7fbe201547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:33.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.576+0000 7fbe26cda700 1 -- 172.21.15.61:0/587873287 >> 172.21.15.61:0/587873287 conn(0x7fbe2006e640 msgr2=0x7fbe20157730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:33.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.576+0000 7fbe26cda700 1 -- 172.21.15.61:0/587873287 shutdown_connections 2023-12-24T20:07:33.578 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:33.576+0000 7fbe26cda700 1 -- 172.21.15.61:0/587873287 wait complete. 2023-12-24T20:07:33.589 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-24T20:07:33.589 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-24T20:07:33.589 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-24T20:07:33.589 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-24T20:07:33.589 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-24T20:07:33.589 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-24T20:07:33.589 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-24T20:07:33.590 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-24T20:07:33.590 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:07:33.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:33.590 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-24T20:07:33.611 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-24T20:07:33.612 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41919sec preferred_lft 41919sec 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::9a40:12c9:2d13:281b/64 scope link noprefixroute 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::cc51:b8ff:fee1:198d/64 scope link 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:07:33.613 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether e2:63:45:bb:a5:9b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T20:07:33.614 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::e063:45ff:febb:a59b/64 scope link 2023-12-24T20:07:33.614 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:33.614 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-24T20:07:33.614 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether ae:cb:c5:ae:09:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T20:07:33.614 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::accb:c5ff:feae:915/64 scope link 2023-12-24T20:07:33.614 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-24T20:07:33.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:33.614 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-24T20:07:33.683 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-24T20:07:33.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:33.684 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-24T20:07:33.746 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-24T20:07:33.746 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-24T20:07:33.746 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-24T20:07:33.746 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-24T20:07:33.746 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-24T20:07:33.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:33.747 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-24T20:07:33.747 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-24T20:07:33.747 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-24T20:07:33.747 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-24T20:07:33.747 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-24T20:07:33.747 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-24T20:07:33.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:33.857 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T20:07:33.875 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T20:07:33.875 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T20:07:33.875 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:07:33.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:07:33.875 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-24T20:07:33.943 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-24T20:07:33.943 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:07:33.943 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-24T20:07:34.000 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-24T20:07:34.001 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-24T20:07:34.001 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:07:34.057 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:07:34.124 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:07:34.125 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:07:34.190 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:07:34.191 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:07:34.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:34.192 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:07:34.249 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-24T20:07:34.249 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-24T20:07:34.292 DEBUG:teuthology.orchestra.run.smithi133:> sudo modprobe fuse 2023-12-24T20:07:34.318 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-24T20:07:34.318 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-24T20:07:34.374 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:2023-12-24T20:07:34.374+0000 7feec41e5540 -1 init, newargv = 0x5560fcab1510 newargc=15 2023-12-24T20:07:34.374 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[49391]: starting ceph client 2023-12-24T20:07:34.378 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[49391]: starting fuse 2023-12-24T20:07:34.388 INFO:teuthology.orchestra.run.smithi133.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-24T20:07:34.389 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-24T20:07:34.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:34.390 DEBUG:teuthology.orchestra.run.smithi133:> ls /sys/fs/fuse/connections 2023-12-24T20:07:34.447 INFO:teuthology.orchestra.run.smithi133.stdout:47 2023-12-24T20:07:34.447 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> import glob 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> import re 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> import os 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> import subprocess 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> def _find_admin_socket(client_name): 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> files = glob.glob(asok_path) 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> # Given a non-glob path, it better be there 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> if "*" not in asok_path: 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> assert(len(files) == 1) 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> return files[0] 2023-12-24T20:07:34.448 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> for f in files: 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> contents = proc_f.read() 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> if mountpoint in contents: 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> return f 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> print(_find_admin_socket("client.1")) 2023-12-24T20:07:34.449 DEBUG:teuthology.orchestra.run.smithi133:> ' 2023-12-24T20:07:34.571 INFO:teuthology.orchestra.run.smithi133.stdout:/var/run/ceph/ceph-client.1.49391.asok 2023-12-24T20:07:34.754 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.49391.asok 2023-12-24T20:07:34.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:34.754 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.49391.asok status 2023-12-24T20:07:34.907 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-24T20:07:34.907 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": { 2023-12-24T20:07:34.907 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_sha1": "5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f", 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "ceph_version": "ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)", 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "entity_id": "1", 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "hostname": "smithi133", 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "pid": "49391", 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "root": "/" 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_count": 0, 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "dentry_pinned_count": 0, 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6674, 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "inst": { 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "name": { 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "client", 2023-12-24T20:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout: "num": 6674 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 493965678 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": { 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "192.168.0.1:0", 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 493965678 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "inst_str": "client.6674 192.168.0.1:0/493965678", 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "addr_str": "192.168.0.1:0/493965678", 2023-12-24T20:07:34.909 INFO:teuthology.orchestra.run.smithi133.stdout: "inode_count": 1, 2023-12-24T20:07:34.910 INFO:teuthology.orchestra.run.smithi133.stdout: "mds_epoch": 92, 2023-12-24T20:07:34.910 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch": 185, 2023-12-24T20:07:34.910 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_epoch_barrier": 0, 2023-12-24T20:07:34.910 INFO:teuthology.orchestra.run.smithi133.stdout: "blocklisted": false, 2023-12-24T20:07:34.910 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs" 2023-12-24T20:07:34.910 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-24T20:07:34.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:34.917 DEBUG:teuthology.orchestra.run.smithi133:> stat --file-system '--printf=%T 2023-12-24T20:07:34.917 DEBUG:teuthology.orchestra.run.smithi133:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-24T20:07:34.935 INFO:teuthology.orchestra.run.smithi133.stdout:fuseblk 2023-12-24T20:07:34.935 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-24T20:07:34.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:34.935 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-24T20:07:35.004 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:07:35.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.140+0000 7fa84c5c0700 1 Processor -- start 2023-12-24T20:07:35.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.140+0000 7fa84c5c0700 1 -- start start 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.141+0000 7fa84c5c0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8440aaf90 0x7fa844159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.141+0000 7fa84c5c0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84406a630 con 0x7fa844159850 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.141+0000 7fa84c5c0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa844069d00 con 0x7fa84406aac0 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.141+0000 7fa84c5c0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440cccf0 con 0x7fa8440aaf90 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.141+0000 7fa84a35c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa844159850 0x7fa8440cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:60864/0 (socket says 172.21.15.61:60864) 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.141+0000 7fa84a35c700 1 -- 172.21.15.61:0/3279648729 learned_addr learned my addr 172.21.15.61:0/3279648729 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.141+0000 7fa84ab5d700 1 --2- 172.21.15.61:0/3279648729 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8440aaf90 0x7fa844159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.141+0000 7fa84935a700 1 -- 172.21.15.61:0/3279648729 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156936770 0 0) 0x7fa84406a630 con 0x7fa844159850 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.141+0000 7fa84935a700 1 -- 172.21.15.61:0/3279648729 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa830003570 con 0x7fa844159850 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.141+0000 7fa84935a700 1 -- 172.21.15.61:0/3279648729 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133362347 0 0) 0x7fa844069d00 con 0x7fa84406aac0 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84935a700 1 -- 172.21.15.61:0/3279648729 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa84406a630 con 0x7fa84406aac0 2023-12-24T20:07:35.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84ab5d700 1 -- 172.21.15.61:0/3279648729 >> v1:172.21.15.133:6789/0 conn(0x7fa84406aac0 legacy=0x7fa8440aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84ab5d700 1 -- 172.21.15.61:0/3279648729 >> v1:172.21.15.61:6789/0 conn(0x7fa844159850 legacy=0x7fa8440cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84935a700 1 -- 172.21.15.61:0/3279648729 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651338768 0 0) 0x7fa830003570 con 0x7fa844159850 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84ab5d700 1 -- 172.21.15.61:0/3279648729 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844069fe0 con 0x7fa8440aaf90 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84ab5d700 1 --2- 172.21.15.61:0/3279648729 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8440aaf90 0x7fa844159c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009e90 tx=0x7fa83c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c93353076c56358a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84935a700 1 -- 172.21.15.61:0/3279648729 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00e070 con 0x7fa8440aaf90 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84935a700 1 -- 172.21.15.61:0/3279648729 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c00b870 con 0x7fa8440aaf90 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84935a700 1 -- 172.21.15.61:0/3279648729 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840001470 con 0x7fa8440aaf90 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84c5c0700 1 -- 172.21.15.61:0/3279648729 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8440aaf90 msgr2=0x7fa844159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.142+0000 7fa84c5c0700 1 --2- 172.21.15.61:0/3279648729 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8440aaf90 0x7fa844159c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009e90 tx=0x7fa83c009780 comp rx=0 tx=0).stop 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.143+0000 7fa84c5c0700 1 -- 172.21.15.61:0/3279648729 shutdown_connections 2023-12-24T20:07:35.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.143+0000 7fa84c5c0700 1 --2- 172.21.15.61:0/3279648729 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8440aaf90 0x7fa844159c20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.143+0000 7fa84c5c0700 1 -- 172.21.15.61:0/3279648729 >> 172.21.15.61:0/3279648729 conn(0x7fa8440cceb0 msgr2=0x7fa8440cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:35.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.143+0000 7fa84c5c0700 1 -- 172.21.15.61:0/3279648729 shutdown_connections 2023-12-24T20:07:35.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.143+0000 7fa84c5c0700 1 -- 172.21.15.61:0/3279648729 wait complete. 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.144+0000 7fa84c5c0700 1 Processor -- start 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.144+0000 7fa84c5c0700 1 -- start start 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.144+0000 7fa84c5c0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa84406aac0 0x7fa844142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84c5c0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8440aaf90 0x7fa84415e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84c5c0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa844159850 0x7fa84416cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84c5c0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84416a980 con 0x7fa844159850 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84c5c0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84416ac60 con 0x7fa8440aaf90 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84c5c0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84416af40 con 0x7fa84406aac0 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84ab5d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa844159850 0x7fa84416cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84ab5d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa844159850 0x7fa84416cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48640/0 (socket says 172.21.15.61:48640) 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84ab5d700 1 -- 172.21.15.61:0/1063675180 learned_addr learned my addr 172.21.15.61:0/1063675180 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:35.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84a35c700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa84406aac0 0x7fa844142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa849b5b700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8440aaf90 0x7fa84415e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84ab5d700 1 -- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa84406aac0 msgr2=0x7fa844142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84ab5d700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa84406aac0 0x7fa844142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84ab5d700 1 -- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8440aaf90 msgr2=0x7fa84415e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84ab5d700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8440aaf90 0x7fa84415e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84ab5d700 1 -- 172.21.15.61:0/1063675180 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c009a20 con 0x7fa844159850 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84ab5d700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa844159850 0x7fa84416cdb0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa83c003000 tx=0x7fa83c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa83a7fc700 1 -- 172.21.15.61:0/1063675180 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c012bb0 con 0x7fa844159850 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa83a7fc700 1 -- 172.21.15.61:0/1063675180 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c012d30 con 0x7fa844159850 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa83a7fc700 1 -- 172.21.15.61:0/1063675180 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c012ea0 con 0x7fa844159850 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.145+0000 7fa84c5c0700 1 -- 172.21.15.61:0/1063675180 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84416b220 con 0x7fa844159850 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.146+0000 7fa84c5c0700 1 -- 172.21.15.61:0/1063675180 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84416b7e0 con 0x7fa844159850 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.146+0000 7fa84c5c0700 1 -- 172.21.15.61:0/1063675180 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84404c3c0 con 0x7fa844159850 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.147+0000 7fa83a7fc700 1 -- 172.21.15.61:0/1063675180 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa83c01e930 con 0x7fa844159850 2023-12-24T20:07:35.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.147+0000 7fa83a7fc700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa828066f30 0x7fa8280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.147+0000 7fa83a7fc700 1 -- 172.21.15.61:0/1063675180 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa83c086900 con 0x7fa844159850 2023-12-24T20:07:35.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.148+0000 7fa84a35c700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa828066f30 0x7fa8280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.148+0000 7fa84a35c700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa828066f30 0x7fa8280693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa8440c9840 tx=0x7fa840000bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:35.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.152+0000 7fa83a7fc700 1 -- 172.21.15.61:0/1063675180 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa83c053b70 con 0x7fa844159850 2023-12-24T20:07:35.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.388+0000 7fa84c5c0700 1 -- 172.21.15.61:0/1063675180 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa84416b9d0 con 0x7fa844159850 2023-12-24T20:07:35.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.389+0000 7fa83a7fc700 1 -- 172.21.15.61:0/1063675180 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fa83c016090 con 0x7fa844159850 2023-12-24T20:07:35.390 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:35.390 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1018177900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1018177900},{"type":"v1","addr":"172.21.15.133:6836","nonce":1018177900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2332940307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2332940307},{"type":"v1","addr":"172.21.15.61:6834","nonce":2332940307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/784121250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":784121250},{"type":"v1","addr":"172.21.15.61:6835","nonce":784121250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:07:20.139140+0000","modified":"2023-12-24T20:07:23.769968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8145":{"gid":8145,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2891152875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2891152875},{"type":"v1","addr":"172.21.15.133:6837","nonce":2891152875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:07:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 -- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa828066f30 msgr2=0x7fa8280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa828066f30 0x7fa8280693e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa8440c9840 tx=0x7fa840000bc0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 -- 172.21.15.61:0/1063675180 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa844159850 msgr2=0x7fa84416cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:35.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa844159850 0x7fa84416cdb0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa83c003000 tx=0x7fa83c017000 comp rx=0 tx=0).stop 2023-12-24T20:07:35.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 -- 172.21.15.61:0/1063675180 shutdown_connections 2023-12-24T20:07:35.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa84406aac0 0x7fa844142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa828066f30 0x7fa8280693e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa844159850 0x7fa84416cdb0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 --2- 172.21.15.61:0/1063675180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8440aaf90 0x7fa84415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 -- 172.21.15.61:0/1063675180 >> 172.21.15.61:0/1063675180 conn(0x7fa8440cceb0 msgr2=0x7fa8440c2650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:35.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 -- 172.21.15.61:0/1063675180 shutdown_connections 2023-12-24T20:07:35.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.391+0000 7fa84c5c0700 1 -- 172.21.15.61:0/1063675180 wait complete. 2023-12-24T20:07:35.395 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 92 2023-12-24T20:07:35.404 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-24T20:07:35.542 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":8145,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.792408098999999,"mdsmap_epoch":92,"osdmap_epoch":185,"osdmap_epoch_barrier":185,"uptime":20.822482288} 2023-12-24T20:07:35.543 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 8145, "mdsmap_epoch": 92, "osdmap_epoch": 185, "osdmap_epoch_barrier": 185, "rank_uptime": 14.792408099, "state": "up:active", "uptime": 20.822482288, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:07:35.543 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-24T20:07:35.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.670+0000 7f0a7e17a700 1 Processor -- start 2023-12-24T20:07:35.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.670+0000 7f0a7e17a700 1 -- start start 2023-12-24T20:07:35.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a7e17a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a781569b0 0x7f0a7806a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a7e17a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a780ca8f0 0x7f0a78069a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a7e17a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0a78069fc0 0x7f0a780cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a7e17a700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7806adb0 con 0x7f0a78069fc0 2023-12-24T20:07:35.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a7e17a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7806a440 con 0x7f0a781569b0 2023-12-24T20:07:35.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a7e17a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a78156d80 con 0x7f0a780ca8f0 2023-12-24T20:07:35.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a77fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0a78069fc0 0x7f0a780cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a77fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f0a78069fc0 0x7f0a780cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48654/0 (socket says 172.21.15.61:48654) 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a77fff700 1 -- 172.21.15.61:0/968308753 learned_addr learned my addr 172.21.15.61:0/968308753 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a777fe700 1 --2- 172.21.15.61:0/968308753 >> v2:172.21.15.133:3300/0 conn(0x7f0a781569b0 0x7f0a7806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a76ffd700 1 --2- 172.21.15.61:0/968308753 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a780ca8f0 0x7f0a78069a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a77fff700 1 -- 172.21.15.61:0/968308753 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a780ca8f0 msgr2=0x7f0a78069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a77fff700 1 --2- 172.21.15.61:0/968308753 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a780ca8f0 0x7f0a78069a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a77fff700 1 -- 172.21.15.61:0/968308753 >> v2:172.21.15.133:3300/0 conn(0x7f0a781569b0 msgr2=0x7f0a7806a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a77fff700 1 --2- 172.21.15.61:0/968308753 >> v2:172.21.15.133:3300/0 conn(0x7f0a781569b0 0x7f0a7806a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a77fff700 1 -- 172.21.15.61:0/968308753 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a78067680 con 0x7f0a78069fc0 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.671+0000 7f0a76ffd700 1 --2- 172.21.15.61:0/968308753 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a780ca8f0 0x7f0a78069a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a77fff700 1 --2- 172.21.15.61:0/968308753 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 0x7f0a780cb2d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f0a7806d770 tx=0x7f0a70009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb16d56ca40e720 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a767fc700 1 -- 172.21.15.61:0/968308753 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000e070 con 0x7f0a78069fc0 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a767fc700 1 -- 172.21.15.61:0/968308753 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7000b990 con 0x7f0a78069fc0 2023-12-24T20:07:35.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a767fc700 1 -- 172.21.15.61:0/968308753 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700092e0 con 0x7f0a78069fc0 2023-12-24T20:07:35.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a7e17a700 1 -- 172.21.15.61:0/968308753 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 msgr2=0x7f0a780cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:35.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a7e17a700 1 --2- 172.21.15.61:0/968308753 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 0x7f0a780cb2d0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f0a7806d770 tx=0x7f0a70009840 comp rx=0 tx=0).stop 2023-12-24T20:07:35.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a7e17a700 1 -- 172.21.15.61:0/968308753 shutdown_connections 2023-12-24T20:07:35.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a7e17a700 1 --2- 172.21.15.61:0/968308753 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 0x7f0a780cb2d0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a7e17a700 1 --2- 172.21.15.61:0/968308753 >> v2:172.21.15.133:3300/0 conn(0x7f0a781569b0 0x7f0a7806a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a7e17a700 1 --2- 172.21.15.61:0/968308753 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a780ca8f0 0x7f0a78069a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a7e17a700 1 -- 172.21.15.61:0/968308753 >> 172.21.15.61:0/968308753 conn(0x7f0a780ce180 msgr2=0x7f0a780ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:35.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a7e17a700 1 -- 172.21.15.61:0/968308753 shutdown_connections 2023-12-24T20:07:35.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.672+0000 7f0a7e17a700 1 -- 172.21.15.61:0/968308753 wait complete. 2023-12-24T20:07:35.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.674+0000 7f0a7e17a700 1 Processor -- start 2023-12-24T20:07:35.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.674+0000 7f0a7e17a700 1 -- start start 2023-12-24T20:07:35.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.674+0000 7f0a7e17a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 0x7f0a78158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.674+0000 7f0a7e17a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a780ca8f0 0x7f0a78159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.674+0000 7f0a7e17a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a781569b0 0x7f0a7814c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.674+0000 7f0a7e17a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7814b700 con 0x7f0a78069fc0 2023-12-24T20:07:35.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.674+0000 7f0a7e17a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a78158890 con 0x7f0a780ca8f0 2023-12-24T20:07:35.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.674+0000 7f0a7e17a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7814bde0 con 0x7f0a781569b0 2023-12-24T20:07:35.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a777fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 0x7f0a78158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.678 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a777fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 0x7f0a78158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:48666/0 (socket says 172.21.15.61:48666) 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a777fe700 1 -- 172.21.15.61:0/1586523616 learned_addr learned my addr 172.21.15.61:0/1586523616 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a77fff700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a781569b0 0x7f0a7814c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a76ffd700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a780ca8f0 0x7f0a78159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a777fe700 1 -- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a781569b0 msgr2=0x7f0a7814c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a777fe700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a781569b0 0x7f0a7814c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a777fe700 1 -- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a780ca8f0 msgr2=0x7f0a78159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a777fe700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a780ca8f0 0x7f0a78159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a777fe700 1 -- 172.21.15.61:0/1586523616 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a70009ae0 con 0x7f0a78069fc0 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a777fe700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 0x7f0a78158350 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800e930 tx=0x7f0a680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a6f7fe700 1 -- 172.21.15.61:0/1586523616 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800eed0 con 0x7f0a78069fc0 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a6f7fe700 1 -- 172.21.15.61:0/1586523616 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6800c850 con 0x7f0a78069fc0 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a7e17a700 1 -- 172.21.15.61:0/1586523616 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7814c0c0 con 0x7f0a78069fc0 2023-12-24T20:07:35.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a6f7fe700 1 -- 172.21.15.61:0/1586523616 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800cbf0 con 0x7f0a78069fc0 2023-12-24T20:07:35.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.675+0000 7f0a7e17a700 1 -- 172.21.15.61:0/1586523616 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a78157e30 con 0x7f0a78069fc0 2023-12-24T20:07:35.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.676+0000 7f0a7e17a700 1 -- 172.21.15.61:0/1586523616 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a78157980 con 0x7f0a78069fc0 2023-12-24T20:07:35.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.677+0000 7f0a6f7fe700 1 -- 172.21.15.61:0/1586523616 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f0a68013470 con 0x7f0a78069fc0 2023-12-24T20:07:35.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.677+0000 7f0a6f7fe700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a58066f30 0x7f0a580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:35.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.677+0000 7f0a6f7fe700 1 -- 172.21.15.61:0/1586523616 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a68084720 con 0x7f0a78069fc0 2023-12-24T20:07:35.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.677+0000 7f0a76ffd700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a58066f30 0x7f0a580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:35.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.678+0000 7f0a76ffd700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a58066f30 0x7f0a580693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0a60006f00 tx=0x7f0a60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:35.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.681+0000 7f0a6f7fe700 1 -- 172.21.15.61:0/1586523616 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a68051990 con 0x7f0a78069fc0 2023-12-24T20:07:35.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:35.881+0000 7f0a7e17a700 1 -- 172.21.15.61:0/1586523616 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f0a7804c3c0 con 0x7f0a78069fc0 2023-12-24T20:07:36.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.807+0000 7f0a6f7fe700 1 -- 172.21.15.61:0/1586523616 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v186) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0a68054fb0 con 0x7f0a78069fc0 2023-12-24T20:07:36.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 -- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a58066f30 msgr2=0x7f0a580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:36.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a58066f30 0x7f0a580693e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0a60006f00 tx=0x7f0a60008040 comp rx=0 tx=0).stop 2023-12-24T20:07:36.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 -- 172.21.15.61:0/1586523616 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 msgr2=0x7f0a78158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:36.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 0x7f0a78158350 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800e930 tx=0x7f0a680091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:36.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 -- 172.21.15.61:0/1586523616 shutdown_connections 2023-12-24T20:07:36.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f0a781569b0 0x7f0a7814c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:36.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f0a58066f30 0x7f0a580693e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:36.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f0a78069fc0 0x7f0a78158350 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:36.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 --2- 172.21.15.61:0/1586523616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a780ca8f0 0x7f0a78159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:36.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 -- 172.21.15.61:0/1586523616 >> 172.21.15.61:0/1586523616 conn(0x7f0a780ce180 msgr2=0x7f0a780ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:36.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 -- 172.21.15.61:0/1586523616 shutdown_connections 2023-12-24T20:07:36.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:36.810+0000 7f0a7e17a700 1 -- 172.21.15.61:0/1586523616 wait complete. 2023-12-24T20:07:36.812 INFO:teuthology.orchestra.run.smithi061.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-24T20:07:36.825 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-24T20:07:36.971 INFO:teuthology.orchestra.run.smithi061.stdout:{"osd_mon_report_interval":"5"} 2023-12-24T20:07:36.971 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-24T20:07:36.971 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-12-24T20:07:36.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:36.972 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-12-24T20:07:37.002 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:07:37.016 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:07:37.103 INFO:teuthology.orchestra.run.smithi061.stderr:16+0 records in 2023-12-24T20:07:37.103 INFO:teuthology.orchestra.run.smithi061.stderr:16+0 records out 2023-12-24T20:07:37.103 INFO:teuthology.orchestra.run.smithi061.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.108345 s, 155 MB/s 2023-12-24T20:07:37.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:37.104 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-12-24T20:07:37.271 INFO:teuthology.orchestra.run.smithi061.stderr:17+0 records in 2023-12-24T20:07:37.272 INFO:teuthology.orchestra.run.smithi061.stderr:17+0 records out 2023-12-24T20:07:37.272 INFO:teuthology.orchestra.run.smithi061.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.104421 s, 171 MB/s 2023-12-24T20:07:37.272 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-24T20:07:37.272 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:07:37.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.393+0000 7ff214b11700 1 Processor -- start 2023-12-24T20:07:37.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.393+0000 7ff214b11700 1 -- start start 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.394+0000 7ff214b11700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2100b2bf0 0x7ff2101629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.394+0000 7ff214b11700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21006e790 con 0x7ff210070bd0 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.394+0000 7ff214b11700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100b00f0 con 0x7ff210070800 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.394+0000 7ff214b11700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff210071040 con 0x7ff2100b2bf0 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.394+0000 7ff20dd9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff210070bd0 0x7ff210157580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:44342/0 (socket says 172.21.15.61:44342) 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.394+0000 7ff20dd9b700 1 -- 172.21.15.61:0/1700170524 learned_addr learned my addr 172.21.15.61:0/1700170524 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20ed9d700 1 --2- 172.21.15.61:0/1700170524 >> v2:172.21.15.133:3300/0 conn(0x7ff2100b2bf0 0x7ff2101629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620516317 0 0) 0x7ff21006e790 con 0x7ff210070bd0 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f8003570 con 0x7ff210070bd0 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2655579990 0 0) 0x7ff1f8003570 con 0x7ff210070bd0 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 >> v2:172.21.15.133:3300/0 conn(0x7ff2100b2bf0 msgr2=0x7ff2101629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:37.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 --2- 172.21.15.61:0/1700170524 >> v2:172.21.15.133:3300/0 conn(0x7ff2100b2bf0 0x7ff2101629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 >> v1:172.21.15.133:6789/0 conn(0x7ff210070800 legacy=0x7ff2100af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21006d8e0 con 0x7ff210070bd0 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7ff200001470 con 0x7ff210070bd0 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 >> v1:172.21.15.61:6789/0 conn(0x7ff210070bd0 legacy=0x7ff210157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1f8003a60 0x7ff1f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1f8004810 0x7ff1f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff1f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210071040 con 0x7ff1f80051c0 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f800c0d0 con 0x7ff1f8004810 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f800c290 con 0x7ff1f8003a60 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20ed9d700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff1f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20dd9b700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1f8004810 0x7ff1f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.395+0000 7ff20e59c700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1f8003a60 0x7ff1f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:37.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff20ed9d700 1 -- 172.21.15.61:0/1700170524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1f8003a60 msgr2=0x7ff1f8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff20ed9d700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff1f8003a60 0x7ff1f8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff20ed9d700 1 -- 172.21.15.61:0/1700170524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1f8004810 msgr2=0x7ff1f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff20ed9d700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1f8004810 0x7ff1f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff20ed9d700 1 -- 172.21.15.61:0/1700170524 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8003570 con 0x7ff1f80051c0 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff20ed9d700 1 -- 172.21.15.61:0/1700170524 reap_dead start 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff20ed9d700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff1f800ba60 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7ff20800e210 tx=0x7ff20800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86426260c78a26a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20800eac0 con 0x7ff1f80051c0 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20800f040 con 0x7ff1f80051c0 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff20d59a700 1 -- 172.21.15.61:0/1700170524 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20800ee70 con 0x7ff1f80051c0 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff214b11700 1 -- 172.21.15.61:0/1700170524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 msgr2=0x7ff1f800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff214b11700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff1f800ba60 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7ff20800e210 tx=0x7ff20800b040 comp rx=0 tx=0).stop 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.396+0000 7ff214b11700 1 -- 172.21.15.61:0/1700170524 shutdown_connections 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.397+0000 7ff214b11700 1 --2- 172.21.15.61:0/1700170524 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff1f800ba60 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:37.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.397+0000 7ff214b11700 1 -- 172.21.15.61:0/1700170524 >> 172.21.15.61:0/1700170524 conn(0x7ff2100cd6f0 msgr2=0x7ff2100cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.397+0000 7ff214b11700 1 -- 172.21.15.61:0/1700170524 shutdown_connections 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.397+0000 7ff214b11700 1 -- 172.21.15.61:0/1700170524 wait complete. 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff214b11700 1 Processor -- start 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff214b11700 1 -- start start 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff214b11700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff2100c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff214b11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21014eca0 0x7ff210169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff214b11700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2100c7c90 0x7ff210068110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff214b11700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21016a140 con 0x7ff1f80051c0 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff214b11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21016abf0 con 0x7ff21014eca0 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff214b11700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21014f110 con 0x7ff2100c7c90 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff20e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff2100c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff20e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff2100c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57200/0 (socket says 172.21.15.61:57200) 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.398+0000 7ff20e59c700 1 -- 172.21.15.61:0/2233139347 learned_addr learned my addr 172.21.15.61:0/2233139347 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:37.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff20ed9d700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2100c7c90 0x7ff210068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff20dd9b700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21014eca0 0x7ff210169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff20e59c700 1 -- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2100c7c90 msgr2=0x7ff210068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff20e59c700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2100c7c90 0x7ff210068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff20e59c700 1 -- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21014eca0 msgr2=0x7ff210169c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff20e59c700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21014eca0 0x7ff210169c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff20e59c700 1 -- 172.21.15.61:0/2233139347 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100ae470 con 0x7ff1f80051c0 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff20e59c700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff2100c9780 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7ff2040029b0 tx=0x7ff204007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff1fe7fc700 1 -- 172.21.15.61:0/2233139347 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204013600 con 0x7ff1f80051c0 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff1fe7fc700 1 -- 172.21.15.61:0/2233139347 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff204013760 con 0x7ff1f80051c0 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff214b11700 1 -- 172.21.15.61:0/2233139347 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2100ae710 con 0x7ff1f80051c0 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff1fe7fc700 1 -- 172.21.15.61:0/2233139347 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204013b20 con 0x7ff1f80051c0 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.399+0000 7ff214b11700 1 -- 172.21.15.61:0/2233139347 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21016a630 con 0x7ff1f80051c0 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.400+0000 7ff214b11700 1 -- 172.21.15.61:0/2233139347 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21004c3c0 con 0x7ff1f80051c0 2023-12-24T20:07:37.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.401+0000 7ff1fe7fc700 1 -- 172.21.15.61:0/2233139347 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff20400f400 con 0x7ff1f80051c0 2023-12-24T20:07:37.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.401+0000 7ff1fe7fc700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:37.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.401+0000 7ff1fe7fc700 1 -- 172.21.15.61:0/2233139347 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff204084020 con 0x7ff1f80051c0 2023-12-24T20:07:37.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.401+0000 7ff20dd9b700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:37.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.402+0000 7ff20dd9b700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1f0066f30 0x7ff1f00693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff210068ce0 tx=0x7ff200001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:37.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.405+0000 7ff1fe7fc700 1 -- 172.21.15.61:0/2233139347 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff204051290 con 0x7ff1f80051c0 2023-12-24T20:07:37.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.600+0000 7ff214b11700 1 -- 172.21.15.61:0/2233139347 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff2100b00f0 con 0x7ff1f80051c0 2023-12-24T20:07:37.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.601+0000 7ff1fe7fc700 1 -- 172.21.15.61:0/2233139347 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v186) v1 ==== 81+0+32282 (secure 0 0 0) 0x7ff2100b00f0 con 0x7ff1f80051c0 2023-12-24T20:07:37.602 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:37.602 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:07:37.602 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 186, 2023-12-24T20:07:37.602 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:07:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:07:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:07:36.796624+0000", 2023-12-24T20:07:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:07:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:07:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:07:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:07:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:07:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:07:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:07:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:07:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:07:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:07:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:07:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:07:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:07:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:07:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 23, 2023-12-24T20:07:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:07:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:07:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:07:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:07:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:07:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:07:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:07:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:07:37.607 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:37.607 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:37.607 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:37.607 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:37.607 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:37.607 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:37.607 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:37.607 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:37.608 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:37.608 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:37.608 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:37.608 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:37.608 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:07:37.608 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:07:37.608 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:07:37.609 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:07:37.609 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:07:37.609 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:37.609 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:37.609 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:37.609 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:37.610 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:37.610 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:37.610 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:37.610 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.610 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:07:37.610 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:37.610 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:37.611 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.612 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:37.613 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:37.614 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:07:37.614 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:07:37.614 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.614 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:37.614 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:07:37.614 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.614 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.615 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.615 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 22, 2023-12-24T20:07:37.615 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:07:37.615 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:17.930601+0000", 2023-12-24T20:07:37.615 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:37.615 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:37.616 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:37.616 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:37.616 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:37.616 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:37.616 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:37.616 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:37.616 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:37.617 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:37.617 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:37.617 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:37.617 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:07:37.617 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:07:37.617 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:07:37.618 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:07:37.618 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:07:37.618 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:37.618 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:37.618 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:37.618 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:37.618 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:37.619 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:37.619 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:37.619 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.619 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "184", 2023-12-24T20:07:37.619 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:37.619 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:37.620 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:37.620 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:37.620 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:37.620 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:37.620 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:37.620 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:37.620 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:37.621 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:37.621 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:37.621 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:37.621 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:37.621 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:37.621 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:37.622 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:37.622 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:37.622 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:37.622 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:37.622 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:37.622 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:37.623 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:37.623 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:37.623 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:37.623 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:37.623 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:37.623 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.624 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:37.624 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:37.624 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:37.624 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:37.624 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:37.624 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:37.624 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:37.625 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:37.625 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:37.625 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:37.625 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:37.625 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:37.625 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:07:37.626 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:07:37.626 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:07:37.626 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.626 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:37.626 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:37.626 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:07:37.626 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.627 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.627 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.627 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.627 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 23, 2023-12-24T20:07:37.627 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:07:37.627 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:19.106020+0000", 2023-12-24T20:07:37.628 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:37.628 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:37.628 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:37.628 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:37.628 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:37.628 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:37.629 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:37.629 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:37.629 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:37.629 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:37.629 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:37.629 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:37.629 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:07:37.630 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:07:37.630 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:07:37.630 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:07:37.630 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:07:37.630 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:37.630 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:37.631 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:37.631 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:37.631 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:37.631 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:37.631 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:37.631 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "186", 2023-12-24T20:07:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:07:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:37.634 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:37.634 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:37.634 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:37.634 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:37.634 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:37.634 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:37.635 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:37.635 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:37.635 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:37.635 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:37.635 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:37.635 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:37.636 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:37.636 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:37.636 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:37.636 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.636 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:37.636 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:37.637 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:37.637 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:37.637 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:37.637 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:37.637 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:37.637 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:37.638 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:37.638 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:37.638 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:37.638 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:37.638 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:07:37.638 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:07:37.638 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.639 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:37.639 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:37.639 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:07:37.639 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.639 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.639 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.640 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:37.640 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:07:37.640 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.640 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:37.640 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:37.641 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:37.641 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:37.641 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:37.641 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:37.641 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:37.641 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:37.641 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.642 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.643 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.644 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:07:37.644 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:37.644 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.644 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.644 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.644 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:37.644 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.644 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:37.645 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.646 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.647 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.648 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:07:37.648 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:07:37.648 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:07:37.648 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:07:37.648 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:37.648 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:37.648 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:37.648 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.649 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.649 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.649 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:37.649 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:37.649 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:37.649 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:37.649 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:37.649 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:37.650 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:37.650 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:37.650 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:37.650 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:37.650 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:37.650 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:37.650 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:37.651 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.651 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.651 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.651 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:07:37.651 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:37.651 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.652 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.652 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.652 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:07:37.652 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:37.652 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.652 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.652 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.653 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:37.653 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.653 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.653 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.653 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:07:37.653 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:37.653 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.654 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.654 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.654 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:07:37.654 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:37.654 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.654 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.654 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.654 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:37.655 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.655 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.655 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.655 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:07:37.655 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:37.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.655 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.655 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.656 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:07:37.656 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:37.656 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.656 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.656 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.656 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:37.657 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.657 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.657 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.657 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:07:37.657 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:37.657 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.658 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.658 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.658 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:07:37.658 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:37.658 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.658 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.658 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.659 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:07:37.659 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:07:37.659 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:07:37.659 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:07:37.659 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:37.659 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:37.659 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:37.660 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.660 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.660 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:37.661 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:37.661 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:37.661 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:37.661 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:37.661 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:37.661 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:37.661 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:37.662 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:37.662 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:37.662 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:37.662 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:37.662 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:37.662 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.662 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.662 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.662 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:07:37.663 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:37.663 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.663 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.663 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.663 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:07:37.663 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:37.663 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.663 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.663 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.664 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.665 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:37.667 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:37.668 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.669 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.670 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:07:37.671 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:07:37.672 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:07:37.673 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:37.673 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:37.673 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:37.673 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.673 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.673 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.673 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:37.673 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:37.674 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:37.674 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:37.674 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:37.674 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:37.674 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:37.674 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:37.674 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:37.674 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:37.674 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.675 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.676 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.677 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:37.677 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.677 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.677 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.677 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:07:37.677 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:37.677 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.677 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.677 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.678 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.679 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:07:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:07:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.684 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.684 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:07:37.684 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:37.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.684 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.684 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.684 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.685 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:37.687 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:37.688 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:07:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:07:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:07:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:37.694 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:37.694 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:37.694 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.694 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.694 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.694 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:07:37.694 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:37.694 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.694 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.695 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.695 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:07:37.695 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:37.695 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.695 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.695 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.695 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:37.695 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.696 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.697 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:37.698 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.699 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:37.700 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:37.701 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:07:37.701 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:37.701 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.701 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.701 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:37.701 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:37.701 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:37.701 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:37.701 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:37.701 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:37.702 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:07:37.702 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:37.702 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.702 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.702 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:37.702 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:37.702 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:37.702 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:37.703 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:37.703 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:37.703 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:07:37.703 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:37.703 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.703 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.703 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:37.704 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:37.704 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:37.704 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:37.704 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:37.704 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:37.704 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:07:37.704 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:37.704 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.705 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.705 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:37.705 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:37.705 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:37.705 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:37.705 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:37.705 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:37.705 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:07:37.706 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:37.706 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.706 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.706 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:37.706 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:37.706 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:37.706 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:37.707 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:37.707 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:37.707 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:07:37.707 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:37.707 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.707 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:37.707 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:37.708 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:37.708 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:37.708 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:37.708 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:37.708 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:37.708 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:07:37.708 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:07:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:07:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:07:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:07:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:07:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:07:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:07:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:07:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:07:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:07:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:07:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:07:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:07:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:07:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:07:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:07:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:07:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:07:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:07:37.712 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:07:37.712 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:07:37.712 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:07:37.712 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:07:37.712 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:07:37.712 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:37.712 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:07:37.714 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 -- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1f0066f30 msgr2=0x7ff1f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:37.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1f0066f30 0x7ff1f00693e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff210068ce0 tx=0x7ff200001e50 comp rx=0 tx=0).stop 2023-12-24T20:07:37.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 -- 172.21.15.61:0/2233139347 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 msgr2=0x7ff2100c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:37.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff2100c9780 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7ff2040029b0 tx=0x7ff204007d30 comp rx=0 tx=0).stop 2023-12-24T20:07:37.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 -- 172.21.15.61:0/2233139347 shutdown_connections 2023-12-24T20:07:37.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff2100c7c90 0x7ff210068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:37.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:37.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1f80051c0 0x7ff2100c9780 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:37.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 --2- 172.21.15.61:0/2233139347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21014eca0 0x7ff210169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:37.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 -- 172.21.15.61:0/2233139347 >> 172.21.15.61:0/2233139347 conn(0x7ff2100cd6f0 msgr2=0x7ff210067760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:37.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 -- 172.21.15.61:0/2233139347 shutdown_connections 2023-12-24T20:07:37.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:37.603+0000 7ff214b11700 1 -- 172.21.15.61:0/2233139347 wait complete. 2023-12-24T20:07:37.716 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:07:42.717 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:07:42.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.853+0000 7f9f583f9700 1 Processor -- start 2023-12-24T20:07:42.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.853+0000 7f9f583f9700 1 -- start start 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.854+0000 7f9f583f9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f50068510 0x7f9f500cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.854+0000 7f9f583f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50159a60 0x7f9f50159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.854+0000 7f9f583f9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f500b2890 con 0x7f9f50068140 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.854+0000 7f9f583f9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f500cf630 con 0x7f9f50068510 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.854+0000 7f9f583f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b2240 con 0x7f9f50159a60 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.855+0000 7f9f56996700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50159a60 0x7f9f50159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.855+0000 7f9f55994700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f50068510 0x7f9f500cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.855+0000 7f9f56996700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50159a60 0x7f9f50159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:42718/0 (socket says 172.21.15.61:42718) 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.855+0000 7f9f56996700 1 -- 172.21.15.61:0/1693052676 learned_addr learned my addr 172.21.15.61:0/1693052676 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.855+0000 7f9f55994700 1 -- 172.21.15.61:0/1693052676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50159a60 msgr2=0x7f9f50159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.855+0000 7f9f55994700 1 --2- 172.21.15.61:0/1693052676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50159a60 0x7f9f50159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:42.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.855+0000 7f9f55994700 1 -- 172.21.15.61:0/1693052676 >> v1:172.21.15.133:6789/0 conn(0x7f9f50068140 legacy=0x7f9f500b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.855+0000 7f9f55994700 1 -- 172.21.15.61:0/1693052676 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f500b2520 con 0x7f9f50068510 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.855+0000 7f9f56996700 1 --2- 172.21.15.61:0/1693052676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50159a60 0x7f9f50159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.855+0000 7f9f55193700 1 -- 172.21.15.61:0/1693052676 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442077678 0 0) 0x7f9f500b2890 con 0x7f9f50068140 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f55994700 1 --2- 172.21.15.61:0/1693052676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f50068510 0x7f9f500cefa0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9f400098e0 tx=0x7f9f400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260ac68002b18b52 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f55193700 1 -- 172.21.15.61:0/1693052676 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4000b640 con 0x7f9f50068510 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f55193700 1 -- 172.21.15.61:0/1693052676 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4000b7a0 con 0x7f9f50068510 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f55193700 1 -- 172.21.15.61:0/1693052676 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4000bb40 con 0x7f9f50068510 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f583f9700 1 -- 172.21.15.61:0/1693052676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f50068510 msgr2=0x7f9f500cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f583f9700 1 --2- 172.21.15.61:0/1693052676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f50068510 0x7f9f500cefa0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9f400098e0 tx=0x7f9f400091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f583f9700 1 -- 172.21.15.61:0/1693052676 shutdown_connections 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f583f9700 1 --2- 172.21.15.61:0/1693052676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50159a60 0x7f9f50159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f583f9700 1 --2- 172.21.15.61:0/1693052676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f50068510 0x7f9f500cefa0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:42.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f583f9700 1 -- 172.21.15.61:0/1693052676 >> 172.21.15.61:0/1693052676 conn(0x7f9f50097a10 msgr2=0x7f9f500ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:42.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f583f9700 1 -- 172.21.15.61:0/1693052676 shutdown_connections 2023-12-24T20:07:42.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.856+0000 7f9f583f9700 1 -- 172.21.15.61:0/1693052676 wait complete. 2023-12-24T20:07:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f583f9700 1 Processor -- start 2023-12-24T20:07:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f583f9700 1 -- start start 2023-12-24T20:07:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f583f9700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50068140 0x7f9f5016e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f583f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f50068510 0x7f9f5009b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f583f9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f50159a60 0x7f9f501443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f583f9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5016d840 con 0x7f9f50159a60 2023-12-24T20:07:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f583f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5016a6e0 con 0x7f9f50068510 2023-12-24T20:07:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f583f9700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5016a9c0 con 0x7f9f50068140 2023-12-24T20:07:42.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f56996700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f50159a60 0x7f9f501443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f56996700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f50159a60 0x7f9f501443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57202/0 (socket says 172.21.15.61:57202) 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.858+0000 7f9f56996700 1 -- 172.21.15.61:0/3168241116 learned_addr learned my addr 172.21.15.61:0/3168241116 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f55994700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f50068510 0x7f9f5009b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f56195700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50068140 0x7f9f5016e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f56996700 1 -- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50068140 msgr2=0x7f9f5016e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f56996700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50068140 0x7f9f5016e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f56996700 1 -- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f50068510 msgr2=0x7f9f5009b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f56996700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f50068510 0x7f9f5009b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f56996700 1 -- 172.21.15.61:0/3168241116 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48009ae0 con 0x7f9f50159a60 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f56996700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f50159a60 0x7f9f501443b0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009f30 tx=0x7f9f4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f467fc700 1 -- 172.21.15.61:0/3168241116 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f48018070 con 0x7f9f50159a60 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f467fc700 1 -- 172.21.15.61:0/3168241116 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4800f040 con 0x7f9f50159a60 2023-12-24T20:07:42.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f467fc700 1 -- 172.21.15.61:0/3168241116 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4800cb70 con 0x7f9f50159a60 2023-12-24T20:07:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f583f9700 1 -- 172.21.15.61:0/3168241116 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f40009420 con 0x7f9f50159a60 2023-12-24T20:07:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.859+0000 7f9f583f9700 1 -- 172.21.15.61:0/3168241116 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5016af80 con 0x7f9f50159a60 2023-12-24T20:07:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.860+0000 7f9f583f9700 1 -- 172.21.15.61:0/3168241116 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5006d440 con 0x7f9f50159a60 2023-12-24T20:07:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.861+0000 7f9f467fc700 1 -- 172.21.15.61:0/3168241116 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9f48003020 con 0x7f9f50159a60 2023-12-24T20:07:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.861+0000 7f9f467fc700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9f34066f30 0x7f9f340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.861+0000 7f9f467fc700 1 -- 172.21.15.61:0/3168241116 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f48084380 con 0x7f9f50159a60 2023-12-24T20:07:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.861+0000 7f9f56195700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9f34066f30 0x7f9f340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:42.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.862+0000 7f9f56195700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9f34066f30 0x7f9f340693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c007fd0 tx=0x7f9f4c007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:42.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:42.866+0000 7f9f467fc700 1 -- 172.21.15.61:0/3168241116 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f4804d5a0 con 0x7f9f50159a60 2023-12-24T20:07:43.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.064+0000 7f9f583f9700 1 -- 172.21.15.61:0/3168241116 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9f5016b530 con 0x7f9f50159a60 2023-12-24T20:07:43.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.065+0000 7f9f467fc700 1 -- 172.21.15.61:0/3168241116 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v186) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f9f480515f0 con 0x7f9f50159a60 2023-12-24T20:07:43.065 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 186, 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:07:36.796624+0000", 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:07:43.066 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 23, 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:07:43.067 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:43.068 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:43.069 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.070 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:07:43.070 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:43.071 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:43.072 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:43.072 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:43.072 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:43.072 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:43.072 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:43.072 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:43.072 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:43.073 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:43.073 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:43.074 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 22, 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:17.930601+0000", 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:43.075 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:07:43.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "184", 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:43.077 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:43.078 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:43.079 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:43.079 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:43.079 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:43.079 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:43.079 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:43.079 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:43.079 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:43.079 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:43.080 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 23, 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:07:43.081 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:19.106020+0000", 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:07:43.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:43.083 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.084 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "186", 2023-12-24T20:07:43.084 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:43.084 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:43.084 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:43.084 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:43.085 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:43.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:43.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:43.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:43.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:43.086 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:43.086 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:43.086 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:43.086 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:43.086 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:43.087 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:07:43.088 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:07:43.088 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.088 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:43.088 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:43.088 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:07:43.088 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.088 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:43.089 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:43.090 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:43.090 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:43.090 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:43.090 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:43.090 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:43.090 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:43.090 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.090 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.090 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.090 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:07:43.091 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:43.091 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.091 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.091 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.091 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:07:43.091 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:43.091 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.091 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.091 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.091 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:43.092 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.092 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.092 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.092 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:07:43.092 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:43.092 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.092 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.092 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.092 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:07:43.092 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:43.093 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.093 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.093 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.093 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:43.093 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.093 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.093 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.093 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:07:43.094 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:43.094 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.094 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.094 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.094 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:07:43.094 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:43.094 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.094 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.094 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.094 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.095 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:43.096 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.097 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:43.098 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.099 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:43.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:43.101 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:43.102 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:43.103 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:43.103 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:43.103 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.103 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.103 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.103 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:07:43.103 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:43.103 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.104 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.105 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:07:43.106 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:43.107 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:43.108 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.109 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.110 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:07:43.111 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:43.112 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.112 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.112 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.112 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:07:43.112 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:43.112 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.112 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.112 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.112 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:07:43.112 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:07:43.113 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:07:43.113 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:07:43.113 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:43.113 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:43.113 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:43.113 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.113 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.113 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.113 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:07:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.118 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:43.119 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.120 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:07:43.122 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:43.122 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.122 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.122 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.122 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:43.122 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.122 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.122 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.122 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:07:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.127 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.127 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.127 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:07:43.127 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:43.127 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.127 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.127 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:07:43.129 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.130 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:43.131 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.132 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:07:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:07:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.141 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:43.142 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:43.143 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:07:43.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 -- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9f34066f30 msgr2=0x7f9f340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:43.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9f34066f30 0x7f9f340693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c007fd0 tx=0x7f9f4c007d10 comp rx=0 tx=0).stop 2023-12-24T20:07:43.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 -- 172.21.15.61:0/3168241116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f50159a60 msgr2=0x7f9f501443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:43.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f50159a60 0x7f9f501443b0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009f30 tx=0x7f9f4800b040 comp rx=0 tx=0).stop 2023-12-24T20:07:43.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 -- 172.21.15.61:0/3168241116 shutdown_connections 2023-12-24T20:07:43.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9f50068140 0x7f9f5016e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:43.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9f34066f30 0x7f9f340693e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:43.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9f50159a60 0x7f9f501443b0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:43.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 --2- 172.21.15.61:0/3168241116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f50068510 0x7f9f5009b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:43.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 -- 172.21.15.61:0/3168241116 >> 172.21.15.61:0/3168241116 conn(0x7f9f50097a10 msgr2=0x7f9f500ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:43.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 -- 172.21.15.61:0/3168241116 shutdown_connections 2023-12-24T20:07:43.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:43.067+0000 7f9f583f9700 1 -- 172.21.15.61:0/3168241116 wait complete. 2023-12-24T20:07:43.146 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:07:48.147 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:07:48.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.283+0000 7f5eee399700 1 Processor -- start 2023-12-24T20:07:48.283 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.283+0000 7f5eee399700 1 -- start start 2023-12-24T20:07:48.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5eee399700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5ee815bb60 0x7f5ee8098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5eee399700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ee80b2660 0x7f5ee80b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5eee399700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80b2eb0 con 0x7f5ee8098aa0 2023-12-24T20:07:48.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5eee399700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80afc20 con 0x7f5ee815bb60 2023-12-24T20:07:48.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5eee399700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80b2bd0 con 0x7f5ee80b2660 2023-12-24T20:07:48.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5ee7fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5ee815bb60 0x7f5ee8098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5ee77fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f5ee8098aa0 0x7f5ee815bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39166/0 (socket says 172.21.15.61:39166) 2023-12-24T20:07:48.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5ee77fe700 1 -- 172.21.15.61:0/3659286938 learned_addr learned my addr 172.21.15.61:0/3659286938 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:48.286 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5eec936700 1 --2- 172.21.15.61:0/3659286938 >> v2:172.21.15.133:3300/0 conn(0x7f5ee80b2660 0x7f5ee80b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5ee7fff700 1 -- 172.21.15.61:0/3659286938 >> v2:172.21.15.133:3300/0 conn(0x7f5ee80b2660 msgr2=0x7f5ee80b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5ee7fff700 1 --2- 172.21.15.61:0/3659286938 >> v2:172.21.15.133:3300/0 conn(0x7f5ee80b2660 0x7f5ee80b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5ee7fff700 1 -- 172.21.15.61:0/3659286938 >> v1:172.21.15.61:6789/0 conn(0x7f5ee8098aa0 legacy=0x7f5ee815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5ee7fff700 1 -- 172.21.15.61:0/3659286938 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80afe10 con 0x7f5ee815bb60 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.284+0000 7f5eec936700 1 --2- 172.21.15.61:0/3659286938 >> v2:172.21.15.133:3300/0 conn(0x7f5ee80b2660 0x7f5ee80b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5ee7fff700 1 --2- 172.21.15.61:0/3659286938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 0x7f5ee8098560 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80a9750 tx=0x7f5ed8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c184459e9fe1e13 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5ee6ffd700 1 -- 172.21.15.61:0/3659286938 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8005c10 con 0x7f5ee815bb60 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5ee6ffd700 1 -- 172.21.15.61:0/3659286938 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed8005d70 con 0x7f5ee815bb60 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5ee6ffd700 1 -- 172.21.15.61:0/3659286938 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8006260 con 0x7f5ee815bb60 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5eee399700 1 -- 172.21.15.61:0/3659286938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 msgr2=0x7f5ee8098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5eee399700 1 --2- 172.21.15.61:0/3659286938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 0x7f5ee8098560 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80a9750 tx=0x7f5ed8009120 comp rx=0 tx=0).stop 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5eee399700 1 -- 172.21.15.61:0/3659286938 shutdown_connections 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5eee399700 1 --2- 172.21.15.61:0/3659286938 >> v2:172.21.15.133:3300/0 conn(0x7f5ee80b2660 0x7f5ee80b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5eee399700 1 --2- 172.21.15.61:0/3659286938 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 0x7f5ee8098560 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.287 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5eee399700 1 -- 172.21.15.61:0/3659286938 >> 172.21.15.61:0/3659286938 conn(0x7f5ee8097a10 msgr2=0x7f5ee80ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:48.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5eee399700 1 -- 172.21.15.61:0/3659286938 shutdown_connections 2023-12-24T20:07:48.288 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.285+0000 7f5eee399700 1 -- 172.21.15.61:0/3659286938 wait complete. 2023-12-24T20:07:48.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.286+0000 7f5eee399700 1 Processor -- start 2023-12-24T20:07:48.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.287+0000 7f5eee399700 1 -- start start 2023-12-24T20:07:48.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.287+0000 7f5eee399700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ee8098aa0 0x7f5ee80c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.287+0000 7f5eee399700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ee80b2660 0x7f5ee80ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.287+0000 7f5eee399700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 0x7f5ee814fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.287+0000 7f5eee399700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80ac8b0 con 0x7f5ee815bb60 2023-12-24T20:07:48.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.287+0000 7f5eee399700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80aa9a0 con 0x7f5ee80b2660 2023-12-24T20:07:48.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.287+0000 7f5eee399700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80abe90 con 0x7f5ee8098aa0 2023-12-24T20:07:48.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.287+0000 7f5eec936700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 0x7f5ee814fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.287+0000 7f5eec936700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 0x7f5ee814fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34380/0 (socket says 172.21.15.61:34380) 2023-12-24T20:07:48.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.287+0000 7f5eec936700 1 -- 172.21.15.61:0/3702911884 learned_addr learned my addr 172.21.15.61:0/3702911884 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:48.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5ee7fff700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ee8098aa0 0x7f5ee80c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5eec936700 1 -- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ee8098aa0 msgr2=0x7f5ee80c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:48.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5eec936700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ee8098aa0 0x7f5ee80c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5eec936700 1 -- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ee80b2660 msgr2=0x7f5ee80ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:48.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5eec936700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ee80b2660 0x7f5ee80ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5eec936700 1 -- 172.21.15.61:0/3702911884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80093c0 con 0x7f5ee815bb60 2023-12-24T20:07:48.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5eec936700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 0x7f5ee814fcb0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000a380 tx=0x7f5ee0007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:48.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5edffff700 1 -- 172.21.15.61:0/3702911884 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000ae10 con 0x7f5ee815bb60 2023-12-24T20:07:48.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5edffff700 1 -- 172.21.15.61:0/3702911884 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee000d650 con 0x7f5ee815bb60 2023-12-24T20:07:48.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5edffff700 1 -- 172.21.15.61:0/3702911884 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000da10 con 0x7f5ee815bb60 2023-12-24T20:07:48.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5eee399700 1 -- 172.21.15.61:0/3702911884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee80aac40 con 0x7f5ee815bb60 2023-12-24T20:07:48.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.288+0000 7f5eee399700 1 -- 172.21.15.61:0/3702911884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee80aaf20 con 0x7f5ee815bb60 2023-12-24T20:07:48.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.289+0000 7f5eee399700 1 -- 172.21.15.61:0/3702911884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee806d440 con 0x7f5ee815bb60 2023-12-24T20:07:48.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.290+0000 7f5edffff700 1 -- 172.21.15.61:0/3702911884 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5ee001e3b0 con 0x7f5ee815bb60 2023-12-24T20:07:48.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.290+0000 7f5edffff700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ec8066f30 0x7f5ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.290+0000 7f5edffff700 1 -- 172.21.15.61:0/3702911884 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ee0084f40 con 0x7f5ee815bb60 2023-12-24T20:07:48.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.290+0000 7f5edffff700 1 -- 172.21.15.61:0/3702911884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f5ec806ea50 con 0x7f5ee815bb60 2023-12-24T20:07:48.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.290+0000 7f5ee7fff700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ec8066f30 0x7f5ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.291+0000 7f5ee7fff700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ec8066f30 0x7f5ec80693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80a9750 tx=0x7f5ed8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:48.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.294+0000 7f5edffff700 1 -- 172.21.15.61:0/3702911884 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ee001a020 con 0x7f5ee815bb60 2023-12-24T20:07:48.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.490+0000 7f5eee399700 1 -- 172.21.15.61:0/3702911884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5ee80ac050 con 0x7f5ee815bb60 2023-12-24T20:07:48.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.491+0000 7f5edffff700 1 -- 172.21.15.61:0/3702911884 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f5ee00521b0 con 0x7f5ee815bb60 2023-12-24T20:07:48.492 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:48.492 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:07:48.492 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 187, 2023-12-24T20:07:48.492 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:07:48.492 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:07:48.492 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:07:43.622248+0000", 2023-12-24T20:07:48.492 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:07:48.492 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:07:48.492 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:07:48.492 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 23, 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:07:48.493 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:48.494 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:48.495 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:48.496 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:48.497 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:48.497 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:48.497 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:48.497 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:48.497 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:48.497 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:48.497 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:48.497 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:48.497 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:48.498 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 22, 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:17.930601+0000", 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:48.499 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:48.500 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:48.500 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:48.500 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:48.500 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:48.500 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:48.500 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:48.501 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "184", 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:48.502 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:48.503 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:48.504 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.505 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 23, 2023-12-24T20:07:48.506 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:07:48.506 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:19.106020+0000", 2023-12-24T20:07:48.506 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1027, 2023-12-24T20:07:48.506 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-24T20:07:48.506 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:48.507 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:48.507 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:48.507 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:48.507 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:48.507 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:48.507 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:48.507 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:48.507 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:48.507 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:48.507 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:07:48.508 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:07:48.508 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:07:48.508 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:07:48.508 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:07:48.508 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:48.508 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:48.508 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:48.508 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:48.508 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:48.508 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "187", 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:48.509 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:48.510 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:48.510 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:07:48.510 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:48.510 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:48.510 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:48.510 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:48.510 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:48.510 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:48.510 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:48.510 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:48.511 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:48.511 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:48.511 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:48.511 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:48.511 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:48.511 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:48.512 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:48.513 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.514 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:48.515 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.516 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.517 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.518 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.519 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:07:48.520 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:48.521 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.521 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.521 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.521 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:07:48.521 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:48.521 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.521 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.521 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.522 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.523 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:48.524 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.525 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.526 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:07:48.527 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:48.528 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:07:48.529 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:48.530 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:48.531 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:48.531 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:48.531 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:48.531 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.531 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.531 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.531 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:07:48.531 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:48.532 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.532 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.532 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.532 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:07:48.532 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:48.532 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.532 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.532 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.532 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:48.533 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:48.534 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:07:48.535 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.536 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:48.537 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.538 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:48.539 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.540 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.541 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.541 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:48.541 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.541 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.541 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.541 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:07:48.541 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:48.541 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.541 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.541 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.542 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:07:48.542 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:48.542 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.542 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.542 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.542 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:07:48.542 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:07:48.542 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:07:48.542 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:07:48.542 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:48.543 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:48.543 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:48.543 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.543 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.543 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.543 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:48.543 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:48.543 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:48.543 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:48.543 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.544 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.545 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.546 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:07:48.547 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:48.548 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.548 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.548 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.548 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:07:48.548 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:48.548 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.548 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.548 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.548 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:48.549 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:07:48.550 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:48.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.552 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.553 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.554 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.555 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.556 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.557 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:48.558 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:48.559 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.560 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:48.561 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.562 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:48.563 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.564 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:07:48.565 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:07:48.566 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:07:48.567 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:07:48.567 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:07:48.567 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:07:48.567 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:07:48.567 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:07:48.567 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:48.567 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 -- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ec8066f30 msgr2=0x7f5ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ec8066f30 0x7f5ec80693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80a9750 tx=0x7f5ed8016000 comp rx=0 tx=0).stop 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 -- 172.21.15.61:0/3702911884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 msgr2=0x7f5ee814fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 0x7f5ee814fcb0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000a380 tx=0x7f5ee0007900 comp rx=0 tx=0).stop 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 -- 172.21.15.61:0/3702911884 shutdown_connections 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5ee8098aa0 0x7f5ee80c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5ec8066f30 0x7f5ec80693e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ee815bb60 0x7f5ee814fcb0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 --2- 172.21.15.61:0/3702911884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ee80b2660 0x7f5ee80ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 -- 172.21.15.61:0/3702911884 >> 172.21.15.61:0/3702911884 conn(0x7f5ee8097a10 msgr2=0x7f5ee809bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 -- 172.21.15.61:0/3702911884 shutdown_connections 2023-12-24T20:07:48.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.493+0000 7f5eee399700 1 -- 172.21.15.61:0/3702911884 wait complete. 2023-12-24T20:07:48.570 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-24T20:07:48.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:48.571 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-12-24T20:07:48.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:07:48.651 INFO:teuthology.orchestra.run.smithi061.stderr:dd: error writing 'large_file_b': No space left on device 2023-12-24T20:07:48.651 INFO:teuthology.orchestra.run.smithi061.stderr:dd: closing output file 'large_file_b': No space left on device 2023-12-24T20:07:48.651 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:07:48.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.772+0000 7f39bb1c8700 1 Processor -- start 2023-12-24T20:07:48.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.773+0000 7f39bb1c8700 1 -- start start 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39bb1c8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f39b415bb60 0x7f39b4098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39bb1c8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39b4098aa0 0x7f39b415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39bb1c8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f39b415c470 0x7f39b40b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39bb1c8700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b40afc20 con 0x7f39b415c470 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39bb1c8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b40b2eb0 con 0x7f39b415bb60 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39bb1c8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b2bd0 con 0x7f39b4098aa0 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b9765700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f39b415c470 0x7f39b40b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b9765700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f39b415c470 0x7f39b40b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34392/0 (socket says 172.21.15.61:34392) 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b9765700 1 -- 172.21.15.61:0/3985234711 learned_addr learned my addr 172.21.15.61:0/3985234711 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b8f64700 1 --2- 172.21.15.61:0/3985234711 >> v2:172.21.15.133:3300/0 conn(0x7f39b415bb60 0x7f39b4098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b9765700 1 -- 172.21.15.61:0/3985234711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39b4098aa0 msgr2=0x7f39b415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:48.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b3fff700 1 --2- 172.21.15.61:0/3985234711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39b4098aa0 0x7f39b415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b9765700 1 --2- 172.21.15.61:0/3985234711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39b4098aa0 0x7f39b415bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b9765700 1 -- 172.21.15.61:0/3985234711 >> v2:172.21.15.133:3300/0 conn(0x7f39b415bb60 msgr2=0x7f39b4098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b9765700 1 --2- 172.21.15.61:0/3985234711 >> v2:172.21.15.133:3300/0 conn(0x7f39b415bb60 0x7f39b4098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b9765700 1 -- 172.21.15.61:0/3985234711 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40afe10 con 0x7f39b415c470 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b8f64700 1 --2- 172.21.15.61:0/3985234711 >> v2:172.21.15.133:3300/0 conn(0x7f39b415bb60 0x7f39b4098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b9765700 1 --2- 172.21.15.61:0/3985234711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 0x7f39b40b08f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f39b406d9b0 tx=0x7f39ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf48ad0d1b9311de server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.774+0000 7f39b37fe700 1 -- 172.21.15.61:0/3985234711 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac00e070 con 0x7f39b415c470 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39b37fe700 1 -- 172.21.15.61:0/3985234711 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac00ba50 con 0x7f39b415c470 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39b37fe700 1 -- 172.21.15.61:0/3985234711 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0092e0 con 0x7f39b415c470 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3985234711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 msgr2=0x7f39b40b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39bb1c8700 1 --2- 172.21.15.61:0/3985234711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 0x7f39b40b08f0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f39b406d9b0 tx=0x7f39ac009840 comp rx=0 tx=0).stop 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3985234711 shutdown_connections 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39bb1c8700 1 --2- 172.21.15.61:0/3985234711 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 0x7f39b40b08f0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39bb1c8700 1 --2- 172.21.15.61:0/3985234711 >> v2:172.21.15.133:3300/0 conn(0x7f39b415bb60 0x7f39b4098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39bb1c8700 1 --2- 172.21.15.61:0/3985234711 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39b4098aa0 0x7f39b415bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3985234711 >> 172.21.15.61:0/3985234711 conn(0x7f39b4097a10 msgr2=0x7f39b40ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3985234711 shutdown_connections 2023-12-24T20:07:48.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.775+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3985234711 wait complete. 2023-12-24T20:07:48.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.777+0000 7f39bb1c8700 1 Processor -- start 2023-12-24T20:07:48.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.777+0000 7f39bb1c8700 1 -- start start 2023-12-24T20:07:48.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39bb1c8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39b4098aa0 0x7f39b40b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39bb1c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39b415bb60 0x7f39b4151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39bb1c8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 0x7f39b41520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39bb1c8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4152620 con 0x7f39b415c470 2023-12-24T20:07:48.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39bb1c8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40abd60 con 0x7f39b415bb60 2023-12-24T20:07:48.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39bb1c8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40ac040 con 0x7f39b4098aa0 2023-12-24T20:07:48.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b9765700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 0x7f39b41520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b9765700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 0x7f39b41520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34402/0 (socket says 172.21.15.61:34402) 2023-12-24T20:07:48.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b9765700 1 -- 172.21.15.61:0/3256286560 learned_addr learned my addr 172.21.15.61:0/3256286560 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:48.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b3fff700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39b415bb60 0x7f39b4151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b8f64700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39b4098aa0 0x7f39b40b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b9765700 1 -- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39b4098aa0 msgr2=0x7f39b40b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:48.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b9765700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39b4098aa0 0x7f39b40b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b9765700 1 -- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39b415bb60 msgr2=0x7f39b4151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:48.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b9765700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39b415bb60 0x7f39b4151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:48.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b9765700 1 -- 172.21.15.61:0/3256286560 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac009ae0 con 0x7f39b415c470 2023-12-24T20:07:48.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b9765700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 0x7f39b41520e0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f39b406d8b0 tx=0x7f39ac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:48.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.778+0000 7f39b0ff9700 1 -- 172.21.15.61:0/3256286560 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac008e80 con 0x7f39b415c470 2023-12-24T20:07:48.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.779+0000 7f39b0ff9700 1 -- 172.21.15.61:0/3256286560 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac01c410 con 0x7f39b415c470 2023-12-24T20:07:48.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.779+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3256286560 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b40ac320 con 0x7f39b415c470 2023-12-24T20:07:48.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.779+0000 7f39b0ff9700 1 -- 172.21.15.61:0/3256286560 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac01c7b0 con 0x7f39b415c470 2023-12-24T20:07:48.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.779+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3256286560 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b40ac8e0 con 0x7f39b415c470 2023-12-24T20:07:48.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.779+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3256286560 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b406d440 con 0x7f39b415c470 2023-12-24T20:07:48.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.780+0000 7f39b0ff9700 1 -- 172.21.15.61:0/3256286560 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f39ac003040 con 0x7f39b415c470 2023-12-24T20:07:48.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.780+0000 7f39b0ff9700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3998066f30 0x7f39980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:48.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.780+0000 7f39b0ff9700 1 -- 172.21.15.61:0/3256286560 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f39ac085f60 con 0x7f39b415c470 2023-12-24T20:07:48.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.780+0000 7f39b0ff9700 1 -- 172.21.15.61:0/3256286560 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f399806ea50 con 0x7f39b415c470 2023-12-24T20:07:48.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.781+0000 7f39b8f64700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3998066f30 0x7f39980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:48.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.781+0000 7f39b8f64700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3998066f30 0x7f39980693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f39a800ab80 tx=0x7f39a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:48.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.785+0000 7f39b0ff9700 1 -- 172.21.15.61:0/3256286560 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39ac0531d0 con 0x7f39b415c470 2023-12-24T20:07:48.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.986+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3256286560 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f39b40acb00 con 0x7f39b415c470 2023-12-24T20:07:48.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.987+0000 7f39b0ff9700 1 -- 172.21.15.61:0/3256286560 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f39ac02b090 con 0x7f39b415c470 2023-12-24T20:07:48.988 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:48.988 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:07:48.988 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 187, 2023-12-24T20:07:48.989 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:07:48.989 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:07:48.989 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:07:43.622248+0000", 2023-12-24T20:07:48.989 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:07:48.989 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:07:48.989 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:07:48.989 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:07:48.989 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:07:48.990 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:07:48.990 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:07:48.990 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:07:48.990 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:07:48.990 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:48.990 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:07:48.991 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:07:48.991 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:07:48.991 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:07:48.991 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:07:48.991 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 23, 2023-12-24T20:07:48.991 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:07:48.991 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:07:48.992 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:07:48.992 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:07:48.992 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:07:48.992 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:07:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:07:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:07:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:48.994 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:48.994 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:48.994 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:48.994 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:48.994 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:48.996 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:07:48.997 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:07:48.997 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:07:48.997 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:07:48.997 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:07:48.997 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:48.997 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:48.997 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:48.997 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:48.997 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:48.998 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:48.998 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:48.998 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:48.998 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:07:48.998 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:48.998 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:48.998 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:48.998 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:48.998 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:48.999 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:48.999 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:48.999 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:48.999 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:48.999 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:49.000 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:49.000 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:49.000 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:49.000 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:49.000 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:49.000 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:49.000 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:49.001 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.002 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 22, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:17.930601+0000", 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:49.003 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.004 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "184", 2023-12-24T20:07:49.005 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:49.005 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:49.005 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:49.005 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:49.005 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:49.005 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:49.005 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:49.006 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:49.007 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 23, 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:19.106020+0000", 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1027, 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "187", 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:49.012 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:49.013 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.014 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.015 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.016 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.017 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.018 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:07:49.024 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:49.025 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.026 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:07:49.027 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:49.028 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:49.029 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:49.030 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.031 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:07:49.032 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.034 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.035 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:49.036 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:49.037 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.038 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.039 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:07:49.040 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:49.041 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.042 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.044 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.045 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:49.046 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.047 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.049 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:07:49.050 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:49.051 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.052 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.053 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.054 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.056 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.056 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:07:49.056 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:49.056 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.056 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.056 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.056 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:07:49.056 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:49.057 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.057 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.057 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.057 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:49.057 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:49.057 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.057 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:49.057 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:07:49.058 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:49.058 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.058 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.058 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:49.058 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:07:49.058 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:49.058 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.058 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.058 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.059 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:07:49.059 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:07:49.059 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:07:49.059 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:07:49.059 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:49.059 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:49.059 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:49.059 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:49.059 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.060 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:49.060 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:07:49.060 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.060 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:49.060 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:49.061 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.062 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:49.064 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:07:49.064 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:49.064 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.064 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.064 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:49.064 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:49.064 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:49.065 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:49.065 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:49.065 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:49.065 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:07:49.065 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:49.065 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.066 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.066 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:49.066 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:49.066 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:49.066 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:49.066 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:49.066 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:49.066 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:07:49.066 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:49.067 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.068 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:49.069 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:07:49.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3998066f30 msgr2=0x7f39980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3998066f30 0x7f39980693e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f39a800ab80 tx=0x7f39a8008040 comp rx=0 tx=0).stop 2023-12-24T20:07:49.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3256286560 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 msgr2=0x7f39b41520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 0x7f39b41520e0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f39b406d8b0 tx=0x7f39ac018000 comp rx=0 tx=0).stop 2023-12-24T20:07:49.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3256286560 shutdown_connections 2023-12-24T20:07:49.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f39b4098aa0 0x7f39b40b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3998066f30 0x7f39980693e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f39b415c470 0x7f39b41520e0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 --2- 172.21.15.61:0/3256286560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39b415bb60 0x7f39b4151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3256286560 >> 172.21.15.61:0/3256286560 conn(0x7f39b4097a10 msgr2=0x7f39b40ae120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:49.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3256286560 shutdown_connections 2023-12-24T20:07:49.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:48.989+0000 7f39bb1c8700 1 -- 172.21.15.61:0/3256286560 wait complete. 2023-12-24T20:07:49.073 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:07:49.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.195+0000 7f630a872700 1 Processor -- start 2023-12-24T20:07:49.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.195+0000 7f630a872700 1 -- start start 2023-12-24T20:07:49.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.195+0000 7f630a872700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63040af710 0x7f63040afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f630a872700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f630415acf0 0x7f6304067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f630a872700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63040687f0 con 0x7f6304068c80 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f630a872700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6304067be0 con 0x7f630415acf0 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f630a872700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6304067ec0 con 0x7f63040af710 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f63037fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f6304068c80 0x7f630415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39176/0 (socket says 172.21.15.61:39176) 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f63037fe700 1 -- 172.21.15.61:0/3787848668 learned_addr learned my addr 172.21.15.61:0/3787848668 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6308e0f700 1 --2- 172.21.15.61:0/3787848668 >> v2:172.21.15.133:3300/0 conn(0x7f630415acf0 0x7f6304067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6303fff700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63040af710 0x7f63040afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432206632 0 0) 0x7f63040687f0 con 0x7f6304068c80 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62ec003570 con 0x7f6304068c80 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847518454 0 0) 0x7f62ec003570 con 0x7f6304068c80 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63040af710 msgr2=0x7f63040afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63040af710 0x7f63040afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 >> v2:172.21.15.133:3300/0 conn(0x7f630415acf0 msgr2=0x7f6304067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:49.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 --2- 172.21.15.61:0/3787848668 >> v2:172.21.15.133:3300/0 conn(0x7f630415acf0 0x7f6304067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63040681a0 con 0x7f6304068c80 2023-12-24T20:07:49.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f62f8001470 con 0x7f6304068c80 2023-12-24T20:07:49.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 >> v1:172.21.15.61:6789/0 conn(0x7f6304068c80 legacy=0x7f630415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63040af710 0x7f62ec003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 0x7f62ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62ec004d50 0x7f62ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6304067be0 con 0x7f62ec003fe0 2023-12-24T20:07:49.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6304067ec0 con 0x7f62ec004d50 2023-12-24T20:07:49.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec00ba90 con 0x7f63040af710 2023-12-24T20:07:49.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.196+0000 7f63037fe700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 0x7f62ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f6303fff700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63040af710 0x7f62ec003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f6308e0f700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62ec004d50 0x7f62ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f63037fe700 1 -- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63040af710 msgr2=0x7f62ec003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f63037fe700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f63040af710 0x7f62ec003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f63037fe700 1 -- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62ec004d50 msgr2=0x7f62ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f63037fe700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62ec004d50 0x7f62ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f63037fe700 1 -- 172.21.15.61:0/3787848668 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec003570 con 0x7f62ec003fe0 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f63037fe700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 0x7f62ec004810 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f62f800c390 tx=0x7f63040b0020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e58fa9dae36f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f800cc00 con 0x7f62ec003fe0 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f800cd60 con 0x7f62ec003fe0 2023-12-24T20:07:49.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.197+0000 7f6302ffd700 1 -- 172.21.15.61:0/3787848668 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8005b70 con 0x7f62ec003fe0 2023-12-24T20:07:49.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.198+0000 7f630a872700 1 -- 172.21.15.61:0/3787848668 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 msgr2=0x7f62ec004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.198+0000 7f630a872700 1 --2- 172.21.15.61:0/3787848668 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 0x7f62ec004810 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f62f800c390 tx=0x7f63040b0020 comp rx=0 tx=0).stop 2023-12-24T20:07:49.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.198+0000 7f6308e0f700 1 -- 172.21.15.61:0/3787848668 reap_dead start 2023-12-24T20:07:49.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.198+0000 7f630a872700 1 -- 172.21.15.61:0/3787848668 shutdown_connections 2023-12-24T20:07:49.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.198+0000 7f630a872700 1 -- 172.21.15.61:0/3787848668 >> 172.21.15.61:0/3787848668 conn(0x7f63040ca200 msgr2=0x7f63040ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:49.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.198+0000 7f630a872700 1 -- 172.21.15.61:0/3787848668 shutdown_connections 2023-12-24T20:07:49.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.198+0000 7f630a872700 1 -- 172.21.15.61:0/3787848668 wait complete. 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.199+0000 7f630a872700 1 Processor -- start 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.199+0000 7f630a872700 1 -- start start 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f630a872700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 0x7f63041541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f630a872700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6304159a00 0x7f6304159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f630a872700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63040b1500 0x7f63040b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f630a872700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63040b1ee0 con 0x7f62ec003fe0 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f630a872700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630415a3b0 con 0x7f63040b1500 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f630a872700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6304158350 con 0x7f6304159a00 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6303fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 0x7f63041541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6303fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 0x7f63041541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34418/0 (socket says 172.21.15.61:34418) 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6303fff700 1 -- 172.21.15.61:0/4077016836 learned_addr learned my addr 172.21.15.61:0/4077016836 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f63037fe700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6304159a00 0x7f6304159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6308e0f700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63040b1500 0x7f63040b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6303fff700 1 -- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6304159a00 msgr2=0x7f6304159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6303fff700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6304159a00 0x7f6304159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6303fff700 1 -- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63040b1500 msgr2=0x7f63040b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6303fff700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63040b1500 0x7f63040b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6303fff700 1 -- 172.21.15.61:0/4077016836 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63041591b0 con 0x7f62ec003fe0 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6308e0f700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63040b1500 0x7f63040b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f63037fe700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6304159a00 0x7f6304159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f6303fff700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 0x7f63041541f0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f62f4011d70 tx=0x7f62f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f62ebfff700 1 -- 172.21.15.61:0/4077016836 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4009e20 con 0x7f62ec003fe0 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f62ebfff700 1 -- 172.21.15.61:0/4077016836 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f400fcd0 con 0x7f62ec003fe0 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f630a872700 1 -- 172.21.15.61:0/4077016836 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63041585a0 con 0x7f62ec003fe0 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.200+0000 7f62ebfff700 1 -- 172.21.15.61:0/4077016836 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4014650 con 0x7f62ec003fe0 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.201+0000 7f630a872700 1 -- 172.21.15.61:0/4077016836 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6304158b60 con 0x7f62ec003fe0 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.201+0000 7f630a872700 1 -- 172.21.15.61:0/4077016836 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6304064a20 con 0x7f62ec003fe0 2023-12-24T20:07:49.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.202+0000 7f62ebfff700 1 -- 172.21.15.61:0/4077016836 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f62f4014a80 con 0x7f62ec003fe0 2023-12-24T20:07:49.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.202+0000 7f62ebfff700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f62f0066f30 0x7f62f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.202+0000 7f62ebfff700 1 -- 172.21.15.61:0/4077016836 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62f4018030 con 0x7f62ec003fe0 2023-12-24T20:07:49.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.202+0000 7f62ebfff700 1 -- 172.21.15.61:0/4077016836 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f62f006ea50 con 0x7f62ec003fe0 2023-12-24T20:07:49.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.203+0000 7f63037fe700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f62f0066f30 0x7f62f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.203+0000 7f63037fe700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f62f0066f30 0x7f62f00693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f63040ccd40 tx=0x7f62f8015000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:49.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.206+0000 7f62ebfff700 1 -- 172.21.15.61:0/4077016836 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62f4022060 con 0x7f62ec003fe0 2023-12-24T20:07:49.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.444+0000 7f630a872700 1 -- 172.21.15.61:0/4077016836 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f630404c3c0 con 0x7f62ec003fe0 2023-12-24T20:07:49.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.444+0000 7f62ebfff700 1 -- 172.21.15.61:0/4077016836 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f62f4059e60 con 0x7f62ec003fe0 2023-12-24T20:07:49.445 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:49.445 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1018177900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1018177900},{"type":"v1","addr":"172.21.15.133:6836","nonce":1018177900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2332940307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2332940307},{"type":"v1","addr":"172.21.15.61:6834","nonce":2332940307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/784121250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":784121250},{"type":"v1","addr":"172.21.15.61:6835","nonce":784121250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:07:20.139140+0000","modified":"2023-12-24T20:07:23.769968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8145":{"gid":8145,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2891152875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2891152875},{"type":"v1","addr":"172.21.15.133:6837","nonce":2891152875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:07:49.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.446+0000 7f630a872700 1 -- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f62f0066f30 msgr2=0x7f62f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.446+0000 7f630a872700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f62f0066f30 0x7f62f00693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f63040ccd40 tx=0x7f62f8015000 comp rx=0 tx=0).stop 2023-12-24T20:07:49.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.446+0000 7f630a872700 1 -- 172.21.15.61:0/4077016836 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 msgr2=0x7f63041541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.446+0000 7f630a872700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 0x7f63041541f0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f62f4011d70 tx=0x7f62f40091a0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.446+0000 7f630a872700 1 -- 172.21.15.61:0/4077016836 shutdown_connections 2023-12-24T20:07:49.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.446+0000 7f630a872700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f62f0066f30 0x7f62f00693e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.446+0000 7f630a872700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63040b1500 0x7f63040b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.446+0000 7f630a872700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f62ec003fe0 0x7f63041541f0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.446+0000 7f630a872700 1 --2- 172.21.15.61:0/4077016836 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f6304159a00 0x7f6304159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.446+0000 7f630a872700 1 -- 172.21.15.61:0/4077016836 >> 172.21.15.61:0/4077016836 conn(0x7f63040ca200 msgr2=0x7f63040cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:49.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.447+0000 7f630a872700 1 -- 172.21.15.61:0/4077016836 shutdown_connections 2023-12-24T20:07:49.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.447+0000 7f630a872700 1 -- 172.21.15.61:0/4077016836 wait complete. 2023-12-24T20:07:49.448 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 92 2023-12-24T20:07:49.459 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-24T20:07:49.607 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":8145,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.857919514999999,"mdsmap_epoch":92,"osdmap_epoch":187,"osdmap_epoch_barrier":185,"uptime":34.887997153999997} 2023-12-24T20:07:49.608 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 8145, "mdsmap_epoch": 92, "osdmap_epoch": 187, "osdmap_epoch_barrier": 185, "rank_uptime": 28.857919515, "state": "up:active", "uptime": 34.887997154, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:07:49.608 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-24T20:07:49.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:49.608 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-24T20:07:49.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:07:49.629 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-24T20:07:49.692 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:07:49.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.855+0000 7f74525af700 1 Processor -- start 2023-12-24T20:07:49.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.855+0000 7f74525af700 1 -- start start 2023-12-24T20:07:49.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f74525af700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c159e60 0x7f744c0c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f74525af700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f744c070d50 0x7f744c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f74525af700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c06a090 con 0x7f744c159a90 2023-12-24T20:07:49.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f74525af700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744c06ac10 con 0x7f744c070d50 2023-12-24T20:07:49.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f74525af700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c0c9e40 con 0x7f744c159e60 2023-12-24T20:07:49.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f7450b4c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f744c070d50 0x7f744c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f7450b4c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f744c070d50 0x7f744c0c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34432/0 (socket says 172.21.15.61:34432) 2023-12-24T20:07:49.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f7450b4c700 1 -- 172.21.15.61:0/3336979104 learned_addr learned my addr 172.21.15.61:0/3336979104 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f744b7fe700 1 --2- 172.21.15.61:0/3336979104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c159e60 0x7f744c0c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f7450b4c700 1 -- 172.21.15.61:0/3336979104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c159e60 msgr2=0x7f744c0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f7450b4c700 1 --2- 172.21.15.61:0/3336979104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c159e60 0x7f744c0c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f7450b4c700 1 -- 172.21.15.61:0/3336979104 >> v1:172.21.15.133:6789/0 conn(0x7f744c159a90 legacy=0x7f744c070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f7450b4c700 1 -- 172.21.15.61:0/3336979104 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c06a2e0 con 0x7f744c070d50 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.856+0000 7f744b7fe700 1 --2- 172.21.15.61:0/3336979104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c159e60 0x7f744c0c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f7450b4c700 1 --2- 172.21.15.61:0/3336979104 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c070d50 0x7f744c0c9900 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7444009f20 tx=0x7f7444009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8d724acc62ce04 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f744affd700 1 -- 172.21.15.61:0/3336979104 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744400e070 con 0x7f744c070d50 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f744affd700 1 -- 172.21.15.61:0/3336979104 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744400ba80 con 0x7f744c070d50 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f744affd700 1 -- 172.21.15.61:0/3336979104 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440092e0 con 0x7f744c070d50 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f74525af700 1 -- 172.21.15.61:0/3336979104 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c070d50 msgr2=0x7f744c0c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f74525af700 1 --2- 172.21.15.61:0/3336979104 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c070d50 0x7f744c0c9900 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7444009f20 tx=0x7f7444009840 comp rx=0 tx=0).stop 2023-12-24T20:07:49.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f74525af700 1 -- 172.21.15.61:0/3336979104 shutdown_connections 2023-12-24T20:07:49.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f74525af700 1 --2- 172.21.15.61:0/3336979104 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c070d50 0x7f744c0c9900 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f74525af700 1 --2- 172.21.15.61:0/3336979104 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c159e60 0x7f744c0c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f74525af700 1 -- 172.21.15.61:0/3336979104 >> 172.21.15.61:0/3336979104 conn(0x7f744c0cd6f0 msgr2=0x7f744c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:49.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f74525af700 1 -- 172.21.15.61:0/3336979104 shutdown_connections 2023-12-24T20:07:49.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.857+0000 7f74525af700 1 -- 172.21.15.61:0/3336979104 wait complete. 2023-12-24T20:07:49.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.858+0000 7f74525af700 1 Processor -- start 2023-12-24T20:07:49.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.859+0000 7f74525af700 1 -- start start 2023-12-24T20:07:49.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.859+0000 7f74525af700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c070d50 0x7f744c16a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.859+0000 7f74525af700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c159a90 0x7f744c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.859+0000 7f74525af700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f744c159e60 0x7f744c15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.859+0000 7f74525af700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c15cf10 con 0x7f744c159a90 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.859+0000 7f74525af700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c16aeb0 con 0x7f744c159e60 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.859+0000 7f74525af700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c15c390 con 0x7f744c070d50 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f744b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c159a90 0x7f744c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f744b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c159a90 0x7f744c15e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34444/0 (socket says 172.21.15.61:34444) 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f744b7fe700 1 -- 172.21.15.61:0/1507390630 learned_addr learned my addr 172.21.15.61:0/1507390630 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f744bfff700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c070d50 0x7f744c16a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f7450b4c700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f744c159e60 0x7f744c15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f744b7fe700 1 -- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c070d50 msgr2=0x7f744c16a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f744b7fe700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c070d50 0x7f744c16a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f744b7fe700 1 -- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f744c159e60 msgr2=0x7f744c15e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f744b7fe700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f744c159e60 0x7f744c15e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:49.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f744b7fe700 1 -- 172.21.15.61:0/1507390630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7444009ae0 con 0x7f744c159a90 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f744b7fe700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c159a90 0x7f744c15e050 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f743400d890 tx=0x7f7434008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f7443fff700 1 -- 172.21.15.61:0/1507390630 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74340125f0 con 0x7f744c159a90 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f7443fff700 1 -- 172.21.15.61:0/1507390630 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7434012750 con 0x7f744c159a90 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f74525af700 1 -- 172.21.15.61:0/1507390630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c15c670 con 0x7f744c159a90 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f7443fff700 1 -- 172.21.15.61:0/1507390630 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434012af0 con 0x7f744c159a90 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.860+0000 7f74525af700 1 -- 172.21.15.61:0/1507390630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c15cc30 con 0x7f744c159a90 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.861+0000 7f74525af700 1 -- 172.21.15.61:0/1507390630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c04c3c0 con 0x7f744c159a90 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.862+0000 7f7443fff700 1 -- 172.21.15.61:0/1507390630 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f743401e460 con 0x7f744c159a90 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.862+0000 7f7443fff700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f742c066f30 0x7f742c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.862+0000 7f7443fff700 1 -- 172.21.15.61:0/1507390630 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7434084ba0 con 0x7f744c159a90 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.862+0000 7f744bfff700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f742c066f30 0x7f742c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:49.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.862+0000 7f7443fff700 1 -- 172.21.15.61:0/1507390630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f742c06ea50 con 0x7f744c159a90 2023-12-24T20:07:49.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.863+0000 7f744bfff700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f742c066f30 0x7f742c0693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f743c003860 tx=0x7f743c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:49.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:49.866+0000 7f7443fff700 1 -- 172.21.15.61:0/1507390630 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7434051e10 con 0x7f744c159a90 2023-12-24T20:07:50.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.061+0000 7f74525af700 1 -- 172.21.15.61:0/1507390630 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f744c06a5c0 con 0x7f744c159a90 2023-12-24T20:07:50.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.062+0000 7f7443fff700 1 -- 172.21.15.61:0/1507390630 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f7434055430 con 0x7f744c159a90 2023-12-24T20:07:50.062 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:50.062 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:07:50.062 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 187, 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:07:43.622248+0000", 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:07:50.063 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 23, 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:50.064 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:50.065 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:50.065 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:50.065 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:50.065 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:50.065 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:50.065 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:50.065 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:50.065 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:50.066 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:50.067 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:50.068 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:50.068 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.068 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:07:50.068 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:50.068 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:50.068 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:50.068 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:50.068 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:50.068 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:50.068 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:50.069 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:50.069 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:50.069 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:50.069 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:50.069 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:50.069 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:50.069 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:50.069 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:50.070 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:50.070 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:50.070 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:50.070 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:50.070 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:50.070 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:50.070 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:50.073 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:50.073 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:50.073 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:50.073 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:50.073 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.073 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:50.073 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:50.073 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:50.073 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.074 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 22, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:17.930601+0000", 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:50.075 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "184", 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:50.076 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:50.077 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:50.078 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.079 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 23, 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:19.106020+0000", 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1027, 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-24T20:07:50.080 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:50.081 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:50.081 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:50.081 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:50.081 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:50.081 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:50.081 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:50.081 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:50.082 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:50.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:50.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:07:50.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:07:50.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:07:50.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:07:50.082 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:07:50.082 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:50.082 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:50.088 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:50.088 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:50.088 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:50.089 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:50.089 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:50.089 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.089 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "187", 2023-12-24T20:07:50.089 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:50.089 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:50.090 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:50.090 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:50.090 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:50.091 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:50.091 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:50.091 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:50.091 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:50.091 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:07:50.091 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:50.092 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:50.092 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:50.092 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:50.092 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:50.092 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:50.092 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:50.093 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:50.093 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:50.093 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:50.093 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:50.093 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:50.093 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:50.094 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:50.094 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:50.094 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:50.094 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.094 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:50.094 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:50.094 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:50.094 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:50.094 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:50.095 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:50.095 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:50.095 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:50.095 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:50.095 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:50.095 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:50.095 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:50.095 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:07:50.095 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:07:50.096 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.096 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:50.096 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:50.097 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:07:50.097 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.098 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.098 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.098 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:50.098 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:07:50.098 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.098 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:50.099 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:50.099 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:50.099 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:50.099 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:50.099 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:50.099 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:50.099 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:50.099 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:50.100 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:50.100 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:50.100 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:50.100 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:50.100 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.100 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.100 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.100 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:07:50.101 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:50.101 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.102 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.102 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.102 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:07:50.102 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:50.102 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.103 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.103 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.104 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:50.104 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.104 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.104 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.104 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:07:50.104 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:50.104 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.105 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.105 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.105 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:07:50.105 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:50.105 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.105 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.105 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.106 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:50.106 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.106 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.106 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.106 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:07:50.106 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:50.106 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.107 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.107 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.107 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:07:50.107 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:50.107 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.107 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.107 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.107 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:50.107 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.108 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.108 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.108 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:07:50.108 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:50.108 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.108 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.108 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.108 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:07:50.109 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:50.109 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.109 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.109 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.109 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:07:50.109 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:07:50.109 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:07:50.109 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:07:50.109 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:50.110 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:50.110 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:50.110 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.110 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.110 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.110 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:50.110 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:50.111 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:50.111 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:50.111 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:50.111 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:50.111 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:50.111 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:50.111 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:50.112 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:50.112 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:50.112 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:50.112 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:50.112 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.113 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.113 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.113 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:07:50.113 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:50.113 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.113 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.113 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.113 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:07:50.114 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:50.114 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.114 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.114 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.114 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:50.114 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.114 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.114 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.114 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:07:50.115 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:50.115 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.115 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.115 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.115 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:07:50.115 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:50.115 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.115 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.116 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.116 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:50.116 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.116 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.116 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.116 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:07:50.116 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:50.116 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.117 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.117 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:07:50.117 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:50.117 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.117 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.117 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.117 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:50.117 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.118 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.118 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.118 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:07:50.118 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:50.118 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.118 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.118 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.118 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:07:50.119 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:50.119 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.119 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.119 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:07:50.119 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:07:50.119 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:07:50.120 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:07:50.120 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:50.120 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:50.120 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:50.120 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.121 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.121 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:50.121 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:50.121 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:50.121 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:50.121 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:50.121 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:50.122 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:50.122 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:50.122 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:50.123 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:50.123 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:50.123 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:50.123 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:50.123 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.123 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.124 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.124 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:07:50.124 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:50.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.124 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.125 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.125 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:07:50.125 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:50.125 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.125 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.125 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.125 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:50.125 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.126 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.126 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:07:50.126 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:50.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.126 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.126 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.126 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:07:50.126 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:50.127 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.127 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.127 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.127 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:50.127 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.127 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.127 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.127 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:07:50.127 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:50.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.128 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.128 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.128 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:07:50.128 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:50.128 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.128 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.129 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:50.129 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.129 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.129 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.129 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:07:50.129 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:50.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.130 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.130 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.130 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:07:50.130 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:50.130 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.130 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.131 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:07:50.131 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:07:50.131 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:07:50.131 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:07:50.131 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:50.131 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:50.132 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:50.132 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.132 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.132 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.132 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:50.132 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:50.132 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:50.132 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:50.132 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:50.133 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:50.133 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:50.133 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:50.133 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:50.133 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:50.133 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:50.133 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:50.133 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:50.133 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.135 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.136 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:50.137 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.137 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.137 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.137 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:07:50.137 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:50.137 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.137 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.137 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.138 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:07:50.138 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:50.138 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.138 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.138 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.138 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:07:50.138 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:07:50.138 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:07:50.139 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:07:50.139 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:50.139 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:50.139 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:50.139 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.139 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.139 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.140 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:50.140 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:50.140 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:50.140 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:50.140 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:50.141 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:50.141 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:50.141 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:50.141 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:50.141 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:50.141 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:50.142 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:50.142 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:50.142 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.142 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.142 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.143 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:07:50.143 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:50.143 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.143 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.143 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.143 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:07:50.143 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:50.144 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.144 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.144 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.144 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:50.144 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.144 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.144 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.144 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:07:50.145 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:50.145 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.145 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.145 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.145 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:07:50.145 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:50.146 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.146 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.146 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.146 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:50.146 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.146 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.147 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.147 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:07:50.147 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:50.147 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.147 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.147 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.147 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:07:50.148 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:50.148 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.148 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.148 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.148 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:50.148 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.149 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.149 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.149 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:07:50.149 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:50.149 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.149 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.149 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.149 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:07:50.150 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:50.150 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.150 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.150 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.150 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:07:50.150 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:07:50.150 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:07:50.150 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:07:50.151 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:50.151 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:50.151 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:50.151 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.151 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.151 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.151 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:50.151 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:50.151 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:50.152 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:50.152 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:50.152 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:50.152 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:50.152 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:50.152 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:50.152 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:50.152 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:50.152 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:50.153 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:50.153 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.153 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.153 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.153 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:07:50.153 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:50.153 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.154 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.154 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.154 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:07:50.154 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:50.154 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.154 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.155 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.155 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:50.155 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.155 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.155 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.155 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:07:50.156 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:50.156 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.156 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.156 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.156 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:07:50.156 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:50.156 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.157 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.157 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.157 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:50.157 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.157 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.157 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.157 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:07:50.157 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:50.158 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.158 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.158 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.158 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:07:50.158 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:50.158 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.158 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.158 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.159 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:50.159 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.159 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.159 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.159 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:07:50.159 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:50.160 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.160 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.160 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.160 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:07:50.160 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:50.160 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.160 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.161 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.161 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:07:50.161 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:07:50.161 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:07:50.161 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:07:50.161 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:50.161 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:50.162 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:50.162 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.162 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.162 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.162 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:50.162 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:50.162 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:50.162 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:50.163 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:50.163 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:50.163 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:50.163 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:50.163 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:50.163 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:50.164 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:50.164 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:50.164 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:50.164 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.164 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.164 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.164 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:07:50.165 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:50.165 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.165 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.165 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.165 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:07:50.165 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:50.166 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.166 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.166 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.166 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:50.166 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.166 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.167 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.167 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:07:50.167 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:50.167 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.167 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.167 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.167 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:07:50.167 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:50.168 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.168 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.168 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.168 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:50.168 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.168 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.169 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.169 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:07:50.169 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:50.169 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.169 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.169 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.170 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:07:50.170 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:50.170 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.170 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.170 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.170 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:50.170 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.171 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.171 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.171 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:07:50.171 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:50.171 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.171 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.172 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.172 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:07:50.172 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:50.172 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.172 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.172 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.172 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:07:50.173 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:07:50.173 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:07:50.173 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:07:50.173 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:50.173 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:50.173 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:50.173 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.174 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.174 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.174 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:50.174 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:50.174 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:50.174 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:50.174 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:50.174 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:50.175 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:50.175 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:50.175 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:50.175 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:50.175 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:50.175 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:50.175 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:50.175 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.176 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.176 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.176 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:07:50.176 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:50.176 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.176 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.176 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.176 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:07:50.176 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:50.177 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.177 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.177 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.177 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:50.177 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.177 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.177 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.178 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:07:50.178 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:50.178 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.178 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.178 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.178 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:07:50.178 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:50.179 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.179 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.179 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.179 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:50.179 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.179 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.179 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.179 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:07:50.180 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:50.180 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.180 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.180 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.180 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:07:50.180 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:50.180 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.180 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.180 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.181 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:50.182 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:50.184 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:07:50.185 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:50.186 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:07:50.187 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:07:50.188 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:07:50.189 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:50.190 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:07:50.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 -- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f742c066f30 msgr2=0x7f742c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:50.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f742c066f30 0x7f742c0693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f743c003860 tx=0x7f743c009040 comp rx=0 tx=0).stop 2023-12-24T20:07:50.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 -- 172.21.15.61:0/1507390630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c159a90 msgr2=0x7f744c15e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:50.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c159a90 0x7f744c15e050 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f743400d890 tx=0x7f7434008040 comp rx=0 tx=0).stop 2023-12-24T20:07:50.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 -- 172.21.15.61:0/1507390630 shutdown_connections 2023-12-24T20:07:50.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f744c070d50 0x7f744c16a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:50.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f742c066f30 0x7f742c0693e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:50.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f744c159e60 0x7f744c15e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:50.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 --2- 172.21.15.61:0/1507390630 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f744c159a90 0x7f744c15e050 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:50.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 -- 172.21.15.61:0/1507390630 >> 172.21.15.61:0/1507390630 conn(0x7f744c0cd6f0 msgr2=0x7f744c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:50.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 -- 172.21.15.61:0/1507390630 shutdown_connections 2023-12-24T20:07:50.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:50.064+0000 7f74525af700 1 -- 172.21.15.61:0/1507390630 wait complete. 2023-12-24T20:07:50.192 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:07:55.193 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:07:55.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.329+0000 7f91b243e700 1 Processor -- start 2023-12-24T20:07:55.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.329+0000 7f91b243e700 1 -- start start 2023-12-24T20:07:55.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91b243e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 0x7f91ac15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:55.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91b243e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91ac15c470 0x7f91ac0b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:55.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91b243e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac0b2eb0 con 0x7f91ac15bb60 2023-12-24T20:07:55.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91b243e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac0afc20 con 0x7f91ac15c470 2023-12-24T20:07:55.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91b243e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0b2bd0 con 0x7f91ac0b2660 2023-12-24T20:07:55.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91ab7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 0x7f91ac15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:55.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91b09db700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91ac15c470 0x7f91ac0b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:55.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91ab7fe700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 0x7f91ac15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:35378/0 (socket says 172.21.15.61:35378) 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91ab7fe700 1 -- 172.21.15.61:0/2757165592 learned_addr learned my addr 172.21.15.61:0/2757165592 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91b09db700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91ac15c470 0x7f91ac0b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:50570/0 (socket says 172.21.15.61:50570) 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.330+0000 7f91abfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f91ac15bb60 0x7f91ac098560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:34732/0 (socket says 172.21.15.61:34732) 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.331+0000 7f91b09db700 1 -- 172.21.15.61:0/2757165592 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 msgr2=0x7f91ac15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.331+0000 7f91b09db700 1 --2- 172.21.15.61:0/2757165592 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 0x7f91ac15bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.331+0000 7f91b09db700 1 -- 172.21.15.61:0/2757165592 >> v1:172.21.15.133:6789/0 conn(0x7f91ac15bb60 legacy=0x7f91ac098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.331+0000 7f91b09db700 1 -- 172.21.15.61:0/2757165592 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac0afe10 con 0x7f91ac15c470 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.331+0000 7f91ab7fe700 1 --2- 172.21.15.61:0/2757165592 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 0x7f91ac15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.331+0000 7f91b09db700 1 --2- 172.21.15.61:0/2757165592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91ac15c470 0x7f91ac0b08f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f91a400f300 tx=0x7f91a400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f6cd9b748e0376e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.331+0000 7f91aaffd700 1 -- 172.21.15.61:0/2757165592 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4012070 con 0x7f91ac15c470 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.331+0000 7f91aaffd700 1 -- 172.21.15.61:0/2757165592 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a400d0d0 con 0x7f91ac15c470 2023-12-24T20:07:55.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.331+0000 7f91aaffd700 1 -- 172.21.15.61:0/2757165592 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400d490 con 0x7f91ac15c470 2023-12-24T20:07:55.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.332+0000 7f91b243e700 1 -- 172.21.15.61:0/2757165592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91ac15c470 msgr2=0x7f91ac0b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:55.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.332+0000 7f91b243e700 1 --2- 172.21.15.61:0/2757165592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91ac15c470 0x7f91ac0b08f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f91a400f300 tx=0x7f91a400db90 comp rx=0 tx=0).stop 2023-12-24T20:07:55.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.332+0000 7f91b243e700 1 -- 172.21.15.61:0/2757165592 shutdown_connections 2023-12-24T20:07:55.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.332+0000 7f91b243e700 1 --2- 172.21.15.61:0/2757165592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91ac15c470 0x7f91ac0b08f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:55.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.332+0000 7f91b243e700 1 --2- 172.21.15.61:0/2757165592 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 0x7f91ac15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:55.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.332+0000 7f91b243e700 1 -- 172.21.15.61:0/2757165592 >> 172.21.15.61:0/2757165592 conn(0x7f91ac097a10 msgr2=0x7f91ac0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:55.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.332+0000 7f91b243e700 1 -- 172.21.15.61:0/2757165592 shutdown_connections 2023-12-24T20:07:55.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.332+0000 7f91b243e700 1 -- 172.21.15.61:0/2757165592 wait complete. 2023-12-24T20:07:55.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.333+0000 7f91b243e700 1 Processor -- start 2023-12-24T20:07:55.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.333+0000 7f91b243e700 1 -- start start 2023-12-24T20:07:55.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b243e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 0x7f91ac14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:55.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b243e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91ac15bb60 0x7f91ac166ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:55.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b243e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac15c470 0x7f91ac165a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:55.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b243e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac150840 con 0x7f91ac15c470 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b243e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac166bd0 con 0x7f91ac15bb60 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b243e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac166330 con 0x7f91ac0b2660 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b09db700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac15c470 0x7f91ac165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b09db700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac15c470 0x7f91ac165a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:34450/0 (socket says 172.21.15.61:34450) 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b09db700 1 -- 172.21.15.61:0/3003329710 learned_addr learned my addr 172.21.15.61:0/3003329710 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91abfff700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 0x7f91ac14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91ab7fe700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91ac15bb60 0x7f91ac166ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b09db700 1 -- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 msgr2=0x7f91ac14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b09db700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 0x7f91ac14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b09db700 1 -- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91ac15bb60 msgr2=0x7f91ac166ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b09db700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91ac15bb60 0x7f91ac166ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b09db700 1 -- 172.21.15.61:0/3003329710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a00094f0 con 0x7f91ac15c470 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.334+0000 7f91b09db700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac15c470 0x7f91ac165a20 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f91a400f9a0 tx=0x7f91a401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.335+0000 7f9193fff700 1 -- 172.21.15.61:0/3003329710 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400d5c0 con 0x7f91ac15c470 2023-12-24T20:07:55.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.335+0000 7f9193fff700 1 -- 172.21.15.61:0/3003329710 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4020620 con 0x7f91ac15c470 2023-12-24T20:07:55.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.335+0000 7f91b243e700 1 -- 172.21.15.61:0/3003329710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a400de30 con 0x7f91ac15c470 2023-12-24T20:07:55.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.335+0000 7f9193fff700 1 -- 172.21.15.61:0/3003329710 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40209e0 con 0x7f91ac15c470 2023-12-24T20:07:55.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.335+0000 7f91b243e700 1 -- 172.21.15.61:0/3003329710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac1668f0 con 0x7f91ac15c470 2023-12-24T20:07:55.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.336+0000 7f91b243e700 1 -- 172.21.15.61:0/3003329710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac1509f0 con 0x7f91ac15c470 2023-12-24T20:07:55.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.336+0000 7f9193fff700 1 -- 172.21.15.61:0/3003329710 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f91a4003040 con 0x7f91ac15c470 2023-12-24T20:07:55.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.336+0000 7f9193fff700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 0x7f91980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:07:55.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.337+0000 7f9193fff700 1 -- 172.21.15.61:0/3003329710 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91a408a0a0 con 0x7f91ac15c470 2023-12-24T20:07:55.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.337+0000 7f9193fff700 1 -- 172.21.15.61:0/3003329710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=188}) v3 -- 0x7f919806ea50 con 0x7f91ac15c470 2023-12-24T20:07:55.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.337+0000 7f91abfff700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 0x7f91980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:07:55.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.337+0000 7f91abfff700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 0x7f91980693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f919c007060 tx=0x7f919c007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:07:55.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.341+0000 7f9193fff700 1 -- 172.21.15.61:0/3003329710 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91ac1509f0 con 0x7f91ac15c470 2023-12-24T20:07:55.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.537+0000 7f91b243e700 1 -- 172.21.15.61:0/3003329710 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f91ac06d440 con 0x7f91ac15c470 2023-12-24T20:07:55.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.538+0000 7f9193fff700 1 -- 172.21.15.61:0/3003329710 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+32301 (secure 0 0 0) 0x7f91a402f020 con 0x7f91ac15c470 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 187, 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:07:43.622248+0000", 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:07:55.539 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 23, 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:07:55.540 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:55.541 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:07:55.542 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:55.543 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:55.544 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.545 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 22, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:17.930601+0000", 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:55.546 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "184", 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:55.547 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:55.548 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:55.549 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.550 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 23, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:19.106020+0000", 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1027, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:07:55.551 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "187", 2023-12-24T20:07:55.552 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:07:55.553 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:07:55.554 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:07:55.555 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:55.556 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.557 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.558 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:55.559 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:07:55.560 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:55.561 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.562 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.563 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.564 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:07:55.565 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:55.566 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.567 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:55.568 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.569 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:55.570 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:55.571 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:55.572 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.573 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:55.574 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.575 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:07:55.576 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:55.577 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:55.578 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.580 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.581 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:55.582 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.583 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.584 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:07:55.585 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.586 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:55.587 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.588 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.589 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.590 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.591 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.592 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:07:55.593 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.594 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.595 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.596 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:07:55.597 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:55.598 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:55.599 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:55.600 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:07:55.601 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:55.602 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:07:55.603 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:07:55.604 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:07:55.605 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:07:55.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 -- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 msgr2=0x7f91980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:55.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 0x7f91980693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f919c007060 tx=0x7f919c007ea0 comp rx=0 tx=0).stop 2023-12-24T20:07:55.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 -- 172.21.15.61:0/3003329710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac15c470 msgr2=0x7f91ac165a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:07:55.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac15c470 0x7f91ac165a20 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f91a400f9a0 tx=0x7f91a401c000 comp rx=0 tx=0).stop 2023-12-24T20:07:55.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 -- 172.21.15.61:0/3003329710 shutdown_connections 2023-12-24T20:07:55.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f91ac0b2660 0x7f91ac14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:55.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9198066f30 0x7f91980693e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:55.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac15c470 0x7f91ac165a20 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:55.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 --2- 172.21.15.61:0/3003329710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91ac15bb60 0x7f91ac166ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:07:55.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 -- 172.21.15.61:0/3003329710 >> 172.21.15.61:0/3003329710 conn(0x7f91ac097a10 msgr2=0x7f91ac06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:07:55.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 -- 172.21.15.61:0/3003329710 shutdown_connections 2023-12-24T20:07:55.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:07:55.540+0000 7f91b243e700 1 -- 172.21.15.61:0/3003329710 wait complete. 2023-12-24T20:07:55.608 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-24T20:08:00.609 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:08:00.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.746+0000 7f3f7fa4b700 1 Processor -- start 2023-12-24T20:08:00.747 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.746+0000 7f3f7fa4b700 1 -- start start 2023-12-24T20:08:00.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.747+0000 7f3f7fa4b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f78159fe0 0x7f3f780cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:00.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.747+0000 7f3f7fa4b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f780c5ee0 0x7f3f780cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:00.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.747+0000 7f3f7fa4b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f780af880 con 0x7f3f78159c10 2023-12-24T20:08:00.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.747+0000 7f3f7fa4b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f780c6fc0 con 0x7f3f78159fe0 2023-12-24T20:08:00.748 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.747+0000 7f3f7fa4b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780c63b0 con 0x7f3f780c5ee0 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.747+0000 7f3f7cfe6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f78159fe0 0x7f3f780cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.747+0000 7f3f7cfe6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f78159fe0 0x7f3f780cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:56976/0 (socket says 172.21.15.61:56976) 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.747+0000 7f3f7d7e7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3f78159c10 0x7f3f780c57d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:34468/0 (socket says 172.21.15.61:34468) 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.747+0000 7f3f7cfe6700 1 -- 172.21.15.61:0/1899548427 learned_addr learned my addr 172.21.15.61:0/1899548427 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.748+0000 7f3f7dfe8700 1 --2- 172.21.15.61:0/1899548427 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f780c5ee0 0x7f3f780cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.748+0000 7f3f7cfe6700 1 -- 172.21.15.61:0/1899548427 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f780c5ee0 msgr2=0x7f3f780cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.748+0000 7f3f7cfe6700 1 --2- 172.21.15.61:0/1899548427 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f780c5ee0 0x7f3f780cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.748+0000 7f3f7cfe6700 1 -- 172.21.15.61:0/1899548427 >> v1:172.21.15.133:6789/0 conn(0x7f3f78159c10 legacy=0x7f3f780c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.748+0000 7f3f7cfe6700 1 -- 172.21.15.61:0/1899548427 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f780c6690 con 0x7f3f78159fe0 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.748+0000 7f3f6ffff700 1 -- 172.21.15.61:0/1899548427 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023941212 0 0) 0x7f3f780af880 con 0x7f3f78159c10 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.748+0000 7f3f7cfe6700 1 --2- 172.21.15.61:0/1899548427 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f78159fe0 0x7f3f780cba80 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3f680099b0 tx=0x7f3f68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccceb4c2fa79c97 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.748+0000 7f3f6ffff700 1 -- 172.21.15.61:0/1899548427 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68009ea0 con 0x7f3f78159fe0 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.748+0000 7f3f6ffff700 1 -- 172.21.15.61:0/1899548427 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6800b860 con 0x7f3f78159fe0 2023-12-24T20:08:00.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.748+0000 7f3f6ffff700 1 -- 172.21.15.61:0/1899548427 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800bc00 con 0x7f3f78159fe0 2023-12-24T20:08:00.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.749+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/1899548427 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f78159fe0 msgr2=0x7f3f780cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:00.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.749+0000 7f3f7fa4b700 1 --2- 172.21.15.61:0/1899548427 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f78159fe0 0x7f3f780cba80 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3f680099b0 tx=0x7f3f68009250 comp rx=0 tx=0).stop 2023-12-24T20:08:00.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.749+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/1899548427 shutdown_connections 2023-12-24T20:08:00.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.749+0000 7f3f7fa4b700 1 --2- 172.21.15.61:0/1899548427 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f780c5ee0 0x7f3f780cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:00.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.749+0000 7f3f7fa4b700 1 --2- 172.21.15.61:0/1899548427 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f78159fe0 0x7f3f780cba80 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:00.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.749+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/1899548427 >> 172.21.15.61:0/1899548427 conn(0x7f3f7806e640 msgr2=0x7f3f78067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:00.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.749+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/1899548427 shutdown_connections 2023-12-24T20:08:00.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.749+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/1899548427 wait complete. 2023-12-24T20:08:00.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.750+0000 7f3f7fa4b700 1 Processor -- start 2023-12-24T20:08:00.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.751+0000 7f3f7fa4b700 1 -- start start 2023-12-24T20:08:00.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7fa4b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f780c5ee0 0x7f3f780cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:00.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7fa4b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f78159c10 0x7f3f7814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:00.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7fa4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f78159fe0 0x7f3f78154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:00.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7fa4b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780d0470 con 0x7f3f780c5ee0 2023-12-24T20:08:00.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7fa4b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7814cbf0 con 0x7f3f78159fe0 2023-12-24T20:08:00.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7fa4b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78155260 con 0x7f3f78159c10 2023-12-24T20:08:00.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7d7e7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f780c5ee0 0x7f3f780cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:00.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7d7e7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f780c5ee0 0x7f3f780cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:56990/0 (socket says 172.21.15.61:56990) 2023-12-24T20:08:00.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7d7e7700 1 -- 172.21.15.61:0/3596544672 learned_addr learned my addr 172.21.15.61:0/3596544672 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:00.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7cfe6700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f78159c10 0x7f3f7814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:00.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7dfe8700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f78159fe0 0x7f3f78154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7d7e7700 1 -- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f78159c10 msgr2=0x7f3f7814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7d7e7700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f78159c10 0x7f3f7814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7d7e7700 1 -- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f78159fe0 msgr2=0x7f3f78154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7d7e7700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f78159fe0 0x7f3f78154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7d7e7700 1 -- 172.21.15.61:0/3596544672 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680094f0 con 0x7f3f780c5ee0 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7cfe6700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f78159c10 0x7f3f7814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.752+0000 7f3f7d7e7700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f780c5ee0 0x7f3f780cff30 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3f740011e0 tx=0x7f3f74007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.753+0000 7f3f6d7fa700 1 -- 172.21.15.61:0/3596544672 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f74005a70 con 0x7f3f780c5ee0 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.753+0000 7f3f6d7fa700 1 -- 172.21.15.61:0/3596544672 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f74005bd0 con 0x7f3f780c5ee0 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.753+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/3596544672 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f781554e0 con 0x7f3f780c5ee0 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.753+0000 7f3f6d7fa700 1 -- 172.21.15.61:0/3596544672 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740070d0 con 0x7f3f780c5ee0 2023-12-24T20:08:00.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.753+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/3596544672 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f78155b20 con 0x7f3f780c5ee0 2023-12-24T20:08:00.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.754+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/3596544672 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f780890b0 con 0x7f3f780c5ee0 2023-12-24T20:08:00.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.755+0000 7f3f6d7fa700 1 -- 172.21.15.61:0/3596544672 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f3f74007440 con 0x7f3f780c5ee0 2023-12-24T20:08:00.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.755+0000 7f3f6d7fa700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f5c066f30 0x7f3f5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:00.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.755+0000 7f3f6d7fa700 1 -- 172.21.15.61:0/3596544672 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f740839f0 con 0x7f3f780c5ee0 2023-12-24T20:08:00.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.755+0000 7f3f7cfe6700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f5c066f30 0x7f3f5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:00.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.756+0000 7f3f7cfe6700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f5c066f30 0x7f3f5c0693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3f78089d80 tx=0x7f3f68017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:00.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.760+0000 7f3f6d7fa700 1 -- 172.21.15.61:0/3596544672 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f74050c60 con 0x7f3f780c5ee0 2023-12-24T20:08:00.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.960+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/3596544672 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3f7804c3c0 con 0x7f3f780c5ee0 2023-12-24T20:08:00.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.961+0000 7f3f6d7fa700 1 -- 172.21.15.61:0/3596544672 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+32282 (secure 0 0 0) 0x7f3f74017070 con 0x7f3f780c5ee0 2023-12-24T20:08:00.961 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:00.961 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:08:00.961 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 188, 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:07:58.625527+0000", 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:08:00.962 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:08:00.963 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:08:00.963 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:08:00.963 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:08:00.963 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:08:00.963 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 23, 2023-12-24T20:08:00.963 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:08:00.963 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:08:00.963 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:08:00.963 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:08:00.965 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:08:00.966 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:08:00.967 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:08:00.968 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:08:00.969 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 22, 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:17.930601+0000", 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:08:00.970 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:08:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "184", 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:08:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:08:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:08:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 23, 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:19.106020+0000", 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:08:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:08:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:08:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:08:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:08:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:08:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:08:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:08:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:08:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:08:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "188", 2023-12-24T20:08:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:08:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:08:00.979 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:08:00.980 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:00.986 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.987 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:08:00.988 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:00.989 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.990 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:00.991 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.992 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.993 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.994 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.995 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.996 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:00.997 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.998 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:00.999 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:08:01.000 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:08:01.001 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.002 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.003 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.004 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.005 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:08:01.006 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.007 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:08:01.008 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.009 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.010 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.011 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.012 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.013 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.014 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.015 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.016 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.017 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.018 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.019 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.020 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.021 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:08:01.022 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.023 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:08:01.024 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.025 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:08:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:08:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:08:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.030 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f5c066f30 msgr2=0x7f3f5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f5c066f30 0x7f3f5c0693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3f78089d80 tx=0x7f3f68017000 comp rx=0 tx=0).stop 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/3596544672 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f780c5ee0 msgr2=0x7f3f780cff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f780c5ee0 0x7f3f780cff30 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3f740011e0 tx=0x7f3f74007e10 comp rx=0 tx=0).stop 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/3596544672 shutdown_connections 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f3f5c066f30 0x7f3f5c0693e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f78159fe0 0x7f3f78154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f780c5ee0 0x7f3f780cff30 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 --2- 172.21.15.61:0/3596544672 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3f78159c10 0x7f3f7814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/3596544672 >> 172.21.15.61:0/3596544672 conn(0x7f3f7806e640 msgr2=0x7f3f7814f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/3596544672 shutdown_connections 2023-12-24T20:08:01.032 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:00.963+0000 7f3f7fa4b700 1 -- 172.21.15.61:0/3596544672 wait complete. 2023-12-24T20:08:01.033 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-24T20:08:01.033 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-24T20:08:01.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.155+0000 7fc3d3fd0700 1 Processor -- start 2023-12-24T20:08:01.155 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.155+0000 7fc3d3fd0700 1 -- start start 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d3fd0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3cc159c10 0x7fc3cc0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d3fd0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3cc159fe0 0x7fc3cc0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d3fd0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc3cc0cba80 0x7fc3cc0cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d3fd0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc0af880 con 0x7fc3cc0cba80 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d3fd0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3cc0cc420 con 0x7fc3cc159c10 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d3fd0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc0c6fc0 con 0x7fc3cc159fe0 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d256d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc3cc0cba80 0x7fc3cc0cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d256d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc3cc0cba80 0x7fc3cc0cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:56998/0 (socket says 172.21.15.61:56998) 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d256d700 1 -- 172.21.15.61:0/4030468897 learned_addr learned my addr 172.21.15.61:0/4030468897 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d1d6c700 1 --2- 172.21.15.61:0/4030468897 >> v2:172.21.15.133:3300/0 conn(0x7fc3cc159c10 0x7fc3cc0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d256d700 1 -- 172.21.15.61:0/4030468897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3cc159fe0 msgr2=0x7fc3cc0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:01.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d256d700 1 --2- 172.21.15.61:0/4030468897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3cc159fe0 0x7fc3cc0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d256d700 1 -- 172.21.15.61:0/4030468897 >> v2:172.21.15.133:3300/0 conn(0x7fc3cc159c10 msgr2=0x7fc3cc0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d256d700 1 --2- 172.21.15.61:0/4030468897 >> v2:172.21.15.133:3300/0 conn(0x7fc3cc159c10 0x7fc3cc0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d256d700 1 -- 172.21.15.61:0/4030468897 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc0c63b0 con 0x7fc3cc0cba80 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d1d6c700 1 --2- 172.21.15.61:0/4030468897 >> v2:172.21.15.133:3300/0 conn(0x7fc3cc159c10 0x7fc3cc0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.156+0000 7fc3d256d700 1 --2- 172.21.15.61:0/4030468897 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc0cba80 0x7fc3cc0cbee0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0d0990 tx=0x7fc3c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2066b449ebf25e47 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d0d6a700 1 -- 172.21.15.61:0/4030468897 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400e070 con 0x7fc3cc0cba80 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d0d6a700 1 -- 172.21.15.61:0/4030468897 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c400ba50 con 0x7fc3cc0cba80 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d0d6a700 1 -- 172.21.15.61:0/4030468897 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40092e0 con 0x7fc3cc0cba80 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/4030468897 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc0cba80 msgr2=0x7fc3cc0cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d3fd0700 1 --2- 172.21.15.61:0/4030468897 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc0cba80 0x7fc3cc0cbee0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0d0990 tx=0x7fc3c4009840 comp rx=0 tx=0).stop 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/4030468897 shutdown_connections 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d3fd0700 1 --2- 172.21.15.61:0/4030468897 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc0cba80 0x7fc3cc0cbee0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d3fd0700 1 --2- 172.21.15.61:0/4030468897 >> v2:172.21.15.133:3300/0 conn(0x7fc3cc159c10 0x7fc3cc0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d3fd0700 1 --2- 172.21.15.61:0/4030468897 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3cc159fe0 0x7fc3cc0c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/4030468897 >> 172.21.15.61:0/4030468897 conn(0x7fc3cc06e640 msgr2=0x7fc3cc067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:01.159 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/4030468897 shutdown_connections 2023-12-24T20:08:01.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.157+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/4030468897 wait complete. 2023-12-24T20:08:01.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.158+0000 7fc3d3fd0700 1 Processor -- start 2023-12-24T20:08:01.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.158+0000 7fc3d3fd0700 1 -- start start 2023-12-24T20:08:01.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.159+0000 7fc3d3fd0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3cc0cba80 0x7fc3cc0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.159+0000 7fc3d3fd0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc159c10 0x7fc3cc13fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.159+0000 7fc3d3fd0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3cc159fe0 0x7fc3cc0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.159+0000 7fc3d3fd0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc0c91e0 con 0x7fc3cc159c10 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.159+0000 7fc3d3fd0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc0b4360 con 0x7fc3cc159fe0 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.159+0000 7fc3d3fd0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc0b4e70 con 0x7fc3cc0cba80 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.159+0000 7fc3d156b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc159c10 0x7fc3cc13fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.159+0000 7fc3d156b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc159c10 0x7fc3cc13fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57002/0 (socket says 172.21.15.61:57002) 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.159+0000 7fc3d156b700 1 -- 172.21.15.61:0/2871520581 learned_addr learned my addr 172.21.15.61:0/2871520581 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d256d700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3cc159fe0 0x7fc3cc0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d1d6c700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3cc0cba80 0x7fc3cc0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d156b700 1 -- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3cc0cba80 msgr2=0x7fc3cc0c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d156b700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3cc0cba80 0x7fc3cc0c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d156b700 1 -- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3cc159fe0 msgr2=0x7fc3cc0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d156b700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3cc159fe0 0x7fc3cc0ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d156b700 1 -- 172.21.15.61:0/2871520581 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4009ae0 con 0x7fc3cc159c10 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d1d6c700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3cc0cba80 0x7fc3cc0c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d256d700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3cc159fe0 0x7fc3cc0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d156b700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc159c10 0x7fc3cc13fda0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00b810 tx=0x7fc3bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3c1ffb700 1 -- 172.21.15.61:0/2871520581 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc00f5f0 con 0x7fc3cc159c10 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3c1ffb700 1 -- 172.21.15.61:0/2871520581 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3bc00f770 con 0x7fc3cc159c10 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/2871520581 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc1402e0 con 0x7fc3cc159c10 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3c1ffb700 1 -- 172.21.15.61:0/2871520581 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc00fb30 con 0x7fc3cc159c10 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.160+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/2871520581 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc0b4b00 con 0x7fc3cc159c10 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.161+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/2871520581 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3cc0890b0 con 0x7fc3cc159c10 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.162+0000 7fc3c1ffb700 1 -- 172.21.15.61:0/2871520581 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc3bc010480 con 0x7fc3cc159c10 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.162+0000 7fc3c1ffb700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc3b0066f30 0x7fc3b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.162+0000 7fc3c1ffb700 1 -- 172.21.15.61:0/2871520581 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3bc084470 con 0x7fc3cc159c10 2023-12-24T20:08:01.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.162+0000 7fc3d1d6c700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc3b0066f30 0x7fc3b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:01.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.163+0000 7fc3d1d6c700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc3b0066f30 0x7fc3b00693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8006fd0 tx=0x7fc3c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:01.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.166+0000 7fc3c1ffb700 1 -- 172.21.15.61:0/2871520581 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3bc051760 con 0x7fc3cc159c10 2023-12-24T20:08:01.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.359+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/2871520581 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc3cc04c3c0 con 0x7fc3cc159c10 2023-12-24T20:08:01.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.360+0000 7fc3c1ffb700 1 -- 172.21.15.61:0/2871520581 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+32282 (secure 0 0 0) 0x7fc3bc054d80 con 0x7fc3cc159c10 2023-12-24T20:08:01.361 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:01.361 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:08:01.361 INFO:teuthology.orchestra.run.smithi061.stdout: "epoch": 188, 2023-12-24T20:08:01.361 INFO:teuthology.orchestra.run.smithi061.stdout: "fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", 2023-12-24T20:08:01.361 INFO:teuthology.orchestra.run.smithi061.stdout: "created": "2023-12-24T19:56:48.741318+0000", 2023-12-24T20:08:01.361 INFO:teuthology.orchestra.run.smithi061.stdout: "modified": "2023-12-24T20:07:58.625527+0000", 2023-12-24T20:08:01.361 INFO:teuthology.orchestra.run.smithi061.stdout: "last_up_change": "2023-12-24T19:56:54.250282+0000", 2023-12-24T20:08:01.361 INFO:teuthology.orchestra.run.smithi061.stdout: "last_in_change": "2023-12-24T19:56:51.229309+0000", 2023-12-24T20:08:01.361 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-24T20:08:01.361 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_num": 5799936, 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_set": [ 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "pglog_hardlimit", 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "purged_snapdirs", 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_deletes", 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "sortbitwise" 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_version": 4, 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "full_ratio": 0.69999998807907104, 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_snapshot": "", 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_max": 23, 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "max_osd": 8, 2023-12-24T20:08:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: "require_min_compat_client": "luminous", 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "min_compat_client": "jewel", 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "require_osd_release": "quincy", 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "pools": [ 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 1, 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": ".mgr", 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T19:56:54.358495+0000", 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:08:01.363 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 1, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 1, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 1, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 1, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 1, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:08:01.364 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "110", 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:08:01.365 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:08:01.366 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:08:01.367 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:08:01.367 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.367 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:08:01.367 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:08:01.367 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:08:01.367 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_max": 32, 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 1 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": {} 2023-12-24T20:08:01.368 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.369 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.369 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.369 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 22, 2023-12-24T20:08:01.369 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_metadata", 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:17.930601+0000", 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:08:01.370 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 32, 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 32, 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 32, 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 32, 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 32, 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "184", 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:08:01.371 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 0, 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:08:01.372 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:08:01.373 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:08:01.377 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_bias": 4, 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 16, 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "recovery_priority": 5 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:08:01.378 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": "cephfs" 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "pool": 23, 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_name": "cephfs_data", 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "create_time": "2023-12-24T20:07:19.106020+0000", 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "flags": 1, 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "flags_names": "hashpspool", 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "type": 1, 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "size": 2, 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "min_size": 1, 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_rule": 0, 2023-12-24T20:08:01.379 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_count": 0, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_target": 0, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_barrier": 0, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "object_hash": 2, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_autoscale_mode": "off", 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num": 64, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num": 64, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_placement_num_target": 64, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_target": 64, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_pending": 64, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "last_pg_merge_meta": { 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "source_pgid": "0.0", 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "ready_epoch": 0, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_started": 0, 2023-12-24T20:08:01.380 INFO:teuthology.orchestra.run.smithi061.stdout: "last_epoch_clean": 0, 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "source_version": "0'0", 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "target_version": "0'0" 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "last_change": "188", 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend": "0", 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "last_force_op_resend_preluminous": "0", 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "auid": 0, 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_mode": "selfmanaged", 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_seq": 0, 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "snap_epoch": 0, 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "pool_snaps": [], 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps": "[]", 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_bytes": 33554432, 2023-12-24T20:08:01.381 INFO:teuthology.orchestra.run.smithi061.stdout: "quota_max_objects": 0, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "tiers": [], 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "tier_of": -1, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "read_tier": -1, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "write_tier": -1, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_mode": "none", 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_bytes": 0, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "target_max_objects": 0, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_flush_age": 0, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "cache_min_evict_age": 0, 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profile": "", 2023-12-24T20:08:01.382 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_params": { 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "none" 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_period": 0, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_count": 0, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "use_gmt_hitset": true, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "min_read_recency_for_promote": 0, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "min_write_recency_for_promote": 0, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_grade_decay_rate": 0, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "hit_set_search_last_n": 0, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "grade_table": [], 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "stripe_width": 0, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "expected_num_objects": 0, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "fast_read": false, 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "options": { 2023-12-24T20:08:01.383 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_num_min": 64, 2023-12-24T20:08:01.384 INFO:teuthology.orchestra.run.smithi061.stdout: "target_size_ratio": 0.89999997615814209 2023-12-24T20:08:01.384 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.384 INFO:teuthology.orchestra.run.smithi061.stdout: "application_metadata": { 2023-12-24T20:08:01.384 INFO:teuthology.orchestra.run.smithi061.stdout: "cephfs": { 2023-12-24T20:08:01.384 INFO:teuthology.orchestra.run.smithi061.stdout: "data": "cephfs" 2023-12-24T20:08:01.384 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.384 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.384 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.384 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "osds": [ 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.385 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6808", 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6809", 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:01.386 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6810", 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6811", 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.387 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6814", 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6815", 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6812", 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6813", 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40393 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.389 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6809/40393", 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6811/40393", 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6815/40393", 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6813/40393", 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.390 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6816", 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.391 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6817", 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6818", 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.392 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6819", 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6822", 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.393 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6823", 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6820", 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.394 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6821", 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40391 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6817/40391", 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6819/40391", 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6823/40391", 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6821/40391", 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.395 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.396 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6800", 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6801", 2023-12-24T20:08:01.397 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6802", 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6803", 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:01.398 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6806", 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6807", 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.399 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6804", 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6805", 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40392 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.400 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6801/40392", 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6803/40392", 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6807/40392", 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6805/40392", 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.401 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.402 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6824", 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6825", 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.403 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6826", 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6827", 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6830", 2023-12-24T20:08:01.404 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.405 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.405 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.405 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6831", 2023-12-24T20:08:01.405 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.405 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.405 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.405 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.405 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6828", 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.61:6829", 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40415 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.61:6825/40415", 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.61:6827/40415", 2023-12-24T20:08:01.406 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.61:6831/40415", 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.61:6829/40415", 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.407 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6800", 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6801", 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.408 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6802", 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6803", 2023-12-24T20:08:01.409 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6806", 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6807", 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.410 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6804", 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6805", 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40575 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.411 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6801/40575", 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6803/40575", 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6807/40575", 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6805/40575", 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.412 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.413 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6824", 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6825", 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6826", 2023-12-24T20:08:01.414 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6827", 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6830", 2023-12-24T20:08:01.415 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6831", 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.416 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6828", 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6829", 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40616 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6825/40616", 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6827/40616", 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6831/40616", 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6829/40616", 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.417 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.418 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6816", 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6817", 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.419 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6818", 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6819", 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.420 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6822", 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6823", 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6820", 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6821", 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40576 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.422 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6817/40576", 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6819/40576", 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6823/40576", 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6821/40576", 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "up": 1, 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "in": 1, 2023-12-24T20:08:01.423 INFO:teuthology.orchestra.run.smithi061.stdout: "weight": 1, 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_affinity": 1, 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_begin": 0, 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "last_clean_end": 0, 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "up_from": 13, 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "up_thru": 183, 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "down_at": 0, 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "lost_at": 0, 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addrs": { 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6808", 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.424 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6809", 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addrs": { 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6810", 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.425 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6811", 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addrs": { 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6814", 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.426 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6815", 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addrs": { 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: "addrvec": [ 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v2", 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6812", 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-12-24T20:08:01.427 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "172.21.15.133:6813", 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 40577 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: "public_addr": "172.21.15.133:6809/40577", 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_addr": "172.21.15.133:6811/40577", 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_back_addr": "172.21.15.133:6815/40577", 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: "heartbeat_front_addr": "172.21.15.133:6813/40577", 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: "state": [ 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: "exists", 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: "up" 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: ] 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:08:01.428 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_xinfo": [ 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 0, 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.359533+0000", 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 1, 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.429 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.399865+0000", 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 2, 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.330738+0000", 2023-12-24T20:08:01.430 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 3, 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.365147+0000", 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 4, 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.431 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.312580+0000", 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 5, 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.386830+0000", 2023-12-24T20:08:01.432 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 6, 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.408744+0000", 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": 7, 2023-12-24T20:08:01.433 INFO:teuthology.orchestra.run.smithi061.stdout: "down_stamp": "0.000000", 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_probability": 0, 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "laggy_interval": 0, 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "features": 4540138320759226367, 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "old_weight": 0, 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "last_purged_snaps_scrub": "2023-12-24T19:56:52.323082+0000", 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "dead_epoch": 0 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: ], 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap": [], 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_upmap_items": [], 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "pg_temp": [], 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "primary_temp": [], 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklist": {}, 2023-12-24T20:08:01.434 INFO:teuthology.orchestra.run.smithi061.stdout: "range_blocklist": {}, 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "erasure_code_profiles": { 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "default": { 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "crush-failure-domain": "osd", 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "k": "2", 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "m": "1", 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "plugin": "jerasure", 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "technique": "reed_sol_van" 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "removed_snaps_queue": [], 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "new_removed_snaps": [], 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "new_purged_snaps": [], 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "crush_node_flags": {}, 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "device_class_flags": {}, 2023-12-24T20:08:01.435 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode": { 2023-12-24T20:08:01.436 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_enabled": false, 2023-12-24T20:08:01.436 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_bucket_count": 0, 2023-12-24T20:08:01.436 INFO:teuthology.orchestra.run.smithi061.stdout: "degraded_stretch_mode": 0, 2023-12-24T20:08:01.436 INFO:teuthology.orchestra.run.smithi061.stdout: "recovering_stretch_mode": 0, 2023-12-24T20:08:01.436 INFO:teuthology.orchestra.run.smithi061.stdout: "stretch_mode_bucket": 0 2023-12-24T20:08:01.436 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-12-24T20:08:01.436 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc3b0066f30 msgr2=0x7fc3b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc3b0066f30 0x7fc3b00693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8006fd0 tx=0x7fc3c8008040 comp rx=0 tx=0).stop 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/2871520581 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc159c10 msgr2=0x7fc3cc13fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc159c10 0x7fc3cc13fda0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc00b810 tx=0x7fc3bc009250 comp rx=0 tx=0).stop 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/2871520581 shutdown_connections 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc3cc0cba80 0x7fc3cc0c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc3b0066f30 0x7fc3b00693e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3cc159fe0 0x7fc3cc0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 --2- 172.21.15.61:0/2871520581 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc3cc159c10 0x7fc3cc13fda0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/2871520581 >> 172.21.15.61:0/2871520581 conn(0x7fc3cc06e640 msgr2=0x7fc3cc156560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/2871520581 shutdown_connections 2023-12-24T20:08:01.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.362+0000 7fc3d3fd0700 1 -- 172.21.15.61:0/2871520581 wait complete. 2023-12-24T20:08:01.439 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:01.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.562+0000 7fdad5fc1700 1 Processor -- start 2023-12-24T20:08:01.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.562+0000 7fdad5fc1700 1 -- start start 2023-12-24T20:08:01.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdad5fc1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdad00ce2c0 0x7fdad015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdad5fc1700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad00ca6f0 con 0x7fdad0157780 2023-12-24T20:08:01.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdad5fc1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad00ca9d0 con 0x7fdad00ca270 2023-12-24T20:08:01.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdad5fc1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad00cacb0 con 0x7fdad00ce2c0 2023-12-24T20:08:01.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdacffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fdad00ce2c0 0x7fdad015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:01.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdacf7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fdad0157780 0x7fdad006c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38540/0 (socket says 172.21.15.61:38540) 2023-12-24T20:08:01.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdacf7fe700 1 -- 172.21.15.61:0/644419715 learned_addr learned my addr 172.21.15.61:0/644419715 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:01.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdacffff700 1 -- 172.21.15.61:0/644419715 >> v1:172.21.15.133:6789/0 conn(0x7fdad00ca270 legacy=0x7fdad00cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:01.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdacffff700 1 -- 172.21.15.61:0/644419715 >> v1:172.21.15.61:6789/0 conn(0x7fdad0157780 legacy=0x7fdad006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdacffff700 1 -- 172.21.15.61:0/644419715 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad00caf90 con 0x7fdad00ce2c0 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.563+0000 7fdace7fc700 1 -- 172.21.15.61:0/644419715 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045609024 0 0) 0x7fdad00ca6f0 con 0x7fdad0157780 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdacffff700 1 --2- 172.21.15.61:0/644419715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad00ce2c0 0x7fdad015ba80 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009e60 tx=0x7fdac8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6548a690743dc768 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdace7fc700 1 -- 172.21.15.61:0/644419715 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800e070 con 0x7fdad00ce2c0 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdace7fc700 1 -- 172.21.15.61:0/644419715 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac800bbf0 con 0x7fdad00ce2c0 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdace7fc700 1 -- 172.21.15.61:0/644419715 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac8012430 con 0x7fdad00ce2c0 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdad5fc1700 1 -- 172.21.15.61:0/644419715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad00ce2c0 msgr2=0x7fdad015ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdad5fc1700 1 --2- 172.21.15.61:0/644419715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad00ce2c0 0x7fdad015ba80 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009e60 tx=0x7fdac8009780 comp rx=0 tx=0).stop 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdad5fc1700 1 -- 172.21.15.61:0/644419715 shutdown_connections 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdad5fc1700 1 --2- 172.21.15.61:0/644419715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad00ce2c0 0x7fdad015ba80 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdad5fc1700 1 -- 172.21.15.61:0/644419715 >> 172.21.15.61:0/644419715 conn(0x7fdad006b650 msgr2=0x7fdad00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:01.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdad5fc1700 1 -- 172.21.15.61:0/644419715 shutdown_connections 2023-12-24T20:08:01.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.564+0000 7fdad5fc1700 1 -- 172.21.15.61:0/644419715 wait complete. 2023-12-24T20:08:01.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.566+0000 7fdad5fc1700 1 Processor -- start 2023-12-24T20:08:01.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.566+0000 7fdad5fc1700 1 -- start start 2023-12-24T20:08:01.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdad5fc1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad00ce2c0 0x7fdad0144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdad5fc1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad0157780 0x7fdad00c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdad5fc1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad015ad30 0x7fdad0156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdad5fc1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad0159120 con 0x7fdad0157780 2023-12-24T20:08:01.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdad5fc1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad00c3f80 con 0x7fdad015ad30 2023-12-24T20:08:01.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdad5fc1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad015b1d0 con 0x7fdad00ce2c0 2023-12-24T20:08:01.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdaceffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad0157780 0x7fdad00c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:01.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdaceffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad0157780 0x7fdad00c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57024/0 (socket says 172.21.15.61:57024) 2023-12-24T20:08:01.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdaceffd700 1 -- 172.21.15.61:0/1072844809 learned_addr learned my addr 172.21.15.61:0/1072844809 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:01.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdaceffd700 1 -- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad00ce2c0 msgr2=0x7fdad0144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdaceffd700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad00ce2c0 0x7fdad0144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdaceffd700 1 -- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad015ad30 msgr2=0x7fdad0156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdacffff700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad015ad30 0x7fdad0156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:01.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdaceffd700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad015ad30 0x7fdad0156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdaceffd700 1 -- 172.21.15.61:0/1072844809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac8009a20 con 0x7fdad0157780 2023-12-24T20:08:01.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdacffff700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad015ad30 0x7fdad0156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:01.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdaceffd700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad0157780 0x7fdad00c5110 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c600 tx=0x7fdac4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:01.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdab77fe700 1 -- 172.21.15.61:0/1072844809 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4011590 con 0x7fdad0157780 2023-12-24T20:08:01.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdab77fe700 1 -- 172.21.15.61:0/1072844809 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4011710 con 0x7fdad0157780 2023-12-24T20:08:01.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdab77fe700 1 -- 172.21.15.61:0/1072844809 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4011ad0 con 0x7fdad0157780 2023-12-24T20:08:01.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdad5fc1700 1 -- 172.21.15.61:0/1072844809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad00c41f0 con 0x7fdad0157780 2023-12-24T20:08:01.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.567+0000 7fdad5fc1700 1 -- 172.21.15.61:0/1072844809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad014f9b0 con 0x7fdad0157780 2023-12-24T20:08:01.574 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.568+0000 7fdad5fc1700 1 -- 172.21.15.61:0/1072844809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad004c3c0 con 0x7fdad0157780 2023-12-24T20:08:01.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.569+0000 7fdab77fe700 1 -- 172.21.15.61:0/1072844809 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdac401c460 con 0x7fdad0157780 2023-12-24T20:08:01.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.569+0000 7fdab77fe700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdabc066f30 0x7fdabc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:01.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.569+0000 7fdab77fe700 1 -- 172.21.15.61:0/1072844809 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdac40842e0 con 0x7fdad0157780 2023-12-24T20:08:01.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.570+0000 7fdacf7fe700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdabc066f30 0x7fdabc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:01.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.570+0000 7fdacf7fe700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdabc066f30 0x7fdabc0693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdac0001660 tx=0x7fdac0007bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:01.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.574+0000 7fdab77fe700 1 -- 172.21.15.61:0/1072844809 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdac4051550 con 0x7fdad0157780 2023-12-24T20:08:01.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.817+0000 7fdad5fc1700 1 -- 172.21.15.61:0/1072844809 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdad01592d0 con 0x7fdad0157780 2023-12-24T20:08:01.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.818+0000 7fdab77fe700 1 -- 172.21.15.61:0/1072844809 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fdad01592d0 con 0x7fdad0157780 2023-12-24T20:08:01.818 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:01.819 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1018177900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1018177900},{"type":"v1","addr":"172.21.15.133:6836","nonce":1018177900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2332940307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2332940307},{"type":"v1","addr":"172.21.15.61:6834","nonce":2332940307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/784121250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":784121250},{"type":"v1","addr":"172.21.15.61:6835","nonce":784121250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:07:20.139140+0000","modified":"2023-12-24T20:07:23.769968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8145":{"gid":8145,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2891152875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2891152875},{"type":"v1","addr":"172.21.15.133:6837","nonce":2891152875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:08:01.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 -- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdabc066f30 msgr2=0x7fdabc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdabc066f30 0x7fdabc0693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdac0001660 tx=0x7fdac0007bd0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 -- 172.21.15.61:0/1072844809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad0157780 msgr2=0x7fdad00c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad0157780 0x7fdad00c5110 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c600 tx=0x7fdac4007f60 comp rx=0 tx=0).stop 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 -- 172.21.15.61:0/1072844809 shutdown_connections 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdad00ce2c0 0x7fdad0144450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdabc066f30 0x7fdabc0693e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdad015ad30 0x7fdad0156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 --2- 172.21.15.61:0/1072844809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdad0157780 0x7fdad00c5110 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 -- 172.21.15.61:0/1072844809 >> 172.21.15.61:0/1072844809 conn(0x7fdad006b650 msgr2=0x7fdad00b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 -- 172.21.15.61:0/1072844809 shutdown_connections 2023-12-24T20:08:01.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:01.820+0000 7fdad5fc1700 1 -- 172.21.15.61:0/1072844809 wait complete. 2023-12-24T20:08:01.822 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 92 2023-12-24T20:08:01.833 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-24T20:08:01.982 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","whoami":0,"id":8145,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":41.232683827000002,"mdsmap_epoch":92,"osdmap_epoch":188,"osdmap_epoch_barrier":187,"uptime":47.262763507999999} 2023-12-24T20:08:01.983 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "dfb999b6-2fb1-4e3b-80b2-d432556cbbe5", "fs_name": "cephfs", "id": 8145, "mdsmap_epoch": 92, "osdmap_epoch": 188, "osdmap_epoch_barrier": 187, "rank_uptime": 41.232683827, "state": "up:active", "uptime": 47.262763508, "want_state": "up:active", "whoami": 0 } 2023-12-24T20:08:01.983 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-24T20:08:01.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-12-24T20:08:01.983 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-24T20:08:02.303 INFO:teuthology.orchestra.run.smithi061.stderr:50+0 records in 2023-12-24T20:08:02.303 INFO:teuthology.orchestra.run.smithi061.stderr:50+0 records out 2023-12-24T20:08:02.303 INFO:teuthology.orchestra.run.smithi061.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.299281 s, 175 MB/s 2023-12-24T20:08:02.303 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-24T20:08:02.303 DEBUG:teuthology.orchestra.run.smithi061:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:08:02.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-24T20:08:02.391 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-24T20:08:02.391 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-12-24T20:08:02.391 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:08:02.391 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-24T20:08:02.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[76110]: fuse finished with error 0 and tester_r 0 2023-12-24T20:08:02.441 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:08:02.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:02.441 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-24T20:08:02.556 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi133.front.sepia.ceph.com... 2023-12-24T20:08:02.557 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-12-24T20:08:02.557 DEBUG:teuthology.orchestra.run.smithi133:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-24T20:08:02.598 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi133.stderr:ceph-fuse[49391]: fuse finished with error 0 and tester_r 0 2023-12-24T20:08:02.600 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:08:02.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:02.600 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-24T20:08:02.766 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:08:02.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:02.766 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-24T20:08:02.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:08:02.784 INFO:teuthology.orchestra.run.smithi061.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-24T20:08:02.785 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:08:02.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:02.785 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-24T20:08:02.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:08:02.827 INFO:teuthology.orchestra.run.smithi133.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-24T20:08:02.827 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:02.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.949+0000 7f7787ee0700 1 Processor -- start 2023-12-24T20:08:02.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.949+0000 7f7787ee0700 1 -- start start 2023-12-24T20:08:02.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.950+0000 7f7787ee0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780068140 0x7f77800cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:02.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.950+0000 7f7787ee0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77800b2890 con 0x7f7780068510 2023-12-24T20:08:02.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.950+0000 7f7787ee0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77800cf630 con 0x7f7780159a60 2023-12-24T20:08:02.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.950+0000 7f7787ee0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77800b2240 con 0x7f7780068140 2023-12-24T20:08:02.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.950+0000 7f778547b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7780068510 0x7f77800b0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38542/0 (socket says 172.21.15.61:38542) 2023-12-24T20:08:02.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.950+0000 7f778547b700 1 -- 172.21.15.61:0/4281301763 learned_addr learned my addr 172.21.15.61:0/4281301763 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.950+0000 7f7785c7c700 1 --2- 172.21.15.61:0/4281301763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780068140 0x7f77800cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7784c7a700 1 -- 172.21.15.61:0/4281301763 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487196096 0 0) 0x7f77800b2890 con 0x7f7780068510 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7784c7a700 1 -- 172.21.15.61:0/4281301763 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f776c003570 con 0x7f7780068510 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7784c7a700 1 -- 172.21.15.61:0/4281301763 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189284017 0 0) 0x7f77800cf630 con 0x7f7780159a60 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7784c7a700 1 -- 172.21.15.61:0/4281301763 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77800b2890 con 0x7f7780159a60 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7785c7c700 1 -- 172.21.15.61:0/4281301763 >> v1:172.21.15.133:6789/0 conn(0x7f7780159a60 legacy=0x7f7780159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7784c7a700 1 -- 172.21.15.61:0/4281301763 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1637174345 0 0) 0x7f776c003570 con 0x7f7780068510 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7785c7c700 1 -- 172.21.15.61:0/4281301763 >> v1:172.21.15.61:6789/0 conn(0x7f7780068510 legacy=0x7f77800b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7785c7c700 1 -- 172.21.15.61:0/4281301763 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77800b2520 con 0x7f7780068140 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7785c7c700 1 --2- 172.21.15.61:0/4281301763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780068140 0x7f77800cefa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7774009900 tx=0x7f7774009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e10ef563b5e80f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7784c7a700 1 -- 172.21.15.61:0/4281301763 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c001470 con 0x7f7780068140 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7784c7a700 1 -- 172.21.15.61:0/4281301763 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7774011420 con 0x7f7780068140 2023-12-24T20:08:02.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.951+0000 7f7784c7a700 1 -- 172.21.15.61:0/4281301763 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77740117c0 con 0x7f7780068140 2023-12-24T20:08:02.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.952+0000 7f7787ee0700 1 -- 172.21.15.61:0/4281301763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780068140 msgr2=0x7f77800cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:02.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.952+0000 7f7787ee0700 1 --2- 172.21.15.61:0/4281301763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780068140 0x7f77800cefa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7774009900 tx=0x7f7774009120 comp rx=0 tx=0).stop 2023-12-24T20:08:02.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.952+0000 7f7787ee0700 1 -- 172.21.15.61:0/4281301763 shutdown_connections 2023-12-24T20:08:02.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.952+0000 7f7787ee0700 1 --2- 172.21.15.61:0/4281301763 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780068140 0x7f77800cefa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:02.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.952+0000 7f7787ee0700 1 -- 172.21.15.61:0/4281301763 >> 172.21.15.61:0/4281301763 conn(0x7f7780097a10 msgr2=0x7f77800ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:02.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.952+0000 7f7787ee0700 1 -- 172.21.15.61:0/4281301763 shutdown_connections 2023-12-24T20:08:02.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.952+0000 7f7787ee0700 1 -- 172.21.15.61:0/4281301763 wait complete. 2023-12-24T20:08:02.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.953+0000 7f7787ee0700 1 Processor -- start 2023-12-24T20:08:02.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.953+0000 7f7787ee0700 1 -- start start 2023-12-24T20:08:02.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f7787ee0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7780068140 0x7f7780156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:02.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f7787ee0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7780068510 0x7f778015d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:02.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f7787ee0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780159a60 0x7f778006b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:02.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f7787ee0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778015da00 con 0x7f7780068510 2023-12-24T20:08:02.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f7787ee0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778015dce0 con 0x7f7780068140 2023-12-24T20:08:02.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f7787ee0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778015dfc0 con 0x7f7780159a60 2023-12-24T20:08:02.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f778547b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7780068510 0x7f778015d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:02.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f778547b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7780068510 0x7f778015d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57030/0 (socket says 172.21.15.61:57030) 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f778547b700 1 -- 172.21.15.61:0/2197643496 learned_addr learned my addr 172.21.15.61:0/2197643496 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f7785c7c700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7780068140 0x7f7780156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f778647d700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780159a60 0x7f778006b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f778547b700 1 -- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780159a60 msgr2=0x7f778006b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f778547b700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780159a60 0x7f778006b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f778547b700 1 -- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7780068140 msgr2=0x7f7780156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f778547b700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7780068140 0x7f7780156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f778547b700 1 -- 172.21.15.61:0/2197643496 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740093c0 con 0x7f7780068510 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f7785c7c700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7780068140 0x7f7780156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f778547b700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7780068510 0x7f778015d090 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f777c00cb70 tx=0x7f777c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.954+0000 7f7771ffb700 1 -- 172.21.15.61:0/2197643496 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c007360 con 0x7f7780068510 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.955+0000 7f7771ffb700 1 -- 172.21.15.61:0/2197643496 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777c0074e0 con 0x7f7780068510 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.955+0000 7f7787ee0700 1 -- 172.21.15.61:0/2197643496 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778015e2a0 con 0x7f7780068510 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.955+0000 7f7771ffb700 1 -- 172.21.15.61:0/2197643496 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c004830 con 0x7f7780068510 2023-12-24T20:08:02.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.955+0000 7f7787ee0700 1 -- 172.21.15.61:0/2197643496 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778015d5d0 con 0x7f7780068510 2023-12-24T20:08:02.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.956+0000 7f7787ee0700 1 -- 172.21.15.61:0/2197643496 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778006d440 con 0x7f7780068510 2023-12-24T20:08:02.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.956+0000 7f7771ffb700 1 -- 172.21.15.61:0/2197643496 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f777c004ba0 con 0x7f7780068510 2023-12-24T20:08:02.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.956+0000 7f7771ffb700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7764066f30 0x7f77640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:02.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.957+0000 7f7771ffb700 1 -- 172.21.15.61:0/2197643496 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f777c083d20 con 0x7f7780068510 2023-12-24T20:08:02.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.957+0000 7f7785c7c700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7764066f30 0x7f77640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:02.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.957+0000 7f7785c7c700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7764066f30 0x7f77640693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7774009160 tx=0x7f7774016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:02.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:02.961+0000 7f7771ffb700 1 -- 172.21.15.61:0/2197643496 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f777c051010 con 0x7f7780068510 2023-12-24T20:08:03.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.203+0000 7f7787ee0700 1 -- 172.21.15.61:0/2197643496 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f778004c3c0 con 0x7f7780068510 2023-12-24T20:08:03.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.203+0000 7f7771ffb700 1 -- 172.21.15.61:0/2197643496 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f777c018090 con 0x7f7780068510 2023-12-24T20:08:03.204 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:03.204 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1018177900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1018177900},{"type":"v1","addr":"172.21.15.133:6836","nonce":1018177900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2332940307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2332940307},{"type":"v1","addr":"172.21.15.61:6834","nonce":2332940307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/784121250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":784121250},{"type":"v1","addr":"172.21.15.61:6835","nonce":784121250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:07:20.139140+0000","modified":"2023-12-24T20:07:23.769968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8145":{"gid":8145,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2891152875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2891152875},{"type":"v1","addr":"172.21.15.133:6837","nonce":2891152875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:08:03.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.205+0000 7f7787ee0700 1 -- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7764066f30 msgr2=0x7f77640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.205+0000 7f7787ee0700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7764066f30 0x7f77640693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7774009160 tx=0x7f7774016000 comp rx=0 tx=0).stop 2023-12-24T20:08:03.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.205+0000 7f7787ee0700 1 -- 172.21.15.61:0/2197643496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7780068510 msgr2=0x7f778015d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.205+0000 7f7787ee0700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7780068510 0x7f778015d090 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f777c00cb70 tx=0x7f777c001b50 comp rx=0 tx=0).stop 2023-12-24T20:08:03.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.205+0000 7f7787ee0700 1 -- 172.21.15.61:0/2197643496 shutdown_connections 2023-12-24T20:08:03.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.205+0000 7f7787ee0700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7780159a60 0x7f778006b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.205+0000 7f7787ee0700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7764066f30 0x7f77640693e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.205+0000 7f7787ee0700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7780068140 0x7f7780156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.205+0000 7f7787ee0700 1 --2- 172.21.15.61:0/2197643496 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7780068510 0x7f778015d090 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.205+0000 7f7787ee0700 1 -- 172.21.15.61:0/2197643496 >> 172.21.15.61:0/2197643496 conn(0x7f7780097a10 msgr2=0x7f77800ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:03.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.206+0000 7f7787ee0700 1 -- 172.21.15.61:0/2197643496 shutdown_connections 2023-12-24T20:08:03.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.206+0000 7f7787ee0700 1 -- 172.21.15.61:0/2197643496 wait complete. 2023-12-24T20:08:03.208 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 92 2023-12-24T20:08:03.222 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:03.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.344+0000 7fbfc4885700 1 Processor -- start 2023-12-24T20:08:03.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.344+0000 7fbfc4885700 1 -- start start 2023-12-24T20:08:03.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfc4885700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbfc0068140 0x7fbfc00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfc4885700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbfc0159a60 0x7fbfc0159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfc4885700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc00b2890 con 0x7fbfc0068510 2023-12-24T20:08:03.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfc4885700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc00cf630 con 0x7fbfc0159a60 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfc4885700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00b2240 con 0x7fbfc0068140 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbfc0159a60 0x7fbfc0159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbfc0159a60 0x7fbfc0159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57040/0 (socket says 172.21.15.61:57040) 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbed9d700 1 -- 172.21.15.61:0/3070311412 learned_addr learned my addr 172.21.15.61:0/3070311412 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbe59c700 1 --2- 172.21.15.61:0/3070311412 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbfc0068140 0x7fbfc00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbed9d700 1 -- 172.21.15.61:0/3070311412 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbfc0068140 msgr2=0x7fbfc00cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbed9d700 1 --2- 172.21.15.61:0/3070311412 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbfc0068140 0x7fbfc00cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbed9d700 1 -- 172.21.15.61:0/3070311412 >> v1:172.21.15.133:6789/0 conn(0x7fbfc0068510 legacy=0x7fbfc00b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbed9d700 1 -- 172.21.15.61:0/3070311412 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc00b2520 con 0x7fbfc0159a60 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbed9d700 1 --2- 172.21.15.61:0/3070311412 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0159a60 0x7fbfc0159f00 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009f20 tx=0x7fbfb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c7a082e0d87644 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbd59a700 1 -- 172.21.15.61:0/3070311412 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb800e070 con 0x7fbfc0159a60 2023-12-24T20:08:03.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbd59a700 1 -- 172.21.15.61:0/3070311412 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb800ba80 con 0x7fbfc0159a60 2023-12-24T20:08:03.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.345+0000 7fbfbd59a700 1 -- 172.21.15.61:0/3070311412 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb80092e0 con 0x7fbfc0159a60 2023-12-24T20:08:03.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.346+0000 7fbfc4885700 1 -- 172.21.15.61:0/3070311412 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0159a60 msgr2=0x7fbfc0159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.346+0000 7fbfc4885700 1 --2- 172.21.15.61:0/3070311412 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0159a60 0x7fbfc0159f00 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009f20 tx=0x7fbfb8009840 comp rx=0 tx=0).stop 2023-12-24T20:08:03.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.346+0000 7fbfc4885700 1 -- 172.21.15.61:0/3070311412 shutdown_connections 2023-12-24T20:08:03.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.346+0000 7fbfc4885700 1 --2- 172.21.15.61:0/3070311412 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0159a60 0x7fbfc0159f00 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.346+0000 7fbfc4885700 1 --2- 172.21.15.61:0/3070311412 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbfc0068140 0x7fbfc00cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.346+0000 7fbfc4885700 1 -- 172.21.15.61:0/3070311412 >> 172.21.15.61:0/3070311412 conn(0x7fbfc0097a10 msgr2=0x7fbfc00ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:03.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.346+0000 7fbfc4885700 1 -- 172.21.15.61:0/3070311412 shutdown_connections 2023-12-24T20:08:03.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.346+0000 7fbfc4885700 1 -- 172.21.15.61:0/3070311412 wait complete. 2023-12-24T20:08:03.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.347+0000 7fbfc4885700 1 Processor -- start 2023-12-24T20:08:03.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.347+0000 7fbfc4885700 1 -- start start 2023-12-24T20:08:03.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfc4885700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbfc0068140 0x7fbfc00c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfc4885700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0068510 0x7fbfc0155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfc4885700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc0159a60 0x7fbfc00c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfc4885700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc009b1b0 con 0x7fbfc0068510 2023-12-24T20:08:03.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfc4885700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00c3b70 con 0x7fbfc0159a60 2023-12-24T20:08:03.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfc4885700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc009b450 con 0x7fbfc0068140 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0068510 0x7fbfc0155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0068510 0x7fbfc0155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57042/0 (socket says 172.21.15.61:57042) 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbdd9b700 1 -- 172.21.15.61:0/3036778441 learned_addr learned my addr 172.21.15.61:0/3036778441 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbe59c700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbfc0068140 0x7fbfc00c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbed9d700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc0159a60 0x7fbfc00c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbdd9b700 1 -- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbfc0068140 msgr2=0x7fbfc00c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbdd9b700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbfc0068140 0x7fbfc00c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbdd9b700 1 -- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc0159a60 msgr2=0x7fbfc00c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbdd9b700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc0159a60 0x7fbfc00c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbdd9b700 1 -- 172.21.15.61:0/3036778441 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb8009ae0 con 0x7fbfc0068510 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.348+0000 7fbfbdd9b700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0068510 0x7fbfc0155be0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000c590 tx=0x7fbfb000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.349+0000 7fbfae7fc700 1 -- 172.21.15.61:0/3036778441 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0011590 con 0x7fbfc0068510 2023-12-24T20:08:03.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.349+0000 7fbfae7fc700 1 -- 172.21.15.61:0/3036778441 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb0011710 con 0x7fbfc0068510 2023-12-24T20:08:03.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.349+0000 7fbfae7fc700 1 -- 172.21.15.61:0/3036778441 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0011ad0 con 0x7fbfc0068510 2023-12-24T20:08:03.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.349+0000 7fbfc4885700 1 -- 172.21.15.61:0/3036778441 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc009b730 con 0x7fbfc0068510 2023-12-24T20:08:03.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.349+0000 7fbfc4885700 1 -- 172.21.15.61:0/3036778441 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc0156120 con 0x7fbfc0068510 2023-12-24T20:08:03.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.350+0000 7fbfc4885700 1 -- 172.21.15.61:0/3036778441 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc00984f0 con 0x7fbfc0068510 2023-12-24T20:08:03.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.350+0000 7fbfae7fc700 1 -- 172.21.15.61:0/3036778441 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbfb001b3b0 con 0x7fbfc0068510 2023-12-24T20:08:03.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.351+0000 7fbfae7fc700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbfa0066f30 0x7fbfa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.351+0000 7fbfae7fc700 1 -- 172.21.15.61:0/3036778441 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbfb0083a40 con 0x7fbfc0068510 2023-12-24T20:08:03.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.351+0000 7fbfbe59c700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbfa0066f30 0x7fbfa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.351+0000 7fbfbe59c700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbfa0066f30 0x7fbfa00693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4006aa0 tx=0x7fbfb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:03.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.355+0000 7fbfae7fc700 1 -- 172.21.15.61:0/3036778441 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfc00984f0 con 0x7fbfc0068510 2023-12-24T20:08:03.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.551+0000 7fbfc4885700 1 -- 172.21.15.61:0/3036778441 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfc00984f0 con 0x7fbfc0068510 2023-12-24T20:08:03.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.552+0000 7fbfae7fc700 1 -- 172.21.15.61:0/3036778441 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+15372 (secure 0 0 0) 0x7fbfc00984f0 con 0x7fbfc0068510 2023-12-24T20:08:03.553 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:03.553 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":188,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:07:58.625527+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:07:17.930601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-24T20:07:19.106020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:03.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.554+0000 7fbfc4885700 1 -- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbfa0066f30 msgr2=0x7fbfa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.554+0000 7fbfc4885700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbfa0066f30 0x7fbfa00693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4006aa0 tx=0x7fbfb4008040 comp rx=0 tx=0).stop 2023-12-24T20:08:03.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.554+0000 7fbfc4885700 1 -- 172.21.15.61:0/3036778441 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0068510 msgr2=0x7fbfc0155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.554+0000 7fbfc4885700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0068510 0x7fbfc0155be0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000c590 tx=0x7fbfb000c8a0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.554+0000 7fbfc4885700 1 -- 172.21.15.61:0/3036778441 shutdown_connections 2023-12-24T20:08:03.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.554+0000 7fbfc4885700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbfc0068140 0x7fbfc00c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.554+0000 7fbfc4885700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbfa0066f30 0x7fbfa00693e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.554+0000 7fbfc4885700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc0159a60 0x7fbfc00c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.554+0000 7fbfc4885700 1 --2- 172.21.15.61:0/3036778441 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbfc0068510 0x7fbfc0155be0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.554+0000 7fbfc4885700 1 -- 172.21.15.61:0/3036778441 >> 172.21.15.61:0/3036778441 conn(0x7fbfc0097a10 msgr2=0x7fbfc00aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:03.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.555+0000 7fbfc4885700 1 -- 172.21.15.61:0/3036778441 shutdown_connections 2023-12-24T20:08:03.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.555+0000 7fbfc4885700 1 -- 172.21.15.61:0/3036778441 wait complete. 2023-12-24T20:08:03.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-24T19:56:54.358495+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-24T20:07:17.930601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-24T20:07:19.106020+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '188', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-24T20:08:03.568 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-24T20:08:03.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.694+0000 7f21fef77700 1 Processor -- start 2023-12-24T20:08:03.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.694+0000 7f21fef77700 1 -- start start 2023-12-24T20:08:03.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fef77700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f21f80cdf90 0x7f21f806b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fef77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21f80ce360 0x7f21f8158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fef77700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21f8158a80 0x7f21f806c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fef77700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f815bad0 con 0x7f21f80cdf90 2023-12-24T20:08:03.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fef77700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f815bdb0 con 0x7f21f8158a80 2023-12-24T20:08:03.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fef77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f815c090 con 0x7f21f80ce360 2023-12-24T20:08:03.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fcd13700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f21f80cdf90 0x7f21f806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fcd13700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f21f80cdf90 0x7f21f806b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57046/0 (socket says 172.21.15.61:57046) 2023-12-24T20:08:03.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fcd13700 1 -- 172.21.15.61:0/2838650760 learned_addr learned my addr 172.21.15.61:0/2838650760 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fd514700 1 --2- 172.21.15.61:0/2838650760 >> v2:172.21.15.133:3300/0 conn(0x7f21f8158a80 0x7f21f806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21f7fff700 1 --2- 172.21.15.61:0/2838650760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21f80ce360 0x7f21f8158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fcd13700 1 -- 172.21.15.61:0/2838650760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21f80ce360 msgr2=0x7f21f8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fcd13700 1 --2- 172.21.15.61:0/2838650760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21f80ce360 0x7f21f8158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fcd13700 1 -- 172.21.15.61:0/2838650760 >> v2:172.21.15.133:3300/0 conn(0x7f21f8158a80 msgr2=0x7f21f806c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fcd13700 1 --2- 172.21.15.61:0/2838650760 >> v2:172.21.15.133:3300/0 conn(0x7f21f8158a80 0x7f21f806c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.695+0000 7f21fcd13700 1 -- 172.21.15.61:0/2838650760 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f815c370 con 0x7f21f80cdf90 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21fcd13700 1 --2- 172.21.15.61:0/2838650760 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 0x7f21f806b700 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f21f80b1570 tx=0x7f21ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1787c29445d09637 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21f77fe700 1 -- 172.21.15.61:0/2838650760 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00b860 con 0x7f21f80cdf90 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21f77fe700 1 -- 172.21.15.61:0/2838650760 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec00b9c0 con 0x7f21f80cdf90 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21f77fe700 1 -- 172.21.15.61:0/2838650760 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00bd60 con 0x7f21f80cdf90 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21fef77700 1 -- 172.21.15.61:0/2838650760 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 msgr2=0x7f21f806b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21fef77700 1 --2- 172.21.15.61:0/2838650760 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 0x7f21f806b700 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f21f80b1570 tx=0x7f21ec009250 comp rx=0 tx=0).stop 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21fef77700 1 -- 172.21.15.61:0/2838650760 shutdown_connections 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21fef77700 1 --2- 172.21.15.61:0/2838650760 >> v2:172.21.15.133:3300/0 conn(0x7f21f8158a80 0x7f21f806c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21fef77700 1 --2- 172.21.15.61:0/2838650760 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 0x7f21f806b700 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21fef77700 1 --2- 172.21.15.61:0/2838650760 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21f80ce360 0x7f21f8158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21fef77700 1 -- 172.21.15.61:0/2838650760 >> 172.21.15.61:0/2838650760 conn(0x7f21f806f810 msgr2=0x7f21f806ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:03.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21fef77700 1 -- 172.21.15.61:0/2838650760 shutdown_connections 2023-12-24T20:08:03.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.696+0000 7f21fef77700 1 -- 172.21.15.61:0/2838650760 wait complete. 2023-12-24T20:08:03.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.697+0000 7f21fef77700 1 Processor -- start 2023-12-24T20:08:03.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.698+0000 7f21fef77700 1 -- start start 2023-12-24T20:08:03.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.698+0000 7f21fef77700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 0x7f21f8165d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.698+0000 7f21fef77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f80ce360 0x7f21f8168b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.698+0000 7f21fef77700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21f8158a80 0x7f21f8143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.698+0000 7f21fef77700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f816a3c0 con 0x7f21f80cdf90 2023-12-24T20:08:03.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.698+0000 7f21fef77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80a6720 con 0x7f21f80ce360 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.698+0000 7f21fef77700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f81697b0 con 0x7f21f8158a80 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.698+0000 7f21fcd13700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 0x7f21f8165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.698+0000 7f21fcd13700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 0x7f21f8165d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57062/0 (socket says 172.21.15.61:57062) 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.698+0000 7f21fcd13700 1 -- 172.21.15.61:0/3383025506 learned_addr learned my addr 172.21.15.61:0/3383025506 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21fd514700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21f8158a80 0x7f21f8143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21f7fff700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f80ce360 0x7f21f8168b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21fcd13700 1 -- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21f8158a80 msgr2=0x7f21f8143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21fcd13700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21f8158a80 0x7f21f8143bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21fcd13700 1 -- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f80ce360 msgr2=0x7f21f8168b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21fcd13700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f80ce360 0x7f21f8168b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21fcd13700 1 -- 172.21.15.61:0/3383025506 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec0094f0 con 0x7f21f80cdf90 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21fcd13700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 0x7f21f8165d90 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f21f806e760 tx=0x7f21ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21f4ff9700 1 -- 172.21.15.61:0/3383025506 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec024440 con 0x7f21f80cdf90 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21f4ff9700 1 -- 172.21.15.61:0/3383025506 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec0245a0 con 0x7f21f80cdf90 2023-12-24T20:08:03.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21fef77700 1 -- 172.21.15.61:0/3383025506 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f8169a90 con 0x7f21f80cdf90 2023-12-24T20:08:03.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21f4ff9700 1 -- 172.21.15.61:0/3383025506 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec024960 con 0x7f21f80cdf90 2023-12-24T20:08:03.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.699+0000 7f21fef77700 1 -- 172.21.15.61:0/3383025506 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f816a050 con 0x7f21f80cdf90 2023-12-24T20:08:03.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.700+0000 7f21fef77700 1 -- 172.21.15.61:0/3383025506 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f804c3c0 con 0x7f21f80cdf90 2023-12-24T20:08:03.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.701+0000 7f21f4ff9700 1 -- 172.21.15.61:0/3383025506 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f21ec01a420 con 0x7f21f80cdf90 2023-12-24T20:08:03.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.701+0000 7f21f4ff9700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f21dc066f30 0x7f21dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:03.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.701+0000 7f21f4ff9700 1 -- 172.21.15.61:0/3383025506 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21ec0862b0 con 0x7f21f80cdf90 2023-12-24T20:08:03.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.701+0000 7f21f7fff700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f21dc066f30 0x7f21dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:03.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.702+0000 7f21f7fff700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f21dc066f30 0x7f21dc0693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f21f815a350 tx=0x7f21e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:03.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.705+0000 7f21f4ff9700 1 -- 172.21.15.61:0/3383025506 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21ec0535a0 con 0x7f21f80cdf90 2023-12-24T20:08:03.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.899+0000 7f21fef77700 1 -- 172.21.15.61:0/3383025506 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21f80cc140 con 0x7f21f80cdf90 2023-12-24T20:08:03.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.899+0000 7f21f4ff9700 1 -- 172.21.15.61:0/3383025506 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v188) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21ec056bc0 con 0x7f21f80cdf90 2023-12-24T20:08:03.900 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-12-24T20:08:03.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 -- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f21dc066f30 msgr2=0x7f21dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f21dc066f30 0x7f21dc0693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f21f815a350 tx=0x7f21e4008040 comp rx=0 tx=0).stop 2023-12-24T20:08:03.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 -- 172.21.15.61:0/3383025506 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 msgr2=0x7f21f8165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:03.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 0x7f21f8165d90 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f21f806e760 tx=0x7f21ec017000 comp rx=0 tx=0).stop 2023-12-24T20:08:03.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 -- 172.21.15.61:0/3383025506 shutdown_connections 2023-12-24T20:08:03.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f21f8158a80 0x7f21f8143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f21dc066f30 0x7f21dc0693e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21f80cdf90 0x7f21f8165d90 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 --2- 172.21.15.61:0/3383025506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f80ce360 0x7f21f8168b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:03.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 -- 172.21.15.61:0/3383025506 >> 172.21.15.61:0/3383025506 conn(0x7f21f806f810 msgr2=0x7f21f81565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:03.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 -- 172.21.15.61:0/3383025506 shutdown_connections 2023-12-24T20:08:03.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:03.902+0000 7f21fef77700 1 -- 172.21.15.61:0/3383025506 wait complete. 2023-12-24T20:08:03.914 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-24T20:08:04.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.038+0000 7fc8cac45700 1 Processor -- start 2023-12-24T20:08:04.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.038+0000 7fc8cac45700 1 -- start start 2023-12-24T20:08:04.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.038+0000 7fc8cac45700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c40cdf90 0x7fc8c406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.038+0000 7fc8cac45700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc8c40ce360 0x7fc8c4158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.038+0000 7fc8cac45700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c415bad0 con 0x7fc8c4158a80 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.038+0000 7fc8cac45700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c415bdb0 con 0x7fc8c40ce360 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.038+0000 7fc8cac45700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c415c090 con 0x7fc8c40cdf90 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c91e2700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fc8c4158a80 0x7fc8c406c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38552/0 (socket says 172.21.15.61:38552) 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c91e2700 1 -- 172.21.15.61:0/1520371307 learned_addr learned my addr 172.21.15.61:0/1520371307 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c3fff700 1 --2- 172.21.15.61:0/1520371307 >> v2:172.21.15.133:3300/0 conn(0x7fc8c40ce360 0x7fc8c4158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c89e1700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c40cdf90 0x7fc8c406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462813484 0 0) 0x7fc8c415bad0 con 0x7fc8c4158a80 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8b4003570 con 0x7fc8c4158a80 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1421362623 0 0) 0x7fc8b4003570 con 0x7fc8c4158a80 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c40cdf90 msgr2=0x7fc8c406b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c40cdf90 0x7fc8c406b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 >> v2:172.21.15.133:3300/0 conn(0x7fc8c40ce360 msgr2=0x7fc8c4158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 --2- 172.21.15.61:0/1520371307 >> v2:172.21.15.133:3300/0 conn(0x7fc8c40ce360 0x7fc8c4158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c415c370 con 0x7fc8c4158a80 2023-12-24T20:08:04.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fc8bc0017f0 con 0x7fc8c4158a80 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 >> v1:172.21.15.61:6789/0 conn(0x7fc8c4158a80 legacy=0x7fc8c406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c40cdf90 0x7fc8b4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b4003fe0 0x7fc8b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8b4004d50 0x7fc8b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c415bdb0 con 0x7fc8b4004d50 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c415c090 con 0x7fc8b4003fe0 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.039+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b400ba90 con 0x7fc8c40cdf90 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c89e1700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c40cdf90 0x7fc8b4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c3fff700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b4003fe0 0x7fc8b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c91e2700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8b4004d50 0x7fc8b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c91e2700 1 -- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c40cdf90 msgr2=0x7fc8b4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c91e2700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c40cdf90 0x7fc8b4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c91e2700 1 -- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b4003fe0 msgr2=0x7fc8b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c91e2700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b4003fe0 0x7fc8b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c91e2700 1 -- 172.21.15.61:0/1520371307 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b4003570 con 0x7fc8b4004d50 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c91e2700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8b4004d50 0x7fc8b40051c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00a970 tx=0x7fc8c415c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c413b368c64e4f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0070d0 con 0x7fc8b4004d50 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc007230 con 0x7fc8b4004d50 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.040+0000 7fc8c37fe700 1 -- 172.21.15.61:0/1520371307 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0075f0 con 0x7fc8b4004d50 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.041+0000 7fc8cac45700 1 -- 172.21.15.61:0/1520371307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8b4004d50 msgr2=0x7fc8b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.041+0000 7fc8cac45700 1 --2- 172.21.15.61:0/1520371307 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8b4004d50 0x7fc8b40051c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00a970 tx=0x7fc8c415c650 comp rx=0 tx=0).stop 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.041+0000 7fc8c91e2700 1 -- 172.21.15.61:0/1520371307 reap_dead start 2023-12-24T20:08:04.044 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.041+0000 7fc8cac45700 1 -- 172.21.15.61:0/1520371307 shutdown_connections 2023-12-24T20:08:04.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.041+0000 7fc8cac45700 1 -- 172.21.15.61:0/1520371307 >> 172.21.15.61:0/1520371307 conn(0x7fc8c406f810 msgr2=0x7fc8c406ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:04.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.041+0000 7fc8cac45700 1 -- 172.21.15.61:0/1520371307 shutdown_connections 2023-12-24T20:08:04.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.041+0000 7fc8cac45700 1 -- 172.21.15.61:0/1520371307 wait complete. 2023-12-24T20:08:04.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.042+0000 7fc8cac45700 1 Processor -- start 2023-12-24T20:08:04.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.042+0000 7fc8cac45700 1 -- start start 2023-12-24T20:08:04.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8cac45700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c41496c0 0x7fc8c40b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8cac45700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8c40b43e0 0x7fc8c40686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8cac45700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8c4068c10 0x7fc8c40af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8cac45700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c4069080 con 0x7fc8c4068c10 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8cac45700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40c8910 con 0x7fc8c40b43e0 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8cac45700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c4149a90 con 0x7fc8c41496c0 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c91e2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8c4068c10 0x7fc8c40af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c91e2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8c4068c10 0x7fc8c40af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57086/0 (socket says 172.21.15.61:57086) 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c91e2700 1 -- 172.21.15.61:0/3706053311 learned_addr learned my addr 172.21.15.61:0/3706053311 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c89e1700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c41496c0 0x7fc8c40b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c3fff700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8c40b43e0 0x7fc8c40686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c91e2700 1 -- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c41496c0 msgr2=0x7fc8c40b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c91e2700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c41496c0 0x7fc8c40b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c91e2700 1 -- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8c40b43e0 msgr2=0x7fc8c40686d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c91e2700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8c40b43e0 0x7fc8c40686d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c91e2700 1 -- 172.21.15.61:0/3706053311 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c40c7d00 con 0x7fc8c4068c10 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.043+0000 7fc8c91e2700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8c4068c10 0x7fc8c40af2c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4004730 tx=0x7fc8bc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:04.048 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.044+0000 7fc8c0ff9700 1 -- 172.21.15.61:0/3706053311 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0070d0 con 0x7fc8c4068c10 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.044+0000 7fc8c0ff9700 1 -- 172.21.15.61:0/3706053311 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc0017b0 con 0x7fc8c4068c10 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.044+0000 7fc8cac45700 1 -- 172.21.15.61:0/3706053311 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c40c7fe0 con 0x7fc8c4068c10 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.044+0000 7fc8c0ff9700 1 -- 172.21.15.61:0/3706053311 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0012d0 con 0x7fc8c4068c10 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.044+0000 7fc8cac45700 1 -- 172.21.15.61:0/3706053311 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c40c85a0 con 0x7fc8c4068c10 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.045+0000 7fc8cac45700 1 -- 172.21.15.61:0/3706053311 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c40b1e10 con 0x7fc8c4068c10 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.045+0000 7fc8c0ff9700 1 -- 172.21.15.61:0/3706053311 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fc8bc024020 con 0x7fc8c4068c10 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.045+0000 7fc8c0ff9700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc8a8066f30 0x7fc8a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.045+0000 7fc8c0ff9700 1 -- 172.21.15.61:0/3706053311 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8bc0867f0 con 0x7fc8c4068c10 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.046+0000 7fc8c89e1700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc8a8066f30 0x7fc8a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.046+0000 7fc8c89e1700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc8a8066f30 0x7fc8a80693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8006f00 tx=0x7fc8b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:04.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.050+0000 7fc8c0ff9700 1 -- 172.21.15.61:0/3706053311 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8bc053a60 con 0x7fc8c4068c10 2023-12-24T20:08:04.242 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.242+0000 7fc8cac45700 1 -- 172.21.15.61:0/3706053311 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8c404c3c0 con 0x7fc8c4068c10 2023-12-24T20:08:04.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.243+0000 7fc8c0ff9700 1 -- 172.21.15.61:0/3706053311 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v188) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8bc02c020 con 0x7fc8c4068c10 2023-12-24T20:08:04.243 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-12-24T20:08:04.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 -- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc8a8066f30 msgr2=0x7fc8a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc8a8066f30 0x7fc8a80693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8006f00 tx=0x7fc8b8008040 comp rx=0 tx=0).stop 2023-12-24T20:08:04.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 -- 172.21.15.61:0/3706053311 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8c4068c10 msgr2=0x7fc8c40af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8c4068c10 0x7fc8c40af2c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4004730 tx=0x7fc8bc016000 comp rx=0 tx=0).stop 2023-12-24T20:08:04.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 -- 172.21.15.61:0/3706053311 shutdown_connections 2023-12-24T20:08:04.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fc8c41496c0 0x7fc8c40b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fc8a8066f30 0x7fc8a80693e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc8c4068c10 0x7fc8c40af2c0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 --2- 172.21.15.61:0/3706053311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8c40b43e0 0x7fc8c40686d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 -- 172.21.15.61:0/3706053311 >> 172.21.15.61:0/3706053311 conn(0x7fc8c406f810 msgr2=0x7fc8c40cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:04.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 -- 172.21.15.61:0/3706053311 shutdown_connections 2023-12-24T20:08:04.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.245+0000 7fc8cac45700 1 -- 172.21.15.61:0/3706053311 wait complete. 2023-12-24T20:08:04.257 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-24T20:08:04.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.382+0000 7facfaac6700 1 Processor -- start 2023-12-24T20:08:04.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.382+0000 7facfaac6700 1 -- start start 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facfaac6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7facf40af0c0 0x7facf4069400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facfaac6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7facf406e980 0x7facf406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facfaac6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf41590e0 con 0x7facf40aecf0 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facfaac6700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf41584d0 con 0x7facf406e980 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facfaac6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf41587b0 con 0x7facf40af0c0 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf9063700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7facf406e980 0x7facf406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf8862700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7facf40aecf0 0x7facf40cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38560/0 (socket says 172.21.15.61:38560) 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf8862700 1 -- 172.21.15.61:0/381501759 learned_addr learned my addr 172.21.15.61:0/381501759 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf3fff700 1 --2- 172.21.15.61:0/381501759 >> v2:172.21.15.133:3300/0 conn(0x7facf40af0c0 0x7facf4069400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf9063700 1 -- 172.21.15.61:0/381501759 >> v2:172.21.15.133:3300/0 conn(0x7facf40af0c0 msgr2=0x7facf4069400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf9063700 1 --2- 172.21.15.61:0/381501759 >> v2:172.21.15.133:3300/0 conn(0x7facf40af0c0 0x7facf4069400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf9063700 1 -- 172.21.15.61:0/381501759 >> v1:172.21.15.61:6789/0 conn(0x7facf40aecf0 legacy=0x7facf40cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf9063700 1 -- 172.21.15.61:0/381501759 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4158a90 con 0x7facf406e980 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf37fe700 1 -- 172.21.15.61:0/381501759 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740498327 0 0) 0x7facf41590e0 con 0x7facf40aecf0 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf3fff700 1 --2- 172.21.15.61:0/381501759 >> v2:172.21.15.133:3300/0 conn(0x7facf40af0c0 0x7facf4069400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf9063700 1 --2- 172.21.15.61:0/381501759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 0x7facf406eda0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7facf4064030 tx=0x7facec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8d615925b16adc server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.383+0000 7facf37fe700 1 -- 172.21.15.61:0/381501759 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec00e070 con 0x7facf406e980 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.384+0000 7facf37fe700 1 -- 172.21.15.61:0/381501759 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec00bc30 con 0x7facf406e980 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.384+0000 7facf37fe700 1 -- 172.21.15.61:0/381501759 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec012430 con 0x7facf406e980 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.384+0000 7facfaac6700 1 -- 172.21.15.61:0/381501759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 msgr2=0x7facf406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.384+0000 7facfaac6700 1 --2- 172.21.15.61:0/381501759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 0x7facf406eda0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7facf4064030 tx=0x7facec009780 comp rx=0 tx=0).stop 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.384+0000 7facfaac6700 1 -- 172.21.15.61:0/381501759 shutdown_connections 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.384+0000 7facfaac6700 1 --2- 172.21.15.61:0/381501759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 0x7facf406eda0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.384+0000 7facfaac6700 1 --2- 172.21.15.61:0/381501759 >> v2:172.21.15.133:3300/0 conn(0x7facf40af0c0 0x7facf4069400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.384+0000 7facfaac6700 1 -- 172.21.15.61:0/381501759 >> 172.21.15.61:0/381501759 conn(0x7facf4067fd0 msgr2=0x7facf40ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.384+0000 7facfaac6700 1 -- 172.21.15.61:0/381501759 shutdown_connections 2023-12-24T20:08:04.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.384+0000 7facfaac6700 1 -- 172.21.15.61:0/381501759 wait complete. 2023-12-24T20:08:04.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.385+0000 7facfaac6700 1 Processor -- start 2023-12-24T20:08:04.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.385+0000 7facfaac6700 1 -- start start 2023-12-24T20:08:04.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facfaac6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 0x7facf4151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facfaac6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facf40aecf0 0x7facf41407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facfaac6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf40af0c0 0x7facf4141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facfaac6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf40b1130 con 0x7facf406e980 2023-12-24T20:08:04.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facfaac6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf40b1410 con 0x7facf40af0c0 2023-12-24T20:08:04.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facfaac6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf40b16f0 con 0x7facf40aecf0 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facf8862700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 0x7facf4151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facf8862700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 0x7facf4151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57108/0 (socket says 172.21.15.61:57108) 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facf8862700 1 -- 172.21.15.61:0/4042940329 learned_addr learned my addr 172.21.15.61:0/4042940329 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facf9063700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf40af0c0 0x7facf4141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.386+0000 7facf3fff700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facf40aecf0 0x7facf41407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facf8862700 1 -- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facf40aecf0 msgr2=0x7facf41407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facf8862700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facf40aecf0 0x7facf41407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facf8862700 1 -- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf40af0c0 msgr2=0x7facf4141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facf8862700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf40af0c0 0x7facf4141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facf8862700 1 -- 172.21.15.61:0/4042940329 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec009a20 con 0x7facf406e980 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facf9063700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf40af0c0 0x7facf4141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facf8862700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 0x7facf4151380 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7face800c5b0 tx=0x7face8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facf0ff9700 1 -- 172.21.15.61:0/4042940329 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8005b30 con 0x7facf406e980 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facf0ff9700 1 -- 172.21.15.61:0/4042940329 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face8005c90 con 0x7facf406e980 2023-12-24T20:08:04.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facfaac6700 1 -- 172.21.15.61:0/4042940329 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf40b19d0 con 0x7facf406e980 2023-12-24T20:08:04.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facf0ff9700 1 -- 172.21.15.61:0/4042940329 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8007300 con 0x7facf406e980 2023-12-24T20:08:04.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.387+0000 7facfaac6700 1 -- 172.21.15.61:0/4042940329 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf4140d10 con 0x7facf406e980 2023-12-24T20:08:04.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.388+0000 7facfaac6700 1 -- 172.21.15.61:0/4042940329 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf404c3c0 con 0x7facf406e980 2023-12-24T20:08:04.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.388+0000 7facf0ff9700 1 -- 172.21.15.61:0/4042940329 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7face801b3b0 con 0x7facf406e980 2023-12-24T20:08:04.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.389+0000 7facf0ff9700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7facd8066f30 0x7facd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.389+0000 7facf0ff9700 1 -- 172.21.15.61:0/4042940329 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7face8083a60 con 0x7facf406e980 2023-12-24T20:08:04.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.389+0000 7facf3fff700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7facd8066f30 0x7facd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.390+0000 7facf3fff700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7facd8066f30 0x7facd80693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7face0006f00 tx=0x7face0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:04.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.393+0000 7facf0ff9700 1 -- 172.21.15.61:0/4042940329 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7face8050cd0 con 0x7facf406e980 2023-12-24T20:08:04.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.593+0000 7facfaac6700 1 -- 172.21.15.61:0/4042940329 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7facf4064060 con 0x7facf406e980 2023-12-24T20:08:04.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.593+0000 7facf0ff9700 1 -- 172.21.15.61:0/4042940329 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v188) v1 ==== 100+0+11 (secure 0 0 0) 0x7face80170a0 con 0x7facf406e980 2023-12-24T20:08:04.594 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 -- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7facd8066f30 msgr2=0x7facd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7facd8066f30 0x7facd80693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7face0006f00 tx=0x7face0008040 comp rx=0 tx=0).stop 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 -- 172.21.15.61:0/4042940329 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 msgr2=0x7facf4151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 0x7facf4151380 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7face800c5b0 tx=0x7face8001070 comp rx=0 tx=0).stop 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 -- 172.21.15.61:0/4042940329 shutdown_connections 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7facd8066f30 0x7facd80693e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facf40af0c0 0x7facf4141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7facf406e980 0x7facf4151380 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 --2- 172.21.15.61:0/4042940329 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7facf40aecf0 0x7facf41407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 -- 172.21.15.61:0/4042940329 >> 172.21.15.61:0/4042940329 conn(0x7facf4067fd0 msgr2=0x7facf40c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:04.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 -- 172.21.15.61:0/4042940329 shutdown_connections 2023-12-24T20:08:04.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.595+0000 7facfaac6700 1 -- 172.21.15.61:0/4042940329 wait complete. 2023-12-24T20:08:04.608 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:04.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.729+0000 7fe8f5dc5700 1 Processor -- start 2023-12-24T20:08:04.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.729+0000 7fe8f5dc5700 1 -- start start 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8f5dc5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f00ca270 0x7fe8f00cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8f5dc5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8f0158b60 0x7fe8f00ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8f5dc5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f00ca6f0 con 0x7fe8f0157780 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8f5dc5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f00ca9d0 con 0x7fe8f0158b60 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8f5dc5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00cacb0 con 0x7fe8f00ca270 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8eeffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f00ca270 0x7fe8f00cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8effff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8f0158b60 0x7fe8f00ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8eeffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f00ca270 0x7fe8f00cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:54814/0 (socket says 172.21.15.61:54814) 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8eeffd700 1 -- 172.21.15.61:0/610996882 learned_addr learned my addr 172.21.15.61:0/610996882 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8ef7fe700 1 --1- 172.21.15.61:0/610996882 >> v1:172.21.15.133:6789/0 conn(0x7fe8f0157780 0x7fe8f006c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:34518/0 (socket says 172.21.15.61:34518) 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.730+0000 7fe8ee7fc700 1 -- 172.21.15.61:0/610996882 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899420697 0 0) 0x7fe8f00ca6f0 con 0x7fe8f0157780 2023-12-24T20:08:04.732 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8eeffd700 1 -- 172.21.15.61:0/610996882 >> v2:172.21.15.133:3300/0 conn(0x7fe8f0158b60 msgr2=0x7fe8f00ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8eeffd700 1 --2- 172.21.15.61:0/610996882 >> v2:172.21.15.133:3300/0 conn(0x7fe8f0158b60 0x7fe8f00ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8eeffd700 1 -- 172.21.15.61:0/610996882 >> v1:172.21.15.133:6789/0 conn(0x7fe8f0157780 legacy=0x7fe8f006c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8eeffd700 1 -- 172.21.15.61:0/610996882 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f00caf90 con 0x7fe8f00ca270 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8effff700 1 --2- 172.21.15.61:0/610996882 >> v2:172.21.15.133:3300/0 conn(0x7fe8f0158b60 0x7fe8f00ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8eeffd700 1 --2- 172.21.15.61:0/610996882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f00ca270 0x7fe8f00cdbb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80099b0 tx=0x7fe8d8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2129ae54ea42473d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8ee7fc700 1 -- 172.21.15.61:0/610996882 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8009ea0 con 0x7fe8f00ca270 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8ee7fc700 1 -- 172.21.15.61:0/610996882 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d800b860 con 0x7fe8f00ca270 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8ee7fc700 1 -- 172.21.15.61:0/610996882 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800bc00 con 0x7fe8f00ca270 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/610996882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f00ca270 msgr2=0x7fe8f00cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.731+0000 7fe8f5dc5700 1 --2- 172.21.15.61:0/610996882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f00ca270 0x7fe8f00cdbb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80099b0 tx=0x7fe8d8009250 comp rx=0 tx=0).stop 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.732+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/610996882 shutdown_connections 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.732+0000 7fe8f5dc5700 1 --2- 172.21.15.61:0/610996882 >> v2:172.21.15.133:3300/0 conn(0x7fe8f0158b60 0x7fe8f00ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.732+0000 7fe8f5dc5700 1 --2- 172.21.15.61:0/610996882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f00ca270 0x7fe8f00cdbb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.733 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.732+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/610996882 >> 172.21.15.61:0/610996882 conn(0x7fe8f006b650 msgr2=0x7fe8f00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:04.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.732+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/610996882 shutdown_connections 2023-12-24T20:08:04.734 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.732+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/610996882 wait complete. 2023-12-24T20:08:04.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.733+0000 7fe8f5dc5700 1 Processor -- start 2023-12-24T20:08:04.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.733+0000 7fe8f5dc5700 1 -- start start 2023-12-24T20:08:04.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.734+0000 7fe8f5dc5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8f0157780 0x7fe8f00b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.734+0000 7fe8f5dc5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8f0158b60 0x7fe8f00c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.734+0000 7fe8f5dc5700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f016b5f0 0x7fe8f014c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.734+0000 7fe8f5dc5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f016c550 con 0x7fe8f0157780 2023-12-24T20:08:04.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.734+0000 7fe8f5dc5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f016ba90 con 0x7fe8f0158b60 2023-12-24T20:08:04.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.734+0000 7fe8f5dc5700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00c3790 con 0x7fe8f016b5f0 2023-12-24T20:08:04.736 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.734+0000 7fe8ef7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8f0157780 0x7fe8f00b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.734+0000 7fe8ef7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8f0157780 0x7fe8f00b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57116/0 (socket says 172.21.15.61:57116) 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.734+0000 7fe8ef7fe700 1 -- 172.21.15.61:0/2326417995 learned_addr learned my addr 172.21.15.61:0/2326417995 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8eeffd700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8f0158b60 0x7fe8f00c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8effff700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f016b5f0 0x7fe8f014c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8ef7fe700 1 -- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f016b5f0 msgr2=0x7fe8f014c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8ef7fe700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f016b5f0 0x7fe8f014c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8ef7fe700 1 -- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8f0158b60 msgr2=0x7fe8f00c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8ef7fe700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8f0158b60 0x7fe8f00c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8ef7fe700 1 -- 172.21.15.61:0/2326417995 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8009a20 con 0x7fe8f0157780 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8effff700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f016b5f0 0x7fe8f014c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8ef7fe700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8f0157780 0x7fe8f00b2980 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000c7e0 tx=0x7fe8e0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8e77fe700 1 -- 172.21.15.61:0/2326417995 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0007300 con 0x7fe8f0157780 2023-12-24T20:08:04.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/2326417995 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d80094f0 con 0x7fe8f0157780 2023-12-24T20:08:04.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8e77fe700 1 -- 172.21.15.61:0/2326417995 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e0007460 con 0x7fe8f0157780 2023-12-24T20:08:04.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8e77fe700 1 -- 172.21.15.61:0/2326417995 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0004830 con 0x7fe8f0157780 2023-12-24T20:08:04.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.735+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/2326417995 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f016bcb0 con 0x7fe8f0157780 2023-12-24T20:08:04.738 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.736+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/2326417995 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f004c3c0 con 0x7fe8f0157780 2023-12-24T20:08:04.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.736+0000 7fe8e77fe700 1 -- 172.21.15.61:0/2326417995 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe8e0004be0 con 0x7fe8f0157780 2023-12-24T20:08:04.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.737+0000 7fe8e77fe700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8d0066f30 0x7fe8d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:04.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.737+0000 7fe8e77fe700 1 -- 172.21.15.61:0/2326417995 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe8e0083af0 con 0x7fe8f0157780 2023-12-24T20:08:04.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.737+0000 7fe8eeffd700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8d0066f30 0x7fe8d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:04.739 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.737+0000 7fe8eeffd700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8d0066f30 0x7fe8d00693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80099b0 tx=0x7fe8d8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:04.741 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.741+0000 7fe8e77fe700 1 -- 172.21.15.61:0/2326417995 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8e0050d60 con 0x7fe8f0157780 2023-12-24T20:08:04.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.981+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/2326417995 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8f015b560 con 0x7fe8f0157780 2023-12-24T20:08:04.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.982+0000 7fe8e77fe700 1 -- 172.21.15.61:0/2326417995 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7fe8e0018020 con 0x7fe8f0157780 2023-12-24T20:08:04.982 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:04.982 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1018177900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1018177900},{"type":"v1","addr":"172.21.15.133:6836","nonce":1018177900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2332940307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2332940307},{"type":"v1","addr":"172.21.15.61:6834","nonce":2332940307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/784121250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":784121250},{"type":"v1","addr":"172.21.15.61:6835","nonce":784121250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:07:20.139140+0000","modified":"2023-12-24T20:07:23.769968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8145":{"gid":8145,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2891152875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2891152875},{"type":"v1","addr":"172.21.15.133:6837","nonce":2891152875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:08:04.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8d0066f30 msgr2=0x7fe8d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8d0066f30 0x7fe8d00693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80099b0 tx=0x7fe8d8017000 comp rx=0 tx=0).stop 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/2326417995 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8f0157780 msgr2=0x7fe8f00b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8f0157780 0x7fe8f00b2980 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000c7e0 tx=0x7fe8e0007e10 comp rx=0 tx=0).stop 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/2326417995 shutdown_connections 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8f016b5f0 0x7fe8f014c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8d0066f30 0x7fe8d00693e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8f0157780 0x7fe8f00b2980 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 --2- 172.21.15.61:0/2326417995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8f0158b60 0x7fe8f00c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/2326417995 >> 172.21.15.61:0/2326417995 conn(0x7fe8f006b650 msgr2=0x7fe8f00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/2326417995 shutdown_connections 2023-12-24T20:08:04.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:04.984+0000 7fe8f5dc5700 1 -- 172.21.15.61:0/2326417995 wait complete. 2023-12-24T20:08:04.986 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 92 2023-12-24T20:08:04.997 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:05.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.117+0000 7f9bf246e700 1 Processor -- start 2023-12-24T20:08:05.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.118+0000 7f9bf246e700 1 -- start start 2023-12-24T20:08:05.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.118+0000 7f9bf246e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9bec159a90 0x7f9bec070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.118+0000 7f9bf246e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159e60 0x7f9bec070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.118+0000 7f9bf246e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec06a090 con 0x7f9bec0b04c0 2023-12-24T20:08:05.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.118+0000 7f9bf246e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec06ac10 con 0x7f9bec159a90 2023-12-24T20:08:05.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.118+0000 7f9bf246e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec06a2e0 con 0x7f9bec159e60 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.118+0000 7f9bf0a0b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9bec0b04c0 0x7f9bec0c93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38574/0 (socket says 172.21.15.61:38574) 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.118+0000 7f9bf0a0b700 1 -- 172.21.15.61:0/314000237 learned_addr learned my addr 172.21.15.61:0/314000237 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beb7fe700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159e60 0x7f9bec070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286557924 0 0) 0x7f9bec06a090 con 0x7f9bec0b04c0 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9bebfff700 1 --2- 172.21.15.61:0/314000237 >> v2:172.21.15.133:3300/0 conn(0x7f9bec159a90 0x7f9bec070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bd4003570 con 0x7f9bec0b04c0 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 636253292 0 0) 0x7f9bd4003570 con 0x7f9bec0b04c0 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159e60 msgr2=0x7f9bec070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159e60 0x7f9bec070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 >> v2:172.21.15.133:3300/0 conn(0x7f9bec159a90 msgr2=0x7f9bec070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 --2- 172.21.15.61:0/314000237 >> v2:172.21.15.133:3300/0 conn(0x7f9bec159a90 0x7f9bec070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec06a5c0 con 0x7f9bec0b04c0 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f9be40017f0 con 0x7f9bec0b04c0 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 >> v1:172.21.15.61:6789/0 conn(0x7f9bec0b04c0 legacy=0x7f9bec0c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd4003a60 0x7f9bd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 0x7f9bd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159e60 0x7f9bd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec06ac10 con 0x7f9bd4004810 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec06a2e0 con 0x7f9bd4003a60 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd400ba60 con 0x7f9bec159e60 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9beb7fe700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 0x7f9bd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9bebfff700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd4003a60 0x7f9bd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.119+0000 7f9bf0a0b700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159e60 0x7f9bd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9beb7fe700 1 -- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159e60 msgr2=0x7f9bd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9beb7fe700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159e60 0x7f9bd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9beb7fe700 1 -- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd4003a60 msgr2=0x7f9bd4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9beb7fe700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bd4003a60 0x7f9bd4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9beb7fe700 1 -- 172.21.15.61:0/314000237 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd4003570 con 0x7f9bd4004810 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9beb7fe700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 0x7f9bd4004c80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9bec15d710 tx=0x7f9be00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d89325c5e95d28 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be000e710 con 0x7f9bd4004810 2023-12-24T20:08:05.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be000e870 con 0x7f9bd4004810 2023-12-24T20:08:05.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9beaffd700 1 -- 172.21.15.61:0/314000237 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be000ec30 con 0x7f9bd4004810 2023-12-24T20:08:05.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9bf246e700 1 -- 172.21.15.61:0/314000237 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 msgr2=0x7f9bd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9bf246e700 1 --2- 172.21.15.61:0/314000237 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 0x7f9bd4004c80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9bec15d710 tx=0x7f9be00091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9bf0a0b700 1 -- 172.21.15.61:0/314000237 reap_dead start 2023-12-24T20:08:05.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9bf246e700 1 -- 172.21.15.61:0/314000237 shutdown_connections 2023-12-24T20:08:05.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.120+0000 7f9bf246e700 1 -- 172.21.15.61:0/314000237 >> 172.21.15.61:0/314000237 conn(0x7f9bec0cd6f0 msgr2=0x7f9bec0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:05.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.121+0000 7f9bf246e700 1 -- 172.21.15.61:0/314000237 shutdown_connections 2023-12-24T20:08:05.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.121+0000 7f9bf246e700 1 -- 172.21.15.61:0/314000237 wait complete. 2023-12-24T20:08:05.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.122+0000 7f9bf246e700 1 Processor -- start 2023-12-24T20:08:05.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.122+0000 7f9bf246e700 1 -- start start 2023-12-24T20:08:05.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bf246e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 0x7f9bec0c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bf246e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bec158bb0 0x7f9bec15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bf246e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159020 0x7f9bec0c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bf246e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec15b170 con 0x7f9bd4004810 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bf246e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec15a280 con 0x7f9bec158bb0 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bf246e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec15a560 con 0x7f9bec159020 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bebfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 0x7f9bec0c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bebfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 0x7f9bec0c1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57126/0 (socket says 172.21.15.61:57126) 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bebfff700 1 -- 172.21.15.61:0/1277948485 learned_addr learned my addr 172.21.15.61:0/1277948485 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9beb7fe700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bec158bb0 0x7f9bec15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bebfff700 1 -- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159020 msgr2=0x7f9bec0c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bf0a0b700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159020 0x7f9bec0c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bebfff700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159020 0x7f9bec0c2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bebfff700 1 -- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bec158bb0 msgr2=0x7f9bec15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bebfff700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bec158bb0 0x7f9bec15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bebfff700 1 -- 172.21.15.61:0/1277948485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec15a840 con 0x7f9bd4004810 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9beb7fe700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bec158bb0 0x7f9bec15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bebfff700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 0x7f9bec0c1b20 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc011d40 tx=0x7f9bdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:05.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bd3fff700 1 -- 172.21.15.61:0/1277948485 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00fac0 con 0x7f9bd4004810 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bd3fff700 1 -- 172.21.15.61:0/1277948485 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc00fc20 con 0x7f9bd4004810 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bd3fff700 1 -- 172.21.15.61:0/1277948485 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc014440 con 0x7f9bd4004810 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bf246e700 1 -- 172.21.15.61:0/1277948485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec15ab20 con 0x7f9bd4004810 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.123+0000 7f9bf246e700 1 -- 172.21.15.61:0/1277948485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec0c2060 con 0x7f9bd4004810 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.124+0000 7f9bf246e700 1 -- 172.21.15.61:0/1277948485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec04c3c0 con 0x7f9bd4004810 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.125+0000 7f9bd3fff700 1 -- 172.21.15.61:0/1277948485 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9bdc014a80 con 0x7f9bd4004810 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.125+0000 7f9bd3fff700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9bd8066f30 0x7f9bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.125+0000 7f9bd3fff700 1 -- 172.21.15.61:0/1277948485 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9bdc018030 con 0x7f9bd4004810 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.125+0000 7f9beb7fe700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9bd8066f30 0x7f9bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.126+0000 7f9beb7fe700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9bd8066f30 0x7f9bd80693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0c7ce0 tx=0x7f9be001a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:05.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.129+0000 7f9bd3fff700 1 -- 172.21.15.61:0/1277948485 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bdc052520 con 0x7f9bd4004810 2023-12-24T20:08:05.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.325+0000 7f9bf246e700 1 -- 172.21.15.61:0/1277948485 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bec15b450 con 0x7f9bd4004810 2023-12-24T20:08:05.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.326+0000 7f9bd3fff700 1 -- 172.21.15.61:0/1277948485 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f9bdc05b030 con 0x7f9bd4004810 2023-12-24T20:08:05.326 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:05.326 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":188,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:07:58.625527+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:07:17.930601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-24T20:07:19.106020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:05.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 -- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9bd8066f30 msgr2=0x7f9bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9bd8066f30 0x7f9bd80693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0c7ce0 tx=0x7f9be001a000 comp rx=0 tx=0).stop 2023-12-24T20:08:05.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 -- 172.21.15.61:0/1277948485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 msgr2=0x7f9bec0c1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 0x7f9bec0c1b20 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc011d40 tx=0x7f9bdc0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 -- 172.21.15.61:0/1277948485 shutdown_connections 2023-12-24T20:08:05.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9bec159020 0x7f9bec0c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9bd8066f30 0x7f9bd80693e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9bd4004810 0x7f9bec0c1b20 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 --2- 172.21.15.61:0/1277948485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bec158bb0 0x7f9bec15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 -- 172.21.15.61:0/1277948485 >> 172.21.15.61:0/1277948485 conn(0x7f9bec0cd6f0 msgr2=0x7f9bec0cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:05.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 -- 172.21.15.61:0/1277948485 shutdown_connections 2023-12-24T20:08:05.329 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.328+0000 7f9bf246e700 1 -- 172.21.15.61:0/1277948485 wait complete. 2023-12-24T20:08:05.341 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:08:05.341 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:05.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.463+0000 7f860e581700 1 Processor -- start 2023-12-24T20:08:05.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.463+0000 7f860e581700 1 -- start start 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860e581700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8608159b00 0x7f8608067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860e581700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8608070d50 0x7f86080afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860e581700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86080a84d0 con 0x7f86080af7d0 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860e581700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86080b01b0 con 0x7f8608070d50 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860e581700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86080a7620 con 0x7f8608159b00 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860cb1e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8608070d50 0x7f86080afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860cb1e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8608070d50 0x7f86080afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57132/0 (socket says 172.21.15.61:57132) 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860cb1e700 1 -- 172.21.15.61:0/1399110277 learned_addr learned my addr 172.21.15.61:0/1399110277 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f8607fff700 1 --2- 172.21.15.61:0/1399110277 >> v2:172.21.15.133:3300/0 conn(0x7f8608159b00 0x7f8608067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860cb1e700 1 -- 172.21.15.61:0/1399110277 >> v2:172.21.15.133:3300/0 conn(0x7f8608159b00 msgr2=0x7f8608067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860cb1e700 1 --2- 172.21.15.61:0/1399110277 >> v2:172.21.15.133:3300/0 conn(0x7f8608159b00 0x7f8608067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860cb1e700 1 -- 172.21.15.61:0/1399110277 >> v1:172.21.15.133:6789/0 conn(0x7f86080af7d0 legacy=0x7f8608070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:05.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f860cb1e700 1 -- 172.21.15.61:0/1399110277 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86080a78c0 con 0x7f8608070d50 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.464+0000 7f8607fff700 1 --2- 172.21.15.61:0/1399110277 >> v2:172.21.15.133:3300/0 conn(0x7f8608159b00 0x7f8608067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f860cb1e700 1 --2- 172.21.15.61:0/1399110277 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608070d50 0x7f86080afc70 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f860806d630 tx=0x7f8600009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f606d0939ab793a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f8606ffd700 1 -- 172.21.15.61:0/1399110277 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860000e070 con 0x7f8608070d50 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f8606ffd700 1 -- 172.21.15.61:0/1399110277 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860000ba10 con 0x7f8608070d50 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f8606ffd700 1 -- 172.21.15.61:0/1399110277 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000092e0 con 0x7f8608070d50 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f860e581700 1 -- 172.21.15.61:0/1399110277 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608070d50 msgr2=0x7f86080afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f860e581700 1 --2- 172.21.15.61:0/1399110277 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608070d50 0x7f86080afc70 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f860806d630 tx=0x7f8600009840 comp rx=0 tx=0).stop 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f860e581700 1 -- 172.21.15.61:0/1399110277 shutdown_connections 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f860e581700 1 --2- 172.21.15.61:0/1399110277 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608070d50 0x7f86080afc70 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f860e581700 1 --2- 172.21.15.61:0/1399110277 >> v2:172.21.15.133:3300/0 conn(0x7f8608159b00 0x7f8608067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f860e581700 1 -- 172.21.15.61:0/1399110277 >> 172.21.15.61:0/1399110277 conn(0x7f86080ca200 msgr2=0x7f86080ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:05.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f860e581700 1 -- 172.21.15.61:0/1399110277 shutdown_connections 2023-12-24T20:08:05.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.465+0000 7f860e581700 1 -- 172.21.15.61:0/1399110277 wait complete. 2023-12-24T20:08:05.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.466+0000 7f860e581700 1 Processor -- start 2023-12-24T20:08:05.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.467+0000 7f860e581700 1 -- start start 2023-12-24T20:08:05.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.467+0000 7f860e581700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8608070d50 0x7f86080b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.467+0000 7f860e581700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86080af7d0 0x7f86081471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.467+0000 7f860e581700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608159b00 0x7f86080b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.467+0000 7f860e581700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8608147720 con 0x7f8608159b00 2023-12-24T20:08:05.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.467+0000 7f860e581700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86080aefb0 con 0x7f86080af7d0 2023-12-24T20:08:05.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.467+0000 7f860e581700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86080ad920 con 0x7f8608070d50 2023-12-24T20:08:05.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860cb1e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608159b00 0x7f86080b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860cb1e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608159b00 0x7f86080b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57148/0 (socket says 172.21.15.61:57148) 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860cb1e700 1 -- 172.21.15.61:0/100352704 learned_addr learned my addr 172.21.15.61:0/100352704 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f8607fff700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8608070d50 0x7f86080b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f86077fe700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86080af7d0 0x7f86081471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860cb1e700 1 -- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8608070d50 msgr2=0x7f86080b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860cb1e700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8608070d50 0x7f86080b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860cb1e700 1 -- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86080af7d0 msgr2=0x7f86081471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860cb1e700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86080af7d0 0x7f86081471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860cb1e700 1 -- 172.21.15.61:0/100352704 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600009ae0 con 0x7f8608159b00 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f8607fff700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8608070d50 0x7f86080b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f86077fe700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86080af7d0 0x7f86081471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860cb1e700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608159b00 0x7f86080b1110 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f860806c750 tx=0x7f8600017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f85effff700 1 -- 172.21.15.61:0/100352704 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000032f0 con 0x7f8608159b00 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f85effff700 1 -- 172.21.15.61:0/100352704 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8600012e60 con 0x7f8608159b00 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860e581700 1 -- 172.21.15.61:0/100352704 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86080adc00 con 0x7f8608159b00 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f85effff700 1 -- 172.21.15.61:0/100352704 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860001d670 con 0x7f8608159b00 2023-12-24T20:08:05.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.468+0000 7f860e581700 1 -- 172.21.15.61:0/100352704 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86080aeb20 con 0x7f8608159b00 2023-12-24T20:08:05.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.469+0000 7f860e581700 1 -- 172.21.15.61:0/100352704 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86080ad780 con 0x7f8608159b00 2023-12-24T20:08:05.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.470+0000 7f85effff700 1 -- 172.21.15.61:0/100352704 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f860001daa0 con 0x7f8608159b00 2023-12-24T20:08:05.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.470+0000 7f85effff700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f85f4066f30 0x7f85f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.470+0000 7f85effff700 1 -- 172.21.15.61:0/100352704 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8600085e10 con 0x7f8608159b00 2023-12-24T20:08:05.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.470+0000 7f8607fff700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f85f4066f30 0x7f85f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.471+0000 7f8607fff700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f85f4066f30 0x7f85f40693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f85fc006fd0 tx=0x7f85fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:05.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.475+0000 7f85effff700 1 -- 172.21.15.61:0/100352704 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86080ad780 con 0x7f8608159b00 2023-12-24T20:08:05.712 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.712+0000 7f860e581700 1 -- 172.21.15.61:0/100352704 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86080ad780 con 0x7f8608159b00 2023-12-24T20:08:05.713 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.712+0000 7f85effff700 1 -- 172.21.15.61:0/100352704 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f86080ad780 con 0x7f8608159b00 2023-12-24T20:08:05.713 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:05.713 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1018177900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1018177900},{"type":"v1","addr":"172.21.15.133:6836","nonce":1018177900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2332940307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2332940307},{"type":"v1","addr":"172.21.15.61:6834","nonce":2332940307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/784121250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":784121250},{"type":"v1","addr":"172.21.15.61:6835","nonce":784121250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:07:20.139140+0000","modified":"2023-12-24T20:07:23.769968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8145":{"gid":8145,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2891152875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2891152875},{"type":"v1","addr":"172.21.15.133:6837","nonce":2891152875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:08:05.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.714+0000 7f860e581700 1 -- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f85f4066f30 msgr2=0x7f85f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.714+0000 7f860e581700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f85f4066f30 0x7f85f40693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f85fc006fd0 tx=0x7f85fc008040 comp rx=0 tx=0).stop 2023-12-24T20:08:05.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.714+0000 7f860e581700 1 -- 172.21.15.61:0/100352704 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608159b00 msgr2=0x7f86080b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.714+0000 7f860e581700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608159b00 0x7f86080b1110 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f860806c750 tx=0x7f8600017000 comp rx=0 tx=0).stop 2023-12-24T20:08:05.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.715+0000 7f860e581700 1 -- 172.21.15.61:0/100352704 shutdown_connections 2023-12-24T20:08:05.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.715+0000 7f860e581700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f8608070d50 0x7f86080b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.715+0000 7f860e581700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f85f4066f30 0x7f85f40693e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.715 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.715+0000 7f860e581700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8608159b00 0x7f86080b1110 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.715+0000 7f860e581700 1 --2- 172.21.15.61:0/100352704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86080af7d0 0x7f86081471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.715+0000 7f860e581700 1 -- 172.21.15.61:0/100352704 >> 172.21.15.61:0/100352704 conn(0x7f86080ca200 msgr2=0x7f8608155260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:05.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.715+0000 7f860e581700 1 -- 172.21.15.61:0/100352704 shutdown_connections 2023-12-24T20:08:05.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.715+0000 7f860e581700 1 -- 172.21.15.61:0/100352704 wait complete. 2023-12-24T20:08:05.716 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 92 2023-12-24T20:08:05.727 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:05.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.850+0000 7f55b2902700 1 Processor -- start 2023-12-24T20:08:05.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.850+0000 7f55b2902700 1 -- start start 2023-12-24T20:08:05.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.850+0000 7f55b2902700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55ac0aaf90 0x7f55ac159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.850+0000 7f55b2902700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac06a630 con 0x7f55ac159850 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.850+0000 7f55b2902700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac069d00 con 0x7f55ac06aac0 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.850+0000 7f55b2902700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ac0cccf0 con 0x7f55ac0aaf90 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55abfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f55ac159850 0x7f55ac0cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38576/0 (socket says 172.21.15.61:38576) 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55abfff700 1 -- 172.21.15.61:0/2905278926 learned_addr learned my addr 172.21.15.61:0/2905278926 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55b0e9f700 1 --2- 172.21.15.61:0/2905278926 >> v2:172.21.15.133:3300/0 conn(0x7f55ac0aaf90 0x7f55ac159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55aaffd700 1 -- 172.21.15.61:0/2905278926 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601582281 0 0) 0x7f55ac06a630 con 0x7f55ac159850 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55aaffd700 1 -- 172.21.15.61:0/2905278926 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5594003570 con 0x7f55ac159850 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55aaffd700 1 -- 172.21.15.61:0/2905278926 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832081673 0 0) 0x7f55ac069d00 con 0x7f55ac06aac0 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55aaffd700 1 -- 172.21.15.61:0/2905278926 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55ac06a630 con 0x7f55ac06aac0 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55b0e9f700 1 -- 172.21.15.61:0/2905278926 >> v1:172.21.15.133:6789/0 conn(0x7f55ac06aac0 legacy=0x7f55ac0aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55b0e9f700 1 -- 172.21.15.61:0/2905278926 >> v1:172.21.15.61:6789/0 conn(0x7f55ac159850 legacy=0x7f55ac0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55b0e9f700 1 -- 172.21.15.61:0/2905278926 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac069fe0 con 0x7f55ac0aaf90 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55b0e9f700 1 --2- 172.21.15.61:0/2905278926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55ac0aaf90 0x7f55ac159c20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009e60 tx=0x7f55a4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d862a339860d0991 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:05.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.851+0000 7f55aaffd700 1 -- 172.21.15.61:0/2905278926 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a400e070 con 0x7f55ac0aaf90 2023-12-24T20:08:05.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.852+0000 7f55aaffd700 1 -- 172.21.15.61:0/2905278926 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a400bab0 con 0x7f55ac0aaf90 2023-12-24T20:08:05.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.852+0000 7f55aaffd700 1 -- 172.21.15.61:0/2905278926 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a400be30 con 0x7f55ac0aaf90 2023-12-24T20:08:05.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.852+0000 7f55b2902700 1 -- 172.21.15.61:0/2905278926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55ac0aaf90 msgr2=0x7f55ac159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.852+0000 7f55b2902700 1 --2- 172.21.15.61:0/2905278926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55ac0aaf90 0x7f55ac159c20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009e60 tx=0x7f55a4009780 comp rx=0 tx=0).stop 2023-12-24T20:08:05.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.852+0000 7f55b2902700 1 -- 172.21.15.61:0/2905278926 shutdown_connections 2023-12-24T20:08:05.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.852+0000 7f55b2902700 1 --2- 172.21.15.61:0/2905278926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55ac0aaf90 0x7f55ac159c20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.852+0000 7f55b2902700 1 -- 172.21.15.61:0/2905278926 >> 172.21.15.61:0/2905278926 conn(0x7f55ac0cceb0 msgr2=0x7f55ac0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:05.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.852+0000 7f55b2902700 1 -- 172.21.15.61:0/2905278926 shutdown_connections 2023-12-24T20:08:05.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.852+0000 7f55b2902700 1 -- 172.21.15.61:0/2905278926 wait complete. 2023-12-24T20:08:05.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.853+0000 7f55b2902700 1 Processor -- start 2023-12-24T20:08:05.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.853+0000 7f55b2902700 1 -- start start 2023-12-24T20:08:05.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55b2902700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55ac06aac0 0x7f55ac150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55b2902700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55ac0aaf90 0x7f55ac169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55b2902700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f55ac159850 0x7f55ac15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55b2902700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac151280 con 0x7f55ac159850 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55b2902700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac15ac80 con 0x7f55ac0aaf90 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55b2902700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac15af60 con 0x7f55ac06aac0 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55b0e9f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f55ac159850 0x7f55ac15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55b0e9f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f55ac159850 0x7f55ac15d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57152/0 (socket says 172.21.15.61:57152) 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55b0e9f700 1 -- 172.21.15.61:0/1315527588 learned_addr learned my addr 172.21.15.61:0/1315527588 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55ab7fe700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55ac0aaf90 0x7f55ac169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.854+0000 7f55abfff700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55ac06aac0 0x7f55ac150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f55b0e9f700 1 -- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55ac06aac0 msgr2=0x7f55ac150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.857 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f55b0e9f700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55ac06aac0 0x7f55ac150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f55b0e9f700 1 -- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55ac0aaf90 msgr2=0x7f55ac169ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f55b0e9f700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55ac0aaf90 0x7f55ac169ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f55b0e9f700 1 -- 172.21.15.61:0/1315527588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a4009a20 con 0x7f55ac159850 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f55abfff700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55ac06aac0 0x7f55ac150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f55b0e9f700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f55ac159850 0x7f55ac15d910 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f55a4013000 tx=0x7f55a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f5593fff700 1 -- 172.21.15.61:0/1315527588 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4027470 con 0x7f55ac159850 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f5593fff700 1 -- 172.21.15.61:0/1315527588 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a40275f0 con 0x7f55ac159850 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f55b2902700 1 -- 172.21.15.61:0/1315527588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac15b240 con 0x7f55ac159850 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f5593fff700 1 -- 172.21.15.61:0/1315527588 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a40279b0 con 0x7f55ac159850 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.855+0000 7f55b2902700 1 -- 172.21.15.61:0/1315527588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac15b800 con 0x7f55ac159850 2023-12-24T20:08:05.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.856+0000 7f55b2902700 1 -- 172.21.15.61:0/1315527588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac04c3c0 con 0x7f55ac159850 2023-12-24T20:08:05.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.858+0000 7f5593fff700 1 -- 172.21.15.61:0/1315527588 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f55a4024070 con 0x7f55ac159850 2023-12-24T20:08:05.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.859+0000 7f5593fff700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5598066f30 0x7f55980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:05.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.859+0000 7f5593fff700 1 -- 172.21.15.61:0/1315527588 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55a40873a0 con 0x7f55ac159850 2023-12-24T20:08:05.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.859+0000 7f55abfff700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5598066f30 0x7f55980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:05.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.860+0000 7f55abfff700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5598066f30 0x7f55980693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f559c0058d0 tx=0x7f559c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:05.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:05.862+0000 7f5593fff700 1 -- 172.21.15.61:0/1315527588 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55a40545f0 con 0x7f55ac159850 2023-12-24T20:08:06.104 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.104+0000 7f55b2902700 1 -- 172.21.15.61:0/1315527588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55ac15b9f0 con 0x7f55ac159850 2023-12-24T20:08:06.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.104+0000 7f5593fff700 1 -- 172.21.15.61:0/1315527588 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4604 (secure 0 0 0) 0x7f55a4057c10 con 0x7f55ac159850 2023-12-24T20:08:06.105 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:06.105 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":92,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1018177900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1018177900},{"type":"v1","addr":"172.21.15.133:6836","nonce":1018177900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2332940307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2332940307},{"type":"v1","addr":"172.21.15.61:6834","nonce":2332940307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/784121250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":784121250},{"type":"v1","addr":"172.21.15.61:6835","nonce":784121250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-24T20:07:20.139140+0000","modified":"2023-12-24T20:07:23.769968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8145},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8145":{"gid":8145,"name":"d","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2891152875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2891152875},{"type":"v1","addr":"172.21.15.133:6837","nonce":2891152875}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-12-24T20:08:06.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 -- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5598066f30 msgr2=0x7f55980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5598066f30 0x7f55980693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f559c0058d0 tx=0x7f559c009040 comp rx=0 tx=0).stop 2023-12-24T20:08:06.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 -- 172.21.15.61:0/1315527588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f55ac159850 msgr2=0x7f55ac15d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f55ac159850 0x7f55ac15d910 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f55a4013000 tx=0x7f55a4019000 comp rx=0 tx=0).stop 2023-12-24T20:08:06.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 -- 172.21.15.61:0/1315527588 shutdown_connections 2023-12-24T20:08:06.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f55ac06aac0 0x7f55ac150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5598066f30 0x7f55980693e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f55ac159850 0x7f55ac15d910 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 --2- 172.21.15.61:0/1315527588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55ac0aaf90 0x7f55ac169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 -- 172.21.15.61:0/1315527588 >> 172.21.15.61:0/1315527588 conn(0x7f55ac0cceb0 msgr2=0x7f55ac0c24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:06.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 -- 172.21.15.61:0/1315527588 shutdown_connections 2023-12-24T20:08:06.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.107+0000 7f55b2902700 1 -- 172.21.15.61:0/1315527588 wait complete. 2023-12-24T20:08:06.109 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 92 2023-12-24T20:08:06.119 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:06.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.241+0000 7f935c904700 1 Processor -- start 2023-12-24T20:08:06.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.241+0000 7f935c904700 1 -- start start 2023-12-24T20:08:06.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f935c904700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9358070d50 0x7f935815c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f935c904700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935815bcd0 con 0x7f935806b630 2023-12-24T20:08:06.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f935c904700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93580cafb0 con 0x7f935806b260 2023-12-24T20:08:06.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f935c904700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93580683a0 con 0x7f9358070d50 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f9356d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f9358070d50 0x7f935815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f9355d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f935806b630 0x7f9358070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:38590/0 (socket says 172.21.15.61:38590) 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f9355d9b700 1 -- 172.21.15.61:0/2313886689 learned_addr learned my addr 172.21.15.61:0/2313886689 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f9356d9d700 1 -- 172.21.15.61:0/2313886689 >> v1:172.21.15.133:6789/0 conn(0x7f935806b260 legacy=0x7f9358067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f9356d9d700 1 -- 172.21.15.61:0/2313886689 >> v1:172.21.15.61:6789/0 conn(0x7f935806b630 legacy=0x7f9358070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f9356d9d700 1 -- 172.21.15.61:0/2313886689 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93580680c0 con 0x7f9358070d50 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f935559a700 1 -- 172.21.15.61:0/2313886689 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950098914 0 0) 0x7f935815bcd0 con 0x7f935806b630 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.242+0000 7f9356d9d700 1 --2- 172.21.15.61:0/2313886689 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9358070d50 0x7f935815c160 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f9350009e60 tx=0x7f9350009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882148b7e1d7845e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.243+0000 7f935559a700 1 -- 172.21.15.61:0/2313886689 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935000e070 con 0x7f9358070d50 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.243+0000 7f935559a700 1 -- 172.21.15.61:0/2313886689 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935000bc30 con 0x7f9358070d50 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.243+0000 7f935559a700 1 -- 172.21.15.61:0/2313886689 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9350012430 con 0x7f9358070d50 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.243+0000 7f935c904700 1 -- 172.21.15.61:0/2313886689 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9358070d50 msgr2=0x7f935815c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.243+0000 7f935c904700 1 --2- 172.21.15.61:0/2313886689 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9358070d50 0x7f935815c160 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f9350009e60 tx=0x7f9350009780 comp rx=0 tx=0).stop 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.243+0000 7f935c904700 1 -- 172.21.15.61:0/2313886689 shutdown_connections 2023-12-24T20:08:06.244 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.243+0000 7f935c904700 1 --2- 172.21.15.61:0/2313886689 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9358070d50 0x7f935815c160 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.243+0000 7f935c904700 1 -- 172.21.15.61:0/2313886689 >> 172.21.15.61:0/2313886689 conn(0x7f93580ca200 msgr2=0x7f93580ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:06.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.243+0000 7f935c904700 1 -- 172.21.15.61:0/2313886689 shutdown_connections 2023-12-24T20:08:06.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.243+0000 7f935c904700 1 -- 172.21.15.61:0/2313886689 wait complete. 2023-12-24T20:08:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.244+0000 7f935c904700 1 Processor -- start 2023-12-24T20:08:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.244+0000 7f935c904700 1 -- start start 2023-12-24T20:08:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f935c904700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935806b260 0x7f93580a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f935c904700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935806b630 0x7f935816a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f935c904700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9358070d50 0x7f935816ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f935c904700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935814daf0 con 0x7f935806b630 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f935c904700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358169a90 con 0x7f9358070d50 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f935c904700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93580a6b50 con 0x7f935806b260 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f9355d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935806b630 0x7f935816a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f9355d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935806b630 0x7f935816a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:57166/0 (socket says 172.21.15.61:57166) 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f9355d9b700 1 -- 172.21.15.61:0/1831771564 learned_addr learned my addr 172.21.15.61:0/1831771564 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f935659c700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935806b260 0x7f93580a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f9356d9d700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9358070d50 0x7f935816ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f9355d9b700 1 -- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935806b260 msgr2=0x7f93580a6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f9355d9b700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935806b260 0x7f93580a6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f9355d9b700 1 -- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9358070d50 msgr2=0x7f935816ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f9355d9b700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9358070d50 0x7f935816ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f9355d9b700 1 -- 172.21.15.61:0/1831771564 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350009a20 con 0x7f935806b630 2023-12-24T20:08:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.245+0000 7f9356d9d700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9358070d50 0x7f935816ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.246+0000 7f9355d9b700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935806b630 0x7f935816a270 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c7e0 tx=0x7f934c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.246+0000 7f93467fc700 1 -- 172.21.15.61:0/1831771564 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c005b30 con 0x7f935806b630 2023-12-24T20:08:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.246+0000 7f93467fc700 1 -- 172.21.15.61:0/1831771564 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c005c90 con 0x7f935806b630 2023-12-24T20:08:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.246+0000 7f935c904700 1 -- 172.21.15.61:0/1831771564 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93580a6e30 con 0x7f935806b630 2023-12-24T20:08:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.246+0000 7f93467fc700 1 -- 172.21.15.61:0/1831771564 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c007300 con 0x7f935806b630 2023-12-24T20:08:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.246+0000 7f935c904700 1 -- 172.21.15.61:0/1831771564 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9358169d50 con 0x7f935806b630 2023-12-24T20:08:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.247+0000 7f935c904700 1 -- 172.21.15.61:0/1831771564 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935804c3c0 con 0x7f935806b630 2023-12-24T20:08:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.247+0000 7f93467fc700 1 -- 172.21.15.61:0/1831771564 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f934c01b400 con 0x7f935806b630 2023-12-24T20:08:06.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.248+0000 7f93467fc700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9338066f30 0x7f93380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.248+0000 7f93467fc700 1 -- 172.21.15.61:0/1831771564 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f934c083ff0 con 0x7f935806b630 2023-12-24T20:08:06.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.248+0000 7f935659c700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9338066f30 0x7f93380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.250 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.248+0000 7f935659c700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9338066f30 0x7f93380693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f93480016c0 tx=0x7f9348009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:06.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.252+0000 7f93467fc700 1 -- 172.21.15.61:0/1831771564 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f934c0512e0 con 0x7f935806b630 2023-12-24T20:08:06.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.447+0000 7f935c904700 1 -- 172.21.15.61:0/1831771564 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9358169f70 con 0x7f935806b630 2023-12-24T20:08:06.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.448+0000 7f93467fc700 1 -- 172.21.15.61:0/1831771564 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+15372 (secure 0 0 0) 0x7f934c054900 con 0x7f935806b630 2023-12-24T20:08:06.448 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:06.448 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":188,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:07:58.625527+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-24T20:07:17.930601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-24T20:07:19.106020+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 -- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9338066f30 msgr2=0x7f93380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9338066f30 0x7f93380693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f93480016c0 tx=0x7f9348009040 comp rx=0 tx=0).stop 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 -- 172.21.15.61:0/1831771564 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935806b630 msgr2=0x7f935816a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935806b630 0x7f935816a270 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c7e0 tx=0x7f934c007df0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 -- 172.21.15.61:0/1831771564 shutdown_connections 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f935806b260 0x7f93580a6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9338066f30 0x7f93380693e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9358070d50 0x7f935816ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 --2- 172.21.15.61:0/1831771564 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f935806b630 0x7f935816a270 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 -- 172.21.15.61:0/1831771564 >> 172.21.15.61:0/1831771564 conn(0x7f93580ca200 msgr2=0x7f9358069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 -- 172.21.15.61:0/1831771564 shutdown_connections 2023-12-24T20:08:06.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.450+0000 7f935c904700 1 -- 172.21.15.61:0/1831771564 wait complete. 2023-12-24T20:08:06.463 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-24T20:08:06.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.585+0000 7f7138cca700 1 Processor -- start 2023-12-24T20:08:06.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.585+0000 7f7138cca700 1 -- start start 2023-12-24T20:08:06.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7138cca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f71340ce010 0x7f71340ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7138cca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71341587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7138cca700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7134158350 con 0x7f7134069f00 2023-12-24T20:08:06.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7138cca700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71340ca740 con 0x7f71340ce010 2023-12-24T20:08:06.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7138cca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71340b1120 con 0x7f71340ce3e0 2023-12-24T20:08:06.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7131d9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71341587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f713259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f71340ce010 0x7f71340ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7131d9b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71341587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:33612/0 (socket says 172.21.15.61:33612) 2023-12-24T20:08:06.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7132d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7134069f00 0x7f71340cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:36720/0 (socket says 172.21.15.61:36720) 2023-12-24T20:08:06.587 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f713259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f71340ce010 0x7f71340ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:33022/0 (socket says 172.21.15.61:33022) 2023-12-24T20:08:06.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7131d9b700 1 -- 172.21.15.61:0/1133618865 learned_addr learned my addr 172.21.15.61:0/1133618865 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:06.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7131d9b700 1 -- 172.21.15.61:0/1133618865 >> v2:172.21.15.133:3300/0 conn(0x7f71340ce010 msgr2=0x7f71340ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:06.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7131d9b700 1 --2- 172.21.15.61:0/1133618865 >> v2:172.21.15.133:3300/0 conn(0x7f71340ce010 0x7f71340ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7131d9b700 1 -- 172.21.15.61:0/1133618865 >> v1:172.21.15.133:6789/0 conn(0x7f7134069f00 legacy=0x7f71340cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.586+0000 7f7131d9b700 1 -- 172.21.15.61:0/1133618865 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71340ca990 con 0x7f71340ce3e0 2023-12-24T20:08:06.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f7131d9b700 1 --2- 172.21.15.61:0/1133618865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71341587e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f71280099b0 tx=0x7f7128009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42f6668c71b493c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:06.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f713159a700 1 -- 172.21.15.61:0/1133618865 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128009ea0 con 0x7f71340ce3e0 2023-12-24T20:08:06.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f713159a700 1 -- 172.21.15.61:0/1133618865 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712800b860 con 0x7f71340ce3e0 2023-12-24T20:08:06.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f713159a700 1 -- 172.21.15.61:0/1133618865 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800bc00 con 0x7f71340ce3e0 2023-12-24T20:08:06.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f7138cca700 1 -- 172.21.15.61:0/1133618865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 msgr2=0x7f71341587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f7138cca700 1 --2- 172.21.15.61:0/1133618865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71341587e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f71280099b0 tx=0x7f7128009250 comp rx=0 tx=0).stop 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f7138cca700 1 -- 172.21.15.61:0/1133618865 shutdown_connections 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f7138cca700 1 --2- 172.21.15.61:0/1133618865 >> v2:172.21.15.133:3300/0 conn(0x7f71340ce010 0x7f71340ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f7138cca700 1 --2- 172.21.15.61:0/1133618865 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71341587e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f7138cca700 1 -- 172.21.15.61:0/1133618865 >> 172.21.15.61:0/1133618865 conn(0x7f713406b790 msgr2=0x7f7134069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f7138cca700 1 -- 172.21.15.61:0/1133618865 shutdown_connections 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.587+0000 7f7138cca700 1 -- 172.21.15.61:0/1133618865 wait complete. 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7138cca700 1 Processor -- start 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7138cca700 1 -- start start 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7138cca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134069f00 0x7f71341473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7138cca700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71340ce010 0x7f71340ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7138cca700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71340689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7138cca700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71340aac30 con 0x7f71340ce010 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7138cca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71340acd00 con 0x7f7134069f00 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7138cca700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71340ad6d0 con 0x7f71340ce3e0 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7131d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71340ce010 0x7f71340ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7131d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71340ce010 0x7f71340ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35516/0 (socket says 172.21.15.61:35516) 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.589+0000 7f7131d9b700 1 -- 172.21.15.61:0/4250058169 learned_addr learned my addr 172.21.15.61:0/4250058169 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f713259c700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134069f00 0x7f71341473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f7132d9d700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71340689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f7131d9b700 1 -- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 msgr2=0x7f71340689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f7131d9b700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71340689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f7131d9b700 1 -- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134069f00 msgr2=0x7f71341473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f7131d9b700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134069f00 0x7f71341473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f7131d9b700 1 -- 172.21.15.61:0/4250058169 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280094f0 con 0x7f71340ce010 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f7132d9d700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71340689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f7131d9b700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71340ce010 0x7f71340ad190 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f71340b1260 tx=0x7f7128017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:06.592 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f71227fc700 1 -- 172.21.15.61:0/4250058169 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800bbe0 con 0x7f71340ce010 2023-12-24T20:08:06.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f71227fc700 1 -- 172.21.15.61:0/4250058169 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712801a450 con 0x7f71340ce010 2023-12-24T20:08:06.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f7138cca700 1 -- 172.21.15.61:0/4250058169 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71340ac3d0 con 0x7f71340ce010 2023-12-24T20:08:06.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f71227fc700 1 -- 172.21.15.61:0/4250058169 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712801a810 con 0x7f71340ce010 2023-12-24T20:08:06.593 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.590+0000 7f7138cca700 1 -- 172.21.15.61:0/4250058169 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71340ac990 con 0x7f71340ce010 2023-12-24T20:08:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.591+0000 7f7138cca700 1 -- 172.21.15.61:0/4250058169 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713404c3c0 con 0x7f71340ce010 2023-12-24T20:08:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.591+0000 7f71227fc700 1 -- 172.21.15.61:0/4250058169 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f712801abc0 con 0x7f71340ce010 2023-12-24T20:08:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.592+0000 7f71227fc700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7114066f30 0x7f71140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.592+0000 7f71227fc700 1 -- 172.21.15.61:0/4250058169 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7128085f40 con 0x7f71340ce010 2023-12-24T20:08:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.592+0000 7f713259c700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7114066f30 0x7f71140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.593+0000 7f713259c700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7114066f30 0x7f71140693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7124009db0 tx=0x7f71240091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.596+0000 7f71227fc700 1 -- 172.21.15.61:0/4250058169 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71280531b0 con 0x7f71340ce010 2023-12-24T20:08:06.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.838+0000 7f7138cca700 1 -- 172.21.15.61:0/4250058169 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f71340ace40 con 0x7f71340ce010 2023-12-24T20:08:06.839 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-12-24T20:08:06.839+0000 7f5e4f757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-24T20:08:06.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.844+0000 7f71227fc700 1 -- 172.21.15.61:0/4250058169 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v93) v1 ==== 161+0+0 (secure 0 0 0) 0x7f71280567d0 con 0x7f71340ce010 2023-12-24T20:08:06.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.846+0000 7f7138cca700 1 -- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7114066f30 msgr2=0x7f71140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.846+0000 7f7138cca700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7114066f30 0x7f71140693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7124009db0 tx=0x7f71240091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.846+0000 7f7138cca700 1 -- 172.21.15.61:0/4250058169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71340ce010 msgr2=0x7f71340ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.846+0000 7f7138cca700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71340ce010 0x7f71340ad190 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f71340b1260 tx=0x7f7128017000 comp rx=0 tx=0).stop 2023-12-24T20:08:06.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.846+0000 7f7138cca700 1 -- 172.21.15.61:0/4250058169 shutdown_connections 2023-12-24T20:08:06.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.846+0000 7f7138cca700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f71340ce3e0 0x7f71340689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.846+0000 7f7138cca700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7114066f30 0x7f71140693e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.846+0000 7f7138cca700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7134069f00 0x7f71341473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.846+0000 7f7138cca700 1 --2- 172.21.15.61:0/4250058169 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71340ce010 0x7f71340ad190 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.846+0000 7f7138cca700 1 -- 172.21.15.61:0/4250058169 >> 172.21.15.61:0/4250058169 conn(0x7f713406b790 msgr2=0x7f7134157270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:06.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.847+0000 7f7138cca700 1 -- 172.21.15.61:0/4250058169 shutdown_connections 2023-12-24T20:08:06.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.847+0000 7f7138cca700 1 -- 172.21.15.61:0/4250058169 wait complete. 2023-12-24T20:08:06.848 INFO:teuthology.orchestra.run.smithi061.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-24T20:08:06.849 INFO:tasks.ceph.mds.d.smithi133.stderr: -7781> 2023-12-24T20:07:25.710+0000 7f3c91603700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-24T20:08:06.859 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-24T20:08:06.880 INFO:tasks.ceph.mds.d.smithi133.stdout:starting mds.d at 2023-12-24T20:08:06.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.982+0000 7fa30c320700 1 Processor -- start 2023-12-24T20:08:06.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.982+0000 7fa30c320700 1 -- start start 2023-12-24T20:08:06.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.983+0000 7fa30c320700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa30415ac00 0x7fa3040c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.983+0000 7fa30c320700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3040c7c30 0x7fa3040cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.983+0000 7fa30c320700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3040c8c30 con 0x7fa30415afd0 2023-12-24T20:08:06.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.983+0000 7fa30c320700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3040c80b0 con 0x7fa3040c7c30 2023-12-24T20:08:06.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.983+0000 7fa30c320700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3040c8390 con 0x7fa30415ac00 2023-12-24T20:08:06.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.983+0000 7fa30a8bd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa30415afd0 0x7fa30415d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34352/0 (socket says 172.21.15.61:34352) 2023-12-24T20:08:06.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.983+0000 7fa30a8bd700 1 -- 172.21.15.61:0/1735287030 learned_addr learned my addr 172.21.15.61:0/1735287030 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:06.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.983+0000 7fa30a0bc700 1 --2- 172.21.15.61:0/1735287030 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa30415ac00 0x7fa3040c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.983+0000 7fa3098bb700 1 --2- 172.21.15.61:0/1735287030 >> v2:172.21.15.133:3300/0 conn(0x7fa3040c7c30 0x7fa3040cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.983+0000 7fa3090ba700 1 -- 172.21.15.61:0/1735287030 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863313249 0 0) 0x7fa3040c8c30 con 0x7fa30415afd0 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.984+0000 7fa3090ba700 1 -- 172.21.15.61:0/1735287030 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f0003570 con 0x7fa30415afd0 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.984+0000 7fa30a0bc700 1 -- 172.21.15.61:0/1735287030 >> v2:172.21.15.133:3300/0 conn(0x7fa3040c7c30 msgr2=0x7fa3040cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.984+0000 7fa30a0bc700 1 --2- 172.21.15.61:0/1735287030 >> v2:172.21.15.133:3300/0 conn(0x7fa3040c7c30 0x7fa3040cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.984+0000 7fa30a0bc700 1 -- 172.21.15.61:0/1735287030 >> v1:172.21.15.61:6789/0 conn(0x7fa30415afd0 legacy=0x7fa30415d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.984+0000 7fa30a0bc700 1 -- 172.21.15.61:0/1735287030 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3040c8670 con 0x7fa30415ac00 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.984+0000 7fa30a0bc700 1 --2- 172.21.15.61:0/1735287030 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa30415ac00 0x7fa3040c76f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40098d0 tx=0x7fa2f4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4a42396d5aba732 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.984+0000 7fa3090ba700 1 -- 172.21.15.61:0/1735287030 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4005c10 con 0x7fa30415ac00 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.984+0000 7fa3090ba700 1 -- 172.21.15.61:0/1735287030 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4005d70 con 0x7fa30415ac00 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.984+0000 7fa3090ba700 1 -- 172.21.15.61:0/1735287030 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4006280 con 0x7fa30415ac00 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.985+0000 7fa30c320700 1 -- 172.21.15.61:0/1735287030 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa30415ac00 msgr2=0x7fa3040c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.985+0000 7fa30c320700 1 --2- 172.21.15.61:0/1735287030 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa30415ac00 0x7fa3040c76f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40098d0 tx=0x7fa2f4009120 comp rx=0 tx=0).stop 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.985+0000 7fa30c320700 1 -- 172.21.15.61:0/1735287030 shutdown_connections 2023-12-24T20:08:06.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.985+0000 7fa30c320700 1 --2- 172.21.15.61:0/1735287030 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa30415ac00 0x7fa3040c76f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.985+0000 7fa30c320700 1 --2- 172.21.15.61:0/1735287030 >> v2:172.21.15.133:3300/0 conn(0x7fa3040c7c30 0x7fa3040cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.985+0000 7fa30c320700 1 -- 172.21.15.61:0/1735287030 >> 172.21.15.61:0/1735287030 conn(0x7fa3040cd0b0 msgr2=0x7fa3040cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:06.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.985+0000 7fa30c320700 1 -- 172.21.15.61:0/1735287030 shutdown_connections 2023-12-24T20:08:06.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.985+0000 7fa30c320700 1 -- 172.21.15.61:0/1735287030 wait complete. 2023-12-24T20:08:06.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.986+0000 7fa30c320700 1 Processor -- start 2023-12-24T20:08:06.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.986+0000 7fa30c320700 1 -- start start 2023-12-24T20:08:06.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.986+0000 7fa30c320700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa30415ac00 0x7fa3040b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.986+0000 7fa30c320700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa30415afd0 0x7fa30415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa30c320700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3040b16b0 0x7fa30415ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa30c320700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30415f3b0 con 0x7fa30415afd0 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa30c320700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3040af690 con 0x7fa30415ac00 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa30c320700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3040acae0 con 0x7fa3040b16b0 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa3098bb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa30415afd0 0x7fa30415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa3098bb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa30415afd0 0x7fa30415e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35518/0 (socket says 172.21.15.61:35518) 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa3098bb700 1 -- 172.21.15.61:0/53114874 learned_addr learned my addr 172.21.15.61:0/53114874 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa30a8bd700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3040b16b0 0x7fa30415ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa30a0bc700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa30415ac00 0x7fa3040b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa3098bb700 1 -- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3040b16b0 msgr2=0x7fa30415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa3098bb700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3040b16b0 0x7fa30415ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa3098bb700 1 -- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa30415ac00 msgr2=0x7fa3040b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa3098bb700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa30415ac00 0x7fa3040b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa3098bb700 1 -- 172.21.15.61:0/53114874 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40093c0 con 0x7fa30415afd0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa30a0bc700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa30415ac00 0x7fa3040b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa3098bb700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa30415afd0 0x7fa30415e7f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fa30000e930 tx=0x7fa3000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa2fa7fc700 1 -- 172.21.15.61:0/53114874 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300013680 con 0x7fa30415afd0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa2fa7fc700 1 -- 172.21.15.61:0/53114874 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3000137e0 con 0x7fa30415afd0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa30c320700 1 -- 172.21.15.61:0/53114874 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3040acdc0 con 0x7fa30415afd0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa2fa7fc700 1 -- 172.21.15.61:0/53114874 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300013b80 con 0x7fa30415afd0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.987+0000 7fa30c320700 1 -- 172.21.15.61:0/53114874 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3040ad380 con 0x7fa30415afd0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.988+0000 7fa30c320700 1 -- 172.21.15.61:0/53114874 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30404c3c0 con 0x7fa30415afd0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.989+0000 7fa2fa7fc700 1 -- 172.21.15.61:0/53114874 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa30000c460 con 0x7fa30415afd0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.989+0000 7fa2fa7fc700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa2e8066f30 0x7fa2e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.989+0000 7fa2fa7fc700 1 -- 172.21.15.61:0/53114874 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa300084730 con 0x7fa30415afd0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.989+0000 7fa30a0bc700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa2e8066f30 0x7fa2e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:06.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.990+0000 7fa30a0bc700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa2e8066f30 0x7fa2e80693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40030a0 tx=0x7fa2f4016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:06.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:06.994+0000 7fa2fa7fc700 1 -- 172.21.15.61:0/53114874 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa300051950 con 0x7fa30415afd0 2023-12-24T20:08:07.118 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:07.121 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:07.239 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.238+0000 7fa30c320700 1 -- 172.21.15.61:0/53114874 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa3040ad5a0 con 0x7fa30415afd0 2023-12-24T20:08:07.868 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.867+0000 7fa2fa7fc700 1 -- 172.21.15.61:0/53114874 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v94) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa300054f70 con 0x7fa30415afd0 2023-12-24T20:08:07.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 -- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa2e8066f30 msgr2=0x7fa2e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:07.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa2e8066f30 0x7fa2e80693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40030a0 tx=0x7fa2f4016000 comp rx=0 tx=0).stop 2023-12-24T20:08:07.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 -- 172.21.15.61:0/53114874 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa30415afd0 msgr2=0x7fa30415e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:07.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa30415afd0 0x7fa30415e7f0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fa30000e930 tx=0x7fa3000091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:07.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 -- 172.21.15.61:0/53114874 shutdown_connections 2023-12-24T20:08:07.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa3040b16b0 0x7fa30415ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:07.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa2e8066f30 0x7fa2e80693e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:07.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa30415ac00 0x7fa3040b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:07.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 --2- 172.21.15.61:0/53114874 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa30415afd0 0x7fa30415e7f0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:07.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 -- 172.21.15.61:0/53114874 >> 172.21.15.61:0/53114874 conn(0x7fa3040cd0b0 msgr2=0x7fa30406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:07.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 -- 172.21.15.61:0/53114874 shutdown_connections 2023-12-24T20:08:07.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:07.870+0000 7fa30c320700 1 -- 172.21.15.61:0/53114874 wait complete. 2023-12-24T20:08:07.884 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-24T20:08:08.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.013+0000 7f309ed63700 1 Processor -- start 2023-12-24T20:08:08.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.013+0000 7f309ed63700 1 -- start start 2023-12-24T20:08:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f309ed63700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f309806a190 0x7f309806a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f309ed63700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3098156d80 con 0x7f30980ca8f0 2023-12-24T20:08:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f309ed63700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3098067680 con 0x7f30981569b0 2023-12-24T20:08:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f309ed63700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309806adb0 con 0x7f309806a190 2023-12-24T20:08:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f309d300700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f30980ca8f0 0x7f3098067b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34360/0 (socket says 172.21.15.61:34360) 2023-12-24T20:08:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f309d300700 1 -- 172.21.15.61:0/1836001287 learned_addr learned my addr 172.21.15.61:0/1836001287 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f3097fff700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f309806a190 0x7f309806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325678123 0 0) 0x7f3098156d80 con 0x7f30980ca8f0 2023-12-24T20:08:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3088003570 con 0x7f30980ca8f0 2023-12-24T20:08:08.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4209406961 0 0) 0x7f3088003570 con 0x7f30980ca8f0 2023-12-24T20:08:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f309806a190 msgr2=0x7f309806a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f30977fe700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f309806a190 0x7f309806a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.014+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 >> v1:172.21.15.133:6789/0 conn(0x7f30981569b0 legacy=0x7f3098069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980c8bd0 con 0x7f30980ca8f0 2023-12-24T20:08:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f30900017f0 con 0x7f30980ca8f0 2023-12-24T20:08:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 >> v1:172.21.15.61:6789/0 conn(0x7f30980ca8f0 legacy=0x7f3098067b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f309806a190 0x7f3088003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3088003fd0 0x7f3088004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 0x7f30880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308800bb10 con 0x7f3088004d50 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308800bc80 con 0x7f3088003fd0 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308800e050 con 0x7f309806a190 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f309d300700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 0x7f30880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f3097fff700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3088003fd0 0x7f3088004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f309caff700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f309806a190 0x7f3088003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f309d300700 1 -- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f309806a190 msgr2=0x7f3088003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f309d300700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f309806a190 0x7f3088003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f309d300700 1 -- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3088003fd0 msgr2=0x7f3088004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f309d300700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3088003fd0 0x7f3088004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f309d300700 1 -- 172.21.15.61:0/1836001287 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088003570 con 0x7f3088004d50 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f309caff700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f309806a190 0x7f3088003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f309d300700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 0x7f30880051c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f309000a920 tx=0x7f30900021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ac4622abb1f011 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900070d0 con 0x7f3088004d50 2023-12-24T20:08:08.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090007230 con 0x7f3088004d50 2023-12-24T20:08:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.015+0000 7f30977fe700 1 -- 172.21.15.61:0/1836001287 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900075f0 con 0x7f3088004d50 2023-12-24T20:08:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.016+0000 7f309ed63700 1 -- 172.21.15.61:0/1836001287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 msgr2=0x7f30880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.016+0000 7f309ed63700 1 --2- 172.21.15.61:0/1836001287 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 0x7f30880051c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f309000a920 tx=0x7f30900021f0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.016+0000 7f309d300700 1 -- 172.21.15.61:0/1836001287 reap_dead start 2023-12-24T20:08:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.016+0000 7f309ed63700 1 -- 172.21.15.61:0/1836001287 shutdown_connections 2023-12-24T20:08:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.016+0000 7f309ed63700 1 -- 172.21.15.61:0/1836001287 >> 172.21.15.61:0/1836001287 conn(0x7f30980ce180 msgr2=0x7f30980ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.016+0000 7f309ed63700 1 -- 172.21.15.61:0/1836001287 shutdown_connections 2023-12-24T20:08:08.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.016+0000 7f309ed63700 1 -- 172.21.15.61:0/1836001287 wait complete. 2023-12-24T20:08:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.018+0000 7f309ed63700 1 Processor -- start 2023-12-24T20:08:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.018+0000 7f309ed63700 1 -- start start 2023-12-24T20:08:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309ed63700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 0x7f30980b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309ed63700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3098155b00 0x7f3098165980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309ed63700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3098154ca0 0x7f30980b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309ed63700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3098165ec0 con 0x7f3088004d50 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309ed63700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980b1ab0 con 0x7f3098155b00 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309ed63700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30980b1d90 con 0x7f3098154ca0 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309caff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 0x7f30980b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309caff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 0x7f30980b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35546/0 (socket says 172.21.15.61:35546) 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309caff700 1 -- 172.21.15.61:0/983713838 learned_addr learned my addr 172.21.15.61:0/983713838 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f3097fff700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3098155b00 0x7f3098165980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309d300700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3098154ca0 0x7f30980b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309caff700 1 -- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3098154ca0 msgr2=0x7f30980b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309caff700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3098154ca0 0x7f30980b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309caff700 1 -- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3098155b00 msgr2=0x7f3098165980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309caff700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3098155b00 0x7f3098165980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309caff700 1 -- 172.21.15.61:0/983713838 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980b2070 con 0x7f3088004d50 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309d300700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3098154ca0 0x7f30980b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309caff700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 0x7f30980b2b50 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f308c00e7b0 tx=0x7f308c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:08.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f3094ff9700 1 -- 172.21.15.61:0/983713838 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c012500 con 0x7f3088004d50 2023-12-24T20:08:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f3094ff9700 1 -- 172.21.15.61:0/983713838 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c010040 con 0x7f3088004d50 2023-12-24T20:08:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.019+0000 7f309ed63700 1 -- 172.21.15.61:0/983713838 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30980b2350 con 0x7f3088004d50 2023-12-24T20:08:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.020+0000 7f3094ff9700 1 -- 172.21.15.61:0/983713838 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c0128b0 con 0x7f3088004d50 2023-12-24T20:08:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.020+0000 7f309ed63700 1 -- 172.21.15.61:0/983713838 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3098155120 con 0x7f3088004d50 2023-12-24T20:08:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.021+0000 7f309ed63700 1 -- 172.21.15.61:0/983713838 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30980b27f0 con 0x7f3088004d50 2023-12-24T20:08:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.021+0000 7f3094ff9700 1 -- 172.21.15.61:0/983713838 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f308c012c60 con 0x7f3088004d50 2023-12-24T20:08:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.021+0000 7f3094ff9700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f307c066f30 0x7f307c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.021+0000 7f3094ff9700 1 -- 172.21.15.61:0/983713838 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f308c084050 con 0x7f3088004d50 2023-12-24T20:08:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.022+0000 7f3097fff700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f307c066f30 0x7f307c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.022+0000 7f3097fff700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f307c066f30 0x7f307c0693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3084006f00 tx=0x7f30840091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:08.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.026+0000 7f3094ff9700 1 -- 172.21.15.61:0/983713838 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f308c051270 con 0x7f3088004d50 2023-12-24T20:08:08.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.221+0000 7f309ed63700 1 -- 172.21.15.61:0/983713838 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3098155340 con 0x7f3088004d50 2023-12-24T20:08:08.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.634+0000 7f3094ff9700 1 -- 172.21.15.61:0/983713838 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v190) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3098155340 con 0x7f3088004d50 2023-12-24T20:08:08.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.636+0000 7f309ed63700 1 -- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f307c066f30 msgr2=0x7f307c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.636+0000 7f309ed63700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f307c066f30 0x7f307c0693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3084006f00 tx=0x7f30840091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.636+0000 7f309ed63700 1 -- 172.21.15.61:0/983713838 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 msgr2=0x7f30980b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.636+0000 7f309ed63700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 0x7f30980b2b50 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f308c00e7b0 tx=0x7f308c009040 comp rx=0 tx=0).stop 2023-12-24T20:08:08.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.637+0000 7f309ed63700 1 -- 172.21.15.61:0/983713838 shutdown_connections 2023-12-24T20:08:08.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.637+0000 7f309ed63700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f3098154ca0 0x7f30980b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.637+0000 7f309ed63700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f307c066f30 0x7f307c0693e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.637+0000 7f309ed63700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3088004d50 0x7f30980b2b50 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.637+0000 7f309ed63700 1 --2- 172.21.15.61:0/983713838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3098155b00 0x7f3098165980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.637+0000 7f309ed63700 1 -- 172.21.15.61:0/983713838 >> 172.21.15.61:0/983713838 conn(0x7f30980ce180 msgr2=0x7f30980683a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:08.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.637+0000 7f309ed63700 1 -- 172.21.15.61:0/983713838 shutdown_connections 2023-12-24T20:08:08.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.637+0000 7f309ed63700 1 -- 172.21.15.61:0/983713838 wait complete. 2023-12-24T20:08:08.638 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' removed 2023-12-24T20:08:08.651 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-24T20:08:08.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.780+0000 7fcc9a5de700 1 Processor -- start 2023-12-24T20:08:08.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.780+0000 7fcc9a5de700 1 -- start start 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.781+0000 7fcc9a5de700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc9406b2c0 0x7fcc9406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.781+0000 7fcc9a5de700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc94157ec0 con 0x7fcc94158be0 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.781+0000 7fcc9a5de700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9415c1b0 con 0x7fcc9406f540 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.781+0000 7fcc9a5de700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc940b03a0 con 0x7fcc9406b2c0 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.781+0000 7fcc98b7b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fcc94158be0 0x7fcc9415b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34368/0 (socket says 172.21.15.61:34368) 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.781+0000 7fcc98b7b700 1 -- 172.21.15.61:0/3187577508 learned_addr learned my addr 172.21.15.61:0/3187577508 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.781+0000 7fcc937fe700 1 --2- 172.21.15.61:0/3187577508 >> v2:172.21.15.133:3300/0 conn(0x7fcc9406b2c0 0x7fcc9406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.781+0000 7fcc92ffd700 1 -- 172.21.15.61:0/3187577508 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147120000 0 0) 0x7fcc8c001490 con 0x7fcc94158be0 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.781+0000 7fcc92ffd700 1 -- 172.21.15.61:0/3187577508 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc80003570 con 0x7fcc94158be0 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.782+0000 7fcc937fe700 1 -- 172.21.15.61:0/3187577508 >> v1:172.21.15.133:6789/0 conn(0x7fcc9406f540 legacy=0x7fcc9406abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.782+0000 7fcc937fe700 1 -- 172.21.15.61:0/3187577508 >> v1:172.21.15.61:6789/0 conn(0x7fcc94158be0 legacy=0x7fcc9415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.782+0000 7fcc92ffd700 1 -- 172.21.15.61:0/3187577508 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1120851136 0 0) 0x7fcc80003570 con 0x7fcc94158be0 2023-12-24T20:08:08.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.782+0000 7fcc937fe700 1 -- 172.21.15.61:0/3187577508 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc94158100 con 0x7fcc9406b2c0 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.782+0000 7fcc937fe700 1 --2- 172.21.15.61:0/3187577508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc9406b2c0 0x7fcc9406f910 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcc840098e0 tx=0x7fcc840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3a4642e6ccc3aef server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.782+0000 7fcc92ffd700 1 -- 172.21.15.61:0/3187577508 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c001980 con 0x7fcc9406b2c0 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.782+0000 7fcc92ffd700 1 -- 172.21.15.61:0/3187577508 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc84011420 con 0x7fcc9406b2c0 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.782+0000 7fcc92ffd700 1 -- 172.21.15.61:0/3187577508 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc840117c0 con 0x7fcc9406b2c0 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.782+0000 7fcc9a5de700 1 -- 172.21.15.61:0/3187577508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc9406b2c0 msgr2=0x7fcc9406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.782+0000 7fcc9a5de700 1 --2- 172.21.15.61:0/3187577508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc9406b2c0 0x7fcc9406f910 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcc840098e0 tx=0x7fcc840091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.783+0000 7fcc9a5de700 1 -- 172.21.15.61:0/3187577508 shutdown_connections 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.783+0000 7fcc9a5de700 1 --2- 172.21.15.61:0/3187577508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc9406b2c0 0x7fcc9406f910 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.783+0000 7fcc9a5de700 1 -- 172.21.15.61:0/3187577508 >> 172.21.15.61:0/3187577508 conn(0x7fcc940ce7d0 msgr2=0x7fcc940cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.783+0000 7fcc9a5de700 1 -- 172.21.15.61:0/3187577508 shutdown_connections 2023-12-24T20:08:08.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.783+0000 7fcc9a5de700 1 -- 172.21.15.61:0/3187577508 wait complete. 2023-12-24T20:08:08.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.784+0000 7fcc9a5de700 1 Processor -- start 2023-12-24T20:08:08.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.784+0000 7fcc9a5de700 1 -- start start 2023-12-24T20:08:08.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc9a5de700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc9406b2c0 0x7fcc940cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc9a5de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc9406f540 0x7fcc940cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc9a5de700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc94158be0 0x7fcc941593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc9a5de700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940cdcf0 con 0x7fcc9406b2c0 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc9a5de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940cd0e0 con 0x7fcc9406f540 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc9a5de700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940cd3c0 con 0x7fcc94158be0 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc93fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc9406b2c0 0x7fcc940cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc93fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc9406b2c0 0x7fcc940cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35550/0 (socket says 172.21.15.61:35550) 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc93fff700 1 -- 172.21.15.61:0/902692977 learned_addr learned my addr 172.21.15.61:0/902692977 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc937fe700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc9406f540 0x7fcc940cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc98b7b700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc94158be0 0x7fcc941593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc93fff700 1 -- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc94158be0 msgr2=0x7fcc941593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc93fff700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc94158be0 0x7fcc941593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc93fff700 1 -- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc9406f540 msgr2=0x7fcc940cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc93fff700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc9406f540 0x7fcc940cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:08.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc93fff700 1 -- 172.21.15.61:0/902692977 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc84009420 con 0x7fcc9406b2c0 2023-12-24T20:08:08.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc937fe700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc9406f540 0x7fcc940cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:08.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc93fff700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc9406b2c0 0x7fcc940cc370 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00c590 tx=0x7fcc7c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:08.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc8bfff700 1 -- 172.21.15.61:0/902692977 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c011590 con 0x7fcc9406b2c0 2023-12-24T20:08:08.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc8bfff700 1 -- 172.21.15.61:0/902692977 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c0116f0 con 0x7fcc9406b2c0 2023-12-24T20:08:08.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc9a5de700 1 -- 172.21.15.61:0/902692977 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc940cd6a0 con 0x7fcc9406b2c0 2023-12-24T20:08:08.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc8bfff700 1 -- 172.21.15.61:0/902692977 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c011ab0 con 0x7fcc9406b2c0 2023-12-24T20:08:08.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.785+0000 7fcc9a5de700 1 -- 172.21.15.61:0/902692977 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc940ccdf0 con 0x7fcc9406b2c0 2023-12-24T20:08:08.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.786+0000 7fcc9a5de700 1 -- 172.21.15.61:0/902692977 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc941591f0 con 0x7fcc9406b2c0 2023-12-24T20:08:08.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.787+0000 7fcc8bfff700 1 -- 172.21.15.61:0/902692977 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcc7c01b3b0 con 0x7fcc9406b2c0 2023-12-24T20:08:08.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.787+0000 7fcc8bfff700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc74066f30 0x7fcc740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:08.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.787+0000 7fcc8bfff700 1 -- 172.21.15.61:0/902692977 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fcc7c083980 con 0x7fcc9406b2c0 2023-12-24T20:08:08.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.788+0000 7fcc8bfff700 1 -- 172.21.15.61:0/902692977 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7fcc7406dcf0 con 0x7fcc9406b2c0 2023-12-24T20:08:08.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.788+0000 7fcc937fe700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc74066f30 0x7fcc740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:08.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.788+0000 7fcc937fe700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc74066f30 0x7fcc740693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcc9406b6c0 tx=0x7fcc84016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:08.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.792+0000 7fcc8bfff700 1 -- 172.21.15.61:0/902692977 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc7c017030 con 0x7fcc9406b2c0 2023-12-24T20:08:08.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:08.990+0000 7fcc9a5de700 1 -- 172.21.15.61:0/902692977 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc94158fe0 con 0x7fcc9406b2c0 2023-12-24T20:08:09.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.886+0000 7fcc8bfff700 1 -- 172.21.15.61:0/902692977 <== mon.0 v2:172.21.15.61:3300/0 7 ==== osd_map(191..191 src has 1..191) v4 ==== 288+0+0 (secure 0 0 0) 0x7fcc7c055110 con 0x7fcc9406b2c0 2023-12-24T20:08:09.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.886+0000 7fcc8bfff700 1 -- 172.21.15.61:0/902692977 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=192}) v3 -- 0x7fcc7406ca80 con 0x7fcc9406b2c0 2023-12-24T20:08:09.892 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.892+0000 7fcc8bfff700 1 -- 172.21.15.61:0/902692977 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v191) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcc7c017030 con 0x7fcc9406b2c0 2023-12-24T20:08:09.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.896+0000 7fcc9a5de700 1 -- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc74066f30 msgr2=0x7fcc740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:09.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.896+0000 7fcc9a5de700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc74066f30 0x7fcc740693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcc9406b6c0 tx=0x7fcc84016000 comp rx=0 tx=0).stop 2023-12-24T20:08:09.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.896+0000 7fcc9a5de700 1 -- 172.21.15.61:0/902692977 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc9406b2c0 msgr2=0x7fcc940cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:09.896 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.896+0000 7fcc9a5de700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc9406b2c0 0x7fcc940cc370 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00c590 tx=0x7fcc7c00c950 comp rx=0 tx=0).stop 2023-12-24T20:08:09.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.896+0000 7fcc9a5de700 1 -- 172.21.15.61:0/902692977 shutdown_connections 2023-12-24T20:08:09.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.896+0000 7fcc9a5de700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc94158be0 0x7fcc941593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:09.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.896+0000 7fcc9a5de700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc74066f30 0x7fcc740693e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:09.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.897+0000 7fcc9a5de700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc9406b2c0 0x7fcc940cc370 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:09.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.897+0000 7fcc9a5de700 1 --2- 172.21.15.61:0/902692977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc9406f540 0x7fcc940cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:09.897 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.897+0000 7fcc9a5de700 1 -- 172.21.15.61:0/902692977 >> 172.21.15.61:0/902692977 conn(0x7fcc940ce7d0 msgr2=0x7fcc940af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:09.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.897+0000 7fcc9a5de700 1 -- 172.21.15.61:0/902692977 shutdown_connections 2023-12-24T20:08:09.898 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:09.897+0000 7fcc9a5de700 1 -- 172.21.15.61:0/902692977 wait complete. 2023-12-24T20:08:09.898 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' removed 2023-12-24T20:08:09.913 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-24T20:08:10.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.042+0000 7f128914f700 1 Processor -- start 2023-12-24T20:08:10.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.042+0000 7f128914f700 1 -- start start 2023-12-24T20:08:10.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.043+0000 7f128914f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12840b2ec0 0x7f12840685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.043+0000 7f128914f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f128406a7e0 0x7f12840c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.043+0000 7f128914f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128415bec0 con 0x7f12840c9850 2023-12-24T20:08:10.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.043+0000 7f128914f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1284068ee0 con 0x7f128406a7e0 2023-12-24T20:08:10.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.043+0000 7f128914f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1284071650 con 0x7f12840b2ec0 2023-12-24T20:08:10.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.043+0000 7f128259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f128406a7e0 0x7f12840c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.043+0000 7f128259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f128406a7e0 0x7f12840c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35554/0 (socket says 172.21.15.61:35554) 2023-12-24T20:08:10.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.043+0000 7f128259c700 1 -- 172.21.15.61:0/2409506818 learned_addr learned my addr 172.21.15.61:0/2409506818 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f1282d9d700 1 --2- 172.21.15.61:0/2409506818 >> v2:172.21.15.133:3300/0 conn(0x7f12840b2ec0 0x7f12840685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f128259c700 1 -- 172.21.15.61:0/2409506818 >> v2:172.21.15.133:3300/0 conn(0x7f12840b2ec0 msgr2=0x7f12840685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f128259c700 1 --2- 172.21.15.61:0/2409506818 >> v2:172.21.15.133:3300/0 conn(0x7f12840b2ec0 0x7f12840685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f128259c700 1 -- 172.21.15.61:0/2409506818 >> v1:172.21.15.133:6789/0 conn(0x7f12840c9850 legacy=0x7f1284067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f128259c700 1 -- 172.21.15.61:0/2409506818 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128415b590 con 0x7f128406a7e0 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f128259c700 1 --2- 172.21.15.61:0/2409506818 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f128406a7e0 0x7f12840c9310 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f128406d5c0 tx=0x7f1274009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ae740275cc2ca8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f1281d9b700 1 -- 172.21.15.61:0/2409506818 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400b860 con 0x7f128406a7e0 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f1281d9b700 1 -- 172.21.15.61:0/2409506818 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400b9c0 con 0x7f128406a7e0 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f1281d9b700 1 -- 172.21.15.61:0/2409506818 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400bd60 con 0x7f128406a7e0 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f128914f700 1 -- 172.21.15.61:0/2409506818 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f128406a7e0 msgr2=0x7f12840c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.044+0000 7f128914f700 1 --2- 172.21.15.61:0/2409506818 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f128406a7e0 0x7f12840c9310 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f128406d5c0 tx=0x7f1274009250 comp rx=0 tx=0).stop 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.045+0000 7f128914f700 1 -- 172.21.15.61:0/2409506818 shutdown_connections 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.045+0000 7f128914f700 1 --2- 172.21.15.61:0/2409506818 >> v2:172.21.15.133:3300/0 conn(0x7f12840b2ec0 0x7f12840685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.045+0000 7f128914f700 1 --2- 172.21.15.61:0/2409506818 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f128406a7e0 0x7f12840c9310 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.045+0000 7f128914f700 1 -- 172.21.15.61:0/2409506818 >> 172.21.15.61:0/2409506818 conn(0x7f12840ce170 msgr2=0x7f12840ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:10.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.045+0000 7f128914f700 1 -- 172.21.15.61:0/2409506818 shutdown_connections 2023-12-24T20:08:10.047 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.045+0000 7f128914f700 1 -- 172.21.15.61:0/2409506818 wait complete. 2023-12-24T20:08:10.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.046+0000 7f128914f700 1 Processor -- start 2023-12-24T20:08:10.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.046+0000 7f128914f700 1 -- start start 2023-12-24T20:08:10.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128914f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128406a7e0 0x7f1284157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128914f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12840b2ec0 0x7f12840ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.049 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128914f700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12840c9850 0x7f12841549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128914f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1284159020 con 0x7f12840b2ec0 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128914f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12840c5500 con 0x7f128406a7e0 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128914f700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12841584a0 con 0x7f12840c9850 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12840b2ec0 0x7f12840ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12840b2ec0 0x7f12840ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35562/0 (socket says 172.21.15.61:35562) 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128259c700 1 -- 172.21.15.61:0/2698918866 learned_addr learned my addr 172.21.15.61:0/2698918866 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f1282d9d700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128406a7e0 0x7f1284157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128359e700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12840c9850 0x7f12841549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128259c700 1 -- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12840c9850 msgr2=0x7f12841549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128259c700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12840c9850 0x7f12841549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128259c700 1 -- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128406a7e0 msgr2=0x7f1284157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128259c700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128406a7e0 0x7f1284157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128259c700 1 -- 172.21.15.61:0/2698918866 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740094f0 con 0x7f12840b2ec0 2023-12-24T20:08:10.050 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128259c700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12840b2ec0 0x7f12840ccb60 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f12840698a0 tx=0x7f1274017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:10.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f126affd700 1 -- 172.21.15.61:0/2698918866 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274024440 con 0x7f12840b2ec0 2023-12-24T20:08:10.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f126affd700 1 -- 172.21.15.61:0/2698918866 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12740245a0 con 0x7f12840b2ec0 2023-12-24T20:08:10.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f126affd700 1 -- 172.21.15.61:0/2698918866 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274024960 con 0x7f12840b2ec0 2023-12-24T20:08:10.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.047+0000 7f128914f700 1 -- 172.21.15.61:0/2698918866 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1284158780 con 0x7f12840b2ec0 2023-12-24T20:08:10.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.048+0000 7f128914f700 1 -- 172.21.15.61:0/2698918866 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1284158d40 con 0x7f12840b2ec0 2023-12-24T20:08:10.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.049+0000 7f128914f700 1 -- 172.21.15.61:0/2698918866 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128404c3c0 con 0x7f12840b2ec0 2023-12-24T20:08:10.051 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.049+0000 7f126affd700 1 -- 172.21.15.61:0/2698918866 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f127401a420 con 0x7f12840b2ec0 2023-12-24T20:08:10.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.049+0000 7f126affd700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1270066f30 0x7f12700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.049+0000 7f126affd700 1 -- 172.21.15.61:0/2698918866 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f12740860c0 con 0x7f12840b2ec0 2023-12-24T20:08:10.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.050+0000 7f1282d9d700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1270066f30 0x7f12700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.052 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.050+0000 7f1282d9d700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1270066f30 0x7f12700693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1278006fd0 tx=0x7f1278008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:10.053 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.054+0000 7f126affd700 1 -- 172.21.15.61:0/2698918866 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12740536b0 con 0x7f12840b2ec0 2023-12-24T20:08:10.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.248+0000 7f128914f700 1 -- 172.21.15.61:0/2698918866 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f12840c56d0 con 0x7f12840b2ec0 2023-12-24T20:08:10.254 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.254+0000 7f126affd700 1 -- 172.21.15.61:0/2698918866 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1274056cd0 con 0x7f12840b2ec0 2023-12-24T20:08:10.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 -- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1270066f30 msgr2=0x7f12700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1270066f30 0x7f12700693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1278006fd0 tx=0x7f1278008040 comp rx=0 tx=0).stop 2023-12-24T20:08:10.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 -- 172.21.15.61:0/2698918866 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12840b2ec0 msgr2=0x7f12840ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12840b2ec0 0x7f12840ccb60 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f12840698a0 tx=0x7f1274017000 comp rx=0 tx=0).stop 2023-12-24T20:08:10.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 -- 172.21.15.61:0/2698918866 shutdown_connections 2023-12-24T20:08:10.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f12840c9850 0x7f12841549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1270066f30 0x7f12700693e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128406a7e0 0x7f1284157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 --2- 172.21.15.61:0/2698918866 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f12840b2ec0 0x7f12840ccb60 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 -- 172.21.15.61:0/2698918866 >> 172.21.15.61:0/2698918866 conn(0x7f12840ce170 msgr2=0x7f12840af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:10.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 -- 172.21.15.61:0/2698918866 shutdown_connections 2023-12-24T20:08:10.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.256+0000 7f128914f700 1 -- 172.21.15.61:0/2698918866 wait complete. 2023-12-24T20:08:10.269 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-12-24T20:08:10.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.391+0000 7f1ab9ba7700 1 Processor -- start 2023-12-24T20:08:10.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.391+0000 7f1ab9ba7700 1 -- start start 2023-12-24T20:08:10.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab9ba7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab4068c80 0x7f1ab40afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab9ba7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ab415acf0 0x7f1ab4067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab9ba7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40687f0 con 0x7f1ab40af710 2023-12-24T20:08:10.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab9ba7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab4067be0 con 0x7f1ab415acf0 2023-12-24T20:08:10.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab9ba7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab4067ec0 con 0x7f1ab4068c80 2023-12-24T20:08:10.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ab415acf0 0x7f1ab4067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab2ffd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab4068c80 0x7f1ab40afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ab415acf0 0x7f1ab4067550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:33118/0 (socket says 172.21.15.61:33118) 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1ab40af710 0x7f1ab415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:36754/0 (socket says 172.21.15.61:36754) 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab3fff700 1 -- 172.21.15.61:0/1476191334 learned_addr learned my addr 172.21.15.61:0/1476191334 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab27fc700 1 -- 172.21.15.61:0/1476191334 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824529281 0 0) 0x7f1ab40687f0 con 0x7f1ab40af710 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab27fc700 1 -- 172.21.15.61:0/1476191334 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a9c003570 con 0x7f1ab40af710 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab2ffd700 1 -- 172.21.15.61:0/1476191334 >> v2:172.21.15.133:3300/0 conn(0x7f1ab415acf0 msgr2=0x7f1ab4067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab2ffd700 1 --2- 172.21.15.61:0/1476191334 >> v2:172.21.15.133:3300/0 conn(0x7f1ab415acf0 0x7f1ab4067550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab2ffd700 1 -- 172.21.15.61:0/1476191334 >> v1:172.21.15.133:6789/0 conn(0x7f1ab40af710 legacy=0x7f1ab415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab2ffd700 1 -- 172.21.15.61:0/1476191334 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab40681a0 con 0x7f1ab4068c80 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.392+0000 7f1ab3fff700 1 --2- 172.21.15.61:0/1476191334 >> v2:172.21.15.133:3300/0 conn(0x7f1ab415acf0 0x7f1ab4067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:10.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab2ffd700 1 --2- 172.21.15.61:0/1476191334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab4068c80 0x7f1ab40afae0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80098e0 tx=0x7f1aa80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6823031604e0b35 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab27fc700 1 -- 172.21.15.61:0/1476191334 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8011630 con 0x7f1ab4068c80 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab27fc700 1 -- 172.21.15.61:0/1476191334 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8011790 con 0x7f1ab4068c80 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab27fc700 1 -- 172.21.15.61:0/1476191334 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8011b30 con 0x7f1ab4068c80 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/1476191334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab4068c80 msgr2=0x7f1ab40afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab9ba7700 1 --2- 172.21.15.61:0/1476191334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab4068c80 0x7f1ab40afae0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80098e0 tx=0x7f1aa80091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/1476191334 shutdown_connections 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab9ba7700 1 --2- 172.21.15.61:0/1476191334 >> v2:172.21.15.133:3300/0 conn(0x7f1ab415acf0 0x7f1ab4067550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab9ba7700 1 --2- 172.21.15.61:0/1476191334 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab4068c80 0x7f1ab40afae0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/1476191334 >> 172.21.15.61:0/1476191334 conn(0x7f1ab40ca200 msgr2=0x7f1ab40ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/1476191334 shutdown_connections 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.393+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/1476191334 wait complete. 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab9ba7700 1 Processor -- start 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab9ba7700 1 -- start start 2023-12-24T20:08:10.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab9ba7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ab4068c80 0x7f1ab415d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab9ba7700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab40af710 0x7f1ab4158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab9ba7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab415acf0 0x7f1ab415ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab9ba7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab416db10 con 0x7f1ab4068c80 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab9ba7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab416a9d0 con 0x7f1ab415acf0 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab9ba7700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab416acb0 con 0x7f1ab40af710 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ab4068c80 0x7f1ab415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ab4068c80 0x7f1ab415d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35564/0 (socket says 172.21.15.61:35564) 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.395+0000 7f1ab37fe700 1 -- 172.21.15.61:0/2179597065 learned_addr learned my addr 172.21.15.61:0/2179597065 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab2ffd700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab40af710 0x7f1ab4158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab3fff700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab415acf0 0x7f1ab415ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab37fe700 1 -- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab40af710 msgr2=0x7f1ab4158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab37fe700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab40af710 0x7f1ab4158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab37fe700 1 -- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab415acf0 msgr2=0x7f1ab415ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab37fe700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab415acf0 0x7f1ab415ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab37fe700 1 -- 172.21.15.61:0/2179597065 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac00bcf0 con 0x7f1ab4068c80 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab2ffd700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab40af710 0x7f1ab4158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab3fff700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab415acf0 0x7f1ab415ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab37fe700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ab4068c80 0x7f1ab415d080 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c590 tx=0x7f1aa4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1a9b7fe700 1 -- 172.21.15.61:0/2179597065 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4005a70 con 0x7f1ab4068c80 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1a9b7fe700 1 -- 172.21.15.61:0/2179597065 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa4005bf0 con 0x7f1ab4068c80 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/2179597065 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa8009420 con 0x7f1ab4068c80 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1a9b7fe700 1 -- 172.21.15.61:0/2179597065 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40070d0 con 0x7f1ab4068c80 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.396+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/2179597065 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab416b270 con 0x7f1ab4068c80 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.397+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/2179597065 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab416ddb0 con 0x7f1ab4068c80 2023-12-24T20:08:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.398+0000 7f1a9b7fe700 1 -- 172.21.15.61:0/2179597065 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f1aa40074c0 con 0x7f1ab4068c80 2023-12-24T20:08:10.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.398+0000 7f1a9b7fe700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa0066f30 0x7f1aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:10.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.398+0000 7f1a9b7fe700 1 -- 172.21.15.61:0/2179597065 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1aa4083880 con 0x7f1ab4068c80 2023-12-24T20:08:10.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.398+0000 7f1ab2ffd700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa0066f30 0x7f1aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:10.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.399+0000 7f1ab2ffd700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa0066f30 0x7f1aa00693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4069070 tx=0x7f1aa8017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:10.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.402+0000 7f1a9b7fe700 1 -- 172.21.15.61:0/2179597065 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1aa4050d50 con 0x7f1ab4068c80 2023-12-24T20:08:10.677 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.676+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/2179597065 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f1ab404c3c0 con 0x7f1ab4068c80 2023-12-24T20:08:10.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.877+0000 7f1a9b7fe700 1 -- 172.21.15.61:0/2179597065 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v522) v1 ==== 135+0+0 (secure 0 0 0) 0x7f1aa40170c0 con 0x7f1ab4068c80 2023-12-24T20:08:10.879 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa0066f30 msgr2=0x7f1aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa0066f30 0x7f1aa00693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4069070 tx=0x7f1aa8017000 comp rx=0 tx=0).stop 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/2179597065 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ab4068c80 msgr2=0x7f1ab415d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ab4068c80 0x7f1ab415d080 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c590 tx=0x7f1aa4007e00 comp rx=0 tx=0).stop 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/2179597065 shutdown_connections 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f1aa0066f30 0x7f1aa00693e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab415acf0 0x7f1ab415ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ab4068c80 0x7f1ab415d080 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 --2- 172.21.15.61:0/2179597065 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f1ab40af710 0x7f1ab4158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/2179597065 >> 172.21.15.61:0/2179597065 conn(0x7f1ab40ca200 msgr2=0x7f1ab40afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/2179597065 shutdown_connections 2023-12-24T20:08:10.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:10.879+0000 7f1ab9ba7700 1 -- 172.21.15.61:0/2179597065 wait complete. 2023-12-24T20:08:10.894 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-24T20:08:10.894 INFO:tasks.cephfs_test_runner: 2023-12-24T20:08:10.894 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-24T20:08:10.894 INFO:tasks.cephfs_test_runner:Ran 10 tests in 629.467s 2023-12-24T20:08:10.894 INFO:tasks.cephfs_test_runner: 2023-12-24T20:08:10.894 INFO:tasks.cephfs_test_runner:OK 2023-12-24T20:08:10.895 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-24T20:08:10.904 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-24T20:08:10.940 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-24T20:08:10.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:10.940 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-12-24T20:08:10.958 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-24T20:08:10.958 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-24T20:08:10.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:10.959 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-24T20:08:11.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:11.038 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-24T20:08:11.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:11.119 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link delete ceph-brx 2023-12-24T20:08:11.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:11.216 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-24T20:08:11.237 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-24T20:08:11.237 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-24T20:08:11.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:11.237 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-24T20:08:11.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:11.317 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-24T20:08:11.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-24T20:08:11.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-12-24T20:08:11.492 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-24T20:08:11.501 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-12-24T20:08:11.502 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:11.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.629+0000 7f51b17ce700 1 Processor -- start 2023-12-24T20:08:11.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.629+0000 7f51b17ce700 1 -- start start 2023-12-24T20:08:11.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51b17ce700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51ac1598c0 0x7f51ac0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51b17ce700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac06ede0 0x7f51ac0ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51b17ce700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac15ae30 con 0x7f51ac159c90 2023-12-24T20:08:11.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51b17ce700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac15a220 con 0x7f51ac1598c0 2023-12-24T20:08:11.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51b17ce700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac15a500 con 0x7f51ac06ede0 2023-12-24T20:08:11.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51aaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51ac1598c0 0x7f51ac0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51aa7fc700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac06ede0 0x7f51ac0ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51ab7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f51ac159c90 0x7f51ac070640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:36762/0 (socket says 172.21.15.61:36762) 2023-12-24T20:08:11.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51ab7fe700 1 -- 172.21.15.61:0/2744829660 learned_addr learned my addr 172.21.15.61:0/2744829660 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:11.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51aa7fc700 1 -- 172.21.15.61:0/2744829660 >> v2:172.21.15.133:3300/0 conn(0x7f51ac1598c0 msgr2=0x7f51ac0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:11.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51aa7fc700 1 --2- 172.21.15.61:0/2744829660 >> v2:172.21.15.133:3300/0 conn(0x7f51ac1598c0 0x7f51ac0cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51aa7fc700 1 -- 172.21.15.61:0/2744829660 >> v1:172.21.15.133:6789/0 conn(0x7f51ac159c90 legacy=0x7f51ac070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:11.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51a9ffb700 1 -- 172.21.15.61:0/2744829660 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17889833 0 0) 0x7f51ac15ae30 con 0x7f51ac159c90 2023-12-24T20:08:11.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51aa7fc700 1 -- 172.21.15.61:0/2744829660 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac15a7e0 con 0x7f51ac06ede0 2023-12-24T20:08:11.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.630+0000 7f51aaffd700 1 --2- 172.21.15.61:0/2744829660 >> v2:172.21.15.133:3300/0 conn(0x7f51ac1598c0 0x7f51ac0cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:11.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51aa7fc700 1 --2- 172.21.15.61:0/2744829660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac06ede0 0x7f51ac0ca090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f51a00098e0 tx=0x7f51a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae29d2abbf1e071 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:11.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51a9ffb700 1 -- 172.21.15.61:0/2744829660 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000b640 con 0x7f51ac06ede0 2023-12-24T20:08:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51a9ffb700 1 -- 172.21.15.61:0/2744829660 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a000b7a0 con 0x7f51ac06ede0 2023-12-24T20:08:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51a9ffb700 1 -- 172.21.15.61:0/2744829660 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000bb40 con 0x7f51ac06ede0 2023-12-24T20:08:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51b17ce700 1 -- 172.21.15.61:0/2744829660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac06ede0 msgr2=0x7f51ac0ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51b17ce700 1 --2- 172.21.15.61:0/2744829660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac06ede0 0x7f51ac0ca090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f51a00098e0 tx=0x7f51a00091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51b17ce700 1 -- 172.21.15.61:0/2744829660 shutdown_connections 2023-12-24T20:08:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51b17ce700 1 --2- 172.21.15.61:0/2744829660 >> v2:172.21.15.133:3300/0 conn(0x7f51ac1598c0 0x7f51ac0cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51b17ce700 1 --2- 172.21.15.61:0/2744829660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac06ede0 0x7f51ac0ca090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51b17ce700 1 -- 172.21.15.61:0/2744829660 >> 172.21.15.61:0/2744829660 conn(0x7f51ac06a5f0 msgr2=0x7f51ac0cd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51b17ce700 1 -- 172.21.15.61:0/2744829660 shutdown_connections 2023-12-24T20:08:11.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.631+0000 7f51b17ce700 1 -- 172.21.15.61:0/2744829660 wait complete. 2023-12-24T20:08:11.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.633+0000 7f51b17ce700 1 Processor -- start 2023-12-24T20:08:11.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.633+0000 7f51b17ce700 1 -- start start 2023-12-24T20:08:11.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.633+0000 7f51b17ce700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51ac06ede0 0x7f51ac14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.633+0000 7f51b17ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ac1598c0 0x7f51ac14f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.633+0000 7f51b17ce700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac159c90 0x7f51ac0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.637 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.633+0000 7f51b17ce700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac150c20 con 0x7f51ac06ede0 2023-12-24T20:08:11.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.633+0000 7f51b17ce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac151020 con 0x7f51ac1598c0 2023-12-24T20:08:11.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.633+0000 7f51b17ce700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac154300 con 0x7f51ac159c90 2023-12-24T20:08:11.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aaffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51ac06ede0 0x7f51ac14cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aaffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51ac06ede0 0x7f51ac14cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35568/0 (socket says 172.21.15.61:35568) 2023-12-24T20:08:11.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aaffd700 1 -- 172.21.15.61:0/2225456637 learned_addr learned my addr 172.21.15.61:0/2225456637 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:11.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51ab7fe700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac159c90 0x7f51ac0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.638 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aa7fc700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ac1598c0 0x7f51ac14f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aaffd700 1 -- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac159c90 msgr2=0x7f51ac0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:11.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aaffd700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac159c90 0x7f51ac0cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aaffd700 1 -- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ac1598c0 msgr2=0x7f51ac14f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:11.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aaffd700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ac1598c0 0x7f51ac14f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aaffd700 1 -- 172.21.15.61:0/2225456637 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c009420 con 0x7f51ac06ede0 2023-12-24T20:08:11.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aa7fc700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ac1598c0 0x7f51ac14f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:11.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51aaffd700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51ac06ede0 0x7f51ac14cf90 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f519c00ec80 tx=0x7f519c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:11.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f5192ffd700 1 -- 172.21.15.61:0/2225456637 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00c9d0 con 0x7f51ac06ede0 2023-12-24T20:08:11.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f5192ffd700 1 -- 172.21.15.61:0/2225456637 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c00cb30 con 0x7f51ac06ede0 2023-12-24T20:08:11.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51b17ce700 1 -- 172.21.15.61:0/2225456637 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a0009420 con 0x7f51ac06ede0 2023-12-24T20:08:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f5192ffd700 1 -- 172.21.15.61:0/2225456637 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c00ced0 con 0x7f51ac06ede0 2023-12-24T20:08:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.634+0000 7f51b17ce700 1 -- 172.21.15.61:0/2225456637 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac150560 con 0x7f51ac06ede0 2023-12-24T20:08:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.635+0000 7f51b17ce700 1 -- 172.21.15.61:0/2225456637 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac04c3c0 con 0x7f51ac06ede0 2023-12-24T20:08:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.636+0000 7f5192ffd700 1 -- 172.21.15.61:0/2225456637 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f519c013680 con 0x7f51ac06ede0 2023-12-24T20:08:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.636+0000 7f5192ffd700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 0x7f51980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.636+0000 7f5192ffd700 1 -- 172.21.15.61:0/2225456637 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f519c084650 con 0x7f51ac06ede0 2023-12-24T20:08:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.636+0000 7f51aa7fc700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 0x7f51980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.637+0000 7f51aa7fc700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 0x7f51980693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f51a0003080 tx=0x7f51a0017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:11.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.640+0000 7f5192ffd700 1 -- 172.21.15.61:0/2225456637 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f519c051bc0 con 0x7f51ac06ede0 2023-12-24T20:08:11.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.834+0000 7f51b17ce700 1 -- 172.21.15.61:0/2225456637 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51ac15aac0 con 0x7f51ac06ede0 2023-12-24T20:08:11.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.835+0000 7f5192ffd700 1 -- 172.21.15.61:0/2225456637 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+12276 (secure 0 0 0) 0x7f519c0551e0 con 0x7f51ac06ede0 2023-12-24T20:08:11.836 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:11.836 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":191,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:08:09.873670+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6837/2891152875":"2023-12-25T20:08:06.840168+0000","172.21.15.133:6835/2891152875":"2023-12-25T20:08:06.840168+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:11.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 -- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 msgr2=0x7f51980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:11.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 0x7f51980693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f51a0003080 tx=0x7f51a0017000 comp rx=0 tx=0).stop 2023-12-24T20:08:11.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 -- 172.21.15.61:0/2225456637 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51ac06ede0 msgr2=0x7f51ac14cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:11.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51ac06ede0 0x7f51ac14cf90 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f519c00ec80 tx=0x7f519c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 -- 172.21.15.61:0/2225456637 shutdown_connections 2023-12-24T20:08:11.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f51ac159c90 0x7f51ac0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5198066f30 0x7f51980693e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f51ac06ede0 0x7f51ac14cf90 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 --2- 172.21.15.61:0/2225456637 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ac1598c0 0x7f51ac14f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 -- 172.21.15.61:0/2225456637 >> 172.21.15.61:0/2225456637 conn(0x7f51ac06a5f0 msgr2=0x7f51ac160010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:11.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 -- 172.21.15.61:0/2225456637 shutdown_connections 2023-12-24T20:08:11.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.837+0000 7f51b17ce700 1 -- 172.21.15.61:0/2225456637 wait complete. 2023-12-24T20:08:11.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-24T20:08:11.851 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:08:11.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.972+0000 7f81c542b700 1 Processor -- start 2023-12-24T20:08:11.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.972+0000 7f81c542b700 1 -- start start 2023-12-24T20:08:11.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81c542b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81c0159c10 0x7f81c00c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81c542b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f81c0159fe0 0x7f81c00c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81c542b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c00af880 con 0x7f81c00cba80 2023-12-24T20:08:11.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81c542b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c00c6fc0 con 0x7f81c0159fe0 2023-12-24T20:08:11.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81c542b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c00c63b0 con 0x7f81c0159c10 2023-12-24T20:08:11.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81be7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f81c0159fe0 0x7f81c00c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81be7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f81c0159fe0 0x7f81c00c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35576/0 (socket says 172.21.15.61:35576) 2023-12-24T20:08:11.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81be7fc700 1 -- 172.21.15.61:0/1695261382 learned_addr learned my addr 172.21.15.61:0/1695261382 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:11.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81beffd700 1 --2- 172.21.15.61:0/1695261382 >> v2:172.21.15.133:3300/0 conn(0x7f81c0159c10 0x7f81c00c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81be7fc700 1 -- 172.21.15.61:0/1695261382 >> v2:172.21.15.133:3300/0 conn(0x7f81c0159c10 msgr2=0x7f81c00c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81be7fc700 1 --2- 172.21.15.61:0/1695261382 >> v2:172.21.15.133:3300/0 conn(0x7f81c0159c10 0x7f81c00c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81be7fc700 1 -- 172.21.15.61:0/1695261382 >> v1:172.21.15.133:6789/0 conn(0x7f81c00cba80 legacy=0x7f81c00cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.973+0000 7f81be7fc700 1 -- 172.21.15.61:0/1695261382 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c00c6690 con 0x7f81c0159fe0 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81be7fc700 1 --2- 172.21.15.61:0/1695261382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159fe0 0x7f81c00c5d10 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f81c00d0990 tx=0x7f81a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46f9e75a65daaeb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81bdffb700 1 -- 172.21.15.61:0/1695261382 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8009e70 con 0x7f81c0159fe0 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81bdffb700 1 -- 172.21.15.61:0/1695261382 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a800b860 con 0x7f81c0159fe0 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81bdffb700 1 -- 172.21.15.61:0/1695261382 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a800bc00 con 0x7f81c0159fe0 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81c542b700 1 -- 172.21.15.61:0/1695261382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159fe0 msgr2=0x7f81c00c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81c542b700 1 --2- 172.21.15.61:0/1695261382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159fe0 0x7f81c00c5d10 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f81c00d0990 tx=0x7f81a8009250 comp rx=0 tx=0).stop 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81c542b700 1 -- 172.21.15.61:0/1695261382 shutdown_connections 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81c542b700 1 --2- 172.21.15.61:0/1695261382 >> v2:172.21.15.133:3300/0 conn(0x7f81c0159c10 0x7f81c00c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81c542b700 1 --2- 172.21.15.61:0/1695261382 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159fe0 0x7f81c00c5d10 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81c542b700 1 -- 172.21.15.61:0/1695261382 >> 172.21.15.61:0/1695261382 conn(0x7f81c006e640 msgr2=0x7f81c0067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:11.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81c542b700 1 -- 172.21.15.61:0/1695261382 shutdown_connections 2023-12-24T20:08:11.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.974+0000 7f81c542b700 1 -- 172.21.15.61:0/1695261382 wait complete. 2023-12-24T20:08:11.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.976+0000 7f81c542b700 1 Processor -- start 2023-12-24T20:08:11.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.976+0000 7f81c542b700 1 -- start start 2023-12-24T20:08:11.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81c542b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81c00cba80 0x7f81c00c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81c542b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159c10 0x7f81c00b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81c542b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81c0159fe0 0x7f81c01562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81c542b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00b4ad0 con 0x7f81c0159c10 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81c542b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00c7b80 con 0x7f81c00cba80 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81c542b700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00c7e60 con 0x7f81c0159fe0 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81be7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159c10 0x7f81c00b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81be7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159c10 0x7f81c00b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35588/0 (socket says 172.21.15.61:35588) 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81be7fc700 1 -- 172.21.15.61:0/943279527 learned_addr learned my addr 172.21.15.61:0/943279527 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81beffd700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81c00cba80 0x7f81c00c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81bf7fe700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81c0159fe0 0x7f81c01562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81be7fc700 1 -- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81c0159fe0 msgr2=0x7f81c01562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81be7fc700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81c0159fe0 0x7f81c01562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81be7fc700 1 -- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81c00cba80 msgr2=0x7f81c00c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81be7fc700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81c00cba80 0x7f81c00c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:11.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81be7fc700 1 -- 172.21.15.61:0/943279527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80094f0 con 0x7f81c0159c10 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81beffd700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81c00cba80 0x7f81c00c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81bf7fe700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81c0159fe0 0x7f81c01562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81be7fc700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159c10 0x7f81c00b4280 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f81c00d1a40 tx=0x7f81a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81b6ffd700 1 -- 172.21.15.61:0/943279527 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8011420 con 0x7f81c0159c10 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81b6ffd700 1 -- 172.21.15.61:0/943279527 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a8011580 con 0x7f81c0159c10 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81c542b700 1 -- 172.21.15.61:0/943279527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c00c8140 con 0x7f81c0159c10 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.977+0000 7f81b6ffd700 1 -- 172.21.15.61:0/943279527 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8011940 con 0x7f81c0159c10 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.978+0000 7f81c542b700 1 -- 172.21.15.61:0/943279527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c00b4db0 con 0x7f81c0159c10 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.979+0000 7f81c542b700 1 -- 172.21.15.61:0/943279527 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c00890b0 con 0x7f81c0159c10 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.979+0000 7f81b6ffd700 1 -- 172.21.15.61:0/943279527 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f81a802c3b0 con 0x7f81c0159c10 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.979+0000 7f81b6ffd700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f81a0066f30 0x7f81a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:11.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.979+0000 7f81b6ffd700 1 -- 172.21.15.61:0/943279527 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f81a80858e0 con 0x7f81c0159c10 2023-12-24T20:08:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.980+0000 7f81beffd700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f81a0066f30 0x7f81a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:11.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.980+0000 7f81beffd700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f81a0066f30 0x7f81a00693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f81b0006f00 tx=0x7f81b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:11.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:11.984+0000 7f81b6ffd700 1 -- 172.21.15.61:0/943279527 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81a8052e50 con 0x7f81c0159c10 2023-12-24T20:08:12.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.172+0000 7f81c542b700 1 -- 172.21.15.61:0/943279527 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81c00c8320 con 0x7f81a0066f30 2023-12-24T20:08:12.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.175+0000 7f81b6ffd700 1 -- 172.21.15.61:0/943279527 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49622 (secure 0 0 0) 0x7f81c00c8320 con 0x7f81a0066f30 2023-12-24T20:08:12.176 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:12.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 -- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f81a0066f30 msgr2=0x7f81a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f81a0066f30 0x7f81a00693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f81b0006f00 tx=0x7f81b0008040 comp rx=0 tx=0).stop 2023-12-24T20:08:12.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 -- 172.21.15.61:0/943279527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159c10 msgr2=0x7f81c00b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159c10 0x7f81c00b4280 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f81c00d1a40 tx=0x7f81a8017000 comp rx=0 tx=0).stop 2023-12-24T20:08:12.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 -- 172.21.15.61:0/943279527 shutdown_connections 2023-12-24T20:08:12.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f81c0159fe0 0x7f81c01562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f81a0066f30 0x7f81a00693e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81c00cba80 0x7f81c00c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 --2- 172.21.15.61:0/943279527 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f81c0159c10 0x7f81c00b4280 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.177 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 -- 172.21.15.61:0/943279527 >> 172.21.15.61:0/943279527 conn(0x7f81c006e640 msgr2=0x7f81c01575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:12.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 -- 172.21.15.61:0/943279527 shutdown_connections 2023-12-24T20:08:12.178 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.177+0000 7f81c542b700 1 -- 172.21.15.61:0/943279527 wait complete. 2023-12-24T20:08:12.178 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:08:12.189 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2023-12-24T20:08:10.472714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":54582,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1507917,"statfs":{"total":1600000000,"available":1544107844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-41768,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-96,"num_write_kb":-33860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001433"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":312,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-24T20:08:08.898851+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:08:08.898851+0000","last_peered":"2023-12-24T20:08:08.898851+0000","last_clean":"2023-12-24T20:08:08.898851+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:08:08.898851+0000","last_undegraded":"2023-12-24T20:08:08.898851+0000","last_fullsized":"2023-12-24T20:08:08.898851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574985,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.308,"15min":0.307},"max":{"1min":0.80200000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.56999999999999995},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.872,"15min":0.872},"last":0.433},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.39400000000000002,"15min":0.34100000000000003},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.623},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.82799999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.312},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.95699999999999996},"last":0.57299999999999995}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.379,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.81499999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.752,"15min":0.80000000000000004},"last":0.45500000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.79100000000000004,"15min":0.83699999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.873},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19475,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175836,"statfs":{"total":200000000,"available":180056649,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.0309999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.45700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.40999999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":0.80200000000000005,"15min":0.95799999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.503}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.27000000000000002},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.44,"5min":0.378,"15min":0.33200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0640000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.077},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.372},"max":{"1min":0.79100000000000004,"5min":0.877,"15min":1.048},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57599999999999996}]},{"osd":5,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.86499999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.254},"max":{"1min":0.628,"5min":0.748,"15min":0.84699999999999998},"last":0.63300000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13331,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181980,"statfs":{"total":200000000,"available":186348105,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.372,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40799999999999997,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.54800000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.371}]},{"osd":3,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.309}]},{"osd":4,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.80900000000000005,"5min":0.871,"15min":0.871},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.59799999999999998},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.94299999999999995,"5min":1.014,"15min":1.014},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.04},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86199999999999999,"5min":0.998,"15min":0.998},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.63},"min":{"1min":0.437,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.64300000000000002},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.39500000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.625}]},{"osd":7,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.629},"min":{"1min":0.501,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69399999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":1.0109999999999999,"5min":1.03,"15min":1.03},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574985,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36499999999999999,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.45800000000000002,"5min":0.70799999999999996,"15min":0.97999999999999998},"last":0.28499999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.439,"5min":0.65400000000000003,"15min":0.92700000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.93999999999999995},"last":0.23899999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56699999999999995,"5min":0.70199999999999996,"15min":2.573},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":1.073,"15min":1.3500000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.65200000000000002},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":2.7149999999999999},"last":0.625}]},{"osd":5,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.372},"max":{"1min":0.94599999999999995,"5min":1.0569999999999999,"15min":2.6859999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.006},"last":0.57399999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":1.0489999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":1.5429999999999999},"last":0.496},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.69999999999999996},"min":{"1min":0.58699999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574985,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.249,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.50800000000000001,"5min":0.61599999999999999,"15min":0.78900000000000003},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.72299999999999998},"last":0.29799999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38100000000000001,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.77700000000000002},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.82799999999999996},"last":0.34399999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.84699999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.88900000000000001},"last":0.27900000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.97999999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.2649999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":3.577},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":1.052,"15min":7.0220000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.075,"5min":1.075,"15min":1.298},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":3.637},"last":0.45600000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.014,"15min":7.0599999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.55400000000000005,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.331},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186076,"statfs":{"total":200000000,"available":190542409,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.373,"15min":0.34599999999999997},"min":{"1min":0.26000000000000001,"5min":0.22600000000000001,"15min":0.182},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.66500000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.371,"15min":0.35899999999999999},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59399999999999997},"last":0.315},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.66500000000000004,"15min":0.79500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.27800000000000002,"15min":0.27300000000000002},"max":{"1min":0.64400000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35899999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.62},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.55300000000000005,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.90600000000000003,"5min":0.92100000000000004,"15min":1.337},"last":0.67100000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.622},"min":{"1min":0.48699999999999999,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":1.038,"15min":1.2010000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53900000000000003,"5min":0.44900000000000001,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89900000000000002,"15min":0.97799999999999998},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.024,"15min":1.1699999999999999},"last":0.752},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":1.4570000000000001},"last":0.48799999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.65300000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.879,"5min":1.02,"15min":1.3779999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.54200000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.004,"15min":1.006},"last":0.69199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7187,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188124,"statfs":{"total":200000000,"available":192639561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.44,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74099999999999999,"5min":0.752,"15min":0.82199999999999995},"last":0.59799999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":4.883},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":1.544},"last":0.57099999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.374},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32100000000000001},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33300000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.75},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.52,"5min":1.52,"15min":8.8200000000000003},"last":0.42399999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.49099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":1.4419999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.57799999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":3.8279999999999998},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.503},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.82999999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.33500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":14.039999999999999},"last":0.629},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.375,"15min":0.31},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.497},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":4.6059999999999999},"last":0.58699999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":1.847},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.52900000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":1.97},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":3.2850000000000001},"last":0.63},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.877,"15min":0.877},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":1.0289999999999999,"15min":1.3320000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.0589999999999999,"15min":4.5330000000000004},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.48599999999999999},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78700000000000003,"5min":0.96499999999999997,"15min":1.8839999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.98799999999999999,"15min":3.766},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60399999999999998}]}]}],"pool_statfs":[]}} 2023-12-24T20:08:12.191 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:08:12.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.312+0000 7f83af59e700 1 Processor -- start 2023-12-24T20:08:12.312 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.312+0000 7f83af59e700 1 -- start start 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83af59e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f83b00b2bf0 0x7f83b00cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83af59e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b00c99a0 con 0x7f83b00af3b0 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83af59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b00cd080 con 0x7f83b00af780 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83af59e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b00cd320 con 0x7f83b00b2bf0 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83add9b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f83b00b2bf0 0x7f83b00cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83ae59c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f83b00af3b0 0x7f83b0067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34376/0 (socket says 172.21.15.61:34376) 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83ae59c700 1 -- 172.21.15.61:0/3138697328 learned_addr learned my addr 172.21.15.61:0/3138697328 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83add9b700 1 -- 172.21.15.61:0/3138697328 >> v1:172.21.15.133:6789/0 conn(0x7f83b00af780 legacy=0x7f83b00ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83add9b700 1 -- 172.21.15.61:0/3138697328 >> v1:172.21.15.61:6789/0 conn(0x7f83b00af3b0 legacy=0x7f83b0067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83add9b700 1 -- 172.21.15.61:0/3138697328 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b006f850 con 0x7f83b00b2bf0 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.313+0000 7f83ad59a700 1 -- 172.21.15.61:0/3138697328 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716804343 0 0) 0x7f83b00c99a0 con 0x7f83b00af3b0 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83add9b700 1 --2- 172.21.15.61:0/3138697328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00b2bf0 0x7f83b00cc950 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f83a00098e0 tx=0x7f83a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399ab2e1d04219b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:12.315 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83ad59a700 1 -- 172.21.15.61:0/3138697328 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0009e80 con 0x7f83b00b2bf0 2023-12-24T20:08:12.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83ad59a700 1 -- 172.21.15.61:0/3138697328 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a000b820 con 0x7f83b00b2bf0 2023-12-24T20:08:12.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83ad59a700 1 -- 172.21.15.61:0/3138697328 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a000bba0 con 0x7f83b00b2bf0 2023-12-24T20:08:12.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83af59e700 1 -- 172.21.15.61:0/3138697328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00b2bf0 msgr2=0x7f83b00cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83af59e700 1 --2- 172.21.15.61:0/3138697328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00b2bf0 0x7f83b00cc950 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f83a00098e0 tx=0x7f83a00091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83af59e700 1 -- 172.21.15.61:0/3138697328 shutdown_connections 2023-12-24T20:08:12.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83af59e700 1 --2- 172.21.15.61:0/3138697328 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00b2bf0 0x7f83b00cc950 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83af59e700 1 -- 172.21.15.61:0/3138697328 >> 172.21.15.61:0/3138697328 conn(0x7f83b00b0e70 msgr2=0x7f83b00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:12.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83af59e700 1 -- 172.21.15.61:0/3138697328 shutdown_connections 2023-12-24T20:08:12.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.314+0000 7f83af59e700 1 -- 172.21.15.61:0/3138697328 wait complete. 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.315+0000 7f83af59e700 1 Processor -- start 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83af59e700 1 -- start start 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83af59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b00af3b0 0x7f83b0156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83af59e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00af780 0x7f83b009a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83af59e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83b00b2bf0 0x7f83b00ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83af59e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0099bd0 con 0x7f83b00af780 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83af59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0098fc0 con 0x7f83b00af3b0 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83af59e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b00992a0 con 0x7f83b00b2bf0 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83add9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00af780 0x7f83b009a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83add9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00af780 0x7f83b009a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35610/0 (socket says 172.21.15.61:35610) 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83add9b700 1 -- 172.21.15.61:0/992244941 learned_addr learned my addr 172.21.15.61:0/992244941 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.316+0000 7f83ae59c700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b00af3b0 0x7f83b0156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f83aed9d700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83b00b2bf0 0x7f83b00ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f83add9b700 1 -- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83b00b2bf0 msgr2=0x7f83b00ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f83add9b700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83b00b2bf0 0x7f83b00ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f83add9b700 1 -- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b00af3b0 msgr2=0x7f83b0156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f83add9b700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b00af3b0 0x7f83b0156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f83add9b700 1 -- 172.21.15.61:0/992244941 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a0009420 con 0x7f83b00af780 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f83add9b700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00af780 0x7f83b009a060 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f83a00030c0 tx=0x7f83a0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f839e7fc700 1 -- 172.21.15.61:0/992244941 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a000b990 con 0x7f83b00af780 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f839e7fc700 1 -- 172.21.15.61:0/992244941 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a0020070 con 0x7f83b00af780 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f83af59e700 1 -- 172.21.15.61:0/992244941 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b0099580 con 0x7f83b00af780 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f839e7fc700 1 -- 172.21.15.61:0/992244941 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a001b450 con 0x7f83b00af780 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.317+0000 7f83af59e700 1 -- 172.21.15.61:0/992244941 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b00ca700 con 0x7f83b00af780 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.319+0000 7f83af59e700 1 -- 172.21.15.61:0/992244941 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b0099a20 con 0x7f83b00af780 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.319+0000 7f839e7fc700 1 -- 172.21.15.61:0/992244941 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f83a0022030 con 0x7f83b00af780 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.319+0000 7f839e7fc700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8390066f30 0x7f83900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.319+0000 7f839e7fc700 1 -- 172.21.15.61:0/992244941 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f83a0085fd0 con 0x7f83b00af780 2023-12-24T20:08:12.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.319+0000 7f83ae59c700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8390066f30 0x7f83900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.320+0000 7f83ae59c700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8390066f30 0x7f83900693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f83a4007fd0 tx=0x7f83a4007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:12.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.324+0000 7f839e7fc700 1 -- 172.21.15.61:0/992244941 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83a0053540 con 0x7f83b00af780 2023-12-24T20:08:12.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.515+0000 7f83af59e700 1 -- 172.21.15.61:0/992244941 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83b0099a20 con 0x7f8390066f30 2023-12-24T20:08:12.517 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.518+0000 7f839e7fc700 1 -- 172.21.15.61:0/992244941 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49626 (secure 0 0 0) 0x7f83b0099a20 con 0x7f8390066f30 2023-12-24T20:08:12.518 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:12.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.519+0000 7f83af59e700 1 -- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8390066f30 msgr2=0x7f83900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.519+0000 7f83af59e700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8390066f30 0x7f83900693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f83a4007fd0 tx=0x7f83a4007d30 comp rx=0 tx=0).stop 2023-12-24T20:08:12.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.519+0000 7f83af59e700 1 -- 172.21.15.61:0/992244941 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00af780 msgr2=0x7f83b009a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.519+0000 7f83af59e700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00af780 0x7f83b009a060 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f83a00030c0 tx=0x7f83a0016000 comp rx=0 tx=0).stop 2023-12-24T20:08:12.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.519+0000 7f83af59e700 1 -- 172.21.15.61:0/992244941 shutdown_connections 2023-12-24T20:08:12.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.519+0000 7f83af59e700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f83b00b2bf0 0x7f83b00ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.519+0000 7f83af59e700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f8390066f30 0x7f83900693e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.519+0000 7f83af59e700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b00af3b0 0x7f83b0156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.519+0000 7f83af59e700 1 --2- 172.21.15.61:0/992244941 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83b00af780 0x7f83b009a060 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.520+0000 7f83af59e700 1 -- 172.21.15.61:0/992244941 >> 172.21.15.61:0/992244941 conn(0x7f83b00b0e70 msgr2=0x7f83b0157170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:12.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.520+0000 7f83af59e700 1 -- 172.21.15.61:0/992244941 shutdown_connections 2023-12-24T20:08:12.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.520+0000 7f83af59e700 1 -- 172.21.15.61:0/992244941 wait complete. 2023-12-24T20:08:12.521 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:08:12.532 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2023-12-24T20:08:12.473207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":54582,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1507917,"statfs":{"total":1600000000,"available":1544107844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52484251,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-119,"num_write_kb":-85079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001505"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":312,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-24T20:08:08.898851+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:08:08.898851+0000","last_peered":"2023-12-24T20:08:08.898851+0000","last_clean":"2023-12-24T20:08:08.898851+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:08:08.898851+0000","last_undegraded":"2023-12-24T20:08:08.898851+0000","last_fullsized":"2023-12-24T20:08:08.898851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574985,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.308,"15min":0.307},"max":{"1min":0.80200000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.56999999999999995},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.872,"15min":0.872},"last":0.433},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.39400000000000002,"15min":0.34100000000000003},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.623},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.82799999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.312},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.95699999999999996},"last":0.57299999999999995}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.379,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.81499999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.752,"15min":0.80000000000000004},"last":0.45500000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.79100000000000004,"15min":0.83699999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.873},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19475,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175836,"statfs":{"total":200000000,"available":180056649,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.0309999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.45700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.40999999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":0.80200000000000005,"15min":0.95799999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.503}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.27000000000000002},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.44,"5min":0.378,"15min":0.33200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0640000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.077},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.372},"max":{"1min":0.79100000000000004,"5min":0.877,"15min":1.048},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57599999999999996}]},{"osd":5,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.86499999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.254},"max":{"1min":0.628,"5min":0.748,"15min":0.84699999999999998},"last":0.63300000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13331,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181980,"statfs":{"total":200000000,"available":186348105,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.372,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40799999999999997,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.54800000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.371}]},{"osd":3,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.309}]},{"osd":4,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.80900000000000005,"5min":0.871,"15min":0.871},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.59799999999999998},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.94299999999999995,"5min":1.014,"15min":1.014},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.04},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86199999999999999,"5min":0.998,"15min":0.998},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.63},"min":{"1min":0.437,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.64300000000000002},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.39500000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.625}]},{"osd":7,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.629},"min":{"1min":0.501,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69399999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":1.0109999999999999,"5min":1.03,"15min":1.03},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574985,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36499999999999999,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.45800000000000002,"5min":0.70799999999999996,"15min":0.97999999999999998},"last":0.28499999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.439,"5min":0.65400000000000003,"15min":0.92700000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.93999999999999995},"last":0.23899999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56699999999999995,"5min":0.70199999999999996,"15min":2.573},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":1.073,"15min":1.3500000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.65200000000000002},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":2.7149999999999999},"last":0.625}]},{"osd":5,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.372},"max":{"1min":0.94599999999999995,"5min":1.0569999999999999,"15min":2.6859999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.006},"last":0.57399999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":1.0489999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":1.5429999999999999},"last":0.496},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.69999999999999996},"min":{"1min":0.58699999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574985,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.249,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.50800000000000001,"5min":0.61599999999999999,"15min":0.78900000000000003},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.72299999999999998},"last":0.29799999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38100000000000001,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.77700000000000002},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.82799999999999996},"last":0.34399999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.84699999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.88900000000000001},"last":0.27900000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.97999999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.2649999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":3.577},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":1.052,"15min":7.0220000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.075,"5min":1.075,"15min":1.298},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":3.637},"last":0.45600000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.014,"15min":7.0599999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.55400000000000005,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.331},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186076,"statfs":{"total":200000000,"available":190542409,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.373,"15min":0.34599999999999997},"min":{"1min":0.26000000000000001,"5min":0.22600000000000001,"15min":0.182},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.66500000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.371,"15min":0.35899999999999999},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59399999999999997},"last":0.315},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.66500000000000004,"15min":0.79500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.27800000000000002,"15min":0.27300000000000002},"max":{"1min":0.64400000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35899999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.62},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.55300000000000005,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.90600000000000003,"5min":0.92100000000000004,"15min":1.337},"last":0.67100000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.622},"min":{"1min":0.48699999999999999,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":1.038,"15min":1.2010000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53900000000000003,"5min":0.44900000000000001,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89900000000000002,"15min":0.97799999999999998},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.024,"15min":1.1699999999999999},"last":0.752},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":1.4570000000000001},"last":0.48799999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.65300000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.879,"5min":1.02,"15min":1.3779999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.54200000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.004,"15min":1.006},"last":0.69199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7187,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188124,"statfs":{"total":200000000,"available":192639561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.44,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74099999999999999,"5min":0.752,"15min":0.82199999999999995},"last":0.59799999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":4.883},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":1.544},"last":0.57099999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.374},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32100000000000001},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33300000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.75},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.52,"5min":1.52,"15min":8.8200000000000003},"last":0.42399999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.49099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":1.4419999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.57799999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":3.8279999999999998},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.503},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.82999999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.33500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":14.039999999999999},"last":0.629},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.375,"15min":0.31},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.497},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":4.6059999999999999},"last":0.58699999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":1.847},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.52900000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":1.97},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":3.2850000000000001},"last":0.63},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.877,"15min":0.877},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":1.0289999999999999,"15min":1.3320000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.0589999999999999,"15min":4.5330000000000004},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.48599999999999999},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78700000000000003,"5min":0.96499999999999997,"15min":1.8839999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.98799999999999999,"15min":3.766},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60399999999999998}]}]}],"pool_statfs":[]}} 2023-12-24T20:08:12.533 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-24T20:08:12.533 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:08:12.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.655+0000 7f7dc1bb1700 1 Processor -- start 2023-12-24T20:08:12.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.655+0000 7f7dc1bb1700 1 -- start start 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dc1bb1700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7dbc15bb60 0x7f7dbc098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dc1bb1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dbc0b2660 0x7f7dbc0b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dc1bb1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dbc0b2eb0 con 0x7f7dbc098aa0 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dc1bb1700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dbc0afc20 con 0x7f7dbc15bb60 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dc1bb1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0b2bd0 con 0x7f7dbc0b2660 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dbb7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7dbc15bb60 0x7f7dbc098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dbb7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7dbc15bb60 0x7f7dbc098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35620/0 (socket says 172.21.15.61:35620) 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dbb7fe700 1 -- 172.21.15.61:0/623714715 learned_addr learned my addr 172.21.15.61:0/623714715 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dbbfff700 1 --2- 172.21.15.61:0/623714715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dbc0b2660 0x7f7dbc0b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dbb7fe700 1 -- 172.21.15.61:0/623714715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dbc0b2660 msgr2=0x7f7dbc0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dbb7fe700 1 --2- 172.21.15.61:0/623714715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dbc0b2660 0x7f7dbc0b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.656+0000 7f7dbb7fe700 1 -- 172.21.15.61:0/623714715 >> v1:172.21.15.133:6789/0 conn(0x7f7dbc098aa0 legacy=0x7f7dbc15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dbb7fe700 1 -- 172.21.15.61:0/623714715 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc0afe10 con 0x7f7dbc15bb60 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dbb7fe700 1 --2- 172.21.15.61:0/623714715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc15bb60 0x7f7dbc098560 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009990 tx=0x7f7dac009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e027ddcf3499f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dba7fc700 1 -- 172.21.15.61:0/623714715 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac005c10 con 0x7f7dbc15bb60 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dba7fc700 1 -- 172.21.15.61:0/623714715 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dac005d70 con 0x7f7dbc15bb60 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dba7fc700 1 -- 172.21.15.61:0/623714715 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00b880 con 0x7f7dbc15bb60 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/623714715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc15bb60 msgr2=0x7f7dbc098560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dc1bb1700 1 --2- 172.21.15.61:0/623714715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc15bb60 0x7f7dbc098560 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009990 tx=0x7f7dac009220 comp rx=0 tx=0).stop 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/623714715 shutdown_connections 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dc1bb1700 1 --2- 172.21.15.61:0/623714715 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dbc0b2660 0x7f7dbc0b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dc1bb1700 1 --2- 172.21.15.61:0/623714715 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc15bb60 0x7f7dbc098560 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/623714715 >> 172.21.15.61:0/623714715 conn(0x7f7dbc097a10 msgr2=0x7f7dbc0ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.657+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/623714715 shutdown_connections 2023-12-24T20:08:12.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.658+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/623714715 wait complete. 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.659+0000 7f7dc1bb1700 1 Processor -- start 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.659+0000 7f7dc1bb1700 1 -- start start 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dc1bb1700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dbc098aa0 0x7f7dbc0accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dc1bb1700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc0b2660 0x7f7dbc068000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dc1bb1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dbc15bb60 0x7f7dbc068540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dc1bb1700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc069050 con 0x7f7dbc0b2660 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dc1bb1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc0a9f70 con 0x7f7dbc15bb60 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dc1bb1700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dbc068d70 con 0x7f7dbc098aa0 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbaffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc0b2660 0x7f7dbc068000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbaffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc0b2660 0x7f7dbc068000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35626/0 (socket says 172.21.15.61:35626) 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbaffd700 1 -- 172.21.15.61:0/778439499 learned_addr learned my addr 172.21.15.61:0/778439499 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbb7fe700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dbc098aa0 0x7f7dbc0accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbbfff700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dbc15bb60 0x7f7dbc068540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbaffd700 1 -- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dbc098aa0 msgr2=0x7f7dbc0accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbaffd700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dbc098aa0 0x7f7dbc0accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbaffd700 1 -- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dbc15bb60 msgr2=0x7f7dbc068540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbaffd700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dbc15bb60 0x7f7dbc068540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbaffd700 1 -- 172.21.15.61:0/778439499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dac009480 con 0x7f7dbc0b2660 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dbaffd700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc0b2660 0x7f7dbc068000 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f7db000c590 tx=0x7f7db000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7da37fe700 1 -- 172.21.15.61:0/778439499 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0011590 con 0x7f7dbc0b2660 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7da37fe700 1 -- 172.21.15.61:0/778439499 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00116f0 con 0x7f7dbc0b2660 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7da37fe700 1 -- 172.21.15.61:0/778439499 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0011ab0 con 0x7f7dbc0b2660 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/778439499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dbc0a9920 con 0x7f7dbc0b2660 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.660+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/778439499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dbc068b00 con 0x7f7dbc0b2660 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.661+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/778439499 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dbc06d440 con 0x7f7dbc0b2660 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.662+0000 7f7da37fe700 1 -- 172.21.15.61:0/778439499 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f7db001b3b0 con 0x7f7dbc0b2660 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.662+0000 7f7da37fe700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7da8066f30 0x7f7da80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:12.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.662+0000 7f7da37fe700 1 -- 172.21.15.61:0/778439499 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7db00837e0 con 0x7f7dbc0b2660 2023-12-24T20:08:12.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.663+0000 7f7dbb7fe700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7da8066f30 0x7f7da80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:12.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.663+0000 7f7dbb7fe700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7da8066f30 0x7f7da80693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009260 tx=0x7f7dac016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:12.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.667+0000 7f7da37fe700 1 -- 172.21.15.61:0/778439499 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7db0050d50 con 0x7f7dbc0b2660 2023-12-24T20:08:12.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.858+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/778439499 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7dbc04c3c0 con 0x7f7da8066f30 2023-12-24T20:08:12.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.861+0000 7f7da37fe700 1 -- 172.21.15.61:0/778439499 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49626 (secure 0 0 0) 0x7f7dbc04c3c0 con 0x7f7da8066f30 2023-12-24T20:08:12.861 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:12.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7da8066f30 msgr2=0x7f7da80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7da8066f30 0x7f7da80693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009260 tx=0x7f7dac016000 comp rx=0 tx=0).stop 2023-12-24T20:08:12.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/778439499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc0b2660 msgr2=0x7f7dbc068000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:12.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc0b2660 0x7f7dbc068000 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f7db000c590 tx=0x7f7db000c950 comp rx=0 tx=0).stop 2023-12-24T20:08:12.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/778439499 shutdown_connections 2023-12-24T20:08:12.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f7dbc098aa0 0x7f7dbc0accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f7da8066f30 0x7f7da80693e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dbc15bb60 0x7f7dbc068540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 --2- 172.21.15.61:0/778439499 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7dbc0b2660 0x7f7dbc068000 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:12.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/778439499 >> 172.21.15.61:0/778439499 conn(0x7f7dbc097a10 msgr2=0x7f7dbc09baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:12.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/778439499 shutdown_connections 2023-12-24T20:08:12.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.863+0000 7f7dc1bb1700 1 -- 172.21.15.61:0/778439499 wait complete. 2023-12-24T20:08:12.864 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:08:12.875 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2023-12-24T20:08:12.473207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":54582,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1507917,"statfs":{"total":1600000000,"available":1544107844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52484251,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-119,"num_write_kb":-85079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001505"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":312,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-24T20:08:08.898851+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:08:08.898851+0000","last_peered":"2023-12-24T20:08:08.898851+0000","last_clean":"2023-12-24T20:08:08.898851+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:08:08.898851+0000","last_undegraded":"2023-12-24T20:08:08.898851+0000","last_fullsized":"2023-12-24T20:08:08.898851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574985,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59299999999999997,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.308,"15min":0.307},"max":{"1min":0.80200000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.58199999999999996,"15min":0.53100000000000003},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59099999999999997,"15min":0.56999999999999995},"min":{"1min":0.36899999999999999,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.872,"15min":0.872},"last":0.433},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.443,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71699999999999997,"5min":0.79400000000000004,"15min":0.79900000000000004},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.56200000000000006},"min":{"1min":0.40699999999999997,"5min":0.39400000000000002,"15min":0.34100000000000003},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42399999999999999,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.80200000000000005,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.36199999999999999,"15min":0.32800000000000001},"max":{"1min":0.82699999999999996,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.623},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.77400000000000002,"5min":0.84099999999999997,"15min":0.91400000000000003},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.497,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.82799999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.505,"15min":0.55200000000000005},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.312},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.95699999999999996},"last":0.57299999999999995}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.379,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.81499999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.373,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72599999999999998,"5min":0.752,"15min":0.80000000000000004},"last":0.45500000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.78500000000000003,"5min":0.79100000000000004,"15min":0.83699999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.873},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19475,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175836,"statfs":{"total":200000000,"available":180056649,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.0309999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.45700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.40999999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":0.80200000000000005,"15min":0.95799999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.503}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.27000000000000002},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.44,"5min":0.378,"15min":0.33200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0640000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.077},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.372},"max":{"1min":0.79100000000000004,"5min":0.877,"15min":1.048},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.57599999999999996}]},{"osd":5,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.86499999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.254},"max":{"1min":0.628,"5min":0.748,"15min":0.84699999999999998},"last":0.63300000000000001}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13331,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181980,"statfs":{"total":200000000,"available":186348105,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.372,"15min":0.35399999999999998},"min":{"1min":0.22600000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.59599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.40799999999999997,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.57399999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.54800000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.371}]},{"osd":3,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.33400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.435,"15min":0.40899999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.25},"max":{"1min":0.63,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.309}]},{"osd":4,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63700000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.80900000000000005,"5min":0.871,"15min":0.871},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64400000000000002,"15min":0.59799999999999998},"min":{"1min":0.47099999999999997,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.94299999999999995,"5min":1.014,"15min":1.014},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.63500000000000001},"min":{"1min":0.46400000000000002,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.95699999999999996,"5min":1.04,"15min":1.04},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65100000000000002,"15min":0.61799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86199999999999999,"5min":0.998,"15min":0.998},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67100000000000004,"15min":0.63},"min":{"1min":0.437,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.64300000000000002},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.39500000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.625}]},{"osd":7,"last update":"Sun Dec 24 20:07:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67000000000000004,"15min":0.629},"min":{"1min":0.501,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69399999999999995,"15min":0.66200000000000003},"min":{"1min":0.48199999999999998,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":1.0109999999999999,"5min":1.03,"15min":1.03},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574985,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36499999999999999,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.45800000000000002,"5min":0.70799999999999996,"15min":0.97999999999999998},"last":0.28499999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.439,"5min":0.65400000000000003,"15min":0.92700000000000005},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.93999999999999995},"last":0.23899999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56699999999999995,"5min":0.70199999999999996,"15min":2.573},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":1.073,"15min":1.3500000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.65200000000000002},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":2.7149999999999999},"last":0.625}]},{"osd":5,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.372},"max":{"1min":0.94599999999999995,"5min":1.0569999999999999,"15min":2.6859999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.006},"last":0.57399999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":1.0489999999999999},"last":0.52200000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":1.5429999999999999},"last":0.496},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.69999999999999996},"min":{"1min":0.58699999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.64800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574985,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.249,"5min":0.22,"15min":0.20300000000000001},"max":{"1min":0.50800000000000001,"5min":0.61599999999999999,"15min":0.78900000000000003},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.38100000000000001},"min":{"1min":0.25,"5min":0.23599999999999999,"15min":0.221},"max":{"1min":0.59199999999999997,"5min":0.65600000000000003,"15min":0.72299999999999998},"last":0.29799999999999999}]},{"osd":1,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38100000000000001,"15min":0.37},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.20200000000000001},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.77700000000000002},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.42299999999999999,"15min":0.41099999999999998},"min":{"1min":0.29499999999999998,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.60399999999999998,"5min":0.64900000000000002,"15min":0.82799999999999996},"last":0.34399999999999997}]},{"osd":3,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.42999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29499999999999998,"15min":0.27200000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.84699999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.316,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.88900000000000001},"last":0.27900000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.621,"15min":0.623},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.97999999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.629,"15min":0.622},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.2649999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64700000000000002,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":3.577},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":1.052,"15min":7.0220000000000002},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64700000000000002,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.075,"5min":1.075,"15min":1.298},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.44900000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":3.637},"last":0.45600000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.014,"5min":1.014,"15min":7.0599999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.55400000000000005,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.331},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574985,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186076,"statfs":{"total":200000000,"available":190542409,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.373,"15min":0.34599999999999997},"min":{"1min":0.26000000000000001,"5min":0.22600000000000001,"15min":0.182},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38300000000000001,"15min":0.36599999999999999},"min":{"1min":0.25600000000000001,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.66500000000000004},"last":0.33000000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.371,"15min":0.35899999999999999},"min":{"1min":0.318,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59399999999999997},"last":0.315},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.432,"15min":0.40400000000000003},"min":{"1min":0.33200000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41499999999999998},"min":{"1min":0.27300000000000002,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.61699999999999999,"5min":0.66500000000000004,"15min":0.79500000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.45200000000000001,"15min":0.437},"min":{"1min":0.34799999999999998,"5min":0.27800000000000002,"15min":0.27300000000000002},"max":{"1min":0.64400000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.35899999999999999}]},{"osd":4,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80100000000000005,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.62},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.62},"min":{"1min":0.55300000000000005,"5min":0.35499999999999998,"15min":0.34100000000000003},"max":{"1min":0.90600000000000003,"5min":0.92100000000000004,"15min":1.337},"last":0.67100000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.629,"15min":0.622},"min":{"1min":0.48699999999999999,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":1.038,"15min":1.2010000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.53900000000000003,"5min":0.44900000000000001,"15min":0.35199999999999998},"max":{"1min":0.84699999999999998,"5min":0.89900000000000002,"15min":0.97799999999999998},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84399999999999997,"5min":1.024,"15min":1.1699999999999999},"last":0.752},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65100000000000002,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93200000000000005,"5min":0.97899999999999998,"15min":1.4570000000000001},"last":0.48799999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:07:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.65300000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.879,"5min":1.02,"15min":1.3779999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.54200000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.88700000000000001,"5min":1.004,"15min":1.006},"last":0.69199999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7187,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188124,"statfs":{"total":200000000,"available":192639561,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.44,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74099999999999999,"5min":0.752,"15min":0.82199999999999995},"last":0.59799999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":4.883},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":1.544},"last":0.57099999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.374},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32100000000000001},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33300000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.75},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.52,"5min":1.52,"15min":8.8200000000000003},"last":0.42399999999999999}]},{"osd":5,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.49099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":1.4419999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.57799999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":3.8279999999999998},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.503},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.82999999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.33500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":14.039999999999999},"last":0.629},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.375,"15min":0.31},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.497},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":4.6059999999999999},"last":0.58699999999999997}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":1.847},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.52900000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":1.97},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":3.2850000000000001},"last":0.63},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.877,"15min":0.877},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":1.0289999999999999,"15min":1.3320000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.0589999999999999,"15min":4.5330000000000004},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.48599999999999999},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78700000000000003,"5min":0.96499999999999997,"15min":1.8839999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.98799999999999999,"15min":3.766},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60399999999999998}]}]}],"pool_statfs":[]}} 2023-12-24T20:08:12.877 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-24T20:08:12.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.998+0000 7fd0ffa39700 1 Processor -- start 2023-12-24T20:08:12.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.998+0000 7fd0ffa39700 1 -- start start 2023-12-24T20:08:13.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.999+0000 7fd0ffa39700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0f8156730 0x7fd0f8156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:13.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.999+0000 7fd0ffa39700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f80b0830 0x7fd0f806d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:13.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.999+0000 7fd0ffa39700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f8067a60 con 0x7fd0f806de20 2023-12-24T20:08:13.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.999+0000 7fd0ffa39700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f806e280 con 0x7fd0f8156730 2023-12-24T20:08:13.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.999+0000 7fd0ffa39700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80c88e0 con 0x7fd0f80b0830 2023-12-24T20:08:13.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.999+0000 7fd0fd7d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0f8156730 0x7fd0f8156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:13.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.999+0000 7fd0fcfd4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f80b0830 0x7fd0f806d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:13.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.999+0000 7fd0fdfd6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd0f806de20 0x7fd0f80c7c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:36790/0 (socket says 172.21.15.61:36790) 2023-12-24T20:08:13.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:12.999+0000 7fd0fdfd6700 1 -- 172.21.15.61:0/4008231816 learned_addr learned my addr 172.21.15.61:0/4008231816 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:13.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.000+0000 7fd0fd7d5700 1 -- 172.21.15.61:0/4008231816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f80b0830 msgr2=0x7fd0f806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:13.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.000+0000 7fd0fd7d5700 1 --2- 172.21.15.61:0/4008231816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f80b0830 0x7fd0f806d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.000+0000 7fd0fd7d5700 1 -- 172.21.15.61:0/4008231816 >> v1:172.21.15.133:6789/0 conn(0x7fd0f806de20 legacy=0x7fd0f80c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:13.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.000+0000 7fd0fd7d5700 1 -- 172.21.15.61:0/4008231816 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f80c8bc0 con 0x7fd0f8156730 2023-12-24T20:08:13.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.000+0000 7fd0fd7d5700 1 --2- 172.21.15.61:0/4008231816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f8156730 0x7fd0f8156b00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80098e0 tx=0x7fd0e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4c6284a47e9611 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:13.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.000+0000 7fd0effff700 1 -- 172.21.15.61:0/4008231816 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8011630 con 0x7fd0f8156730 2023-12-24T20:08:13.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.000+0000 7fd0effff700 1 -- 172.21.15.61:0/4008231816 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e8011790 con 0x7fd0f8156730 2023-12-24T20:08:13.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.000+0000 7fd0effff700 1 -- 172.21.15.61:0/4008231816 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8011b30 con 0x7fd0f8156730 2023-12-24T20:08:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.001+0000 7fd0ffa39700 1 -- 172.21.15.61:0/4008231816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f8156730 msgr2=0x7fd0f8156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.001+0000 7fd0ffa39700 1 --2- 172.21.15.61:0/4008231816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f8156730 0x7fd0f8156b00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80098e0 tx=0x7fd0e80091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.001+0000 7fd0ffa39700 1 -- 172.21.15.61:0/4008231816 shutdown_connections 2023-12-24T20:08:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.001+0000 7fd0ffa39700 1 --2- 172.21.15.61:0/4008231816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f8156730 0x7fd0f8156b00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.001+0000 7fd0ffa39700 1 --2- 172.21.15.61:0/4008231816 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f80b0830 0x7fd0f806d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.001+0000 7fd0ffa39700 1 -- 172.21.15.61:0/4008231816 >> 172.21.15.61:0/4008231816 conn(0x7fd0f80cd6f0 msgr2=0x7fd0f80cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.001+0000 7fd0ffa39700 1 -- 172.21.15.61:0/4008231816 shutdown_connections 2023-12-24T20:08:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.001+0000 7fd0ffa39700 1 -- 172.21.15.61:0/4008231816 wait complete. 2023-12-24T20:08:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.002+0000 7fd0ffa39700 1 Processor -- start 2023-12-24T20:08:13.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.003+0000 7fd0ffa39700 1 -- start start 2023-12-24T20:08:13.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0ffa39700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f806de20 0x7fd0f814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:13.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0ffa39700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f80b0830 0x7fd0f8067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:13.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0ffa39700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f8156730 0x7fd0f8068430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:13.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0ffa39700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80c5db0 con 0x7fd0f80b0830 2023-12-24T20:08:13.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0ffa39700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f814d3e0 con 0x7fd0f806de20 2023-12-24T20:08:13.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0ffa39700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80c54a0 con 0x7fd0f8156730 2023-12-24T20:08:13.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fcfd4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f80b0830 0x7fd0f8067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:13.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fcfd4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f80b0830 0x7fd0f8067ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35636/0 (socket says 172.21.15.61:35636) 2023-12-24T20:08:13.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fcfd4700 1 -- 172.21.15.61:0/1489922597 learned_addr learned my addr 172.21.15.61:0/1489922597 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:13.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fd7d5700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f806de20 0x7fd0f814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:13.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fdfd6700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f8156730 0x7fd0f8068430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:13.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fcfd4700 1 -- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f8156730 msgr2=0x7fd0f8068430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:13.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fcfd4700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f8156730 0x7fd0f8068430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fcfd4700 1 -- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f806de20 msgr2=0x7fd0f814cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:13.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fcfd4700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f806de20 0x7fd0f814cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fcfd4700 1 -- 172.21.15.61:0/1489922597 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e8009420 con 0x7fd0f80b0830 2023-12-24T20:08:13.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0fcfd4700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f80b0830 0x7fd0f8067ef0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400ec80 tx=0x7fd0f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:13.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0ed7fa700 1 -- 172.21.15.61:0/1489922597 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400c850 con 0x7fd0f80b0830 2023-12-24T20:08:13.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0ed7fa700 1 -- 172.21.15.61:0/1489922597 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f400c9b0 con 0x7fd0f80b0830 2023-12-24T20:08:13.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0ffa39700 1 -- 172.21.15.61:0/1489922597 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f80c5760 con 0x7fd0f80b0830 2023-12-24T20:08:13.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.004+0000 7fd0ed7fa700 1 -- 172.21.15.61:0/1489922597 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400cd50 con 0x7fd0f80b0830 2023-12-24T20:08:13.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.005+0000 7fd0ffa39700 1 -- 172.21.15.61:0/1489922597 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f80c7970 con 0x7fd0f80b0830 2023-12-24T20:08:13.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.005+0000 7fd0ffa39700 1 -- 172.21.15.61:0/1489922597 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f8159d40 con 0x7fd0f80b0830 2023-12-24T20:08:13.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.006+0000 7fd0ed7fa700 1 -- 172.21.15.61:0/1489922597 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd0f4013680 con 0x7fd0f80b0830 2023-12-24T20:08:13.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.006+0000 7fd0ed7fa700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0dc066f30 0x7fd0dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:13.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.006+0000 7fd0ed7fa700 1 -- 172.21.15.61:0/1489922597 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd0f4084460 con 0x7fd0f80b0830 2023-12-24T20:08:13.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.007+0000 7fd0fd7d5700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0dc066f30 0x7fd0dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:13.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.007+0000 7fd0fd7d5700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0dc066f30 0x7fd0dc0693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80030c0 tx=0x7fd0e8016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:13.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.011+0000 7fd0ed7fa700 1 -- 172.21.15.61:0/1489922597 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0f40519d0 con 0x7fd0f80b0830 2023-12-24T20:08:13.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.206+0000 7fd0ffa39700 1 -- 172.21.15.61:0/1489922597 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0f804c3c0 con 0x7fd0f80b0830 2023-12-24T20:08:13.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.207+0000 7fd0ed7fa700 1 -- 172.21.15.61:0/1489922597 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+12276 (secure 0 0 0) 0x7fd0f4054ff0 con 0x7fd0f80b0830 2023-12-24T20:08:13.207 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:13.208 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":191,"fsid":"dfb999b6-2fb1-4e3b-80b2-d432556cbbe5","created":"2023-12-24T19:56:48.741318+0000","modified":"2023-12-24T20:08:09.873670+0000","last_up_change":"2023-12-24T19:56:54.250282+0000","last_in_change":"2023-12-24T19:56:51.229309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-24T19:56:54.358495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":40393},{"type":"v1","addr":"172.21.15.61:6809","nonce":40393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":40393},{"type":"v1","addr":"172.21.15.61:6811","nonce":40393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":40393},{"type":"v1","addr":"172.21.15.61:6815","nonce":40393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":40393},{"type":"v1","addr":"172.21.15.61:6813","nonce":40393}]},"public_addr":"172.21.15.61:6809/40393","cluster_addr":"172.21.15.61:6811/40393","heartbeat_back_addr":"172.21.15.61:6815/40393","heartbeat_front_addr":"172.21.15.61:6813/40393","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":40391},{"type":"v1","addr":"172.21.15.61:6817","nonce":40391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":40391},{"type":"v1","addr":"172.21.15.61:6819","nonce":40391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":40391},{"type":"v1","addr":"172.21.15.61:6823","nonce":40391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":40391},{"type":"v1","addr":"172.21.15.61:6821","nonce":40391}]},"public_addr":"172.21.15.61:6817/40391","cluster_addr":"172.21.15.61:6819/40391","heartbeat_back_addr":"172.21.15.61:6823/40391","heartbeat_front_addr":"172.21.15.61:6821/40391","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":40392},{"type":"v1","addr":"172.21.15.61:6801","nonce":40392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":40392},{"type":"v1","addr":"172.21.15.61:6803","nonce":40392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":40392},{"type":"v1","addr":"172.21.15.61:6807","nonce":40392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":40392},{"type":"v1","addr":"172.21.15.61:6805","nonce":40392}]},"public_addr":"172.21.15.61:6801/40392","cluster_addr":"172.21.15.61:6803/40392","heartbeat_back_addr":"172.21.15.61:6807/40392","heartbeat_front_addr":"172.21.15.61:6805/40392","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":40415},{"type":"v1","addr":"172.21.15.61:6825","nonce":40415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":40415},{"type":"v1","addr":"172.21.15.61:6827","nonce":40415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":40415},{"type":"v1","addr":"172.21.15.61:6831","nonce":40415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":40415},{"type":"v1","addr":"172.21.15.61:6829","nonce":40415}]},"public_addr":"172.21.15.61:6825/40415","cluster_addr":"172.21.15.61:6827/40415","heartbeat_back_addr":"172.21.15.61:6831/40415","heartbeat_front_addr":"172.21.15.61:6829/40415","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":40575},{"type":"v1","addr":"172.21.15.133:6801","nonce":40575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":40575},{"type":"v1","addr":"172.21.15.133:6803","nonce":40575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":40575},{"type":"v1","addr":"172.21.15.133:6807","nonce":40575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":40575},{"type":"v1","addr":"172.21.15.133:6805","nonce":40575}]},"public_addr":"172.21.15.133:6801/40575","cluster_addr":"172.21.15.133:6803/40575","heartbeat_back_addr":"172.21.15.133:6807/40575","heartbeat_front_addr":"172.21.15.133:6805/40575","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":40616},{"type":"v1","addr":"172.21.15.133:6825","nonce":40616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":40616},{"type":"v1","addr":"172.21.15.133:6827","nonce":40616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":40616},{"type":"v1","addr":"172.21.15.133:6831","nonce":40616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":40616},{"type":"v1","addr":"172.21.15.133:6829","nonce":40616}]},"public_addr":"172.21.15.133:6825/40616","cluster_addr":"172.21.15.133:6827/40616","heartbeat_back_addr":"172.21.15.133:6831/40616","heartbeat_front_addr":"172.21.15.133:6829/40616","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":40576},{"type":"v1","addr":"172.21.15.133:6817","nonce":40576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":40576},{"type":"v1","addr":"172.21.15.133:6819","nonce":40576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":40576},{"type":"v1","addr":"172.21.15.133:6823","nonce":40576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":40576},{"type":"v1","addr":"172.21.15.133:6821","nonce":40576}]},"public_addr":"172.21.15.133:6817/40576","cluster_addr":"172.21.15.133:6819/40576","heartbeat_back_addr":"172.21.15.133:6823/40576","heartbeat_front_addr":"172.21.15.133:6821/40576","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":40577},{"type":"v1","addr":"172.21.15.133:6809","nonce":40577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":40577},{"type":"v1","addr":"172.21.15.133:6811","nonce":40577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":40577},{"type":"v1","addr":"172.21.15.133:6815","nonce":40577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":40577},{"type":"v1","addr":"172.21.15.133:6813","nonce":40577}]},"public_addr":"172.21.15.133:6809/40577","cluster_addr":"172.21.15.133:6811/40577","heartbeat_back_addr":"172.21.15.133:6815/40577","heartbeat_front_addr":"172.21.15.133:6813/40577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.359533+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.399865+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.330738+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.365147+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.312580+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.386830+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.408744+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-24T19:56:52.323082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6837/2891152875":"2023-12-25T20:08:06.840168+0000","172.21.15.133:6835/2891152875":"2023-12-25T20:08:06.840168+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-24T20:08:13.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 -- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0dc066f30 msgr2=0x7fd0dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:13.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0dc066f30 0x7fd0dc0693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80030c0 tx=0x7fd0e8016000 comp rx=0 tx=0).stop 2023-12-24T20:08:13.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 -- 172.21.15.61:0/1489922597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f80b0830 msgr2=0x7fd0f8067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:13.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f80b0830 0x7fd0f8067ef0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400ec80 tx=0x7fd0f40091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 -- 172.21.15.61:0/1489922597 shutdown_connections 2023-12-24T20:08:13.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd0f8156730 0x7fd0f8068430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd0dc066f30 0x7fd0dc0693e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f806de20 0x7fd0f814cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 --2- 172.21.15.61:0/1489922597 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd0f80b0830 0x7fd0f8067ef0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:13.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 -- 172.21.15.61:0/1489922597 >> 172.21.15.61:0/1489922597 conn(0x7fd0f80cd6f0 msgr2=0x7fd0f80cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:13.211 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.209+0000 7fd0ffa39700 1 -- 172.21.15.61:0/1489922597 shutdown_connections 2023-12-24T20:08:13.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:13.210+0000 7fd0ffa39700 1 -- 172.21.15.61:0/1489922597 wait complete. 2023-12-24T20:08:14.222 INFO:tasks.ceph:Scrubbing osd.0 2023-12-24T20:08:14.223 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:08:14.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.362+0000 7fdf48bdb700 1 Processor -- start 2023-12-24T20:08:14.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.362+0000 7fdf48bdb700 1 -- start start 2023-12-24T20:08:14.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.363+0000 7fdf48bdb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf440ce750 0x7fdf4406f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.363+0000 7fdf48bdb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf4415b590 0x7fdf440ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.364 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.363+0000 7fdf48bdb700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf440c8d90 con 0x7fdf440c9500 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.363+0000 7fdf48bdb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440cf060 con 0x7fdf4415b590 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.363+0000 7fdf48bdb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4415bd00 con 0x7fdf440ce750 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.363+0000 7fdf42d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fdf440c9500 0x7fdf440af3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34378/0 (socket says 172.21.15.61:34378) 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.363+0000 7fdf42d9d700 1 -- 172.21.15.61:0/4069443373 learned_addr learned my addr 172.21.15.61:0/4069443373 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.363+0000 7fdf41d9b700 1 --2- 172.21.15.61:0/4069443373 >> v2:172.21.15.133:3300/0 conn(0x7fdf4415b590 0x7fdf440ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.363+0000 7fdf4259c700 1 --2- 172.21.15.61:0/4069443373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf440ce750 0x7fdf4406f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4159a700 1 -- 172.21.15.61:0/4069443373 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009122746 0 0) 0x7fdf440c8d90 con 0x7fdf440c9500 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4159a700 1 -- 172.21.15.61:0/4069443373 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf2c003570 con 0x7fdf440c9500 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4159a700 1 -- 172.21.15.61:0/4069443373 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1826980500 0 0) 0x7fdf2c003570 con 0x7fdf440c9500 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4259c700 1 -- 172.21.15.61:0/4069443373 >> v2:172.21.15.133:3300/0 conn(0x7fdf4415b590 msgr2=0x7fdf440ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4259c700 1 --2- 172.21.15.61:0/4069443373 >> v2:172.21.15.133:3300/0 conn(0x7fdf4415b590 0x7fdf440ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4259c700 1 -- 172.21.15.61:0/4069443373 >> v1:172.21.15.61:6789/0 conn(0x7fdf440c9500 legacy=0x7fdf440af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4259c700 1 -- 172.21.15.61:0/4069443373 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4415bfe0 con 0x7fdf440ce750 2023-12-24T20:08:14.365 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf41d9b700 1 --2- 172.21.15.61:0/4069443373 >> v2:172.21.15.133:3300/0 conn(0x7fdf4415b590 0x7fdf440ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:14.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4259c700 1 --2- 172.21.15.61:0/4069443373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf440ce750 0x7fdf4406f850 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf380098e0 tx=0x7fdf380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f97312da7ded14ab server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4159a700 1 -- 172.21.15.61:0/4069443373 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c0017f0 con 0x7fdf440ce750 2023-12-24T20:08:14.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4159a700 1 -- 172.21.15.61:0/4069443373 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf38011420 con 0x7fdf440ce750 2023-12-24T20:08:14.366 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.364+0000 7fdf4159a700 1 -- 172.21.15.61:0/4069443373 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf380117c0 con 0x7fdf440ce750 2023-12-24T20:08:14.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.365+0000 7fdf48bdb700 1 -- 172.21.15.61:0/4069443373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf440ce750 msgr2=0x7fdf4406f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.365+0000 7fdf48bdb700 1 --2- 172.21.15.61:0/4069443373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf440ce750 0x7fdf4406f850 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf380098e0 tx=0x7fdf380091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.365+0000 7fdf48bdb700 1 -- 172.21.15.61:0/4069443373 shutdown_connections 2023-12-24T20:08:14.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.365+0000 7fdf48bdb700 1 --2- 172.21.15.61:0/4069443373 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf440ce750 0x7fdf4406f850 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.365+0000 7fdf48bdb700 1 --2- 172.21.15.61:0/4069443373 >> v2:172.21.15.133:3300/0 conn(0x7fdf4415b590 0x7fdf440ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.365+0000 7fdf48bdb700 1 -- 172.21.15.61:0/4069443373 >> 172.21.15.61:0/4069443373 conn(0x7fdf44069760 msgr2=0x7fdf44069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.365+0000 7fdf48bdb700 1 -- 172.21.15.61:0/4069443373 shutdown_connections 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.365+0000 7fdf48bdb700 1 -- 172.21.15.61:0/4069443373 wait complete. 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.366+0000 7fdf48bdb700 1 Processor -- start 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.366+0000 7fdf48bdb700 1 -- start start 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf48bdb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf440c9500 0x7fdf44148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf48bdb700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf440ce750 0x7fdf44157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf48bdb700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf4415b590 0x7fdf440b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf48bdb700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44156e90 con 0x7fdf440ce750 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf48bdb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf441562a0 con 0x7fdf440c9500 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf48bdb700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44156560 con 0x7fdf4415b590 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf41d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf440ce750 0x7fdf44157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf41d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf440ce750 0x7fdf44157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35648/0 (socket says 172.21.15.61:35648) 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf41d9b700 1 -- 172.21.15.61:0/1952275341 learned_addr learned my addr 172.21.15.61:0/1952275341 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:14.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf4259c700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf440c9500 0x7fdf44148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf42d9d700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf4415b590 0x7fdf440b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf41d9b700 1 -- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf4415b590 msgr2=0x7fdf440b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf41d9b700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf4415b590 0x7fdf440b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf41d9b700 1 -- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf440c9500 msgr2=0x7fdf44148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf41d9b700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf440c9500 0x7fdf44148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf41d9b700 1 -- 172.21.15.61:0/1952275341 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34009420 con 0x7fdf440ce750 2023-12-24T20:08:14.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.367+0000 7fdf42d9d700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fdf4415b590 0x7fdf440b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:14.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.368+0000 7fdf41d9b700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf440ce750 0x7fdf44157320 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400ec80 tx=0x7fdf340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.371 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.368+0000 7fdf327fc700 1 -- 172.21.15.61:0/1952275341 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400c9d0 con 0x7fdf440ce750 2023-12-24T20:08:14.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.368+0000 7fdf327fc700 1 -- 172.21.15.61:0/1952275341 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3400cb30 con 0x7fdf440ce750 2023-12-24T20:08:14.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.368+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf38009420 con 0x7fdf440ce750 2023-12-24T20:08:14.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.368+0000 7fdf327fc700 1 -- 172.21.15.61:0/1952275341 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400ceb0 con 0x7fdf440ce750 2023-12-24T20:08:14.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.368+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf44156b20 con 0x7fdf440ce750 2023-12-24T20:08:14.372 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.368+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf4404c3c0 con 0x7fdf440ce750 2023-12-24T20:08:14.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.369+0000 7fdf327fc700 1 -- 172.21.15.61:0/1952275341 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fdf34013680 con 0x7fdf440ce750 2023-12-24T20:08:14.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.370+0000 7fdf327fc700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf24066f30 0x7fdf240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.370+0000 7fdf327fc700 1 -- 172.21.15.61:0/1952275341 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdf34084b70 con 0x7fdf440ce750 2023-12-24T20:08:14.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.370+0000 7fdf327fc700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] conn(0x7fdf2406cd80 0x7fdf2406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.370+0000 7fdf327fc700 1 -- 172.21.15.61:0/1952275341 --> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf2406f860 con 0x7fdf2406cd80 2023-12-24T20:08:14.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.370+0000 7fdf327fc700 1 -- 172.21.15.61:0/1952275341 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf34084e60 con 0x7fdf440ce750 2023-12-24T20:08:14.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.370+0000 7fdf42d9d700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] conn(0x7fdf2406cd80 0x7fdf2406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.370+0000 7fdf4259c700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf24066f30 0x7fdf240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.370+0000 7fdf42d9d700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] conn(0x7fdf2406cd80 0x7fdf2406f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.370+0000 7fdf4259c700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf24066f30 0x7fdf240693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdf380030c0 tx=0x7fdf38016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.371+0000 7fdf327fc700 1 -- 172.21.15.61:0/1952275341 <== osd.0 v2:172.21.15.61:6808/40393 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fdf2406f860 con 0x7fdf2406cd80 2023-12-24T20:08:14.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 --> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdf4415c2c0 con 0x7fdf2406cd80 2023-12-24T20:08:14.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf327fc700 1 -- 172.21.15.61:0/1952275341 <== osd.0 v2:172.21.15.61:6808/40393 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fdf4415c2c0 con 0x7fdf2406cd80 2023-12-24T20:08:14.384 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:08:14.384 INFO:teuthology.orchestra.run.smithi061.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-24T20:08:14.384 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:08:14.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 >> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] conn(0x7fdf2406cd80 msgr2=0x7fdf2406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.61:6808/40393,v1:172.21.15.61:6809/40393] conn(0x7fdf2406cd80 0x7fdf2406f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf24066f30 msgr2=0x7fdf240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fdf24066f30 0x7fdf240693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdf380030c0 tx=0x7fdf38016000 comp rx=0 tx=0).stop 2023-12-24T20:08:14.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf440ce750 msgr2=0x7fdf44157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 --2- 172.21.15.61:0/1952275341 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf440ce750 0x7fdf44157320 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400ec80 tx=0x7fdf340091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf42d9d700 1 -- 172.21.15.61:0/1952275341 reap_dead start 2023-12-24T20:08:14.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 shutdown_connections 2023-12-24T20:08:14.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 >> 172.21.15.61:0/1952275341 conn(0x7fdf44069760 msgr2=0x7fdf440b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:14.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 shutdown_connections 2023-12-24T20:08:14.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.384+0000 7fdf48bdb700 1 -- 172.21.15.61:0/1952275341 wait complete. 2023-12-24T20:08:14.396 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-24T20:08:14.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.519+0000 7f9abc27d700 1 Processor -- start 2023-12-24T20:08:14.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.519+0000 7f9abc27d700 1 -- start start 2023-12-24T20:08:14.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.520+0000 7f9abc27d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab40ce3e0 0x7f9ab40ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.520+0000 7f9abc27d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab4158350 con 0x7f9ab40ce010 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.520+0000 7f9abc27d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab40ca740 con 0x7f9ab4069f00 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.520+0000 7f9abc27d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4158ef0 con 0x7f9ab40ce3e0 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9aba019700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9ab40ce010 0x7f9ab41587e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34384/0 (socket says 172.21.15.61:34384) 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9aba019700 1 -- 172.21.15.61:0/2000433197 learned_addr learned my addr 172.21.15.61:0/2000433197 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9818700 1 --2- 172.21.15.61:0/2000433197 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab40ce3e0 0x7f9ab40ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9017700 1 -- 172.21.15.61:0/2000433197 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970830713 0 0) 0x7f9ab4158350 con 0x7f9ab40ce010 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9017700 1 -- 172.21.15.61:0/2000433197 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aa0003570 con 0x7f9ab40ce010 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9017700 1 -- 172.21.15.61:0/2000433197 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959004536 0 0) 0x7f9ab40ca740 con 0x7f9ab4069f00 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9818700 1 -- 172.21.15.61:0/2000433197 >> v1:172.21.15.133:6789/0 conn(0x7f9ab4069f00 legacy=0x7f9ab40cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9818700 1 -- 172.21.15.61:0/2000433197 >> v1:172.21.15.61:6789/0 conn(0x7f9ab40ce010 legacy=0x7f9ab41587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9818700 1 -- 172.21.15.61:0/2000433197 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40b1120 con 0x7f9ab40ce3e0 2023-12-24T20:08:14.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9818700 1 --2- 172.21.15.61:0/2000433197 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab40ce3e0 0x7f9ab40ca200 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009910 tx=0x7f9ab00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5239fc41711483e server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.523 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9017700 1 -- 172.21.15.61:0/2000433197 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000b680 con 0x7f9ab40ce3e0 2023-12-24T20:08:14.523 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9017700 1 -- 172.21.15.61:0/2000433197 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000b7e0 con 0x7f9ab40ce3e0 2023-12-24T20:08:14.523 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.521+0000 7f9ab9017700 1 -- 172.21.15.61:0/2000433197 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000bba0 con 0x7f9ab40ce3e0 2023-12-24T20:08:14.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.522+0000 7f9abc27d700 1 -- 172.21.15.61:0/2000433197 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab40ce3e0 msgr2=0x7f9ab40ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.522+0000 7f9abc27d700 1 --2- 172.21.15.61:0/2000433197 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab40ce3e0 0x7f9ab40ca200 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009910 tx=0x7f9ab00091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.522+0000 7f9abc27d700 1 -- 172.21.15.61:0/2000433197 shutdown_connections 2023-12-24T20:08:14.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.522+0000 7f9abc27d700 1 --2- 172.21.15.61:0/2000433197 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab40ce3e0 0x7f9ab40ca200 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.522+0000 7f9abc27d700 1 -- 172.21.15.61:0/2000433197 >> 172.21.15.61:0/2000433197 conn(0x7f9ab406b790 msgr2=0x7f9ab4069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:14.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.522+0000 7f9abc27d700 1 -- 172.21.15.61:0/2000433197 shutdown_connections 2023-12-24T20:08:14.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.522+0000 7f9abc27d700 1 -- 172.21.15.61:0/2000433197 wait complete. 2023-12-24T20:08:14.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.524+0000 7f9abc27d700 1 Processor -- start 2023-12-24T20:08:14.524 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.524+0000 7f9abc27d700 1 -- start start 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9abc27d700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab4069f00 0x7f9ab4156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9abc27d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ab40ce010 0x7f9ab415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9abc27d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab40ce3e0 0x7f9ab4169e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9abc27d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab40c5e80 con 0x7f9ab40ce010 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9abc27d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab40b2780 con 0x7f9ab40ce3e0 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9abc27d700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab41573e0 con 0x7f9ab4069f00 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9ab9818700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ab40ce010 0x7f9ab415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9ab9818700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ab40ce010 0x7f9ab415b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35664/0 (socket says 172.21.15.61:35664) 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9ab9818700 1 -- 172.21.15.61:0/2275448172 learned_addr learned my addr 172.21.15.61:0/2275448172 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9aba019700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab4069f00 0x7f9ab4156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9aba81a700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab40ce3e0 0x7f9ab4169e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9ab9818700 1 -- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab4069f00 msgr2=0x7f9ab4156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9ab9818700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab4069f00 0x7f9ab4156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9ab9818700 1 -- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab40ce3e0 msgr2=0x7f9ab4169e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9ab9818700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab40ce3e0 0x7f9ab4169e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9ab9818700 1 -- 172.21.15.61:0/2275448172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0009420 con 0x7f9ab40ce010 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9aba81a700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab40ce3e0 0x7f9ab4169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9ab9818700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ab40ce010 0x7f9ab415b6a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4064b60 tx=0x7f9ab0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9aaa7fc700 1 -- 172.21.15.61:0/2275448172 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000bb60 con 0x7f9ab40ce010 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9aaa7fc700 1 -- 172.21.15.61:0/2275448172 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0027450 con 0x7f9ab40ce010 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9abc27d700 1 -- 172.21.15.61:0/2275448172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab40c8650 con 0x7f9ab40ce010 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9aaa7fc700 1 -- 172.21.15.61:0/2275448172 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0027810 con 0x7f9ab40ce010 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.525+0000 7f9abc27d700 1 -- 172.21.15.61:0/2275448172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab40c8980 con 0x7f9ab40ce010 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.526+0000 7f9abc27d700 1 -- 172.21.15.61:0/2275448172 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab40b2930 con 0x7f9ab40ce010 2023-12-24T20:08:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.527+0000 7f9aaa7fc700 1 -- 172.21.15.61:0/2275448172 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f9ab0027b80 con 0x7f9ab40ce010 2023-12-24T20:08:14.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.527+0000 7f9aaa7fc700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9a98066f30 0x7f9a980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.527+0000 7f9aaa7fc700 1 -- 172.21.15.61:0/2275448172 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9ab00861f0 con 0x7f9ab40ce010 2023-12-24T20:08:14.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.527+0000 7f9aba019700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9a98066f30 0x7f9a980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.528+0000 7f9aba019700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9a98066f30 0x7f9a980693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40058d0 tx=0x7f9aa4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.531+0000 7f9aaa7fc700 1 -- 172.21.15.61:0/2275448172 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ab40b2930 con 0x7f9ab40ce010 2023-12-24T20:08:14.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.725+0000 7f9abc27d700 1 -- 172.21.15.61:0/2275448172 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ab40c9390 con 0x7f9a98066f30 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.725+0000 7f9aaa7fc700 1 -- 172.21.15.61:0/2275448172 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9ab40c9390 con 0x7f9a98066f30 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.727+0000 7f9abc27d700 1 -- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9a98066f30 msgr2=0x7f9a980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.727+0000 7f9abc27d700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9a98066f30 0x7f9a980693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40058d0 tx=0x7f9aa4009040 comp rx=0 tx=0).stop 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.727+0000 7f9abc27d700 1 -- 172.21.15.61:0/2275448172 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ab40ce010 msgr2=0x7f9ab415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.727+0000 7f9abc27d700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ab40ce010 0x7f9ab415b6a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4064b60 tx=0x7f9ab0017000 comp rx=0 tx=0).stop 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.727+0000 7f9abc27d700 1 -- 172.21.15.61:0/2275448172 shutdown_connections 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.727+0000 7f9abc27d700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f9ab4069f00 0x7f9ab4156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.727+0000 7f9abc27d700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f9a98066f30 0x7f9a980693e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.727+0000 7f9abc27d700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ab40ce3e0 0x7f9ab4169e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.727+0000 7f9abc27d700 1 --2- 172.21.15.61:0/2275448172 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ab40ce010 0x7f9ab415b6a0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.727+0000 7f9abc27d700 1 -- 172.21.15.61:0/2275448172 >> 172.21.15.61:0/2275448172 conn(0x7f9ab406b790 msgr2=0x7f9ab406eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:14.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.728+0000 7f9abc27d700 1 -- 172.21.15.61:0/2275448172 shutdown_connections 2023-12-24T20:08:14.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.728+0000 7f9abc27d700 1 -- 172.21.15.61:0/2275448172 wait complete. 2023-12-24T20:08:14.822 INFO:teuthology.orchestra.run.smithi061.stderr:instructed osd(s) 0 to deep-scrub 2023-12-24T20:08:14.822 INFO:tasks.ceph:Scrubbing osd.1 2023-12-24T20:08:14.822 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:08:14.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.949+0000 7f22780a6700 1 Processor -- start 2023-12-24T20:08:14.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.949+0000 7f22780a6700 1 -- start start 2023-12-24T20:08:14.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.950+0000 7f22780a6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f227006f540 0x7f227006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.950+0000 7f22780a6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2270157ec0 con 0x7f227006b2c0 2023-12-24T20:08:14.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.950+0000 7f22780a6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227015c1b0 con 0x7f2270158be0 2023-12-24T20:08:14.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.950+0000 7f22780a6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22700b03a0 con 0x7f227006f540 2023-12-24T20:08:14.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.950+0000 7f2276643700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f227006b2c0 0x7f227015b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34398/0 (socket says 172.21.15.61:34398) 2023-12-24T20:08:14.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.950+0000 7f2276643700 1 -- 172.21.15.61:0/203645261 learned_addr learned my addr 172.21.15.61:0/203645261 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:14.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2275e42700 1 --2- 172.21.15.61:0/203645261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f227006f540 0x7f227006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2274e40700 1 -- 172.21.15.61:0/203645261 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530207318 0 0) 0x7f2268001490 con 0x7f227006b2c0 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2274e40700 1 -- 172.21.15.61:0/203645261 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f225c003570 con 0x7f227006b2c0 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2274e40700 1 -- 172.21.15.61:0/203645261 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144665587 0 0) 0x7f227015c1b0 con 0x7f2270158be0 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2274e40700 1 -- 172.21.15.61:0/203645261 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2268001490 con 0x7f2270158be0 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2275e42700 1 -- 172.21.15.61:0/203645261 >> v1:172.21.15.133:6789/0 conn(0x7f2270158be0 legacy=0x7f227006abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2274e40700 1 -- 172.21.15.61:0/203645261 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924770187 0 0) 0x7f225c003570 con 0x7f227006b2c0 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2275e42700 1 -- 172.21.15.61:0/203645261 >> v1:172.21.15.61:6789/0 conn(0x7f227006b2c0 legacy=0x7f227015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2275e42700 1 -- 172.21.15.61:0/203645261 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270158100 con 0x7f227006f540 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2275e42700 1 --2- 172.21.15.61:0/203645261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f227006f540 0x7f227006f910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2260009910 tx=0x7f22600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41ee732893dc4d6f server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2274e40700 1 -- 172.21.15.61:0/203645261 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268001980 con 0x7f227006f540 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2274e40700 1 -- 172.21.15.61:0/203645261 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2260011420 con 0x7f227006f540 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.951+0000 7f2274e40700 1 -- 172.21.15.61:0/203645261 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22600117c0 con 0x7f227006f540 2023-12-24T20:08:14.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.952+0000 7f22780a6700 1 -- 172.21.15.61:0/203645261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f227006f540 msgr2=0x7f227006f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.952+0000 7f22780a6700 1 --2- 172.21.15.61:0/203645261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f227006f540 0x7f227006f910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2260009910 tx=0x7f22600091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.952+0000 7f22780a6700 1 -- 172.21.15.61:0/203645261 shutdown_connections 2023-12-24T20:08:14.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.952+0000 7f22780a6700 1 --2- 172.21.15.61:0/203645261 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f227006f540 0x7f227006f910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.952+0000 7f22780a6700 1 -- 172.21.15.61:0/203645261 >> 172.21.15.61:0/203645261 conn(0x7f22700ce7d0 msgr2=0x7f22700cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:14.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.952+0000 7f22780a6700 1 -- 172.21.15.61:0/203645261 shutdown_connections 2023-12-24T20:08:14.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.952+0000 7f22780a6700 1 -- 172.21.15.61:0/203645261 wait complete. 2023-12-24T20:08:14.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.953+0000 7f22780a6700 1 Processor -- start 2023-12-24T20:08:14.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.953+0000 7f22780a6700 1 -- start start 2023-12-24T20:08:14.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f22780a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f227006b2c0 0x7f2270148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f22780a6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f227006f540 0x7f227016b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f22780a6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2270158be0 0x7f227016b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f22780a6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22700c2740 con 0x7f227006f540 2023-12-24T20:08:14.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f22780a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2270156e50 con 0x7f227006b2c0 2023-12-24T20:08:14.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f22780a6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2270156520 con 0x7f2270158be0 2023-12-24T20:08:14.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2275641700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f227006f540 0x7f227016b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2275641700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f227006f540 0x7f227016b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35670/0 (socket says 172.21.15.61:35670) 2023-12-24T20:08:14.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2275641700 1 -- 172.21.15.61:0/3259374882 learned_addr learned my addr 172.21.15.61:0/3259374882 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:14.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2275e42700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f227006b2c0 0x7f2270148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2276643700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2270158be0 0x7f227016b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2275641700 1 -- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2270158be0 msgr2=0x7f227016b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2275641700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2270158be0 0x7f227016b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2275641700 1 -- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f227006b2c0 msgr2=0x7f2270148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2275641700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f227006b2c0 0x7f2270148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2275641700 1 -- 172.21.15.61:0/3259374882 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2260009420 con 0x7f227006f540 2023-12-24T20:08:14.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2276643700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f2270158be0 0x7f227016b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.954+0000 7f2275641700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f227006f540 0x7f227016b130 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c590 tx=0x7f226c007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.955+0000 7f2265ffb700 1 -- 172.21.15.61:0/3259374882 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c010690 con 0x7f227006f540 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.955+0000 7f2265ffb700 1 -- 172.21.15.61:0/3259374882 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c010810 con 0x7f227006f540 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.955+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2270156800 con 0x7f227006f540 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.955+0000 7f2265ffb700 1 -- 172.21.15.61:0/3259374882 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c010bd0 con 0x7f227006f540 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.955+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22700b4340 con 0x7f227006f540 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.955+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f227004c3c0 con 0x7f227006f540 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.956+0000 7f2265ffb700 1 -- 172.21.15.61:0/3259374882 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f226c002030 con 0x7f227006f540 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.956+0000 7f2265ffb700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2254066f30 0x7f22540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.957+0000 7f2265ffb700 1 -- 172.21.15.61:0/3259374882 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f226c083860 con 0x7f227006f540 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.957+0000 7f2265ffb700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] conn(0x7f225406cd80 0x7f225406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.957+0000 7f2265ffb700 1 -- 172.21.15.61:0/3259374882 --> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f225406f860 con 0x7f225406cd80 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.957+0000 7f2265ffb700 1 -- 172.21.15.61:0/3259374882 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7f226c088240 con 0x7f227006f540 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.957+0000 7f2275e42700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2254066f30 0x7f22540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.957+0000 7f2276643700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] conn(0x7f225406cd80 0x7f225406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:14.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.957+0000 7f2276643700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] conn(0x7f225406cd80 0x7f225406f190 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.957+0000 7f2275e42700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2254066f30 0x7f22540693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f22600091e0 tx=0x7f2260016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:14.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.958+0000 7f2265ffb700 1 -- 172.21.15.61:0/3259374882 <== osd.1 v2:172.21.15.61:6816/40391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f225406f860 con 0x7f225406cd80 2023-12-24T20:08:14.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 --> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22701583e0 con 0x7f225406cd80 2023-12-24T20:08:14.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f2265ffb700 1 -- 172.21.15.61:0/3259374882 <== osd.1 v2:172.21.15.61:6816/40391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f22701583e0 con 0x7f225406cd80 2023-12-24T20:08:14.971 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:08:14.971 INFO:teuthology.orchestra.run.smithi061.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-24T20:08:14.972 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:08:14.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 >> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] conn(0x7f225406cd80 msgr2=0x7f225406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.61:6816/40391,v1:172.21.15.61:6817/40391] conn(0x7f225406cd80 0x7f225406f190 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2254066f30 msgr2=0x7f22540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2254066f30 0x7f22540693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f22600091e0 tx=0x7f2260016000 comp rx=0 tx=0).stop 2023-12-24T20:08:14.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f227006f540 msgr2=0x7f227016b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:14.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 --2- 172.21.15.61:0/3259374882 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f227006f540 0x7f227016b130 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c590 tx=0x7f226c007da0 comp rx=0 tx=0).stop 2023-12-24T20:08:14.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f2276643700 1 -- 172.21.15.61:0/3259374882 reap_dead start 2023-12-24T20:08:14.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 shutdown_connections 2023-12-24T20:08:14.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 >> 172.21.15.61:0/3259374882 conn(0x7f22700ce7d0 msgr2=0x7f22700cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:14.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 shutdown_connections 2023-12-24T20:08:14.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:14.971+0000 7f22780a6700 1 -- 172.21.15.61:0/3259374882 wait complete. 2023-12-24T20:08:14.984 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-24T20:08:15.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.106+0000 7fcc3aa7e700 1 Processor -- start 2023-12-24T20:08:15.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.106+0000 7fcc3aa7e700 1 -- start start 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3aa7e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcc340ce010 0x7fcc340ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3aa7e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc340ce3e0 0x7fcc341587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3aa7e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc34158350 con 0x7fcc34069f00 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3aa7e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc340ca740 con 0x7fcc340ce010 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3aa7e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc340b1120 con 0x7fcc340ce3e0 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3881a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcc340ce010 0x7fcc340ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3901b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fcc34069f00 0x7fcc340cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34404/0 (socket says 172.21.15.61:34404) 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3901b700 1 -- 172.21.15.61:0/143641953 learned_addr learned my addr 172.21.15.61:0/143641953 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc33fff700 1 --2- 172.21.15.61:0/143641953 >> v2:172.21.15.133:3300/0 conn(0x7fcc340ce3e0 0x7fcc341587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3881a700 1 -- 172.21.15.61:0/143641953 >> v2:172.21.15.133:3300/0 conn(0x7fcc340ce3e0 msgr2=0x7fcc341587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3881a700 1 --2- 172.21.15.61:0/143641953 >> v2:172.21.15.133:3300/0 conn(0x7fcc340ce3e0 0x7fcc341587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3881a700 1 -- 172.21.15.61:0/143641953 >> v1:172.21.15.61:6789/0 conn(0x7fcc34069f00 legacy=0x7fcc340cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3881a700 1 -- 172.21.15.61:0/143641953 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc340ca990 con 0x7fcc340ce010 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc337fe700 1 -- 172.21.15.61:0/143641953 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262280649 0 0) 0x7fcc34158350 con 0x7fcc34069f00 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc3881a700 1 --2- 172.21.15.61:0/143641953 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 0x7fcc340ca200 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fcc340c5870 tx=0x7fcc280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577d435963ada4b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.108+0000 7fcc337fe700 1 -- 172.21.15.61:0/143641953 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800b6b0 con 0x7fcc340ce010 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.109+0000 7fcc337fe700 1 -- 172.21.15.61:0/143641953 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2800b810 con 0x7fcc340ce010 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.109+0000 7fcc337fe700 1 -- 172.21.15.61:0/143641953 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800bbb0 con 0x7fcc340ce010 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.109+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/143641953 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 msgr2=0x7fcc340ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.109+0000 7fcc3aa7e700 1 --2- 172.21.15.61:0/143641953 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 0x7fcc340ca200 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fcc340c5870 tx=0x7fcc280091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.109+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/143641953 shutdown_connections 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.109+0000 7fcc3aa7e700 1 --2- 172.21.15.61:0/143641953 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 0x7fcc340ca200 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.109+0000 7fcc3aa7e700 1 --2- 172.21.15.61:0/143641953 >> v2:172.21.15.133:3300/0 conn(0x7fcc340ce3e0 0x7fcc341587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.109+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/143641953 >> 172.21.15.61:0/143641953 conn(0x7fcc3406b790 msgr2=0x7fcc34069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.109+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/143641953 shutdown_connections 2023-12-24T20:08:15.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.109+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/143641953 wait complete. 2023-12-24T20:08:15.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.111+0000 7fcc3aa7e700 1 Processor -- start 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.111+0000 7fcc3aa7e700 1 -- start start 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc3aa7e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc34069f00 0x7fcc34150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc3aa7e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 0x7fcc34068610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc3aa7e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ce3e0 0x7fcc34152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc3aa7e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3415acf0 con 0x7fcc340ce010 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc3aa7e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc34068b50 con 0x7fcc340ce3e0 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc3aa7e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3415a0e0 con 0x7fcc34069f00 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc33fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 0x7fcc34068610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc33fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 0x7fcc34068610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35696/0 (socket says 172.21.15.61:35696) 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc33fff700 1 -- 172.21.15.61:0/1334093292 learned_addr learned my addr 172.21.15.61:0/1334093292 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc33fff700 1 -- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc34069f00 msgr2=0x7fcc34150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc3901b700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ce3e0 0x7fcc34152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc33fff700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc34069f00 0x7fcc34150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc33fff700 1 -- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ce3e0 msgr2=0x7fcc34152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc33fff700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ce3e0 0x7fcc34152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc33fff700 1 -- 172.21.15.61:0/1334093292 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28009420 con 0x7fcc340ce010 2023-12-24T20:08:15.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc33fff700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 0x7fcc34068610 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000d890 tx=0x7fcc20008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc30ff9700 1 -- 172.21.15.61:0/1334093292 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000b600 con 0x7fcc340ce010 2023-12-24T20:08:15.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.112+0000 7fcc30ff9700 1 -- 172.21.15.61:0/1334093292 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2000b760 con 0x7fcc340ce010 2023-12-24T20:08:15.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.113+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/1334093292 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3415a3c0 con 0x7fcc340ce010 2023-12-24T20:08:15.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.113+0000 7fcc30ff9700 1 -- 172.21.15.61:0/1334093292 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000bae0 con 0x7fcc340ce010 2023-12-24T20:08:15.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.113+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/1334093292 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3415a980 con 0x7fcc340ce010 2023-12-24T20:08:15.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.113+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/1334093292 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3404c3c0 con 0x7fcc340ce010 2023-12-24T20:08:15.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.114+0000 7fcc30ff9700 1 -- 172.21.15.61:0/1334093292 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fcc2001e460 con 0x7fcc340ce010 2023-12-24T20:08:15.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.114+0000 7fcc30ff9700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc18066f30 0x7fcc180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.114+0000 7fcc30ff9700 1 -- 172.21.15.61:0/1334093292 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcc20084910 con 0x7fcc340ce010 2023-12-24T20:08:15.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.115+0000 7fcc3881a700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc18066f30 0x7fcc180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.115+0000 7fcc3881a700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc18066f30 0x7fcc180693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcc280091e0 tx=0x7fcc28017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.119+0000 7fcc30ff9700 1 -- 172.21.15.61:0/1334093292 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc20051e80 con 0x7fcc340ce010 2023-12-24T20:08:15.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.314+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/1334093292 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc3415ae30 con 0x7fcc18066f30 2023-12-24T20:08:15.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.314+0000 7fcc30ff9700 1 -- 172.21.15.61:0/1334093292 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcc3415ae30 con 0x7fcc18066f30 2023-12-24T20:08:15.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.316+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc18066f30 msgr2=0x7fcc180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.316+0000 7fcc3aa7e700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc18066f30 0x7fcc180693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcc280091e0 tx=0x7fcc28017000 comp rx=0 tx=0).stop 2023-12-24T20:08:15.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.316+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/1334093292 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 msgr2=0x7fcc34068610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.316+0000 7fcc3aa7e700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 0x7fcc34068610 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000d890 tx=0x7fcc20008040 comp rx=0 tx=0).stop 2023-12-24T20:08:15.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.316+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/1334093292 shutdown_connections 2023-12-24T20:08:15.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.316+0000 7fcc3aa7e700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fcc34069f00 0x7fcc34150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.316+0000 7fcc3aa7e700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fcc18066f30 0x7fcc180693e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.316+0000 7fcc3aa7e700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc340ce3e0 0x7fcc34152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.316+0000 7fcc3aa7e700 1 --2- 172.21.15.61:0/1334093292 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc340ce010 0x7fcc34068610 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.316+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/1334093292 >> 172.21.15.61:0/1334093292 conn(0x7fcc3406b790 msgr2=0x7fcc34153700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:15.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.317+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/1334093292 shutdown_connections 2023-12-24T20:08:15.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.317+0000 7fcc3aa7e700 1 -- 172.21.15.61:0/1334093292 wait complete. 2023-12-24T20:08:15.318 INFO:teuthology.orchestra.run.smithi061.stderr:instructed osd(s) 1 to deep-scrub 2023-12-24T20:08:15.329 INFO:tasks.ceph:Scrubbing osd.2 2023-12-24T20:08:15.329 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:08:15.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.455+0000 7fb062bf8700 1 Processor -- start 2023-12-24T20:08:15.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.455+0000 7fb062bf8700 1 -- start start 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.455+0000 7fb062bf8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb05c159af0 0x7fb05c0c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.455+0000 7fb062bf8700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05c06e740 con 0x7fb05c0c9890 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.455+0000 7fb062bf8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05c06de10 con 0x7fb05c159ec0 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.455+0000 7fb062bf8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05c06e0f0 con 0x7fb05c159af0 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb061195700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb05c0c9890 0x7fb05c0afc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34420/0 (socket says 172.21.15.61:34420) 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb061195700 1 -- 172.21.15.61:0/892458175 learned_addr learned my addr 172.21.15.61:0/892458175 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb060994700 1 --2- 172.21.15.61:0/892458175 >> v2:172.21.15.133:3300/0 conn(0x7fb05c159af0 0x7fb05c0c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb05b7fe700 1 -- 172.21.15.61:0/892458175 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136124641 0 0) 0x7fb05c06e740 con 0x7fb05c0c9890 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb05b7fe700 1 -- 172.21.15.61:0/892458175 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb04c003570 con 0x7fb05c0c9890 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb060994700 1 -- 172.21.15.61:0/892458175 >> v1:172.21.15.133:6789/0 conn(0x7fb05c159ec0 legacy=0x7fb05c0c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb060994700 1 -- 172.21.15.61:0/892458175 >> v1:172.21.15.61:6789/0 conn(0x7fb05c0c9890 legacy=0x7fb05c0afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb05b7fe700 1 -- 172.21.15.61:0/892458175 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445937850 0 0) 0x7fb05c06de10 con 0x7fb05c159ec0 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb060994700 1 -- 172.21.15.61:0/892458175 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c06e3d0 con 0x7fb05c159af0 2023-12-24T20:08:15.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb060994700 1 --2- 172.21.15.61:0/892458175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb05c159af0 0x7fb05c0c8f70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb0500098e0 tx=0x7fb0500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=650a15cade129beb server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb05b7fe700 1 -- 172.21.15.61:0/892458175 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000b640 con 0x7fb05c159af0 2023-12-24T20:08:15.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb05b7fe700 1 -- 172.21.15.61:0/892458175 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05000b7a0 con 0x7fb05c159af0 2023-12-24T20:08:15.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.456+0000 7fb05b7fe700 1 -- 172.21.15.61:0/892458175 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000bb40 con 0x7fb05c159af0 2023-12-24T20:08:15.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.457+0000 7fb062bf8700 1 -- 172.21.15.61:0/892458175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb05c159af0 msgr2=0x7fb05c0c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.457+0000 7fb062bf8700 1 --2- 172.21.15.61:0/892458175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb05c159af0 0x7fb05c0c8f70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb0500098e0 tx=0x7fb0500091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.457+0000 7fb062bf8700 1 -- 172.21.15.61:0/892458175 shutdown_connections 2023-12-24T20:08:15.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.457+0000 7fb062bf8700 1 --2- 172.21.15.61:0/892458175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb05c159af0 0x7fb05c0c8f70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.457+0000 7fb062bf8700 1 -- 172.21.15.61:0/892458175 >> 172.21.15.61:0/892458175 conn(0x7fb05c067550 msgr2=0x7fb05c067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.457+0000 7fb062bf8700 1 -- 172.21.15.61:0/892458175 shutdown_connections 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.457+0000 7fb062bf8700 1 -- 172.21.15.61:0/892458175 wait complete. 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.458+0000 7fb062bf8700 1 Processor -- start 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.458+0000 7fb062bf8700 1 -- start start 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb062bf8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb05c0c9890 0x7fb05c0c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb062bf8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb05c159af0 0x7fb05c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb062bf8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb05c159ec0 0x7fb05c0c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb062bf8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c15c0a0 con 0x7fb05c159af0 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb062bf8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c15b490 con 0x7fb05c159ec0 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb062bf8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c15b770 con 0x7fb05c0c9890 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb05bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb05c159af0 0x7fb05c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb05bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb05c159af0 0x7fb05c156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35702/0 (socket says 172.21.15.61:35702) 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb05bfff700 1 -- 172.21.15.61:0/618457771 learned_addr learned my addr 172.21.15.61:0/618457771 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb061195700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb05c159ec0 0x7fb05c0c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb060994700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb05c0c9890 0x7fb05c0c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb05bfff700 1 -- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb05c0c9890 msgr2=0x7fb05c0c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb05bfff700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fb05c0c9890 0x7fb05c0c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb05bfff700 1 -- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb05c159ec0 msgr2=0x7fb05c0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb05bfff700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb05c159ec0 0x7fb05c0c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.459+0000 7fb05bfff700 1 -- 172.21.15.61:0/618457771 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050009420 con 0x7fb05c159af0 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.460+0000 7fb05bfff700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb05c159af0 0x7fb05c156560 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fb04800c530 tx=0x7fb04800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.460+0000 7fb058ff9700 1 -- 172.21.15.61:0/618457771 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048011590 con 0x7fb05c159af0 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.460+0000 7fb058ff9700 1 -- 172.21.15.61:0/618457771 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb048011710 con 0x7fb05c159af0 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.460+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05c15ba50 con 0x7fb05c159af0 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.460+0000 7fb058ff9700 1 -- 172.21.15.61:0/618457771 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048011ad0 con 0x7fb05c159af0 2023-12-24T20:08:15.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.460+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c0c7420 con 0x7fb05c159af0 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.461+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb05c04c3c0 con 0x7fb05c159af0 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.461+0000 7fb058ff9700 1 -- 172.21.15.61:0/618457771 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fb04801b3b0 con 0x7fb05c159af0 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.461+0000 7fb058ff9700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb040066f30 0x7fb0400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.462+0000 7fb058ff9700 1 -- 172.21.15.61:0/618457771 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb0480836c0 con 0x7fb05c159af0 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.462+0000 7fb058ff9700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] conn(0x7fb04006cd80 0x7fb04006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.462+0000 7fb058ff9700 1 -- 172.21.15.61:0/618457771 --> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb04006f860 con 0x7fb04006cd80 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.462+0000 7fb058ff9700 1 -- 172.21.15.61:0/618457771 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb048085ca0 con 0x7fb05c159af0 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.462+0000 7fb060994700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb040066f30 0x7fb0400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.462+0000 7fb061195700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] conn(0x7fb04006cd80 0x7fb04006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.462+0000 7fb061195700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] conn(0x7fb04006cd80 0x7fb04006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.462+0000 7fb060994700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb040066f30 0x7fb0400693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb0500093f0 tx=0x7fb050017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.463+0000 7fb058ff9700 1 -- 172.21.15.61:0/618457771 <== osd.2 v2:172.21.15.61:6800/40392 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fb04006f860 con 0x7fb04006cd80 2023-12-24T20:08:15.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.475+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 --> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb05c06db10 con 0x7fb04006cd80 2023-12-24T20:08:15.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb058ff9700 1 -- 172.21.15.61:0/618457771 <== osd.2 v2:172.21.15.61:6800/40392 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fb05c06db10 con 0x7fb04006cd80 2023-12-24T20:08:15.477 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:08:15.477 INFO:teuthology.orchestra.run.smithi061.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-24T20:08:15.477 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:08:15.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 >> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] conn(0x7fb04006cd80 msgr2=0x7fb04006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb062bf8700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.61:6800/40392,v1:172.21.15.61:6801/40392] conn(0x7fb04006cd80 0x7fb04006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb040066f30 msgr2=0x7fb0400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb062bf8700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fb040066f30 0x7fb0400693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb0500093f0 tx=0x7fb050017000 comp rx=0 tx=0).stop 2023-12-24T20:08:15.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb05c159af0 msgr2=0x7fb05c156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb062bf8700 1 --2- 172.21.15.61:0/618457771 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb05c159af0 0x7fb05c156560 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fb04800c530 tx=0x7fb04800c840 comp rx=0 tx=0).stop 2023-12-24T20:08:15.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb061195700 1 -- 172.21.15.61:0/618457771 reap_dead start 2023-12-24T20:08:15.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 shutdown_connections 2023-12-24T20:08:15.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 >> 172.21.15.61:0/618457771 conn(0x7fb05c067550 msgr2=0x7fb05c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:15.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 shutdown_connections 2023-12-24T20:08:15.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.476+0000 7fb062bf8700 1 -- 172.21.15.61:0/618457771 wait complete. 2023-12-24T20:08:15.488 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-24T20:08:15.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.610+0000 7fca97148700 1 Processor -- start 2023-12-24T20:08:15.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.610+0000 7fca97148700 1 -- start start 2023-12-24T20:08:15.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca97148700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90157870 0x7fca900cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca97148700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca90067f30 0x7fca9015be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca97148700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca900684a0 con 0x7fca900b2990 2023-12-24T20:08:15.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca97148700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca90067c40 con 0x7fca90067f30 2023-12-24T20:08:15.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca97148700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9006b120 con 0x7fca90157870 2023-12-24T20:08:15.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca956e5700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fca900b2990 0x7fca900b2db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:34432/0 (socket says 172.21.15.61:34432) 2023-12-24T20:08:15.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca956e5700 1 -- 172.21.15.61:0/1274980411 learned_addr learned my addr 172.21.15.61:0/1274980411 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca8ffff700 1 --2- 172.21.15.61:0/1274980411 >> v2:172.21.15.133:3300/0 conn(0x7fca90067f30 0x7fca9015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca94ee4700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90157870 0x7fca900cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553615154 0 0) 0x7fca900684a0 con 0x7fca900b2990 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca80003570 con 0x7fca900b2990 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 130828416 0 0) 0x7fca80003570 con 0x7fca900b2990 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90157870 msgr2=0x7fca900cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca8f7fe700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90157870 0x7fca900cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 >> v2:172.21.15.133:3300/0 conn(0x7fca90067f30 msgr2=0x7fca9015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca8f7fe700 1 --2- 172.21.15.61:0/1274980411 >> v2:172.21.15.133:3300/0 conn(0x7fca90067f30 0x7fca9015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.611+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9015c3b0 con 0x7fca900b2990 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fca880017f0 con 0x7fca900b2990 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 >> v1:172.21.15.61:6789/0 conn(0x7fca900b2990 legacy=0x7fca900b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90157870 0x7fca80003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca800040b0 0x7fca80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80004d50 0x7fca800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca90067c40 con 0x7fca800040b0 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9006b120 con 0x7fca80004d50 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8000bbf0 con 0x7fca90157870 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8ffff700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca800040b0 0x7fca80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca94ee4700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90157870 0x7fca80003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca956e5700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80004d50 0x7fca800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8ffff700 1 -- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90157870 msgr2=0x7fca80003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8ffff700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90157870 0x7fca80003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8ffff700 1 -- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80004d50 msgr2=0x7fca800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8ffff700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca80004d50 0x7fca800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8ffff700 1 -- 172.21.15.61:0/1274980411 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca80003570 con 0x7fca800040b0 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8ffff700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca800040b0 0x7fca80004810 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009c00 tx=0x7fca7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7758d74cf5dca7a server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00e710 con 0x7fca800040b0 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c00e870 con 0x7fca800040b0 2023-12-24T20:08:15.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.612+0000 7fca8f7fe700 1 -- 172.21.15.61:0/1274980411 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c00ec30 con 0x7fca800040b0 2023-12-24T20:08:15.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.613+0000 7fca97148700 1 -- 172.21.15.61:0/1274980411 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca800040b0 msgr2=0x7fca80004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.613+0000 7fca97148700 1 --2- 172.21.15.61:0/1274980411 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca800040b0 0x7fca80004810 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009c00 tx=0x7fca7c0091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.613+0000 7fca956e5700 1 -- 172.21.15.61:0/1274980411 reap_dead start 2023-12-24T20:08:15.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.613+0000 7fca97148700 1 -- 172.21.15.61:0/1274980411 shutdown_connections 2023-12-24T20:08:15.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.613+0000 7fca97148700 1 -- 172.21.15.61:0/1274980411 >> 172.21.15.61:0/1274980411 conn(0x7fca900ce220 msgr2=0x7fca900af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:15.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.613+0000 7fca97148700 1 -- 172.21.15.61:0/1274980411 shutdown_connections 2023-12-24T20:08:15.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.613+0000 7fca97148700 1 -- 172.21.15.61:0/1274980411 wait complete. 2023-12-24T20:08:15.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.614+0000 7fca97148700 1 Processor -- start 2023-12-24T20:08:15.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.614+0000 7fca97148700 1 -- start start 2023-12-24T20:08:15.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca97148700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca800040b0 0x7fca90157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca97148700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca90154870 0x7fca90149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca97148700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90154ce0 0x7fca9014a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca97148700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900cbb70 con 0x7fca90154870 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca97148700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900caf60 con 0x7fca800040b0 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca97148700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca900cb240 con 0x7fca90154ce0 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca8ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca90154870 0x7fca90149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca8ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca90154870 0x7fca90149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35724/0 (socket says 172.21.15.61:35724) 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca8ffff700 1 -- 172.21.15.61:0/3422512189 learned_addr learned my addr 172.21.15.61:0/3422512189 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca94ee4700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca800040b0 0x7fca90157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca956e5700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90154ce0 0x7fca9014a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca8ffff700 1 -- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90154ce0 msgr2=0x7fca9014a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca8ffff700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90154ce0 0x7fca9014a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca8ffff700 1 -- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca800040b0 msgr2=0x7fca90157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca8ffff700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca800040b0 0x7fca90157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.620 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.615+0000 7fca8ffff700 1 -- 172.21.15.61:0/3422512189 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca900cb520 con 0x7fca90154870 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.616+0000 7fca8ffff700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca90154870 0x7fca90149e40 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fca8000bb40 tx=0x7fca7c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.616+0000 7fca8cff9700 1 -- 172.21.15.61:0/3422512189 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c022070 con 0x7fca90154870 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.616+0000 7fca8cff9700 1 -- 172.21.15.61:0/3422512189 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c00e9e0 con 0x7fca90154870 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.616+0000 7fca97148700 1 -- 172.21.15.61:0/3422512189 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca900cb800 con 0x7fca90154870 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.616+0000 7fca8cff9700 1 -- 172.21.15.61:0/3422512189 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c01c450 con 0x7fca90154870 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.616+0000 7fca97148700 1 -- 172.21.15.61:0/3422512189 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca900cc240 con 0x7fca90154870 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.617+0000 7fca97148700 1 -- 172.21.15.61:0/3422512189 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca900cb990 con 0x7fca90154870 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.617+0000 7fca8cff9700 1 -- 172.21.15.61:0/3422512189 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fca7c01c880 con 0x7fca90154870 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.617+0000 7fca8cff9700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca74066f60 0x7fca74069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.618+0000 7fca8cff9700 1 -- 172.21.15.61:0/3422512189 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fca7c085930 con 0x7fca90154870 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.618+0000 7fca94ee4700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca74066f60 0x7fca74069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.618+0000 7fca94ee4700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca74066f60 0x7fca74069410 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fca84006f00 tx=0x7fca840091a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.622+0000 7fca8cff9700 1 -- 172.21.15.61:0/3422512189 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca7c052f50 con 0x7fca90154870 2023-12-24T20:08:15.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.817+0000 7fca97148700 1 -- 172.21.15.61:0/3422512189 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fca9004c3c0 con 0x7fca74066f60 2023-12-24T20:08:15.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.817+0000 7fca8cff9700 1 -- 172.21.15.61:0/3422512189 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fca9004c3c0 con 0x7fca74066f60 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 -- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca74066f60 msgr2=0x7fca74069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca74066f60 0x7fca74069410 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fca84006f00 tx=0x7fca840091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 -- 172.21.15.61:0/3422512189 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca90154870 msgr2=0x7fca90149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca90154870 0x7fca90149e40 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fca8000bb40 tx=0x7fca7c01a000 comp rx=0 tx=0).stop 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 -- 172.21.15.61:0/3422512189 shutdown_connections 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fca90154ce0 0x7fca9014a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fca74066f60 0x7fca74069410 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca800040b0 0x7fca90157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 --2- 172.21.15.61:0/3422512189 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fca90154870 0x7fca90149e40 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 -- 172.21.15.61:0/3422512189 >> 172.21.15.61:0/3422512189 conn(0x7fca900ce220 msgr2=0x7fca901531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:15.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 -- 172.21.15.61:0/3422512189 shutdown_connections 2023-12-24T20:08:15.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.819+0000 7fca97148700 1 -- 172.21.15.61:0/3422512189 wait complete. 2023-12-24T20:08:15.821 INFO:teuthology.orchestra.run.smithi061.stderr:instructed osd(s) 2 to deep-scrub 2023-12-24T20:08:15.832 INFO:tasks.ceph:Scrubbing osd.3 2023-12-24T20:08:15.832 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:08:15.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.958+0000 7f5c1380a700 1 Processor -- start 2023-12-24T20:08:15.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.958+0000 7f5c1380a700 1 -- start start 2023-12-24T20:08:15.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.959+0000 7f5c1380a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5c0c159a10 0x7f5c0c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.959+0000 7f5c1380a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0c159de0 0x7f5c0c0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.959+0000 7f5c1380a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0c070d50 con 0x7f5c0c06a800 2023-12-24T20:08:15.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.959+0000 7f5c1380a700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0c071290 con 0x7f5c0c159a10 2023-12-24T20:08:15.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.959+0000 7f5c1380a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c070fb0 con 0x7f5c0c159de0 2023-12-24T20:08:15.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.959+0000 7f5c115a6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5c0c159a10 0x7f5c0c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.959+0000 7f5c115a6700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5c0c159a10 0x7f5c0c0c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35740/0 (socket says 172.21.15.61:35740) 2023-12-24T20:08:15.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.959+0000 7f5c115a6700 1 -- 172.21.15.61:0/520340181 learned_addr learned my addr 172.21.15.61:0/520340181 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:15.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.959+0000 7f5c11da7700 1 --2- 172.21.15.61:0/520340181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0c159de0 0x7f5c0c0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c115a6700 1 -- 172.21.15.61:0/520340181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0c159de0 msgr2=0x7f5c0c0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c115a6700 1 --2- 172.21.15.61:0/520340181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0c159de0 0x7f5c0c0cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c115a6700 1 -- 172.21.15.61:0/520340181 >> v1:172.21.15.133:6789/0 conn(0x7f5c0c06a800 legacy=0x7f5c0c070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c115a6700 1 -- 172.21.15.61:0/520340181 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c0675f0 con 0x7f5c0c159a10 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c11da7700 1 --2- 172.21.15.61:0/520340181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0c159de0 0x7f5c0c0cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c115a6700 1 --2- 172.21.15.61:0/520340181 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c0c159a10 0x7f5c0c0c7d40 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0099b0 tx=0x7f5bfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bbca8608eb78c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c03fff700 1 -- 172.21.15.61:0/520340181 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00b860 con 0x7f5c0c159a10 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c03fff700 1 -- 172.21.15.61:0/520340181 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc00b9c0 con 0x7f5c0c159a10 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c03fff700 1 -- 172.21.15.61:0/520340181 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00bd60 con 0x7f5c0c159a10 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c1380a700 1 -- 172.21.15.61:0/520340181 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c0c159a10 msgr2=0x7f5c0c0c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.960+0000 7f5c1380a700 1 --2- 172.21.15.61:0/520340181 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c0c159a10 0x7f5c0c0c7d40 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0099b0 tx=0x7f5bfc009250 comp rx=0 tx=0).stop 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.961+0000 7f5c1380a700 1 -- 172.21.15.61:0/520340181 shutdown_connections 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.961+0000 7f5c1380a700 1 --2- 172.21.15.61:0/520340181 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0c159de0 0x7f5c0c0cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.961+0000 7f5c1380a700 1 --2- 172.21.15.61:0/520340181 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c0c159a10 0x7f5c0c0c7d40 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.961+0000 7f5c1380a700 1 -- 172.21.15.61:0/520340181 >> 172.21.15.61:0/520340181 conn(0x7f5c0c0ce180 msgr2=0x7f5c0c0ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:15.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.961+0000 7f5c1380a700 1 -- 172.21.15.61:0/520340181 shutdown_connections 2023-12-24T20:08:15.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.961+0000 7f5c1380a700 1 -- 172.21.15.61:0/520340181 wait complete. 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.962+0000 7f5c1380a700 1 Processor -- start 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.962+0000 7f5c1380a700 1 -- start start 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c1380a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c0c06a800 0x7f5c0c13e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c1380a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c0c159a10 0x7f5c0c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c1380a700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0c159de0 0x7f5c0c0c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c1380a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c13e9a0 con 0x7f5c0c06a800 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c1380a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c15c650 con 0x7f5c0c159a10 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c1380a700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c0c74d0 con 0x7f5c0c159de0 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c115a6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c0c06a800 0x7f5c0c13e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c115a6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c0c06a800 0x7f5c0c13e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35746/0 (socket says 172.21.15.61:35746) 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c115a6700 1 -- 172.21.15.61:0/1153311241 learned_addr learned my addr 172.21.15.61:0/1153311241 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c115a6700 1 -- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0c159de0 msgr2=0x7f5c0c0c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c11da7700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0c159de0 0x7f5c0c0c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c10da5700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c0c159a10 0x7f5c0c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c115a6700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f5c0c159de0 0x7f5c0c0c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c115a6700 1 -- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c0c159a10 msgr2=0x7f5c0c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c115a6700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c0c159a10 0x7f5c0c0c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c115a6700 1 -- 172.21.15.61:0/1153311241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc0094f0 con 0x7f5c0c06a800 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c115a6700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c0c06a800 0x7f5c0c13e460 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009290 tx=0x7f5bfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c017fa700 1 -- 172.21.15.61:0/1153311241 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc026480 con 0x7f5c0c06a800 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c017fa700 1 -- 172.21.15.61:0/1153311241 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc01f070 con 0x7f5c0c06a800 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c0c77b0 con 0x7f5c0c06a800 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c017fa700 1 -- 172.21.15.61:0/1153311241 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc026830 con 0x7f5c0c06a800 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.963+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c15c2e0 con 0x7f5c0c06a800 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.964+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5c0c04c3c0 con 0x7f5c0c06a800 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.965+0000 7f5c017fa700 1 -- 172.21.15.61:0/1153311241 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f5bfc026ba0 con 0x7f5c0c06a800 2023-12-24T20:08:15.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.965+0000 7f5c017fa700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5bf0066f30 0x7f5bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.965+0000 7f5c017fa700 1 -- 172.21.15.61:0/1153311241 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5bfc021070 con 0x7f5c0c06a800 2023-12-24T20:08:15.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.965+0000 7f5c017fa700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] conn(0x7f5bf006cd80 0x7f5bf006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:15.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.965+0000 7f5c017fa700 1 -- 172.21.15.61:0/1153311241 --> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5bf006f860 con 0x7f5bf006cd80 2023-12-24T20:08:15.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.965+0000 7f5c10da5700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5bf0066f30 0x7f5bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.965+0000 7f5c017fa700 1 -- 172.21.15.61:0/1153311241 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bfc088520 con 0x7f5c0c06a800 2023-12-24T20:08:15.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.965+0000 7f5c11da7700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] conn(0x7f5bf006cd80 0x7f5bf006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:15.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.966+0000 7f5c11da7700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] conn(0x7f5bf006cd80 0x7f5bf006f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.966+0000 7f5c10da5700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5bf0066f30 0x7f5bf00693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c155fd0 tx=0x7f5c08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:15.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.966+0000 7f5c017fa700 1 -- 172.21.15.61:0/1153311241 <== osd.3 v2:172.21.15.61:6824/40415 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f5bf006f860 con 0x7f5bf006cd80 2023-12-24T20:08:15.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.979+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 --> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5c0c06b870 con 0x7f5bf006cd80 2023-12-24T20:08:15.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.979+0000 7f5c017fa700 1 -- 172.21.15.61:0/1153311241 <== osd.3 v2:172.21.15.61:6824/40415 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f5c0c06b870 con 0x7f5bf006cd80 2023-12-24T20:08:15.980 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:08:15.980 INFO:teuthology.orchestra.run.smithi061.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-24T20:08:15.980 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:08:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 >> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] conn(0x7f5bf006cd80 msgr2=0x7f5bf006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c1380a700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.61:6824/40415,v1:172.21.15.61:6825/40415] conn(0x7f5bf006cd80 0x7f5bf006f190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5bf0066f30 msgr2=0x7f5bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c1380a700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5bf0066f30 0x7f5bf00693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c155fd0 tx=0x7f5c08009040 comp rx=0 tx=0).stop 2023-12-24T20:08:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c0c06a800 msgr2=0x7f5c0c13e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c1380a700 1 --2- 172.21.15.61:0/1153311241 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5c0c06a800 0x7f5c0c13e460 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009290 tx=0x7f5bfc017000 comp rx=0 tx=0).stop 2023-12-24T20:08:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c11da7700 1 -- 172.21.15.61:0/1153311241 reap_dead start 2023-12-24T20:08:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 shutdown_connections 2023-12-24T20:08:15.981 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 >> 172.21.15.61:0/1153311241 conn(0x7f5c0c0ce180 msgr2=0x7f5c0c0c8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 shutdown_connections 2023-12-24T20:08:15.982 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:15.980+0000 7f5c1380a700 1 -- 172.21.15.61:0/1153311241 wait complete. 2023-12-24T20:08:15.992 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-24T20:08:16.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.114+0000 7fe78bb00700 1 Processor -- start 2023-12-24T20:08:16.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.115+0000 7fe78bb00700 1 -- start start 2023-12-24T20:08:16.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.115+0000 7fe78bb00700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7840cafd0 0x7fe7840aa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.115+0000 7fe78bb00700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840abfb0 0x7fe7840c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.115+0000 7fe78bb00700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7840c89f0 con 0x7fe7840cb3a0 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.115+0000 7fe78bb00700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840abb90 con 0x7fe7840cafd0 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.115+0000 7fe78bb00700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840aaf10 con 0x7fe7840abfb0 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78909b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840abfb0 0x7fe7840c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78989c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7840cafd0 0x7fe7840aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78909b700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840abfb0 0x7fe7840c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:33950/0 (socket says 172.21.15.61:33950) 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78909b700 1 -- 172.21.15.61:0/3196400641 learned_addr learned my addr 172.21.15.61:0/3196400641 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78a09d700 1 --1- 172.21.15.61:0/3196400641 >> v1:172.21.15.133:6789/0 conn(0x7fe7840cb3a0 0x7fe784159700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:36838/0 (socket says 172.21.15.61:36838) 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78889a700 1 -- 172.21.15.61:0/3196400641 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174175254 0 0) 0x7fe77c001490 con 0x7fe7840cb3a0 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78889a700 1 -- 172.21.15.61:0/3196400641 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe770003570 con 0x7fe7840cb3a0 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78909b700 1 -- 172.21.15.61:0/3196400641 >> v2:172.21.15.133:3300/0 conn(0x7fe7840cafd0 msgr2=0x7fe7840aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:16.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78909b700 1 --2- 172.21.15.61:0/3196400641 >> v2:172.21.15.133:3300/0 conn(0x7fe7840cafd0 0x7fe7840aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78909b700 1 -- 172.21.15.61:0/3196400641 >> v1:172.21.15.133:6789/0 conn(0x7fe7840cb3a0 legacy=0x7fe784159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78909b700 1 -- 172.21.15.61:0/3196400641 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840ab1f0 con 0x7fe7840abfb0 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78989c700 1 --2- 172.21.15.61:0/3196400641 >> v2:172.21.15.133:3300/0 conn(0x7fe7840cafd0 0x7fe7840aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.116+0000 7fe78909b700 1 --2- 172.21.15.61:0/3196400641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840abfb0 0x7fe7840c84b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe7740099b0 tx=0x7fe774009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633b73011b0a6f52 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78889a700 1 -- 172.21.15.61:0/3196400641 <== mon.2 v2:172.21.15.133:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400b680 con 0x7fe7840abfb0 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78889a700 1 -- 172.21.15.61:0/3196400641 <== mon.2 v2:172.21.15.133:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77400b7e0 con 0x7fe7840abfb0 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78889a700 1 -- 172.21.15.61:0/3196400641 <== mon.2 v2:172.21.15.133:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400bb80 con 0x7fe7840abfb0 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78bb00700 1 -- 172.21.15.61:0/3196400641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840abfb0 msgr2=0x7fe7840c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78bb00700 1 --2- 172.21.15.61:0/3196400641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840abfb0 0x7fe7840c84b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe7740099b0 tx=0x7fe774009250 comp rx=0 tx=0).stop 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78bb00700 1 -- 172.21.15.61:0/3196400641 shutdown_connections 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78bb00700 1 --2- 172.21.15.61:0/3196400641 >> v2:172.21.15.133:3300/0 conn(0x7fe7840cafd0 0x7fe7840aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78bb00700 1 --2- 172.21.15.61:0/3196400641 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840abfb0 0x7fe7840c84b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78bb00700 1 -- 172.21.15.61:0/3196400641 >> 172.21.15.61:0/3196400641 conn(0x7fe7840cd090 msgr2=0x7fe7840cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78bb00700 1 -- 172.21.15.61:0/3196400641 shutdown_connections 2023-12-24T20:08:16.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.117+0000 7fe78bb00700 1 -- 172.21.15.61:0/3196400641 wait complete. 2023-12-24T20:08:16.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.118+0000 7fe78bb00700 1 Processor -- start 2023-12-24T20:08:16.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.118+0000 7fe78bb00700 1 -- start start 2023-12-24T20:08:16.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78bb00700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7840abfb0 0x7fe784154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78bb00700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7840cafd0 0x7fe7840c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78bb00700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840cb3a0 0x7fe78415fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78bb00700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78406b1e0 con 0x7fe7840abfb0 2023-12-24T20:08:16.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78bb00700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78406b4c0 con 0x7fe7840cafd0 2023-12-24T20:08:16.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78bb00700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78406b7a0 con 0x7fe7840cb3a0 2023-12-24T20:08:16.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78989c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7840abfb0 0x7fe784154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78989c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7840abfb0 0x7fe784154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:35752/0 (socket says 172.21.15.61:35752) 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78989c700 1 -- 172.21.15.61:0/3371023563 learned_addr learned my addr 172.21.15.61:0/3371023563 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78909b700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7840cafd0 0x7fe7840c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.119+0000 7fe78a09d700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840cb3a0 0x7fe78415fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe78989c700 1 -- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840cb3a0 msgr2=0x7fe78415fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe78989c700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840cb3a0 0x7fe78415fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe78989c700 1 -- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7840cafd0 msgr2=0x7fe7840c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe78989c700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7840cafd0 0x7fe7840c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe78989c700 1 -- 172.21.15.61:0/3371023563 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800093c0 con 0x7fe7840abfb0 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe78989c700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7840abfb0 0x7fe784154880 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe78000ec80 tx=0x7fe780009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe779ffb700 1 -- 172.21.15.61:0/3371023563 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780005a00 con 0x7fe7840abfb0 2023-12-24T20:08:16.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe779ffb700 1 -- 172.21.15.61:0/3371023563 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780005b60 con 0x7fe7840abfb0 2023-12-24T20:08:16.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe78bb00700 1 -- 172.21.15.61:0/3371023563 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7740094f0 con 0x7fe7840abfb0 2023-12-24T20:08:16.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe779ffb700 1 -- 172.21.15.61:0/3371023563 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000c850 con 0x7fe7840abfb0 2023-12-24T20:08:16.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.120+0000 7fe78bb00700 1 -- 172.21.15.61:0/3371023563 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe784154dc0 con 0x7fe7840abfb0 2023-12-24T20:08:16.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.121+0000 7fe78bb00700 1 -- 172.21.15.61:0/3371023563 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78404c3c0 con 0x7fe7840abfb0 2023-12-24T20:08:16.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.121+0000 7fe779ffb700 1 -- 172.21.15.61:0/3371023563 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe78000cbc0 con 0x7fe7840abfb0 2023-12-24T20:08:16.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.122+0000 7fe779ffb700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe768066f30 0x7fe7680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.122+0000 7fe779ffb700 1 -- 172.21.15.61:0/3371023563 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe7800846a0 con 0x7fe7840abfb0 2023-12-24T20:08:16.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.122+0000 7fe78909b700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe768066f30 0x7fe7680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.122+0000 7fe78909b700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe768066f30 0x7fe7680693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe7840ac3a0 tx=0x7fe774017000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.126+0000 7fe779ffb700 1 -- 172.21.15.61:0/3371023563 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7800556a0 con 0x7fe7840abfb0 2023-12-24T20:08:16.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.321+0000 7fe78bb00700 1 -- 172.21.15.61:0/3371023563 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7840ab4d0 con 0x7fe768066f30 2023-12-24T20:08:16.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.321+0000 7fe779ffb700 1 -- 172.21.15.61:0/3371023563 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7840ab4d0 con 0x7fe768066f30 2023-12-24T20:08:16.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.323+0000 7fe78bb00700 1 -- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe768066f30 msgr2=0x7fe7680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.323+0000 7fe78bb00700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe768066f30 0x7fe7680693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe7840ac3a0 tx=0x7fe774017000 comp rx=0 tx=0).stop 2023-12-24T20:08:16.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.323+0000 7fe78bb00700 1 -- 172.21.15.61:0/3371023563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7840abfb0 msgr2=0x7fe784154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.323+0000 7fe78bb00700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7840abfb0 0x7fe784154880 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fe78000ec80 tx=0x7fe780009120 comp rx=0 tx=0).stop 2023-12-24T20:08:16.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.324+0000 7fe78bb00700 1 -- 172.21.15.61:0/3371023563 shutdown_connections 2023-12-24T20:08:16.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.324+0000 7fe78bb00700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe7840cb3a0 0x7fe78415fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.324+0000 7fe78bb00700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe768066f30 0x7fe7680693e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.324+0000 7fe78bb00700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe7840abfb0 0x7fe784154880 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.324+0000 7fe78bb00700 1 --2- 172.21.15.61:0/3371023563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7840cafd0 0x7fe7840c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.324+0000 7fe78bb00700 1 -- 172.21.15.61:0/3371023563 >> 172.21.15.61:0/3371023563 conn(0x7fe7840cd090 msgr2=0x7fe7841576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:16.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.324+0000 7fe78bb00700 1 -- 172.21.15.61:0/3371023563 shutdown_connections 2023-12-24T20:08:16.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.324+0000 7fe78bb00700 1 -- 172.21.15.61:0/3371023563 wait complete. 2023-12-24T20:08:16.325 INFO:teuthology.orchestra.run.smithi061.stderr:instructed osd(s) 3 to deep-scrub 2023-12-24T20:08:16.336 INFO:tasks.ceph:Scrubbing osd.4 2023-12-24T20:08:16.336 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:08:16.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.461+0000 7fd6675d8700 1 Processor -- start 2023-12-24T20:08:16.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.461+0000 7fd6675d8700 1 -- start start 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.462+0000 7fd6675d8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd66006f850 0x7fd66015b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.462+0000 7fd6675d8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd6600c9500 0x7fd6600c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.462+0000 7fd6675d8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66006fcc0 con 0x7fd6600ce750 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.462+0000 7fd6675d8700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6600c8d90 con 0x7fd6600c9500 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.462+0000 7fd6675d8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66015bd00 con 0x7fd66006f850 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.462+0000 7fd665b75700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd6600c9500 0x7fd6600c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.462+0000 7fd665b75700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd6600c9500 0x7fd6600c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41458/0 (socket says 172.21.15.61:41458) 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.462+0000 7fd665b75700 1 -- 172.21.15.61:0/2929475861 learned_addr learned my addr 172.21.15.61:0/2929475861 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.463+0000 7fd664b73700 1 --2- 172.21.15.61:0/2929475861 >> v2:172.21.15.133:3300/0 conn(0x7fd66006f850 0x7fd66015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.463+0000 7fd665b75700 1 -- 172.21.15.61:0/2929475861 >> v2:172.21.15.133:3300/0 conn(0x7fd66006f850 msgr2=0x7fd66015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:16.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.463+0000 7fd665b75700 1 --2- 172.21.15.61:0/2929475861 >> v2:172.21.15.133:3300/0 conn(0x7fd66006f850 0x7fd66015b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.463+0000 7fd665b75700 1 -- 172.21.15.61:0/2929475861 >> v1:172.21.15.133:6789/0 conn(0x7fd6600ce750 legacy=0x7fd6600ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.463+0000 7fd665b75700 1 -- 172.21.15.61:0/2929475861 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66015bad0 con 0x7fd6600c9500 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.463+0000 7fd665b75700 1 --2- 172.21.15.61:0/2929475861 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6600c9500 0x7fd6600c9960 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fd6600cf860 tx=0x7fd658009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241bdff0b3a7755b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.463+0000 7fd657fff700 1 -- 172.21.15.61:0/2929475861 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65800e070 con 0x7fd6600c9500 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.463+0000 7fd657fff700 1 -- 172.21.15.61:0/2929475861 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65800ba50 con 0x7fd6600c9500 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.463+0000 7fd657fff700 1 -- 172.21.15.61:0/2929475861 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6580092e0 con 0x7fd6600c9500 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.464+0000 7fd6675d8700 1 -- 172.21.15.61:0/2929475861 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6600c9500 msgr2=0x7fd6600c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.464+0000 7fd6675d8700 1 --2- 172.21.15.61:0/2929475861 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6600c9500 0x7fd6600c9960 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fd6600cf860 tx=0x7fd658009840 comp rx=0 tx=0).stop 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.464+0000 7fd6675d8700 1 -- 172.21.15.61:0/2929475861 shutdown_connections 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.464+0000 7fd6675d8700 1 --2- 172.21.15.61:0/2929475861 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6600c9500 0x7fd6600c9960 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.464+0000 7fd6675d8700 1 --2- 172.21.15.61:0/2929475861 >> v2:172.21.15.133:3300/0 conn(0x7fd66006f850 0x7fd66015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.464+0000 7fd6675d8700 1 -- 172.21.15.61:0/2929475861 >> 172.21.15.61:0/2929475861 conn(0x7fd660069760 msgr2=0x7fd660069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.464+0000 7fd6675d8700 1 -- 172.21.15.61:0/2929475861 shutdown_connections 2023-12-24T20:08:16.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.464+0000 7fd6675d8700 1 -- 172.21.15.61:0/2929475861 wait complete. 2023-12-24T20:08:16.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.465+0000 7fd6675d8700 1 Processor -- start 2023-12-24T20:08:16.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.465+0000 7fd6675d8700 1 -- start start 2023-12-24T20:08:16.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.466+0000 7fd6675d8700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd66006f850 0x7fd660156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.466+0000 7fd6675d8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6600c9500 0x7fd6600b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.466+0000 7fd6675d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6600ce750 0x7fd6600b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.466+0000 7fd6675d8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600c6d50 con 0x7fd6600c9500 2023-12-24T20:08:16.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.466+0000 7fd6675d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600b22c0 con 0x7fd6600ce750 2023-12-24T20:08:16.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.466+0000 7fd6675d8700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600b25a0 con 0x7fd66006f850 2023-12-24T20:08:16.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd664b73700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6600c9500 0x7fd6600b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd664b73700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6600c9500 0x7fd6600b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41462/0 (socket says 172.21.15.61:41462) 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd664b73700 1 -- 172.21.15.61:0/2748447156 learned_addr learned my addr 172.21.15.61:0/2748447156 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd665b75700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6600ce750 0x7fd6600b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd665374700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd66006f850 0x7fd660156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd664b73700 1 -- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd66006f850 msgr2=0x7fd660156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd664b73700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd66006f850 0x7fd660156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd664b73700 1 -- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6600ce750 msgr2=0x7fd6600b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd664b73700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6600ce750 0x7fd6600b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd664b73700 1 -- 172.21.15.61:0/2748447156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd658009ae0 con 0x7fd6600c9500 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd665374700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fd66006f850 0x7fd660156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd664b73700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6600c9500 0x7fd6600b16e0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00d890 tx=0x7fd65c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd6557fa700 1 -- 172.21.15.61:0/2748447156 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c0125f0 con 0x7fd6600c9500 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd6557fa700 1 -- 172.21.15.61:0/2748447156 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c012750 con 0x7fd6600c9500 2023-12-24T20:08:16.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6600b2880 con 0x7fd6600c9500 2023-12-24T20:08:16.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd6557fa700 1 -- 172.21.15.61:0/2748447156 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c012ad0 con 0x7fd6600c9500 2023-12-24T20:08:16.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.467+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6601572f0 con 0x7fd6600c9500 2023-12-24T20:08:16.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.468+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6600c6b20 con 0x7fd6600c9500 2023-12-24T20:08:16.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.469+0000 7fd6557fa700 1 -- 172.21.15.61:0/2748447156 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fd65c01e460 con 0x7fd6600c9500 2023-12-24T20:08:16.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.469+0000 7fd6557fa700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd644066f30 0x7fd6440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.469+0000 7fd6557fa700 1 -- 172.21.15.61:0/2748447156 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd65c084850 con 0x7fd6600c9500 2023-12-24T20:08:16.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.469+0000 7fd6557fa700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] conn(0x7fd64406cd80 0x7fd64406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.469+0000 7fd6557fa700 1 -- 172.21.15.61:0/2748447156 --> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd64406f860 con 0x7fd64406cd80 2023-12-24T20:08:16.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.469+0000 7fd6557fa700 1 -- 172.21.15.61:0/2748447156 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd65c089240 con 0x7fd6600c9500 2023-12-24T20:08:16.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.469+0000 7fd665374700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd644066f30 0x7fd6440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.469+0000 7fd665b75700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] conn(0x7fd64406cd80 0x7fd64406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.470+0000 7fd665374700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd644066f30 0x7fd6440693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd650007fd0 tx=0x7fd650009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.470+0000 7fd665b75700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] conn(0x7fd64406cd80 0x7fd64406f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.471+0000 7fd6557fa700 1 -- 172.21.15.61:0/2748447156 <== osd.4 v2:172.21.15.133:6800/40575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fd64406f860 con 0x7fd64406cd80 2023-12-24T20:08:16.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.483+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 --> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd66004c3c0 con 0x7fd64406cd80 2023-12-24T20:08:16.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6557fa700 1 -- 172.21.15.61:0/2748447156 <== osd.4 v2:172.21.15.133:6800/40575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fd66004c3c0 con 0x7fd64406cd80 2023-12-24T20:08:16.484 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:08:16.484 INFO:teuthology.orchestra.run.smithi061.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-24T20:08:16.484 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:08:16.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] conn(0x7fd64406cd80 msgr2=0x7fd64406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6675d8700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:6800/40575,v1:172.21.15.133:6801/40575] conn(0x7fd64406cd80 0x7fd64406f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd644066f30 msgr2=0x7fd6440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6675d8700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fd644066f30 0x7fd6440693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd650007fd0 tx=0x7fd650009040 comp rx=0 tx=0).stop 2023-12-24T20:08:16.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6600c9500 msgr2=0x7fd6600b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6675d8700 1 --2- 172.21.15.61:0/2748447156 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6600c9500 0x7fd6600b16e0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00d890 tx=0x7fd65c008040 comp rx=0 tx=0).stop 2023-12-24T20:08:16.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd665b75700 1 -- 172.21.15.61:0/2748447156 reap_dead start 2023-12-24T20:08:16.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 shutdown_connections 2023-12-24T20:08:16.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 >> 172.21.15.61:0/2748447156 conn(0x7fd660069760 msgr2=0x7fd6600ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:16.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 shutdown_connections 2023-12-24T20:08:16.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.484+0000 7fd6675d8700 1 -- 172.21.15.61:0/2748447156 wait complete. 2023-12-24T20:08:16.496 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-24T20:08:16.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.619+0000 7ff25306c700 1 Processor -- start 2023-12-24T20:08:16.619 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.619+0000 7ff25306c700 1 -- start start 2023-12-24T20:08:16.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.619+0000 7ff25306c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff24c0cbe20 0x7ff24c15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.619+0000 7ff25306c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff24c151080 0x7ff24c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.619+0000 7ff25306c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24c157f60 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.619+0000 7ff25306c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c0c81f0 con 0x7ff24c0cbe20 2023-12-24T20:08:16.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.619+0000 7ff25306c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24c0677f0 con 0x7ff24c151080 2023-12-24T20:08:16.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff250e08700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff24c0cbe20 0x7ff24c15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.621 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff250e08700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff24c0cbe20 0x7ff24c15a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41474/0 (socket says 172.21.15.61:41474) 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff250e08700 1 -- 172.21.15.61:0/835113563 learned_addr learned my addr 172.21.15.61:0/835113563 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff251609700 1 --2- 172.21.15.61:0/835113563 >> v2:172.21.15.133:3300/0 conn(0x7ff24c151080 0x7ff24c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff250e08700 1 -- 172.21.15.61:0/835113563 >> v2:172.21.15.133:3300/0 conn(0x7ff24c151080 msgr2=0x7ff24c157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff250e08700 1 --2- 172.21.15.61:0/835113563 >> v2:172.21.15.133:3300/0 conn(0x7ff24c151080 0x7ff24c157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff250e08700 1 -- 172.21.15.61:0/835113563 >> v1:172.21.15.133:6789/0 conn(0x7ff24c0cc1f0 legacy=0x7ff24c150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff250e08700 1 -- 172.21.15.61:0/835113563 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24c15ab80 con 0x7ff24c0cbe20 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff250e08700 1 --2- 172.21.15.61:0/835113563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cbe20 0x7ff24c15a5a0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0ca130 tx=0x7ff240009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471cd5e5cfcb9461 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff24b7fe700 1 -- 172.21.15.61:0/835113563 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24000b820 con 0x7ff24c0cbe20 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff24b7fe700 1 -- 172.21.15.61:0/835113563 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24000b980 con 0x7ff24c0cbe20 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.620+0000 7ff24b7fe700 1 -- 172.21.15.61:0/835113563 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24000bd20 con 0x7ff24c0cbe20 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.621+0000 7ff25306c700 1 -- 172.21.15.61:0/835113563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cbe20 msgr2=0x7ff24c15a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.621+0000 7ff25306c700 1 --2- 172.21.15.61:0/835113563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cbe20 0x7ff24c15a5a0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0ca130 tx=0x7ff240009250 comp rx=0 tx=0).stop 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.621+0000 7ff25306c700 1 -- 172.21.15.61:0/835113563 shutdown_connections 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.621+0000 7ff25306c700 1 --2- 172.21.15.61:0/835113563 >> v2:172.21.15.133:3300/0 conn(0x7ff24c151080 0x7ff24c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.621+0000 7ff25306c700 1 --2- 172.21.15.61:0/835113563 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cbe20 0x7ff24c15a5a0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.622 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.621+0000 7ff25306c700 1 -- 172.21.15.61:0/835113563 >> 172.21.15.61:0/835113563 conn(0x7ff24c0cd6f0 msgr2=0x7ff24c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:16.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.621+0000 7ff25306c700 1 -- 172.21.15.61:0/835113563 shutdown_connections 2023-12-24T20:08:16.623 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.621+0000 7ff25306c700 1 -- 172.21.15.61:0/835113563 wait complete. 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.622+0000 7ff25306c700 1 Processor -- start 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.622+0000 7ff25306c700 1 -- start start 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff25306c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff24c0cbe20 0x7ff24c0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff25306c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cc1f0 0x7ff24c0b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff25306c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff24c151080 0x7ff24c14f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff25306c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c0b1a20 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff25306c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c0b2840 con 0x7ff24c0cbe20 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff25306c700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24c14fd60 con 0x7ff24c151080 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff24bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cc1f0 0x7ff24c0b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff24bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cc1f0 0x7ff24c0b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41480/0 (socket says 172.21.15.61:41480) 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff24bfff700 1 -- 172.21.15.61:0/3330360428 learned_addr learned my addr 172.21.15.61:0/3330360428 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff250e08700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff24c0cbe20 0x7ff24c0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff251609700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff24c151080 0x7ff24c14f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff24bfff700 1 -- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff24c151080 msgr2=0x7ff24c14f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff24bfff700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff24c151080 0x7ff24c14f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff24bfff700 1 -- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff24c0cbe20 msgr2=0x7ff24c0c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff24bfff700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff24c0cbe20 0x7ff24c0c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.623+0000 7ff24bfff700 1 -- 172.21.15.61:0/3330360428 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2400094f0 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.624+0000 7ff24bfff700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cc1f0 0x7ff24c0b14e0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7ff23800c5d0 tx=0x7ff238007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.624+0000 7ff248ff9700 1 -- 172.21.15.61:0/3330360428 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238011590 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.624+0000 7ff25306c700 1 -- 172.21.15.61:0/3330360428 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff24c0b1c30 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.624+0000 7ff248ff9700 1 -- 172.21.15.61:0/3330360428 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff238011710 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.624+0000 7ff248ff9700 1 -- 172.21.15.61:0/3330360428 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238011ad0 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.624+0000 7ff25306c700 1 -- 172.21.15.61:0/3330360428 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff24c0b21f0 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.626 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.625+0000 7ff25306c700 1 -- 172.21.15.61:0/3330360428 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24c04c3c0 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.625+0000 7ff248ff9700 1 -- 172.21.15.61:0/3330360428 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff23801c460 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.625+0000 7ff248ff9700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff230066f60 0x7ff230069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.626+0000 7ff248ff9700 1 -- 172.21.15.61:0/3330360428 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff238083f10 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.626+0000 7ff250e08700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff230066f60 0x7ff230069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.626+0000 7ff250e08700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff230066f60 0x7ff230069410 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0ca130 tx=0x7ff240016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.630 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.630+0000 7ff248ff9700 1 -- 172.21.15.61:0/3330360428 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff238051480 con 0x7ff24c0cc1f0 2023-12-24T20:08:16.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.822+0000 7ff25306c700 1 -- 172.21.15.61:0/3330360428 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff24c0c8bd0 con 0x7ff230066f60 2023-12-24T20:08:16.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.822+0000 7ff248ff9700 1 -- 172.21.15.61:0/3330360428 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff24c0c8bd0 con 0x7ff230066f60 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 -- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff230066f60 msgr2=0x7ff230069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff230066f60 0x7ff230069410 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff24c0ca130 tx=0x7ff240016000 comp rx=0 tx=0).stop 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 -- 172.21.15.61:0/3330360428 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cc1f0 msgr2=0x7ff24c0b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cc1f0 0x7ff24c0b14e0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7ff23800c5d0 tx=0x7ff238007f60 comp rx=0 tx=0).stop 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 -- 172.21.15.61:0/3330360428 shutdown_connections 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff24c151080 0x7ff24c14f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff230066f60 0x7ff230069410 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff24c0cbe20 0x7ff24c0c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 --2- 172.21.15.61:0/3330360428 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff24c0cc1f0 0x7ff24c0b14e0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 -- 172.21.15.61:0/3330360428 >> 172.21.15.61:0/3330360428 conn(0x7ff24c0cd6f0 msgr2=0x7ff24c1505e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 -- 172.21.15.61:0/3330360428 shutdown_connections 2023-12-24T20:08:16.825 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.824+0000 7ff25306c700 1 -- 172.21.15.61:0/3330360428 wait complete. 2023-12-24T20:08:16.826 INFO:teuthology.orchestra.run.smithi061.stderr:instructed osd(s) 4 to deep-scrub 2023-12-24T20:08:16.837 INFO:tasks.ceph:Scrubbing osd.5 2023-12-24T20:08:16.837 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:08:16.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.963+0000 7f2268af4700 1 Processor -- start 2023-12-24T20:08:16.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.963+0000 7f2268af4700 1 -- start start 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.964+0000 7f2268af4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f226415cfc0 0x7f22640ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.964+0000 7f2268af4700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22640abb50 con 0x7f22640cd5c0 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.964+0000 7f2268af4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22640abe30 con 0x7f226415d390 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.964+0000 7f2268af4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22640ac110 con 0x7f226415cfc0 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f2261d9b700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f22640cd5c0 0x7f22640aa880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51360/0 (socket says 172.21.15.61:51360) 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f2261d9b700 1 -- 172.21.15.61:0/2341944176 learned_addr learned my addr 172.21.15.61:0/2341944176 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226259c700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f226415cfc0 0x7f22640ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702825221 0 0) 0x7f22640abb50 con 0x7f22640cd5c0 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f224c003570 con 0x7f22640cd5c0 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2833227671 0 0) 0x7f224c003570 con 0x7f22640cd5c0 2023-12-24T20:08:16.971 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f226415cfc0 msgr2=0x7f22640ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f226415cfc0 0x7f22640ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 >> v1:172.21.15.133:6789/0 conn(0x7f226415d390 legacy=0x7f22640aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2264063bc0 con 0x7f22640cd5c0 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f2254001470 con 0x7f22640cd5c0 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 >> v1:172.21.15.61:6789/0 conn(0x7f22640cd5c0 legacy=0x7f22640aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f224c003a90 0x7f224c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f224c004810 0x7f224c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f226415cfc0 0x7f224c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22640ac110 con 0x7f224c003a90 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c00bb10 con 0x7f224c004810 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c00bcd0 con 0x7f226415cfc0 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.965+0000 7f226259c700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f224c003a90 0x7f224c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f2261d9b700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f224c004810 0x7f224c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f2262d9d700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f226415cfc0 0x7f224c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.972 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f226259c700 1 -- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f226415cfc0 msgr2=0x7f224c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f226259c700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f226415cfc0 0x7f224c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f226259c700 1 -- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f224c004810 msgr2=0x7f224c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f226259c700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f224c004810 0x7f224c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f226259c700 1 -- 172.21.15.61:0/2341944176 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c003570 con 0x7f224c003a90 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f2262d9d700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f226415cfc0 0x7f224c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f226259c700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f224c003a90 0x7f224c003e60 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f2258009c00 tx=0x7f22580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b56d26654c4a96b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225800e710 con 0x7f224c003a90 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225800e870 con 0x7f224c003a90 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.966+0000 7f226159a700 1 -- 172.21.15.61:0/2341944176 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225800ec30 con 0x7f224c003a90 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.967+0000 7f2268af4700 1 -- 172.21.15.61:0/2341944176 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f224c003a90 msgr2=0x7f224c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.967+0000 7f2268af4700 1 --2- 172.21.15.61:0/2341944176 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f224c003a90 0x7f224c003e60 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f2258009c00 tx=0x7f22580091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.967+0000 7f2262d9d700 1 -- 172.21.15.61:0/2341944176 reap_dead start 2023-12-24T20:08:16.973 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.967+0000 7f2268af4700 1 -- 172.21.15.61:0/2341944176 shutdown_connections 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.967+0000 7f2268af4700 1 -- 172.21.15.61:0/2341944176 >> 172.21.15.61:0/2341944176 conn(0x7f2264068020 msgr2=0x7f22640cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.967+0000 7f2268af4700 1 -- 172.21.15.61:0/2341944176 shutdown_connections 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.967+0000 7f2268af4700 1 -- 172.21.15.61:0/2341944176 wait complete. 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.968+0000 7f2268af4700 1 Processor -- start 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.968+0000 7f2268af4700 1 -- start start 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2268af4700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f224c003a90 0x7f2264147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2268af4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f226406de50 0x7f226406e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2268af4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2264169e70 0x7f226416a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2268af4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2264158710 con 0x7f2264169e70 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2268af4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226406e800 con 0x7f226406de50 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2268af4700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2264147ec0 con 0x7f224c003a90 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2262d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2264169e70 0x7f226416a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2262d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2264169e70 0x7f226416a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41502/0 (socket says 172.21.15.61:41502) 2023-12-24T20:08:16.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2262d9d700 1 -- 172.21.15.61:0/2915430375 learned_addr learned my addr 172.21.15.61:0/2915430375 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f226259c700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f224c003a90 0x7f2264147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2261d9b700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f226406de50 0x7f226406e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2262d9d700 1 -- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f224c003a90 msgr2=0x7f2264147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2262d9d700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f224c003a90 0x7f2264147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2262d9d700 1 -- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f226406de50 msgr2=0x7f226406e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2262d9d700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f226406de50 0x7f226406e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2262d9d700 1 -- 172.21.15.61:0/2915430375 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226416ab70 con 0x7f2264169e70 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2261d9b700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f226406de50 0x7f226406e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2262d9d700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2264169e70 0x7f226416a2f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f226415d760 tx=0x7f225c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f22527fc700 1 -- 172.21.15.61:0/2915430375 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c018070 con 0x7f2264169e70 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f22527fc700 1 -- 172.21.15.61:0/2915430375 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c006ba0 con 0x7f2264169e70 2023-12-24T20:08:16.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226416d630 con 0x7f2264169e70 2023-12-24T20:08:16.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.969+0000 7f22527fc700 1 -- 172.21.15.61:0/2915430375 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c013630 con 0x7f2264169e70 2023-12-24T20:08:16.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.970+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226416dbf0 con 0x7f2264169e70 2023-12-24T20:08:16.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.970+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f226416d490 con 0x7f2264169e70 2023-12-24T20:08:16.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.971+0000 7f22527fc700 1 -- 172.21.15.61:0/2915430375 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f225c003030 con 0x7f2264169e70 2023-12-24T20:08:16.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.971+0000 7f22527fc700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2244066f30 0x7f22440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.971+0000 7f22527fc700 1 -- 172.21.15.61:0/2915430375 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f225c083c80 con 0x7f2264169e70 2023-12-24T20:08:16.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.971+0000 7f22527fc700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] conn(0x7f224406cd80 0x7f224406f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:16.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.971+0000 7f22527fc700 1 -- 172.21.15.61:0/2915430375 --> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f224406f860 con 0x7f224406cd80 2023-12-24T20:08:16.977 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.971+0000 7f22527fc700 1 -- 172.21.15.61:0/2915430375 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7f225c0862c0 con 0x7f2264169e70 2023-12-24T20:08:16.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.971+0000 7f226259c700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2244066f30 0x7f22440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.972+0000 7f2261d9b700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] conn(0x7f224406cd80 0x7f224406f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:16.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.972+0000 7f226259c700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2244066f30 0x7f22440693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f226415a560 tx=0x7f225801a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.972+0000 7f2261d9b700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] conn(0x7f224406cd80 0x7f224406f190 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:16.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.973+0000 7f22527fc700 1 -- 172.21.15.61:0/2915430375 <== osd.5 v2:172.21.15.133:6824/40616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f224406f860 con 0x7f224406cd80 2023-12-24T20:08:16.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.985+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 --> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f226404c3c0 con 0x7f224406cd80 2023-12-24T20:08:16.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.986+0000 7f22527fc700 1 -- 172.21.15.61:0/2915430375 <== osd.5 v2:172.21.15.133:6824/40616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f226404c3c0 con 0x7f224406cd80 2023-12-24T20:08:16.986 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:08:16.987 INFO:teuthology.orchestra.run.smithi061.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-24T20:08:16.987 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.986+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] conn(0x7f224406cd80 msgr2=0x7f224406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.986+0000 7f2268af4700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:6824/40616,v1:172.21.15.133:6825/40616] conn(0x7f224406cd80 0x7f224406f190 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.986+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2244066f30 msgr2=0x7f22440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.987+0000 7f2268af4700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f2244066f30 0x7f22440693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f226415a560 tx=0x7f225801a000 comp rx=0 tx=0).stop 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.987+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2264169e70 msgr2=0x7f226416a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.987+0000 7f2268af4700 1 --2- 172.21.15.61:0/2915430375 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2264169e70 0x7f226416a2f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f226415d760 tx=0x7f225c009040 comp rx=0 tx=0).stop 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.987+0000 7f2262d9d700 1 -- 172.21.15.61:0/2915430375 reap_dead start 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.987+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 shutdown_connections 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.987+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 >> 172.21.15.61:0/2915430375 conn(0x7f2264068020 msgr2=0x7f226415c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.987+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 shutdown_connections 2023-12-24T20:08:16.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:16.987+0000 7f2268af4700 1 -- 172.21.15.61:0/2915430375 wait complete. 2023-12-24T20:08:16.999 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-24T20:08:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.121+0000 7fbf1131e700 1 Processor -- start 2023-12-24T20:08:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.121+0000 7fbf1131e700 1 -- start start 2023-12-24T20:08:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf1131e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 0x7fbf0c15d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf1131e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbf0c0d0560 0x7fbf0c15dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf1131e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c0d0bb0 con 0x7fbf0c1437b0 2023-12-24T20:08:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf1131e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c15b550 con 0x7fbf0c0d0560 2023-12-24T20:08:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf1131e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0d09a0 con 0x7fbf0c1433e0 2023-12-24T20:08:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf0a7fc700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fbf0c1437b0 0x7fbf0c0cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51372/0 (socket says 172.21.15.61:51372) 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf0a7fc700 1 -- 172.21.15.61:0/347067573 learned_addr learned my addr 172.21.15.61:0/347067573 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf0b7fe700 1 --2- 172.21.15.61:0/347067573 >> v2:172.21.15.61:3300/0 conn(0x7fbf0c0d0560 0x7fbf0c15dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf0affd700 1 --2- 172.21.15.61:0/347067573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 0x7fbf0c15d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf09ffb700 1 -- 172.21.15.61:0/347067573 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287360891 0 0) 0x7fbf0c0d0bb0 con 0x7fbf0c1437b0 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf09ffb700 1 -- 172.21.15.61:0/347067573 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbef8003570 con 0x7fbf0c1437b0 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf0b7fe700 1 -- 172.21.15.61:0/347067573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 msgr2=0x7fbf0c15d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf0b7fe700 1 --2- 172.21.15.61:0/347067573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 0x7fbf0c15d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf0b7fe700 1 -- 172.21.15.61:0/347067573 >> v1:172.21.15.61:6789/0 conn(0x7fbf0c1437b0 legacy=0x7fbf0c0cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf0b7fe700 1 -- 172.21.15.61:0/347067573 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c0d0e90 con 0x7fbf0c0d0560 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf0affd700 1 --2- 172.21.15.61:0/347067573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 0x7fbf0c15d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.122+0000 7fbf0b7fe700 1 --2- 172.21.15.61:0/347067573 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c0d0560 0x7fbf0c15dd90 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009e60 tx=0x7fbf04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3767820bfe8281 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf09ffb700 1 -- 172.21.15.61:0/347067573 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0400e070 con 0x7fbf0c0d0560 2023-12-24T20:08:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf09ffb700 1 -- 172.21.15.61:0/347067573 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400bb60 con 0x7fbf0c0d0560 2023-12-24T20:08:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf09ffb700 1 -- 172.21.15.61:0/347067573 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04012430 con 0x7fbf0c0d0560 2023-12-24T20:08:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf1131e700 1 -- 172.21.15.61:0/347067573 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c0d0560 msgr2=0x7fbf0c15dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf1131e700 1 --2- 172.21.15.61:0/347067573 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c0d0560 0x7fbf0c15dd90 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fbf04009e60 tx=0x7fbf04009780 comp rx=0 tx=0).stop 2023-12-24T20:08:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf1131e700 1 -- 172.21.15.61:0/347067573 shutdown_connections 2023-12-24T20:08:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf1131e700 1 --2- 172.21.15.61:0/347067573 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 0x7fbf0c15d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf1131e700 1 --2- 172.21.15.61:0/347067573 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c0d0560 0x7fbf0c15dd90 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf1131e700 1 -- 172.21.15.61:0/347067573 >> 172.21.15.61:0/347067573 conn(0x7fbf0c06e640 msgr2=0x7fbf0c067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf1131e700 1 -- 172.21.15.61:0/347067573 shutdown_connections 2023-12-24T20:08:17.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.123+0000 7fbf1131e700 1 -- 172.21.15.61:0/347067573 wait complete. 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.124+0000 7fbf1131e700 1 Processor -- start 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.124+0000 7fbf1131e700 1 -- start start 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf1131e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf0c0d0560 0x7fbf0c0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf1131e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 0x7fbf0c139730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf1131e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c1437b0 0x7fbf0c16d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf1131e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c138b90 con 0x7fbf0c1437b0 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf1131e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c16b620 con 0x7fbf0c0d0560 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf1131e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c13a0f0 con 0x7fbf0c1433e0 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf0b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c1437b0 0x7fbf0c16d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf0b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c1437b0 0x7fbf0c16d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41512/0 (socket says 172.21.15.61:41512) 2023-12-24T20:08:17.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf0b7fe700 1 -- 172.21.15.61:0/1212271482 learned_addr learned my addr 172.21.15.61:0/1212271482 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf0affd700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf0c0d0560 0x7fbf0c0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.125+0000 7fbf0a7fc700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 0x7fbf0c139730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf0b7fe700 1 -- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 msgr2=0x7fbf0c139730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf0b7fe700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 0x7fbf0c139730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf0b7fe700 1 -- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf0c0d0560 msgr2=0x7fbf0c0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf0b7fe700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf0c0d0560 0x7fbf0c0cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf0b7fe700 1 -- 172.21.15.61:0/1212271482 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf04009a20 con 0x7fbf0c1437b0 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf0b7fe700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c1437b0 0x7fbf0c16d8c0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400b6c0 tx=0x7fbf04019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf02ffd700 1 -- 172.21.15.61:0/1212271482 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04027470 con 0x7fbf0c1437b0 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf02ffd700 1 -- 172.21.15.61:0/1212271482 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf040275f0 con 0x7fbf0c1437b0 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf1131e700 1 -- 172.21.15.61:0/1212271482 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c13a3d0 con 0x7fbf0c1437b0 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf02ffd700 1 -- 172.21.15.61:0/1212271482 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf040279b0 con 0x7fbf0c1437b0 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.126+0000 7fbf1131e700 1 -- 172.21.15.61:0/1212271482 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c15a870 con 0x7fbf0c1437b0 2023-12-24T20:08:17.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.127+0000 7fbf1131e700 1 -- 172.21.15.61:0/1212271482 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c16b900 con 0x7fbf0c1437b0 2023-12-24T20:08:17.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.128+0000 7fbf02ffd700 1 -- 172.21.15.61:0/1212271482 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fbf04024070 con 0x7fbf0c1437b0 2023-12-24T20:08:17.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.128+0000 7fbf02ffd700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbeec066f30 0x7fbeec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.128+0000 7fbf02ffd700 1 -- 172.21.15.61:0/1212271482 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbf04086a80 con 0x7fbf0c1437b0 2023-12-24T20:08:17.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.128+0000 7fbf0affd700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbeec066f30 0x7fbeec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.129+0000 7fbf0affd700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbeec066f30 0x7fbeec0693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbef4006f00 tx=0x7fbef4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.132+0000 7fbf02ffd700 1 -- 172.21.15.61:0/1212271482 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf04053ff0 con 0x7fbf0c1437b0 2023-12-24T20:08:17.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.326+0000 7fbf1131e700 1 -- 172.21.15.61:0/1212271482 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf0c16b3d0 con 0x7fbeec066f30 2023-12-24T20:08:17.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.328+0000 7fbf02ffd700 1 -- 172.21.15.61:0/1212271482 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbf0c16b3d0 con 0x7fbeec066f30 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 -- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbeec066f30 msgr2=0x7fbeec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbeec066f30 0x7fbeec0693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbef4006f00 tx=0x7fbef4008040 comp rx=0 tx=0).stop 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 -- 172.21.15.61:0/1212271482 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c1437b0 msgr2=0x7fbf0c16d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c1437b0 0x7fbf0c16d8c0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400b6c0 tx=0x7fbf04019000 comp rx=0 tx=0).stop 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 -- 172.21.15.61:0/1212271482 shutdown_connections 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fbeec066f30 0x7fbeec0693e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbf0c1437b0 0x7fbf0c16d8c0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf0c0d0560 0x7fbf0c0cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 --2- 172.21.15.61:0/1212271482 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fbf0c1433e0 0x7fbf0c139730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 -- 172.21.15.61:0/1212271482 >> 172.21.15.61:0/1212271482 conn(0x7fbf0c06e640 msgr2=0x7fbf0c15d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 -- 172.21.15.61:0/1212271482 shutdown_connections 2023-12-24T20:08:17.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.329+0000 7fbf1131e700 1 -- 172.21.15.61:0/1212271482 wait complete. 2023-12-24T20:08:17.331 INFO:teuthology.orchestra.run.smithi061.stderr:instructed osd(s) 5 to deep-scrub 2023-12-24T20:08:17.341 INFO:tasks.ceph:Scrubbing osd.6 2023-12-24T20:08:17.342 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:08:17.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.467+0000 7f57b32cf700 1 Processor -- start 2023-12-24T20:08:17.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.468+0000 7f57b32cf700 1 -- start start 2023-12-24T20:08:17.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b32cf700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f57ac1566c0 0x7f57ac0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b32cf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57ac0cc240 0x7f57ac156a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b32cf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57ac156fd0 0x7f57ac157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b32cf700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac157da0 con 0x7f57ac1566c0 2023-12-24T20:08:17.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b32cf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac068ee0 con 0x7f57ac0cc240 2023-12-24T20:08:17.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b32cf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0682d0 con 0x7f57ac156fd0 2023-12-24T20:08:17.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b106b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f57ac1566c0 0x7f57ac0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b106b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f57ac1566c0 0x7f57ac0cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41514/0 (socket says 172.21.15.61:41514) 2023-12-24T20:08:17.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b106b700 1 -- 172.21.15.61:0/98879262 learned_addr learned my addr 172.21.15.61:0/98879262 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:17.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b086a700 1 --2- 172.21.15.61:0/98879262 >> v2:172.21.15.133:3300/0 conn(0x7f57ac0cc240 0x7f57ac156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b186c700 1 --2- 172.21.15.61:0/98879262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57ac156fd0 0x7f57ac157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b106b700 1 -- 172.21.15.61:0/98879262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57ac156fd0 msgr2=0x7f57ac157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:17.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b106b700 1 --2- 172.21.15.61:0/98879262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57ac156fd0 0x7f57ac157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b106b700 1 -- 172.21.15.61:0/98879262 >> v2:172.21.15.133:3300/0 conn(0x7f57ac0cc240 msgr2=0x7f57ac156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:17.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b106b700 1 --2- 172.21.15.61:0/98879262 >> v2:172.21.15.133:3300/0 conn(0x7f57ac0cc240 0x7f57ac156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b106b700 1 -- 172.21.15.61:0/98879262 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac0685b0 con 0x7f57ac1566c0 2023-12-24T20:08:17.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.469+0000 7f57b106b700 1 --2- 172.21.15.61:0/98879262 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57ac1566c0 0x7f57ac0cbd00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0b3770 tx=0x7f57a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3995d95c538be89b server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f579ffff700 1 -- 172.21.15.61:0/98879262 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a000f6b0 con 0x7f57ac1566c0 2023-12-24T20:08:17.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f579ffff700 1 -- 172.21.15.61:0/98879262 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a000f810 con 0x7f57ac1566c0 2023-12-24T20:08:17.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f579ffff700 1 -- 172.21.15.61:0/98879262 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a000fbd0 con 0x7f57ac1566c0 2023-12-24T20:08:17.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f57b32cf700 1 -- 172.21.15.61:0/98879262 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57ac1566c0 msgr2=0x7f57ac0cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f57b32cf700 1 --2- 172.21.15.61:0/98879262 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57ac1566c0 0x7f57ac0cbd00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0b3770 tx=0x7f57a0009250 comp rx=0 tx=0).stop 2023-12-24T20:08:17.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f57b32cf700 1 -- 172.21.15.61:0/98879262 shutdown_connections 2023-12-24T20:08:17.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f57b32cf700 1 --2- 172.21.15.61:0/98879262 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57ac156fd0 0x7f57ac157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f57b32cf700 1 --2- 172.21.15.61:0/98879262 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57ac1566c0 0x7f57ac0cbd00 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f57b32cf700 1 --2- 172.21.15.61:0/98879262 >> v2:172.21.15.133:3300/0 conn(0x7f57ac0cc240 0x7f57ac156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f57b32cf700 1 -- 172.21.15.61:0/98879262 >> 172.21.15.61:0/98879262 conn(0x7f57ac0ca1e0 msgr2=0x7f57ac0ca5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f57b32cf700 1 -- 172.21.15.61:0/98879262 shutdown_connections 2023-12-24T20:08:17.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.470+0000 7f57b32cf700 1 -- 172.21.15.61:0/98879262 wait complete. 2023-12-24T20:08:17.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.471+0000 7f57b32cf700 1 Processor -- start 2023-12-24T20:08:17.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.471+0000 7f57b32cf700 1 -- start start 2023-12-24T20:08:17.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b32cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac0cc240 0x7f57ac155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b32cf700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57ac1566c0 0x7f57ac1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b32cf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57ac156fd0 0x7f57ac14fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b32cf700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0b0510 con 0x7f57ac156fd0 2023-12-24T20:08:17.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b32cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac151be0 con 0x7f57ac0cc240 2023-12-24T20:08:17.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b32cf700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac151ec0 con 0x7f57ac1566c0 2023-12-24T20:08:17.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b186c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57ac156fd0 0x7f57ac14fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b186c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57ac156fd0 0x7f57ac14fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41516/0 (socket says 172.21.15.61:41516) 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b186c700 1 -- 172.21.15.61:0/3959724696 learned_addr learned my addr 172.21.15.61:0/3959724696 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b106b700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac0cc240 0x7f57ac155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.472+0000 7f57b086a700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57ac1566c0 0x7f57ac1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f57b186c700 1 -- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57ac1566c0 msgr2=0x7f57ac1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f57b186c700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f57ac1566c0 0x7f57ac1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f57b186c700 1 -- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac0cc240 msgr2=0x7f57ac155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f57b186c700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac0cc240 0x7f57ac155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f57b186c700 1 -- 172.21.15.61:0/3959724696 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00094f0 con 0x7f57ac156fd0 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f57b186c700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57ac156fd0 0x7f57ac14fc30 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009df0 tx=0x7f57a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f579d7fa700 1 -- 172.21.15.61:0/3959724696 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a400caa0 con 0x7f57ac156fd0 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f579d7fa700 1 -- 172.21.15.61:0/3959724696 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a400f040 con 0x7f57ac156fd0 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac0b0720 con 0x7f57ac156fd0 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f579d7fa700 1 -- 172.21.15.61:0/3959724696 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a400ce70 con 0x7f57ac156fd0 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.473+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac150170 con 0x7f57ac156fd0 2023-12-24T20:08:17.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.474+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57ac04c3c0 con 0x7f57ac156fd0 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.474+0000 7f579d7fa700 1 -- 172.21.15.61:0/3959724696 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f57a4014690 con 0x7f57ac156fd0 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.475+0000 7f579d7fa700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5790066f30 0x7f57900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.475+0000 7f579d7fa700 1 -- 172.21.15.61:0/3959724696 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f57a4084d50 con 0x7f57ac156fd0 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.475+0000 7f579d7fa700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] conn(0x7f579006cd80 0x7f579006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.475+0000 7f579d7fa700 1 -- 172.21.15.61:0/3959724696 --> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f579006f860 con 0x7f579006cd80 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.475+0000 7f579d7fa700 1 -- 172.21.15.61:0/3959724696 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57a4087390 con 0x7f57ac156fd0 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.475+0000 7f57b106b700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5790066f30 0x7f57900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.475+0000 7f57b086a700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] conn(0x7f579006cd80 0x7f579006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.475+0000 7f57b106b700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5790066f30 0x7f57900693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0b3770 tx=0x7f57a0019000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.476+0000 7f57b086a700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] conn(0x7f579006cd80 0x7f579006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.476+0000 7f579d7fa700 1 -- 172.21.15.61:0/3959724696 <== osd.6 v2:172.21.15.133:6816/40576 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7f579006f860 con 0x7f579006cd80 2023-12-24T20:08:17.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.489+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 --> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57ac152080 con 0x7f579006cd80 2023-12-24T20:08:17.489 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f579d7fa700 1 -- 172.21.15.61:0/3959724696 <== osd.6 v2:172.21.15.133:6816/40576 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7f57ac152080 con 0x7f579006cd80 2023-12-24T20:08:17.490 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:08:17.490 INFO:teuthology.orchestra.run.smithi061.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-24T20:08:17.490 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:08:17.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] conn(0x7f579006cd80 msgr2=0x7f579006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b32cf700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:6816/40576,v1:172.21.15.133:6817/40576] conn(0x7f579006cd80 0x7f579006f190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5790066f30 msgr2=0x7f57900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b32cf700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f5790066f30 0x7f57900693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0b3770 tx=0x7f57a0019000 comp rx=0 tx=0).stop 2023-12-24T20:08:17.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57ac156fd0 msgr2=0x7f57ac14fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b32cf700 1 --2- 172.21.15.61:0/3959724696 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57ac156fd0 0x7f57ac14fc30 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009df0 tx=0x7f57a400b040 comp rx=0 tx=0).stop 2023-12-24T20:08:17.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b186c700 1 -- 172.21.15.61:0/3959724696 reap_dead start 2023-12-24T20:08:17.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 shutdown_connections 2023-12-24T20:08:17.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 >> 172.21.15.61:0/3959724696 conn(0x7f57ac0ca1e0 msgr2=0x7f57ac06a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 shutdown_connections 2023-12-24T20:08:17.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.490+0000 7f57b32cf700 1 -- 172.21.15.61:0/3959724696 wait complete. 2023-12-24T20:08:17.502 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-24T20:08:17.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.624+0000 7f4f0f736700 1 Processor -- start 2023-12-24T20:08:17.625 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.625+0000 7f4f0f736700 1 -- start start 2023-12-24T20:08:17.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.625+0000 7f4f0f736700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4f08159a60 0x7f4f08068560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.625+0000 7f4f0f736700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08068aa0 0x7f4f08070950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.625+0000 7f4f0f736700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f08068f10 con 0x7f4f08070e90 2023-12-24T20:08:17.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.625+0000 7f4f0f736700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0815e360 con 0x7f4f08159a60 2023-12-24T20:08:17.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.625+0000 7f4f0f736700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0815d750 con 0x7f4f08068aa0 2023-12-24T20:08:17.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4f0d4d2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4f08159a60 0x7f4f08068560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4f0dcd3700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4f08070e90 0x7f4f080c6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51374/0 (socket says 172.21.15.61:51374) 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4f0d4d2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4f08159a60 0x7f4f08068560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41520/0 (socket says 172.21.15.61:41520) 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4f0dcd3700 1 -- 172.21.15.61:0/1228830116 learned_addr learned my addr 172.21.15.61:0/1228830116 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4f0ccd1700 1 --2- 172.21.15.61:0/1228830116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08068aa0 0x7f4f08070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4f0d4d2700 1 -- 172.21.15.61:0/1228830116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08068aa0 msgr2=0x7f4f08070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4f0d4d2700 1 --2- 172.21.15.61:0/1228830116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08068aa0 0x7f4f08070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4f0d4d2700 1 -- 172.21.15.61:0/1228830116 >> v1:172.21.15.61:6789/0 conn(0x7f4f08070e90 legacy=0x7f4f080c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4f0d4d2700 1 -- 172.21.15.61:0/1228830116 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0815da30 con 0x7f4f08159a60 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4efffff700 1 -- 172.21.15.61:0/1228830116 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906813262 0 0) 0x7f4f08068f10 con 0x7f4f08070e90 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4f0d4d2700 1 --2- 172.21.15.61:0/1228830116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08159a60 0x7f4f08068560 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80098e0 tx=0x7f4ef80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711f6acc46bd40e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4efffff700 1 -- 172.21.15.61:0/1228830116 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8009e80 con 0x7f4f08159a60 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4efffff700 1 -- 172.21.15.61:0/1228830116 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef800b860 con 0x7f4f08159a60 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.626+0000 7f4efffff700 1 -- 172.21.15.61:0/1228830116 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800bbe0 con 0x7f4f08159a60 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.627+0000 7f4f0f736700 1 -- 172.21.15.61:0/1228830116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08159a60 msgr2=0x7f4f08068560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.627+0000 7f4f0f736700 1 --2- 172.21.15.61:0/1228830116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08159a60 0x7f4f08068560 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80098e0 tx=0x7f4ef80091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.628 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.627+0000 7f4f0f736700 1 -- 172.21.15.61:0/1228830116 shutdown_connections 2023-12-24T20:08:17.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.627+0000 7f4f0f736700 1 --2- 172.21.15.61:0/1228830116 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08159a60 0x7f4f08068560 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.627+0000 7f4f0f736700 1 --2- 172.21.15.61:0/1228830116 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08068aa0 0x7f4f08070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.627+0000 7f4f0f736700 1 -- 172.21.15.61:0/1228830116 >> 172.21.15.61:0/1228830116 conn(0x7f4f080cac10 msgr2=0x7f4f0806da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.627+0000 7f4f0f736700 1 -- 172.21.15.61:0/1228830116 shutdown_connections 2023-12-24T20:08:17.629 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.627+0000 7f4f0f736700 1 -- 172.21.15.61:0/1228830116 wait complete. 2023-12-24T20:08:17.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.628+0000 7f4f0f736700 1 Processor -- start 2023-12-24T20:08:17.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.628+0000 7f4f0f736700 1 -- start start 2023-12-24T20:08:17.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0f736700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08068aa0 0x7f4f08156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0f736700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08070e90 0x7f4f080afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0f736700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f08159a60 0x7f4f080b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.631 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0f736700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080b1670 con 0x7f4f08068aa0 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0f736700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f080b0aa0 con 0x7f4f08159a60 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0f736700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08156cb0 con 0x7f4f08070e90 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0d4d2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08068aa0 0x7f4f08156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0d4d2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08068aa0 0x7f4f08156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41534/0 (socket says 172.21.15.61:41534) 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0d4d2700 1 -- 172.21.15.61:0/2329291695 learned_addr learned my addr 172.21.15.61:0/2329291695 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0ccd1700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08070e90 0x7f4f080afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0dcd3700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f08159a60 0x7f4f080b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0d4d2700 1 -- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08070e90 msgr2=0x7f4f080afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0d4d2700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08070e90 0x7f4f080afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0d4d2700 1 -- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f08159a60 msgr2=0x7f4f080b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0d4d2700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f08159a60 0x7f4f080b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.632 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0d4d2700 1 -- 172.21.15.61:0/2329291695 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8009420 con 0x7f4f08068aa0 2023-12-24T20:08:17.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0ccd1700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08070e90 0x7f4f080afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:17.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.629+0000 7f4f0dcd3700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f08159a60 0x7f4f080b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:17.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.630+0000 7f4f0d4d2700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08068aa0 0x7f4f08156770 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f4f0806d0d0 tx=0x7f4ef8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.630+0000 7f4efd7fa700 1 -- 172.21.15.61:0/2329291695 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8011420 con 0x7f4f08068aa0 2023-12-24T20:08:17.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.630+0000 7f4efd7fa700 1 -- 172.21.15.61:0/2329291695 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef80115a0 con 0x7f4f08068aa0 2023-12-24T20:08:17.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.630+0000 7f4efd7fa700 1 -- 172.21.15.61:0/2329291695 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8011960 con 0x7f4f08068aa0 2023-12-24T20:08:17.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.630+0000 7f4f0f736700 1 -- 172.21.15.61:0/2329291695 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f080b0d40 con 0x7f4f08068aa0 2023-12-24T20:08:17.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.630+0000 7f4f0f736700 1 -- 172.21.15.61:0/2329291695 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f080b1300 con 0x7f4f08068aa0 2023-12-24T20:08:17.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.631+0000 7f4f0f736700 1 -- 172.21.15.61:0/2329291695 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0804c3c0 con 0x7f4f08068aa0 2023-12-24T20:08:17.633 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.631+0000 7f4efd7fa700 1 -- 172.21.15.61:0/2329291695 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f4ef802c3b0 con 0x7f4f08068aa0 2023-12-24T20:08:17.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.632+0000 7f4efd7fa700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4eec066f30 0x7f4eec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.632+0000 7f4efd7fa700 1 -- 172.21.15.61:0/2329291695 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4ef80858e0 con 0x7f4f08068aa0 2023-12-24T20:08:17.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.632+0000 7f4f0ccd1700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4eec066f30 0x7f4eec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.632+0000 7f4f0ccd1700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4eec066f30 0x7f4eec0693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4f0816e8e0 tx=0x7f4f04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.636+0000 7f4efd7fa700 1 -- 172.21.15.61:0/2329291695 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ef8052db0 con 0x7f4f08068aa0 2023-12-24T20:08:17.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.832+0000 7f4f0f736700 1 -- 172.21.15.61:0/2329291695 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f080b17b0 con 0x7f4eec066f30 2023-12-24T20:08:17.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.833+0000 7f4efd7fa700 1 -- 172.21.15.61:0/2329291695 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4f0400f760 con 0x7f4eec066f30 2023-12-24T20:08:17.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 -- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4eec066f30 msgr2=0x7f4eec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4eec066f30 0x7f4eec0693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4f0816e8e0 tx=0x7f4f04008040 comp rx=0 tx=0).stop 2023-12-24T20:08:17.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 -- 172.21.15.61:0/2329291695 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08068aa0 msgr2=0x7f4f08156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08068aa0 0x7f4f08156770 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f4f0806d0d0 tx=0x7f4ef8017000 comp rx=0 tx=0).stop 2023-12-24T20:08:17.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 -- 172.21.15.61:0/2329291695 shutdown_connections 2023-12-24T20:08:17.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4eec066f30 0x7f4eec0693e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f08159a60 0x7f4f080b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4f08068aa0 0x7f4f08156770 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 --2- 172.21.15.61:0/2329291695 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f4f08070e90 0x7f4f080afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 -- 172.21.15.61:0/2329291695 >> 172.21.15.61:0/2329291695 conn(0x7f4f080cac10 msgr2=0x7f4f0806a410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 -- 172.21.15.61:0/2329291695 shutdown_connections 2023-12-24T20:08:17.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.835+0000 7f4f0f736700 1 -- 172.21.15.61:0/2329291695 wait complete. 2023-12-24T20:08:17.837 INFO:teuthology.orchestra.run.smithi061.stderr:instructed osd(s) 6 to deep-scrub 2023-12-24T20:08:17.848 INFO:tasks.ceph:Scrubbing osd.7 2023-12-24T20:08:17.848 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-24T20:08:17.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.974+0000 7fa894bed700 1 Processor -- start 2023-12-24T20:08:17.974 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.974+0000 7fa894bed700 1 -- start start 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.975+0000 7fa894bed700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa890159ab0 0x7fa8900af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.975+0000 7fa894bed700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8900afaf0 0x7fa8900cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.975+0000 7fa894bed700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8900cec30 con 0x7fa890159e80 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.975+0000 7fa894bed700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8900aff90 con 0x7fa8900afaf0 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.975+0000 7fa894bed700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900b0270 con 0x7fa890159ab0 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8900afaf0 0x7fa8900cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88e59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa890159ab0 0x7fa8900af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88e59c700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa890159ab0 0x7fa8900af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:60600/0 (socket says 172.21.15.61:60600) 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8900afaf0 0x7fa8900cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:57074/0 (socket says 172.21.15.61:57074) 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88ed9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa890159e80 0x7fa89015d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:47194/0 (socket says 172.21.15.61:47194) 2023-12-24T20:08:17.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88e59c700 1 -- 172.21.15.61:0/2761151768 learned_addr learned my addr 172.21.15.61:0/2761151768 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88dd9b700 1 -- 172.21.15.61:0/2761151768 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa890159ab0 msgr2=0x7fa8900af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88dd9b700 1 --2- 172.21.15.61:0/2761151768 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa890159ab0 0x7fa8900af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88dd9b700 1 -- 172.21.15.61:0/2761151768 >> v1:172.21.15.133:6789/0 conn(0x7fa890159e80 legacy=0x7fa89015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88dd9b700 1 -- 172.21.15.61:0/2761151768 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900ce5e0 con 0x7fa8900afaf0 2023-12-24T20:08:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88d59a700 1 -- 172.21.15.61:0/2761151768 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297608033 0 0) 0x7fa8900cec30 con 0x7fa890159e80 2023-12-24T20:08:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88e59c700 1 --2- 172.21.15.61:0/2761151768 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa890159ab0 0x7fa8900af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.976+0000 7fa88dd9b700 1 --2- 172.21.15.61:0/2761151768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8900afaf0 0x7fa8900cd390 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa8800098e0 tx=0x7fa8800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d066b4cecc42d27 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa88d59a700 1 -- 172.21.15.61:0/2761151768 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000b640 con 0x7fa8900afaf0 2023-12-24T20:08:17.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa88d59a700 1 -- 172.21.15.61:0/2761151768 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000b7a0 con 0x7fa8900afaf0 2023-12-24T20:08:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa88d59a700 1 -- 172.21.15.61:0/2761151768 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000bb40 con 0x7fa8900afaf0 2023-12-24T20:08:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa894bed700 1 -- 172.21.15.61:0/2761151768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8900afaf0 msgr2=0x7fa8900cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa894bed700 1 --2- 172.21.15.61:0/2761151768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8900afaf0 0x7fa8900cd390 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa8800098e0 tx=0x7fa8800091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa894bed700 1 -- 172.21.15.61:0/2761151768 shutdown_connections 2023-12-24T20:08:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa894bed700 1 --2- 172.21.15.61:0/2761151768 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa890159ab0 0x7fa8900af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa894bed700 1 --2- 172.21.15.61:0/2761151768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8900afaf0 0x7fa8900cd390 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa894bed700 1 -- 172.21.15.61:0/2761151768 >> 172.21.15.61:0/2761151768 conn(0x7fa89006e600 msgr2=0x7fa890067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa894bed700 1 -- 172.21.15.61:0/2761151768 shutdown_connections 2023-12-24T20:08:17.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.977+0000 7fa894bed700 1 -- 172.21.15.61:0/2761151768 wait complete. 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.978+0000 7fa894bed700 1 Processor -- start 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.978+0000 7fa894bed700 1 -- start start 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa894bed700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8900afaf0 0x7fa890152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa894bed700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa890159ab0 0x7fa89016d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa894bed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa890159e80 0x7fa89016d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa894bed700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa890152ca0 con 0x7fa890159ab0 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa894bed700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900c9470 con 0x7fa890159e80 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa894bed700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900c9750 con 0x7fa8900afaf0 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa88dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa890159ab0 0x7fa89016d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.984 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa88dd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa890159ab0 0x7fa89016d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41540/0 (socket says 172.21.15.61:41540) 2023-12-24T20:08:17.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa88dd9b700 1 -- 172.21.15.61:0/47694904 learned_addr learned my addr 172.21.15.61:0/47694904 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:17.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa88e59c700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8900afaf0 0x7fa890152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.979+0000 7fa88ed9d700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa890159e80 0x7fa89016d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa88dd9b700 1 -- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8900afaf0 msgr2=0x7fa890152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa88dd9b700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fa8900afaf0 0x7fa890152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa88dd9b700 1 -- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa890159e80 msgr2=0x7fa89016d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa88dd9b700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa890159e80 0x7fa89016d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa88dd9b700 1 -- 172.21.15.61:0/47694904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780094f0 con 0x7fa890159ab0 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa88ed9d700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa890159e80 0x7fa89016d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa88dd9b700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa890159ab0 0x7fa89016d3c0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fa890068ad0 tx=0x7fa880017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa8867fc700 1 -- 172.21.15.61:0/47694904 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000bb20 con 0x7fa890159ab0 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa8867fc700 1 -- 172.21.15.61:0/47694904 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa880011420 con 0x7fa890159ab0 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa880009420 con 0x7fa890159ab0 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa8867fc700 1 -- 172.21.15.61:0/47694904 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880011800 con 0x7fa890159ab0 2023-12-24T20:08:17.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.980+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8900c9d10 con 0x7fa890159ab0 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.981+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa89004c3c0 con 0x7fa890159ab0 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.981+0000 7fa8867fc700 1 -- 172.21.15.61:0/47694904 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fa880011c30 con 0x7fa890159ab0 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.982+0000 7fa8867fc700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa870066f30 0x7fa8700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.982+0000 7fa8867fc700 1 -- 172.21.15.61:0/47694904 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa880085e60 con 0x7fa890159ab0 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.982+0000 7fa8867fc700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] conn(0x7fa87006cd80 0x7fa87006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.982+0000 7fa8867fc700 1 -- 172.21.15.61:0/47694904 --> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa87006f860 con 0x7fa87006cd80 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.982+0000 7fa88e59c700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa870066f30 0x7fa8700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.982+0000 7fa8867fc700 1 -- 172.21.15.61:0/47694904 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8800884a0 con 0x7fa890159ab0 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.982+0000 7fa88ed9d700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] conn(0x7fa87006cd80 0x7fa87006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.982+0000 7fa88e59c700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa870066f30 0x7fa8700693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa8780094c0 tx=0x7fa878008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.983+0000 7fa88ed9d700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] conn(0x7fa87006cd80 0x7fa87006f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:17.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.983+0000 7fa8867fc700 1 -- 172.21.15.61:0/47694904 <== osd.7 v2:172.21.15.133:6808/40577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22340 (crc 0 0 0) 0x7fa87006f860 con 0x7fa87006cd80 2023-12-24T20:08:17.996 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.996+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 --> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa8900ce8c0 con 0x7fa87006cd80 2023-12-24T20:08:17.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa8867fc700 1 -- 172.21.15.61:0/47694904 <== osd.7 v2:172.21.15.133:6808/40577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+682 (crc 0 0 0) 0x7fa8900ce8c0 con 0x7fa87006cd80 2023-12-24T20:08:17.997 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-12-24T20:08:17.997 INFO:teuthology.orchestra.run.smithi061.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-24T20:08:17.997 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-12-24T20:08:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] conn(0x7fa87006cd80 msgr2=0x7fa87006f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa894bed700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:6808/40577,v1:172.21.15.133:6809/40577] conn(0x7fa87006cd80 0x7fa87006f190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa870066f30 msgr2=0x7fa8700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa894bed700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fa870066f30 0x7fa8700693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa8780094c0 tx=0x7fa878008040 comp rx=0 tx=0).stop 2023-12-24T20:08:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa890159ab0 msgr2=0x7fa89016d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa894bed700 1 --2- 172.21.15.61:0/47694904 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa890159ab0 0x7fa89016d3c0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fa890068ad0 tx=0x7fa880017000 comp rx=0 tx=0).stop 2023-12-24T20:08:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa88ed9d700 1 -- 172.21.15.61:0/47694904 reap_dead start 2023-12-24T20:08:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 shutdown_connections 2023-12-24T20:08:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 >> 172.21.15.61:0/47694904 conn(0x7fa89006e600 msgr2=0x7fa890152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 shutdown_connections 2023-12-24T20:08:17.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:17.997+0000 7fa894bed700 1 -- 172.21.15.61:0/47694904 wait complete. 2023-12-24T20:08:18.009 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-24T20:08:18.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.132+0000 7fe8ee0b6700 1 Processor -- start 2023-12-24T20:08:18.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.132+0000 7fe8ee0b6700 1 -- start start 2023-12-24T20:08:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.133+0000 7fe8ee0b6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80b17c0 0x7fe8e8159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.133+0000 7fe8ee0b6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e815e970 con 0x7fe8e80cba10 2023-12-24T20:08:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.133+0000 7fe8ee0b6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e815da80 con 0x7fe8e80cb640 2023-12-24T20:08:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.133+0000 7fe8ee0b6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e815dd60 con 0x7fe8e80b17c0 2023-12-24T20:08:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.133+0000 7fe8e7fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fe8e80cba10 0x7fe8e8159dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:51380/0 (socket says 172.21.15.61:51380) 2023-12-24T20:08:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.133+0000 7fe8e7fff700 1 -- 172.21.15.61:0/3532662676 learned_addr learned my addr 172.21.15.61:0/3532662676 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.133+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583840790 0 0) 0x7fe8e815e970 con 0x7fe8e80cba10 2023-12-24T20:08:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.133+0000 7fe8e6ffd700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80b17c0 0x7fe8e8159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d4003570 con 0x7fe8e80cba10 2023-12-24T20:08:18.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 298516894 0 0) 0x7fe8d4003570 con 0x7fe8e80cba10 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80b17c0 msgr2=0x7fe8e8159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80b17c0 0x7fe8e8159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 >> v1:172.21.15.133:6789/0 conn(0x7fe8e80cb640 legacy=0x7fe8e8068d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e815e040 con 0x7fe8e80cba10 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7fe8e00017f0 con 0x7fe8e80cba10 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 >> v1:172.21.15.61:6789/0 conn(0x7fe8e80cba10 legacy=0x7fe8e8159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4003a90 0x7fe8d4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4004810 0x7fe8d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80b17c0 0x7fe8d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e815dd60 con 0x7fe8d4004810 2023-12-24T20:08:18.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d400bb10 con 0x7fe8d4003a90 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d400bcd0 con 0x7fe8e80b17c0 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e6ffd700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4004810 0x7fe8d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e77fe700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4003a90 0x7fe8d4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e7fff700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80b17c0 0x7fe8d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e6ffd700 1 -- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80b17c0 msgr2=0x7fe8d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e6ffd700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80b17c0 0x7fe8d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e6ffd700 1 -- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4003a90 msgr2=0x7fe8d4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e6ffd700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4003a90 0x7fe8d4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e6ffd700 1 -- 172.21.15.61:0/3532662676 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4003570 con 0x7fe8d4004810 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e77fe700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4003a90 0x7fe8d4003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.134+0000 7fe8e6ffd700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4004810 0x7fe8d4004c80 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80b1be0 tx=0x7fe8d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac87a3d1487323 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.135+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000e710 con 0x7fe8d4004810 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.135+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d000e870 con 0x7fe8d4004810 2023-12-24T20:08:18.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.135+0000 7fe8e67fc700 1 -- 172.21.15.61:0/3532662676 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000ec30 con 0x7fe8d4004810 2023-12-24T20:08:18.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.135+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/3532662676 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4004810 msgr2=0x7fe8d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.135+0000 7fe8ee0b6700 1 --2- 172.21.15.61:0/3532662676 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8d4004810 0x7fe8d4004c80 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80b1be0 tx=0x7fe8d00091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.135+0000 7fe8e7fff700 1 -- 172.21.15.61:0/3532662676 reap_dead start 2023-12-24T20:08:18.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.135+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/3532662676 shutdown_connections 2023-12-24T20:08:18.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.135+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/3532662676 >> 172.21.15.61:0/3532662676 conn(0x7fe8e8069760 msgr2=0x7fe8e8069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:18.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.135+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/3532662676 shutdown_connections 2023-12-24T20:08:18.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.135+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/3532662676 wait complete. 2023-12-24T20:08:18.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.136+0000 7fe8ee0b6700 1 Processor -- start 2023-12-24T20:08:18.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.136+0000 7fe8ee0b6700 1 -- start start 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.137+0000 7fe8ee0b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4004810 0x7fe8e80c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.137+0000 7fe8ee0b6700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80c4bf0 0x7fe8e80cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.137+0000 7fe8ee0b6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8e80cefa0 0x7fe8e80c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.137+0000 7fe8ee0b6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80cc520 con 0x7fe8e80cefa0 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.137+0000 7fe8ee0b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80cc700 con 0x7fe8d4004810 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.137+0000 7fe8ee0b6700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80cc9e0 con 0x7fe8e80c4bf0 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.137+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8e80cefa0 0x7fe8e80c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.137+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8e80cefa0 0x7fe8e80c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41546/0 (socket says 172.21.15.61:41546) 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.137+0000 7fe8e7fff700 1 -- 172.21.15.61:0/464094884 learned_addr learned my addr 172.21.15.61:0/464094884 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.137+0000 7fe8e6ffd700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80c4bf0 0x7fe8e80cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8e77fe700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4004810 0x7fe8e80c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8e7fff700 1 -- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80c4bf0 msgr2=0x7fe8e80cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8e7fff700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80c4bf0 0x7fe8e80cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8e7fff700 1 -- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4004810 msgr2=0x7fe8e80c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8e7fff700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4004810 0x7fe8e80c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8e7fff700 1 -- 172.21.15.61:0/464094884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80cccc0 con 0x7fe8e80cefa0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8e77fe700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4004810 0x7fe8e80c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8e7fff700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8e80cefa0 0x7fe8e80c6350 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80cbde0 tx=0x7fe8e0001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8df7fe700 1 -- 172.21.15.61:0/464094884 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e000ebc0 con 0x7fe8e80cefa0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8df7fe700 1 -- 172.21.15.61:0/464094884 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e000ed40 con 0x7fe8e80cefa0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/464094884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e80ccfa0 con 0x7fe8e80cefa0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8df7fe700 1 -- 172.21.15.61:0/464094884 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0013670 con 0x7fe8e80cefa0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.138+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/464094884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e80c6890 con 0x7fe8e80cefa0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.139+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/464094884 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e804c3c0 con 0x7fe8e80cefa0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.139+0000 7fe8df7fe700 1 -- 172.21.15.61:0/464094884 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7fe8e0013a20 con 0x7fe8e80cefa0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.140+0000 7fe8df7fe700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8c8066f30 0x7fe8c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.140+0000 7fe8df7fe700 1 -- 172.21.15.61:0/464094884 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe8e00847c0 con 0x7fe8e80cefa0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.140+0000 7fe8e77fe700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8c8066f30 0x7fe8c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.141+0000 7fe8e77fe700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8c8066f30 0x7fe8c80693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8000c00 tx=0x7fe8d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:18.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.144+0000 7fe8df7fe700 1 -- 172.21.15.61:0/464094884 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8e0051d30 con 0x7fe8e80cefa0 2023-12-24T20:08:18.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.339+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/464094884 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8e80c2de0 con 0x7fe8c8066f30 2023-12-24T20:08:18.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.339+0000 7fe8df7fe700 1 -- 172.21.15.61:0/464094884 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe8e80c2de0 con 0x7fe8c8066f30 2023-12-24T20:08:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8c8066f30 msgr2=0x7fe8c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8c8066f30 0x7fe8c80693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8000c00 tx=0x7fe8d8009040 comp rx=0 tx=0).stop 2023-12-24T20:08:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/464094884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8e80cefa0 msgr2=0x7fe8e80c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8e80cefa0 0x7fe8e80c6350 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80cbde0 tx=0x7fe8e0001330 comp rx=0 tx=0).stop 2023-12-24T20:08:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/464094884 shutdown_connections 2023-12-24T20:08:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7fe8c8066f30 0x7fe8c80693e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fe8e80cefa0 0x7fe8e80c6350 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8d4004810 0x7fe8e80c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 --2- 172.21.15.61:0/464094884 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7fe8e80c4bf0 0x7fe8e80cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/464094884 >> 172.21.15.61:0/464094884 conn(0x7fe8e8069760 msgr2=0x7fe8e806b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:18.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/464094884 shutdown_connections 2023-12-24T20:08:18.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.341+0000 7fe8ee0b6700 1 -- 172.21.15.61:0/464094884 wait complete. 2023-12-24T20:08:18.345 INFO:teuthology.orchestra.run.smithi061.stderr:instructed osd(s) 7 to deep-scrub 2023-12-24T20:08:18.354 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:08:18.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.476+0000 7f53012da700 1 Processor -- start 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.476+0000 7f53012da700 1 -- start start 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.476+0000 7f53012da700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f52fc159c10 0x7f52fc0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.476+0000 7f53012da700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52fc159fe0 0x7f52fc0c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.476+0000 7f53012da700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc0af880 con 0x7f52fc0cba80 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.476+0000 7f53012da700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc0c6fc0 con 0x7f52fc159c10 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.476+0000 7f53012da700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0c63b0 con 0x7f52fc159fe0 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52faffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f52fc159c10 0x7f52fc0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52faffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f52fc159c10 0x7f52fc0c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41558/0 (socket says 172.21.15.61:41558) 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52faffd700 1 -- 172.21.15.61:0/2067005788 learned_addr learned my addr 172.21.15.61:0/2067005788 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52fa7fc700 1 --2- 172.21.15.61:0/2067005788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52fc159fe0 0x7f52fc0c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52faffd700 1 -- 172.21.15.61:0/2067005788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52fc159fe0 msgr2=0x7f52fc0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52faffd700 1 --2- 172.21.15.61:0/2067005788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52fc159fe0 0x7f52fc0c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52faffd700 1 -- 172.21.15.61:0/2067005788 >> v1:172.21.15.133:6789/0 conn(0x7f52fc0cba80 legacy=0x7f52fc0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52faffd700 1 -- 172.21.15.61:0/2067005788 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0c6690 con 0x7f52fc159c10 2023-12-24T20:08:18.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52faffd700 1 --2- 172.21.15.61:0/2067005788 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc159c10 0x7f52fc0c57d0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0099b0 tx=0x7f52ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b683b4ba27913ad server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:18.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52f9ffb700 1 -- 172.21.15.61:0/2067005788 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00b860 con 0x7f52fc159c10 2023-12-24T20:08:18.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52f9ffb700 1 -- 172.21.15.61:0/2067005788 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00b9c0 con 0x7f52fc159c10 2023-12-24T20:08:18.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.477+0000 7f52f9ffb700 1 -- 172.21.15.61:0/2067005788 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00bd60 con 0x7f52fc159c10 2023-12-24T20:08:18.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.478+0000 7f53012da700 1 -- 172.21.15.61:0/2067005788 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc159c10 msgr2=0x7f52fc0c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.478+0000 7f53012da700 1 --2- 172.21.15.61:0/2067005788 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc159c10 0x7f52fc0c57d0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0099b0 tx=0x7f52ec009250 comp rx=0 tx=0).stop 2023-12-24T20:08:18.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.478+0000 7f53012da700 1 -- 172.21.15.61:0/2067005788 shutdown_connections 2023-12-24T20:08:18.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.478+0000 7f53012da700 1 --2- 172.21.15.61:0/2067005788 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc159c10 0x7f52fc0c57d0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.478+0000 7f53012da700 1 --2- 172.21.15.61:0/2067005788 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52fc159fe0 0x7f52fc0c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.478+0000 7f53012da700 1 -- 172.21.15.61:0/2067005788 >> 172.21.15.61:0/2067005788 conn(0x7f52fc06e640 msgr2=0x7f52fc067550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:18.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.478+0000 7f53012da700 1 -- 172.21.15.61:0/2067005788 shutdown_connections 2023-12-24T20:08:18.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.478+0000 7f53012da700 1 -- 172.21.15.61:0/2067005788 wait complete. 2023-12-24T20:08:18.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.479+0000 7f53012da700 1 Processor -- start 2023-12-24T20:08:18.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.479+0000 7f53012da700 1 -- start start 2023-12-24T20:08:18.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f53012da700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc0cba80 0x7f52fc0b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f53012da700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52fc159c10 0x7f52fc16acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f53012da700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52fc159fe0 0x7f52fc141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f53012da700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc16e5b0 con 0x7f52fc0cba80 2023-12-24T20:08:18.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f53012da700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc16b200 con 0x7f52fc159fe0 2023-12-24T20:08:18.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f53012da700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc16d930 con 0x7f52fc159c10 2023-12-24T20:08:18.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f52faffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc0cba80 0x7f52fc0b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f52faffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc0cba80 0x7f52fc0b6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:41572/0 (socket says 172.21.15.61:41572) 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f52faffd700 1 -- 172.21.15.61:0/186098170 learned_addr learned my addr 172.21.15.61:0/186098170 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f52fa7fc700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52fc159c10 0x7f52fc16acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f52fb7fe700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52fc159fe0 0x7f52fc141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f52faffd700 1 -- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52fc159c10 msgr2=0x7f52fc16acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f52faffd700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52fc159c10 0x7f52fc16acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f52faffd700 1 -- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52fc159fe0 msgr2=0x7f52fc141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f52faffd700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52fc159fe0 0x7f52fc141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.480+0000 7f52faffd700 1 -- 172.21.15.61:0/186098170 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec0094f0 con 0x7f52fc0cba80 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.481+0000 7f52faffd700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc0cba80 0x7f52fc0b6230 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0d1a40 tx=0x7f52ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.481+0000 7f52e2ffd700 1 -- 172.21.15.61:0/186098170 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec011e40 con 0x7f52fc0cba80 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.481+0000 7f52e2ffd700 1 -- 172.21.15.61:0/186098170 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec024440 con 0x7f52fc0cba80 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.481+0000 7f53012da700 1 -- 172.21.15.61:0/186098170 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc16dc10 con 0x7f52fc0cba80 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.481+0000 7f52e2ffd700 1 -- 172.21.15.61:0/186098170 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0247e0 con 0x7f52fc0cba80 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.481+0000 7f53012da700 1 -- 172.21.15.61:0/186098170 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc16e1d0 con 0x7f52fc0cba80 2023-12-24T20:08:18.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.482+0000 7f53012da700 1 -- 172.21.15.61:0/186098170 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc0890b0 con 0x7f52fc0cba80 2023-12-24T20:08:18.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.482+0000 7f52e2ffd700 1 -- 172.21.15.61:0/186098170 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f52ec01a420 con 0x7f52fc0cba80 2023-12-24T20:08:18.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.482+0000 7f52e2ffd700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f52e8066f30 0x7f52e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:18.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.483+0000 7f52e2ffd700 1 -- 172.21.15.61:0/186098170 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f52ec086040 con 0x7f52fc0cba80 2023-12-24T20:08:18.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.483+0000 7f52fa7fc700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f52e8066f30 0x7f52e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:18.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.483+0000 7f52fa7fc700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f52e8066f30 0x7f52e80693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f52f0006fd0 tx=0x7f52f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:18.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.487+0000 7f52e2ffd700 1 -- 172.21.15.61:0/186098170 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52ec053630 con 0x7f52fc0cba80 2023-12-24T20:08:18.679 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.678+0000 7f53012da700 1 -- 172.21.15.61:0/186098170 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52fc04c3c0 con 0x7f52e8066f30 2023-12-24T20:08:18.681 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.682+0000 7f52e2ffd700 1 -- 172.21.15.61:0/186098170 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49974 (secure 0 0 0) 0x7f52fc04c3c0 con 0x7f52e8066f30 2023-12-24T20:08:18.682 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 -- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f52e8066f30 msgr2=0x7f52e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f52e8066f30 0x7f52e80693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f52f0006fd0 tx=0x7f52f0008040 comp rx=0 tx=0).stop 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 -- 172.21.15.61:0/186098170 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc0cba80 msgr2=0x7f52fc0b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc0cba80 0x7f52fc0b6230 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0d1a40 tx=0x7f52ec017000 comp rx=0 tx=0).stop 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 -- 172.21.15.61:0/186098170 shutdown_connections 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f52e8066f30 0x7f52e80693e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52fc159fe0 0x7f52fc141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f52fc0cba80 0x7f52fc0b6230 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 --2- 172.21.15.61:0/186098170 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f52fc159c10 0x7f52fc16acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 -- 172.21.15.61:0/186098170 >> 172.21.15.61:0/186098170 conn(0x7f52fc06e640 msgr2=0x7f52fc156690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 -- 172.21.15.61:0/186098170 shutdown_connections 2023-12-24T20:08:18.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:18.683+0000 7f53012da700 1 -- 172.21.15.61:0/186098170 wait complete. 2023-12-24T20:08:18.685 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:08:18.696 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2023-12-24T20:08:18.474276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9547,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552952,"statfs":{"total":1600000000,"available":1590222976,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.844343"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":312,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-12-24T20:08:08.898851+0000","last_change":"2023-12-24T19:56:56.330535+0000","last_active":"2023-12-24T20:08:08.898851+0000","last_peered":"2023-12-24T20:08:08.898851+0000","last_clean":"2023-12-24T20:08:08.898851+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:08:08.898851+0000","last_undegraded":"2023-12-24T20:08:08.898851+0000","last_fullsized":"2023-12-24T20:08:08.898851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-24T19:56:55.301150+0000","last_clean_scrub_stamp":"2023-12-24T19:56:55.301150+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:20:33.614446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.308,"15min":0.307},"max":{"1min":0.77800000000000002,"5min":0.81200000000000006,"15min":0.90500000000000003},"last":0.437},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57899999999999996,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50900000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.40100000000000002,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.78900000000000003,"15min":0.872},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58399999999999996,"15min":0.55800000000000005},"min":{"1min":0.40999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.41999999999999998,"5min":0.39400000000000002,"15min":0.34100000000000003},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":0.85299999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.42499999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.91400000000000003},"last":0.60099999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.70699999999999996,"5min":0.754,"15min":0.82799999999999996},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.50600000000000001,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.316,"15min":0.312},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.95699999999999996},"last":0.624}]},{"osd":5,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.41299999999999998,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.754,"5min":0.79800000000000004,"15min":0.81499999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.80000000000000004},"last":0.65100000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.83699999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.48799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.81100000000000005,"5min":0.84899999999999998,"15min":0.873},"last":0.71199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.80900000000000005,"15min":1.0309999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.58999999999999997,"15min":0.56899999999999995},"min":{"1min":0.45700000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72099999999999997,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56200000000000006,"15min":0.54800000000000004},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.30599999999999999},"max":{"1min":0.748,"5min":0.80200000000000005,"15min":0.95799999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55900000000000005,"15min":0.53600000000000003},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.71499999999999997,"5min":0.75,"15min":1.0029999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58899999999999997,"15min":0.56399999999999995},"min":{"1min":0.43099999999999999,"5min":0.38,"15min":0.27000000000000002},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.54200000000000004},"min":{"1min":0.44,"5min":0.378,"15min":0.33200000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.0640000000000001},"last":0.627}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.57199999999999995},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":1.077},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.59799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.372},"max":{"1min":0.79100000000000004,"5min":0.877,"15min":1.048},"last":0.65900000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"min":{"1min":0.36599999999999999,"5min":0.307,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59299999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":0.81599999999999995,"5min":0.84299999999999997,"15min":0.86499999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.254},"max":{"1min":0.628,"5min":0.748,"15min":0.84699999999999998},"last":0.68200000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.54700000000000004},"min":{"1min":0.33500000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35099999999999998},"max":{"1min":0.76200000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36799999999999999,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.51200000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.41499999999999998,"15min":0.38200000000000001},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.60399999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.38600000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40799999999999997,"15min":0.38400000000000001},"min":{"1min":0.29099999999999998,"5min":0.25,"15min":0.216},"max":{"1min":0.57099999999999995,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.37},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39700000000000002,"15min":0.377},"min":{"1min":0.313,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.53300000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.32900000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44500000000000001,"15min":0.42299999999999999},"min":{"1min":0.30099999999999999,"5min":0.29299999999999998,"15min":0.26300000000000001},"max":{"1min":0.60399999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.434,"15min":0.40999999999999998},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.25},"max":{"1min":0.51000000000000001,"5min":0.64700000000000002,"15min":0.70999999999999996},"last":0.31}]},{"osd":4,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.60999999999999999},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.77100000000000002,"5min":0.871,"15min":0.871},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.60099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.376},"max":{"1min":0.78400000000000003,"5min":1.014,"15min":1.014},"last":0.58399999999999996}]},{"osd":5,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66600000000000004,"15min":0.63800000000000001},"min":{"1min":0.496,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":1.04,"15min":1.04},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65100000000000002,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81799999999999995,"5min":0.998,"15min":0.998},"last":0.69599999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67000000000000004,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":1.054,"15min":1.054},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69199999999999995,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.39500000000000002},"max":{"1min":0.80400000000000005,"5min":1.012,"15min":1.012},"last":0.628}]},{"osd":7,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67000000000000004,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78200000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574986,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.36499999999999999,"15min":0.39300000000000002},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":0.51200000000000001,"5min":0.64500000000000002,"15min":2.6259999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.376},"min":{"1min":0.29599999999999999,"5min":0.24199999999999999,"15min":0.215},"max":{"1min":0.45800000000000002,"5min":0.70799999999999996,"15min":0.97999999999999998},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.251,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":0.439,"5min":0.65400000000000003,"15min":0.92700000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.41199999999999998,"15min":0.40500000000000003},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.23499999999999999},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.93999999999999995},"last":0.372}]},{"osd":3,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.44700000000000001},"min":{"1min":0.29799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56699999999999995,"5min":0.70199999999999996,"15min":2.573},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45900000000000002,"15min":0.436},"min":{"1min":0.38200000000000001,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.57299999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"min":{"1min":0.48399999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":1.073,"15min":1.3500000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.65200000000000002},"min":{"1min":0.49199999999999999,"5min":0.42499999999999999,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":2.7149999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.69199999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.372},"max":{"1min":0.94599999999999995,"5min":1.0569999999999999,"15min":2.6859999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65900000000000003,"15min":0.63600000000000001},"min":{"1min":0.53700000000000003,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.006},"last":0.67100000000000004}]},{"osd":6,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.47599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91600000000000004,"5min":0.97699999999999998,"15min":1.655},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85999999999999999,"5min":0.91100000000000003,"15min":1.0489999999999999},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65000000000000002,"15min":0.64500000000000002},"min":{"1min":0.54400000000000004,"5min":0.39800000000000002,"15min":0.38400000000000001},"max":{"1min":0.93100000000000005,"5min":1.0589999999999999,"15min":1.5429999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.69999999999999996},"min":{"1min":0.58699999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0529999999999999,"15min":2.6579999999999999},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.20300000000000001},"max":{"1min":0.53400000000000003,"5min":0.61599999999999999,"15min":0.78900000000000003},"last":0.247},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39400000000000002,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.25,"15min":0.221},"max":{"1min":0.496,"5min":0.65600000000000003,"15min":0.72299999999999998},"last":0.38500000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38400000000000001,"15min":0.371},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.20200000000000001},"max":{"1min":0.51400000000000001,"5min":0.58399999999999996,"15min":0.77700000000000002},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.42299999999999999,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.48999999999999999,"5min":0.64900000000000002,"15min":0.82799999999999996},"last":0.31900000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44600000000000001,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56499999999999995,"5min":0.67500000000000004,"15min":0.84699999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.42199999999999999,"15min":0.41699999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.25700000000000001},"max":{"1min":0.47699999999999998,"5min":0.627,"15min":0.88900000000000001},"last":0.34000000000000002}]},{"osd":4,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.436,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.80500000000000005,"5min":0.95799999999999996,"15min":0.97999999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.85099999999999998,"5min":0.98699999999999999,"15min":1.2649999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":0.97299999999999998,"15min":3.577},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63800000000000001,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86899999999999999,"5min":1.052,"15min":7.0220000000000002},"last":0.50700000000000001}]},{"osd":6,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64600000000000002,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.78100000000000003,"5min":1.075,"15min":1.298},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.44900000000000001},"max":{"1min":0.79900000000000004,"5min":1.0029999999999999,"15min":3.637},"last":0.60499999999999998}]},{"osd":7,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81499999999999995,"5min":1.014,"15min":7.0599999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68400000000000005,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.89800000000000002,"5min":0.97399999999999998,"15min":1.331},"last":0.51400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.379,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.182},"max":{"1min":0.54300000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.626},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38700000000000001,"15min":0.36699999999999999},"min":{"1min":0.26800000000000002,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.57199999999999995,"5min":0.60499999999999998,"15min":0.66500000000000004},"last":0.45000000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.51900000000000002,"5min":0.57699999999999996,"15min":0.59399999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.28899999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64700000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.67200000000000004}]},{"osd":2,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.433,"15min":0.41499999999999998},"min":{"1min":0.30399999999999999,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.61799999999999999,"5min":0.66500000000000004,"15min":0.79500000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.45600000000000002,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.27800000000000002,"15min":0.27300000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58199999999999996}]},{"osd":4,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69799999999999995,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63700000000000001,"15min":0.61799999999999999},"min":{"1min":0.45000000000000001,"5min":0.39500000000000002,"15min":0.34100000000000003},"max":{"1min":0.86399999999999999,"5min":0.92100000000000004,"15min":1.337},"last":0.79100000000000004}]},{"osd":5,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":1.038,"15min":1.2010000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.48899999999999999,"5min":0.47899999999999998,"15min":0.35199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.97799999999999998},"last":0.83799999999999997}]},{"osd":6,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.64500000000000002,"15min":0.63100000000000001},"min":{"1min":0.48099999999999998,"5min":0.44500000000000001,"15min":0.39900000000000002},"max":{"1min":0.89000000000000001,"5min":1.024,"15min":1.1699999999999999},"last":0.88},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.39100000000000001},"max":{"1min":0.82499999999999996,"5min":0.97899999999999998,"15min":1.4570000000000001},"last":0.86499999999999999}]},{"osd":7,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.433},"max":{"1min":0.83599999999999997,"5min":1.02,"15min":1.3779999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.45200000000000001,"15min":0.375},"max":{"1min":0.92400000000000004,"5min":1.004,"15min":1.006},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.54300000000000004},"min":{"1min":0.42199999999999999,"5min":0.30299999999999999,"15min":0.28599999999999998},"max":{"1min":0.71499999999999997,"5min":0.79300000000000004,"15min":0.92200000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.56100000000000005},"min":{"1min":0.44,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74099999999999999,"5min":0.752,"15min":0.82199999999999995},"last":0.51600000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.65600000000000003},"min":{"1min":0.41499999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":4.883},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":1.544},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32100000000000001},"max":{"1min":0.67800000000000005,"5min":0.84399999999999997,"15min":1.1890000000000001},"last":0.42099999999999999}]},{"osd":3,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.58199999999999996,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.33300000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.75},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.52,"5min":1.52,"15min":8.8200000000000003},"last":0.628}]},{"osd":5,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.44500000000000001,"15min":0.49099999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.68700000000000006,"5min":0.68899999999999995,"15min":1.4419999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48399999999999999,"15min":0.57799999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":3.8279999999999998},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":1.6439999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:07:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53400000000000003,"15min":0.82999999999999996},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.33500000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":14.039999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.375,"15min":0.31},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.64900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.29699999999999999},"max":{"1min":0.69399999999999995,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.70699999999999996,"5min":0.79700000000000004,"15min":4.6059999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.55600000000000005},"min":{"1min":0.35799999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.71999999999999997,"5min":0.80800000000000005,"15min":1.847},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.45100000000000001,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.499},{"interface":"front","average":{"1min":0.621,"5min":0.60899999999999999,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.77400000000000002,"5min":0.89800000000000002,"15min":1.97},"last":0.68400000000000005}]},{"osd":3,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":0.84699999999999998,"15min":3.2850000000000001},"last":0.622},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.623,"15min":0.58699999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39200000000000002},"max":{"1min":0.76000000000000001,"5min":0.877,"15min":0.877},"last":0.66300000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51100000000000001,"15min":0.495},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":1.0289999999999999,"15min":1.3320000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.74299999999999999,"5min":1.0589999999999999,"15min":4.5330000000000004},"last":0.57199999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.48599999999999999},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78700000000000003,"5min":0.96499999999999997,"15min":1.8839999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.35499999999999998,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":0.98799999999999999,"15min":3.766},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.70899999999999996}]}]}],"pool_statfs":[]}} 2023-12-24T20:08:18.700 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-24T19:56:55.301150+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=24, tm_hour=19, tm_min=56, tm_sec=55, tm_wday=6, tm_yday=358, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=24, tm_hour=20, tm_min=8, tm_sec=13, tm_wday=6, tm_yday=358, tm_isdst=0) 2023-12-24T20:08:18.700 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-24T20:08:37.259 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:37.262 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:38.701 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-24T20:08:38.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.836+0000 7f496c56e700 1 Processor -- start 2023-12-24T20:08:38.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.837+0000 7f496c56e700 1 -- start start 2023-12-24T20:08:38.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f496c56e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f49640af710 0x7f49640afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f496c56e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49640687f0 con 0x7f4964068c80 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f496c56e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4964067be0 con 0x7f496415acf0 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f496c56e700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4964067ec0 con 0x7f49640af710 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f496a30a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f49640af710 0x7f49640afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f4969b09700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4964068c80 0x7f496415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:48182/0 (socket says 172.21.15.61:48182) 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f4969b09700 1 -- 172.21.15.61:0/4247949380 learned_addr learned my addr 172.21.15.61:0/4247949380 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f4969308700 1 -- 172.21.15.61:0/4247949380 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603023371 0 0) 0x7f49640687f0 con 0x7f4964068c80 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f4969308700 1 -- 172.21.15.61:0/4247949380 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4950003570 con 0x7f4964068c80 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f496a30a700 1 -- 172.21.15.61:0/4247949380 >> v1:172.21.15.133:6789/0 conn(0x7f496415acf0 legacy=0x7f49640ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f496a30a700 1 -- 172.21.15.61:0/4247949380 >> v1:172.21.15.61:6789/0 conn(0x7f4964068c80 legacy=0x7f496415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f496a30a700 1 -- 172.21.15.61:0/4247949380 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49640681a0 con 0x7f49640af710 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f496a30a700 1 --2- 172.21.15.61:0/4247949380 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 0x7f49640afae0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f49600098e0 tx=0x7f49600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ea9e1b8ebd22fa server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f4969308700 1 -- 172.21.15.61:0/4247949380 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960011630 con 0x7f49640af710 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.838+0000 7f4969308700 1 -- 172.21.15.61:0/4247949380 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4960011790 con 0x7f49640af710 2023-12-24T20:08:38.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.839+0000 7f4969308700 1 -- 172.21.15.61:0/4247949380 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960011b10 con 0x7f49640af710 2023-12-24T20:08:38.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.839+0000 7f496c56e700 1 -- 172.21.15.61:0/4247949380 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 msgr2=0x7f49640afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.839+0000 7f496c56e700 1 --2- 172.21.15.61:0/4247949380 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 0x7f49640afae0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f49600098e0 tx=0x7f49600091a0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.839+0000 7f496c56e700 1 -- 172.21.15.61:0/4247949380 shutdown_connections 2023-12-24T20:08:38.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.839+0000 7f496c56e700 1 --2- 172.21.15.61:0/4247949380 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 0x7f49640afae0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.839+0000 7f496c56e700 1 -- 172.21.15.61:0/4247949380 >> 172.21.15.61:0/4247949380 conn(0x7f49640ca200 msgr2=0x7f49640ca600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:38.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.839+0000 7f496c56e700 1 -- 172.21.15.61:0/4247949380 shutdown_connections 2023-12-24T20:08:38.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.839+0000 7f496c56e700 1 -- 172.21.15.61:0/4247949380 wait complete. 2023-12-24T20:08:38.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.840+0000 7f496c56e700 1 Processor -- start 2023-12-24T20:08:38.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.840+0000 7f496c56e700 1 -- start start 2023-12-24T20:08:38.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f496c56e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4964068c80 0x7f4964168df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:38.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f496c56e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 0x7f4964165fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f496c56e700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f496415acf0 0x7f49641679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f496c56e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496416a6f0 con 0x7f49640af710 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f496c56e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4964169330 con 0x7f4964068c80 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f496c56e700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4964169ae0 con 0x7f496415acf0 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f4969b09700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 0x7f4964165fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f4969b09700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 0x7f4964165fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:37434/0 (socket says 172.21.15.61:37434) 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f4969b09700 1 -- 172.21.15.61:0/1452290944 learned_addr learned my addr 172.21.15.61:0/1452290944 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f496a30a700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4964068c80 0x7f4964168df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f496ab0b700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f496415acf0 0x7f49641679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f4969b09700 1 -- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f496415acf0 msgr2=0x7f49641679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f4969b09700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f496415acf0 0x7f49641679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f4969b09700 1 -- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4964068c80 msgr2=0x7f4964168df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.841+0000 7f4969b09700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4964068c80 0x7f4964168df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:38.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.842+0000 7f4969b09700 1 -- 172.21.15.61:0/1452290944 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960009420 con 0x7f49640af710 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.842+0000 7f496ab0b700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f496415acf0 0x7f49641679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.842+0000 7f4969b09700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 0x7f4964165fe0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f495800c590 tx=0x7f4958007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.842+0000 7f49567fc700 1 -- 172.21.15.61:0/1452290944 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958005c00 con 0x7f49640af710 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.842+0000 7f49567fc700 1 -- 172.21.15.61:0/1452290944 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4958005d60 con 0x7f49640af710 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.842+0000 7f496c56e700 1 -- 172.21.15.61:0/1452290944 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4964169dc0 con 0x7f49640af710 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.842+0000 7f49567fc700 1 -- 172.21.15.61:0/1452290944 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958007300 con 0x7f49640af710 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.842+0000 7f496c56e700 1 -- 172.21.15.61:0/1452290944 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496416a380 con 0x7f49640af710 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.843+0000 7f496c56e700 1 -- 172.21.15.61:0/1452290944 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496416a8a0 con 0x7f49640af710 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.843+0000 7f49567fc700 1 -- 172.21.15.61:0/1452290944 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f495801b3b0 con 0x7f49640af710 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.844+0000 7f49567fc700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 0x7f49480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.844+0000 7f49567fc700 1 -- 172.21.15.61:0/1452290944 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4958083610 con 0x7f49640af710 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.844+0000 7f496a30a700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 0x7f49480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:38.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.844+0000 7f496a30a700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 0x7f49480693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f49600091e0 tx=0x7f4960016000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:38.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:38.848+0000 7f49567fc700 1 -- 172.21.15.61:0/1452290944 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f496416a8a0 con 0x7f49640af710 2023-12-24T20:08:39.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.040+0000 7f496c56e700 1 -- 172.21.15.61:0/1452290944 --> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f496404c3c0 con 0x7f4948066f30 2023-12-24T20:08:39.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.043+0000 7f49567fc700 1 -- 172.21.15.61:0/1452290944 <== mgr.4100 v2:172.21.15.133:6832/39914 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49853 (secure 0 0 0) 0x7f496404c3c0 con 0x7f4948066f30 2023-12-24T20:08:39.043 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:39.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 -- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 msgr2=0x7f49480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 0x7f49480693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f49600091e0 tx=0x7f4960016000 comp rx=0 tx=0).stop 2023-12-24T20:08:39.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 -- 172.21.15.61:0/1452290944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 msgr2=0x7f4964165fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.045 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 0x7f4964165fe0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f495800c590 tx=0x7f4958007d90 comp rx=0 tx=0).stop 2023-12-24T20:08:39.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 -- 172.21.15.61:0/1452290944 shutdown_connections 2023-12-24T20:08:39.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f496415acf0 0x7f49641679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f4948066f30 0x7f49480693e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4964068c80 0x7f4964168df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 --2- 172.21.15.61:0/1452290944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f49640af710 0x7f4964165fe0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 -- 172.21.15.61:0/1452290944 >> 172.21.15.61:0/1452290944 conn(0x7f49640ca200 msgr2=0x7f4964155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:39.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 -- 172.21.15.61:0/1452290944 shutdown_connections 2023-12-24T20:08:39.046 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.045+0000 7f496c56e700 1 -- 172.21.15.61:0/1452290944 wait complete. 2023-12-24T20:08:39.046 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-12-24T20:08:39.057 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":533,"stamp":"2023-12-24T20:08:38.478245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9547,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552952,"statfs":{"total":1600000000,"available":1590222976,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002416"},"pg_stats":[{"pgid":"1.0","version":"191'119","reported_seq":325,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-12-24T20:08:19.177920+0000","last_change":"2023-12-24T20:08:19.177894+0000","last_active":"2023-12-24T20:08:19.177920+0000","last_peered":"2023-12-24T20:08:19.177920+0000","last_clean":"2023-12-24T20:08:19.177920+0000","last_became_active":"2023-12-24T19:56:56.329859+0000","last_became_peered":"2023-12-24T19:56:56.329859+0000","last_unstale":"2023-12-24T20:08:19.177920+0000","last_undegraded":"2023-12-24T20:08:19.177920+0000","last_fullsized":"2023-12-24T20:08:19.177920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'119","last_scrub_stamp":"2023-12-24T20:08:19.177842+0000","last_deep_scrub":"191'119","last_deep_scrub_stamp":"2023-12-24T20:08:19.177842+0000","last_clean_scrub_stamp":"2023-12-24T20:08:19.177842+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-26T04:31:36.993603+0000","scrub_duration":0.0024951370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.308,"15min":0.307},"max":{"1min":0.77800000000000002,"5min":0.81200000000000006,"15min":0.90500000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57899999999999996,"15min":0.53400000000000003},"min":{"1min":0.38800000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.40100000000000002,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":0.70599999999999996,"5min":0.78900000000000003,"15min":0.872},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.58399999999999996,"15min":0.55800000000000005},"min":{"1min":0.40999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.57999999999999996}]},{"osd":2,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60199999999999998,"15min":0.56599999999999995},"min":{"1min":0.41999999999999998,"5min":0.39400000000000002,"15min":0.34100000000000003},"max":{"1min":0.71999999999999997,"5min":0.76700000000000002,"15min":0.85299999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.73499999999999999,"5min":0.85299999999999998,"15min":0.86899999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.36199999999999999,"15min":0.32800000000000001},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.42499999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.91400000000000003},"last":0.496}]},{"osd":4,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29099999999999998,"15min":0.25700000000000001},"max":{"1min":0.70699999999999996,"5min":0.754,"15min":0.82799999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.50600000000000001,"15min":0.54700000000000004},"min":{"1min":0.31900000000000001,"5min":0.316,"15min":0.312},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.95699999999999996},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.41299999999999998,"5min":0.318,"15min":0.29699999999999999},"max":{"1min":0.754,"5min":0.79800000000000004,"15min":0.81499999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.38600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.80000000000000004},"last":0.439}]},{"osd":6,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.44600000000000001,"5min":0.371,"15min":0.33400000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.83699999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.48799999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.81100000000000005,"5min":0.84899999999999998,"15min":0.873},"last":0.51400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.54600000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":1.0309999999999999},"last":0.62},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":0.78700000000000003,"15min":0.82499999999999996},"last":0.72699999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.55100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35499999999999998,"15min":0.30599999999999999},"max":{"1min":0.76900000000000002,"5min":0.80200000000000005,"15min":0.95799999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.54100000000000004},"min":{"1min":0.39800000000000002,"5min":0.36599999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":1.0029999999999999},"last":0.64100000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.56599999999999995},"min":{"1min":0.44,"5min":0.38800000000000001,"15min":0.27000000000000002},"max":{"1min":0.81000000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.54800000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.33200000000000002},"max":{"1min":0.73799999999999999,"5min":0.76800000000000002,"15min":1.0640000000000001},"last":0.68799999999999994}]},{"osd":3,"last update":"Sun Dec 24 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59499999999999997,"15min":0.57399999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.72599999999999998,"5min":0.80600000000000005,"15min":1.077},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63,"15min":0.60099999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.372},"max":{"1min":0.78500000000000003,"5min":0.877,"15min":1.048},"last":0.65400000000000003}]},{"osd":4,"last update":"Sun Dec 24 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.47999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.27200000000000002},"max":{"1min":0.68500000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54100000000000004,"15min":0.52700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59699999999999998}]},{"osd":5,"last update":"Sun Dec 24 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.54800000000000004},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.34599999999999997},"max":{"1min":0.747,"5min":0.84299999999999997,"15min":0.86499999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.51200000000000001},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.254},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.84699999999999998},"last":0.56499999999999995}]},{"osd":7,"last update":"Sun Dec 24 20:08:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55800000000000005,"15min":0.54900000000000004},"min":{"1min":0.45600000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72599999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.44500000000000001,"5min":0.35599999999999998,"15min":0.35099999999999998},"max":{"1min":0.78600000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36799999999999999,"15min":0.35299999999999998},"min":{"1min":0.24199999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.51200000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.41499999999999998,"15min":0.38200000000000001},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.60399999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40799999999999997,"15min":0.38400000000000001},"min":{"1min":0.29099999999999998,"5min":0.25,"15min":0.216},"max":{"1min":0.57099999999999995,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39700000000000002,"15min":0.377},"min":{"1min":0.313,"5min":0.23999999999999999,"15min":0.23100000000000001},"max":{"1min":0.53300000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.434}]},{"osd":3,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44500000000000001,"15min":0.42299999999999999},"min":{"1min":0.30099999999999999,"5min":0.29299999999999998,"15min":0.26300000000000001},"max":{"1min":0.60399999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.498},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.434,"15min":0.40999999999999998},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.25},"max":{"1min":0.51000000000000001,"5min":0.64700000000000002,"15min":0.70999999999999996},"last":0.41199999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63900000000000001,"15min":0.60999999999999999},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.77100000000000002,"5min":0.871,"15min":0.871},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.60099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.376},"max":{"1min":0.78400000000000003,"5min":1.014,"15min":1.014},"last":0.76900000000000002}]},{"osd":5,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.66600000000000004,"15min":0.63800000000000001},"min":{"1min":0.496,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":1.04,"15min":1.04},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.65100000000000002,"15min":0.61899999999999999},"min":{"1min":0.41899999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81799999999999995,"5min":0.998,"15min":0.998},"last":0.93700000000000006}]},{"osd":6,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.67000000000000004,"15min":0.63200000000000001},"min":{"1min":0.45500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80700000000000005,"5min":1.054,"15min":1.054},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69199999999999995,"15min":0.64600000000000002},"min":{"1min":0.48599999999999999,"5min":0.48199999999999998,"15min":0.39500000000000002},"max":{"1min":0.80400000000000005,"5min":1.012,"15min":1.012},"last":1}]},{"osd":7,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67000000000000004,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78200000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.66400000000000003},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.81299999999999994,"5min":1.03,"15min":1.03},"last":0.84599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193686,"statfs":{"total":200000000,"available":198335096,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 24 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.39100000000000001},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.20300000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":2.6259999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39900000000000002,"15min":0.378},"min":{"1min":0.28499999999999998,"5min":0.24299999999999999,"15min":0.215},"max":{"1min":0.56699999999999995,"5min":0.70799999999999996,"15min":0.97999999999999998},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Dec 24 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.371},"min":{"1min":0.248,"5min":0.24199999999999999,"15min":0.20599999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.42699999999999999,"15min":0.40699999999999997},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23499999999999999},"max":{"1min":0.74099999999999999,"5min":0.75600000000000001,"15min":0.93999999999999995},"last":0.45300000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.33100000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":2.573},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.439},"min":{"1min":0.32500000000000001,"5min":0.313,"15min":0.28899999999999998},"max":{"1min":0.59499999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.434}]},{"osd":4,"last update":"Sun Dec 24 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.622,"15min":0.60499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.873,"5min":1.073,"15min":1.3500000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.222,"5min":1.222,"15min":2.7149999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Dec 24 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.49199999999999999,"5min":0.45700000000000002,"15min":0.372},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":2.6859999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66700000000000004,"15min":0.63900000000000001},"min":{"1min":0.49299999999999999,"5min":0.41199999999999998,"15min":0.40400000000000003},"max":{"1min":0.98099999999999998,"5min":1.006,"15min":1.006},"last":0.69899999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.35699999999999998},"max":{"1min":0.93700000000000006,"5min":0.97699999999999998,"15min":1.655},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.65100000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.0489999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:08:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.64600000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.38400000000000001},"max":{"1min":0.97499999999999998,"5min":1.0589999999999999,"15min":1.5429999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.69699999999999995},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":2.6579999999999999},"last":0.623}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.20300000000000001},"max":{"1min":0.53400000000000003,"5min":0.61599999999999999,"15min":0.78900000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39400000000000002,"15min":0.38100000000000001},"min":{"1min":0.255,"5min":0.25,"15min":0.221},"max":{"1min":0.496,"5min":0.65600000000000003,"15min":0.72299999999999998},"last":0.28599999999999998}]},{"osd":1,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38400000000000001,"15min":0.371},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.20200000000000001},"max":{"1min":0.51400000000000001,"5min":0.58399999999999996,"15min":0.77700000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.42299999999999999,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.48999999999999999,"5min":0.64900000000000002,"15min":0.82799999999999996},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.44600000000000001,"15min":0.42999999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56499999999999995,"5min":0.67500000000000004,"15min":0.84699999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.42199999999999999,"15min":0.41699999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.25700000000000001},"max":{"1min":0.47699999999999998,"5min":0.627,"15min":0.88900000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.436,"5min":0.39100000000000001,"15min":0.35999999999999999},"max":{"1min":0.80500000000000005,"5min":0.95799999999999996,"15min":0.97999999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.63500000000000001,"15min":0.623},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.40000000000000002},"max":{"1min":0.85099999999999998,"5min":0.98699999999999999,"15min":1.2649999999999999},"last":0.47099999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88400000000000001,"5min":0.97299999999999998,"15min":3.577},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63800000000000001,"15min":0.65700000000000003},"min":{"1min":0.438,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.86899999999999999,"5min":1.052,"15min":7.0220000000000002},"last":0.56799999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64600000000000002,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.78100000000000003,"5min":1.075,"15min":1.298},"last":0.624},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.44900000000000001},"max":{"1min":0.79900000000000004,"5min":1.0029999999999999,"15min":3.637},"last":0.55000000000000004}]},{"osd":7,"last update":"Sun Dec 24 20:08:14 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81499999999999995,"5min":1.014,"15min":7.0599999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68400000000000005,"15min":0.68100000000000005},"min":{"1min":0.48899999999999999,"5min":0.44400000000000001,"15min":0.439},"max":{"1min":0.89800000000000002,"5min":0.97399999999999998,"15min":1.331},"last":0.58799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.379,"15min":0.34799999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.182},"max":{"1min":0.54300000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38700000000000001,"15min":0.36699999999999999},"min":{"1min":0.26800000000000002,"5min":0.23699999999999999,"15min":0.21099999999999999},"max":{"1min":0.57199999999999995,"5min":0.60499999999999998,"15min":0.66500000000000004},"last":0.38300000000000001}]},{"osd":1,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.38,"15min":0.36099999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.51900000000000002,"5min":0.57699999999999996,"15min":0.59399999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.441,"15min":0.40699999999999997},"min":{"1min":0.28899999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64700000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.317}]},{"osd":2,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.433,"15min":0.41499999999999998},"min":{"1min":0.30399999999999999,"5min":0.247,"15min":0.23200000000000001},"max":{"1min":0.61799999999999999,"5min":0.66500000000000004,"15min":0.79500000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.45600000000000002,"15min":0.437},"min":{"1min":0.28999999999999998,"5min":0.27800000000000002,"15min":0.27300000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.47299999999999998}]},{"osd":4,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.44,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69799999999999995,"5min":0.88500000000000001,"15min":1.2310000000000001},"last":0.505},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63700000000000001,"15min":0.61799999999999999},"min":{"1min":0.45000000000000001,"5min":0.39500000000000002,"15min":0.34100000000000003},"max":{"1min":0.86399999999999999,"5min":0.92100000000000004,"15min":1.337},"last":0.58099999999999996}]},{"osd":5,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.628,"15min":0.621},"min":{"1min":0.432,"5min":0.432,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":1.038,"15min":1.2010000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.48899999999999999,"5min":0.47899999999999998,"15min":0.35199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.97799999999999998},"last":0.56799999999999995}]},{"osd":6,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.64500000000000002,"15min":0.63100000000000001},"min":{"1min":0.48099999999999998,"5min":0.44500000000000001,"15min":0.39900000000000002},"max":{"1min":0.89000000000000001,"5min":1.024,"15min":1.1699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.39100000000000001},"max":{"1min":0.82499999999999996,"5min":0.97899999999999998,"15min":1.4570000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Dec 24 20:08:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66400000000000003,"15min":0.65200000000000002},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.433},"max":{"1min":0.83599999999999997,"5min":1.02,"15min":1.3779999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.67500000000000004,"15min":0.65400000000000003},"min":{"1min":0.47399999999999998,"5min":0.45200000000000001,"15min":0.375},"max":{"1min":0.92400000000000004,"5min":1.004,"15min":1.006},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56299999999999994,"15min":0.54500000000000004},"min":{"1min":0.39700000000000002,"5min":0.313,"15min":0.28599999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.36599999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73599999999999999,"5min":0.752,"15min":0.82199999999999995},"last":0.442}]},{"osd":1,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.64100000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33300000000000002},"max":{"1min":0.66300000000000003,"5min":0.78400000000000003,"15min":4.883},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.31900000000000001,"15min":0.26800000000000002},"max":{"1min":0.72299999999999998,"5min":0.79100000000000004,"15min":1.544},"last":0.45600000000000002}]},{"osd":2,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.374,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.67500000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42099999999999999,"5min":0.373,"15min":0.32100000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1890000000000001},"last":0.505}]},{"osd":3,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.44400000000000001,"5min":0.41099999999999998,"15min":0.33300000000000002},"max":{"1min":0.73399999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58999999999999997,"15min":0.72099999999999997},"min":{"1min":0.38100000000000001,"5min":0.379,"15min":0.374},"max":{"1min":0.72299999999999998,"5min":1.52,"15min":8.8200000000000003},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.44900000000000001,"15min":0.48599999999999999},"min":{"1min":0.35899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66700000000000004,"5min":0.68899999999999995,"15min":1.4419999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.48199999999999998,"15min":0.56499999999999995},"min":{"1min":0.313,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.749,"5min":0.93700000000000006,"15min":3.8279999999999998},"last":0.52200000000000002}]},{"osd":6,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.51700000000000002,"15min":0.52400000000000002},"min":{"1min":0.42699999999999999,"5min":0.34599999999999997,"15min":0.32100000000000001},"max":{"1min":0.86499999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56200000000000006,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.6439999999999999},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.78200000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33500000000000002},"max":{"1min":0.78800000000000003,"5min":0.99399999999999999,"15min":14.039999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.31},"max":{"1min":0.80300000000000005,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.49099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1049,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194263,"statfs":{"total":200000000,"available":198925464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56299999999999994,"15min":0.53700000000000003},"min":{"1min":0.39600000000000002,"5min":0.33400000000000002,"15min":0.29699999999999999},"max":{"1min":0.68600000000000005,"5min":0.76500000000000001,"15min":1.2949999999999999},"last":0.62},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59499999999999997,"15min":0.57599999999999996},"min":{"1min":0.40000000000000002,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.76500000000000001,"5min":0.79100000000000004,"15min":4.6059999999999999},"last":0.57599999999999996}]},{"osd":1,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59799999999999998,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.33300000000000002,"15min":0.33200000000000002},"max":{"1min":0.71899999999999997,"5min":0.80800000000000005,"15min":1.847},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.35599999999999998},"max":{"1min":0.71599999999999997,"5min":0.84099999999999997,"15min":4.4900000000000002},"last":0.53400000000000003}]},{"osd":2,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57499999999999996,"15min":0.54900000000000004},"min":{"1min":0.45400000000000001,"5min":0.39600000000000002,"15min":0.318},"max":{"1min":0.77100000000000002,"5min":0.83699999999999997,"15min":3.8559999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.57499999999999996},"min":{"1min":0.502,"5min":0.39200000000000002,"15min":0.37},"max":{"1min":0.76100000000000001,"5min":0.89800000000000002,"15min":1.97},"last":0.54500000000000004}]},{"osd":3,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.63200000000000001,"15min":0.60199999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.38},"max":{"1min":0.77200000000000002,"5min":0.84699999999999998,"15min":3.2850000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.59099999999999997},"min":{"1min":0.46500000000000002,"5min":0.42099999999999999,"15min":0.39200000000000002},"max":{"1min":0.748,"5min":0.877,"15min":0.877},"last":0.63400000000000001}]},{"osd":4,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.29999999999999999,"15min":0.252},"max":{"1min":0.64200000000000002,"5min":1.0289999999999999,"15min":1.3320000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51400000000000001,"15min":0.52600000000000002},"min":{"1min":0.36899999999999999,"5min":0.316,"15min":0.27800000000000002},"max":{"1min":0.73099999999999998,"5min":1.0589999999999999,"15min":4.5330000000000004},"last":0.47599999999999998}]},{"osd":6,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.30299999999999999},"max":{"1min":0.66300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39900000000000002,"5min":0.36099999999999999,"15min":0.28799999999999998},"max":{"1min":0.71999999999999997,"5min":0.96499999999999997,"15min":1.8839999999999999},"last":0.40899999999999997}]},{"osd":7,"last update":"Sun Dec 24 20:08:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33400000000000002},"max":{"1min":0.71299999999999997,"5min":0.98799999999999999,"15min":3.766},"last":0.443},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.55900000000000005},"min":{"1min":0.39300000000000002,"5min":0.38600000000000001,"15min":0.35399999999999998},"max":{"1min":0.71999999999999997,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.499}]}]}],"pool_statfs":[]}} 2023-12-24T20:08:39.060 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-24T20:08:39.180 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.180+0000 7f59e9bf0700 1 Processor -- start 2023-12-24T20:08:39.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.180+0000 7f59e9bf0700 1 -- start start 2023-12-24T20:08:39.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.181+0000 7f59e9bf0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59e41578d0 0x7f59e40af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.181+0000 7f59e9bf0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e40caf30 con 0x7f59e406f6e0 2023-12-24T20:08:39.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.181+0000 7f59e9bf0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e40af9f0 con 0x7f59e406b320 2023-12-24T20:08:39.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.181+0000 7f59e9bf0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e40afcd0 con 0x7f59e41578d0 2023-12-24T20:08:39.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.181+0000 7f59e2ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f59e406f6e0 0x7f59e406ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:48188/0 (socket says 172.21.15.61:48188) 2023-12-24T20:08:39.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.181+0000 7f59e2ffd700 1 -- 172.21.15.61:0/2867737393 learned_addr learned my addr 172.21.15.61:0/2867737393 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-12-24T20:08:39.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.181+0000 7f59e37fe700 1 --2- 172.21.15.61:0/2867737393 >> v2:172.21.15.133:3300/0 conn(0x7f59e41578d0 0x7f59e40af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.181+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806973685 0 0) 0x7f59e40caf30 con 0x7f59e406f6e0 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.181+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d0003570 con 0x7f59e406f6e0 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1129327105 0 0) 0x7f59d0003570 con 0x7f59e406f6e0 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 >> v2:172.21.15.133:3300/0 conn(0x7f59e41578d0 msgr2=0x7f59e40af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 --2- 172.21.15.61:0/2867737393 >> v2:172.21.15.133:3300/0 conn(0x7f59e41578d0 0x7f59e40af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 >> v1:172.21.15.133:6789/0 conn(0x7f59e406b320 legacy=0x7f59e40c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e40affb0 con 0x7f59e406f6e0 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3698618310 0 0) 0x7f59cc001470 con 0x7f59e406f6e0 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 >> v1:172.21.15.61:6789/0 conn(0x7f59e406f6e0 legacy=0x7f59e406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d0003a60 0x7f59d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59d0004810 0x7f59d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59d00051c0 0x7f59d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40afcd0 con 0x7f59d00051c0 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d000c0d0 con 0x7f59d0003a60 2023-12-24T20:08:39.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d000c290 con 0x7f59d0004810 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e3fff700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59d00051c0 0x7f59d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e37fe700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d0003a60 0x7f59d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e2ffd700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59d0004810 0x7f59d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e3fff700 1 -- 172.21.15.61:0/2867737393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59d0004810 msgr2=0x7f59d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e3fff700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59d0004810 0x7f59d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e3fff700 1 -- 172.21.15.61:0/2867737393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d0003a60 msgr2=0x7f59d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e3fff700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d0003a60 0x7f59d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e3fff700 1 -- 172.21.15.61:0/2867737393 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d0003570 con 0x7f59d00051c0 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e3fff700 1 -- 172.21.15.61:0/2867737393 reap_dead start 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.182+0000 7f59e3fff700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59d00051c0 0x7f59d000ba60 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f59dc001f90 tx=0x7f59dc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd95786e4a01f7d server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.183+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc001950 con 0x7f59d00051c0 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.183+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc00c8b0 con 0x7f59d00051c0 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.183+0000 7f59e27fc700 1 -- 172.21.15.61:0/2867737393 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc00cc50 con 0x7f59d00051c0 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.183+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2867737393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59d00051c0 msgr2=0x7f59d000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.183+0000 7f59e9bf0700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59d00051c0 0x7f59d000ba60 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f59dc001f90 tx=0x7f59dc001640 comp rx=0 tx=0).stop 2023-12-24T20:08:39.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.183+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2867737393 shutdown_connections 2023-12-24T20:08:39.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.183+0000 7f59e9bf0700 1 --2- 172.21.15.61:0/2867737393 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59d00051c0 0x7f59d000ba60 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.183+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2867737393 >> 172.21.15.61:0/2867737393 conn(0x7f59e40ce800 msgr2=0x7f59e40cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:39.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.183+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2867737393 shutdown_connections 2023-12-24T20:08:39.187 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.183+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2867737393 wait complete. 2023-12-24T20:08:39.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.184+0000 7f59e9bf0700 1 Processor -- start 2023-12-24T20:08:39.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.185+0000 7f59e9bf0700 1 -- start start 2023-12-24T20:08:39.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.185+0000 7f59e9bf0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d00051c0 0x7f59e4155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.185+0000 7f59e9bf0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59e40c9000 0x7f59e40c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.185+0000 7f59e9bf0700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e4159ac0 0x7f59e4159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.185+0000 7f59e9bf0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40c99b0 con 0x7f59e40c9000 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.185+0000 7f59e9bf0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40b2580 con 0x7f59d00051c0 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.185+0000 7f59e9bf0700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40b3100 con 0x7f59e4159ac0 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.185+0000 7f59e2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59e40c9000 0x7f59e40c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.185+0000 7f59e2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59e40c9000 0x7f59e40c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:37464/0 (socket says 172.21.15.61:37464) 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.185+0000 7f59e2ffd700 1 -- 172.21.15.61:0/2737779000 learned_addr learned my addr 172.21.15.61:0/2737779000 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59e37fe700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d00051c0 0x7f59e4155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59e2ffd700 1 -- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e4159ac0 msgr2=0x7f59e4159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59e2ffd700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e4159ac0 0x7f59e4159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59e2ffd700 1 -- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d00051c0 msgr2=0x7f59e4155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59e2ffd700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d00051c0 0x7f59e4155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59e2ffd700 1 -- 172.21.15.61:0/2737779000 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e40b3590 con 0x7f59e40c9000 2023-12-24T20:08:39.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59e2ffd700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59e40c9000 0x7f59e40c9470 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0073c0 tx=0x7f59cc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59db7fe700 1 -- 172.21.15.61:0/2737779000 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00f8d0 con 0x7f59e40c9000 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59db7fe700 1 -- 172.21.15.61:0/2737779000 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc00fa30 con 0x7f59e40c9000 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2737779000 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e41562c0 con 0x7f59e40c9000 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59db7fe700 1 -- 172.21.15.61:0/2737779000 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59cc00fdf0 con 0x7f59e40c9000 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.186+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2737779000 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e40b2ab0 con 0x7f59e40c9000 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.187+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2737779000 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e404c3c0 con 0x7f59e40c9000 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.187+0000 7f59db7fe700 1 -- 172.21.15.61:0/2737779000 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7f59cc0135c0 con 0x7f59e40c9000 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.188+0000 7f59db7fe700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f59c4066f30 0x7f59c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.188+0000 7f59db7fe700 1 -- 172.21.15.61:0/2737779000 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f59cc083fc0 con 0x7f59e40c9000 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.188+0000 7f59e37fe700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f59c4066f30 0x7f59c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.189+0000 7f59e37fe700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f59c4066f30 0x7f59c40693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f59d4006f00 tx=0x7f59d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.192 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.192+0000 7f59db7fe700 1 -- 172.21.15.61:0/2737779000 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59cc051530 con 0x7f59e40c9000 2023-12-24T20:08:39.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.387+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2737779000 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f59e40b3240 con 0x7f59e40c9000 2023-12-24T20:08:39.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.391+0000 7f59db7fe700 1 -- 172.21.15.61:0/2737779000 <== mon.0 v2:172.21.15.61:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f59cc001450 con 0x7f59e40c9000 2023-12-24T20:08:39.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.392+0000 7f59db7fe700 1 -- 172.21.15.61:0/2737779000 <== mon.0 v2:172.21.15.61:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f59e40b3240 con 0x7f59e40c9000 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.394+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f59c4066f30 msgr2=0x7f59c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.394+0000 7f59e9bf0700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f59c4066f30 0x7f59c40693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f59d4006f00 tx=0x7f59d4008040 comp rx=0 tx=0).stop 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.394+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2737779000 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59e40c9000 msgr2=0x7f59e40c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.394+0000 7f59e9bf0700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59e40c9000 0x7f59e40c9470 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f59cc0073c0 tx=0x7f59cc001e50 comp rx=0 tx=0).stop 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.394+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2737779000 shutdown_connections 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.394+0000 7f59e9bf0700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7f59e4159ac0 0x7f59e4159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.394+0000 7f59e9bf0700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7f59c4066f30 0x7f59c40693e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.394+0000 7f59e9bf0700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d00051c0 0x7f59e4155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.394+0000 7f59e9bf0700 1 --2- 172.21.15.61:0/2737779000 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f59e40c9000 0x7f59e40c9470 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.394+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2737779000 >> 172.21.15.61:0/2737779000 conn(0x7f59e40ce800 msgr2=0x7f59e40cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:39.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.395+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2737779000 shutdown_connections 2023-12-24T20:08:39.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.395+0000 7f59e9bf0700 1 -- 172.21.15.61:0/2737779000 wait complete. 2023-12-24T20:08:39.407 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-24T20:08:39.407 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-24T20:08:39.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.528+0000 7ff67fc41700 1 Processor -- start 2023-12-24T20:08:39.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.528+0000 7ff67fc41700 1 -- start start 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.529+0000 7ff67fc41700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815bb60 0x7ff678098560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.529+0000 7ff67fc41700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6780b2660 0x7ff6780b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.529+0000 7ff67fc41700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6780b2eb0 con 0x7ff678098aa0 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.529+0000 7ff67fc41700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6780afc20 con 0x7ff6780b2660 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.529+0000 7ff67fc41700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6780b2bd0 con 0x7ff67815bb60 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67e1de700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6780b2660 0x7ff6780b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67d9dd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815bb60 0x7ff678098560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67e1de700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6780b2660 0x7ff6780b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.61:45478/0 (socket says 172.21.15.61:45478) 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67e1de700 1 -- 172.21.15.61:0/1600471660 learned_addr learned my addr 172.21.15.61:0/1600471660 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67d9dd700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815bb60 0x7ff678098560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3301/0 says I am v2:172.21.15.61:60946/0 (socket says 172.21.15.61:60946) 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67d1dc700 1 --1- 172.21.15.61:0/1600471660 >> v1:172.21.15.133:6789/0 conn(0x7ff678098aa0 0x7ff67815bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.61:44424/0 (socket says 172.21.15.61:44424) 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67e1de700 1 -- 172.21.15.61:0/1600471660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815bb60 msgr2=0x7ff678098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67e1de700 1 --2- 172.21.15.61:0/1600471660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815bb60 0x7ff678098560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67e1de700 1 -- 172.21.15.61:0/1600471660 >> v1:172.21.15.133:6789/0 conn(0x7ff678098aa0 legacy=0x7ff67815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67e1de700 1 -- 172.21.15.61:0/1600471660 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6780afe10 con 0x7ff6780b2660 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67d9dd700 1 --2- 172.21.15.61:0/1600471660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815bb60 0x7ff678098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67c9db700 1 -- 172.21.15.61:0/1600471660 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802621156 0 0) 0x7ff6780b2eb0 con 0x7ff678098aa0 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67e1de700 1 --2- 172.21.15.61:0/1600471660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6780b2660 0x7ff6780b08f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff670009f20 tx=0x7ff670009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d5eaefbb0ea4b18 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67c9db700 1 -- 172.21.15.61:0/1600471660 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67000e070 con 0x7ff6780b2660 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67c9db700 1 -- 172.21.15.61:0/1600471660 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff67000b9d0 con 0x7ff6780b2660 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.530+0000 7ff67c9db700 1 -- 172.21.15.61:0/1600471660 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6700092e0 con 0x7ff6780b2660 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.531+0000 7ff67fc41700 1 -- 172.21.15.61:0/1600471660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6780b2660 msgr2=0x7ff6780b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.531+0000 7ff67fc41700 1 --2- 172.21.15.61:0/1600471660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6780b2660 0x7ff6780b08f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff670009f20 tx=0x7ff670009840 comp rx=0 tx=0).stop 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.531+0000 7ff67fc41700 1 -- 172.21.15.61:0/1600471660 shutdown_connections 2023-12-24T20:08:39.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.531+0000 7ff67fc41700 1 --2- 172.21.15.61:0/1600471660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6780b2660 0x7ff6780b08f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.534 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.531+0000 7ff67fc41700 1 --2- 172.21.15.61:0/1600471660 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff67815bb60 0x7ff678098560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.534 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.531+0000 7ff67fc41700 1 -- 172.21.15.61:0/1600471660 >> 172.21.15.61:0/1600471660 conn(0x7ff678097a10 msgr2=0x7ff6780ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:39.534 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.531+0000 7ff67fc41700 1 -- 172.21.15.61:0/1600471660 shutdown_connections 2023-12-24T20:08:39.534 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.531+0000 7ff67fc41700 1 -- 172.21.15.61:0/1600471660 wait complete. 2023-12-24T20:08:39.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.532+0000 7ff67fc41700 1 Processor -- start 2023-12-24T20:08:39.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.532+0000 7ff67fc41700 1 -- start start 2023-12-24T20:08:39.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67fc41700 1 --2- >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff678098aa0 0x7ff6780ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67fc41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6780b2660 0x7ff6780abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67fc41700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff67815bb60 0x7ff678168220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67fc41700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff678169590 con 0x7ff67815bb60 2023-12-24T20:08:39.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67fc41700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff678169830 con 0x7ff6780b2660 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67fc41700 1 -- --> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff678169b10 con 0x7ff678098aa0 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67e1de700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff67815bb60 0x7ff678168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67e1de700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff67815bb60 0x7ff678168220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:37468/0 (socket says 172.21.15.61:37468) 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67e1de700 1 -- 172.21.15.61:0/2113638968 learned_addr learned my addr 172.21.15.61:0/2113638968 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67d9dd700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff678098aa0 0x7ff6780ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.533+0000 7ff67d1dc700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6780b2660 0x7ff6780abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff67e1de700 1 -- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff678098aa0 msgr2=0x7ff6780ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff67e1de700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff678098aa0 0x7ff6780ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff67e1de700 1 -- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6780b2660 msgr2=0x7ff6780abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff67e1de700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6780b2660 0x7ff6780abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff67e1de700 1 -- 172.21.15.61:0/2113638968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6680093c0 con 0x7ff67815bb60 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff67e1de700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff67815bb60 0x7ff678168220 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7ff67000b610 tx=0x7ff670009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff66dffb700 1 -- 172.21.15.61:0/2113638968 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670008b10 con 0x7ff67815bb60 2023-12-24T20:08:39.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff66dffb700 1 -- 172.21.15.61:0/2113638968 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff670008c90 con 0x7ff67815bb60 2023-12-24T20:08:39.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff66dffb700 1 -- 172.21.15.61:0/2113638968 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6700256d0 con 0x7ff67815bb60 2023-12-24T20:08:39.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff67fc41700 1 -- 172.21.15.61:0/2113638968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff670009ae0 con 0x7ff67815bb60 2023-12-24T20:08:39.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.534+0000 7ff67fc41700 1 -- 172.21.15.61:0/2113638968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67816a0d0 con 0x7ff67815bb60 2023-12-24T20:08:39.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.535+0000 7ff67fc41700 1 -- 172.21.15.61:0/2113638968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67806d440 con 0x7ff67815bb60 2023-12-24T20:08:39.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.536+0000 7ff66dffb700 1 -- 172.21.15.61:0/2113638968 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 84742+0+0 (secure 0 0 0) 0x7ff670003040 con 0x7ff67815bb60 2023-12-24T20:08:39.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.536+0000 7ff66dffb700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff65c066f30 0x7ff65c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-24T20:08:39.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.536+0000 7ff66dffb700 1 -- 172.21.15.61:0/2113638968 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff670085e10 con 0x7ff67815bb60 2023-12-24T20:08:39.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.536+0000 7ff67d9dd700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff65c066f30 0x7ff65c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-24T20:08:39.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.537+0000 7ff67d9dd700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff65c066f30 0x7ff65c0693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff668009f30 tx=0x7ff668009120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-24T20:08:39.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.540+0000 7ff66dffb700 1 -- 172.21.15.61:0/2113638968 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff670053430 con 0x7ff67815bb60 2023-12-24T20:08:39.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.777+0000 7ff67fc41700 1 -- 172.21.15.61:0/2113638968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff67816a2c0 con 0x7ff67815bb60 2023-12-24T20:08:39.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.778+0000 7ff66dffb700 1 -- 172.21.15.61:0/2113638968 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+3532 (secure 0 0 0) 0x7ff670020de0 con 0x7ff67815bb60 2023-12-24T20:08:39.778 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-12-24T20:08:39.778 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":94,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1018177900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1018177900},{"type":"v1","addr":"172.21.15.133:6836","nonce":1018177900}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":7543,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2451550561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2451550561},{"type":"v1","addr":"172.21.15.133:6837","nonce":2451550561}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8136,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6834/2332940307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2332940307},{"type":"v1","addr":"172.21.15.61:6834","nonce":2332940307}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8139,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6835/784121250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6833","nonce":784121250},{"type":"v1","addr":"172.21.15.61:6835","nonce":784121250}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[]} 2023-12-24T20:08:39.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 -- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff65c066f30 msgr2=0x7ff65c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff65c066f30 0x7ff65c0693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff668009f30 tx=0x7ff668009120 comp rx=0 tx=0).stop 2023-12-24T20:08:39.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 -- 172.21.15.61:0/2113638968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff67815bb60 msgr2=0x7ff678168220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-24T20:08:39.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff67815bb60 0x7ff678168220 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7ff67000b610 tx=0x7ff670009840 comp rx=0 tx=0).stop 2023-12-24T20:08:39.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 -- 172.21.15.61:0/2113638968 shutdown_connections 2023-12-24T20:08:39.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x7ff678098aa0 0x7ff6780ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:6832/39914,v1:172.21.15.133:6833/39914] conn(0x7ff65c066f30 0x7ff65c0693e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff67815bb60 0x7ff678168220 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 --2- 172.21.15.61:0/2113638968 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6780b2660 0x7ff6780abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-24T20:08:39.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 -- 172.21.15.61:0/2113638968 >> 172.21.15.61:0/2113638968 conn(0x7ff678097a10 msgr2=0x7ff67806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-24T20:08:39.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 -- 172.21.15.61:0/2113638968 shutdown_connections 2023-12-24T20:08:39.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-12-24T20:08:39.780+0000 7ff67fc41700 1 -- 172.21.15.61:0/2113638968 wait complete. 2023-12-24T20:08:39.783 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 94 2023-12-24T20:08:39.792 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-24T20:08:39.793 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-24T20:08:39.793 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-24T20:08:39.793 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:39.801 INFO:tasks.ceph.mds.a:Stopped 2023-12-24T20:08:39.802 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-24T20:08:39.802 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:39.850 INFO:tasks.ceph.mds.c:Stopped 2023-12-24T20:08:39.850 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-24T20:08:39.851 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:39.861 INFO:tasks.ceph.mds.b:Stopped 2023-12-24T20:08:39.861 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-24T20:08:39.862 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:39.912 INFO:tasks.ceph.mds.d:Stopped 2023-12-24T20:08:39.912 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-24T20:08:39.913 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-24T20:08:39.913 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:39.933 INFO:tasks.ceph.osd.0:Stopped 2023-12-24T20:08:39.933 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-24T20:08:39.933 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:39.995 INFO:tasks.ceph.osd.1:Stopped 2023-12-24T20:08:39.995 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-24T20:08:39.996 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.059 INFO:tasks.ceph.osd.2:Stopped 2023-12-24T20:08:40.059 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-24T20:08:40.059 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.117 INFO:tasks.ceph.osd.3:Stopped 2023-12-24T20:08:40.118 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-24T20:08:40.118 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.139 INFO:tasks.ceph.osd.4:Stopped 2023-12-24T20:08:40.139 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-24T20:08:40.139 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.198 INFO:tasks.ceph.osd.5:Stopped 2023-12-24T20:08:40.198 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-24T20:08:40.198 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.260 INFO:tasks.ceph.osd.6:Stopped 2023-12-24T20:08:40.260 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-24T20:08:40.260 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.320 INFO:tasks.ceph.osd.7:Stopped 2023-12-24T20:08:40.320 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-24T20:08:40.321 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-24T20:08:40.321 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.343 INFO:tasks.ceph.mgr.y:Stopped 2023-12-24T20:08:40.343 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-24T20:08:40.343 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.387 INFO:tasks.ceph.mgr.x:Stopped 2023-12-24T20:08:40.387 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-24T20:08:40.387 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-24T20:08:40.387 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.398 INFO:tasks.ceph.mon.a:Stopped 2023-12-24T20:08:40.398 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-24T20:08:40.398 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.440 INFO:tasks.ceph.mon.b:Stopped 2023-12-24T20:08:40.440 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-24T20:08:40.440 INFO:teuthology.orchestra.run:waiting for 300 2023-12-24T20:08:40.491 INFO:tasks.ceph.mon.c:Stopped 2023-12-24T20:08:40.492 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-24T20:08:40.492 DEBUG:teuthology.orchestra.run.smithi061:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-24T20:08:40.528 INFO:teuthology.orchestra.run.smithi061.stdout:1703447813.2546344 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 215993.357772 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-12-24T20:08:40.528 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-12-24T20:08:40.529 DEBUG:teuthology.orchestra.run.smithi061:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-24T20:08:40.606 DEBUG:teuthology.orchestra.run.smithi061:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-24T20:08:40.682 DEBUG:teuthology.orchestra.run.smithi061:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-24T20:08:40.758 INFO:teuthology.orchestra.run.smithi061.stdout:1703447813.2546344 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 215993.357772 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-12-24T20:08:40.759 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:08:40.759 DEBUG:teuthology.orchestra.run.smithi061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-24T20:08:40.985 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:08:40.985 DEBUG:teuthology.orchestra.run.smithi061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-24T20:08:41.084 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:08:41.084 DEBUG:teuthology.orchestra.run.smithi061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-24T20:08:41.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:08:41.211 DEBUG:teuthology.orchestra.run.smithi061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-24T20:08:41.298 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:08:41.298 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-24T20:08:41.436 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:08:41.436 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-24T20:08:41.553 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:08:41.554 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-24T20:08:41.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:08:41.618 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-24T20:08:41.685 INFO:tasks.ceph:Archiving mon data... 2023-12-24T20:08:41.687 DEBUG:teuthology.misc:Transferring archived files from smithi061:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456/data/mon.a.tgz 2023-12-24T20:08:41.687 DEBUG:teuthology.orchestra.run.smithi061:> mktemp 2023-12-24T20:08:41.705 INFO:teuthology.orchestra.run.smithi061.stdout:/tmp/tmp.aXotzn6G7l 2023-12-24T20:08:41.705 DEBUG:teuthology.orchestra.run.smithi061:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.aXotzn6G7l 2023-12-24T20:08:41.857 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 0666 /tmp/tmp.aXotzn6G7l 2023-12-24T20:08:41.946 DEBUG:teuthology.orchestra.remote:smithi061:/tmp/tmp.aXotzn6G7l is 375KB 2023-12-24T20:08:42.044 DEBUG:teuthology.orchestra.run.smithi061:> rm -fr /tmp/tmp.aXotzn6G7l 2023-12-24T20:08:42.061 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456/data/mon.b.tgz 2023-12-24T20:08:42.061 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-24T20:08:42.081 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.9kmVwwN68M 2023-12-24T20:08:42.081 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9kmVwwN68M 2023-12-24T20:08:42.224 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.9kmVwwN68M 2023-12-24T20:08:42.311 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.9kmVwwN68M is 376KB 2023-12-24T20:08:42.407 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.9kmVwwN68M 2023-12-24T20:08:42.424 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456/data/mon.c.tgz 2023-12-24T20:08:42.424 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-24T20:08:42.482 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.PDNPtgy3B9 2023-12-24T20:08:42.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.PDNPtgy3B9 2023-12-24T20:08:42.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.PDNPtgy3B9 2023-12-24T20:08:42.699 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.PDNPtgy3B9 is 376KB 2023-12-24T20:08:42.796 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.PDNPtgy3B9 2023-12-24T20:08:42.813 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-24T20:08:42.813 DEBUG:teuthology.orchestra.run.smithi061:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-24T20:08:42.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-24T20:08:42.879 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-24T20:08:42.880 DEBUG:teuthology.orchestra.run.smithi061:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-24T20:08:42.890 DEBUG:teuthology.orchestra.run.smithi133:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-24T20:08:42.921 INFO:teuthology.orchestra.run.smithi061.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-24T20:08:42.947 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-24T20:08:42.953 INFO:tasks.ceph:Archiving crash dumps... 2023-12-24T20:08:42.954 DEBUG:teuthology.misc:Transferring archived files from smithi061:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456/remote/smithi061/crash 2023-12-24T20:08:42.955 DEBUG:teuthology.orchestra.run.smithi061:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-24T20:08:43.001 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456/remote/smithi133/crash 2023-12-24T20:08:43.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-24T20:08:43.028 INFO:tasks.ceph:Shutting down logrotate 2023-12-24T20:08:43.029 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:43.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:43.141 DEBUG:teuthology.orchestra.run.smithi061:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:43.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-24T20:08:43.197 INFO:tasks.ceph:Compressing logs... 2023-12-24T20:08:43.197 DEBUG:teuthology.orchestra.run.smithi061:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-24T20:08:43.213 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-24T20:08:43.241 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54146.log 2023-12-24T20:08:43.242 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56163.log 2023-12-24T20:08:43.242 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41192.log 2023-12-24T20:08:43.242 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54146.log.gz 2023-12-24T20:08:43.242 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2023-12-24T20:08:43.242 INFO:teuthology.orchestra.run.smithi061.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56163.log.gz 2023-12-24T20:08:43.255 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77425.log 2023-12-24T20:08:43.255 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50639.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41192.log.gz 2023-12-24T20:08:43.255 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75125.log 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58594.log 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75125.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77425.log.gz 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43333.log 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58594.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75125.log.gz 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51086.log 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58594.log.gz 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78554.log 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43333.log: /var/log/ceph/ceph-client.admin.51086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72678.log 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43333.log.gz 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51086.log.gz 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78370.log 2023-12-24T20:08:43.256 INFO:teuthology.orchestra.run.smithi061.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78554.log.gz 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42552.log 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78370.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72678.log.gz 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49703.log 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78370.log.gz 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48909.log 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42552.log.gz 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67776.log 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.48909.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49703.log.gz 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73337.log 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67776.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48909.log.gz 2023-12-24T20:08:43.257 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75631.log 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.67776.log.gz 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.73337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79081.log 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75631.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73337.log.gz 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58410.log 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75631.log.gz 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.79081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62770.log 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.79081.log.gz 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49906.log 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62770.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58410.log.gz 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40721.log 2023-12-24T20:08:43.258 INFO:teuthology.orchestra.run.smithi061.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62770.log.gz 2023-12-24T20:08:43.259 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63520.log 2023-12-24T20:08:43.259 INFO:teuthology.orchestra.run.smithi061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49906.log.gz 2023-12-24T20:08:43.259 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.40721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42199.log 2023-12-24T20:08:43.259 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63520.log: 89.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.40721.log.gz--verbose 2023-12-24T20:08:43.259 INFO:teuthology.orchestra.run.smithi061.stderr:-- /var/log/ceph/ceph-client.admin.59389.log 2023-12-24T20:08:43.259 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42199.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-24T20:08:43.259 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42199.log.gz 2023-12-24T20:08:43.259 INFO:teuthology.orchestra.run.smithi061.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63520.log.gz 2023-12-24T20:08:43.260 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52427.log 2023-12-24T20:08:43.260 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-mon.a.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59389.log.gz 2023-12-24T20:08:43.260 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2023-12-24T20:08:43.260 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77563.log 2023-12-24T20:08:43.260 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43241.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52427.log.gz 2023-12-24T20:08:43.260 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73868.log 2023-12-24T20:08:43.261 INFO:teuthology.orchestra.run.smithi061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2023-12-24T20:08:43.261 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55730.log 2023-12-24T20:08:43.261 INFO:teuthology.orchestra.run.smithi061.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77563.log.gz 2023-12-24T20:08:43.261 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55638.log 2023-12-24T20:08:43.261 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.73868.log: /var/log/ceph/ceph-client.admin.55730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57115.log 2023-12-24T20:08:43.261 INFO:teuthology.orchestra.run.smithi061.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73868.log.gz 2023-12-24T20:08:43.261 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55638.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55730.log.gz 2023-12-24T20:08:43.261 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68824.log 2023-12-24T20:08:43.261 INFO:teuthology.orchestra.run.smithi061.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55638.log.gz 2023-12-24T20:08:43.261 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.57115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61455.log 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57115.log.gz 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75355.log 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68824.log.gz 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72448.log 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75355.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61455.log.gz 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41769.log 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75355.log.gz 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65516.log 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72448.log.gz 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53312.log 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41769.log.gz 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47289.log 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65516.log.gz 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69254.log 2023-12-24T20:08:43.262 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53312.log: /var/log/ceph/ceph-client.admin.47289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45693.log 2023-12-24T20:08:43.263 INFO:teuthology.orchestra.run.smithi061.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53312.log.gz 2023-12-24T20:08:43.263 INFO:teuthology.orchestra.run.smithi061.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47289.log.gz 2023-12-24T20:08:43.263 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45647.log 2023-12-24T20:08:43.263 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47335.log 2023-12-24T20:08:43.263 INFO:teuthology.orchestra.run.smithi061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69254.log.gz 2023-12-24T20:08:43.263 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45693.log.gz 2023-12-24T20:08:43.263 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73157.log 2023-12-24T20:08:43.263 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45647.log.gz 2023-12-24T20:08:43.263 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64382.log 2023-12-24T20:08:43.263 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.73157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56780.log 2023-12-24T20:08:43.264 INFO:teuthology.orchestra.run.smithi061.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47335.log.gz 2023-12-24T20:08:43.264 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56834.log 2023-12-24T20:08:43.278 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-24T20:08:43.279 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47912.log 2023-12-24T20:08:43.279 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43667.log 2023-12-24T20:08:43.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.1.47912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46446.log 2023-12-24T20:08:43.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.43667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45064.log 2023-12-24T20:08:43.279 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47132.log 2023-12-24T20:08:43.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.46446.log: /var/log/ceph/ceph-client.1.45064.log: /var/log/ceph/ceph-client.1.47132.log: 91.0% -- replaced with /var/log/ceph/ceph-client.1.43667.log.gz 2023-12-24T20:08:43.279 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.1.46446.log.gz 2023-12-24T20:08:43.279 INFO:teuthology.orchestra.run.smithi133.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.1.47912.log.gz 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.1.45064.log.gz 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.1.47132.log.gz 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40125.log 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40365.log 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40125.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40125.log.gz 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45772.log 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40320.log 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40365.log.gz 2023-12-24T20:08:43.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.45772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40173.log 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40320.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40173.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40320.log.gz 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40173.log.gz 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.d.log: 91.0% -- replaced with /var/log/ceph/ceph-client.1.45772.log.gz 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mon.c.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40274.log 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.40274.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40274.log.gz 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mon.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-24T20:08:43.281 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48686.log 2023-12-24T20:08:43.282 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.48686.log: 93.0% -- replaced with /var/log/ceph/ceph-client.1.48686.log.gz 2023-12-24T20:08:43.282 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41637.log 2023-12-24T20:08:43.287 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.41637.log: 89.0% -- replaced with /var/log/ceph/ceph-client.1.41637.log.gz 2023-12-24T20:08:43.287 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42247.log 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.3.42247.log: 88.4% -- replaced with /var/log/ceph/ceph-client.3.42247.log.gz 2023-12-24T20:08:43.288 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44343.log 2023-12-24T20:08:43.292 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.44343.log: 93.2% -- replaced with /var/log/ceph/ceph-client.1.44343.log.gz 2023-12-24T20:08:43.292 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40221.log 2023-12-24T20:08:43.292 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40221.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40221.log.gz 2023-12-24T20:08:43.292 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43000.log 2023-12-24T20:08:43.293 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.43000.log: 88.6% -- replaced with /var/log/ceph/ceph-client.1.43000.log.gz 2023-12-24T20:08:43.293 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-24T20:08:43.299 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-24T20:08:43.305 INFO:teuthology.orchestra.run.smithi061.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64382.log.gz 2023-12-24T20:08:43.305 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59165.log 2023-12-24T20:08:43.306 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56834.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56780.log.gz 2023-12-24T20:08:43.306 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68251.log 2023-12-24T20:08:43.306 INFO:teuthology.orchestra.run.smithi061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56834.log.gz 2023-12-24T20:08:43.306 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60160.log 2023-12-24T20:08:43.306 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68251.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59165.log.gz 2023-12-24T20:08:43.306 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63058.log 2023-12-24T20:08:43.306 INFO:teuthology.orchestra.run.smithi061.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68251.log.gz 2023-12-24T20:08:43.306 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.60160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42197.log 2023-12-24T20:08:43.306 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63058.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60160.log.gz 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54378.log 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63058.log.gz 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67532.log 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54378.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42197.log.gz 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76336.log 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54378.log.gz 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60001.log 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76336.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67532.log.gz 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74506.log 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76336.log.gz 2023-12-24T20:08:43.307 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.60001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72185.log 2023-12-24T20:08:43.308 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74506.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60001.log.gz 2023-12-24T20:08:43.308 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52741.log 2023-12-24T20:08:43.308 INFO:teuthology.orchestra.run.smithi061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74506.log.gz 2023-12-24T20:08:43.308 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45463.log 2023-12-24T20:08:43.308 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56545.log 2023-12-24T20:08:43.308 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52741.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72185.log.gz 2023-12-24T20:08:43.308 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45463.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52741.log.gz 2023-12-24T20:08:43.308 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75171.log 2023-12-24T20:08:43.308 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56545.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45463.log.gzgzip 2023-12-24T20:08:43.308 INFO:teuthology.orchestra.run.smithi061.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.47631.log 2023-12-24T20:08:43.309 INFO:teuthology.orchestra.run.smithi061.stderr: 87.6%/var/log/ceph/ceph-client.admin.75171.log: -- replaced with /var/log/ceph/ceph-client.admin.56545.log.gz 2023-12-24T20:08:43.309 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64203.log 2023-12-24T20:08:43.309 INFO:teuthology.orchestra.run.smithi061.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75171.log.gz 2023-12-24T20:08:43.309 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70898.log 2023-12-24T20:08:43.309 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71082.log 2023-12-24T20:08:43.309 INFO:teuthology.orchestra.run.smithi061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47631.log.gz 2023-12-24T20:08:43.309 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.70898.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64203.log.gz 2023-12-24T20:08:43.309 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43425.log 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70898.log.gz 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48751.log 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.71082.log.gz 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52695.log 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.48751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79037.log 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43425.log.gz 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52695.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48751.log.gz 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47012.log 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr: 88.4%/var/log/ceph/ceph-client.admin.79037.log: -- replaced with /var/log/ceph/ceph-client.admin.52695.log.gz 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70603.log 2023-12-24T20:08:43.310 INFO:teuthology.orchestra.run.smithi061.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.79037.log.gz 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67036.log 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47012.log.gz 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.70603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59075.log 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.67036.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70603.log.gz 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48955.log 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42965.log 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.48955.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59075.log.gz 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48955.log.gz 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42965.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42965.log.gz 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46039.log 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77860.log 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69496.log 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77860.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46039.log.gz 2023-12-24T20:08:43.311 INFO:teuthology.orchestra.run.smithi061.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77860.log.gz 2023-12-24T20:08:43.312 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45417.log 2023-12-24T20:08:43.312 INFO:teuthology.orchestra.run.smithi061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69496.log.gz 2023-12-24T20:08:43.312 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69450.log 2023-12-24T20:08:43.312 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45417.log: /var/log/ceph/ceph-client.admin.69450.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45417.log.gz 2023-12-24T20:08:43.312 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54286.log 2023-12-24T20:08:43.312 INFO:teuthology.orchestra.run.smithi061.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69450.log.gz 2023-12-24T20:08:43.312 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59771.log 2023-12-24T20:08:43.312 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50499.log 2023-12-24T20:08:43.312 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54286.log: /var/log/ceph/ceph-client.admin.59771.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54286.log.gz 2023-12-24T20:08:43.312 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50499.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59771.log.gz 2023-12-24T20:08:43.313 INFO:teuthology.orchestra.run.smithi061.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50499.log.gz 2023-12-24T20:08:43.313 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67216.log 2023-12-24T20:08:43.313 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46331.log 2023-12-24T20:08:43.313 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69912.log 2023-12-24T20:08:43.313 INFO:teuthology.orchestra.run.smithi061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67216.log.gz 2023-12-24T20:08:43.313 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46331.log: /var/log/ceph/ceph-client.admin.69912.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46331.log.gz 2023-12-24T20:08:43.313 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42203.log 2023-12-24T20:08:43.314 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73960.log 2023-12-24T20:08:43.314 INFO:teuthology.orchestra.run.smithi061.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69912.log.gz 2023-12-24T20:08:43.314 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42203.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-24T20:08:43.314 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.73960.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42203.log.gz 2023-12-24T20:08:43.314 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-mds.c.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.73960.log.gz 2023-12-24T20:08:43.314 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54516.log 2023-12-24T20:08:43.314 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47105.log 2023-12-24T20:08:43.314 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66373.log 2023-12-24T20:08:43.315 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47105.log: /var/log/ceph/ceph-client.admin.66373.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47105.log.gz 2023-12-24T20:08:43.315 INFO:teuthology.orchestra.run.smithi061.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54516.log.gz 2023-12-24T20:08:43.315 INFO:teuthology.orchestra.run.smithi061.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66373.log.gz 2023-12-24T20:08:43.315 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53220.log 2023-12-24T20:08:43.315 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69682.log 2023-12-24T20:08:43.315 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43103.log 2023-12-24T20:08:43.315 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69682.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53220.log.gz 2023-12-24T20:08:43.315 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43103.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.69682.log.gz 2023-12-24T20:08:43.315 INFO:teuthology.orchestra.run.smithi061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43103.log.gz 2023-12-24T20:08:43.315 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44899.log 2023-12-24T20:08:43.316 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54903.log 2023-12-24T20:08:43.316 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.2.44899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60206.log 2023-12-24T20:08:43.316 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.54903.log: /var/log/ceph/ceph-client.admin.60206.log: 90.0% -- replaced with /var/log/ceph/ceph-client.2.44899.log.gz 2023-12-24T20:08:43.316 INFO:teuthology.orchestra.run.smithi061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60206.log.gz 2023-12-24T20:08:43.316 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74276.log 2023-12-24T20:08:43.316 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40074.log 2023-12-24T20:08:43.316 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74276.log: 88.2%/var/log/ceph/ceph-client.admin.40074.log: -- replaced with /var/log/ceph/ceph-client.admin.74276.log.gz 2023-12-24T20:08:43.316 INFO:teuthology.orchestra.run.smithi061.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.40074.log.gz 2023-12-24T20:08:43.316 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57299.log 2023-12-24T20:08:43.316 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58935.log 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.57299.log: /var/log/ceph/ceph-client.admin.58935.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58935.log.gz 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.57299.log.gz 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43471.log 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63474.log 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.0.73157.log.gz 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43471.log: /var/log/ceph/ceph-client.admin.63474.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43471.log.gz 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63474.log.gz 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68940.log 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42206.log 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51612.log 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42206.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68940.log.gz 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42206.log.gz 2023-12-24T20:08:43.317 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.51612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54424.log 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55868.log 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54424.log: /var/log/ceph/ceph-client.admin.55868.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54424.log.gz 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55868.log.gz 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58704.log 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49381.log 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58704.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58704.log.gz 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49381.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49381.log.gz 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76514.log 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56591.log 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76514.log: /var/log/ceph/ceph-client.admin.56591.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76514.log.gz 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56591.log.gz 2023-12-24T20:08:43.318 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74577.log 2023-12-24T20:08:43.319 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48117.log 2023-12-24T20:08:43.319 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74577.log: /var/log/ceph/ceph-client.admin.48117.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74577.log.gz 2023-12-24T20:08:43.319 INFO:teuthology.orchestra.run.smithi061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48117.log.gz 2023-12-24T20:08:43.319 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41401.log 2023-12-24T20:08:43.319 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71607.log 2023-12-24T20:08:43.319 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41401.log: /var/log/ceph/ceph-client.admin.71607.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41401.log.gz 2023-12-24T20:08:43.319 INFO:teuthology.orchestra.run.smithi061.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71607.log.gz 2023-12-24T20:08:43.319 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73684.log 2023-12-24T20:08:43.319 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71999.log 2023-12-24T20:08:43.319 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.73684.log: /var/log/ceph/ceph-client.admin.71999.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73684.log.gz 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42873.log 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71999.log.gz 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41355.log 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42873.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42873.log.gz 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40961.log 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41355.log.gz 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.40961.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40961.log.gz 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60252.log 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41008.log 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.60252.log: /var/log/ceph/ceph-client.admin.41008.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.60252.log.gz 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41008.log.gz 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55932.log 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45039.log 2023-12-24T20:08:43.320 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55932.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55932.log.gz 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45039.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45039.log.gz 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54100.log 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42804.log 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54100.log: /var/log/ceph/ceph-client.admin.42804.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54100.log.gz 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42804.log.gz 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66086.log 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62432.log 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66086.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66086.log.gz/var/log/ceph/ceph-client.admin.62432.log: 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62432.log.gz 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74165.log 2023-12-24T20:08:43.321 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55592.log 2023-12-24T20:08:43.322 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74165.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74165.log.gz 2023-12-24T20:08:43.322 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55592.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55592.log.gz 2023-12-24T20:08:43.322 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53358.log 2023-12-24T20:08:43.323 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.49391.log 2023-12-24T20:08:43.329 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.1.49391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40413.log 2023-12-24T20:08:43.329 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.1.49391.log.gz 2023-12-24T20:08:43.337 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49611.log 2023-12-24T20:08:43.338 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53358.log: /var/log/ceph/ceph-client.admin.49611.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53358.log.gz 2023-12-24T20:08:43.339 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68389.log 2023-12-24T20:08:43.339 INFO:teuthology.orchestra.run.smithi061.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49611.log.gz 2023-12-24T20:08:43.339 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78830.log 2023-12-24T20:08:43.339 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68389.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68389.log.gz 2023-12-24T20:08:43.339 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67822.log 2023-12-24T20:08:43.339 INFO:teuthology.orchestra.run.smithi061.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78830.log.gz 2023-12-24T20:08:43.339 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67822.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67822.log.gz 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71266.log 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57023.log 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71266.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71266.log.gz 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.57023.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57023.log.gz 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77655.log 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52971.log 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77655.log: 87.9%/var/log/ceph/ceph-client.admin.52971.log: -- replaced with /var/log/ceph/ceph-client.admin.77655.log.gz 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52971.log.gz 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68113.log 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74845.log 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68113.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68113.log.gz 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74845.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74845.log.gz 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75309.log 2023-12-24T20:08:43.340 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50854.log 2023-12-24T20:08:43.341 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75309.log: 95.0% -- replaced with /var/log/ceph/ceph-client.0.67036.log.gz 2023-12-24T20:08:43.341 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62548.log 2023-12-24T20:08:43.341 INFO:teuthology.orchestra.run.smithi061.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75309.log.gz 2023-12-24T20:08:43.341 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74753.log 2023-12-24T20:08:43.341 INFO:teuthology.orchestra.run.smithi061.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50854.log.gz 2023-12-24T20:08:43.341 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62724.log 2023-12-24T20:08:43.341 INFO:teuthology.orchestra.run.smithi061.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62548.log.gz 2023-12-24T20:08:43.341 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69774.log 2023-12-24T20:08:43.342 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62724.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.74753.log.gz 2023-12-24T20:08:43.342 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62724.log.gz 2023-12-24T20:08:43.342 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47677.log 2023-12-24T20:08:43.342 INFO:teuthology.orchestra.run.smithi061.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69774.log.gz 2023-12-24T20:08:43.342 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56254.log 2023-12-24T20:08:43.342 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55083.log 2023-12-24T20:08:43.343 INFO:teuthology.orchestra.run.smithi061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47677.log.gz 2023-12-24T20:08:43.343 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56254.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-24T20:08:43.343 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55083.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56254.log.gz 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55083.log.gz 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77517.log 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60819.log 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77517.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77517.log.gz 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.60819.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60819.log.gz 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59863.log 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78738.log 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59863.log: /var/log/ceph/ceph-client.admin.78738.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59863.log.gz 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78738.log.gz 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53764.log 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61342.log 2023-12-24T20:08:43.344 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53764.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53764.log.gz 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61342.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61342.log.gz 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62294.log 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46791.log 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62294.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62294.log.gz 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46791.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46791.log.gz 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79127.log 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45370.log 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.79127.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79127.log.gz 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45370.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45370.log.gz 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41054.log 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74119.log 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41054.log: /var/log/ceph/ceph-client.admin.74119.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41054.log.gz 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74119.log.gz 2023-12-24T20:08:43.345 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76904.log 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53474.log 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76904.log: /var/log/ceph/ceph-client.admin.53474.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76904.log.gz 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53474.log.gz 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70479.log 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75447.log 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.70479.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70479.log.gz 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75447.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75447.log.gz 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59677.log 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59817.log 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59677.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59677.log.gz 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59817.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59817.log.gz 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58502.log 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58502.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58502.log.gz 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47058.log 2023-12-24T20:08:43.346 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68297.log 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47058.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47058.log.gz 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68297.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68297.log.gz 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42205.log 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75079.log 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42205.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42205.log.gz 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75079.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75079.log.gz 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65083.log 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47427.log 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65083.log: /var/log/ceph/ceph-client.admin.47427.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65083.log.gz 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47427.log.gz 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77333.log 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58318.log 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77333.log: /var/log/ceph/ceph-client.admin.58318.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77333.log.gz 2023-12-24T20:08:43.347 INFO:teuthology.orchestra.run.smithi061.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58318.log.gz 2023-12-24T20:08:43.348 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49859.log 2023-12-24T20:08:43.348 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65768.log 2023-12-24T20:08:43.349 INFO:teuthology.orchestra.run.smithi133.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-24T20:08:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40413.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40413.log.gz 2023-12-24T20:08:43.350 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49859.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49859.log.gz 2023-12-24T20:08:43.350 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66226.log 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65768.log.gz 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78600.log 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66226.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.66226.log.gz 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78600.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78600.log.gz 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71174.log 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49998.log 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71174.log: /var/log/ceph/ceph-client.admin.49998.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71174.log.gz 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49998.log.gz 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61000.log 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-24T20:08:43.351 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61000.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61000.log.gz 2023-12-24T20:08:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40459.log 2023-12-24T20:08:43.352 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50090.log 2023-12-24T20:08:43.353 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50090.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50090.log.gz 2023-12-24T20:08:43.354 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70533.log 2023-12-24T20:08:43.354 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.70533.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70533.log.gz 2023-12-24T20:08:43.355 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48001.log 2023-12-24T20:08:43.356 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.48001.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48001.log.gz 2023-12-24T20:08:43.356 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56414.log 2023-12-24T20:08:43.357 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56414.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56414.log.gz 2023-12-24T20:08:43.357 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64945.log 2023-12-24T20:08:43.358 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64945.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64945.log.gz 2023-12-24T20:08:43.358 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55454.log 2023-12-24T20:08:43.359 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55454.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55454.log.gz 2023-12-24T20:08:43.359 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68686.log 2023-12-24T20:08:43.360 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68686.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68686.log.gz 2023-12-24T20:08:43.361 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52925.log 2023-12-24T20:08:43.362 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52925.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52925.log.gz 2023-12-24T20:08:43.362 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61907.log 2023-12-24T20:08:43.362 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61907.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61907.log.gz 2023-12-24T20:08:43.362 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59585.log 2023-12-24T20:08:43.363 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59585.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59585.log.gz 2023-12-24T20:08:43.363 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64853.log 2023-12-24T20:08:43.364 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40459.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40459.log.gz 2023-12-24T20:08:43.364 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64853.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64853.log.gz 2023-12-24T20:08:43.364 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67308.log 2023-12-24T20:08:43.365 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67308.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67308.log.gz 2023-12-24T20:08:43.365 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45601.log 2023-12-24T20:08:43.366 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45601.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45601.log.gz 2023-12-24T20:08:43.366 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77471.log 2023-12-24T20:08:43.367 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71515.log 2023-12-24T20:08:43.368 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77471.log: /var/log/ceph/ceph-client.admin.71515.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77471.log.gz 2023-12-24T20:08:43.368 INFO:teuthology.orchestra.run.smithi061.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71515.log.gz 2023-12-24T20:08:43.368 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42194.log 2023-12-24T20:08:43.368 INFO:teuthology.orchestra.run.smithi133.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-24T20:08:43.369 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42194.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42194.log.gz 2023-12-24T20:08:43.369 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41447.log 2023-12-24T20:08:43.370 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41447.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41447.log.gz 2023-12-24T20:08:43.370 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68870.log 2023-12-24T20:08:43.370 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74368.log 2023-12-24T20:08:43.372 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68870.log: /var/log/ceph/ceph-client.admin.74368.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68870.log.gz 2023-12-24T20:08:43.372 INFO:teuthology.orchestra.run.smithi061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74368.log.gz 2023-12-24T20:08:43.372 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-24T20:08:43.375 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph.log: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-24T20:08:43.375 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66603.log 2023-12-24T20:08:43.375 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51224.log 2023-12-24T20:08:43.377 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66603.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66603.log.gz 2023-12-24T20:08:43.377 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.51224.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51224.log.gz 2023-12-24T20:08:43.377 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65175.log 2023-12-24T20:08:43.378 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65175.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65175.log.gz 2023-12-24T20:08:43.378 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69208.log 2023-12-24T20:08:43.378 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66557.log 2023-12-24T20:08:43.379 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69208.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69208.log.gz 2023-12-24T20:08:43.379 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66557.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66557.log.gz 2023-12-24T20:08:43.380 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49565.log 2023-12-24T20:08:43.380 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49565.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49565.log.gz 2023-12-24T20:08:43.381 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56638.log 2023-12-24T20:08:43.389 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57207.log 2023-12-24T20:08:43.390 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56638.log: /var/log/ceph/ceph-client.admin.57207.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56638.log.gz 2023-12-24T20:08:43.390 INFO:teuthology.orchestra.run.smithi061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57207.log.gz 2023-12-24T20:08:43.390 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58226.log 2023-12-24T20:08:43.391 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58226.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58226.log.gz 2023-12-24T20:08:43.391 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42518.log 2023-12-24T20:08:43.392 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42518.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42518.log.gz 2023-12-24T20:08:43.392 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43517.log 2023-12-24T20:08:43.393 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43517.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43517.log.gz 2023-12-24T20:08:43.393 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63336.log 2023-12-24T20:08:43.394 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63336.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63336.log.gz 2023-12-24T20:08:43.394 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66719.log 2023-12-24T20:08:43.395 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66719.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66719.log.gz 2023-12-24T20:08:43.395 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58889.log 2023-12-24T20:08:43.396 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61769.log 2023-12-24T20:08:43.397 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58889.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58889.log.gz 2023-12-24T20:08:43.397 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61769.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61769.log.gz 2023-12-24T20:08:43.397 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73822.log 2023-12-24T20:08:43.398 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.73822.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73822.log.gz 2023-12-24T20:08:43.398 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55500.log 2023-12-24T20:08:43.398 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41907.log 2023-12-24T20:08:43.399 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55500.log: /var/log/ceph/ceph-client.admin.41907.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55500.log.gz 2023-12-24T20:08:43.400 INFO:teuthology.orchestra.run.smithi061.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41907.log.gz 2023-12-24T20:08:43.400 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72724.log 2023-12-24T20:08:43.400 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72724.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72724.log.gz 2023-12-24T20:08:43.400 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-24T20:08:43.405 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77768.log 2023-12-24T20:08:43.406 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77768.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77768.log.gz 2023-12-24T20:08:43.410 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50762.log 2023-12-24T20:08:43.411 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50762.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50762.log.gz 2023-12-24T20:08:43.411 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78278.log 2023-12-24T20:08:43.412 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78278.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78278.log.gz 2023-12-24T20:08:43.412 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51178.log 2023-12-24T20:08:43.413 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.51178.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51178.log.gz 2023-12-24T20:08:43.413 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70299.log 2023-12-24T20:08:43.424 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.70299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42919.log 2023-12-24T20:08:43.438 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42919.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42919.log.gz 2023-12-24T20:08:43.438 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54586.log 2023-12-24T20:08:43.442 INFO:teuthology.orchestra.run.smithi061.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.70299.log.gz 2023-12-24T20:08:43.444 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54586.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54586.log.gz 2023-12-24T20:08:43.444 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58751.log 2023-12-24T20:08:43.444 INFO:teuthology.orchestra.run.smithi133.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-24T20:08:43.446 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58751.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58751.log.gz 2023-12-24T20:08:43.446 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60068.log 2023-12-24T20:08:43.451 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.60068.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60068.log.gz 2023-12-24T20:08:43.451 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41493.log 2023-12-24T20:08:43.452 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41493.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41493.log.gz 2023-12-24T20:08:43.452 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43563.log 2023-12-24T20:08:43.454 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43563.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43563.log.gz 2023-12-24T20:08:43.454 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71128.log 2023-12-24T20:08:43.455 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71128.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71128.log.gz 2023-12-24T20:08:43.455 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47151.log 2023-12-24T20:08:43.457 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47151.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47151.log.gz 2023-12-24T20:08:43.457 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-24T20:08:43.462 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61953.log 2023-12-24T20:08:43.482 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61953.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61953.log.gz 2023-12-24T20:08:43.482 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66038.log 2023-12-24T20:08:43.482 INFO:teuthology.orchestra.run.smithi061.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-24T20:08:43.482 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66038.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66038.log.gz 2023-12-24T20:08:43.482 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65470.log 2023-12-24T20:08:43.484 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65470.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65470.log.gz 2023-12-24T20:08:43.484 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57253.log 2023-12-24T20:08:43.485 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.57253.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57253.log.gz 2023-12-24T20:08:43.485 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43195.log 2023-12-24T20:08:43.489 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43195.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43195.log.gz 2023-12-24T20:08:43.489 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78692.log 2023-12-24T20:08:43.489 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78692.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78692.log.gz 2023-12-24T20:08:43.489 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75723.log 2023-12-24T20:08:43.490 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75723.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.75723.log.gz 2023-12-24T20:08:43.490 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46469.log 2023-12-24T20:08:43.491 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46469.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2023-12-24T20:08:43.491 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41723.log 2023-12-24T20:08:43.492 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41723.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41723.log.gz 2023-12-24T20:08:43.492 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44384.log 2023-12-24T20:08:43.493 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.44384.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44384.log.gz 2023-12-24T20:08:43.493 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51040.log 2023-12-24T20:08:43.494 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.51040.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51040.log.gz 2023-12-24T20:08:43.494 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72287.log 2023-12-24T20:08:43.496 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72287.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72287.log.gz 2023-12-24T20:08:43.496 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61288.log 2023-12-24T20:08:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61288.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61288.log.gz 2023-12-24T20:08:43.497 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58797.log 2023-12-24T20:08:43.498 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58797.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58797.log.gz 2023-12-24T20:08:43.498 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58548.log 2023-12-24T20:08:43.499 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58548.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58548.log.gz 2023-12-24T20:08:43.499 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46561.log 2023-12-24T20:08:43.500 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46561.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46561.log.gz 2023-12-24T20:08:43.501 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51837.log 2023-12-24T20:08:43.502 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.51837.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51837.log.gz 2023-12-24T20:08:43.502 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65378.log 2023-12-24T20:08:43.503 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65378.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65378.log.gz 2023-12-24T20:08:43.503 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62638.log 2023-12-24T20:08:43.504 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62638.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62638.log.gz 2023-12-24T20:08:43.504 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47381.log 2023-12-24T20:08:43.505 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47381.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47381.log.gz 2023-12-24T20:08:43.505 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46377.log 2023-12-24T20:08:43.507 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46377.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46377.log.gz 2023-12-24T20:08:43.507 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43011.log 2023-12-24T20:08:43.508 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43011.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43011.log.gz 2023-12-24T20:08:43.508 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49952.log 2023-12-24T20:08:43.509 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49952.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49952.log.gz 2023-12-24T20:08:43.509 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54332.log 2023-12-24T20:08:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54332.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54332.log.gz 2023-12-24T20:08:43.510 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62340.log 2023-12-24T20:08:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62340.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62340.log.gz 2023-12-24T20:08:43.511 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47483.log 2023-12-24T20:08:43.512 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47483.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47483.log.gz 2023-12-24T20:08:43.513 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56117.log 2023-12-24T20:08:43.514 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56117.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56117.log.gz 2023-12-24T20:08:43.514 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64315.log 2023-12-24T20:08:43.515 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64315.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64315.log.gz 2023-12-24T20:08:43.515 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69542.log 2023-12-24T20:08:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69542.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69542.log.gz 2023-12-24T20:08:43.516 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49427.log 2023-12-24T20:08:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49427.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49427.log.gz 2023-12-24T20:08:43.517 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65946.log 2023-12-24T20:08:43.519 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65946.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65946.log.gz 2023-12-24T20:08:43.519 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53063.log 2023-12-24T20:08:43.520 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53063.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53063.log.gz 2023-12-24T20:08:43.520 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59631.log 2023-12-24T20:08:43.521 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59631.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59631.log.gz 2023-12-24T20:08:43.521 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45739.log 2023-12-24T20:08:43.522 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45739.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45739.log.gz 2023-12-24T20:08:43.522 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75677.log 2023-12-24T20:08:43.524 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75677.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75677.log.gz 2023-12-24T20:08:43.524 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74460.log 2023-12-24T20:08:43.525 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74460.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74460.log.gz 2023-12-24T20:08:43.525 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61999.log 2023-12-24T20:08:43.526 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61999.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61999.log.gz 2023-12-24T20:08:43.526 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74073.log 2023-12-24T20:08:43.527 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74073.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74073.log.gz 2023-12-24T20:08:43.527 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66419.log 2023-12-24T20:08:43.537 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66419.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66419.log.gz 2023-12-24T20:08:43.537 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53404.log 2023-12-24T20:08:43.538 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53404.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53404.log.gz 2023-12-24T20:08:43.538 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54240.log 2023-12-24T20:08:43.539 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54240.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54240.log.gz 2023-12-24T20:08:43.539 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51132.log 2023-12-24T20:08:43.541 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.51132.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51132.log.gz 2023-12-24T20:08:43.541 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67730.log 2023-12-24T20:08:43.542 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67730.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67730.log.gz 2023-12-24T20:08:43.542 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65424.log 2023-12-24T20:08:43.543 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65424.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65424.log.gz 2023-12-24T20:08:43.543 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49519.log 2023-12-24T20:08:43.544 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49519.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49519.log.gz 2023-12-24T20:08:43.544 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41539.log 2023-12-24T20:08:43.546 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41539.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41539.log.gz 2023-12-24T20:08:43.546 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61861.log 2023-12-24T20:08:43.549 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61861.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61861.log.gz 2023-12-24T20:08:43.549 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48455.log 2023-12-24T20:08:43.550 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.48455.log: 94.4% -- replaced with /var/log/ceph/ceph-client.0.54903.log.gz 2023-12-24T20:08:43.550 INFO:teuthology.orchestra.run.smithi061.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.48455.log.gz 2023-12-24T20:08:43.551 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71036.log 2023-12-24T20:08:43.552 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-24T20:08:43.552 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71036.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71036.log.gz 2023-12-24T20:08:43.559 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59435.log 2023-12-24T20:08:43.577 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59435.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59435.log.gz 2023-12-24T20:08:43.578 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68732.log 2023-12-24T20:08:43.589 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68732.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68732.log.gz 2023-12-24T20:08:43.589 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73453.log 2023-12-24T20:08:43.590 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.73453.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73453.log.gz 2023-12-24T20:08:43.590 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77195.log 2023-12-24T20:08:43.592 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77195.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.77195.log.gz 2023-12-24T20:08:43.592 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46745.log 2023-12-24T20:08:43.592 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46745.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46745.log.gz 2023-12-24T20:08:43.593 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58364.log 2023-12-24T20:08:43.594 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58364.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58364.log.gz 2023-12-24T20:08:43.594 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76110.log 2023-12-24T20:08:43.594 INFO:teuthology.orchestra.run.smithi061.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.51612.log.gz 2023-12-24T20:08:43.596 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.76110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46699.log 2023-12-24T20:08:43.599 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46699.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46699.log.gz 2023-12-24T20:08:43.599 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44244.log 2023-12-24T20:08:43.601 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.44244.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.44244.log.gz 2023-12-24T20:08:43.601 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52879.log 2023-12-24T20:08:43.602 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52879.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52879.log.gz 2023-12-24T20:08:43.603 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66327.log 2023-12-24T20:08:43.604 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66327.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66327.log.gz 2023-12-24T20:08:43.604 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45923.log 2023-12-24T20:08:43.605 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45923.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45923.log.gz 2023-12-24T20:08:43.605 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40830.log 2023-12-24T20:08:43.606 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.40830.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40830.log.gz 2023-12-24T20:08:43.606 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77149.log 2023-12-24T20:08:43.606 INFO:teuthology.orchestra.run.smithi133.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-24T20:08:43.607 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77149.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77149.log.gz 2023-12-24T20:08:43.607 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78922.log 2023-12-24T20:08:43.608 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-24T20:08:43.608 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78922.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78922.log.gz 2023-12-24T20:08:43.608 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75401.log 2023-12-24T20:08:43.610 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75401.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75401.log.gz 2023-12-24T20:08:43.610 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60865.log 2023-12-24T20:08:43.611 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.60865.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60865.log.gz 2023-12-24T20:08:43.611 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52268.log 2023-12-24T20:08:43.612 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52268.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52268.log.gz 2023-12-24T20:08:43.612 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52130.log 2023-12-24T20:08:43.613 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52130.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52130.log.gz 2023-12-24T20:08:43.613 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49749.log 2023-12-24T20:08:43.614 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49749.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49749.log.gz 2023-12-24T20:08:43.614 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53634.log 2023-12-24T20:08:43.615 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53634.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53634.log.gz 2023-12-24T20:08:43.616 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77287.log 2023-12-24T20:08:43.617 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77287.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77287.log.gz 2023-12-24T20:08:43.617 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71358.log 2023-12-24T20:08:43.618 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71358.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71358.log.gz 2023-12-24T20:08:43.618 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45509.log 2023-12-24T20:08:43.619 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45509.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45509.log.gz 2023-12-24T20:08:43.619 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56071.log 2023-12-24T20:08:43.620 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56071.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56071.log.gz 2023-12-24T20:08:43.620 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47725.log 2023-12-24T20:08:43.622 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47725.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47725.log.gz 2023-12-24T20:08:43.622 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65900.log 2023-12-24T20:08:43.623 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65900.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65900.log.gz 2023-12-24T20:08:43.623 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41953.log 2023-12-24T20:08:43.624 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41953.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41953.log.gz 2023-12-24T20:08:43.624 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63150.log 2023-12-24T20:08:43.625 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63150.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63150.log.gz 2023-12-24T20:08:43.625 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68343.log 2023-12-24T20:08:43.626 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68343.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68343.log.gz 2023-12-24T20:08:43.626 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64540.log 2023-12-24T20:08:43.628 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64540.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64540.log.gz 2023-12-24T20:08:43.628 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45785.log 2023-12-24T20:08:43.629 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45785.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45785.log.gz 2023-12-24T20:08:43.629 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78416.log 2023-12-24T20:08:43.630 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78416.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.78416.log.gz 2023-12-24T20:08:43.630 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40390.log 2023-12-24T20:08:43.631 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.40390.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40390.log.gz 2023-12-24T20:08:43.632 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41585.log 2023-12-24T20:08:43.633 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41585.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41585.log.gz 2023-12-24T20:08:43.633 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52381.log 2023-12-24T20:08:43.634 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52381.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52381.log.gz 2023-12-24T20:08:43.634 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54054.log 2023-12-24T20:08:43.635 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54054.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54054.log.gz 2023-12-24T20:08:43.635 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45555.log 2023-12-24T20:08:43.636 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45555.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45555.log.gz 2023-12-24T20:08:43.636 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52314.log 2023-12-24T20:08:43.637 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52314.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52314.log.gz 2023-12-24T20:08:43.638 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46653.log 2023-12-24T20:08:43.639 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46653.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46653.log.gz 2023-12-24T20:08:43.639 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45877.log 2023-12-24T20:08:43.640 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45877.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45877.log.gz 2023-12-24T20:08:43.640 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48635.log 2023-12-24T20:08:43.641 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.48635.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48635.log.gz 2023-12-24T20:08:43.641 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57069.log 2023-12-24T20:08:43.642 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.57069.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57069.log.gz 2023-12-24T20:08:43.642 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68067.log 2023-12-24T20:08:43.644 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68067.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68067.log.gz 2023-12-24T20:08:43.644 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76996.log 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76996.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76996.log.gz 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65562.log 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65562.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65562.log.gz 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63290.log 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63290.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63290.log.gz 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42781.log 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.0.76110.log.gz 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63590.log 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42781.log.gz 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63590.log: /var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63590.log.gz 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74027.log 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74027.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74027.log.gz 2023-12-24T20:08:43.653 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41999.log 2023-12-24T20:08:43.654 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41999.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41999.log.gz 2023-12-24T20:08:43.654 INFO:teuthology.orchestra.run.smithi061.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-24T20:08:43.654 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72494.log 2023-12-24T20:08:43.654 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71469.log 2023-12-24T20:08:43.654 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72494.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72494.log.gz 2023-12-24T20:08:43.655 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67262.log 2023-12-24T20:08:43.655 INFO:teuthology.orchestra.run.smithi061.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71469.log.gz 2023-12-24T20:08:43.655 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76950.log 2023-12-24T20:08:43.655 INFO:teuthology.orchestra.run.smithi061.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67262.log.gz 2023-12-24T20:08:43.655 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45324.log 2023-12-24T20:08:43.656 INFO:teuthology.orchestra.run.smithi061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76950.log.gz 2023-12-24T20:08:43.656 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62137.log 2023-12-24T20:08:43.657 INFO:teuthology.orchestra.run.smithi061.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45324.log.gz 2023-12-24T20:08:43.657 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70944.log 2023-12-24T20:08:43.658 INFO:teuthology.orchestra.run.smithi061.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62137.log.gz 2023-12-24T20:08:43.658 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.70944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72333.log 2023-12-24T20:08:43.658 INFO:teuthology.orchestra.run.smithi061.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70944.log.gz 2023-12-24T20:08:43.658 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2023-12-24T20:08:43.659 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72333.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72333.log.gz 2023-12-24T20:08:43.659 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47197.log 2023-12-24T20:08:43.660 INFO:teuthology.orchestra.run.smithi061.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2023-12-24T20:08:43.660 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62386.log 2023-12-24T20:08:43.660 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47197.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47197.log.gz 2023-12-24T20:08:43.661 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56324.log 2023-12-24T20:08:43.661 INFO:teuthology.orchestra.run.smithi061.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62386.log.gz 2023-12-24T20:08:43.661 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75793.log 2023-12-24T20:08:43.662 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56324.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56324.log.gz 2023-12-24T20:08:43.662 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78324.log 2023-12-24T20:08:43.662 INFO:teuthology.orchestra.run.smithi061.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75793.log.gz 2023-12-24T20:08:43.663 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43675.log 2023-12-24T20:08:43.664 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78324.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78324.log.gz 2023-12-24T20:08:43.664 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41309.log 2023-12-24T20:08:43.664 INFO:teuthology.orchestra.run.smithi061.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43675.log.gz 2023-12-24T20:08:43.664 INFO:teuthology.orchestra.run.smithi061.stderr:gzip /var/log/ceph/ceph-client.admin.41309.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.78048.log 2023-12-24T20:08:43.665 INFO:teuthology.orchestra.run.smithi061.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41309.log.gz 2023-12-24T20:08:43.665 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65129.log 2023-12-24T20:08:43.666 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78048.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78048.log.gz 2023-12-24T20:08:43.666 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61501.log 2023-12-24T20:08:43.666 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65129.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65129.log.gz 2023-12-24T20:08:43.667 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61501.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61501.log.gz 2023-12-24T20:08:43.667 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69116.log 2023-12-24T20:08:43.668 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69116.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69116.log.gz 2023-12-24T20:08:43.668 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52018.log 2023-12-24T20:08:43.669 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52018.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52018.log.gz 2023-12-24T20:08:43.669 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55546.log 2023-12-24T20:08:43.670 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55546.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55546.log.gz 2023-12-24T20:08:43.670 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75539.log 2023-12-24T20:08:43.671 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75539.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75539.log.gz 2023-12-24T20:08:43.671 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78002.log 2023-12-24T20:08:43.672 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78002.log.gz 2023-12-24T20:08:43.672 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63104.log 2023-12-24T20:08:43.672 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63104.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63104.log.gz 2023-12-24T20:08:43.672 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62091.log 2023-12-24T20:08:43.673 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62091.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62091.log.gz 2023-12-24T20:08:43.673 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65678.log 2023-12-24T20:08:43.674 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65678.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65678.log.gz 2023-12-24T20:08:43.674 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71867.log 2023-12-24T20:08:43.675 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71867.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71867.log.gz 2023-12-24T20:08:43.675 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54470.log 2023-12-24T20:08:43.676 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54470.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54470.log.gz 2023-12-24T20:08:43.676 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58456.log 2023-12-24T20:08:43.677 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58456.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58456.log.gz 2023-12-24T20:08:43.677 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64991.log 2023-12-24T20:08:43.678 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64991.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64991.log.gz 2023-12-24T20:08:43.678 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56732.log 2023-12-24T20:08:43.678 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74985.log 2023-12-24T20:08:43.679 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56732.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56732.log.gz 2023-12-24T20:08:43.680 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74985.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74985.log.gz 2023-12-24T20:08:43.680 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78646.log 2023-12-24T20:08:43.680 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77814.log 2023-12-24T20:08:43.681 INFO:teuthology.orchestra.run.smithi061.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78646.log.gz 2023-12-24T20:08:43.682 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77814.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77814.log.gz 2023-12-24T20:08:43.682 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71953.log 2023-12-24T20:08:43.682 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71953.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71953.log.gz 2023-12-24T20:08:43.682 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56684.log 2023-12-24T20:08:43.683 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56684.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56684.log.gz 2023-12-24T20:08:43.683 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47863.log 2023-12-24T20:08:43.684 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47863.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47863.log.gz 2023-12-24T20:08:43.684 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68778.log 2023-12-24T20:08:43.685 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68778.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68778.log.gz 2023-12-24T20:08:43.685 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66134.log 2023-12-24T20:08:43.686 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59531.log 2023-12-24T20:08:43.686 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66134.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66134.log.gz 2023-12-24T20:08:43.687 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59531.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59531.log.gz 2023-12-24T20:08:43.687 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59251.log 2023-12-24T20:08:43.688 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59251.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59251.log.gz 2023-12-24T20:08:43.688 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55776.log 2023-12-24T20:08:43.689 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55776.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55776.log.gz 2023-12-24T20:08:43.689 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62478.log 2023-12-24T20:08:43.690 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62478.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62478.log.gz 2023-12-24T20:08:43.690 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50160.log 2023-12-24T20:08:43.691 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50160.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50160.log.gz 2023-12-24T20:08:43.691 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2023-12-24T20:08:43.692 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47955.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2023-12-24T20:08:43.692 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55979.log 2023-12-24T20:08:43.692 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55979.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55979.log.gz 2023-12-24T20:08:43.692 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46966.log 2023-12-24T20:08:43.697 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46966.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46966.log.gz 2023-12-24T20:08:43.697 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48047.log 2023-12-24T20:08:43.697 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.48047.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48047.log.gz 2023-12-24T20:08:43.698 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60640.log 2023-12-24T20:08:43.698 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.60640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73383.log 2023-12-24T20:08:43.698 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.73383.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73383.log.gz 2023-12-24T20:08:43.698 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49067.log 2023-12-24T20:08:43.707 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49067.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49067.log.gz 2023-12-24T20:08:43.707 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63244.log 2023-12-24T20:08:43.708 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63244.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63244.log.gz 2023-12-24T20:08:43.708 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47243.log 2023-12-24T20:08:43.709 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47243.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47243.log.gz 2023-12-24T20:08:43.709 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50545.log 2023-12-24T20:08:43.710 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50545.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50545.log.gz 2023-12-24T20:08:43.710 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50948.log 2023-12-24T20:08:43.711 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50948.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50948.log.gz 2023-12-24T20:08:43.711 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75493.log 2023-12-24T20:08:43.713 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75493.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75493.log.gz 2023-12-24T20:08:43.713 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51294.log 2023-12-24T20:08:43.714 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.51294.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51294.log.gz 2023-12-24T20:08:43.714 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63382.log 2023-12-24T20:08:43.715 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63382.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63382.log.gz 2023-12-24T20:08:43.715 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42200.log 2023-12-24T20:08:43.716 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42200.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42200.log.gz 2023-12-24T20:08:43.716 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61815.log 2023-12-24T20:08:43.717 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61815.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61815.log.gz 2023-12-24T20:08:43.717 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63198.log 2023-12-24T20:08:43.719 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63198.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63198.log.gz 2023-12-24T20:08:43.719 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56025.log 2023-12-24T20:08:43.720 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56025.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56025.log.gz 2023-12-24T20:08:43.720 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47909.log 2023-12-24T20:08:43.721 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47909.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47909.log.gz 2023-12-24T20:08:43.721 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63004.log 2023-12-24T20:08:43.722 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63004.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63004.log.gz 2023-12-24T20:08:43.722 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72540.log 2023-12-24T20:08:43.723 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72540.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72540.log.gz 2023-12-24T20:08:43.724 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57912.log 2023-12-24T20:08:43.725 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.57912.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57912.log.gz 2023-12-24T20:08:43.725 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62201.log 2023-12-24T20:08:43.726 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62201.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62201.log.gz 2023-12-24T20:08:43.726 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51972.log 2023-12-24T20:08:43.727 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.51972.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51972.log.gz 2023-12-24T20:08:43.727 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78508.log 2023-12-24T20:08:43.728 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78508.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78508.log.gz 2023-12-24T20:08:43.728 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56926.log 2023-12-24T20:08:43.730 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56926.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56926.log.gz 2023-12-24T20:08:43.730 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53858.log 2023-12-24T20:08:43.731 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53858.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53858.log.gz 2023-12-24T20:08:43.731 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71561.log 2023-12-24T20:08:43.732 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71561.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71561.log.gz 2023-12-24T20:08:43.732 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2023-12-24T20:08:43.733 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46239.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2023-12-24T20:08:43.733 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65992.log 2023-12-24T20:08:43.734 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65992.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.65992.log.gz 2023-12-24T20:08:43.735 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57686.log 2023-12-24T20:08:43.746 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.57686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50407.log 2023-12-24T20:08:43.757 INFO:teuthology.orchestra.run.smithi061.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-24T20:08:43.758 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50407.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50407.log.gz 2023-12-24T20:08:43.758 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76560.log 2023-12-24T20:08:43.760 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76560.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76560.log.gz 2023-12-24T20:08:43.764 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76382.log 2023-12-24T20:08:43.770 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76382.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76382.log.gz 2023-12-24T20:08:43.770 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50994.log 2023-12-24T20:08:43.777 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50994.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50994.log.gz 2023-12-24T20:08:43.777 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73914.log 2023-12-24T20:08:43.791 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.73914.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73914.log.gz 2023-12-24T20:08:43.791 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74799.log 2023-12-24T20:08:43.792 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74799.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74799.log.gz 2023-12-24T20:08:43.792 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69030.log 2023-12-24T20:08:43.793 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69030.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69030.log.gz 2023-12-24T20:08:43.794 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59955.log 2023-12-24T20:08:43.794 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59955.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59955.log.gz 2023-12-24T20:08:43.795 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62248.log 2023-12-24T20:08:43.796 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62248.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62248.log.gz 2023-12-24T20:08:43.796 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53904.log 2023-12-24T20:08:43.799 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53904.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53904.log.gz 2023-12-24T20:08:43.799 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68205.log 2023-12-24T20:08:43.800 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68205.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68205.log.gz 2023-12-24T20:08:43.800 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78094.log 2023-12-24T20:08:43.801 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78094.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.78094.log.gz 2023-12-24T20:08:43.801 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67486.log 2023-12-24T20:08:43.802 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67486.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67486.log.gz 2023-12-24T20:08:43.802 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76672.log 2023-12-24T20:08:43.803 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76672.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76672.log.gz 2023-12-24T20:08:43.803 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72045.log 2023-12-24T20:08:43.805 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72045.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.72045.log.gz 2023-12-24T20:08:43.805 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45085.log 2023-12-24T20:08:43.806 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45085.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45085.log.gz 2023-12-24T20:08:43.806 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69820.log 2023-12-24T20:08:43.807 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69820.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69820.log.gz 2023-12-24T20:08:43.807 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70990.log 2023-12-24T20:08:43.809 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.70990.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70990.log.gz 2023-12-24T20:08:43.809 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74891.log 2023-12-24T20:08:43.810 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74891.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74891.log.gz 2023-12-24T20:08:43.810 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74322.log 2023-12-24T20:08:43.811 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74322.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74322.log.gz 2023-12-24T20:08:43.811 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75217.log 2023-12-24T20:08:43.812 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75217.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.75217.log.gz 2023-12-24T20:08:43.812 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68594.log 2023-12-24T20:08:43.813 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68594.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68594.log.gz 2023-12-24T20:08:43.813 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78140.log 2023-12-24T20:08:43.814 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78140.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78140.log.gz 2023-12-24T20:08:43.814 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65608.log 2023-12-24T20:08:43.816 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65608.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65608.log.gz 2023-12-24T20:08:43.816 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53544.log 2023-12-24T20:08:43.817 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53544.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53544.log.gz 2023-12-24T20:08:43.817 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69866.log 2023-12-24T20:08:43.818 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69866.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69866.log.gz 2023-12-24T20:08:43.818 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40641.log 2023-12-24T20:08:43.819 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.40641.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40641.log.gz 2023-12-24T20:08:43.819 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72840.log 2023-12-24T20:08:43.821 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72840.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72840.log.gz 2023-12-24T20:08:43.821 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45232.log 2023-12-24T20:08:43.822 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45232.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45232.log.gz 2023-12-24T20:08:43.822 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42524.log 2023-12-24T20:08:43.823 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42524.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42524.log.gz 2023-12-24T20:08:43.823 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42196.log 2023-12-24T20:08:43.824 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42196.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42196.log.gz 2023-12-24T20:08:43.824 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50591.log 2023-12-24T20:08:43.825 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50591.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50591.log.gz 2023-12-24T20:08:43.825 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71707.log 2023-12-24T20:08:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71707.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71707.log.gz 2023-12-24T20:08:43.827 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72632.log 2023-12-24T20:08:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72632.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72632.log.gz 2023-12-24T20:08:43.828 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66180.log 2023-12-24T20:08:43.829 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66180.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66180.log.gz 2023-12-24T20:08:43.829 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46285.log 2023-12-24T20:08:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46285.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46285.log.gz 2023-12-24T20:08:43.831 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49657.log 2023-12-24T20:08:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49657.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49657.log.gz 2023-12-24T20:08:43.832 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66272.log 2023-12-24T20:08:43.833 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66272.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66272.log.gz 2023-12-24T20:08:43.833 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69982.log 2023-12-24T20:08:43.834 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69982.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69982.log.gz 2023-12-24T20:08:43.834 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52649.log 2023-12-24T20:08:43.835 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52649.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52649.log.gz 2023-12-24T20:08:43.835 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47585.log 2023-12-24T20:08:43.837 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47585.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47585.log.gz 2023-12-24T20:08:43.837 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71653.log 2023-12-24T20:08:43.838 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71653.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71653.log.gz 2023-12-24T20:08:43.838 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76804.log 2023-12-24T20:08:43.839 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76804.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76804.log.gz 2023-12-24T20:08:43.839 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50044.log 2023-12-24T20:08:43.840 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50044.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50044.log.gz 2023-12-24T20:08:43.840 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76718.log 2023-12-24T20:08:43.841 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76718.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76718.log.gz 2023-12-24T20:08:43.842 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73776.log 2023-12-24T20:08:43.843 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.73776.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73776.log.gz 2023-12-24T20:08:43.843 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61046.log 2023-12-24T20:08:43.844 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61046.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61046.log.gz 2023-12-24T20:08:43.844 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59725.log 2023-12-24T20:08:43.845 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59725.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59725.log.gz 2023-12-24T20:08:43.845 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74229.log 2023-12-24T20:08:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74229.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74229.log.gz 2023-12-24T20:08:43.846 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67644.log 2023-12-24T20:08:43.848 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67644.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67644.log.gz 2023-12-24T20:08:43.848 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46193.log 2023-12-24T20:08:43.849 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46193.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46193.log.gz 2023-12-24T20:08:43.849 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78784.log 2023-12-24T20:08:43.850 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78784.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78784.log.gz 2023-12-24T20:08:43.850 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55129.log 2023-12-24T20:08:43.851 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55129.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55129.log.gz 2023-12-24T20:08:43.851 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63428.log 2023-12-24T20:08:43.852 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.63428.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63428.log.gz 2023-12-24T20:08:43.852 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50902.log 2023-12-24T20:08:43.854 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50902.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50902.log.gz 2023-12-24T20:08:43.854 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60114.log 2023-12-24T20:08:43.855 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.60114.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60114.log.gz 2023-12-24T20:08:43.855 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55822.log 2023-12-24T20:08:43.856 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55822.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55822.log.gz 2023-12-24T20:08:43.856 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38330.log 2023-12-24T20:08:43.857 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph.tmp-client.admin.38330.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38330.log.gz 2023-12-24T20:08:43.857 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53810.log 2023-12-24T20:08:43.858 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53810.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53810.log.gz 2023-12-24T20:08:43.858 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66511.log 2023-12-24T20:08:43.860 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66511.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66511.log.gz 2023-12-24T20:08:43.860 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54194.log 2023-12-24T20:08:43.861 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54194.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54194.log.gz 2023-12-24T20:08:43.861 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41815.log 2023-12-24T20:08:43.862 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41815.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41815.log.gz 2023-12-24T20:08:43.862 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55408.log 2023-12-24T20:08:43.863 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55408.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55408.log.gz 2023-12-24T20:08:43.864 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49473.log 2023-12-24T20:08:43.865 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49473.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49473.log.gz 2023-12-24T20:08:43.865 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77379.log 2023-12-24T20:08:43.866 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77379.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77379.log.gz 2023-12-24T20:08:43.866 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67868.log 2023-12-24T20:08:43.867 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67868.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67868.log.gz 2023-12-24T20:08:43.868 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58272.log 2023-12-24T20:08:43.869 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58272.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58272.log.gz 2023-12-24T20:08:43.869 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74414.log 2023-12-24T20:08:43.870 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74414.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74414.log.gz 2023-12-24T20:08:43.870 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72586.log 2023-12-24T20:08:43.871 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72586.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72586.log.gz 2023-12-24T20:08:43.871 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61112.log 2023-12-24T20:08:43.872 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61112.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61112.log.gz 2023-12-24T20:08:43.872 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57866.log 2023-12-24T20:08:43.873 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.57866.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57866.log.gz 2023-12-24T20:08:43.873 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68527.log 2023-12-24T20:08:43.874 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68527.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68527.log.gz 2023-12-24T20:08:43.874 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50808.log 2023-12-24T20:08:43.876 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50808.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50808.log.gz 2023-12-24T20:08:43.876 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67914.log 2023-12-24T20:08:43.877 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67914.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67914.log.gz 2023-12-24T20:08:43.877 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74937.log 2023-12-24T20:08:43.878 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74937.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74937.log.gz 2023-12-24T20:08:43.878 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41261.log 2023-12-24T20:08:43.879 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41261.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41261.log.gz 2023-12-24T20:08:43.880 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43149.log 2023-12-24T20:08:43.881 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43149.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43149.log.gz 2023-12-24T20:08:43.881 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51791.log 2023-12-24T20:08:43.882 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.51791.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51791.log.gz 2023-12-24T20:08:43.882 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46423.log 2023-12-24T20:08:43.883 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46423.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46423.log.gz 2023-12-24T20:08:43.883 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78968.log 2023-12-24T20:08:43.884 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78968.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78968.log.gz 2023-12-24T20:08:43.884 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77609.log 2023-12-24T20:08:43.886 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77609.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77609.log.gz 2023-12-24T20:08:43.886 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52787.log 2023-12-24T20:08:43.887 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52787.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52787.log.gz 2023-12-24T20:08:43.887 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43057.log 2023-12-24T20:08:43.888 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43057.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43057.log.gz 2023-12-24T20:08:43.888 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64807.log 2023-12-24T20:08:43.890 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64807.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64807.log.gz 2023-12-24T20:08:43.890 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53718.log 2023-12-24T20:08:43.891 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53718.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53718.log.gz 2023-12-24T20:08:43.891 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47531.log 2023-12-24T20:08:43.892 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47531.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47531.log.gz 2023-12-24T20:08:43.892 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54000.log 2023-12-24T20:08:43.893 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.54000.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54000.log.gz 2023-12-24T20:08:43.893 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2023-12-24T20:08:43.894 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43287.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2023-12-24T20:08:43.894 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59909.log 2023-12-24T20:08:43.895 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59909.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59909.log.gz 2023-12-24T20:08:43.896 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47817.log 2023-12-24T20:08:43.897 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47817.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47817.log.gz 2023-12-24T20:08:43.897 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41861.log 2023-12-24T20:08:43.902 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41861.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41861.log.gz 2023-12-24T20:08:43.902 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42522.log 2023-12-24T20:08:43.902 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42522.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42522.log.gz 2023-12-24T20:08:43.902 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45969.log 2023-12-24T20:08:43.902 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45969.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45969.log.gz 2023-12-24T20:08:43.902 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69162.log 2023-12-24T20:08:43.902 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69162.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69162.log.gz 2023-12-24T20:08:43.902 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65331.log 2023-12-24T20:08:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65331.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65331.log.gz 2023-12-24T20:08:43.903 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55684.log 2023-12-24T20:08:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.55684.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55684.log.gz 2023-12-24T20:08:43.904 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68481.log 2023-12-24T20:08:43.905 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68481.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68481.log.gz 2023-12-24T20:08:43.905 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58843.log 2023-12-24T20:08:43.906 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58843.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58843.log.gz 2023-12-24T20:08:43.907 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74667.log 2023-12-24T20:08:43.907 INFO:teuthology.orchestra.run.smithi133.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-24T20:08:43.908 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.74667.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74667.log.gz 2023-12-24T20:08:43.908 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61409.log 2023-12-24T20:08:43.909 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61409.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61409.log.gz 2023-12-24T20:08:43.909 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64899.log 2023-12-24T20:08:43.910 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64899.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64899.log.gz 2023-12-24T20:08:43.910 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77722.log 2023-12-24T20:08:43.911 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77722.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77722.log.gz 2023-12-24T20:08:43.911 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41146.log 2023-12-24T20:08:43.912 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41146.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41146.log.gz 2023-12-24T20:08:43.913 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59297.log 2023-12-24T20:08:43.914 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59297.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59297.log.gz 2023-12-24T20:08:43.914 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47771.log 2023-12-24T20:08:43.915 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.47771.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47771.log.gz 2023-12-24T20:08:43.915 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66465.log 2023-12-24T20:08:43.916 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66465.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66465.log.gz 2023-12-24T20:08:43.916 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58640.log 2023-12-24T20:08:43.917 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58640.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58640.log.gz 2023-12-24T20:08:43.917 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45278.log 2023-12-24T20:08:43.919 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45278.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45278.log.gz 2023-12-24T20:08:43.919 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63907.log 2023-12-24T20:08:43.922 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.0.63907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41100.log 2023-12-24T20:08:43.922 INFO:teuthology.orchestra.run.smithi061.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.63907.log.gz 2023-12-24T20:08:43.924 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41100.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41100.log.gz 2023-12-24T20:08:43.924 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73730.log 2023-12-24T20:08:43.925 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.73730.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73730.log.gz 2023-12-24T20:08:43.925 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78462.log 2023-12-24T20:08:43.926 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78462.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78462.log.gz 2023-12-24T20:08:43.927 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60322.log 2023-12-24T20:08:43.928 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.60322.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60322.log.gz 2023-12-24T20:08:43.928 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-24T20:08:43.938 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42574.log 2023-12-24T20:08:43.939 INFO:teuthology.orchestra.run.smithi061.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-24T20:08:43.940 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42574.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42574.log.gz 2023-12-24T20:08:43.940 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50361.log 2023-12-24T20:08:43.941 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50361.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50361.log.gz 2023-12-24T20:08:43.941 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41677.log 2023-12-24T20:08:43.942 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41677.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41677.log.gz 2023-12-24T20:08:43.943 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68435.log 2023-12-24T20:08:43.944 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68435.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68435.log.gz 2023-12-24T20:08:43.944 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62908.log 2023-12-24T20:08:43.945 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62908.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62908.log.gz 2023-12-24T20:08:43.946 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53017.log 2023-12-24T20:08:43.946 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53017.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53017.log.gz 2023-12-24T20:08:43.946 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65854.log 2023-12-24T20:08:43.947 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65854.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65854.log.gz 2023-12-24T20:08:43.947 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67440.log 2023-12-24T20:08:43.948 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67440.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67440.log.gz 2023-12-24T20:08:43.948 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71312.log 2023-12-24T20:08:43.950 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71312.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71312.log.gz 2023-12-24T20:08:43.950 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42523.log 2023-12-24T20:08:43.951 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42523.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42523.log.gz 2023-12-24T20:08:43.951 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59343.log 2023-12-24T20:08:43.952 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59343.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59343.log.gz 2023-12-24T20:08:43.952 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65037.log 2023-12-24T20:08:43.953 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65037.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65037.log.gz 2023-12-24T20:08:43.953 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64428.log 2023-12-24T20:08:43.955 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64428.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64428.log.gz 2023-12-24T20:08:43.955 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50708.log 2023-12-24T20:08:43.956 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50708.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50708.log.gz 2023-12-24T20:08:43.956 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62045.log 2023-12-24T20:08:43.957 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62045.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62045.log.gz 2023-12-24T20:08:43.957 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52833.log 2023-12-24T20:08:43.959 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52833.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52833.log.gz 2023-12-24T20:08:43.959 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72770.log 2023-12-24T20:08:43.960 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72770.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.72770.log.gz 2023-12-24T20:08:43.960 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46515.log 2023-12-24T20:08:43.962 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46515.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46515.log.gz 2023-12-24T20:08:43.962 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46607.log 2023-12-24T20:08:43.963 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46607.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46607.log.gz 2023-12-24T20:08:43.963 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78232.log 2023-12-24T20:08:43.964 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78232.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78232.log.gz 2023-12-24T20:08:43.964 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69396.log 2023-12-24T20:08:43.965 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69396.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69396.log.gz 2023-12-24T20:08:43.965 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57369.log 2023-12-24T20:08:43.967 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.57369.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57369.log.gz 2023-12-24T20:08:43.967 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65221.log 2023-12-24T20:08:43.968 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65221.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65221.log.gz 2023-12-24T20:08:43.968 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53952.log 2023-12-24T20:08:43.969 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53952.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53952.log.gz 2023-12-24T20:08:43.969 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49335.log 2023-12-24T20:08:43.970 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49335.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49335.log.gz 2023-12-24T20:08:43.970 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59483.log 2023-12-24T20:08:43.971 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59483.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59483.log.gz 2023-12-24T20:08:43.972 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69728.log 2023-12-24T20:08:43.973 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69728.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69728.log.gz 2023-12-24T20:08:43.973 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59005.log 2023-12-24T20:08:43.974 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.59005.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59005.log.gz 2023-12-24T20:08:43.974 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76290.log 2023-12-24T20:08:43.975 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76290.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76290.log.gz 2023-12-24T20:08:43.975 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61677.log 2023-12-24T20:08:43.976 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61677.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61677.log.gz 2023-12-24T20:08:43.976 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56499.log 2023-12-24T20:08:43.977 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56499.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56499.log.gz 2023-12-24T20:08:43.978 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71422.log 2023-12-24T20:08:43.979 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71422.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71422.log.gz 2023-12-24T20:08:43.979 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69590.log 2023-12-24T20:08:43.980 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69590.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69590.log.gz 2023-12-24T20:08:43.980 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61158.log 2023-12-24T20:08:43.981 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61158.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61158.log.gz 2023-12-24T20:08:43.981 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58180.log 2023-12-24T20:08:43.982 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.58180.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58180.log.gz 2023-12-24T20:08:43.982 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48863.log 2023-12-24T20:08:43.984 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.48863.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48863.log.gz 2023-12-24T20:08:43.984 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41631.log 2023-12-24T20:08:43.985 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.41631.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41631.log.gz 2023-12-24T20:08:43.985 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50453.log 2023-12-24T20:08:43.986 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50453.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50453.log.gz 2023-12-24T20:08:43.986 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78186.log 2023-12-24T20:08:43.987 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78186.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78186.log.gz 2023-12-24T20:08:43.987 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65267.log 2023-12-24T20:08:43.988 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.65267.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65267.log.gz 2023-12-24T20:08:43.989 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53109.log 2023-12-24T20:08:43.990 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53109.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53109.log.gz 2023-12-24T20:08:43.990 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52473.log 2023-12-24T20:08:43.991 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52473.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52473.log.gz 2023-12-24T20:08:43.991 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48681.log 2023-12-24T20:08:43.992 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.48681.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48681.log.gz 2023-12-24T20:08:43.992 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69348.log 2023-12-24T20:08:43.993 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69348.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69348.log.gz 2023-12-24T20:08:43.993 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62956.log 2023-12-24T20:08:43.995 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62956.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62956.log.gz 2023-12-24T20:08:43.995 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78876.log 2023-12-24T20:08:43.996 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.78876.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78876.log.gz 2023-12-24T20:08:43.996 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71220.log 2023-12-24T20:08:43.997 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71220.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71220.log.gz 2023-12-24T20:08:43.997 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43379.log 2023-12-24T20:08:43.998 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.43379.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43379.log.gz 2023-12-24T20:08:43.998 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76606.log 2023-12-24T20:08:43.999 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76606.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76606.log.gz 2023-12-24T20:08:43.999 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62816.log 2023-12-24T20:08:44.000 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62816.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62816.log.gz 2023-12-24T20:08:44.001 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72379.log 2023-12-24T20:08:44.002 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72379.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72379.log.gz 2023-12-24T20:08:44.002 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56975.log 2023-12-24T20:08:44.003 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56975.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56975.log.gz 2023-12-24T20:08:44.003 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75585.log 2023-12-24T20:08:44.004 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75585.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.75585.log.gz 2023-12-24T20:08:44.005 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75263.log 2023-12-24T20:08:44.006 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75263.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75263.log.gz 2023-12-24T20:08:44.006 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53173.log 2023-12-24T20:08:44.007 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.53173.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53173.log.gz 2023-12-24T20:08:44.007 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69300.log 2023-12-24T20:08:44.009 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69300.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69300.log.gz 2023-12-24T20:08:44.009 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62862.log 2023-12-24T20:08:44.009 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.62862.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62862.log.gz 2023-12-24T20:08:44.009 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72233.log 2023-12-24T20:08:44.010 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72233.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72233.log.gz 2023-12-24T20:08:44.011 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69636.log 2023-12-24T20:08:44.012 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.69636.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69636.log.gz 2023-12-24T20:08:44.012 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64087.log 2023-12-24T20:08:44.013 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64087.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64087.log.gz 2023-12-24T20:08:44.013 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64133.log 2023-12-24T20:08:44.014 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.64133.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64133.log.gz 2023-12-24T20:08:44.014 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52084.log 2023-12-24T20:08:44.015 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.52084.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52084.log.gz 2023-12-24T20:08:44.015 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77241.log 2023-12-24T20:08:44.016 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.77241.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77241.log.gz 2023-12-24T20:08:44.016 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72091.log 2023-12-24T20:08:44.018 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72091.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72091.log.gz 2023-12-24T20:08:44.018 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49795.log 2023-12-24T20:08:44.019 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.49795.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49795.log.gz 2023-12-24T20:08:44.019 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57161.log 2023-12-24T20:08:44.020 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.57161.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57161.log.gz 2023-12-24T20:08:44.020 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45831.log 2023-12-24T20:08:44.021 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.45831.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45831.log.gz 2023-12-24T20:08:44.021 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42519.log 2023-12-24T20:08:44.022 INFO:teuthology.orchestra.run.smithi133.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-24T20:08:44.023 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42519.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42519.log.gz 2023-12-24T20:08:44.023 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61723.log 2023-12-24T20:08:44.024 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.61723.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61723.log.gz 2023-12-24T20:08:44.024 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68640.log 2023-12-24T20:08:44.025 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68640.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68640.log.gz 2023-12-24T20:08:44.025 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46881.log 2023-12-24T20:08:44.026 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.46881.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46881.log.gz 2023-12-24T20:08:44.026 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42573.log 2023-12-24T20:08:44.027 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.42573.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42573.log.gz 2023-12-24T20:08:44.027 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75033.log 2023-12-24T20:08:44.029 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.75033.log: 95.2% -- replaced with /var/log/ceph/ceph-client.0.60640.log.gz 2023-12-24T20:08:44.029 INFO:teuthology.orchestra.run.smithi061.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75033.log.gz 2023-12-24T20:08:44.029 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66649.log 2023-12-24T20:08:44.030 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.66649.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.66649.log.gz 2023-12-24T20:08:44.030 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50231.log 2023-12-24T20:08:44.031 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71777.log 2023-12-24T20:08:44.031 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.50231.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50231.log.gz 2023-12-24T20:08:44.032 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.71777.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71777.log.gz 2023-12-24T20:08:44.033 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40915.log 2023-12-24T20:08:44.033 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.40915.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40915.log.gz 2023-12-24T20:08:44.034 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76850.log 2023-12-24T20:08:44.035 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.76850.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76850.log.gz 2023-12-24T20:08:44.035 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67598.log 2023-12-24T20:08:44.036 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.67598.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.67598.log.gz 2023-12-24T20:08:44.036 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68159.log 2023-12-24T20:08:44.038 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.68159.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68159.log.gz 2023-12-24T20:08:44.038 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56880.log 2023-12-24T20:08:44.039 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.56880.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56880.log.gz 2023-12-24T20:08:44.039 INFO:teuthology.orchestra.run.smithi061.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72137.log 2023-12-24T20:08:44.040 INFO:teuthology.orchestra.run.smithi061.stderr:/var/log/ceph/ceph-client.admin.72137.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72137.log.gz 2023-12-24T20:08:44.068 INFO:teuthology.orchestra.run.smithi133.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-24T20:08:44.068 INFO:teuthology.orchestra.run.smithi133.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-24T20:08:44.070 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-24T20:08:44.070 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m0.817s 2023-12-24T20:08:44.070 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m3.791s 2023-12-24T20:08:44.070 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m0.151s 2023-12-24T20:08:44.110 INFO:teuthology.orchestra.run.smithi061.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.0.57686.log.gz 2023-12-24T20:08:44.168 INFO:teuthology.orchestra.run.smithi061.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-24T20:08:44.263 INFO:teuthology.orchestra.run.smithi061.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-24T20:08:44.334 INFO:teuthology.orchestra.run.smithi061.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-24T20:08:44.362 INFO:teuthology.orchestra.run.smithi061.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-24T20:08:44.491 INFO:teuthology.orchestra.run.smithi061.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-24T20:08:44.492 INFO:teuthology.orchestra.run.smithi061.stderr: 2023-12-24T20:08:44.493 INFO:teuthology.orchestra.run.smithi061.stderr:real 0m1.264s 2023-12-24T20:08:44.493 INFO:teuthology.orchestra.run.smithi061.stderr:user 0m6.769s 2023-12-24T20:08:44.493 INFO:teuthology.orchestra.run.smithi061.stderr:sys 0m0.587s 2023-12-24T20:08:44.493 INFO:tasks.ceph:Archiving logs... 2023-12-24T20:08:44.493 DEBUG:teuthology.misc:Transferring archived files from smithi061:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456/remote/smithi061/log 2023-12-24T20:08:44.494 DEBUG:teuthology.orchestra.run.smithi061:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-24T20:08:45.757 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456/remote/smithi133/log 2023-12-24T20:08:45.758 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-24T20:08:46.325 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-24T20:08:46.334 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-24T20:08:46.335 DEBUG:teuthology.orchestra.run.smithi061:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-24T20:08:46.337 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-24T20:08:46.434 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-24T20:08:46.445 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-24T20:08:46.446 DEBUG:teuthology.orchestra.run.smithi061:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-24T20:08:46.448 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-24T20:08:46.466 INFO:teuthology.orchestra.run.smithi061.stderr:bash: ntpq: command not found 2023-12-24T20:08:46.466 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2023-12-24T20:08:46.470 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-24T20:08:46.470 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2023-12-24T20:08:46.471 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 63 +671us[ +671us] +/- 80ms 2023-12-24T20:08:46.471 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv02.front.sepia.ceph.com 3 6 377 64 -591us[ -590us] +/- 52ms 2023-12-24T20:08:46.471 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +263us[ +263us] +/- 83ms 2023-12-24T20:08:46.471 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-24T20:08:46.473 INFO:teuthology.orchestra.run.smithi061.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-24T20:08:46.473 INFO:teuthology.orchestra.run.smithi061.stdout:=============================================================================== 2023-12-24T20:08:46.473 INFO:teuthology.orchestra.run.smithi061.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 63 +682us[ +691us] +/- 80ms 2023-12-24T20:08:46.473 INFO:teuthology.orchestra.run.smithi061.stdout:^* hv02.front.sepia.ceph.com 3 6 377 61 -591us[ -582us] +/- 52ms 2023-12-24T20:08:46.473 INFO:teuthology.orchestra.run.smithi061.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +272us[ +272us] +/- 83ms 2023-12-24T20:08:46.473 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-24T20:08:46.473 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-24T20:08:46.483 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-24T20:08:46.484 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-24T20:08:46.512 DEBUG:teuthology.orchestra.run.smithi061:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-24T20:08:46.604 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-24T20:08:46.675 DEBUG:teuthology.orchestra.run.smithi061:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-24T20:08:46.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:08:46.710 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-24T20:08:46.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:08:46.741 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-24T20:08:46.750 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-24T20:08:46.786 INFO:teuthology.task.internal:Duration was 1298.145678 seconds 2023-12-24T20:08:46.787 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-24T20:08:46.821 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-24T20:08:46.822 DEBUG:teuthology.orchestra.run.smithi061:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-24T20:08:46.824 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-24T20:08:46.872 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-24T20:08:46.873 INFO:teuthology.orchestra.run.smithi061.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-24T20:08:47.135 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-24T20:08:47.135 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi061.front.sepia.ceph.com 2023-12-24T20:08:47.135 DEBUG:teuthology.orchestra.run.smithi061:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-24T20:08:47.159 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2023-12-24T20:08:47.159 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-24T20:08:47.180 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-24T20:08:47.180 DEBUG:teuthology.orchestra.run.smithi061:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-24T20:08:47.202 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-24T20:08:47.255 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-24T20:08:47.255 DEBUG:teuthology.orchestra.run.smithi061:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-24T20:08:47.284 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-24T20:08:47.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-24T20:08:47.372 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-24T20:08:47.372 DEBUG:teuthology.orchestra.run.smithi061:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-24T20:08:47.400 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-24T20:08:47.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-24T20:08:47.438 DEBUG:teuthology.orchestra.run.smithi061:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-24T20:08:47.442 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-24T20:08:47.467 INFO:teuthology.orchestra.run.smithi061.stdout:kernel.core_pattern = core 2023-12-24T20:08:47.493 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2023-12-24T20:08:47.507 DEBUG:teuthology.orchestra.run.smithi061:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-24T20:08:47.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:08:47.539 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-24T20:08:47.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-24T20:08:47.564 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-24T20:08:47.574 INFO:teuthology.task.internal:Transferring archived files... 2023-12-24T20:08:47.574 DEBUG:teuthology.misc:Transferring archived files from smithi061:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456/remote/smithi061 2023-12-24T20:08:47.574 DEBUG:teuthology.orchestra.run.smithi061:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-24T20:08:47.617 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456/remote/smithi133 2023-12-24T20:08:47.617 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-24T20:08:47.653 INFO:teuthology.task.internal:Removing archive directory... 2023-12-24T20:08:47.653 DEBUG:teuthology.orchestra.run.smithi061:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-24T20:08:47.655 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-24T20:08:47.704 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-24T20:08:47.715 INFO:teuthology.task.internal:Not uploading archives. 2023-12-24T20:08:47.716 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-24T20:08:47.746 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-24T20:08:47.746 DEBUG:teuthology.orchestra.run.smithi061:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-24T20:08:47.751 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-24T20:08:47.765 INFO:teuthology.orchestra.run.smithi061.stdout: 262157 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 24 20:08 /home/ubuntu/cephtest 2023-12-24T20:08:47.767 INFO:teuthology.orchestra.run.smithi133.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 24 20:08 /home/ubuntu/cephtest 2023-12-24T20:08:47.769 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-24T20:08:47.779 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-24T20:08:47.847 INFO:teuthology.nuke:Checking targets against current locks 2023-12-24T20:08:47.873 DEBUG:teuthology.nuke:shortname: smithi061 2023-12-24T20:08:47.873 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-24T20:08:47.897 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-24 19:41:28.259133', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMKTiZ5La285rjy8lxT50C4HZdGqhb70oICSSBxPGanEXRMwsUk6v4+rc+RciNaqN451D18zfIee11G2zsOiSAk='} 2023-12-24T20:08:47.902 DEBUG:teuthology.nuke:shortname: smithi133 2023-12-24T20:08:47.902 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-24T20:08:47.927 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-24_15:41:15-fs-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7500456', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-24 19:41:28.261071', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNThfGfMMmLySKD43rbOrpUGeIIpUwnVsBwmooAy/5Y68xtPz/UoaPRWfSn2BcWTQNG/SoB5/2WPj7qKElA51ZY='} 2023-12-24T20:08:47.962 INFO:teuthology.orchestra.console.smithi061:Power off 2023-12-24T20:08:47.962 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-24T20:08:47.990 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-12-24T20:08:47.993 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:08:48.015 INFO:teuthology.orchestra.console.smithi133:Power off 2023-12-24T20:08:48.016 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-24T20:08:48.028 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-12-24T20:08:48.042 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-12-24T20:08:48.042 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:08:48.067 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-12-24T20:08:52.029 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:08:52.069 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:08:52.144 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-12-24T20:08:52.188 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-12-24T20:08:56.145 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:08:56.190 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-24T20:08:56.256 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-12-24T20:08:56.300 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-12-24T20:08:56.358 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-12-24T20:08:56.402 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-12-24T20:08:56.507 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1298.1456780433655 failure_reason: '"1703447813.2546344 osd.1 (osd.1) 3 : cluster [WRN] OSD bench result of 215993.357772 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.1. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-12-24T20:08:56.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-24T20:08:56.598 INFO:teuthology.run:FAIL